docker service logs hangs #38640
Description
Description
docker service logs sometimes hangs
Steps to reproduce the issue:
docker service logs service-name
Describe the results you received:
Some logs are shown on the terminal but it never finishes
It does not always hang at the same spot
Service I am trying has 2 replicas.
Happens maybe 50% of the time I try.
Let me know if there is further debug information I can collect
Describe the results you expected:
All logs shown and it does not hang
Additional information you deem important (e.g. issue happens only occasionally):
Output of docker version:
Client:
Version: 18.09.0
API version: 1.39
Go version: go1.10.4
Git commit: 4d60db4
Built: Wed Nov 7 00:48:57 2018
OS/Arch: linux/amd64
Experimental: false
Server: Docker Engine - Community
Engine:
Version: 18.09.0
API version: 1.39 (minimum version 1.12)
Go version: go1.10.4
Git commit: 4d60db4
Built: Wed Nov 7 00:16:44 2018
OS/Arch: linux/amd64
Experimental: false
Output of docker info:
Containers: 35
Running: 18
Paused: 0
Stopped: 17
Images: 26
Server Version: 18.09.0
Storage Driver: overlay2
Backing Filesystem: xfs
Supports d_type: true
Native Overlay Diff: true
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
Volume: local
Network: bridge host macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
Swarm: active
NodeID: ov37b8anl2rz98ywv5bfcoa01
Is Manager: true
ClusterID: yjzcdr6xadmpfmtwx32z5hthg
Managers: 3
Nodes: 3
Default Address Pool: 10.0.0.0/8
SubnetSize: 24
Orchestration:
Task History Retention Limit: 5
Raft:
Snapshot Interval: 10000
Number of Old Snapshots to Retain: 0
Heartbeat Tick: 1
Election Tick: 10
Dispatcher:
Heartbeat Period: 5 seconds
CA Configuration:
Expiry Duration: 3 months
Force Rotate: 0
Autolock Managers: false
Root Rotation In Progress: false
Node Address: 10.31.11.22
Manager Addresses:
10.31.11.22:2377
10.31.11.87:2377
10.31.11.88:2377
Runtimes: runc
Default Runtime: runc
Init Binary: docker-init
containerd version: c4446665cb9c30056f4998ed953e6d4ff22c7c39
runc version: 4fc53a81fb7c994640722ac585fa9ca548971871
init version: fec3683
Security Options:
apparmor
seccomp
Profile: default
Kernel Version: 4.4.0-139-generic
Operating System: Ubuntu 16.04.5 LTS
OSType: linux
Architecture: x86_64
CPUs: 4
Total Memory: 7.796GiB
Name: quoited1.fyre.ibm.com
ID: 6RP6:HW7M:IYDP:YNI7:ITUX:RHPH:DQZX:LBVV:RROL:AO7J:YVUC:OKMM
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): false
Registry: https://index.docker.io/v1/
Labels:
Experimental: false
Insecure Registries:
127.0.0.0/8
Live Restore Enabled: false
Product License: Community Engine
WARNING: No swap limit support
Additional environment details (AWS, VirtualBox, physical, etc.):
The stack has about 20 services. I am only seeing one of them hang.
I deleted one of the stopped containers for this service, it seems to have made it occur less frequently but I can't say for sure.