Thanks to visit codestin.com
Credit goes to github.com

Skip to content

runtime_vm: Panic creating a container due to "panic: protobuf tag not enough fields in Status.state" #3991

@fidencio

Description

@fidencio

When creating a vm using the "vm" runtime type and kata, the following panic will happen:

panic
Jul 21 16:20:10 angeli crio[41277]: panic: protobuf tag not enough fields in Status.state:
Jul 21 16:20:10 angeli crio[41277]: goroutine 467 [running]:
Jul 21 16:20:10 angeli crio[41277]: panic(0x1c1ff20, 0xc000489420)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/panic.go:1064 +0x46d fp=0xc0007f7418 sp=0xc0007f7360 pc=0x43872d
Jul 21 16:20:10 angeli crio[41277]: github.com/gogo/protobuf/proto.(*unmarshalInfo).computeUnmarshalInfo(0xc000258a00)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/gogo/protobuf/proto/table_unmarshal.go:341 +0x1834 fp=0xc0007f77d8 sp=0xc0007f7418 pc=0x82ef24
Jul 21 16:20:10 angeli crio[41277]: github.com/gogo/protobuf/proto.(*unmarshalInfo).unmarshal(0xc000258a00, 0xc00036cc00, 0xc00075d922, 0x0, 0x6, 0x0, 0x2348f60)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/gogo/protobuf/proto/table_unmarshal.go:138 +0xe02 fp=0xc0007f79a8 sp=0xc0007f77d8 pc=0x82d682
Jul 21 16:20:10 angeli crio[41277]: github.com/gogo/protobuf/proto.makeUnmarshalMessagePtr.func1(0xc00075d922, 0x6, 0x7, 0xc000485b00, 0x2, 0x0, 0x0, 0x203000, 0xc00007bb20, 0x4114a6)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/gogo/protobuf/proto/table_unmarshal.go:1826 +0x12b fp=0xc0007f7a40 sp=0xc0007f79a8 pc=0x84f58b
Jul 21 16:20:10 angeli crio[41277]: github.com/gogo/protobuf/proto.(*unmarshalInfo).unmarshal(0xc0002588c0, 0xc000485b00, 0xc00075d920, 0x8, 0x8, 0x411d18, 0x20)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/gogo/protobuf/proto/table_unmarshal.go:175 +0x79e fp=0xc0007f7c10 sp=0xc0007f7a40 pc=0x82d01e
Jul 21 16:20:10 angeli crio[41277]: github.com/gogo/protobuf/proto.(*InternalMessageInfo).Unmarshal(0xc0006a2ae0, 0x22f6aa0, 0xc000485b00, 0xc00075d920, 0x8, 0x8, 0x1, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/gogo/protobuf/proto/table_unmarshal.go:63 +0x66 fp=0xc0007f7c70 sp=0xc0007f7c10 pc=0x82c616
Jul 21 16:20:10 angeli crio[41277]: github.com/gogo/protobuf/proto.(*Buffer).Unmarshal(0xc0007f7cf0, 0x22f6aa0, 0xc000485b00, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/gogo/protobuf/proto/decode.go:424 +0x1ec fp=0xc0007f7cc0 sp=0xc0007f7c70 pc=0x80695c
Jul 21 16:20:10 angeli crio[41277]: github.com/gogo/protobuf/proto.Unmarshal(0xc00075d920, 0x8, 0x8, 0x22f6aa0, 0xc000485b00, 0xc0006c68b8, 0xc00007bf40)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/gogo/protobuf/proto/decode.go:342 +0x170 fp=0xc0007f7d28 sp=0xc0007f7cc0 pc=0x8064c0
Jul 21 16:20:10 angeli crio[41277]: github.com/containerd/ttrpc.(*Client).recv(0xc000215280, 0xc000485b00, 0xc000a42380, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/containerd/ttrpc/client.go:323 +0x14f fp=0xc0007f7da8 sp=0xc0007f7d28 pc=0x19a34ef
Jul 21 16:20:10 angeli crio[41277]: github.com/containerd/ttrpc.(*Client).run(0xc000215280)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/containerd/ttrpc/client.go:273 +0x471 fp=0xc0007f7fd8 sp=0xc0007f7da8 pc=0x19a2fb1
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0007f7fe0 sp=0xc0007f7fd8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by github.com/containerd/ttrpc.NewClient
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/containerd/ttrpc/client.go:92 +0x17e
Jul 21 16:20:10 angeli crio[41277]: goroutine 1 [select, 1 minutes]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc0007f9938 sp=0xc0007f9918 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.selectgo(0xc0007f9d00, 0xc0007f9b04, 0x3, 0x231a8a0, 0xc000421a90)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc0007f9a60 sp=0xc0007f9938 pc=0x44ae83
Jul 21 16:20:10 angeli crio[41277]: main.main.func2(0xc000091e40, 0xc000526500, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/cmd/crio/main.go:313 +0xd9d fp=0xc0007f9d88 sp=0xc0007f9a60 pc=0x1acdced
Jul 21 16:20:10 angeli crio[41277]: github.com/urfave/cli/v2.(*App).RunContext(0xc0002f6780, 0x23113a0, 0xc000130010, 0xc0001181b0, 0x1, 0x1, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/urfave/cli/v2/app.go:315 +0x70b fp=0xc0007f9eb0 sp=0xc0007f9d88 pc=0x135088b
Jul 21 16:20:10 angeli crio[41277]: github.com/urfave/cli/v2.(*App).Run(...)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/urfave/cli/v2/app.go:215
Jul 21 16:20:10 angeli crio[41277]: main.main()
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/cmd/crio/main.go:340 +0x6c2 fp=0xc0007f9f88 sp=0xc0007f9eb0 pc=0x1acaa62
Jul 21 16:20:10 angeli crio[41277]: runtime.main()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:203 +0x1fa fp=0xc0007f9fe0 sp=0xc0007f9f88 pc=0x43b17a
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0007f9fe8 sp=0xc0007f9fe0 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: goroutine 2 [force gc (idle), 1 minutes]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bc90, 0x336cb90, 0x1411, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000068fb0 sp=0xc000068f90 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.goparkunlock(...)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:310
Jul 21 16:20:10 angeli crio[41277]: runtime.forcegchelper()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:253 +0xb7 fp=0xc000068fe0 sp=0xc000068fb0 pc=0x43b3f7
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000068fe8 sp=0xc000068fe0 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by runtime.init.6
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:242 +0x35
Jul 21 16:20:10 angeli crio[41277]: goroutine 3 [GC sweep wait]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bc90, 0x3374220, 0x140c, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc0000697a8 sp=0xc000069788 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.goparkunlock(...)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:310
Jul 21 16:20:10 angeli crio[41277]: runtime.bgsweep(0xc00007e000)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/mgcsweep.go:89 +0x131 fp=0xc0000697d8 sp=0xc0000697a8 pc=0x427c61
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0000697e0 sp=0xc0000697d8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by runtime.gcenable
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/mgc.go:214 +0x5c
Jul 21 16:20:10 angeli crio[41277]: goroutine 4 [GC scavenge wait]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bc90, 0x33741e0, 0x140d, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000069f78 sp=0xc000069f58 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.goparkunlock(...)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:310
Jul 21 16:20:10 angeli crio[41277]: runtime.bgscavenge(0xc00007e000)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/mgcscavenge.go:285 +0x290 fp=0xc000069fd8 sp=0xc000069f78 pc=0x4262f0
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000069fe0 sp=0xc000069fd8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by runtime.gcenable
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/mgc.go:215 +0x7e
Jul 21 16:20:10 angeli crio[41277]: goroutine 18 [finalizer wait]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bc90, 0x33a2c70, 0xc000491410, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000068758 sp=0xc000068738 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.goparkunlock(...)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:310
Jul 21 16:20:10 angeli crio[41277]: runtime.runfinq()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/mfinal.go:175 +0xa3 fp=0xc0000687e0 sp=0xc000068758 pc=0x41d793
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0000687e8 sp=0xc0000687e0 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by runtime.createfing
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/mfinal.go:156 +0x61
Jul 21 16:20:10 angeli crio[41277]: goroutine 157 [IO wait]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bc60, 0x7f53e2c7db90, 0xc000221b02, 0x5)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000476a40 sp=0xc000476a20 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.netpollblock(0x7f53e2c7db68, 0x72, 0xc0008b2000)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/netpoll.go:419 +0x9a fp=0xc000476a78 sp=0xc000476a40 pc=0x4344fa
Jul 21 16:20:10 angeli crio[41277]: internal/poll.runtime_pollWait(0x7f53e2c7db68, 0x72, 0xffffffffffffffff)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/netpoll.go:203 +0x55 fp=0xc000476aa0 sp=0xc000476a78 pc=0x433a65
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*pollDesc).wait(0xc000314c98, 0x72, 0x8000, 0x8000, 0xffffffffffffffff)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_poll_runtime.go:87 +0x45 fp=0xc000476ad0 sp=0xc000476aa0 pc=0x4d29e5
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*pollDesc).waitRead(...)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_poll_runtime.go:92
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*FD).Read(0xc000314c80, 0xc0008b2000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_unix.go:169 +0x19b fp=0xc000476b40 sp=0xc000476ad0 pc=0x4d387b
Jul 21 16:20:10 angeli crio[41277]: net.(*netFD).Read(0xc000314c80, 0xc0008b2000, 0x8000, 0x8000, 0x2f, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/net/fd_unix.go:202 +0x4f fp=0xc000476ba0 sp=0xc000476b40 pc=0x7628df
Jul 21 16:20:10 angeli crio[41277]: net.(*conn).Read(0xc000010e40, 0xc0008b2000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/net/net.go:184 +0x8e fp=0xc000476c00 sp=0xc000476ba0 pc=0x77668e
Jul 21 16:20:10 angeli crio[41277]: github.com/soheilhy/cmux.(*bufferedReader).Read(0xc0001d8160, 0xc0008b2000, 0x8000, 0x8000, 0x8, 0xc000476db8, 0xad19bb)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/soheilhy/cmux/buffer.go:53 +0x12c fp=0xc000476c68 sp=0xc000476c00 pc=0x1ac419c
Jul 21 16:20:10 angeli crio[41277]: github.com/soheilhy/cmux.(*MuxConn).Read(0xc0001d8150, 0xc0008b2000, 0x8000, 0x8000, 0x20, 0xc000476d08, 0x18)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/soheilhy/cmux/cmux.go:260 +0x4f fp=0xc000476cb0 sp=0xc000476c68 pc=0x1ac551f
Jul 21 16:20:10 angeli crio[41277]: bufio.(*Reader).Read(0xc0002d7920, 0xc00042ee38, 0x9, 0x9, 0xc00006d180, 0x1007f540a8f8e98, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/bufio/bufio.go:226 +0x24f fp=0xc000476d00 sp=0xc000476cb0 pc=0x5128bf
Jul 21 16:20:10 angeli crio[41277]: io.ReadAtLeast(0x22b9600, 0xc0002d7920, 0xc00042ee38, 0x9, 0x9, 0x9, 0x5f16f99a, 0xc000476dc0, 0x4ca4f6)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/io/io.go:310 +0x87 fp=0xc000476d60 sp=0xc000476d00 pc=0x4ad887
Jul 21 16:20:10 angeli crio[41277]: io.ReadFull(...)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/io/io.go:329
Jul 21 16:20:10 angeli crio[41277]: golang.org/x/net/http2.readFrameHeader(0xc00042ee38, 0x9, 0x9, 0x22b9600, 0xc0002d7920, 0x0, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/golang.org/x/net/http2/frame.go:237 +0x87 fp=0xc000476dc8 sp=0xc000476d60 pc=0xad0b27
Jul 21 16:20:10 angeli crio[41277]: golang.org/x/net/http2.(*Framer).ReadFrame(0xc00042ee00, 0xc0005bfd80, 0x3375880, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/golang.org/x/net/http2/frame.go:492 +0xa1 fp=0xc000476e88 sp=0xc000476dc8 pc=0xad1361
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc000698300, 0xc0005818c0, 0x2099998)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/internal/transport/http2_server.go:453 +0x98 fp=0xc000476f50 sp=0xc000476e88 pc=0x12c53e8
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc.(*Server).serveStreams(0xc000270a80, 0x232fae0, 0xc000698300)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/server.go:818 +0xfe fp=0xc000476fa0 sp=0xc000476f50 pc=0x131460e
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000270a80, 0x232fae0, 0xc000698300)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/server.go:777 +0x3f fp=0xc000476fc8 sp=0xc000476fa0 pc=0x132676f
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000476fd0 sp=0xc000476fc8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by google.golang.org/grpc.(*Server).handleRawConn
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/server.go:776 +0x4fd
Jul 21 16:20:10 angeli crio[41277]: goroutine 24 [GC worker (idle)]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bb08, 0xc0004c6ce0, 0x401418, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc00006a760 sp=0xc00006a740 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.gcBgMarkWorker(0xc00005f000)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/mgc.go:1873 +0xff fp=0xc00006a7d8 sp=0xc00006a760 pc=0x42115f
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc00006a7e0 sp=0xc00006a7d8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by runtime.gcBgMarkStartWorkers
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/mgc.go:1821 +0x77
Jul 21 16:20:10 angeli crio[41277]: goroutine 7 [GC worker (idle)]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bb08, 0xc0004c6cd0, 0x401418, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000230f60 sp=0xc000230f40 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.gcBgMarkWorker(0xc00005c800)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/mgc.go:1873 +0xff fp=0xc000230fd8 sp=0xc000230f60 pc=0x42115f
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000230fe0 sp=0xc000230fd8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by runtime.gcBgMarkStartWorkers
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/mgc.go:1821 +0x77
Jul 21 16:20:10 angeli crio[41277]: goroutine 41 [chan receive]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209ba80, 0xc0001c6898, 0x7f540a8f170e, 0x2)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc0002316d0 sp=0xc0002316b0 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.chanrecv(0xc0001c6840, 0xc0002317b0, 0xc00014a501, 0x3376018)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/chan.go:525 +0x2e7 fp=0xc000231760 sp=0xc0002316d0 pc=0x40aeb7
Jul 21 16:20:10 angeli crio[41277]: runtime.chanrecv2(0xc0001c6840, 0xc0002317b0, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/chan.go:412 +0x2b fp=0xc000231790 sp=0xc000231760 pc=0x40abbb
Jul 21 16:20:10 angeli crio[41277]: k8s.io/klog/v2.(*loggingT).flushDaemon(0x3376000)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/k8s.io/klog/v2/klog.go:1131 +0x8b fp=0xc0002317d8 sp=0xc000231790 pc=0x89a42b
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0002317e0 sp=0xc0002317d8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by k8s.io/klog/v2.init.0
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/k8s.io/klog/v2/klog.go:416 +0xd6
Jul 21 16:20:10 angeli crio[41277]: goroutine 42 [GC worker (idle)]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bb08, 0xc0001c4210, 0x1418, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000231f60 sp=0xc000231f40 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.gcBgMarkWorker(0xc00005a000)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/mgc.go:1873 +0xff fp=0xc000231fd8 sp=0xc000231f60 pc=0x42115f
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000231fe0 sp=0xc000231fd8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by runtime.gcBgMarkStartWorkers
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/mgc.go:1821 +0x77
Jul 21 16:20:10 angeli crio[41277]: goroutine 43 [GC worker (idle)]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bb08, 0xc000052710, 0x1418, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000232760 sp=0xc000232740 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.gcBgMarkWorker(0xc000061800)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/mgc.go:1873 +0xff fp=0xc0002327d8 sp=0xc000232760 pc=0x42115f
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0002327e0 sp=0xc0002327d8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by runtime.gcBgMarkStartWorkers
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/mgc.go:1821 +0x77
Jul 21 16:20:10 angeli crio[41277]: goroutine 11 [chan receive]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209ba80, 0xc000502058, 0x170e, 0x2)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000065ed0 sp=0xc000065eb0 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.chanrecv(0xc000502000, 0xc000065fb0, 0xc00009c001, 0x3375f38)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/chan.go:525 +0x2e7 fp=0xc000065f60 sp=0xc000065ed0 pc=0x40aeb7
Jul 21 16:20:10 angeli crio[41277]: runtime.chanrecv2(0xc000502000, 0xc000065fb0, 0x1070a01)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/chan.go:412 +0x2b fp=0xc000065f90 sp=0xc000065f60 pc=0x40abbb
Jul 21 16:20:10 angeli crio[41277]: k8s.io/klog.(*loggingT).flushDaemon(0x3375f20)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/k8s.io/klog/klog.go:1010 +0x8b fp=0xc000065fd8 sp=0xc000065f90 pc=0x1ac954b
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000065fe0 sp=0xc000065fd8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by k8s.io/klog.init.0
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/k8s.io/klog/klog.go:411 +0xd6
Jul 21 16:20:10 angeli crio[41277]: goroutine 156 [select, 1 minutes]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000883cc0 sp=0xc000883ca0 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.selectgo(0xc000883f08, 0xc000883e68, 0x4, 0x0, 0xc000136540)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc000883de8 sp=0xc000883cc0 pc=0x44ae83
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc000698300)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/internal/transport/http2_server.go:959 +0x285 fp=0xc000883fd8 sp=0xc000883de8 pc=0x12c9715
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000883fe0 sp=0xc000883fd8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by google.golang.org/grpc/internal/transport.newHTTP2Server
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/internal/transport/http2_server.go:297 +0x10e6
Jul 21 16:20:10 angeli crio[41277]: goroutine 458 [select]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc0009f7e20 sp=0xc0009f7e00 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.selectgo(0xc0009f82b0, 0xc0009f7fb8, 0x2, 0xc00076e9c0, 0xc0008c65a0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc0009f7f48 sp=0xc0009f7e20 pc=0x44ae83
Jul 21 16:20:10 angeli crio[41277]: github.com/cri-o/cri-o/internal/oci.(*runtimeVM).CreateContainer(0xc000715090, 0xc0000b26e0, 0xc0006b448a, 0x41, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/internal/oci/runtime_vm.go:149 +0x86c fp=0xc0009f8310 sp=0xc0009f7f48 pc=0x19fb6fc
Jul 21 16:20:10 angeli crio[41277]: github.com/cri-o/cri-o/internal/oci.(*Runtime).CreateContainer(0xc000581e60, 0xc0000b26e0, 0xc0006b448a, 0x41, 0xc00070d880, 0x7f540a8f8e98)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/internal/oci/oci.go:246 +0x116 fp=0xc0009f8368 sp=0xc0009f8310 pc=0x19ed6b6
Jul 21 16:20:10 angeli crio[41277]: github.com/cri-o/cri-o/server.(*Server).createContainerPlatform(0xc000490000, 0xc0000b26e0, 0xc0006b448a, 0x41, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/server/container_create_linux.go:180 +0x97 fp=0xc0009f8478 sp=0xc0009f8368 pc=0x1a87717
Jul 21 16:20:10 angeli crio[41277]: github.com/cri-o/cri-o/server.(*Server).runPodSandbox(0xc000490000, 0x2311420, 0xc000563c20, 0xc00000e4e0, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/server/sandbox_run_linux.go:625 +0x4d77 fp=0xc0009f9848 sp=0xc0009f8478 pc=0x1aaad57
Jul 21 16:20:10 angeli crio[41277]: github.com/cri-o/cri-o/server.(*Server).RunPodSandbox(0xc000490000, 0x2311420, 0xc000563c20, 0xc00000e4e0, 0xc000490000, 0x1, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/server/sandbox_run.go:68 +0x49 fp=0xc0009f9890 sp=0xc0009f9848 pc=0x1aa5a39
Jul 21 16:20:10 angeli crio[41277]: k8s.io/cri-api/pkg/apis/runtime/v1alpha2._RuntimeService_RunPodSandbox_Handler.func1(0x2311420, 0xc000563c20, 0x1e9ac60, 0xc00000e4e0, 0xc000977948, 0x1, 0x1, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/k8s.io/cri-api/pkg/apis/runtime/v1alpha2/api.pb.go:7731 +0x89 fp=0xc0009f98d8 sp=0xc0009f9890 pc=0x144bfc9
Jul 21 16:20:10 angeli crio[41277]: github.com/cri-o/cri-o/internal/log.UnaryInterceptor.func1(0x2311420, 0xc000563b00, 0x1e9ac60, 0xc00000e4e0, 0xc00000e520, 0xc00000e560, 0x4ca4f6, 0x5f16f992, 0xc01f6e65ed, 0x593bc68180b)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/internal/log/interceptors.go:57 +0x116 fp=0xc0009f9968 sp=0xc0009f98d8 pc=0x132cd16
Jul 21 16:20:10 angeli crio[41277]: github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1(0x2311420, 0xc000563b00, 0x1e9ac60, 0xc00000e4e0, 0x20, 0x1dd80c0, 0xc00000e4e0, 0x1d6a640)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/grpc-ecosystem/go-grpc-middleware/chain.go:25 +0x63 fp=0xc0009f99c8 sp=0xc0009f9968 pc=0x1ac3e33
Jul 21 16:20:10 angeli crio[41277]: github.com/cri-o/cri-o/server/metrics.UnaryInterceptor.func1(0x2311420, 0xc000563b00, 0x1e9ac60, 0xc00000e4e0, 0xc00000e520, 0xc00000e580, 0x1ac3eba, 0x1dd80c0, 0xc00000e5c0, 0xc00000e520)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/server/metrics/interceptors.go:24 +0xc6 fp=0xc0009f9a70 sp=0xc0009f99c8 pc=0x1a3a4c6
Jul 21 16:20:10 angeli crio[41277]: github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1.1.1(0x2311420, 0xc000563b00, 0x1e9ac60, 0xc00000e4e0, 0xc000140400, 0x0, 0xc000880b30, 0x411d18)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/grpc-ecosystem/go-grpc-middleware/chain.go:25 +0x63 fp=0xc0009f9ad0 sp=0xc0009f9a70 pc=0x1ac3e33
Jul 21 16:20:10 angeli crio[41277]: github.com/grpc-ecosystem/go-grpc-middleware.ChainUnaryServer.func1(0x2311420, 0xc000563b00, 0x1e9ac60, 0xc00000e4e0, 0xc00000e520, 0xc00000e560, 0xc000880ba0, 0x5059d8, 0x1e1fcc0, 0xc000563b00)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/grpc-ecosystem/go-grpc-middleware/chain.go:34 +0xd5 fp=0xc0009f9b40 sp=0xc0009f9ad0 pc=0x1ac4015
Jul 21 16:20:10 angeli crio[41277]: k8s.io/cri-api/pkg/apis/runtime/v1alpha2._RuntimeService_RunPodSandbox_Handler(0x1f80c80, 0xc000490000, 0x2311420, 0xc000563b00, 0xc0006da2a0, 0xc000580720, 0x2311420, 0xc000563b00, 0xc00094e580, 0x559)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/k8s.io/cri-api/pkg/apis/runtime/v1alpha2/api.pb.go:7733 +0x14b fp=0xc0009f9bb0 sp=0xc0009f9b40 pc=0x13b5abb
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc.(*Server).processUnaryRPC(0xc000270a80, 0x232fae0, 0xc000698300, 0xc000140400, 0xc0001f9e00, 0x32dbf58, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/server.go:1171 +0x50a fp=0xc0009f9e40 sp=0xc0009f9bb0 pc=0x1315fda
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc.(*Server).handleStream(0xc000270a80, 0x232fae0, 0xc000698300, 0xc000140400, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/server.go:1494 +0xccd fp=0xc0009f9f68 sp=0xc0009f9e40 pc=0x131a16d
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc.(*Server).serveStreams.func1.2(0xc0001c4f50, 0xc000270a80, 0x232fae0, 0xc000698300, 0xc000140400)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/server.go:834 +0xa1 fp=0xc0009f9fb8 sp=0xc0009f9f68 pc=0x1326901
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0009f9fc0 sp=0xc0009f9fb8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by google.golang.org/grpc.(*Server).serveStreams.func1
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/server.go:832 +0x204
Jul 21 16:20:10 angeli crio[41277]: goroutine 162 [IO wait, 1 minutes]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bc60, 0x7f53e2c7de30, 0xc000471b02, 0x5)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000474b38 sp=0xc000474b18 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.netpollblock(0x7f53e2c7de08, 0x72, 0x22be940)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/netpoll.go:419 +0x9a fp=0xc000474b70 sp=0xc000474b38 pc=0x4344fa
Jul 21 16:20:10 angeli crio[41277]: internal/poll.runtime_pollWait(0x7f53e2c7de08, 0x72, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/netpoll.go:203 +0x55 fp=0xc000474b98 sp=0xc000474b70 pc=0x433a65
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*pollDesc).wait(0xc000314818, 0x72, 0x0, 0x0, 0x1f8962d)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_poll_runtime.go:87 +0x45 fp=0xc000474bc8 sp=0xc000474b98 pc=0x4d29e5
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*pollDesc).waitRead(...)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_poll_runtime.go:92
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*FD).Accept(0xc000314800, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_unix.go:384 +0x1d4 fp=0xc000474c48 sp=0xc000474bc8 pc=0x4d5224
Jul 21 16:20:10 angeli crio[41277]: net.(*netFD).accept(0xc000314800, 0xc000474d68, 0xc0001afc00, 0x7f540a8f8e98)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/net/fd_unix.go:238 +0x42 fp=0xc000474d30 sp=0xc000474c48 pc=0x763192
Jul 21 16:20:10 angeli crio[41277]: net.(*TCPListener).accept(0xc000208780, 0xc000474da8, 0x411d18, 0x30)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/net/tcpsock_posix.go:139 +0x32 fp=0xc000474d70 sp=0xc000474d30 pc=0x780152
Jul 21 16:20:10 angeli crio[41277]: net.(*TCPListener).Accept(0xc000208780, 0x1e1fcc0, 0xc0000d4ae0, 0x1c97120, 0x32c3080)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/net/tcpsock.go:261 +0x64 fp=0xc000474db0 sp=0xc000474d70 pc=0x77eee4
Jul 21 16:20:10 angeli crio[41277]: net/http.(*onceCloseListener).Accept(0xc0000d48a0, 0xc000130010, 0x1c97120, 0x32c3080, 0x1f16b80)
Jul 21 16:20:10 angeli crio[41277]:         <autogenerated>:1 +0x3c fp=0xc000474de8 sp=0xc000474db0 pc=0xa06d0c
Jul 21 16:20:10 angeli crio[41277]: net/http.(*Server).Serve(0xc00079a2a0, 0x23085e0, 0xc000208780, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/net/http/server.go:2901 +0x25d fp=0xc000474ef8 sp=0xc000474de8 pc=0x9e149d
Jul 21 16:20:10 angeli crio[41277]: k8s.io/kubernetes/pkg/kubelet/cri/streaming.(*server).Start(0xc0005cd4d0, 0xe62c01, 0x231a460, 0xc0002fb670)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/k8s.io/kubernetes/pkg/kubelet/cri/streaming/server.go:248 +0x147 fp=0xc000474f60 sp=0xc000474ef8 pc=0x1a7ffb7
Jul 21 16:20:10 angeli crio[41277]: github.com/cri-o/cri-o/server.New.func1(0xc000490000)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/server/server.go:412 +0x6d fp=0xc000474fd8 sp=0xc000474f60 pc=0x1abf93d
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000474fe0 sp=0xc000474fd8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by github.com/cri-o/cri-o/server.New
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/server/server.go:410 +0x74b
Jul 21 16:20:10 angeli crio[41277]: goroutine 150 [select, 1 minutes]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000066c28 sp=0xc000066c08 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.selectgo(0xc000066f40, 0xc000066dc4, 0x3, 0x0, 0xc000066da0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc000066d50 sp=0xc000066c28 pc=0x44ae83
Jul 21 16:20:10 angeli crio[41277]: github.com/cri-o/cri-o/server.(*Server).StartExitMonitor.func1(0xc00009c690, 0xc000490000, 0xc00010f9e0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/server/server.go:557 +0x125 fp=0xc000066fc8 sp=0xc000066d50 pc=0x1abfd35
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000066fd0 sp=0xc000066fc8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by github.com/cri-o/cri-o/server.(*Server).StartExitMonitor
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/server/server.go:555 +0x12d
Jul 21 16:20:10 angeli crio[41277]: goroutine 106 [chan receive]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209ba80, 0xc0005022f8, 0x170e, 0x2)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000067548 sp=0xc000067528 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.chanrecv(0xc0005022a0, 0xc000067620, 0x41df01, 0x44323e)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/chan.go:525 +0x2e7 fp=0xc0000675d8 sp=0xc000067548 pc=0x40aeb7
Jul 21 16:20:10 angeli crio[41277]: runtime.chanrecv2(0xc0005022a0, 0xc000067620, 0x18)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/chan.go:412 +0x2b fp=0xc000067608 sp=0xc0000675d8 pc=0x40abbb
Jul 21 16:20:10 angeli crio[41277]: github.com/soheilhy/cmux.muxListener.Accept(...)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/soheilhy/cmux/cmux.go:229
Jul 21 16:20:10 angeli crio[41277]: github.com/soheilhy/cmux.(*muxListener).Accept(0xc00075e680, 0x2099958, 0xc000270a80, 0x232a440, 0xc0005a29a0)
Jul 21 16:20:10 angeli crio[41277]:         <autogenerated>:1 +0x5b fp=0xc000067640 sp=0xc000067608 pc=0x1ac72db
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc.(*Server).Serve(0xc000270a80, 0x2309720, 0xc00075e680, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/server.go:695 +0x210 fp=0xc000067770 sp=0xc000067640 pc=0x1313350
Jul 21 16:20:10 angeli crio[41277]: main.main.func2.3(0xc000270a80, 0x2309720, 0xc00075e680)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/cmd/crio/main.go:289 +0x43 fp=0xc0000677c8 sp=0xc000067770 pc=0x1accc83
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0000677d0 sp=0xc0000677c8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by main.main.func2
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/cmd/crio/main.go:288 +0xc2c
Jul 21 16:20:10 angeli crio[41277]: goroutine 74 [syscall, 1 minutes]:
Jul 21 16:20:10 angeli crio[41277]: syscall.Syscall6(0xe8, 0x7, 0xc000677b74, 0x7, 0xffffffffffffffff, 0x0, 0x0, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/syscall/asm_linux_amd64.s:41 +0x5 fp=0xc000677aa8 sp=0xc000677aa0 pc=0x4bd2a5
Jul 21 16:20:10 angeli crio[41277]: golang.org/x/sys/unix.EpollWait(0x7, 0xc000677b74, 0x7, 0x7, 0xffffffffffffffff, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/golang.org/x/sys/unix/zsyscall_linux_amd64.go:76 +0x72 fp=0xc000677b18 sp=0xc000677aa8 pc=0x56a642
Jul 21 16:20:10 angeli crio[41277]: github.com/fsnotify/fsnotify.(*fdPoller).wait(0xc0005884c0, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/fsnotify/fsnotify/inotify_poller.go:86 +0x91 fp=0xc000677be0 sp=0xc000677b18 pc=0xd789a1
Jul 21 16:20:10 angeli crio[41277]: github.com/fsnotify/fsnotify.(*Watcher).readEvents(0xc00009c140)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/fsnotify/fsnotify/inotify.go:192 +0x1f8 fp=0xc000687fd8 sp=0xc000677be0 pc=0xd77ba8
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000687fe0 sp=0xc000687fd8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by github.com/fsnotify/fsnotify.NewWatcher
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/fsnotify/fsnotify/inotify.go:59 +0x1a5
Jul 21 16:20:10 angeli crio[41277]: goroutine 75 [select, 1 minutes]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000233540 sp=0xc000233520 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.selectgo(0xc000233738, 0xc0002336b4, 0x3, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc000233668 sp=0xc000233540 pc=0x44ae83
Jul 21 16:20:10 angeli crio[41277]: github.com/cri-o/ocicni/pkg/ocicni.(*cniNetworkPlugin).monitorConfDir(0xc00055c900, 0xc0005822f0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/cri-o/ocicni/pkg/ocicni/ocicni.go:153 +0x19b fp=0xc0002337d0 sp=0xc000233668 pc=0xe639cb
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0002337d8 sp=0xc0002337d0 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by github.com/cri-o/ocicni/pkg/ocicni.initCNI
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/cri-o/ocicni/pkg/ocicni/ocicni.go:253 +0x39b
Jul 21 16:20:10 angeli crio[41277]: goroutine 107 [chan receive]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209ba80, 0xc000502418, 0x20170e, 0x2)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000470d40 sp=0xc000470d20 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.chanrecv(0xc0005023c0, 0xc000470e18, 0x45a001, 0x5959f0d9c25)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/chan.go:525 +0x2e7 fp=0xc000470dd0 sp=0xc000470d40 pc=0x40aeb7
Jul 21 16:20:10 angeli crio[41277]: runtime.chanrecv2(0xc0005023c0, 0xc000470e18, 0x4ca4f6)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/chan.go:412 +0x2b fp=0xc000470e00 sp=0xc000470dd0 pc=0x40abbb
Jul 21 16:20:10 angeli crio[41277]: github.com/soheilhy/cmux.muxListener.Accept(...)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/soheilhy/cmux/cmux.go:229
Jul 21 16:20:10 angeli crio[41277]: github.com/soheilhy/cmux.(*muxListener).Accept(0xc00075e7c0, 0xc000470e80, 0x18, 0xc0002f6180, 0x9e159c)
Jul 21 16:20:10 angeli crio[41277]:         <autogenerated>:1 +0x5b fp=0xc000470e38 sp=0xc000470e00 pc=0x1ac72db
Jul 21 16:20:10 angeli crio[41277]: net/http.(*onceCloseListener).Accept(0xc0006e0000, 0x209b5b0, 0xc0002f00a0, 0x2311420, 0xc0006e00c0)
Jul 21 16:20:10 angeli crio[41277]:         <autogenerated>:1 +0x3c fp=0xc000470e70 sp=0xc000470e38 pc=0xa06d0c
Jul 21 16:20:10 angeli crio[41277]: net/http.(*Server).Serve(0xc00079a380, 0x2309720, 0xc00075e7c0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/net/http/server.go:2901 +0x25d fp=0xc000470f80 sp=0xc000470e70 pc=0x9e149d
Jul 21 16:20:10 angeli crio[41277]: main.main.func2.4(0xc00079a380, 0x2309720, 0xc00075e7c0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/cmd/crio/main.go:294 +0x43 fp=0xc000470fc8 sp=0xc000470f80 pc=0x1accd53
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000470fd0 sp=0xc000470fc8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by main.main.func2
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/cmd/crio/main.go:293 +0xc68
Jul 21 16:20:10 angeli crio[41277]: goroutine 60 [select]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000bfdd58 sp=0xc000bfdd38 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.selectgo(0xc000bfded8, 0xc000bfdeb0, 0x2, 0xc0005edee0, 0x1ac71aa)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc000bfde80 sp=0xc000bfdd58 pc=0x44ae83
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc0006cb860, 0x1, 0x0, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x122 fp=0xc000bfdf38 sp=0xc000bfde80 pc=0x12b07d2
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0008701e0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1cd fp=0xc000bfdf90 sp=0xc000bfdf38 pc=0x12b10dd
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc000620a80)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/internal/transport/http2_server.go:291 +0xcb fp=0xc000bfdfd8 sp=0xc000bfdf90 pc=0x12d350b
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000bfdfe0 sp=0xc000bfdfd8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by google.golang.org/grpc/internal/transport.newHTTP2Server
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/internal/transport/http2_server.go:288 +0x10c1
Jul 21 16:20:10 angeli crio[41277]: goroutine 488 [IO wait]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bc60, 0x7f53e2c7d730, 0xc000221b02, 0x5)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc0006a94b0 sp=0xc0006a9490 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.netpollblock(0x7f53e2c7d708, 0x72, 0xc000690000)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/netpoll.go:419 +0x9a fp=0xc0006a94e8 sp=0xc0006a94b0 pc=0x4344fa
Jul 21 16:20:10 angeli crio[41277]: internal/poll.runtime_pollWait(0x7f53e2c7d708, 0x72, 0xffffffffffffffff)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/netpoll.go:203 +0x55 fp=0xc0006a9510 sp=0xc0006a94e8 pc=0x433a65
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*pollDesc).wait(0xc000125ed8, 0x72, 0x8001, 0x8000, 0xffffffffffffffff)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_poll_runtime.go:87 +0x45 fp=0xc0006a9540 sp=0xc0006a9510 pc=0x4d29e5
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*pollDesc).waitRead(...)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_poll_runtime.go:92
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*FD).Read(0xc000125ec0, 0xc000690000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_unix.go:169 +0x19b fp=0xc0006a95b0 sp=0xc0006a9540 pc=0x4d387b
Jul 21 16:20:10 angeli crio[41277]: os.(*File).read(...)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/os/file_unix.go:263
Jul 21 16:20:10 angeli crio[41277]: os.(*File).Read(0xc000010c20, 0xc000690000, 0x8000, 0x8000, 0x4db2e7, 0xc0001360c0, 0xc000690000)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/os/file.go:116 +0x71 fp=0xc0006a9620 sp=0xc0006a95b0 pc=0x4dac91
Jul 21 16:20:10 angeli crio[41277]: github.com/cri-o/cri-o/utils/fifo.(*fifo).Read(0xc0006da000, 0xc000690000, 0x8000, 0x8000, 0x453, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/fifo/fifo.go:154 +0x2c3 fp=0xc0006a96c8 sp=0xc0006a9620 pc=0x19e2de3
Jul 21 16:20:10 angeli crio[41277]: io.copyBuffer(0x22bc860, 0xc000134010, 0x7f53e0a8d468, 0xc0006da000, 0xc000690000, 0x8000, 0x8000, 0x7f81e5, 0xc0006b42a0, 0x6f)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/io/io.go:405 +0x122 fp=0xc0006a9740 sp=0xc0006a96c8 pc=0x4add22
Jul 21 16:20:10 angeli crio[41277]: io.Copy(...)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/io/io.go:364
Jul 21 16:20:10 angeli crio[41277]: github.com/cri-o/cri-o/internal/oci.(*runtimeVM).startRuntimeDaemon.func1(0x22f6d60, 0xc0006da000)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/internal/oci/runtime_vm.go:210 +0xc6 fp=0xc0006a97d0 sp=0xc0006a9740 pc=0x1a05266
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0006a97d8 sp=0xc0006a97d0 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by github.com/cri-o/cri-o/internal/oci.(*runtimeVM).startRuntimeDaemon
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/internal/oci/runtime_vm.go:208 +0x445
Jul 21 16:20:10 angeli crio[41277]: goroutine 108 [IO wait]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bc60, 0x7f53e2c7dab0, 0xc000881b02, 0x5)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000887c40 sp=0xc000887c20 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.netpollblock(0x7f53e2c7da88, 0x72, 0x22be940)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/netpoll.go:419 +0x9a fp=0xc000887c78 sp=0xc000887c40 pc=0x4344fa
Jul 21 16:20:10 angeli crio[41277]: internal/poll.runtime_pollWait(0x7f53e2c7da88, 0x72, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/netpoll.go:203 +0x55 fp=0xc000887ca0 sp=0xc000887c78 pc=0x433a65
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*pollDesc).wait(0xc000314118, 0x72, 0x0, 0x0, 0x1f8962d)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_poll_runtime.go:87 +0x45 fp=0xc000887cd0 sp=0xc000887ca0 pc=0x4d29e5
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*pollDesc).waitRead(...)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_poll_runtime.go:92
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*FD).Accept(0xc000314100, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_unix.go:384 +0x1d4 fp=0xc000887d50 sp=0xc000887cd0 pc=0x4d5224
Jul 21 16:20:10 angeli crio[41277]: net.(*netFD).accept(0xc000314100, 0xc000134048, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/net/fd_unix.go:238 +0x42 fp=0xc000887e38 sp=0xc000887d50 pc=0x763192
Jul 21 16:20:10 angeli crio[41277]: net.(*UnixListener).accept(0xc0005806f0, 0xc000887eb8, 0xc000887ec0, 0x28)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/net/unixsock_posix.go:162 +0x32 fp=0xc000887e70 sp=0xc000887e38 pc=0x787232
Jul 21 16:20:10 angeli crio[41277]: net.(*UnixListener).Accept(0xc0005806f0, 0x2099400, 0xc000421a90, 0x232a7a0, 0xc000134048)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/net/unixsock.go:260 +0x64 fp=0xc000887eb0 sp=0xc000887e70 pc=0x7854e4
Jul 21 16:20:10 angeli crio[41277]: github.com/soheilhy/cmux.(*cMux).Serve(0xc000421a90, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/soheilhy/cmux/cmux.go:162 +0xa4 fp=0xc000887f40 sp=0xc000887eb0 pc=0x1ac4c64
Jul 21 16:20:10 angeli crio[41277]: main.main.func2.5(0xc0006ba000, 0x231a8a0, 0xc000421a90, 0xc0005835c0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/cmd/crio/main.go:302 +0x66 fp=0xc000887fc0 sp=0xc000887f40 pc=0x1acce16
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000887fc8 sp=0xc000887fc0 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by main.main.func2
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/cmd/crio/main.go:300 +0xcca
Jul 21 16:20:10 angeli crio[41277]: goroutine 149 [syscall, 1 minutes]:
Jul 21 16:20:10 angeli crio[41277]: syscall.Syscall6(0xe8, 0x27, 0xc0008fdb74, 0x7, 0xffffffffffffffff, 0x0, 0x0, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/syscall/asm_linux_amd64.s:41 +0x5 fp=0xc0008fdaa8 sp=0xc0008fdaa0 pc=0x4bd2a5
Jul 21 16:20:10 angeli crio[41277]: golang.org/x/sys/unix.EpollWait(0x27, 0xc0008fdb74, 0x7, 0x7, 0xffffffffffffffff, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/golang.org/x/sys/unix/zsyscall_linux_amd64.go:76 +0x72 fp=0xc0008fdb18 sp=0xc0008fdaa8 pc=0x56a642
Jul 21 16:20:10 angeli crio[41277]: github.com/fsnotify/fsnotify.(*fdPoller).wait(0xc0005b9e60, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/fsnotify/fsnotify/inotify_poller.go:86 +0x91 fp=0xc0008fdbe0 sp=0xc0008fdb18 pc=0xd789a1
Jul 21 16:20:10 angeli crio[41277]: github.com/fsnotify/fsnotify.(*Watcher).readEvents(0xc00009c690)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/fsnotify/fsnotify/inotify.go:192 +0x1f8 fp=0xc00090dfd8 sp=0xc0008fdbe0 pc=0xd77ba8
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc00090dfe0 sp=0xc00090dfd8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by github.com/fsnotify/fsnotify.NewWatcher
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/fsnotify/fsnotify/inotify.go:59 +0x1a5
Jul 21 16:20:10 angeli crio[41277]: goroutine 62 [IO wait]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bc60, 0x7f53e2c7dc70, 0xc0002f1b02, 0x5)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000475a40 sp=0xc000475a20 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.netpollblock(0x7f53e2c7dc48, 0x72, 0xc000872000)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/netpoll.go:419 +0x9a fp=0xc000475a78 sp=0xc000475a40 pc=0x4344fa
Jul 21 16:20:10 angeli crio[41277]: internal/poll.runtime_pollWait(0x7f53e2c7dc48, 0x72, 0xffffffffffffffff)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/netpoll.go:203 +0x55 fp=0xc000475aa0 sp=0xc000475a78 pc=0x433a65
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*pollDesc).wait(0xc000718018, 0x72, 0x8000, 0x8000, 0xffffffffffffffff)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_poll_runtime.go:87 +0x45 fp=0xc000475ad0 sp=0xc000475aa0 pc=0x4d29e5
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*pollDesc).waitRead(...)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_poll_runtime.go:92
Jul 21 16:20:10 angeli crio[41277]: internal/poll.(*FD).Read(0xc000718000, 0xc000872000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_unix.go:169 +0x19b fp=0xc000475b40 sp=0xc000475ad0 pc=0x4d387b
Jul 21 16:20:10 angeli crio[41277]: net.(*netFD).Read(0xc000718000, 0xc000872000, 0x8000, 0x8000, 0x1e, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/net/fd_unix.go:202 +0x4f fp=0xc000475ba0 sp=0xc000475b40 pc=0x7628df
Jul 21 16:20:10 angeli crio[41277]: net.(*conn).Read(0xc00020ccd8, 0xc000872000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/net/net.go:184 +0x8e fp=0xc000475c00 sp=0xc000475ba0 pc=0x77668e
Jul 21 16:20:10 angeli crio[41277]: github.com/soheilhy/cmux.(*bufferedReader).Read(0xc0005a29b0, 0xc000872000, 0x8000, 0x8000, 0x8, 0xc000475db8, 0xad19bb)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/soheilhy/cmux/buffer.go:53 +0x12c fp=0xc000475c68 sp=0xc000475c00 pc=0x1ac419c
Jul 21 16:20:10 angeli crio[41277]: github.com/soheilhy/cmux.(*MuxConn).Read(0xc0005a29a0, 0xc000872000, 0x8000, 0x8000, 0x20, 0x418d83, 0x18)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/soheilhy/cmux/cmux.go:260 +0x4f fp=0xc000475cb0 sp=0xc000475c68 pc=0x1ac551f
Jul 21 16:20:10 angeli crio[41277]: bufio.(*Reader).Read(0xc000870000, 0xc00058e738, 0x9, 0x9, 0xc00006d180, 0x1007f540a8f8108, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/bufio/bufio.go:226 +0x24f fp=0xc000475d00 sp=0xc000475cb0 pc=0x5128bf
Jul 21 16:20:10 angeli crio[41277]: io.ReadAtLeast(0x22b9600, 0xc000870000, 0xc00058e738, 0x9, 0x9, 0x9, 0x5f16f995, 0xc000475dc0, 0x4ca4f6)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/io/io.go:310 +0x87 fp=0xc000475d60 sp=0xc000475d00 pc=0x4ad887
Jul 21 16:20:10 angeli crio[41277]: io.ReadFull(...)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/io/io.go:329
Jul 21 16:20:10 angeli crio[41277]: golang.org/x/net/http2.readFrameHeader(0xc00058e738, 0x9, 0x9, 0x22b9600, 0xc000870000, 0x0, 0x0, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/golang.org/x/net/http2/frame.go:237 +0x87 fp=0xc000475dc8 sp=0xc000475d60 pc=0xad0b27
Jul 21 16:20:10 angeli crio[41277]: golang.org/x/net/http2.(*Framer).ReadFrame(0xc00058e700, 0xc000703e40, 0x3375880, 0x0, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/golang.org/x/net/http2/frame.go:492 +0xa1 fp=0xc000475e88 sp=0xc000475dc8 pc=0xad1361
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0xc000620a80, 0xc000740360, 0x2099998)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/internal/transport/http2_server.go:453 +0x98 fp=0xc000475f50 sp=0xc000475e88 pc=0x12c53e8
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc.(*Server).serveStreams(0xc000270a80, 0x232fae0, 0xc000620a80)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/server.go:818 +0xfe fp=0xc000475fa0 sp=0xc000475f50 pc=0x131460e
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc.(*Server).handleRawConn.func1(0xc000270a80, 0x232fae0, 0xc000620a80)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/server.go:777 +0x3f fp=0xc000475fc8 sp=0xc000475fa0 pc=0x132676f
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000475fd0 sp=0xc000475fc8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by google.golang.org/grpc.(*Server).handleRawConn
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/server.go:776 +0x4fd
Jul 21 16:20:10 angeli crio[41277]: goroutine 61 [select]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000884cc0 sp=0xc000884ca0 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.selectgo(0xc000884f08, 0xc000884e68, 0x4, 0x0, 0xc000125920)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc000884de8 sp=0xc000884cc0 pc=0x44ae83
Jul 21 16:20:10 angeli crio[41277]: google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0xc000620a80)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/internal/transport/http2_server.go:959 +0x285 fp=0xc000884fd8 sp=0xc000884de8 pc=0x12c9715
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000884fe0 sp=0xc000884fd8 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by google.golang.org/grpc/internal/transport.newHTTP2Server
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/internal/transport/http2_server.go:297 +0x10e6
Jul 21 16:20:10 angeli crio[41277]: goroutine 105 [chan receive, 1 minutes]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209ba80, 0xc0005024d8, 0x44170e, 0x2)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc0006ac500 sp=0xc0006ac4e0 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.chanrecv(0xc000502480, 0xc0006ac640, 0x300000001, 0xc0002f7980)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/chan.go:525 +0x2e7 fp=0xc0006ac590 sp=0xc0006ac500 pc=0x40aeb7
Jul 21 16:20:10 angeli crio[41277]: runtime.chanrecv2(0xc000502480, 0xc0006ac640, 0xc0002f7980)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/chan.go:412 +0x2b fp=0xc0006ac5c0 sp=0xc0006ac590 pc=0x40abbb
Jul 21 16:20:10 angeli crio[41277]: main.catchShutdown.func1(0xc000502480, 0xc0005835c0, 0xc000270a80, 0xc00079a380, 0x2311360, 0xc000317b40, 0xc000490000, 0xc000489230)
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/cmd/crio/main.go:51 +0x5b fp=0xc0006ac7a0 sp=0xc0006ac5c0 pc=0x1acc25b
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0006ac7a8 sp=0xc0006ac7a0 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by main.catchShutdown
Jul 21 16:20:10 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/cmd/crio/main.go:50 +0x193
Jul 21 16:20:10 angeli crio[41277]: goroutine 163 [syscall, 1 minutes]:
Jul 21 16:20:10 angeli crio[41277]: runtime.notetsleepg(0x33a3780, 0xffffffffffffffff, 0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/lock_futex.go:227 +0x34 fp=0xc0006adf98 sp=0xc0006adf68 pc=0x4101d4
Jul 21 16:20:10 angeli crio[41277]: os/signal.signal_recv(0x0)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/sigqueue.go:147 +0x9c fp=0xc0006adfc0 sp=0xc0006adf98 pc=0x44fb4c
Jul 21 16:20:10 angeli crio[41277]: os/signal.loop()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/os/signal/signal_unix.go:23 +0x22 fp=0xc0006adfe0 sp=0xc0006adfc0 pc=0xd7c312
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0006adfe8 sp=0xc0006adfe0 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by os/signal.Notify.func1
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/os/signal/signal.go:127 +0x44
Jul 21 16:20:10 angeli crio[41277]: goroutine 164 [select, 1 minutes, locked to thread]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc00022ce08 sp=0xc00022cde8 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.selectgo(0xc00022cf78, 0xc00022cf70, 0x2, 0x8, 0x1)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc00022cf30 sp=0xc00022ce08 pc=0x44ae83
Jul 21 16:20:10 angeli crio[41277]: runtime.ensureSigM.func1()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/signal_unix.go:850 +0x1d8 fp=0xc00022cfe0 sp=0xc00022cf30 pc=0x466188
Jul 21 16:20:10 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc00022cfe8 sp=0xc00022cfe0 pc=0x468ca1
Jul 21 16:20:10 angeli crio[41277]: created by runtime.ensureSigM
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/signal_unix.go:833 +0xd5
Jul 21 16:20:10 angeli crio[41277]: goroutine 165 [chan receive, 1 minutes]:
Jul 21 16:20:10 angeli crio[41277]: runtime.gopark(0x209ba80, 0xc0001c7d38, 0x7f53e0a1170e, 0x2)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000232eb8 sp=0xc000232e98 pc=0x43b540
Jul 21 16:20:10 angeli crio[41277]: runtime.chanrecv(0xc0001c7ce0, 0x0, 0x1, 0xc0005aa278)
Jul 21 16:20:10 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/chan.go:525 +0x2e7 fp=0xc000232f48 sp=0xc000232eb8 pc=0x40aeb7
Jul 21 16:20:10 angeli crio[41277]: runtime.chanrecv1(0xc0001c7ce0, 0x0)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/chan.go:407 +0x2b fp=0xc000232f78 sp=0xc000232f48 pc=0x40ab7b
Jul 21 16:20:11 angeli crio[41277]: github.com/cri-o/cri-o/pkg/config.(*Config).StartWatcher.func1(0xc0001c7ce0, 0xc000490000)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/pkg/config/reload.go:24 +0x38 fp=0xc000232fd0 sp=0xc000232f78 pc=0x1334758
Jul 21 16:20:11 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000232fd8 sp=0xc000232fd0 pc=0x468ca1
Jul 21 16:20:11 angeli crio[41277]: created by github.com/cri-o/cri-o/pkg/config.(*Config).StartWatcher
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/pkg/config/reload.go:21 +0xb5
Jul 21 16:20:11 angeli crio[41277]: goroutine 155 [select]:
Jul 21 16:20:11 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000b41d58 sp=0xc000b41d38 pc=0x43b540
Jul 21 16:20:11 angeli crio[41277]: runtime.selectgo(0xc000b41ed8, 0xc000b41eb0, 0x2, 0xc000b41ee0, 0x1ac71aa)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc000b41e80 sp=0xc000b41d58 pc=0x44ae83
Jul 21 16:20:11 angeli crio[41277]: google.golang.org/grpc/internal/transport.(*controlBuffer).get(0xc00009d400, 0x1, 0x0, 0x0, 0x0, 0x0)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:395 +0x122 fp=0xc000b41f38 sp=0xc000b41e80 pc=0x12b07d2
Jul 21 16:20:11 angeli crio[41277]: google.golang.org/grpc/internal/transport.(*loopyWriter).run(0xc0005024e0, 0x0, 0x0)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/internal/transport/controlbuf.go:513 +0x1cd fp=0xc000b41f90 sp=0xc000b41f38 pc=0x12b10dd
Jul 21 16:20:11 angeli crio[41277]: google.golang.org/grpc/internal/transport.newHTTP2Server.func2(0xc000698300)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/internal/transport/http2_server.go:291 +0xcb fp=0xc000b41fd8 sp=0xc000b41f90 pc=0x12d350b
Jul 21 16:20:11 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000b41fe0 sp=0xc000b41fd8 pc=0x468ca1
Jul 21 16:20:11 angeli crio[41277]: created by google.golang.org/grpc/internal/transport.newHTTP2Server
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/google.golang.org/grpc/internal/transport/http2_server.go:288 +0x10c1
Jul 21 16:20:11 angeli crio[41277]: goroutine 167 [chan receive, 1 minutes]:
Jul 21 16:20:11 angeli crio[41277]: runtime.gopark(0x209ba80, 0xc00010fa38, 0xc45d337fa77d170e, 0x2)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000633e50 sp=0xc000633e30 pc=0x43b540
Jul 21 16:20:11 angeli crio[41277]: runtime.chanrecv(0xc00010f9e0, 0x0, 0xc00009c601, 0x209bdb8)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/chan.go:525 +0x2e7 fp=0xc000633ee0 sp=0xc000633e50 pc=0x40aeb7
Jul 21 16:20:11 angeli crio[41277]: runtime.chanrecv1(0xc00010f9e0, 0x0)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/chan.go:407 +0x2b fp=0xc000633f10 sp=0xc000633ee0 pc=0x40ab7b
Jul 21 16:20:11 angeli crio[41277]: github.com/cri-o/cri-o/server.(*Server).StartExitMonitor(0xc000490000)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/server/server.go:605 +0x181 fp=0xc000633fc0 sp=0xc000633f10 pc=0x1ab8d01
Jul 21 16:20:11 angeli crio[41277]: main.main.func2.2(0xc000490000)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/cmd/crio/main.go:261 +0x2b fp=0xc000633fd8 sp=0xc000633fc0 pc=0x1accc2b
Jul 21 16:20:11 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000633fe0 sp=0xc000633fd8 pc=0x468ca1
Jul 21 16:20:11 angeli crio[41277]: created by main.main.func2
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/cmd/crio/main.go:260 +0x84f
Jul 21 16:20:11 angeli crio[41277]: goroutine 168 [select, 1 minutes]:
Jul 21 16:20:11 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000477cf8 sp=0xc000477cd8 pc=0x43b540
Jul 21 16:20:11 angeli crio[41277]: runtime.selectgo(0xc000477f50, 0xc000477e78, 0x2, 0x0, 0x0)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc000477e20 sp=0xc000477cf8 pc=0x44ae83
Jul 21 16:20:11 angeli crio[41277]: github.com/containers/libpod/pkg/hooks.(*Manager).Monitor(0xc0001c1740, 0x2311360, 0xc000317b40, 0xc000502180)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/containers/libpod/pkg/hooks/monitor.go:49 +0x1a6 fp=0xc000477fc0 sp=0xc000477e20 pc=0xd7a5f6
Jul 21 16:20:11 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000477fc8 sp=0xc000477fc0 pc=0x468ca1
Jul 21 16:20:11 angeli crio[41277]: created by main.main.func2
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/cmd/crio/main.go:267 +0x8ca
Jul 21 16:20:11 angeli crio[41277]: goroutine 169 [syscall, 1 minutes]:
Jul 21 16:20:11 angeli crio[41277]: syscall.Syscall6(0xe8, 0x22, 0xc0008ddb74, 0x7, 0xffffffffffffffff, 0x0, 0x0, 0x3e8000d0008, 0x100005, 0x110005)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/syscall/asm_linux_amd64.s:41 +0x5 fp=0xc0008ddaa8 sp=0xc0008ddaa0 pc=0x4bd2a5
Jul 21 16:20:11 angeli crio[41277]: golang.org/x/sys/unix.EpollWait(0x22, 0xc0008ddb74, 0x7, 0x7, 0xffffffffffffffff, 0x100210005, 0x75716f6e0006000c, 0x23000800657565)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/golang.org/x/sys/unix/zsyscall_linux_amd64.go:76 +0x72 fp=0xc0008ddb18 sp=0xc0008ddaa8 pc=0x56a642
Jul 21 16:20:11 angeli crio[41277]: github.com/fsnotify/fsnotify.(*fdPoller).wait(0xc000855d60, 0x0, 0x0, 0x0)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/fsnotify/fsnotify/inotify_poller.go:86 +0x91 fp=0xc0008ddbe0 sp=0xc0008ddb18 pc=0xd789a1
Jul 21 16:20:11 angeli crio[41277]: github.com/fsnotify/fsnotify.(*Watcher).readEvents(0xc000421a40)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/fsnotify/fsnotify/inotify.go:192 +0x1f8 fp=0xc0008edfd8 sp=0xc0008ddbe0 pc=0xd77ba8
Jul 21 16:20:11 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0008edfe0 sp=0xc0008edfd8 pc=0x468ca1
Jul 21 16:20:11 angeli crio[41277]: created by github.com/fsnotify/fsnotify.NewWatcher
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/fsnotify/fsnotify/inotify.go:59 +0x1a5
Jul 21 16:20:11 angeli crio[41277]: goroutine 530 [IO wait]:
Jul 21 16:20:11 angeli crio[41277]: runtime.gopark(0x209bc60, 0x7f53e2c7d1f0, 0xc0006c1b02, 0x5)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc0009f58d8 sp=0xc0009f58b8 pc=0x43b540
Jul 21 16:20:11 angeli crio[41277]: runtime.netpollblock(0x7f53e2c7d1c8, 0x72, 0xc000986000)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/netpoll.go:419 +0x9a fp=0xc0009f5910 sp=0xc0009f58d8 pc=0x4344fa
Jul 21 16:20:11 angeli crio[41277]: internal/poll.runtime_pollWait(0x7f53e2c7d1c8, 0x72, 0xffffffffffffffff)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/netpoll.go:203 +0x55 fp=0xc0009f5938 sp=0xc0009f5910 pc=0x433a65
Jul 21 16:20:11 angeli crio[41277]: internal/poll.(*pollDesc).wait(0xc00013e298, 0x72, 0x1000, 0x1000, 0xffffffffffffffff)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_poll_runtime.go:87 +0x45 fp=0xc0009f5968 sp=0xc0009f5938 pc=0x4d29e5
Jul 21 16:20:11 angeli crio[41277]: internal/poll.(*pollDesc).waitRead(...)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_poll_runtime.go:92
Jul 21 16:20:11 angeli crio[41277]: internal/poll.(*FD).Read(0xc00013e280, 0xc000986000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/internal/poll/fd_unix.go:169 +0x19b fp=0xc0009f59d8 sp=0xc0009f5968 pc=0x4d387b
Jul 21 16:20:11 angeli crio[41277]: net.(*netFD).Read(0xc00013e280, 0xc000986000, 0x1000, 0x1000, 0xe7791f701, 0xc0009f5a88, 0xc00006d180)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/net/fd_unix.go:202 +0x4f fp=0xc0009f5a38 sp=0xc0009f59d8 pc=0x7628df
Jul 21 16:20:11 angeli crio[41277]: net.(*conn).Read(0xc000134048, 0xc000986000, 0x1000, 0x1000, 0x0, 0x0, 0x0)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/net/net.go:184 +0x8e fp=0xc0009f5a98 sp=0xc0009f5a38 pc=0x77668e
Jul 21 16:20:11 angeli crio[41277]: github.com/soheilhy/cmux.(*bufferedReader).Read(0xc0004e2160, 0xc000986000, 0x1000, 0x1000, 0x0, 0x0, 0xc000036038)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/soheilhy/cmux/buffer.go:53 +0x12c fp=0xc0009f5b00 sp=0xc0009f5a98 pc=0x1ac419c
Jul 21 16:20:11 angeli crio[41277]: github.com/soheilhy/cmux.(*MuxConn).Read(0xc0004e2150, 0xc000986000, 0x1000, 0x1000, 0x209acd8, 0xc0009f5bc8, 0x776e69)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/soheilhy/cmux/cmux.go:260 +0x4f fp=0xc0009f5b48 sp=0xc0009f5b00 pc=0x1ac551f
Jul 21 16:20:11 angeli crio[41277]: net/http.(*connReader).Read(0xc000036030, 0xc000986000, 0x1000, 0x1000, 0xc0009f5c08, 0x1ac708a, 0xc000134048)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/net/http/server.go:786 +0xf4 fp=0xc0009f5ba8 sp=0xc0009f5b48 pc=0x9d71a4
Jul 21 16:20:11 angeli crio[41277]: bufio.(*Reader).fill(0xc000222060)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/bufio/bufio.go:100 +0x103 fp=0xc0009f5bf8 sp=0xc0009f5ba8 pc=0x512203
Jul 21 16:20:11 angeli crio[41277]: bufio.(*Reader).Peek(0xc000222060, 0x4, 0x18d11cf651, 0x3375880, 0x0, 0x0, 0x3375880)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/bufio/bufio.go:138 +0x4f fp=0xc0009f5c18 sp=0xc0009f5bf8 pc=0x51236f
Jul 21 16:20:11 angeli crio[41277]: net/http.(*conn).serve(0xc0002f00a0, 0x2311360, 0xc0006ce7c0)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/net/http/server.go:1920 +0x9d7 fp=0xc0009f5fc8 sp=0xc0009f5c18 pc=0x9dccd7
Jul 21 16:20:11 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0009f5fd0 sp=0xc0009f5fc8 pc=0x468ca1
Jul 21 16:20:11 angeli crio[41277]: created by net/http.(*Server).Serve
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/net/http/server.go:2933 +0x35c
Jul 21 16:20:11 angeli crio[41277]: goroutine 468 [select]:
Jul 21 16:20:11 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc0002305c8 sp=0xc0002305a8 pc=0x43b540
Jul 21 16:20:11 angeli crio[41277]: runtime.selectgo(0xc000230728, 0xc00023071c, 0x3, 0xc0005806f0, 0xc0005022a0)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc0002306f0 sp=0xc0002305c8 pc=0x44ae83
Jul 21 16:20:11 angeli crio[41277]: github.com/cri-o/cri-o/utils/fifo.OpenFifo.func1(0x0, 0x2311360, 0xc0006c1840, 0xc000223b60)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/fifo/fifo.go:92 +0x11c fp=0xc0002307c0 sp=0xc0002306f0 pc=0x19e406c
Jul 21 16:20:11 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc0002307c8 sp=0xc0002307c0 pc=0x468ca1
Jul 21 16:20:11 angeli crio[41277]: created by github.com/cri-o/cri-o/utils/fifo.OpenFifo
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/fifo/fifo.go:88 +0x1f7
Jul 21 16:20:11 angeli crio[41277]: goroutine 469 [syscall]:
Jul 21 16:20:11 angeli crio[41277]: syscall.Syscall6(0x101, 0xffffffffffffff9c, 0xc0006f2560, 0x80000, 0x0, 0x0, 0x0, 0x0, 0x1000, 0x0)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/syscall/asm_linux_amd64.s:41 +0x5 fp=0xc000079dd0 sp=0xc000079dc8 pc=0x4bd2a5
Jul 21 16:20:11 angeli crio[41277]: syscall.openat(0xffffffffffffff9c, 0xc0001c5360, 0x10, 0x80000, 0xc000000000, 0x411d18, 0x10, 0x1c201e0)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/syscall/zsyscall_linux_amd64.go:68 +0xbb fp=0xc000079e50 sp=0xc000079dd0 pc=0x4b8dbb
Jul 21 16:20:11 angeli crio[41277]: syscall.Open(...)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/syscall/syscall_linux.go:138
Jul 21 16:20:11 angeli crio[41277]: os.openFileNolog(0xc0001c5360, 0x10, 0x0, 0xc000000000, 0x3, 0xc00022c758, 0x40a522)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/os/file_unix.go:200 +0x8f fp=0xc000079eb0 sp=0xc000079e50 pc=0x4ddfbf
Jul 21 16:20:11 angeli crio[41277]: os.OpenFile(0xc0001c5360, 0x10, 0x0, 0x0, 0x0, 0xc000421a90, 0x20993f8)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/os/file.go:307 +0x63 fp=0xc000079ef8 sp=0xc000079eb0 pc=0x4dc0c3
Jul 21 16:20:11 angeli crio[41277]: github.com/cri-o/cri-o/utils/fifo.OpenFifo.func2(0x0, 0xc0006c1880, 0x0, 0xc000223b60, 0x2311360, 0xc0006c1840)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/fifo/fifo.go:110 +0x35f fp=0xc000079fb0 sp=0xc000079ef8 pc=0x19e450f
Jul 21 16:20:11 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000079fb8 sp=0xc000079fb0 pc=0x468ca1
Jul 21 16:20:11 angeli crio[41277]: created by github.com/cri-o/cri-o/utils/fifo.OpenFifo
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/fifo/fifo.go:103 +0x254
Jul 21 16:20:11 angeli crio[41277]: goroutine 470 [select]:
Jul 21 16:20:11 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc00022ddc8 sp=0xc00022dda8 pc=0x43b540
Jul 21 16:20:11 angeli crio[41277]: runtime.selectgo(0xc00022df28, 0xc00022df1c, 0x3, 0x0, 0x0)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc00022def0 sp=0xc00022ddc8 pc=0x44ae83
Jul 21 16:20:11 angeli crio[41277]: github.com/cri-o/cri-o/utils/fifo.OpenFifo.func1(0x0, 0x2311360, 0xc0006c1840, 0xc000223c20)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/fifo/fifo.go:92 +0x11c fp=0xc00022dfc0 sp=0xc00022def0 pc=0x19e406c
Jul 21 16:20:11 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc00022dfc8 sp=0xc00022dfc0 pc=0x468ca1
Jul 21 16:20:11 angeli crio[41277]: created by github.com/cri-o/cri-o/utils/fifo.OpenFifo
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/fifo/fifo.go:88 +0x1f7
Jul 21 16:20:11 angeli crio[41277]: goroutine 471 [syscall]:
Jul 21 16:20:11 angeli crio[41277]: syscall.Syscall6(0x101, 0xffffffffffffff9c, 0xc0006f6080, 0x80000, 0x0, 0x0, 0x0, 0x0, 0x1000, 0x0)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/syscall/asm_linux_amd64.s:41 +0x5 fp=0xc000880dd0 sp=0xc000880dc8 pc=0x4bd2a5
Jul 21 16:20:11 angeli crio[41277]: syscall.openat(0xffffffffffffff9c, 0xc0004c6cb0, 0x10, 0x80000, 0x0, 0x0, 0x0, 0x1c201e0)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/syscall/zsyscall_linux_amd64.go:68 +0xbb fp=0xc000880e50 sp=0xc000880dd0 pc=0x4b8dbb
Jul 21 16:20:11 angeli crio[41277]: syscall.Open(...)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/syscall/syscall_linux.go:138
Jul 21 16:20:11 angeli crio[41277]: os.openFileNolog(0xc0004c6cb0, 0x10, 0x0, 0xc000000000, 0x465650, 0xc0001f9e00, 0xc0007aab71)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/os/file_unix.go:200 +0x8f fp=0xc000880eb0 sp=0xc000880e50 pc=0x4ddfbf
Jul 21 16:20:11 angeli crio[41277]: os.OpenFile(0xc0004c6cb0, 0x10, 0x0, 0x0, 0x0, 0x4, 0xc000502540)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/os/file.go:307 +0x63 fp=0xc000880ef8 sp=0xc000880eb0 pc=0x4dc0c3
Jul 21 16:20:11 angeli crio[41277]: github.com/cri-o/cri-o/utils/fifo.OpenFifo.func2(0x0, 0xc0006c18c0, 0x0, 0xc000223c20, 0x2311360, 0xc0006c1840)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/fifo/fifo.go:110 +0x35f fp=0xc000880fb0 sp=0xc000880ef8 pc=0x19e450f
Jul 21 16:20:11 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000880fb8 sp=0xc000880fb0 pc=0x468ca1
Jul 21 16:20:11 angeli crio[41277]: created by github.com/cri-o/cri-o/utils/fifo.OpenFifo
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/fifo/fifo.go:103 +0x254
Jul 21 16:20:11 angeli crio[41277]: goroutine 472 [select]:
Jul 21 16:20:11 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000885cf8 sp=0xc000885cd8 pc=0x43b540
Jul 21 16:20:11 angeli crio[41277]: runtime.selectgo(0xc000885e68, 0xc000885e58, 0x2, 0xc000754000, 0x40e4cc)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc000885e20 sp=0xc000885cf8 pc=0x44ae83
Jul 21 16:20:11 angeli crio[41277]: github.com/cri-o/cri-o/utils/fifo.(*fifo).Read(0xc000223b60, 0xc000754000, 0x8000, 0x8000, 0x0, 0x0, 0x1)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/fifo/fifo.go:157 +0x16c fp=0xc000885ec8 sp=0xc000885e20 pc=0x19e2c8c
Jul 21 16:20:11 angeli crio[41277]: io.copyBuffer(0x22b9e20, 0xc0004859a0, 0x7f53e0a8d468, 0xc000223b60, 0xc000754000, 0x8000, 0x8000, 0x0, 0x0, 0x0)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/io/io.go:405 +0x122 fp=0xc000885f40 sp=0xc000885ec8 pc=0x4add22
Jul 21 16:20:11 angeli crio[41277]: io.Copy(...)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/io/io.go:364
Jul 21 16:20:11 angeli crio[41277]: github.com/cri-o/cri-o/utils/io.(*ContainerIO).Pipe.func1(0xc0006c17c0, 0xc000b76820)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/io/container_io.go:110 +0xa5 fp=0xc000885fd0 sp=0xc000885f40 pc=0x19e8545
Jul 21 16:20:11 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000885fd8 sp=0xc000885fd0 pc=0x468ca1
Jul 21 16:20:11 angeli crio[41277]: created by github.com/cri-o/cri-o/utils/io.(*ContainerIO).Pipe
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/io/container_io.go:109 +0x71
Jul 21 16:20:11 angeli crio[41277]: goroutine 473 [select]:
Jul 21 16:20:11 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000882cf8 sp=0xc000882cd8 pc=0x43b540
Jul 21 16:20:11 angeli crio[41277]: runtime.selectgo(0xc000882e68, 0xc000882e58, 0x2, 0xc00079c000, 0x40e2fb)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc000882e20 sp=0xc000882cf8 pc=0x44ae83
Jul 21 16:20:11 angeli crio[41277]: github.com/cri-o/cri-o/utils/fifo.(*fifo).Read(0xc000223c20, 0xc00079c000, 0x8000, 0x8000, 0x0, 0x44b700, 0xc000a33ce1)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/fifo/fifo.go:157 +0x16c fp=0xc000882ec8 sp=0xc000882e20 pc=0x19e2c8c
Jul 21 16:20:11 angeli crio[41277]: io.copyBuffer(0x22b9e20, 0xc000485a00, 0x7f53e0a8d468, 0xc000223c20, 0xc00079c000, 0x8000, 0x8000, 0xc000698300, 0xc000948100, 0x0)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/io/io.go:405 +0x122 fp=0xc000882f40 sp=0xc000882ec8 pc=0x4add22
Jul 21 16:20:11 angeli crio[41277]: io.Copy(...)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/io/io.go:364
Jul 21 16:20:11 angeli crio[41277]: github.com/cri-o/cri-o/utils/io.(*ContainerIO).Pipe.func2(0xc0006c17c0, 0xc000b76820)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/io/container_io.go:122 +0xa5 fp=0xc000882fd0 sp=0xc000882f40 pc=0x19e87b5
Jul 21 16:20:11 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000882fd8 sp=0xc000882fd0 pc=0x468ca1
Jul 21 16:20:11 angeli crio[41277]: created by github.com/cri-o/cri-o/utils/io.(*ContainerIO).Pipe
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/utils/io/container_io.go:121 +0xcc
Jul 21 16:20:11 angeli crio[41277]: goroutine 474 [select]:
Jul 21 16:20:11 angeli crio[41277]: runtime.gopark(0x209bce0, 0x0, 0x1809, 0x1)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/proc.go:304 +0xe0 fp=0xc000076b00 sp=0xc000076ae0 pc=0x43b540
Jul 21 16:20:11 angeli crio[41277]: runtime.selectgo(0xc000076ca0, 0xc000076c50, 0x3, 0x1, 0x1d09e00)
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/select.go:316 +0xc73 fp=0xc000076c28 sp=0xc000076b00 pc=0x44ae83
Jul 21 16:20:11 angeli crio[41277]: github.com/containerd/ttrpc.(*Client).dispatch(0xc000215280, 0x2311420, 0xc000037350, 0xc000223d40, 0xc000485b00, 0x1e, 0xc000632e18)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/containerd/ttrpc/client.go:161 +0x301 fp=0xc000076da0 sp=0xc000076c28 pc=0x19a24f1
Jul 21 16:20:11 angeli crio[41277]: github.com/containerd/ttrpc.(*Client).dispatch-fm(0x2311420, 0xc000037350, 0xc000223d40, 0xc000485b00, 0xc000588301, 0xc0004f7b40)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/containerd/ttrpc/client.go:144 +0x52 fp=0xc000076de8 sp=0xc000076da0 pc=0x19a4e52
Jul 21 16:20:11 angeli crio[41277]: github.com/containerd/ttrpc.defaultClientInterceptor(0x2311420, 0xc000037350, 0xc000223d40, 0xc000485b00, 0xc0004f7b30, 0xc0004f7b40, 0x1f, 0xc000953230)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/containerd/ttrpc/interceptor.go:49 +0x4e fp=0xc000076e28 sp=0xc000076de8 pc=0x19a3b0e
Jul 21 16:20:11 angeli crio[41277]: github.com/containerd/ttrpc.(*Client).Call(0xc000215280, 0x2311420, 0xc000037350, 0x1fa7fef, 0x17, 0x1f87212, 0x6, 0x1e61ba0, 0xc00076e9c0, 0x1e61cc0, ...)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/containerd/ttrpc/client.go:130 +0x31d fp=0xc000076ef0 sp=0xc000076e28 pc=0x19a1f8d
Jul 21 16:20:11 angeli crio[41277]: github.com/containerd/containerd/runtime/v2/task.(*taskClient).Create(0xc0001344b8, 0x2311420, 0xc000037350, 0xc00076e9c0, 0x0, 0x0, 0x0)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/vendor/github.com/containerd/containerd/runtime/v2/task/shim.pb.go:3330 +0xbd fp=0xc000076f70 sp=0xc000076ef0 pc=0x19cc87d
Jul 21 16:20:11 angeli crio[41277]: github.com/cri-o/cri-o/internal/oci.(*runtimeVM).CreateContainer.func3(0xc000715090, 0xc00076e9c0, 0xc0008c65a0)
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/internal/oci/runtime_vm.go:142 +0x5c fp=0xc000076fc8 sp=0xc000076f70 pc=0x1a0511c
Jul 21 16:20:11 angeli crio[41277]: runtime.goexit()
Jul 21 16:20:11 angeli crio[41277]:         /usr/lib/go-1.14/src/runtime/asm_amd64.s:1373 +0x1 fp=0xc000076fd0 sp=0xc000076fc8 pc=0x468ca1
Jul 21 16:20:11 angeli crio[41277]: created by github.com/cri-o/cri-o/internal/oci.(*runtimeVM).CreateContainer
Jul 21 16:20:11 angeli crio[41277]:         /home/fidencio/go/src/github.com/cri-o/cri-o/internal/oci/runtime_vm.go:140 +0x7bb

Using the following yml as reproducer:

reproducer
apiVersion: v1
kind: Pod
metadata:
  creationTimestamp: "2020-07-11T17:52:32Z"
  name: reproducer
spec:
  runtimeClassName: kata
  restartPolicy: Never
  containers:
  - command:
    - date
    env:
    - name: PATH
      value: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
    - name: TERM
      value: xterm
    - name: HOSTNAME
    - name: container
      value: podman
    image: docker.io/library/busybox:latest
    name: sadramanujan
    resources: {}
    securityContext:
      allowPrivilegeEscalation: true
      capabilities: {}
      privileged: false
      readOnlyRootFilesystem: false
      seLinuxOptions: {}
    stdin: true
    tty: true

Steps to reproduce the issue:

  1. kubectl create -f /path/to/reproducer.yml
  2. Wait till the pod status changes to "ContainerCreating"
  3. Check journalctl -xe -t kubelet

Describe the results you received:
You'll notice the crash mentioned above

Describe the results you expected:
No crash

Additional information you deem important (e.g. issue happens only occasionally):
This issue was introduced in this commit: 9bf8e53, and I'm running upstream CRI-O against kubernets v1.18.5, which may be the reason of the imcompatibility.

Output of crio --version:

fidencio@angeli ~/go/src/github.com/cri-o/cri-o $ crio --version
crio version 1.19.0-dev
Version:       1.19.0-dev
GitCommit:     44e40787bd85aa61d4ed8099d3a8417af388e787
GitTreeState:  clean
BuildDate:     2020-07-21T16:32:32Z
GoVersion:     go1.14.4
Compiler:      gc
Platform:      linux/amd64
Linkmode:      dynamic

Additional environment details (AWS, VirtualBox, physical, etc.):
Physical k8s setup, setup using kubeadm.

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedDenotes an issue that needs help from a contributor. Must meet "help wanted" guidelines.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions