[BUG] zmq.error.ZMQError: Too many open files #61837
Description
Description
Running salt minion on OpenBSD. It works fine for a bit, then stops and requires a restart.
Shows this in the logs:
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/salt/ext/tornado/ioloop.py", line 606, in _run_callback
ret = callback()
File "/usr/local/lib/python3.8/site-packages/salt/ext/tornado/stack_context.py", line 278, in null_wrapper
return fn(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/salt/ext/tornado/ioloop.py", line 628, in _discard_future_result
future.result()
File "/usr/local/lib/python3.8/site-packages/salt/ext/tornado/concurrent.py", line 249, in result
raise_exc_info(self._exc_info)
File "<string>", line 4, in raise_exc_info
File "/usr/local/lib/python3.8/site-packages/salt/ext/tornado/gen.py", line 1064, in run
yielded = self.gen.throw(*exc_info)
File "/usr/local/lib/python3.8/site-packages/salt/transport/zeromq.py", line 1334, in _internal_send_recv
self._init_socket() # re-init the zmq socket (no other way in zmq)
File "/usr/local/lib/python3.8/site-packages/salt/transport/zeromq.py", line 1291, in _init_socket
self.socket = self.context.socket(zmq.REQ)
File "/usr/local/lib/python3.8/site-packages/zmq/sugar/context.py", line 146, in socket
s = self._socket_class(self, socket_type, **kwargs)
File "/usr/local/lib/python3.8/site-packages/zmq/sugar/socket.py", line 59, in __init__
super(Socket, self).__init__(*a, **kw)
File "zmq/backend/cython/socket.pyx", line 328, in zmq.backend.cython.socket.Socket.__init__
zmq.error.ZMQError: Too many open files
Setup
(Please provide relevant configs and/or SLS files (be sure to remove sensitive info. There is no general set-up of Salt.)
Please be as specific as possible and give set-up details.
- [ X] on-prem machine
Steps to Reproduce the behavior
Just generally using salt minion and it'll stop working.
Expected behavior
It to be stable :)
Versions Report
$ salt --versions-report
Salt Version:
Salt: 3003.3
Dependency Versions:
cffi: Not Installed
cherrypy: Not Installed
dateutil: Not Installed
docker-py: Not Installed
gitdb: Not Installed
gitpython: Not Installed
Jinja2: 2.11.3
libgit2: Not Installed
M2Crypto: 0.38.0
Mako: Not Installed
msgpack: 0.6.2
msgpack-pure: Not Installed
mysql-python: Not Installed
pycparser: Not Installed
pycrypto: 3.10.1
pycryptodome: Not Installed
pygit2: Not Installed
Python: 3.8.12 (default, Sep 26 2021, 13:12:50)
python-gnupg: Not Installed
PyYAML: 5.3.1
PyZMQ: 18.0.1
smmap: Not Installed
timelib: Not Installed
Tornado: 4.5.3
ZMQ: 4.3.4
System Versions:
dist: openbsd 7.0
locale: utf-8
machine: amd64
release: 7.0
system: OpenBSD
version: OpenBSD 7.0Additional context
Add any other context about the problem here.