Python 3.12 support - RuntimeError #2299

Toaster192 · 2023-08-08T14:19:03Z

Problem Statement

Tried using sentry with python 3.12. Ran into newly implemented RuntimeError tests. Want to give a heads up for once there is 3.12 (hopefuly after 3.11 #1950 🤞 ) support that this is something that will probably need fixing(?)

Example traceback (source):

Exception ignored in atexit callback: <function AtexitIntegration.setup_once.<locals>._shutdown at 0x7fa77fa24e00>
Traceback (most recent call last):
  File "/builds/4704997395/software/venv/lib64/python3.12/site-packages/sentry_sdk/integrations/atexit.py", line 61, in _shutdown
    client.close(callback=integration.callback)
  File "/builds/4704997395/software/venv/lib64/python3.12/site-packages/sentry_sdk/client.py", line 580, in close
    self.flush(timeout=timeout, callback=callback)
  File "/builds/4704997395/software/venv/lib64/python3.12/site-packages/sentry_sdk/client.py", line 604, in flush
    self.transport.flush(timeout=timeout, callback=callback)
  File "/builds/4704997395/software/venv/lib64/python3.12/site-packages/sentry_sdk/transport.py", line 525, in flush
    self._worker.submit(lambda: self._flush_client_reports(force=True))
  File "/builds/4704997395/software/venv/lib64/python3.12/site-packages/sentry_sdk/worker.py", line 117, in submit
    self._ensure_thread()
  File "/builds/4704997395/software/venv/lib64/python3.12/site-packages/sentry_sdk/worker.py", line 42, in _ensure_thread
    self.start()
  File "/builds/4704997395/software/venv/lib64/python3.12/site-packages/sentry_sdk/worker.py", line 70, in start
    self._thread.start()
  File "/builds/4704997395/software/venv/lib64/python3.12/site-packages/sentry_sdk/integrations/threading.py", line 56, in sentry_start
    return old_start(self, *a, **kw)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib64/python3.12/threading.py", line 971, in start
    _start_new_thread(self._bootstrap, ())
RuntimeError: can't create new thread at interpreter shutdown

cpython commit adding this "detection": python/cpython@ce558e6

Solution Brainstorm

Some sort of "graceful shutdown" on exit perhaps?

The text was updated successfully, but these errors were encountered:

Toaster192 · 2023-08-08T14:22:18Z

We got to work around this by closing sentry manually at the end of our programs 🤷

sentrivana · 2023-08-08T15:03:06Z

Thanks for the heads up @Toaster192!

jnoordsij · 2023-10-03T08:26:11Z

Would be great to have this fixed now that Python 3.12 is officially released.

sentrivana · 2023-10-03T12:22:02Z

Agreed @jnoordsij. We're currently figuring out what we need to fix for 3.12, this is definitely on the list.

ThiefMaster · 2023-10-06T15:45:47Z

Looking at #1950, is there some hope hat it will not take month(s) for 3.12 support? Even more so considering that 3.11 was just about (non-technical) metadata, while there's an actual issue with 3.12 right now which is not necessarily a blocker but at least a bit annoying when an application has CLI tools for example where this exception gets raised.

antonpirker · 2023-10-09T06:52:41Z

We have a PR open for supporting 3.12, but we can not give you an estimate on when it will be merged/released:

#2408

robd003 · 2023-10-15T01:46:35Z

I'm also seeing this issue when terminating a Sanic server

^C[2023-10-14 15:38:55 -0400] [18739] [INFO] Received signal SIGINT. Shutting down.
[2023-10-14 15:38:55 -0400] [18739] [INFO] Server Stopped
Exception ignored in atexit callback: <function AtexitIntegration.setup_once.<locals>._shutdown at 0x103eb0c20>
Traceback (most recent call last):
  File "/Users/robd/code/allfactors-sanic/env/lib/python3.12/site-packages/sentry_sdk/integrations/atexit.py", line 61, in _shutdown
    client.close(callback=integration.callback)
  File "/Users/robd/code/allfactors-sanic/env/lib/python3.12/site-packages/sentry_sdk/client.py", line 618, in close
    self.flush(timeout=timeout, callback=callback)
  File "/Users/robd/code/allfactors-sanic/env/lib/python3.12/site-packages/sentry_sdk/client.py", line 646, in flush
    self.transport.flush(timeout=timeout, callback=callback)
  File "/Users/robd/code/allfactors-sanic/env/lib/python3.12/site-packages/sentry_sdk/transport.py", line 549, in flush
    self._worker.submit(lambda: self._flush_client_reports(force=True))
  File "/Users/robd/code/allfactors-sanic/env/lib/python3.12/site-packages/sentry_sdk/worker.py", line 117, in submit
    self._ensure_thread()
  File "/Users/robd/code/allfactors-sanic/env/lib/python3.12/site-packages/sentry_sdk/worker.py", line 42, in _ensure_thread
    self.start()
  File "/Users/robd/code/allfactors-sanic/env/lib/python3.12/site-packages/sentry_sdk/worker.py", line 70, in start
    self._thread.start()
  File "/Users/robd/code/allfactors-sanic/env/lib/python3.12/site-packages/sentry_sdk/integrations/threading.py", line 56, in sentry_start
    return old_start(self, *a, **kw)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/python@3.12/3.12.0/Frameworks/Python.framework/Versions/3.12/lib/python3.12/threading.py", line 971, in start
    _start_new_thread(self._bootstrap, ())
RuntimeError: can't create new thread at interpreter shutdown
Traceback (most recent call last):
  File "/Users/robd/code/allfactors-sanic/src/af_events.py", line 1455, in <module>
    app.run(host='0.0.0.0', port=8081, workers=2, access_log=False, debug=False)
  File "/Users/robd/code/allfactors-sanic/env/lib/python3.12/site-packages/sanic/mixins/startup.py", line 209, in run
    serve(primary=self)  # type: ignore
    ^^^^^^^^^^^^^^^^^^^
  File "/Users/robd/code/allfactors-sanic/env/lib/python3.12/site-packages/sanic/mixins/startup.py", line 880, in serve
    sock.shutdown(SHUT_RDWR)
OSError: [Errno 57] Socket is not connected
Sentry is attempting to send 2 pending events

ethrgeist · 2023-10-20T07:47:58Z

This also occurs when running migrations in Django.

python .\src\manage.py migrate
2023-10-20 09:44:42,475 DEBUG __init__: couldn't import psycopg 'c' implementation: No module named 'psycopg_c'
Operations to perform:
  Apply all migrations: <bunch of apps>
Running migrations:
  No migrations to apply.
Exception ignored in atexit callback: <function AtexitIntegration.setup_once.<locals>._shutdown at 0x000001F382D9B380>
Traceback (most recent call last):
  File "C:\Users\user\.virtualenvs\sad-django\Lib\site-packages\sentry_sdk\integrations\atexit.py", line 61, in _shutdown
    client.close(callback=integration.callback)
  File "C:\Users\user\.virtualenvs\sad-django\Lib\site-packages\sentry_sdk\client.py", line 618, in close
    self.flush(timeout=timeout, callback=callback)
  File "C:\Users\user\.virtualenvs\sad-django\Lib\site-packages\sentry_sdk\client.py", line 646, in flush
    self.transport.flush(timeout=timeout, callback=callback)
  File "C:\Users\user\.virtualenvs\sad-django\Lib\site-packages\sentry_sdk\transport.py", line 549, in flush
    self._worker.submit(lambda: self._flush_client_reports(force=True))
  File "C:\Users\user\.virtualenvs\sad-django\Lib\site-packages\sentry_sdk\worker.py", line 117, in submit
    self._ensure_thread()
  File "C:\Users\user\.virtualenvs\sad-django\Lib\site-packages\sentry_sdk\worker.py", line 42, in _ensure_thread
    self.start()
  File "C:\Users\user\.virtualenvs\sad-django\Lib\site-packages\sentry_sdk\worker.py", line 70, in start
    self._thread.start()
  File "C:\Users\user\.virtualenvs\sad-django\Lib\site-packages\sentry_sdk\integrations\threading.py", line 56, in sentry_start
    return old_start(self, *a, **kw)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "c:\users\user\.pyenv\pyenv-win\versions\3.12.0\Lib\threading.py", line 971, in start
    _start_new_thread(self._bootstrap, ())
RuntimeError: can't create new thread at interpreter shutdown

ThiefMaster · 2023-10-20T07:49:09Z

Yes, I think it always happens when the Python interpreter exits while the sentry SDK is 'active'...

antonpirker · 2023-10-23T10:42:14Z

Thanks for all the input! We will try to tackle this soon!

antonpirker · 2023-10-31T12:45:03Z

Hey everybody,
we just released an update that should fix this problem: https://github.com/getsentry/sentry-python/releases/tag/1.33.0

Could you give it a try @Toaster192 @robd003 and @ethrgeist ?

ethrgeist · 2023-10-31T12:51:55Z

Looks good, CLI and reload spam is gone, thank you very much!

8000

shikharvaish28 · 2024-04-01T10:10:14Z

Hi team, I am getting this error everytime a program has to exit:

I am using python 3.12 and sentry-sdk==1.14.0

Exception ignored in atexit callback: <function AtexitIntegration.setup_once.<locals>._shutdown at 0x7f1cc3949940>
Traceback (most recent call last):
  File "/opt/dataDumper/myenv/lib/python3.12/site-packages/sentry_sdk/integrations/atexit.py", line 62, in _shutdown
    client.close(callback=integration.callback)
  File "/opt/dataDumper/myenv/lib/python3.12/site-packages/sentry_sdk/client.py", line 482, in close
    self.flush(timeout=timeout, callback=callback)
  File "/opt/dataDumper/myenv/lib/python3.12/site-packages/sentry_sdk/client.py", line 504, in flush
    self.transport.flush(timeout=timeout, callback=callback)
  File "/opt/dataDumper/myenv/lib/python3.12/site-packages/sentry_sdk/transport.py", line 492, in flush
    self._worker.submit(lambda: self._flush_client_reports(force=True))
  File "/opt/dataDumper/myenv/lib/python3.12/site-packages/sentry_sdk/worker.py", line 113, in submit
    self._ensure_thread()
  File "/opt/dataDumper/myenv/lib/python3.12/site-packages/sentry_sdk/worker.py", line 42, in _ensure_thread
    self.start()
  File "/opt/dataDumper/myenv/lib/python3.12/site-packages/sentry_sdk/worker.py", line 70, in start
    self._thread.start()
  File "/opt/dataDumper/myenv/lib/python3.12/site-packages/sentry_sdk/integrations/threading.py", line 54, in sentry_start
    return old_start(self, *a, **kw)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/threading.py", line 992, in start
    _start_new_thread(self._bootstrap, ())
RuntimeError: can't create new thread at interpreter shutdown

ddelange · 2024-04-01T10:12:32Z

the fix was released in 1.33.0

Toaster192 added the enhancement label Aug 8, 2023

getsantry bot added the Waiting for: Product Owner label Aug 8, 2023

getsantry bot added this to GitHub Issues with 👀 Aug 8, 2023

getsantry bot removed the Waiting for: Product Owner label Aug 8, 2023

getsantry bot moved this to Waiting for: Product Owner in GitHub Issues with 👀 Aug 8, 2023

getsantry bot added the Waiting for: Product Owner label Aug 8, 2023

sentrivana removed the Waiting for: Product Owner label Aug 8, 2023

getsantry bot removed the Waiting for: Product Owner label Aug 8, 2023

getsantry bot removed the status in GitHub Issues with 👀 Aug 8, 2023

sentrivana added the Python:3.12 label Aug 8, 2023

getsantry bot added the Waiting for: Product Owner label Oct 3, 2023

getsantry bot moved this to Waiting for: Product Owner in GitHub Issues with 👀 Oct 3, 2023

sentrivana added this to the Python 3.12 Support milestone Oct 3, 2023

getsantry bot removed the Waiting for: Product Owner label Oct 3, 2023

getsantry bot removed the status in GitHub Issues with 👀 Oct 3, 2023

ThiefMaster mentioned this issue Oct 5, 2023

Support Python 3.12 and include it in CI runs indico/indico#5978

Merged

18 tasks

getsantry bot added the Waiting for: Product Owner label Oct 6, 2023

getsantry bot moved this to Waiting for: Product Owner in GitHub Issues with 👀 Oct 6, 2023

getsantry bot removed the Waiting for: Product Owner label Oct 9, 2023

getsantry bot removed the status in GitHub Issues with 👀 Oct 9, 2023

getsantry bot added the Waiting for: Product Owner label Oct 15, 2023

getsantry bot moved this to Waiting for: Product Owner in GitHub Issues with 👀 Oct 15, 2023

antonpirker removed the Waiting for: Product Owner label Oct 16, 2023

getsantry bot removed the status in GitHub Issues with 👀 Oct 16, 2023

getsantry bot added the Waiting for: Product Owner label Oct 20, 2023

getsantry bot moved this to Waiting for: Product Owner in GitHub Issues with 👀 Oct 20, 2023

ethrgeist mentioned this issue Oct 20, 2023

Sentry SDK aktuell nicht Python 3.12 kompatibel clabs/rockon#169

Closed

getsantry bot removed the Waiting for: Product Owner label Oct 23, 2023

getsantry bot removed the status in GitHub Issues with 👀 Oct 23, 2023

sentrivana self-assigned this Oct 23, 2023

sentrivana mentioned this issue Oct 25, 2023

Support Python 3.12 #2408

Closed

foarsitter mentioned this issue Oct 25, 2023

Python 3.12 cookiecutter/cookiecutter-django#4644

Closed

mitsuhiko mentioned this issue Oct 28, 2023

feat: Detect interpreter in shutdown state on thread spawn #2468

Merged

stephanie-anderson assigned antonpirker Oct 30, 2023

antonpirker closed this as completed in #2468 Oct 30, 2023

sentrivana mentioned this issue Nov 2, 2023

Officially support Python 3.12 #2480

Closed

4 tasks

linbuxiao mentioned this issue Nov 8, 2023

[Bug]: 在python3.12下运行的时候，按CTRL+c终止运行时会产生报错 TeamPGM/PagerMaid-Pyro#63

Closed

4 tasks

euri10 mentioned this issue Jan 11, 2024

3.12 upgrade > RuntimeError: can't start new thread #2632

Closed

bartfeenstra mentioned this issue Jan 15, 2024

macOS builds fail bartfeenstra/betty#1173

Closed

damies13 mentioned this issue Feb 18, 2024

ModuleNotFoundError: When running RFSwarm-Agent on Python 3.12 damies13/rfswarm#177

Closed

jgoclawski mentioned this issue Jun 5, 2024

Fix closing asynchronous handler on Python 3.12. fluent/fluent-logger-python#207

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Python 3.12 support - RuntimeError #2299

Python 3.12 support - RuntimeError #2299

Python 3.12 support - RuntimeError #2299

Python 3.12 support - RuntimeError #2299

Comments

Problem Statement

Solution Brainstorm