Repository navigation
Multiprocessing not propagating -Xfrozen_modules=off #106723
Description
Bug report
After python3.11 changes around frozen imports, when using multiprocessing contexts other than fork, the newly added -Xfrozen_modules=off isn't passed to spawned process interpreters.
Simple snippet demonstrating the issue:
"""
$ python -Xfrozen_modules=off test.py
main: {'frozen_modules': 'off'}
forkserver: {}
spawn: {}
fork: {'frozen_modules': 'off'}
"""
import sys
import multiprocessing
def xoptions():
return sys._xoptions
def main():
print('main:', xoptions())
for ctx in ('forkserver', 'spawn', 'fork'):
with multiprocessing.get_context(ctx).Pool(1) as pool:
print(f'{ctx}:', pool.apply(xoptions))
if __name__ == '__main__':
main()The issue seems to be subprocess._args_from_interpreter_flags not honoring frozen_modules key from sys._xoptions.
$ python -Xfrozen_modules=off -c 'import subprocess;print(subprocess._args_from_interpreter_flags())'
[]Your environment
python 3.11.4
Activity
gh-106723: forward -Xfrozen_modules option to spawned process interpr…
pythongh-106723: forward -Xfrozen_modules option to spawned process i…
pythongh-106723: forward -Xfrozen_modules option to spawned process i…
[3.11] gh-106723: forward -Xfrozen_modules option to spawned process …
[3.12] gh-106723: forward -Xfrozen_modules option to spawned process …