I am not sure when pybind11 will support building python ABI compatible bindings. I am considering nanobind as an alternative, but I would want to see this issue resolved before that.

In the meantime we can see how much API changes will be needed. At first glance the API seems compatible, and it does have quite some nice features like nanobind_add_stub.