Compatibility on NPU? #66
Description
Is APE compatible with NPU?
I'm using torch 2.1.0 and torch-npu 2.1.0 with all packages in requirements installed.
On a 910B3 x 8 device.
uname -a
Linux localhost.localdomain 5.10.0-136.12.0.86.h1032.eulerosv2r12.aarch64 #1 SMP Wed Jun 28 18:34:50 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux
When I run python demo/ape_service.py, I encountered error below:
Traceback (most recent call last):
File "/home/code/Video-RAG-master/APE-main/demo/ape_service.py", line 36, in <module>
main()
File "/home/code/Video-RAG-master/APE-main/demo/ape_service.py", line 8, in main
demo = VisualizationDemo(cfg, args=None)
File "/home/code/Video-RAG-master/APE-main/demo/predictor_lazy.py", line 177, in __init__
self.predictor = DefaultPredictor(cfg)
File "/home/code/Video-RAG-master/APE-main/ape/engine/defaults.py", line 190, in __init__
self.model.to("npu")
File "/home/ma-user/anaconda3/envs/llava/lib/python3.10/site-packages/torch_npu/utils/module.py", line 60, in to
self.cast_weight(device)
File "/home/ma-user/anaconda3/envs/llava/lib/python3.10/site-packages/torch_npu/utils/module.py", line 119, in cast_weight
_format_cast(self, current_class)
File "/home/ma-user/anaconda3/envs/llava/lib/python3.10/site-packages/torch_npu/utils/module.py", line 86, in _format_cast
if torch.npu.is_jit_compile_false():
File "/home/ma-user/anaconda3/envs/llava/lib/python3.10/site-packages/torch_npu/npu/npu_config.py", line 120, in is_jit_compile_false
torch_npu.npu._lazy_init()
File "/home/ma-user/anaconda3/envs/llava/lib/python3.10/site-packages/torch_npu/npu/__init__.py", line 203, in _lazy_init
torch_npu._C._npu_init()
RuntimeError: Failed to set compile option ACL_OP_COMPILER_CACHE_MODE, result = 500001, set value enable