Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Multiple new caffe2-related build failures. #73074

Closed
xkszltl opened this issue Feb 18, 2022 · 1 comment
Closed

Multiple new caffe2-related build failures. #73074

xkszltl opened this issue Feb 18, 2022 · 1 comment
Labels
caffe2 module: build Build system issues triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module

Comments

@xkszltl
Copy link
Contributor

xkszltl commented Feb 18, 2022 •
edited by pytorch-bot bot
Loading

🐛 Describe the bug

We hit these in master when building on Debian 11.

[1/6] : && /usr/bin/g++-10 -fdebug-prefix-map='/tmp/scratch'='/usr/local/src' -g1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICAT
E_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-functi
on -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=a
lways -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow -O3 -DNDEBUG -DNDEBUG -rdynamic -pthread binaries/CMakeFiles/run_plan_mpi.dir/ru
n_plan_mpi.cc.o -o bin/run_plan_mpi  -Wl,-rpath,/usr/lib/x86_64-linux-gnu/openmpi/lib:/usr/local/lib:/tmp/scratch/pytorch/build/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:  /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi_cxx.so  /usr/lib/x86_64-linux-gnu/
openmpi/lib/libmpi.so  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libtorch.so" -Wl,--as-needed  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libtorch_cpu.so" -Wl,--as-needed  /usr/local/lib/libprotobuf.so.3.19.4.0  /usr/lib/x86_64-linux-gnu
/libz.so  lib/libc10.so  -pthread  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_lp64.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_gnu_thread.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_core.so  -fopenmp  /usr/lib/x86_64-linux-gnu/
libpthread.so  -lm  /usr/lib/x86_64-linux-gnu/libdl.so  /usr/local/lib/libglog.so.0.4.0  /usr/local/lib/libgflags.so.2.2.2  /usr/local/lib/libunwind.so  -lpthread && :
FAILED: bin/run_plan_mpi 
: && /usr/bin/g++-10 -fdebug-prefix-map='/tmp/scratch'='/usr/local/src' -g1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBI
LE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-function -Wn
o-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always 
-faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow -O3 -DNDEBUG -DNDEBUG -rdynamic -pthread binaries/CMakeFiles/run_plan_mpi.dir/run_plan
_mpi.cc.o -o bin/run_plan_mpi  -Wl,-rpath,/usr/lib/x86_64-linux-gnu/openmpi/lib:/usr/local/lib:/tmp/scratch/pytorch/build/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:  /usr/lib/x86_64-linux-gnu/openmpi/lib/libmpi_cxx.so  /usr/lib/x86_64-linux-gnu/openmp
i/lib/libmpi.so  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libtorch.so" -Wl,--as-needed  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libtorch_cpu.so" -Wl,--as-needed  /usr/local/lib/libprotobuf.so.3.19.4.0  /usr/lib/x86_64-linux-gnu/libz.
so  lib/libc10.so  -pthread  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_lp64.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_gnu_thread.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_core.so  -fopenmp  /usr/lib/x86_64-linux-gnu/libpth
read.so  -lm  /usr/lib/x86_64-linux-gnu/libdl.so  /usr/local/lib/libglog.so.0.4.0  /usr/local/lib/libgflags.so.2.2.2  /usr/local/lib/libunwind.so  -lpthread && :
/usr/bin/ld: binaries/CMakeFiles/run_plan_mpi.dir/run_plan_mpi.cc.o: warning: relocation against `_ZN3fLB37FLAGS_caffe2_print_blob_sizes_at_exitE' in read-only section `.text._ZNSt10unique_ptrIN6caffe29WorkspaceESt14default_deleteIS1_EED2Ev[_ZNSt10unique
_ptrIN6caffe29WorkspaceESt14default_deleteIS1_EED5Ev]'
/usr/bin/ld: binaries/CMakeFiles/run_plan_mpi.dir/run_plan_mpi.cc.o: in function `caffe2::Workspace::~Workspace()':
/usr/local/src/pytorch/build/../caffe2/core/workspace.h:107: undefined reference to `fLB::FLAGS_caffe2_print_blob_sizes_at_exit'
/usr/bin/ld: /usr/local/src/pytorch/build/../caffe2/core/workspace.h:108: undefined reference to `caffe2::Workspace::PrintBlobSizes()'
/usr/bin/ld: binaries/CMakeFiles/run_plan_mpi.dir/run_plan_mpi.cc.o: in function `caffe2::Workspace::Workspace(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, caffe2::Workspace const*)':
/usr/local/src/pytorch/build/../caffe2/core/workspace.h:101: undefined reference to `caffe2::Workspace::bookkeeper()'
/usr/bin/ld: binaries/CMakeFiles/run_plan_mpi.dir/run_plan_mpi.cc.o: in function `main':
/usr/local/src/pytorch/build/../binaries/run_plan_mpi.cc:38: undefined reference to `caffe2::GlobalInit(int*, char***)'
/usr/bin/ld: binaries/CMakeFiles/run_plan_mpi.dir/run_plan_mpi.cc.o: in function `caffe2::ReadProtoFromFile(char const*, google::protobuf::Message*)':
/usr/local/src/pytorch/build/../caffe2/utils/proto_utils.h:137: undefined reference to `caffe2::ReadProtoFromBinaryFile(char const*, google::protobuf::MessageLite*)'
/usr/bin/ld: binaries/CMakeFiles/run_plan_mpi.dir/run_plan_mpi.cc.o: in function `main':
/usr/local/src/pytorch/build/../binaries/run_plan_mpi.cc:43: undefined reference to `caffe2::Workspace::RunPlan(caffe2::PlanDef const&, std::function<bool (int)>)'
/usr/bin/ld: binaries/CMakeFiles/run_plan_mpi.dir/run_plan_mpi.cc.o: in function `caffe2::ReadProtoFromFile(char const*, google::protobuf::Message*)':
/usr/local/src/pytorch/build/../caffe2/utils/proto_utils.h:138: undefined reference to `caffe2::ReadProtoFromTextFile(char const*, google::protobuf::Message*)'
/usr/bin/ld: warning: creating DT_TEXTREL in a PIE
collect2: error: ld returned 1 exit status
[2/6] : && /usr/bin/g++-10 -fdebug-prefix-map='/tmp/scratch'='/usr/local/src' -g1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICAT
E_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-functi
on -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=a
lways -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow -O3 -DNDEBUG -DNDEBUG -rdynamic -pthread binaries/CMakeFiles/convert_image_to_te
nsor.dir/convert_image_to_tensor.cc.o -o bin/convert_image_to_tensor  -Wl,-rpath,/usr/local/lib:/tmp/scratch/pytorch/build/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:  /usr/local/lib/libopencv_highgui.so.4.5.5  /usr/local/lib/libopencv_optflow.so.4.5.5
  /usr/local/lib/libopencv_videoio.so.4.5.5  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libtorch.so" -Wl,--as-needed  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libtorch_cpu.so" -Wl,--as-needed  /usr/local/lib/libprotobuf.so.3.19.4.0  /us
r/lib/x86_64-linux-gnu/libz.so  lib/libc10.so  -pthread  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_lp64.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_gnu_thread.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_core.so  -fopenmp  /usr
/lib/x86_64-linux-gnu/libpthread.so  -lm  /usr/lib/x86_64-linux-gnu/libdl.so  /usr/local/lib/libglog.so.0.4.0  /usr/local/lib/libgflags.so.2.2.2  /usr/local/lib/libunwind.so  -lpthread  /usr/local/lib/libopencv_ximgproc.so.4.5.5  /usr/local/lib/libopencv
_imgcodecs.so.4.5.5  /usr/local/lib/libopencv_video.so.4.5.5  /usr/local/lib/libopencv_calib3d.so.4.5.5  /usr/local/lib/libopencv_features2d.so.4.5.5  /usr/local/lib/libopencv_imgproc.so.4.5.5  /usr/local/lib/libopencv_flann.so.4.5.5  /usr/local/lib/libo
pencv_core.so.4.5.5 && :
FAILED: bin/convert_image_to_tensor 
: && /usr/bin/g++-10 -fdebug-prefix-map='/tmp/scratch'='/usr/local/src' -g1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBI
LE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-function -Wn
o-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always 
-faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow -O3 -DNDEBUG -DNDEBUG -rdynamic -pthread binaries/CMakeFiles/convert_image_to_tensor.d
ir/convert_image_to_tensor.cc.o -o bin/convert_image_to_tensor  -Wl,-rpath,/usr/local/lib:/tmp/scratch/pytorch/build/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:  /usr/local/lib/libopencv_highgui.so.4.5.5  /usr/local/lib/libopencv_optflow.so.4.5.5  /usr
/local/lib/libopencv_videoio.so.4.5.5  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libtorch.so" -Wl,--as-needed  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libtorch_cpu.so" -Wl,--as-needed  /usr/local/lib/libprotobuf.so.3.19.4.0  /usr/lib/
x86_64-linux-gnu/libz.so  lib/libc10.so  -pthread  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_lp64.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_gnu_thread.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_core.so  -fopenmp  /usr/lib/x
86_64-linux-gnu/libpthread.so  -lm  /usr/lib/x86_64-linux-gnu/libdl.so  /usr/local/lib/libglog.so.0.4.0  /usr/local/lib/libgflags.so.2.2.2  /usr/local/lib/libunwind.so  -lpthread  /usr/local/lib/libopencv_ximgproc.so.4.5.5  /usr/local/lib/libopencv_imgco
decs.so.4.5.5  /usr/local/lib/libopencv_video.so.4.5.5  /usr/local/lib/libopencv_calib3d.so.4.5.5  /usr/local/lib/libopencv_features2d.so.4.5.5  /usr/local/lib/libopencv_imgproc.so.4.5.5  /usr/local/lib/libopencv_flann.so.4.5.5  /usr/local/lib/libopencv_
core.so.4.5.5 && :
/usr/bin/ld: binaries/CMakeFiles/convert_image_to_tensor.dir/convert_image_to_tensor.cc.o: in function `caffe2::WriteProtoToBinaryFile(google::protobuf::MessageLite const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > c
onst&)':
/usr/local/src/pytorch/build/../caffe2/utils/proto_utils.h:59: undefined reference to `caffe2::WriteProtoToBinaryFile(google::protobuf::MessageLite const&, char const*)'
/usr/bin/ld: binaries/CMakeFiles/convert_image_to_tensor.dir/convert_image_to_tensor.cc.o: in function `caffe2::WriteProtoToTextFile(google::protobuf::Message const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&,
 bool)':
/usr/local/src/pytorch/build/../caffe2/utils/proto_utils.h:132: undefined reference to `caffe2::WriteProtoToTextFile(google::protobuf::Message const&, char const*, bool)'
/usr/bin/ld: binaries/CMakeFiles/convert_image_to_tensor.dir/convert_image_to_tensor.cc.o: in function `main':
/usr/local/src/pytorch/build/../binaries/convert_image_to_tensor.cc:446: undefined reference to `caffe2::GlobalInit(int*, char***)'
collect2: error: ld returned 1 exit status
[3/6] : && /usr/bin/g++-10 -fdebug-prefix-map='/tmp/scratch'='/usr/local/src' -g1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICAT
E_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-functi
on -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=a
lways -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow -O3 -DNDEBUG -DNDEBUG -rdynamic -pthread binaries/CMakeFiles/make_image_db.dir/m
ake_image_db.cc.o -o bin/make_image_db  -Wl,-rpath,/usr/local/lib:/tmp/scratch/pytorch/build/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:  /usr/local/lib/libopencv_highgui.so.4.5.5  /usr/local/lib/libopencv_optflow.so.4.5.5  /usr/local/lib/libopencv_vid
eoio.so.4.5.5  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libtorch.so" -Wl,--as-needed  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libtorch_cpu.so" -Wl,--as-needed  /usr/local/lib/libprotobuf.so.3.19.4.0  /usr/lib/x86_64-linux-gnu/libz.so
  lib/libc10.so  -pthread  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_lp64.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_gnu_thread.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_core.so  -fopenmp  /usr/lib/x86_64-linux-gnu/libpthre
ad.so  -lm  /usr/lib/x86_64-linux-gnu/libdl.so  /usr/local/lib/libglog.so.0.4.0  /usr/local/lib/libgflags.so.2.2.2  /usr/local/lib/libunwind.so  -lpthread  /usr/local/lib/libopencv_ximgproc.so.4.5.5  /usr/local/lib/libopencv_imgcodecs.so.4.5.5  /usr/loca
l/lib/libopencv_video.so.4.5.5  /usr/local/lib/libopencv_calib3d.so.4.5.5  /usr/local/lib/libopencv_features2d.so.4.5.5  /usr/local/lib/libopencv_imgproc.so.4.5.5  /usr/local/lib/libopencv_flann.so.4.5.5  /usr/local/lib/libopencv_core.so.4.5.5 && :
FAILED: bin/make_image_db 
: && /usr/bin/g++-10 -fdebug-prefix-map='/tmp/scratch'='/usr/local/src' -g1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBI
LE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-function -Wn
o-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always 
-faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow -O3 -DNDEBUG -DNDEBUG -rdynamic -pthread binaries/CMakeFiles/make_image_db.dir/make_im
age_db.cc.o -o bin/make_image_db  -Wl,-rpath,/usr/local/lib:/tmp/scratch/pytorch/build/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:  /usr/local/lib/libopencv_highgui.so.4.5.5  /usr/local/lib/libopencv_optflow.so.4.5.5  /usr/local/lib/libopencv_videoio.s
o.4.5.5  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libtorch.so" -Wl,--as-needed  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libtorch_cpu.so" -Wl,--as-needed  /usr/local/lib/libprotobuf.so.3.19.4.0  /usr/lib/x86_64-linux-gnu/libz.so  lib/
libc10.so  -pthread  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_lp64.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_gnu_thread.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_core.so  -fopenmp  /usr/lib/x86_64-linux-gnu/libpthread.so 
 -lm  /usr/lib/x86_64-linux-gnu/libdl.so  /usr/local/lib/libglog.so.0.4.0  /usr/local/lib/libgflags.so.2.2.2  /usr/local/lib/libunwind.so  -lpthread  /usr/local/lib/libopencv_ximgproc.so.4.5.5  /usr/local/lib/libopencv_imgcodecs.so.4.5.5  /usr/local/lib/
libopencv_video.so.4.5.5  /usr/local/lib/libopencv_calib3d.so.4.5.5  /usr/local/lib/libopencv_features2d.so.4.5.5  /usr/local/lib/libopencv_imgproc.so.4.5.5  /usr/local/lib/libopencv_flann.so.4.5.5  /usr/local/lib/libopencv_core.so.4.5.5 && :
/usr/bin/ld: binaries/CMakeFiles/make_image_db.dir/make_image_db.cc.o: in function `caffe2::db::CreateDB(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std:
:allocator<char> > const&, caffe2::db::Mode)':
/usr/local/src/pytorch/build/../caffe2/core/db.h:136: undefined reference to `caffe2::db::Caffe2DBRegistry[abi:cxx11]()'
/usr/bin/ld: binaries/CMakeFiles/make_image_db.dir/make_image_db.cc.o: in function `main':
/usr/local/src/pytorch/build/../binaries/make_image_db.cc:275: undefined reference to `caffe2::GlobalInit(int*, char***)'
collect2: error: ld returned 1 exit status
[4/6] : && /usr/bin/g++-10 -fdebug-prefix-map='/tmp/scratch'='/usr/local/src' -g1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICAT
E_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-functi
on -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=a
lways -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow -O3 -DNDEBUG -DNDEBUG -rdynamic -pthread binaries/CMakeFiles/convert_encoded_to_
raw_leveldb.dir/convert_encoded_to_raw_leveldb.cc.o -o bin/convert_encoded_to_raw_leveldb  -Wl,-rpath,/usr/local/lib:/tmp/scratch/pytorch/build/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:  /usr/local/lib/libopencv_highgui.so.4.5.5  /usr/local/lib/libop
encv_optflow.so.4.5.5  /usr/local/lib/libopencv_videoio.so.4.5.5  /usr/local/lib/libleveldb.a  /usr/local/lib/libsnappy.so  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libtorch.so" -Wl,--as-needed  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/li
b/libtorch_cpu.so" -Wl,--as-needed  /usr/local/lib/libprotobuf.so.3.19.4.0  /usr/lib/x86_64-linux-gnu/libz.so  lib/libc10.so  -pthread  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_lp64.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_gnu_thr
ead.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_core.so  -fopenmp  /usr/lib/x86_64-linux-gnu/libpthread.so  -lm  /usr/lib/x86_64-linux-gnu/libdl.so  /usr/local/lib/libglog.so.0.4.0  /usr/local/lib/libgflags.so.2.2.2  /usr/local/lib/libunwind.so  
-lpthread  /usr/local/lib/libopencv_ximgproc.so.4.5.5  /usr/local/lib/libopencv_imgcodecs.so.4.5.5  /usr/local/lib/libopencv_video.so.4.5.5  /usr/local/lib/libopencv_calib3d.so.4.5.5  /usr/local/lib/libopencv_features2d.so.4.5.5  /usr/local/lib/libopencv
_imgproc.so.4.5.5  /usr/local/lib/libopencv_flann.so.4.5.5  /usr/local/lib/libopencv_core.so.4.5.5 && :
FAILED: bin/convert_encoded_to_raw_leveldb 
: && /usr/bin/g++-10 -fdebug-prefix-map='/tmp/scratch'='/usr/local/src' -g1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBI
LE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-function -Wn
o-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always 
-faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow -O3 -DNDEBUG -DNDEBUG -rdynamic -pthread binaries/CMakeFiles/convert_encoded_to_raw_le
veldb.dir/convert_encoded_to_raw_leveldb.cc.o -o bin/convert_encoded_to_raw_leveldb  -Wl,-rpath,/usr/local/lib:/tmp/scratch/pytorch/build/lib:/opt/intel/oneapi/mkl/latest/lib/intel64:  /usr/local/lib/libopencv_highgui.so.4.5.5  /usr/local/lib/libopencv_o
ptflow.so.4.5.5  /usr/local/lib/libopencv_videoio.so.4.5.5  /usr/local/lib/libleveldb.a  /usr/local/lib/libsnappy.so  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libtorch.so" -Wl,--as-needed  -Wl,--no-as-needed,"/tmp/scratch/pytorch/build/lib/libt
orch_cpu.so" -Wl,--as-needed  /usr/local/lib/libprotobuf.so.3.19.4.0  /usr/lib/x86_64-linux-gnu/libz.so  lib/libc10.so  -pthread  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_lp64.so  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_gnu_thread.so
  /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_core.so  -fopenmp  /usr/lib/x86_64-linux-gnu/libpthread.so  -lm  /usr/lib/x86_64-linux-gnu/libdl.so  /usr/local/lib/libglog.so.0.4.0  /usr/local/lib/libgflags.so.2.2.2  /usr/local/lib/libunwind.so  -lpthr
ead  /usr/local/lib/libopencv_ximgproc.so.4.5.5  /usr/local/lib/libopencv_imgcodecs.so.4.5.5  /usr/local/lib/libopencv_video.so.4.5.5  /usr/local/lib/libopencv_calib3d.so.4.5.5  /usr/local/lib/libopencv_features2d.so.4.5.5  /usr/local/lib/libopencv_imgpr
oc.so.4.5.5  /usr/local/lib/libopencv_flann.so.4.5.5  /usr/local/lib/libopencv_core.so.4.5.5 && :
/usr/bin/ld: binaries/CMakeFiles/convert_encoded_to_raw_leveldb.dir/convert_encoded_to_raw_leveldb.cc.o: in function `main':
/usr/local/src/pytorch/build/../binaries/convert_encoded_to_raw_leveldb.cc:152: undefined reference to `caffe2::GlobalInit(int*, char***)'
collect2: error: ld returned 1 exit status
[5/6] ccache /usr/bin/g++-10 -DGFLAGS_IS_A_DLL=0 -DGOOGLE_GLOG_DLL_DECL="" -DGOOGLE_GLOG_DLL_DECL_FOR_UNITTESTS="" -DHAVE_MALLOC_USABLE_SIZE=1 -DHAVE_MMAP=1 -DHAVE_SHM_OPEN=1 -DHAVE_SHM_UNLINK=1 -DIDEEP_USE_MKL -DMINIZ_DISABLE_ZIP_READER_CRC32_CHECKS -DO
NNXIFI_ENABLE_EXT=1 -DONNX_ML=1 -DONNX_NAMESPACE=onnx_torch -DUSE_C10D_GLOO -DUSE_C10D_MPI -DUSE_DISTRIBUTED -DUSE_EXTERNAL_MZCRC -DUSE_RPC -DUSE_TENSORPIPE -D_FILE_OFFSET_BITS=64 -I/tmp/scratch/pytorch/build/aten/src -I/tmp/scratch/pytorch/aten/src -I/t
mp/scratch/pytorch/build -I/tmp/scratch/pytorch -I/tmp/scratch/pytorch/cmake/../third_party/benchmark/include -I/tmp/scratch/pytorch/third_party/onnx -I/tmp/scratch/pytorch/build/third_party/onnx -I/tmp/scratch/pytorch/third_party/foxi -I/tmp/scratch/pyt
orch/build/third_party/foxi -I/tmp/scratch/pytorch/torch/csrc/api -I/tmp/scratch/pytorch/torch/csrc/api/include -I/tmp/scratch/pytorch/c10/.. -isystem /tmp/scratch/pytorch/build/third_party/gloo -isystem /tmp/scratch/pytorch/cmake/../third_party/gloo -is
ystem /tmp/scratch/pytorch/cmake/../third_party/googletest/googlemock/include -isystem /tmp/scratch/pytorch/cmake/../third_party/googletest/googletest/include -isystem /opt/intel/oneapi/mkl/latest/include -isystem /tmp/scratch/pytorch/third_party/gemmlow
p -isystem /tmp/scratch/pytorch/third_party/neon2sse -isystem /tmp/scratch/pytorch/third_party/XNNPACK/include -isystem /usr/local/include/opencv4 -isystem /usr/local/include/eigen3 -isystem /usr/lib/x86_64-linux-gnu/openmpi/include -isystem /usr/lib/x86
_64-linux-gnu/openmpi/include/openmpi -isystem /tmp/scratch/pytorch/third_party/ideep/include -fdebug-prefix-map='/tmp/scratch'='/usr/local/src' -g1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DUSE_FB
GEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown
-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-er
ror=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow -O3 -DNDEBUG 
-DNDEBUG -fPIE   -march=native -DCAFFE2_USE_GLOO -DTH_HAVE_THREAD -pthread -std=gnu++14 -MD -MT binaries/CMakeFiles/convert_and_benchmark.dir/convert_and_benchmark.cc.o -MF binaries/CMakeFiles/convert_and_benchmark.dir/convert_and_benchmark.cc.o.d -o bin
aries/CMakeFiles/convert_and_benchmark.dir/convert_and_benchmark.cc.o -c /tmp/scratch/pytorch/binaries/convert_and_benchmark.cc
FAILED: binaries/CMakeFiles/convert_and_benchmark.dir/convert_and_benchmark.cc.o 
ccache /usr/bin/g++-10 -DGFLAGS_IS_A_DLL=0 -DGOOGLE_GLOG_DLL_DECL="" -DGOOGLE_GLOG_DLL_DECL_FOR_UNITTESTS="" -DHAVE_MALLOC_USABLE_SIZE=1 -DHAVE_MMAP=1 -DHAVE_SHM_OPEN=1 -DHAVE_SHM_UNLINK=1 -DIDEEP_USE_MKL -DMINIZ_DISABLE_ZIP_READER_CRC32_CHECKS -DONNXIFI
_ENABLE_EXT=1 -DONNX_ML=1 -DONNX_NAMESPACE=onnx_torch -DUSE_C10D_GLOO -DUSE_C10D_MPI -DUSE_DISTRIBUTED -DUSE_EXTERNAL_MZCRC -DUSE_RPC -DUSE_TENSORPIPE -D_FILE_OFFSET_BITS=64 -I/tmp/scratch/pytorch/build/aten/src -I/tmp/scratch/pytorch/aten/src -I/tmp/scr
atch/pytorch/build -I/tmp/scratch/pytorch -I/tmp/scratch/pytorch/cmake/../third_party/benchmark/include -I/tmp/scratch/pytorch/third_party/onnx -I/tmp/scratch/pytorch/build/third_party/onnx -I/tmp/scratch/pytorch/third_party/foxi -I/tmp/scratch/pytorch/b
uild/third_party/foxi -I/tmp/scratch/pytorch/torch/csrc/api -I/tmp/scratch/pytorch/torch/csrc/api/include -I/tmp/scratch/pytorch/c10/.. -isystem /tmp/scratch/pytorch/build/third_party/gloo -isystem /tmp/scratch/pytorch/cmake/../third_party/gloo -isystem 
/tmp/scratch/pytorch/cmake/../third_party/googletest/googlemock/include -isystem /tmp/scratch/pytorch/cmake/../third_party/googletest/googletest/include -isystem /opt/intel/oneapi/mkl/latest/include -isystem /tmp/scratch/pytorch/third_party/gemmlowp -isy
stem /tmp/scratch/pytorch/third_party/neon2sse -isystem /tmp/scratch/pytorch/third_party/XNNPACK/include -isystem /usr/local/include/opencv4 -isystem /usr/local/include/eigen3 -isystem /usr/lib/x86_64-linux-gnu/openmpi/include -isystem /usr/lib/x86_64-li
nux-gnu/openmpi/include/openmpi -isystem /tmp/scratch/pytorch/third_party/ideep/include -fdebug-prefix-map='/tmp/scratch'='/usr/local/src' -g1 -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DUSE_FBGEMM -
DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragm
as -Wno-sign-compare -Wno-unused-parameter -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=re
dundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Werror=cast-function-type -Wno-stringop-overflow -O3 -DNDEBUG -DNDEB
UG -fPIE   -march=native -DCAFFE2_USE_GLOO -DTH_HAVE_THREAD -pthread -std=gnu++14 -MD -MT binaries/CMakeFiles/convert_and_benchmark.dir/convert_and_benchmark.cc.o -MF binaries/CMakeFiles/convert_and_benchmark.dir/convert_and_benchmark.cc.o.d -o binaries/
CMakeFiles/convert_and_benchmark.dir/convert_and_benchmark.cc.o -c /tmp/scratch/pytorch/binaries/convert_and_benchmark.cc
/tmp/scratch/pytorch/binaries/convert_and_benchmark.cc:34:10: fatal error: observers/net_observer_reporter_print.h: No such file or directory
   34 | #include <observers/net_observer_reporter_print.h>
      |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
ninja: build stopped: subcommand failed.

CMake args in case needed: https://github.com/xkszltl/Roaster/blob/601a110c5c11286113835f1cce2bbdb2bf1e7ff8/pkgs/pytorch.sh#L114-L158

Versions

Current (mid Feb, 2022) master, commit b9ccbe4

cc @malfet @seemethere
@xkszltl
Copy link
Contributor Author

xkszltl commented Feb 18, 2022

BTW we know the regression is after 025cd69 (we have some system pinned on this version as they only have python3.6), but not sure from which one exactly.

xkszltl added a commit to xkszltl/Roaster that referenced this issue Feb 18, 2022
@xkszltl
Pin pytorch version due to a build regression:
5ed7f2e 
- pytorch/pytorch#73074
@mikaylagawarecki mikaylagawarecki added caffe2 module: build Build system issues triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module labels Feb 18, 2022
@drisspg drisspg closed this as completed Oct 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
caffe2 module: build Build system issues triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@xkszltl @drisspg @mikaylagawarecki