Skip to content

undefined symbol: NVPW_MetricsContext_GetMetricProperties_Begin #1208

@joshuacox

Description

@joshuacox

I have seen #975 and I set:

export CUDA_SOURCE_DIR=/usr/local/cuda-12.9
export PATH="/usr/local/cuda-12.9/bin:$PATH"

after installing 12.9 toolkit

wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/sbsa/cuda-ubuntu2404.pin
sudo mv cuda-ubuntu2404.pin /etc/apt/preferences.d/cuda-repository-pin-600
wget https://developer.download.nvidia.com/compute/cuda/12.9.0/local_installers/cuda-repo-ubuntu2404-12-9-local_12.9.0-575.51.03-1_arm64.deb
sudo dpkg -i cuda-repo-ubuntu2404-12-9-local_12.9.0-575.51.03-1_arm64.deb
sudo cp /var/cuda-repo-ubuntu2404-12-9-local/cuda-*-keyring.gpg /usr/share/keyrings/
sudo apt-get update
sudo apt-get -y install cuda-toolkit-12-9
nvidia-smi            
Fri Dec 19 17:54:01 2025       
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 575.57.08              Driver Version: 575.57.08      CUDA Version: 12.9     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GH200 480GB             On  |   00000009:01:00.0 Off |                    0 |
| N/A   25C    P0             79W /  900W |       0MiB /  97871MiB |      0%      Default |
|                                         |                        |             Disabled |
+-----------------------------------------+------------------------+----------------------+
                                                                                         
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|  No running processes found                                                             |
+-----------------------------------------------------------------------------------------+
uv venv
source .venv/bin/activate
uv pip install torch --reinstall --index-url=https://download.pytorch.org/whl/cu129
uv pip install --reinstall cupti-python setuptools
Resolved 6 packages in 68ms
Prepared 6 packages in 0.30ms
Uninstalled 6 packages in 15ms
Installed 6 packages in 13ms
 ~ cuda-bindings==13.0.0
 ~ cuda-pathfinder==1.3.3
 ~ cupti-python==13.0.0
 ~ numpy==2.3.5
 ~ nvidia-cuda-cupti==13.0.85
 ~ setuptools==80.9.0


$ cmake .
-- ROCM_SOURCE_DIR =
-- Found CUPTI
-- Found NVPERF: Using built-in FindCUDAToolkit target
-- {fmt} version: 11.2.0
-- Build type: Release
-- Kineto: FMT_SOURCE_DIR = /home/user/kineto/libkineto/third_party/fmt
-- ROCTRACER_INCLUDE_DIR = /include/roctracer
-- DYNOLOG_INCLUDE_DIR = /home/user/kineto/libkineto/third_party/dynolog/
-- IPCFABRIC_INCLUDE_DIR = /home/user/kineto/libkineto/third_party/dynolog//dynolog/src/ipcfabric/
-- Configuring done (0.4s)
-- Generating done (0.0s)
-- Build files have been written to: /home/user/kineto/libkineto
$ make
[ 0%] Built target libkineto_defs.bzl
[ 54%] Built target kineto_base
[ 57%] Built target kineto_api
[ 59%] Built target kineto
[ 63%] Built target fmt
[ 67%] Built target gtest
[ 70%] Built target gmock
[ 73%] Built target gmock_main
[ 77%] Built target gtest_main
[ 78%] Linking CXX executable ConfigTest
/home/user/kineto/libkineto/test/ConfigTest: symbol lookup error: /home/user/kineto/libkineto/test/ConfigTest: undefined symbol: NVPW_MetricsContext_GetMetricProperties_Begin
CMake Error at /usr/share/cmake-3.28/Modules/GoogleTestAddTests.cmake:112 (message):
Error running test executable.

Path: '/home/user/kineto/libkineto/test/ConfigTest'
Result: 127
Output:

Call Stack (most recent call first):
/usr/share/cmake-3.28/Modules/GoogleTestAddTests.cmake:225 (gtest_discover_tests_impl)

make[2]: *** [test/CMakeFiles/ConfigTest.dir/build.make:173: test/ConfigTest] Error 1
make[2]: *** Deleting file 'test/ConfigTest'
make[1]: *** [CMakeFiles/Makefile2:446: test/CMakeFiles/ConfigTest.dir/all] Error 2
make: *** [Makefile:146: all] Error 2


Where is this `NVPW_MetricsContext_GetMetricProperties_Begin` symbol?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions