The config key CPU_RUNTIME_CACHE_CAPACITY is valid and functional when used directly with OpenVINO Runtime:
config = {
"CPU_RUNTIME_CACHE_CAPACITY": "0",
"PERFORMANCE_HINT": "THROUGHPUT"
}
However, if I put this key inside the plugin_config block of OVMS model config JSON, the server fails to start and throws an error log in terminal:
CPU_RUNTIME_CACHE_CAPACITY not found in supported config keys for device: CPU.
OVMS config snippet I used:
"config": {
"name": "vocos",
"base_path": "./models/vocos",
"target_device": "CPU",
"plugin_config": {
"CPU_RUNTIME_CACHE_CAPACITY": "0",
"PERFORMANCE_HINT": "THROUGHPUT"
}
}
Is there an equivalent supported configuration in OVMS to disable the CPU runtime cache (set CPU_RUNTIME_CACHE_CAPACITY to 0)?
The config key
CPU_RUNTIME_CACHE_CAPACITYis valid and functional when used directly with OpenVINO Runtime:However, if I put this key inside the plugin_config block of OVMS model config JSON, the server fails to start and throws an error log in terminal:
CPU_RUNTIME_CACHE_CAPACITY not found in supported config keys for device: CPU.OVMS config snippet I used:
Is there an equivalent supported configuration in OVMS to disable the CPU runtime cache (set
CPU_RUNTIME_CACHE_CAPACITYto0)?