Skip to content

CPU_RUNTIME_CACHE_CAPACITY is unsupported in OVMS plugin_config but works in raw OpenVINO Runtime #4299

Description

@Isochronism

The config key CPU_RUNTIME_CACHE_CAPACITY is valid and functional when used directly with OpenVINO Runtime:

config = {
    "CPU_RUNTIME_CACHE_CAPACITY": "0",
    "PERFORMANCE_HINT": "THROUGHPUT"
}

However, if I put this key inside the plugin_config block of OVMS model config JSON, the server fails to start and throws an error log in terminal:
CPU_RUNTIME_CACHE_CAPACITY not found in supported config keys for device: CPU.

OVMS config snippet I used:

"config": {
  "name": "vocos",
  "base_path": "./models/vocos",
  "target_device": "CPU",
  "plugin_config": {
    "CPU_RUNTIME_CACHE_CAPACITY": "0",
    "PERFORMANCE_HINT": "THROUGHPUT"
  }
}

Is there an equivalent supported configuration in OVMS to disable the CPU runtime cache (set CPU_RUNTIME_CACHE_CAPACITY to 0)?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions