A comprehensive benchmarking suite should be developed for qandle to evaluate performance across a variety of circuit types and execution modes. The suite should:
- Include both sparsely entangled and densely entangled quantum circuits.
- Benchmark both forward passes (gradient-free) and backward passes (with gradients).
- Monitor and report execution speed and peak memory usage for each benchmark run.
- Research and identify the latest high-performance quantum circuit simulation papers and packages for comparison. Ensure these are included as baseline competitors in the suite where feasible.
- Use a separate
uv dependency group for benchmarking to avoid overly complex default dependencies.
This will provide a robust assessment of qandle's capabilities and areas for optimization, and support ongoing performance improvements.
A comprehensive benchmarking suite should be developed for qandle to evaluate performance across a variety of circuit types and execution modes. The suite should:
uvdependency group for benchmarking to avoid overly complex default dependencies.This will provide a robust assessment of qandle's capabilities and areas for optimization, and support ongoing performance improvements.