Skip to content

Reproducing Multigrain subset results #10

Description

@illizard

Hi, I'm trying to reproduce the baseline following the step provided in the below link.
( https://github.com/facebookresearch/isc2021/blob/main/docs/4_multigrain_subset.md )
I strictly followed the steps without any modification of the given code.
However, for my case, the result seems far different from the doc.

It supposed to be:
Average Precision: 0.56314
Recall at P90 : 0.41374
Threshold at P90 : -1.51692
Recall at rank 1: 0.60970
Recall at rank 10: 0.70827

But I got:
Track 2 running matching of 4991 queries in 4991 database (1500D descriptors), max_results=500000.
Evaluating 499999 predictions (4991 GT matches)
Average Precision: 0.09594
Recall at P90 : 0.07113
Threshold at P90 : -1.52351
Recall at rank 1: 0.10258
Recall at rank 10: 0.12022

I really have no idea on the incorrect result.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions