Skip to content

Known issues with repro_script.sh #243

@motiwari

Description

@motiwari

Once fixing #241 , and bumping CONF_MULTIPLIER to 3 we experience the following things that need to be fixed:

  • The classification multipliers are more modest. This can be fixed by copy-pasting the dataset (e.g., 10 times)
  • The Forest CovType results for the MAB solver are still worse than for the EXACT solver. This is consistent with what we wrote in the paper, but we should investigate
  • Get tests to pass
  • Some of the logarithmic scaling plots look worse on MNIST. This is probably due to the data deduplication issue (fixing 4x MNIST -> 1x MNIST)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions