Skip to content

Decide gold-corpus licensing and publication plan before v1.0 #899

Description

@medelman17

The antecedent annotator (#829) will produce a gold corpus of labeled Id./supra → antecedent links. Before v1.0 ships, we need a deliberate decision on how that corpus is released, since publication is not reversible.

Options, in no particular order:

  1. Full release — publish all labels (e.g. CC-BY) alongside the repo's existing committed corpus fixtures
  2. Benchmark split — publish a versioned dev/test benchmark subset; keep the remainder as a held-out evaluation set
  3. Defer — keep the corpus unpublished for now and revisit after v1.0

Considerations to settle as part of the decision: license for the labels (source opinions are public-domain via CourtListener), dev/test split discipline if any subset is published, whether the resolver-accuracy CI net needs public data to run on fork PRs, and versioning of the corpus artifact.

No action needed until v1.0 launch planning; filing now so the decision point doesn't get lost.

🤖 Generated with Claude Code

Metadata

Metadata

Assignees

No one assigned

    Labels

    ready-for-humanNeeds human implementation (judgment/design/manual testing)

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions