Skip to content

[MEDIUM] Ingestion parse failures silently dropped (DEBUG log level) #46

Description

@Walid-peach

Summary

scripts/ingest_deputies.py:165 catches all parse exceptions and logs them at DEBUG level. In production, this means bad records are silently skipped with no visibility.

Location

except Exception as exc:
    log.debug("Could not parse deputy item: %s — %s", item, exc)

Fix

Raise to WARNING and include a count of skipped records in the final summary log line. Consider emitting a single ERROR if the skip rate exceeds a threshold (e.g. >5% of records).

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions