Skip to content

log metrics for metis uploads - #1481

Closed
amadeovezz wants to merge 1 commit into
masterfrom
measure-upload
Closed

log metrics for metis uploads#1481
amadeovezz wants to merge 1 commit into
masterfrom
measure-upload

Conversation

@amadeovezz

Copy link
Copy Markdown
Contributor

Minimal change set to get some metrics in prod for metis uploads

@amadeovezz amadeovezz changed the title add started_at to uploads, log metrics log metrics for metis uploads Mar 13, 2026
"upload_complete project=#{project_name} bucket=#{bucket.name} " \
"file=#{file_name} size_bytes=#{data_block.size} " \
"duration_seconds=#{'%.3f' % duration} bytes_per_sec=#{bps}"
)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

seems to just send this to stdout rather than to the ledger? Those logs are pretty ephemeral.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I didn't want to an a upload_started_at column to the ledger model just for this use case. I thought you were just testing one off use cases that you would be manually monitoring?

If we want something query-able we will need a different strategy

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i thought we were putting this in the ledger so we could monitor upload speeds in general, i can always time client-side for one-off use cases. It should be pretty straightforward to just send the same content to the ledger instead of stdout, no?

@amadeovezz

Copy link
Copy Markdown
Contributor Author

closed - work is moving to #1462

@amadeovezz amadeovezz closed this Mar 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants