Skip to content

Feat(lambda): Refactor Extension to a Unified Collector-Based Layer#10

Merged
bardabun merged 74 commits into
mainfrom
feat/unified-lambda-layer
Sep 29, 2025
Merged

Feat(lambda): Refactor Extension to a Unified Collector-Based Layer#10
bardabun merged 74 commits into
mainfrom
feat/unified-lambda-layer

Conversation

@bardabun

@bardabun bardabun commented Aug 14, 2025

Copy link
Copy Markdown

This PR introduces Combined Layers that bundle language instrumentation and a custom embedded OpenTelemetry Collector into a single Lambda layer, alongside a refactored, modernized collector pipeline and build system.

Key changes

  • New telemetryapireceiver: Converts AWS Telemetry API platform events into OTel logs, metrics, and traces.
  • Unified pipeline: All telemetry (platform + app) flows through one collector pipeline with sensible defaults.
  • Combined Layers: Single-layer deployment for Python, Node.js, Java, Ruby, and Go (collector-only for Go).
  • Build system: Production-ready build scripts per language:
    • python: python/src/build-combined.sh
    • nodejs: nodejs/packages/layer/build-combined.sh
    • java: java/build-combined.sh
    • ruby: ruby/build-combined.sh
    • go: go/build-combined.sh
  • Documentation: Additive updates to each language README (no major rewrites) with Combined Layer usage and environment variables (Required vs Optional).

@8naama 8naama left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work! 🎉

I've left some comments, specifically about fork considerations, I think to make merging in the future simpler - we should minimize the amount of changes to existing files where possible. Do you think all changes are worth the trade off?

Comment thread .github/workflows/e2e-go.yml Outdated
Comment thread .github/workflows/e2e-go.yml
Comment thread .github/workflows/e2e-go.yml Outdated
Comment thread .github/workflows/e2e-go.yml Outdated
Comment thread .github/workflows/release-combined-go-lambda-layer.yml
Comment thread collector/config.yaml
Comment thread collector/internal/lifecycle/manager.go
Comment thread collector/receiver/telemetryapireceiver/receiver.go
Comment thread .github/workflows/release-combined-go-lambda-layer.yml Outdated
@bardabun bardabun requested a review from 8naama August 26, 2025 14:16
@bardabun bardabun merged commit 7b0f431 into main Sep 29, 2025
26 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants