Skip to content

Replace old Spark Jar integration tests with an acceptance test#5191

Merged
andrewnester merged 3 commits intomainfrom
acc/spark-jar-task
May 6, 2026
Merged

Replace old Spark Jar integration tests with an acceptance test#5191
andrewnester merged 3 commits intomainfrom
acc/spark-jar-task

Conversation

@andrewnester
Copy link
Copy Markdown
Contributor

Changes

Replace old Spark Jar integration tests with an acceptance test

Why

We don't need to test the matric of DBR / Java / Spark versions anymore and instead can just rely on an acceptance test for LTS DBR

Tests

Added an acceptance test which pass on both Cloud and Local

artifacts:
my_java_code:
path: ./myjar
build: "javac PrintArgs.java && jar cvfm PrintArgs.jar META-INF/MANIFEST.MF PrintArgs.class"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

question - do we specifically want to test javac there or can we add a jar directly and then remove JDK requirement from our test suite and github workflows?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We want to make sure here that building with artifacts section actually works, that it produce the artifacts which we can later correctly reference on

Comment thread acceptance/bundle/deploy/spark-jar-task/databricks.yml.tmpl Outdated
@andrewnester andrewnester requested a review from pietern May 6, 2026 11:44
@andrewnester andrewnester temporarily deployed to test-trigger-is May 6, 2026 11:44 — with GitHub Actions Inactive
@andrewnester andrewnester temporarily deployed to test-trigger-is May 6, 2026 11:44 — with GitHub Actions Inactive
@andrewnester andrewnester merged commit e7d7525 into main May 6, 2026
22 of 23 checks passed
@andrewnester andrewnester deleted the acc/spark-jar-task branch May 6, 2026 13:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants