Skip to content

Don't sync test.toml and script as bundle files in acceptance tests - #6843

Merged
denik merged 2 commits into
mainfrom
denik/remove-test-toml
Sep 25, 2026
Merged

denik merged 2 commits into
mainfrom
denik/remove-test-toml

Conversation

@denik

@denik denik commented Sep 25, 2026 •

Copy link
Copy Markdown
Contributor

The acceptance runner copied each test's test.toml into the test dir and wrote the merged entry-point script there too, so bundle deploy/sync picked both up as bundle sources — uploading them to the workspace and inflating every Files: N count.

Skip copying test.toml, and run the merged script from outputDir (a sibling of the bundle dir) with a leading cd "$TEST_TMP_DIR", so relative paths still resolve against the bundle dir and $0 stays script. Drop the now-dead workarounds that only existed to hide these files (.gitignore / sync.exclude / Ignore entries in a few sync, immutable and validate tests), and regenerate the goldens.

Related: #6629

This pull request and its description were written by Isaac.

The acceptance runner copied each test's test.toml into the test dir and wrote
the merged entry-point script there too, so "bundle deploy"/"sync" picked both
up as bundle sources -- uploading them to the workspace and inflating every
"Files: N" count.

Skip copying test.toml, and run the merged script from outputDir (a sibling of
the bundle dir) with a leading `cd "$TEST_TMP_DIR"`, so relative paths still
resolve against the bundle dir and $0 stays "script" (no temp path leaks into
output). Drop the now-dead workarounds that only existed to hide these files
(.gitignore / sync.exclude / Ignore entries in a few sync, immutable and
validate tests), and regenerate the goldens.

Co-authored-by: Isaac <no-reply@databricks.com>
@github-actions github-actions Bot added DABs DABs related issues PyDABs labels Sep 25, 2026
@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Sep 25, 2026 •

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: dd206aa

Run: 36127860493

Env ✅​pass 🙈​skip Time
✅​ aws linux 295 60 6:01
✅​ aws windows 282 62 4:42
✅​ azure linux 294 60 6:08
✅​ azure windows 281 62 4:44
✅​ gcp linux 295 60 6:06
✅​ gcp windows 282 62 6:45
Top 6 slowest tests (at least 2 minutes):
duration env testname
5:28 gcp windows TestAccept
3:55 aws linux TestAccept
3:54 azure linux TestAccept
3:53 gcp linux TestAccept
3:33 aws windows TestAccept
3:24 azure windows TestAccept

@denik
denik marked this pull request as ready for review September 25, 2026 11:00
test.toml is no longer copied into the test dir and out* files live outside
the bundle root, so `exclude: ["out*", "test.toml"]` matched nothing. Remove it;
the deploy still times out on file_to_upload.txt exactly as before.

Co-authored-by: Isaac <no-reply@databricks.com>
@denik
denik enabled auto-merge September 25, 2026 11:09
@denik
denik added this pull request to the merge queue Sep 25, 2026
Merged via the queue into main with commit 0aaf151 Sep 25, 2026
33 checks passed
@denik
denik deleted the denik/remove-test-toml branch September 25, 2026 11:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

DABs DABs related issues PyDABs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants