Skip to content

List postgres databases during Lakebase plugin selection, add option to ignore fields in bundles - #4634

Merged
pkosiec merged 6 commits into
mainfrom
pkosiec/postgres-db-lister
Mar 9, 2026
Merged

pkosiec merged 6 commits into
mainfrom
pkosiec/postgres-db-lister

Conversation

@pkosiec

@pkosiec pkosiec commented Mar 3, 2026 •

Copy link
Copy Markdown
Member

Changes

  • List postgres databases during Lakebase plugin selection
  • Add "bundleIgnore" field to exclude it from databricks.yml file (for Lakebase, we need a LAKEBASE_ENDPOINT env that shouldn't be listed in the DAB)
  • Fix the prompt title

See also databricks/appkit#132

Resolves https://databricks.atlassian.net/browse/LKB-10074

Testing

Test it together with databricks/appkit#132 -> check it out for the latest template

  1. Build the CLI (make build)
  2. Run the databricks apps init command with custom template (locally cloned one) - replace the path: DATABRICKS_APPKIT_TEMPLATE_PATH="/Users/pawel.kosiec/repositories/databricks-os/appkit/template" dbx apps init
  3. Select Lakebase
  4. Select your project, branch and database
  5. DO NOT deploy your app yet
  6. Move to the databricks.yml
  • Remove the resources.apps.app.resources and all unused variables (postgres_branch, postgres_database).
  1. Deploy the app with databricks apps deploy
  2. Bind the Lakebase project to your App, click "Deploy" button again
  3. App should connect to Lakebase successfully

Demo

init-flow.mov

@pkosiec
pkosiec temporarily deployed to test-trigger-is March 3, 2026 10:16 — with GitHub Actions Inactive
@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Mar 3, 2026 •

Copy link
Copy Markdown
Collaborator

Commit: f2a56d7

Run: 22861936142

Env 🟨​KNOWN 🔄​flaky 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
🟨​ aws linux 7 1 7 268 781 6:24
🟨​ aws windows 7 1 7 270 779 6:01
💚​ aws-ucws linux 8 7 365 696 7:36
🔄​ aws-ucws windows 2 7 7 366 694 6:47
💚​ azure linux 2 9 271 779 5:54
💚​ azure windows 2 9 273 777 5:27
🔄​ azure-ucws linux 2 1 9 369 692 8:17
🔄​ azure-ucws windows 2 1 9 371 690 8:01
💚​ gcp linux 2 9 267 782 5:36
💚​ gcp windows 2 9 269 780 6:06
16 interesting tests: 7 KNOWN, 7 SKIP, 2 flaky
Test Name aws linux aws windows aws-ucws linux aws-ucws windows azure linux azure windows azure-ucws linux azure-ucws windows gcp linux gcp windows
🟨​ TestAccept 🟨​K 🟨​K 💚​R 🔄​f 💚​R 💚​R 🔄​f 💚​R 💚​R 💚​R
🙈​ TestAccept/bundle/resources/permissions 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions 🟨​K 🟨​K 💚​R 💚​R 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct 🟨​K 🟨​K 💚​R 💚​R
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform 🟨​K 🟨​K 💚​R 💚​R
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions 🟨​K 🟨​K 💚​R 💚​R 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct 🟨​K 🟨​K 💚​R 💚​R
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform 🟨​K 🟨​K 💚​R 💚​R
🙈​ TestAccept/bundle/resources/postgres_branches/basic 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_branches/recreate 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_branches/update_protected 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_branches/without_branch_id 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_endpoints/recreate 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/synced_database_tables/basic 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🔄​ TestAccept/ssh/connect-serverless-gpu 🙈​s 🙈​s ✅​p 🔄​f 🙈​s 🙈​s 🔄​f 🔄​f 🙈​s 🙈​s
🔄​ TestAccept/ssh/connection 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 🔄​f 💚​R 💚​R
Top 21 slowest tests (at least 2 minutes):
duration env testname
4:32 azure windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
4:28 gcp windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:41 gcp linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:31 aws-ucws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:27 aws-ucws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:23 gcp linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:20 azure-ucws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:18 azure-ucws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:14 gcp windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:11 aws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:05 aws-ucws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:04 aws-ucws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:54 aws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:52 azure linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:51 aws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:48 aws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:46 azure linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:42 aws-ucws linux TestAccept/ssh/connect-serverless-gpu
2:25 azure-ucws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:14 azure windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:04 azure-ucws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct

@pkosiec
pkosiec force-pushed the pkosiec/postgres-db-lister branch from b31a392 to c8c3c0d Compare March 3, 2026 11:23
@pkosiec
pkosiec changed the base branch from pkosiec/bump-go-sdk to pkosiec/bump-tf March 3, 2026 11:23
@pkosiec
pkosiec temporarily deployed to test-trigger-is March 3, 2026 11:23 — with GitHub Actions Inactive
@pkosiec
pkosiec temporarily deployed to test-trigger-is March 3, 2026 12:09 — with GitHub Actions Inactive
@pkosiec pkosiec changed the title List postgres databases during Lakebase plugin selection List postgres databases during Lakebase plugin selection, add option to ignore fields in bundles Mar 3, 2026
@pkosiec
pkosiec temporarily deployed to test-trigger-is March 4, 2026 13:27 — with GitHub Actions Inactive
@pkosiec
pkosiec temporarily deployed to test-trigger-is March 5, 2026 13:10 — with GitHub Actions Inactive
@pkosiec
pkosiec force-pushed the pkosiec/postgres-db-lister branch from 7bd03bc to e8ec949 Compare March 5, 2026 13:40
@pkosiec
pkosiec changed the base branch from pkosiec/bump-tf to pkosiec/bump-go-sdk March 5, 2026 13:41
@pkosiec
pkosiec marked this pull request as ready for review March 5, 2026 13:41
@pkosiec
pkosiec requested a review from a team as a code owner March 5, 2026 13:41
@calvarjorge
calvarjorge marked this pull request as draft March 6, 2026 13:21
@calvarjorge
calvarjorge marked this pull request as ready for review March 6, 2026 13:21
@pkosiec
pkosiec force-pushed the pkosiec/bump-go-sdk branch from 08a5e25 to 996e407 Compare March 9, 2026 14:14
Base automatically changed from pkosiec/bump-go-sdk to main March 9, 2026 15:35
Revert the description hint and Filtering(true/false) changes in
promptFromListWithLabel and PromptForAppSelection, as these are
addressed properly in PR #4603.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@pkosiec
pkosiec force-pushed the pkosiec/postgres-db-lister branch from e8ec949 to f2a56d7 Compare March 9, 2026 15:50
@pkosiec
pkosiec temporarily deployed to test-trigger-is March 9, 2026 15:50 — with GitHub Actions Inactive
@pkosiec
pkosiec added this pull request to the merge queue Mar 9, 2026
Merged via the queue into main with commit fd9f50e Mar 9, 2026
18 checks passed
@pkosiec
pkosiec deleted the pkosiec/postgres-db-lister branch March 9, 2026 18:44
denik pushed a commit that referenced this pull request May 20, 2026
…to ignore fields in bundles (#4634)

## Changes
- List postgres databases during Lakebase plugin selection
- Add "bundleIgnore" field to exclude it from `databricks.yml` file (for
Lakebase, we need a `LAKEBASE_ENDPOINT` env that shouldn't be listed in
the DAB)
- Fix the prompt title

See also databricks/appkit#132

Resolves https://databricks.atlassian.net/browse/LKB-10074

## Testing

Test it together with databricks/appkit#132 ->
check it out for the latest template

1. Build the CLI (`make build`)
2. Run the `databricks apps init` command with custom template (locally
cloned one) - replace the path:
`DATABRICKS_APPKIT_TEMPLATE_PATH="/Users/pawel.kosiec/repositories/databricks-os/appkit/template"
dbx apps init`
3. Select Lakebase
4. Select your project, branch and database
5. DO NOT deploy your app yet
6. Move to the `databricks.yml`
- Remove the `resources.apps.app.resources` and all unused variables
(`postgres_branch`, `postgres_database`).
7. Deploy the app with `databricks apps deploy`
8. Bind the Lakebase project to your App, click "Deploy" button again
9. App should connect to Lakebase successfully


## Demo


https://github.com/user-attachments/assets/29091cc2-62e3-4ece-aa50-8570d48d79a5

---------

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>

This branch was previously deployed

1 inactive deployment
test-trigger-is — f2a56d7f Deployed Mar 9, 2026 by pkosiec via integration-trigger #23236
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants