Skip to content

Add a one-job ExecuTorch torchci report ingestion canary - #24744

Open
psiddh wants to merge 2 commits into
mainfrom
executorch-torchci-report-canary
Open

psiddh wants to merge 2 commits into
mainfrom
executorch-torchci-report-canary

Conversation

@psiddh

@psiddh psiddh commented Nov 6, 2026

Copy link
Copy Markdown
Contributor

Summary

Add one opt-in Linux CI canary to verify that actual ExecuTorch test results reach the existing HUD ingestion pipeline before enabling the production jobs. It runs the 17 existing dependency-selection regression tests under the upstream schema-1.0 reporter, using a dedicated CPU Python environment and the merged test-infra uploader.

The job preserves real repository, workflow and job attribution. It emits the actual report/execution UUIDs so the uploaded S3 object can be reconciled with received ClickHouse run records. Other jobs remain unopted; there are no HUD, schema, production image or dependency-pin changes.

This tests report transport/ingestion with actual ET infrastructure tests. It does not claim full backend coverage or validate the planned production image. The PR is for a pre-rollout canary, not production enablement.

Test plan

Workflow actionlint/ShellCheck, embedded Python syntax and whitespace/safety checks pass locally. The existing suite was read and contains 17 test methods. Reporter source and schema are checked in CI, with an exact November 2 CPU torch pin.

E2E acceptance is still pending: positive real report rows, actual S3 upload/object, matching report/job/execution UUIDs in ClickHouse, then eligible health/page rows after normal refresh. A green job or skipped/best-effort upload is not acceptance. Record the real run/job IDs and links as evidence after the canary executes.

Authored with AI assistance, for owner review before posting.

Run existing dependency-selection tests under the real upstream reporter in an isolated CPU environment; opt this job into the existing reusable uploader and record real report/job/run UUIDs for receipt verification. Authored with AI assistance.
Copilot AI balanced review requested due to automatic review settings November 6, 2026 18:45
@pytorch-bot

pytorch-bot Bot commented Nov 6, 2026 •

Copy link
Copy Markdown

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/24744

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 10e0a5a with merge base a7c5880 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 6, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has insufficient remaining quota. Try requesting a review at a lower effort level.

@github-actions

github-actions Bot commented Nov 6, 2026

Copy link
Copy Markdown

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

Keep the actual test set and reporter unchanged, repair the closing heredoc delimiter and pin the callee/helper checkout to the tested uploader-path fix. Authored with AI assistance.
Copilot AI balanced review requested due to automatic review settings November 6, 2026 18:57

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has insufficient remaining quota. Try requesting a review at a lower effort level.

jobs:
reports:
if: ${{ github.event.pull_request.head.repo.full_name == github.repository }}
uses: pytorch/test-infra/.github/workflows/linux_job_v3.yml@c94b20ef8ba2c2343abdd631f6f15b16ff32c113

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For both the test-infra pin and the torch version pins, do we want to generalize this to keep this workflow stable when things change?

This branch was previously deployed

1 inactive deployment
cadence — 10e0a5ad Deployed Nov 6, 2026 by psiddh via hifi5s-op-test / hifi5s #37100
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants