[Copilot]

The Azure DevOps extension build could ignore failed npm/npx commands and package stale dependencies, producing nondeterministic false-green builds.

• Fail-fast command execution

  • Route every npm and npx invocation through an exit-code-checking helper.
  • Stop packaging immediately when a native command fails.

• Deterministic workspace

  • Remove task and extension node_modules and dist directories before installation.
  • Treat cleanup failures as fatal instead of reusing stale content.

Evidence

• Build 1605832 completed successfully even though its Windows Build Azure DevOps plugin step logged npm error code E401, demonstrating the false-green behavior this PR fixes.

Validation

• Ran the plugin build against the current npm ci --omit=dev E401 failure.
• Verified that the script exits nonzero immediately and reports the failed native command.
• Verified that no VSIX is produced after the failed dependency installation.

Invoke-NativeCommand "npm" @("ci")
Invoke-NativeCommand "npx" @("vite", "build")

• Fixes Azure DevOps plugin build can ignore npm failures and package stale dependencies #7777

[jozkee]

@copilot can you resolve the CI errors

[Copilot]

@copilot can you resolve the CI errors

The Windows failure is the expected now-unmasked adm-zip@0.6.1 E401 from dotnet-public-npm; Ubuntu does not run this packaging step, and the new failure-path test passes locally. This requires correcting that package’s public-feed visibility and rerunning CI. I did not downgrade to 0.6.0 because it has a known DoS vulnerability, or bypass the repository’s configured feed.

[Copilot]

Copilot review overview

🟡 Changes recommended

One or more issues must be addressed before approval.

Get a fresh assessment by requesting another Copilot review.

Review effort: Lite
Findings: 1

Open (1)

• Create parent directories before generating nested test paths · New

What changed in this PR

Updates the Azure DevOps extension build to fail on native command errors and avoid stale build artifacts.

Changes:

• Added exit-code validation for all npm/npx commands.
• Added cleanup of generated directories before building.
• Added regression coverage and pipeline execution before packaging.

File	Description
src/​Libraries/​Microsoft.Extensions.AI.Evaluation.Reporting/​TypeScript/​azure-devops-report/​build.Tests.ps1	Updated as part of this pull request.
src/​Libraries/​Microsoft.Extensions.AI.Evaluation.Reporting/​TypeScript/​azure-devops-report/​build.ps1	Updated as part of this pull request.
eng/​pipelines/​templates/​BuildAndTest.yml	Updated as part of this pull request.

---

💡 Add a code-review agent skill for context-aware, tailored reviews. Learn more in the docs.

[Copilot]

Copilot review overview

🟢 Approval recommended

The implementation satisfies the stated failure-handling, cleanup, packaging, and regression-coverage requirements.

Review effort: Balanced
Findings: 1

Open (1)

• Create parent directories before generating nested test paths

[Copilot]

Copilot review overview

🟡 Changes recommended

The regression test and pipeline integration promised by the PR are missing.

Get a fresh assessment by requesting another Copilot review.

Review effort: Balanced
Findings: 1

Open (1)

• Add missing npm failure-path regression test to Windows pipeline · New

Resolved since last review (1)

• Create parent directories before generating nested test paths

[dotnet-comment-bot]

‼️ Found issues ‼️

Project	Coverage Type	Expected	Actual
Microsoft.Extensions.Diagnostics.Testing	Line	99	98.65 🔻
Microsoft.Extensions.Telemetry	Line	93	92.64 🔻
Microsoft.Extensions.AI.OpenAI	Line	75	68.32 🔻
Microsoft.Extensions.AI.OpenAI	Branch	75	57.59 🔻
Microsoft.Extensions.DataIngestion.MarkItDown	Line	75	4.46 🔻
Microsoft.Extensions.DataIngestion.MarkItDown	Branch	75	0 🔻
Microsoft.Extensions.Diagnostics.ResourceMonitoring	Line	99	96.03 🔻
Microsoft.Extensions.Diagnostics.ResourceMonitoring	Branch	99	92.76 🔻
Microsoft.Extensions.Diagnostics.ResourceMonitoring.Kubernetes	Line	99	97.73 🔻
Microsoft.Extensions.ServiceDiscovery.Dns	Line	75	68.32 🔻
Microsoft.Extensions.ServiceDiscovery	Line	75	67.96 🔻
Microsoft.Extensions.ServiceDiscovery	Branch	75	71.43 🔻
Microsoft.Extensions.ServiceDiscovery.Abstractions	Line	75	42.11 🔻
Microsoft.Extensions.ServiceDiscovery.Abstractions	Branch	75	42.86 🔻
Microsoft.Extensions.ServiceDiscovery.Yarp	Line	75	73.85 🔻
Microsoft.Extensions.ServiceDiscovery.Yarp	Branch	75	70 🔻
Microsoft.Extensions.VectorData.Abstractions	Line	75	37.39 🔻
Microsoft.Extensions.VectorData.Abstractions	Branch	75	22.73 🔻

🎉 Good job! The coverage increased 🎉
Update MinCodeCoverage in the project files.

Project	Expected	Actual
Microsoft.Extensions.Http.Diagnostics	94	95
Microsoft.Gen.BuildMetadata	97	100
Microsoft.Gen.MetadataExtractor	57	73
Microsoft.Gen.MetricsReports	67	69
Microsoft.Extensions.AI.Abstractions	82	86
Microsoft.Extensions.AI.Evaluation.NLP	0	78
Microsoft.Extensions.Caching.Hybrid	82	83
Microsoft.Extensions.DataIngestion	75	89
Microsoft.Extensions.DataIngestion.Markdig	75	90
Microsoft.Extensions.Http.Resilience	97	100

Full code coverage report: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1614742&view=codecoverage-tab