Skip to content

[tests] Update NUnit packages to latest stable versions#25516

Draft
rolfbjarne wants to merge 2 commits into
mainfrom
dev/rolf/nunitv4-bump
Draft

[tests] Update NUnit packages to latest stable versions#25516
rolfbjarne wants to merge 2 commits into
mainfrom
dev/rolf/nunitv4-bump

Conversation

@rolfbjarne
Copy link
Copy Markdown
Member

Update the following package versions:

  • NUnit: 4.4.0 → 4.6.1
  • NUnit3TestAdapter: 6.1.0 → 6.2.0
  • NUnitAnalyzers: 4.7.0 → 4.13.0
  • NUnitXmlTestLogger: 3.1.15 → 8.0.0
  • NUnitLite: 3.12.0 → 4.6.1
  • NUnitV2ResultWriter: 3.6.0 → 3.8.0

Also remove the tools/nunit3-console* scripts, they're no longer needed.

Update the following package versions:
- NUnit: 4.4.0 → 4.6.1
- NUnit3TestAdapter: 6.1.0 → 6.2.0
- NUnitAnalyzers: 4.7.0 → 4.13.0
- NUnitXmlTestLogger: 3.1.15 → 8.0.0
- NUnitLite: 3.12.0 → 4.6.1
- NUnitV2ResultWriter: 3.6.0 → 3.8.0

Also remove the tools/nunit3-console* scripts, they're no longer needed.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the repository’s centralized NUnit-related package versions used by test projects, and removes legacy nunit3-console wrapper scripts from tools/ as they’re no longer referenced.

Changes:

  • Bump NUnit, NUnit3TestAdapter, NUnit.Analyzers, NUnitXml.TestLogger, NUnitLite, and NUnitV2ResultWriter versions via Directory.Build.props.
  • Remove version-pinned tools/nunit3-console-* bash wrappers that invoked nunit3-console.exe via mono.

Reviewed changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated no comments.

Show a summary per file
File Description
tools/nunit3-console-3.9.0 Removed legacy mono-based nunit3-console wrapper script.
tools/nunit3-console-3.10.0 Removed legacy mono-based nunit3-console wrapper script.
tools/nunit3-console-3.11.1 Removed legacy mono-based nunit3-console wrapper script.
tools/nunit3-console-3.12.0 Removed legacy mono-based nunit3-console wrapper script.
Directory.Build.props Centralized version bumps for NUnit-related test dependencies (including NUnitXml.TestLogger 8.0.0 and NUnit 4.6.1).

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

- Add nunit.framework.legacy.dll to BundleStructureTest expected files
  (NUnit 4.6.1 ships this assembly alongside nunit.framework.dll)
- Add trimmer/ILC warning suppression for nunit.framework.legacy
- Add --dlsym for nunit.framework.legacy.dll in nunit.framework.targets
- Remove [Timeout] attributes no longer supported by NUnitLite 4.x
  (ObjectTest.InvokeTest and SecSharedCredentialTest methods)

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

✅ [PR Build #bbeaa3f] Build passed (Detect API changes) ✅

Pipeline on Agent
Hash: bbeaa3f080d99a3fa3d29e4429350251f2e8c892 [PR build]

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

✅ [PR Build #bbeaa3f] Build passed (Build packages) ✅

Pipeline on Agent
Hash: bbeaa3f080d99a3fa3d29e4429350251f2e8c892 [PR build]

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

✅ [PR Build #bbeaa3f] Build passed (Build packages) ✅

Pipeline on Agent
Hash: bbeaa3f080d99a3fa3d29e4429350251f2e8c892 [PR build]

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

✅ API diff for current PR / commit

NET (empty diffs)

✅ API diff vs stable

NET (empty diffs)

ℹ️ Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent
Hash: bbeaa3f080d99a3fa3d29e4429350251f2e8c892 [PR build]

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

✅ [PR Build #bbeaa3f] Build passed (Build macOS tests) ✅

Pipeline on Agent
Hash: bbeaa3f080d99a3fa3d29e4429350251f2e8c892 [PR build]

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

🔥 [CI Build #bbeaa3f] Test results 🔥

Test results

❌ Tests failed on VSTS: test results

0 tests crashed, 53 tests failed, 130 tests passed.

Failures

❌ fsharp tests

2 tests failed, 2 tests passed.

Failed tests

  • fsharp/iOS - simulator/Debug: LaunchTimedOut
  • fsharp/tvOS - simulator/Debug: LaunchTimedOut

Html Report (VSDrops) Download

❌ introspection tests

4 tests failed, 2 tests passed.

Failed tests

  • introspection/iOS - simulator/Debug: LaunchTimedOut
  • introspection/iOS - simulator/Debug (ARM64): LaunchTimedOut
  • introspection/tvOS - simulator/Debug: LaunchTimedOut
  • introspection/tvOS - simulator/Debug (ARM64): LaunchTimedOut

Html Report (VSDrops) Download

❌ linker tests (tvOS)

11 tests failed, 0 tests passed.

Failed tests

  • dont link/tvOS - simulator/Debug: LaunchTimedOut
  • dont link/tvOS - simulator/Release: LaunchTimedOut
  • link sdk/tvOS - simulator/Debug: LaunchTimedOut
  • link sdk/tvOS - simulator/Release: LaunchTimedOut
  • link all/tvOS - simulator/Debug: LaunchTimedOut
  • link all/tvOS - simulator/Release: LaunchTimedOut
  • link all/tvOS - simulator/Debug (don't bundle original resources): LaunchTimedOut
  • trimmode copy/tvOS - simulator/Debug: LaunchTimedOut
  • trimmode copy/tvOS - simulator/Release: LaunchTimedOut
  • trimmode link/tvOS - simulator/Debug: LaunchTimedOut
  • trimmode link/tvOS - simulator/Release: LaunchTimedOut

Html Report (VSDrops) Download

❌ monotouch tests (iOS)

5 tests failed, 13 tests passed.

Failed tests

  • monotouch-test/iOS - simulator/Release (NativeAOT, ARM64): Crashed
  • monotouch-test/iOS - simulator/Release (trimmable static registrar, NativeAOT, ARM64): Crashed
  • monotouch-test/iOS - simulator/Release (NativeAOT, x64): Crashed
  • monotouch-test/iOS - simulator/Release (trimmable static registrar, NativeAOT, x64): Crashed
  • monotouch-test/iOS - simulator/Release (NativeAOT, .NET 11 defaults): Crashed

Html Report (VSDrops) Download

❌ monotouch tests (MacCatalyst)

6 tests failed, 14 tests passed.

Failed tests

  • monotouch-test/Mac Catalyst/Release (NativeAOT): TimedOut (Execution timed out after 1200 seconds.
    Test run crashed)
  • monotouch-test/Mac Catalyst/Release (NativeAOT, ARM64): TimedOut (Execution timed out after 1200 seconds.
    Test run crashed)
  • monotouch-test/Mac Catalyst/Release (NativeAOT, x64): TimedOut (Execution timed out after 1200 seconds.
    Test run crashed)
  • monotouch-test/Mac Catalyst/Release (trimmable static registrar, NativeAOT): TimedOut (Execution timed out after 1200 seconds.
    Test run crashed)
  • monotouch-test/Mac Catalyst/Release (trimmable static registrar, NativeAOT, ARM64): TimedOut (Execution timed out after 1200 seconds.
    Test run crashed)
  • monotouch-test/Mac Catalyst/Release (trimmable static registrar, NativeAOT, x64): Failed (Test run crashed (exit code: 134).
    Test run crashed)

Html Report (VSDrops) Download

❌ monotouch tests (macOS)

6 tests failed, 14 tests passed.

Failed tests

  • monotouch-test/macOS/Release (NativeAOT): Failed (Test run crashed (exit code: 134).
    Test run crashed)
  • monotouch-test/macOS/Release (NativeAOT, ARM64): Failed (Test run crashed (exit code: 134).
    Test run crashed)
  • monotouch-test/macOS/Release (NativeAOT, x64): Failed (Test run crashed (exit code: 134).
    Test run crashed)
  • monotouch-test/macOS/Release (trimmable static registrar, NativeAOT): Failed (Test run crashed (exit code: 134).
    Test run crashed)
  • monotouch-test/macOS/Release (trimmable static registrar, NativeAOT, ARM64): Failed (Test run crashed (exit code: 134).
    Test run crashed)
  • monotouch-test/macOS/Release (trimmable static registrar, NativeAOT, x64): Failed (Test run crashed (exit code: 134).
    Test run crashed)

Html Report (VSDrops) Download

❌ monotouch tests (tvOS)

18 tests failed, 0 tests passed.

Failed tests

  • monotouch-test/tvOS - simulator/Debug: LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (link sdk): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (link all): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (LinkSdk): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (static registrar): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (all optimizations): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (ARM64): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (NativeAOT, ARM64): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (trimmable static registrar, NativeAOT, ARM64): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (managed static registrar): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (managed static registrar, all optimizations): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (NativeAOT, x64): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (trimmable static registrar, NativeAOT, x64): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (interpreter): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (interpreter): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (compat inline dlfcn): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (strict inline dlfcn, link sdk): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (NativeAOT, .NET 11 defaults): LaunchTimedOut

Html Report (VSDrops) Download

❌ windows tests

1 tests failed, 2 tests passed.

Failed tests

  • Remote .NET tests/Xamarin.Tests.DotNetProjectTest.AppWithLibraryWithResourcesReferenceOnRemoteWindows(iOS,"ios-arm64",True): Failed: 'dotnet build' failed with exit code 1

Html Report (VSDrops) Download

Successes

✅ cecil: All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (iOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (MacCatalyst): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (macOS): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (tvOS): All 1 tests passed. Html Report (VSDrops) Download
✅ framework: All 2 tests passed. Html Report (VSDrops) Download
✅ generator: All 5 tests passed. Html Report (VSDrops) Download
✅ interdependent-binding-projects: All 4 tests passed. Html Report (VSDrops) Download
✅ linker (iOS): All 11 tests passed. Html Report (VSDrops) Download
✅ linker (MacCatalyst): All 11 tests passed. Html Report (VSDrops) Download
✅ linker (macOS): All 11 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
✅ sharpie: All 1 tests passed. Html Report (VSDrops) Download
✅ xcframework: All 4 tests passed. Html Report (VSDrops) Download
✅ xtro: All 1 tests passed. Html Report (VSDrops) Download

macOS tests

✅ Tests on macOS Monterey (12): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Ventura (13): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Sonoma (14): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Sequoia (15): All 5 tests passed. Html Report (VSDrops) Download
✅ Tests on macOS Tahoe (26): All 5 tests passed. Html Report (VSDrops) Download

Linux Build Verification

Linux build succeeded

Pipeline on Agent
Hash: bbeaa3f080d99a3fa3d29e4429350251f2e8c892 [PR build]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants