Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New Test SDK is very broken. #4997

Open
mwwhited opened this issue Feb 12, 2025 · 11 comments
Open

New Test SDK is very broken. #4997

mwwhited opened this issue Feb 12, 2025 · 11 comments

Comments

@mwwhited
Copy link

The MSTest SDK is very broken. From logging to filtering it just simply doesn't work. Please provide a means to use the old format.

@nohwnd nohwnd transferred this issue from microsoft/vstest Feb 12, 2025
@nohwnd
Copy link
Member

nohwnd commented Feb 12, 2025

Moved the issue here where the new testing platform and mstest lives. How did you generate your project? At the moment all usage of mstest.sdk should be opt-in, so you knowingly use the new experience.

@nohwnd
Copy link
Member

nohwnd commented Feb 12, 2025

I would also like to know more details about what did not work for you, and the commands you've ran and the errors you've got, please :)

@mwwhited
Copy link
Author

I would love if the template was opt-in... but every time I create a new MSTest project it is using the new MSTest SDK mess which is extremely brittle. I'll get the thing working and it works okay until the next update which breaks my local and server side build for hours until I figure out what is different. Also the fact that it hide everything from the console and doesn't detect tests as runtime really isn't useful. When it fails to detect tests it just doesn't run the tests but says they are successful which again really isn't helpful.

And when it does work it only lists the number of tests passed or failed but not the list of tests or their actual outputs. Generally it's a horrible user experience and I would love if I could just use the older version that's hasn't had any issues for years.

@mwwhited
Copy link
Author

Also, the command I use is really complex... it's dotnet test

@nohwnd
Copy link
Member

nohwnd commented Feb 12, 2025

are you creating the project via dotnet new or via Visual Studio? What is the version of the dotnet sdk you are using? dotnet --info

@mwwhited
Copy link
Author

visual studio and latest

.NET SDK:
Version: 9.0.200
Commit: 90e8b202f2
Workload version: 9.0.200-manifests.c4f6226a
MSBuild version: 17.13.8+cbc39bea8

Runtime Environment:
OS Name: Windows
OS Version: 10.0.22631
OS Platform: Windows
RID: win-x64
Base Path: C:\Program Files\dotnet\sdk\9.0.200\

.NET workloads installed:
There are no installed workloads to display.
Configured to use loose manifests when installing new manifests.

Host:
Version: 9.0.2
Architecture: x64
Commit: 80aa709f5d

.NET SDKs installed:
8.0.406 [C:\Program Files\dotnet\sdk]
9.0.200 [C:\Program Files\dotnet\sdk]

.NET runtimes installed:
Microsoft.AspNetCore.App 6.0.36 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 8.0.13 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 9.0.2 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.NETCore.App 6.0.36 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 8.0.13 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 9.0.2 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.WindowsDesktop.App 6.0.36 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 8.0.13 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 9.0.2 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]

Other architectures found:
x86 [C:\Program Files (x86)\dotnet]
registered at [HKLM\SOFTWARE\dotnet\Setup\InstalledVersions\x86\InstallLocation]

Environment variables:
Not set

global.json file:
Not found

Learn more:
https://aka.ms/dotnet/info

Download .NET:
https://aka.ms/dotnet/download

@mwwhited
Copy link
Author

If I used an old project as a template it works fine but if it has the TestPlatform B.S. it never works consistently.

@Evangelink
Copy link
Member

@mwwhited just uncheck the MSTest.Sdk checkbox and it will remain unchecked. This is also disabled by default so if you see it checked that means you have enabled it at one point and didn't disable it.

@mwwhited
Copy link
Author

Even with that unchecked it is adding test platform garbage. I'm just clearing the files by hand now. It would be really nice if you created new templates instead of breaking existing ones when you make these changes.

@Evangelink
Copy link
Member

It would be really nice if you were posting any actionable information or example :)

@mwwhited
Copy link
Author

It would be nice if I could have the old template... but here we are.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants