How to run ALL tests in my solution using command line MSTest.exe?

Question

According to MSDN here and discussed here, we can use MSTest.exe to run tests from command line - which is sweet and faster than running within the IDE (especia

Answer 1

I accomplished this using the testmetadata argument and pointing it to my .vsmdi file.

As explained here.

E.g.:

mstest /testmetadata:mySolution.vsmdi

However note that testmetadata can be more fragile (e.g. empty test lists combined with the Ignore attribute cause "Specified cast is not valid"). Creating a batch with all DLLs containing test classes could be more reliable alternative.

Answer 2

I needed the same thing, without wanting to install anything or generate vsmdi files, so I came up with this PowerShell script, below. It runs ALL tests in one command on a folder and it's subfolders (not solution, but fine for me).

Feel free to suggest how to make this script more elegant:

$x = ""; dir *\bin\*test*.dll -Recurse | foreach { $x += "/testcontainer:""$_"" " }; iex "mstest $x"

Instructions:

• Add path to mstest.exe via Environment variables variable PATH, otherwise just replace mstest with its full path in the PowerShell script above.

• Open PowerShell, paste the command.
• Modify *\bin\*test*.dll to meet your needs. In current script it will get all DLLs in the bin folder recursively, containing substring "test" in the filename.
• Run the command!

Answer 3

Just use:

mstest.exe /testcontainer:yourTests.dll /resultsfile:res.trx

and it will run all tests in that assembly, and spit out the results in the specified file.

Answer 4

You might want to have a look at the Gallio.Echo test runner which comes with the Gallio test automation platform. It's a free (OSS) package with many convenient reporting tools and test runners and which supports most the existing test frameworks (MbUnit, NUnit, MSTest, xUnit, etc.)

More specifically, Gallio.Echo is a versatile command line test runner. You can specify a list of test assemblies, various filters, and many extra options. Gallio consolidates the test results in a single report (Xml, Html, Zip, etc.)