Freigeben über


NUnit vs VSTS

One of the most popular open source application for .Net developers is NUnit.

 

With the next release of VS2005 and VSTS, the new IDE has integrated unit test support, with a lot of new functionality over NUnit.

 

However there are some basic features that VSTS does not implement.

 

1) Assert.AreEqual (string expected, string actual) does not inform at which char differs 

 

More than 80% of unit tests involve some kind of string comparison, when the strings defer NUnit told you the first different char in the string. However VSTS just say: "Strings defer". Suppose you are comparing a big string (more that 10000chars). How should I discover the differences?

 

I thought this "simple" feature will be added to final version. Sadly I've read today this will be postponed to V2

https://lab.msdn.microsoft.com/productfeedback/viewfeedback.aspx?feedbackid=4f45f51d-4228-4a48-b027-584fbc280e5f

If you think this way don't forget to vote for this suggestion

 

(Bug opened by ragc https://blogs.clearscreen.com/ragc/archive/2005/08/25/2394.aspx)

 

 

2) Organize tests in a hierarchy

 

 The most natural way to organize your test suite is based in a simple schema, a tree based on Namespace/Namespace/TestClass/TestMethod.

 

VSTS will offer a lot of new ways to define hierarchies to organize your tests, but you will have to spend some time organizing, because the default view is a flat view of all the test methods.

 

This feature will also be postponed for next version: https://lab.msdn.microsoft.com/productfeedback/viewfeedback.aspx?feedbackid=d4b0397b-1fdb-4954-af24-20b5461157a3

 

3) TestResults View 

 

When you have a big test suite, say more than 300 tests, you need a quick view of the results.

NUnit bubble exceptions and failures to the parent node (Namespace) so it is very easy to find namepsaces (family of tests) with broken test results.

 

With VSTS we have two problems, first of all we don't have a TestResults view with a comprehensive summary of the test suite run. The second is the mechanism to inspect test results, you have to open a new VS sub-window to read every failure (unsable when you want to know what's going on when a small number of tests have failed)

 

Summary

 

I would like to start using VSTS as soon as possible, however I think this three features are a MUST HAVE, so I would like to know if you have better workarounds than those described in the MS-ProdFeedbackCenter.

 

Or maybe you know  some AddIns, or VS PowerToys to avoid the lack of usability of VS UnitTesting V1.

Comments

  • Anonymous
    November 16, 2005
    I too am weighing the VSTS solution vs. Open Source. We've spent a lot of time building our own integrated development environment with CruiseControl.NET, Nant, Nunit, Ncover etc... and I am wondering about TeamSystem now. I can see how we'd save a TON of time not dealing with all these seperate solutions and just get all the functionality from TS--but I am a little leary of just how good the team system solution is.

    I don't know much about the server piece is it a continuous integration server or just a repository?
  • Anonymous
    May 02, 2006
    The comment has been removed