Udostępnij za pośrednictwem

Driving Automation of Test Cases

  • Artykuł

As I’ve mentioned in previous posts, our team has been working our way up the testability pyramid. We started with unit tests, and now have about 670 C++/CLI unit tests that are testing our C++ code. However, we didn’t have any automated acceptance or UI tests. Our tester was going nuts because he was always behind the curve, and was doing entirely manual testing.

Starting about two sprints ago (our sprints are two weeks), we finally had both the resources and infrastructure to be able to start automating acceptance tests. I’ll describe our infrastructure in a separate blog post. But once we start write tests, we wanted to know how were were doing. To answer that question, I wrote a Reporting Services report:

image

You can download this report from here: Source Code Test Automation Status.rdl.

The report above is real data from one of our projects. Green is good—it shows how many test cases we’ve automated.

This report pulls data from the Test Case work item’s Automation Status field. This field can be Not Automated (the default for new test cases), Planned, or Automated. You can switch to automated by clicking on the Associated Automation tab of the Test Case and selecting a test method that is in the currently open solution. Alternatively, if you have the Test View tool window open in Visual Studio, you can right click a test, click Associate Test to Test Case and then choose a test case.

Since we plan to automate almost all of these test cases, we’re using the Planned automation state to represent test cases where we’re writing an automated test. In other words, in our case, Planned represents work in flight.

Hope you find this report as useful as we do in both driving test case automation, and knowing where you’re at.

Comments

  • Anonymous
    June 14, 2011
    Very Very cool report. I've been looking for something like this. Thanks for sharing! Can you do a blog post on how you wrote it?

  • Anonymous
    June 23, 2011
    Hi I get a access denied when I try to download this report. Could you please grant me access. I need a similar report in one of my projects and wanted to refer it. Thanks

  • Anonymous
    June 23, 2011
    @Nirav, I think I've fixed the problem. Try again and let me know if you still have problems (or perhaps also let me know if you can download it successfully).

  • Anonymous
    July 01, 2014
    Hi. Where can I find this report or where can I get guidance to create one?

  • Anonymous
    July 01, 2014
    It looks like the location where I uploaded the files doesn't exist anymore, and unfortunately, I don't have a copy of the file. Grump.