New Load Test and Web Test features in the Orcas release

Here is a summary of just a few of the enhancements to Web testing and load testing coming in the Orcas release of Visual Studio Team System (other team members will be blogging about other enhancements): 

 The Web Test recorder now records AJAX requests and other requests missed by the VSTS 2005 Web Test recorder.   This should mean that you no longer need to use Fiddler to record Web test requests, though Fiddler is still very useful for diagnosing problems recording or replaying Web tests.     Note that dependent requests that will be parsed and automatically submitted when the Web test is run are still not recorded since that would be redundant.

Load Test enhancements

New load model based on user pacing

With this load model, rather than specifying a percentage for each of the tests in one of the load test's scenario, you specify the rate at which each virtual user runs tests.  For example:

    TestA: 4 tests per user/hr
    TestB: 2 tests per user/hr
    TestC: 0.125 tests per user/hr

Virtual users may be idle between running test depending on the pacing and the duration of the individual tests.    With the example above, if each test runs for 1 minute, then each virtual users will be running tests for just 6.125 minutes of every hour.   This more closely simulates the real-world where users of an application come and go while doing other things.

Here is a screen shot of the dialog to specify the pacing:

Load test duration based on test iteration count rather than time

The Orcas release supports the option of running the load test for a fixed number of test iterations rather than a fixed length of time.   This is a load test run setting rather than a scenario setting, so the load test completes onces the total number of tests run in all of the scenarios reaches the specified number of test iterations.

Performance improvements for load tests containing unit tests

The overhead of running unit tests in a load test has been dramatically reduced.   The rate of Tests / Sec that a single load test agent machine can drive has increased by a factor of about 10 when running empty unit tests.     The percentage improvement will be significantly smaller when using unit tests that actually do something.   For a Web service unit test, we measuread an improvement in throughput driven from one load test agent of approximately 25%.

Comments

• Anonymous
  June 15, 2007
  Brian Harry on Updated Quescing patch released. Sean Lumley on Orcas Feature: Managing Load Test Results....
• Anonymous
  June 15, 2007
  It's great to see the native support for AJAX! Nice job. :-)
• Anonymous
  June 28, 2007
  Lot's of new stuff for web, load, and unit tests in Orcas. Follow the links for more info. Web test ·
• Anonymous
  August 17, 2007
  Orcas - Visual Studio Team System 2008 - new features coming for Web and Load testing and a feature of
• Anonymous
  October 23, 2007
  Online Help Working with Web Tests Working with Load Tests Working with Controllers, Agents, and Rigs
• Anonymous
  December 17, 2007
  Visual Studio Team System for Testers Content Index for Web Tests and Load Tests Getting Started Online
• Anonymous
  July 07, 2008
  虽然是E文的，但我相信大家的能力，在学习过程中也把英语练了，蛮好的。