Share via


List Performance Tests (Compact 2013)

3/26/2014

This test suite measures the frame-rate that is achieved when performing pan and flick gestures on a ListBox. The ListBoxes are populated using data-binding.

Performance logs can be found at: \\release\XRListPerfResults.xml

Test Prerequisites

Your device must meet the following requirements before you run this test.

The following prerequisites must be met to run this test.

The XAML for Windows Embedded Performance Test suite can be run on any connected device. Some of the tests may run out of memory on devices with less than 256 MB of memory.

The following table shows the software requirements for the Windows Embedded Compact-based device that will be running the performance test suite. In addition, the run-time image for the devices must include support for XAML for Windows Embedded (SYSGEN_XAML_RUNTIME) and CEPerf (IMGCEPERF).

Requirement

Description

Tux.exe

Tux test harness, required for executing the test.

Kato.dll

Kato logging engine, required for logging test data

Gse2.dll

Utility that generates simulated gesture events

Subtests

The table below lists the subtests included in this test.

SubTest ID

Description

3024347

Pan in a list of 1000 items where each item is a simple string

3024348

Pan in a list of 1000 items where each item is a template of strings and PNG images

3024349

Pan in a list of 1000 items where each item is a template of JPG images

3024350

Flick in a list of 1000 items where each item is a simple string

3024351

Flick in a list of 1000 items where each item is a template of strings and PNG images

3024352

Flick in a list of 1000 items where each item is a template of JPG images

3028437

Scroll in a list of 1000 items where each item is a simple string

3028438

Scroll in a list of 1000 items where each item is a template of string and PNG images

3028439

Scroll in a list of 1000 items where each item is a template of JPG images

Setting Up the Test

For each of the tests it is recommended that you first clear the log file (unless you wish to aggregate the results of a number of tests into a single log file). Enter the following at the command line in order to clear the log file:

log 0x0

y

log -flush

Running the Test

s tux -o -d \release\XRListPerfTests.dll -c data=\release\xamlruntime\test\perf\ListPerf\vspperf.testsuite.xml;repeats=<repeats>;seconds=<seconds>;<UseBaml> -x <test#>

Argument

Description

Repeats

How many times to run the test. 1 is typically a good value.

Seconds

How many seconds to run the test. 30 is typically a good value.

UseBAML

If this is included, the test will run using a binary form of XAML which loads faster.

Test#

Which of the tests to run. Here are the recommended tests:

(1) Pan in a list of 1000 items where each item is a simple string

(2) Pan in a list of 1000 items where each item is a template of strings and PNG images

(3) Pan in a list of 1000 items where each item is a template of JPG images

(11) Flick in a list of 1000 items where each item is a simple string

(12) Flick in a list of 1000 items where each item is a template of strings and PNG images

(13) Flick in a list of 1000 items where each item is a template of JPG images

(21) Scroll in a list of 1000 items where each item is a simple string

(22) Scroll in a list of 1000 items where each item is a template of strings and PNG images

(23) Scroll in a list of 1000 items where each item is a template of JPG images

Verifying the Test

This test reports a Pass or Fail result.

The List Performance Tests logs can be found in the CTK log directory:

  • XRListPerfResults.xml

The following values are common performance measurements:

  • Average Frame Rate Change Average - frame per second during Animation in frames per second (fps)
  • Load Image from Resource Average - average time for loading images from dll resource in microseconds
  • Create Host From Xaml Average - average time for loading and parsing xaml and generating the visual element tree in microseconds
  • Paint Element Tree Average - average time for rendering the visual element tree in microseconds
  • First Paint - time from process launch to the end of the first rendering of the visual element tree in microseconds

Troubleshooting the Test

Known issues: Tests with large resources may fail cause lower-end devices to run out of memory, failing the test.

If running from cmd:

Re-run the test from command line with the following parameter at the end: -f Logfile.txt. The log file, which can be found the release directory after the test executes will have more detailed information on the failure.

If running from a test framework:

Open the test framework’s log file for a more detailed information on the failure.

See Also

Other Resources

Shell Tests