How to: Override Settings in Your Test Plan for Test Runs
You can specify how to run your manual and automated tests in your test plans by using Microsoft Test Manager. If you want to run your tests by using different test settings, environments, builds, or build configurations, then you can override the selections that you have made for your test plan. For more information about test settings, environments, and assigning builds, see Setting Up Machines and Collecting Diagnostic Information Using Test Settings and How to: Select a Build for Your Test Plan.
If you want to override these settings when you run your tests, you must select Run with options, as shown in the following illustration. The values that you can override are displayed based on whether the tests that you have selected are manual, automated, or both.
You can also specify that the selected automated tests run manually by using these options. For more information, see How to: Run a Test Case with Associated Automation as a Manual Test.
If you use a different build for a test run than the build that has been assigned to the test plan, when you select the build you can also select the build configuration. The build and the build configuration that you select are recorded together with the test results for this test run.
Requirements
- Visual Studio Ultimate, Visual Studio Premium, Visual Studio Test Professional
Important
If you run automated tests and you do not select a build configuration, the test assemblies to run the automated tests are searched for recursively from the root of the build drop folder. If it is important which assemblies are selected when you run your automated tests, you should use Run with options to specify the build configuration. For example, you might want to use the retail build configuration for your tests instead of the debug build configuration. For more information about build configurations, see Build Configurations.
To override settings in your test plan for test runs
Open Microsoft Test Manager.
Note
To display the Microsoft Test Manager window, choose Start, and then choose All Programs. Point to Microsoft Visual Studio 2012 and then choose Microsoft Test Manager.
To override the test plan values to run the tests, choose the down-arrow on the center group switcher and then choose Testing Center.
On the center group menu bar, choose Test.
Select the tests or test suite to run and then choose the drop-down arrow next to Run and point to Run with options.
The Run options dialog box is displayed.
To override the build that you will use to run the tests, select a build from Build. This build information is stored as part of the test results for manual and automated tests.
Important
If you run automated tests, the build drop location for this build is used to find the test assemblies to run the automated tests.
Select the build configuration that you plan to use from Build configuration. This build configuration information is stored as part of the test results for manual and automated tests. You do not have to select a build configuration.
Important
If you run automated tests, the test assemblies for this specific build configuration are used to run the tests.
To manually run any automated tests that you selected, select Run all the tests manually.
To override the test settings for any manual tests that you selected, choose Test settings under Manual test runs and select the test setting that you want to use. Then choose Environment to select a matching environment.
Note
This environment must contain the same roles as the test settings that you use. Only environments that match these roles are displayed.
To override the test settings for any automated tests that you selected, choose Test settings under Automated test runs and select the test setting that you want to use. Then choose Environment to select a matching environment.
Note
This environment must contain the same roles as the test settings that you use. Only environments that match these roles are displayed.
To run the tests, choose Run.
If you have selected both manual and automated tests, the automated tests are started as a test run and Test Runner is started to run the manual tests as a separate test run.