Producing a test run summary using Test Scribe

  • Article

 

The newest release of Test Scribe now sits inside the Microsoft® Test Manager product as an integrated set of activities.  Whereas before you would have a separate user experience for using the Test Scribe tool, now you must use the Test Manager product.  To access the new Test Scribe user experience, open Microsoft® Test Manager and change the center group drop down to the “Tools” center group. 

center_group_list

Figure 1.1 – The list of available centers including the new “Tools” center group

Click on the “Tools” center group and your default activity inside Test Manager will change to the “Test Run Summary” activity. 

test_run_summary

Figure 1.2 – The “Test Run Summary” Test Scribe activity

This activity presents a list of all active test runs in your Team Foundation Server and provides easy query-by-example (QBE) support for quickly finding the test runs you are interested in.  Once you have chosen your run(s), click the “Generate” toolbar button or context-menu.  Test Scribe will aggregate your selection to produce a summary for said run(s).

test_run_summary_in_progress

Figure 1.3 – Test Scribe generation of test run summary document

 

Once generation has completed, you will be presented with a Microsoft® Word® document including details on your run(s)!

test_run_summary_multiple

Figure 1.4 – Completed test run summary document

Comments

  • Anonymous
    June 08, 2010
    I am getting an error trying to generate this report. I am using VS2010 RTM on Windows 7 x64. Compiling transformation: Assembly 'Microsoft.TeamFoundation.TestManagement.Client, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' uses 'Microsoft.TeamFoundation.WorkItemTracking.Client, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' which has a higher version than referenced assembly 'Microsoft.TeamFoundation.WorkItemTracking.Client, Version=9.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a'

  • Anonymous
    June 08, 2010
    Hey there...I'm getting the same error, though while generating a Test Plan Summary. It's ironic that this is a "testing" tool, yet it doesn't seem to have been tested properly?!?? :P I'm also running RTM VSTS2010 (Ultimate) on Win 7 x64. Looks to me like you've linked the VS2008 version of the assembly somehow...?

  • Anonymous
    June 08, 2010
    Compiling transformation: Assembly 'Microsoft.TeamFoundation.TestManagement.Client, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' uses 'Microsoft.TeamFoundation.WorkItemTracking.Client, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' which has a higher version than referenced assembly 'Microsoft.TeamFoundation.WorkItemTracking.Client, Version=9.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' same Problem with W7x86 VS2010 Ultimate (have Visual Studio Team Explorer 2008 parallel installed)

  • Anonymous
    June 09, 2010
    Right, solved it - in my case it was a problem caused by running VS2008 side by side with VS2010. I uninstalled 2008 and it was fine. It's probably enough to uninstall Team Explorer, but I uninstalled the whole thing to be sure.

  • Anonymous
    June 10, 2010
    Thanks Mark! I also had VS2008 still installed on my system. I just uninstalled Team Explorer 2008 and that got it up and running. Generates some pretty cool reports. Thanks again for posting the solution.

  • Anonymous
    June 10, 2010
    I've been able to repro the sxs issue and am working on a fix in the form of a new version of Test Scribe.  With luck I will post the new bits next week.  Thank you all very much for your patience. -Ryan

  • Anonymous
    June 23, 2010
    I used the email Blog author link on main page and recieved: Generating server: by2msftvsmtp04.phx.gbl tstblog@microsoft.com #< #5.4.1 smtp;550 5.4.1 tstblog@microsoft.com: Recipient address rejected: Access Denied> #SMTP# any other way of sending?

  • Anonymous
    February 16, 2011
    The tool worked for me and generated awesome summary for Test plan and Test run. Something that i think might add value is : The test run summary generated when all the test cases are grouped by Build number only gives the pie chart based on the test cases that have passed , failed or in progress . It would be great if there could also be a pie chart that would include the test runs based on the suites and list the number of test cases not executed for a build.

  • Anonymous
    July 14, 2011
    Test Run Summary shows a list of all test runs in test manager. How can i query and  get report for only some of the test runs. ex: If there are 2 test plans and i want to see the report for only one of them how do i do it?