TFS perf benchmarks on slow WAN (300 kpbs)

We did a perf benchmark testing recently with VSTT Load Test slow network simulator. This is the result we got:

1. Baseline: Normal WAN (1Gbps)

2. Comparison Run: Slow WAN (300 Kbps).

 

As expected, almost all tests are slower due to slower network. But overall perf are still pretty good for these small operations.

Scenario

Test Case

Baseline

Comparison Run

% Change from Baseline

TFSLoad

WITNew_Common_NewWI

0.065

0.432

-564%

TFSLoad

WITPage_Common_PageItems

0.081

0.475

-489%

TFSLoad

WITQuery_Common_AreaUnderAndTitleContains

0.163

0.783

-380%

TFSLoad

WITUpdate_Common_ActiveToResolved

0.100

0.466

-364%

TFSLoad

VCGet

0.162

0.493

-204%

TFSLoad

PMGSSCheckPermission

0.005

0.016

-198%

TFSLoad

VCQueryWorkspaces

0.015

0.040

-172%

TFSLoad

WITQuery_Common_AssignedTo

0.074

0.198

-166%

TFSLoad

PMGSSListProjectGroups

0.018

0.042

-133%

TFSLoad

PMGSSIsPermitted

0.006

0.014

-129%

TFSLoad

PMGSSReadIdentity

0.006

0.013

-118%

TFSLoad

PMGSSGetUserIdentity

0.007

0.015

-118%

TFSLoad

VCDir

0.023

0.047

-105%

TFSLoad

VCHistory

0.028

0.050

-82%

TFSLoad

VCAdd

0.078

0.135

-72%

TFSLoad

VCUndelete

0.134

0.228

-70%

TFSLoad

VCRename

0.173

0.293

-69%

TFSLoad

VCCheckin

0.149

0.244

-64%

TFSLoad

VCQueryItems

0.021

0.034

-64%

TFSLoad

VCStatus

0.072

0.116

-61%

TFSLoad

WITUpdate_Common_EditSimpleActive

0.091

0.144

-59%

TFSLoad

VCGetSpecific

0.113

0.176

-55%

TFSLoad

VCEdit

0.105

0.163

-55%

TFSLoad

VCDelete

0.151

0.226

-49%

TFSLoad

VCShelveUnshelve

0.334

0.488

-46%

TFSLoad

VCQueryShelvesets

0.013

0.019

-44%

TFSLoad

VCQueryItemsExtended

0.060

0.084

-41%

TFSLoad

VCMerge

0.147

0.201

-37%

TFSLoad

WITBulk_Common_UpdateEdit10

0.906

1.223

-35%

TFSLoad

VCBranch

0.297

0.366

-23%

TFSLoad

TBQueueBuildsTest

52.227

55.048

-5%

TFSLoad

TBViewBuildDetailedReportTest

1.051

1.085

-3%

TFSLoad

TBViewBuildSummaryReportTest

1.074

1.086

-1%

TFSLoad

VCUndo

0.134

0.130

3%