TFS perf benchmarks on slow WAN (300 kpbs)
We did a perf benchmark testing recently with VSTT Load Test slow network simulator. This is the result we got:
1. Baseline: Normal WAN (1Gbps)
2. Comparison Run: Slow WAN (300 Kbps).
As expected, almost all tests are slower due to slower network. But overall perf are still pretty good for these small operations.
Scenario |
Test Case |
Baseline |
Comparison Run |
% Change from Baseline |
TFSLoad |
WITNew_Common_NewWI |
0.065 |
0.432 |
-564% |
TFSLoad |
WITPage_Common_PageItems |
0.081 |
0.475 |
-489% |
TFSLoad |
WITQuery_Common_AreaUnderAndTitleContains |
0.163 |
0.783 |
-380% |
TFSLoad |
WITUpdate_Common_ActiveToResolved |
0.100 |
0.466 |
-364% |
TFSLoad |
VCGet |
0.162 |
0.493 |
-204% |
TFSLoad |
PMGSSCheckPermission |
0.005 |
0.016 |
-198% |
TFSLoad |
VCQueryWorkspaces |
0.015 |
0.040 |
-172% |
TFSLoad |
WITQuery_Common_AssignedTo |
0.074 |
0.198 |
-166% |
TFSLoad |
PMGSSListProjectGroups |
0.018 |
0.042 |
-133% |
TFSLoad |
PMGSSIsPermitted |
0.006 |
0.014 |
-129% |
TFSLoad |
PMGSSReadIdentity |
0.006 |
0.013 |
-118% |
TFSLoad |
PMGSSGetUserIdentity |
0.007 |
0.015 |
-118% |
TFSLoad |
VCDir |
0.023 |
0.047 |
-105% |
TFSLoad |
VCHistory |
0.028 |
0.050 |
-82% |
TFSLoad |
VCAdd |
0.078 |
0.135 |
-72% |
TFSLoad |
VCUndelete |
0.134 |
0.228 |
-70% |
TFSLoad |
VCRename |
0.173 |
0.293 |
-69% |
TFSLoad |
VCCheckin |
0.149 |
0.244 |
-64% |
TFSLoad |
VCQueryItems |
0.021 |
0.034 |
-64% |
TFSLoad |
VCStatus |
0.072 |
0.116 |
-61% |
TFSLoad |
WITUpdate_Common_EditSimpleActive |
0.091 |
0.144 |
-59% |
TFSLoad |
VCGetSpecific |
0.113 |
0.176 |
-55% |
TFSLoad |
VCEdit |
0.105 |
0.163 |
-55% |
TFSLoad |
VCDelete |
0.151 |
0.226 |
-49% |
TFSLoad |
VCShelveUnshelve |
0.334 |
0.488 |
-46% |
TFSLoad |
VCQueryShelvesets |
0.013 |
0.019 |
-44% |
TFSLoad |
VCQueryItemsExtended |
0.060 |
0.084 |
-41% |
TFSLoad |
VCMerge |
0.147 |
0.201 |
-37% |
TFSLoad |
WITBulk_Common_UpdateEdit10 |
0.906 |
1.223 |
-35% |
TFSLoad |
VCBranch |
0.297 |
0.366 |
-23% |
TFSLoad |
TBQueueBuildsTest |
52.227 |
55.048 |
-5% |
TFSLoad |
TBViewBuildDetailedReportTest |
1.051 |
1.085 |
-3% |
TFSLoad |
TBViewBuildSummaryReportTest |
1.074 |
1.086 |
-1% |
TFSLoad |
VCUndo |
0.134 |
0.130 |
3% |