Manually process the data warehouse and analysis services cube for Azure DevOps

  • [アーティクル]

TFS 2017 | TFS 2015 | TFS 2013

You can manually process the Team Foundation Server (TFS) relational database (Tfs_Warehouse) or SQL Server Analysis Services cube (Tfs_Analysis):

  • When you need the freshest data in your reports.
  • When errors have occurred.
  • After you've resolved schema conflicts.

During typical operations, the warehouse is processed within two minutes of changes made to an operational store, and the cube is processed every two hours. By manually processing the warehouse, you help ensure queries and reports are up to date with data that depends on the warehouse.

You use the Warehouse Control Web Service to process the warehouse or cube or carry out other maintenance operations. If you know that you want to do a full rebuild of both databases, then use the Administration console or the TFSConfig RebuildWarehouse command.

Warehouse Control Web Services page

Note

Do not use SQL Server Management Studio (SSMS) to manually process the cube. Processing the cube using that tool is not supported.

Process the warehouse or cube

Processing the warehouse or cube depends on how much data is involved; it can take minutes or hours. Before you process either database, determine the processing status for the synchronization job or jobs that you want to run. Make sure that the status returns Idle

To access the web services

  1. If you aren't a member of the Administrators security group on the application-tier server for TFS, get added now.

    Also, make sure that your server-level Administer warehouse permission must be set to Allow.

  2. Sign in to the application-tier server and open the Warehouse Control Web Service by entering the following URL in a supported web browser:

    http://localhost:8080/DefaultCollection/TeamFoundation/Administration/v3.0/WarehouseControlService.asmx

    Or,

     http://localhost:8080/VirtualDirectory/DefaultCollection/TeamFoundation/Administration/v3.0/WarehouseControlService.asmx

    For VirtualDirectory, type the IIS Virtual Directory that was specified when TFS was installed. By default, the virtual directory is tfs.

    If the project is on a different project collection, specify the name of the collection in place of DefaultCollection.

  3. The WarehouseControlWebService page opens.

    If the page doesn't open, verify that the TFS Application Pool is running.

To check the process status

Choose GetProcessingStatus.

Get processing status

A new browser window opens. It indicates the following job's processing status:

  • Common Structures Warehouse Sync
  • Full Analysis Database Sync
  • Incremental Analysis Database Sync

And, the status for the following jobs for each team project collection is provided:

  • Build Warehouse Sync
  • Common Structures Warehouse Sync
  • Test Management Warehouse Sync
  • Version Control Warehouse Sync
  • Work Item Tracking Warehouse Sync

A value of Idle indicates that the synchronization job is currently not running. You should process the data warehouse or the cube only when the processing status for these jobs is Idle. If a different value is returned, repeat this step until Idle is returned for the job that you want to process.

To process the data warehouse

  1. Choose ProcessWarehouse, and optionally specify the team project collection to process. If you leave collectionName blank, all collections are processed.

    The service returns True when it successfully starts the processing of the warehouse and False if it isn't successful. A value of False indicates that the warehouse is currently being processed.

  2. To determine the processing status of the warehouse choose GetProcessingStatus as described earlier in to check the process status.

    Warehouse processing is completed when the GetProcessingStatus service returns a value of Idle, and a value of Succeeded for Common Structures Warehouse Sync and for each warehouse for each team project collection.

To process the Analysis Services cube

  1. Choose ProcessAnalysisDatabase.

  2. For processingType, type either Incremental or Full.

    If you specify Incremental, data is processed only if it has been added since the most recent processing.

    If you specify Full, all data is processed as if the warehouse were being rebuilt. Full processes take longer to carry out. Only do them when they're required. For example, when a team project or project collection has been removed or deleted, do a full process.

    The service returns True when it successfully starts the processing of the cube and False if it isn't successful. A value of False indicates that the cube is currently being processed.

  3. To determine the processing status of the warehouse choose GetProcessingStatus as described earlier in to check the process status.

    Cube processing is completed when the GetProcessingStatus service returns a value of Idle, and a value of Succeeded for the following jobs.

    • Full Analysis Database Sync
    • Incremental Analysis Database Sync

Process dimensions for expanded capacity

You should run the ProcessDimensionsForExpandedCapacity web service when you receive one of the following error messages:

Microsoft.TeamFoundation.Warehouse.WarehouseException: TF221122: An error occurred running job Full Analysis Database Sync for team project collection or Team Foundation server TEAM FOUNDATION.

Microsoft.TeamFoundation.Warehouse.WarehouseException: Failed to Process Analysis Database 'Tfs_Analysis'.

You should run the ProcessDimensionsForExpandedCapacity web service when you receive the following error message:
Microsoft.TeamFoundation.Warehouse.WarehouseException: TF221122: An error occurred running job Full Analysis Database Sync for team project collection or Team Foundation server TEAM FOUNDATION.
Microsoft.TeamFoundation.Warehouse.WarehouseException: Failed to Process Analysis Database 'Tfs_Analysis'.
Microsoft.TeamFoundation.Warehouse.WarehouseException: File system error: A string store or binary store with a compatibility level of '1050' is at the maximum file size of 4 gigabytes. To store additional strings, you can change the StringStoresCompatibilityLevel property of the associated dimension or distinct count measure to '1100' and reprocess. This option is only available on databases with a compatibility level of '1100' or higher.
Physical file: \?\I:\OLAP\Data\Tfs_Analysis.0.db\vDimWorkItemOverlay.5.dim\7.WorkItemSK.asstore.

This service changes the StringStoresCompatibilityLevel to 1100 for the Work Item dimension and carries out a full cube reprocess.

  1. From the Warehouse Control Web Service, choose ProcessDimensionsForExpandedCapacity.

  2. Enter the name of the dimension. From the above error message, the dimension name is vDimWorkItemOverlay.

  3. The service returns True when it successfully resets the value to 1100.

    Wait until the cube processing has succeeded.

You should process a database manually for one of the following reasons:

  • Incrementally process the cube when reports don't show the latest data and you need them up to date for an upcoming meeting.
  • Process each team project collection within the data warehouse to verify resolution of all schema conflicts.
  • Process each team project collection within the data warehouse to collect information to diagnose issues appearing in the event viewer related to warehouse jobs.

Do a full rebuild of the warehouse and cube when you move, restore, rename, or fail over the TFS data-tier server.

As needed, change the refresh processing interval or other processing parameters.