Data is missing from management API using service principle. ex: Advisor Recommendations

Hi @Mahesh Reddy
Thanks for the question and using MS Q&A platform.

As I understand you're experiencing some issues with retrieving the full dataset from the Azure Management API. I'd be happy to help you troubleshoot this.

Here are some steps to help you troubleshoot and resolve the issue:

• Permission Issues: First, let's check the permissions. Since you've created a service principal in Azure AD App Registration, you need to ensure that the service principal has the necessary permissions to access the resources. Here are some possible permissions that might be missing: Microsoft.Resources/subscriptions/resourceGroups/read Microsoft.Resources/subscriptions/resources/read Microsoft.Security/assessments/read Microsoft.Security/tasks/read Microsoft.Security/secureScores/read You can check the Azure AD App Registration's API permissions by going to the "API permissions" tab and verifying that the necessary permissions are listed. If not, you can add them by clicking "Add a permission" and searching for the required permissions.
• Handle pagination: The Azure Management API uses pagination to limit the number of results returned in a single response. By default, the API returns a maximum of 100 results per page. To retrieve all data, you need to handle pagination correctly. When calling the API, check the response headers for the Link header, which contains a URL to the next page of results. You can then use this URL to retrieve the next page of data.

For example, in the response headers, you might see:

Link: <https://management.azure.com/subscriptions/{subscriptionId}/resources?api-version=2021-04-01&$skiptoken={skiptoken}>; rel="next"

Use the URL in the Link header to retrieve the next page of results. Continue this process until there are no more pages to retrieve.

• Check subscription scope: Since you're trying to retrieve data from multiple subscriptions under the same tenant, ensure that your service principal has the necessary permissions at the tenant level. Assign the required permissions to your service principal at the tenant level, and then use the https://management.azure.com/ endpoint to retrieve data from all subscriptions.
• Verify token scope: When obtaining the access token, ensure that the token scope includes the necessary permissions for each dataset. You can do this by specifying the scope parameter when requesting the access token. For example, to retrieve resources, you might specify the scope as https://management.azure.com/.default.
• Use the correct API version: Ensure that you're using the correct API version for each dataset. The API version you're using (2021-04-01) might not be the latest or the one that supports the features you need. Check the Azure Management API documentation for each dataset to determine the recommended API version.  
• It seems like the issue is that you are unable to add the required permissions. The permissions you mentioned are not available in the Azure AD app registration's API permissions. This means that you need to add them manually.

By following these steps, you should be able to retrieve all data from the Azure Management API for each dataset.

Please let us know if you have any further queries. I’m happy to assist you further. 

Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.