Hello Subhadip Roy,
Greetings! Welcome to Microsoft Q&A Platform.
I understand that you’re encountering an issue with the copy activity in Azure Data Factory (ADF) when trying to extract error tables from Databricks Delta tables, convert them to CSV, and load them into Azure Data Lake, the error message you’re encountering indicates that the URL scheme being used is not valid. Azure Data Lake Storage Gen2 (ADLS Gen2) only supports http and https schemes.
Please verify which authentication method is used to connect to ADLS Gen2 and if it is service principal, check whether it has necessary permissions to access the particular folder in error message (please refer this document).
Ensure that the URL you are using in your configuration is correctly formatted with https also in Azure Data Factory, check the linked service configuration for your ADLS Gen2. Ensure that the URL is correctly specified and uses the https scheme and confirm that the URL you’re using starts with either http:// or https://. If you’re using a different scheme, such as ftp:// or file://, you’ll need to modify it to one of the supported schemes.
Ensure that your Azure Storage account allows access from Azure services. You might need to enable the “Allow trusted Microsoft services to access this storage account” option in the storage account firewall settings. Check the firewall settings of your ADLS Gen2 storage account to ensure that the IP addresses of the ADF integration runtime are allowed.
If the self-hosted integration runtime uses a proxy server, check the Azure Storage firewall settings to ensure that the IP address of the proxy server is allowed. If it is not allowed, add the IP address to the firewall settings refer article - https://video2.skills-academy.com/en-us/azure/data-factory/azure-integration-runtime-ip-addresses.
In addition, please make sure that the below troubleshooting steps have been followed: https://video2.skills-academy.com/en-us/azure/data-factory/connector-troubleshoot-azure-data-lake#azure-data-lake-storage-gen2, Troubleshoot the Azure Data Lake Storage connectors in Azure Data Factory and Azure Synapse
Hope this answer helps! please let us know if you have any further queries. I’m happy to assist you further.
Please "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.