How to write directly from Amazon s3 bucket to unity catalog volume storage?
Hello, I am trying to save files from an s3 bucket into volume storage on Unity Catalog. I am using the boto3 library and when using the download file command I get the below error. I have been able to pull down two files, but I was essentially using the…
Getting Socket error code timed out while connecting to a SFTP server via Azure data factory
I am very new to Azure and My Use Case is that, I want to move the file from my Azure blob storage to a third party SFTP server. I got to know that Azure data factory will help me to move the files out by creating linked services from source and target…
Cannot bulk load because the file "xxxxxxx.txt" could not be opened. Operating system error code 161(The specified path is invalid.).
I am trying to bulk insert to a azure SQL database table from the text file stored in BLOB storage.( It is a public storage size of the file is 741MB I did CREATE EXTERNAL DATA SOURCE MyAzureBlobStorage WITH ( TYPE = BLOB_STORAGE, LOCATION =…
How to retrieve accidentally deleted blob without soft delete enabled
A blob has been accidentally deleted and soft delete was not enabled. Can we retrieve it?
Not able to mount azure blob storage with azure data bricks
I am using below code #Define parameters storage_account_name = "rupeshblob001" # e.g., "mystorageaccount" container_name = "testcontainer" # e.g., "mycontainer" mount_point = "/mnt/mymountpoint" #…
Hydration of blob through copying sets "Copying Status" to pending instead of the "Archive Status" to rehydrate-pending.
CONTEXT: I am rehydrating an archived blob by copying it in a different storage account of the same region. COMMAND: Using either of the possible options listed here:…
Azure Blob File is Detected Not Exist While It Actually Exists
I want to move a video file from Azure Blob Storage to Sharepoint directly using C#. The code below does not work because there is a problem when getting the blobStream. I have ensured that my containerName and blobName are correct. However, when I…
Microsoft deprecated NuGet package support for the Migrated Storage Account
Considering the classic storage accounts are migrated to Azure Resource Manager, will the deprecated NuGet packages Microsoft.WindowsAzure.Storage Microsoft.Azure.Storage be able to call Azure Resource Manager (migrated account)? Note: NuGet…
Azure Gallery Apps The SAS is not valid for source uri (Code: InvalidParameter)
I just can't seem to work this out. I have a Storage Account that has anonymous access disabled. I have msi's and exe's on there that I am wanting to use the Azure Compute Gallery to deploy to the Azure VMs. So, I'm using both the portal and Azure…
Enabled anonymous access to contain via browser
I have several large files that I need to share with several individuals. These are not private files and they will soon be available for public access on our website. I would prefer to allow anonymous access to these files - and they should be…
How to improve synapse notebook performance while storing data to blob
I have created multiple cell in notebook and executing. Taking to much time to fetching data from particular path and store data into DB as well as blob. So how can I reduce the execution time??
![](https://techprofile.blob.core.windows.net/images/hAFzqf2_AwAAAAAAAAAAAA.png?8DB62B)
Multimodal Vector Embeddings
I was trying to create multimodal vector index for text and images by running this script: https://github.com/Azure/azure-search-vector-samples/blob/main/demo-python/code/e2e-demos/azure-ai-search-multimodal-build-demo.ipynb For the actual blob storage…
How to allow all systems which are corp connected to access my azure storage account
Is it possible to grant access to all systems connected to the Microsoft VPN network to my Azure storage account? Although we restricted access to specific user groups and IP addresses/vnets, we have over 400 individual users who mount our file share on…
Modifying SFTP container directory permissions via ACL
Hi, I have setup up an SFTP service over Azure blob storage for a data vendor. The container has three folders - inbound, outbound and archive. From the portal I can give the permissions (READ, WRITE or LIST) to a local user for the whole container which…
Requirements/Limitations on Tags
We have x million files (and growing). Does it make sense to keep the original file name as a index tag or should be keep it in properties? Original file name is quasi unique so there will be around x million tags. Will the search on tags be perfomant on…
Unable to see the Azure blog storage trigger
When Im trying to create a blob storage trigger, although ive created a blob I couldn't get the trigger please have a look at the attached screenshots. Please someone have a look into this, I am reachable on the email id below nissynani2002@icloud.com
Azure BlobClient download access denied for target folder
I am creating an Azure Storage blob and using the BlobClient download method to download the blob content to a local file. I get "Access Denied". Is there a way to set security on the local folder to allow the Azure app to write the file. …
Users are not able to see some resources in a resource group where they have respective contributor access.
I created a resource group and added some resources in that. There I added my team through security group which has respective contributor roles for those resources. Some of these resources including blob storage is not visible to the team. To…
Blob versioning with hierarchical namespace
Hello, As it has been discussed here, https://video2.skills-academy.com/en-us/answers/questions/1066453/versioning-and-hierarchical-namespace, I am following-up on the same topic. Is there any way we can enable blob versioning with hierarchical namespace…
AzCopy Security Mechanism
Hello Experts, I couldn’t find much information related to AzCopy security best practices, particularly around encryption in transit and at rest, TLS certification, secure protocols, etc. I would greatly appreciate it if you could share or direct me to…