Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,408 questions
1 answer
Creating datasets in Azure Machine Learning service from more than 100 paths
Hi, I need to create a dataset in Azure Machine Learning service from an Azure Data Lake Gen2 registered as a Datastore. Data in the lake are 1000's of avro files stored by an Event Hub Capture following the pattern…
asked 2020-06-09T16:08:40.387+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(44.800000000000004, 92%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAC%3C/text%3E%3C/svg%3E)
Ariel Cedola
21
Reputation points
commented 2020-06-11T17:32:16.453+00:00
Ariel Cedola
21
Reputation points
1 answer
One of the answers was accepted by the question author.
HDInsight Cluster create a file with write mask
Hi, We are using Data Lake Gen 1 as the data store for HDInsight Cluster version 3.6. I wrote a simple spark code to write a file using saveas command of pyspark. The file is created in the DataLake with a write mask on. As a result. Any other user is…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(188.79999999999998, 61%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHG%3C/text%3E%3C/svg%3E)
1 answer
How to push data from Azure Data lake to remote file server (network file folder)
Hello Experts, I need your guidance on how to push files from Azure Data lake to remote file server(network file folder). Our requirement is to send files from Azure Data Lake Gen2 to Remote File Server( Network File Folder), once the data pushed…
asked 2020-06-01T08:56:36.84+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 78%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EF%3C/text%3E%3C/svg%3E)
fbmsdn511
1
Reputation point
commented 2020-06-03T01:24:27.297+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
KranthiPakala-MSFT
46,437
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Merge two different Azure Data Lake Storage Account under one subscription.
Hi There, I have two Storage accounts the old ADLS Gen1 under one Management Group and subscription and another new ADLS Gen 2 under entirely different Management Group and another subscription. Now, the requirement is to have complete data (Gen1 +…
asked 2020-05-30T19:05:57.457+00:00
Utkarsh Sharma
41
Reputation points
accepted 2020-05-30T20:14:21.87+00:00
Utkarsh Sharma
41
Reputation points
2 answers
One of the answers was accepted by the question author.
Copy Multiple files into ADL Gen2
I have a Data Factory pipeline that currently copies files daily from a Google Storage account down to an Azure Storage Blob ADL Gen2 enabled. Source several different files, File1, File2, File3 etc, all have a data range in the file name…
asked 2020-05-11T06:31:21.043+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 57.99999999999999%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERH%3C/text%3E%3C/svg%3E)
Ramya Harinarthini_MSFT
5,311
Reputation points Microsoft Employee
answered 2020-05-30T18:44:02.26+00:00
Utkarsh Sharma
41
Reputation points
1 answer
One of the answers was accepted by the question author.
Azure File storage SAS TOKEN
I can upload files to ADLS Gen 2 blob storage with AzCopy through OAuth authorization, but I am unable to upload to file storage with the same. It is asking for SAS token. Please tell me the process of generating SAS token. Thanks. [Note: As we…
asked 2020-05-11T06:25:14.897+00:00
Ramya Harinarthini_MSFT
5,311
Reputation points Microsoft Employee
accepted 2020-05-11T10:24:28.987+00:00
Ramya Harinarthini_MSFT
5,311
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
SSIS connection manager for ADLS Gen 2
Could we use SSIS with ADLS gen2. I am trying to write file to Azure data lake gen 2 using Azure Blob Upload task and Azure Data Lake Store File System Task, but i am unable to do it. Thanks. [Note: As we migrate from MSDN, this question has been…
asked 2020-05-08T22:49:51.74+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 55.00000000000001%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
601
Reputation points
accepted 2020-05-08T23:04:57.96+00:00
HimanshuSinha-msft
601
Reputation points
1 answer
One of the answers was accepted by the question author.
Data Lake and Environments - Best Practice
Hello All, Is it a best practice to have one Big Data Lake for all the environments (Dev, Stage, QA and Prod) or have a Data Lake for Prod and another for Non-Prod ... etc.? If we chose to share a data lake across environments, then audit will play…
asked 2020-05-08T22:44:08.943+00:00
HimanshuSinha-msft
601
Reputation points
accepted 2020-05-08T23:04:48.817+00:00
HimanshuSinha-msft
601
Reputation points