ADLS connections with third party

Anshal 2,246 Reputation points
2024-07-23T07:31:13.8+00:00

Hi friends, we have ingested data from all the data sources and stored it in ADLS Gen2 but after that, there is a virtual layer in the form of Denodo. This virtualization tool only has views and once views are executed, it fetches the data from multiple data sources and retrieves the data. Since Denodo has views on how it would connect with ADLS and fetch the data from multiple datalake folders and subfolders at once. Is it even possible?

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,458 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,520 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Amira Bedhiafi 22,616 Reputation points
    2024-07-23T20:05:11.91+00:00

    Create a data source in Denodo that connects to your ADLS Gen2 account and provide the necessary connection details such as the Account Name, Account Key, Container Name, and File System Name.

    Then you need to provide the Account Key for authentication. You may also use other authentication methods like Service Principal or Managed Identity if preferred.

    Once everything is ok , you can create base views in Denodo which will represent the data stored in ADLS Gen2.

    Select the files or folders you want to create views for and define the schema for these files (Denodo c can automatically detect the schema based on the file format) and create Base View for each data file or folder you need.

    To fetch data from multiple folders and subfolders, you can use the derived views or combine multiple base views using SQL.

    https://community.denodo.com/videos/details/Cloud/Denodo%207.0/How%20to%20connect%20to%20Azure%20Data%20Lake%20Storage%20from%20Denodo%20Platform


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.