How to migrate data from Azure databases to the container of storage accounts?

Huang, Winston-HR 300 Reputation points
2024-06-24T07:30:36.06+00:00

hi friends,

i want to migrate data from two databases of azure synapse analytics to my ADLS2 container.What is a simple and efficient way?

Thanks

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,408 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,612 questions
0 comments
Accepted answer
  1. Nandan Hegde 30,716 Reputation points MVP
    2024-06-24T08:09:58.12+00:00

    Hey,

    Below are the 2 ways to migrate it , both would have a meta data driven framework.

    1. use CETAS query to copy data from the tables into the blob

    https://video2.skills-academy.com/en-us/azure/synapse-analytics/sql/develop-tables-cetas

    You can create a dynamic SP and loop it the number of times the number of tables within the database and then do the CETAS per table

    1. Use ADF/synapse pipelines to copy the data from the tables with ADLS gen 2 as the sink.

    The flow would be

    Lookup activity >> Foreach (within foreach copy activity)

    Lookup activity : Get list of table from information schema query

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest