pyspark notebook: dedicated pool table to pandas dataframe

Jon Z 60

Hello,

I have a table in the dedicated pool, I need to read this table into a pandas dataframe to do some calculation

Is this posible ?

Thanks

1 answer

Nandan Hegde 32,181 Reputation points MVP

2024-09-27T02:43:45.78+00:00

Yes, it is possible

below MSFT doc provides details :

https://video2.skills-academy.com/en-us/azure/synapse-analytics/spark/synapse-spark-sql-pool-import-export?tabs=scala%2Cscala1%2Cscala2%2Cscala3%2Cscala4%2Cscala5
Please sign in to rate this answer.
Jon Z 60 Reputation points

2024-09-27T07:17:54.9866667+00:00

thanks for the reponse, however, I need to use pandas library and the doc refers to pyspark arrow dataframe

Is it posible to dump the content of a table directly to a pandas dataframe
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Your answer