Using Spark action in HDInsight Hue

Abhijeet Bane 1 Reputation point
2020-07-23T09:32:26.923+00:00

I have created a Spark 2.4 cluster using HDInsights in Azure.
I have installed Hue over it using Script actions.
Also did the necessary steps for SSH tunneling and connecting to Hue UI.
However, on the Hue UI I am able to only see Pig and Hive actions. I want to create an Oozie flow and using Spark actions in it. Any help to configure Spark with Hue on this HDInsight Spark cluster?

Azure HDInsight
Azure HDInsight
An Azure managed cluster service for open-source analytics.
204 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,047 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. PRADEEPCHEEKATLA-MSFT 84,531 Reputation points Microsoft Employee
    2020-07-24T05:11:55.977+00:00

    Hi @Abhijeet Bane ,

    Welcome to Microsoft Q&A Platform.

    In Hue, Apache Oozie referred as workflows.

    13596-hue-workflow.png

    Hue is a set of Web applications used to interact with an Apache Hadoop cluster. You can use Hue to browse the storage associated with a Hadoop cluster (WASB, in the case of HDInsight clusters), run Hive jobs and Pig scripts, and so on. The following components are available with Hue installations on an HDInsight Hadoop cluster.

    • Beeswax Hive Editor
    • Apache Pig
    • Metastore manager
    • Apache Oozie
    • FileBrowser (which talks to WASB default container)
    • Job Browser

    13556-hue-workflows.gif

    Reference: Azure HDInsight - Hue

    Hope this helps. Do let us know if you any further queries.

    ----------------------------------------------------------------------------------------

    Do click on "Accept Answer" and Upvote on the post that helps you, this can be beneficial to other community members.