Open Source Big Data applications that work with Azure Data Lake Storage Gen1

Note

Azure Data Lake Storage Gen1 is now retired. See the retirement announcement here.Data Lake Storage Gen1 resources are no longer accessible.

This article lists the open source big data applications that work with Azure Data Lake Storage Gen1. For the applications in the table below, only the versions available with the listed distribution are supported. For information on what versions of these applications are available with HDInsight, see HDInsight component versioning.

Open Source Software Distribution
Apache Sqoop HDInsight 3.2, 3.4, 3.5, and 3.6
MapReduce HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Storm HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Hive HDInsight 3.2, 3.4, 3.5, and 3.6
HCatalog HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Mahout HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Pig/Pig Latin HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Oozie HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Zookeeper HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Tez HDInsight 3.2, 3.4, 3.5, and 3.6
Apache Spark HDInsight 3.4, 3.5, and 3.6

See also