Azure HDInsight
Product
A managed open-source analytics service that runs big data frameworks such as Hadoop, Spark, HBase, Hive and Kafka in Azure.
Description
Azure HDInsight is a managed open-source analytics service in the cloud. It runs big data frameworks in your Azure environment. The page names cluster types for Apache Hadoop, Apache Spark, Apache HBase, Interactive Query with Hive and Apache Kafka. Clusters include components such as Ambari, Hive, Tez, Oozie and ZooKeeper, and further libraries can be added with script actions.
Clusters are created on demand and can join an Azure Virtual Network and use Microsoft Entra ID. Azure Monitor integration and an end-to-end SLA for production workloads are listed as features. Power BI and Excel can connect to the data, and development tools include Visual Studio, VS Code, Eclipse and IntelliJ.
The page names four typical uses: batch processing and ETL, data warehousing with interactive queries on very large data, processing of streaming IoT data, and extending on-premises big data setups to Azure. Data engineers and analysts who want to keep open-source tools and their code use it. The page shows no retirement notice.
| Type | Product |
|---|---|
| Also known as | HDInsight |
| Documentation | learn.microsoft.com/en-us/azure/hdinsight/hdinsight-overview |
Related topics in brief
- Microsoft Azure · Part of · Platform
Microsoft Azure is Microsoft's cloud platform with services for computing, storage, networking, databases, analytics and AI. - Microsoft · Developed by · Organization
Microsoft Corporation is a technology company that develops software and cloud services such as Microsoft 365, Azure and Dynamics 365. - Microsoft tool · Is a · Category
A software product or service developed by Microsoft. - Analytics and BI tool · Is a · Category
A tool for analysing data and building reports and dashboards. - Azure Databricks · Related to · Product
A first-party managed Apache Spark analytics service on Azure, built by Microsoft and Databricks, for data engineering, analytics and machine learning on data kept in your own storage. - Azure Synapse Analytics · Related to · Product
Azure analytics service that combines data warehousing and big data analytics; its serverless SQL pool can query files such as public Azure Open Datasets directly with OPENROWSET without provisioning storage. - Azure Data Lake Storage · Related to · Product
Azure Data Lake Storage is a set of capabilities on Azure Blob Storage for storing large volumes of data for analytics workloads. - Apache Spark · Related to · Product
An open-source distributed processing engine that splits large data workloads across many machines; it began at UC Berkeley and is maintained by the Apache Software Foundation. - Apache Kafka · Related to · Product
Open-source distributed event streaming platform from the Apache Software Foundation, used for high-throughput event streams, data pipelines and analytics with the ability to replay past events.
Part of
- Microsoft Azure · Platform
Developed by
- Microsoft · Organization
Is a
- Microsoft tool · Category
- Analytics and BI tool · Category
Related to
- Azure Databricks · Product
- Azure Synapse Analytics · Product
- Azure Data Lake Storage · Product
- Apache Spark · Product
- Apache Kafka · Product
Community wiki
Short info above, community knowledge below: add practical tips, examples or corrections. New contributions are reviewed first; trusted members publish directly.
Experts and companies for this topic
Nobody has listed this topic yet. Add it to your profile.
Experts on related topics
- Mirko Peters ✔ · via Microsoft Azure
Sources
- Documentation: learn.microsoft.com/en-us/azure/hdinsight/hdinsight-overview
Maintained by Mirko Peters (Microsoft MVP) · Last updated: