Azure Community Support

Ask questions, get answers and connect with Microsoft engineers and Azure community experts

Products

    StackOverflow

    Community responses to development questions

    Using JsonSerDe in a hive script in an on-demand hdinsight cluster

    • azure
    • hive
    • user-defined-functions
    • hdinsight

    Connecting Azure HDInsight Spark cluster and Eventhubs with Kafka protocol

    • java
    • azure
    • apache-spark
    • azure-eventhub
    • hdinsight

    Issue with Invoke-AzResourceAction cmdlet with a function wrapper

    • azure
    • certificate
    • azure-resource-manager
    • azure-powershell
    • hdinsight

    Serverfault

    Community responses to Sys/Net admin questions

    The are no most recent posts for HDInsight in Serverfault

    Azure Feedback

    Do you have an idea or suggestion based on your experience with Azure?

    default conda environment update

    As we know, Python 2.7 stop it's support on Jan 1st, 2020. But anaconda installed in HDinsight is still in old version. Base Environment use python 2.7. When using HDInsight Spark with Azure Machine Learning, it will always come with an error first to update conda. That is a bad experience.

    Documentation mentions that Kafka 2.3 is a recommended option on HDI 4.0.

    https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-version-release "We recommend using Spark 2.4 & Kafka 2.3 and above in HDInsight 4.0." How can this be set up as there is no option to configure Kafka 2.3 while cluster creation?

    Kill a cluster in "Applying Changes"

    There is no way to delete a cluster if it is still in "applying changes" phase. When automating cluster creation I need to iterate, change things and break things. If I need to repeat an experiment, I have to wait for (a minimum) of 30 minutes to repeat an experiment on the HDInsight cluster, just because is in Applying changes. Feels like loosing control over my resources and incurs on extra cost and time.

    T4

    Il est oou

    Influence the next generation of Microsoft products

    Give feedback