How to fix error "AADB2C90046" returned back by ACS endpoint of Azure AD B2C?
Users are encountering an error after successful authentication through SiteMinder (external IdP). Following authentication, SiteMinder sends a SAML Response to Azure AD B2C's ACS endpoint, but B2C returns the below…
Why Microsoft Azure Open AI Service trainings require enterprise level access?
The training content is for the student who need restriction free learning but when Open AI service training is restricted to have an enterprise level request, it is acting as a barrier for a person to learn about those services. Why is there no free…
how to revert test result after retention expire
Hi Supporter, We have an issue Test results of Azure DevOps when retention expires and all the test results data are removed. Those results are significant to us. Could you advise us on How to revert the test result after the retention expires? Big…
How to improve the apache pool efficiency ?
I have roughly around 3000 jsons and i am creating a dataframe out of it and saving it to delta format and it is taking me hours for that even though my spark pool is of medium size. The spark pool runs at 33% utilization,
Register button is disabled for Azure HDInsight
Hello, I hope this message finds you well. We are having an issue with the registration button for the HDInsight resource provider in the Azure portal. When trying to register from the account of the user with the global adminitiration role, I noticed…
Databricks OutOfMemory error on code that previously worked without issue
I have a notebook in Azure Databricks that converts a list of columns in a bronze tier table into individual child rows in a silver tier table. This notebook was previously running (for weeks) without issue. Suddenly, I am now consistently receiving an…
Databricks OutOfMemory error on code that previously worked without issue
I have a notebook in Azure Databricks that does some transformations on a bronze tier table and inserts the transformed data into a silver tier table. This notebook is used to do an initial load of the data from our existing system into our new datalake.…
About Event Hub Billing Method
Hi Everyone According to the pricing page on Event Hub, one of the fact questions expresses the following: To understand this well, I want you to help me understand this based on the next scenarios. Both scenarios tell us about changing the capactity of…
Disable Microsoft Defender for Cloud for select virtual machines in Azure
I have several VMs running Windows 10/11 and Ubuntu in my Azure vnet and I really don't need them included in Microsoft Defender for Cloud. I've done some searching and apparently there is no way to select which VMs are included in the service, it's an…
Failure on Write EventSubscription - Internal error
I am trying to set up Databricks Autoloader with File Notifications. Every time I get a failure on the EventSubscription/write operation. I have tried giving the relevant account as much access as I can but still nothing. { "statusMessage":…
How to ship Azure Databricks artifacts from Dev->QA->Prod through Azure Devops Pipelines?
We have a Azure Databricks workspace and Dev/QA/Prod environments. Everytime the Data engineers have to ship the artifacts from nonprod -> prod (e.g. python notebooks, config modules, etc) they have to copy the artifacts manually over to the next…
Activity stuck in queue status
Starting from today morning, I am facing problem that any pipeline run, by trigger or manually or in debug mode, doesn't start. To be precise, pipeline starts ("In progress", but first activity stays in "Queue" status). Doesn't matter…
Stored procedure transformation always on queued
Hello , I have 2 environment dev and test. There is a stored procedure which run successfully on dev bot queued on test for hours. What are the possible causes for that ? It runned successfully on dev in 1m on datafactory and 5 second on database.
Azure Data Factory pipelines stuck on first activity for 7+ hours
Hi, I just woke up to monitor all the runs, and suddenly saw that all of my runs were stuck on the first activity, or not even starting the first activity some for more than 7+ hours. This happened over-night as yesterday everything was fine and I didn't…
Do you know how to install the 'ODBC Driver 17 for PostgreSQL' on a Azure Databricks cluster?
I am attempting to run postgreSQL stored procedures , through Azure Databricks notebook. We have stored procedure written in Azure Database for PostgreSQL and we want to run postgreSQL stored procedures through Azure Databricks Notebook (using…
How do I add an inbound security rule if there is an default DenyAllInbound Rule that causes an error when attempting to create an inbound rule?
|Received an email with: The public IP address range for the Azure Databricks control plane will be updated on 30 May 2024—you may need to take action You're receiving this email because you use Azure Databricks. To support infrastructure …
How to send compressed Json to azure event hub and read in fabric pyspark streaming ?
I am sending compressed data into Event Hub to overcome 1 MB hard limit in Azure Event Hub. I also have to read this in Py-spark and update delta table. The compressed data send to Event hub is coming as null in Py-spark stream. How to read it? This is…
Help on executing custom query on Azure Cosmos DB using Spark in Azure Synapse
Hi Team, I want to run custom query against cosmos db in spark using clientid and secret but I'm ending up with below error. can you please assit. I tried multiple way but it still gives same error. AppId has Reader access on the cosmos db account. As…
When we deploy ADF,we are getting "TooManyFactoryUpdaterequests" in Create or Replace GlobalParameter through Azure Devops
When we deploy ADF, we are getting "TooManyFactoryUpdaterequests" in Create or Replace GlobalParameter using CI/CD Azure devops
How to get the subscription key of an ARM-based Azure AI video indexer account?
Is there a way to obtain the subscription key of an ARM-based Azure AI video indexer account? If so, what is the process to do so? Thank you.