In the blog post Call a Fabric REST API from Azure Data Factory I explained how you can call a Fabric REST API endpoint from Azure Data Factory (or Synapse if you will). Let’s go a step further and execute a Fabric Data Pipeline from an ADF pipeline, which is a common request. A Fabric […]
Category: Fabric
Call a Fabric REST API from Azure Data Factory
Suppose you want to call a certain Microsoft Fabric REST API endpoint from Azure Data Factory (or Synapse Pipelines). This can be done using a Web Activity, and most Fabric APIs now support service principals or managed identities. Let’s illustrate with an example. I’m going to call the REST API endpoint to create a new […]
How I passed the DP-700 Exam
I recently took and passed the DP-700 exam, which is required for the Microsoft Certified: Fabric Data Engineer Associate certification. It’s the second Fabric certification, and it focuses more on the data engineering aspect of Fabric, as well as a bit of governance and administration. My preparation for this exam is probably fairly atypical, because: […]
Take over Ownership in Microsoft Fabric
When you create an item in Microsoft Fabric (a notebook, a lakehouse, a warehouse, a pipeline …), you are also the owner of the item. There has been an outstanding issue in Microsoft Fabric, where if a user’s account was deactivated, other users could no longer access the item. Whoopsies. When a consultant came in, […]
Microsoft finally adds Tenant Switcher for Fabric / Power BI
Praise whatever deity you believe in, because it’s finally here, a tenant switcher for Microsoft Fabric (which includes Power BI). A what? Let me explain. When you have a organization with multiple tenants in Azure (also called directories in some products like Azure Devops), or you’re a consultant like me who works with multiple clients […]
Dynamic Warehouse & Lakehouse Connections in Microsoft Fabric Data Pipelines
When you develop data pipelines in Microsoft Fabric (the Azure Data Factory equivalent in Fabric, not to be confused with deployment pipelines), you will most likely have some activities with a connection to a warehouse, a lakehouse or a KQL database (for the remainder of the blog post I’ll talk about a warehouse, but it […]
System Views in Microsoft Fabric – Query references an object that is not supported in distributed processing mode
I have a metadata-driven ELT framework that heavily relies on dynamic SQL to generate SQL statements that load data from views into a respective fact or dimension. Such a task is well suited for generation, since the pattern to load a type 1 SCD, type 2 SCD or a fact table is always the same. […]
PostgreSQL error in Fabric Pipelines – No pg_hba.conf Entry for Host
I came across a bit of a weird error when I was trying to connect to a PostGreSQL database (hosted as an Azure DB for PostGreSQL), where “xx.xx.xx.xxx” is some IP address: No pg_hba.conf entry for host “xx.xx.xx.xxx” Some context to get us started. I’m using Pipelines in Microsoft Fabric to copy data from an […]
Techorama 2024 – Slides
You can find the slidedeck for my Techorama session “Microsoft Fabric for Dummies” on github.
Webinar – Microsoft Fabric for Dummies
On Wednesday May 15th 2024 I will give a free webinar on MSSQLTips.com about Microsoft Fabric (at 6PM UTC).Abstract: Microsoft Fabric is the new all-encompassing data platform of Microsoft. But there are so many components, services, and features to learn, it may seem overwhelming. In this session, we step back and start from the beginning. […]