Import an Azure Function into API Management, give clients an APIM subscription key while APIM holds the Function host key, then lock down the Function so callers cannot bypass APIM.
Copy activity moves data; mapping data flows transform it on managed Spark. How they differ on runtimes, connectors, transformations, tuning, billing, schema drift and debugging, how they combine, and a decision guide for choosing.
Fix [PATH_NOT_FOUND] Path does not exist errors when a Databricks notebook reads ADLS Gen2: what the error means, how to find the first wrong path segment, and fixes for abfss URIs, globs, late files, mounts and Unity Catalog volumes.
Make an Azure Data Factory mapping data flow survive new, renamed and retyped columns when landing Parquet in ADLS Gen2: source settings, byName(), column patterns, sink mapping and Parquet naming rules.
Event Hubs, Service Bus and Event Grid compared: streams vs messages vs notifications, ordering, replay, dead-lettering and delivery guarantees, with a decision guide and a Bicep example.
Why events arrive late, how Spark watermarks and Stream Analytics tolerances decide what counts, and six strategies to measure lateness, size watermarks and correct late data instead of losing it.
A hands-on guide to Spark Structured Streaming: the micro-batch model, sources and sinks, output modes, triggers, watermarks, foreachBatch upserts and monitoring, with output from a local run.
Step-by-step: stream Event Hubs events into bronze and silver Delta tables on Azure Databricks with the Kafka connector, a Unity Catalog service credential, watermarks and deduplication.
How Azure Event Hubs works under the hood: partitions and partition keys, sizing the partition count, consumer groups, checkpoints and tier limits, with Bicep and Python examples.