Spark configurations are critical in controlling the behavior of your data processing tasks. These configurations influence various aspects of Spark’s performance, from memory management to execution behavior. Typically, these settings are adjusted at the session level, meaning they apply only to the specific Spark session in which they are set. This granularity allows for fine-tuning of… READ MORE
Introduction For a long time, Git has been at the center of IT development. While there are a few patterns on how to use Git, the main idea remains the same. There is a collaboration branch, often called ‘main,’ where developers work from by branching out. At some point, the work in the branch-out branch… READ MORE
Imagine soaring high above the city, the landscape stretching out below, each building, each road, each individual vehicle going about their day. That is the view from a helicopter — a perspective that allows you to see everything at once, yet with the ability to focus on specific details. This is an apt analogy for Microsoft… READ MORE
Microsoft Fabric is a cloud-based data platform that provides a range of services for data engineering, data science, and business intelligence. It is an extension of Azure Synapse Analytics that integrates all analytics workloads from the data engineer to the business knowledge worker. Fabric brings together Power BI, Data Factory, and the Data Lake, on… READ MORE
Microsoft Fabric is a comprehensive analytics solution designed for enterprise customers and is a new unified data analytics platform from Microsoft that has brought together a range of data technologies, some of which are already available in the Azure universe. It encompasses various aspects such as data movement, data science, real-time analytics, and business intelligence.… READ MORE
Microsoft Fabric – The Future of Data Analytics? Join Marthe Moengen, MVP, for an interesting and insightful webinar that will discuss the disruptive power of Microsoft Fabric and whether it is set to become the future of data analytics. Webinar Description: Microsoft Fabric – The Future of Data Analytics? In the dynamic realm of data… READ MORE
I have previously written a post on Power BI Dataflows explaining what it is, how you can set it up when you should use it, and why you should use it. I am a big fan of the Gen 1 Power BI Dataflows. So now, with the new introduction of Dataflows Gen 2 in Fabric,… READ MORE
As I mentioned in my Build Announcement Summary, Microsoft Fabric has been announced! In short, Fabric covers the complete spectrum of services including data movement, data lake, data engineering, data integration and data science, real time analytics, and business intelligence. It promises to offer end to end analytics from the data lake to the business user, covering the… READ MORE
