Get Started Resources
Explore essential resources to kickstart your journey with Databricks. Access tutorials, guides, and...
0 Posts
Activity in Resources
- 159 Views
- 3 replies
- 11 kudos
🌟 Community Sparks of the Week | October 10 – 16 🌟
Midway through October, our community continues to light up with collaboration, curiosity, and thoughtful problem-solving! Each week, our top contributors set the bar higher—sharing solutions, supporting peers, and reminding us that great communitie...
- 159 Views
- 3 replies
- 11 kudos
Latest Reply
- 11 kudos
Thanks @BS_THE_ANALYST ! It's community members like you that make these forums so great!
- 11 kudos
- 1047 Views
- 4 replies
- 9 kudos
Processing LAS Well Log Files and Other Semi-Structured Data with Databricks AI Functions
Oil and gas companies are no strangers to data silos. Despite decades of drilling and technological advances, extremely important well information, carefully recorded in the field, often winds up scattered across proprietary tools, legacy databases, ...
- 1047 Views
- 4 replies
- 9 kudos
Latest Reply
- 9 kudos
@brett-aulbaugh, by considering the dimensionality, we also implemented the unpivot solution.
- 9 kudos
- 175 Views
- 0 replies
- 1 kudos
Azure Databricks — Serverless Private Connectivity to Customer’s Resources (Part-1)
Authors: Kiran Anand, Suraj Karuvel Introduction The serverless model provides customers with a fast and easy option to run their workloads in Azure Databricks. In this model, the compute runs in Databricks’ Azure tenant and not in yours. In many ca...
- 175 Views
- 0 replies
- 1 kudos
- 441 Views
- 4 replies
- 18 kudos
🌟 Community Sparks of the Week | 3 – 9 October 🌟
We have kicked off October on a high note! Our community continues to shine with members who go above and beyond—sharing precise solutions, welcoming new contributors, and helping others troubleshoot with patience and clarity. Each of these Sparks r...
- 441 Views
- 4 replies
- 18 kudos
- 133 Views
- 1 replies
- 3 kudos
Hadoop Walked So Databricks Could Run
Are you familiar with this scenario: Your data team spends 80% of their time fixing infrastructure issues instead of extracting insights.In today’s data-driven world, organisations are drowning in data but starving for actionable insights. Traditiona...
- 133 Views
- 1 replies
- 3 kudos
Latest Reply
- 3 kudos
Great one!! @Senga98 All the best!
- 3 kudos
- 564 Views
- 1 replies
- 6 kudos
🚀 Weekly Delta (8 - 14 October): A Look Back at This Week’s Top Community Highlights
We kept the October momentum going strong — with vibrant technical discussions, creative experiments, and deep dives into AI, streaming, and governance. Here’s a look at what stood out this week in the Databricks Community Fresh Content & Articles...
- 564 Views
- 1 replies
- 6 kudos
Latest Reply
- 6 kudos
Awesome!! Thanks @Sujitha All the best,BS
- 6 kudos
- 400 Views
- 0 replies
- 1 kudos
How to Deploy Agent-to-Agent (A2A) Protocol on Databricks Apps?-> End-to-End Guide
Modern AI systems rarely live alone. They collaborate. Google’s Agent-to-Agent (A2A) protocol gives agents a common language (JSON-RPC over HTTP/S, with streaming via SSE) plus a discovery mechanism (the Agent Card) so they can find and work with eac...
- 400 Views
- 0 replies
- 1 kudos
- 397 Views
- 2 replies
- 5 kudos
API Consumption on Databricks
In this blog, I will be talking about the building the architecture to serve the API consumption on Databricks Platform. I will be using Lakebase approach for this. It will be useful for this kind of API requirement.API Requirement: Performance:Curre...
- 397 Views
- 2 replies
- 5 kudos
Latest Reply
- 5 kudos
Sharp design choices, @rathorer! Appreciate you sharing this detailed architecture.
- 5 kudos
- 119 Views
- 0 replies
- 1 kudos
Validating pointer-based Delta comparison architecture using flatMapGroupsWithState in Structured St
Hi everyone,I’m leading an implementation where we’re comparing events from two real-time streams — a Source and a Target — in Databricks Structured Streaming (Scala).Our goal is to identify and emit “delta” differences between corresponding records ...
- 119 Views
- 0 replies
- 1 kudos
- 10828 Views
- 6 replies
- 3 kudos
Editing value of widget parameter within notebook code
I have a notebook with a text widget where I want to be able to edit the value of the widget within the notebook and then reference it in SQL code. For example, assuming there is a text widget named Var1 that has input value "Hello", I would want to ...
- 10828 Views
- 6 replies
- 3 kudos
Latest Reply
- 3 kudos
It seems that only way to use parameters in sql code block is to use dbutils.widget and you cannot change those parameters without removing widget and setting it up again in code
- 3 kudos
- 2088 Views
- 6 replies
- 9 kudos
Attribute-Based Access Control (ABAC) in Databricks Unity Catalog
What Is ABAC and Why Does It Matter?Attribute-Based Access Control (ABAC) is a data governance model now available in Databricks, designed to offer fine-grained, dynamic, and scalable access control for data, AI assets, and files managed through Data...
- 2088 Views
- 6 replies
- 9 kudos
- 176 Views
- 0 replies
- 1 kudos
Databricks Policies and Bundles Inheritance: Let Policies Rule Your DABS
Just the policy_id can specify the entire cluster configuration. Yes, we can inherit default and fixed values from policies. Updating runtime version for 100s of jobs, for example, is much easier this way. Read more: - https://databrickster.med...
- 176 Views
- 0 replies
- 1 kudos
- 4302 Views
- 3 replies
- 3 kudos
IP CIDR For Azure Databricks Hive Metastore
Starting on mid of October, Azure Databricks will conduct Hive Metastore maintenance. This maintenance will change the IP addresses of the Hive Metastore. If you have hard-coded Hive Metastore IP addresses in your user-defined routes or firewalls, y...
- 4302 Views
- 3 replies
- 3 kudos
Latest Reply
- 3 kudos
@Rob_Hughes We expect only a small number of customers to be affected — specifically those who have hard-coded static IPs in their firewall or UDRs. This setup isn’t recommended, as explicitly called out in our public documentation. The blog post mai...
- 3 kudos
- 1221 Views
- 4 replies
- 23 kudos
🌟 Community Sparks of the Week | September 26 – October 2 🌟
As we close out September and step into October, it’s incredible to see how our top contributors continue to lead with consistency, clarity, and collaboration. Week after week, they’ve stayed at the forefront of discussions, setting the tone for know...
- 1221 Views
- 4 replies
- 23 kudos
Latest Reply
- 23 kudos
@szymon_dybczak Congratz on your certification. If you can publish your preparation tips in community that would be great.
- 23 kudos
- 505 Views
- 0 replies
- 3 kudos
IoT Ingestion Using Append Flows
IoT (Internet-of-Things) devices are disrupting the manufacturing industry. While estimates vary, most sources agree that there are tens of billions of IoT devices currently operating in manufacturing in 2025. As advantageous as this is to being able...
- 505 Views
- 0 replies
- 3 kudos