How to Register & Prepare If you're interested in advancing your skills with Databricks through a Specialist Session, here's a clear guide on how to register and what free courses you can take to prepare effectively. How to Begin Your Learning Path S...
- 1000 Views
- 0 replies
- 3 kudos
2 weeks ago
BrickCon 2025 | Dec 3–5, 2025 A community-driven conference built by and for Databricks users around the world. Get ready for an unforgettable experience at BrickCon 2025 — the first-ever community-led Databricks conference bringing together da...
- 447 Views
- 3 replies
- 4 kudos
2 weeks ago
We are excited to spotlight Nayanjyoti Sonowal, one of our most active and insightful contributors in the Databricks Community, whose journey reflects the spirit of learning, collaboration, and innovation we value most. Dive into his story, told in h...
- 502 Views
- 5 replies
- 11 kudos
Tuesday
Healthy gaming communities start with positive interactions. With this Databricks Solution Accelerator, you can: Detect toxic comments in real time using NLP techniquesFlag questionable chat messages for moderationIntegrate seamlessly into existing c...
- 1175 Views
- 4 replies
- 4 kudos
2 weeks ago
We kept the October momentum going strong — with vibrant technical discussions, creative experiments, and deep dives into AI, streaming, and governance. Here’s a look at what stood out this week in the Databricks Community Fresh Content & Articles...
- 280 Views
- 1 replies
- 4 kudos
Wednesday
As we close out September and step into October, it’s incredible to see how our top contributors continue to lead with consistency, clarity, and collaboration. Week after week, they’ve stayed at the forefront of discussions, setting the tone for know...
- 1026 Views
- 4 replies
- 9 kudos
2 weeks ago
Learn, Level Up, and Get Rewarded! Save the dates: October 10 – October 31, 2025! We're celebrating learning, growth, and career advancement with an exciting opportunity to level up in data engineering, data analysis, machine learning, and genera...
- 149057 Views
- 313 replies
- 109 kudos
08-07-2025
Data + AI World Tour continues the momentum from Data + AI Summit, the world’s premier event for the data, analytics and AI community. Now we’re coming to a city near you — with 19 stops across five continents. Find out what’s next in data and AI, an...
- 3161 Views
- 8 replies
- 2 kudos
a month ago
Community Activity
- 34622 Views
- 47 replies
- 30 kudos
community edition : "User is not a member of this workspace"
Something very strange has happened. When trying to login to my databricks community edition account. I'm getting the email with my verification code. but after entring that code, I'm getting the error message : "User is not a member of this workspac...
- 34622 Views
- 47 replies
- 30 kudos
Latest Reply
- 30 kudos
I'm also facing the same error on registering to community edition. After providing correct verification code, I'm getting error "User is not a member of this workspace". The url -> https://community.cloud.databricks.com/verify-code?tuuid=2cd7f036-38...
- 30 kudos
- 1803 Views
- 3 replies
- 1 kudos
Best practices for optimizing Spark jobs
What are some best practices for optimizing Spark jobs in Databricks, especially when dealing large datasets? Any tips or resources would be greatly appreciated! I’m trying to analyze data on restaurant menu prices so that insights would be especiall...
- 1803 Views
- 3 replies
- 1 kudos
Latest Reply
- 1 kudos
Their menu is full of creative options — it’s hard to pick just one favorite because everything tastes amazing!”
- 1 kudos
- 2609 Views
- 2 replies
- 0 kudos
Resolved! Whether Databricks has any plans to Integrate Databricks Genie with Azure OpenAI?
Hi,I am checking to see if Databricks has any plans to Integrate Databricks Genie with Azure OpenAI? as I know Databricks Genie is designed to work with Databricks' data ecosystem itself. But is there any plans to enhance this capability where we can...
- 2609 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
Thank you Louis, yes I believe when I posted in May it wasn’t available. Now I can see the option. Thanks for the reply.
- 0 kudos
- 154 Views
- 1 replies
- 0 kudos
AIM with Entra ID Groups – Users and Service Principals not visible in Workspace
Hello Community, I am testing Automatic Identity Management (AIM) in Databricks with Unity Catalog enabled. Steps I did: • AIM is activated • In Microsoft Entra ID I created a group g1 and added user u1 and service principal sp1 ...
- 154 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
In Azure Databricks, when AIM is enabled, Entra users, service principals, and groups are available in Azure Databricks as soon as they’re granted permissions. Group memberships, including nested groups, flow directly from Entra ID, so permissions al...
- 0 kudos
- 11361 Views
- 16 replies
- 3 kudos
Is it possible to view Databricks cluster metrics using REST API
I am looking for some help on getting databricks cluster metrics such as memory utilization, CPU utilization, memory swap utilization, free file system using REST API.I am trying it in postman using databricks token and with my Service Principal bear...
- 11361 Views
- 16 replies
- 3 kudos
Latest Reply
- 3 kudos
Is there any solution found to get cpu, memory metrics for Hive meta store backed workloads ? We are not using UC. So can't use system tables
- 3 kudos
- 39 Views
- 2 replies
- 0 kudos
DLT Pipeline Stopped working
Hello, Suddenly our DLT pipelines we're getting failures saying thatLookupError: Traceback (most recent call last): result_df = result_df.withColumn("input_file_path", col("_metadata.file_path")).withColumn( ...
- 39 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
May be there is internally some updates from databricks Can Check and Switch Your Pipeline Channel, In the DLT pipeline settings (under Advanced > Channel), confirm if it's set to "Preview". Switch to "Current" for a more stable engine version, then...
- 0 kudos
- 67 Views
- 1 replies
- 0 kudos
Cannot create databricks app using knowledge assistant
Hello, I built a knowledge assistant and I want to create a databricks app with it. I am using the streamlit chatbot template. I get an error "endpoint not supported". I can successfully create other databricks apps using models like claude sonnet. I...
- 67 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @mmoise - It is not yet possible to create a DB app using an agent created from Agent Bricks KA. It will be added soon in the future. You can create a custom app, though. You can refer to the DB apps cookbook and use FastAPI as backend and React a...
- 0 kudos
- 560 Views
- 1 replies
- 0 kudos
Unable to query external GraphQL API
Hi allI'm switching to evaluating Databricks after being unhappy with Microsoft Fabric.I'm looking for a platform to aggregate external files and tables, do processing and push into 3rd party using GraphQL. That push is going to be quite sophisticate...
- 560 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
hi @Dimitry , I'm not sure about this specific library, but I was able to query a graphQL endpoint with requests.post. Have you tested that at all? Happy to dig in deeper if you need to use this specific library for any reason, but if not - you may w...
- 0 kudos
- 31 Views
- 0 replies
- 0 kudos
Cannot import pyspark.pipelines module
Question: What could be a cause of the following error of my code in a Databricks notebook, and how can we fix the error? I'm using latest Free Edition of Databricks that has runtime version 17.2 and PySpark version 4.0.0.Error:ImportError: cannot im...
- 31 Views
- 0 replies
- 0 kudos
- 107 Views
- 4 replies
- 3 kudos
Resolved! REGARD COPOUN CODE
After completing all the relevant courses for the certification, I haven’t received the coupon code yet.
- 107 Views
- 4 replies
- 3 kudos
Latest Reply
- 3 kudos
Thank you for confirming and taking the time to clarify this. I really appreciate your help and guidance!
- 3 kudos
- 82 Views
- 1 replies
- 0 kudos
Questions About Notebook Debugging Tools
I'm researching the different ways to debug in databricks notebooks and have some questions.1. Can the python breakpoint() function be used in notebooks? This article says it can be used https://www.databricks.com/blog/new-debugging-features-databric...
- 82 Views
- 1 replies
- 0 kudos
Latest Reply
- 0 kudos
Hi @help_needed_445 ! Can you give a bit more information on your environment? Which cloud are you operating in where you are not able to use the native debugging tool? I have tested in an Azure workspace by adding a breakpoint in the gutter of a spe...
- 0 kudos
- 79 Views
- 3 replies
- 11 kudos
🌟 Community Sparks of the Week | October 10 – 16 🌟
Midway through October, our community continues to light up with collaboration, curiosity, and thoughtful problem-solving! Each week, our top contributors set the bar higher—sharing solutions, supporting peers, and reminding us that great communitie...
- 79 Views
- 3 replies
- 11 kudos
Latest Reply
- 11 kudos
Thanks @BS_THE_ANALYST ! It's community members like you that make these forums so great!
- 11 kudos
- 63 Views
- 4 replies
- 0 kudos
Resolved! Can't enable "variantType-preview" using DLTs
Using create_streaming_table and passing table properties as follows, I get an error running the pipeline for the first time:> Your table schema requires manually enablement of the following table feature(s): variantType-preview.I'm using this code:c...
- 63 Views
- 4 replies
- 0 kudos
Latest Reply
- 0 kudos
There's a workaround available in most situations which is to first create the table without the VARIANT column, run the pipeline at least once, and then add the column in a subsequent refresh.
- 0 kudos
- 8739 Views
- 2 replies
- 0 kudos
View column comments
As a way to minimize storage costs, my team and I want to create views instead of tables in the Gold layer.We always try to improve the experience of our users by adding comments to the columns. the problem is that views do not inherit comments from ...
- 8739 Views
- 2 replies
- 0 kudos
Latest Reply
- 0 kudos
you can use COMMENT ON to set or update the comment on an view-- View-level comment (use TABLE for views)COMMENT ON TABLE catalog.schema.my_view IS 'View for user info';-- Column-level comment on a viewCOMMENT ON COLUMN catalog.schema.my_view.name IS...
- 0 kudos
- 12001 Views
- 4 replies
- 0 kudos
Resolved! Unable to add column comment on a View. Any way to update comments on multiple columns in bulk?
I noticed that unlike "Alter Table" there is no "Alter View" command to add comment on a column in the existing view. This is a regular view created on Tables (and not Materialized view). If the underlying table column has comment then the View inh...
- 12001 Views
- 4 replies
- 0 kudos
Announcements
| User | Count |
|---|---|
| 2108 | |
| 1151 | |
| 946 | |
| 922 | |
| 752 |
Latest from our Blog
Azure Databricks — Serverless Private Connectivity to Customer’s Resources (Part-1)
Authors: Kiran Anand, Suraj Karuvel Introduction The serverless model provides customers with a fast and easy option to run their workloads in Azure Databricks. In this model, the compute runs in Dat...
How to Deploy Agent-to-Agent (A2A) Protocol on Databricks Apps?-> End-to-End Guide
Modern AI systems rarely live alone. They collaborate. Google’s Agent-to-Agent (A2A) protocol gives agents a common language (JSON-RPC over HTTP/S, with streaming via SSE) plus a discovery mechanism (...
IoT Ingestion Using Append Flows
IoT (Internet-of-Things) devices are disrupting the manufacturing industry. While estimates vary, most sources agree that there are tens of billions of IoT devices currently operating in manufacturing...
Turning GPS Pings into Insights: Mobile Fleet Analytics with Databricks Spatial SQL
Turning GPS Pings into Insights: Mobile Fleet Analytics with Databricks Spatial SQL Energy companies manage large and complex fleets of mobile equipment - from service trucks in a utility company, to ...