Hey Community! Join us for a free, Community-Sponsored BrickTalk where Databricks experts will break down exactly how to give your conversational agents true spatial awareness. BrickTalks is a community event series where Databricks experts share rea...
Grow Your Skills and Earn Rewards! Mark your calendar: June 15 – July 6, 2026 Join us for a three-week event dedicated to learning, upskilling, and advancing your career in data engineering, analytics, machine learning, and generative AI. Whethe...
Learn how the lakebase architecture decouples compute from storage, so you can build, ship and run agents and apps faster. Databricks has introduced a new category of serverless Postgres database built to integrate seamlessly with your lakehouse sta...
Our Community Champion Program celebrates members who go above and beyond to share knowledge, support fellow practitioners, and help make the Databricks Community a valuable place to learn and grow. Each month, we recognize individuals whose expertis...
Advances in deep learning have made computer vision a practical approach for product quality inspection. The Product Quality Inspection Solution Accelerator shows how organizations can implement an end-to-end computer vision pipeline, build and train...
The Weekly Digest • June 22 – June 28 Community Pulse The SUMMIT ended. The CONTENT didn't. Your weekly roundup is here. This Week's Community Stars The members who showed up and made a difference this week: @balajij8 @Yogasathyandrun @Sumit...
General Q: Where can I ask questions if I have questions while going through the self-paced material? A: The Databricks Academy Learners Group page is a forum within the Databricks Community where you can ask questions and get them answered by your ...
Hello Databricks Team,Was there a time before on 07/06/2025 the course catalog needed to be completed ? I have enrolled and also completed the courses within the festival window but just want to make sure I have gotten my courses completed within th...
Summary:We configured Lakebase CDF to stream changes from a native Postgres table (public.query_logs) into Unity Catalog, but the destination Delta table never appears despite completing all documented prerequisites.Steps taken1. Created query_logs ...
Not only is code CI/CD possible, but runtime CI/CD is now possible thanks to #databricks docker. more about it: https://databrickster.medium.com/databricks-docker-from-runtime-ci-cd-to-compliance-1479cf6cdf8d https://www.sunnydata.ai/blog/databricks-...
Why would we want to use docker?Wouldn't that just add unnecessary complexity?
There are so many new connectors that I stopped counting them and mentioned it in the news. Every week, there is something new. If you just need to ingest data into Databricks from a cloud source, always check the release page, as not everything is e...
Hi everyone,I'm looking for some advice because I'm experiencing an issue with my Databricks certifications.I passed two Databricks certification exams last Friday using my account lee.dongkeun@kt.com. However, it has now been more than three days, ...
Hi everyone,I'm trying to use the new Unity AI Gateway v2 (beta) endpoint from an agent deployed with the Mosaic AI Agent Framework and I'm running into what looks like a scope mismatch.Library versionsdatabricks-agents==1.11.0mlflow==3.12.0python~3....
This isn't a config problem on your end, it's a support gap. On-behalf-of auth for the standalone Unity AI Gateway beta endpoint isn't supported yet when you're deploying through databricks.agents.deploy(). Specifically, "ai-gateway" isn't a valid va...
Hi!Do you know if it's correct to use the plain user and token for installing a custom dependency (an internal python package) in a mlflow registered model? (it's the only way I get it working because if not it can't install the dependency) It works,...
The dynamic conda.yaml generation trick doesn't actually fix this, and you already found that out yourself. Whatever ends up in the final logged conda.yaml is what gets read at environment build time, so if a plaintext credential has to be in that fi...
Hello everybody,My team and I are facing a sudden and unexpected issue with training Forecasting models utilizing AutoML on Azure Databricks. As of two weeks ago, we privatized our Azure Databricks environment behind a private network, accessible onl...
Databricks AutoML is still around and actively used as of mid-2026, so nothing's wrong on that front, but there's a nuance worth knowing: starting with Databricks Runtime 18.0 ML, AutoML was removed as a built-in library on classic compute. It's stil...
Getting 'Unauthorized Access' when Serverless compute is trying to read s3 bucket data, same works fine with normal compute storage and external location, credentials, IAM policy and serverless egress rules all seems to be correct because normal comp...
Your read is right, and fair point on the allowlist: editing network policies is part of serverless egress control, which is an Enterprise capability, so on Premium the propagation window is the path. Your timing hypothesis matches how this works int...
Hi Lakebase users! We are looking for reviews on G2 of Lakebase to hear how you are using the product in order to help other data and AI teams see what’s possible. Since GA, thousands of teams have moved production workloads onto Lakebase. A few exam...
As the subject states, my question is:Is it required to run the Ingestion Pipeline in Lakeflow Connect on Serverless compute? Cause I try to define my own cluster in the DAB, but it raises an error:`Error: cannot create pipeline: You cannot provide c...
Yes — Lakeflow Connect ingestion pipelines always run on Serverless compute. Databricks overrides your compute config and switches back to serverless,because the ingestion connector requires it.
"With Genie, product teams ask their own questions and get answers instantly. It’s changed how we work with data." - Tim Cederkäll, Product Manager, Data Platform, Electrolux Connectivity Domain Electrolux Group, a global appliance manufacturer, ...
Environment:Bundle engine: directResource type: Volume (Unity Catalog)Problem:I'm trying to use the lifecycle field with prevent_destroy: true on a Unity Catalog volume resource in my Declarative Automation Bundle (DAB). the validation fails with:Err...
Databricks has shared a practical approach for turning large volumes of video into searchable, AI-ready intelligence by treating video analysis as a data engineering problem. For public sector and operational teams, that means moving faster from raw ...
Dear community,We follow the environment-isolation guidance in [1], relying on between-workspace and within-workspace separation (Unity Catalog, catalog-workspace bindings, ACLs). In our case we have different groups of users each assigned to their o...
Today there's no admin setting today that scopes the "add people" search to just your workspace, it's an account-wide search by design since AI/BI dashboards are shareable with any account user regardless of workspace membership. One thing that can h...
| User | Count |
|---|---|
| 2278 | |
| 1343 | |
| 1235 | |
| 1182 | |
| 960 |
| User | Count |
|---|---|
| 444 | |
| 286 | |
| 220 | |
| 63 | |
| 51 |
Getting a model behind a REST endpoint is the easy part; however keeping it fast, affordable, and stable once production traffic shows up is where teams spend their real time. Databricks Model Serving...
Introduction For enterprise groups deploying Azure Databricks, the Azure Tenant — Databricks Account relationship is a foundational architectural decision. It shapes data isolation between subsidiarie...
Summary In production machine learning systems (like real-time recommenders or fraud detection), models operate under a strict latency budget (typically milliseconds end-to-end). Within this window, t...
Lakeflow Spark Declarative Pipelines (SDP) has long supported two ways to maintain a table: a streaming flow for incremental ingestion and a materialized view for a fully derived result that is always...
