VIRTUAL TRAINING Time: AMER Aug 19 – Aug 20, 2026 | 9:00 AM PT / 12:00 PM ET Register for the Workshop Note: Marking RSVP on this Community event does not register you for the workshop. Please use the Register button above to complete your registr...
Congratulations to all members who have received the new Databricks Partner badge! Your badge recognizes your affiliation with the Databricks Partner ecosystem and helps community members quickly identify trusted partner professionals across discuss...
WEBINARTime:AMER - Aug 13, 10:00 AM PT / 1:00 PM ETEMEA - Aug 13, 9:00 AM GMT / 10:00 AM BST / 11:00 AM CESTAPAC - Aug 13, 9:30 AM IST / 12 PM SGT / 1PM JST/KST / 2 PM AEST (Japanese and Korean captions available) Register for the Workshop Note: M...
New in Community Say hello to the Genie Hub Your questions about Databricks Genie, answered by the people actually building with it. Ask the community anything about Genie… Ask → Genie runs on plain-language conversation - you ask, it answers f...
Help Your Knowledge Reach More People Every Technical Blog, Community Article, MVP article, or answer you share can help someone beyond the Databricks Community. Small improvements in how you write can make your content easier to discover through C...
Our Community Champion Program has always been about recognizing individuals who consistently show up to support others, share their expertise, and strengthen the Databricks Community. Alongside our customers, we’re equally proud to recognize the inc...
In programmatic advertising, the value of an impression depends on whether an ad is viewed by a user. The Real-Time Bidding Optimization Solution Accelerator shows how to predict ad viewability and use those insights to optimize bidding strategies, m...
The Weekly Digest • July 20 – August 2 Community Pulse From technical deep-dives to trending discussions – your community digest is here. OUR STANDOUT COMMUNITY STARS Celebrating the members who made a difference this period : @balajij8 @bin...
I'm new to Databricks and have been tasked with exploring Databricks Clean Rooms. I'm a bit confused about how billing works for Clean Rooms and their overall functionality. Specifically, I'm curious about the following:Environment Hosting: Are Clean...
Databricks no longer charges a per-collaborator fee for Clean Rooms as of Jan 2026. The earlier replies in this thread that reference a per-collaborator daily charge are outdated and should not be used for current billing decisions. Lower cost: No mo...
Hello Databricks Community,I am exploring the configuration and scaling of high QPS (Queries Per Second) endpoints for Databricks AI Search, as described in the official documentation. I have several questions and would appreciate insights from anyon...
For high-QPS AI Search endpoints in Databricks, I’d start by separating the problem into latency, throughput, scaling, and cost. Make sure you know your target QPS, acceptable p95/p99 latency, query size, embedding/model latency, and whether traffic ...
The new Databricks Certified Context Engineer Associate beta exam is not a typical certification exam.I took it during Data + AI Summit 2026, and my first reaction was simple: this is a serious exam.I have completed seven Databricks certifications so...
Hi All,We are trying to create a Databricks agent and were looking for a step by step approach if there is any. We did go through the Author an agent and deploy it on Databricks Apps | Databricks on AWS but weren't very clear on creation of a new age...
One pipeline woke up every five minutes. The other stayed running. Using the same e-commerce streaming workload, median end-to-end data freshness improved from 4.0 minutes to 33 seconds, while P95 latency dropped from 9.3 minutes to just 60 seconds. ...
Looks great. It really shows your deep knowledge of the system and the scenarios needed to validate it thoroughly! it really helps us with better understanding of different modes! TY
Hello Databricks Community,I am using Databricks Free Edition and trying to ingest a CSV file from Google Drive using Data Engineering → Data Ingestion → Ingest data from Google Drive.The pipeline validation is failing with the following error:Pipeli...
SQL is a first-class language in SDP SQL is a first-class language in Spark Declarative Pipelines (SDP). You can build, test, and ship an entire pipeline in SQL. This makes it a powerful tool for those with a SQL background, as SDP enables both batch...
Hi Databricks Team,I recently scheduled my certification exam for 16 August 2026. Unfortunately, due to a mistake while booking the exam, I selected the Databricks Certified Data Analyst Associate instead of the Databricks Certified Data Engineer Ass...
I wonder if there is any GitHub that specifically focuses on Databricks' Lakehouse monitoring solution with definitions and codes that can do this.I want to onboard it for a customer of mine and don't want to write from scratch if one is already pres...
Hi Surya, You can begin with Data Quality Monitoring solution - already present. It has anomaly detection & Data Profiling (formerly known as Lakehouse Monitoring) solutions helping in Statistical Profiling, data quality, snapshot quality monitors, d...
Congratulations to all members who have received the new Databricks Partner badge! Your badge recognizes your affiliation with the Databricks Partner ecosystem and helps community members quickly identify trusted partner professionals across discuss...
@Rishabh_Tiwari Thank u so much !! https://www.linkedin.com/posts/rahul-k-b77ab221_databricks-dataal-databricks-activity-7492542568694702081-WMa5?utm_source=share&utm_medium=member_desktop&rcm=ACoAAASclwsBxvwp96iLg4mSM6BaBKgswBHJ9B0
Our Community Champion Program has always been about recognizing individuals who consistently show up to support others, share their expertise, and strengthen the Databricks Community. Alongside our customers, we’re equally proud to recognize the inc...
We run a medallion pipeline on Databricks:Bronze: AutoLoader ingests raw CSV files into Delta tables (append-only, all columns as STRING, schema evolution via addNewColumns)Silver: PySpark jobs clean and transform bronze data into Delta tables using ...
You can skip using traditional schema migration tools like Liquibase, Flyway or Alembic into Delta Lake as they were generally designed for relational databases where state is tracked through sequential DDL scripts.Silver LayerNew Columns - You can l...
I'm learning Databricks, and I'm interested in using it to analyze data from a gaming website focused on Tomodachi Life ROM .I'd like to understand the best approach for building a simple analytics workflow.Some questions I have are:How can I import ...
If you want to analyze gaming website traffic and search trends with Databricks, you can start by bringing your website analytics, search data, and other relevant sources into a centralized data environment. From there, you can clean and combine the ...
Taking exams is so stressful already, and if your exam gets suspended it is extra stressful. Don't worry! Our support team is awesome and will help you get back on track. The most important step is to file a ticket in our Help Center. Be sure to inc...
Hi @Cert-Team and @cert-ops I am seeking help regarding an issue I faced with my Databricks Certified Data Engineer Associate certification exam and would appreciate any guidance or assistance from the Databricks team. I had scheduled my exam for 2nd...
Building a Production LangGraph Agent on Databricks: The NorthStar Brand Copilot How we built and deployed an end-to-end CPG AI agent on Databricks using LangGraph, MCP servers, Lakebase memory, Genie, Vector Search, and MLflow and the best practices...
| User | Count |
|---|---|
| 2286 | |
| 1357 | |
| 1245 | |
| 1184 | |
| 961 |
| User | Count |
|---|---|
| 448 | |
| 286 | |
| 220 | |
| 63 | |
| 51 |
One pipeline woke up every five minutes. The other stayed running. Using the same e-commerce streaming workload, median end-to-end data freshness improved from 4.0 minutes to 33 seconds, while P95 lat...
SQL is a first-class language in SDP SQL is a first-class language in Spark Declarative Pipelines (SDP). You can build, test, and ship an entire pipeline in SQL. This makes it a powerful tool for thos...
Building a Production LangGraph Agent on Databricks: The NorthStar Brand Copilot How we built and deployed an end-to-end CPG AI agent on Databricks using LangGraph, MCP servers, Lakebase memory, Genie...
Every time you copy lakehouse data into an app-side database, you create another system to maintain, another copy to secure, and another pipeline to debug at 2 AM. But that is exactly what teams do wh...
