New board topics in Databricks Community

Hi,

What the maximum size to read using dbutils.fs.head()?

is there a limit? because AI says 10MB and I couldn't find useful info in documentations, while I tried in the actual one and it was only limited by the driver memory.

Thanks in advance.

Databricks Academy offers the free DevOps Essentials for Data Engineering course, designed to help data engineers apply software engineering best practices and DevOps principles on the Databricks Data Intelligence Platform. Instead of going deep into every tool, this course focuses on the core habits that mak...

Hi all,

I’m trying to set up REST-based communication between my Lakebase and a REST-client.

I’m following the documentation “Connecting to Lakebase via REST using a service principal

We have a dlt pipeline which creates some same table, which are created based on some transformation and those transformation are kept inside a function in a seperate file. and those file were used using import function.
we are deploying those changes via terraform into the databricks, now the problem was everytime you run the dlt pipeline it will execute the pipeline with...

Hi,

On a managed Delta table  I get:

Error:

Audit logs show VACUUM START/END executed by a service principal (GUID userName); I never ran VACUUM manually. Table properties don’t ...