Open, direct access to data stored in standard data formats.

Supports ACID transactions.

Supports BI and Machine learning workloads

Support for end-to-end streaming and batch workloads

All the above

Lakehouse supports schema enforcement and evolution, traditional data warehouses lack schema evolution.

Lakehouse supports SQL

Lakehouse supports ACID

Lakehouse enforces data integrity

Lakehouse supports primary and foreign keys like a data warehouse

Data plane

Control plane

Databricks Filesystem

JDBC data source

Databricks web application

Setup an additional job to run ahead of the actual job so the cluster is running second job starts

Use the Databricks cluster pools feature to reduce the startup time

Use Databricks Premium edition instead of Databricks standard edition

Pin the cluster in the cluster UI page so it is always available to the jobs

Disable auto termination so the cluster is always running

You can approve the pull request if you are the owner of Databricks repos

A workspace can only have one instance of git integration

Databricks Repos and Notebook versioning are the same features

You cannot create a new branch in Databricks repos

Databricks repos allow you to comment and commit code changes and push them to a remote branch

Cluster pools allow you to perform load balancing

Cluster pools allow you to create a cluster

Cluster pools allow you to save time when starting a new cluster

Cluster pools are used to share resources among multiple teams

Cluster pools allow you to have all the nodes in the cluster from single physical server rack

Remove virtual machines but storage and networking are automatically dropped

Drop storage disks but Virtual machines and networking are automatically dropped

Remove networking but Virtual machines and storage disks are automatically dropped

Remove logs

No action needs to be performed. All resources are automatically removed.

Delta lake is Datawarehouse service on top of data lake that can provide reliability, security, and performance

Delta lake is a caching layer on top of data lake that can provide reliability, security, and performance

Delta lake is an open storage format like parquet with additional capabilities that can provide reliability, security, and performance

Delta lake is an open storage format designed to replace flat files with additional capabilities that can provide reliability, security, and performance

Delta lake is proprietary software designed by Databricks that can provide reliability, security, and performance

VACCUM command can be used to compact small parquet files, and the OPTIMZE command can be used to delete parquet files that are marked for deletion/unused.

VACCUM command can be used to delete empty/blank parquet files in a delta table. OPTIMIZE command can be used to update stale statistics on a delta table.

VACCUM command can be used to compress the parquet files to reduce the size of the table, OPTIMIZE command can be used to cache frequently delta tables for better performance.

VACCUM command can be used to delete empty/blank parquet files in a delta table, OPTIMIZE command can be used to cache frequently delta tables for better performance.

OPTIMIZE command can be used to compact small parquet files, and the VACCUM command can be used to delete parquet files that are marked for deletion/unused.

DROP DELTA table_name

DROP TABLE table_name

DROP TABLE table_name FORMAT DELTA

DROP table_name