With managed tables, you can reduce your storage and compute costs thanks to predictive optimization or file list caching. Now it is really time to migrate external tables to managed ones, thanks to ALTER SET MANAGED functionality.
Read more:
- h...
How much time does it take to ingest two billion rows using the free databricks edition?https://www.databricks.com/blog/learn-experiment-and-build-databricks-free-edition
Just the policy_id can specify the entire cluster configuration. Yes, we can inherit default and fixed values from policies. Updating runtime version for 100s of jobs, for example, is much easier this way.
Read more:
- https://databrickster.med...
Now you can define relations also directly in Genie. It includes options like “Many to One”, “One to Many”, “One to One”, “Many to Many”.
Read more:
- https://databrickster.medium.com/relationship-in-databricks-genie-f8bf59a9b578
- https://www.su...
@nayan_wylde no don't do that hehe. It was example of extreme approach. Usually use catalog to separate environment + in enterprises to separate divisions like customer tower, marketing tower, finance tower etc
Databricks is working on improvements and new functionality related to that. For now, the only solution is a DEEP CLONE. You can run it more frequently or implement your own replication based on a change data feed. You could use delta sharing for tha...
@szymon_dybczak, I recently heard about a use case where the company is automatically creating a new catalog for every employee... but of course I agree with you.