Finding the right data within sprawling enterprise systems has become a significant hurdle for many organizations. Teams struggle to answer basic questions: Does this data exist? Where is it? Is it trustworthy? How do I access it? Databricks aims to solve this fragmentation with its new Discover experience, now in beta, built directly into Databricks Unity Catalog Discover.
This new feature unifies the search for data, analytics, and AI assets, embedding crucial business context and trust signals directly into the catalog. It moves beyond technical hierarchies to organize information around how businesses actually operate.
Organizing Data by Business Function
A core component of this update is the introduction of Domains, a feature designed to group assets by business units or use cases like Finance or Marketing. Unlike rigid folder structures, assets can reside in multiple Domains, eliminating the need for duplication or difficult organizational choices. This approach, detailed in the Databricks blog post, allows for flexible business context encoding.
Domains in Unity Catalog also empower stewards to curate relevant assets, pin high-priority items, and add rich descriptions. This makes discovery more intuitive for users, aligning with their daily workflows and making it easier to find trusted information, similar to efforts seen in solutions like Bayer Consumer Health Unifies Data with Databricks.
Intelligent Curation and Trusted Access
The Discover experience leverages AI-powered signals, such as asset usage and popularity, alongside human curation like certifications and deprecation tags. Certifications act as clear trust indicators, guiding users to approved sources of truth. AI recommendations surface relevant assets without overwhelming users.
Crucially, discovery is now directly linked to action. The platform integrates request-for-access workflows, allowing users to secure permissions directly from the Discover page. This streamlines governance, reduces reliance on data stewards as bottlenecks, and accelerates the time-to-insight for users across the organization, enhancing overall enterprise data catalog solutions.
