Snowflake Invests in Metaplane to Enhance Data Quality Observation
Today, Snowflake announced an undisclosed investment in Metaplane, a Boston-based startup that assists enterprises in identifying and rectifying data quality issues using an AI-powered platform.
The collaboration between Snowflake and Metaplane aims to integrate Metaplane’s data observability offering with the Snowflake data cloud. This integration will enable users of Snowflake to closely monitor the information that fuels their downstream projects, particularly AI applications.
Addressing Data Quality Challenges
Modern business applications heavily rely on data, including AI-powered chatbots, but ensuring data quality remains a challenge for many organizations. The sheer volume of data housed in siloed systems, databases, and applications makes it difficult for teams to effectively manage and identify issues.
Metaplane, co-founded by MIT graduate Kevin Hu, former HubSpot engineer Peter Casinelli, and ex-Appcues developer Guru Mahendran, leverages AI at various layers of the data stack. The platform integrates with tools across the data stack such as Fivetran, Snowflake BigQuery, dbt, Airflow, and Tableau, utilizing machine learning models to train on the entire data profile, covering historical metadata, lineage, and logs.
Once trained, the platform automatically detects data anomalies and schema changes, providing alerts to data teams in real-time. Users can set up monitors in just 15 minutes to track data quality metrics like freshness, row count, uniqueness, and nullness.
Deepening Integration with Snowflake
Following the investment from Snowflake, Metaplane will enhance its integration with the Snowflake data cloud, encompassing additional telemetry and metadata. This deeper integration will cover entire data pipelines and key app capabilities, enabling Snowflake customers to closely monitor the quality of their data assets as they move through various stages of the pipeline to power downstream applications.
Furthermore, Snowflake’s partnership with Metaplane will lead to the launch of a native app on the data cloud. This native app will allow users to deploy and manage Metaplane directly within their Snowflake instance, enhancing the user experience and eliminating the need to move or copy data outside the secure Snowflake environment.
Snowflake’s Strategic Approach to AI
Under the leadership of CEO Sridhar Ramaswamy, Snowflake has been aggressively pursuing AI initiatives to strengthen its position in the data industry. The company’s Cortex platform, launched last year, aims to build advanced AI applications leveraging data stored in the Snowflake data cloud.
In addition to investing in Metaplane, Snowflake has collaborated with other AI vendors and developed its own large language model, Arctic, to cater to complex enterprise workloads. The company’s recent investments in Coda, Coalesce, Observe, and Landing AI underscore its commitment to advancing data and AI capabilities.
Image/Photo credit: source url