跳转至

Data Lifetime(数据生命周期 (Data Lifetime))

Data Lifetime is a service that allows you to set lineage-aware retention policies on datasets in Foundry. These policies govern the deletion of transactions within a dataset on which they are applied, along with any downstream datasets.

Data Lifetime policy view

Data Lifetime deletion view

Data frequently experiences duplication, integration with additional data, and storage in various formats to accommodate a range of use cases. Foundry's distinct features enable data engineers to track modifications and merges back to their origin, ensuring other users can examine the data's transformation history both upstream and downstream. The structure that governs the flow of data through a system, starting from its source and extending to its various final forms, is commonly known as "data lineage". In Foundry, data flow visualization can be achieved using our interactive Data Lineage tool. Understanding the environment associated with data integrations and transformations is an essential first step when exploring the deletion process.

:::callout{theme="neutral"} In some cases, regulations may necessitate the deletion of specific data. This typically involves removing all "descendants" within the data lineage to guarantee a comprehensive approach to deletion. This ensures compliance with the data protection regulations that may require organizations to completely remove the data and any associated instances or derived versions within the system's architecture. :::


中文翻译


数据生命周期 (Data Lifetime)

数据生命周期是一项服务,允许您在 Foundry 中为数据集设置可感知数据血缘的保留策略 (retention policies)。这些策略管理着应用了该策略的数据集内事务的删除,以及所有下游数据集的删除。

数据生命周期策略视图

数据生命周期删除视图

数据经常经历重复、与其他数据集成,并以多种格式存储以满足各种用例需求。Foundry 的独特功能使数据工程师能够将修改和合并追溯至其源头,确保其他用户可以检查数据在上游和下游的转换历史。这种管理数据从源头到各种最终形态在系统中流动的结构,通常被称为"数据血缘" (data lineage)。在 Foundry 中,您可以使用我们的交互式数据血缘工具来实现数据流的可视化。在探索删除过程时,理解与数据集成和转换相关的环境是至关重要的第一步。

:::callout{theme="neutral"} 在某些情况下,法规可能要求删除特定数据。这通常涉及移除数据血缘中的所有"后代" (descendants),以确保删除过程的全面性。这有助于遵守数据保护法规,这些法规可能要求组织在系统架构中彻底删除数据及其所有相关实例或衍生版本。 :::