Understanding Data Lineage
Data lineage is the process of tracing the origin, movement, and transformations of data elements throughout their entire lifecycle within a system or across multiple systems. In the context of data transfer from NetSuite to NetSuite Analytics Warehouse, it refers to the process of understanding and documenting the journey of data from the NetSuite application to the Analytics Warehouse platform, ensuring a clear and traceable path for data analysis and reporting.
NetSuite Analytics Warehouse Data Lineage Mapping Guide
Data lineage provides analysts and business users with a clear understanding of the data origin and transformations, making it easier to interpret and use the data effectively in NetSuite Analytics Warehouse.
To understand better the journey of data from its source within NetSuite to its final destination in NetSuite Analytics Warehouse, you can use the following file as a comprehensive mapping guide: Data_Lineage_NS_NSAW.
This document is organized into eight columns, representing the data progression through three key stages:
-
NetSuite: this is the initial stage. It describes the original structure of the data within NetSuite, and it is represented by the columns under the NetSuite Linage section in the mapping guide file.
-
Data Warehouse: this is the intermediate stage. It describes the data physical layer after its transfer and how it is stored in NetSuite Analytics Warehouse. It is represented by the Physical Table and Physical Column columns under the Semantic Model (RPD) Lineage section in the mapping guide file.
-
Analytics: this is the final stage. It describes the semantic layer of the data as it appears in NetSuite Analytics Warehouse. This semantic layer is specifically designed for an easier and better reporting and analysis experience. It is represented by the Subject Area, Table (Analytics), and Column (Analytics) columns in the mapping guide file.
The following table provides a better understanding of the columns in the mapping guide file:
Net |
Semantic Model (RPD) Lineage |
||||||
---|---|---|---|---|---|---|---|
Net |
NetSuite Column |
Net |
Physical Table |
Physical Column |
Subject Area |
Table ( |
Column (Analytics) |
This column i |
This column specifies the name of the i |
This c |
This column shows the name of the table in NetSuite Analytics Warehouse where the data is stored after being transferred from NetSuite, for example DW_
Note:
This name may be different from the NetSuite table name due to data warehousing conventions. |
This column indicates the name of the data field (column) within the data warehouse table, for example D
Note:
This name may be different from the NetSuite column name due to data warehousing conventions. |
This column represents the subject areas within a functional area in NetSuite Analytics Warehouse. Subject areas are the logical grouping of related data. These groups are specifically made to locate relevant information in an easier way. For example, NetSuite -Assembly Build. |
This column displays the name of the table as it appears within the analytics tools. These tables are specifically designed to facilitate reporting. For example, Item. |
This column specifies the name of the data field as it appears in NetSuite Analytics Warehouse. These column names are designed to be more descriptive and intuitive. For example, Item Income Account. |