Understanding Data Lineage

Data lineage is the process of tracing the origin, movement, and transformations of data elements throughout their entire lifecycle within a system or across multiple systems. In the context of data transfer from NetSuite to NetSuite Analytics Warehouse, it refers to the process of understanding and documenting the journey of data from the NetSuite application to the Analytics Warehouse platform, ensuring a clear and traceable path for data analysis and reporting.

NetSuite Analytics Warehouse Data Lineage Mapping Guide

Data lineage provides analysts and business users with a clear understanding of the data origin and transformations, making it easier to interpret and use the data effectively in NetSuite Analytics Warehouse.

To understand better the journey of data from its source within NetSuite to its final destination in NetSuite Analytics Warehouse, you can use the following file as a comprehensive mapping guide: Data_Lineage_NS_NSAW.

This document is organized into eight columns, representing the data progression through three key stages:

  1. NetSuite: this is the initial stage. It describes the original structure of the data within NetSuite, and it is represented by the columns under the NetSuite Linage section in the mapping guide file.

  2. Data Warehouse: this is the intermediate stage. It describes the data physical layer after its transfer and how it is stored in NetSuite Analytics Warehouse. It is represented by the Physical Table and Physical Column columns under the Semantic Model (RPD) Lineage section in the mapping guide file.

  3. Analytics: this is the final stage. It describes the semantic layer of the data as it appears in NetSuite Analytics Warehouse. This semantic layer is specifically designed for an easier and better reporting and analysis experience. It is represented by the Subject Area, Table (Analytics), and Column (Analytics) columns in the mapping guide file.

The following table provides a better understanding of the columns in the mapping guide file:

NetSuite Lineage

Semantic Model (RPD) Lineage

NetSuite Table

NetSuite Column

NetSuite Table Type

Physical Table

Physical Column

Subject Area

Table (Analytics)

Column (Analytics)

This column indicates the name of the table within NetSuite where the data originates, for example Account.

This column specifies the name of the individual data field within the NetSuite table, for example displaynamewithhierarchy.

This column defines the type of table within NetSuite, for example Other Record.

This column shows the name of the table in NetSuite Analytics Warehouse where the data is stored after being transferred from NetSuite, for example DW_NS_ACCOUNT_D.

Note:

This name may be different from the NetSuite table name due to data warehousing conventions.

This column indicates the name of the data field (column) within the data warehouse table, for example DISPLAYNAMEWITHHIERARCHY.

Note:

This name may be different from the NetSuite column name due to data warehousing conventions.

This column represents the subject areas within a functional area in NetSuite Analytics Warehouse. Subject areas are the logical grouping of related data. These groups are specifically made to locate relevant information in an easier way. For example, NetSuite -Assembly Build.

This column displays the name of the table as it appears within the analytics tools. These tables are specifically designed to facilitate reporting. For example, Item.

This column specifies the name of the data field as it appears in NetSuite Analytics Warehouse. These column names are designed to be more descriptive and intuitive. For example, Item Income Account.

Related Topics

General Notices