Hash Generator
The Hash Generator processor creates a Hash key for each input attribute. The output Hash key will be the same (and unique) for each distinct data value that is input to it.
Use the Hash Generator processor where you want to create a key in a set of data that will remain the same provided the input attribute retains the same value.
Hash keys are often used when 'diffing' data, for example to create processes that only run various processors on records that have changed in important attributes since the last time they were processed.
It is common to use the Concatenate processor before the Hash Generator to concatenate a number of attributes into a single attribute, and use that single attribute to generate the Hash key. The Hash key will then stay the same as long as the exact values of all the attributes passed into the Concatenate processor stay the same.
The following table describes the configuration options:
Configuration | Description |
---|---|
Inputs |
Specify any String or String Array type attributes that you want to use to generate Hash keys. |
Options |
None. |
Outputs |
Describes any data attribute or flag attribute outputs. |
Data Attributes |
The following data attributes are output:
|
Flags |
None. |
The Hash Generator transformer presents no summary statistics on its processing.In the Data view, each input attribute is shown with its new derived Hash key attribute to the right.
Output Filters
None.
Example
In this example, a concatenated NAMEANDADDRESS attribute, derived from all name and address attributes, is used to generate a Hash key for each record:
NAMEANDADDRESS | NAMEANDADDRESS.Hash |
---|---|
Mr|Jonathan BINIAN|Warrington HDC|Warrington| |
207dff53331d004b207b7e03cf9c63be |
Ms|Rosemary THORP|Benton Square|Benton| |
764fd23a622bf3cd30379caae9d7cd95 |
Ms|Margaret|ROBERTSON|23 High Street|Leicester| |
a41958f76d398b809f740f4e0c064914 |