A transformation reads data from a previous operation, processes the data according to the defined rules and passes the result on to the next operation. The possibilities with the rules reach from simple changing of the attributes (e.g. “all in capital letters”) over complex logical connections (e.g. „cuddle the cat but only if it is red or blue“) up to self-defined tools which permit arbitrary changes at the table. More about their creation can be found in chapter ‘Rules’.

Transformations are the core component of Chioro in which the magic takes place.

The configuration includes the following aspects.

  • Which data are passed directly and which are processed?
  • Which attributes are newly created, by linking the existing data?
  • Are additional data tables needed?

In an overview:

overview

  1. selection transformation / rules: Switch between basic configuration or rules to be applied.

  2. configure transformation: In the ‘Transformation’ tab …

    • a unique name can be given to the operation.
    • it can be selected whether only those columns are to be taken over for which a rule exists (‘Preset target with source’ = off) - or all.
    • can be selected whether empty records are to be transferred or not.
  3. Execute transformation: Note: This window is only available in the ‘Transformation’ tab. The process is started by clicking the ‘Transform’ button. In the history already executed operations are listed.

  4. info metrics: In the metrics, various key figures about the transformation can be seen. An explanation of metrics can be found in the Data tables of the Chioro system.

  5. source data display: Provides the same functionality as the Data evaluation, additionally the preview can be displayed for selected data sets (see also 6.).

  6. Result: The result preview offers the same functionality as the Data tables preview. There is the possibility not only to view the source, but also to compare the possible result of the transformation or to get a preview of the possible result. of the possible result. The button ‘Result preview’ is used for this purpose. With it the result of the transformation can be viewed. To compare data sets, Chioro marks the result data row when a row is marked in the source. This will mark the selected row in the source with the corresponding row found in the result preview.

Note that the actual transformation is not done in real time and takes some time depending on the number of rules and the number of rows. The preview is done in real time because only a very small dataset is transformed that is visible on the screen. Our recent benchmark of an actual transformation with 100,000 rows and 120 rules in a typical Chioro instance took about 15 minutes.

Extension copy and paste rules

You can copy and paste rules from a transformation. For this purpose two new buttons have been added to the rules:

overview

  1. copy button
  2. paste button

On the picture you can see that the “Paste Button” is grayed out. This is because no rules have been copied to the clipboard yet. You can change this by selecting all the rules you want to copy and clicking the “Copy” button. As soon as you have done this, you will see as feedback in the upper right corner of the window a message: “Rules successfully copied to clipboard” and the “Paste” button is now clickable.

Overview Overview

If you want to paste the copied rules into a transformation click on the Paste button. Now a window opens which shows the copied rules in a JSON format. Furthermore there is a checkbox above the text area which you can select if you want to overwrite an existing rule that has the same name and the same ID. If you have made your changes, click on the “Insert” button in the lower right corner and the rules will be inserted. If the checkbox is not checked, the copied rules will simply be pasted as new rules to the transformation.

overview