Altair SmartWorks Analytics

 

Appending Data

The Append node allows you to combine data from two or more tables of a similar schema. In contrast to the Join node, which increases the number of columns in the resulting table relative to those in the two initial tables, the Append node increases the number of rows in the resulting table. The following example demonstrates how two input tables are appended, but you can easily add as many tables as you need to append to the node.

Prerequisite

  • An Execution Profile with an active session linked to the workflow

Steps

  1. Produce at least two Data Frame nodes by importing at least two data tables.

  2. From the Data Preparation group of the Nodes tabbed page, drag and drop the Append node from the Palette to the Workflow Canvas. The Append node can have multiple input sockets and one output socket. Connect the output socket of each of the Data Frame nodes produced in Step 1 to the input sockets of the Append node.

  3.  

    You can add more tables to append by simply connecting the output sock of another Data Frame object node to the input socket of the Append node, as shown below:

  4. Configure the Append node by double-clicking on the node or using the Open option provided in the node menu.  

  5. The Append Node Viewer displays as follows if you have two input tables.

     

    If you have three input tables, the Append Node Viewer displays as follows:

     

  6. Configure the node by providing the following details:

  7. Property

    Description

    Input Properties

    Table Names - The name of the tables to be appended. This field is automatically populated from the Data Frame node and cannot be edited.

    Output Properties

    Table - The table name.

     

    Default Append Strategy

    You can create appends:

    • By Name (with a case-sensitivity setting) - Columns are appended if the names of the columns match, regardless of order. The schema of the resulting table is that of the first table specified in Input Properties.

    • By Order - All columns are matched according to their order in the table, regardless of name or type. The schema of the resulting table is that of the first table specified in Input Properties.

    You can also opt to append by:

    • Match by Type - When this option is selected, the column data type will also be matched with the chosen append strategy. The output table creates new columns that do not match.

     

    Manual Column Matching:

    Regardless of the Append Strategy employed, columns can be manually mapped using the Configuration interface. This functionality can be used if the Default Append Strategy is insufficient for appending the columns in the input tables

    The node supports more than two tables as inputs, and manual mapping can be configured for the columns in any of these input tables.

    Use the dropdown button to find any column to select for mapping from a list of available non-mapped columns.

    Select the column to set the manual map. In the example below, the No_Sales column will map to the No_Products column.

     

    Once selected, the columns will be mapped and the Data Preview will update accordingly

    Columns to Include

    Specify which columns from the data inputs should be included in the append output. A search option is also provided to address inputs with numerous columns.

     

     

    When you have finished configuring your append table, a preview of your data displays in the right-hand side of the Node Viewer.

     

  8. Check the code that will be executed for your specified Append configuration by saving your current configuration and then clicking on the Code tab of the Append Node Viewer. You can use the Code Editor to refine the code further.

  9.  

  10. Complete the Append Node configuration by clicking Save. To cancel your changes and return to the Workflow Canvas, press Discard or simply close the Append Node Viewer. To execute the Append operation, click the Run button.

  11.