Why Sorter transformation is Active ? How to avoid duplicate records using sorter and Source Qualifier with screen shot examples

Hello all,

In this topic, I am gonna explain about why sorter transformation is active and How to avoid duplicate records using sorter transformation and source qualifier.

There are two ways to eliminate duplicate records
1. By using source qualifier
2.Using sorter transformation

Source qualifier

Edit properties >> Select Distinct( By selecting this option, we can eliminate the duplicate records.  Kindly check the pic below:

Using sorter transformation , we can eliminate the duplicate records  . Kindly check the screenshot below:

Before we sort the records, there are 5 records in the table including 2 duplicate records

Sorter Mapping below:

Edit sorter transformation properties and select distinct . (check the pic below)

After selecting the distinct properties in the sorter transformation, workflow has been executed and it eliminated the duplicate records. In the table, now  u can see that duplicate records has been eliminated. It retrieved only 4 records. so it has been proved that sorter transformation is an active transformation