The Deduplicate function searches your data for rows that match each other exactly, and condenses them into a single row, removing duplicate entries from your data.
In the Deduplicate window, you have the option to add/remove columns from the Columns field. Any columns added to this field will be included in the deduplication process. As you add columns, they will appear in the preview. NOTE: Only those columns added to the Columns field will be included in the deduplication process and resulting output; any columns not selected will not be considered during the deduplication process and will be removed from the data upon its completion. Once you are satisfied with the parameters of the deduplication function, click the Save button to finalize the process and commit it to your project.
Other shaping operations:
Shape (Group By)