Remove Duplicate Lines
Remove duplicate lines that match exactly, keeping the first occurrence of each. Useful for cleaning name lists copied from spreadsheets or chat logs; lines that are only similar are not merged.
How to use
- Comparison works on whole lines, so an extra space at the start or end can make a line count as different.
- To improve matching, trim leading and trailing spaces from each line first, then run the dedupe.
FAQ
Do different capitalisations count as duplicates?
The tool compares text content, so Apple and apple are usually treated as different lines. If you want them merged, unify the case first and then run the dedupe.
Does it keep the first or the last copy?
The first occurrence is kept and later duplicates are removed. If you would rather keep the last one, reverse the lines first, dedupe, and reverse again.
Further reading