Tools
Remove duplicate lines
Remove repeated lines from a list, keeping the first occurrence of each.
About this tool
Whenever you merge lists from different sources, duplicates turn up: emails repeated across two exports, keywords pulled from different SEO tools, URLs from a sitemap or product codes. This tool deletes repeated lines and keeps only the first occurrence of each, leaving the rest of the list in its original order. You end up with a clean list ready to import, count or compare.
Paste your list, one item per line, and press “Remove duplicate lines”. Matching is exact: “London” and “london”, or “hello” and “hello ” with a trailing space, count as different lines. To avoid that, convert everything to lowercase and use “Remove extra spaces” first, then run the duplicates button. The line counter at the bottom shows how many lines are left.
The list is processed in your browser and never sent to a server, which matters if it contains email addresses or customer data. Note that the text is kept in your browser’s local storage until you press the bin button. The tool works on whole lines: it won’t spot duplicates within a single line or across the columns of a CSV.
Frequently asked questions
Which line is kept when there are repeats?
The first one. Later occurrences are removed and the rest of the list keeps its original order.
Is it case-sensitive?
Yes, matching is exact. If you want “Hello” and “hello” treated as the same line, convert the text to lowercase first.
How can I tell how many duplicates were removed?
Check the line counter in the bottom bar before and after pressing the button; the difference is the number of duplicates removed.
Can I use it on an Excel column?
Yes: copy the column, paste it here, remove duplicates and paste it back. Excel has its own Remove Duplicates under the Data tab, but here you don’t need to open the file.