Remove duplicate lines from your text instantly. Keep unique lines, remove consecutive duplicates, or strip all repeated content.
All processing happens in your browser. Your data never leaves your device.
Paste your text and duplicates are removed instantly. Choose between removing all duplicate lines (keeping first occurrence), removing only consecutive duplicates (like the Unix uniq command), or removing every line that appears more than once. All processing happens in your browser β your text never leaves your device.
Cleaning up data, removing repeated entries from lists, deduplicating log files, or preparing text for analysis β this tool handles it all instantly without any software installation.
The tool scans your text line by line. In 'Remove all duplicates' mode, it keeps only the first occurrence of each line. In 'Consecutive only' mode, it works like the Unix uniq command β only removing duplicates that appear next to each other. In 'Remove all occurrences' mode, it strips every line that appears more than once.
Yes. All processing happens entirely in your browser using JavaScript. Your text is never sent to any server or stored anywhere.
'Remove all duplicates' keeps the first occurrence of each unique line. 'Consecutive only' only removes duplicates that are adjacent (like Unix uniq). 'Remove all occurrences' removes every line that appears two or more times β nothing is kept.
When case sensitive is turned off, 'Hello' and 'hello' are treated as the same line. The original casing of the first occurrence is preserved in the output.
There's no hard limit, but very large texts (over 100,000 lines) may slow down your browser since all processing happens client-side.
TikTok
Twitter
Facebook