> ## Content Index
> Fetch the complete content index at: https://kudithipudi.org/llms.txt
> Use this file to discover other available public pages before exploring further.

# HOW TO : Delete duplicate lines in Linux/Unix
- URL: https://kudithipudi.org/how-to-delete-duplicate-lines-in-linuxunix/
- Published: 2009-01-22T06:22:29.000Z
- Updated: 2009-01-22T06:22:29.000Z
- Description: If you have a large text file and want to quickly delete any duplicate lines, you can use the following option of sort in *nix.. sort...
- Author: admin
- Tags: HOWTO, Linux, Technology, Uncategorized, #wp, #wp-post, #Import 2026-08-23 02:32

If you have a large text file and want to quickly delete any duplicate lines, you can use the following option of sort in \*nix..

`sort -u filename > newfilename`

If you want to get even funkier :), like only checking duplicates on a particular column, feel free to check out this link [http://www.gnu.org/software/coreutils/manual/html\_node/sort-invocation.html#sort-invocation](http://www.gnu.org/software/coreutils/manual/html%5Fnode/sort-invocation.html?ref=kudithipudi.org#sort-invocation).