Date: 2013dec1 Language: bash OS: Linux Q. How can I remove duplicate lines from a file? A. Use the -u option of sort:

sort -u file1 > file2

This will read file1 sort it and remove duplicate lines, placing the result in file2. The -u option stands for "unique".