Table of Contents
Introduction
In this guide, I demonstrate how to use the uniq command in Linux to handle repeated lines. We’ll explore practical examples of the uniq command in action.
What does the “uniq” command mean?
“uniq” – This command is used to report or omit repeated lines.
uniq command the syntax
uniq [OPTION]... [INPUT [OUTPUT]]In the man page, the describes it
- uniq – report or omit repeated lines.
- man uniq – More details information about uniq command.
How to Use Uniq Command in Linux
I have created a file uniq_command.txt as below
[vagrant@DevopsRoles ~]$ cat uniq_command.txt HuuPV, My website DevopsRoles.com and HuuPhan.com.SN:199x. Devops Roles. Devops Roles. Devops Roles. Devops Roles. Hello world :)
Remove duplicate lines with the uniq command.
[vagrant@DevopsRoles ~]$ uniq uniq_command.txt HuuPV, My website DevopsRoles.com and HuuPhan.com.SN:199x. Devops Roles. Hello world :)
The number of times a line was repeated
[vagrant@DevopsRoles ~]$ uniq -c uniq_command.txt
1 HuuPV, My website DevopsRoles.com and HuuPhan.com.SN:199x.
4 Devops Roles.
1
1 Hello world :)
It only prints the repeated lines.
[vagrant@DevopsRoles ~]$ uniq -d uniq_command.txt Devops Roles.
Prints all repeated duplicate line
[vagrant@DevopsRoles ~]$ uniq -D uniq_command.txt Devops Roles. Devops Roles. Devops Roles. Devops Roles.
How to not print the duplicate lines. Only the unique lines.
[vagrant@DevopsRoles ~]$ uniq -u uniq_command.txt HuuPV, My website DevopsRoles.com and HuuPhan.com.SN:199x. Hello world :)
Conclusion
The uniq command is a straightforward tool in Linux, essential for managing and eliminating duplicate lines in files. It offers a simple yet effective way to clean data by reporting or omitting repeated entries. Thank you for visiting the DevopsRoles page and exploring this utility with us!
