snippetbashTip
uniq — Output the unique lines from an input or file. Since it does not detect repeated lines unless they a
Viewed 0 times
thecommandlinesfromcliuniqueuniqoutput
Problem
How to use the
uniq command: Output the unique lines from an input or file. Since it does not detect repeated lines unless they are adjacent, we need to sort them first. See also: sort. More information: <https://www.gnu.org/software/coreutils/manual/html_node/uniq-invocation.html>.Solution
uniq — Output the unique lines from an input or file. Since it does not detect repeated lines unless they are adjacent, we need to sort them first. See also: sort. More information: <https://www.gnu.org/software/coreutils/manual/html_node/uniq-invocation.html>.Display each line once:
sort {{path/to/file}} | uniqDisplay only unique lines:
sort {{path/to/file}} | uniq {{[-u|--unique]}}Display only duplicate lines:
sort {{path/to/file}} | uniq {{[-d|--repeated]}}Display number of occurrences of each line along with that line:
sort {{path/to/file}} | uniq {{[-c|--count]}}Display number of occurrences of each line, sorted by the most frequent:
sort {{path/to/file}} | uniq {{[-c|--count]}} | sort {{[-nr|--numeric-sort --reverse]}}Compare only the first 10 characters on each line for uniqueness:
sort {{path/to/file}} | uniq {{[-w|--check-chars]}} 10Compare text after the first 5 characters on each line for uniqueness:
sort {{path/to/file}} | uniq {{[-s|--skip-chars]}} 5Code Snippets
Display each line once
sort {{path/to/file}} | uniqDisplay only unique lines
sort {{path/to/file}} | uniq {{[-u|--unique]}}Display only duplicate lines
sort {{path/to/file}} | uniq {{[-d|--repeated]}}Display number of occurrences of each line along with that line
sort {{path/to/file}} | uniq {{[-c|--count]}}Display number of occurrences of each line, sorted by the most frequent
sort {{path/to/file}} | uniq {{[-c|--count]}} | sort {{[-nr|--numeric-sort --reverse]}}Context
tldr-pages: common/uniq
Revisions (0)
No revisions yet.