Commands using uniq sorted by votes

Commands using uniq (255)

sorted by

Top 30 History

Top 30 History Command line with histogram display Show Sample Output

history|awk '{print $2}'|sort|uniq -c|sort -rn|head -30|awk '!max{max=$1;}{r="";i=s=100*$1/max;while(i-->0)r=r"#";printf "%50s %5d %s %s",$2,$1,r,"\n";}'

injez · 2014-09-29 12:40:43 9

Fetch the requested virtual domains and their hits from log file

The command will read the apache log file and fetch the virtual host requested and the number of requests.
This is sample output - yours may be different.
1

cat /etc/httpd/logs/access.log | awk '{ print $6}' | sed -e 's/\[//' | awk -F'/' '{print $1}' | sort | uniq -c

suyashjain · 2014-10-13 13:39:53 8
Print all open regular files sorted by the number of file handles open to each.

This command run fine on my Ubuntu machine, but on Red Hat I had to change the awk command to `awk '{print $10}'`.
This is sample output - yours may be different.
1

sudo lsof | egrep 'w.+REG' | awk '{print $10}' | sort | uniq -c | sort -n

kennethjor · 2015-08-18 14:09:02 10
Print all open regular files sorted by the number of file handles open to each.

List all open files of all processes. . find /proc/*/fd Look through the /proc file descriptors . -xtype f list only symlinks to file . -printf "%l\n" print the symlink target . grep -P '^/(?!dev|proc|sys)' ignore files from /dev /proc or /sys . sort | uniq -c | sort -n count the results . Many processes will create and immediately delete temporary files. These can the filtered out by adding: ... | grep -v " (deleted)$" | ... Show Sample Output
This is sample output - yours may be different.
```
...
3 /var/log/squid/cache.log
5 /home/flatcap/.cache/tracker/meta.db-shm
5 /home/flatcap/.mozilla/firefox/bjt6fky6.default/places.sqlite
5 /home/flatcap/.mozilla/firefox/bjt6fky6.default/places.sqlite-wal
7 /home/flatcap/.cache/tracker/meta.db
7 /home/flatcap/.cache/tracker/meta.db-wal
```
1

find /proc/*/fd -xtype f -printf "%l\n" | grep -P '^/(?!dev|proc|sys)' | sort | uniq -c | sort -n

flatcap · 2015-08-18 17:58:21 11
Read random news on the internet

sort -R randomize the list. head -n1 takes the first.
This is sample output - yours may be different.
1

links `lynx -dump -listonly "http://news.google.com" | grep -Eo "(http|https)://[a-zA-Z0-9./?=_-]*" | grep -v "google.com" | sort -R | uniq | head -n1`

mogoh · 2016-07-26 12:54:53 15
processes per user counter

No need for sort Show Sample Output
This is sample output - yours may be different.
```
     31 somebody
      2 avahi
      1 colord
      1 libvirt-dnsmasq
      1 messagebus
      1 nobody
    181 root
      1 rtkit
      4 sddm
      1 syslog
      1 systemd-timesync
      1 usbmux
      1 whoopsie
```
1

ps hax -o user --sort user | uniq -c

sharkhands · 2016-09-15 23:31:51 15
Image to color palette generator

Extract a color palette from a image useful for designers. Example usage: extract-palette myawesomeimage.jpg 4 Where the first argument is the image you want to extract a palette from. The second argument is the number of colors you want. It may be the case where you want to change the search space. In that case, change the -resize argument to a bigger or smaller result. See the ImageMagick documentation for the -resize argument. Show Sample Output
This is sample output - yours may be different.
```
#0F0E17
#60579D
#9D6E97
#E99B75
#C57D8F
#D89690
#AA736B
#4D3B3F
```
1

extract-palette() { convert "$1" -resize 300x -dither None -colors "$2" txt: | tail -n +2 | tr -s ' ' | cut -d ' ' -f 3 | sort | uniq -c | sort -rn | tr -s ' ' | cut -d ' ' -f 3;}

seabre · 2017-06-21 22:07:26 51

Find the top 10 directories containing the highest number of files

It can be used to pinpoint the path(s) where the largest number of files resides when running out of free i-nodes Show Sample Output

acavagni · 2019-03-06 20:36:14 32

find directory with most inodes/files

Find which directory in one filesystem that contains most inodes or files. Show Sample Output

find / -xdev -printf '%h\n' | sort | uniq -c | sort -k 1 -n | tail

Raboo · 2019-05-24 12:01:30 38

find out which directory uses most inodes - list total sum of directoryname existing on filesystem
This is sample output - yours may be different.
1

find /etc -xdev -printf '%h\n' | sort | uniq -c | sort -k 1 -n

aysadk · 2019-07-02 09:13:53 36
Find failures with journalctl

Sometimes things break. You can find the most recent errors using a combination of journalctl, along with the classic tools sort and uniq Show Sample Output
This is sample output - yours may be different.
```
898172 "/usr/bin/dockerd"
    752 "/usr/local/sbin/node_exporter"
     30 "/usr/bin/gnome-shell"
     26 "/usr/bin/cat"
     22 "/usr/libexec/gsd-media-keys"
[...]
```
1

journalctl --no-pager --since today --grep 'fail|error|fatal' --output json | jq '._EXE' | sort | uniq -c | sort --numeric --reverse --key 1

mikhail · 2021-12-22 22:27:17 216
Finds all of the mailers being used in your rails app
This is sample output - yours may be different.
0

egrep -r '(render_message|multipart).*('`find app/views -name '*.erb' | grep mailer | sed -e 's/\..*//' -e 's/.*\///' | uniq | xargs | sed 's/ /|/g'`')' app/models

foobarfighter · 2009-06-12 18:53:29 5
Find duplicate dir in path
This is sample output - yours may be different.
0

echo $PATH|tr : '\n'|sort|uniq -d

haivu · 2009-09-24 17:22:45 3
Grap all images with the tags 'bitch' and 'bw' from a flickr photofeed

Show Sample Output
This is sample output - yours may be different.
```
A director full of desktop wallpapers showing nice woman ;)
```
0

for URL in `wget -O - http://api.flickr.com/services/feeds/photos_public.gne?tags=bitch,bw 2>/dev/null | grep -E -o "http[^ ]+?jpg" | grep -v "_m" | uniq | grep -v 'buddy' `; do FILE=`echo $URL | grep -E -o "[0-9a-z_]+\.jpg"`; curl $URL > $FILE; done;

Cowboy · 2009-10-30 11:52:31 3
This command will shorten any URL the user inputs. What makes this command different is that it utilizes 5 different services and gives you 5 different outputs.

This command will shorten any URL the user inputs. What makes this command different is that it utilizes 5 different services and gives you 5 different outputs: is.gd, bit.ly, u.nu, geekology.co.za, and tinyurl. curl -s http://tinyurl.com/create.php?url=$1 \ | sed -n 's/.*$http:\/\/tinyurl.com\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq ; curl -s http://bit.ly/?url=$1 \ | sed -n 's/.*$shortened-url" value="http:\/\/bit.ly\/[a-zA-Z0-9][a-zA-Z0-9]*$.*/\1/p' \ | sed -n 's/.*$http:\/\/bit.ly\/[a-zA-Z0-9][a-zA-Z0-9]*$.*/\1/p' \ | uniq ; curl -s http://geekology.co.za/shortii/create.php?u=$1 \ | sed -n 's/.*$http:\/\/geekology.co.za\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq ; curl -s http://u.nu/unu-api-simple?url=$1 \ | sed -n 's/.*$http:\/\/u.nu\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq ; curl -s http://is.gd/api.php?longurl=$1 \ | sed -n 's/.*$http:\/\/is.gd\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq echo ""
This is sample output - yours may be different.
0

curl -s http://tinyurl.com/create.php?url=$1 \ | sed -n 's/.*$http:\/\/tinyurl.com\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq ; curl -s http://bit.ly/?url=$1 \ | sed -n 's/.*\(shortened-url"...............

o0110o · 2010-01-11 01:11:27 7
Find Duplicate Files (based on size first, then MD5 hash)

A bit shorter and parallelized. Depending on the speed of your cpu and your disk this may run faster. Parallel is from https://savannah.nongnu.org/projects/parallel/
This is sample output - yours may be different.
0

find -not -empty -type f -printf "%s\n" | sort | uniq -d | parallel find -type f -size {}c | parallel md5sum | sort | uniq -w32 --all-repeated=separate

unixmonkey8046 · 2010-01-28 08:40:18 4
Count and show duplicate file names

Useful for C projects where header file names must be unique (e.g. when using autoconf/automake), or when diagnosing if the wrong header file is being used (due to dupe file names) Show Sample Output
This is sample output - yours may be different.
```
[user@localhost]$ find . -type f  |sed "s#.*/##g" |sort |uniq -c -d
      2 globals.h
      9 Makefile
      8 Makefile.bak
```
0

find . -type f |sed "s#.*/##g" |sort |uniq -c -d

shadycraig · 2010-02-17 11:59:54 5
Count repeated lines, listing them in descending order of frequency

Finds all (not just adjacent) repeated lines in a file. Show Sample Output
This is sample output - yours may be different.
```
      6 G
      6 E
      6 C
      6 A
      4 F
      4 D
      4 B
      4 0.5
      4 0.1
      2 1
      2 0.9
      2 0.7
      2 0.4
      2 0.2
```
0

LC_ALL=C sort file | uniq -c | sort -n -k1 -r

drmaciver · 2010-03-23 12:09:04 3
Get Unique Hostnames from Apache Config Files

Get a list of all the unique hostnames from the apache configuration files. Handy to see what sites are running on a server.
This is sample output - yours may be different.
0

cat /etc/apache2/sites-enabled/* | egrep 'ServerAlias|ServerName' | tr -s " " | sed 's/^[ ]//g' | uniq | cut -d ' ' -f 2 | sed 's/www.//g' | sort | uniq

chronosMark · 2010-04-08 08:51:17 5
Get a count of how many file types a project has

I created this command to give me a quick overview of how many file types a directory, and all its subdirectories, contains. It works based off file extension, rather than file(1)'s magic output, because it ended up being more accurate and less confusing. Files that don't have an ext (README) are generally not important for me to want to count, but you're free to customize this fit your needs. Show Sample Output
This is sample output - yours may be different.
```
    FILE TYPE        TOTAL
         .ico        1
         .jpg        17
         .log        1
         .php        104
         .png        44
```
0

printf "\n%25s%10sTOTAL\n" 'FILE TYPE' ' '; for ext in $(find . -iname \*.* | egrep -o '\.[^[:space:].]+$' | egrep -v '\.svn*' | sort -f | uniq -i); do count=$(find . -iname \*$ext | wc -l); printf "%25s%10s%d\n" $ext ' ' $count; done

rkulla · 2010-04-16 21:12:11 3
Generate list of words and their frequencies in a text file.
This is sample output - yours may be different.
0

tr A-Z a-z | tr -d 0-9\[\],\*-.?\:\"#\;\<\>\@ | tr ' /_' '\n' | sort | uniq -c

gcurious · 2010-10-19 17:21:05 3
Generate list of words and their frequencies in a text file.

Gives the same results as the command by putnamhill using nine less characters.
This is sample output - yours may be different.
0

tr -cs A-Za-z '\n' | sort | uniq -ci

TheMightyBuzzard · 2010-10-20 04:12:58 5
Ranking of the most frequently used commands
This is sample output - yours may be different.
0

history | awk '{print $2}' | awk 'BEGIN {FS="|"}{print $1}' | sort | uniq -c | sort -n | tail | sort -nr

maccu · 2010-11-17 11:14:21 5
Ranking of the most frequently used commands

Your version works fine except for someone who's interested in commands 'sudo' was prefixed to i.e. in your command, use of sudo appears as number of times sudo was used. Slight variation in my command peeks into what commands sudo was used for and counts the command (ignores 'sudo')
This is sample output - yours may be different.
0

history | awk '{print $2,$3}' | sed s/sudo// | awk '{print $1}' | awk 'BEGIN {FS="|"}{print $1}' | sort | uniq -c | sort -n | tail | sort -nr

b_t · 2010-11-17 12:15:04 3
List and count the number of open sessions per user
This is sample output - yours may be different.
0

users | xargs -n1 echo | sort | uniq -c

michaelmior · 2011-01-05 19:05:05 3
‹ First < 4 5 6 7 8 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

write the output of a command to /var/log/user.log... each line will contain $USER, making this easy to grep for.

This command is useful if you want to copy the output of a series of commands to a file, for example if you want to pastebin the output from 'uname -a', 'lspci -vvv' and 'lsmod' for video driver trouble-shooting on your favorite Linux forum. 'log' takes all the following arguments as a command to execute, with STDOUT sent to /var/log/user.log. The command is echoed to the log before it is executed. The advantages of using logger (as opposed to appending output from commands to a file) are 1) commands are always appended to the logs... you don't have to worry about clobbering your log file accidentally by using '>' rather than '>>' 2) logs are automatically cleaned up by logrotate. The following functions allow you to mark the start and end of a section of /var/log/user.log. $ startlog() { export LOGMARK=$(date +%Y.%m.%d_%H:%M:%S); echo "$LOGMARK.START" | logger -t $USER; } then $ endlog() { echo "$LOGMARK.END" | logger -t $USER; } printlog will print all lines between $LOGMARK.START and $LOGMARK.END, removing everything that is prepended to each line by logger. $ printlog() { sudo sed -n -e "/$LOGMARK.START/,/$LOGMARK.END/p" /var/log/user.log| sed "s/.*$USER: //"; } The following command should dump just about all the information that you could possibly want about your linux configuration into the clipboard. $ startlog; for cmd in 'uname -a' 'cat /etc/issue' 'dmesg' 'lsusb' 'lspci' 'sudo lshw' 'lsmod'; do log $cmd; done; endlog; printlog | xsel --clipboard This is ready for a trip to http://pastebin.com/, and you don't have to worry about leaving temporary files lying around cluttering up $HOME. Caveats: I'm sure that startlog, endlog, and printlog could use some cleanup and error checking... there are unchecked dependencies between printlog and endlog, as well as between endlog and startlog. It might be useful for 'log' to send stderr to logger as well.

HTTP GET request on wireshark remotly

List Threads by Pid along with Thread Start Time

This command will list all threads started by a particular pid along with the start time of each thread. This is very valuable when diagnosing thread leaks.

netstat with group by ip adress

Compare two directory trees.

Docker: Remove all exited docker container

Find the package that installed a command

ROT13 using the tr command

Get a qrcode for a given string

Benchmark SQL Query

Benchmark a SQL query against MySQL Server. The example runs the query 10 times, and you get the average runtime in the output. To ensure that the query does not get cached, use `RESET QUERY CACHE;` on top in the query file.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using uniq

Commands using uniq (255) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using uniq (255)

sorted by