Commands using uniq sorted by votes

Commands using uniq (255)

sorted by

Top 30 History

Top 30 History Command line with histogram display Show Sample Output

history|awk '{print $2}'|sort|uniq -c|sort -rn|head -30|awk '!max{max=$1;}{r="";i=s=100*$1/max;while(i-->0)r=r"#";printf "%50s %5d %s %s",$2,$1,r,"\n";}'

injez · 2014-09-29 12:40:43 9

Fetch the requested virtual domains and their hits from log file

The command will read the apache log file and fetch the virtual host requested and the number of requests.
This is sample output - yours may be different.
1

cat /etc/httpd/logs/access.log | awk '{ print $6}' | sed -e 's/\[//' | awk -F'/' '{print $1}' | sort | uniq -c

suyashjain · 2014-10-13 13:39:53 8
Print all open regular files sorted by the number of file handles open to each.

This command run fine on my Ubuntu machine, but on Red Hat I had to change the awk command to `awk '{print $10}'`.
This is sample output - yours may be different.
1

sudo lsof | egrep 'w.+REG' | awk '{print $10}' | sort | uniq -c | sort -n

kennethjor · 2015-08-18 14:09:02 10
Print all open regular files sorted by the number of file handles open to each.

List all open files of all processes. . find /proc/*/fd Look through the /proc file descriptors . -xtype f list only symlinks to file . -printf "%l\n" print the symlink target . grep -P '^/(?!dev|proc|sys)' ignore files from /dev /proc or /sys . sort | uniq -c | sort -n count the results . Many processes will create and immediately delete temporary files. These can the filtered out by adding: ... | grep -v " (deleted)$" | ... Show Sample Output
This is sample output - yours may be different.
```
...
3 /var/log/squid/cache.log
5 /home/flatcap/.cache/tracker/meta.db-shm
5 /home/flatcap/.mozilla/firefox/bjt6fky6.default/places.sqlite
5 /home/flatcap/.mozilla/firefox/bjt6fky6.default/places.sqlite-wal
7 /home/flatcap/.cache/tracker/meta.db
7 /home/flatcap/.cache/tracker/meta.db-wal
```
1

find /proc/*/fd -xtype f -printf "%l\n" | grep -P '^/(?!dev|proc|sys)' | sort | uniq -c | sort -n

flatcap · 2015-08-18 17:58:21 11
Read random news on the internet

sort -R randomize the list. head -n1 takes the first.
This is sample output - yours may be different.
1

links `lynx -dump -listonly "http://news.google.com" | grep -Eo "(http|https)://[a-zA-Z0-9./?=_-]*" | grep -v "google.com" | sort -R | uniq | head -n1`

mogoh · 2016-07-26 12:54:53 15
processes per user counter

No need for sort Show Sample Output
This is sample output - yours may be different.
```
     31 somebody
      2 avahi
      1 colord
      1 libvirt-dnsmasq
      1 messagebus
      1 nobody
    181 root
      1 rtkit
      4 sddm
      1 syslog
      1 systemd-timesync
      1 usbmux
      1 whoopsie
```
1

ps hax -o user --sort user | uniq -c

sharkhands · 2016-09-15 23:31:51 15
Image to color palette generator

Extract a color palette from a image useful for designers. Example usage: extract-palette myawesomeimage.jpg 4 Where the first argument is the image you want to extract a palette from. The second argument is the number of colors you want. It may be the case where you want to change the search space. In that case, change the -resize argument to a bigger or smaller result. See the ImageMagick documentation for the -resize argument. Show Sample Output
This is sample output - yours may be different.
```
#0F0E17
#60579D
#9D6E97
#E99B75
#C57D8F
#D89690
#AA736B
#4D3B3F
```
1

extract-palette() { convert "$1" -resize 300x -dither None -colors "$2" txt: | tail -n +2 | tr -s ' ' | cut -d ' ' -f 3 | sort | uniq -c | sort -rn | tr -s ' ' | cut -d ' ' -f 3;}

seabre · 2017-06-21 22:07:26 51

Find the top 10 directories containing the highest number of files

It can be used to pinpoint the path(s) where the largest number of files resides when running out of free i-nodes Show Sample Output

acavagni · 2019-03-06 20:36:14 32

find directory with most inodes/files

Find which directory in one filesystem that contains most inodes or files. Show Sample Output

find / -xdev -printf '%h\n' | sort | uniq -c | sort -k 1 -n | tail

Raboo · 2019-05-24 12:01:30 38

find out which directory uses most inodes - list total sum of directoryname existing on filesystem
This is sample output - yours may be different.
1

find /etc -xdev -printf '%h\n' | sort | uniq -c | sort -k 1 -n

aysadk · 2019-07-02 09:13:53 36
Find failures with journalctl

Sometimes things break. You can find the most recent errors using a combination of journalctl, along with the classic tools sort and uniq Show Sample Output
This is sample output - yours may be different.
```
898172 "/usr/bin/dockerd"
    752 "/usr/local/sbin/node_exporter"
     30 "/usr/bin/gnome-shell"
     26 "/usr/bin/cat"
     22 "/usr/libexec/gsd-media-keys"
[...]
```
1

journalctl --no-pager --since today --grep 'fail|error|fatal' --output json | jq '._EXE' | sort | uniq -c | sort --numeric --reverse --key 1

mikhail · 2021-12-22 22:27:17 215
Finds all of the mailers being used in your rails app
This is sample output - yours may be different.
0

egrep -r '(render_message|multipart).*('`find app/views -name '*.erb' | grep mailer | sed -e 's/\..*//' -e 's/.*\///' | uniq | xargs | sed 's/ /|/g'`')' app/models

foobarfighter · 2009-06-12 18:53:29 5
Find duplicate dir in path
This is sample output - yours may be different.
0

echo $PATH|tr : '\n'|sort|uniq -d

haivu · 2009-09-24 17:22:45 3
Grap all images with the tags 'bitch' and 'bw' from a flickr photofeed

Show Sample Output
This is sample output - yours may be different.
```
A director full of desktop wallpapers showing nice woman ;)
```
0

for URL in `wget -O - http://api.flickr.com/services/feeds/photos_public.gne?tags=bitch,bw 2>/dev/null | grep -E -o "http[^ ]+?jpg" | grep -v "_m" | uniq | grep -v 'buddy' `; do FILE=`echo $URL | grep -E -o "[0-9a-z_]+\.jpg"`; curl $URL > $FILE; done;

Cowboy · 2009-10-30 11:52:31 3
This command will shorten any URL the user inputs. What makes this command different is that it utilizes 5 different services and gives you 5 different outputs.

This command will shorten any URL the user inputs. What makes this command different is that it utilizes 5 different services and gives you 5 different outputs: is.gd, bit.ly, u.nu, geekology.co.za, and tinyurl. curl -s http://tinyurl.com/create.php?url=$1 \ | sed -n 's/.*$http:\/\/tinyurl.com\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq ; curl -s http://bit.ly/?url=$1 \ | sed -n 's/.*$shortened-url" value="http:\/\/bit.ly\/[a-zA-Z0-9][a-zA-Z0-9]*$.*/\1/p' \ | sed -n 's/.*$http:\/\/bit.ly\/[a-zA-Z0-9][a-zA-Z0-9]*$.*/\1/p' \ | uniq ; curl -s http://geekology.co.za/shortii/create.php?u=$1 \ | sed -n 's/.*$http:\/\/geekology.co.za\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq ; curl -s http://u.nu/unu-api-simple?url=$1 \ | sed -n 's/.*$http:\/\/u.nu\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq ; curl -s http://is.gd/api.php?longurl=$1 \ | sed -n 's/.*$http:\/\/is.gd\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq echo ""
This is sample output - yours may be different.
0

curl -s http://tinyurl.com/create.php?url=$1 \ | sed -n 's/.*$http:\/\/tinyurl.com\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq ; curl -s http://bit.ly/?url=$1 \ | sed -n 's/.*\(shortened-url"...............

o0110o · 2010-01-11 01:11:27 7
Find Duplicate Files (based on size first, then MD5 hash)

A bit shorter and parallelized. Depending on the speed of your cpu and your disk this may run faster. Parallel is from https://savannah.nongnu.org/projects/parallel/
This is sample output - yours may be different.
0

find -not -empty -type f -printf "%s\n" | sort | uniq -d | parallel find -type f -size {}c | parallel md5sum | sort | uniq -w32 --all-repeated=separate

unixmonkey8046 · 2010-01-28 08:40:18 4
Count and show duplicate file names

Useful for C projects where header file names must be unique (e.g. when using autoconf/automake), or when diagnosing if the wrong header file is being used (due to dupe file names) Show Sample Output
This is sample output - yours may be different.
```
[user@localhost]$ find . -type f  |sed "s#.*/##g" |sort |uniq -c -d
      2 globals.h
      9 Makefile
      8 Makefile.bak
```
0

find . -type f |sed "s#.*/##g" |sort |uniq -c -d

shadycraig · 2010-02-17 11:59:54 5
Count repeated lines, listing them in descending order of frequency

Finds all (not just adjacent) repeated lines in a file. Show Sample Output
This is sample output - yours may be different.
```
      6 G
      6 E
      6 C
      6 A
      4 F
      4 D
      4 B
      4 0.5
      4 0.1
      2 1
      2 0.9
      2 0.7
      2 0.4
      2 0.2
```
0

LC_ALL=C sort file | uniq -c | sort -n -k1 -r

drmaciver · 2010-03-23 12:09:04 3
Get Unique Hostnames from Apache Config Files

Get a list of all the unique hostnames from the apache configuration files. Handy to see what sites are running on a server.
This is sample output - yours may be different.
0

cat /etc/apache2/sites-enabled/* | egrep 'ServerAlias|ServerName' | tr -s " " | sed 's/^[ ]//g' | uniq | cut -d ' ' -f 2 | sed 's/www.//g' | sort | uniq

chronosMark · 2010-04-08 08:51:17 5
Get a count of how many file types a project has

I created this command to give me a quick overview of how many file types a directory, and all its subdirectories, contains. It works based off file extension, rather than file(1)'s magic output, because it ended up being more accurate and less confusing. Files that don't have an ext (README) are generally not important for me to want to count, but you're free to customize this fit your needs. Show Sample Output
This is sample output - yours may be different.
```
    FILE TYPE        TOTAL
         .ico        1
         .jpg        17
         .log        1
         .php        104
         .png        44
```
0

printf "\n%25s%10sTOTAL\n" 'FILE TYPE' ' '; for ext in $(find . -iname \*.* | egrep -o '\.[^[:space:].]+$' | egrep -v '\.svn*' | sort -f | uniq -i); do count=$(find . -iname \*$ext | wc -l); printf "%25s%10s%d\n" $ext ' ' $count; done

rkulla · 2010-04-16 21:12:11 3
Generate list of words and their frequencies in a text file.
This is sample output - yours may be different.
0

tr A-Z a-z | tr -d 0-9\[\],\*-.?\:\"#\;\<\>\@ | tr ' /_' '\n' | sort | uniq -c

gcurious · 2010-10-19 17:21:05 3
Generate list of words and their frequencies in a text file.

Gives the same results as the command by putnamhill using nine less characters.
This is sample output - yours may be different.
0

tr -cs A-Za-z '\n' | sort | uniq -ci

TheMightyBuzzard · 2010-10-20 04:12:58 5
Ranking of the most frequently used commands
This is sample output - yours may be different.
0

history | awk '{print $2}' | awk 'BEGIN {FS="|"}{print $1}' | sort | uniq -c | sort -n | tail | sort -nr

maccu · 2010-11-17 11:14:21 5
Ranking of the most frequently used commands

Your version works fine except for someone who's interested in commands 'sudo' was prefixed to i.e. in your command, use of sudo appears as number of times sudo was used. Slight variation in my command peeks into what commands sudo was used for and counts the command (ignores 'sudo')
This is sample output - yours may be different.
0

history | awk '{print $2,$3}' | sed s/sudo// | awk '{print $1}' | awk 'BEGIN {FS="|"}{print $1}' | sort | uniq -c | sort -n | tail | sort -nr

b_t · 2010-11-17 12:15:04 3
List and count the number of open sessions per user
This is sample output - yours may be different.
0

users | xargs -n1 echo | sort | uniq -c

michaelmior · 2011-01-05 19:05:05 3
‹ First < 4 5 6 7 8 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Restore user,group and mod of an entire website

I often use it at my work, on an ovh server with root ssh access and often have to change mod after having finished an operation. This command, replace the user, group and mod by the one required by apache to work.

list block devices

Shows all block devices in a tree with descruptions of what they are.

Validating a file with checksum

launch bash without using any letters

ry4an@four:~$ echo $SHLVL 1 ry4an@four:~$ ${0/-/} ry4an@four:~$ echo $SHLVL 2

Read and write to TCP or UDP sockets with common bash tools

Ever needed to test firewalls but didn't have netcat, telnet or even FTP? Enter /dev/tcp, your new best friend. /dev/tcp/(hostname)/(port) is a bash builtin that bash can use to open connections to TCP and UDP ports. This one-liner opens a connection on a port to a server and lets you read and write to it from the terminal. How it works: First, exec sets up a redirect for /dev/tcp/$server/$port to file descriptor 5. Then, as per some excellent feedback from @flatcap, we launch a redirect from file descriptor 5 to STDOUT and send that to the background (which is what causes the PID to be printed when the commands are run), and then redirect STDIN to file descriptor 5 with the second cat. Finally, when the second cat dies (the connection is closed), we clean up the file descriptor with 'exec 5>&-'. It can be used to test FTP, HTTP, NTP, or can connect to netcat listening on a port (makes for a simple chat client!) Replace /tcp/ with /udp/ to use UDP instead.

Create a mirror of a local folder, on a remote server

Create a exact mirror of the local folder "/root/files", on remote server 'remote_server' using SSH command (listening on port 22) (all files & folders on destination server/folder will be deleted)

Getting a domain from url, ex: very nice to get url from squid access.log

replace strings in file names

Uses vi style search / replace in bash to rename files. Works with regex's too (I use the following a script to fixup / shorten file names): # Remove complete parenthetical/bracket/brace phrases rename 's/$.*$//g' * rename 's/\[.*\]//g' * rename 's/\{.*\}//g' *

Pronounce an English word using Merriam-Webster.com

Looks up a word on merriam-webster.com, does a screen scrape for the FIRST audio pronunciation and plays it. USAGE: Put this one-liner into a shell script (e.g., ~/bin/pronounce) and run it from the command line giving it the word to say: $ pronounce lek If the word isn't found in merriam-webster, no audio is played and the script returns an error value. However, M-W is a fairly complete dictionary (better than howjsay.com which won't let you hear how to pronounce naughty words). ASSUMPTIONS: GNU's sed (which supports -r for extended regular expressions) and Linux's aplay. Aplay can be replaced by any program that can play .WAV files from stdin. KNOWN BUGS: only the FIRST pronunciation is played, which is problematic if you wanted a particular form (plural, adjectival, etc) of the word. For example, if you run this: $ pronounce onomatopoetic you'll hear a voice saying "onomatopoeia". Playing the correct form of the word is possible, but doing so might make the screen scraper even more fragile than it already is. (The slightest change to the format of m-w.com could break it).

Read funny developer comments in the Linux source tree

These are way better than fortune(6).

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using uniq

Commands using uniq (255) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using uniq (255)

sorted by