Commands using uniq sorted by votes

Commands using uniq (255)

sorted by

Top 30 History

Top 30 History Command line with histogram display Show Sample Output

history|awk '{print $2}'|sort|uniq -c|sort -rn|head -30|awk '!max{max=$1;}{r="";i=s=100*$1/max;while(i-->0)r=r"#";printf "%50s %5d %s %s",$2,$1,r,"\n";}'

injez · 2014-09-29 12:40:43 9

Fetch the requested virtual domains and their hits from log file

The command will read the apache log file and fetch the virtual host requested and the number of requests.
This is sample output - yours may be different.
1

cat /etc/httpd/logs/access.log | awk '{ print $6}' | sed -e 's/\[//' | awk -F'/' '{print $1}' | sort | uniq -c

suyashjain · 2014-10-13 13:39:53 8
Print all open regular files sorted by the number of file handles open to each.

This command run fine on my Ubuntu machine, but on Red Hat I had to change the awk command to `awk '{print $10}'`.
This is sample output - yours may be different.
1

sudo lsof | egrep 'w.+REG' | awk '{print $10}' | sort | uniq -c | sort -n

kennethjor · 2015-08-18 14:09:02 10
Print all open regular files sorted by the number of file handles open to each.

List all open files of all processes. . find /proc/*/fd Look through the /proc file descriptors . -xtype f list only symlinks to file . -printf "%l\n" print the symlink target . grep -P '^/(?!dev|proc|sys)' ignore files from /dev /proc or /sys . sort | uniq -c | sort -n count the results . Many processes will create and immediately delete temporary files. These can the filtered out by adding: ... | grep -v " (deleted)$" | ... Show Sample Output
This is sample output - yours may be different.
```
...
3 /var/log/squid/cache.log
5 /home/flatcap/.cache/tracker/meta.db-shm
5 /home/flatcap/.mozilla/firefox/bjt6fky6.default/places.sqlite
5 /home/flatcap/.mozilla/firefox/bjt6fky6.default/places.sqlite-wal
7 /home/flatcap/.cache/tracker/meta.db
7 /home/flatcap/.cache/tracker/meta.db-wal
```
1

find /proc/*/fd -xtype f -printf "%l\n" | grep -P '^/(?!dev|proc|sys)' | sort | uniq -c | sort -n

flatcap · 2015-08-18 17:58:21 11
Read random news on the internet

sort -R randomize the list. head -n1 takes the first.
This is sample output - yours may be different.
1

links `lynx -dump -listonly "http://news.google.com" | grep -Eo "(http|https)://[a-zA-Z0-9./?=_-]*" | grep -v "google.com" | sort -R | uniq | head -n1`

mogoh · 2016-07-26 12:54:53 15
processes per user counter

No need for sort Show Sample Output
This is sample output - yours may be different.
```
     31 somebody
      2 avahi
      1 colord
      1 libvirt-dnsmasq
      1 messagebus
      1 nobody
    181 root
      1 rtkit
      4 sddm
      1 syslog
      1 systemd-timesync
      1 usbmux
      1 whoopsie
```
1

ps hax -o user --sort user | uniq -c

sharkhands · 2016-09-15 23:31:51 15
Image to color palette generator

Extract a color palette from a image useful for designers. Example usage: extract-palette myawesomeimage.jpg 4 Where the first argument is the image you want to extract a palette from. The second argument is the number of colors you want. It may be the case where you want to change the search space. In that case, change the -resize argument to a bigger or smaller result. See the ImageMagick documentation for the -resize argument. Show Sample Output
This is sample output - yours may be different.
```
#0F0E17
#60579D
#9D6E97
#E99B75
#C57D8F
#D89690
#AA736B
#4D3B3F
```
1

extract-palette() { convert "$1" -resize 300x -dither None -colors "$2" txt: | tail -n +2 | tr -s ' ' | cut -d ' ' -f 3 | sort | uniq -c | sort -rn | tr -s ' ' | cut -d ' ' -f 3;}

seabre · 2017-06-21 22:07:26 51

Find the top 10 directories containing the highest number of files

It can be used to pinpoint the path(s) where the largest number of files resides when running out of free i-nodes Show Sample Output

acavagni · 2019-03-06 20:36:14 32

find directory with most inodes/files

Find which directory in one filesystem that contains most inodes or files. Show Sample Output

find / -xdev -printf '%h\n' | sort | uniq -c | sort -k 1 -n | tail

Raboo · 2019-05-24 12:01:30 38

find out which directory uses most inodes - list total sum of directoryname existing on filesystem
This is sample output - yours may be different.
1

find /etc -xdev -printf '%h\n' | sort | uniq -c | sort -k 1 -n

aysadk · 2019-07-02 09:13:53 36
Find failures with journalctl

Sometimes things break. You can find the most recent errors using a combination of journalctl, along with the classic tools sort and uniq Show Sample Output
This is sample output - yours may be different.
```
898172 "/usr/bin/dockerd"
    752 "/usr/local/sbin/node_exporter"
     30 "/usr/bin/gnome-shell"
     26 "/usr/bin/cat"
     22 "/usr/libexec/gsd-media-keys"
[...]
```
1

journalctl --no-pager --since today --grep 'fail|error|fatal' --output json | jq '._EXE' | sort | uniq -c | sort --numeric --reverse --key 1

mikhail · 2021-12-22 22:27:17 212
Finds all of the mailers being used in your rails app
This is sample output - yours may be different.
0

egrep -r '(render_message|multipart).*('`find app/views -name '*.erb' | grep mailer | sed -e 's/\..*//' -e 's/.*\///' | uniq | xargs | sed 's/ /|/g'`')' app/models

foobarfighter · 2009-06-12 18:53:29 5
Find duplicate dir in path
This is sample output - yours may be different.
0

echo $PATH|tr : '\n'|sort|uniq -d

haivu · 2009-09-24 17:22:45 3
Grap all images with the tags 'bitch' and 'bw' from a flickr photofeed

Show Sample Output
This is sample output - yours may be different.
```
A director full of desktop wallpapers showing nice woman ;)
```
0

for URL in `wget -O - http://api.flickr.com/services/feeds/photos_public.gne?tags=bitch,bw 2>/dev/null | grep -E -o "http[^ ]+?jpg" | grep -v "_m" | uniq | grep -v 'buddy' `; do FILE=`echo $URL | grep -E -o "[0-9a-z_]+\.jpg"`; curl $URL > $FILE; done;

Cowboy · 2009-10-30 11:52:31 3
This command will shorten any URL the user inputs. What makes this command different is that it utilizes 5 different services and gives you 5 different outputs.

This command will shorten any URL the user inputs. What makes this command different is that it utilizes 5 different services and gives you 5 different outputs: is.gd, bit.ly, u.nu, geekology.co.za, and tinyurl. curl -s http://tinyurl.com/create.php?url=$1 \ | sed -n 's/.*$http:\/\/tinyurl.com\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq ; curl -s http://bit.ly/?url=$1 \ | sed -n 's/.*$shortened-url" value="http:\/\/bit.ly\/[a-zA-Z0-9][a-zA-Z0-9]*$.*/\1/p' \ | sed -n 's/.*$http:\/\/bit.ly\/[a-zA-Z0-9][a-zA-Z0-9]*$.*/\1/p' \ | uniq ; curl -s http://geekology.co.za/shortii/create.php?u=$1 \ | sed -n 's/.*$http:\/\/geekology.co.za\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq ; curl -s http://u.nu/unu-api-simple?url=$1 \ | sed -n 's/.*$http:\/\/u.nu\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq ; curl -s http://is.gd/api.php?longurl=$1 \ | sed -n 's/.*$http:\/\/is.gd\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq echo ""
This is sample output - yours may be different.
0

curl -s http://tinyurl.com/create.php?url=$1 \ | sed -n 's/.*$http:\/\/tinyurl.com\/[a-z0-9][a-z0-9]*$.*/\1/p' \ | uniq ; curl -s http://bit.ly/?url=$1 \ | sed -n 's/.*\(shortened-url"...............

o0110o · 2010-01-11 01:11:27 7
Find Duplicate Files (based on size first, then MD5 hash)

A bit shorter and parallelized. Depending on the speed of your cpu and your disk this may run faster. Parallel is from https://savannah.nongnu.org/projects/parallel/
This is sample output - yours may be different.
0

find -not -empty -type f -printf "%s\n" | sort | uniq -d | parallel find -type f -size {}c | parallel md5sum | sort | uniq -w32 --all-repeated=separate

unixmonkey8046 · 2010-01-28 08:40:18 4
Count and show duplicate file names

Useful for C projects where header file names must be unique (e.g. when using autoconf/automake), or when diagnosing if the wrong header file is being used (due to dupe file names) Show Sample Output
This is sample output - yours may be different.
```
[user@localhost]$ find . -type f  |sed "s#.*/##g" |sort |uniq -c -d
      2 globals.h
      9 Makefile
      8 Makefile.bak
```
0

find . -type f |sed "s#.*/##g" |sort |uniq -c -d

shadycraig · 2010-02-17 11:59:54 5
Count repeated lines, listing them in descending order of frequency

Finds all (not just adjacent) repeated lines in a file. Show Sample Output
This is sample output - yours may be different.
```
      6 G
      6 E
      6 C
      6 A
      4 F
      4 D
      4 B
      4 0.5
      4 0.1
      2 1
      2 0.9
      2 0.7
      2 0.4
      2 0.2
```
0

LC_ALL=C sort file | uniq -c | sort -n -k1 -r

drmaciver · 2010-03-23 12:09:04 3
Get Unique Hostnames from Apache Config Files

Get a list of all the unique hostnames from the apache configuration files. Handy to see what sites are running on a server.
This is sample output - yours may be different.
0

cat /etc/apache2/sites-enabled/* | egrep 'ServerAlias|ServerName' | tr -s " " | sed 's/^[ ]//g' | uniq | cut -d ' ' -f 2 | sed 's/www.//g' | sort | uniq

chronosMark · 2010-04-08 08:51:17 5
Get a count of how many file types a project has

I created this command to give me a quick overview of how many file types a directory, and all its subdirectories, contains. It works based off file extension, rather than file(1)'s magic output, because it ended up being more accurate and less confusing. Files that don't have an ext (README) are generally not important for me to want to count, but you're free to customize this fit your needs. Show Sample Output
This is sample output - yours may be different.
```
    FILE TYPE        TOTAL
         .ico        1
         .jpg        17
         .log        1
         .php        104
         .png        44
```
0

printf "\n%25s%10sTOTAL\n" 'FILE TYPE' ' '; for ext in $(find . -iname \*.* | egrep -o '\.[^[:space:].]+$' | egrep -v '\.svn*' | sort -f | uniq -i); do count=$(find . -iname \*$ext | wc -l); printf "%25s%10s%d\n" $ext ' ' $count; done

rkulla · 2010-04-16 21:12:11 3
Generate list of words and their frequencies in a text file.
This is sample output - yours may be different.
0

tr A-Z a-z | tr -d 0-9\[\],\*-.?\:\"#\;\<\>\@ | tr ' /_' '\n' | sort | uniq -c

gcurious · 2010-10-19 17:21:05 3
Generate list of words and their frequencies in a text file.

Gives the same results as the command by putnamhill using nine less characters.
This is sample output - yours may be different.
0

tr -cs A-Za-z '\n' | sort | uniq -ci

TheMightyBuzzard · 2010-10-20 04:12:58 5
Ranking of the most frequently used commands
This is sample output - yours may be different.
0

history | awk '{print $2}' | awk 'BEGIN {FS="|"}{print $1}' | sort | uniq -c | sort -n | tail | sort -nr

maccu · 2010-11-17 11:14:21 5
Ranking of the most frequently used commands

Your version works fine except for someone who's interested in commands 'sudo' was prefixed to i.e. in your command, use of sudo appears as number of times sudo was used. Slight variation in my command peeks into what commands sudo was used for and counts the command (ignores 'sudo')
This is sample output - yours may be different.
0

history | awk '{print $2,$3}' | sed s/sudo// | awk '{print $1}' | awk 'BEGIN {FS="|"}{print $1}' | sort | uniq -c | sort -n | tail | sort -nr

b_t · 2010-11-17 12:15:04 3
List and count the number of open sessions per user
This is sample output - yours may be different.
0

users | xargs -n1 echo | sort | uniq -c

michaelmior · 2011-01-05 19:05:05 3
‹ First < 4 5 6 7 8 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Convert any sequence of spaces/tabs to single space/tab

Remove empty lines additionally: $ tr -s ' \t\n' 2.txt identical with: $ tr -s '[:space:]' 2.txt To "clean perfectly" a text or code file, You can combine this command with another one: $ while read l; do echo -e "$l"; done 2.txt (= remove all leading and trailing spaces or tabs from all lines of a text file)

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

list files recursively by size

Capture video of a linux desktop

This will grab the image from desktop, starting with the upper-left corner at x=100, y=200 with a width and height of 1024?768.

Automatic ssh Session Logger

A wrapper around ssh to automatically provide logging and session handling. This function runs ssh, which runs screen, which runs script. . The logs and the screen session are stored on the server. This means you can leave a session running and re-attach to it later, or from another machine. . . Requirements: * Log sessions on a remote server * Transparent - nothing extra to type * No installation - nothing to copy to the server beforehand . Features: * Function wrapper delegating to ssh - so nothing to remember - uses .ssh/config as expected - passes your command line option to ssh * Self-contained: no scripts to install on the server * Uses screen(1), so is: - detachable - re-attachable - shareable * Records session using script(1) * Configurable log file location, which may contain variables or whitespace L="$HOME" # local variable L="\$HOME" # server variable L="some space" . Limitations: * Log dir/file may not contain '~' (which would require eval on the server) . . The sessions are named by the local user connecting to the server. Therefore if you detach and re-run the same command you will reconnect to your original session. If you want to connect/share another's session simply run: $ USER=bob ssh root@server . The command above is stripped down to an absolute minimum. A fully expanded and annotated version is available as a Gist (git pastebin): https://gist.github.com/flatcap/3c42326abeb1197ee714 . If you want to add timing info to script, change the command to: $ ssh(){ L="\$HOME/logs/$(date +%F_%H:%M)-$USER";/usr/bin/ssh -t "$@" "mkdir -p \"${L%/*}\";screen -xRRS $USER script --timing=\"$L-timing\" -f \"$L\"";}

Download YouTube Videos using wget and youtube-dl and just using the video link

in place of "output-filename.mp4" put the name you want the file to be named with. in place of "youtube-video-link" put the link of the Video page eg: http://www.youtube.com/watch?v=AclA-7YntvE in place of "format-number" put the number of the file format you would like How to get the "format-number" to get format number type in below command before running this command $ youtube-dl -F "youtube-video-link" and it will list all the available formats with the format number, like to download in 360p mp4 use the number "18" To automatically let it fetch the best quality available just remove the -f "format-number" and you are good to go.

Use Perl like grep

Much better alternatives - grep-alikes using perl regexps. With more options, and nicer outputs.

Remove all the files except abc in the directory

Finds all files in the current directory and deletes them besides file called "abc"

Mount/unmount your truecrypted file containers

This should automatically mount it to /media/truecrypt1. Further mounts will go to /media/truecrypt2, and so on. You shouldn't need sudo/su if your permissions are right. I alias tru='truecrypt' since tr and true are commands. To explicitly create a mount point do: tru volume.tc /media/foo To make sure an GUI explorer window (nautilus, et al) opens on the mounted volume, add: --explorer To see what you currently have mounted do: tru -l To dismount a volume do: tru -d volume.tc. To dismount all mounted volumes at once do: tru -d Tested with Truecrypt v6.3a / Ubuntu 9.10

Validate date, also a date within a leap year

Important to know: a valid date will return 0, otherwise 1!

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using uniq

Commands using uniq (255) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using uniq (255)

sorted by