Commands using sort sorted by votes

Commands using sort (800)

sorted by

Diff two directories by finding and comparing the md5 checksums of their contents.

Compares the md5 checksums of the contents of two directories, outputting the checksum and filename where any files differ. Shows only the file name, not the full path.
This is sample output - yours may be different.
1

diff <(sort <(md5deep -b -r /directory/1/) ) <(sort <(md5deep -b -r /directory/2/)

unixmonkey64021 · 2013-08-19 18:20:49 9
Filter IP's in apache access logs based on use

Show's per IP of how many requests they did to the Apache webserver
This is sample output - yours may be different.
1

cat /var/log/apache2/access_logs | cut -d ' ' -f 1 | uniq -c | sort -n

basvdburg · 2013-09-02 13:04:47 7
Filter IP's in apache access logs based on use

The first sort is necessary for ips in a list to be actually unique.
This is sample output - yours may be different.
1

cat /var/log/apache2/access_logs | cut -d' ' -f1 | sort | uniq -c | sort -n

while0pass · 2013-09-07 23:57:31 7
netstat with group by (ip adress)

Same as the rest, but handle IPv6 short IPs. Also, sort in the order that you're probably looking for. Show Sample Output
This is sample output - yours may be different.
```
    239 192.168.26.242
    129 172.16.12.3
     12 192.168.26.241
     12 172.16.12.2
      2 127.0.0.1
      1 172.16.12.66
      1 172.16.115.246
```
1

netstat -ntu | awk ' $5 ~ /^(::ffff:|[0-9|])/ { gsub("::ffff:","",$5); print $5}' | cut -d: -f1 | sort | uniq -c | sort -nr

mrwulf · 2013-09-10 19:28:06 6
apache statistics
This is sample output - yours may be different.
1

grep "10/Sep/2013" access.log| cut -d[ -f2 | cut -d] -f1 | awk -F: '{print $2":"$3}' | sort -nk1 -nk2 | uniq -c | awk '{ if ($1 > 10) print $0}'

bormarek · 2013-09-12 08:45:38 19
Create md5sum of a directory
This is sample output - yours may be different.
1

find -name .git -prune -o -type f -exec md5sum {} \; | sort -k2 | md5sum

pdxdoughnut · 2013-10-28 22:14:08 10
Find directories over 50MB in the home directory
This is sample output - yours may be different.
1

du -k ~/* | awk '$1 > 50000' | sort -nr

jmorganwalker · 2013-11-12 15:42:52 11
List the size (in human readable form) of all sub folders from the current location

Sorted in human readable format. Show Sample Output
This is sample output - yours may be different.
```
16K	conf.d
32K	mods-available
72K	cli
76K	cgi
148K	apache2
```
1

du -hs *|sort -h

felixhorro · 2013-11-21 10:14:47 19
Which files/dirs waste my disk space

I added -S to du so that you don't include /foo/bar/baz.iso in /foo, and change sorts -n to -h so that it can properly sort the human readable sizes.
This is sample output - yours may be different.
1

du -Sh | sort -h | tail

pdxdoughnut · 2013-11-27 17:50:11 7
count files by type

displays a list of all file extensions in current directory and how many files there are of each type of extension in ascending order (case insensitive) Show Sample Output
This is sample output - yours may be different.
```
      1 .md5
      1 .pub
      1 .pxd
      1 .rtf
      1 .sql
      1 .vsd
      2 .csv
      2 .lnk
      3 .7z
      3 .msg
      3 .xls
      3 .xlsm
      3 .zip
      4 .doc
      5 .htm
      5 .pptx
      5 .xps
      9 .txt
     13 .jpg
     16 .png
     19 .xlsx
     23 .docx
     48 .pdf
```
1

ls | tr [:upper:] [:lower:] | grep -oP '\.[^\.]+$' | sort | uniq -c | sort

icefyre · 2014-01-30 11:37:27 10
Find longest running non-root processes on a machine

If you have ever been trying to look for a list of processes based on their elapsed time you don't need to look any further. This command lets you find the list of processes ordered in a reversed order (oldest at the top) that have been running for over an hour on your system. Any system processes are filtered out, leaving only user initiated ones in. I find it extremely useful for debugging and performance analysis. Show Sample Output
This is sample output - yours may be different.
```
   19:52:12  0.0  1815 qmgr -l -t fifo -u
   19:52:02  0.0  1815 tlsmgr -l -t unix -u -c
   19:50:43  0.0  2286 -bash
   15:40:27  0.0 39276 /usr/bin/perl /usr/local/bin/abgit.pl master
   15:39:54  0.0 39391 /usr/bin/perl /usr/local/bin/farthrow.pl
   15:39:39  2.5 39432 /usr/bin/perl /usr/local/bin/receivemail.pl
   15:39:36  0.0 39454 /usr/bin/perl /usr/local/bin/doevent.pl
```
1

ps -eo etime,pid,pcpu,ppid,args | sed -e '/\[.\+\]/d' -e '/^[ \t]*[0-9]\{2\}:[0-9]\{2\} /d' | sort -k1r

neurodrone · 2014-02-14 00:22:31 10
List all duplicate directories

Very quick! Based only on the content sizes and the character counts of filenames. If both numbers are equal then two (or more) directories seem to be most likely identical. if in doubt apply: diff -rq path_to_dir1 path_to_dir2 AWK function taken from here: http://stackoverflow.com/questions/2912224/find-duplicates-lines-based-on-some-delimited-fileds-on-line Show Sample Output
This is sample output - yours may be different.
```
215 1320 ./hwebcam048.kopija
215 1320 ./hwebcam048
24 16 ./ac3dlx/lib/tk8.5/ttk/CVS
24 16 ./ac3dlx/lib/tk8.4/CVS
24 16 ./ac3dlx/tcl/CVS
```
1

find . -type d| while read i; do echo $(ls -1 "$i"|wc -m) $(du -s "$i"); done|sort -s -n -k1,1 -k2,2 |awk -F'[ \t]+' '{ idx=$1$2; if (array[idx] == 1) {print} else if (array[idx]) {print array[idx]; print; array[idx]=1} else {array[idx]=$0}}'

knoppix5 · 2014-02-25 22:50:09 27
Export unpushed files list
This is sample output - yours may be different.
1

git log origin/master..master --name-only --pretty="format:" | sort | uniq | xargs tar -rf mytarfile.tar

sarfraznawaz2005 · 2014-03-04 12:17:29 7
Sort netflow packet capture

Sort netflow packet capture by unique connections excluding source port. Show Sample Output
This is sample output - yours may be different.
```
    224 10.153.154.131->10.153.199.4:443
    206 10.153.217.69->10.153.156.4:53
    156 204.188.136.12->10.153.29.36:443
    121 204.156.7.28->10.153.29.35:443
    110 10.153.136.10->10.153.156.5:53
    104 10.153.219.86->10.153.156.4:53
```
1

grep -o -P '[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\:[0-9]{1,5}\s->\s{5}[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\:[0-9]{1,5}' <capture file> | tr -d ' ' | sed 's/:.....//g' | sort -n | uniq -c | sort -nr

santizo · 2014-03-05 21:34:42 8
Number of connections to domains on a cPanel server
This is sample output - yours may be different.
1

/usr/bin/lynx -dump -width 500 http://127.0.0.1/whm-server-status | awk 'BEGIN { FS = " " } ; { print $12 }' | sed '/^$/d' | sort | uniq -c | sort -n

copocaneta · 2014-03-12 12:38:24 8
Btrfs: Find file names with checksum errors

Btrfs reports the inode numbers of files with failed checksums. Use `find` to lookup the file names of those inodes. The files may need to be deleted and replaced with backups.
This is sample output - yours may be different.
1

dmesg | grep -Po 'csum failed ino\S* \d+' | awk '{print $4}' | sort -u | xargs -n 1 find / -inum 2> /dev/null

Sepero · 2014-03-22 12:22:46 9
Find 10 largest files in git history
This is sample output - yours may be different.
1

git verify-pack -v .git/objects/pack/pack-*.idx | grep blob | sort -k3nr | head | while read s x b x; do git rev-list --all --objects | grep $s | awk '{print "'"$b"'",$0;}'; done

qdrizh · 2014-06-25 07:37:24 6
Sort lines on clipboard

Does the same thing in environments where you have "xclip" instead of "pbpaste"/"pbpate" and "pbcopy".
This is sample output - yours may be different.
1

xclip -o -selection clipboard | sort | xclip -i -selection clipboard

gumnos · 2014-07-07 19:04:02 10
Sort content of a directory including hidden files.

This command sorts the content including hidden files in human readable format of the current directory. Show Sample Output
This is sample output - yours may be different.
```
/etc/pki/tls#
0	cert.pem
8.0K	private
12K	openssl.cnf
28K	misc
1.2M	certs
1.3M	total
```
1

du -sch .[!.]* * |sort -h

krizzo · 2014-07-17 21:45:46 16
list ips with high number of connections
This is sample output - yours may be different.
1

netstat -tn 2>/dev/null | grep :80 | awk '{print $5}' | cut -d: -f1 | sort | uniq -c | sort -nr | head

djzander · 2014-08-01 07:28:57 5

Parse compressed apache error log file and show top errors

credit shall fall to this for non-gzipped version: https://gist.github.com/marcanuy/a08d5f2d9c19ba621399 Show Sample Output

zanhsieh · 2014-09-24 05:26:24 8

tcpdump top 10 talkers

capture 2000 packets and print the top 10 talkers
This is sample output - yours may be different.
1

tcpdump -tnn -c 2000 -i eth0 | awk -F "." '{print $1"."$2"."$3"."$4}' | sort | uniq -c | sort -nr | awk ' $1 > 10 '

hochmeister · 2014-09-26 01:15:23 10

Top 30 History

Top 30 History Command line with histogram display Show Sample Output

history|awk '{print $2}'|sort|uniq -c|sort -rn|head -30|awk '!max{max=$1;}{r="";i=s=100*$1/max;while(i-->0)r=r"#";printf "%50s %5d %s %s",$2,$1,r,"\n";}'

injez · 2014-09-29 12:40:43 9

Fetch the requested virtual domains and their hits from log file

The command will read the apache log file and fetch the virtual host requested and the number of requests.
This is sample output - yours may be different.
1

cat /etc/httpd/logs/access.log | awk '{ print $6}' | sed -e 's/\[//' | awk -F'/' '{print $1}' | sort | uniq -c

suyashjain · 2014-10-13 13:39:53 8

BIGGEST Files in a Directory

Find biggest files in a directory Show Sample Output

find . -printf '%.5m %10M %#9u %-9g %TY-%Tm-%Td+%Tr [%Y] %s %p\n'|sort -nrk8|head

AskApache · 2014-12-10 23:48:20 9

‹ First < 13 14 15 16 17 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

check open ports without netstat or lsof

A command line calculator in Perl

Once I wrote a command line calculator program in C, then I found this... and added to it a bit. For ease of use I normally use this in a tiny Perl program (which I call pc for 'Perl Calculator') #!/usr/bin/perl -w die "Usage: $0 MATHS\n" unless(@ARGV);for(@ARGV){s/x/*/g;s/v/sqrt /g;s/\^/**/g}; print eval(join('',@ARGV)),$/; It handles square roots, power, modulus: $ pc 1+2 (1 plus 2) 3 $ pc 3x4 (3 times 4) 12 $ pc 5^6 (5 to the power of 6) 15625 $ pc v 49 ( square root of 49 ) 7 $ pc 12/3 (12 divided by 3) 4 $ pc 19%4 (19 modulus 4) 3 (you can string maths together too) $ pc 10 x 10 x 10 1000 $ pc 10 + 10 + 10 / 2 25 $ pc 7 x v49 49

Capture video of a linux desktop

This is identical to the original command, but allows you to specify an offset if you have multiple monitors. In this case you'll record a 1366x768 window that's offset by 1366 pixels in the x axis and 0 pixels in the y axis. Note also that the -sameq option has been replaced by -qscale - at least in ffmpeg version 1.2.1 on Fedora 19.

Find partition name using mount point

lsblk | grep mountpoint

Given $PID, print all child processes on stdout

Simpler.

Find out how old a web page is

I used to use the Firefox "View page info" feature a lot to determine how stale the web page I was looking at was. Now that I use mostly Chrome I miss that feature, so here is a command line alternative using wget. The -S says to display the server response, the --spider says to not download any files/pages, just fetch the header. The output goes to stderr, so to grep it you use 2>&1 to combine the stderr stream with stdout, the pipe that to grep for Last-Modified. You can use curl instead if you have it installed, like this: $ curl --head -s http://osswin.sourceforge.net | grep Mod

Detect illegal access to kernel space, potentially useful for Meltdown detection

Based on capsule8 agent examples, not rigorously tested

du with colored bar graph

i'm using gawk, you may get varying mileage with other varieties. You might want to change the / after du to say, /home/ or /var or something, otherwise this command might take quite some time to complete. Sorry it's so obsfucated, I had to turn a script into a one-liner under 255 characters for commandlinefu. Note: the bar ratio is relative, so the highest ratio of the total disk, "anchors" the rest of the graph. EDIT: the math was slightly wrong, fixed it. Also, made it compliant with older versions of df.

check open ports without netstat or lsof

List bash functions defined in .bash_profile or .bashrc

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using sort

Commands using sort (800) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using sort (800)

sorted by