Commands using sort (800)
-
Using GNU Grep with perl regexp (works on newer Ubuntus) Show Sample Output
0ss -t -o state established '( dport = :443 || dport = :80 )' | grep -Po '([0-9a-z:.]*)(?=:http[s])' | sort -u|netcat whois.cymru.com 43|grep -v "AS Name"|sort -t'|' -k3 -
by determining most popular use in history using percentage . Show Sample Output
0history | awk '{CMD[$2]++;count++;}END { for (a in CMD)print CMD[a] " " CMD[a]/count*100 "% " a;}' | grep -v "./" | column -c3 -s " " -t | sort -nr | nl | head -n10 -
list all directory sizes and sort by size
0du -ks * | sort -nr | cut -f2 | xargs -d '\n' du -sh -
debian kernel 4.4.6 Show Sample Output
0grep "checksum error at logical" /var/log/messages | egrep -o "[^ ]+$" | tr -d ')' | sort | uniq -
0cat access.log | awk '{print $1}' | sort -n | uniq -c | sort -nr | head -20
-
0find /var -type f -exec du -h {} \; | sort -rh | head -10
-
As output, checksums and filenames will be printed.
0diff <(sort <(md5deep -r /directory/1/) | awk -F '/' '{print $1 $NF}') <(sort <(md5deep -r /directory/2/) | awk -F '/' '{print $1 $NF}') -
0tr "\|\;" "\n" < ~/.bash_history | sed -e "s/^ //g" | cut -d " " -f 1 | sort | uniq -c | sort -rn | head -20
-
0history | awk '{a[$2]++}END{for(i in a){print a[i] " " i}}' | sort -rn | head
-
0ps aux | awk '{if ($5 != 0 ) print $2,$5,$6,$11}' | sort -k2rn | head -10 | column -t
-
tune ping's -c and parallel's -j for your needs Show Sample Output
0awk -F, '$1!~/^Name/ {print $1,$(NF-3)}' dnscrypt-resolvers.csv | awk -F"[: ]" '$2!~/^\[/ {print $1,$2}' | parallel -j 10 --colsep " " "echo -n \"{1} \"; ping -qc 60 {2} | tr -d \"\\n\" |awk -F\"[/ ]+\" '{print \$(NF-3),\$2}'" |sort -rnk 2 -
Results will be shown in columns. Only different files and files in one directory that is not in the other will be shown.
0diff -y --suppress-common-lines <(sort -k2 <(md5deep -r -b directory1)) <(sort -k2 <(md5deep -r -b directory2)) -
Order and uniq
0declare -a array=($(tail -n +2 /proc/net/tcp | cut -d":" -f"3"|cut -d" " -f"1")) && for port in ${array[@]}; do echo $((0x$port)); done | sort | uniq -
0find . -type f \( -name '*.pm' -o -name '*.pl' \) | xargs grep "^use " | cut -d : -f2 | sort | uniq
-
Use comm command to compare two text files and display lines that are exactly the same on both files and write those to a new output file using tee
0comm -1 -2 <(sort file1) <(sort file2) |& tee outputfile -
Useful to see what ports are taken by running services. Show Sample Output
0netstat -ltn | awk -n '/tcp /{ split($4, x, ":"); print(x[2]); }' | sort -n -
0zgrep 'pattern' /var/logs/apache2/access.log* | awk '{print $7}' | sort -n | uniq -c | sort -rn
-
0ps axno user,tty | awk '$1 >= 1000 && $1 < 65530 && $2 != "?"' | sort -u
-
To allow recursivity :
find -type f -exec md5sum '{}' ';' | sort | uniq -c -w 33 | sort -gr | head -n 5 | cut -c1-7,41-Display only filenames :find -maxdepth 1 -type f -exec md5sum '{}' ';' | sort | uniq -c -w 33 | sort -gr | head -n 5 | cut -c43-Show Sample Output0find -maxdepth 1 -type f -exec md5sum '{}' ';' | sort | uniq -c -w 33 | sort -gr | head -n 5 | cut -c1-7,41- -
Useful in scripts to compare known malicious IP addresses with what you are actually blocking. Show Sample Output
0ufw status | sort | uniq | grep -E -o "([0-9]{1,3}[\.]){3}[0-9]{1,3}" -
Check the connection of the maximum number of IP Show Sample Output
0netstat -na | grep ESTABLISHED | awk '{print$5}' | awk -F : '{print$1}' | sort | uniq -c | sort -r -
Shows the size of folders and files, sorted from highest to lowest in human format (gb, mb,kb,etc...) Very useful to see the folders that are occupying more space. Show Sample Output
0du -sh * | sort -rh -
Show file count into directories. Usefull when you try to find hugh directories that elevate system CPU (vmstat -> sy) Show Sample Output
0find / -type d | while read i; do ls $i | wc -l | tr -d \\n; echo " -> $i"; done | sort -n -
It works extremely fast, because it calculates md5sum only on the files that have the same size and name. But there is nothing for free - it won't find duplicates with the different names. Show Sample Output
0find -type f -printf '%20s\t%100f\t%p\n' | sort -n | uniq -Dw121 | awk -F'\t' '{print $3}' | xargs -d '\n' md5sum | uniq -Dw32 | cut -b 35- | xargs -d '\n' ls -lU -
0netstat -tn 2>/dev/null | grep :80 | awk '{print $5}' | cut -d: -f1 | sort | uniq -c | sort -nr | head
- ‹ First < 25 26 27 28 29 > Last ›
What's this?
commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.
Check These Out
Stay in the loop…
- Follow the Tweets.
-
Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.
» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10 - Subscribe to the feeds.
-
Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):
Subscribe to the feed for:
- » all commands
- » commands with 3 up-votes (commandlinefu3)
- » commands with 10 up-votes (commandlinefu10)
- » commands using sort