Commands using sort sorted by votes

Commands using sort (800)

sorted by

Lookup autonomous systems of all outgoing http/s traffic

Using GNU Grep with perl regexp (works on newer Ubuntus) Show Sample Output
This is sample output - yours may be different.
```
16509   | 54.93.1.1    | AMAZON-02 - Amazon.com, Inc., US
```
0

ss -t -o state established '( dport = :443 || dport = :80 )' | grep -Po '([0-9a-z:.]*)(?=:http[s])' | sort -u|netcat whois.cymru.com 43|grep -v "AS Name"|sort -t'|' -k3

miniker84 · 2016-04-08 09:07:39 12
Finding commands to create alias for

by determining most popular use in history using percentage . Show Sample Output
This is sample output - yours may be different.
```
     1  187  25.7931%   sudo
     2  63   8.68966%   ls
     3  43   5.93103%   ping
     4  31   4.27586%   soccer
     5  26   3.58621%   cd
     6  21   2.89655%   zypper
     7  19   2.62069%   nmcli
     8  17   2.34483%   python
     9  17   2.34483%   find
    10  17   2.34483%   cat
```
0

history | awk '{CMD[$2]++;count++;}END { for (a in CMD)print CMD[a] " " CMD[a]/count*100 "% " a;}' | grep -v "./" | column -c3 -s " " -t | sort -nr | nl | head -n10

turrtle13 · 2016-04-24 17:21:35 9
list all directory sizes and sort by size

list all directory sizes and sort by size
This is sample output - yours may be different.
0

du -ks * | sort -nr | cut -f2 | xargs -d '\n' du -sh

unsorted · 2016-04-26 11:11:54 9
Btrfs: Find file names with checksum errors

debian kernel 4.4.6 Show Sample Output
This is sample output - yours may be different.
```
images/10000/vm-10000-disk-1.raw
images/8001/BUGBTRFS/vm-8001-disk-2.raw
images/9003/vm-9003-disk-2.raw.crash.btrfs
```
0

grep "checksum error at logical" /var/log/messages | egrep -o "[^ ]+$" | tr -d ')' | sort | uniq

andrefalgon · 2016-04-30 09:13:36 8
sorta apache logs by ip frequency
This is sample output - yours may be different.
0

cat access.log | awk '{print $1}' | sort -n | uniq -c | sort -nr | head -20

prees · 2016-05-05 20:52:03 13
Find top 10 largest files in /var directory (including subdirectories)
This is sample output - yours may be different.
0

find /var -type f -exec du -h {} \; | sort -rh | head -10

jiananmail · 2016-05-31 00:21:32 10
Diff two directories by finding and comparing the md5 checksums of their contents.

As output, checksums and filenames will be printed.
This is sample output - yours may be different.
0

diff <(sort <(md5deep -r /directory/1/) | awk -F '/' '{print $1 $NF}') <(sort <(md5deep -r /directory/2/) | awk -F '/' '{print $1 $NF}')

linux_noob · 2016-06-06 20:05:01 11
Find 20 most frequently-used shell commands from (bash history)
This is sample output - yours may be different.
0

tr "\|\;" "\n" < ~/.bash_history | sed -e "s/^ //g" | cut -d " " -f 1 | sort | uniq -c | sort -rn | head -20

turrtle13 · 2016-07-01 19:27:12 10
Ten most often used commands
This is sample output - yours may be different.
0

history | awk '{a[$2]++}END{for(i in a){print a[i] " " i}}' | sort -rn | head

turrtle13 · 2016-07-01 19:38:01 12
Display the top ten running processes sorted by the memory usage:
This is sample output - yours may be different.
0

ps aux | awk '{if ($5 != 0 ) print $2,$5,$6,$11}' | sort -k2rn | head -10 | column -t

turrtle13 · 2016-07-01 19:40:56 12

dnscrypt-proxy: get servers with lowest rtt

tune ping's -c and parallel's -j for your needs Show Sample Output

awk -F, '$1!~/^Name/ {print $1,$(NF-3)}' dnscrypt-resolvers.csv | awk -F"[: ]" '$2!~/^\[/ {print $1,$2}' | parallel -j 10 --colsep " " "echo -n \"{1} \"; ping -qc 60 {2} | tr -d \"\\n\" |awk -F\"[/ ]+\" '{print \$(NF-3),\$2}'" |sort -rnk 2

petzah · 2016-07-17 12:06:28 13

Diff two directories by finding and comparing the md5 checksums of their contents.

Results will be shown in columns. Only different files and files in one directory that is not in the other will be shown.
This is sample output - yours may be different.
0

diff -y --suppress-common-lines <(sort -k2 <(md5deep -r -b directory1)) <(sort -k2 <(md5deep -r -b directory2))

MeLoPasoPipa · 2016-08-18 09:17:16 12
check open ports without netstat or lsof

Order and uniq
This is sample output - yours may be different.
0

declare -a array=($(tail -n +2 /proc/net/tcp | cut -d":" -f"3"|cut -d" " -f"1")) && for port in ${array[@]}; do echo $((0x$port)); done | sort | uniq

lucasjr76 · 2016-08-19 03:20:59 18
List used Perl libraries in Perl project
This is sample output - yours may be different.
0

find . -type f $ -name '*.pm' -o -name '*.pl' $ | xargs grep "^use " | cut -d : -f2 | sort | uniq

tlezotte · 2016-09-28 19:59:38 16
Compare two files and output similarities to a new file

Use comm command to compare two text files and display lines that are exactly the same on both files and write those to a new output file using tee
This is sample output - yours may be different.
0

comm -1 -2 <(sort file1) <(sort file2) |& tee outputfile

poole · 2016-10-26 18:45:37 16
open listening ports

Useful to see what ports are taken by running services. Show Sample Output
This is sample output - yours may be different.
```
22
80
443
```
0

netstat -ltn | awk -n '/tcp /{ split($4, x, ":"); print(x[2]); }' | sort -n

felix_hummel · 2016-11-01 18:48:14 16
Retrieve a download count for URLs in apache logs
This is sample output - yours may be different.
0

zgrep 'pattern' /var/logs/apache2/access.log* | awk '{print $7}' | sort -n | uniq -c | sort -rn

funkjedi · 2016-11-30 20:14:28 15
all users with terminal sessions
This is sample output - yours may be different.
0

ps axno user,tty | awk '$1 >= 1000 && $1 < 65530 && $2 != "?"' | sort -u

aalex · 2017-01-06 21:05:38 16
Find the top most 5 duplicate files in a folder

To allow recursivity : find -type f -exec md5sum '{}' ';' | sort | uniq -c -w 33 | sort -gr | head -n 5 | cut -c1-7,41- Display only filenames : find -maxdepth 1 -type f -exec md5sum '{}' ';' | sort | uniq -c -w 33 | sort -gr | head -n 5 | cut -c43- Show Sample Output
This is sample output - yours may be different.
```
     50 ./file17.txt
     32 ./file44.txt
     11 ./file72.txt
      5 ./file29.txt
      3 ./file53.txt
```
0

find -maxdepth 1 -type f -exec md5sum '{}' ';' | sort | uniq -c -w 33 | sort -gr | head -n 5 | cut -c1-7,41-

MaDCOw · 2017-02-09 11:36:31 18
get all the IP addresses currently blocked by UFW (uncomplicated firewall)

Useful in scripts to compare known malicious IP addresses with what you are actually blocking. Show Sample Output
This is sample output - yours may be different.
```
217.118.95.89
217.12.113.114
```
0

ufw status | sort | uniq | grep -E -o "([0-9]{1,3}[\.]){3}[0-9]{1,3}"

harvix · 2017-02-17 12:12:44 18
Check the connection of the maximum number of IP

Check the connection of the maximum number of IP Show Sample Output
This is sample output - yours may be different.
```
      2 10.177.137.104
      2 10.139.17.154
      1 10.219.144.207
      1 10.137.2.204
      1 10.137.138.17
      1 10.130.0.238
```
0

netstat -na | grep ESTABLISHED | awk '{print$5}' | awk -F : '{print$1}' | sort | uniq -c | sort -r

casechen · 2017-03-26 12:12:09 17
Shows the size of folders and files, sorted from highest to lowest

Shows the size of folders and files, sorted from highest to lowest in human format (gb, mb,kb,etc...) Very useful to see the folders that are occupying more space. Show Sample Output
This is sample output - yours may be different.
```
88G	home
6,8G	usr
5,4G	var
860M	lib
666M	opt
152M	boot
49M	data
17M	etc
13M	sbin
13M	run
13M	bin
420K	dev
188K	root
16K	tmp
```
0

du -sh * | sort -rh

khain · 2017-04-03 10:23:40 33
File count into directories

Show file count into directories. Usefull when you try to find hugh directories that elevate system CPU (vmstat -> sy) Show Sample Output
This is sample output - yours may be different.
```
76 -> /opt/node-v6.9.1-linux-x64/include/node/openssl
82 -> /opt/node-v6.9.1-linux-x64/lib/node_modules/npm/node_modules
97 -> /opt/kingsoft/wps-office/office6
152 -> /opt/kingsoft/wps-office/office6/chart/styles
```
0

find / -type d | while read i; do ls $i | wc -l | tr -d \\n; echo " -> $i"; done | sort -n

Zort · 2017-05-12 00:02:43 19

Find Duplicate Files (based on size, name, and md5sum)

It works extremely fast, because it calculates md5sum only on the files that have the same size and name. But there is nothing for free - it won't find duplicates with the different names. Show Sample Output

find -type f -printf '%20s\t%100f\t%p\n' | sort -n | uniq -Dw121 | awk -F'\t' '{print $3}' | xargs -d '\n' md5sum | uniq -Dw32 | cut -b 35- | xargs -d '\n' ls -lU

ant7 · 2017-05-21 02:26:16 16

List all IP's connected to port 80
This is sample output - yours may be different.
0

netstat -tn 2>/dev/null | grep :80 | awk '{print $5}' | cut -d: -f1 | sort | uniq -c | sort -nr | head

kumarrav90 · 2017-05-28 10:57:14 15
‹ First < 25 26 27 28 29 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Check how far along (in %) your program is in a file

Say you're started "xzcat bigdata.xz | complicated-processing-program >summary" an hour ago, and you of course forgot to enable progress output (you could've just put "awk 'NR%1000==0{print NR>"/dev/stderr"}{print}'" in the pipeline but it's too late for that now). But you really want some idea of how far along your program is. Then you can run the above command to see how many % along xzcat is in reading the file. Note that this is for the GNU/Linux version of lsof; the one found on e.g. Darwin has slightly different output so the awk part may need some tweaks.

split a multi-page PDF into separate files

Simple alternative to the previous submitted one

Convert Unix newlines to DOS newlines

The ctrl+v,ctrl+m portion represents key presses that you should do. If you do it successfully you should see a ^M character appear.

Cleanup firefox's database.

For Mac OS X users only

backup system over ssh, exlucde common dirs

Multi-line grep

Using perl you can search for patterns spanning several lines, a thing that grep can't do. Append the list of files to above command or pipe a file through it, just as with regular grep. If you add the 's' modifier to the regex, the dot '.' also matches line endings, useful if you don't known how many lines you need are between parts of your pattern. Change '*' to '*?' to make it greedy, that is match only as few characters as possible. See also http://www.commandlinefu.com/commands/view/1764/display-a-block-of-text-with-awk to do a similar thing with awk. Edit: The undef has to be put in a begin-block, or a match in the first line would not be found.

See how many more processes are allowed, awesome!

There is a limit to how many processes you can run at the same time for each user, especially with web hosts. If the maximum # of processes for your user is 200, then the following sets OPTIMUM_P to 100. $ OPTIMUM_P=$(( (`ulimit -u` - `find /proc -maxdepth 1 $ -user $USER -o -group $GROUPNAME $ -type d|wc -l`) / 2 )) This is very useful in scripts because this is such a fast low-resource-intensive (compared to ps, who, lsof, etc) way to determine how many processes are currently running for whichever user. The number of currently running processes is subtracted from the high limit setup for the account (see limits.conf, pam, initscript). An easy to understand example- this searches the current directory for shell scripts, and runs up to 100 'file' commands at the same time, greatly speeding up the command. $ find . -type f | xargs -P $OPTIMUM_P -iFNAME file FNAME | sed -n '/shell script text/p' I am using it in my http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html especially for the xargs command. Xargs has a -P option that lets you specify how many processes to run at the same time. For instance if you have 1000 urls in a text file and wanted to download all of them fast with curl, you could download 100 at a time (check ps output on a separate [pt]ty for proof) like this: $ cat url-list.txt | xargs -I '{}' -P $OPTIMUM_P curl -O '{}' I like to do things as fast as possible on my servers. I have several types of servers and hosting environments, some with very restrictive jail shells with 20processes limit, some with 200, some with 8000, so for the jailed shells my xargs -P10 would kill my shell or dump core. Using the above I can set the -P value dynamically, so xargs always works, like this. $ cat url-list.txt | xargs -I '{}' -P $OPTIMUM_P curl -O '{}' If you were building a process-killer (very common for cheap hosting) this would also be handy. Note that if you are only allowed 20 or so processes, you should just use -P1 with xargs.

list files recursively by size

Transfer SSH public key to another machine in one step

This command sequence allows simple setup of (gasp!) password-less SSH logins. Be careful, as if you already have an SSH keypair in your ~/.ssh directory on the local machine, there is a possibility ssh-keygen may overwrite them. ssh-copy-id copies the public key to the remote host and appends it to the remote account's ~/.ssh/authorized_keys file. When trying ssh, if you used no passphrase for your key, the remote shell appears soon after invoking ssh user@host.

Gentoo: Get the size of all installed packets, sorted

On a Gentoo system, this command will tell you which packets you have installed and sort them by how much space they consume. Good for finding out space-hogs when tidying up disk space.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using sort

Commands using sort (800) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using sort (800)

sorted by