Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

all java -Xmx values in a system, add them up

process name , process id , xms( initial memory allocation pool) , xmx(maximum memory allocation pool) Show Sample Output
This is sample output - yours may be different.
```
solr 32603 -Xmx614 -Xmx614
root 42319 -Xmx60G -Xmx60G
solr 42320 -Xmx60G -Xmx60G
```
0

ps -ef | grep jav[a] | awk '{print substr($1,1),substr($2,1),substr($0,index($0,"-Xms"),7),substr($0,index($0,"-Xmx"),7)}'

illia · 2016-02-14 18:50:58 12
Remove all untagged docker images

Remove all untagged images
This is sample output - yours may be different.
0

docker rmi $(docker images | grep "^<none>" | awk "{print $3}")

vivek_saini07 · 2016-02-20 21:51:09 14
Reports file systems with disk usage exceeding 90% on the specified host
This is sample output - yours may be different.
0

function df_func { local dfts=$(ssh $1 "df -lP | tail -n +2 | sed 's/%//'"); echo $dfts | awk '$5 > 90 {exit 1}' > /dev/null; if [ $? == 1 ]; then echo -n "$1 "; echo $dfts | awk '$5 > 90 {printf "%s %d%%\n", $6, $5}'; fi }

wytten12 · 2016-03-30 19:57:39 10
Display the standard deviation of a column of numbers with awk

I was concerned that the other scripts didn't use the correct order of operations for the calculation. Variance needs to be squared before being summed, then divided by NR and then square rooted. Not sure if this method is correct but this is what I came up with. I think it works correctly but I'm not totally sure. If anyone could critique it that would be great.
This is sample output - yours may be different.
0

awk '{delta=$1; avg+=$1/NR;} END {print "stdev = " sqrt(((delta-avg)^2)/NR);}'

123nor · 2016-04-19 08:49:49 12
Finding commands to create alias for

by determining most popular use in history using percentage . Show Sample Output
This is sample output - yours may be different.
```
     1  187  25.7931%   sudo
     2  63   8.68966%   ls
     3  43   5.93103%   ping
     4  31   4.27586%   soccer
     5  26   3.58621%   cd
     6  21   2.89655%   zypper
     7  19   2.62069%   nmcli
     8  17   2.34483%   python
     9  17   2.34483%   find
    10  17   2.34483%   cat
```
0

history | awk '{CMD[$2]++;count++;}END { for (a in CMD)print CMD[a] " " CMD[a]/count*100 "% " a;}' | grep -v "./" | column -c3 -s " " -t | sort -nr | nl | head -n10

turrtle13 · 2016-04-24 17:21:35 9
sorta apache logs by ip frequency
This is sample output - yours may be different.
0

cat access.log | awk '{print $1}' | sort -n | uniq -c | sort -nr | head -20

prees · 2016-05-05 20:52:03 13
list java heap summary
This is sample output - yours may be different.
0

ps -ef | grep -oh 'Xmx[0-9]*' | cut -d'x' -f2 | awk '{SUM += $1} END { print SUM}'

Raboo · 2016-05-13 11:12:08 12
Thread count per user
This is sample output - yours may be different.
0

ps -u jboss -o nlwp= | awk '{ num_threads += $1 } END { print num_threads }'

leonbartlett · 2016-05-23 08:41:47 733
delete some 4 months old docker images, not using force
This is sample output - yours may be different.
0

docker images |grep '4 months' | awk '{print$3}' | xargs docker rmi

breign · 2016-05-25 12:50:30 10
Diff two directories by finding and comparing the md5 checksums of their contents.

As output, checksums and filenames will be printed.
This is sample output - yours may be different.
0

diff <(sort <(md5deep -r /directory/1/) | awk -F '/' '{print $1 $NF}') <(sort <(md5deep -r /directory/2/) | awk -F '/' '{print $1 $NF}')

linux_noob · 2016-06-06 20:05:01 11
access.log to csv
This is sample output - yours may be different.
0

awk '{ agent=""; for(i=12; i<=NF; i++){agent=agent $i" ";} print "\""$1"\",\""$4" "$5"\","$6" "$7" "$8","$9","$10","$11","agent }' access.log

miramir · 2016-06-07 11:04:19 35
Auto-kill auto-spawned process

Given a process name (kdiff3 in this example) that keeps auto-spawning/starting, auto-kill until it stops, assuming there is an upper limit (if not, reboot). This was beneficial after I clicked the DIFF button in a git GUI on a merge commit. 2000+ files were being opened one after the other in my diff program (kdiff3). Each time I closed one (or quit Kdiff3), the next file would be auto-opened in Kdiff3.
This is sample output - yours may be different.
0

while [ ! -z $(ps -A | grep -m1 kdiff3 | awk '{print $1}') ]; do kill -9 $(ps -A | grep -m1 kdiff3 | awk '{print $1}'); sleep 1; done

supervisord · 2016-06-07 21:56:44 12
Ten most often used commands
This is sample output - yours may be different.
0

history | awk '{a[$2]++}END{for(i in a){print a[i] " " i}}' | sort -rn | head

turrtle13 · 2016-07-01 19:38:01 12
Display the top ten running processes sorted by the memory usage:
This is sample output - yours may be different.
0

ps aux | awk '{if ($5 != 0 ) print $2,$5,$6,$11}' | sort -k2rn | head -10 | column -t

turrtle13 · 2016-07-01 19:40:56 12

dnscrypt-proxy: get servers with lowest rtt

tune ping's -c and parallel's -j for your needs Show Sample Output

awk -F, '$1!~/^Name/ {print $1,$(NF-3)}' dnscrypt-resolvers.csv | awk -F"[: ]" '$2!~/^\[/ {print $1,$2}' | parallel -j 10 --colsep " " "echo -n \"{1} \"; ping -qc 60 {2} | tr -d \"\\n\" |awk -F\"[/ ]+\" '{print \$(NF-3),\$2}'" |sort -rnk 2

petzah · 2016-07-17 12:06:28 13

Block all FaceBook traffic

I don't know why you would want to echo "blocking ....", but my alternative is functionally equivalent with the extra echo.
This is sample output - yours may be different.
0

ASN=32934;whois -H -h riswhois.ripe.net -- -F -K -i $ASN|awk '/^'$ASN'/ {if ($2 ~ /::/) {a="6"} else {a=""};b="sudo ip"a"tables -A INPUT -s "$2" -j REJECT"; print " blocking "$2;system(b)}'

AndrewM · 2016-07-22 07:48:27 14
Disk usage summary

Adds up the used disk space on all hard drives that are directly connected to the machine (i.e. no network mounts etc.) Assumes there are no IDE drives present. Show Sample Output
This is sample output - yours may be different.
```
18 GiB used in total
```
0

echo $(df -BG | grep sd | awk '{print $3}' | paste -sd+ | tr -d G | bc) GiB used in total

thureduehrsen · 2016-08-09 10:08:35 38
Show Available Disk Usage | Pretty Way

Shows available disk space on sda1 animated with colors Show Sample Output
This is sample output - yours may be different.
```
337G 
```
0

clear && df -h | grep /dev/sda1 | awk {'print $4'} | lolcat -a -s 10

frozenvortex · 2016-08-10 21:42:38 12
see whats getting written into all of the open logfiles under /var/log

The result will be a bunch of 'tail' commands running in the background in your current shell.
This is sample output - yours may be different.
0

eval `lsof +D /var/log|(read;awk '{print "tail -f " $9 " &" }'|sort|uniq)`

p_b_r · 2016-08-25 20:23:38 14
Watch PHP log, without knowing it's location (gets from php.ini)

Runs "php -i", filter the error_log location, then watches it using "tail"
This is sample output - yours may be different.
0

tail -v -f $(php -i | grep "^[ \t]*error_log" | awk -F"=>" '{ print $2; }' | sed 's/^[ ]*//g')

paulera · 2016-08-31 12:13:31 25
List just the executable files (or directories) in current directory

ls -l outputs long listing of files to awk, which sorts the output to include all lines that have the executable bit set (-x.), but excludes (!) the lines that have the directory bit set (drw), then prints the results to the screen. Show Sample Output
This is sample output - yours may be different.
```
-rwxr-xr-x. 1 root root    26 Sep 21 08:41 executable1
-rwxr-xr-x. 1 root root    26 Sep 21 08:42 executable2
```
0

ls -l|awk ''/-x./' && !'/drw/' {print}'

PCnetMD · 2016-09-21 14:42:10 15
Delete all php package
This is sample output - yours may be different.
0

sudo apt-get purge `dpkg -l | grep php| awk '{print $2}' |tr "\n" " "`

bDrwx · 2016-09-23 15:33:18 25
Get the current svn branch/tag (Good for PS1/PROMPT_COMMAND cases)

Diverse trunk and branch, when last index is trunk, show trunk repository name when last index minus one is branches, show branch repository name
This is sample output - yours may be different.
0

svn info | grep ^URL | awk 'BEGIN {FS="\/"}; {if($(NF-1)=="branches") {print $NF} else if($NF=="trunk") {print $(NF-1)} else {print $NF} } '

mtaqwim · 2016-10-18 02:16:45 17
Sum file sizes of found files
This is sample output - yours may be different.
0

find . -mtime +30 -exec ls -all "{}" \; | awk '{COUNTER+=$5} END {SIZE=COUNTER/1024/1024; print "size sum of found files is: " SIZE "MB"}'

breign · 2016-10-28 08:05:57 16
open listening ports

Useful to see what ports are taken by running services. Show Sample Output
This is sample output - yours may be different.
```
22
80
443
```
0

netstat -ltn | awk -n '/tcp /{ split($4, x, ":"); print(x[2]); }' | sort -n

felix_hummel · 2016-11-01 18:48:14 16
‹ First < 43 44 45 46 47 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Convert GoogleCL gmail contacts to cone adress book

Full Command: $ google contacts list name,name,email|perl -pne 's%^((?!N\/A)(.+?)),((?!N\/A)(.+?)),([a-z0-9\._-]+\@([a-z0-9][a-z0-9-]*[a-z0-9]\.)+([a-z]+\.)?([a-z]+))%${1}:${3} %imx'|grep -oP '^((?!N\/A)(.+?)) ' | sort You'll need googlecl and python-gdata. First setup google cl via: $ google Then give your PC access $ google contacts list name,email Then do the command, save it or use this one to dump it in the cone-address.txt file in your home dir: $ google contacts list name,name,email | perl -p -n -e 's%^((?!N\/A)(.+?)),((?!N\/A)(.+?)),([a-z0-9\._-]+\@([a-z0-9][a-z0-9-]*[a-z0-9]\.)+([a-z]+\.)?([a-z]+))%${1}:${3} %imx' | grep -o -P '^((?!N\/A)(.+?)) ' | sort > ~/cone-adress.txt Then import into cone. It filters out multiple emails, and contacts with no email that have N/A. (Picasa photo persons without email for example...)

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

Convert seconds to [DD:][HH:]MM:SS

Rename files in batch

Convert CSV to JSON

Replace 'csv_file.csv' with your filename.

for loop with leading zero in bash 3

list current processes writing to hard drive

Intercept, monitor and manipulate a TCP connection.

This will handle multiple incoming connections. Also, found sed works best with -u flag (unbuffered io). Easiest way I've found to get ncat is to install nmap.

Measures download speed on eth0

Rename duplicates from MusicBrainz Picard

Renames duplicates from MusicBrainz Picard, so you get the latest copy and not a bunch of duplicates.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by