Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

all java -Xmx values in a system, add them up

process name , process id , xms( initial memory allocation pool) , xmx(maximum memory allocation pool) Show Sample Output
This is sample output - yours may be different.
```
solr 32603 -Xmx614 -Xmx614
root 42319 -Xmx60G -Xmx60G
solr 42320 -Xmx60G -Xmx60G
```
0

ps -ef | grep jav[a] | awk '{print substr($1,1),substr($2,1),substr($0,index($0,"-Xms"),7),substr($0,index($0,"-Xmx"),7)}'

illia · 2016-02-14 18:50:58 12
Remove all untagged docker images

Remove all untagged images
This is sample output - yours may be different.
0

docker rmi $(docker images | grep "^<none>" | awk "{print $3}")

vivek_saini07 · 2016-02-20 21:51:09 14
Reports file systems with disk usage exceeding 90% on the specified host
This is sample output - yours may be different.
0

function df_func { local dfts=$(ssh $1 "df -lP | tail -n +2 | sed 's/%//'"); echo $dfts | awk '$5 > 90 {exit 1}' > /dev/null; if [ $? == 1 ]; then echo -n "$1 "; echo $dfts | awk '$5 > 90 {printf "%s %d%%\n", $6, $5}'; fi }

wytten12 · 2016-03-30 19:57:39 10
Display the standard deviation of a column of numbers with awk

I was concerned that the other scripts didn't use the correct order of operations for the calculation. Variance needs to be squared before being summed, then divided by NR and then square rooted. Not sure if this method is correct but this is what I came up with. I think it works correctly but I'm not totally sure. If anyone could critique it that would be great.
This is sample output - yours may be different.
0

awk '{delta=$1; avg+=$1/NR;} END {print "stdev = " sqrt(((delta-avg)^2)/NR);}'

123nor · 2016-04-19 08:49:49 12
Finding commands to create alias for

by determining most popular use in history using percentage . Show Sample Output
This is sample output - yours may be different.
```
     1  187  25.7931%   sudo
     2  63   8.68966%   ls
     3  43   5.93103%   ping
     4  31   4.27586%   soccer
     5  26   3.58621%   cd
     6  21   2.89655%   zypper
     7  19   2.62069%   nmcli
     8  17   2.34483%   python
     9  17   2.34483%   find
    10  17   2.34483%   cat
```
0

history | awk '{CMD[$2]++;count++;}END { for (a in CMD)print CMD[a] " " CMD[a]/count*100 "% " a;}' | grep -v "./" | column -c3 -s " " -t | sort -nr | nl | head -n10

turrtle13 · 2016-04-24 17:21:35 9
sorta apache logs by ip frequency
This is sample output - yours may be different.
0

cat access.log | awk '{print $1}' | sort -n | uniq -c | sort -nr | head -20

prees · 2016-05-05 20:52:03 13
list java heap summary
This is sample output - yours may be different.
0

ps -ef | grep -oh 'Xmx[0-9]*' | cut -d'x' -f2 | awk '{SUM += $1} END { print SUM}'

Raboo · 2016-05-13 11:12:08 12
Thread count per user
This is sample output - yours may be different.
0

ps -u jboss -o nlwp= | awk '{ num_threads += $1 } END { print num_threads }'

leonbartlett · 2016-05-23 08:41:47 736
delete some 4 months old docker images, not using force
This is sample output - yours may be different.
0

docker images |grep '4 months' | awk '{print$3}' | xargs docker rmi

breign · 2016-05-25 12:50:30 10
Diff two directories by finding and comparing the md5 checksums of their contents.

As output, checksums and filenames will be printed.
This is sample output - yours may be different.
0

diff <(sort <(md5deep -r /directory/1/) | awk -F '/' '{print $1 $NF}') <(sort <(md5deep -r /directory/2/) | awk -F '/' '{print $1 $NF}')

linux_noob · 2016-06-06 20:05:01 11
access.log to csv
This is sample output - yours may be different.
0

awk '{ agent=""; for(i=12; i<=NF; i++){agent=agent $i" ";} print "\""$1"\",\""$4" "$5"\","$6" "$7" "$8","$9","$10","$11","agent }' access.log

miramir · 2016-06-07 11:04:19 35
Auto-kill auto-spawned process

Given a process name (kdiff3 in this example) that keeps auto-spawning/starting, auto-kill until it stops, assuming there is an upper limit (if not, reboot). This was beneficial after I clicked the DIFF button in a git GUI on a merge commit. 2000+ files were being opened one after the other in my diff program (kdiff3). Each time I closed one (or quit Kdiff3), the next file would be auto-opened in Kdiff3.
This is sample output - yours may be different.
0

while [ ! -z $(ps -A | grep -m1 kdiff3 | awk '{print $1}') ]; do kill -9 $(ps -A | grep -m1 kdiff3 | awk '{print $1}'); sleep 1; done

supervisord · 2016-06-07 21:56:44 12
Ten most often used commands
This is sample output - yours may be different.
0

history | awk '{a[$2]++}END{for(i in a){print a[i] " " i}}' | sort -rn | head

turrtle13 · 2016-07-01 19:38:01 12
Display the top ten running processes sorted by the memory usage:
This is sample output - yours may be different.
0

ps aux | awk '{if ($5 != 0 ) print $2,$5,$6,$11}' | sort -k2rn | head -10 | column -t

turrtle13 · 2016-07-01 19:40:56 12

dnscrypt-proxy: get servers with lowest rtt

tune ping's -c and parallel's -j for your needs Show Sample Output

awk -F, '$1!~/^Name/ {print $1,$(NF-3)}' dnscrypt-resolvers.csv | awk -F"[: ]" '$2!~/^\[/ {print $1,$2}' | parallel -j 10 --colsep " " "echo -n \"{1} \"; ping -qc 60 {2} | tr -d \"\\n\" |awk -F\"[/ ]+\" '{print \$(NF-3),\$2}'" |sort -rnk 2

petzah · 2016-07-17 12:06:28 13

Block all FaceBook traffic

I don't know why you would want to echo "blocking ....", but my alternative is functionally equivalent with the extra echo.
This is sample output - yours may be different.
0

ASN=32934;whois -H -h riswhois.ripe.net -- -F -K -i $ASN|awk '/^'$ASN'/ {if ($2 ~ /::/) {a="6"} else {a=""};b="sudo ip"a"tables -A INPUT -s "$2" -j REJECT"; print " blocking "$2;system(b)}'

AndrewM · 2016-07-22 07:48:27 14
Disk usage summary

Adds up the used disk space on all hard drives that are directly connected to the machine (i.e. no network mounts etc.) Assumes there are no IDE drives present. Show Sample Output
This is sample output - yours may be different.
```
18 GiB used in total
```
0

echo $(df -BG | grep sd | awk '{print $3}' | paste -sd+ | tr -d G | bc) GiB used in total

thureduehrsen · 2016-08-09 10:08:35 38
Show Available Disk Usage | Pretty Way

Shows available disk space on sda1 animated with colors Show Sample Output
This is sample output - yours may be different.
```
337G 
```
0

clear && df -h | grep /dev/sda1 | awk {'print $4'} | lolcat -a -s 10

frozenvortex · 2016-08-10 21:42:38 12
see whats getting written into all of the open logfiles under /var/log

The result will be a bunch of 'tail' commands running in the background in your current shell.
This is sample output - yours may be different.
0

eval `lsof +D /var/log|(read;awk '{print "tail -f " $9 " &" }'|sort|uniq)`

p_b_r · 2016-08-25 20:23:38 14
Watch PHP log, without knowing it's location (gets from php.ini)

Runs "php -i", filter the error_log location, then watches it using "tail"
This is sample output - yours may be different.
0

tail -v -f $(php -i | grep "^[ \t]*error_log" | awk -F"=>" '{ print $2; }' | sed 's/^[ ]*//g')

paulera · 2016-08-31 12:13:31 25
List just the executable files (or directories) in current directory

ls -l outputs long listing of files to awk, which sorts the output to include all lines that have the executable bit set (-x.), but excludes (!) the lines that have the directory bit set (drw), then prints the results to the screen. Show Sample Output
This is sample output - yours may be different.
```
-rwxr-xr-x. 1 root root    26 Sep 21 08:41 executable1
-rwxr-xr-x. 1 root root    26 Sep 21 08:42 executable2
```
0

ls -l|awk ''/-x./' && !'/drw/' {print}'

PCnetMD · 2016-09-21 14:42:10 15
Delete all php package
This is sample output - yours may be different.
0

sudo apt-get purge `dpkg -l | grep php| awk '{print $2}' |tr "\n" " "`

bDrwx · 2016-09-23 15:33:18 25
Get the current svn branch/tag (Good for PS1/PROMPT_COMMAND cases)

Diverse trunk and branch, when last index is trunk, show trunk repository name when last index minus one is branches, show branch repository name
This is sample output - yours may be different.
0

svn info | grep ^URL | awk 'BEGIN {FS="\/"}; {if($(NF-1)=="branches") {print $NF} else if($NF=="trunk") {print $(NF-1)} else {print $NF} } '

mtaqwim · 2016-10-18 02:16:45 17
Sum file sizes of found files
This is sample output - yours may be different.
0

find . -mtime +30 -exec ls -all "{}" \; | awk '{COUNTER+=$5} END {SIZE=COUNTER/1024/1024; print "size sum of found files is: " SIZE "MB"}'

breign · 2016-10-28 08:05:57 16
open listening ports

Useful to see what ports are taken by running services. Show Sample Output
This is sample output - yours may be different.
```
22
80
443
```
0

netstat -ltn | awk -n '/tcp /{ split($4, x, ":"); print(x[2]); }' | sort -n

felix_hummel · 2016-11-01 18:48:14 16
‹ First < 43 44 45 46 47 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Testing reading speed with dd

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

Have subversion ignore a file pattern in a directory

If you don't want to commit files to subversion, and don't want those file to show up when doing an "svn stat", this command is what you need

Play 89.3 @TheCurrent and get system notifications on song changes.

Plays the mp3 stream of The Current as a background job. When you are done run: $ fg %1 then to exit Quite possible with Growl for mac I'd guess, although have not tried. Libnotify needed for notification, stream will still work otherwise

Do one ping to a URL, I use this in a MRTG gauge graph to monitor connectivity

Decrypt passwords from Google Chrome and Chromium.

Read this before you down voting and comment that it is not working -> Wont work on latest versions ~75> since database file is locked and has to be decrypted. This is useful if you have an old hdd with a chrome installation and want to decrypt your old passwords fast.

Play radio stream with mplayer

Above command will play Virgin Radio Dubai

File rotation without rename command

Rotates log files with "gz"-extension in a directory for 7 days and enumerates the number in file name. i.e.: logfile.1.gz > logfile.2.gz I needed this line due to the limitations on AIX Unix systems which do not ship with the rename command.

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Extract tar content without leading parent directory

If archive has leading directory level same as archive name and you want to strip it, this command is for you.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by