Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

all java -Xmx values in a system, add them up

process name , process id , xms( initial memory allocation pool) , xmx(maximum memory allocation pool) Show Sample Output
This is sample output - yours may be different.
```
solr 32603 -Xmx614 -Xmx614
root 42319 -Xmx60G -Xmx60G
solr 42320 -Xmx60G -Xmx60G
```
0

ps -ef | grep jav[a] | awk '{print substr($1,1),substr($2,1),substr($0,index($0,"-Xms"),7),substr($0,index($0,"-Xmx"),7)}'

illia · 2016-02-14 18:50:58 12
Remove all untagged docker images

Remove all untagged images
This is sample output - yours may be different.
0

docker rmi $(docker images | grep "^<none>" | awk "{print $3}")

vivek_saini07 · 2016-02-20 21:51:09 14
Reports file systems with disk usage exceeding 90% on the specified host
This is sample output - yours may be different.
0

function df_func { local dfts=$(ssh $1 "df -lP | tail -n +2 | sed 's/%//'"); echo $dfts | awk '$5 > 90 {exit 1}' > /dev/null; if [ $? == 1 ]; then echo -n "$1 "; echo $dfts | awk '$5 > 90 {printf "%s %d%%\n", $6, $5}'; fi }

wytten12 · 2016-03-30 19:57:39 10
Display the standard deviation of a column of numbers with awk

I was concerned that the other scripts didn't use the correct order of operations for the calculation. Variance needs to be squared before being summed, then divided by NR and then square rooted. Not sure if this method is correct but this is what I came up with. I think it works correctly but I'm not totally sure. If anyone could critique it that would be great.
This is sample output - yours may be different.
0

awk '{delta=$1; avg+=$1/NR;} END {print "stdev = " sqrt(((delta-avg)^2)/NR);}'

123nor · 2016-04-19 08:49:49 12
Finding commands to create alias for

by determining most popular use in history using percentage . Show Sample Output
This is sample output - yours may be different.
```
     1  187  25.7931%   sudo
     2  63   8.68966%   ls
     3  43   5.93103%   ping
     4  31   4.27586%   soccer
     5  26   3.58621%   cd
     6  21   2.89655%   zypper
     7  19   2.62069%   nmcli
     8  17   2.34483%   python
     9  17   2.34483%   find
    10  17   2.34483%   cat
```
0

history | awk '{CMD[$2]++;count++;}END { for (a in CMD)print CMD[a] " " CMD[a]/count*100 "% " a;}' | grep -v "./" | column -c3 -s " " -t | sort -nr | nl | head -n10

turrtle13 · 2016-04-24 17:21:35 9
sorta apache logs by ip frequency
This is sample output - yours may be different.
0

cat access.log | awk '{print $1}' | sort -n | uniq -c | sort -nr | head -20

prees · 2016-05-05 20:52:03 13
list java heap summary
This is sample output - yours may be different.
0

ps -ef | grep -oh 'Xmx[0-9]*' | cut -d'x' -f2 | awk '{SUM += $1} END { print SUM}'

Raboo · 2016-05-13 11:12:08 12
Thread count per user
This is sample output - yours may be different.
0

ps -u jboss -o nlwp= | awk '{ num_threads += $1 } END { print num_threads }'

leonbartlett · 2016-05-23 08:41:47 733
delete some 4 months old docker images, not using force
This is sample output - yours may be different.
0

docker images |grep '4 months' | awk '{print$3}' | xargs docker rmi

breign · 2016-05-25 12:50:30 10
Diff two directories by finding and comparing the md5 checksums of their contents.

As output, checksums and filenames will be printed.
This is sample output - yours may be different.
0

diff <(sort <(md5deep -r /directory/1/) | awk -F '/' '{print $1 $NF}') <(sort <(md5deep -r /directory/2/) | awk -F '/' '{print $1 $NF}')

linux_noob · 2016-06-06 20:05:01 11
access.log to csv
This is sample output - yours may be different.
0

awk '{ agent=""; for(i=12; i<=NF; i++){agent=agent $i" ";} print "\""$1"\",\""$4" "$5"\","$6" "$7" "$8","$9","$10","$11","agent }' access.log

miramir · 2016-06-07 11:04:19 35
Auto-kill auto-spawned process

Given a process name (kdiff3 in this example) that keeps auto-spawning/starting, auto-kill until it stops, assuming there is an upper limit (if not, reboot). This was beneficial after I clicked the DIFF button in a git GUI on a merge commit. 2000+ files were being opened one after the other in my diff program (kdiff3). Each time I closed one (or quit Kdiff3), the next file would be auto-opened in Kdiff3.
This is sample output - yours may be different.
0

while [ ! -z $(ps -A | grep -m1 kdiff3 | awk '{print $1}') ]; do kill -9 $(ps -A | grep -m1 kdiff3 | awk '{print $1}'); sleep 1; done

supervisord · 2016-06-07 21:56:44 12
Ten most often used commands
This is sample output - yours may be different.
0

history | awk '{a[$2]++}END{for(i in a){print a[i] " " i}}' | sort -rn | head

turrtle13 · 2016-07-01 19:38:01 12
Display the top ten running processes sorted by the memory usage:
This is sample output - yours may be different.
0

ps aux | awk '{if ($5 != 0 ) print $2,$5,$6,$11}' | sort -k2rn | head -10 | column -t

turrtle13 · 2016-07-01 19:40:56 12

dnscrypt-proxy: get servers with lowest rtt

tune ping's -c and parallel's -j for your needs Show Sample Output

awk -F, '$1!~/^Name/ {print $1,$(NF-3)}' dnscrypt-resolvers.csv | awk -F"[: ]" '$2!~/^\[/ {print $1,$2}' | parallel -j 10 --colsep " " "echo -n \"{1} \"; ping -qc 60 {2} | tr -d \"\\n\" |awk -F\"[/ ]+\" '{print \$(NF-3),\$2}'" |sort -rnk 2

petzah · 2016-07-17 12:06:28 13

Block all FaceBook traffic

I don't know why you would want to echo "blocking ....", but my alternative is functionally equivalent with the extra echo.
This is sample output - yours may be different.
0

ASN=32934;whois -H -h riswhois.ripe.net -- -F -K -i $ASN|awk '/^'$ASN'/ {if ($2 ~ /::/) {a="6"} else {a=""};b="sudo ip"a"tables -A INPUT -s "$2" -j REJECT"; print " blocking "$2;system(b)}'

AndrewM · 2016-07-22 07:48:27 14
Disk usage summary

Adds up the used disk space on all hard drives that are directly connected to the machine (i.e. no network mounts etc.) Assumes there are no IDE drives present. Show Sample Output
This is sample output - yours may be different.
```
18 GiB used in total
```
0

echo $(df -BG | grep sd | awk '{print $3}' | paste -sd+ | tr -d G | bc) GiB used in total

thureduehrsen · 2016-08-09 10:08:35 38
Show Available Disk Usage | Pretty Way

Shows available disk space on sda1 animated with colors Show Sample Output
This is sample output - yours may be different.
```
337G 
```
0

clear && df -h | grep /dev/sda1 | awk {'print $4'} | lolcat -a -s 10

frozenvortex · 2016-08-10 21:42:38 12
see whats getting written into all of the open logfiles under /var/log

The result will be a bunch of 'tail' commands running in the background in your current shell.
This is sample output - yours may be different.
0

eval `lsof +D /var/log|(read;awk '{print "tail -f " $9 " &" }'|sort|uniq)`

p_b_r · 2016-08-25 20:23:38 14
Watch PHP log, without knowing it's location (gets from php.ini)

Runs "php -i", filter the error_log location, then watches it using "tail"
This is sample output - yours may be different.
0

tail -v -f $(php -i | grep "^[ \t]*error_log" | awk -F"=>" '{ print $2; }' | sed 's/^[ ]*//g')

paulera · 2016-08-31 12:13:31 25
List just the executable files (or directories) in current directory

ls -l outputs long listing of files to awk, which sorts the output to include all lines that have the executable bit set (-x.), but excludes (!) the lines that have the directory bit set (drw), then prints the results to the screen. Show Sample Output
This is sample output - yours may be different.
```
-rwxr-xr-x. 1 root root    26 Sep 21 08:41 executable1
-rwxr-xr-x. 1 root root    26 Sep 21 08:42 executable2
```
0

ls -l|awk ''/-x./' && !'/drw/' {print}'

PCnetMD · 2016-09-21 14:42:10 15
Delete all php package
This is sample output - yours may be different.
0

sudo apt-get purge `dpkg -l | grep php| awk '{print $2}' |tr "\n" " "`

bDrwx · 2016-09-23 15:33:18 25
Get the current svn branch/tag (Good for PS1/PROMPT_COMMAND cases)

Diverse trunk and branch, when last index is trunk, show trunk repository name when last index minus one is branches, show branch repository name
This is sample output - yours may be different.
0

svn info | grep ^URL | awk 'BEGIN {FS="\/"}; {if($(NF-1)=="branches") {print $NF} else if($NF=="trunk") {print $(NF-1)} else {print $NF} } '

mtaqwim · 2016-10-18 02:16:45 17
Sum file sizes of found files
This is sample output - yours may be different.
0

find . -mtime +30 -exec ls -all "{}" \; | awk '{COUNTER+=$5} END {SIZE=COUNTER/1024/1024; print "size sum of found files is: " SIZE "MB"}'

breign · 2016-10-28 08:05:57 16
open listening ports

Useful to see what ports are taken by running services. Show Sample Output
This is sample output - yours may be different.
```
22
80
443
```
0

netstat -ltn | awk -n '/tcp /{ split($4, x, ":"); print(x[2]); }' | sort -n

felix_hummel · 2016-11-01 18:48:14 16
‹ First < 43 44 45 46 47 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Recursively scan directories for mp3s and pass them to mplayer

The command first deletes any old playlist calles playlist.tmp under /tmp. After that it recursively searches all direcotries under ~/mp3 and stores the result in /tmp/playlist.tmp. After havin created the playlist, the command will execute mplayer which will shuffle through the playlist. This command is aliased to m is aliased to `rm -rf /tmp/playlist.tmp && find ~/mp3 -name *.mp3 > /tmp/playlist.tmp && mplayer -playlist /tmp/playlist.tmp -shuffle -loop 0 | grep Playing' in my ~/.bashrc.

Ruby - nslookup against a list of IP`s or FQDN`s

This version uses host and no ruby.

Gets the english pronunciation of a phrase

Usage examples: say hello say "hello world" say hello+world

Detect illegal access to kernel space, potentially useful for Meltdown detection

Based on capsule8 agent examples, not rigorously tested

check open ports without netstat or lsof

List all files in current dir and subdirs sorted by size

or $ tree -ifsF --noreport .|sort -n -k2|grep -v '/$' (rows presenting directory names become hidden)

Get current Xorg resolution via xrandr

Check apache config syntax and restart or edit the file

Checks the apache configuration syntax, if is OK then restart the service otherwise opens the configuration file with VIM on the line where the configuration fails.

Analyze awk fields

Breaks down and numbers each line and it's fields. This is really useful when you are going to parse something with awk but aren't sure exactly where to start.

Batch convert PNG to JPEG

Convert all PNG images in directory to JPEG using ImageMagick, and delete the old PNG images.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by