Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

all java -Xmx values in a system, add them up

process name , process id , xms( initial memory allocation pool) , xmx(maximum memory allocation pool) Show Sample Output
This is sample output - yours may be different.
```
solr 32603 -Xmx614 -Xmx614
root 42319 -Xmx60G -Xmx60G
solr 42320 -Xmx60G -Xmx60G
```
0

ps -ef | grep jav[a] | awk '{print substr($1,1),substr($2,1),substr($0,index($0,"-Xms"),7),substr($0,index($0,"-Xmx"),7)}'

illia · 2016-02-14 18:50:58 12
Remove all untagged docker images

Remove all untagged images
This is sample output - yours may be different.
0

docker rmi $(docker images | grep "^<none>" | awk "{print $3}")

vivek_saini07 · 2016-02-20 21:51:09 14
Reports file systems with disk usage exceeding 90% on the specified host
This is sample output - yours may be different.
0

function df_func { local dfts=$(ssh $1 "df -lP | tail -n +2 | sed 's/%//'"); echo $dfts | awk '$5 > 90 {exit 1}' > /dev/null; if [ $? == 1 ]; then echo -n "$1 "; echo $dfts | awk '$5 > 90 {printf "%s %d%%\n", $6, $5}'; fi }

wytten12 · 2016-03-30 19:57:39 10
Display the standard deviation of a column of numbers with awk

I was concerned that the other scripts didn't use the correct order of operations for the calculation. Variance needs to be squared before being summed, then divided by NR and then square rooted. Not sure if this method is correct but this is what I came up with. I think it works correctly but I'm not totally sure. If anyone could critique it that would be great.
This is sample output - yours may be different.
0

awk '{delta=$1; avg+=$1/NR;} END {print "stdev = " sqrt(((delta-avg)^2)/NR);}'

123nor · 2016-04-19 08:49:49 12
Finding commands to create alias for

by determining most popular use in history using percentage . Show Sample Output
This is sample output - yours may be different.
```
     1  187  25.7931%   sudo
     2  63   8.68966%   ls
     3  43   5.93103%   ping
     4  31   4.27586%   soccer
     5  26   3.58621%   cd
     6  21   2.89655%   zypper
     7  19   2.62069%   nmcli
     8  17   2.34483%   python
     9  17   2.34483%   find
    10  17   2.34483%   cat
```
0

history | awk '{CMD[$2]++;count++;}END { for (a in CMD)print CMD[a] " " CMD[a]/count*100 "% " a;}' | grep -v "./" | column -c3 -s " " -t | sort -nr | nl | head -n10

turrtle13 · 2016-04-24 17:21:35 9
sorta apache logs by ip frequency
This is sample output - yours may be different.
0

cat access.log | awk '{print $1}' | sort -n | uniq -c | sort -nr | head -20

prees · 2016-05-05 20:52:03 13
list java heap summary
This is sample output - yours may be different.
0

ps -ef | grep -oh 'Xmx[0-9]*' | cut -d'x' -f2 | awk '{SUM += $1} END { print SUM}'

Raboo · 2016-05-13 11:12:08 12
Thread count per user
This is sample output - yours may be different.
0

ps -u jboss -o nlwp= | awk '{ num_threads += $1 } END { print num_threads }'

leonbartlett · 2016-05-23 08:41:47 733
delete some 4 months old docker images, not using force
This is sample output - yours may be different.
0

docker images |grep '4 months' | awk '{print$3}' | xargs docker rmi

breign · 2016-05-25 12:50:30 10
Diff two directories by finding and comparing the md5 checksums of their contents.

As output, checksums and filenames will be printed.
This is sample output - yours may be different.
0

diff <(sort <(md5deep -r /directory/1/) | awk -F '/' '{print $1 $NF}') <(sort <(md5deep -r /directory/2/) | awk -F '/' '{print $1 $NF}')

linux_noob · 2016-06-06 20:05:01 11
access.log to csv
This is sample output - yours may be different.
0

awk '{ agent=""; for(i=12; i<=NF; i++){agent=agent $i" ";} print "\""$1"\",\""$4" "$5"\","$6" "$7" "$8","$9","$10","$11","agent }' access.log

miramir · 2016-06-07 11:04:19 35
Auto-kill auto-spawned process

Given a process name (kdiff3 in this example) that keeps auto-spawning/starting, auto-kill until it stops, assuming there is an upper limit (if not, reboot). This was beneficial after I clicked the DIFF button in a git GUI on a merge commit. 2000+ files were being opened one after the other in my diff program (kdiff3). Each time I closed one (or quit Kdiff3), the next file would be auto-opened in Kdiff3.
This is sample output - yours may be different.
0

while [ ! -z $(ps -A | grep -m1 kdiff3 | awk '{print $1}') ]; do kill -9 $(ps -A | grep -m1 kdiff3 | awk '{print $1}'); sleep 1; done

supervisord · 2016-06-07 21:56:44 12
Ten most often used commands
This is sample output - yours may be different.
0

history | awk '{a[$2]++}END{for(i in a){print a[i] " " i}}' | sort -rn | head

turrtle13 · 2016-07-01 19:38:01 12
Display the top ten running processes sorted by the memory usage:
This is sample output - yours may be different.
0

ps aux | awk '{if ($5 != 0 ) print $2,$5,$6,$11}' | sort -k2rn | head -10 | column -t

turrtle13 · 2016-07-01 19:40:56 12

dnscrypt-proxy: get servers with lowest rtt

tune ping's -c and parallel's -j for your needs Show Sample Output

awk -F, '$1!~/^Name/ {print $1,$(NF-3)}' dnscrypt-resolvers.csv | awk -F"[: ]" '$2!~/^\[/ {print $1,$2}' | parallel -j 10 --colsep " " "echo -n \"{1} \"; ping -qc 60 {2} | tr -d \"\\n\" |awk -F\"[/ ]+\" '{print \$(NF-3),\$2}'" |sort -rnk 2

petzah · 2016-07-17 12:06:28 13

Block all FaceBook traffic

I don't know why you would want to echo "blocking ....", but my alternative is functionally equivalent with the extra echo.
This is sample output - yours may be different.
0

ASN=32934;whois -H -h riswhois.ripe.net -- -F -K -i $ASN|awk '/^'$ASN'/ {if ($2 ~ /::/) {a="6"} else {a=""};b="sudo ip"a"tables -A INPUT -s "$2" -j REJECT"; print " blocking "$2;system(b)}'

AndrewM · 2016-07-22 07:48:27 14
Disk usage summary

Adds up the used disk space on all hard drives that are directly connected to the machine (i.e. no network mounts etc.) Assumes there are no IDE drives present. Show Sample Output
This is sample output - yours may be different.
```
18 GiB used in total
```
0

echo $(df -BG | grep sd | awk '{print $3}' | paste -sd+ | tr -d G | bc) GiB used in total

thureduehrsen · 2016-08-09 10:08:35 38
Show Available Disk Usage | Pretty Way

Shows available disk space on sda1 animated with colors Show Sample Output
This is sample output - yours may be different.
```
337G 
```
0

clear && df -h | grep /dev/sda1 | awk {'print $4'} | lolcat -a -s 10

frozenvortex · 2016-08-10 21:42:38 12
see whats getting written into all of the open logfiles under /var/log

The result will be a bunch of 'tail' commands running in the background in your current shell.
This is sample output - yours may be different.
0

eval `lsof +D /var/log|(read;awk '{print "tail -f " $9 " &" }'|sort|uniq)`

p_b_r · 2016-08-25 20:23:38 14
Watch PHP log, without knowing it's location (gets from php.ini)

Runs "php -i", filter the error_log location, then watches it using "tail"
This is sample output - yours may be different.
0

tail -v -f $(php -i | grep "^[ \t]*error_log" | awk -F"=>" '{ print $2; }' | sed 's/^[ ]*//g')

paulera · 2016-08-31 12:13:31 25
List just the executable files (or directories) in current directory

ls -l outputs long listing of files to awk, which sorts the output to include all lines that have the executable bit set (-x.), but excludes (!) the lines that have the directory bit set (drw), then prints the results to the screen. Show Sample Output
This is sample output - yours may be different.
```
-rwxr-xr-x. 1 root root    26 Sep 21 08:41 executable1
-rwxr-xr-x. 1 root root    26 Sep 21 08:42 executable2
```
0

ls -l|awk ''/-x./' && !'/drw/' {print}'

PCnetMD · 2016-09-21 14:42:10 15
Delete all php package
This is sample output - yours may be different.
0

sudo apt-get purge `dpkg -l | grep php| awk '{print $2}' |tr "\n" " "`

bDrwx · 2016-09-23 15:33:18 25
Get the current svn branch/tag (Good for PS1/PROMPT_COMMAND cases)

Diverse trunk and branch, when last index is trunk, show trunk repository name when last index minus one is branches, show branch repository name
This is sample output - yours may be different.
0

svn info | grep ^URL | awk 'BEGIN {FS="\/"}; {if($(NF-1)=="branches") {print $NF} else if($NF=="trunk") {print $(NF-1)} else {print $NF} } '

mtaqwim · 2016-10-18 02:16:45 17
Sum file sizes of found files
This is sample output - yours may be different.
0

find . -mtime +30 -exec ls -all "{}" \; | awk '{COUNTER+=$5} END {SIZE=COUNTER/1024/1024; print "size sum of found files is: " SIZE "MB"}'

breign · 2016-10-28 08:05:57 16
open listening ports

Useful to see what ports are taken by running services. Show Sample Output
This is sample output - yours may be different.
```
22
80
443
```
0

netstat -ltn | awk -n '/tcp /{ split($4, x, ":"); print(x[2]); }' | sort -n

felix_hummel · 2016-11-01 18:48:14 16
‹ First < 43 44 45 46 47 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Find the processes that are on the runqueue. Processes with a status of

Want to know why your load average is so high? Run this command to see what processes are on the run queue. Runnable processes have a status of "R", and commands waiting on I/O have a status of "D". On some older versions of Linux may require -emo instead of -eo. On Solaris: ps -aefL -o s -o user -o comm | egrep "^O|^R|COMMAND"

list files recursively by size

Show battery infomations for OS X 10.5.x

Copy all files, including hidden files, recursively without traversing backward

You could do the following, however, brace expansion with {} is not defined in POSIX, and therefore not guaranteed to work in all shells. But, if it does, it's more convenient (although it's certainly not less typing): $ cp -r {*,.??*} /dest Sometimes there are times when I need to cp(1), mv(1) or rm(1) files recursively, but don't want to traverse the previous directory by following ../../../../ etc out of the current directory. This command prevents that. The secret sauce is ".??*". The file globbing ensures that it must start with a dot, and be followed by at least two characters. So, three characters must exist in the filename, which eliminates "." and "..".

Add .gitignore files to all empty directories recursively from your current directory

Convert a date to timestamp

Simple way to get a timestamp from a date

PulseAudio: set the volume via command line

If you have more than one SINK

List all directories only.

Undocumented syntax, but should work on every shell. It'll list all directories in the current one. Change `*/` into globbing `**/` for recursivity.

Socksify any program to avoid restrictive firwalls

Require: - tsocks (deb pkg) - A working SOCKS proxy. It's easy with ssh: $ ssh -N -D localhost:1080 your.home.pc -p 443 - tsocks configuration in your /etc/tsocks.conf (for the previous): server = 127.0.0.1 server_port = 1080

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by