Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Calculating number of Connection to MySQL
This is sample output - yours may be different.
0

mysql -u root -p -N -e"show processlist\G;" | egrep "Host\:" | awk -F: '{ print $2 }' | sort | uniq -c

zuck · 2011-12-22 09:04:07 4
kill all running instances of wine and programs runned by it (exe)

The other 2 commands that are listed will also kill the egrep process and any libexec processes because the .exe isn't escaped so it is really using . meaning anything containing exe. The command i posted escapes the (dot) in .exe and then filters the actual egrep process so that it doesn't get killed before the other processes being killed. Also added the -9 switch for kill to send sigterm to the processes, in case people are wondering why processes aren't getting killed after running just kill . This should work better for people :)
This is sample output - yours may be different.
0

wineserver -k; killall -9 wine wineserver; for i in `ps ax|egrep "*\.exe"|grep -v 'egrep'|awk '{print $1 }'`;do kill -9 $i;done

godmachine81 · 2011-12-30 01:38:15 4
list all users with UID bigger than 999 in /etc/passwd

To distinguish normal users from system users. Specify an UID, to list all all users with UID bigger than that in /etc/passwd.
This is sample output - yours may be different.
0

awk -F: '$3 > 999 { print $1 }' /etc/passwd

rockenrola · 2011-12-30 14:47:10 3
Set ondemand governor for all cpu cores.

Save as a bash script and run as root to set the ondemand cpu frequency governor for all cpu cores. Name the file ondemand. Change 'ondemand' in the argument to performance or your preferred governor to do the same thing but set all cpu cores to use the performance governor (or your preferred governor)
This is sample output - yours may be different.
0

for i in `cat /proc/cpuinfo |grep processor|awk '{print $3}'`;do cpufreq-set -g ondemand $i;done

godmachine81 · 2011-12-31 01:44:18 3
Mount a partitoned disk-image file

Mounts a disk-image of a hdd with partitions
This is sample output - yours may be different.
0

IMG="image.img";PART=1;mount -o loop,ro,offset=$(parted $IMG -s unit b print|awk '$1=='$PART' {sub(/B/,"",$2);print $2}') $IMG /mnt/whatever

AndroTux · 2011-12-31 14:58:18 3
A list of IPs (only) that are online in a specific subnet.

Often you want to nmap a list of IPs using the -iL flag. This is an easy way to generate a list of IPs that are online in a specific subnet or IP range (192.168.1.100-110). Show Sample Output
This is sample output - yours may be different.
```
192.168.1.1
192.168.1.43
192.168.1.67
192.168.1.100
192.168.1.101
192.168.1.104
```
0

nmap -sP 192.168.1.0/24 | awk "/^Host/"'{ print $3 }' |nawk -F'[()]' '{print $2}'

cantormath · 2011-12-31 15:50:22 3
Show WebSphere AppServer uid|pid|cell|node|jvms

Tested in bash on AIX & Linux, used for WAS versions 6.0 & up. Sorts by node name. Useful when you have vertically-stacked instances of WAS/Portal. Cuts out all the classpath/optional parameter clutter that makes a simple "ps -ef | grep java" so difficult to sort through. Show Sample Output
This is sample output - yours may be different.
```
wasguy      14221350   ExampleCell1    Node1       WebSphere_Portal
wasguy      11141130   ExampleCell1    Node1       WebSphere_Portal_3
wasguy      11665646   ExampleCell1    Node1       nodeagent
wasguy      1769816    ExampleCell2    Node2       WebSphere_Portal
wasguy      10289222   ExampleCell2    Node2       WebSphere_Portal_3
wasguy      11665646   ExampleCell2    Node2       nodeagent
```
0

ps -ef | grep [j]ava | awk -F ' ' ' { print $1," ",$2,"\t",$(NF-2),"\t",$(NF-1),"\t",$NF } ' | sort -k4

drockney · 2012-01-05 16:05:48 3
diff two css files to create an overriding css (e.g. for wordpress child themes)

This will extract the differing CSS entries of two files. I've left the initial character (plus or space) in output to show the real differing line, remove the initial character to get a working CSS file. The output CSS file is usable by either adding it in a below the to original.css, or by only using the output but adding @import url("original.css"); in the beginning. This is very useful for converting Wordpress theme copies into real Wordpress child themes. Could exclude common lines within entries too, I guess, but that might not be worth the complexity. Show Sample Output
This is sample output - yours may be different.
```
+++ style.css	2012-01-12 08:33:13.486877866 +0100
@@ -1,1324 +1,1427 @@
 /* =Layout
 -------------------------------------------------------------- */
 
 /*
 LAYOUT: Two columns
 DESCRIPTION: Two-column fixed layout with one sidebar right of content
 */
 
 #container {
 	float: left;
+	margin: 0 -240px 0 38px;
 	width: 100%;
 }

 #content {
+	margin: 0 250px 0 0px;
 }
```
0

diff -U99999 original.css modified.css | awk '/^-/{next} {f=f"\n"$0} /^\+.*[^ ]/{yes=1} /}/ {if(yes){print f} f="";yes=0}'

unhammer · 2012-01-12 07:57:22 4
Find duplicate UID in /etc/passwd

Detect duplicate UID in you /etc/passwd (or GID in /etc/group file). Duplicate UID is often forbidden for it can be a security breach. Show Sample Output
This is sample output - yours may be different.
```
user@host:/etc# awk -F: '{print $3}' /etc/passwd | sort |uniq -d
203
user@host:/etc# 
```
0

awk -F: '{print $3}' /etc/passwd | sort |uniq -d

ultips · 2012-01-17 11:16:35 3
Show CPU idle and used time

This command displays the CPU idle + used time using stats from /proc/stat. Show Sample Output
This is sample output - yours may be different.
```
idle 	 used
72.4139% 21.1866%
```
0

grep "cpu " /proc/stat | awk -F ' ' '{total = $2 + $3 + $4 + $5} END {print "idle \t used\n" $5*100/total "% " $2*100/total "%"}'

Goez · 2012-01-21 04:12:50 3
Find files with size over 100MB and output with better lay-out

This command does a basic find with size. It also improves the printout given (more clearer then default) Adjusting the ./ will alter the path. Adjusting the "-size +100000k" will specify the size to search for. Show Sample Output
This is sample output - yours may be different.
```
goez@goez-laptop:~/test$ ls -sh
total 392M
102M 101MB_file  201M 200MB_file   91M 90MB_file
goez@goez-laptop:~/test$ find ./ -type f -size +100000k -exec ls -lh {} \; 2>/dev/null| awk '{ print $8 " : " $5}'
./101MB_file : 101M
./200MB_file : 200M
```
0

find ./ -type f -size +100000k -exec ls -lh {} \; 2>/dev/null| awk '{ print $8 " : " $5}'

Goez · 2012-01-21 04:19:35 5
Create a shell script from history of commands

If you are installing some new package. You can first go through the step by step install and then take the commands that you ran from history to create shell script which can used to install the package on other machines say test or production.
This is sample output - yours may be different.
0

history | awk '{$1=""; print $0}' > install_pkg.sh

cfunz · 2012-01-23 06:46:25 3
find an unused unprivileged TCP port

This is also perl-less, and only uses AWK as its postprocessor. Tested with GAWK and MAWK.
This is sample output - yours may be different.
0

netstat -tan | awk '$1 == "tcp" && $4 ~ /:/ { port=$4; sub(/^[^:]+:/, "", port); used[int(port)] = 1; } END { for (p = 32768; p <= 61000; ++p) if (! (p in used)) { print p; exit(0); }; exit(1); }'

wirawan0 · 2012-01-26 20:42:56 5
Kill processes associated with PATTERN

Kill all process that concide whit PATTERN Show Sample Output
This is sample output - yours may be different.
```
kill 28310: No such process
```
0

ps -fea | grep PATTERN | awk {'print $2'} | xargs kill -9

luiscachog · 2012-01-27 20:31:36 3
Print heap addresses and size

Show Sample Output
This is sample output - yours may be different.
```
00014000-00174000 rwxp 00000000 00:00 0    [heap]
Size:    1408 kB
Rss:     1292 kB
```
0

PID=`ps | grep process_name | grep -v grep | head -n 1 | awk '{print $1}'`; cat /proc/$PID/smaps | grep heap -A 2

yohananov · 2012-01-30 13:31:40 3
Change time format in log, UNIX Timestamp to Human readable

It remove the square bracket and convert UNIX time to human readable time for all line of a stream (or file). Show Sample Output
This is sample output - yours may be different.
```
Input :
[1325199600] CURRENT SERVICE STATE: HOST01;Loopback;OK;HARD;1;Loopback0:UP:1 UP: OK
[1325199600] CURRENT SERVICE STATE: HOST01;Uptime Routers SFR;OK;HARD;1;Information only: 114 days

Ouput :
12/30/11 00:00:00 CURRENT SERVICE STATE: HOST01;Loopback;OK;HARD;1;Loopback0:UP:1 UP: OK
12/30/11 00:00:00 CURRENT SERVICE STATE: HOST01;Uptime Routers SFR;OK;HARD;1;Information only: 114 days
```
0

sed -r 's/(\[|])//g' | awk ' { $1=strftime("%D %T",$1); print }'

Zulu · 2012-02-03 13:07:37 4
See who are using a specific port

See who is using a specific port. Especially when you're using AIX. In Ubuntu, for example, this can easily be seen with the netstat command. Show Sample Output
This is sample output - yours may be different.
```
Usually a nice list of IP addresses :-)
```
0

netstat -Aan | grep .80 | grep -v 127.0.0.1 | grep EST | awk '{print $6}' | cut -d "." -f1,2,3,4 | sort | uniq

janvanderwijk · 2012-02-03 13:54:11 4
display memory usage of a process

page where I got inspiration: http://www.commandlinefu.com/commands/view/5473/get-acurate-memory-usage-of-a-process-in-megabytes and http://www.commandlinefu.com/commands/view/10022/display-the-top-10-running-processes-sorted-by-memory-usage
This is sample output - yours may be different.
0

TOTAL_RAM=`free | head -n 2 | tail -n 1 | awk '{ print $2 }'`; PROC_RSS=`ps axo rss,comm | grep [h]ttpd | awk '{ TOTAL += $1 } END { print TOTAL }'`; PROC_PCT=`echo "scale=4; ( $PROC_RSS/$TOTAL_RAM ) * 100" | bc`; echo "RAM Used by HTTP: $PROC_PCT%"

0disse0 · 2012-02-03 16:10:36 12
List prime numbers from 2 to 100

This is actually quite slow~ P.S. change `seq 2 100` to `seq 2 1000` and try Show Sample Output
This is sample output - yours may be different.
```
2 3 5 7 11 13 17 19 23 29 31 37 41 43 47 53 59 61 67 71 73 79 83 89 97
```
0

for num in `seq 2 100`;do if [ `factor $num|awk '{print $2}'` == $num ];then echo -n "$num ";fi done;echo

alvinhochun · 2012-02-18 08:11:19 3
add all files not under version control to repository

handels @, ?, whitespaces in names. replace "?" and "add" by "!" and "rm" for svn mass remove. ---> I m looking for a nicer way to write it, perhaps with something using " perl -ne '`blahblah` if /\?(.*)/' " Show Sample Output
This is sample output - yours may be different.
```
$ svn st
A       fichieravecpointdinterrogation?airsetra.txt
A       fichier avec @ un arobase
A       fichier avec @ un arobase@
A       fichier avec des espaces
A       fichieravec@sansepace.txt
```
0

svn st | awk ' {if ( $1 == "?" ){print $1="",$0}} ' | sed -e 's/^[ \t]*//' | sed 's/ /\\ /g' | perl -ne '`svn add ${1}@` if /(.*)(@*)(.*)/'

JulieCaroline · 2012-02-23 18:42:02 3
kill an arbitrary process running on an Android device attached via USB debug cable

This is great when you need to reboot the system-server, or your own daemon that has gone crazy
This is sample output - yours may be different.
0

adb shell ps | grep <process name> | awk '{print $2}' | xargs adb shell kill

riansanderson · 2012-03-03 01:03:39 3
Extract single column from TPC-H datafiles
This is sample output - yours may be different.
0

awk -F\| '{ print $2 }' nation.tbl

maarten · 2012-03-03 12:22:01 3
Count Number of Columns in TPC-H table-file (or any pipe seperated file
This is sample output - yours may be different.
0

head -n1 nation.tbl | sed 's/$.$/\1\n/g' | sort | uniq -c | grep \| | awk '{ print $1 }'

maarten · 2012-03-03 12:35:58 3
Output specific line in a very big file and exit afterwards

This will save parsing time for operations on very big files.
This is sample output - yours may be different.
0

awk 'FNR==100 {print;exit}' file

Testuser_01 · 2012-03-04 20:25:57 8
Aspect ratio of a resolution

EG: aspectRatio 1920 1200 For display a image in full screen it should be in any of the resolution obtained from the output. So resize an image to any of it and you can display it in full screen For general aspect ratio : aspectRatio () { for i in `seq 1 1000 `; do awk "BEGIN {print $1/$i, $2/$i}"; done |grep -v "\." |tail -1; } Show Sample Output
This is sample output - yours may be different.
```
1920 1200
960 600
640 400
480 300
384 240
320 200
240 150
192 120
160 100
128 80
120 75
96 60
80 50
64 40
48 30
40 25
32 20
24 15
16 10
8 5
```
0

aspectRatio () { for i in `seq 1 1000 `; do awk "BEGIN {print $1/$i, $2/$i}"; done |grep -v "\."; }

totti · 2012-03-07 06:22:25 3
‹ First < 31 32 33 34 35 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Find broken symlinks

To understand why this is the equivalent of "find -L /path/to/search -type l, see http://ynform.org/w/Pub/FindBrokenSymbolicLinks or look at http://www.gnu.org/software/findutils/manual/html_mono/find.html

See loaded modules in apache

Easiest way to check which modules are loaded in apache.

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

CLI Visual Apache Web Log Analyzer

GoAccess is an open source real-time Apache web log analyzer and interactive viewer that runs in a terminal in *nix systems. It provides fast and valuable HTTP statistics for system administrators that require a visual server report on the fly. http://goaccess.prosoftcorp.com/

View the newest xkcd comic.

Get memory total from /proc/meminfo in Gigs

Get AWS temporary credentials ready to export based on a MFA virtual appliance

Detect encoding of a text file

This command gives you the charset of a text file, which would be handy if you have no idea of the encoding.

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

Commit command to history file immedeately after execution

This could be added to .bashrc. Background: Linux usually saves history only on clean exit of shell. If shell ends unclean, history is lost. Also numerous terminals might confuse their history. With this variable set, history is immedeately written, accessible to all other open shells.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by