Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Calculating number of Connection to MySQL
This is sample output - yours may be different.
0

mysql -u root -p -N -e"show processlist\G;" | egrep "Host\:" | awk -F: '{ print $2 }' | sort | uniq -c

zuck · 2011-12-22 09:04:07 4
kill all running instances of wine and programs runned by it (exe)

The other 2 commands that are listed will also kill the egrep process and any libexec processes because the .exe isn't escaped so it is really using . meaning anything containing exe. The command i posted escapes the (dot) in .exe and then filters the actual egrep process so that it doesn't get killed before the other processes being killed. Also added the -9 switch for kill to send sigterm to the processes, in case people are wondering why processes aren't getting killed after running just kill . This should work better for people :)
This is sample output - yours may be different.
0

wineserver -k; killall -9 wine wineserver; for i in `ps ax|egrep "*\.exe"|grep -v 'egrep'|awk '{print $1 }'`;do kill -9 $i;done

godmachine81 · 2011-12-30 01:38:15 4
list all users with UID bigger than 999 in /etc/passwd

To distinguish normal users from system users. Specify an UID, to list all all users with UID bigger than that in /etc/passwd.
This is sample output - yours may be different.
0

awk -F: '$3 > 999 { print $1 }' /etc/passwd

rockenrola · 2011-12-30 14:47:10 3
Set ondemand governor for all cpu cores.

Save as a bash script and run as root to set the ondemand cpu frequency governor for all cpu cores. Name the file ondemand. Change 'ondemand' in the argument to performance or your preferred governor to do the same thing but set all cpu cores to use the performance governor (or your preferred governor)
This is sample output - yours may be different.
0

for i in `cat /proc/cpuinfo |grep processor|awk '{print $3}'`;do cpufreq-set -g ondemand $i;done

godmachine81 · 2011-12-31 01:44:18 3
Mount a partitoned disk-image file

Mounts a disk-image of a hdd with partitions
This is sample output - yours may be different.
0

IMG="image.img";PART=1;mount -o loop,ro,offset=$(parted $IMG -s unit b print|awk '$1=='$PART' {sub(/B/,"",$2);print $2}') $IMG /mnt/whatever

AndroTux · 2011-12-31 14:58:18 3
A list of IPs (only) that are online in a specific subnet.

Often you want to nmap a list of IPs using the -iL flag. This is an easy way to generate a list of IPs that are online in a specific subnet or IP range (192.168.1.100-110). Show Sample Output
This is sample output - yours may be different.
```
192.168.1.1
192.168.1.43
192.168.1.67
192.168.1.100
192.168.1.101
192.168.1.104
```
0

nmap -sP 192.168.1.0/24 | awk "/^Host/"'{ print $3 }' |nawk -F'[()]' '{print $2}'

cantormath · 2011-12-31 15:50:22 3
Show WebSphere AppServer uid|pid|cell|node|jvms

Tested in bash on AIX & Linux, used for WAS versions 6.0 & up. Sorts by node name. Useful when you have vertically-stacked instances of WAS/Portal. Cuts out all the classpath/optional parameter clutter that makes a simple "ps -ef | grep java" so difficult to sort through. Show Sample Output
This is sample output - yours may be different.
```
wasguy      14221350   ExampleCell1    Node1       WebSphere_Portal
wasguy      11141130   ExampleCell1    Node1       WebSphere_Portal_3
wasguy      11665646   ExampleCell1    Node1       nodeagent
wasguy      1769816    ExampleCell2    Node2       WebSphere_Portal
wasguy      10289222   ExampleCell2    Node2       WebSphere_Portal_3
wasguy      11665646   ExampleCell2    Node2       nodeagent
```
0

ps -ef | grep [j]ava | awk -F ' ' ' { print $1," ",$2,"\t",$(NF-2),"\t",$(NF-1),"\t",$NF } ' | sort -k4

drockney · 2012-01-05 16:05:48 3
diff two css files to create an overriding css (e.g. for wordpress child themes)

This will extract the differing CSS entries of two files. I've left the initial character (plus or space) in output to show the real differing line, remove the initial character to get a working CSS file. The output CSS file is usable by either adding it in a below the to original.css, or by only using the output but adding @import url("original.css"); in the beginning. This is very useful for converting Wordpress theme copies into real Wordpress child themes. Could exclude common lines within entries too, I guess, but that might not be worth the complexity. Show Sample Output
This is sample output - yours may be different.
```
+++ style.css	2012-01-12 08:33:13.486877866 +0100
@@ -1,1324 +1,1427 @@
 /* =Layout
 -------------------------------------------------------------- */
 
 /*
 LAYOUT: Two columns
 DESCRIPTION: Two-column fixed layout with one sidebar right of content
 */
 
 #container {
 	float: left;
+	margin: 0 -240px 0 38px;
 	width: 100%;
 }

 #content {
+	margin: 0 250px 0 0px;
 }
```
0

diff -U99999 original.css modified.css | awk '/^-/{next} {f=f"\n"$0} /^\+.*[^ ]/{yes=1} /}/ {if(yes){print f} f="";yes=0}'

unhammer · 2012-01-12 07:57:22 4
Find duplicate UID in /etc/passwd

Detect duplicate UID in you /etc/passwd (or GID in /etc/group file). Duplicate UID is often forbidden for it can be a security breach. Show Sample Output
This is sample output - yours may be different.
```
user@host:/etc# awk -F: '{print $3}' /etc/passwd | sort |uniq -d
203
user@host:/etc# 
```
0

awk -F: '{print $3}' /etc/passwd | sort |uniq -d

ultips · 2012-01-17 11:16:35 3
Show CPU idle and used time

This command displays the CPU idle + used time using stats from /proc/stat. Show Sample Output
This is sample output - yours may be different.
```
idle 	 used
72.4139% 21.1866%
```
0

grep "cpu " /proc/stat | awk -F ' ' '{total = $2 + $3 + $4 + $5} END {print "idle \t used\n" $5*100/total "% " $2*100/total "%"}'

Goez · 2012-01-21 04:12:50 3
Find files with size over 100MB and output with better lay-out

This command does a basic find with size. It also improves the printout given (more clearer then default) Adjusting the ./ will alter the path. Adjusting the "-size +100000k" will specify the size to search for. Show Sample Output
This is sample output - yours may be different.
```
goez@goez-laptop:~/test$ ls -sh
total 392M
102M 101MB_file  201M 200MB_file   91M 90MB_file
goez@goez-laptop:~/test$ find ./ -type f -size +100000k -exec ls -lh {} \; 2>/dev/null| awk '{ print $8 " : " $5}'
./101MB_file : 101M
./200MB_file : 200M
```
0

find ./ -type f -size +100000k -exec ls -lh {} \; 2>/dev/null| awk '{ print $8 " : " $5}'

Goez · 2012-01-21 04:19:35 5
Create a shell script from history of commands

If you are installing some new package. You can first go through the step by step install and then take the commands that you ran from history to create shell script which can used to install the package on other machines say test or production.
This is sample output - yours may be different.
0

history | awk '{$1=""; print $0}' > install_pkg.sh

cfunz · 2012-01-23 06:46:25 3
find an unused unprivileged TCP port

This is also perl-less, and only uses AWK as its postprocessor. Tested with GAWK and MAWK.
This is sample output - yours may be different.
0

netstat -tan | awk '$1 == "tcp" && $4 ~ /:/ { port=$4; sub(/^[^:]+:/, "", port); used[int(port)] = 1; } END { for (p = 32768; p <= 61000; ++p) if (! (p in used)) { print p; exit(0); }; exit(1); }'

wirawan0 · 2012-01-26 20:42:56 5
Kill processes associated with PATTERN

Kill all process that concide whit PATTERN Show Sample Output
This is sample output - yours may be different.
```
kill 28310: No such process
```
0

ps -fea | grep PATTERN | awk {'print $2'} | xargs kill -9

luiscachog · 2012-01-27 20:31:36 3
Print heap addresses and size

Show Sample Output
This is sample output - yours may be different.
```
00014000-00174000 rwxp 00000000 00:00 0    [heap]
Size:    1408 kB
Rss:     1292 kB
```
0

PID=`ps | grep process_name | grep -v grep | head -n 1 | awk '{print $1}'`; cat /proc/$PID/smaps | grep heap -A 2

yohananov · 2012-01-30 13:31:40 3
Change time format in log, UNIX Timestamp to Human readable

It remove the square bracket and convert UNIX time to human readable time for all line of a stream (or file). Show Sample Output
This is sample output - yours may be different.
```
Input :
[1325199600] CURRENT SERVICE STATE: HOST01;Loopback;OK;HARD;1;Loopback0:UP:1 UP: OK
[1325199600] CURRENT SERVICE STATE: HOST01;Uptime Routers SFR;OK;HARD;1;Information only: 114 days

Ouput :
12/30/11 00:00:00 CURRENT SERVICE STATE: HOST01;Loopback;OK;HARD;1;Loopback0:UP:1 UP: OK
12/30/11 00:00:00 CURRENT SERVICE STATE: HOST01;Uptime Routers SFR;OK;HARD;1;Information only: 114 days
```
0

sed -r 's/(\[|])//g' | awk ' { $1=strftime("%D %T",$1); print }'

Zulu · 2012-02-03 13:07:37 4
See who are using a specific port

See who is using a specific port. Especially when you're using AIX. In Ubuntu, for example, this can easily be seen with the netstat command. Show Sample Output
This is sample output - yours may be different.
```
Usually a nice list of IP addresses :-)
```
0

netstat -Aan | grep .80 | grep -v 127.0.0.1 | grep EST | awk '{print $6}' | cut -d "." -f1,2,3,4 | sort | uniq

janvanderwijk · 2012-02-03 13:54:11 4
display memory usage of a process

page where I got inspiration: http://www.commandlinefu.com/commands/view/5473/get-acurate-memory-usage-of-a-process-in-megabytes and http://www.commandlinefu.com/commands/view/10022/display-the-top-10-running-processes-sorted-by-memory-usage
This is sample output - yours may be different.
0

TOTAL_RAM=`free | head -n 2 | tail -n 1 | awk '{ print $2 }'`; PROC_RSS=`ps axo rss,comm | grep [h]ttpd | awk '{ TOTAL += $1 } END { print TOTAL }'`; PROC_PCT=`echo "scale=4; ( $PROC_RSS/$TOTAL_RAM ) * 100" | bc`; echo "RAM Used by HTTP: $PROC_PCT%"

0disse0 · 2012-02-03 16:10:36 12
List prime numbers from 2 to 100

This is actually quite slow~ P.S. change `seq 2 100` to `seq 2 1000` and try Show Sample Output
This is sample output - yours may be different.
```
2 3 5 7 11 13 17 19 23 29 31 37 41 43 47 53 59 61 67 71 73 79 83 89 97
```
0

for num in `seq 2 100`;do if [ `factor $num|awk '{print $2}'` == $num ];then echo -n "$num ";fi done;echo

alvinhochun · 2012-02-18 08:11:19 3
add all files not under version control to repository

handels @, ?, whitespaces in names. replace "?" and "add" by "!" and "rm" for svn mass remove. ---> I m looking for a nicer way to write it, perhaps with something using " perl -ne '`blahblah` if /\?(.*)/' " Show Sample Output
This is sample output - yours may be different.
```
$ svn st
A       fichieravecpointdinterrogation?airsetra.txt
A       fichier avec @ un arobase
A       fichier avec @ un arobase@
A       fichier avec des espaces
A       fichieravec@sansepace.txt
```
0

svn st | awk ' {if ( $1 == "?" ){print $1="",$0}} ' | sed -e 's/^[ \t]*//' | sed 's/ /\\ /g' | perl -ne '`svn add ${1}@` if /(.*)(@*)(.*)/'

JulieCaroline · 2012-02-23 18:42:02 3
kill an arbitrary process running on an Android device attached via USB debug cable

This is great when you need to reboot the system-server, or your own daemon that has gone crazy
This is sample output - yours may be different.
0

adb shell ps | grep <process name> | awk '{print $2}' | xargs adb shell kill

riansanderson · 2012-03-03 01:03:39 3
Extract single column from TPC-H datafiles
This is sample output - yours may be different.
0

awk -F\| '{ print $2 }' nation.tbl

maarten · 2012-03-03 12:22:01 3
Count Number of Columns in TPC-H table-file (or any pipe seperated file
This is sample output - yours may be different.
0

head -n1 nation.tbl | sed 's/$.$/\1\n/g' | sort | uniq -c | grep \| | awk '{ print $1 }'

maarten · 2012-03-03 12:35:58 3
Output specific line in a very big file and exit afterwards

This will save parsing time for operations on very big files.
This is sample output - yours may be different.
0

awk 'FNR==100 {print;exit}' file

Testuser_01 · 2012-03-04 20:25:57 8
Aspect ratio of a resolution

EG: aspectRatio 1920 1200 For display a image in full screen it should be in any of the resolution obtained from the output. So resize an image to any of it and you can display it in full screen For general aspect ratio : aspectRatio () { for i in `seq 1 1000 `; do awk "BEGIN {print $1/$i, $2/$i}"; done |grep -v "\." |tail -1; } Show Sample Output
This is sample output - yours may be different.
```
1920 1200
960 600
640 400
480 300
384 240
320 200
240 150
192 120
160 100
128 80
120 75
96 60
80 50
64 40
48 30
40 25
32 20
24 15
16 10
8 5
```
0

aspectRatio () { for i in `seq 1 1000 `; do awk "BEGIN {print $1/$i, $2/$i}"; done |grep -v "\."; }

totti · 2012-03-07 06:22:25 3
‹ First < 31 32 33 34 35 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Make vim open in tabs by default (save to .profile)

I always add this to my .profile rc so I can do things like: "vim *.c" and the files are opened in tabs.

Terminal - Show directories in the PATH, one per line with sed and bash3.X `here string'

Create a mirror of a local folder, on a remote server

Create a exact mirror of the local folder "/root/files", on remote server 'remote_server' using SSH command (listening on port 22) (all files & folders on destination server/folder will be deleted)

List the files any process is using

List the files a process is using.

check open ports without netstat or lsof

Recursive Line Count

We use `-not -name ".*"` for the reason we must omit hidden files (which unnecessary). We can only show up total lines like this: $ find * -type f -not -name ".*" | xargs wc -l | tail -1

For when GUI programs stop responding..

man xkill

List all execs in $PATH, usefull for grepping the resulting list

##Dependancies: bash coreutils Many executables in $PATH have the keyword somewhere other than the beginning in their file names. The command is useful for exploring the executables in $PATH like this. $ find ${PATH//:/ } -executable -type f -printf "%f\n" |grep admin lpadmin time-admin network-admin svnadmin users-admin django-admin shares-admin services-admin

create pdf files from text files or stdout.

Easily decode unix-time (funtion)

A shell function using perl to easily convert Unix-time to text. Put in in your ~/.bashrc or equivalent. Tested on Linux / Solaris Bourne, bash and zsh. using perl 5.6 and higher. (Does not require GNU date like some other commands)

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by