Commands using gawk sorted by votes

Commands using gawk (38)

sorted by

gawk gets fixed width field
This is sample output - yours may be different.
5

ls -l | gawk -v FIELDWIDTHS='1 3 3 3' '{print $2}'

kev · 2012-02-08 08:18:25 98
slow down CPU and IO for process and its offsprings.
This is sample output - yours may be different.
4

slow2() { ionice -c3 renice -n 20 $(pstree `pidof $1` -p -a -u -A|gawk 'BEGIN{FS=","}{print $2}'|cut -f1 -d " ") ; }

oernii3 · 2010-11-18 10:50:17 4
Prepend section dates to individual entries in a summary log file

Searches for dates on lines by themselves. Uses that date to prepend all rows that contain SEARCHSTRING with the date, until it reaches another line with a date by itself. This fixed an issue with a specific log export where there would be a date, followed by all of the entries for that date.
This is sample output - yours may be different.
4

gawk 'match($0, /^\s*([0-9]{2}\/[0-9]{2}\/[0-9]{4})\s*/, m) {prev_date=m[1]} /SEARCHSTRING/ {print prev_date, ",", $1 $2, ",", $3, "," $5}' inputfile.txt

jtopian · 2023-07-11 23:20:38 509

Generate a playlist of all the files in the directory, newer first

I use this to generate a playlist with all the podcasts I listen to. Ordered from most recent to older. Show Sample Output

find . -type f -print0 | xargs -r0 stat -c %Y\ %n | sort -rn | gawk '{sub(/.\//,"",$2); print $2}' > /tmp/playlist.m3u

microft · 2009-03-04 16:41:02 11

connect to all screen instances running

connects to all the screen instances running.
This is sample output - yours may be different.
3

screen -ls | grep pts | gawk '{ split($1, x, "."); print x[1] }' | while read i; do gnome-terminal -e screen\ -dx\ $i; done

microft · 2009-04-22 10:36:39 10
List all PostgreSQL databases. Useful when doing backups
This is sample output - yours may be different.
3

psql -U postgres -lAt | gawk -F\| '$1 !~ /^template/ && $1 !~ /^postgres/ && NF > 1 {print $1}'

lv4tech · 2009-05-15 14:33:50 6
Prefix command output with duration for each line

Prefixes each output line with time between it and the previous one. Show Sample Output
This is sample output - yours may be different.
```
0s -- start --
0s Reading package lists...
34s dh_strip -papp-common
1s dh_compress -papp-common
4s dh_fixperms -papp-common
0s dh_makeshlibs -papp-common
0s dh_strip -papp-web
```
3

program | gawk 'BEGIN { l=systime() ; p="-- start --" } { t=systime(); print t-l "s " p; l=t; p=$0 } END { t=systime(); print t-l "s " p}'

Denis · 2012-08-08 00:08:16 4
To find the count of each open file on a system (that supports losf)
This is sample output - yours may be different.
2

sudo lsof | awk '{printf("%s %s %s\n", $1, $3, $NF)}' | grep -v "(" | sort -k 4 | gawk '$NF==prv{ct++;next} {printf("%d %s\n",ct,$0);ct=1;prv=$NF}' | uniq | sort -nr

bpfx · 2009-02-05 14:18:57 77
command line to optimize all table from a mysql database
This is sample output - yours may be different.
2

mysql -u uname dbname -e "show tables" | grep -v Tables_in | grep -v "+" | gawk '{print "optimize table " $1 ";"}' | mysql -u uname dbname

dlamotte · 2009-02-05 14:54:22 43
find sparse files

Prints the path/filename and sparseness of any sparse files (files that use less actual space than their total size because the filesystem treats large blocks of 00 bytes efficiently).
This is sample output - yours may be different.
2

find -type f -printf "%S\t%p\n" 2>/dev/null | gawk '{if ($1 < 1.0) print $1 $2}'

thetrivialstuff · 2011-07-02 19:22:49 6
Show drive names next to their full serial number (and disk info)

Scrap everything and use `gawk` to do all the magic, since it's like the future or something. gawk 'match($11, /[a-z]{3}$/) && match($9, /^ata-/) { gsub("../", ""); print $11,"\t",$9 }' Yank out only ata- lines that have a drive letter (ignore lines with partitions). Then strip ../../ and print the output. Yay awk. Be sure to see the alternatives as my initial command is listed there. This one is a revision of the original. Show Sample Output
This is sample output - yours may be different.
```
sda	ata-Samsung_SSD_840_PRO_Series_XXXXX
sdb	ata-WDC_WD30EFRX-68AX9N0_WD-XXXXX
sdc	ata-WDC_WD30EFRX-68EUZN0_WD-XXXXX
sdd	ata-WDC_WD30EFRX-68EUZN0_WD-XXXXX
sde	ata-WDC_WD30EFRX-68AX9N0_WD-XXXXX
```
2

ls -l /dev/disk/by-id |gawk 'match($11, /[a-z]{3}$/) && match($9, /^ata-/) { gsub("../", ""); print $11,"\t",$9 }' |sort

lig0n · 2015-05-18 15:42:33 10
Gentoo: Get the size of all installed packets, sorted

On a Gentoo system, this command will tell you which packets you have installed and sort them by how much space they consume. Good for finding out space-hogs when tidying up disk space. Show Sample Output
This is sample output - yours may be different.
```
alanceil@kvirasim:03:06:2:0:~> equery s | sed 's/(\|)/ /g' | sort -n -k 9 | gawk '{print $1" "$9/1048576"m"}'
app-text/scrollkeeper-9999-r1: 0m
gnome-base/gail-1000: 0m
--- *snip* ---
dev-java/sun-jdk-1.6.0.13: 158.84m
games-puzzle/neverball-1.5.0: 174.607m
app-office/openoffice-bin-3.0.0: 380.035m
```
1

equery s | sed 's/(\|)/ /g' | sort -n -k 9 | gawk '{print $1" "$9/1048576"m"}'

Alanceil · 2009-07-30 01:12:10 6
Ultimate current directory usage command

A little bit smaller, faster and should handle files with special characters in the name.
This is sample output - yours may be different.
1

find . -maxdepth 1 ! -name '.' -execdir du -0 -s {} + | sort -znr | gawk 'BEGIN{ORS=RS="\0";} {sub($1 "\t", ""); print $0;}' | xargs -0 du -hs

ashawley · 2009-09-11 16:07:39 7
Get acurate memory usage of a Process in MegaBytes
This is sample output - yours may be different.
1

pmap $(pgrep [ProcessName] -n) | gawk '/total/ { a=strtonum($2); b=int(a/1024); printf b};'

lv4tech · 2010-04-28 08:16:28 4
truncate deleted files from lsof

While the posted solution works, I'm a bit uneasy about the "%d" part. This would be hyper-correct approach: lsof|gawk '$4~/txt/{next};/REG.*$deleted$$/{sub(/.$/,"",$4);printf ">/proc/%s/fd/%s\n", $2,$4}' Oh, and you gotta pipe the result to sh if you want it to actually trim the files. ;) Btw, this approach also removes false negatives (OP's command skips any deleted files with "txt" in their name).
This is sample output - yours may be different.
1

lsof|gawk '$4~/txt/{next};/REG.*$deleted$$/{printf ">/proc/%s/fd/%d\n", $2,$4}'

wejn · 2014-03-11 10:40:32 13
get the list of temps for your hard-drives

get a list of temps of your hard-drives. Show Sample Output
This is sample output - yours may be different.
```
31 31 31 29
```
0

hddtemp /dev/sda /dev/sdb /dev/hda /dev/hdb | gawk '{print $NF}' | perl -n -e '$_ =~ s/(\d+)/print "$1 "/eg }{ print "\n"'

microft · 2009-05-20 16:01:58 4
Extract the daily average number of iops

You need sysstat and gawk for this to work. Show Sample Output
This is sample output - yours may be different.
```
4789.98
4286.45
4286.23
4028.34
4108.42
812.15
3171.27
3696.37
4584.12
```
0

for x in `seq -w 1 30`; do sar -b -f /var/log/sa/sa$x | gawk '/Average/ {print $2}'; done

unixmonkey4319 · 2009-06-17 02:46:52 4
File without comments or blank lines.
This is sample output - yours may be different.
0

gawk '!/^[\t\ ]*#/{print $0}' filename | strings

unixmonkey14934 · 2010-12-10 00:38:12 5

# Multiline paragraph sort; with case insensitive option (-i)

Among other things, this allows the sorting of comment descriptions and command lines retrieved as text from CommandLineFu.com. Show Sample Output

gawk 'BEGIN {RS="\n\n"; if (ARGV[1]=="-i"){IGNORECASE=1; ARGC=1}};{Text[NR]=$0};END {asort(Text);for (i=1;i<=NR;i++) printf "%s\n\n",Text[i] }' -i<Zip.txt

IF_Rock · 2011-05-10 19:08:27 6

# Multiline unique paragraph sort; with case insensitive option (-i)

Sorts blank line delimited paragraphs. '-i' -- case insensitivity option -- removes redundant paragraphs in a case insensitive way, and then sorts in a case insensitive way. If you search CommandLineFu with multiple anded terms searches, redundancy can ensue. This sorts the retrieved text (among other kinds of data), and removes the redundancy. Show Sample Output
This is sample output - yours may be different.
```
# Backup all MySQL Databases to individual files
for I in $(mysql -e 'show databases' -s --skip-column-names); do mysqldump $I | gzip > "$I.sql.gz"; done

# backup local MySQL database into a folder and removes older then 5 days backups
mysqldump -uUSERNAME -pPASSWORD database | gzip > /path/to/db/files/db-backup-`date +%Y-%m-%d`.sql.gz ;find /path/to/db/files/* -mtime +5 -exec rm {} \;

# geoip information
curl -s "http://www.geody.com/geoip.php?ip=$(curl -s icanhazip.com)" | sed '/^IP:/!d;s/<[^>][^>]*>//g'

# List files contained within a zip archive
unzip -l <filename>
```
0

gawk 'BEGIN {RS="\n\n"; if (ARGV[1]=="-i")IGNORECASE=1;ARGC=1}{if (IGNORECASE)Text[tolower($0)]=$0;else Text[$0]=$0 };END {N=asort(Text);for(i=1;i<=N;i++)printf "%s\n\n",Text[i]}' -i<Test.txt

IF_Rock · 2011-05-11 01:03:30 4
wala
This is sample output - yours may be different.
0

lynx -useragent=Opera -dump 'http://www.facebook.com/ajax/typeahead_friends.php?u=Bilal Butt&__a=1' |gawk -F'\"t\":\"' -v RS='\",' 'RT{print $NF}' |grep -v '\"n\":\"' |cut -d, -f2

dmz2011 · 2011-11-25 08:16:09 32
Command to kill PID

You can also use gawk: ps auxww | gawk '/application/' | gawk '/processtobekilled/' | gawk '{print $2}' | grep -v grep | xargs kill -9
This is sample output - yours may be different.
0

ps auxww | grep application | grep processtobekilled | gawk '{print $2}' | grep -v grep | xargs kill -9

j0sh10 · 2012-07-03 20:37:56 70
Capture screen and mic input using FFmpeg and ALSA

Now we can capture only a specific window (we have to chose by clicking on it) ffmpeg complains about "Frame size must be a multiple of 2" so we calculate the upper even number with (g)awk trickery. We remove the grep, we are already using (g)awk here ....why losing time with grep !!! ;) Show Sample Output
This is sample output - yours may be different.
```
...
Stream mapping:
  Stream #0.0 -> #0.0
Press [q] to stop encoding
frame=   18 fps= 11 q=0.0 Lsize=      55kB time=1.80 bitrate= 252.5kbits/s    
video:55kB audio:0kB global headers:0kB muxing overhead 1.626234%
```
0

a=$(xwininfo |gawk 'BEGIN {FS="[x+ \t]*"} /-geometry/ {print int(($3+1)/2)*2"x"int(($4+1)/2)*2"+"$5"+"$6}') ; echo ${a} ; ffmpeg -f x11grab -s ${a} -r 10 -i :0.0 -sameq -f mp4 -s wvga -y /tmp/out.mpg

dwygo · 2012-08-31 14:48:41 6
Find highest context switches

This command will find the highest context switches on a server and give you the process listing. Show Sample Output
This is sample output - yours may be different.
```
Context Switches: 1097211 - Process : [migration/12]
Context Switches: 1500058 - Process : [migration/10]
Context Switches: 1558813 - Process : [migration/13]
Context Switches: 2207748 - Process : [migration/11]
Context Switches: 2516720 - Process : /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --log-error=/var/lib/mysql/server.err --open-files-limit=12288 --pid-file=/var/lib/mysql/server.pid
```
0

grep -H voluntary_ctxt /proc/*/status |gawk '{ split($1,proc,"/"); if ( $2 > 10000000 ) { printf $2 " - Process : "; system("ps h -o cmd -p "proc[3]) } }' | sort -nk1,1 | sed 's/^/Context Switches: /g'

jperkster · 2012-09-01 19:43:47 55
face are
This is sample output - yours may be different.
0

lynx -useragent=Opera -dump 'http://www.facebook.com/ajax/typeahead_friends.php?u=100000475200812&__a=1' |gawk -F'\"t\":\"' -v RS='\",' 'RT{print $NF}' |grep -v '\"n\":\"' |cut -d, -f2

pheloke · 2012-09-10 02:22:03 5
1 2 >

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Create a mirror of a local folder, on a remote server

Create a exact mirror of the local folder "/root/files", on remote server 'remote_server' using SSH command (listening on port 22) (all files & folders on destination server/folder will be deleted)

A DESTRUCTIVE command to render a drive unbootable

THIS COMMAND IS DESTRUCTIVE. That said, lets assume you want to render your boot drive unbootable and reboot your machine. Maybe you want it to boot off the network and kickstart from a boot server for a fresh OS install. Replace /dev/fd0 with the device name of your boot drive and this DESTRUCTIVE command will render your drive unbootable. Your BIOS boot priority should be set to boot from HD first, then LAN.

cat large file to clipboard with speed-o-meter

shortest alternative without the speed-o-meter"xclip large.xml" "xclip -o" to get the clipboard content, alternatively [shift key] + insert or middle button of your mouse.

Url Encode

Monitor all DNS queries made by Firefox Mac OS X version

mount an iso

mounts an ISO file to a directory on the target file system

Graphically show percent of mount space used

Automatically drops mount points that have non-numeric sizes (e.g. /proc). Tested in bash on Linux and AIX.

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

nice disk usage, sorted by size, see description for full command

full command below, would not let me put full command in text box du -sk ./* | sort -nr | awk 'BEGIN{ pref[1]="K"; pref[2]="M"; pref[3]="G";} { total = total + $1; x = $1; y = 1; while( x > 1024 ) { x = (x + 1023)/1024; y++; } printf("%g%s\t%s\n",int(x*10)/10,pref[y],$2); } END { y = 1; while( total > 1024 ) { total = (total + 1023)/1024; y++; } printf("Total: %g%s\n",int(total*10)/10,pref[y]); }'

Convert CSV to JSON

Replace 'csv_file.csv' with your filename.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using gawk

Commands using gawk (38) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using gawk (38)

sorted by