Commands tagged awk sorted by votes

Commands tagged awk (348)

sorted by

Make a statistic about the lines of code

This is really fast :) time find . -name \*.c | xargs wc -l | tail -1 | awk '{print $1}' 204753 real 0m0.191s user 0m0.068s sys 0m0.116s Show Sample Output
This is sample output - yours may be different.
```
204753
```
0

find . -name \*.c | xargs wc -l | tail -1 | awk '{print $1}'

karpoke · 2009-09-08 08:25:45 4
Visualizing system performance data

draw `vmstat ` data using gnuplot
This is sample output - yours may be different.
0

vmstat 2 10 | awk 'NR > 2 {print NR, $13}' | gnuplot -e "set terminal png;set output 'v.png';plot '-' u 1:2 t 'cpu' w linespoints;"

Sunng · 2009-09-23 07:19:47 3
Calculating series with awk: add numbers from 1 to 100

Calculating series with awk only, no need for seq: add numbers from 1 to 100 Variations: 1+3+...+(2n-1) = n^2 awk 'BEGIN {for(i=1;i<=19;i+=2)sum+=i}; END {print sum}' /dev/null # displays 100 1/2 + 1/4 + ... = 1 awk 'BEGIN {for(i=1;i<=10;i++)sum+=1/(2**i)}; END {print sum}' /dev/null # displays 0.999023 Show Sample Output
This is sample output - yours may be different.
```
5050
```
0

awk 'BEGIN {for(i=1;i<=100;i++)sum+=i}; END {print sum}' /dev/null

dennisw · 2009-10-26 18:24:57 3
Get ethX mac addresses

Simple MAC adrress, thanks to ifconfig.
This is sample output - yours may be different.
0

ifconfig | awk '/HW/ {print $5}'

Cont3mpo · 2009-11-05 18:00:50 4
View the newest xkcd comic.

I wasn't sure how to display the image, so I thought I'd try xml for a different twist. Show Sample Output
This is sample output - yours may be different.
```
<?xml version="1.0"?>
<xkcd>
<item>
<title>Spinal Tap Amps</title>
<comment>Wow, that's less than $200 per ... uh ... that's a good deal!</comment>
<image>http://imgs.xkcd.com/comics/spinal_tap_amps.png</image>
</item>
</xkcd>
```
0

curl -s 'xkcd.com' | awk -F\" '/^<img/{printf("<?xml version=\"1.0\"?>\n<xkcd>\n<item>\n <title>%s</title>\n <comment>%s</comment>\n <image>%s</image>\n</item>\n</xkcd>\n", $6, $4, $2)}'

putnamhill · 2009-12-03 19:49:37 3
View a random xkcd comic

Only need to install Image Magick package. Display a xkcd comic with its title and save it in /tmp directory If you prefer to view the newest xkcd, use this command: wget -q http://xkcd.com/ -O-| sed -n '/<img src="http:\/\/imgs.xkcd.com\/comics/{s/.*$http:.*$" t.*/\1/;p}' | awk '{system ("wget -q " $1 " -O- | display -title $(basename " $1") -write /tmp/$(basename " $1")");}'
This is sample output - yours may be different.
0

wget -q http://dynamic.xkcd.com/comic/random/ -O-| sed -n '/<img src="http:\/\/imgs.xkcd.com\/comics/{s/.*$http:.*$" t.*/\1/;p}' | awk '{system ("wget -q " $1 " -O- | display -title $(basename " $1") -write /tmp/$(basename " $1")");}'

laugg · 2009-12-09 13:41:25 7
Get current Xorg resolution via xrandr
This is sample output - yours may be different.
0

xrandr -q | awk -F'current' -F',' 'NR==1 {gsub("( |current)","");print $2}'

sputnick · 2010-02-02 16:26:17 6
Averaging columns of numbers

Computes a columns average in a file. Input parameters = column number and optional pattern. Show Sample Output
This is sample output - yours may be different.
```
$> cat 0.5-10000.dat | avg 2 
Average over 10000 lines: 1.005299
```
0

function avg { awk "/$2/{sum += \$$1; lc += 1;} END {printf \"Average over %d lines: %f\n\", lc, sum/lc}"; }

vimzard · 2010-02-18 10:20:22 4
List of commands you use most often

If you use HISTTIMEFORMAT environment e.g. timestamping typed commands, $(echo "1 2 $HISTTIMEFORMAT" | wc -w) gives the number of columns that containing non-command parts per lines. It should universify this command. Show Sample Output
This is sample output - yours may be different.
```
361 sudo
167 latin
130 ll
73 apt-get
72 mcedit
55 w
51 echo
50 ssh
48 mount
48 iwlist
```
0

history | awk '{a[$'$(echo "1 2 $HISTTIMEFORMAT" | wc -w)']++}END{for(i in a){print a[i] " " i}}' | sort -rn | head

bandie91 · 2010-05-02 21:48:53 3
Get IPv4 of eth0 for use with scripts
This is sample output - yours may be different.
0

ifconfig eth0 | awk '/inet / {print $2}' | cut -d ':' -f2

mrwill · 2010-06-30 08:52:01 3
How To Get the Apache Document Root
This is sample output - yours may be different.
0

awk '$1~/^DocumentRoot/{print $2}' /etc/apache2/sites-available/default

cicatriz · 2010-07-22 14:33:58 4
command line fu roulette

Splitting on tags in awk is a handy way to parse html.
This is sample output - yours may be different.
0

curl -sL 'www.commandlinefu.com/commands/random' | awk -F'</?[^>]+>' '/"command"/{print $2}'

putnamhill · 2010-08-13 11:42:42 5
Generate trigonometric/log data easily

If you want a sequence that can be plotted, do: seq 8 | awk '{print "e(" $0 ")" }' | bc -l | awk '{print NR " " $0}' Other bc functions include s (sine), c (cosine), l (log) and j (bessel). See the man page for details. Show Sample Output
This is sample output - yours may be different.
```
2.71828182845904523536
7.38905609893065022723
20.08553692318766774092
54.59815003314423907811
148.41315910257660342111
403.42879349273512260838
1096.63315842845859926372
2980.95798704172827474359
```
0

seq 8 | awk '{print "e(" $0 ")" }' | bc -l

polar · 2010-08-14 02:52:39 4
Get all links of a website
This is sample output - yours may be different.
0

lynx -dump http://www.domain.com | awk '/http/{print $2}' | egrep "^https{0,1}"

xutale · 2010-11-10 11:05:52 2
Create a tar of modified/added files since revision 1792.

The result of this command is a tar with all files that have been modified/added since revision 1792 until HEAD. This command is super useful for incremental releases.
This is sample output - yours may be different.
0

svn diff -r 1792:HEAD --summarize | awk '{if ($1 != "D") print $2}'| xargs -I {} tar rf incremental_release.tar {}

windfold · 2011-04-05 15:00:49 3
use awk to replace field with it's md5sum

Source: http://www.eggheadcafe.com/software/aspnet/35700746/calculating-md5sum-strings-from-within-awk.aspx Show Sample Output
This is sample output - yours may be different.
```
In:
joe 123456789 fdfdsajk
bob 125344325 dfjsakl

Out:
joe b2cfa4183267af678ea06c7407d4d6d8 fdfdsajk
bob f052b6bf06cde7c020543ed6f7bc1146 dfjsakl
```
0

awk '{command="echo "$2"|md5sum" ;command | getline $2; close(command);sub(/[[:blank:]].*/,"",$2); print $0}'

erichelgeson · 2011-05-10 15:11:36 3
Show seconds since modified of newest modified file in directory
This is sample output - yours may be different.
0

FILE=`ls -ltr /var/lib/pgsql/backups/daily/ | tail -n1 | awk '{print $NF}'`; TIME=`stat -c %Y /var/lib/pgsql/backups/daily/$FILE`; NOW=`date +%s`; echo $((NOW-TIME))

allrightname · 2011-05-12 13:21:37 6
Show seconds since modified of newest modified file in directory
This is sample output - yours may be different.
0

ls -atr /home/reports/*.csv -o --time-sty=+%s | tail -1 | awk '{print systime()-$5}'

MiKatp · 2011-05-12 13:58:56 5
join every five lines

seq 20 | awk '{line=line sep $0; sep=" "} !(NR%5){print line; line=sep=""}' Show Sample Output
This is sample output - yours may be different.
```
1 2 3 4 5
6 7 8 9 10
11 12 13 14 15
16 17 18 19 20
```
0

seq 20 | awk 'ORS=NR%5?FS:RS'

kev · 2011-05-26 11:39:34 9
group every five lines
This is sample output - yours may be different.
0

awk '{x+=$2; y+=$3} NR%5==0{print x/5,y/5; x=y=0}' file.txt

kev · 2011-05-26 11:48:32 3
List your interfaces and MAC addresses

Why use grep and awk?
This is sample output - yours may be different.
0

ifconfig | awk '/HWaddr/ { print $1, $5 }'

Wazutiman · 2011-06-02 12:11:08 3
all out

to be executed from root. this works well on most commercial unix systems, have not tried on linux systems.
This is sample output - yours may be different.
0

ps -fu userid | awk '/userid/{print $2}' | xargs kill

unxscorob · 2011-06-16 12:20:19 3
netstat with group by (ip adress)

count connections, group by IP and port
This is sample output - yours may be different.
0

netstat -nt | awk -F":" '{print $2}' | sort | uniq -c

sreimann · 2011-07-05 07:53:29 3
Find lines of code (LOC) of a filetype in a project.

Replace .py with .rb or .java to get the LOC of that particular filetype. An alternative is http://www.commandlinefu.com/commands/view/2812/make-a-statistic-about-the-lines-of-code Show Sample Output
This is sample output - yours may be different.
```
16809
```
0

find . -type f -name "*.py" -exec wc -l {} \; | awk '{ SUM += $1} END {print SUM }'

dheerosaur · 2011-07-08 13:38:11 10
Download 40 top funnyjunk Images to the current directory

If your version of curl does not support the --compressed option, use curl -s http://funnyjunk.com | gunzip instead of curl -s --compressed http://funnyjunk.com
This is sample output - yours may be different.
0

curl -s --compressed http://funnyjunk.com | awk -F'"' '/ '"'"'mainpagetop24h'"'"'/ { print "http://funnyjunk.com"$4 }' | xargs curl -s | grep -o 'ht.*m/pictures/.*\.jpg\|ht.*m/gifs/.*\.gif' | grep "_......_" | uniq | xargs wget

laniner · 2011-07-21 15:57:21 6
‹ First < 6 7 8 9 10 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

watch snapshots commit in VMware ESX

To monitor .vmdk files during snapshot deletion (commit) on ESX only (ESXi doesn't have the watch command): 1. Navigate to the VM directory containing .vmdk files. # watch "ls -tough --full-time *.vmdk" where: -t sorts by modification time -o do not list group information (to narrow the output) -u sorts by access time -g only here for the purpose to easily remember the created mnemonic word 'tough' -h prints sizes in human readable format (e.g., 1K 234M 2G) --full-time sets the time style to full-iso and does not list user information (to narrow the output) optionally useful parameters to the watch command: -d highlight changes between updates -n seconds to wait between updates (default is 2) -t turn off printing the header

Grab IP address on machine with multiple interfaces

Instead of hard-coding in a check to scrape info from ifconfig based on a specific interface, do it in a more portable way. This works really well if you switch between wired, wireless, bluetooth or even VPN connections. You can get your current IP in a script (since it'll be something like tun0 instead of eth0 or wlan1). This uses a well known public ip address 8.8.8.8, but it doesn't actually connect to it, it just shows you the route it would take.

List just the executable files (or directories) in current directory

Does an 'ls' on just the files and directories in the current directory with an execute bit turned on. This version will list directories. Just tack on "-type f" to the start of the find to omit listing directories and list only files.

Debug redirects between production reloads

Watches the headers of a curl, following any redirects and printing only the HTTP status and the location of the possible redirects.

In place line numbering

Add permanent line numbers to a file without creating a temp file. The rm command deletes file10 while the nl command works on the open file descriptor of file10 which it outputs into a new file again named file10. The new file10 will now be numbered in the same directory with the same file name and content as before, but it will in fact be a new file, using (ls -i) to show its inode number will prove this.

Detect illegal access to kernel space, potentially useful for Meltdown detection

Based on capsule8 agent examples, not rigorously tested

Display condensed log of changes to current git repository

Assuming you are working within a git repository, you can run the above command & see what has changed in reverse chronological order, with one commit per line. Other formatting variations to 'oneline' include 'short', 'medium', 'full', 'fuller', 'email' or 'raw'.

Create a backup of the file.

It will create a backup of the filename. The advantage is that if you list the folder the backups will be sorted by date. The command works on any unix in bash.

print shared library dependencies

May be used on (embedded) systems lack ldd

Shrink more than one blank lines to one in VIM.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged awk

Commands tagged awk (348) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged awk (348)

sorted by