Commands tagged awk sorted by votes

Commands tagged awk (348)

sorted by

Make a statistic about the lines of code

This is really fast :) time find . -name \*.c | xargs wc -l | tail -1 | awk '{print $1}' 204753 real 0m0.191s user 0m0.068s sys 0m0.116s Show Sample Output
This is sample output - yours may be different.
```
204753
```
0

find . -name \*.c | xargs wc -l | tail -1 | awk '{print $1}'

karpoke · 2009-09-08 08:25:45 4
Visualizing system performance data

draw `vmstat ` data using gnuplot
This is sample output - yours may be different.
0

vmstat 2 10 | awk 'NR > 2 {print NR, $13}' | gnuplot -e "set terminal png;set output 'v.png';plot '-' u 1:2 t 'cpu' w linespoints;"

Sunng · 2009-09-23 07:19:47 3
Calculating series with awk: add numbers from 1 to 100

Calculating series with awk only, no need for seq: add numbers from 1 to 100 Variations: 1+3+...+(2n-1) = n^2 awk 'BEGIN {for(i=1;i<=19;i+=2)sum+=i}; END {print sum}' /dev/null # displays 100 1/2 + 1/4 + ... = 1 awk 'BEGIN {for(i=1;i<=10;i++)sum+=1/(2**i)}; END {print sum}' /dev/null # displays 0.999023 Show Sample Output
This is sample output - yours may be different.
```
5050
```
0

awk 'BEGIN {for(i=1;i<=100;i++)sum+=i}; END {print sum}' /dev/null

dennisw · 2009-10-26 18:24:57 3
Get ethX mac addresses

Simple MAC adrress, thanks to ifconfig.
This is sample output - yours may be different.
0

ifconfig | awk '/HW/ {print $5}'

Cont3mpo · 2009-11-05 18:00:50 4
View the newest xkcd comic.

I wasn't sure how to display the image, so I thought I'd try xml for a different twist. Show Sample Output
This is sample output - yours may be different.
```
<?xml version="1.0"?>
<xkcd>
<item>
<title>Spinal Tap Amps</title>
<comment>Wow, that's less than $200 per ... uh ... that's a good deal!</comment>
<image>http://imgs.xkcd.com/comics/spinal_tap_amps.png</image>
</item>
</xkcd>
```
0

curl -s 'xkcd.com' | awk -F\" '/^<img/{printf("<?xml version=\"1.0\"?>\n<xkcd>\n<item>\n <title>%s</title>\n <comment>%s</comment>\n <image>%s</image>\n</item>\n</xkcd>\n", $6, $4, $2)}'

putnamhill · 2009-12-03 19:49:37 3
View a random xkcd comic

Only need to install Image Magick package. Display a xkcd comic with its title and save it in /tmp directory If you prefer to view the newest xkcd, use this command: wget -q http://xkcd.com/ -O-| sed -n '/<img src="http:\/\/imgs.xkcd.com\/comics/{s/.*$http:.*$" t.*/\1/;p}' | awk '{system ("wget -q " $1 " -O- | display -title $(basename " $1") -write /tmp/$(basename " $1")");}'
This is sample output - yours may be different.
0

wget -q http://dynamic.xkcd.com/comic/random/ -O-| sed -n '/<img src="http:\/\/imgs.xkcd.com\/comics/{s/.*$http:.*$" t.*/\1/;p}' | awk '{system ("wget -q " $1 " -O- | display -title $(basename " $1") -write /tmp/$(basename " $1")");}'

laugg · 2009-12-09 13:41:25 7
Get current Xorg resolution via xrandr
This is sample output - yours may be different.
0

xrandr -q | awk -F'current' -F',' 'NR==1 {gsub("( |current)","");print $2}'

sputnick · 2010-02-02 16:26:17 6
Averaging columns of numbers

Computes a columns average in a file. Input parameters = column number and optional pattern. Show Sample Output
This is sample output - yours may be different.
```
$> cat 0.5-10000.dat | avg 2 
Average over 10000 lines: 1.005299
```
0

function avg { awk "/$2/{sum += \$$1; lc += 1;} END {printf \"Average over %d lines: %f\n\", lc, sum/lc}"; }

vimzard · 2010-02-18 10:20:22 4
List of commands you use most often

If you use HISTTIMEFORMAT environment e.g. timestamping typed commands, $(echo "1 2 $HISTTIMEFORMAT" | wc -w) gives the number of columns that containing non-command parts per lines. It should universify this command. Show Sample Output
This is sample output - yours may be different.
```
361 sudo
167 latin
130 ll
73 apt-get
72 mcedit
55 w
51 echo
50 ssh
48 mount
48 iwlist
```
0

history | awk '{a[$'$(echo "1 2 $HISTTIMEFORMAT" | wc -w)']++}END{for(i in a){print a[i] " " i}}' | sort -rn | head

bandie91 · 2010-05-02 21:48:53 3
Get IPv4 of eth0 for use with scripts
This is sample output - yours may be different.
0

ifconfig eth0 | awk '/inet / {print $2}' | cut -d ':' -f2

mrwill · 2010-06-30 08:52:01 3
How To Get the Apache Document Root
This is sample output - yours may be different.
0

awk '$1~/^DocumentRoot/{print $2}' /etc/apache2/sites-available/default

cicatriz · 2010-07-22 14:33:58 4
command line fu roulette

Splitting on tags in awk is a handy way to parse html.
This is sample output - yours may be different.
0

curl -sL 'www.commandlinefu.com/commands/random' | awk -F'</?[^>]+>' '/"command"/{print $2}'

putnamhill · 2010-08-13 11:42:42 5
Generate trigonometric/log data easily

If you want a sequence that can be plotted, do: seq 8 | awk '{print "e(" $0 ")" }' | bc -l | awk '{print NR " " $0}' Other bc functions include s (sine), c (cosine), l (log) and j (bessel). See the man page for details. Show Sample Output
This is sample output - yours may be different.
```
2.71828182845904523536
7.38905609893065022723
20.08553692318766774092
54.59815003314423907811
148.41315910257660342111
403.42879349273512260838
1096.63315842845859926372
2980.95798704172827474359
```
0

seq 8 | awk '{print "e(" $0 ")" }' | bc -l

polar · 2010-08-14 02:52:39 4
Get all links of a website
This is sample output - yours may be different.
0

lynx -dump http://www.domain.com | awk '/http/{print $2}' | egrep "^https{0,1}"

xutale · 2010-11-10 11:05:52 2
Create a tar of modified/added files since revision 1792.

The result of this command is a tar with all files that have been modified/added since revision 1792 until HEAD. This command is super useful for incremental releases.
This is sample output - yours may be different.
0

svn diff -r 1792:HEAD --summarize | awk '{if ($1 != "D") print $2}'| xargs -I {} tar rf incremental_release.tar {}

windfold · 2011-04-05 15:00:49 3
use awk to replace field with it's md5sum

Source: http://www.eggheadcafe.com/software/aspnet/35700746/calculating-md5sum-strings-from-within-awk.aspx Show Sample Output
This is sample output - yours may be different.
```
In:
joe 123456789 fdfdsajk
bob 125344325 dfjsakl

Out:
joe b2cfa4183267af678ea06c7407d4d6d8 fdfdsajk
bob f052b6bf06cde7c020543ed6f7bc1146 dfjsakl
```
0

awk '{command="echo "$2"|md5sum" ;command | getline $2; close(command);sub(/[[:blank:]].*/,"",$2); print $0}'

erichelgeson · 2011-05-10 15:11:36 3
Show seconds since modified of newest modified file in directory
This is sample output - yours may be different.
0

FILE=`ls -ltr /var/lib/pgsql/backups/daily/ | tail -n1 | awk '{print $NF}'`; TIME=`stat -c %Y /var/lib/pgsql/backups/daily/$FILE`; NOW=`date +%s`; echo $((NOW-TIME))

allrightname · 2011-05-12 13:21:37 6
Show seconds since modified of newest modified file in directory
This is sample output - yours may be different.
0

ls -atr /home/reports/*.csv -o --time-sty=+%s | tail -1 | awk '{print systime()-$5}'

MiKatp · 2011-05-12 13:58:56 5
join every five lines

seq 20 | awk '{line=line sep $0; sep=" "} !(NR%5){print line; line=sep=""}' Show Sample Output
This is sample output - yours may be different.
```
1 2 3 4 5
6 7 8 9 10
11 12 13 14 15
16 17 18 19 20
```
0

seq 20 | awk 'ORS=NR%5?FS:RS'

kev · 2011-05-26 11:39:34 9
group every five lines
This is sample output - yours may be different.
0

awk '{x+=$2; y+=$3} NR%5==0{print x/5,y/5; x=y=0}' file.txt

kev · 2011-05-26 11:48:32 3
List your interfaces and MAC addresses

Why use grep and awk?
This is sample output - yours may be different.
0

ifconfig | awk '/HWaddr/ { print $1, $5 }'

Wazutiman · 2011-06-02 12:11:08 3
all out

to be executed from root. this works well on most commercial unix systems, have not tried on linux systems.
This is sample output - yours may be different.
0

ps -fu userid | awk '/userid/{print $2}' | xargs kill

unxscorob · 2011-06-16 12:20:19 3
netstat with group by (ip adress)

count connections, group by IP and port
This is sample output - yours may be different.
0

netstat -nt | awk -F":" '{print $2}' | sort | uniq -c

sreimann · 2011-07-05 07:53:29 3
Find lines of code (LOC) of a filetype in a project.

Replace .py with .rb or .java to get the LOC of that particular filetype. An alternative is http://www.commandlinefu.com/commands/view/2812/make-a-statistic-about-the-lines-of-code Show Sample Output
This is sample output - yours may be different.
```
16809
```
0

find . -type f -name "*.py" -exec wc -l {} \; | awk '{ SUM += $1} END {print SUM }'

dheerosaur · 2011-07-08 13:38:11 10
Download 40 top funnyjunk Images to the current directory

If your version of curl does not support the --compressed option, use curl -s http://funnyjunk.com | gunzip instead of curl -s --compressed http://funnyjunk.com
This is sample output - yours may be different.
0

curl -s --compressed http://funnyjunk.com | awk -F'"' '/ '"'"'mainpagetop24h'"'"'/ { print "http://funnyjunk.com"$4 }' | xargs curl -s | grep -o 'ht.*m/pictures/.*\.jpg\|ht.*m/gifs/.*\.gif' | grep "_......_" | uniq | xargs wget

laniner · 2011-07-21 15:57:21 6
‹ First < 6 7 8 9 10 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Rename file to same name plus datestamp of last modification.

Note that the -i will not help in a script. Proper error checking is required.

Read null character seperated fields from a file

Handle any bad named file which contains ",',\n,\b,\t,` etc Store the file name as null character separated list $find . -print0 >name.lst and retrieve it using $read -r -d "" Eg: $find . -print0 >name.lst; $cat name.lst| while IFS="" read -r -d "" file; $do $ls -l "$file"; $done

Get the IP address of a machine. Just the IP, no junk.

Convert YAML to JSON

Converts YAML file to JSON. Note that you'll need to install PyYAML. Also some YAML data types (like dates) are not supported by JSON).

find all active IP addresses in a network

mtr, better than traceroute and ping combined

mtr combines the functionality of the traceroute and ping programs in a single network diagnostic tool. As mtr starts, it investigates the network connection between the host mtr runs on and HOSTNAME. by sending packets with purposly low TTLs. It continues to send packets with low TTL, noting the response time of the intervening routers. This allows mtr to print the response percentage and response times of the internet route to HOSTNAME. A sudden increase in packetloss or response time is often an indication of a bad (or simply over‐loaded) link.

pngcrush all .png files in the directory

Nothing too magical here, just uses pngcrush to losslessly compress all your pngs!

Remove newlines from output

Remove newlines from output. One character shorter than awk /./ filename and doesn't use a superfluous cat. To be fair though, I'm pretty sure fraktil was thinking being able to nuke newlines from any command is much more useful than just from one file.

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged awk

Commands tagged awk (348) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged awk (348)

sorted by