Commands tagged awk (348)
-
This is really fast :)
time find . -name \*.c | xargs wc -l | tail -1 | awk '{print $1}'204753 real 0m0.191s user 0m0.068s sys 0m0.116s Show Sample Output0find . -name \*.c | xargs wc -l | tail -1 | awk '{print $1}' -
draw `vmstat ` data using gnuplot
0vmstat 2 10 | awk 'NR > 2 {print NR, $13}' | gnuplot -e "set terminal png;set output 'v.png';plot '-' u 1:2 t 'cpu' w linespoints;" -
Calculating series with awk only, no need for seq: add numbers from 1 to 100 Variations: 1+3+...+(2n-1) = n^2
awk 'BEGIN {for(i=1;i<=19;i+=2)sum+=i}; END {print sum}' /dev/null # displays 1001/2 + 1/4 + ... = 1awk 'BEGIN {for(i=1;i<=10;i++)sum+=1/(2**i)}; END {print sum}' /dev/null # displays 0.999023Show Sample Output0awk 'BEGIN {for(i=1;i<=100;i++)sum+=i}; END {print sum}' /dev/null -
Simple MAC adrress, thanks to ifconfig.
0ifconfig | awk '/HW/ {print $5}' -
I wasn't sure how to display the image, so I thought I'd try xml for a different twist. Show Sample Output
0curl -s 'xkcd.com' | awk -F\" '/^<img/{printf("<?xml version=\"1.0\"?>\n<xkcd>\n<item>\n <title>%s</title>\n <comment>%s</comment>\n <image>%s</image>\n</item>\n</xkcd>\n", $6, $4, $2)}' -
Only need to install Image Magick package. Display a xkcd comic with its title and save it in /tmp directory If you prefer to view the newest xkcd, use this command:
wget -q http://xkcd.com/ -O-| sed -n '/<img src="http:\/\/imgs.xkcd.com\/comics/{s/.*\(http:.*\)" t.*/\1/;p}' | awk '{system ("wget -q " $1 " -O- | display -title $(basename " $1") -write /tmp/$(basename " $1")");}'0wget -q http://dynamic.xkcd.com/comic/random/ -O-| sed -n '/<img src="http:\/\/imgs.xkcd.com\/comics/{s/.*\(http:.*\)" t.*/\1/;p}' | awk '{system ("wget -q " $1 " -O- | display -title $(basename " $1") -write /tmp/$(basename " $1")");}' -
0xrandr -q | awk -F'current' -F',' 'NR==1 {gsub("( |current)","");print $2}'
-
Computes a columns average in a file. Input parameters = column number and optional pattern. Show Sample Output
0function avg { awk "/$2/{sum += \$$1; lc += 1;} END {printf \"Average over %d lines: %f\n\", lc, sum/lc}"; } -
If you use HISTTIMEFORMAT environment e.g. timestamping typed commands, $(echo "1 2 $HISTTIMEFORMAT" | wc -w) gives the number of columns that containing non-command parts per lines. It should universify this command. Show Sample Output
0history | awk '{a[$'$(echo "1 2 $HISTTIMEFORMAT" | wc -w)']++}END{for(i in a){print a[i] " " i}}' | sort -rn | head -
0ifconfig eth0 | awk '/inet / {print $2}' | cut -d ':' -f2
-
0awk '$1~/^DocumentRoot/{print $2}' /etc/apache2/sites-available/default
-
Splitting on tags in awk is a handy way to parse html.
0curl -sL 'www.commandlinefu.com/commands/random' | awk -F'</?[^>]+>' '/"command"/{print $2}' -
If you want a sequence that can be plotted, do: seq 8 | awk '{print "e(" $0 ")" }' | bc -l | awk '{print NR " " $0}' Other bc functions include s (sine), c (cosine), l (log) and j (bessel). See the man page for details. Show Sample Output
0seq 8 | awk '{print "e(" $0 ")" }' | bc -l -
0lynx -dump http://www.domain.com | awk '/http/{print $2}' | egrep "^https{0,1}"
-
The result of this command is a tar with all files that have been modified/added since revision 1792 until HEAD. This command is super useful for incremental releases.
0svn diff -r 1792:HEAD --summarize | awk '{if ($1 != "D") print $2}'| xargs -I {} tar rf incremental_release.tar {} -
0awk '{command="echo "$2"|md5sum" ;command | getline $2; close(command);sub(/[[:blank:]].*/,"",$2); print $0}'
-
0FILE=`ls -ltr /var/lib/pgsql/backups/daily/ | tail -n1 | awk '{print $NF}'`; TIME=`stat -c %Y /var/lib/pgsql/backups/daily/$FILE`; NOW=`date +%s`; echo $((NOW-TIME))
-
0ls -atr /home/reports/*.csv -o --time-sty=+%s | tail -1 | awk '{print systime()-$5}'
-
seq 20 | awk '{line=line sep $0; sep=" "} !(NR%5){print line; line=sep=""}' Show Sample Output
0seq 20 | awk 'ORS=NR%5?FS:RS' -
0awk '{x+=$2; y+=$3} NR%5==0{print x/5,y/5; x=y=0}' file.txt
-
Why use grep and awk?
0ifconfig | awk '/HWaddr/ { print $1, $5 }' -
to be executed from root. this works well on most commercial unix systems, have not tried on linux systems.
0ps -fu userid | awk '/userid/{print $2}' | xargs kill -
count connections, group by IP and port
0netstat -nt | awk -F":" '{print $2}' | sort | uniq -c -
Replace .py with .rb or .java to get the LOC of that particular filetype. An alternative is http://www.commandlinefu.com/commands/view/2812/make-a-statistic-about-the-lines-of-code Show Sample Output
0find . -type f -name "*.py" -exec wc -l {} \; | awk '{ SUM += $1} END {print SUM }' -
If your version of curl does not support the --compressed option, use
curl -s http://funnyjunk.com | gunzipinstead ofcurl -s --compressed http://funnyjunk.com0curl -s --compressed http://funnyjunk.com | awk -F'"' '/ '"'"'mainpagetop24h'"'"'/ { print "http://funnyjunk.com"$4 }' | xargs curl -s | grep -o 'ht.*m/pictures/.*\.jpg\|ht.*m/gifs/.*\.gif' | grep "_......_" | uniq | xargs wget - ‹ First < 6 7 8 9 10 > Last ›
What's this?
commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.
Check These Out
Stay in the loop…
- Follow the Tweets.
-
Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.
» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10 - Subscribe to the feeds.
-
Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):
Subscribe to the feed for:
- » all commands
- » commands with 3 up-votes (commandlinefu3)
- » commands with 10 up-votes (commandlinefu10)
- » commands tagged awk