Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Get Dollar-Euro exchage rate

You can get others rates changing the "EUR/US" part. look at the url: wap.kitco.com/exrate.wml to get more options. Show Sample Output
This is sample output - yours may be different.
```
0.7007
```
4

curl -s wap.kitco.com/exrate.wml | awk ' BEGIN { x=0; FS = "<" } { if ($0~"^<br/>") {x=0} if (x==1) {print $1} if ($0~"EUR/US") {x=1} }'

jamaese · 2009-08-27 16:30:19 5

List of reverse DNS records for a subnet

This command uses nmap to perform reverse DNS lookups on a subnet. It produces a list of IP addresses with the corresponding PTR record for a given subnet. You can enter the subnet in CDIR notation (i.e. /24 for a Class C)). You could add "--dns-servers x.x.x.x" after the "-sL" if you need the lookups to be performed on a specific DNS server. On some installations nmap needs sudo I believe. Also I hope awk is standard on most distros. Show Sample Output

nmap -R -sL 209.85.229.99/27 | awk '{if($3=="not")print"("$2") no PTR";else print$3" is "$2}' | grep '('

netsaint · 2009-09-02 16:33:15 5

Display the standard deviation of a column of numbers with awk

This will calculate a running standard deviation in one pass and should never have the possibility for overflow that can happen with other implementations. I suppose there is a potential for underflow in the corner case where the deltas are small or the values themselves are small.
This is sample output - yours may be different.
4

awk '{delta = $1 - avg; avg += delta / NR; mean2 += delta * ($1 - avg); } END { print sqrt(mean2 / NR); }'

ashawley · 2009-09-11 04:46:01 5
Show apps that use internet connection at the moment.

This corrects duplicate output from the previous command. Show Sample Output
This is sample output - yours may be different.
```
dropbox    
emacs-snapshot
firefox-bin
gvfsd-http 
python     
```
4

netstat -lantp | grep -i establ | awk -F/ '{print $2}' | sort | uniq

HarimaKenji · 2009-09-19 14:42:31 7
Commit only newly added files to subversion repository
This is sample output - yours may be different.
4

svn ci `svn stat |awk '/^A/{printf $2" "}'`

realist · 2009-11-04 03:30:07 3
Shows you how many hours of avi video you have.

midentify.sh is part of mplayer, but you might have to locate it on your box. Show Sample Output
This is sample output - yours may be different.
```
35.5096
hours
```
4

/usr/share/mplayer/midentify.sh `find . -name "*.avi" -print` | grep ID_LENGTH | awk -F "=" '{sum += $2} END {print sum/60/60; print "hours"}'

equant · 2009-11-17 03:33:20 11
Short Information about loaded kernel modules
This is sample output - yours may be different.
4

awk '{print $1}' "/proc/modules" | xargs modinfo | awk '/^(filename|desc|depends)/'

unixmonkey7109 · 2009-11-20 13:06:25 3
Analyse compressed Apache access logs for the most commonly requested pages
This is sample output - yours may be different.
4

zcat access_log.*.gz | awk '{print $7}' | sort | uniq -c | sort -n | tail -n 20

tkb · 2009-12-11 09:36:30 4
Print trending topics on Twitter
This is sample output - yours may be different.
4

curl --silent search.twitter.com | sed -n '/div id=\"hot\"/,/div/p' | awk -F\> '{print $2}' | awk -F\< '{print $1}' | sed '/^$/d'

allrightname · 2009-12-21 21:29:34 3
Every Nth line position # (AWK)

A better way to show the file lines 3n + 1
This is sample output - yours may be different.
4

awk 'NR%3==1' file

point_to_null · 2010-01-08 18:52:24 9
Numerically sorted human readable disk usage

Provides numerically sorted human readable du output. I so wish there was just a du flag for this. Show Sample Output
This is sample output - yours may be different.
```
# du -x --max-depth=1 /var | sort -n | awk '{ print $2 }' | xargs du -hx --max-depth=0
0       /var/lock
128K    /var/run
4.0K    /var/crash
4.0K    /var/games
4.0K    /var/local
4.0K    /var/opt
4.0K    /var/tmp
8.0K    /var/mail
692K    /var/spool
7.2M    /var/backups
13M     /var/log
97M     /var/www
236M    /var/lib
539M    /var/cache
891M    /var
```
4

du -x --max-depth=1 | sort -n | awk '{ print $2 }' | xargs du -hx --max-depth=0

d34dh0r53 · 2010-02-18 19:46:47 6
Grab a list of MP3s out of Firefox's cache

Ever gone to a site that has an MP3 embedded into a pesky flash player, but no download link? Well, this one-liner will yank the names of those tunes straight out of FF's cache in a nice, easy to read list. What you do with them after that is *ahem* no concern of mine. ;) Show Sample Output
This is sample output - yours may be different.
```
4CF25EB3d01
```
4

for i in `ls ~/.mozilla/firefox/*/Cache`; do file $i | grep -i mpeg | awk '{print $1}' | sed s/.$//; done

BoxingOctopus · 2010-04-11 23:14:18 7
Quickly analyse an Apache error log

This searches the Apache error_log for each of the 5 most significant Apache error levels, if any are found the date is then cut from the output in order to sort then print the most common occurrence of each error. Show Sample Output
This is sample output - yours may be different.
```
  4  [emerg] (17)File exists: Couldn't create accept lock 
  20 [error] [client 1.2.3.4] File does not exist: /Welcome, referer: http://127.0.0.1/
  23 [warn] Init: Session Cache is not configured [hint: SSLSessionCache]
```
4

for i in emerg alert crit error warn ; do awk '$6 ~ /^\['$i'/ {print substr($0, index($0,$6)) }' error_log | sort | uniq -c | sort -n | tail -1; done

zlemini · 2010-04-15 21:47:18 3
Extract title from HTML files

Case Insensitive! and Works even if the "<title>...</title>" spans over multiple line. Simple! :-) Show Sample Output
This is sample output - yours may be different.
```
Extract title from HTML files | commandlinefu.com
```
4

awk 'BEGIN{IGNORECASE=1;FS="<title>|</title>";RS=EOF} {print $2}' file.html

sata · 2010-04-20 10:54:03 5

Search shoutcast web radio by keyword

Searches for web radio by submitted keyword and returns the station name and the link for listing . May be enhanced to read user's selection and submit it to mplayer. Show Sample Output

echo "Keyword?";read keyword;query="http://www.shoutcast.com/sbin/newxml.phtml?search="$keyword"";curl -s $query |awk -F '"' 'NR <= 4 {next}NR>15{exit}{sub(/SHOUTcast.com/,"http://yp.shoutcast.com/sbin/tunein-station.pls?id="$6)}{print i++" )"$2}'

benyounes · 2010-05-03 00:44:10 8

Count number of hits per IP address in last 2000 lines of apache logs and print the IP and hits if hits > 20
This is sample output - yours may be different.
4

tail -n2000 /var/www/domains/*/*/logs/access_log | awk '{print $1}' | sort | uniq -c | sort -n | awk '{ if ($1 > 20)print $1,$2}'

allrightname · 2010-05-10 19:08:37 3
ping MAC ADDRESS

# first install arp-scan if not have it arp-scan 10.1.1.0/24 .... show ip+mac in localnet awk '/00:1b:11:dc:a9:65/ {print $1}' .... get ip associated with MAC ` backtick make do command substitution passing ip to command ping Show Sample Output
This is sample output - yours may be different.
```
ping -c 2 `arp-scan 10.1.1.0/24 | awk '/00:1b:11:dc:a9:65/ {print $1}'`
PING 10.1.1.1 (10.1.1.1) 56(84) bytes of data.
64 bytes from 10.1.1.1: icmp_seq=1 ttl=64 time=0.911 ms
64 bytes from 10.1.1.1: icmp_seq=2 ttl=64 time=0.827 ms

--- 10.1.1.1 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1000ms
rtt min/avg/max/mdev = 0.827/0.869/0.911/0.042 ms
```
4

ping -c 2 `arp-scan 10.1.1.0/24 | awk '/00:1b:11:dc:a9:65/ {print $1}'`

voyeg3r · 2010-05-11 13:12:43 5
Determine next available UID

better with accounts on ldap Show Sample Output
This is sample output - yours may be different.
```
834
```
4

getent passwd | awk -F: '($3>600) && ($3<10000) && ($3>maxuid) { maxuid=$3; } END { print maxuid+1; }'

bunam · 2010-05-25 12:27:33 42
Create user add lines from partial passwd file

Handy if you are installing a new server or recovering an old one and you have a passwd file with the accounts you want to add to the server. If you edit the file so that only the accounts that you want to add are left this line will spit out the correct useradd lines. The uid, gecos and shell will be preserved. Show Sample Output
This is sample output - yours may be different.
```
Input:
jsnuffy:x:600:600:Joe Snuffy:/home/jsnuffy:/bin/bash
hhandle:x:601:601:Harru Hoehandle:/home/hhandle:/bin/bash
ssimple:x:602:602:Sally Simple:/home/ssimple:/bin/bash

Output:
useradd -u 600 -c "Joe Snuffy" -s /bin/bash jsnuffy
useradd -u 601 -c "Harru Hoehandle" -s /bin/bash hhandle
useradd -u 602 -c "Sally Simple" -s /bin/bash ssimple
```
4

awk -F: '{print "useradd -u "$3,"-c \""$5"\"","-s "$7,$1}' passwd

UnixSage · 2010-06-06 11:54:35 9
list folders containing less than 2 MB of data

Just shortened the awk a bit and removed sed. Edit: I'm assuming there are no spaces in the path. To support white space in pathname try: awk '($1 < 2048) {sub(/^[0-9]+[ \t]+/,""); print $0}'
This is sample output - yours may be different.
4

find . -type d -exec du -sk '{}' \; | awk '($1 < 2048) {print $2}'

putnamhill · 2010-06-16 11:53:14 3
Print number of mb of free ram

This will show the amount of physical RAM that is left unused by the system. Show Sample Output
This is sample output - yours may be different.
```
13 MB
```
4

grep '^MemFree:' /proc/meminfo | awk '{ mem=($2)/(1024) ; printf "%0.0f MB\n", mem }'

dbbolton · 2010-06-30 18:33:29 3
Short one line while loop that outputs parameterized content from one file to another
This is sample output - yours may be different.
4

awk '{print $1}' < three-column.txt > first-column.txt

infinull · 2010-07-09 04:00:05 5
List all authors of a particular git project

Gets the authors, sorts by number of commits (as a vague way of estimating how much of the project is their work, i.e. the higher in the list, the more they've done) and then outputs the results. Show Sample Output
This is sample output - yours may be different.
```
AUTHOR NAME <AUTHOR EMAIL ADDRESS>
```
4

git log --format='%aN <%aE>' | awk '{arr[$0]++} END{for (i in arr){print arr[i], i;}}' | sort -rn | cut -d\ -f2-

chrisjkirkham · 2010-07-19 11:40:52 5
Command line calculator

works with fractions like 1/3.5
This is sample output - yours may be different.
4

awk "BEGIN{ print $* }"

maelcum · 2010-10-07 16:13:41 7

Get information on your graphics card on linux (such as graphics memory size)

Loop is needed if you have more then one card. Show Sample Output

for I in `/sbin/lspci |awk '/VGA/{print $1}'`;do /sbin/lspci -v -s $I;done

houghi · 2010-10-26 19:02:26 6

‹ First < 6 7 8 9 10 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Convert CSV to JSON

Replace 'csv_file.csv' with your filename.

Set laptop display brightness

Run as root. Path may vary depending on laptop model and video card (this was tested on an Acer laptop with ATI HD3200 video). $ cat /proc/acpi/video/VGA/LCD/brightness to discover the possible values for your display.

Ultimate current directory usage command

Based on the MrMerry one, just add some visuals and sort directory and files

Remove security limitations from PDF documents using ghostscript (for Windows)

#4345 also works under windows

Sort file greater than a specified size in human readeable format including their path and typed by color, running from current directory

1. find file greater than 10 MB 2. direct it to xargs 3. xargs pass them as argument to ls

Find where a kind of file is stored

In this case searches for where .desktop files are stored. The resulted is a sorted list of the top directories containing such files.

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

Convert seconds to [DD:][HH:]MM:SS

list block devices

Shows all block devices in a tree with descruptions of what they are.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by