Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

kill all processes using a directory/file/etc

This command will kill all processes using a directory. It's quick and dirty. One may also use a -9 with kill in case regular kill doesn't work. This is useful if one needs to umount a directory. Show Sample Output
This is sample output - yours may be different.
```
lsof|grep /data/| awk '{print $2}'|xargs kill
kill 1635: No such process
kill 1635: No such process
```
5

lsof|grep /somemount/| awk '{print $2}'|xargs kill

archlich · 2009-03-12 18:42:19 12
Play musical notes from octave of middle C

Are there any creative pieces of music that can be created using beep and the shell? I'd love to hear it!
This is sample output - yours may be different.
5

man beep | sed -e '1,/Note/d; /BUGS/,$d' | awk '{print $2}' | xargs -IX sudo beep -f X -l 500

jnash · 2009-04-01 06:48:48 10
List files above a given threshold

List files above a given size threshold. Show Sample Output
This is sample output - yours may be different.
```
./tapestry/tapestry-project-4.1.5-full.zip: 46M
./tapestry/tapestry-bin-5.1.0.1.zip: 29M
./tapestry/tapestry-bin-5.1.0.2.tar.bz2: 29M
./tapestry/tapestry-bin-5.1.0.0.zip: 29M
./tapestry/tapestry-project-4.1.3-full.tar.bz2: 27M
./tapestry/tapestry-bin-5.1.0.0.tar.gz: 29M
```
5

find . -type f -size +25000k -exec ls -lh {} \; | awk '{ print $8 ": " $5 }'

benajnim · 2009-04-02 15:01:17 8
Remove today's installed packages
This is sample output - yours may be different.
5

grep "install " /var/log/dpkg.log | awk '{print $4}' | xargs apt-get -y remove --purge

skygreg · 2009-04-06 13:06:04 10
get the top 10 longest filenames
This is sample output - yours may be different.
5

find | sed -e "s/^.*\///" | awk ' BEGIN { FS=""} { print NF " " $0 } ' | sort -nrf | head -10

nitehawk · 2009-04-13 21:03:07 5
Print IP of any interface. Useful for scripts.
This is sample output - yours may be different.
5

ip route show dev ppp0 | awk '{ print $7 }'

williamruckman · 2009-05-06 02:07:57 8
Get line number of all matches in a file
This is sample output - yours may be different.
5

awk '/match/{print NR}' file

inof · 2009-06-03 17:34:13 7
When was your OS installed?

shows also time if its the same year or shows year if installed before actual year and also works if /etc is a link (mac os) Show Sample Output
This is sample output - yours may be different.
```
Jul 15 11:46
or
Dec 24 2006
```
5

ls -lct /etc/ | tail -1 | awk '{print $6, $7, $8}'

peshay · 2009-09-04 16:52:50 5
(Git) Revert files with changed mode, not content

I sometimes (due to mismanagement!) end up with files in a git repo which have had their modes changed, but not their content. This one-liner lets me revert the mode changes, while leaving changed-content files be, so I can commit just the actual changes made.
This is sample output - yours may be different.
5

git diff --numstat | awk '{if ($1 == "0" && $2 == "0") print $3}' | xargs git checkout HEAD

lingo · 2009-09-17 22:12:50 11
print all except first collumn
This is sample output - yours may be different.
5

awk '{$1=""; print}'

hoberion · 2009-09-23 08:13:40 3
Get the total length of all videos in the current dir in H:m:s

You're behind on your TV catch-up, but how far behind? This command tries to open mplayer against all files in the current dir. If it's a video file it will contain ID_LENGTH, which is summed and output in hours, minutes and seconds. Someone better at awk could probably reduce this down a lot. Show Sample Output
This is sample output - yours may be different.
```
30529.18
8h:28m:49s
```
5

mplayer -vo dummy -ao dummy -identify * 2>&1 | grep ID_LENGTH | sed 's/.*=$[0-9]*$/\1/' | xargs echo | sed 's/ /+/g' | bc | awk 'S=$1; {printf "%dh:%dm:%ds\n",S/(60*60),S%(60*60)/60,S%60}'

Strawp · 2009-09-24 10:33:19 6

Plot frequency distribution of words from files on a terminal.

Uses the dumb terminal option in gnuplot to plot a graph of frequencies. In this case, we are looking at a frequency analysis of words in all of the .c files. Show Sample Output

This is sample output - yours may be different.

$ cat *.c | { printf "se te du\nplot '-' t '' w dots\n"; tr '[[:upper:]]' '[[:lower:]]' | tr -s [[:punct:][:space:]] '\n' | sort | uniq -c | sort -nr | head -n 100 | awk '{print $1}END{print "e"}'; } | gnuplot

  60 .+-----+------+------+------+-------+------+------+------+------+-----++
     +      +      +      +      +       +      +      +      +      +      +
     |                                                                      |
  50 ++                                                                    ++
     |                                                                      |
     |.                                                                     |
     |.                                                                     |
  40 ++                                                                    ++
     |                                                                      |
     | ..                                                                   |
  30 ++                                                                    ++
     |   .                                                                  |
     |                                                                      |
  20 ++  ..                                                                ++
     |     ..                                                               |
     |       ..                                                             |
     |         ...                                                          |
  10 ++           ....                                                     ++
     |                ...............                                       |
     +      +      +      +      +   .......................................+
   0 ++-----+------+------+------+-------+------+------+------+------+-----++
     0      10     20     30     40      50     60     70     80     90    100

cat *.c | { printf "se te du\nplot '-' t '' w dots\n"; tr '[[:upper:]]' '[[:lower:]]' | tr -s [[:punct:][:space:]] '\n' | sort | uniq -c | sort -nr | head -n 100 | awk '{print $1}END{print "e"}'; } | gnuplot

taliver · 2009-11-20 14:53:26 7

Weather on the Command line

Get your weather from a weather station just blocks from your home. Go to http://www.wunderground.com/wundermap/ and find a weather station near you. Click on a temperature bubble for that area. When the window pops up, click on hypertext link with the station ID, then on the bottom right of the page, click on the Current Conditions XML. Thats your link! Good luck! Show Sample Output
This is sample output - yours may be different.
```
53.1
```
5

lynx -dump http://api.wunderground.com/weatherstation/WXCurrentObXML.asp?ID=KCALOSAN32 | grep GMT | awk '{print $3}'

editorreilly · 2010-02-05 19:17:18 8
Get all mac address
This is sample output - yours may be different.
5

ifconfig | awk '/HWaddr/ { print $NF }'

unixmonkey8473 · 2010-02-27 20:20:12 6
Top ten (or whatever) memory utilizing processes (with children aggregate)

This command loops over all of the processes in a system and creates an associative array in awk with the process name as the key and the sum of the RSS as the value. The associative array has the effect of summing a parent process and all of it's children. It then prints the top ten processes sorted by size. Show Sample Output
This is sample output - yours may be different.
```
2472    NetworkManager
3624    getty
3888    hald
3948    nm-system-setti
3968    gdm
4012    bash
6384    sshd
14348   apache2
20560   console-kit-dae
22104   mysqld
```
5

ps axo rss,comm,pid | awk '{ proc_list[$2]++; proc_list[$2 "," 1] += $1; } END { for (proc in proc_list) { printf("%d\t%s\n", proc_list[proc "," 1],proc); }}' | sort -n | tail -n 10

d34dh0r53 · 2010-03-03 16:41:05 5
print all network interfaces' names and IPv4 addresses

ifconfig can't properly display interface's name longer 9 symbols,also it can't show IPs added thru ip command, so 'ip' should be used instead. This alias properly shows long names, bond interfaces and all interface aliases. loopback interface is ignored, since its IP is obvious Show Sample Output
This is sample output - yours may be different.
```
base0             10.0.2.15/24 
base0:1           192.168.0.1/27 
base0:managment   10.23.98.15/24 
vlan666           10.1.57.18/30 
vlan666:service   192.168.100.1/24 
```
5

alias ips='ip a | awk '\''/inet /&&!/ lo/{print $NF,$2}'\'' | column -t'

zolden · 2010-03-06 20:33:04 3
Capture screen and mic input using FFmpeg and ALSA

Yet another x11grab using ffmpeg. I also added mic input to the capturing video stream using alsa. Yet I need to find out how to capture audio which is currently playing. Show Sample Output
This is sample output - yours may be different.
```
http://www.youtube.com/watch?v=K3gOxtXN5wc
```
5

ffmpeg -f alsa -itsoffset 00:00:02.000 -ac 2 -i hw:0,0 -f x11grab -s $(xwininfo -root | grep 'geometry' | awk '{print $2;}') -r 10 -i :0.0 -sameq -f mp4 -s wvga -y intro.mp4

mohan43u · 2010-03-31 09:33:05 6
Show interface/ip using awk

Interfaces like lo can be omitted from the beginning, there are probably better ways of doing this, i'm a noob at awk. Show Sample Output
This is sample output - yours may be different.
```
lo 127.0.0.1
wlan0 192.168.1.100
```
5

ifconfig -a| awk '/^wlan|^eth|^lo/ {;a=$1;FS=":"; nextline=NR+1; next}{ if (NR==nextline) { split($2,b," ")}{ if ($2 ~ /[0-9]\./) {print a,b[1]}; FS=" "}}'

alf · 2010-04-15 04:34:28 16
Get IPv4 of eth0 for use with scripts

I've been using it in a script to build from scratch proxy servers. Show Sample Output
This is sample output - yours may be different.
```
192.168.0.1
```
5

ifconfig eth0 | grep "inet " | cut -d ':' -f2 | awk '{print $1}'

jaimerosario · 2010-06-29 00:06:08 4
Revert all modified files in an SVN repo
This is sample output - yours may be different.
5

svn st | grep -e '^M' | awk '{print $2}' | xargs svn revert

ethanmiller · 2010-08-11 14:24:05 3
Fibonacci numbers with awk

recursive version, "pure" AWK Show Sample Output
This is sample output - yours may be different.
```
0
1
1
2
3
5
8
13
21
34
55
89
144
233
377
610
987
1597
2584
4181
6765
10946
17711
28657
```
5

awk 'func f(n){return(n<2?n:f(n-1)+f(n-2))}BEGIN{while(a<24){print f(a++)}}'

unefunge · 2010-11-24 10:40:08 7
Retrieve the size of a file on a server

- Where $URL is the URL of the file. - Replace the $2 by $3 at the end to get a human-readable size. Credits to svanberg @ ArchLinux forums for original idea. Edit: Replaced command with better version by FRUiT. (removed unnecessary grep)
This is sample output - yours may be different.
5

wget --spider $URL 2>&1 | awk '/Length/ {print $2}'

d3Xt3r · 2011-07-03 00:14:58 10
Lists all usernames in alphabetical order

Save some CPU, and some PIDs. :)
This is sample output - yours may be different.
5

awk -F ':' '{print $1 | "sort";}' /etc/passwd

atoponce · 2011-12-20 12:46:52 3
Find duplicate UID in /etc/passwd

You can use only awk
This is sample output - yours may be different.
5

awk -F":" '!list[$3]++{print $3}' /etc/passwd

richard · 2012-01-24 12:47:52 8

Search for packages, ranked by popularity

This will take the packages matching a given `apt-cache search` query (a collection of AND'd words or regexps) and tell you how popular they are. This is particularly nice for those times you have to figure out which solution to use for e.g. a PDF reader or a VNC client. Substitute "ubuntu.com" for "debian.org" if you want this to use Ubuntu's data instead. Everything else will work perfectly. Show Sample Output

apt-popcon() { (echo \#rank; apt-cache search "$@" |awk '$1 !~ /^lib/ {print " "$1" "}') |grep -Ff- <(wget -qqO- http://popcon.debian.org/by_inst.gz |gunzip); }

adamhotep · 2012-09-08 00:29:31 4

‹ First < 4 5 6 7 8 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Salvage a borked terminal

This works in some situations where 'reset' and the other alternatives don't.

list with full path

List the full path of some files. You can add ".*" on the end if you want to display hidden files.

Sort files by date

Show you the list of files of current directory sorted by date youngest to oldest, remove the 'r' if you want it in the otherway.

Remove annoying OS X DS_Store folders

Recursively removes all those hidden .DS_Store folders starting in current working directory.

mkdir & cd into it as single command

The biggest advantage of this over the functions is that it is portable.

Does a traceroute. Lookup and display the network or AS names and AS numbers.

From the man page. lft ? display the route packets take to a network host/socket using one of several layer-4 protocols and methods; optionally show heuristic network information in transitu -A Enable lookup and display of of AS (autonomous system) numbers (e.g., [1]). This option queries one of several whois servers (see options 'C' and 'r') in order to ascertain the origin ASN of the IP address in question. By default, LFT uses the pWhoIs service whose ASN data tends to be more accurate and more timely than using the RADB as it is derived from the Internet's global routing table. -N Enable lookup and display of network or AS names (e.g., [GNTY-NETBLK-4]). This option queries Prefix WhoIs, RIPE NCC, or the RADB (as requested). In the case of Prefix WhoIs or RADB, the network name is displayed. In the case of RIPE NCC, the AS name is displayed.

Skip filenames with control characters, a.k.a tab,newline etc

Watch Network Service Activity in Real-time

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Schedule Nice Background Commands That Won't Die on Logout - Alternative to nohup and at

Check out the usage of 'trap', you may not have seen this one much. This command provides a way to schedule commands at certain times by running them after sleep finishes sleeping. In the example 'sleep 2h' sleeps for 2 hours. What is cool about this command is that it uses the 'trap' builtin bash command to remove the SIGHUP trap that normally exits all processes started by the shell upon logout. The 'trap 1' command then restores the normal SIGHUP behaviour. It also uses the 'nice -n 19' command which causes the sleep process to be run with minimal CPU. Further, it runs all the commands within the 2nd parentheses in the background. This is sweet cuz you can fire off as many of these as you want. Very helpful for shell scripts.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by