Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Get a text on a position on the file and store in a variable
This is sample output - yours may be different.
-1

TIMEUNIT=$(awk '/timescale/{print NR}' a)

arcege · 2009-10-28 12:12:37 3
Get column names in MySQL

Useful when you need to write e.g. an INSERT for a table with a large number of columns. This command will retrieve the column names and comma-separate them ready for INSERT INTO(...), removing the last comma.
This is sample output - yours may be different.
-1

mysql -u <user> --password=<password> -e "SHOW COLUMNS FROM <table>" <database> | awk '{print $1}' | tr "\n" "," | sed 's/,$//g'

maxmanders · 2009-10-29 13:42:17 3
force change password for all user
This is sample output - yours may be different.
-1

for i in `cat /etc/passwd | awk -F : '{ print $1 }';`; do passwd -e $i; done

irraz · 2009-11-11 13:01:22 3
kalarm 1 per minute simplest e-mail beacom for Geovision surveillance DVR

I have a custmer's Geovision DVR installed on a closed proxi (only logme-in reaches it). I have to check for reliability but logmein hangs and is too slow a process I made the Geovision software send e-mail every minute to the www.spam.la site. All this script does is to retrieve the e-mail header from spam.la ( no login!), filtering sender, stopping at the first occurrence of the word "secs" ( the age of the last e-mail ). The result is the age of the sender's last e-mail, tiny published on top of my screen once a minute. I can refresh www.spam.la via web browser, but have other things to do. I use it inside Kalarm ( kde task schedule ) set to 1 minute repeat. It can be done without kalarm, using Watch outside the script. Try it out now using my account = geo1 ( change sender by geo1 in this script) Needs curl , osd-bin
This is sample output - yours may be different.
-1

curl http://www.spam.la/?f=sender | grep secs| awk '{print; exit}' | osd_cat -i 40 -d 30 -l 2

m33600 · 2009-11-12 21:33:06 5
Match a URL

don't have to be that complicated
This is sample output - yours may be different.
-1

cho "(Something like http://foo.com/blah_blah)" | awk '{for(i=1;i<=NF;i++){if($i~/^(http|ftp):\/\//)print $i}}'

unixmonkey7109 · 2009-11-28 03:31:41 6
View the newest xkcd comic.

Same thing just a different way to get there. You will need lynx
This is sample output - yours may be different.
-1

lynx --dump --source http://www.xkcd.com | grep `lynx --dump http://www.xkcd.com | egrep '(png|jpg)'` | grep title | cut -d = -f2,3 | cut -d '"' -f2,4 | sed -e 's/"/|/g' | awk -F"|" ' { system("display " $1);system("echo "$2); } '

solarislackware · 2009-12-03 18:53:57 3
Return IP Address

Tested on Solaris.
This is sample output - yours may be different.
-1

/usr/sbin/ifconfig -a|awk -F" " 'NR==4{print $2}'

elZaphod · 2009-12-04 18:41:29 4
Show Network IP and Subnet

same thing as the other
This is sample output - yours may be different.
-1

ipcalc $(ifconfig eth0 | grep "inet addr:" | cut -d':' -f2,4 | sed 's/.+Bcast:/\//g') | awk '/Network/ { print $2 } '

solarislackware · 2009-12-05 15:00:32 3
Every Nth line position # (AWK)

awk extract every nth line. Generic is: awk '{if (NR % LINE == POSITION) print $0}' foo where "last" position is always 0 (zero). Show Sample Output
This is sample output - yours may be different.
```
$ awk '{if (NR % 3 == 1) print $0}' blah1
1
4
7

$ awk '{if (NR % 3 == 2) print $0}' blah1
2
5
8

$ awk '{if (NR % 3 == 0) print $0}' blah1
3
6
9
```
-1

awk '{if (NR % 3 == 1) print $0}' foo > foo_every3_position1; awk '{if (NR % 3 == 2) print $0}' foo > foo_every3_position2; awk '{if (NR % 3 == 0) print $0}' foo > foo_every3_position3

oshazard · 2010-01-08 04:20:06 4
open new tab without in gnome-terminal

open a new tab in active gnome-terminal instance needs sudo apt-get install xdotool and sudo apt-get install wmctrl
This is sample output - yours may be different.
-1

WID=xprop -root | grep "_NET_ACTIVE_WINDOW(WINDOW)"| awk '{print $5}' xdotool windowfocus $WID xdotool key ctrl+shift+t wmctrl -i -a $WID

drunkcoder · 2010-03-22 08:34:24 7
output one file per line

Problem: you want to output one line per file. you can't just 'tr -d' because you want one line per file and you don't want to use a loop. Solution: use awk to print each line without the record separator and a newline after each file. Show Sample Output
This is sample output - yours may be different.
```
$ cat a.txt
line1
line2
line3
$ cat b.txt
foo
bar
baz
$ awk 'BEGIN{ORS=""}NR!=1&&FNR==1{print "\n"}{print}END{print "\n"}' a.txt b.txt
line1line2line3
foobarbaz
```
-1

awk 'BEGIN{ORS=""}NR!=1&&FNR==1{print "\n"}{print}END{print "\n"}' *.txt

recursiverse · 2010-05-24 19:22:35 8
Kill processes hogging up CPU (Flash after resume)

I found Flash eating one of my CPUs after resume, the command above will help with that. For optional kicks you can put it into a script in /etc/pm/sleep.d/ (aspect in #swhack wrote this for me)
This is sample output - yours may be different.
-1

top -bn 1 | awk '{if($1 ~ /^[0-9]+$/ && $9 > 97) {print $1;exit}}'|xargs kill

chx · 2010-06-02 13:51:40 5
calculate the total size of files in specified directory (in Megabytes)

the command will not include hidden files Show Sample Output
This is sample output - yours may be different.
```
$ls -l | awk 'BEGIN { SUM=0 } { SUM+=$5 } END { print SUM/1024/1024"M" }'
11.35349M
```
-1

ls -l directory | awk 'BEGIN { SUM=0 } { SUM+=$5 } END { print SUM/1024/1024"M" }'

emacs · 2010-06-04 01:51:04 3
List of commands you use most often

This alternative cleans HISTTIMEFORMAT environment variable and calls gnuplot just after /tmp/cmds is closed, to avoid some errors.
This is sample output - yours may be different.
-1

HISTTIMEFORMAT='' history | awk '{a[$2]++}END{for(i in a){print a[i] " " i}}' | sort -rn | head > /tmp/cmds ; gnuplot -persist <<<'plot "/tmp/cmds" using 1:xticlabels(2) with boxes'

narcelio · 2010-06-17 17:38:16 3
Quickly check a device in a LVM volume group against multipath

This is an easy way to quickly get a status for a device in multipath on SLES systems, as long as the server is configured based on Novell's standards, where multipathed disks are referred to by /dev/disk/by-... tree. Make sure to replace name_of_vg with your Volume Group name.
This is sample output - yours may be different.
-1

pvscan | awk '/name_of_vg/ {print $2}' | sed 's/[-|/|]/ /g' | cut -d " " -f7

slashdot · 2010-06-22 16:34:42 3

print statistics about users' connect time

'ac' is included in the package 'acct', which is described as "The GNU Accounting utilities for process and login accounting". Other interesting flags are: * print statistics for a specified user ac -d username * print statistics for all the users ac -p With my command, the output is also printed in a sexagesimal, more readable, style. Show Sample Output

-1

ac -d | awk '{h=int($NF); m=($NF-h)*60; s=int((m-int(m))*60); m=int(m); print $0" = "h"h "m"m "s"s "}'

karpoke · 2010-06-24 08:08:41 7

Delete the \n character at the end of file
This is sample output - yours may be different.
-1

awk 'BEGIN { ARGV[ARGC++]=ARGV[ARGC-1] } NR!=FNR { if(num==0) num=NR-1; if(FNR<num) {print} else { ORS=""; print } } ' abc1.txt > abc2.txt

kevintse · 2010-06-26 13:08:33 5
Find default gateway

Find your default gateway and print it directly output. http://www.bayner.com/ kerim@bayner.com Show Sample Output
This is sample output - yours may be different.
```
192.168.1.1
```
-1

ip route show | awk '$3 ~ /^[1-9]+/ {print $3;}'

kerim · 2010-08-08 23:57:23 3
Find default gateway
This is sample output - yours may be different.
-1

route -n | grep "^0\." | awk '{print "Gateway to the World: "$2", via "$NF""}'

bandie91 · 2010-08-09 11:55:37 26
Find default gateway

Tested on CentOS, Ubuntu, and MacOS.
This is sample output - yours may be different.
-1

netstat -rn | awk '/UG/{print $2}'

putnamhill · 2010-08-09 15:56:02 5
Restore individual table from mysqldump backup.

This will look through file and print the data in between the pattern matches. It's great for restoring tables from a mysqldump backup. You can then import it back into your database with: mysql -u <user> -h <host> <database> < restored_table.sql
This is sample output - yours may be different.
-1

awk '/Table structure for table .table01./,/Table structure for table .table02./{print}' <file> > restored_table.sql

din7 · 2010-08-09 18:23:13 3
View the newest xkcd comic.

Shorter version with curl and awk
This is sample output - yours may be different.
-1

eog `curl 'http://xkcd.com/' | awk -F "ng): |</h" '/embedding/{print $2}'`

dog · 2010-08-25 14:04:30 3
Switch to windows using gpicker

Require wmctrl and gpicker and an EWMH/NetWM compatible X Window Manager
This is sample output - yours may be different.
-1

wmctrl -i -a `wmctrl -l -x | gpicker -d "\n" -n "\n" - | awk '{print $1}'`

Iany · 2010-08-30 02:19:43 4
Sum up total size and count of all certain filename pattern/regex
This is sample output - yours may be different.
-1

find -regextype posix-egrep -regex ".*/[A-Z]{3}_201009[0-9]{2}.*" -printf "%f %s\n" | awk '{ SUM += $2;COUNT++ } END { print SUM/1024 " kb in " COUNT " files" }'

taintedkernel · 2010-09-21 15:41:45 3
Greets the user appropriately
This is sample output - yours may be different.
-1

echo -e "12 morning\n15 afternoon\n24 evening" | awk '{if ('`date +%H`' < $1) print "Good " $2}'

bazardeur · 2010-09-24 21:15:23 4
‹ First < 47 48 49 50 51 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Edit a file on a remote host using vim

Stream YouTube URL directly to mplayer.

This is the result of a several week venture without X. I found myself totally happy without X (and by extension without flash) and was able to do just about anything but watch YouTube videos... so this a the solution I came up with for that. I am sure this can be done better but this does indeed work... and tends to work far better than YouTube's ghetto proprietary flash player ;-) Replace $i with any YouTube ID you want and this will scrape the site for the _real_ URL to the full quality .FLV file on Youtube's server and will then will hand that over to mplayer (or vlc or whatever you want) to be streamed. In some browsers you can replace $i with just a % or put this in a shell script so all YouTube IDs can be handed directly off to your media player of choice for true streaming without the need for Flash or a downloader like clive. (I do however fully recommend clive if you wish to archive videos instead of streaming them) If any interest is shown I would be more than happy to provide similar commands for other sites. Most streaming flash players use similar logic to YouTube. Edit: 05/03/2011 - Updated line to work with current YouTube. It could be a lot prettier but I will probably follow up with another update when I figure out how to get rid of that pesky Grep. Sed should take that syntax... but it doesn't. Original (no longer working) command: mplayer -fs $(echo "http://youtube.com/get_video.php?$(curl -s $youtube_url | sed -n "/watch_fullscreen/s;.*$video_id.\+$&title.*;\1;p")")

processes per user counter

enumerates the number of processes for each user. ps BSD format is used here , for standard Unix format use : ps -eLf |awk '{$1} {++P[$1]} END {for(a in P) if (a !="UID") print a,P[a]}'

Capture video of a linux desktop

This is identical to the original command, but allows you to specify an offset if you have multiple monitors. In this case you'll record a 1366x768 window that's offset by 1366 pixels in the x axis and 0 pixels in the y axis. Note also that the -sameq option has been replaced by -qscale - at least in ffmpeg version 1.2.1 on Fedora 19.

Runs previous command replacing foo by bar every time that foo appears

Very useful for rerunning a long command changing some arguments globally. As opposed to ^foo^bar, which only replaces the first occurrence of foo, this one changes every occurrence.

trace http requests with tshark

trace http requests on the specified interface. uses the amazing tshark tool (http://www.wireshark.org/docs/man-pages/tshark.html)

run command on a group of nodes in parallel

Bypass with hexencoding, dump /etc/passwd

AWK Calculator

Remove newlines from output

?Cat and grep? You can use only grep ("grep \. filename"). Better option is awk.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by