Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Revert all modified files in an SVN repo

This command allows you to revert every modified file one-by-one in a while loop, but also after "echo $file;" you can do any sort of processing you might want to add before the revert happens. Show Sample Output
This is sample output - yours may be different.
```
my/files.txt
Reverted 'my/files.txt'
```
0

svn status | grep "^M" | while read entry; do file=`echo $entry | awk '{print $2}'`; echo $file; svn revert $file; done

wsams · 2012-06-17 16:01:06 9
Number of connections per IP with range 24

cut -f1,2 - IP range 16 cut -f1,2,3 - IP range 24 cut -f1,2,3,4 - IP range 24 Show Sample Output
This is sample output - yours may be different.
```
      1 192.168.1.5
      5 192.168.1.2
      8 192.168.1.52
     15 192.168.1.3
     19 192.168.1.30
```
0

netstat -tn | grep :80 | awk '{print $5}'| grep -v ':80' | cut -f1 -d: |cut -f1,2,3 -d. | sort | uniq -c| sort -n

krishnan · 2012-06-26 08:29:37 3
Mute Master sound channel, printing only the percent volume
This is sample output - yours may be different.
0

amixer -c 0 set Master toggle | sed -n "$ p" | awk '{print $4}' | sed "s/[^0-9]//g"

dtsip · 2012-06-26 21:16:42 7
Unmuting master channel, printing only percent value, while suppressing other outputs
This is sample output - yours may be different.
0

amixer -c 0 set Master toggle | tail -1 | awk '{print $4}' | sed "s/[^0-9]//g" ; amixer -c 0 set Speaker toggle >/dev/null; amixer -c 0 set Front toggle >/dev/null

dtsip · 2012-06-26 21:18:07 5
Execute git submodule update in parallel with xargs
This is sample output - yours may be different.
0

git submodule status | awk '{print $2}' | xargs -P5 -n1 git submodule update --init

lox · 2012-06-27 19:26:56 3
Generate a password for website authentication that can be recreated each time you need to authenticate without saving the password

Create a bash function for easy reference webPassword() { echo $1 $2 | md5sum | awk '{print substr($0,0,10)}' } alias webpwd=webPassword Use like this. webpwd www.commandlinefu.com MyPetNameHere Show Sample Output
This is sample output - yours may be different.
```
$ echo http://www.TheWebSiteName.com privatekeyword | md5sum | awk '{print substr($0,0,10)}'

3ac2dd2389
```
0

echo http://www.TheWebSiteName.com privatekeyword | md5sum | awk '{print substr($0,0,10)}'

ertjies · 2012-06-28 11:32:08 3
Get the IP address
This is sample output - yours may be different.
0

ifconfig | grep "inet" | grep "broadcast" | awk '{print $2}'

wotan · 2012-07-13 01:24:42 3
Get the IP address

more variety
This is sample output - yours may be different.
0

ifconfig | grep "inet" | tail -1 | awk '{print $2}'

wotan · 2012-07-13 01:27:59 3
Get the IP address
This is sample output - yours may be different.
0

ip a s eth0 | awk '/inet / {print $2} | sed -e 's/\/..//g'

ilovespam · 2012-07-18 02:43:15 3
Get the IP address
This is sample output - yours may be different.
0

ip a s eth0 | awk -F"[/ ]+" '/inet / {print $3}'

ilovespam · 2012-07-18 02:47:12 3
Get Unique Hostnames from Apache Config Files

Get a list of all the unique hostnames from the apache configuration files. Handy to see what sites are running on a server. When i saw the command i had some ideas to make it shorter. Here is my version.
This is sample output - yours may be different.
0

egrep 'ServerAlias|ServerName' /etc/apache2/sites-enabled/*.conf | awk '{printf "%s\t%s\n",$2,$3}' | sed 's/www.//' | sort | uniq

staeff · 2012-07-25 12:51:15 3
Displays all the fields of a table, really usefull to run it inside editor (Emacs or vim)

You can execute this inside an editor to get all the fields inside your buffer and do the magic, really usefull when your tables contain a giant list of fields. Show Sample Output
This is sample output - yours may be different.
```
user@machine:~$ echo "describe information_schema.COLUMNS" | mysql -u root | awk '{print $1}' | grep -v Field
TABLE_CATALOG
TABLE_SCHEMA
TABLE_NAME
COLUMN_NAME
ORDINAL_POSITION
COLUMN_DEFAULT
IS_NULLABLE
DATA_TYPE
CHARACTER_MAXIMUM_LENGTH
CHARACTER_OCTET_LENGTH
NUMERIC_PRECISION
NUMERIC_SCALE
CHARACTER_SET_NAME
COLLATION_NAME
COLUMN_TYPE
COLUMN_KEY
EXTRA
PRIVILEGES
```
0

echo "DESCRIBE dbname.table_name" | mysql -u dbusername | awk '{print $1}' | grep -v Field

adauto · 2012-07-26 21:06:11 3
sum and average of requests responses times or sizes in Apache2 access log

Depending on your Apache access log configuration you may have to change the sum+=$11 to previous or next awk token. Beware, usually in access log last token is time of response in microseconds, penultimate token is size of response in bytes. You may use this command line to calculate sum and average of responses sizes. You can also refine the egrep regexp to match specific HTTP requests. Show Sample Output
This is sample output - yours may be different.
```
Tot=134020202(15201)
Avg=8816.54
```
0

egrep '.*(("STATUS)|("HEAD)).*' http_access.2012.07.18.log | awk '{sum+=$11; ++n} END {print "Tot="sum"("n")";print "Avg="sum/n}'

fanchok · 2012-07-27 12:18:29 3
Remove from PATH paths containing a string

If there are spaces won't work.
This is sample output - yours may be different.
0

export PATH= $(echo $PATH | tr ':' '\n' | awk '!/matching string/' | paste -sd:)

bugmenot · 2012-07-29 00:30:54 3

Display IP addresses Pidgin IM Client is connected to

lsof -p `pidof pidgin` | awk '{ print $9 }'|egrep `hostname` | grep -o ">[^:]\+:" | tr -d ":>" | while read line; do host $line; done;

NaN0 · 2012-08-08 14:47:20 3

Add executable bit to all shell scripts under current directory recursively.

Allows to change 'shell' compatible files execution bit even if their name is not *.sh
This is sample output - yours may be different.
0

find . -type f -exec file '{}' + | grep shell | awk -F':' '{print $1}' | xargs chmod u+x

llebegue · 2012-08-09 18:53:08 3
Kill all processes belonging to a user

Okay, commands like this are a bit of a personal peeve. awk(1) operates on a /pattern/ {action} paradigm and yet I see people leave out the /pattern/ portion of an awk command all the time, opting to use grep or sed instead. You'll save yourself some typing and time if you include the /pattern/ with your {action}.
This is sample output - yours may be different.
0

ps wwwwuax|awk '/command/ { printf("kill -9 %s\n",$2) }'|/bin/sh

jetdillo · 2012-08-14 21:44:38 4
Random (sfw, 1920x1080) wallpaper from wallbase.cc
This is sample output - yours may be different.
0

wget --no-use-server-timestamps $(curl $(curl http://wallbase.cc/random/23/eqeq/1920x1080/0/100/20 | grep 'wallpaper/' | awk -F'"' '{print $2}' | head -n1) | grep -A4 bigwall | grep img | awk -F'"' '{print $2}'); feh --bg-center $(ls -1t | head -n1)

yosh · 2012-08-14 22:06:27 3
Connected to first screen session created
This is sample output - yours may be different.
0

screen -x $(screen -ls | awk 'NR == 2 { print $1 }')

codecaine · 2012-08-17 02:03:26 4
list all available disks and disk partitions

grep -e "[sh]d[a-l]$" /proc/partitions | awk '{print $4}' # for disks only grep -e "[sh]d[a-l][0-9]\+" /proc/partitions | awk '{print $4}' # for partitions only Show Sample Output
This is sample output - yours may be different.
```
sda
sda1
sda2
sda3
sdb
sdb1
sdb2
sdb3
```
0

grep -e "[sh]d[a-l][0-9]\?" /proc/partitions | awk '{print $4}'

kro · 2012-08-17 13:15:46 6
Network Interfaces

Linux only Show Sample Output
This is sample output - yours may be different.
```
lo
eth0
```
0

awk '{print $1}' /proc/net/dev|grep :|sed "s/:.*//g"

kro · 2012-08-17 13:36:47 56

Look for free ip's in a given /24 subnet.

The command will make it easy to determine free IP ranges in a crowded sub-net. Show Sample Output

SUBNET="192.168.41" ; diff -y <(nmap -sP -n ${SUBNET}.0/24 | grep ${SUBNET}. | awk '{print $5}' | sort -t"." -k4 -n) <(for i in $(seq 1 254); do echo ${SUBNET}.$i; done)

michel_p · 2012-08-28 09:11:18 4

add untracked/changed items to a git repository before doing a commit and/or sending upstream

I came up with this because I don't have a problem remembering the big major changes I made deep inside my tree for a specific feature or bugfix but always manage to forget the trivial stuff I tweaked or touched along the way that needs to get pushed as well. Show Sample Output
This is sample output - yours may be different.
```
bash-3.2$ git status|awk '/modified:/ { printf("git add %s\n",$3) }; NF ==2 { printf("git add %s\n",$2) }'
git add Android/
git add Docs/
bash-3.2$bash-3.2$ git status
# On branch dev
# Changes to be committed:
#   (use "git reset HEAD <file>..." to unstage)
#
#       new file:   Android/.classpath
#       new file:   Android/.project
#       new file:   Android/AndroidManifest.xml
```
0

git status|awk '/modified:/ { printf("git add %s\n",$3) }; NF ==2 { printf("git add %s\n",$2) }'|sh

jetdillo · 2012-09-03 00:09:04 5

add untracked/changed items to a git repository before doing a commit and/or sending upstream

Uses the --porcelain option, which is garanteed to be stable among git versions and configurations - also, is way easier to parse. Show Sample Output

git status --porcelain | awk '{print $2}' | xargs git add

brandizzi · 2012-09-05 18:07:26 4

Get Current CPU Usage

Get the current cpu % usage on your system. Show Sample Output
This is sample output - yours may be different.
```
13.50
```
0

top -n2 -d 0.5 | grep ^Cpu | sed 's/[[:alpha:]%]*//g' | awk 'NR == 2 {printf("%.2f\n",100-$5)}'

wizzra · 2012-09-06 12:56:26 5
‹ First < 33 34 35 36 37 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

which program is this port belongs to ?

Sometimes you need to use a port that is already opened by some program , and you don't know who to "kill" for it to release - so, now you do !

Get the size of all the directories in current directory (Sorted Human Readable)

as per eightmillion's comment. Simply economical :)

Sort on multiple dis-contiguous keys/fields (can even specify key number/field from the end)

Notes: 1) -n-1 means sort key is the last field 2) -l is important if each separate record is on a new line (usually so for text files) 3) -j tells msort not to create log file (msort.log) in the working directory 4) may need to install msort package. 5) msort does lot more. Check man msort

Numeric zero padding file rename

This uses Perl's rename utility (you may have to call it as prename on your box) and won't choke on spaces or other characters in filenames. It will also zero pad a number even in filenames like "vacation-4.jpg".

updatedb for MAC OSX

MAC OSX doesn't come with an updatedb command by default, this will emulate the updatedb thats on a typical Linux OS. Simply add it to your ~/.bash_profile

How to trim a video using ffmpeg

Will trim the video to 4 seconds starting from the beginning. The -vcodec , -acodec options are required so that ffmpeg knows in what video/audio format you want for the new video.

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Stream YouTube URL directly to mplayer.

Streams youtube video with v=ID directly into the mplayer. If exists, it uses the HD-quality stream. If you don't want to watch it in HD-quality, you can use the shorter form: $ID=52DnUo6wJto; mplayer -fs $(echo "http://youtube.com/get_video.php?&video_id=$ID$(wget -qO - 'http://youtube.com/watch?v='$ID | perl -ne 'print $1."&asv=" if /^.*(&t=.*?)&.*$/')")

Remote Serial connection redirected over network using SSH

Requires software found at: http://lpccomp.bc.ca/remserial/ Remote [A] (with physical serial port connected to device) $./remserial -d -p 23000 -s "115200 raw" /dev/ttyS0 & Local [B] (running the program that needs to connect to serial device) Create a SSH tunnel to the remote server: $ssh -N -L 23000:localhost:23000 user@hostwithphysicalserialport Use the locally tunnelled port to connect the local virtual serial port to the remote real physical port: $./remserial -d -r localhost -p 23000 -l /dev/remser1 /dev/ptmx & Example: Running minicom on machine B using serial /dev/remser1 will actually connect you to whatever device is plugged into machine A's serial port /dev/ttyS0.

Start screen with name and run command

Runs an instance of screen with name of "name_me" and command of "echo "hi"" To reconnect to screen instance later use: screen -r name_me

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by