Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Get the revision number at which the current branch is created.
This is sample output - yours may be different.
-1

svn log --stop-on-copy | grep r[0-9] | awk '{print $1}' | sed "s/r//" | sort -n | head -1

jimthunderbird · 2010-10-07 21:21:20 3
Get just the IP for a hostname
This is sample output - yours may be different.
-1

host google.com|awk '{print $NF}'

aitilang · 2010-11-03 11:15:30 3
AWK: Set Field Separator from command line

Set field separator char from command line. Prints first, second and lsat columns. Show Sample Output
This is sample output - yours may be different.
```
Input:
Col1,Col2,Col3,[...],ColLast

Output:
Col1 Col2 ColLast
```
-1

awk 'BEGIN {FS=","} { print $1 " " $2 " " $NF}' foo.txt

EBAH · 2010-11-12 15:26:04 4
Find the uid and gid of your apache process

This command allows you to find the effective uid and gid of the Apache process regardless of process name (which can be apache2 or httpd depending on distro).
This is sample output - yours may be different.
-1

ps -o euid,egid --ppid `netstat --inet --inet6 -pln|awk '/:80 / { split($7,tmp, "/"); print tmp[1]; }'`|sort |uniq|grep -v EUID

chx · 2010-11-18 21:22:29 2

Used it on daily basis, not sure if it's any better than the OPs version, tho' One advantage is - you can replace 'bash' at the end of the line with eg. cat - to check if the generated command is OK. Show Sample Output

-1

mailq |awk '/MAILER-DAEMON/{gsub("*","");printf("postsuper -d %s\n",$1)}'|bash

unefunge · 2010-11-24 11:42:54 19

Print free memory
This is sample output - yours may be different.
-1

free -m | awk '/Mem/ {print $4}'

agudmund · 2010-11-29 13:31:55 6
print a cpu of a process
This is sample output - yours may be different.
-1

ps -eo args,%cpu | grep -m1 PROCESS | tr 'a-z-' ' ' | awk '{print $1}'

lin72 · 2010-11-29 17:43:52 4
turn off all services in specific runlevel

works in fedora, centos and presumably other distros that use chkconfig
This is sample output - yours may be different.
-1

for i in $(chkconfig --list | grep "4:on" | awk {'print $1'}); do chkconfig --level 4 "$i" off; done

m1cawber · 2011-01-25 03:54:43 6

transform several lines in one with Awk

remove all carriage return of a given file (or input, if used with | ) and replace them with a space (or whatever character is after %s) Show Sample Output

-1

awk ' { printf ("%s ", $0)} END {printf ("\n") } ' FILE

bouktin · 2011-02-02 11:51:41 6

pid list by httpd listen port

% lsof -v lsof version information: revision: 4.78
This is sample output - yours may be different.
-1

lsof | awk '/*:https?/{print $2}' | sort -u

sugitaro · 2011-02-04 01:37:17 3
Extract tags in a file
This is sample output - yours may be different.
-1

awk -vRS="</Tag2>" '/<Tag2>/{gsub(/.*<Tag2>/,"");print}' file

pathcl · 2011-02-20 00:23:47 3
collapse first five fields of Google Adwords export .tsv file into a single field

The exported TSV file of Google Adwords' first five columns are text, they usually should collapse into one cell, a multi-line text cell, but there is no guaranteed way to represent line-break within cells for .tsv file format, thus Google split it to 5 columns. The problem is, with 5 columns of text, there are hardly space to put additional fields while maintain printable output. This script collapses the first five columns of each row into one single multi-line text cell, for console output or direct send to printer.
This is sample output - yours may be different.
-1

awk -F $'\t' '{printf $1 LS $2 LS $3 LS $4 LS $5; for (i = 7; i < NF; i++) printf $i "\t"; printf "\n--\n";}' LS=$'\n' 'Ad report.tsv' | column -t -s $'\t'

zhangweiwu · 2011-02-28 10:52:16 4
List of syscalls (for 32/64 bits systems)
This is sample output - yours may be different.
-1

egrep '__NR_' /usr/include/asm/unistd_`getconf -a | awk '$1~/^WORD/{print $2}'`.h | sed -e 's/^#define __NR_//' | column -t

cicatriz · 2011-03-04 15:09:40 6
Generate MD5 of string and output only the hash checksum
This is sample output - yours may be different.
-1

echo -n "String to MD5" | md5sum | awk '{print $1}'

twjolson · 2011-03-05 02:37:28 4
this svn script will commit all files excluding those with extensions {.project .classpath .properties .sh .number} and those with Status Modified or Added {M or A}
This is sample output - yours may be different.
-1

svn st | grep -e [MA] | egrep -ve '.project|.classpath|.properties|.sh|.number' | awk -F' ' '{ print $2}' | xargs svn ci -m "message"

drunkcoder · 2011-03-10 15:32:36 6
List Seeon.tv Available Video Channels

This shows a list of channels from seeon.tv website to watch shows and movies
This is sample output - yours may be different.
-1

lynx --dump http://www.seeon.tv/channels| grep "/channels"|awk '{print $2}'|sort -u|while read links; do lynx --dump "$links"|awk '/view/ {print $2}'|sort -u; done

Bonster · 2011-04-01 05:58:20 5
Deletes all branches in a git repository except next and master (clean git repo)

This command will delete all branches in your git repository other than next and master. I use this to cleanup my git repos after making multiple branches and merging them back into next. It's much faster than individually deleting each expired branch using: git branch -D <branch_name>
This is sample output - yours may be different.
-1

git branch -D `git branch | awk '{ if ($0 !~ /next|master/) printf "%s", $0 }'`

denheck · 2011-04-14 17:43:21 4
Remove all unused kernels with apt-get

Same as 7272 but that one was too dangerous so i added -P to prompt users to continue or cancel Note the double space: "...^ii␣␣linux-image-2..." Like 5813, but fixes two bugs: [1]This leaves the meta-packages 'linux-headers-generic' and 'linux-image-generic' alone so that automatic upgrades work correctly in the future. [2]Kernels newer than the currently running one are left alone (this can happen if you didn't reboot after installing a new kernel).
This is sample output - yours may be different.
-1

sudo aptitude remove -P $(dpkg -l|awk '/^ii linux-image-2/{print $2}'|sed 's/linux-image-//'|awk -v v=`uname -r` 'v>$0'|sed 's/-generic//'|awk '{printf("linux-headers-%s\nlinux-headers-%s-generic\nlinux-image-%s-generic\n",$0,$0,$0)}')

Bonster · 2011-04-25 05:19:57 3
Count messages in mcabber history for each JID
This is sample output - yours may be different.
-1

for f in ~/.mcabber/histo/*; do a=`egrep "^(MR|MS)" $f | wc -l`; echo $f: $a | awk -F\/ '{print $6}'; done

aluminiumgeek · 2011-06-04 10:51:49 3

Clone all remote branches of a specific GitHub repository

Show Sample Output

-1

git branch -a | grep "remotes/origin" | grep -v master | awk -F / '{print $3}' | xargs -I % git clone -b % git://github.com/jamesotron/DevWorld-2010-Cocoa-Workshop %

evandrix · 2011-06-29 00:13:47 3

Find most used focal lengths in a directory of photos

First column is number of photos, second column is the focal length. Show Sample Output
This is sample output - yours may be different.
```
     17 17.0
      2 47.0
      1 50.0
      4 53.0
      6 78.0
      3 85.0
```
-1

exiv2 *JPG | grep Focal | awk '{print $5}' | sort -n | uniq -c

ivanatora · 2011-07-05 11:25:29 8
Remove annotation- (or other own-lined) tags from an XML document

Removes all lines between the lines containing "" and "", including these lines itself Backdrop: Sometimes when working with XML files without an graphical editor, large comment-/annotation-blocks taper the readability to walk through the file. I like to create a copy of such documents without these annotations. As the documentation itself is in documentation tags inside the annotation tags an therefore graphical editors tend to put the annotation tags in their own lines, this command removes all documentations within annotation-tags. Show Sample Output
This is sample output - yours may be different.
```
transforms:

<xsd:attribute name="version" type="xsd:string" use="required" fixed="1.0">
    <xsd:annotation>
        <xsd:documentation>This attribute denotes the version number ot the utilized XML-schema.</xsd:documentation>
    </xsd:annotation>
</xsd:attribute>

into:

<xsd:attribute name="version" type="xsd:string" use="required" fixed="1.0">
</xsd:attribute>
```
-1

awk "/<xsd:annotation>/{h=1};!h;/<\/xsd:annotation>/{h=0}" annotatedSchema.xsd

2chg · 2011-07-15 07:17:17 7
Display CPU usage in percentage
This is sample output - yours may be different.
-1

ps aux | awk {'sum+=$3;print sum'} | tail -n 1

tailot · 2011-07-16 16:16:59 3
Display only hosts up in network

Today many hosts are blocking traditional ICMP echo replay for an "security" reason, so nmap's fast ARP scan is more usable to view all live IPv4 devices around you. Must be root for ARP scanning.
This is sample output - yours may be different.
-1

nmap -sP -PR -oG - `/sbin/ip -4 addr show | awk '/inet/ {print $2}' | sed 1d`

l3k · 2011-07-21 11:50:26 3
All IP connected to my host

find all computer connected to my host through TCP connection Show Sample Output
This is sample output - yours may be different.
```
81.91.145.204
85.133.199.175
85.185.21.146
91.186.200.13
91.189.90.40
91.98.155.188
91.99.41.81
92.50.59.10
94.182.63.188
```
-1

netstat -nut | awk '$NF=="ESTABLISHED" {print $5}' | cut -d: -f1 | sort -u

bitbasher · 2011-07-27 07:24:10 3
‹ First < 48 49 50 51 52 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Simple Comment an entire file

With this simple sed command we can easily comment and entire file.

Scale,Rotate, brightness, contrast,...with Image Magick

$rotate: the rotate angle $width, $height: width and height to scale to $birghtness: change brighness

find all active IP addresses in a network

Show directories in the PATH, one per line

Shorter version.

Watch the progress of 'dd'

This version was mentioned in the comments. Credits go to flatcap.

HourGlass

Displays an animated hourglass for x amount of seconds

Get decimal ascii code from character

the shortest command for character 'a' i know

replace spaces in filenames with underscores

This command will replace all the spaces in all the filenames of the current directory with underscores. There are other commands that do this here, but this one is the easiest and shortest.

split a file by a specific number of lines

Splits the file "my_file" every 500 lines. Will create files called xx01 xx02 and so on. You can change the prefix by using the -f option. Comes in handy for splitting logfiles for example. I am using it for feeding a logfile parser with smaller files instead of one big file (due to performance reasons)

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by