Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Get the revision number at which the current branch is created.
This is sample output - yours may be different.
-1

svn log --stop-on-copy | grep r[0-9] | awk '{print $1}' | sed "s/r//" | sort -n | head -1

jimthunderbird · 2010-10-07 21:21:20 3
Get just the IP for a hostname
This is sample output - yours may be different.
-1

host google.com|awk '{print $NF}'

aitilang · 2010-11-03 11:15:30 3
AWK: Set Field Separator from command line

Set field separator char from command line. Prints first, second and lsat columns. Show Sample Output
This is sample output - yours may be different.
```
Input:
Col1,Col2,Col3,[...],ColLast

Output:
Col1 Col2 ColLast
```
-1

awk 'BEGIN {FS=","} { print $1 " " $2 " " $NF}' foo.txt

EBAH · 2010-11-12 15:26:04 4
Find the uid and gid of your apache process

This command allows you to find the effective uid and gid of the Apache process regardless of process name (which can be apache2 or httpd depending on distro).
This is sample output - yours may be different.
-1

ps -o euid,egid --ppid `netstat --inet --inet6 -pln|awk '/:80 / { split($7,tmp, "/"); print tmp[1]; }'`|sort |uniq|grep -v EUID

chx · 2010-11-18 21:22:29 2

Used it on daily basis, not sure if it's any better than the OPs version, tho' One advantage is - you can replace 'bash' at the end of the line with eg. cat - to check if the generated command is OK. Show Sample Output

-1

mailq |awk '/MAILER-DAEMON/{gsub("*","");printf("postsuper -d %s\n",$1)}'|bash

unefunge · 2010-11-24 11:42:54 19

Print free memory
This is sample output - yours may be different.
-1

free -m | awk '/Mem/ {print $4}'

agudmund · 2010-11-29 13:31:55 6
print a cpu of a process
This is sample output - yours may be different.
-1

ps -eo args,%cpu | grep -m1 PROCESS | tr 'a-z-' ' ' | awk '{print $1}'

lin72 · 2010-11-29 17:43:52 4
turn off all services in specific runlevel

works in fedora, centos and presumably other distros that use chkconfig
This is sample output - yours may be different.
-1

for i in $(chkconfig --list | grep "4:on" | awk {'print $1'}); do chkconfig --level 4 "$i" off; done

m1cawber · 2011-01-25 03:54:43 6

transform several lines in one with Awk

remove all carriage return of a given file (or input, if used with | ) and replace them with a space (or whatever character is after %s) Show Sample Output

-1

awk ' { printf ("%s ", $0)} END {printf ("\n") } ' FILE

bouktin · 2011-02-02 11:51:41 6

pid list by httpd listen port

% lsof -v lsof version information: revision: 4.78
This is sample output - yours may be different.
-1

lsof | awk '/*:https?/{print $2}' | sort -u

sugitaro · 2011-02-04 01:37:17 3
Extract tags in a file
This is sample output - yours may be different.
-1

awk -vRS="</Tag2>" '/<Tag2>/{gsub(/.*<Tag2>/,"");print}' file

pathcl · 2011-02-20 00:23:47 3
collapse first five fields of Google Adwords export .tsv file into a single field

The exported TSV file of Google Adwords' first five columns are text, they usually should collapse into one cell, a multi-line text cell, but there is no guaranteed way to represent line-break within cells for .tsv file format, thus Google split it to 5 columns. The problem is, with 5 columns of text, there are hardly space to put additional fields while maintain printable output. This script collapses the first five columns of each row into one single multi-line text cell, for console output or direct send to printer.
This is sample output - yours may be different.
-1

awk -F $'\t' '{printf $1 LS $2 LS $3 LS $4 LS $5; for (i = 7; i < NF; i++) printf $i "\t"; printf "\n--\n";}' LS=$'\n' 'Ad report.tsv' | column -t -s $'\t'

zhangweiwu · 2011-02-28 10:52:16 4
List of syscalls (for 32/64 bits systems)
This is sample output - yours may be different.
-1

egrep '__NR_' /usr/include/asm/unistd_`getconf -a | awk '$1~/^WORD/{print $2}'`.h | sed -e 's/^#define __NR_//' | column -t

cicatriz · 2011-03-04 15:09:40 6
Generate MD5 of string and output only the hash checksum
This is sample output - yours may be different.
-1

echo -n "String to MD5" | md5sum | awk '{print $1}'

twjolson · 2011-03-05 02:37:28 4
this svn script will commit all files excluding those with extensions {.project .classpath .properties .sh .number} and those with Status Modified or Added {M or A}
This is sample output - yours may be different.
-1

svn st | grep -e [MA] | egrep -ve '.project|.classpath|.properties|.sh|.number' | awk -F' ' '{ print $2}' | xargs svn ci -m "message"

drunkcoder · 2011-03-10 15:32:36 6
List Seeon.tv Available Video Channels

This shows a list of channels from seeon.tv website to watch shows and movies
This is sample output - yours may be different.
-1

lynx --dump http://www.seeon.tv/channels| grep "/channels"|awk '{print $2}'|sort -u|while read links; do lynx --dump "$links"|awk '/view/ {print $2}'|sort -u; done

Bonster · 2011-04-01 05:58:20 5
Deletes all branches in a git repository except next and master (clean git repo)

This command will delete all branches in your git repository other than next and master. I use this to cleanup my git repos after making multiple branches and merging them back into next. It's much faster than individually deleting each expired branch using: git branch -D <branch_name>
This is sample output - yours may be different.
-1

git branch -D `git branch | awk '{ if ($0 !~ /next|master/) printf "%s", $0 }'`

denheck · 2011-04-14 17:43:21 4
Remove all unused kernels with apt-get

Same as 7272 but that one was too dangerous so i added -P to prompt users to continue or cancel Note the double space: "...^ii␣␣linux-image-2..." Like 5813, but fixes two bugs: [1]This leaves the meta-packages 'linux-headers-generic' and 'linux-image-generic' alone so that automatic upgrades work correctly in the future. [2]Kernels newer than the currently running one are left alone (this can happen if you didn't reboot after installing a new kernel).
This is sample output - yours may be different.
-1

sudo aptitude remove -P $(dpkg -l|awk '/^ii linux-image-2/{print $2}'|sed 's/linux-image-//'|awk -v v=`uname -r` 'v>$0'|sed 's/-generic//'|awk '{printf("linux-headers-%s\nlinux-headers-%s-generic\nlinux-image-%s-generic\n",$0,$0,$0)}')

Bonster · 2011-04-25 05:19:57 3
Count messages in mcabber history for each JID
This is sample output - yours may be different.
-1

for f in ~/.mcabber/histo/*; do a=`egrep "^(MR|MS)" $f | wc -l`; echo $f: $a | awk -F\/ '{print $6}'; done

aluminiumgeek · 2011-06-04 10:51:49 3

Clone all remote branches of a specific GitHub repository

Show Sample Output

-1

git branch -a | grep "remotes/origin" | grep -v master | awk -F / '{print $3}' | xargs -I % git clone -b % git://github.com/jamesotron/DevWorld-2010-Cocoa-Workshop %

evandrix · 2011-06-29 00:13:47 3

Find most used focal lengths in a directory of photos

First column is number of photos, second column is the focal length. Show Sample Output
This is sample output - yours may be different.
```
     17 17.0
      2 47.0
      1 50.0
      4 53.0
      6 78.0
      3 85.0
```
-1

exiv2 *JPG | grep Focal | awk '{print $5}' | sort -n | uniq -c

ivanatora · 2011-07-05 11:25:29 8
Remove annotation- (or other own-lined) tags from an XML document

Removes all lines between the lines containing "" and "", including these lines itself Backdrop: Sometimes when working with XML files without an graphical editor, large comment-/annotation-blocks taper the readability to walk through the file. I like to create a copy of such documents without these annotations. As the documentation itself is in documentation tags inside the annotation tags an therefore graphical editors tend to put the annotation tags in their own lines, this command removes all documentations within annotation-tags. Show Sample Output
This is sample output - yours may be different.
```
transforms:

<xsd:attribute name="version" type="xsd:string" use="required" fixed="1.0">
    <xsd:annotation>
        <xsd:documentation>This attribute denotes the version number ot the utilized XML-schema.</xsd:documentation>
    </xsd:annotation>
</xsd:attribute>

into:

<xsd:attribute name="version" type="xsd:string" use="required" fixed="1.0">
</xsd:attribute>
```
-1

awk "/<xsd:annotation>/{h=1};!h;/<\/xsd:annotation>/{h=0}" annotatedSchema.xsd

2chg · 2011-07-15 07:17:17 7
Display CPU usage in percentage
This is sample output - yours may be different.
-1

ps aux | awk {'sum+=$3;print sum'} | tail -n 1

tailot · 2011-07-16 16:16:59 3
Display only hosts up in network

Today many hosts are blocking traditional ICMP echo replay for an "security" reason, so nmap's fast ARP scan is more usable to view all live IPv4 devices around you. Must be root for ARP scanning.
This is sample output - yours may be different.
-1

nmap -sP -PR -oG - `/sbin/ip -4 addr show | awk '/inet/ {print $2}' | sed 1d`

l3k · 2011-07-21 11:50:26 3
All IP connected to my host

find all computer connected to my host through TCP connection Show Sample Output
This is sample output - yours may be different.
```
81.91.145.204
85.133.199.175
85.185.21.146
91.186.200.13
91.189.90.40
91.98.155.188
91.99.41.81
92.50.59.10
94.182.63.188
```
-1

netstat -nut | awk '$NF=="ESTABLISHED" {print $5}' | cut -d: -f1 | sort -u

bitbasher · 2011-07-27 07:24:10 3
‹ First < 48 49 50 51 52 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Put public IP address in a variable

list files recursively by size

Find Duplicate Files (based on size first, then MD5 hash)

for OS X

Scans for open ports using telnet

Efficient count files in directory (no recursion)

$ time perl -e 'if(opendir D,"."){@a=readdir D;print $#a - 1,"\n"}' 205413 real 0m0.497s user 0m0.220s sys 0m0.268s $ time { ls |wc -l; } 205413 real 0m3.776s user 0m3.340s sys 0m0.424s ********* ** EDIT: turns out this perl liner is mostly masturbation. this is slightly faster: $ find . -maxdepth 1 | wc -l sh-3.2$ time { find . -maxdepth 1|wc -l; } 205414 real 0m0.456s user 0m0.116s sys 0m0.328s ** EDIT: now a slightly faster perl version $ perl -e 'if(opendir D,"."){++$c foreach readdir D}print $c-1,"\n"' sh-3.2$ time perl -e 'if(opendir D,"."){++$c foreach readdir D}print $c-1,"\n"' 205414 real 0m0.415s user 0m0.176s sys 0m0.232s

Create a thumbnail from a video file

Check the current price of Bitcoin in USD

Find the most recently changed files (recursively)

user 'tr' to convert mixed case in a file to lower case

convert mixed case in a file to lower case

drop first column of output by piping to this

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by