Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Get the revision number at which the current branch is created.
This is sample output - yours may be different.
-1

svn log --stop-on-copy | grep r[0-9] | awk '{print $1}' | sed "s/r//" | sort -n | head -1

jimthunderbird · 2010-10-07 21:21:20 3
Get just the IP for a hostname
This is sample output - yours may be different.
-1

host google.com|awk '{print $NF}'

aitilang · 2010-11-03 11:15:30 3
AWK: Set Field Separator from command line

Set field separator char from command line. Prints first, second and lsat columns. Show Sample Output
This is sample output - yours may be different.
```
Input:
Col1,Col2,Col3,[...],ColLast

Output:
Col1 Col2 ColLast
```
-1

awk 'BEGIN {FS=","} { print $1 " " $2 " " $NF}' foo.txt

EBAH · 2010-11-12 15:26:04 4
Find the uid and gid of your apache process

This command allows you to find the effective uid and gid of the Apache process regardless of process name (which can be apache2 or httpd depending on distro).
This is sample output - yours may be different.
-1

ps -o euid,egid --ppid `netstat --inet --inet6 -pln|awk '/:80 / { split($7,tmp, "/"); print tmp[1]; }'`|sort |uniq|grep -v EUID

chx · 2010-11-18 21:22:29 2

Used it on daily basis, not sure if it's any better than the OPs version, tho' One advantage is - you can replace 'bash' at the end of the line with eg. cat - to check if the generated command is OK. Show Sample Output

-1

mailq |awk '/MAILER-DAEMON/{gsub("*","");printf("postsuper -d %s\n",$1)}'|bash

unefunge · 2010-11-24 11:42:54 19

Print free memory
This is sample output - yours may be different.
-1

free -m | awk '/Mem/ {print $4}'

agudmund · 2010-11-29 13:31:55 6
print a cpu of a process
This is sample output - yours may be different.
-1

ps -eo args,%cpu | grep -m1 PROCESS | tr 'a-z-' ' ' | awk '{print $1}'

lin72 · 2010-11-29 17:43:52 4
turn off all services in specific runlevel

works in fedora, centos and presumably other distros that use chkconfig
This is sample output - yours may be different.
-1

for i in $(chkconfig --list | grep "4:on" | awk {'print $1'}); do chkconfig --level 4 "$i" off; done

m1cawber · 2011-01-25 03:54:43 6

transform several lines in one with Awk

remove all carriage return of a given file (or input, if used with | ) and replace them with a space (or whatever character is after %s) Show Sample Output

-1

awk ' { printf ("%s ", $0)} END {printf ("\n") } ' FILE

bouktin · 2011-02-02 11:51:41 6

pid list by httpd listen port

% lsof -v lsof version information: revision: 4.78
This is sample output - yours may be different.
-1

lsof | awk '/*:https?/{print $2}' | sort -u

sugitaro · 2011-02-04 01:37:17 3
Extract tags in a file
This is sample output - yours may be different.
-1

awk -vRS="</Tag2>" '/<Tag2>/{gsub(/.*<Tag2>/,"");print}' file

pathcl · 2011-02-20 00:23:47 3
collapse first five fields of Google Adwords export .tsv file into a single field

The exported TSV file of Google Adwords' first five columns are text, they usually should collapse into one cell, a multi-line text cell, but there is no guaranteed way to represent line-break within cells for .tsv file format, thus Google split it to 5 columns. The problem is, with 5 columns of text, there are hardly space to put additional fields while maintain printable output. This script collapses the first five columns of each row into one single multi-line text cell, for console output or direct send to printer.
This is sample output - yours may be different.
-1

awk -F $'\t' '{printf $1 LS $2 LS $3 LS $4 LS $5; for (i = 7; i < NF; i++) printf $i "\t"; printf "\n--\n";}' LS=$'\n' 'Ad report.tsv' | column -t -s $'\t'

zhangweiwu · 2011-02-28 10:52:16 4
List of syscalls (for 32/64 bits systems)
This is sample output - yours may be different.
-1

egrep '__NR_' /usr/include/asm/unistd_`getconf -a | awk '$1~/^WORD/{print $2}'`.h | sed -e 's/^#define __NR_//' | column -t

cicatriz · 2011-03-04 15:09:40 6
Generate MD5 of string and output only the hash checksum
This is sample output - yours may be different.
-1

echo -n "String to MD5" | md5sum | awk '{print $1}'

twjolson · 2011-03-05 02:37:28 4
this svn script will commit all files excluding those with extensions {.project .classpath .properties .sh .number} and those with Status Modified or Added {M or A}
This is sample output - yours may be different.
-1

svn st | grep -e [MA] | egrep -ve '.project|.classpath|.properties|.sh|.number' | awk -F' ' '{ print $2}' | xargs svn ci -m "message"

drunkcoder · 2011-03-10 15:32:36 6
List Seeon.tv Available Video Channels

This shows a list of channels from seeon.tv website to watch shows and movies
This is sample output - yours may be different.
-1

lynx --dump http://www.seeon.tv/channels| grep "/channels"|awk '{print $2}'|sort -u|while read links; do lynx --dump "$links"|awk '/view/ {print $2}'|sort -u; done

Bonster · 2011-04-01 05:58:20 5
Deletes all branches in a git repository except next and master (clean git repo)

This command will delete all branches in your git repository other than next and master. I use this to cleanup my git repos after making multiple branches and merging them back into next. It's much faster than individually deleting each expired branch using: git branch -D <branch_name>
This is sample output - yours may be different.
-1

git branch -D `git branch | awk '{ if ($0 !~ /next|master/) printf "%s", $0 }'`

denheck · 2011-04-14 17:43:21 4
Remove all unused kernels with apt-get

Same as 7272 but that one was too dangerous so i added -P to prompt users to continue or cancel Note the double space: "...^ii␣␣linux-image-2..." Like 5813, but fixes two bugs: [1]This leaves the meta-packages 'linux-headers-generic' and 'linux-image-generic' alone so that automatic upgrades work correctly in the future. [2]Kernels newer than the currently running one are left alone (this can happen if you didn't reboot after installing a new kernel).
This is sample output - yours may be different.
-1

sudo aptitude remove -P $(dpkg -l|awk '/^ii linux-image-2/{print $2}'|sed 's/linux-image-//'|awk -v v=`uname -r` 'v>$0'|sed 's/-generic//'|awk '{printf("linux-headers-%s\nlinux-headers-%s-generic\nlinux-image-%s-generic\n",$0,$0,$0)}')

Bonster · 2011-04-25 05:19:57 3
Count messages in mcabber history for each JID
This is sample output - yours may be different.
-1

for f in ~/.mcabber/histo/*; do a=`egrep "^(MR|MS)" $f | wc -l`; echo $f: $a | awk -F\/ '{print $6}'; done

aluminiumgeek · 2011-06-04 10:51:49 3

Clone all remote branches of a specific GitHub repository

Show Sample Output

-1

git branch -a | grep "remotes/origin" | grep -v master | awk -F / '{print $3}' | xargs -I % git clone -b % git://github.com/jamesotron/DevWorld-2010-Cocoa-Workshop %

evandrix · 2011-06-29 00:13:47 3

Find most used focal lengths in a directory of photos

First column is number of photos, second column is the focal length. Show Sample Output
This is sample output - yours may be different.
```
     17 17.0
      2 47.0
      1 50.0
      4 53.0
      6 78.0
      3 85.0
```
-1

exiv2 *JPG | grep Focal | awk '{print $5}' | sort -n | uniq -c

ivanatora · 2011-07-05 11:25:29 8
Remove annotation- (or other own-lined) tags from an XML document

Removes all lines between the lines containing "" and "", including these lines itself Backdrop: Sometimes when working with XML files without an graphical editor, large comment-/annotation-blocks taper the readability to walk through the file. I like to create a copy of such documents without these annotations. As the documentation itself is in documentation tags inside the annotation tags an therefore graphical editors tend to put the annotation tags in their own lines, this command removes all documentations within annotation-tags. Show Sample Output
This is sample output - yours may be different.
```
transforms:

<xsd:attribute name="version" type="xsd:string" use="required" fixed="1.0">
    <xsd:annotation>
        <xsd:documentation>This attribute denotes the version number ot the utilized XML-schema.</xsd:documentation>
    </xsd:annotation>
</xsd:attribute>

into:

<xsd:attribute name="version" type="xsd:string" use="required" fixed="1.0">
</xsd:attribute>
```
-1

awk "/<xsd:annotation>/{h=1};!h;/<\/xsd:annotation>/{h=0}" annotatedSchema.xsd

2chg · 2011-07-15 07:17:17 7
Display CPU usage in percentage
This is sample output - yours may be different.
-1

ps aux | awk {'sum+=$3;print sum'} | tail -n 1

tailot · 2011-07-16 16:16:59 3
Display only hosts up in network

Today many hosts are blocking traditional ICMP echo replay for an "security" reason, so nmap's fast ARP scan is more usable to view all live IPv4 devices around you. Must be root for ARP scanning.
This is sample output - yours may be different.
-1

nmap -sP -PR -oG - `/sbin/ip -4 addr show | awk '/inet/ {print $2}' | sed 1d`

l3k · 2011-07-21 11:50:26 3
All IP connected to my host

find all computer connected to my host through TCP connection Show Sample Output
This is sample output - yours may be different.
```
81.91.145.204
85.133.199.175
85.185.21.146
91.186.200.13
91.189.90.40
91.98.155.188
91.99.41.81
92.50.59.10
94.182.63.188
```
-1

netstat -nut | awk '$NF=="ESTABLISHED" {print $5}' | cut -d: -f1 | sort -u

bitbasher · 2011-07-27 07:24:10 3
‹ First < 48 49 50 51 52 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

list files recursively by size

Find usb device in realtime

Using this command you can track a moment when usb device was attached.

List the size (in human readable form) of all sub folders from the current location

Simple and easy to remember. -h is human, -d1 = depth 1. disk usage, human, depth 1

See KeepAlive counters on tcp connections

See connection's tcp timers

Get the number of days in a given month and year

Use mplayer to save video streams to a file

I use this command to save RTSP video streams over night from one of our national TV stations, so I won't have to squeeze the data through my slow internet connection when I want to watch it the next day. For ease of use, you might want to put this in a file: #!/bin/bash FILE="`basename \"$1\"`" mplayer -dumpstream -dumpfile "$FILE" -playlist "$1"

Show which programs are listening on TCP and UDP ports

-p Tell me the name of the program and it's PID -l that is listening -u on a UDP port. -n Give me numeric IP addresses (don't resolve them) -t oh, also TCP ports

Resume a detached screen session, resizing to fit the current terminal

By default, screen tries to restore its old window sizes when attaching to resizable terminals. This command is the command-line equivalent to typing ^A F to fit an open screen session to the window.

put current directory in LAN quickly

This works on all versions of python 2.X. Tested on Linux and bundled python versions on Mac OSX and Solaris / UNIX Note: Serves globally on port 8000. Ctrl+c to stop. Don't start the server and leave it on a internet connected machine. :)

sed /pat/!d without using sed (no RE; limited to shell patterns aka globbing)

POSIX requires this "string truncating" functionality. might as well use it, at least for very small tasks where invoking sed and using RE is overkill.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by