Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Get the revision number at which the current branch is created.
This is sample output - yours may be different.
-1

svn log --stop-on-copy | grep r[0-9] | awk '{print $1}' | sed "s/r//" | sort -n | head -1

jimthunderbird · 2010-10-07 21:21:20 3
Get just the IP for a hostname
This is sample output - yours may be different.
-1

host google.com|awk '{print $NF}'

aitilang · 2010-11-03 11:15:30 3
AWK: Set Field Separator from command line

Set field separator char from command line. Prints first, second and lsat columns. Show Sample Output
This is sample output - yours may be different.
```
Input:
Col1,Col2,Col3,[...],ColLast

Output:
Col1 Col2 ColLast
```
-1

awk 'BEGIN {FS=","} { print $1 " " $2 " " $NF}' foo.txt

EBAH · 2010-11-12 15:26:04 4
Find the uid and gid of your apache process

This command allows you to find the effective uid and gid of the Apache process regardless of process name (which can be apache2 or httpd depending on distro).
This is sample output - yours may be different.
-1

ps -o euid,egid --ppid `netstat --inet --inet6 -pln|awk '/:80 / { split($7,tmp, "/"); print tmp[1]; }'`|sort |uniq|grep -v EUID

chx · 2010-11-18 21:22:29 2

Used it on daily basis, not sure if it's any better than the OPs version, tho' One advantage is - you can replace 'bash' at the end of the line with eg. cat - to check if the generated command is OK. Show Sample Output

-1

mailq |awk '/MAILER-DAEMON/{gsub("*","");printf("postsuper -d %s\n",$1)}'|bash

unefunge · 2010-11-24 11:42:54 19

Print free memory
This is sample output - yours may be different.
-1

free -m | awk '/Mem/ {print $4}'

agudmund · 2010-11-29 13:31:55 6
print a cpu of a process
This is sample output - yours may be different.
-1

ps -eo args,%cpu | grep -m1 PROCESS | tr 'a-z-' ' ' | awk '{print $1}'

lin72 · 2010-11-29 17:43:52 4
turn off all services in specific runlevel

works in fedora, centos and presumably other distros that use chkconfig
This is sample output - yours may be different.
-1

for i in $(chkconfig --list | grep "4:on" | awk {'print $1'}); do chkconfig --level 4 "$i" off; done

m1cawber · 2011-01-25 03:54:43 6

transform several lines in one with Awk

remove all carriage return of a given file (or input, if used with | ) and replace them with a space (or whatever character is after %s) Show Sample Output

-1

awk ' { printf ("%s ", $0)} END {printf ("\n") } ' FILE

bouktin · 2011-02-02 11:51:41 6

pid list by httpd listen port

% lsof -v lsof version information: revision: 4.78
This is sample output - yours may be different.
-1

lsof | awk '/*:https?/{print $2}' | sort -u

sugitaro · 2011-02-04 01:37:17 3
Extract tags in a file
This is sample output - yours may be different.
-1

awk -vRS="</Tag2>" '/<Tag2>/{gsub(/.*<Tag2>/,"");print}' file

pathcl · 2011-02-20 00:23:47 3
collapse first five fields of Google Adwords export .tsv file into a single field

The exported TSV file of Google Adwords' first five columns are text, they usually should collapse into one cell, a multi-line text cell, but there is no guaranteed way to represent line-break within cells for .tsv file format, thus Google split it to 5 columns. The problem is, with 5 columns of text, there are hardly space to put additional fields while maintain printable output. This script collapses the first five columns of each row into one single multi-line text cell, for console output or direct send to printer.
This is sample output - yours may be different.
-1

awk -F $'\t' '{printf $1 LS $2 LS $3 LS $4 LS $5; for (i = 7; i < NF; i++) printf $i "\t"; printf "\n--\n";}' LS=$'\n' 'Ad report.tsv' | column -t -s $'\t'

zhangweiwu · 2011-02-28 10:52:16 4
List of syscalls (for 32/64 bits systems)
This is sample output - yours may be different.
-1

egrep '__NR_' /usr/include/asm/unistd_`getconf -a | awk '$1~/^WORD/{print $2}'`.h | sed -e 's/^#define __NR_//' | column -t

cicatriz · 2011-03-04 15:09:40 6
Generate MD5 of string and output only the hash checksum
This is sample output - yours may be different.
-1

echo -n "String to MD5" | md5sum | awk '{print $1}'

twjolson · 2011-03-05 02:37:28 4
this svn script will commit all files excluding those with extensions {.project .classpath .properties .sh .number} and those with Status Modified or Added {M or A}
This is sample output - yours may be different.
-1

svn st | grep -e [MA] | egrep -ve '.project|.classpath|.properties|.sh|.number' | awk -F' ' '{ print $2}' | xargs svn ci -m "message"

drunkcoder · 2011-03-10 15:32:36 6
List Seeon.tv Available Video Channels

This shows a list of channels from seeon.tv website to watch shows and movies
This is sample output - yours may be different.
-1

lynx --dump http://www.seeon.tv/channels| grep "/channels"|awk '{print $2}'|sort -u|while read links; do lynx --dump "$links"|awk '/view/ {print $2}'|sort -u; done

Bonster · 2011-04-01 05:58:20 5
Deletes all branches in a git repository except next and master (clean git repo)

This command will delete all branches in your git repository other than next and master. I use this to cleanup my git repos after making multiple branches and merging them back into next. It's much faster than individually deleting each expired branch using: git branch -D <branch_name>
This is sample output - yours may be different.
-1

git branch -D `git branch | awk '{ if ($0 !~ /next|master/) printf "%s", $0 }'`

denheck · 2011-04-14 17:43:21 4
Remove all unused kernels with apt-get

Same as 7272 but that one was too dangerous so i added -P to prompt users to continue or cancel Note the double space: "...^ii␣␣linux-image-2..." Like 5813, but fixes two bugs: [1]This leaves the meta-packages 'linux-headers-generic' and 'linux-image-generic' alone so that automatic upgrades work correctly in the future. [2]Kernels newer than the currently running one are left alone (this can happen if you didn't reboot after installing a new kernel).
This is sample output - yours may be different.
-1

sudo aptitude remove -P $(dpkg -l|awk '/^ii linux-image-2/{print $2}'|sed 's/linux-image-//'|awk -v v=`uname -r` 'v>$0'|sed 's/-generic//'|awk '{printf("linux-headers-%s\nlinux-headers-%s-generic\nlinux-image-%s-generic\n",$0,$0,$0)}')

Bonster · 2011-04-25 05:19:57 3
Count messages in mcabber history for each JID
This is sample output - yours may be different.
-1

for f in ~/.mcabber/histo/*; do a=`egrep "^(MR|MS)" $f | wc -l`; echo $f: $a | awk -F\/ '{print $6}'; done

aluminiumgeek · 2011-06-04 10:51:49 3

Clone all remote branches of a specific GitHub repository

Show Sample Output

-1

git branch -a | grep "remotes/origin" | grep -v master | awk -F / '{print $3}' | xargs -I % git clone -b % git://github.com/jamesotron/DevWorld-2010-Cocoa-Workshop %

evandrix · 2011-06-29 00:13:47 3

Find most used focal lengths in a directory of photos

First column is number of photos, second column is the focal length. Show Sample Output
This is sample output - yours may be different.
```
     17 17.0
      2 47.0
      1 50.0
      4 53.0
      6 78.0
      3 85.0
```
-1

exiv2 *JPG | grep Focal | awk '{print $5}' | sort -n | uniq -c

ivanatora · 2011-07-05 11:25:29 8
Remove annotation- (or other own-lined) tags from an XML document

Removes all lines between the lines containing "" and "", including these lines itself Backdrop: Sometimes when working with XML files without an graphical editor, large comment-/annotation-blocks taper the readability to walk through the file. I like to create a copy of such documents without these annotations. As the documentation itself is in documentation tags inside the annotation tags an therefore graphical editors tend to put the annotation tags in their own lines, this command removes all documentations within annotation-tags. Show Sample Output
This is sample output - yours may be different.
```
transforms:

<xsd:attribute name="version" type="xsd:string" use="required" fixed="1.0">
    <xsd:annotation>
        <xsd:documentation>This attribute denotes the version number ot the utilized XML-schema.</xsd:documentation>
    </xsd:annotation>
</xsd:attribute>

into:

<xsd:attribute name="version" type="xsd:string" use="required" fixed="1.0">
</xsd:attribute>
```
-1

awk "/<xsd:annotation>/{h=1};!h;/<\/xsd:annotation>/{h=0}" annotatedSchema.xsd

2chg · 2011-07-15 07:17:17 7
Display CPU usage in percentage
This is sample output - yours may be different.
-1

ps aux | awk {'sum+=$3;print sum'} | tail -n 1

tailot · 2011-07-16 16:16:59 3
Display only hosts up in network

Today many hosts are blocking traditional ICMP echo replay for an "security" reason, so nmap's fast ARP scan is more usable to view all live IPv4 devices around you. Must be root for ARP scanning.
This is sample output - yours may be different.
-1

nmap -sP -PR -oG - `/sbin/ip -4 addr show | awk '/inet/ {print $2}' | sed 1d`

l3k · 2011-07-21 11:50:26 3
All IP connected to my host

find all computer connected to my host through TCP connection Show Sample Output
This is sample output - yours may be different.
```
81.91.145.204
85.133.199.175
85.185.21.146
91.186.200.13
91.189.90.40
91.98.155.188
91.99.41.81
92.50.59.10
94.182.63.188
```
-1

netstat -nut | awk '$NF=="ESTABLISHED" {print $5}' | cut -d: -f1 | sort -u

bitbasher · 2011-07-27 07:24:10 3
‹ First < 48 49 50 51 52 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

list block devices

Shows all block devices in a tree with descruptions of what they are.

convert wmv into xvid avi format

Check if a remote port is up using dnstools.com (i.e. from behind a firewall/proxy)

Shell function; returns 0 if the port is up, 1 otherwise (check $? after executing). First parameter: IP address/hostname Second parameter: port number There is no error checking for the input parameters.

Pipe the result of a command to IRC (channel or query)

$ command | my_irc Pipe whatever you want to this function, it will, if everything goes well, be redirected to a channel or a user on an IRC server. Please note that : - I am not responsible of flood excesses you might provoke. - that function does not reply to PINGs from the server. That's the reason why I first write in a temporary file. Indeed, I don't want to wait for inputs while being connected to the server. However, according to the configuration of the server and the length of your file, you may timeout before finishing. - Concerning the server, the variable content must be on the form "irc.server.org 6667" (or any other port). If you want to make some tests, you can also create a fake IRC server on "localhost 55555" by using $ netcat -l -p 55555 - Concerning the target, you can choose a channel (beginning with a '#' like "#chan") or a user (like "user") - The other variables have obvious names.

Restore mysql database uncompressing on the fly.

This way you keep the file compressed saving disk space. Other way less optimal using named pipes: mysql -uroot -p'passwd' database <

Output sound when your computer is downloading something

Outputs pseudo-random sounds to speakers (stereo mode because of -c 2) when there are any kind of network activity.

Trim png files in a folder

That should be a short as it can get.

Add .gitignore files to all empty directories recursively from your current directory

Find Duplicate Files (based on size first, then MD5 hash)

for OS X

Detect illegal access to kernel space, potentially useful for Meltdown detection

Based on capsule8 agent examples, not rigorously tested

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by