Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

List you configure's ip address in your system

List system current active ip address Show Sample Output
This is sample output - yours may be different.
```
eth0    192.168.10.75/24
eth1    10.0.15.4/24
```
0

ip addr list | grep global | awk '{print $7"\t"$2}'

tevisky · 2013-08-08 13:05:35 7
To find a class/properties/xml in collection of jars
This is sample output - yours may be different.
0

for i in `find . -name "*.jar"`; do jar -tvf $i | grep -v /$ | awk -v file=$i '{print file ":" $8}'; done > all_jars.txt

rajashekar · 2013-08-09 17:03:30 6
Remove semaphores

Solves these pesky errors you see in the Apache log: [Fri Jun 28 17:51:00 2013] [emerg] (28)No space left on device: Couldn't create accept lock (/monsoon/opt/apache2/logs/accept.lock.356) (5) Naturally, can be used to get rid of other semaphores. Note: change the apache user in accordance to your ENV. Show Sample Output
This is sample output - yours may be different.
```
It works quietly, unless you have no sem IDs attached to this user [in this case, apache]
```
0

ipcs -s | grep apache | awk ' { print $2 } ' | xargs ipcrm sem

kernel01 · 2013-08-12 16:29:32 193
all java -Xmx values in a system, add them up

This will find all the -Xmx[BIGINT] running on a system, add them up for you and give you the total. Show Sample Output
This is sample output - yours may be different.
```
39424
```
0

output=$(ps -ef|grep -i java 2>/dev/null); for w in ${output[@]}; do if [[ $w =~ .*Xmx.* ]]; then result=$(grep -oP "[0-9]+" <<< $w); echo $result ;fi ; done| awk 'BEGIN {sum=0} {for(i=1; i<=NF; i++) sum+=$i } END {print sum}'

massiverobot · 2013-08-13 14:04:17 7
Find ur local network cidr Notation

This command give you Just the Network Cidr Notation Show Sample Output
This is sample output - yours may be different.
```
/8
/16
/24
/32
```
0

ip addr show |grep -w inet | grep -v 127.0.0.1 | awk '{ print $2}'| cut -d "/" -f 2

htmlgifted · 2013-08-17 18:54:23 12
compute the qps according to the latest n lines of logs
This is sample output - yours may be different.
0

tail -n 1000 access.log | grep "200 POST" | awk '{print substr($3,0,9)}' | awk '{data[$0]++}END{for(item in data){print item, data[item]}}'

hefei1986 · 2013-08-19 08:15:33 11
get the current weather in NYC, in human readable form
This is sample output - yours may be different.
0

curl -s poncho.is/forecast/new_york/today/ | grep -E 'og:title|og:description' | cut -d\" -f4 | awk '{print $0,"<p>"}' | lynx -stdin -dump

jc · 2013-08-21 21:43:11 46
Remove all message queues owned by user foo
This is sample output - yours may be different.
0

ipcs -q | grep foo | awk '{print $2}' | xargs -I ipcid ipcrm -q ipcid

eko · 2013-08-29 15:08:13 14
Quick and dirty list of installed packages on deb based system
This is sample output - yours may be different.
0

apt-cache -n dumpavail | grep 'Package:' | awk '{print $2 }'

txmoose · 2013-08-30 15:58:41 9
Find a machine's IP address and FQDN
This is sample output - yours may be different.
0

for i in `ip addr show dev eth1 | grep inet | awk '{print $2}' | cut -d/ -f1`; do echo -n $i; echo -en '\t'; host $i | awk '{print $5}'; done

BoxingOctopus · 2013-09-05 17:50:33 7
Get IP address from domain

Show Sample Output
This is sample output - yours may be different.
```
123.123.123.123
```
0

host example.com | head -1 | awk '{print $4}'

wes · 2013-09-05 22:20:49 7
Changes the initial login group for all users with GID > 500 (specified with LIMIT), to group YOURGROUP

Credit for the awk command goes to: http://www.cyberciti.biz/faq/howto-move-migrate-user-accounts-old-to-new-server/
This is sample output - yours may be different.
0

for I in $(awk -v LIMIT=500 -F: '($3>=LIMIT) && ($3!=65534)' /etc/passwd | cut -f 1-1 -d ':' | xargs); do usermod -g YOURGROUP $I ; done

Edoard · 2013-09-06 15:18:16 6
Get the Nth argument of the last command in $HISTFILE

This gets the Nth argument in the last line of your history file. This is useful where history is being written after each command, and you want to use arguments from the previous command in the current command, such as when doing copies/moving directories etc. I wrote this after getting irritated with having to continually type in long paths/arguments. You could also use $_ if all you want is the last argument. Show Sample Output
This is sample output - yours may be different.
```
$ echo "This little piggy went to the market"
This little piggy went to the market
$ garg 5
went
```
0

function garg () { tail -n 1 ${HISTFILE} | awk "{ print \$$1 }" }

plasticphyte · 2013-09-10 04:07:46 10
print all available make targets
This is sample output - yours may be different.
0

make --print-data-base --dry-run | awk -F':' '/^[a-zA-Z0-9][^$#\/\t=]*:([^=]|$)/ {split($1,A,/ /);for(i in A)print A[i]}'

grapsus · 2013-10-07 12:39:25 6
Check where mail was sent from
This is sample output - yours may be different.
0

grep cwd /var/log/exim_mainlog | grep -v /var/spool | awk -F"cwd=" '{print $2}' | awk '{print $1}' | sort | uniq -c | sort -n

franB · 2013-10-09 20:59:14 7
Find Duplicate Files (based on size first, then MD5 hash)

* Find all file sizes and file names from the current directory down (replace "." with a target directory as needed). * sort the file sizes in numeric order * List only the duplicated file sizes * drop the file sizes so there are simply a list of files (retain order) * calculate md5sums on all of the files * replace the first instance of two spaces (md5sum output) with a \0 * drop the unique md5sums so only duplicate files remain listed * Use AWK to aggregate identical files on one line. * Remove the blank line from the beginning (This was done more efficiently by putting another "IF" into the AWK command, but then the whole line exceeded the 255 char limit). >>>> Each output line contains the md5sum and then all of the files that have that identical md5sum. All fields are \0 delimited. All records are \n delimited.
This is sample output - yours may be different.
0

find . -type f -not -empty -printf "%-25s%p\n"|sort -n|uniq -D -w25|cut -b26-|xargs -d"\n" -n1 md5sum|sed "s/ /\x0/"|uniq -D -w32|awk -F"\0" 'BEGIN{l="";}{if(l!=$1||l==""){printf "\n%s\0",$1}printf "\0%s",$2;l=$1}END{printf "\n"}'|sed "/^$/d"

alafrosty · 2013-10-22 13:34:19 7
Delete keys from Redis by matching a pattern

Delete items from Redis, using redis-cli, by matching a key pattern. Show Sample Output
This is sample output - yours may be different.
```
(integer) 1
(integer) 1
(integer) 1
(integer) 1
(integer) 1
```
0

for key in `echo 'KEYS pattern*' | redis-cli | awk '{print $1}'`; do echo DEL $key; done | redis-cli

caiosba · 2013-10-29 04:50:35 10
Use awk's FIELDWIDTHS function to manipulate a string.
This is sample output - yours may be different.
0

echo "rootgot" | awk 'BEGIN{FIELDWIDTHS="4 3"}{print $2$1}'

in2nix4life · 2013-11-06 14:17:37 6
Search ruby-files with non-ascii character, but without encoding directive

Show Sample Output
This is sample output - yours may be different.
```
app/models/foo.rb
```
0

grep -l --include '*.rb' --include '*.rake' '^[^#]*[^a-zA-Z0-9[:punct:][:space:]]' -R . | xargs -L1 awk '!/encoding/ && NR < 2 { print FILENAME }'

numbata · 2013-11-13 21:41:42 6
List user processes with their memory usage and total usage.

Add up the amount of memory your processes are using and display the total. Replace marcanuy with your desired username. Show Sample Output
This is sample output - yours may be different.
```
    PID   RSS COMMAND
 194491  1756 sshd: marcanuy@pts/0
 194501  2056 -bash
 200189  1132 ps -u marcanuy -o pid,rss,command
 200190   960 awk {print $0}{sum+=$2} END {print "Total", sum/1024, "MB"}
 221029  7916 php54 /home/marcanuy/devs/tweets.php
 221030  7632 php54 /home/marcanuy/devs/parser.php
Total 20.9492 MB
```
0

ps -u marcanuy -o pid,rss,command | awk '{print $0}{sum+=$2} END {print "Total", sum/1024, "MB"}'

marcanuy · 2013-11-20 01:21:59 7
dpkg - undo selection of installed packages for deinstall

If you run dpkg --clear-selections or have otherwise selected installed packages for deinstall, but want to undo it, run this. It will set all installed packages back to installed status so that they won't be removed by commands like "dpkg -Pa"
This is sample output - yours may be different.
0

dpkg -l | grep ^ri | awk '{print $2 " install"}' | sudo dpkg --set-selections

ajmccluskey · 2013-11-23 06:41:18 14
Remove all older kernels then the current running kernel for Ubuntu/Debian base system
This is sample output - yours may be different.
0

export KEEP_KERNEL=2; dpkg -l 'linux-image*' | awk '/^ii/ { print $2 }' | grep "[0-9]" | awk 'BEGIN{i=1}{print i++, $0}' | grep `uname -r` -B99 | sort -r | tail -n+$(($KEEP_KERNEL+2)) | awk '{print $2}'| xargs apt-get -y purge

The_IceMan_Blog · 2013-11-23 15:35:42 7
Kill all processes found in grep

Kills all processes with a certain string. This was done to kill all ssh sessions openned by zenoss which look like: usr/bin/ssh /opt/zenoss/bin/zenmodeler
This is sample output - yours may be different.
0

for line in `ps aux | grep <string> | awk '{print $2}'`; do sudo kill $line; done;

mjbrune · 2013-11-24 00:02:16 17
list executed files current dir
This is sample output - yours may be different.
0

ls -al | awk '/^-rwx/ {print $9}'

qixingyue · 2013-11-24 03:37:49 7
fstab update
This is sample output - yours may be different.
0

mv /etc/fstab /etc/fstab.old && mount | awk '{print $1, $3, $5, $6}'| sed s/$//g|sed s/$/' 0 0'/g >> /etc/fstab

cas_alexi · 2013-11-26 06:31:27 6
‹ First < 37 38 39 40 41 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

What is my ip?

remove lines which are longer than 255

create disk copy over the net without temp files

I wanted to create a copy of my whole laptop disk on an lvm disk of the same size. First I created the logical volume: lvcreate -L120G -nlaptop mylvms SOURCE: dd if=/dev/sda bs=16065b | netcat ip-target 1234 TARGET: nc -l -p 1234 | dd of=/dev/mapper/mylvms-laptop bs=16065b to follow its process you issue the following command in a different terminal STATS: on target in a different terminal: watch -n60 -- kill -USR1 $(pgrep dd) (see http://www.commandlinefu.com/commands/view/4356/output-stats-from-a-running-dd-command-to-see-its-progress)

Get lines count of a list of files

This command gives you the number of lines of every file in the folder and its subfolders matching the search options specified in the find command. It also gives the total amount of lines of these files. The combination of print0 and files0-from options makes the whole command simple and efficient.

sudo for entire line (including pipes and redirects)

USAGE: $ sudor your command This command uses a dirty hack with history, so be sure you not turned it off. WARNING! This command behavior differ from other commands. It more like text macro, so you shouldn't use it in subshells, non-interactive sessions, other functions/aliases and so on. You shouldn't pipe into sudor (any string that prefixes sudor will be removed), but if you really want, use this commands: $ proceed_sudo () { sudor_command="`HISTTIMEFORMAT=\"\" history 1 | sed -r -e 's/^.*?sudor//' -e 's/\"/\\\"/g'`" ; pre_sudor_command="`history 1 | cut -d ' ' -f 5- | sed -r -e 's/sudor.*$//' -e 's/\"/\\\"/g'`"; if [ -n "${pre_sudor_command/ */}" ] ; then eval "${pre_sudor_command%| *}" | sudo sh -c "$sudor_command"; else sudo sh -c "$sudor_command" ;fi ;}; alias sudor="proceed_sudo # "

do something else while waiting for an event, such as reboot

until (ssh root@10.1.1.39 2> /dev/null); do date; sleep 15; done In this case will execute "date" then "sleep 15" until we are able to ssh into server, such as after a reboot Could also be like: until ( ping 10.1.1.39 1> /dev/null); do echo "server 10.1.1.39 is down"; sleep 15; done

Salvage a borked terminal

This is more or less the same as 'reset', but with two advantages: the initial LF character makes sure you're starting a new line to the tty driver, the final one is more reliably a line-end as CR is often unset; and second, 'stty sane' is reliable on older UNIX systems, especially Berkeley-based ones.

Rotate a single page PDF by 180 degrees

More pdftk examples: http://www.pdflabs.com/docs/pdftk-cli-examples/

pip install into current directory without virtualenv

For subsequent commands in the prefixed path: $ PYTHONPATH=$PWD/lib/python*/site-packages ./bin/pip --version

Upload a video to youtube

Google just released a new commend line tool offering all sorts of new services from the commend line. One of them is uploading a youtube video but there are plenty more google services to interact with. Download it here: http://code.google.com/p/googlecl/ Manual: http://code.google.com/p/googlecl/wiki/Manual

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by