Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

List you configure's ip address in your system

List system current active ip address Show Sample Output
This is sample output - yours may be different.
```
eth0    192.168.10.75/24
eth1    10.0.15.4/24
```
0

ip addr list | grep global | awk '{print $7"\t"$2}'

tevisky · 2013-08-08 13:05:35 7
To find a class/properties/xml in collection of jars
This is sample output - yours may be different.
0

for i in `find . -name "*.jar"`; do jar -tvf $i | grep -v /$ | awk -v file=$i '{print file ":" $8}'; done > all_jars.txt

rajashekar · 2013-08-09 17:03:30 6
Remove semaphores

Solves these pesky errors you see in the Apache log: [Fri Jun 28 17:51:00 2013] [emerg] (28)No space left on device: Couldn't create accept lock (/monsoon/opt/apache2/logs/accept.lock.356) (5) Naturally, can be used to get rid of other semaphores. Note: change the apache user in accordance to your ENV. Show Sample Output
This is sample output - yours may be different.
```
It works quietly, unless you have no sem IDs attached to this user [in this case, apache]
```
0

ipcs -s | grep apache | awk ' { print $2 } ' | xargs ipcrm sem

kernel01 · 2013-08-12 16:29:32 194
all java -Xmx values in a system, add them up

This will find all the -Xmx[BIGINT] running on a system, add them up for you and give you the total. Show Sample Output
This is sample output - yours may be different.
```
39424
```
0

output=$(ps -ef|grep -i java 2>/dev/null); for w in ${output[@]}; do if [[ $w =~ .*Xmx.* ]]; then result=$(grep -oP "[0-9]+" <<< $w); echo $result ;fi ; done| awk 'BEGIN {sum=0} {for(i=1; i<=NF; i++) sum+=$i } END {print sum}'

massiverobot · 2013-08-13 14:04:17 7
Find ur local network cidr Notation

This command give you Just the Network Cidr Notation Show Sample Output
This is sample output - yours may be different.
```
/8
/16
/24
/32
```
0

ip addr show |grep -w inet | grep -v 127.0.0.1 | awk '{ print $2}'| cut -d "/" -f 2

htmlgifted · 2013-08-17 18:54:23 12
compute the qps according to the latest n lines of logs
This is sample output - yours may be different.
0

tail -n 1000 access.log | grep "200 POST" | awk '{print substr($3,0,9)}' | awk '{data[$0]++}END{for(item in data){print item, data[item]}}'

hefei1986 · 2013-08-19 08:15:33 11
get the current weather in NYC, in human readable form
This is sample output - yours may be different.
0

curl -s poncho.is/forecast/new_york/today/ | grep -E 'og:title|og:description' | cut -d\" -f4 | awk '{print $0,"<p>"}' | lynx -stdin -dump

jc · 2013-08-21 21:43:11 46
Remove all message queues owned by user foo
This is sample output - yours may be different.
0

ipcs -q | grep foo | awk '{print $2}' | xargs -I ipcid ipcrm -q ipcid

eko · 2013-08-29 15:08:13 14
Quick and dirty list of installed packages on deb based system
This is sample output - yours may be different.
0

apt-cache -n dumpavail | grep 'Package:' | awk '{print $2 }'

txmoose · 2013-08-30 15:58:41 9
Find a machine's IP address and FQDN
This is sample output - yours may be different.
0

for i in `ip addr show dev eth1 | grep inet | awk '{print $2}' | cut -d/ -f1`; do echo -n $i; echo -en '\t'; host $i | awk '{print $5}'; done

BoxingOctopus · 2013-09-05 17:50:33 7
Get IP address from domain

Show Sample Output
This is sample output - yours may be different.
```
123.123.123.123
```
0

host example.com | head -1 | awk '{print $4}'

wes · 2013-09-05 22:20:49 7
Changes the initial login group for all users with GID > 500 (specified with LIMIT), to group YOURGROUP

Credit for the awk command goes to: http://www.cyberciti.biz/faq/howto-move-migrate-user-accounts-old-to-new-server/
This is sample output - yours may be different.
0

for I in $(awk -v LIMIT=500 -F: '($3>=LIMIT) && ($3!=65534)' /etc/passwd | cut -f 1-1 -d ':' | xargs); do usermod -g YOURGROUP $I ; done

Edoard · 2013-09-06 15:18:16 6
Get the Nth argument of the last command in $HISTFILE

This gets the Nth argument in the last line of your history file. This is useful where history is being written after each command, and you want to use arguments from the previous command in the current command, such as when doing copies/moving directories etc. I wrote this after getting irritated with having to continually type in long paths/arguments. You could also use $_ if all you want is the last argument. Show Sample Output
This is sample output - yours may be different.
```
$ echo "This little piggy went to the market"
This little piggy went to the market
$ garg 5
went
```
0

function garg () { tail -n 1 ${HISTFILE} | awk "{ print \$$1 }" }

plasticphyte · 2013-09-10 04:07:46 10
print all available make targets
This is sample output - yours may be different.
0

make --print-data-base --dry-run | awk -F':' '/^[a-zA-Z0-9][^$#\/\t=]*:([^=]|$)/ {split($1,A,/ /);for(i in A)print A[i]}'

grapsus · 2013-10-07 12:39:25 6
Check where mail was sent from
This is sample output - yours may be different.
0

grep cwd /var/log/exim_mainlog | grep -v /var/spool | awk -F"cwd=" '{print $2}' | awk '{print $1}' | sort | uniq -c | sort -n

franB · 2013-10-09 20:59:14 7
Find Duplicate Files (based on size first, then MD5 hash)

* Find all file sizes and file names from the current directory down (replace "." with a target directory as needed). * sort the file sizes in numeric order * List only the duplicated file sizes * drop the file sizes so there are simply a list of files (retain order) * calculate md5sums on all of the files * replace the first instance of two spaces (md5sum output) with a \0 * drop the unique md5sums so only duplicate files remain listed * Use AWK to aggregate identical files on one line. * Remove the blank line from the beginning (This was done more efficiently by putting another "IF" into the AWK command, but then the whole line exceeded the 255 char limit). >>>> Each output line contains the md5sum and then all of the files that have that identical md5sum. All fields are \0 delimited. All records are \n delimited.
This is sample output - yours may be different.
0

find . -type f -not -empty -printf "%-25s%p\n"|sort -n|uniq -D -w25|cut -b26-|xargs -d"\n" -n1 md5sum|sed "s/ /\x0/"|uniq -D -w32|awk -F"\0" 'BEGIN{l="";}{if(l!=$1||l==""){printf "\n%s\0",$1}printf "\0%s",$2;l=$1}END{printf "\n"}'|sed "/^$/d"

alafrosty · 2013-10-22 13:34:19 7
Delete keys from Redis by matching a pattern

Delete items from Redis, using redis-cli, by matching a key pattern. Show Sample Output
This is sample output - yours may be different.
```
(integer) 1
(integer) 1
(integer) 1
(integer) 1
(integer) 1
```
0

for key in `echo 'KEYS pattern*' | redis-cli | awk '{print $1}'`; do echo DEL $key; done | redis-cli

caiosba · 2013-10-29 04:50:35 10
Use awk's FIELDWIDTHS function to manipulate a string.
This is sample output - yours may be different.
0

echo "rootgot" | awk 'BEGIN{FIELDWIDTHS="4 3"}{print $2$1}'

in2nix4life · 2013-11-06 14:17:37 6
Search ruby-files with non-ascii character, but without encoding directive

Show Sample Output
This is sample output - yours may be different.
```
app/models/foo.rb
```
0

grep -l --include '*.rb' --include '*.rake' '^[^#]*[^a-zA-Z0-9[:punct:][:space:]]' -R . | xargs -L1 awk '!/encoding/ && NR < 2 { print FILENAME }'

numbata · 2013-11-13 21:41:42 6
List user processes with their memory usage and total usage.

Add up the amount of memory your processes are using and display the total. Replace marcanuy with your desired username. Show Sample Output
This is sample output - yours may be different.
```
    PID   RSS COMMAND
 194491  1756 sshd: marcanuy@pts/0
 194501  2056 -bash
 200189  1132 ps -u marcanuy -o pid,rss,command
 200190   960 awk {print $0}{sum+=$2} END {print "Total", sum/1024, "MB"}
 221029  7916 php54 /home/marcanuy/devs/tweets.php
 221030  7632 php54 /home/marcanuy/devs/parser.php
Total 20.9492 MB
```
0

ps -u marcanuy -o pid,rss,command | awk '{print $0}{sum+=$2} END {print "Total", sum/1024, "MB"}'

marcanuy · 2013-11-20 01:21:59 7
dpkg - undo selection of installed packages for deinstall

If you run dpkg --clear-selections or have otherwise selected installed packages for deinstall, but want to undo it, run this. It will set all installed packages back to installed status so that they won't be removed by commands like "dpkg -Pa"
This is sample output - yours may be different.
0

dpkg -l | grep ^ri | awk '{print $2 " install"}' | sudo dpkg --set-selections

ajmccluskey · 2013-11-23 06:41:18 14
Remove all older kernels then the current running kernel for Ubuntu/Debian base system
This is sample output - yours may be different.
0

export KEEP_KERNEL=2; dpkg -l 'linux-image*' | awk '/^ii/ { print $2 }' | grep "[0-9]" | awk 'BEGIN{i=1}{print i++, $0}' | grep `uname -r` -B99 | sort -r | tail -n+$(($KEEP_KERNEL+2)) | awk '{print $2}'| xargs apt-get -y purge

The_IceMan_Blog · 2013-11-23 15:35:42 7
Kill all processes found in grep

Kills all processes with a certain string. This was done to kill all ssh sessions openned by zenoss which look like: usr/bin/ssh /opt/zenoss/bin/zenmodeler
This is sample output - yours may be different.
0

for line in `ps aux | grep <string> | awk '{print $2}'`; do sudo kill $line; done;

mjbrune · 2013-11-24 00:02:16 17
list executed files current dir
This is sample output - yours may be different.
0

ls -al | awk '/^-rwx/ {print $9}'

qixingyue · 2013-11-24 03:37:49 7
fstab update
This is sample output - yours may be different.
0

mv /etc/fstab /etc/fstab.old && mount | awk '{print $1, $3, $5, $6}'| sed s/$//g|sed s/$/' 0 0'/g >> /etc/fstab

cas_alexi · 2013-11-26 06:31:27 6
‹ First < 37 38 39 40 41 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Search recursively to find a word or phrase in certain file types, such as C code

I have a bash alias for this command line and find it useful for searching C code for error messages. The -H tells grep to print the filename. you can omit the -i to match the case exactly or keep the -i for case-insensitive matching. This find command find all .c and .h files

Get creation date of a file on ext2-3-4 fs

Return the creation date of a file on ext2, 3, 4 filesystems, because stat command won't show it. Useful on ubuntu, debian, and else

List your installed Chromium extensions (with url to each page)

Gives you a list for all installed chrome (chromium) extensions with URL to the page of the extension. With this you can easy add a new Bookmark folder called "extensions" add every URL to that folder, so it will be synced and you can access the names from every computer you are logged in. ------------------------------------------------------------------------------------------------------------------ Only tested with chromium, for chrome you maybe have to change the find $PATH.

Count threads of a jvm process

if you have problem threads problem in tomcat

Check how far along (in %) your program is in a file

Imagine you've started a long-running process that involves piping data, but you forgot to add the progress-bar option to a command. e.g. $ xz -dc bigdata.xz | complicated-processing-program > summary . This command uses lsof to see how much data xz has read from the file. $ lsof -o0 -o -Fo FILENAME Display offsets (-o), in decimal (-o0), in parseable form (-Fo) This will output something like: . p12607 f3 o0t45187072 . Process id (p), File Descriptor (f), Offset (o) . We stat the file to get its size $ stat -c %s FILENAME . Then we plug the values into awk. Split the line at the letter t: -Ft Define a variable for the file's size: -s=$(stat...) Only work on the offset line: /^o/ . Note this command was tested using the Linux version of lsof. Because it uses lsof's batch option (-F) it may be portable. . Thanks to @unhammer for the brilliant idea.

Show me just the ip address

Sometimes it's useful to output just the ip address. Or some other information, changing the "ipv4.addresses" in command. The power of awk! Show all possible "greps" with $ nmcli connection show [yourInterfaceNameHere]

RELINK a lot of broken symlinks - FIX broken symlinks after rsync site to new server

After you run this script, you can check status for broken symlink with this command: find -L . -type l

list block devices

Shows all block devices in a tree with descruptions of what they are.

clear screen, keep prompt at eye-level (faster than clear(1), tput cl, etc.)

this leaves the cursor at the bottom of the terminal screen, where your eyes are. ctrl-l moves it to the top, forcing you to look up.

Convert IP octets to HEX with no dots.

Converts IP octets to hex using printf command. Useful for generating pxeboot aliases in the pxelinux.cfg folder.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by