Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

List you configure's ip address in your system

List system current active ip address Show Sample Output
This is sample output - yours may be different.
```
eth0    192.168.10.75/24
eth1    10.0.15.4/24
```
0

ip addr list | grep global | awk '{print $7"\t"$2}'

tevisky · 2013-08-08 13:05:35 7
To find a class/properties/xml in collection of jars
This is sample output - yours may be different.
0

for i in `find . -name "*.jar"`; do jar -tvf $i | grep -v /$ | awk -v file=$i '{print file ":" $8}'; done > all_jars.txt

rajashekar · 2013-08-09 17:03:30 6
Remove semaphores

Solves these pesky errors you see in the Apache log: [Fri Jun 28 17:51:00 2013] [emerg] (28)No space left on device: Couldn't create accept lock (/monsoon/opt/apache2/logs/accept.lock.356) (5) Naturally, can be used to get rid of other semaphores. Note: change the apache user in accordance to your ENV. Show Sample Output
This is sample output - yours may be different.
```
It works quietly, unless you have no sem IDs attached to this user [in this case, apache]
```
0

ipcs -s | grep apache | awk ' { print $2 } ' | xargs ipcrm sem

kernel01 · 2013-08-12 16:29:32 194
all java -Xmx values in a system, add them up

This will find all the -Xmx[BIGINT] running on a system, add them up for you and give you the total. Show Sample Output
This is sample output - yours may be different.
```
39424
```
0

output=$(ps -ef|grep -i java 2>/dev/null); for w in ${output[@]}; do if [[ $w =~ .*Xmx.* ]]; then result=$(grep -oP "[0-9]+" <<< $w); echo $result ;fi ; done| awk 'BEGIN {sum=0} {for(i=1; i<=NF; i++) sum+=$i } END {print sum}'

massiverobot · 2013-08-13 14:04:17 7
Find ur local network cidr Notation

This command give you Just the Network Cidr Notation Show Sample Output
This is sample output - yours may be different.
```
/8
/16
/24
/32
```
0

ip addr show |grep -w inet | grep -v 127.0.0.1 | awk '{ print $2}'| cut -d "/" -f 2

htmlgifted · 2013-08-17 18:54:23 12
compute the qps according to the latest n lines of logs
This is sample output - yours may be different.
0

tail -n 1000 access.log | grep "200 POST" | awk '{print substr($3,0,9)}' | awk '{data[$0]++}END{for(item in data){print item, data[item]}}'

hefei1986 · 2013-08-19 08:15:33 11
get the current weather in NYC, in human readable form
This is sample output - yours may be different.
0

curl -s poncho.is/forecast/new_york/today/ | grep -E 'og:title|og:description' | cut -d\" -f4 | awk '{print $0,"<p>"}' | lynx -stdin -dump

jc · 2013-08-21 21:43:11 46
Remove all message queues owned by user foo
This is sample output - yours may be different.
0

ipcs -q | grep foo | awk '{print $2}' | xargs -I ipcid ipcrm -q ipcid

eko · 2013-08-29 15:08:13 14
Quick and dirty list of installed packages on deb based system
This is sample output - yours may be different.
0

apt-cache -n dumpavail | grep 'Package:' | awk '{print $2 }'

txmoose · 2013-08-30 15:58:41 9
Find a machine's IP address and FQDN
This is sample output - yours may be different.
0

for i in `ip addr show dev eth1 | grep inet | awk '{print $2}' | cut -d/ -f1`; do echo -n $i; echo -en '\t'; host $i | awk '{print $5}'; done

BoxingOctopus · 2013-09-05 17:50:33 7
Get IP address from domain

Show Sample Output
This is sample output - yours may be different.
```
123.123.123.123
```
0

host example.com | head -1 | awk '{print $4}'

wes · 2013-09-05 22:20:49 7
Changes the initial login group for all users with GID > 500 (specified with LIMIT), to group YOURGROUP

Credit for the awk command goes to: http://www.cyberciti.biz/faq/howto-move-migrate-user-accounts-old-to-new-server/
This is sample output - yours may be different.
0

for I in $(awk -v LIMIT=500 -F: '($3>=LIMIT) && ($3!=65534)' /etc/passwd | cut -f 1-1 -d ':' | xargs); do usermod -g YOURGROUP $I ; done

Edoard · 2013-09-06 15:18:16 6
Get the Nth argument of the last command in $HISTFILE

This gets the Nth argument in the last line of your history file. This is useful where history is being written after each command, and you want to use arguments from the previous command in the current command, such as when doing copies/moving directories etc. I wrote this after getting irritated with having to continually type in long paths/arguments. You could also use $_ if all you want is the last argument. Show Sample Output
This is sample output - yours may be different.
```
$ echo "This little piggy went to the market"
This little piggy went to the market
$ garg 5
went
```
0

function garg () { tail -n 1 ${HISTFILE} | awk "{ print \$$1 }" }

plasticphyte · 2013-09-10 04:07:46 10
print all available make targets
This is sample output - yours may be different.
0

make --print-data-base --dry-run | awk -F':' '/^[a-zA-Z0-9][^$#\/\t=]*:([^=]|$)/ {split($1,A,/ /);for(i in A)print A[i]}'

grapsus · 2013-10-07 12:39:25 6
Check where mail was sent from
This is sample output - yours may be different.
0

grep cwd /var/log/exim_mainlog | grep -v /var/spool | awk -F"cwd=" '{print $2}' | awk '{print $1}' | sort | uniq -c | sort -n

franB · 2013-10-09 20:59:14 7
Find Duplicate Files (based on size first, then MD5 hash)

* Find all file sizes and file names from the current directory down (replace "." with a target directory as needed). * sort the file sizes in numeric order * List only the duplicated file sizes * drop the file sizes so there are simply a list of files (retain order) * calculate md5sums on all of the files * replace the first instance of two spaces (md5sum output) with a \0 * drop the unique md5sums so only duplicate files remain listed * Use AWK to aggregate identical files on one line. * Remove the blank line from the beginning (This was done more efficiently by putting another "IF" into the AWK command, but then the whole line exceeded the 255 char limit). >>>> Each output line contains the md5sum and then all of the files that have that identical md5sum. All fields are \0 delimited. All records are \n delimited.
This is sample output - yours may be different.
0

find . -type f -not -empty -printf "%-25s%p\n"|sort -n|uniq -D -w25|cut -b26-|xargs -d"\n" -n1 md5sum|sed "s/ /\x0/"|uniq -D -w32|awk -F"\0" 'BEGIN{l="";}{if(l!=$1||l==""){printf "\n%s\0",$1}printf "\0%s",$2;l=$1}END{printf "\n"}'|sed "/^$/d"

alafrosty · 2013-10-22 13:34:19 7
Delete keys from Redis by matching a pattern

Delete items from Redis, using redis-cli, by matching a key pattern. Show Sample Output
This is sample output - yours may be different.
```
(integer) 1
(integer) 1
(integer) 1
(integer) 1
(integer) 1
```
0

for key in `echo 'KEYS pattern*' | redis-cli | awk '{print $1}'`; do echo DEL $key; done | redis-cli

caiosba · 2013-10-29 04:50:35 10
Use awk's FIELDWIDTHS function to manipulate a string.
This is sample output - yours may be different.
0

echo "rootgot" | awk 'BEGIN{FIELDWIDTHS="4 3"}{print $2$1}'

in2nix4life · 2013-11-06 14:17:37 6
Search ruby-files with non-ascii character, but without encoding directive

Show Sample Output
This is sample output - yours may be different.
```
app/models/foo.rb
```
0

grep -l --include '*.rb' --include '*.rake' '^[^#]*[^a-zA-Z0-9[:punct:][:space:]]' -R . | xargs -L1 awk '!/encoding/ && NR < 2 { print FILENAME }'

numbata · 2013-11-13 21:41:42 6
List user processes with their memory usage and total usage.

Add up the amount of memory your processes are using and display the total. Replace marcanuy with your desired username. Show Sample Output
This is sample output - yours may be different.
```
    PID   RSS COMMAND
 194491  1756 sshd: marcanuy@pts/0
 194501  2056 -bash
 200189  1132 ps -u marcanuy -o pid,rss,command
 200190   960 awk {print $0}{sum+=$2} END {print "Total", sum/1024, "MB"}
 221029  7916 php54 /home/marcanuy/devs/tweets.php
 221030  7632 php54 /home/marcanuy/devs/parser.php
Total 20.9492 MB
```
0

ps -u marcanuy -o pid,rss,command | awk '{print $0}{sum+=$2} END {print "Total", sum/1024, "MB"}'

marcanuy · 2013-11-20 01:21:59 7
dpkg - undo selection of installed packages for deinstall

If you run dpkg --clear-selections or have otherwise selected installed packages for deinstall, but want to undo it, run this. It will set all installed packages back to installed status so that they won't be removed by commands like "dpkg -Pa"
This is sample output - yours may be different.
0

dpkg -l | grep ^ri | awk '{print $2 " install"}' | sudo dpkg --set-selections

ajmccluskey · 2013-11-23 06:41:18 14
Remove all older kernels then the current running kernel for Ubuntu/Debian base system
This is sample output - yours may be different.
0

export KEEP_KERNEL=2; dpkg -l 'linux-image*' | awk '/^ii/ { print $2 }' | grep "[0-9]" | awk 'BEGIN{i=1}{print i++, $0}' | grep `uname -r` -B99 | sort -r | tail -n+$(($KEEP_KERNEL+2)) | awk '{print $2}'| xargs apt-get -y purge

The_IceMan_Blog · 2013-11-23 15:35:42 7
Kill all processes found in grep

Kills all processes with a certain string. This was done to kill all ssh sessions openned by zenoss which look like: usr/bin/ssh /opt/zenoss/bin/zenmodeler
This is sample output - yours may be different.
0

for line in `ps aux | grep <string> | awk '{print $2}'`; do sudo kill $line; done;

mjbrune · 2013-11-24 00:02:16 17
list executed files current dir
This is sample output - yours may be different.
0

ls -al | awk '/^-rwx/ {print $9}'

qixingyue · 2013-11-24 03:37:49 7
fstab update
This is sample output - yours may be different.
0

mv /etc/fstab /etc/fstab.old && mount | awk '{print $1, $3, $5, $6}'| sed s/$//g|sed s/$/' 0 0'/g >> /etc/fstab

cas_alexi · 2013-11-26 06:31:27 6
‹ First < 37 38 39 40 41 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Convert CSV to JSON

Replace 'csv_file.csv' with your filename.

Transfer SSH public key to another machine in one step

This command sequence allows simple setup of (gasp!) password-less SSH logins. Be careful, as if you already have an SSH keypair in your ~/.ssh directory on the local machine, there is a possibility ssh-keygen may overwrite them. ssh-copy-id copies the public key to the remote host and appends it to the remote account's ~/.ssh/authorized_keys file. When trying ssh, if you used no passphrase for your key, the remote shell appears soon after invoking ssh user@host.

Who invoked me? / Get parent command

Get the name of the parent command. This might be helpful, if you need to react on that information. E. g. a script called directly via ssh has got sshd as parent, manually invoked the parent process will probably be bash

find the biggest files recursively, no matter how many

This command will find the biggest files recursively under a certain directory, no matter if they are too many. If you try the regular commands ("find -type f -exec ls -laSr {} +" or "find -type f -print0 | xargs -0 ls -laSr") the sorting won't be correct because of command line arguments limit. This command won't use command line arguments to sort the files and will display the sorted list correctly.

Edit the last or previous command line in an editor then execute

If you would like to edit a previous command, which might be long and complicated, you can use the fc (I think it stands for fix command). Invoke fc alone will edit the last command using the default editor (specified by $FCEDIT, $EDITOR, or emacs, in that order). After you make the changes in the editor, save and exit to execute that command. The fc command is more flexible than what I have described. Please 'man bash' for more information.

replace strings in file names

Uses vi style search / replace in bash to rename files. Works with regex's too (I use the following a script to fixup / shorten file names): # Remove complete parenthetical/bracket/brace phrases rename 's/$.*$//g' * rename 's/\[.*\]//g' * rename 's/\{.*\}//g' *

Search some text from all files inside a directory

generate iso

Last month

Work out last months value

invoke MATLAB functions from command line

`-r script.m` also possible

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by