Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

List you configure's ip address in your system

List system current active ip address Show Sample Output
This is sample output - yours may be different.
```
eth0    192.168.10.75/24
eth1    10.0.15.4/24
```
0

ip addr list | grep global | awk '{print $7"\t"$2}'

tevisky · 2013-08-08 13:05:35 7
To find a class/properties/xml in collection of jars
This is sample output - yours may be different.
0

for i in `find . -name "*.jar"`; do jar -tvf $i | grep -v /$ | awk -v file=$i '{print file ":" $8}'; done > all_jars.txt

rajashekar · 2013-08-09 17:03:30 6
Remove semaphores

Solves these pesky errors you see in the Apache log: [Fri Jun 28 17:51:00 2013] [emerg] (28)No space left on device: Couldn't create accept lock (/monsoon/opt/apache2/logs/accept.lock.356) (5) Naturally, can be used to get rid of other semaphores. Note: change the apache user in accordance to your ENV. Show Sample Output
This is sample output - yours may be different.
```
It works quietly, unless you have no sem IDs attached to this user [in this case, apache]
```
0

ipcs -s | grep apache | awk ' { print $2 } ' | xargs ipcrm sem

kernel01 · 2013-08-12 16:29:32 194
all java -Xmx values in a system, add them up

This will find all the -Xmx[BIGINT] running on a system, add them up for you and give you the total. Show Sample Output
This is sample output - yours may be different.
```
39424
```
0

output=$(ps -ef|grep -i java 2>/dev/null); for w in ${output[@]}; do if [[ $w =~ .*Xmx.* ]]; then result=$(grep -oP "[0-9]+" <<< $w); echo $result ;fi ; done| awk 'BEGIN {sum=0} {for(i=1; i<=NF; i++) sum+=$i } END {print sum}'

massiverobot · 2013-08-13 14:04:17 7
Find ur local network cidr Notation

This command give you Just the Network Cidr Notation Show Sample Output
This is sample output - yours may be different.
```
/8
/16
/24
/32
```
0

ip addr show |grep -w inet | grep -v 127.0.0.1 | awk '{ print $2}'| cut -d "/" -f 2

htmlgifted · 2013-08-17 18:54:23 12
compute the qps according to the latest n lines of logs
This is sample output - yours may be different.
0

tail -n 1000 access.log | grep "200 POST" | awk '{print substr($3,0,9)}' | awk '{data[$0]++}END{for(item in data){print item, data[item]}}'

hefei1986 · 2013-08-19 08:15:33 11
get the current weather in NYC, in human readable form
This is sample output - yours may be different.
0

curl -s poncho.is/forecast/new_york/today/ | grep -E 'og:title|og:description' | cut -d\" -f4 | awk '{print $0,"<p>"}' | lynx -stdin -dump

jc · 2013-08-21 21:43:11 46
Remove all message queues owned by user foo
This is sample output - yours may be different.
0

ipcs -q | grep foo | awk '{print $2}' | xargs -I ipcid ipcrm -q ipcid

eko · 2013-08-29 15:08:13 14
Quick and dirty list of installed packages on deb based system
This is sample output - yours may be different.
0

apt-cache -n dumpavail | grep 'Package:' | awk '{print $2 }'

txmoose · 2013-08-30 15:58:41 9
Find a machine's IP address and FQDN
This is sample output - yours may be different.
0

for i in `ip addr show dev eth1 | grep inet | awk '{print $2}' | cut -d/ -f1`; do echo -n $i; echo -en '\t'; host $i | awk '{print $5}'; done

BoxingOctopus · 2013-09-05 17:50:33 7
Get IP address from domain

Show Sample Output
This is sample output - yours may be different.
```
123.123.123.123
```
0

host example.com | head -1 | awk '{print $4}'

wes · 2013-09-05 22:20:49 7
Changes the initial login group for all users with GID > 500 (specified with LIMIT), to group YOURGROUP

Credit for the awk command goes to: http://www.cyberciti.biz/faq/howto-move-migrate-user-accounts-old-to-new-server/
This is sample output - yours may be different.
0

for I in $(awk -v LIMIT=500 -F: '($3>=LIMIT) && ($3!=65534)' /etc/passwd | cut -f 1-1 -d ':' | xargs); do usermod -g YOURGROUP $I ; done

Edoard · 2013-09-06 15:18:16 6
Get the Nth argument of the last command in $HISTFILE

This gets the Nth argument in the last line of your history file. This is useful where history is being written after each command, and you want to use arguments from the previous command in the current command, such as when doing copies/moving directories etc. I wrote this after getting irritated with having to continually type in long paths/arguments. You could also use $_ if all you want is the last argument. Show Sample Output
This is sample output - yours may be different.
```
$ echo "This little piggy went to the market"
This little piggy went to the market
$ garg 5
went
```
0

function garg () { tail -n 1 ${HISTFILE} | awk "{ print \$$1 }" }

plasticphyte · 2013-09-10 04:07:46 10
print all available make targets
This is sample output - yours may be different.
0

make --print-data-base --dry-run | awk -F':' '/^[a-zA-Z0-9][^$#\/\t=]*:([^=]|$)/ {split($1,A,/ /);for(i in A)print A[i]}'

grapsus · 2013-10-07 12:39:25 6
Check where mail was sent from
This is sample output - yours may be different.
0

grep cwd /var/log/exim_mainlog | grep -v /var/spool | awk -F"cwd=" '{print $2}' | awk '{print $1}' | sort | uniq -c | sort -n

franB · 2013-10-09 20:59:14 7
Find Duplicate Files (based on size first, then MD5 hash)

* Find all file sizes and file names from the current directory down (replace "." with a target directory as needed). * sort the file sizes in numeric order * List only the duplicated file sizes * drop the file sizes so there are simply a list of files (retain order) * calculate md5sums on all of the files * replace the first instance of two spaces (md5sum output) with a \0 * drop the unique md5sums so only duplicate files remain listed * Use AWK to aggregate identical files on one line. * Remove the blank line from the beginning (This was done more efficiently by putting another "IF" into the AWK command, but then the whole line exceeded the 255 char limit). >>>> Each output line contains the md5sum and then all of the files that have that identical md5sum. All fields are \0 delimited. All records are \n delimited.
This is sample output - yours may be different.
0

find . -type f -not -empty -printf "%-25s%p\n"|sort -n|uniq -D -w25|cut -b26-|xargs -d"\n" -n1 md5sum|sed "s/ /\x0/"|uniq -D -w32|awk -F"\0" 'BEGIN{l="";}{if(l!=$1||l==""){printf "\n%s\0",$1}printf "\0%s",$2;l=$1}END{printf "\n"}'|sed "/^$/d"

alafrosty · 2013-10-22 13:34:19 7
Delete keys from Redis by matching a pattern

Delete items from Redis, using redis-cli, by matching a key pattern. Show Sample Output
This is sample output - yours may be different.
```
(integer) 1
(integer) 1
(integer) 1
(integer) 1
(integer) 1
```
0

for key in `echo 'KEYS pattern*' | redis-cli | awk '{print $1}'`; do echo DEL $key; done | redis-cli

caiosba · 2013-10-29 04:50:35 10
Use awk's FIELDWIDTHS function to manipulate a string.
This is sample output - yours may be different.
0

echo "rootgot" | awk 'BEGIN{FIELDWIDTHS="4 3"}{print $2$1}'

in2nix4life · 2013-11-06 14:17:37 6
Search ruby-files with non-ascii character, but without encoding directive

Show Sample Output
This is sample output - yours may be different.
```
app/models/foo.rb
```
0

grep -l --include '*.rb' --include '*.rake' '^[^#]*[^a-zA-Z0-9[:punct:][:space:]]' -R . | xargs -L1 awk '!/encoding/ && NR < 2 { print FILENAME }'

numbata · 2013-11-13 21:41:42 6
List user processes with their memory usage and total usage.

Add up the amount of memory your processes are using and display the total. Replace marcanuy with your desired username. Show Sample Output
This is sample output - yours may be different.
```
    PID   RSS COMMAND
 194491  1756 sshd: marcanuy@pts/0
 194501  2056 -bash
 200189  1132 ps -u marcanuy -o pid,rss,command
 200190   960 awk {print $0}{sum+=$2} END {print "Total", sum/1024, "MB"}
 221029  7916 php54 /home/marcanuy/devs/tweets.php
 221030  7632 php54 /home/marcanuy/devs/parser.php
Total 20.9492 MB
```
0

ps -u marcanuy -o pid,rss,command | awk '{print $0}{sum+=$2} END {print "Total", sum/1024, "MB"}'

marcanuy · 2013-11-20 01:21:59 7
dpkg - undo selection of installed packages for deinstall

If you run dpkg --clear-selections or have otherwise selected installed packages for deinstall, but want to undo it, run this. It will set all installed packages back to installed status so that they won't be removed by commands like "dpkg -Pa"
This is sample output - yours may be different.
0

dpkg -l | grep ^ri | awk '{print $2 " install"}' | sudo dpkg --set-selections

ajmccluskey · 2013-11-23 06:41:18 14
Remove all older kernels then the current running kernel for Ubuntu/Debian base system
This is sample output - yours may be different.
0

export KEEP_KERNEL=2; dpkg -l 'linux-image*' | awk '/^ii/ { print $2 }' | grep "[0-9]" | awk 'BEGIN{i=1}{print i++, $0}' | grep `uname -r` -B99 | sort -r | tail -n+$(($KEEP_KERNEL+2)) | awk '{print $2}'| xargs apt-get -y purge

The_IceMan_Blog · 2013-11-23 15:35:42 7
Kill all processes found in grep

Kills all processes with a certain string. This was done to kill all ssh sessions openned by zenoss which look like: usr/bin/ssh /opt/zenoss/bin/zenmodeler
This is sample output - yours may be different.
0

for line in `ps aux | grep <string> | awk '{print $2}'`; do sudo kill $line; done;

mjbrune · 2013-11-24 00:02:16 17
list executed files current dir
This is sample output - yours may be different.
0

ls -al | awk '/^-rwx/ {print $9}'

qixingyue · 2013-11-24 03:37:49 7
fstab update
This is sample output - yours may be different.
0

mv /etc/fstab /etc/fstab.old && mount | awk '{print $1, $3, $5, $6}'| sed s/$//g|sed s/$/' 0 0'/g >> /etc/fstab

cas_alexi · 2013-11-26 06:31:27 6
‹ First < 37 38 39 40 41 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Create black and white image

Use ImageMagick to create a "black and white" copy of an image.

Given $PID, print all child processes on stdout

Simpler.

Change the default editor for modifying the sudoers list.

On Ubuntu, the default editor for visudo is nano. To change the editor to something else (e.g., vi) use this command.

Generate a list of installed packages on Debian-based systems

This command is useful when you want to install the same packages on another fresh OS install for example. To do that, use: $ sudo dpkg --set-selections < LIST_FILE

Find files and list them sorted by modification time

Works with files containing spaces and for very large directories.

command to change the exif date time of a image

Convert CSV to JSON

Replace 'csv_file.csv' with your filename.

Find usb device in realtime

Using this command you can track a moment when usb device was attached.

Undo several commits by committing an inverse patch.

Use this to make a new commit that "softly" reverts a branch to some commit (i.e. squashes the history into an inverse patch). You can review the changes first by doing the diff alone.

Convert A USB Cable Into A Smart Home Gadget

An old USB A/B cable is all you need to make your own Smart Home hardware! Cut off and discard the B-portion of the USB cable. On the A side, connect the RED (+) and WHITE (D-) wires via a 1 kiloohm resistor. $Picture: http://imgur.com/dJGVlAU Now plug the cable into a USB port on your Linux computer. Your hardware is ready! Run the above command after changing variable mysms to your personal email-to-SMS gateway info as required by your cellular service provider. The command uses the amazing usbmon tool (see link below) to detect the cable. For the curious, to view the raw usbmon output, run this command: (Also see the sample output) $usbmon -i usb0 How does it work? When the red and white wires are connected (via the 1 kiloohm resistor) the USB hardwere is tricked into thinking that a new USB device is trying to start up. We then use the usbmon utility to capture the host USB events as it tries to talk to the cable. The expect utility watches the usbmon stream and waits for the disconnect text "-2:128" before sending the SMS message. Finally, the sendmail tool is used to email the SMS message to your smartphone via your cellular provider's SMS-to-email gateway. As a result, when the electrical connection between the red and white wire is interrupted, or the USB cable is unplugged from your computer, you get an SMS notification of the disconnect event on your smartphone. Could this be the cheapest smart home gadget ever? What are YOU going to sense with it? Please let me know in the comments and please don't forget to click it up! $ $Links: $ http://www.linuxcertif.com/man/8/usbmon/ http://en.wikipedia.org/wiki/USB#Pinouts http://imgur.com/dJGVlAU

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by