Commands tagged awk sorted by votes

Commands tagged awk (348)

sorted by

netstat with group by (ip adress)

Same as the rest, but handle IPv6 short IPs. Also, sort in the order that you're probably looking for. Show Sample Output
This is sample output - yours may be different.
```
    239 192.168.26.242
    129 172.16.12.3
     12 192.168.26.241
     12 172.16.12.2
      2 127.0.0.1
      1 172.16.12.66
      1 172.16.115.246
```
1

netstat -ntu | awk ' $5 ~ /^(::ffff:|[0-9|])/ { gsub("::ffff:","",$5); print $5}' | cut -d: -f1 | sort | uniq -c | sort -nr

mrwulf · 2013-09-10 19:28:06 6
Get IP address from domain

shorter (thus better ;-) Show Sample Output
This is sample output - yours may be different.
```
$ dig +short nu.nl
62.69.166.254
```
1

dig +short <domain>

Iz7ueNae · 2013-09-11 13:01:03 6
Download latest NVIDIA Geforce x64 Windows driver

Download latest NVIDIA Geforce x64 Windows7-8 driver from Nvidia's website. Pulls the latest download version (which includes beta). This is the "English" version. The following command includes a 'sed' line to replace "english" with "international" if needed. You can also replace the starting subdomain with "eu." "uk." and others. Enjoy this one liner! 1 character under the max :) wget "us.download.nvidia.com$(wget -qO- "$(wget -qO- "nvidia.com/Download/processFind.aspx?psid=95&pfid=695&osid=19&lid=1&lang=en-us" | awk '/driverResults.aspx/ {print $4}' | cut -d "'" -f2 | head -n 1)" | awk '/url=/ {print $2}' | sed -e "s/english/international/" | cut -d '=' -f3 | cut -d '&' -f1)" Show Sample Output
This is sample output - yours may be different.
```
HTTP request sent, awaiting response... 200 OK
Length: 211183464 (201M) [application/octet-stream]
Saving to: ?331.82-desktop-win8-win7-winvista-64bit-english-whql.exe?
```
1

wget "us.download.nvidia.com$(wget -qO- "$(wget -qO- "nvidia.com/Download/processFind.aspx?psid=95&pfid=695&osid=19&lid=1&lang=en-us"|awk '/driverResults.aspx/ {print $4}'|cut -d "'" -f2|head -n 1)"|awk '/url=/ {print $2}'|cut -d '=' -f3|cut -d '&' -f1)"

lowjax · 2013-11-21 03:04:59 11
Get current Xorg resolution via xrandr
This is sample output - yours may be different.
1

xrandr | grep \* | awk '{print $1}'

sgnn7 · 2013-12-06 17:45:49 6
List all duplicate directories

Very quick! Based only on the content sizes and the character counts of filenames. If both numbers are equal then two (or more) directories seem to be most likely identical. if in doubt apply: diff -rq path_to_dir1 path_to_dir2 AWK function taken from here: http://stackoverflow.com/questions/2912224/find-duplicates-lines-based-on-some-delimited-fileds-on-line Show Sample Output
This is sample output - yours may be different.
```
215 1320 ./hwebcam048.kopija
215 1320 ./hwebcam048
24 16 ./ac3dlx/lib/tk8.5/ttk/CVS
24 16 ./ac3dlx/lib/tk8.4/CVS
24 16 ./ac3dlx/tcl/CVS
```
1

find . -type d| while read i; do echo $(ls -1 "$i"|wc -m) $(du -s "$i"); done|sort -s -n -k1,1 -k2,2 |awk -F'[ \t]+' '{ idx=$1$2; if (array[idx] == 1) {print} else if (array[idx]) {print array[idx]; print; array[idx]=1} else {array[idx]=$0}}'

knoppix5 · 2014-02-25 22:50:09 27
calculate how much bogomips one cpu core has (assuming you have 4 cores).

on some distro's you have to replace "BogoMIPS" with "bogomips". Show Sample Output
This is sample output - yours may be different.
```
#([04:33:58][root@fritz:~]#)cat /proc/cpuinfo | grep BogoMIPS | uniq | sed 's/^.*://g' | awk '{print($1 / 4) }'
52.8375
```
1

cat /proc/cpuinfo | grep BogoMIPS | uniq | sed 's/^.*://g' | awk '{print($1 / 4) }'

derpat · 2014-03-01 03:44:03 6
Show total disk space on all partitions

show off how big your disks are Show Sample Output
This is sample output - yours may be different.
```
Filesystem                  Size  Used Avail Use% Mounted on
total                       7.5T  2.7T  4.9T  36% -
```
1

df -h --total | awk 'NR==1; END{print}'

PROJAK_SX · 2014-03-01 19:52:50 8
truncate deleted files from lsof

While the posted solution works, I'm a bit uneasy about the "%d" part. This would be hyper-correct approach: lsof|gawk '$4~/txt/{next};/REG.*$deleted$$/{sub(/.$/,"",$4);printf ">/proc/%s/fd/%s\n", $2,$4}' Oh, and you gotta pipe the result to sh if you want it to actually trim the files. ;) Btw, this approach also removes false negatives (OP's command skips any deleted files with "txt" in their name).
This is sample output - yours may be different.
1

lsof|gawk '$4~/txt/{next};/REG.*$deleted$$/{printf ">/proc/%s/fd/%d\n", $2,$4}'

wejn · 2014-03-11 10:40:32 12
Sysadmin day date of any given year

Calculate the date of Sysadmin day (last Friday of July) of any given year Show Sample Output
This is sample output - yours may be different.
```
Jul 31
```
1

YEAR=2015; echo Jul $(ncal 7 $YEAR | awk '/^Fr/{print $NF}')

andreasS · 2014-08-17 11:12:09 8
tcpdump top 10 talkers

capture 2000 packets and print the top 10 talkers
This is sample output - yours may be different.
1

tcpdump -tnn -c 2000 -i eth0 | awk -F "." '{print $1"."$2"."$3"."$4}' | sort | uniq -c | sort -nr | awk ' $1 > 10 '

hochmeister · 2014-09-26 01:15:23 10
Print the IPv4 address of a given interface
This is sample output - yours may be different.
1

ip addr show enp3s0 | awk '/inet[^6]/{print $2}' | awk -F'/' '{print $1}'

hochmeister · 2014-10-10 17:58:47 8
convert Decimal to IP from stdin

https://stackoverflow.com/questions/10768160/ip-address-converter Show Sample Output
This is sample output - yours may be different.
```
echo "
3749846016
3749846016
3749846016
" | awk {'print rshift(and($1, 0xFF000000), 24) "." rshift(and($1, 0x00FF0000), 16) "." rshift(and($1, 0x0000FF00), 8) "." and($1, 0x000000FF)'} 
0.0.0.0
223.130.28.0
223.130.28.0
223.130.28.0
0.0.0.0
```
1

awk {'print rshift(and($1, 0xFF000000), 24) "." rshift(and($1, 0x00FF0000), 16) "." rshift(and($1, 0x0000FF00), 8) "." and($1, 0x000000FF)'}

emphazer · 2018-08-16 11:46:26 355
List top 100 djs from https://djmag.com/top100djs
This is sample output - yours may be different.
1

lynx -listonly -nonumbers -dump https://djmag.com/top100djs|sed '1d'|cut -d- -f5,6,7|sed -n '180,$p'|nl --number-format=rn --number-width=3|sed 's/-/ /g'|sed -e 's/.*/\L&/' -e 's/\<./\u&/g'

wuseman1 · 2019-01-20 08:23:18 33
worse alternative to <ctrl+r>

worse alternative to ctrl+r: grep the history removing duplicates without sorting (case insensitive search). Show Sample Output
This is sample output - yours may be different.
```
head ~/.bash_history # history sample for reference:
echo "duplicate"
awk --help
echo "duplicate"
echo "ctrl+r is better"

# input:
memo echo

# output:
echo "duplicate"
echo "ctrl+r is better"
```
1

function memo() { awk '! seen[$0]++' <<< $(grep -i "$@" ~/.bash_history ); }

mikhail · 2019-04-04 00:54:43 36

Show whats going on restoring files from a spectrum protect backup

spectrum protect's dsmc command shows file names and total amount of restore. This command shows which files are actually open and their siz in GB and highlights the change to the previous output Show Sample Output

watch -n60 -d 'lsof -w /filesysname|grep -v NAME|awk '\''{$7=int($7/1073741824) " GB"; print $7, $9}'\'''

BodoGreif · 2019-09-02 11:49:20 95

Parse m3u playlist file for total time

Parse an m3u file with seconds for each item and output the length of the entire playlist Show Sample Output
This is sample output - yours may be different.
```
03:13:37
```
1

awk -F":|," '{RS="#"; sec+=$2}END{h=(sec/3600);m=((sec/60) % 60);s=(s;printf("%02d:%02d:%02d\n", h, m, s)}' file.m3u

jonavon · 2020-05-16 18:55:32 102
Print lines in a text file with numbers in first column higher or equal than a value

A text file contains thousands of numbers. This command prints lines were the number is greater or equal than a specified value (134000000). Show Sample Output
This is sample output - yours may be different.
```
134013941.402859
134298679.533591
134694074.478486
```
1

awk '$NF >= 134000000 {print $0}' single-column-numbers.txt

bugmenot · 2021-06-30 07:48:47 162
Shows a specific process memory usage
This is sample output - yours may be different.
1

mem() { ps -C "$1" -O rss | awk '{ count ++; sum += $2 }; END {count --; print "Number of processes:\t",count; print "Mem. usage per process:\t",sum/1024/count, "MB"; print "Total memory usage:\t", sum/1024, "MB" ;};'; }

mikhail · 2022-01-23 16:14:24 369
Bash command to convert IP addresses into their "reverse" form
This is sample output - yours may be different.
1

echo "32.6.6.102" | awk -F. '{print $4"."$3"." $2"."$1}'

SeeFor · 2022-04-14 20:07:05 536
Extract the daily average number of iops

You need sysstat and gawk for this to work. Show Sample Output
This is sample output - yours may be different.
```
4789.98
4286.45
4286.23
4028.34
4108.42
812.15
3171.27
3696.37
4584.12
```
0

for x in `seq -w 1 30`; do sar -b -f /var/log/sa/sa$x | gawk '/Average/ {print $2}'; done

unixmonkey4319 · 2009-06-17 02:46:52 4
String Capitalization

Helpful when we want to do mass file renaming(especially mp3s). Show Sample Output
This is sample output - yours may be different.
```
$ (STRING="COmManDLinEfU"; echo "${STRING}" | tr '[A-Z]' '[a-z]' | awk '{print toupper(substr($0,1,1))substr($0,2);}')
Commandlinefu
```
0

echo "${STRING}" | tr '[A-Z]' '[a-z]' | awk '{print toupper(substr($0,1,1))substr($0,2);}'

mohan43u · 2009-06-23 21:11:34 119
Watch number of lines being processed on a clear screen

awk can clear the screen while displaying output. This is a handy way of seeing how many lines a tail -f has hit or see how many files find has found. On solaris, you may have to use 'nawk' and your machine needs 'tput' Show Sample Output
This is sample output - yours may be different.
```
13164
```
0

cat /dev/urandom|awk 'BEGIN{"tput cuu1" | getline CursorUp; "tput clear" | getline Clear; printf Clear}{num+=1;printf CursorUp; print num}'

axelabs · 2009-07-13 07:30:51 5
Edit all files found having a specific string found by grep

This will drop you into vim to edit all files that contain your grep string.
This is sample output - yours may be different.
0

grep -ir 'foo' * | awk '{print $1}' | sed -e 's/://' | xargs vim

elubow · 2009-09-03 15:12:27 3
Edit all files found having a specific string found by grep

saves one command. Needs GNU grep though :-(
This is sample output - yours may be different.
0

grep -ir 'foo' * | awk -F '{print $1}' | xargs vim

verboEse · 2009-09-03 15:58:47 3
Fibonacci numbers with awk

Does not require input to function or complete. Number of iterations controlled by shell variable $NUM. Show Sample Output
This is sample output - yours may be different.
```
1
1
2
3
5
8
13
21
34
55
89
144
233
377
610
987
1597
2584
4181
6765
10946
17711
28657
```
0

awk 'BEGIN {a=1;b=1;for(i=0;i<'${NUM}';i++){print a;c=a+b;a=b;b=c}}'

arcege · 2009-09-06 03:05:55 4
‹ First < 5 6 7 8 9 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Generate random valid mac addresses

First set the variable $hexchars: $hexchars="0123456789ABCDEF" Change the number in the first for loop if you need less then 1200 mac addresses

Set laptop display brightness

Run as root. Path may vary depending on laptop model and video card (this was tested on an Acer laptop with ATI HD3200 video). $ cat /proc/acpi/video/VGA/LCD/brightness to discover the possible values for your display.

check open ports without netstat or lsof

Detect encoding of a text file

This command gives you the charset of a text file, which would be handy if you have no idea of the encoding.

list all files in a directory, sorted in reverse order by modification time, use file descriptors.

It's both silly, and infinitely useful. Especially useful in logfile directories where you want to know what file is being updated while troubleshooting.

Get a range of SVN revisions from svn diff and tar gz them

Handy when you need to create a list of files to be updated when subversion is not available on the remote host. You can take this tar file, and upload and extract it where you need it. Replace M and N with the revisions specific to yours. Make sure you do this from an updated (svn up) working directory.

Tell what is encoded in a float, given its HEX bytes

It handles all possible combination of the hex bytes, including NaNs, Infinities, Normalized and Subnormal Numbers... $ This crazy DC stuff spent me a few days to write, optimize, polish and squeeze so that it works within the tight 255 character bound... $ You can modify it easily for other IEEE754 numbers, say, half, double, double-extended, quadruple $ (I hope someone will find this useful and submit more dc code to commandlinefu!)

Convert CSV to JSON

Replace 'csv_file.csv' with your filename.

Given $PID, print all child processes on stdout

Simpler.

Multi line grep using sed and specifying open/close tags

This line does not include your closing tag in the output.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged awk

Commands tagged awk (348) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged awk (348)

sorted by