Commands tagged awk sorted by votes

Commands tagged awk (348)

sorted by

netstat with group by (ip adress)

Same as the rest, but handle IPv6 short IPs. Also, sort in the order that you're probably looking for. Show Sample Output
This is sample output - yours may be different.
```
    239 192.168.26.242
    129 172.16.12.3
     12 192.168.26.241
     12 172.16.12.2
      2 127.0.0.1
      1 172.16.12.66
      1 172.16.115.246
```
1

netstat -ntu | awk ' $5 ~ /^(::ffff:|[0-9|])/ { gsub("::ffff:","",$5); print $5}' | cut -d: -f1 | sort | uniq -c | sort -nr

mrwulf · 2013-09-10 19:28:06 6
Get IP address from domain

shorter (thus better ;-) Show Sample Output
This is sample output - yours may be different.
```
$ dig +short nu.nl
62.69.166.254
```
1

dig +short <domain>

Iz7ueNae · 2013-09-11 13:01:03 6
Download latest NVIDIA Geforce x64 Windows driver

Download latest NVIDIA Geforce x64 Windows7-8 driver from Nvidia's website. Pulls the latest download version (which includes beta). This is the "English" version. The following command includes a 'sed' line to replace "english" with "international" if needed. You can also replace the starting subdomain with "eu." "uk." and others. Enjoy this one liner! 1 character under the max :) wget "us.download.nvidia.com$(wget -qO- "$(wget -qO- "nvidia.com/Download/processFind.aspx?psid=95&pfid=695&osid=19&lid=1&lang=en-us" | awk '/driverResults.aspx/ {print $4}' | cut -d "'" -f2 | head -n 1)" | awk '/url=/ {print $2}' | sed -e "s/english/international/" | cut -d '=' -f3 | cut -d '&' -f1)" Show Sample Output
This is sample output - yours may be different.
```
HTTP request sent, awaiting response... 200 OK
Length: 211183464 (201M) [application/octet-stream]
Saving to: ?331.82-desktop-win8-win7-winvista-64bit-english-whql.exe?
```
1

wget "us.download.nvidia.com$(wget -qO- "$(wget -qO- "nvidia.com/Download/processFind.aspx?psid=95&pfid=695&osid=19&lid=1&lang=en-us"|awk '/driverResults.aspx/ {print $4}'|cut -d "'" -f2|head -n 1)"|awk '/url=/ {print $2}'|cut -d '=' -f3|cut -d '&' -f1)"

lowjax · 2013-11-21 03:04:59 11
Get current Xorg resolution via xrandr
This is sample output - yours may be different.
1

xrandr | grep \* | awk '{print $1}'

sgnn7 · 2013-12-06 17:45:49 6
List all duplicate directories

Very quick! Based only on the content sizes and the character counts of filenames. If both numbers are equal then two (or more) directories seem to be most likely identical. if in doubt apply: diff -rq path_to_dir1 path_to_dir2 AWK function taken from here: http://stackoverflow.com/questions/2912224/find-duplicates-lines-based-on-some-delimited-fileds-on-line Show Sample Output
This is sample output - yours may be different.
```
215 1320 ./hwebcam048.kopija
215 1320 ./hwebcam048
24 16 ./ac3dlx/lib/tk8.5/ttk/CVS
24 16 ./ac3dlx/lib/tk8.4/CVS
24 16 ./ac3dlx/tcl/CVS
```
1

find . -type d| while read i; do echo $(ls -1 "$i"|wc -m) $(du -s "$i"); done|sort -s -n -k1,1 -k2,2 |awk -F'[ \t]+' '{ idx=$1$2; if (array[idx] == 1) {print} else if (array[idx]) {print array[idx]; print; array[idx]=1} else {array[idx]=$0}}'

knoppix5 · 2014-02-25 22:50:09 27
calculate how much bogomips one cpu core has (assuming you have 4 cores).

on some distro's you have to replace "BogoMIPS" with "bogomips". Show Sample Output
This is sample output - yours may be different.
```
#([04:33:58][root@fritz:~]#)cat /proc/cpuinfo | grep BogoMIPS | uniq | sed 's/^.*://g' | awk '{print($1 / 4) }'
52.8375
```
1

cat /proc/cpuinfo | grep BogoMIPS | uniq | sed 's/^.*://g' | awk '{print($1 / 4) }'

derpat · 2014-03-01 03:44:03 6
Show total disk space on all partitions

show off how big your disks are Show Sample Output
This is sample output - yours may be different.
```
Filesystem                  Size  Used Avail Use% Mounted on
total                       7.5T  2.7T  4.9T  36% -
```
1

df -h --total | awk 'NR==1; END{print}'

PROJAK_SX · 2014-03-01 19:52:50 8
truncate deleted files from lsof

While the posted solution works, I'm a bit uneasy about the "%d" part. This would be hyper-correct approach: lsof|gawk '$4~/txt/{next};/REG.*$deleted$$/{sub(/.$/,"",$4);printf ">/proc/%s/fd/%s\n", $2,$4}' Oh, and you gotta pipe the result to sh if you want it to actually trim the files. ;) Btw, this approach also removes false negatives (OP's command skips any deleted files with "txt" in their name).
This is sample output - yours may be different.
1

lsof|gawk '$4~/txt/{next};/REG.*$deleted$$/{printf ">/proc/%s/fd/%d\n", $2,$4}'

wejn · 2014-03-11 10:40:32 12
Sysadmin day date of any given year

Calculate the date of Sysadmin day (last Friday of July) of any given year Show Sample Output
This is sample output - yours may be different.
```
Jul 31
```
1

YEAR=2015; echo Jul $(ncal 7 $YEAR | awk '/^Fr/{print $NF}')

andreasS · 2014-08-17 11:12:09 8
tcpdump top 10 talkers

capture 2000 packets and print the top 10 talkers
This is sample output - yours may be different.
1

tcpdump -tnn -c 2000 -i eth0 | awk -F "." '{print $1"."$2"."$3"."$4}' | sort | uniq -c | sort -nr | awk ' $1 > 10 '

hochmeister · 2014-09-26 01:15:23 10
Print the IPv4 address of a given interface
This is sample output - yours may be different.
1

ip addr show enp3s0 | awk '/inet[^6]/{print $2}' | awk -F'/' '{print $1}'

hochmeister · 2014-10-10 17:58:47 8
convert Decimal to IP from stdin

https://stackoverflow.com/questions/10768160/ip-address-converter Show Sample Output
This is sample output - yours may be different.
```
echo "
3749846016
3749846016
3749846016
" | awk {'print rshift(and($1, 0xFF000000), 24) "." rshift(and($1, 0x00FF0000), 16) "." rshift(and($1, 0x0000FF00), 8) "." and($1, 0x000000FF)'} 
0.0.0.0
223.130.28.0
223.130.28.0
223.130.28.0
0.0.0.0
```
1

awk {'print rshift(and($1, 0xFF000000), 24) "." rshift(and($1, 0x00FF0000), 16) "." rshift(and($1, 0x0000FF00), 8) "." and($1, 0x000000FF)'}

emphazer · 2018-08-16 11:46:26 346
List top 100 djs from https://djmag.com/top100djs
This is sample output - yours may be different.
1

lynx -listonly -nonumbers -dump https://djmag.com/top100djs|sed '1d'|cut -d- -f5,6,7|sed -n '180,$p'|nl --number-format=rn --number-width=3|sed 's/-/ /g'|sed -e 's/.*/\L&/' -e 's/\<./\u&/g'

wuseman1 · 2019-01-20 08:23:18 33
worse alternative to <ctrl+r>

worse alternative to ctrl+r: grep the history removing duplicates without sorting (case insensitive search). Show Sample Output
This is sample output - yours may be different.
```
head ~/.bash_history # history sample for reference:
echo "duplicate"
awk --help
echo "duplicate"
echo "ctrl+r is better"

# input:
memo echo

# output:
echo "duplicate"
echo "ctrl+r is better"
```
1

function memo() { awk '! seen[$0]++' <<< $(grep -i "$@" ~/.bash_history ); }

mikhail · 2019-04-04 00:54:43 36

Show whats going on restoring files from a spectrum protect backup

spectrum protect's dsmc command shows file names and total amount of restore. This command shows which files are actually open and their siz in GB and highlights the change to the previous output Show Sample Output

watch -n60 -d 'lsof -w /filesysname|grep -v NAME|awk '\''{$7=int($7/1073741824) " GB"; print $7, $9}'\'''

BodoGreif · 2019-09-02 11:49:20 94

Parse m3u playlist file for total time

Parse an m3u file with seconds for each item and output the length of the entire playlist Show Sample Output
This is sample output - yours may be different.
```
03:13:37
```
1

awk -F":|," '{RS="#"; sec+=$2}END{h=(sec/3600);m=((sec/60) % 60);s=(s;printf("%02d:%02d:%02d\n", h, m, s)}' file.m3u

jonavon · 2020-05-16 18:55:32 102
Print lines in a text file with numbers in first column higher or equal than a value

A text file contains thousands of numbers. This command prints lines were the number is greater or equal than a specified value (134000000). Show Sample Output
This is sample output - yours may be different.
```
134013941.402859
134298679.533591
134694074.478486
```
1

awk '$NF >= 134000000 {print $0}' single-column-numbers.txt

bugmenot · 2021-06-30 07:48:47 162
Shows a specific process memory usage
This is sample output - yours may be different.
1

mem() { ps -C "$1" -O rss | awk '{ count ++; sum += $2 }; END {count --; print "Number of processes:\t",count; print "Mem. usage per process:\t",sum/1024/count, "MB"; print "Total memory usage:\t", sum/1024, "MB" ;};'; }

mikhail · 2022-01-23 16:14:24 368
Bash command to convert IP addresses into their "reverse" form
This is sample output - yours may be different.
1

echo "32.6.6.102" | awk -F. '{print $4"."$3"." $2"."$1}'

SeeFor · 2022-04-14 20:07:05 527
Extract the daily average number of iops

You need sysstat and gawk for this to work. Show Sample Output
This is sample output - yours may be different.
```
4789.98
4286.45
4286.23
4028.34
4108.42
812.15
3171.27
3696.37
4584.12
```
0

for x in `seq -w 1 30`; do sar -b -f /var/log/sa/sa$x | gawk '/Average/ {print $2}'; done

unixmonkey4319 · 2009-06-17 02:46:52 4
String Capitalization

Helpful when we want to do mass file renaming(especially mp3s). Show Sample Output
This is sample output - yours may be different.
```
$ (STRING="COmManDLinEfU"; echo "${STRING}" | tr '[A-Z]' '[a-z]' | awk '{print toupper(substr($0,1,1))substr($0,2);}')
Commandlinefu
```
0

echo "${STRING}" | tr '[A-Z]' '[a-z]' | awk '{print toupper(substr($0,1,1))substr($0,2);}'

mohan43u · 2009-06-23 21:11:34 119
Watch number of lines being processed on a clear screen

awk can clear the screen while displaying output. This is a handy way of seeing how many lines a tail -f has hit or see how many files find has found. On solaris, you may have to use 'nawk' and your machine needs 'tput' Show Sample Output
This is sample output - yours may be different.
```
13164
```
0

cat /dev/urandom|awk 'BEGIN{"tput cuu1" | getline CursorUp; "tput clear" | getline Clear; printf Clear}{num+=1;printf CursorUp; print num}'

axelabs · 2009-07-13 07:30:51 5
Edit all files found having a specific string found by grep

This will drop you into vim to edit all files that contain your grep string.
This is sample output - yours may be different.
0

grep -ir 'foo' * | awk '{print $1}' | sed -e 's/://' | xargs vim

elubow · 2009-09-03 15:12:27 3
Edit all files found having a specific string found by grep

saves one command. Needs GNU grep though :-(
This is sample output - yours may be different.
0

grep -ir 'foo' * | awk -F '{print $1}' | xargs vim

verboEse · 2009-09-03 15:58:47 3
Fibonacci numbers with awk

Does not require input to function or complete. Number of iterations controlled by shell variable $NUM. Show Sample Output
This is sample output - yours may be different.
```
1
1
2
3
5
8
13
21
34
55
89
144
233
377
610
987
1597
2584
4181
6765
10946
17711
28657
```
0

awk 'BEGIN {a=1;b=1;for(i=0;i<'${NUM}';i++){print a;c=a+b;a=b;b=c}}'

arcege · 2009-09-06 03:05:55 4
‹ First < 5 6 7 8 9 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Include a remote file (in vim)

Like vim scp://yourhost//your/file but in vim cmds.

Send a local file via email

if "mail -a" fail, try "mutt -a" or "nail -a"

Wait for file to stop changing

Here's a way to wait for a file (a download, a logfile, etc) to stop changing, then do something. As written it will just return to the prompt, but you could add a "; echo DONE" or whatever at the end. This just compares the full output of "ls" every 10 seconds, and keeps going as long as that output has changed since the last interval. If the file is being appended to, the size will change, and if it's being modified without growing, the timestamp from the "--full-time" option will have changed. The output of just "ls -l" isn't sufficient since by default it doesn't show seconds, just minutes. Waiting for a file to stop changing is not a very elegant or reliable way to measure that some process is finished - if you know the process ID there are much better ways. This method will also give a false positive if the changes to the target file are delayed longer than the sleep interval for any reason (network timeouts, etc). But sometimes the process that is writing the file doesn't exit, rather it continues on doing something else, so this approach can be useful if you understand its limitations.

Partition a sequence of disk drives for LVM with fdisk

So, I'm using a CentOS VM in VirtualBox, and created four new disks in the SCSI controller. The VM created the folders: /dev/sda /dev/sdb /dev/sdc /dev/sdd Using a 'for loop' all disks are partitioned for LVM.

Show current network interface in use

Give any files that don't already have it group read permission under the current folder (recursive)

Makes any files in the current directory (and any sub-directories) group-readable. Using the "! -perm /g=r" limits the number of files to only those that do not already have this property Using "+" on the end of the -exec body tells find to build the entire command by appending all matching files before execution, so invokes chmod once only, not once per file.

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

list files recursively by size

start a tunnel from some machine's port 80 to your local post 2001

now you can acces the website by going to http://localhost:2001/

Figure out what shell you're running

short, sweet, and works after sudoing a new shell.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged awk

Commands tagged awk (348) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged awk (348)

sorted by