Commands tagged awk sorted by votes

Commands tagged awk (348)

sorted by

netstat with group by (ip adress)

Same as the rest, but handle IPv6 short IPs. Also, sort in the order that you're probably looking for. Show Sample Output
This is sample output - yours may be different.
```
    239 192.168.26.242
    129 172.16.12.3
     12 192.168.26.241
     12 172.16.12.2
      2 127.0.0.1
      1 172.16.12.66
      1 172.16.115.246
```
1

netstat -ntu | awk ' $5 ~ /^(::ffff:|[0-9|])/ { gsub("::ffff:","",$5); print $5}' | cut -d: -f1 | sort | uniq -c | sort -nr

mrwulf · 2013-09-10 19:28:06 6
Get IP address from domain

shorter (thus better ;-) Show Sample Output
This is sample output - yours may be different.
```
$ dig +short nu.nl
62.69.166.254
```
1

dig +short <domain>

Iz7ueNae · 2013-09-11 13:01:03 6
Download latest NVIDIA Geforce x64 Windows driver

Download latest NVIDIA Geforce x64 Windows7-8 driver from Nvidia's website. Pulls the latest download version (which includes beta). This is the "English" version. The following command includes a 'sed' line to replace "english" with "international" if needed. You can also replace the starting subdomain with "eu." "uk." and others. Enjoy this one liner! 1 character under the max :) wget "us.download.nvidia.com$(wget -qO- "$(wget -qO- "nvidia.com/Download/processFind.aspx?psid=95&pfid=695&osid=19&lid=1&lang=en-us" | awk '/driverResults.aspx/ {print $4}' | cut -d "'" -f2 | head -n 1)" | awk '/url=/ {print $2}' | sed -e "s/english/international/" | cut -d '=' -f3 | cut -d '&' -f1)" Show Sample Output
This is sample output - yours may be different.
```
HTTP request sent, awaiting response... 200 OK
Length: 211183464 (201M) [application/octet-stream]
Saving to: ?331.82-desktop-win8-win7-winvista-64bit-english-whql.exe?
```
1

wget "us.download.nvidia.com$(wget -qO- "$(wget -qO- "nvidia.com/Download/processFind.aspx?psid=95&pfid=695&osid=19&lid=1&lang=en-us"|awk '/driverResults.aspx/ {print $4}'|cut -d "'" -f2|head -n 1)"|awk '/url=/ {print $2}'|cut -d '=' -f3|cut -d '&' -f1)"

lowjax · 2013-11-21 03:04:59 11
Get current Xorg resolution via xrandr
This is sample output - yours may be different.
1

xrandr | grep \* | awk '{print $1}'

sgnn7 · 2013-12-06 17:45:49 6
List all duplicate directories

Very quick! Based only on the content sizes and the character counts of filenames. If both numbers are equal then two (or more) directories seem to be most likely identical. if in doubt apply: diff -rq path_to_dir1 path_to_dir2 AWK function taken from here: http://stackoverflow.com/questions/2912224/find-duplicates-lines-based-on-some-delimited-fileds-on-line Show Sample Output
This is sample output - yours may be different.
```
215 1320 ./hwebcam048.kopija
215 1320 ./hwebcam048
24 16 ./ac3dlx/lib/tk8.5/ttk/CVS
24 16 ./ac3dlx/lib/tk8.4/CVS
24 16 ./ac3dlx/tcl/CVS
```
1

find . -type d| while read i; do echo $(ls -1 "$i"|wc -m) $(du -s "$i"); done|sort -s -n -k1,1 -k2,2 |awk -F'[ \t]+' '{ idx=$1$2; if (array[idx] == 1) {print} else if (array[idx]) {print array[idx]; print; array[idx]=1} else {array[idx]=$0}}'

knoppix5 · 2014-02-25 22:50:09 27
calculate how much bogomips one cpu core has (assuming you have 4 cores).

on some distro's you have to replace "BogoMIPS" with "bogomips". Show Sample Output
This is sample output - yours may be different.
```
#([04:33:58][root@fritz:~]#)cat /proc/cpuinfo | grep BogoMIPS | uniq | sed 's/^.*://g' | awk '{print($1 / 4) }'
52.8375
```
1

cat /proc/cpuinfo | grep BogoMIPS | uniq | sed 's/^.*://g' | awk '{print($1 / 4) }'

derpat · 2014-03-01 03:44:03 6
Show total disk space on all partitions

show off how big your disks are Show Sample Output
This is sample output - yours may be different.
```
Filesystem                  Size  Used Avail Use% Mounted on
total                       7.5T  2.7T  4.9T  36% -
```
1

df -h --total | awk 'NR==1; END{print}'

PROJAK_SX · 2014-03-01 19:52:50 8
truncate deleted files from lsof

While the posted solution works, I'm a bit uneasy about the "%d" part. This would be hyper-correct approach: lsof|gawk '$4~/txt/{next};/REG.*$deleted$$/{sub(/.$/,"",$4);printf ">/proc/%s/fd/%s\n", $2,$4}' Oh, and you gotta pipe the result to sh if you want it to actually trim the files. ;) Btw, this approach also removes false negatives (OP's command skips any deleted files with "txt" in their name).
This is sample output - yours may be different.
1

lsof|gawk '$4~/txt/{next};/REG.*$deleted$$/{printf ">/proc/%s/fd/%d\n", $2,$4}'

wejn · 2014-03-11 10:40:32 12
Sysadmin day date of any given year

Calculate the date of Sysadmin day (last Friday of July) of any given year Show Sample Output
This is sample output - yours may be different.
```
Jul 31
```
1

YEAR=2015; echo Jul $(ncal 7 $YEAR | awk '/^Fr/{print $NF}')

andreasS · 2014-08-17 11:12:09 8
tcpdump top 10 talkers

capture 2000 packets and print the top 10 talkers
This is sample output - yours may be different.
1

tcpdump -tnn -c 2000 -i eth0 | awk -F "." '{print $1"."$2"."$3"."$4}' | sort | uniq -c | sort -nr | awk ' $1 > 10 '

hochmeister · 2014-09-26 01:15:23 10
Print the IPv4 address of a given interface
This is sample output - yours may be different.
1

ip addr show enp3s0 | awk '/inet[^6]/{print $2}' | awk -F'/' '{print $1}'

hochmeister · 2014-10-10 17:58:47 8
convert Decimal to IP from stdin

https://stackoverflow.com/questions/10768160/ip-address-converter Show Sample Output
This is sample output - yours may be different.
```
echo "
3749846016
3749846016
3749846016
" | awk {'print rshift(and($1, 0xFF000000), 24) "." rshift(and($1, 0x00FF0000), 16) "." rshift(and($1, 0x0000FF00), 8) "." and($1, 0x000000FF)'} 
0.0.0.0
223.130.28.0
223.130.28.0
223.130.28.0
0.0.0.0
```
1

awk {'print rshift(and($1, 0xFF000000), 24) "." rshift(and($1, 0x00FF0000), 16) "." rshift(and($1, 0x0000FF00), 8) "." and($1, 0x000000FF)'}

emphazer · 2018-08-16 11:46:26 355
List top 100 djs from https://djmag.com/top100djs
This is sample output - yours may be different.
1

lynx -listonly -nonumbers -dump https://djmag.com/top100djs|sed '1d'|cut -d- -f5,6,7|sed -n '180,$p'|nl --number-format=rn --number-width=3|sed 's/-/ /g'|sed -e 's/.*/\L&/' -e 's/\<./\u&/g'

wuseman1 · 2019-01-20 08:23:18 33
worse alternative to <ctrl+r>

worse alternative to ctrl+r: grep the history removing duplicates without sorting (case insensitive search). Show Sample Output
This is sample output - yours may be different.
```
head ~/.bash_history # history sample for reference:
echo "duplicate"
awk --help
echo "duplicate"
echo "ctrl+r is better"

# input:
memo echo

# output:
echo "duplicate"
echo "ctrl+r is better"
```
1

function memo() { awk '! seen[$0]++' <<< $(grep -i "$@" ~/.bash_history ); }

mikhail · 2019-04-04 00:54:43 36

Show whats going on restoring files from a spectrum protect backup

spectrum protect's dsmc command shows file names and total amount of restore. This command shows which files are actually open and their siz in GB and highlights the change to the previous output Show Sample Output

watch -n60 -d 'lsof -w /filesysname|grep -v NAME|awk '\''{$7=int($7/1073741824) " GB"; print $7, $9}'\'''

BodoGreif · 2019-09-02 11:49:20 95

Parse m3u playlist file for total time

Parse an m3u file with seconds for each item and output the length of the entire playlist Show Sample Output
This is sample output - yours may be different.
```
03:13:37
```
1

awk -F":|," '{RS="#"; sec+=$2}END{h=(sec/3600);m=((sec/60) % 60);s=(s;printf("%02d:%02d:%02d\n", h, m, s)}' file.m3u

jonavon · 2020-05-16 18:55:32 102
Print lines in a text file with numbers in first column higher or equal than a value

A text file contains thousands of numbers. This command prints lines were the number is greater or equal than a specified value (134000000). Show Sample Output
This is sample output - yours may be different.
```
134013941.402859
134298679.533591
134694074.478486
```
1

awk '$NF >= 134000000 {print $0}' single-column-numbers.txt

bugmenot · 2021-06-30 07:48:47 164
Shows a specific process memory usage
This is sample output - yours may be different.
1

mem() { ps -C "$1" -O rss | awk '{ count ++; sum += $2 }; END {count --; print "Number of processes:\t",count; print "Mem. usage per process:\t",sum/1024/count, "MB"; print "Total memory usage:\t", sum/1024, "MB" ;};'; }

mikhail · 2022-01-23 16:14:24 370
Bash command to convert IP addresses into their "reverse" form
This is sample output - yours may be different.
1

echo "32.6.6.102" | awk -F. '{print $4"."$3"." $2"."$1}'

SeeFor · 2022-04-14 20:07:05 537
Extract the daily average number of iops

You need sysstat and gawk for this to work. Show Sample Output
This is sample output - yours may be different.
```
4789.98
4286.45
4286.23
4028.34
4108.42
812.15
3171.27
3696.37
4584.12
```
0

for x in `seq -w 1 30`; do sar -b -f /var/log/sa/sa$x | gawk '/Average/ {print $2}'; done

unixmonkey4319 · 2009-06-17 02:46:52 4
String Capitalization

Helpful when we want to do mass file renaming(especially mp3s). Show Sample Output
This is sample output - yours may be different.
```
$ (STRING="COmManDLinEfU"; echo "${STRING}" | tr '[A-Z]' '[a-z]' | awk '{print toupper(substr($0,1,1))substr($0,2);}')
Commandlinefu
```
0

echo "${STRING}" | tr '[A-Z]' '[a-z]' | awk '{print toupper(substr($0,1,1))substr($0,2);}'

mohan43u · 2009-06-23 21:11:34 119
Watch number of lines being processed on a clear screen

awk can clear the screen while displaying output. This is a handy way of seeing how many lines a tail -f has hit or see how many files find has found. On solaris, you may have to use 'nawk' and your machine needs 'tput' Show Sample Output
This is sample output - yours may be different.
```
13164
```
0

cat /dev/urandom|awk 'BEGIN{"tput cuu1" | getline CursorUp; "tput clear" | getline Clear; printf Clear}{num+=1;printf CursorUp; print num}'

axelabs · 2009-07-13 07:30:51 5
Edit all files found having a specific string found by grep

This will drop you into vim to edit all files that contain your grep string.
This is sample output - yours may be different.
0

grep -ir 'foo' * | awk '{print $1}' | sed -e 's/://' | xargs vim

elubow · 2009-09-03 15:12:27 3
Edit all files found having a specific string found by grep

saves one command. Needs GNU grep though :-(
This is sample output - yours may be different.
0

grep -ir 'foo' * | awk -F '{print $1}' | xargs vim

verboEse · 2009-09-03 15:58:47 3
Fibonacci numbers with awk

Does not require input to function or complete. Number of iterations controlled by shell variable $NUM. Show Sample Output
This is sample output - yours may be different.
```
1
1
2
3
5
8
13
21
34
55
89
144
233
377
610
987
1597
2584
4181
6765
10946
17711
28657
```
0

awk 'BEGIN {a=1;b=1;for(i=0;i<'${NUM}';i++){print a;c=a+b;a=b;b=c}}'

arcege · 2009-09-06 03:05:55 4
‹ First < 5 6 7 8 9 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

lsof - cleaned up for just open listening ports, the process, and the owner of the process

another formatting/oneliner for lsof User - Process - Port

Schedule a command while one is already running.

Useful when you have only one terminal session e.g. ssh. and want to queue up another command after the currently running has finished(in case if you forget to run that command). Originally used as ; python-updater when running emerge. When I have noticed that a package failed due to that command not run.

Open a manpage in the default (graphical) web browser

An easy alias for opening a manpage, nicely HTML formatted, in your set internet browser. If you get a "command exited with status 3" error you need to install groff.

Best option set for 7zip compression of database dumps or generic text files

These re the best option combination that works fine for compressing my database dumps. It's possible that there are another option or value that might improve the compression ratio, by these are the ones that worked, the syntax for 7zr it's a little messy...

exec chmod to subfiles

Using `-exec cmd {} +` causes find to build the command using all matching filenames before execution, rather than once per file.

Convert CSV to JSON with miller

Using the csv tool `miller` you can transform a csv file into a json array of objects, where the properties are the values of the csv header line and the values are the values of the subsequent lines.

stream a youtube video with mpv where $1 is the youtube link.

opens a new session with video stream

Get your external IP address

Request all information about my IP address in json format

Split and join with split and cat.

`split -b 1k file` splits files into 1k chunks. Rejoin them with `cat x* > file`.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged awk

Commands tagged awk (348) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged awk (348)

sorted by