Commands using awk sorted by votes

Commands using awk (1,420)

sorted by

list all file extensions in a directory

... plus do a sort according frequency Show Sample Output
This is sample output - yours may be different.
```
cp@lilith:~ > find Downloads/ -type f | awk -F'.' '{print $NF}' |sort|uniq -c|sort -g |tail
    133 svg
    133 svn-base
    192 xpm
    199 o
    207 uue
    301 cc
    441 cpp
    503 c
   1344 java
   1398 h
```
11

find . -type f | awk -F'.' '{print $NF}' | sort| uniq -c | sort -g

cp · 2011-02-14 09:15:29 9
print multiplication formulas

seq -s ' ' 1 9 | sed -n ':a;p;s/ *\w$//;h;/^$/t;b a;q' | tac | awk '{for(i=1;i 1x1=1 1x2=2 2x2=4 1x3=3 2x3=6 3x3=9 1x4=4 2x4=8 3x4=12 4x4=16 1x5=5 2x5=10 3x5=15 4x5=20 5x5=25 1x6=6 2x6=12 3x6=18 4x6=24 5x6=30 6x6=36 1x7=7 2x7=14 3x7=21 4x7=28 5x7=35 6x7=42 7x7=49 1x8=8 2x8=16 3x8=24 4x8=32 5x8=40 6x8=48 7x8=56 8x8=64 1x9=9 2x9=18 3x9=27 4x9=36 5x9=45 6x9=54 7x9=63 8x9=72 9x9=81
This is sample output - yours may be different.
11

seq 9 | sed 'H;g' | awk -v RS='' '{for(i=1;i<=NF;i++)printf("%dx%d=%d%s", i, NR, i*NR, i==NR?"\n":"\t")}'

kev · 2011-10-22 18:41:09 36
Show tcp connections sorted by Host / Most connections
This is sample output - yours may be different.
11

netstat -ntu|awk '{print $5}'|cut -d: -f1 -s|sort|uniq -c|sort -nk1 -r

dbiesecke · 2022-03-08 11:52:18 746
Measures download speed on eth0
This is sample output - yours may be different.
10

while true; do X=$Y; sleep 1; Y=$(ifconfig eth0|grep RX\ bytes|awk '{ print $2 }'|cut -d : -f 2); echo "$(( Y-X )) bps"; done

stuntdawg · 2009-03-27 08:26:39 10
sends your internal IP by email

This is useful if you have need to do port forwarding and your router doesn't assign static IPs, you can add it to a script in a cron job that checks if you IP as recently changed or with a trigger script. This was tested on Mac OSX.
This is sample output - yours may be different.
10

ifconfig en1 | awk '/inet / {print $2}' | mail -s "hello world" email@email.com

rez0r · 2009-04-28 06:01:52 13
When was your OS installed?

Show time and date when you installed your OS. Show Sample Output
This is sample output - yours may be different.
```
$ ls -lct /etc | tail -1 | awk '{print $6, $7}'
2009-08-25 13:25
```
10

ls -lct /etc | tail -1 | awk '{print $6, $7}'

MrMerry · 2009-09-03 10:26:37 13
Check which files are opened by Firefox then sort by largest size.

Just refining last proposal for this check, showing awk power to make more complex math (instead /1024/1024, 2^20). We don't need declare variable before run lsof, because $(command) returns his output. Also, awk can perform filtering by regexp instead to call grep. I changed the 0.0000xxxx messy output, with a more readable form purging all fractional numbers and files less than 1 MB. Show Sample Output
This is sample output - yours may be different.
```
41 MB -- /home/tzk/.mozilla/firefox/default/urlclassifier3.sqlite
6 MB -- /home/tzk/.mozilla/firefox/default/places.sqlite
3 MB -- /home/tzk/.mozilla/firefox/default/XPC.mfasl
2 MB -- /home/tzk/.mozilla/firefox/default/extensions/writearea@writearea.com/chrome/writearea.jar
2 MB -- /home/tzk/.mozilla/firefox/default/extensions/writearea@writearea.com/chrome/writearea.jar
2 MB -- /home/tzk/.mozilla/firefox/default/extensions/{4BBDD651-70CF-4821-84F8-2B918CF89CA3}-trash/chrome/febe.jar
```
10

lsof -p $(pidof firefox) | awk '/.mozilla/ { s = int($7/(2^20)); if(s>0) print (s)" MB -- "$9 | "sort -rn" }'

tzk · 2010-01-13 22:45:53 9
See your current RAM frequency

man dmidecode [look for type] Show Sample Output
This is sample output - yours may be different.
```
[root@ronfedora ~]# dmidecode -t 17 | awk -F":" '/Speed/ { print $2 }'
 533 MHz
 533 MHz
```
10

dmidecode -t 17 | awk -F":" '/Speed/ { print $2 }'

unixhome · 2010-02-19 12:15:13 17
Show bandwidth use oneliner

poorman's ifstat using just sh and awk. You must change "eth0" with your interface's name. Show Sample Output
This is sample output - yours may be different.
```
02:18:43     1.71 KiB/s in     0.11 KiB/s out
02:18:44     0.75 KiB/s in     0.25 KiB/s out
02:18:45     0.47 KiB/s in     0.20 KiB/s out
02:18:46     0.59 KiB/s in     0.15 KiB/s out
02:18:47     1.12 KiB/s in     1.37 KiB/s out
02:18:48     0.65 KiB/s in     0.21 KiB/s out
02:18:49     0.50 KiB/s in     0.31 KiB/s out
02:18:50     1.28 KiB/s in     0.37 KiB/s out
02:18:51     0.50 KiB/s in     0.05 KiB/s out
02:18:52     2.26 KiB/s in     0.10 KiB/s out
```
10

while true; do cat /proc/net/dev; sleep 1; done | awk -v dc="date \"+%T\"" '/eth0/{i = $2 - oi; o = $10 - oo; oi = $2; oo = $10; dc|getline d; close(dc); if (a++) printf "%s %8.2f KiB/s in %8.2f KiB/s out\n", d, i/1024, o/1024}'

point_to_null · 2011-11-21 05:24:44 14
drop first column of output by piping to this
This is sample output - yours may be different.
10

awk '{ $1="";print}'

snaguber · 2015-05-26 20:55:36 17
Click on a GUI window and show its process ID and command used to run the process

This command is useful when you want to know what process is responsible for a certain GUI application and what command you need to issue to launch it in terminal. Show Sample Output
This is sample output - yours may be different.
```
jack@jack-pc$ xprop | awk '/PID/ {print $3}' | xargs ps -p
 8025 /usr/lib/firefox-3.0.13/firefox
```
9

xprop | awk '/PID/ {print $3}' | xargs ps h -o pid,cmd

jackhab · 2009-02-16 07:55:19 88
Check the age of the filesystem

Very useful set of commands to know when your file system was created. Show Sample Output
This is sample output - yours may be different.
```
# df / | awk '{print $1}' | grep dev | xargs tune2fs -l | grep create
Filesystem created:       Fri Oct 24 03:46:36 2008
```
9

df / | awk '{print $1}' | grep dev | xargs tune2fs -l | grep create

Kaio · 2009-02-16 18:45:03 1194
awk using multiple field separators

You can use multiple field separators by separating them with | (=or). This may be helpful when you want to split a string by two separators for example. #echo "one=two three" | awk -F "=| " {'print $1, $3'} one three
This is sample output - yours may be different.
9

awk -F "=| "

Bender · 2009-03-02 21:09:51 12
Check for login failures and summarize

This command checks for the number of times when someone has tried to login to your server and failed. If there are a lot, then that user is being targeted on your system and you might want to make sure that user either has remote logins disabled, or has a strong password, or both. If your output has an "invalid" line, it is a summary of all logins from users that don't exist on your system. Show Sample Output
This is sample output - yours may be different.
```
3478 invalid
   1255 root
     11 mysql
      8 mail
      6 www-data
```
9

zgrep "Failed password" /var/log/auth.log* | awk '{print $9}' | sort | uniq -c | sort -nr | less

dbart · 2009-03-03 13:45:56 14
print file without duplicated lines using awk

This create an array 'a' with wole lines. only one occurrence of each line - Not Get lines ++ !
This is sample output - yours may be different.
9

awk '!a[$0]++' file

voyeg3r · 2009-08-23 15:28:43 6
Remove today's Debian installed packages

Adapted using your usefull comments !
This is sample output - yours may be different.
9

grep -e `date +%Y-%m-%d` /var/log/dpkg.log | awk '/install / {print $4}' | uniq | xargs apt-get -y remove

skygreg · 2010-01-12 09:42:22 12
Monitor a file with tail with timestamps added
This is sample output - yours may be different.
9

tail -f file | awk '{now=strftime("%F %T%z\t");sub(/^/, now);print}'

arcege · 2010-11-25 04:11:52 7
Connect via SSH to VirtualBox guest VM without knowing IP address

Booting the VM headless via VBoxHeadless requires knowledge of the VM's network in order to connect. Using VBoxManage in this way and you can SSH to the VM without first looking up the current IP, which changes depending on how you have your VM configured. Show Sample Output
This is sample output - yours may be different.
```
host-user@host:~$ ssh vm-user@`VBoxManage guestproperty get "vm-name" "/VirtualBox/GuestInfo/Net/0/V4/IP" | awk '{ print $2 }'`
vm-user@192.168.1.123's password: 
```
9

ssh vm-user@`VBoxManage guestproperty get "vm-name" "/VirtualBox/GuestInfo/Net/0/V4/IP" | awk '{ print $2 }'`

lucasrangit · 2011-05-04 18:01:36 7
output length of longest line

If your wc does not have the -L option, you can use awk.
This is sample output - yours may be different.
9

awk '(length > n) {n = length} END {print n}'

putnamhill · 2011-08-15 13:10:38 7
Print all lines between two line numbers

This command uses awk(1) to print all lines between two known line numbers in a file. Useful for seeing output in a log file, where the line numbers are known. The above command will print all lines between, and including, lines 3 and 6.
This is sample output - yours may be different.
9

awk 'NR >= 3 && NR <= 6' /path/to/file

atoponce · 2011-12-14 14:28:56 11
nmap get all active online ips from specific network

scan whole specific network for active online ips Show Sample Output
This is sample output - yours may be different.
```
192.168.1.79
192.168.1.82
192.168.1.83
192.168.1.84
192.168.1.86
192.168.1.87
192.168.1.89
192.168.1.94
192.168.1.97
192.168.1.100
192.168.1.101
192.168.1.104
192.168.1.110
192.168.1.119
192.168.1.120
```
9

nmap -n -sn 192.168.1.0/24 -oG - | awk '/Up$/{print $2}'

aysadk · 2019-09-04 13:31:53 734
Command to logout all the users in one command
This is sample output - yours may be different.
9

sudo who | awk '!/root/{ cmd="/sbin/pkill -KILL -u " $1; system(cmd)}'

tg0000 · 2021-02-03 13:35:52 610
Add all unversioned files to svn
This is sample output - yours may be different.
8

svn st | grep "^\?" | awk "{print \$2}" | xargs svn add $1

mk · 2009-02-05 17:28:53 32
Quickly find a count of how many times invalid users have attempted to access your system
This is sample output - yours may be different.
8

gunzip -c /var/log/auth.log.*.gz | cat - /var/log/auth.log /var/log/auth.log.0 | grep "Invalid user" | awk '{print $8;}' | sort | uniq -c | less

eanx · 2009-03-03 04:26:57 21
Find brute force attempts on SSHd

Searches the /var/log/secure log file for Failed and/or invalid user log in attempts. Show Sample Output
This is sample output - yours may be different.
```
2 67.11.200.144
      4 210.40.128.31
      6 208.71.128.195
      6 64.39.0.38
     15 219.246.112.241
     20 200.214.15.142
     30 119.70.154.57
     30 79.38.22.92
     40 61.152.201.74
     87 88.191.94.168
    107 200.27.214.30
    107 61.134.27.234
    115 200.6.208.186
    170 222.73.37.25
    387 99.154.226.153
    548 222.35.78.224
    627 94.75.240.141
    946 213.191.111.5
```
8

cat /var/log/secure | grep sshd | grep Failed | sed 's/invalid//' | sed 's/user//' | awk '{print $11}' | sort | uniq -c | sort -n

empulse · 2009-03-30 15:48:24 18
< 1 2 3 4 5 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Reboot without being root

For more, See: https://github.com/noureddin/bash-scripts/blob/master/user_scripts/userpower

Display a cool clock on your terminal

This command displays a clock on your terminal which updates the time every second. Press Ctrl-C to exit. A couple of variants: A little bit bigger text: $ watch -t -n1 "date +%T|figlet -f big" You can try other figlet fonts, too. Big sideways characters: $ watch -n 1 -t '/usr/games/banner -w 30 $(date +%M:%S)' This requires a particular version of banner and a 40-line terminal or you can adjust the width ("30" here).

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Limit bandwidth usage by any program

Trickle is a voluntary, cooperative bandwidth shaper. it works entirely in userland and is very easy to use. The most simple application is to limit the bandwidth usage of programs.

Create md5sum of a directory

ls -qahlSr # list all files in size order - largest last

I find it useful, when cleaning up deleting unwanted files to make more space, to list in size order so I can delete the largest first. Note that using "q" shows files with non-printing characters in name. In this sample output (above), I found two copies of the same iso file both of which are immediate "delete candidates" for me.

Transfer large files/directories with no overhead over the network

This invokes tar on the remote machine and pipes the resulting tarfile over the network using ssh and is saved on the local machine. This is useful for making a one-off backup of a directory tree with zero storage overhead on the source. Variations on this include using compression on the source by using 'tar cfvp' or compression at the destination via $ ssh user@host "cd dir; tar cfp - *" | gzip - > file.tar.gz

modify a file in place with perl

changes THIS to THAT in all files matching fileglob* without using secondary files

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,420) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,420)

sorted by