Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

Sum columns from CSV column $COL
This is sample output - yours may be different.
8

awk -F ',' '{ x = x + $4 } END { print x }' test.csv

coffeeaddict_nl · 2009-08-11 12:10:33 11
connect via ssh using mac address

Connect to a machine running ssh using mac address by using the "arp" command Show Sample Output
This is sample output - yours may be different.
```
ssh: connect to host 192.168.1.103 port 22: No route to host
```
8

ssh root@`for ((i=100; i<=110; i++));do arp -a 192.168.1.$i; done | grep 00:35:cf:56:b2:2g | awk '{print $2}' | sed -e 's/(//' -e 's/)//'`

gean01 · 2009-09-09 04:32:20 15
Upload images to omploader.org from the command line.

This function uploads images to http://omploader.org and then prints out the links to the file. Some coloring can also be added to the command with: ompload() { curl -F file1=@"$1" http://omploader.org/upload|awk '/Info:|File:|Thumbnail:|BBCode:/{gsub(/<[^<]*?\/?>/,"");$1=$1;sub(/^/,"\033[0;34m");sub(/:/,"\033[0m:");print}';} Show Sample Output
This is sample output - yours may be different.
```
user@lappy:~$ ompload ompload.png
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 77812  100  2302  100 75510    870  28559  0:00:02  0:00:02 --:--:-- 30558
Info:http://omploader.org/iMnB2eQ
File:http://omploader.org/vMnB2eQ
Thumbnail:http://omploader.org/tMnB2eQ
BBCode:[url=http://omploader.org/vMnB2eQ][img]http://omploader.org/tMnB2eQ[/img][/url]
```
8

ompload() { curl -# -F file1=@"$1" http://ompldr.org/upload|awk '/Info:|File:|Thumbnail:|BBCode:/{gsub(/<[^<]*?\/?>/,"");$1=$1;print}';}

eightmillion · 2009-11-07 20:56:52 5
show ls colors with demo

This can show all ls colors, with a demo.
This is sample output - yours may be different.
8

echo $LS_COLORS | sed 's/:/\n/g' | awk -F= '!/^$/{printf("%s \x1b[%smdemo\x1b[0m\n",$0,$2)}'

bones7456 · 2009-12-15 01:17:46 7
Find pages returning 404 errors in apache logs

Finds the top ten pages returning an http response code of 404 in an apache log.
This is sample output - yours may be different.
8

awk '$9 == 404 {print $7}' access_log | uniq -c | sort -rn | head

zlemini · 2010-04-08 21:40:53 7
Remove all unused kernels with apt-get

This should do the same thing and is about 70 chars shorter. Show Sample Output
This is sample output - yours may be different.
```
The following packages will be REMOVED:
  linux-image-2.6.32-3-amd64 linux-image-amd64 
0 packages upgraded, 0 newly installed, 2 to remove and 0 not upgraded.
Need to get 0B of archives. After unpacking 99.6MB will be freed.
Would download/install/remove packages.

# `uname -r` = "2.6.34-dbb-deb"
```
8

aptitude remove $(dpkg -l|egrep '^ii linux-(im|he)'|awk '{print $2}'|grep -v `uname -r`)

dbbolton · 2010-06-10 21:23:00 10
Print just line 4 from a textfile
This is sample output - yours may be different.
8

awk 'NR==4'

Aparicio · 2010-07-08 21:04:04 3
Find default gateway
This is sample output - yours may be different.
8

ip route | awk '/default/{print $3}'

rthemocap · 2010-08-10 21:16:40 51
Quick network status of machine

credit to tumblr engineering blog @ http://engineering.tumblr.com/ Show Sample Output
This is sample output - yours may be different.
```
 1618 ESTABLISHED
 4 LAST_ACK
 2 SYN_RECV
 1 TIME_WAIT
 1 CLOSE_WAIT
```
8

netstat -tn | awk 'NR>2 {print $6}' | sort | uniq -c | sort -rn

evandrix · 2011-09-12 23:29:39 13
Rank top 10 most frequently used commands
This is sample output - yours may be different.
8

history | awk '{print $2}' | sort | uniq -c | sort -rn | head

ken_fallon · 2012-01-05 22:23:25 4
Keep a copy of the raw Youtube FLV,MP4,etc stored in /tmp/

Certain Flash video players (e.g. Youtube) write their video streams to disk in /tmp/ , but the files are unlinked. i.e. the player creates the file and then immediately deletes the filename (unlinking files in this way makes it hard to find them, and/or ensures their cleanup if the browser or plugin should crash etc.) But as long as the flash plugin's process runs, a file descriptor remains in its /proc/ hierarchy, from which we (and the player) still have access to the file. The method above worked nicely for me when I had 50 tabs open with Youtube videos and didn't want to have to re-download them all with some tool.
This is sample output - yours may be different.
8

lsof -n -P|grep FlashXX|awk '{ print "/proc/" $2 "/fd/" substr($4, 1, length($4)-1) }'|while read f;do newname=$(exiftool -FileModifyDate -FileType -t -d %Y%m%d%H%M%S $f|cut -f2|tr '\n' '.'|sed 's/\.$//');echo "$f -> $newname";cp $f ~/Vids/$newname;done

mhs · 2012-02-25 01:49:45 5
sum a column of numbers
This is sample output - yours may be different.
8

awk '{s+=$1}END{print s}' <file>

evandrix · 2013-01-10 03:16:48 4
nmap get all active online ips from specific network

scan whole specific network for active online ips Show Sample Output
This is sample output - yours may be different.
```
192.168.1.79
192.168.1.82
192.168.1.83
192.168.1.84
192.168.1.86
192.168.1.87
192.168.1.89
192.168.1.94
192.168.1.97
192.168.1.100
192.168.1.101
192.168.1.104
192.168.1.110
192.168.1.119
192.168.1.120
```
8

nmap -n -sn 192.168.1.0/24 -oG - | awk '/Up$/{print $2}'

aysadk · 2019-09-04 13:31:53 125
Parse a quoted .csv file

The $2, $3, $4 fields are arbitrary but note that the first field starts from $2 and the last field is $NF-1. This is due to the fact that the leading and trailing quotes are treated as field delimiters. Show Sample Output
This is sample output - yours may be different.
```
$ echo '"foo", "bar", "baz"' | awk -F'^"|", "|"$' '{ print $2,$3,$4 }'
$ foo bar baz
```
7

awk -F'^"|", "|"$' '{ print $2,$3,$4 }' file.csv

SiegeX · 2009-02-16 21:32:46 8
Quickly analyze apache logs for top 25 most common IP addresses.

This command is much quicker than the alternative of "sort | uniq -c | sort -n". Show Sample Output
This is sample output - yours may be different.
```
348, 192.22.16.56
358, 192.240.8.178
360, 192.107.248.220
394, 192.206.78.2
424, 192.242.141.25
426, 192.175.45.153
440, 192.51.107.202
493, 192.215.222.135
500, 192.20.53.245
688, 192.164.143.36
732, 192.139.1.20
```
7

cat $(ls -tr | tail -1) | awk '{ a[$1] += 1; } END { for(i in a) printf("%d, %s\n", a[i], i ); }' | sort -n | tail -25

oremj · 2009-03-06 17:50:29 5
See most used commands

It will return a ranked list of your most commonly-entered commands using your command history Show Sample Output
This is sample output - yours may be different.
```
8 wine
      8 kill
      7 killall
     66 cd
      5 wget
      4 telnet
```
7

history|awk '{print $2}'|awk 'BEGIN {FS="|"} {print $1}'|sort|uniq -c|sort -r

kayowas · 2009-04-05 13:40:56 12
Get pages number of the pdf file
This is sample output - yours may be different.
7

pdfinfo Virtualization_A_Beginner_Guide.pdf | awk /Pages/

ncaio · 2009-05-31 15:45:38 7
du disk top 10

fancy command line ncdu clone Show Sample Output
This is sample output - yours may be different.
```
67 MB used by /var/log
42 MB used by /var/log/gdm
9 MB used by /var/log/ConsoleKit
2 MB used by /var/log/munin
1 MB used by /var/log/kismet
1 MB used by /var/log/dist-upgrade
0 MB used by /var/log/apache2
0 MB used by /var/log/installer
0 MB used by /var/log/vmware
0 MB used by /var/log/cups
```
7

for i in `du --max-depth=1 $HOME | sort -n -r | awk '{print $1 ":" $2}'`; do size=`echo $i | awk -F: '{print $1}'`; dir=`echo $i | awk -F: '{print $NF}'`; size2=$(($size/1024)); echo "$size2 MB used by $dir"; done | head -n 10

tuxifier · 2009-06-02 21:27:48 8
log your PC's motherboard and CPU temperature along with the current date

Uses the data in the /proc system, provided by the acpid, to find out the CPU temperature. Can be run on systems without lm-sensors installed as well. Show Sample Output
This is sample output - yours may be different.
```
08/25/0902:54:32 => 51 C
```
7

echo `date +%m/%d/%y%X |awk '{print $1;}' `" => "` cat /proc/acpi/thermal_zone/THRM/temperature | awk '{print $2, $3;}'` >> datetmp.log

ninadsp · 2009-08-24 21:26:29 33
convert unixtime to human-readable with awk

- convert unixtime to human-readable with awk - useful to read logfiles with unix-timestamps, f.e. squid-log: sudo tail -f /var/log/squid3/access.log | awk '{ print strftime("%c ", $1) $0; } Show Sample Output
This is sample output - yours may be different.
```
$ echo 1234567890 | awk '{ print strftime("%c", $0); }'
Sat 14 Feb 2009 12:31:30 AM CET
```
7

echo 1234567890 | awk '{ print strftime("%c", $0); }'

alvinx · 2009-08-25 09:37:54 6
Show apps that use internet connection at the moment. (Multi-Language)

Show apps that use internet connection at the moment. Can be used to discover what programms create internet traffic. Skip the part after awk to get more details, though it will not work showing only unique processes. This version will work with other languages such as Spanish and Portuguese, if the word for "ESTABLISHED" still contain the fragment "STAB"(e.g. "ESTABELECIDO") Show Sample Output
This is sample output - yours may be different.
```
firefox
http
ktorrent
opera
python
```
7

netstat -lantp | grep -i stab | awk -F/ '{print $2}' | sort | uniq

ProMole · 2009-09-19 14:54:31 9
Detect if we are running on a VMware virtual machine

If you run this command on a VMWare Virtual Machine, it will return the string "VMware Virtual Platform". If you run it on a physical machine, it will return nothing. Useful for having a script determine if it's running on a VM or not. Of course, you must have dmidecode installed for this to work. Try it this way in a script: ISVM=$(dmidecode | awk '/VMware Virtual Platform/ {print $3,$4,$5}') Then test if $ISVM has text in it, or is blank.
This is sample output - yours may be different.
7

dmidecode | awk '/VMware Virtual Platform/ {print $3,$4,$5}'

SuperFly · 2009-09-25 14:46:35 13
cpu and memory usage top 10 under Linux

The original version gives an error, here is the correct output
This is sample output - yours may be different.
7

ps -eo user,pcpu,pmem | tail -n +2 | awk '{num[$1]++; cpu[$1] += $2; mem[$1] += $3} END{printf("NPROC\tUSER\tCPU\tMEM\n"); for (user in cpu) printf("%d\t%s\t%.2f\t%.2f\n",num[user], user, cpu[user], mem[user]) }'

georgz · 2009-10-29 12:49:01 11
Print trending topics on Twitter
This is sample output - yours may be different.
7

curl -s search.twitter.com | awk -F'</?[^>]+>' '/\/intra\/trend\//{print $2}'

putnamhill · 2009-12-22 01:01:02 12
see the TIME_WAIT and ESTABLISHED nums of the network

see the TIME_WAIT and ESTABLISHED nums of the network Show Sample Output
This is sample output - yours may be different.
```
TIME_WAIT 60013
ESTABLISHED 37
```
7

netstat -n | awk '/^tcp/ {++B[$NF]} END {for(a in B) print a, B[a]}'

healthly · 2010-04-24 12:11:52 4
‹ First < 2 3 4 5 6 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

underscore to camelCase

Are there any words in the English language that use at least half of the alphabet without repeating any letters?

This is the most straightforward approach: first regexp limits dictionary file to words with thirteen or more characters, second regexp discards any words that have a letter repeated. (Bonus challenge: Try doing it in a single regexp!)

Write comments to your history.

A null operation with the name 'comment', allowing comments to be written to HISTFILE. Prepending '#' to a command will *not* write the command to the history file, although it will be available for the current session, thus '#' is not useful for keeping track of comments past the current session.

Record a screencast and convert it to an mpeg

Grab X11 input and create an MPEG at 25 fps with the resolution 800x600

Big Countdown Clock with hours, minutes and seconds

Figlet is easy to find for download on the internet, and works for any text. Quite cool.

ssh batch jobs: query hundreds of hosts with an ssh command

Need to query hundreds of hosts with an ssh command ? Of course you'll have setup keys on all your remote HOSTs. But in the case a key is not present this command will skip that node, proceeding on to the next. -t: Force pseudo-tty allocation. This can be used to execute arbitrary screen-based programs on a remote machine. Also prevents unwanted stty messages being sent to console -q: Quiet mode. -o "BatchMode yes" If set to yes, passphrase/password querying will be disabled. This option is useful in scripts and other batch jobs where no user is present

netstat with group by (ip adress)

Same as the rest, but handle IPv6 short IPs. Also, sort in the order that you're probably looking for.

Edit a file in vim (at the first error) if it is not well formed xml.

Validate a file using xmllint. If there are parser errors, edit the file in vim at the line of the first error.

Move all files between to date

In a folder with many files and folders, you want to move all files where the date is >= the file olderFilesNameToMove and

Find usb device in realtime

Using this command you can track a moment when usb device was attached.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by