Commands using awk sorted by votes

Commands using awk (1,418)

sorted by

List of commands you use most often *suppressing sudo*
This is sample output - yours may be different.
0

history | awk '{if ($2 == "sudo") a[$3]++; else a[$2]++}END{for(i in a){print a[i] " " i}}' | sort -rn | head

JamieKitson · 2012-12-31 13:43:00 5
Get user's full name in Mac OS X
This is sample output - yours may be different.
0

finger `whoami` | awk -F: '{ print $3 }' | head -n1 | sed 's/^ //'

andrew_duffy · 2013-01-03 20:19:03 7
Convert metasploit cachedump files to Hashcat format for cracking

Convert Metasploit?s MSCACHE output to Hashcat version (performed in ~/.msf4/loot/):
This is sample output - yours may be different.
0

cat *mscache* | awk -F '"' '{print $4":"$2}'

mubix · 2013-01-06 06:54:57 13
Purge all broken packages on ubuntu
This is sample output - yours may be different.
0

aptitude purge $(dpkg -l|grep ^rc|awk '{ print $2 }')

velvetzhero · 2013-01-09 12:29:56 4
Command to get list of all existing programming languages from Wikipedia article

Requirements: curl, grep, awk, internet connection with access to wikipedia Loaded page: http://en.wikipedia.org/wiki/List_of_programming_languages If you can make shorter version of this listgetter, you are welcome to paste it here :) Show Sample Output
This is sample output - yours may be different.
```
R (programming language)
R++
Racket (programming language)
RAPID
Rapira
Ratfiv
Ratfor
Rc
REBOL
Core War
REFAL
Reia (programming language)
Revolution (programming language)
Rex (language)
REXX
Rlab
ROOP (programming language)
IBM RPG
RPL (programming language)
Robot Battle
RTL/2
Ruby (programming language)
Rust (programming language)
```
0

curl http://en.wikipedia.org/wiki/List_of_programming_languages | grep "<li>" | awk -F"title=" '{ print $2 }' | awk -F\" '{ print $2 }'

sxiii · 2013-01-09 21:40:11 11

read ajp13 packet contents on terminal using tshark 1.4.15

if you have a capture file *.eth, and ajp protocol is in use on port 9009, you can paste the above command. You can change the fiile and port name Show Sample Output

tshark -r *.eth -S -R "ajp13" -d tcp.port==9009,ajp13 -s 0 -l -V | awk '/Apache JServ/ {p=1} /^ *$/ {p=0;printf "\n"} (p){printf "%s\n", $0} /^(Frame|Internet Pro|Transmission Control)/ {print $0}'

tsureshkumar · 2013-01-10 21:12:51 4

How to find all open files by a process in Solaris 10

Executing pfiles will return a list of all descriptors utilized by the process We are interested in the S_IFREG entries since they are pointing usually to files In the line, there is the inode number of the file which we use in order to find the filename. The only bad thing is that in order not to search from / you have to suspect where could possibly be the file. Improvements more than welcome. lsof was not available in my case Show Sample Output
This is sample output - yours may be different.
```
user@machine# for i in `pfiles 25925|grep S_IFREG|awk '{print $5}'|awk -F":" '{print $2}'`; do find /path/tmp -inum $i |xargs ls -lah; done
-rw-r--r-- 1 user group 910 Jan 26  2012 /path/tmp/file1.prm
-rw-rw-rw- 1 user group 6.3K Jan 20 06:30 /path/tmp/file2.rpt
-rw-r--r-- 1 user group 86K Jan 23 23:34 /path/tmp/file3.log
-rwxrw-r-- 1 user group 65 Dec 26 07:27 /path/tmp/file4.pcr
```
0

for i in `pfiles pid|grep S_IFREG|awk '{print $5}'|awk -F":" '{print $2}'`; do find / -inum $i |xargs ls -lah; done

giorger · 2013-01-24 13:57:19 4

Find stock debian package config files that have been modified since installation

This functionality seems to be missing from commands like dpkg. Ideally, I want to duplicate the behavior of rpm --verify, but it seems difficult to do this in one relatively short command pipeline. Show Sample Output

dpkg-query -Wf '${Package}\n' | xargs dpkg --status | sed '/^Conffiles:/,/^Description:/!d;//d' | awk '{print $2 " " $1}' | md5sum -c 2>/dev/null | grep FAILED$ | cut -f1 -d':'

hallmarc · 2013-01-31 16:52:38 10

Count open file handles for a specific user ID
This is sample output - yours may be different.
0

for x in `ps -u 500 u | grep java | awk '{ print $2 }'`;do ls /proc/$x/fd|wc -l;done

akashrpatel · 2013-02-02 20:29:31 5
One liner to show a notification on Desktop in case the load exceeds 1.

I run this via crontab every one minute on my machine occasionally to see if a process is eating up my system's resources.
This is sample output - yours may be different.
0

load=`uptime|awk -F',' '{print $3}'|awk '{print $3}'`; if [[ $(echo "if ($load > 1.0) 1 else 0" | bc) -eq 1 ]]; then notify-send "Load $load";fi

adimania · 2013-02-06 08:30:24 5
Batch rename and number files

This command will take the files in a directory, rename them, and then number them from 1...N. Black belt stuff. Hell of a time saver.
This is sample output - yours may be different.
0

find . -name '*.jpg' | awk 'BEGIN{ a=0 }{ printf "mv %s name%01d.jpg\n", $0, a++ }' | bash

doublescythe · 2013-02-07 06:12:37 4
Remaining Disk space for important mounted drives
This is sample output - yours may be different.
0

df -H | grep -vE '^Filesystem|tmpfs|cdrom|none' | awk '{ print $5 " " $1 }'

leonteale · 2013-02-07 19:01:27 4
empty a gettext po-file (or, po2pot)

Also removes translator comments. You can remove the header by omitting --keep-header, but if your msgids contain non-ASCII characters you will need the header to specify a suitable charset.
This is sample output - yours may be different.
0

msgfilter --keep-header --input input.po awk '{}' | sed '/^#$/d; /^#[^\:\~,\.]/d' >empty.po

seanf · 2013-02-08 08:05:32 7

Print data from field 9 till the end separated by a white space and new record separated by newline.

It'll print the file names preserving the spaces in their names and adding new line after every new filename. I wrote this to quickly find out how many files in any directory is owned by a particular user. This can be extended using pipe and grep to do much more. Show Sample Output

awk '{for (i=9;i<=NF;i++) {printf "%s",$i; printf "%s", " ";}; printf "\n"}'

adimania · 2013-02-12 13:57:43 4

Purge completely packages on debian / ubuntu

completely remove those packages that leave files in debian / ubuntu marked with rc and not removed completely with traditional tools
This is sample output - yours may be different.
0

dpkg -l | grep ^rc | awk '{ print $2}' | xargs apt-get -y remove --purge

Richzendy · 2013-02-15 01:34:37 7
Order all files oldest to newest then get the last one touched

On the Mac, the 'ls' function can sort based on month/day/time, but seems to lack ability to filter on the Year field (#9 among the long listed fields). The sorted list continuously increases the 'START' year for the most recently accessed set of files. The final month printed will be the highest month that appeared in that START year. The command does its magic on the current directory, and suitably discards all entries that are themselves directories. If you expect files dating prior to 2002, change the START year accordingly.
This is sample output - yours may be different.
0

ls -lT -rt | grep "^-" | awk 'BEGIN {START=2002} (START <= $9){ print $10 ;START=$9 }' | tail -1

Glamdring · 2013-02-24 23:39:22 7
Kill a lot of process once a time
This is sample output - yours may be different.
0

ps aux | grep <process> | grep -v grep | awk '{print $2}' | xargs -i -t kill -9 {}

szimbaro · 2013-02-27 12:33:30 4
Go get those photos from a Picasa album (full size)
This is sample output - yours may be different.
0

wget -O - "[PICASA ALBUM RSS LINK]" |sed 's/</\n</g' | grep media:content |sed 's/.*url='"'"'$[^'"'"']*$'"'"'.*$/\1/' |awk -F'/' '{gsub($NF,"d/"$NF); print $0}'|wget -i -

mxac · 2013-03-16 15:48:41 4
Display count of log entries via the previous minute for graphing purposes. Example given is for DHCPREQUESTS on an ISC dhcp service log.
This is sample output - yours may be different.
0

DATE=`date +"%H:%M" --date '-1 min'`; egrep "\ $DATE\:..\ " /var/log/dhcpd.log |awk '/DHCPREQUEST/ {split($3,t,":"); printf("%02d:%02d\n",t[1],t[2]);}' |uniq -c;

jobewan · 2013-03-17 02:23:37 5
Get the number of open sockets for a process
This is sample output - yours may be different.
0

ps aux | grep [process] | awk '{print $2}' | xargs -I % ls /proc/%/fd | wc -l

auser · 2013-04-03 09:40:03 7
List LVM Volume Groups as an unprivileged user
This is sample output - yours may be different.
0

cat /sys/block/{*,*/*}/holders/dm*/dm/name | awk -F- '{print $1}' | sort -u

hufman · 2013-04-03 18:00:39 6
Find LVM Volume Group name for a block device
This is sample output - yours may be different.
0

cat /sys/block/md1/holders/dm*/dm/name | awk -F- '{print $1}' | sort -u

hufman · 2013-04-03 18:01:16 5
find potentially malicious PHP commands used in backdoors and aliked scripts

I have found that base64 encoded webshells and the like contain lots of data but hardly any newlines due to the formatting of their payloads. Checking the "width" will not catch everything, but then again, this is a fuzzy problem that relies on broad generalizations and heuristics that are never going to be perfect. What I have done is set an arbitrary threshold (200 for example) and compare the values that are produced by this script, only displaying those above the threshold. One webshell I tested this on scored 5000+ so I know it works for at least one piece of malware.
This is sample output - yours may be different.
0

for ii in $(find /path/to/docroot -type f -name \*.php); do echo $ii; wc -lc $ii | awk '{ nr=$2/($1 + 1); printf("%d\n",nr); }'; done

faceinthecrowd · 2013-04-05 19:06:17 10
Show number of connections per remote IP
This is sample output - yours may be different.
0

netstat -antu | awk '$5 ~ /[0-9]:/{split($5, a, ":"); ips[a[1]]++} END {for (ip in ips) print ips[ip], ip | "sort -k1 -nr"}'

4Aiur · 2013-04-09 03:24:43 7
If your disk space Used =100% displayed even after deleting the files generated the below command then Just REBOOT the System .
This is sample output - yours may be different.
0

dd if=/dev/zero of=/fs/to/fill/dummy00 bs=8192 count=$(df --block-size=8192 / | awk 'NR!=1 {print $4-100}')

veenaloke · 2013-04-21 13:57:14 5
‹ First < 35 36 37 38 39 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Bitcoin prices from the command line

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

batch convert Nikon RAW (nef) images to JPG

converts RAW files from a Nikon DSLR to jpg for easy viewing etc. requires ufraw package

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Enable ** to expand files recursively (>=bash-4.0)

Since bash 4.0, you can use ** to recursively expand to all files in the current directory. This behaviour is disabled by default, this command enables it (you'd best put it in your .profile). See the sample output for clarification. In my opinion this is much better than creating hacks with find and xargs when you want to pass files to an application.

Generate a random password 30 characters long

This command is similar to the alternate, except with head(1), you can pick as many passwords as you wish to generate by changing the number of lines you wish to preview.

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

Debug a remote php application (behind firewall) using ssh tunnel for XDEBUG port 9000

If you need to xdebug a remote php application, which is behind a firewall, and you have an ssh daemon running on that machine. you can redirect port 9000 on that machine over to your local machine from which you run your xdebug client (I am using phpStorm) So, run this command on your local machine and start your local xdebug client, to start debugging. more info: http://code.google.com/p/spectator/wiki/Installing

Convert seconds to [DD:][HH:]MM:SS

list with full path

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using awk

Commands using awk (1,418) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using awk (1,418)

sorted by