Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

2011-03-12 - Confoo 2011 presentation
Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands
To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner
Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed
Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.
Hide

Tags

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands using uniq

Commands using uniq from sorted by
Terminal - Commands using uniq - 172 results
sed -e "s/| /\n/g" ~/.bash_history | cut -d ' ' -f 1 | sort | uniq -c | sort -nr | head
2009-02-21 16:17:41
User: erdnaxeli
Functions: cut sed sort uniq
6
Up
Down
See the 10 programs the most used
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
"some line input" | sort | uniq -c | sort -nr
2009-02-21 02:08:22
User: dkaz
Functions: sort uniq
2
Up
Down
Quickest way to sort/display # of occurences
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sed 's/[ \t]*$//' < emails.txt | tr 'A-Z' 'a-z' | sort | uniq > emails_sorted.txt
2009-02-20 19:49:17
User: jdunn
Functions: sed sort tr uniq
8
Up
Down
Sort a one-per-line list of email address, weeding out duplicates
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
lsof | awk '{print $1}' | sort | uniq -c | sort -rn | head
2009-02-19 19:45:09
User: sud0er
Functions: awk sort uniq
3
Up
Down
Show top running processes by the number of open filehandles they have

I think I could cut down the number of pipes here, any suggestions?

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -alpn | grep :80 | awk '{print $4}' |awk -F: '{print $(NF-1)}' |sort | uniq -c | sort -n
2009-02-19 04:59:32
User: nitins
Functions: awk grep netstat sort uniq
Tags: sort awk uniq netstat ddos
-2
Up
Down
Checking total connections to each Ip inserver

Useful to check DDoS attacks on servers.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
last | grep -v "^$" | awk '{ print $1 }' | sort -nr | uniq -c
2009-02-18 16:38:59
User: hkyeakley
Functions: awk grep last sort uniq
15
Up
Down
Quick glance at who's been using your system recently

This command takes the output of the 'last' command, removes empty lines, gets just the first field ($USERNAME), sort the $USERNAMES in reverse order and then gives a summary count of unique matches.

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
history | awk '{print $2}' | sort | uniq -c | sort -rn | head
2009-02-17 14:25:49
User: mikeda
Functions: awk sort uniq
18
Up
Down
List of commands you use most often
Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -ntu | awk '{print $5}' | cut -d: -f1 | sort | uniq -c | sort -n | tail
2009-02-16 15:48:27
User: TuxOtaku
Functions: awk cut netstat sort uniq
2
Up
Down
Netstat Connection Check

This command does a tally of concurrent active connections from single IPs and prints out those IPs that have the most active concurrent connections. VERY useful in determining the source of a DoS or DDoS attack.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -anl | grep :80 | awk '{print $5}' | cut -d ":" -f 1 | uniq -c | sort -n | grep -c IPHERE
2009-02-16 08:54:08
User: nullrouter
Functions: awk cut grep netstat sort uniq
3
Up
Down
Who has the most Apache connections.

This will tell you who has the most Apache connections by IP (replace IPHERE with the actual IP you wish to check). Or if you wish, remove | grep -c IPHERE for the full list.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -pant 2> /dev/null | grep SYN_ | awk '{print $5;}' | cut -d: -f1 | sort | uniq -c | sort -n | tail -20
2009-02-16 08:49:38
User: unixmonkey982
Functions: awk cut grep netstat sort tail uniq
3
Up
Down
List top 20 IP from which TCP connection is in SYN_RECV state

List top 20 IP from which TCP connection is in SYN_RECV state.

Useful on web servers to detect a syn flood attack.

Replace SYN_ with ESTA to find established connections

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -anp |grep 'tcp\|udp' | awk '{print $5}' | sed s/::ffff:// | cut -d: -f1 | sort | uniq -c | sort -n
2009-02-15 09:16:16
User: dt
Functions: awk cut netstat sed sort uniq
12
Up
Down
count IPv4 connections per IP

usefull in case of abuser/DoS attacks.

Show sample output | Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
last | awk '{ print $1 }' | sort | uniq -c | grep -v wtmp
2009-02-07 18:42:59
User: mnikhil
Functions: awk grep last sort uniq
0
Up
Down
To get how many users logged in and logged out and how many times ?
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sed -e 's/ *$//' ~/.bash_history | sort | uniq -cd | sort -nr | head
2009-02-07 11:10:06
User: erdnaxeli
Functions: sed sort uniq
7
Up
Down
top 10 commands used
Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
# cut -d ' ' -f1 /var/log/nginx/nginx-access.log | sort | uniq -c | sort -nr | head -10 | nl
2009-02-07 00:22:11
User: msisk
Functions: cut head sort uniq
1
Up
Down
See the top 10 IP addresses in a web access log
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
perl -pe 's/.+;//' ~/.zsh_history | sort | uniq -c | sort -r|head -10
2009-02-06 15:24:32
User: aoiaoi
Functions: perl sort uniq
2
Up
Down
The top ten commands you use
Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cd ~/.purple/logs/; egrep -ri "i can haz|pwn|l33t|w00|zomg" * | cut -d'/' -f 3 | sort | uniq | xargs -I {} echo "Note to self: ban user '{}'"
2009-02-05 21:23:53
User: rhythmx
Functions: cd cut echo egrep sort uniq xargs
5
Up
Down
Find and list users who talk like "lolcats"

Greps IRC logs for phrases and lists users who said them.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -ant | awk '{print $NF}' | grep -v '[a-z]' | sort | uniq -c
2009-02-05 18:02:59
User: himynameisthor
Functions: awk grep netstat sort uniq
24
Up
Down
List the number and type of active network connections
Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sudo lsof | awk '{printf("%s %s %s\n", $1, $3, $NF)}' | grep -v "(" | sort -k 4 | gawk '$NF==prv{ct++;next} {printf("%d %s\n",ct,$0);ct=1;prv=$NF}' | uniq | sort -nr
2009-02-05 14:18:57
User: bpfx
Functions: awk gawk grep sort sudo uniq
2
Up
Down
To find the count of each open file on a system (that supports losf)
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
alias counts=sort | uniq -c | sort -nr
2009-02-05 08:24:02
User: porges
Functions: alias sort uniq
3
Up
Down
A nice command for summarising repeated information
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
grep -o "\(new \(\w\+\)\|\w\+::\)" file.php | sed 's/new \|:://' | sort | uniq -c | sort
2009-01-26 12:08:47
User: root
Functions: grep sed sort uniq
-2
Up
Down
Analyse a PHP file for instantations and static calls

This grabs all lines that make an instantation or static call, then filters out the cruft and displays a summary of each class called and the frequency.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
tail -10000 access_log | awk '{print $1}' | sort | uniq -c | sort -n | tail
2009-01-25 21:01:52
User: root
Functions: awk sort tail uniq
20
Up
Down
Analyse an Apache access log for the most common IP addresses

This uses awk to grab the IP address from each request and then sorts and summarises the top 10.

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -name "*\.php" | xargs grep -o --color "\w\+::\w\+" | cut -d":" -f2 | sort | uniq -c
2009-01-20 23:18:06
User: root
Functions: cut find grep sort uniq xargs
3
Up
Down
Display a list of all PHP classes that are called statically

Searches all .php files for a static instantiation of a class and displays the class names along with their frequencies.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate