Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

2011-03-12 - Confoo 2011 presentation
Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands
To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner
Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed
Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.
Hide

Tags

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Commands using sed from sorted by
Terminal - Commands using sed - 1,037 results
find . -type f -exec grep StringToFind \{\} --with-filename \;|sed -e '/svn/d'|sed -e '/~/d'
2009-03-31 18:09:31
User: f241vc15
Functions: find grep sed
-3
Up
Down
Look for a string in one of your codes, excluding the files with svn and ~ (temp/back up files)

Look for a string in one of your codes, excluding the files with svn and ~ (temp/back up files). This can be useful when you're looking for a particular string in one of your source codes for example, inside a directory which is under version control (e.g. svn), removing all the annoying files with ~ (tilde) from the search. you can even change the command after -exec to delete (rm) or view (cat) files found by 'find' for example

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cat /var/log/secure | grep sshd | grep Failed | sed 's/invalid//' | sed 's/user//' | awk '{print $11}' | sort | uniq -c | sort -n
2009-03-30 15:48:24
User: empulse
Functions: awk cat grep sed sort sshd uniq
8
Up
Down
Find brute force attempts on SSHd

Searches the /var/log/secure log file for Failed and/or invalid user log in attempts.

Show sample output | Comments (7) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
netstat -atn | awk ' /tcp/ {printf("%s\n",substr($4,index($4,":")+1,length($4) )) }' | sed -e "s/://g" | sort -rnu | awk '{array [$1] = $1} END {i=32768; again=1; while (again == 1) {if (array[i] == i) {i=i+1} else {print i; again=0}}}'
2009-03-27 20:38:43
User: mpb
Functions: awk netstat sed sort
4
Up
Down
find an unused unprivileged TCP port

Some commands (such as netcat) have a port option but how can you know which ports are unused?

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find ./ -iname "*.mp3" -type f -printf "mv '%p' '%p'\n" | sed -e "s/mp3'$/mp3'/I" | sh
2009-03-27 13:42:40
User: jnash
Functions: find sed
Tags: rename, extension
-1
Up
Down
Rename *.MP3 *.Mp3 *.mP3 etc.. to *.mp3.

Extensible to other ugly extensions like *.JPG, *.Jpg etc..

Leave out the last pipe to sh to perform a dry run.

Comments (6) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ls /some/directory | sed -rn -e 's/input_file_regex/mv -v & output_file_name/p' | sh
2009-03-25 09:20:15
User: polar
Functions: ls sed
Tags: bash sed
-2
Up
Down
Easy Regex based mass renaming

Allows for quick mass renaming, assuming the user has some familiarity with regular expressions. Basically, it replaces the original_file_name in the output of ls with

"mv -v original_file_name new_file_name"

and passes the output to sh.

Show sample output | Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
watch -n 7 -d 'uptime | sed s/.*users,//'
2009-03-25 02:52:36
User: detert
Functions: sed watch
2
Up
Down
keep an eye on system load changes

helps you keep watch on the load of a system, without having to stare constantly at the terminal. The -d argument to watch highlights the difference from the last run, making it easier to note how the load is fluctuating. The sed command just strips off the information about how long the box has been up, and how many users are logged in.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sed 's/\b\(0*\)//g' filename
2009-03-24 20:19:42
User: alperyilmaz
Functions: sed
Tags: sed
1
Up
Down
Remove leading zeros in multiple columns with sed

Leading zeros might help correct sorting and they can be removed by sed after sorting

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sed -e :a -e 's/\(.*[0-9]\)\([0-9]\{3\}\)/\1,\2/;ta' filename
2009-03-24 20:06:02
User: alperyilmaz
Functions: sed
Tags: sed
3
Up
Down
Add thousand separator with sed, in a file or within pipe

Does not necessarily require a file to process, it can be used in a pipe as well:

cat filename | sed -e :a -e 's/\(.*[0-9]\)\([0-9]\{3\}\)/\1,\2/;ta'

I don't remember where I copy/pasted this from, I wish I credited the original author

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
head -c $((<pw-lenght>-2)) /dev/urandom | uuencode -m - | sed -e '1d' -e '3d' | sed -e 's/=.*$//g'
2009-03-24 20:05:16
User: P17
Functions: head sed uuencode
-2
Up
Down
Creates a random passwort from /dev/urandom [0-9A-za-z]

Replace < pw-length > with the desired password-length.

The password-length is not always correct, but wayne...

Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
/usr/sbin/arp -i eth0 | awk '{print $3}' | sed 1d
2009-03-24 18:53:26
User: prayer
Functions: awk sed
Tags: Network
-1
Up
Down
List nearbies
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find -iname '*.flac' | sed 's:/[^/]*$::' | uniq
2009-03-24 13:26:31
User: ar
Functions: find sed
-2
Up
Down
List your FLAC albums

Run this in your music folder, or give the path directly after "find".

The sed pattern filters away the basename.

Show sample output | Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
curl -s -u user:password http://twitter.com/statuses/friends_timeline.rss | grep title | sed -ne 's/<\/*title>//gp' | head -n 4 | say -v Bruce
2009-03-20 20:14:13
User: sixtus
Functions: grep head sed
-7
Up
Down
Speak the last 3 tweets on Mac OS

You need curl.. and a Mac of course.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sed /BEGIN/,/END/s/xxx/yyy/g input.txt
2009-03-20 14:34:32
User: kayowas
Functions: sed
0
Up
Down
Replace words with sed

Replace the words between BEGIN and END.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sed ':a;N;$!ba;s/\n/ /g'
2009-03-17 20:54:04
User: cidiom
Functions: sed
Tags: Linux
0
Up
Down
Remove/replace newline characters.

Ever had a file with a list of numbers you wanted to add, use:

cat file | sed ':a;N;$!ba;s/\n/+/g' | bc
Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -print | sed -e 's;[^/]*/;|____;g;s;____|; |;g'
2009-03-12 22:25:26
User: JesusSuperstar
Functions: find sed
Tags: bash Linux sed find tree map
-1
Up
Down
simulates the DOS tree command that you might be missing on your Mac or Linux box

NOT MINE! Taken from hackzine.com blog.

It creates a tree-style output of all the (sub)folders and (sub)files from the current folder and down(deeper)

Quoting some of hackzine's words

"Murphy Mac sent us a link to a handy find/sed command that simulates the DOS tree command that you might be missing on your Mac or Linux box. [..split...] Like most things I've seen sed do, it does quite a bit in a single line of code and is completely impossible to read. Sure it's just a couple of substitutions, but like a jack in the box, it remains a surprise every time I run it."

Show sample output | Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
diff <(nmap -sP 192.168.1.0/24 | grep ^Host | sed 's/.appears to be up.//g' | sed 's/Host //g') auth.hosts | sed 's/[0-9][a-z,A-Z][0-9]$//' | sed 's/</UNAUTHORIZED IP -/g'
2009-03-12 05:28:08
User: bandit36
Functions: diff grep sed
Tags: diff sed nmap grep
1
Up
Down
Scan your LAN for unauthorized IPs

populate the auth.hosts file with a list of IP addresses that are authorized to be in use and when you run this command it will return the addresses that are pingable and not in the authorized list.

Can be combined with the "Command line Twitter" command to tweet unauthorized access.

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
for x in *s.yml; do mv $x `echo $x | sed 's/s\.yml/\.yml/'`; done
2009-03-10 17:51:19
User: foobarfighter
Functions: mv sed
-1
Up
Down
Singularize all files in a directory

Jan Nelson from Grockit came up with this for us when we needed to rename all of our fixtures.

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ls `echo $PATH | sed 's/:/ /g'`
2009-03-09 19:01:41
User: archlich
Functions: ls sed
4
Up
Down
list all executables in your path

If run in bash, this will display all executables that are in your current $PATH

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
i="8uyxVmdaJ-w";mplayer -fs $(curl -s "http://www.youtube.com/get_video_info?&video_id=$i" | echo -e $(sed 's/%/\\x/g;s/.*\(v[0-9]\.lscache.*\)/http:\/\/\1/g') | grep -oP '^[^|,]*')
2009-03-09 03:57:44
User: lrvick
Functions: echo grep sed
Tags: bash mplayer youtube streaming flash
55
Up
Down
Stream YouTube URL directly to mplayer.

This is the result of a several week venture without X. I found myself totally happy without X (and by extension without flash) and was able to do just about anything but watch YouTube videos... so this a the solution I came up with for that. I am sure this can be done better but this does indeed work... and tends to work far better than YouTube's ghetto proprietary flash player ;-)

Replace $i with any YouTube ID you want and this will scrape the site for the _real_ URL to the full quality .FLV file on Youtube's server and will then will hand that over to mplayer (or vlc or whatever you want) to be streamed.

In some browsers you can replace $i with just a % or put this in a shell script so all YouTube IDs can be handed directly off to your media player of choice for true streaming without the need for Flash or a downloader like clive. (I do however fully recommend clive if you wish to archive videos instead of streaming them)

If any interest is shown I would be more than happy to provide similar commands for other sites. Most streaming flash players use similar logic to YouTube.

Edit: 05/03/2011 -

Updated line to work with current YouTube. It could be a lot prettier but I will probably follow up with another update when I figure out how to get rid of that pesky Grep. Sed should take that syntax... but it doesn't.

Original (no longer working) command:

mplayer -fs $(echo "http://youtube.com/get_video.php?$(curl -s $youtube_url | sed -n "/watch_fullscreen/s;.*\(video_id.\+\)&title.*;\1;p")")

Show sample output | Comments (15) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -iname "*wav" > step1 ; sed -e 's/\(^.*\)wav/\"\1wav\" \"\1mp3\"/' step1 > step2 ; sed -e 's/^/lame /' step2 > step3 ; chmod +x step3 ; ./step3
2009-03-08 17:22:38
User: bigbrovar
Functions: chmod find sed
0
Up
Down
command for converting wav files to mp3
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ps -e -o pcpu,cpu,nice,state,cputime,args --sort pcpu | sed "/^ 0.0 /d"
2009-03-07 16:47:10
User: fbparis
Functions: ps sed
9
Up
Down
Processes by CPU usage
Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
INFILE=/path/to/your/backup.img; MOUNTPT=/mnt/foo; PARTITION=1; mount "$INFILE" "$MOUNTPT" -o loop,offset=$[ `/sbin/sfdisk -d "$INFILE" | grep "start=" | head -n $PARTITION | tail -n1 | sed 's/.*start=[ ]*//' | sed 's/,.*//'` * 512 ]
2009-03-06 21:29:13
User: Alanceil
Functions: grep head mount sed tail
Tags: backup Linux mount mount point sfdisk image partition recovery restore
6
Up
Down
Mount a partition from within a complete disk dump

Suppose you made a backup of your hard disk with dd:

dd if=/dev/sda of=/mnt/disk/backup.img

This command enables you to mount a partition from inside this image, so you can access your files directly.

Substitute PARTITION=1 with the number of the partition you want to mount (returned from sfdisk -d yourfile.img).

Show sample output | Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ps -o %mem= -C firefox-bin | sed -s 's/\..*/%/'
2009-03-06 21:09:26
User: susannakaukinen
Functions: ps sed
6
Up
Down
See how many % of your memory firefox is using
Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
wget -c -v -S -T 100 --tries=0 `curl -s http://ms1.espectador.com/ podcast/espectador/la_venganza_sera_terrible.xml | grep -v xml | grep link | sed 's/]*>//g'`
2009-03-04 13:12:28
User: fmdlc
Functions: grep link sed wget
-3
Up
Down
Download a complete podcast

This download a complete audio podcast

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
$ grep -rl oldstring . |xargs sed -i -e 's/oldstring/newstring/'
2009-03-03 20:10:19
User: netfortius
Functions: grep sed
Tags: perl sed
25
Up
Down
recursive search and replace old with new string, inside files

recursively traverse the directory structure from . down, look for string "oldstring" in all files, and replace it with "newstring", wherever found

also:

grep -rl oldstring . |xargs perl -pi~ -e 's/oldstring/newstring'
Comments (9) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate