Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Universal configuration monitoring and system of record for IT.
Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

May 19, 2015 - A Look At The New Commandlinefu
I've put together a short writeup on what kind of newness you can expect from the next iteration of clfu. Check it out here.
March 2, 2015 - New Management
I'm Jon, I'll be maintaining and improving clfu. Thanks to David for building such a great resource!
Hide

Top Tags


awk, bash, curl, find, grep, Linux, sed
Hide

Functions

Hide

Credits

Maintained by Jon H.

Site originally by David Winterbottom (user root).

Psst. Open beta.

Wow, didn't really expect you to read this far down. The latest iteration of the site is in open beta. It's a gentle open beta-- not in prime-time just yet. It's being hosted over at UpGuard (link) and you are more than welcome to give it a shot. Couple things:

  • » The open beta is running a copy of the database that will not carry over to the final version. Don't post anything you don't mind losing.
  • » If you wish to use your user account, you will probably need to reset your password.
Your feedback is appreciated via the form on the beta page. Thanks! -Jon & CLFU Team

Commands tagged sed from sorted by
Terminal - Commands tagged sed - 341 results
echo -n 'text' | xxd -ps | sed 's/[[:xdigit:]]\{2\}/\\x&/g'
2010-07-13 21:46:30
User: camocrazed
Functions: echo sed
Tags: sed hex ascii
0
Up
Down
Convert ascii string to hex

Same as another one I saw, just with a cleaner sed command

Edit: updated the sed command to use the [[:xdigit:]] character class - more portable between locales

Note that it will have a newline inserted after every 32 characters of input, due to the output of xxd

Show sample output | Comments (70) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
echo "${1}" | egrep '^[[:digit:]]*$' ; if [ "$?" -eq 0 ] ; then sed -i "${1}"d $HOME/.ssh/known_hosts ; else printf "\tYou must enter a number!\n\n" ; exit 1 ; fi
2010-07-11 23:09:11
User: DaveQB
Functions: echo egrep exit printf sed
Tags: sed
-13
Up
Down
Remove "ssh host" from known hosts file.

I have this as a file called deletekey in my ~/bin.

Makes life a little easier.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ssh-keygen -R <the_offending_host>
2010-07-11 19:37:24
User: bunam
Functions: ssh ssh-keygen
Tags: sed
43
Up
Down
Remove a line in a text file. Useful to fix

In this case it's better do to use the dedicated tool

Comments (3) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sed -i 8d ~/.ssh/known_hosts
2010-07-10 14:22:34
User: prayer
Functions: sed
Tags: sed
30
Up
Down
Remove a line in a text file. Useful to fix "ssh host key change" warnings
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sed -n '4{p;q}'
2010-07-10 00:26:22
User: kniht
Functions: sed
Tags: Text Processing sed
12
Up
Down
Print just line 4 from a textfile

Prints the 4th line and then quits. (Credit goes to flatcap in comments: http://www.commandlinefu.com/commands/view/6031/print-just-line-4-from-a-textfile#comment.)

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
variable="foo" && sed 's/bar/'$variable'/g' $variable.conf >> $variable.temp && sed '1,5d' $variable.temp && mv $variable.temp $variable.conf
2010-07-09 22:12:51
User: jdorfman
Functions: mv sed
Tags: bash sed nginx
0
Up
Down
Find, Replace, Write & Remove First 5 Lines

I wrote this script to speed up Nginx configs. This (long) one liner can be run via BASH. You will see that we set a variable in bash called 'foo' and the streamline editor (sed) finds 'bar' in 'foo.conf' next it writes that output to a temp file (foo.temp) and removes the first 5 lines (that aren't needed in this case) & lastly it moves (overwrites) foo.temp to foo.conf

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cut -d: -f1 /etc/passwd | sort
2010-07-07 12:12:02
User: dog
Functions: cut
Tags: sort sed cut sorting users
-2
Up
Down
Shows users and 'virtual users' on your a unix-type system
Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sudo lsof|sed 's/ */ /g'|cut -f3 -d' '|sort -u
2010-07-07 08:20:28
User: binaryten
Functions: cut sed sort sudo
Tags: sort sed cut sorting users
-4
Up
Down
Shows users and 'virtual users' on your a unix-type system

Most systems (at least my macbook) have system users defined, such as _www and using "users" for example will not list them. This command allows you to see who the 'virtual' users are on your system.

Show sample output | Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
vim --version | grep -P '^(\+|\-)' | sed 's/\s/\n/g' | grep -Pv '^ ?$'
2010-07-02 02:57:19
User: evaryont
Functions: grep sed vim
Tags: vim sed grep
2
Up
Down
List of all vim features

The above output is for a custom compiled version of Vim on Arch Linux.

Just a quick shell one liner, and presents a list of all the enabled and disabled (those prefixed with a '-') features.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
statt(){ C=c;stat --h|sed '/Th/,/NO/!d;/%/!d'|while read l;do p=${l/% */};[ $p == %Z ]&&C=fc&&echo ^FS:^;echo "`stat -$C $p \"$1\"` ^$p^${l#%* }";done|column -ts^; }
2010-06-11 23:31:03
User: AskApache
Functions: column read sed
Tags: bash sed ls file column read while loop function GNU/Linux stat askapache sh
3
Up
Down
STAT Function showing ALL info, stat options, and descriptions

This shows every bit of information that stat can get for any file, dir, fifo, etc. It's great because it also shows the format and explains it for each format option.

If you just want stat help, create this handy alias 'stath' to display all format options with explanations.

alias stath="stat --h|sed '/Th/,/NO/!d;/%/!d'"

To display on 2 lines:

( F=/etc/screenrc N=c IFS=$'\n'; for L in $(sed 's/%Z./%Z\n/'<<<`stat --h|sed -n '/^ *%/s/^ *%\(.\).*$/\1:%\1/p'`); do G=$(echo "stat -$N '$L' \"$F\""); eval $G; N=fc;done; )

For a similarly powerful stat-like function optimized for pretty output (and can sort by any field), check out the "lll" function

http://www.commandlinefu.com/commands/view/5815/advanced-ls-output-using-find-for-formattedsortable-file-stat-info

From my .bash_profile ->

http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
alias sorth='sort --help|sed -n "/^ *-[^-]/s/^ *\(-[^ ]* -[^ ]*\) *\(.*\)/\1:\2/p"|column -ts":"'
2010-06-10 21:30:31
User: AskApache
Functions: alias column sed
Tags: bash sort sed uniq alias column sorting reverse help askapache sh fields unique buffer
3
Up
Down
View advanced Sort options, Quick Reference Help Alias

Once you get into advanced/optimized scripts, functions, or cli usage, you will use the sort command alot. The options are difficult to master/memorize however, and when you use sort commands as much as I do (some examples below), it's useful to have the help available with a simple alias. I love this alias as I never seem to remember all the options for sort, and I use sort like crazy (much better than uniq for example).

# Sorts by file permissions

find . -maxdepth 1 -printf '%.5m %10M %p\n' | sort -k1 -r -g -bS 20%

00761 drwxrw---x ./tmp

00755 drwxr-xr-x .

00701 drwx-----x ./askapache-m

00644 -rw-r--r-- ./.htaccess

# Shows uniq history fast

history 1000 | sed 's/^[0-9 ]*//' | sort -fubdS 50%

exec bash -lxv

export TERM=putty-256color

Taken from my http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
dpkg -l 'linux-*' | sed '/^ii/!d;/'"$(uname -r | sed "s/\(.*\)-\([^0-9]\+\)/\1/")"'/d;s/^[^ ]* [^ ]* \([^ ]*\).*/\1/;/[0-9]/!d' | xargs sudo apt-get -y purge
2010-06-10 20:33:32
User: mitzip
Functions: sed sudo xargs
Tags: Debian Ubuntu sed apt-get kernel dpkg
4
Up
Down
Remove all unused kernels with apt-get

This will remove all installed kernels on your debian based install, except the one you're currently using.

From:

http://tuxtweaks.com/2009/12/remove-old-kernels-in-ubuntu/comment-page-1/#comment-1590

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
IFS=`echo -en "\n\b"`; for i in $(curl http://feeds.digg.com/digg/container/technology/popular.rss | grep '<title>' | sed -e 's#<[^>]*>##g' | tail -n10); do echo $i; echo $i | sed 's/^/Did you hear about /g' | say; sleep 30; done
2010-06-07 22:16:19
User: echosedawk
Functions: echo grep sed sleep tail
Tags: bash sed curl osx
-2
Up
Down
Generate background office noise using Digg feeds and OSX.

Instead of having someone else read you the Digg headlines, Have OSX do it. Requires Curl+Sed+Say. This could probably be easily modified to use espeak for Linux.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find ~/.thunderbird/*.default/ -name *.msf | sed 's/ /\\ /g' | xargs rm {} \;
2010-06-04 12:35:24
User: allrightname
Functions: find rm sed xargs
Tags: sed find xargs thunderbird
-1
Up
Down
Find and delete thunderbird's msf files to make your profile work quickly again.

The thunderbird message datastores get corrupt some times causing random failures, compaction to fail and general suck in thunderbird. Removing them causes thunderbird to rebuild the indexes and makes things quick again.

Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
ls -rl --time-style=+%s * | sed '/^$/,/^total [0-9]*$/d' | sort -nk6
2010-05-27 19:14:12
User: putnamhill
Functions: ls sed sort
Tags: sort sed ls
-2
Up
Down
Find files and list them sorted by modification time

Here's a version that doesn't use find.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sed -n 's/\([0-9]\{1,3\}\.\)\{3\}[0-9]\{1,3\}/\nip&\n/gp' ips.txt | grep ip | sed 's/ip//'| sort | uniq
2010-05-23 11:26:32
User: rubenmoran
Functions: grep sed sort
Tags: sed ip address
2
Up
Down
Extract ip addresses with sed

Extracts ip addressess from file using sed. Uses a tag(ip) to grep the IP lines after extracting. Must be a way to just output regex matched on sed.

Show sample output | Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sortwc () { local L;while read -r L;do builtin printf "${#L}@%s\n" "$L";done|sort -n|sed -u 's/^[^@]*@//'; }
2010-05-20 20:13:52
User: AskApache
Functions: printf read sed sort
Tags: bash sort sed read while sorting function builtin askapache printf
2
Up
Down
Sort output by length of line

This provides a way to sort output based on the length of the line, so that shorter lines appear before longer lines. It's an addon to the sort that I've wanted for years, sometimes it's very useful. Taken from my http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
command ps wwo pid,user,group,vsize:8,size:8,sz:6,rss:6,pmem:7,pcpu:7,time:7,wchan,sched=,stat,flags,comm,args k -vsz -A|sed -u '/^ *PID/d;10q'
2010-05-18 18:41:38
User: AskApache
Functions: command ps sed
Tags: cpu usage memory memory usage bash cpu sort sed process ps askapache processes
2
Up
Down
Viewing Top Processes according to cpu, mem, swap size, etc.

I've wanted this for a long time, finally just sat down and came up with it. This shows you the sorted output of ps in a pretty format perfect for cron or startup scripts. You can sort by changing the k -vsz to k -pmem for example to sort by memory instead.

If you want a function, here's one from my http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html

aa_top_ps(){ local T N=${1:-10};T=${2:-vsz}; ps wwo pid,user,group,vsize:8,size:8,sz:6,rss:6,pmem:7,pcpu:7,time:7,wchan,sched=,stat,flags,comm,args k -${T} -A|sed -u "/^ *PID/d;${N}q"; }
Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -type f -not -regex ".*\/.svn\/.*" -exec sed -i 's/oldstring/newstring/g' {} +
2010-05-15 14:16:25
User: binarysys
Functions: find sed
Tags: sed find .svn
0
Up
Down
Find and replace recursivly a ignoring .svn
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
(for i in `find . -maxdepth 2 -name .svn | sed 's/.svn$//'`; do echo $i; svn info $i; done ) | egrep '^.\/|^URL'
2010-05-09 11:54:37
User: jespere
Functions: echo egrep info sed
Tags: bash Linux egrep sed subversion GNU grep GNU find
0
Up
Down
If you have lots of svn working copies in one dir and want to see in which repositories they are stored, this will do the trick.

If you have lots of subversion working copies in one directory and want to see in which repositories they are stored, this will do the trick. Can be convenient if you need to move to a new subversion server.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
tree -d -I 'CVS' -f -i | sed 's/\//./g' | sed 's/\.\.//g'
2010-05-03 09:00:13
User: ducleotide
Functions: sed
Tags: sed tree
2
Up
Down
print java packages by using unix tree and sed

if you need a quick way of printing out all the packages that contain classes this command will print the directory structure and replace '/' with '.'

It will also ignore CVS directories (we use CVS here)

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
LATEST=`readlink /boot/vmlinuz`; OLD=`readlink /boot/vmlinuz.old`; cat /boot/grub/grub.conf | sed -i -e 's/\(Latest \[[^-]*\).*\]/\1-'"${LATEST#*-}"]'/1' -e 's/\(Old \[[^-]*\).*\]/\1-'"${OLD#*-}"]'/1' /boot/grub/grub.conf
2010-04-21 19:16:51
User: algol
Functions: cat sed
Tags: sed grub readlink installkernel bash String Manipulations
1
Up
Down
Automagically update grub.conf labels after installing a new kernel

I like to label my grub boot options with the correct kernel version/build.

After building and installing a new kernel with "make install" I had to edit my grub.conf by hand.

To avoid this, I've decided to write this little command line to:

1. read the version/build part of the filename to which the kernel symlinks point

2. replace the first label lines of grub.conf

grub.conf label lines must be in this format:

Latest [{name}-{version/build}]

Old [{name}-{version/build}]

only the {version/build} part is substituted.

For instance:

title Latest [GNU/Linux-2.6.31-gentoo-r10.201003]

would turn to

title Latest [GNU/Linux-2.6.32-gentoo-r7.201004]"

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
alias dateh='date --help|sed -n "/^ *%%/,/^ *%Z/p"|while read l;do F=${l/% */}; date +%$F:"|'"'"'${F//%n/ }'"'"'|${l#* }";done|sed "s/\ *|\ */|/g" |column -s "|" -t'
2010-04-21 01:22:18
User: AskApache
Functions: alias column date read sed
Tags: bash sed alias column read while date loop for substitution askapache sh POSIX locale parameter
21
Up
Down
View all date formats, Quick Reference Help Alias

If you have used bash for any scripting, you've used the date command alot. It's perfect for using as a way to create filename's dynamically within aliases,functions, and commands like below.. This is actually an update to my first alias, since a few commenters (below) had good observations on what was wrong with my first command.

# creating a date-based ssh-key for askapache.github.com

ssh-keygen -f ~/.ssh/`date +git-$USER@$HOSTNAME-%m-%d-%g` -C [email protected]' # [email protected]

# create a tar+gzip backup of the current directory

tar -czf $(date +$HOME/.backups/%m-%d-%g-%R-`sed -u 's/\//#/g' <<< $PWD`.tgz) . # tar -czf /home/gpl/.backups/04-22-10-01:13-#home#gpl#.rr#src.tgz .

I personally find myself having to reference

date --help

quite a bit as a result. So this nice alias saves me a lot of time. This is one bdash mofo. Works in sh and bash (posix), but will likely need to be changed for other shells due to the parameter substitution going on.. Just extend the sed command, I prefer sed to pretty much everything anyways.. but it's always preferable to put in the extra effort to go for as much builtin use as you can. Otherwise it's not a top one-liner, it's a lazyboy recliner.

Here's the old version:

alias dateh='date --help|sed "/^ *%%/,/^ *%Z/!d;s/ \+/ /g"|while read l;do date "+ %${l/% */}_${l/% */}_${l#* }";done|column -s_ -t'

This trick from my [ http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html bash_profile ]

Show sample output | Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
sed -n 's/.*<title>\(.*\)<\/title>.*/\1/ip;T;q' file.html
2010-04-19 07:41:10
User: octopus
Functions: sed
Tags: sed html Linux UNIX
3
Up
Down
Extract title from HTML files

This command can be used to extract the title defined in HTML pages

Comments (5) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
for i in `ls ~/.mozilla/firefox/*/Cache`; do file $i | grep -i mpeg | awk '{print $1}' | sed s/.$//; done
2010-04-11 23:14:18
User: TuxOtaku
Functions: awk file grep sed
Tags: sed awk flash grep file mp3 firefox for mpeg cache
4
Up
Down
Grab a list of MP3s out of Firefox's cache

Ever gone to a site that has an MP3 embedded into a pesky flash player, but no download link? Well, this one-liner will yank the names of those tunes straight out of FF's cache in a nice, easy to read list. What you do with them after that is *ahem* no concern of mine. ;)

Show sample output | Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate