Commands tagged sed | commandlinefu.com

Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

If you have a new feature suggestion or find a bug, please get in touch via http://commandlinefu.uservoice.com/

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged sed

Hide

News

2011-03-12 - Confoo 2011 presentation: Slides are available from the commandlinefu presentation at Confoo 2011: http://presentations.codeinthehole.com/confoo2011/
2011-01-04 - Moderation now required for new commands: To try and put and end to the spamming, new commands require moderation before they will appear on the site.
2010-12-27 - Apologies for not banning the trolls sooner: Have been away from the interwebs over Christmas. Will be more vigilant henceforth.
2010-09-24 - OAuth and pagination problems fixed: Apologies for the delay in getting Twitter's OAuth supported. Annoying pagination gremlin also fixed.

Hide

Functions

Hide

Credits

Site by David Winterbottom (user root).

Terminal - Commands tagged sed - 332 results

curl -s 'http://xkcd.com/rss.xml' | xpath '//item[1]/description/text()' 2>&1 | sed -n 's/.*title="$[^"]*$".*/\1/p' | fold -s

2013-02-16 22:38:26

User: putnamhill

Functions: fold sed

Tags: sed curl fold xpath

Up
Down

display the hover text of the most recent xkcd

I look at xkcd in my news reader, but it displays the image's title attribute only for a few seconds which makes reading the longer ones more challenging. So I use this to display it in my console.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

find /path/ -type f -exec grep -l '<string of text>' {} \; | xargs sed -i -e 's%<string of text>%<new text string>%g'

2013-02-07 18:47:01

User: leonteale

Functions: find grep sed xargs

Tags: sed search and replace

-2

Up
Down

a find and replace within text-based files

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

sed -i 's/http:\/\/old\/new\///g' index.html

2013-02-07 18:45:23

User: leonteale

Functions: sed

Tags: sed search and replace

-1

Up
Down

a find and replace within text-based files

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

color()(set -o pipefail;"$@" 2>&1>&3|sed $'s,.*,\e[31m&\e[m,'>&2)3>&1

2013-01-30 13:42:03

User: bkmeneguello

Functions: sed set

Tags: bash sed color

Up
Down

Turns red the stderr output

Reference:

http://stackoverflow.com/a/4455706

sed '/^\s*[^@%]/s=$[A-Z][A-Z]*$$[^}A-Z]\|},$$={\1}\2=g' literature.bib > output.bib

2013-01-15 22:24:17

User: michelsberg

Functions: sed

Tags: sed latex BibTeX

Up
Down

Put uppercase letters in curly brackets in a BibTeX database

It is often recommended to enclose capital letters in a BibTeX file in braces, so the letters will not be transformed to lower case, when imported from LaTeX. This is an attempt to apply this rule to a BibTeX database file.

DO NOT USE sed '...' input.bib > input.bib as it will empty the file!

How it works:

/^\s*[^@%]/

Apply the search-and-replace rule to lines that start (^) with zero or more white spaces (\s*), followed by any character ([...]) that is *NOT* a "@" or a "%" (^@%).

s=<some stuff>=<other stuff>=g

Search (s) for some stuff and replace by other stuff. Do that globally (g) for all matches in each processed line.

$[A-Z][A-Z]*$$[^}A-Z]\|},$$

Matches at least one uppercase letter ([A-Z][A-Z]*) followed by a character that is EITHER not "}" and not a capital letter ([^}A-Z]) OR (|) it actually IS a "}", which is followed by "," at the end of the line ($).

Putting regular expressions in escaped parentheses ($ and $, respectively) allows to dereference the matched string later.

{\1}\2

Replace the matched string by "{", followed by part 1 of the matched string (\1), followed by "}", followed by the second part of the matched string (\2).

I tried this with GNU sed, only, version 4.2.1.

sed '/foo/ s/foo/foobar/g' <filename>

2013-01-02 08:52:44

User: totti

Functions: sed

Tags: sed file optimize

-6

Up
Down

optimized sed

Use optimized sed to big file/stream to reduce execution time

Use

sed '/foo/ s/foo/foobar/g' <filename>

insted of sed

's/foo/foobar/g' <filename>

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

for ARG in * ; do sudo -u USER 7z x -o"$(echo $ARG|sed 's/$.*$\..*/\1/')" "$ARG" ; done

2012-12-31 19:47:24

User: n158

Functions: sudo

Tags: sed archive 7z folder for loop

Up
Down

Extract all archives from current folder, each archive in its own folder.

Magic line will extract almost all possible archives from current folder in its own folders. Don't forget to change USER name in sudo command. sed is used to create names for folders from archive names w/o extension. You can test sed expression, used in this command:

arg='war.lan.net' ; x=$(echo $arg|sed 's/$.*$\..*/\1/') ; echo $x

If some archives can't be extracted, install packages:

apt-get install p7zip-full p7zip-rar

Hope this will save a lot of your time. Enjoy.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

curl -s http://en.m.wikipedia.org/wiki/List_of_Internet_top-level_domains | sed -n '/<tr valign="top">/{s/<[^>]*>//g;p}'

2012-12-24 23:54:05

User: flatcap

Functions: sed

Tags: sed domain name

Up
Down

Oneliner to get domain names list of all existing domain names (from wikipedia)

Quietly get a webpage from wikipedia: curl -s

By default, don't output anything: sed -n

Search for interesting lines: /<tr valign="top">/

With the matching lines: {}

Search and replace any html tags: s/<[^>]*>//g

Finally print the result: p

replace old new -- `find -type f`

2012-12-13 20:22:17

User: brian

Tags: sed find

Up
Down

recursive search and replace old with new string, inside files

Search and replace recursively. :-) Shorter and simpler than the others. And allows more terms:

replace old new [old new ...] -- `find -type f`

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

sed -r "s@\^\[{1,2}([0-9]{1,2}(;[0-9]{1,2})?(;[0-9])?(m|K){1,2})?@@g"

2012-11-29 18:42:32

User: malathion

Functions: sed

Tags: sed color colors ansi

Up
Down

Remove color codes (special characters) with sed

Catches some background colors missed by the highest rated alternative.

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

cat dump.sql | sed -n -e '/Table structure for table .table1./,/Table structure for table .table2./p'

2012-11-22 23:54:04

User: infojunkie

Functions: cat sed

Tags: mysql sed

-1

Up
Down

Extract single table from a MySQL dump

Given a dump.sql file, extract table1 creation and data commands. table2 is the one following table1 in the dump file. You can also use the same idea to extract several consecutive tables.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

curl -qsL http://checkip.dyn.com | sed -E "s/^.*Address: ([0-9\.]+).*$/\1/"

2012-10-28 22:20:50

User: wafflesnatcha

Functions: sed

Tags: sed curl ipv4

Up
Down

Get external IP address

Retrieves the current WAN ipv4 address via checkip.dyn.com.

git for-each-ref --sort='-authordate' --format='%(refname)%09%(authordate)' refs/heads | sed -e 's-refs/heads/--'

2012-09-25 09:05:09

User: ptitfred

Functions: sed

Tags: bash git sed

Up
Down

Show git branches by date - useful for showing active branches

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

source <(egrep '^#define EX_.*' /usr/include/sysexits.h | sed -e 's/#define/declare -r/g' | sed 's/\//#/g' | sed -e 's/\s\{1,\}/ /g' | sed -e 's/ $[0-9]$/\=\1/'g )

2012-09-21 13:30:37

User: fishdaemon

Functions: egrep sed

Tags: bash sed exit errno exit code

-1

Up
Down

Use exit codes that actually means something.

Use meaningful exit codes

change "source" to "cat" to view output instead of assigning

sed 1d foo.txt

2012-09-13 23:29:11

User: putnamhill

Functions: sed

Tags: sed

Up
Down

Deleting / Ignoring lines from the top of a file

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

cp foo.txt foo.txt.tmp; sed '$ d' foo.txt.tmp > foo.txt; rm -f foo.txt.tmp

2012-09-13 20:57:40

User: kaushalmehra

Functions: cp rm sed

Tags: sed unix

-2

Up
Down

Deleting / Ignoring tailer record from the file

sed '$ d' foo.txt.tmp

...deletes last line from the file

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

sed -n -e "/^\[/h; /priority *=/{ G; s/\n/ /; s/ity=/ity = /; p }" /etc/yum.repos.d/*.repo | sort -k3n

2012-09-06 00:09:09

User: eddieb

Functions: sed sort

Tags: yum sed repository

Up
Down

Easy way to display yum repo priorities

This probably only works without modifications in RHEL/CentOS/Fedora.

for i in /var/spool/cron/tabs/*; do echo ${i##*/}; sed 's/^/\t/' $i; echo; done

2012-07-12 08:07:20

User: harpo

Functions: echo sed

Tags: sed echo for for loop

Up
Down

Show crontabs for all users

This is flatcaps tweaked command to make it work on SLES 11.2

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

for i in /var/spool/cron/*; do echo ${i##*/}; sed 's/^/\t/' $i; echo; done

2012-07-11 13:36:34

User: flatcap

Functions: echo sed

Tags: sed echo for for loop

Up
Down

Show crontabs for all users

Show the crontabs of all the users.

gcc -E code.c | sed '/^\#/d' | indent -st -i2 > code-x.c

2012-06-18 22:20:33

User: enikulenkov

Functions: gcc sed

Tags: sed indent gcc preprocessor

Up
Down

Apply only preprocessor for .c file and beautify output

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

python -c 'import googl; print googl.Googl("<your_google_api_key>").shorten("'$someurl'")[u"id"]'

2012-05-31 17:14:17

User: shr386

Functions: python

Tags: sed curl python google url python-gdata google shortener

Up
Down

Google URL shortener

(1) required: python-googl ( install by: pip install python-googl )

(2) get from google API console https://code.google.com/apis/console/

ls -R | grep ":$" | sed -e 's/:$//' -e 's/[^-][^\/]*\//--/g' -e 's/^/ /' -e 's/-/|/'

2012-05-30 14:50:13

User: Koobiac

Functions: grep ls sed

Tags: sed ls grep tree

Up
Down

Simulate a tree command

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

2012-05-30 09:38:02

User: theist

Functions: exec grep sed sort

Tags: sed grep mysqlbinlog

Up
Down

mysqlbinlog headers sorted by event time

Shows sorted by query time, the headers of mysqlbinlog entries. Then is easy to locate the heavier events on the raw log dump

iotop -a -p $(sed 's, , -p ,g' <<<`pgrep "_raid|_resync|jbd2"`)

2012-05-17 19:45:02

User: AskApache

Functions: sed

Tags: sed askapache raid iotop

Up
Down

Monitor RAID IO Usage

Shows the IO of the raid sync

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate

echo `disklabel mfid1s4 | sed -n '$p' | awk '{print $2}'` / 1024 / 1024 | bc -l

2012-05-04 12:48:58

User: RageJello

Functions: awk bc echo sed

Tags: csh sed awk bc -l FreeBSD disklabel bsdlabel

Up
Down

Converts the output of disklabel from bytes to Gigabytes on FreeBSD

This was done in csh.

< 1 2 3 4 5 > Last ›