Commands tagged sed sorted by votes

Commands tagged sed (376)

sorted by

Expand shell variables in sed scripts

With this command you can use shell variables inside sed scripts. This is useful if the script MUST remain in an external file, otherwise you can simply use an inline -e argument to sed.
This is sample output - yours may be different.
-1

expanded_script=$(eval "echo \"$(cat ${sed_script_file})\"") && sed -e "${expanded_script}" your_input_file

giuseppe_rota · 2009-05-07 14:21:14 5
Reverse DNS lookups

Reverse DNS lookups, from a file with list of IP's, here the file is called lookups.txt
This is sample output - yours may be different.
-1

sed 's/$[0-9]*$\.$[0-9]*$\.$[0-9]*$\.$[0-9]*$.in-addr.arpa domain name pointer$.*$\./\4.\3.\2.\1\5/' \ lookups.txt

hemanth · 2009-08-22 09:37:20 4
Print all members of US House of Representatives

Uses curl to download page of membership of US Congress. Use sed to strip HTML then perl to print a line starting with two tabs (a line with a representative) Show Sample Output
This is sample output - yours may be different.
```
curl "http://www.house.gov/house/MemberWWW.shtml" 2>/dev/null | sed -e :a -e 
  's/<[^>]*>//g;/</N;//ba' | perl -nle 's/^\t\t(.*$)/ $1/ and 
  print;' > DefeatedIn2010.txt

#Fills a file called "DefeatedIn2010.txt" with the name of every member of congress.
```
-1

curl "http://www.house.gov/house/MemberWWW.shtml" 2>/dev/null | sed -e :a -e 's/<[^>]*>//g;/</N;//ba' | perl -nle 's/^\t\t(.*$)/ $1/ and print;'

drewk · 2009-09-24 23:37:36 15
Print line numbers

Print out contents of file with line numbers. This version will print a number for every line, and separates the numbering from the line with a tab. Show Sample Output
This is sample output - yours may be different.
```
1     This is line 1.
2     This is line 2.
3
4     This is line 4.
```
-1

sed = <file> | sed 'N;s/\n/\t/'

jgc · 2009-12-11 14:39:14 3
Move itens from subdirectories to current directory

You WILL have problems if the files have the same name. Use cases: consolidate music library and unify photos (especially if your camera separates images by dates). After running the command and verifying if there was no name issues, you can use ls -d */ | sed -e 's/^/\"/g' -e 's/$/\"/g' | xargs rm -r to remove now empty subdirectories.
This is sample output - yours may be different.
-1

ls -d */* | sed -e 's/^/\"/g' -e 's/$/\"/g' | xargs mv -t $(pwd)

leovailati · 2010-03-01 23:43:26 6
Bash function to see if the day ends in

The shell has perfectly adequate pattern matching for simple expressions. Show Sample Output
This is sample output - yours may be different.
```
ok
```
-1

function ends_in_y() { case $(date +%A) in *y ) true ;; * ) false ;; esac } ; ends_in_y && echo ok

unixmonkey9199 · 2010-04-06 22:18:52 3
Change the homepage of Chromium
This is sample output - yours may be different.
-1

change-homepage(){ sed -ri 's|( "homepage": ").*(",)|\1'"$@"'\2|' .config/chromium/Default/Preferences; }

matthewbauer · 2010-04-10 21:21:55 3
Find and delete thunderbird's msf files to make your profile work quickly again.

The thunderbird message datastores get corrupt some times causing random failures, compaction to fail and general suck in thunderbird. Removing them causes thunderbird to rebuild the indexes and makes things quick again.
This is sample output - yours may be different.
-1

find ~/.thunderbird/*.default/ -name *.msf | sed 's/ /\\ /g' | xargs rm {} \;

allrightname · 2010-06-04 12:35:24 6
Get the amount of currently registered users from i18n.counter.li.org.
This is sample output - yours may be different.
-1

wget -qO - http://i18n.counter.li.org/ | grep 'users registered' | sed 's/.*\<font size=7\>//g' | tr '\>' ' ' | sed 's/<br.*//g' | tr ' ' '\0'

hunterm · 2010-10-07 03:19:17 4
Fetch current song from last.fm
This is sample output - yours may be different.
-1

curl -s http://www.last.fm/user/$LASTFMUSER | grep -A 1 subjectCell | sed -e 's#<[^>]*>##g' | head -n2 | tail -n1 | sed 's/^[[:space:]]*//g'

sn0opy · 2011-01-24 08:16:48 3
Find artist and title of a music cd, UPC code given (first result only)

Substitute that 724349691704 with an UPC of a CD you have at hand, and (hopefully) this oneliner should return the $Artist - $Title, querying discogs.com. Yes, I know, all that head/tail/grep crap can be improved with a single sed command, feel free to send "patches" :D Enjoy! Show Sample Output
This is sample output - yours may be different.
```
Iron Maiden - Killers
```
-1

wget http://www.discogs.com/search?q=724349691704 -O foobar &> /dev/null ; grep \/release\/ foobar | head -2 | tail -1 | sed -e 's/^<div>.*>$.*$<\/a><\/div>/\1/' ; rm foobar

TetsuyO · 2011-01-30 23:34:54 3
Generate MD5 of string and output only the hash checksum
This is sample output - yours may be different.
-1

echo -n "String to get MD5" | md5sum | sed "s/ -//"

Tephlon · 2011-03-03 23:40:04 3
Clean-up release directories keeping the only the latest two

Deletes capistrano-style release directories (except that there are dashes between the YYYY-MM-DD) Show Sample Output
This is sample output - yours may be different.
```
user@server:~/apps/appname/releases$ ls
2010-12-02-121502  2010-12-01-215457
```
-1

find . -maxdepth 1 -type d | grep -Pv "^.$" | sort -rn --field-separator="-" | sed -n '3,$p' | xargs rm -rf

wilmoore · 2011-03-08 17:38:26 6
urldecoding

urldecode files in current directrory
This is sample output - yours may be different.
-1

ls * | while read fin;do fout=$(echo -n $fin | sed -e's/%$[0-9A-F][0-9A-F]$/\\\\\x\1/g' | xargs echo -e);if [ "$fout" != "$fin" ];then echo "mv '$fin' '$fout'";fi;done | bash -x

pawelb1973 · 2011-05-18 07:24:54 82
convert chrome html export to folders, links and descriptions

chrome only lets you export in html format, with a lot of table junk, this command will just export the titles of the links and the links without all that extra junk Show Sample Output
This is sample output - yours may be different.
```
<h3>search engines</h3>
<a href="http://google.com/">google search engine</a>
```
-1

grep -E '<DT><A|<DT><H3' bookmarks.html | sed 's/<DT>//' | sed '/Bookmarks bar/d' | sed 's/ ADD_DATE=\".*\"//g' | sed 's/^[ \t]*//' | tr '<A HREF' '<a href'

chrismccoy · 2011-05-26 22:21:01 8
Remove CR LF from a text file
This is sample output - yours may be different.
-1

sed -i 's/\r\n//' file.txt

ewilson · 2011-06-23 20:34:22 3
Remove color codes (special characters) with sed
This is sample output - yours may be different.
-1

cat input.txt | sed 's/\\\033[^a-zA-Z]*.//g'

lingo · 2011-08-02 05:27:36 4
Time redis ping in thousands of a second.

Outputs the real time it takes a Redis ping to run in thousands of a second without any proceeding 0's. Useful for logging or scripted action.
This is sample output - yours may be different.
-1

TIME=$( { time redis-cli PING; } 2>&1 ) ; echo $TIME | awk '{print $3}' | sed 's/0m//; s/\.//; s/s//; s/^0.[^[1-9]*//g;'

allrightname · 2011-08-11 19:09:49 4
Uptime in minute

Get info directly from /proc/uptime
This is sample output - yours may be different.
-1

awk '{print $0/60;}' /proc/uptime

ioggstream · 2011-08-31 10:41:21 17
Print just line 4 from a textfile

d --> delete !d ---> delete others
This is sample output - yours may be different.
-1

sed '4!d'

totti · 2011-09-05 17:54:57 3
Print just line 4 from a textfile

Perl version - just for completeness sake ;)
This is sample output - yours may be different.
-1

perl -ne '$. == 4 && print && exit'

bashrc · 2011-09-05 21:52:16 3
Remove trailing whitespaces (or tabs) from a text file

This command is useful when you are programming, for example.
This is sample output - yours may be different.
-1

sed -i 's/[ \t]\+$//g' file.txt

elder · 2011-09-07 01:47:44 9
ssh hostchange know_host improver

If you work in an environment, where some ssh hosts change regularly this might be handy...
This is sample output - yours may be different.
-1

sshostnew () {sed -i "$1d" $HOME/.ssh/known_hosts ; }

_john · 2011-11-07 10:33:04 10
Remove superfluous from conf file

Use it with cat and '|' for know what is used in a conf file. For example cat /etc/squid/squid.conf | sed -re '/^#/d ; s/#.*$// ; /^\s$/d' : Show you what you use in your file conf. It removes all comments and empty lines. Empty lines are lines with nothing, a tab, or a space.
This is sample output - yours may be different.
-1

sed -re '/^#/d ; s/#.*$// ; /^\s*$/d'

Zulu · 2012-02-02 18:12:52 4
Convert an UNIX file to a DOS file.

This permit to convert an UNIX file to DOS file. You can use it in a loop to convert multiple files, like : for i in *.bat; do sed -i 's/$/\r/' $i; done
This is sample output - yours may be different.
-1

sed -i 's/$/\r/' file

evolix · 2012-02-23 08:34:30 6
‹ First < 11 12 13 14 15 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Resample a WAV file with sox

Change the sample rate with sox, the swiss army knife of sound processing.

list block devices

Shows all block devices in a tree with descruptions of what they are.

export iPad App list to txt file

This will generate the same output without changing the current directory, and filepath will be relative to the current directory. Note: it will (still) fail if your iTunes library is in a non-standard location.

Find files with lines that do not match a pattern

This one would be much faster, as it's only one executed command.

Start dd and show progress every X seconds

remove the last of all html files in a directory

sed can be used deleting the last line and with -i option, there's no need to for temp files, the change is made on the actual file

Arch Linux: Search for missing libraries using pacman

If, while using a program, you get an error similar to: error while loading shared libraries: libusb-0.1.so.4: cannot open shared object file: No such file or directory Use pacman or pkgfile to search for the package that owns the missing library https://wiki.archlinux.org/index.php/General_troubleshooting#Message:_%22error_while_loading_shared_libraries%22

Disconnect telnet

You are stuck with testing a tcp port using telnet, and must kill the telnet session from another terminal... Or, press ctrl+5 and write close/quit to force the current connection to close..

Create QR codes from a URL.

QR codes are those funny square 2d bar codes that everyone seems to be pointing their smart phones at. Try the following... $ qrurl http://xkcd.com Then open qr.*.png in your favorite image viewer. Point your the bar code reader on your smart phone at the code, and you'll shortly be reading xkcd on your phone. URLs are not the only thing that can be encoded by QR codes... short texts (to around 2K) can be encoded this way, although this function doesn't do any URL encoding, so unless you want to do that by hand it won't be useful for that.

Display last exit status of a command

The variable ? contain the last exit status of a command, it can be printed for troubleshooting purpose.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged sed

Commands tagged sed (376) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged sed (376)

sorted by