Commands tagged sed sorted by votes

Commands tagged sed (376)

sorted by

Expand shell variables in sed scripts

With this command you can use shell variables inside sed scripts. This is useful if the script MUST remain in an external file, otherwise you can simply use an inline -e argument to sed.
This is sample output - yours may be different.
-1

expanded_script=$(eval "echo \"$(cat ${sed_script_file})\"") && sed -e "${expanded_script}" your_input_file

giuseppe_rota · 2009-05-07 14:21:14 5
Reverse DNS lookups

Reverse DNS lookups, from a file with list of IP's, here the file is called lookups.txt
This is sample output - yours may be different.
-1

sed 's/$[0-9]*$\.$[0-9]*$\.$[0-9]*$\.$[0-9]*$.in-addr.arpa domain name pointer$.*$\./\4.\3.\2.\1\5/' \ lookups.txt

hemanth · 2009-08-22 09:37:20 4
Print all members of US House of Representatives

Uses curl to download page of membership of US Congress. Use sed to strip HTML then perl to print a line starting with two tabs (a line with a representative) Show Sample Output
This is sample output - yours may be different.
```
curl "http://www.house.gov/house/MemberWWW.shtml" 2>/dev/null | sed -e :a -e 
  's/<[^>]*>//g;/</N;//ba' | perl -nle 's/^\t\t(.*$)/ $1/ and 
  print;' > DefeatedIn2010.txt

#Fills a file called "DefeatedIn2010.txt" with the name of every member of congress.
```
-1

curl "http://www.house.gov/house/MemberWWW.shtml" 2>/dev/null | sed -e :a -e 's/<[^>]*>//g;/</N;//ba' | perl -nle 's/^\t\t(.*$)/ $1/ and print;'

drewk · 2009-09-24 23:37:36 15
Print line numbers

Print out contents of file with line numbers. This version will print a number for every line, and separates the numbering from the line with a tab. Show Sample Output
This is sample output - yours may be different.
```
1     This is line 1.
2     This is line 2.
3
4     This is line 4.
```
-1

sed = <file> | sed 'N;s/\n/\t/'

jgc · 2009-12-11 14:39:14 3
Move itens from subdirectories to current directory

You WILL have problems if the files have the same name. Use cases: consolidate music library and unify photos (especially if your camera separates images by dates). After running the command and verifying if there was no name issues, you can use ls -d */ | sed -e 's/^/\"/g' -e 's/$/\"/g' | xargs rm -r to remove now empty subdirectories.
This is sample output - yours may be different.
-1

ls -d */* | sed -e 's/^/\"/g' -e 's/$/\"/g' | xargs mv -t $(pwd)

leovailati · 2010-03-01 23:43:26 6
Bash function to see if the day ends in

The shell has perfectly adequate pattern matching for simple expressions. Show Sample Output
This is sample output - yours may be different.
```
ok
```
-1

function ends_in_y() { case $(date +%A) in *y ) true ;; * ) false ;; esac } ; ends_in_y && echo ok

unixmonkey9199 · 2010-04-06 22:18:52 3
Change the homepage of Chromium
This is sample output - yours may be different.
-1

change-homepage(){ sed -ri 's|( "homepage": ").*(",)|\1'"$@"'\2|' .config/chromium/Default/Preferences; }

matthewbauer · 2010-04-10 21:21:55 3
Find and delete thunderbird's msf files to make your profile work quickly again.

The thunderbird message datastores get corrupt some times causing random failures, compaction to fail and general suck in thunderbird. Removing them causes thunderbird to rebuild the indexes and makes things quick again.
This is sample output - yours may be different.
-1

find ~/.thunderbird/*.default/ -name *.msf | sed 's/ /\\ /g' | xargs rm {} \;

allrightname · 2010-06-04 12:35:24 6
Get the amount of currently registered users from i18n.counter.li.org.
This is sample output - yours may be different.
-1

wget -qO - http://i18n.counter.li.org/ | grep 'users registered' | sed 's/.*\<font size=7\>//g' | tr '\>' ' ' | sed 's/<br.*//g' | tr ' ' '\0'

hunterm · 2010-10-07 03:19:17 4
Fetch current song from last.fm
This is sample output - yours may be different.
-1

curl -s http://www.last.fm/user/$LASTFMUSER | grep -A 1 subjectCell | sed -e 's#<[^>]*>##g' | head -n2 | tail -n1 | sed 's/^[[:space:]]*//g'

sn0opy · 2011-01-24 08:16:48 3
Find artist and title of a music cd, UPC code given (first result only)

Substitute that 724349691704 with an UPC of a CD you have at hand, and (hopefully) this oneliner should return the $Artist - $Title, querying discogs.com. Yes, I know, all that head/tail/grep crap can be improved with a single sed command, feel free to send "patches" :D Enjoy! Show Sample Output
This is sample output - yours may be different.
```
Iron Maiden - Killers
```
-1

wget http://www.discogs.com/search?q=724349691704 -O foobar &> /dev/null ; grep \/release\/ foobar | head -2 | tail -1 | sed -e 's/^<div>.*>$.*$<\/a><\/div>/\1/' ; rm foobar

TetsuyO · 2011-01-30 23:34:54 3
Generate MD5 of string and output only the hash checksum
This is sample output - yours may be different.
-1

echo -n "String to get MD5" | md5sum | sed "s/ -//"

Tephlon · 2011-03-03 23:40:04 3
Clean-up release directories keeping the only the latest two

Deletes capistrano-style release directories (except that there are dashes between the YYYY-MM-DD) Show Sample Output
This is sample output - yours may be different.
```
user@server:~/apps/appname/releases$ ls
2010-12-02-121502  2010-12-01-215457
```
-1

find . -maxdepth 1 -type d | grep -Pv "^.$" | sort -rn --field-separator="-" | sed -n '3,$p' | xargs rm -rf

wilmoore · 2011-03-08 17:38:26 6
urldecoding

urldecode files in current directrory
This is sample output - yours may be different.
-1

ls * | while read fin;do fout=$(echo -n $fin | sed -e's/%$[0-9A-F][0-9A-F]$/\\\\\x\1/g' | xargs echo -e);if [ "$fout" != "$fin" ];then echo "mv '$fin' '$fout'";fi;done | bash -x

pawelb1973 · 2011-05-18 07:24:54 80
convert chrome html export to folders, links and descriptions

chrome only lets you export in html format, with a lot of table junk, this command will just export the titles of the links and the links without all that extra junk Show Sample Output
This is sample output - yours may be different.
```
<h3>search engines</h3>
<a href="http://google.com/">google search engine</a>
```
-1

grep -E '<DT><A|<DT><H3' bookmarks.html | sed 's/<DT>//' | sed '/Bookmarks bar/d' | sed 's/ ADD_DATE=\".*\"//g' | sed 's/^[ \t]*//' | tr '<A HREF' '<a href'

chrismccoy · 2011-05-26 22:21:01 8
Remove CR LF from a text file
This is sample output - yours may be different.
-1

sed -i 's/\r\n//' file.txt

ewilson · 2011-06-23 20:34:22 3
Remove color codes (special characters) with sed
This is sample output - yours may be different.
-1

cat input.txt | sed 's/\\\033[^a-zA-Z]*.//g'

lingo · 2011-08-02 05:27:36 4
Time redis ping in thousands of a second.

Outputs the real time it takes a Redis ping to run in thousands of a second without any proceeding 0's. Useful for logging or scripted action.
This is sample output - yours may be different.
-1

TIME=$( { time redis-cli PING; } 2>&1 ) ; echo $TIME | awk '{print $3}' | sed 's/0m//; s/\.//; s/s//; s/^0.[^[1-9]*//g;'

allrightname · 2011-08-11 19:09:49 4
Uptime in minute

Get info directly from /proc/uptime
This is sample output - yours may be different.
-1

awk '{print $0/60;}' /proc/uptime

ioggstream · 2011-08-31 10:41:21 17
Print just line 4 from a textfile

d --> delete !d ---> delete others
This is sample output - yours may be different.
-1

sed '4!d'

totti · 2011-09-05 17:54:57 3
Print just line 4 from a textfile

Perl version - just for completeness sake ;)
This is sample output - yours may be different.
-1

perl -ne '$. == 4 && print && exit'

bashrc · 2011-09-05 21:52:16 3
Remove trailing whitespaces (or tabs) from a text file

This command is useful when you are programming, for example.
This is sample output - yours may be different.
-1

sed -i 's/[ \t]\+$//g' file.txt

elder · 2011-09-07 01:47:44 9
ssh hostchange know_host improver

If you work in an environment, where some ssh hosts change regularly this might be handy...
This is sample output - yours may be different.
-1

sshostnew () {sed -i "$1d" $HOME/.ssh/known_hosts ; }

_john · 2011-11-07 10:33:04 10
Remove superfluous from conf file

Use it with cat and '|' for know what is used in a conf file. For example cat /etc/squid/squid.conf | sed -re '/^#/d ; s/#.*$// ; /^\s$/d' : Show you what you use in your file conf. It removes all comments and empty lines. Empty lines are lines with nothing, a tab, or a space.
This is sample output - yours may be different.
-1

sed -re '/^#/d ; s/#.*$// ; /^\s*$/d'

Zulu · 2012-02-02 18:12:52 4
Convert an UNIX file to a DOS file.

This permit to convert an UNIX file to DOS file. You can use it in a loop to convert multiple files, like : for i in *.bat; do sed -i 's/$/\r/' $i; done
This is sample output - yours may be different.
-1

sed -i 's/$/\r/' file

evolix · 2012-02-23 08:34:30 6
‹ First < 11 12 13 14 15 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Remove all unused kernels with apt-get

This should do the same thing and is about 70 chars shorter.

find and delete empty dirs, start in current working dir

A quick way to find and delete empty dirs, it starts in the current working directory. If you do find . -empty -type d you will see what could be removed, or to a test run.

Rename files in batch

SVN Status log to CSV

Note you have also the --xml option ;)

Play all the music in a folder, on shuffle

Play files in shuffle mode with bash and mpg123. Why bother using big-as-hell stuff like mplayer? This will play all your music files contained in */* (in my case author/song.format) with bash and mplayer showing a nice output.

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

Arch Linux: Search for missing libraries using pacman

If, while using a program, you get an error similar to: error while loading shared libraries: libusb-0.1.so.4: cannot open shared object file: No such file or directory Use pacman or pkgfile to search for the package that owns the missing library https://wiki.archlinux.org/index.php/General_troubleshooting#Message:_%22error_while_loading_shared_libraries%22

Tunnel ssh through Socks Proxy

If you are blocked or need to use a Socks proxy

Command line calculator

This function defines a command line calculator that handles everything pythons math module can handle, e.g. trigonometric functions, sqrt, log, erf, ... (see http://docs.python.org/library/math.html). It even knows about the constants pi and e.

Find the process you are looking for minus the grepped one

As an alternative to using an additional grep -v grep you can use a simple regular expression in the search pattern (first letter is something out of the single letter list ;-)) to drop the grep command itself.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged sed

Commands tagged sed (376) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged sed (376)

sorted by