Commands tagged sed sorted by votes

Commands tagged sed (376)

sorted by

Expand shell variables in sed scripts

With this command you can use shell variables inside sed scripts. This is useful if the script MUST remain in an external file, otherwise you can simply use an inline -e argument to sed.
This is sample output - yours may be different.
-1

expanded_script=$(eval "echo \"$(cat ${sed_script_file})\"") && sed -e "${expanded_script}" your_input_file

giuseppe_rota · 2009-05-07 14:21:14 5
Reverse DNS lookups

Reverse DNS lookups, from a file with list of IP's, here the file is called lookups.txt
This is sample output - yours may be different.
-1

sed 's/$[0-9]*$\.$[0-9]*$\.$[0-9]*$\.$[0-9]*$.in-addr.arpa domain name pointer$.*$\./\4.\3.\2.\1\5/' \ lookups.txt

hemanth · 2009-08-22 09:37:20 4
Print all members of US House of Representatives

Uses curl to download page of membership of US Congress. Use sed to strip HTML then perl to print a line starting with two tabs (a line with a representative) Show Sample Output
This is sample output - yours may be different.
```
curl "http://www.house.gov/house/MemberWWW.shtml" 2>/dev/null | sed -e :a -e 
  's/<[^>]*>//g;/</N;//ba' | perl -nle 's/^\t\t(.*$)/ $1/ and 
  print;' > DefeatedIn2010.txt

#Fills a file called "DefeatedIn2010.txt" with the name of every member of congress.
```
-1

curl "http://www.house.gov/house/MemberWWW.shtml" 2>/dev/null | sed -e :a -e 's/<[^>]*>//g;/</N;//ba' | perl -nle 's/^\t\t(.*$)/ $1/ and print;'

drewk · 2009-09-24 23:37:36 15
Print line numbers

Print out contents of file with line numbers. This version will print a number for every line, and separates the numbering from the line with a tab. Show Sample Output
This is sample output - yours may be different.
```
1     This is line 1.
2     This is line 2.
3
4     This is line 4.
```
-1

sed = <file> | sed 'N;s/\n/\t/'

jgc · 2009-12-11 14:39:14 3
Move itens from subdirectories to current directory

You WILL have problems if the files have the same name. Use cases: consolidate music library and unify photos (especially if your camera separates images by dates). After running the command and verifying if there was no name issues, you can use ls -d */ | sed -e 's/^/\"/g' -e 's/$/\"/g' | xargs rm -r to remove now empty subdirectories.
This is sample output - yours may be different.
-1

ls -d */* | sed -e 's/^/\"/g' -e 's/$/\"/g' | xargs mv -t $(pwd)

leovailati · 2010-03-01 23:43:26 6
Bash function to see if the day ends in

The shell has perfectly adequate pattern matching for simple expressions. Show Sample Output
This is sample output - yours may be different.
```
ok
```
-1

function ends_in_y() { case $(date +%A) in *y ) true ;; * ) false ;; esac } ; ends_in_y && echo ok

unixmonkey9199 · 2010-04-06 22:18:52 3
Change the homepage of Chromium
This is sample output - yours may be different.
-1

change-homepage(){ sed -ri 's|( "homepage": ").*(",)|\1'"$@"'\2|' .config/chromium/Default/Preferences; }

matthewbauer · 2010-04-10 21:21:55 3
Find and delete thunderbird's msf files to make your profile work quickly again.

The thunderbird message datastores get corrupt some times causing random failures, compaction to fail and general suck in thunderbird. Removing them causes thunderbird to rebuild the indexes and makes things quick again.
This is sample output - yours may be different.
-1

find ~/.thunderbird/*.default/ -name *.msf | sed 's/ /\\ /g' | xargs rm {} \;

allrightname · 2010-06-04 12:35:24 6
Get the amount of currently registered users from i18n.counter.li.org.
This is sample output - yours may be different.
-1

wget -qO - http://i18n.counter.li.org/ | grep 'users registered' | sed 's/.*\<font size=7\>//g' | tr '\>' ' ' | sed 's/<br.*//g' | tr ' ' '\0'

hunterm · 2010-10-07 03:19:17 4
Fetch current song from last.fm
This is sample output - yours may be different.
-1

curl -s http://www.last.fm/user/$LASTFMUSER | grep -A 1 subjectCell | sed -e 's#<[^>]*>##g' | head -n2 | tail -n1 | sed 's/^[[:space:]]*//g'

sn0opy · 2011-01-24 08:16:48 3
Find artist and title of a music cd, UPC code given (first result only)

Substitute that 724349691704 with an UPC of a CD you have at hand, and (hopefully) this oneliner should return the $Artist - $Title, querying discogs.com. Yes, I know, all that head/tail/grep crap can be improved with a single sed command, feel free to send "patches" :D Enjoy! Show Sample Output
This is sample output - yours may be different.
```
Iron Maiden - Killers
```
-1

wget http://www.discogs.com/search?q=724349691704 -O foobar &> /dev/null ; grep \/release\/ foobar | head -2 | tail -1 | sed -e 's/^<div>.*>$.*$<\/a><\/div>/\1/' ; rm foobar

TetsuyO · 2011-01-30 23:34:54 3
Generate MD5 of string and output only the hash checksum
This is sample output - yours may be different.
-1

echo -n "String to get MD5" | md5sum | sed "s/ -//"

Tephlon · 2011-03-03 23:40:04 3
Clean-up release directories keeping the only the latest two

Deletes capistrano-style release directories (except that there are dashes between the YYYY-MM-DD) Show Sample Output
This is sample output - yours may be different.
```
user@server:~/apps/appname/releases$ ls
2010-12-02-121502  2010-12-01-215457
```
-1

find . -maxdepth 1 -type d | grep -Pv "^.$" | sort -rn --field-separator="-" | sed -n '3,$p' | xargs rm -rf

wilmoore · 2011-03-08 17:38:26 6
urldecoding

urldecode files in current directrory
This is sample output - yours may be different.
-1

ls * | while read fin;do fout=$(echo -n $fin | sed -e's/%$[0-9A-F][0-9A-F]$/\\\\\x\1/g' | xargs echo -e);if [ "$fout" != "$fin" ];then echo "mv '$fin' '$fout'";fi;done | bash -x

pawelb1973 · 2011-05-18 07:24:54 80
convert chrome html export to folders, links and descriptions

chrome only lets you export in html format, with a lot of table junk, this command will just export the titles of the links and the links without all that extra junk Show Sample Output
This is sample output - yours may be different.
```
<h3>search engines</h3>
<a href="http://google.com/">google search engine</a>
```
-1

grep -E '<DT><A|<DT><H3' bookmarks.html | sed 's/<DT>//' | sed '/Bookmarks bar/d' | sed 's/ ADD_DATE=\".*\"//g' | sed 's/^[ \t]*//' | tr '<A HREF' '<a href'

chrismccoy · 2011-05-26 22:21:01 8
Remove CR LF from a text file
This is sample output - yours may be different.
-1

sed -i 's/\r\n//' file.txt

ewilson · 2011-06-23 20:34:22 3
Remove color codes (special characters) with sed
This is sample output - yours may be different.
-1

cat input.txt | sed 's/\\\033[^a-zA-Z]*.//g'

lingo · 2011-08-02 05:27:36 4
Time redis ping in thousands of a second.

Outputs the real time it takes a Redis ping to run in thousands of a second without any proceeding 0's. Useful for logging or scripted action.
This is sample output - yours may be different.
-1

TIME=$( { time redis-cli PING; } 2>&1 ) ; echo $TIME | awk '{print $3}' | sed 's/0m//; s/\.//; s/s//; s/^0.[^[1-9]*//g;'

allrightname · 2011-08-11 19:09:49 4
Uptime in minute

Get info directly from /proc/uptime
This is sample output - yours may be different.
-1

awk '{print $0/60;}' /proc/uptime

ioggstream · 2011-08-31 10:41:21 17
Print just line 4 from a textfile

d --> delete !d ---> delete others
This is sample output - yours may be different.
-1

sed '4!d'

totti · 2011-09-05 17:54:57 3
Print just line 4 from a textfile

Perl version - just for completeness sake ;)
This is sample output - yours may be different.
-1

perl -ne '$. == 4 && print && exit'

bashrc · 2011-09-05 21:52:16 3
Remove trailing whitespaces (or tabs) from a text file

This command is useful when you are programming, for example.
This is sample output - yours may be different.
-1

sed -i 's/[ \t]\+$//g' file.txt

elder · 2011-09-07 01:47:44 9
ssh hostchange know_host improver

If you work in an environment, where some ssh hosts change regularly this might be handy...
This is sample output - yours may be different.
-1

sshostnew () {sed -i "$1d" $HOME/.ssh/known_hosts ; }

_john · 2011-11-07 10:33:04 10
Remove superfluous from conf file

Use it with cat and '|' for know what is used in a conf file. For example cat /etc/squid/squid.conf | sed -re '/^#/d ; s/#.*$// ; /^\s$/d' : Show you what you use in your file conf. It removes all comments and empty lines. Empty lines are lines with nothing, a tab, or a space.
This is sample output - yours may be different.
-1

sed -re '/^#/d ; s/#.*$// ; /^\s*$/d'

Zulu · 2012-02-02 18:12:52 4
Convert an UNIX file to a DOS file.

This permit to convert an UNIX file to DOS file. You can use it in a loop to convert multiple files, like : for i in *.bat; do sed -i 's/$/\r/' $i; done
This is sample output - yours may be different.
-1

sed -i 's/$/\r/' file

evolix · 2012-02-23 08:34:30 6
‹ First < 11 12 13 14 15 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Fastest segmented parallel sync of a remote directory over ssh

Mirror a remote directory using some tricks to maximize network speed. lftp:: coolest file transfer tool ever -u: username and password (pwd is merely a placeholder if you have ~/.ssh/id_rsa) -e: execute internal lftp commands set sftp:connect-program: use some specific command instead of plain ssh ssh:: -a -x -T: disable useless things -c arcfour: use the most efficient cipher specification -o Compression=no: disable compression to save CPU mirror: copy remote dir subtree to local dir -v: be verbose (cool progress bar and speed meter, one for each file in parallel) -c: continue interrupted file transfers if possible --loop: repeat mirror until no differences found --use-pget-n=3: transfer each file with 3 independent parallel TCP connections -P 2: transfer 2 files in parallel (totalling 6 TCP connections) sftp://remotehost:22: use sftp protocol on port 22 (you can give any other port if appropriate) You can play with values for --use-pget-n and/or -P to achieve maximum speed depending on the particular network. If the files are compressible removing "-o Compression=n" can be beneficial. Better create an alias for the command.

check open ports without netstat or lsof

split a multi-page PDF into separate files

Have to do this once per output file, because if device is 'pdfwrite', even if 'gs' sees '%d' in the OutputFile it still only creates one single output file. Embed it into a simple shell script if you want to split a document out into one file for every page.

Google Spell Checker

I took matthewbauer's cool one-liner and rewrote it as a shell function that returns all the suggestions or outputs "OK" if it doesn't find anything wrong. It should work on ksh, zsh, and bash. Users that don't have tee can leave that part off like this: $spellcheck(){ typeset y=$@;curl -sd "$y" https://google.com/tbproxy/spell|sed -n '/s="[1-9]"/{s/]*>/ /g;s/\t/ /g;s/ *$.*$/Suggestions: \1\n/g;p}';}

makes screen your default shell without breaking SCP or SFTP

I changed my shell to screen by editing .bashrc, this stopped scp from connecting. Adding two tests before screen fixed them problem.

iso-8859-1 to utf-8 safe recursive rename

This command is a powerful "detoxifier" that eliminates special chars, spaces and all those little chars we don't like. It support several "sequences" so be sure to check your /usr/local/etc/detoxrc while at it... and maybe define your own

Replace "space" char with "dot" char in current directory file names

regex for turning a URL into a real hyperlink (i.e. for posting somewhere that accepts basic html)

This should work with anything://url.whatever etc etc ;)

Display all shell functions set in the current shell environment

Uses the shell builtin `declare` with the '-f' flag to output only functions to grep out only the function names. You can use it as an alias or function like so: alias shfunctions="builtin declare -f | command grep --color=never -E '^[a-zA-Z_]+\ '" shfunctions () { builtin declare -f | command grep --color=never -E '^[a-zA-Z_]+\ '; }

Watch RX/TX rate of an interface in kb/s

Just a simple way without the need of additional tools. Of course, replace eth0 with your IF.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged sed

Commands tagged sed (376) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged sed (376)

sorted by