Commands tagged sed sorted by votes

Commands tagged sed (376)

sorted by

Expand shell variables in sed scripts

With this command you can use shell variables inside sed scripts. This is useful if the script MUST remain in an external file, otherwise you can simply use an inline -e argument to sed.
This is sample output - yours may be different.
-1

expanded_script=$(eval "echo \"$(cat ${sed_script_file})\"") && sed -e "${expanded_script}" your_input_file

giuseppe_rota · 2009-05-07 14:21:14 5
Reverse DNS lookups

Reverse DNS lookups, from a file with list of IP's, here the file is called lookups.txt
This is sample output - yours may be different.
-1

sed 's/$[0-9]*$\.$[0-9]*$\.$[0-9]*$\.$[0-9]*$.in-addr.arpa domain name pointer$.*$\./\4.\3.\2.\1\5/' \ lookups.txt

hemanth · 2009-08-22 09:37:20 4
Print all members of US House of Representatives

Uses curl to download page of membership of US Congress. Use sed to strip HTML then perl to print a line starting with two tabs (a line with a representative) Show Sample Output
This is sample output - yours may be different.
```
curl "http://www.house.gov/house/MemberWWW.shtml" 2>/dev/null | sed -e :a -e 
  's/<[^>]*>//g;/</N;//ba' | perl -nle 's/^\t\t(.*$)/ $1/ and 
  print;' > DefeatedIn2010.txt

#Fills a file called "DefeatedIn2010.txt" with the name of every member of congress.
```
-1

curl "http://www.house.gov/house/MemberWWW.shtml" 2>/dev/null | sed -e :a -e 's/<[^>]*>//g;/</N;//ba' | perl -nle 's/^\t\t(.*$)/ $1/ and print;'

drewk · 2009-09-24 23:37:36 15
Print line numbers

Print out contents of file with line numbers. This version will print a number for every line, and separates the numbering from the line with a tab. Show Sample Output
This is sample output - yours may be different.
```
1     This is line 1.
2     This is line 2.
3
4     This is line 4.
```
-1

sed = <file> | sed 'N;s/\n/\t/'

jgc · 2009-12-11 14:39:14 3
Move itens from subdirectories to current directory

You WILL have problems if the files have the same name. Use cases: consolidate music library and unify photos (especially if your camera separates images by dates). After running the command and verifying if there was no name issues, you can use ls -d */ | sed -e 's/^/\"/g' -e 's/$/\"/g' | xargs rm -r to remove now empty subdirectories.
This is sample output - yours may be different.
-1

ls -d */* | sed -e 's/^/\"/g' -e 's/$/\"/g' | xargs mv -t $(pwd)

leovailati · 2010-03-01 23:43:26 6
Bash function to see if the day ends in

The shell has perfectly adequate pattern matching for simple expressions. Show Sample Output
This is sample output - yours may be different.
```
ok
```
-1

function ends_in_y() { case $(date +%A) in *y ) true ;; * ) false ;; esac } ; ends_in_y && echo ok

unixmonkey9199 · 2010-04-06 22:18:52 3
Change the homepage of Chromium
This is sample output - yours may be different.
-1

change-homepage(){ sed -ri 's|( "homepage": ").*(",)|\1'"$@"'\2|' .config/chromium/Default/Preferences; }

matthewbauer · 2010-04-10 21:21:55 3
Find and delete thunderbird's msf files to make your profile work quickly again.

The thunderbird message datastores get corrupt some times causing random failures, compaction to fail and general suck in thunderbird. Removing them causes thunderbird to rebuild the indexes and makes things quick again.
This is sample output - yours may be different.
-1

find ~/.thunderbird/*.default/ -name *.msf | sed 's/ /\\ /g' | xargs rm {} \;

allrightname · 2010-06-04 12:35:24 6
Get the amount of currently registered users from i18n.counter.li.org.
This is sample output - yours may be different.
-1

wget -qO - http://i18n.counter.li.org/ | grep 'users registered' | sed 's/.*\<font size=7\>//g' | tr '\>' ' ' | sed 's/<br.*//g' | tr ' ' '\0'

hunterm · 2010-10-07 03:19:17 4
Fetch current song from last.fm
This is sample output - yours may be different.
-1

curl -s http://www.last.fm/user/$LASTFMUSER | grep -A 1 subjectCell | sed -e 's#<[^>]*>##g' | head -n2 | tail -n1 | sed 's/^[[:space:]]*//g'

sn0opy · 2011-01-24 08:16:48 3
Find artist and title of a music cd, UPC code given (first result only)

Substitute that 724349691704 with an UPC of a CD you have at hand, and (hopefully) this oneliner should return the $Artist - $Title, querying discogs.com. Yes, I know, all that head/tail/grep crap can be improved with a single sed command, feel free to send "patches" :D Enjoy! Show Sample Output
This is sample output - yours may be different.
```
Iron Maiden - Killers
```
-1

wget http://www.discogs.com/search?q=724349691704 -O foobar &> /dev/null ; grep \/release\/ foobar | head -2 | tail -1 | sed -e 's/^<div>.*>$.*$<\/a><\/div>/\1/' ; rm foobar

TetsuyO · 2011-01-30 23:34:54 3
Generate MD5 of string and output only the hash checksum
This is sample output - yours may be different.
-1

echo -n "String to get MD5" | md5sum | sed "s/ -//"

Tephlon · 2011-03-03 23:40:04 3
Clean-up release directories keeping the only the latest two

Deletes capistrano-style release directories (except that there are dashes between the YYYY-MM-DD) Show Sample Output
This is sample output - yours may be different.
```
user@server:~/apps/appname/releases$ ls
2010-12-02-121502  2010-12-01-215457
```
-1

find . -maxdepth 1 -type d | grep -Pv "^.$" | sort -rn --field-separator="-" | sed -n '3,$p' | xargs rm -rf

wilmoore · 2011-03-08 17:38:26 6
urldecoding

urldecode files in current directrory
This is sample output - yours may be different.
-1

ls * | while read fin;do fout=$(echo -n $fin | sed -e's/%$[0-9A-F][0-9A-F]$/\\\\\x\1/g' | xargs echo -e);if [ "$fout" != "$fin" ];then echo "mv '$fin' '$fout'";fi;done | bash -x

pawelb1973 · 2011-05-18 07:24:54 82
convert chrome html export to folders, links and descriptions

chrome only lets you export in html format, with a lot of table junk, this command will just export the titles of the links and the links without all that extra junk Show Sample Output
This is sample output - yours may be different.
```
<h3>search engines</h3>
<a href="http://google.com/">google search engine</a>
```
-1

grep -E '<DT><A|<DT><H3' bookmarks.html | sed 's/<DT>//' | sed '/Bookmarks bar/d' | sed 's/ ADD_DATE=\".*\"//g' | sed 's/^[ \t]*//' | tr '<A HREF' '<a href'

chrismccoy · 2011-05-26 22:21:01 8
Remove CR LF from a text file
This is sample output - yours may be different.
-1

sed -i 's/\r\n//' file.txt

ewilson · 2011-06-23 20:34:22 3
Remove color codes (special characters) with sed
This is sample output - yours may be different.
-1

cat input.txt | sed 's/\\\033[^a-zA-Z]*.//g'

lingo · 2011-08-02 05:27:36 4
Time redis ping in thousands of a second.

Outputs the real time it takes a Redis ping to run in thousands of a second without any proceeding 0's. Useful for logging or scripted action.
This is sample output - yours may be different.
-1

TIME=$( { time redis-cli PING; } 2>&1 ) ; echo $TIME | awk '{print $3}' | sed 's/0m//; s/\.//; s/s//; s/^0.[^[1-9]*//g;'

allrightname · 2011-08-11 19:09:49 4
Uptime in minute

Get info directly from /proc/uptime
This is sample output - yours may be different.
-1

awk '{print $0/60;}' /proc/uptime

ioggstream · 2011-08-31 10:41:21 17
Print just line 4 from a textfile

d --> delete !d ---> delete others
This is sample output - yours may be different.
-1

sed '4!d'

totti · 2011-09-05 17:54:57 3
Print just line 4 from a textfile

Perl version - just for completeness sake ;)
This is sample output - yours may be different.
-1

perl -ne '$. == 4 && print && exit'

bashrc · 2011-09-05 21:52:16 3
Remove trailing whitespaces (or tabs) from a text file

This command is useful when you are programming, for example.
This is sample output - yours may be different.
-1

sed -i 's/[ \t]\+$//g' file.txt

elder · 2011-09-07 01:47:44 9
ssh hostchange know_host improver

If you work in an environment, where some ssh hosts change regularly this might be handy...
This is sample output - yours may be different.
-1

sshostnew () {sed -i "$1d" $HOME/.ssh/known_hosts ; }

_john · 2011-11-07 10:33:04 10
Remove superfluous from conf file

Use it with cat and '|' for know what is used in a conf file. For example cat /etc/squid/squid.conf | sed -re '/^#/d ; s/#.*$// ; /^\s$/d' : Show you what you use in your file conf. It removes all comments and empty lines. Empty lines are lines with nothing, a tab, or a space.
This is sample output - yours may be different.
-1

sed -re '/^#/d ; s/#.*$// ; /^\s*$/d'

Zulu · 2012-02-02 18:12:52 4
Convert an UNIX file to a DOS file.

This permit to convert an UNIX file to DOS file. You can use it in a loop to convert multiple files, like : for i in *.bat; do sed -i 's/$/\r/' $i; done
This is sample output - yours may be different.
-1

sed -i 's/$/\r/' file

evolix · 2012-02-23 08:34:30 6
‹ First < 11 12 13 14 15 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Sort movies by length, longest first

Sort .avi movies by time length, print the longest first, and so on...

Create a continuous digital clock in Linux terminal

Source: http://www.my-guides.net/en/guides/linux/364-how-to-create-a-continuous-digital-clock-in-linux-terminal

generate a unique and secure password for every website that you login to

usage: sitepass MaStErPaSsWoRd example.com description: An admittedly excessive amount of hashing, but this will give you a pretty secure password, It also eliminates repeated characters and deletes itself from your command history. tr '!-~' 'P-~!-O' # this bit is rot47, kinda like rot13 but more nerdy rev # this avoids the first few bytes of gzip payload, and the magic bytes.

Display a Lissajous curve in text

Use Ruby's standard Curses module to display a Lissajous curve in the console. Replace the "0.2" with different numbers for different curves.

list files recursively by size

Get your outgoing IP address

Get your external ip adress thanks to http://www.icanhazip.com

Multiplication table

The multiplication table for math study

find the path of the java called from the command line

The output will likely point to '/etc/alternatives/java'. So find out where that points by issuing ls -l like this: ls -l /etc/alternatives/java

Get length of current playlist in xmms2

ssh batch jobs: query hundreds of hosts with an ssh command

Need to query hundreds of hosts with an ssh command ? Of course you'll have setup keys on all your remote HOSTs. But in the case a key is not present this command will skip that node, proceeding on to the next. -t: Force pseudo-tty allocation. This can be used to execute arbitrary screen-based programs on a remote machine. Also prevents unwanted stty messages being sent to console -q: Quiet mode. -o "BatchMode yes" If set to yes, passphrase/password querying will be disabled. This option is useful in scripts and other batch jobs where no user is present

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged sed

Commands tagged sed (376) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged sed (376)

sorted by