Commands tagged sed sorted by votes

Commands tagged sed (376)

sorted by

Expand shell variables in sed scripts

With this command you can use shell variables inside sed scripts. This is useful if the script MUST remain in an external file, otherwise you can simply use an inline -e argument to sed.
This is sample output - yours may be different.
-1

expanded_script=$(eval "echo \"$(cat ${sed_script_file})\"") && sed -e "${expanded_script}" your_input_file

giuseppe_rota · 2009-05-07 14:21:14 5
Reverse DNS lookups

Reverse DNS lookups, from a file with list of IP's, here the file is called lookups.txt
This is sample output - yours may be different.
-1

sed 's/$[0-9]*$\.$[0-9]*$\.$[0-9]*$\.$[0-9]*$.in-addr.arpa domain name pointer$.*$\./\4.\3.\2.\1\5/' \ lookups.txt

hemanth · 2009-08-22 09:37:20 4
Print all members of US House of Representatives

Uses curl to download page of membership of US Congress. Use sed to strip HTML then perl to print a line starting with two tabs (a line with a representative) Show Sample Output
This is sample output - yours may be different.
```
curl "http://www.house.gov/house/MemberWWW.shtml" 2>/dev/null | sed -e :a -e 
  's/<[^>]*>//g;/</N;//ba' | perl -nle 's/^\t\t(.*$)/ $1/ and 
  print;' > DefeatedIn2010.txt

#Fills a file called "DefeatedIn2010.txt" with the name of every member of congress.
```
-1

curl "http://www.house.gov/house/MemberWWW.shtml" 2>/dev/null | sed -e :a -e 's/<[^>]*>//g;/</N;//ba' | perl -nle 's/^\t\t(.*$)/ $1/ and print;'

drewk · 2009-09-24 23:37:36 15
Print line numbers

Print out contents of file with line numbers. This version will print a number for every line, and separates the numbering from the line with a tab. Show Sample Output
This is sample output - yours may be different.
```
1     This is line 1.
2     This is line 2.
3
4     This is line 4.
```
-1

sed = <file> | sed 'N;s/\n/\t/'

jgc · 2009-12-11 14:39:14 3
Move itens from subdirectories to current directory

You WILL have problems if the files have the same name. Use cases: consolidate music library and unify photos (especially if your camera separates images by dates). After running the command and verifying if there was no name issues, you can use ls -d */ | sed -e 's/^/\"/g' -e 's/$/\"/g' | xargs rm -r to remove now empty subdirectories.
This is sample output - yours may be different.
-1

ls -d */* | sed -e 's/^/\"/g' -e 's/$/\"/g' | xargs mv -t $(pwd)

leovailati · 2010-03-01 23:43:26 6
Bash function to see if the day ends in

The shell has perfectly adequate pattern matching for simple expressions. Show Sample Output
This is sample output - yours may be different.
```
ok
```
-1

function ends_in_y() { case $(date +%A) in *y ) true ;; * ) false ;; esac } ; ends_in_y && echo ok

unixmonkey9199 · 2010-04-06 22:18:52 3
Change the homepage of Chromium
This is sample output - yours may be different.
-1

change-homepage(){ sed -ri 's|( "homepage": ").*(",)|\1'"$@"'\2|' .config/chromium/Default/Preferences; }

matthewbauer · 2010-04-10 21:21:55 3
Find and delete thunderbird's msf files to make your profile work quickly again.

The thunderbird message datastores get corrupt some times causing random failures, compaction to fail and general suck in thunderbird. Removing them causes thunderbird to rebuild the indexes and makes things quick again.
This is sample output - yours may be different.
-1

find ~/.thunderbird/*.default/ -name *.msf | sed 's/ /\\ /g' | xargs rm {} \;

allrightname · 2010-06-04 12:35:24 6
Get the amount of currently registered users from i18n.counter.li.org.
This is sample output - yours may be different.
-1

wget -qO - http://i18n.counter.li.org/ | grep 'users registered' | sed 's/.*\<font size=7\>//g' | tr '\>' ' ' | sed 's/<br.*//g' | tr ' ' '\0'

hunterm · 2010-10-07 03:19:17 4
Fetch current song from last.fm
This is sample output - yours may be different.
-1

curl -s http://www.last.fm/user/$LASTFMUSER | grep -A 1 subjectCell | sed -e 's#<[^>]*>##g' | head -n2 | tail -n1 | sed 's/^[[:space:]]*//g'

sn0opy · 2011-01-24 08:16:48 3
Find artist and title of a music cd, UPC code given (first result only)

Substitute that 724349691704 with an UPC of a CD you have at hand, and (hopefully) this oneliner should return the $Artist - $Title, querying discogs.com. Yes, I know, all that head/tail/grep crap can be improved with a single sed command, feel free to send "patches" :D Enjoy! Show Sample Output
This is sample output - yours may be different.
```
Iron Maiden - Killers
```
-1

wget http://www.discogs.com/search?q=724349691704 -O foobar &> /dev/null ; grep \/release\/ foobar | head -2 | tail -1 | sed -e 's/^<div>.*>$.*$<\/a><\/div>/\1/' ; rm foobar

TetsuyO · 2011-01-30 23:34:54 3
Generate MD5 of string and output only the hash checksum
This is sample output - yours may be different.
-1

echo -n "String to get MD5" | md5sum | sed "s/ -//"

Tephlon · 2011-03-03 23:40:04 3
Clean-up release directories keeping the only the latest two

Deletes capistrano-style release directories (except that there are dashes between the YYYY-MM-DD) Show Sample Output
This is sample output - yours may be different.
```
user@server:~/apps/appname/releases$ ls
2010-12-02-121502  2010-12-01-215457
```
-1

find . -maxdepth 1 -type d | grep -Pv "^.$" | sort -rn --field-separator="-" | sed -n '3,$p' | xargs rm -rf

wilmoore · 2011-03-08 17:38:26 6
urldecoding

urldecode files in current directrory
This is sample output - yours may be different.
-1

ls * | while read fin;do fout=$(echo -n $fin | sed -e's/%$[0-9A-F][0-9A-F]$/\\\\\x\1/g' | xargs echo -e);if [ "$fout" != "$fin" ];then echo "mv '$fin' '$fout'";fi;done | bash -x

pawelb1973 · 2011-05-18 07:24:54 82
convert chrome html export to folders, links and descriptions

chrome only lets you export in html format, with a lot of table junk, this command will just export the titles of the links and the links without all that extra junk Show Sample Output
This is sample output - yours may be different.
```
<h3>search engines</h3>
<a href="http://google.com/">google search engine</a>
```
-1

grep -E '<DT><A|<DT><H3' bookmarks.html | sed 's/<DT>//' | sed '/Bookmarks bar/d' | sed 's/ ADD_DATE=\".*\"//g' | sed 's/^[ \t]*//' | tr '<A HREF' '<a href'

chrismccoy · 2011-05-26 22:21:01 8
Remove CR LF from a text file
This is sample output - yours may be different.
-1

sed -i 's/\r\n//' file.txt

ewilson · 2011-06-23 20:34:22 3
Remove color codes (special characters) with sed
This is sample output - yours may be different.
-1

cat input.txt | sed 's/\\\033[^a-zA-Z]*.//g'

lingo · 2011-08-02 05:27:36 4
Time redis ping in thousands of a second.

Outputs the real time it takes a Redis ping to run in thousands of a second without any proceeding 0's. Useful for logging or scripted action.
This is sample output - yours may be different.
-1

TIME=$( { time redis-cli PING; } 2>&1 ) ; echo $TIME | awk '{print $3}' | sed 's/0m//; s/\.//; s/s//; s/^0.[^[1-9]*//g;'

allrightname · 2011-08-11 19:09:49 4
Uptime in minute

Get info directly from /proc/uptime
This is sample output - yours may be different.
-1

awk '{print $0/60;}' /proc/uptime

ioggstream · 2011-08-31 10:41:21 17
Print just line 4 from a textfile

d --> delete !d ---> delete others
This is sample output - yours may be different.
-1

sed '4!d'

totti · 2011-09-05 17:54:57 3
Print just line 4 from a textfile

Perl version - just for completeness sake ;)
This is sample output - yours may be different.
-1

perl -ne '$. == 4 && print && exit'

bashrc · 2011-09-05 21:52:16 3
Remove trailing whitespaces (or tabs) from a text file

This command is useful when you are programming, for example.
This is sample output - yours may be different.
-1

sed -i 's/[ \t]\+$//g' file.txt

elder · 2011-09-07 01:47:44 9
ssh hostchange know_host improver

If you work in an environment, where some ssh hosts change regularly this might be handy...
This is sample output - yours may be different.
-1

sshostnew () {sed -i "$1d" $HOME/.ssh/known_hosts ; }

_john · 2011-11-07 10:33:04 10
Remove superfluous from conf file

Use it with cat and '|' for know what is used in a conf file. For example cat /etc/squid/squid.conf | sed -re '/^#/d ; s/#.*$// ; /^\s$/d' : Show you what you use in your file conf. It removes all comments and empty lines. Empty lines are lines with nothing, a tab, or a space.
This is sample output - yours may be different.
-1

sed -re '/^#/d ; s/#.*$// ; /^\s*$/d'

Zulu · 2012-02-02 18:12:52 4
Convert an UNIX file to a DOS file.

This permit to convert an UNIX file to DOS file. You can use it in a loop to convert multiple files, like : for i in *.bat; do sed -i 's/$/\r/' $i; done
This is sample output - yours may be different.
-1

sed -i 's/$/\r/' file

evolix · 2012-02-23 08:34:30 6
‹ First < 11 12 13 14 15 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Query Wikipedia via console over DNS

Query Wikipedia by issuing a DNS query for a TXT record. The TXT record will also include a short URL to the complete corresponding Wikipedia entry.You can also write a little shell script like: $ $ cat wikisole.sh $ #!/bin/sh $ dig +short txt ${1}.wp.dg.cx and run it like $ ./wikisole.sh unix were your first option ($1) will be used as search term.

grab all commandlinefu shell functions into a single file, suitable for sourcing.

Each shell function has its own summary line, as a comment. If there are multiple shell functions with the same name, the function with the highest number of votes is put into the file. Note: added 'grep -v' to the end of the pipeline, to eliminate extraneous lines containing only '--'. Thanks to matthewbauer for pointing this out.

Send a file to a pastebin from STDIN or a file, with a single function

echo "Hello world!" | sprunge # Redirect a stream to a pastebin sprunge ~/.bashrc # Send a file to a pastebin

Update your OpenDNS network ip

Intended for dynamic ip OpenDNS users, this command will update your OpenDNS network IP. For getting your IP, you can use one of the many one-liners here on commandlinefu. Example: I use this in a script which is run by kppp after it has successfully connected to my ISP: --- #!/bin/bash IP="`curl -s http://checkip.dyndns.org/ | grep -o '[[:digit:].]\+'`" PW="hex-obfuscated-pw-here" if [ "$IP" == "" ] ; then echo 'Not online.' ; exit 1 else wget -q --user=topsecret --password="`echo $PW | xxd -ps -r`" 'https://updates.opendns.com/nic/update?hostname=myhostname&myip='"$IP" -O - /etc/init.d/ntp-client restart & fi --- PS: DynDNS should use a similar method, if you know the URL, please post a comment. (Something with members.dyndns.org, if I recall correctly)

show framebuffer console modes to use in grub vga option

look at /boot/grub/menu.lst for somethig like: ## additional options to use with the default boot option, but not with the ## alternatives ## e.g. defoptions=vga=791 resume=/dev/hda5 ## defoptions=vga=795 # defoptions=vga=873 ## altoption boot targets option ## multiple altoptions lines are allowed ## e.g. altoptions=(extra menu suffix) extra boot options ## altoptions=(recovery) single # altoptions=(verbose mode) vga=775 debug # altoptions=(console mode) vga=ask # altoptions=(graphic mode) quiet splash # altoptions=(recovery mode) single vga=(decimal value) is framebuffer mode

find unreadable file

Log the current memory statistics frequently to syslog

Uses logger in a while loop to log memory statistics frequently into the local syslog server.

Convert control codes to visible Unicode Control Pictures

Converts control codes and spaces (ASCII code ≤ 32) to visible Unicode Control Pictures, U+2400 ? U+2420. Skips \n characters, which is probably a good thing.

fetch all revisions of a specific file in an SVN repository

Manages everything through one sed script instead of pipes of greps and awks. Quoting of shell variables is generally easier within a sed script.

Skype conversation logs to IRC-format logs

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged sed

Commands tagged sed (376) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged sed (376)

sorted by