Commands using sed (1,319)
-
Count and Find all IP connected to my host through TCP connection. Show Sample Output
0netstat -an |grep ":80" |awk '{print $5}' | sed s/::ffff://g | cut -d: -f1 |sort |uniq -c |sort -n | tail -1000 | grep -v "0.0.0.0" -
#ugly, I know Show Sample Output
0curl -s http://www.infoplease.com/countries.html | grep "<td" | grep ipa | sed -e 's#html">#\n#g' | cut -f 1 -d\< | grep -v "^\ \ *$" -
nothing special Show Sample Output
0ls -l | grep ^d | sed 's:.*\ ::g' -
0svn st | grep '^?' | sed -e 's/\?[[:space:]]*//' | tr '\n' '\0' | xargs -0 svn add
-
So I use OSX and don't have the shuf command. This is what I could come up with. This command assumes /usr/share/dict/words does not surpass 137,817,948 lines and line selection is NOT uniformly random. Show Sample Output
0jot 4 | awk '{ print "wc -l /usr/share/dict/words | awk '"'"'{ print \"echo $[ $RANDOM * $RANDOM % \" $1 \"]\" }'"'"' | bash | awk '"'"'{ print \"sed -n \" $1 \"p /usr/share/dict/words\" }'"'"' | bash" }' | bash | tr -d '\n' | sed 's/$/\n/' -
Change "sort -f" to "sort" and "uniq -ic" to "uniq -c" to make it case sensitive. Show Sample Output
0find . -type f | sed -n 's/..*\.//p' | sort -f | uniq -ic -
0curl -s http://www.perl.org/get.html | grep -m1 '\.tar\.gz' | sed 's/.*perl-//; s/\.tar\.gz.*//'
-
Use matched data and some other as replacement data Show Sample Output
0echo "abcde" | sed 's/./& /g' -
Using large wordlists is cumbersome. Using password cracking programs with rules such as Hashcat or John the ripper is much more effective. In order to do this many times we need to "clean" a wordlist removing all numbers, special characters, spaces, whitespace and other garbage. This command will covert a entire wordlist to all lowercase with no garbage.
0cat dirtyfile.txt | awk '{gsub(/[[:punct:]]/,"")}1' | tr A-Z a-z | sed 's/[0-9]*//g' | sed -e 's/ //g' | strings | tr -cs '[:alpha:]' '\ ' | sed -e 's/ /\n/g' | tr A-Z a-z | sort -u > cleanfile.txt -
Can't print correctly in the command field. There is a new line before } as follows
seq 20 | sed -n '5,6 { w out.txt}' Show Sample Output0seq 20 | sed '5,6 { w out.txt }' #Can't print correctly. See sample output -
0TEST_UUID=$(blkid /dev/sda6 | sed -rn "s/^.*UUID=\"([a-z0-9]{8}-[a-z0-9]{4}-[a-z0-9]{4}-[a-z0-9]{4}-[a-z0-9]{12})\".*/\1/p")
-
Prints exactly 15th line of $file. You can also specify a range: sed -n '2,18p' $file - this will print lines 2 to 18, inclusive.
0sed -n '15p' $file -
0date -u +%W$(uname)|sha256sum|sed 's/\W//g'
-
0lynx -dump http://www.anti-abuse.org/multi-rbl-check/ | grep ']' | awk -F\] '{ print $2 }' | sed '/^\[/d' | egrep -v ^[A-Z]
-
This function uses xmllint to evaluate xpaths. Usage: xpath /some/xpath XMLfile Show Sample Output
0xpath () { xmllint --format --shell "$2" <<< "cat $1" | sed '/^\/ >/d' } -
Helps if you accidentally deleted files from an svn repo with plain rm and you would like to mark them for svn to delete too.
0svn status|grep -iR '^!'|sed 's/!/ /g'|xargs -i svn rm '{}' -
grabs and prints the AmazonMP3 daily album deal
0wget -qO- "http://www.amazon.com/b?ie=UTF8&node=163856011" | grep Daily | sed -e 's/<[^>]*>//g' -e 's/^ *//' -e 's/\&[^;]*;/ /' -
Encrypt any text to MD5 , replace text with the string you want to convert to MD5 Show Sample Output
0wget -qO - --post-data "data[Row][clear]=text" http://md5-encryption.com | grep -A1 "Md5 encrypted state" | tail -n1 | cut -d '"' -f3 | sed 's/>//g; s/<\/b//g' -
[continued]...with "bin:" and line starting with "lp:". This specific example with /etc/passwd shows the power of sed to extract data from text files. Here we see an extract from /etc/passwd beginning with the line starting with "bin:" and ending with the line starting with "lp:". Note also, placing the STDIN redirection at the start of the command makes it easy to recall and modify the command parameters line in shell history. Show Sample Output
0< /etc/passwd sed -n "/^bin:/,/^lp:/p" -
Unmounts all CIFS-based network drives. Very nice for shutting down network mounts on a Linux laptop just prior to going to sleep. Show Sample Output
0for D in `mount -lt cifs | sed 's/.*on \(\/.\+\) type.*/\1/'`; do echo -n "UNMOUNTING $D..."; sudo umount $D; echo " [DONE]"; done; -
Uses sed with a regex to move the linenumbers to the line end. The plain regex (w/o escapes) looks like that: ^([^:]*):(.*) Show Sample Output
0grep -n log4j MainPm.java | sed -e 's/^\([^:]*\):\(.*\)/\2 \1/' -
sed '4~5,+1d' file.txt 1 2 3 6 7 8 Show Sample Output
0sed -n '1~5{N;N;p}' file.txt -
Create fortune's *.dat file from commandlinefu from saved preferite script by suhasgupta (http://www.commandlinefu.com/commands/view/3681/backup-all-your-commandlinefu.com-favourites-to-a-plaintext-file) - Italian tutorial here: http://mrehqe.blogspot.com/2011/11/come-ottenere-un-commandlinefu-della.html
0sed ':a;N;$!ba;s/\n\n/\n%\n/g' input.txt >output -
0sed -i '$a\FOOBAR' *
-
Just an other solution :)
0echo foobar | sed -r 's/(^.|.$)//g' - ‹ First < 29 30 31 32 33 > Last ›
What's this?
commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.
Check These Out
Stay in the loop…
- Follow the Tweets.
-
Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.
» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10 - Subscribe to the feeds.
-
Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):
Subscribe to the feed for:
- » all commands
- » commands with 3 up-votes (commandlinefu3)
- » commands with 10 up-votes (commandlinefu10)
- » commands using sed