Commands tagged sed sorted by votes

Commands tagged sed (376)

sorted by

Use exit codes that actually means something.

Use meaningful exit codes change "source" to "cat" to view output instead of assigning Show Sample Output

-1

source <(egrep '^#define EX_.*' /usr/include/sysexits.h | sed -e 's/#define/declare -r/g' | sed 's/\//#/g' | sed -e 's/\s\{1,\}/ /g' | sed -e 's/ $[0-9]$/\=\1/'g )

fishdaemon · 2012-09-21 13:30:37 10

Extract single table from a MySQL dump

Given a dump.sql file, extract table1 creation and data commands. table2 is the one following table1 in the dump file. You can also use the same idea to extract several consecutive tables.
This is sample output - yours may be different.
-1

cat dump.sql | sed -n -e '/Table structure for table .table1./,/Table structure for table .table2./p'

infojunkie · 2012-11-22 23:54:04 5
a find and replace within text-based files
This is sample output - yours may be different.
-1

sed -i 's/http:\/\/old\/new\///g' index.html

leonteale · 2013-02-07 18:45:23 5
Removes single line from known_hosts file

Quickly remove the conflicting line (key) from current users known_hosts file when there is an SSH host conflict. Very nice when you get tired of writing out full commands. Ideally you would place this into your .bash_profile Usage: rhost [n] Example: rhost 33 (removes line 33 from ~/.ssh/known_hosts) Function assumes the $HOME exists, you could alternatively use "~/.ssh/known_hosts" Mac OSX likes a space for sed -i "$1" d
This is sample output - yours may be different.
-1

rhost() { if [[ $1 =~ ^[0-9]+$ ]]; then sed -i "$1"d ${HOME}/.ssh/known_hosts; else echo "rhost [n]"; fi }

lowjax · 2013-08-01 21:10:34 13
Sort files in $PWD by year embedded anywhere in filename
This is sample output - yours may be different.
-1

ls --color=never -1| grep -E "[0-9]{4}"|sed -re "s/^(.*)([0-9]{4})(.*)$/\2 \1\2\3/" | sort -r

ysangkok · 2014-01-04 20:50:12 10
Edit a single line in multiple files with sed

Find and replace specific characters in a single line in multiple files with sed. Show Sample Output
This is sample output - yours may be different.
```
Original file
file1.txt:This is the MATCHING STRING and ORIGINAL some more text

Replaced file

file1.txt:This is the MATCHING STRING and REPLACEMENT some more text
```
-1

for f in `ls`; do sed -i '/MATCHING STRING/ { s/ORIGINAL/REPLACEMENT/; }' ${f} ; done

krizzo · 2015-05-21 19:37:42 15
shell bash iterate number range with for loop

"seq" has an additional parameter to use as INCREMENT. # seq FIRST INCREMENT LAST https://linux.die.net/man/1/seq Show Sample Output
This is sample output - yours may be different.
```
1
2
3
4
5
```
-1

for i in $(seq 1 5) ; do echo $i ; done

guilsson · 2019-07-29 18:34:12 219
Easy Regex based mass renaming

Allows for quick mass renaming, assuming the user has some familiarity with regular expressions. Basically, it replaces the original_file_name in the output of ls with "mv -v original_file_name new_file_name" and passes the output to sh. Show Sample Output
This is sample output - yours may be different.
```
$ ls ~/manga/ | sed -rn -e 's/naruto_(...\.zip)/mv -v & \1/p' | sh
`naruto_431.zip' -> `431.zip'
`naruto_432.zip' -> `432.zip'
`naruto_433.zip' -> `433.zip'
`naruto_434.zip' -> `434.zip'
$
```
-2

ls /some/directory | sed -rn -e 's/input_file_regex/mv -v & output_file_name/p' | sh

polar · 2009-03-25 09:20:15 11
print random commandlinefu.com submission

ok I'm sure it's not pretty Show Sample Output
This is sample output - yours may be different.
```
Terminal - runs a bash script in debugging mode    
bash -x ./post_to_commandlinefu.sh
```
-2

lynx -source http://www.commandlinefu.com/commands/random | sed 's/<[^>]*>//g' | head -1037 | tail -10 | sed -e 's/^[ \t]*//' | sed '/^$/d' | head -2

lxtips · 2009-06-02 09:48:59 11
Outputs a 10-digit random number
This is sample output - yours may be different.
-2

n=$RANDOM$RANDOM$RANDOM; let "n %= 10000000000"; echo $n

alset · 2009-10-15 05:10:00 4
Remove an unnecessary suffix from a file name for all files in a directory

For this example, all files in the current directory that end in '.xml.skippy' will have the '.skippy' removed from their names.
This is sample output - yours may be different.
-2

for f in $(ls *.xml.skippy); do mv $f `echo $f | sed 's|.skippy||'`; done

argherna · 2009-11-19 21:36:26 20
Checks apache's access_log file, strips the search queries and shoves them up your e-mail

It's not a big line, and it *may not* work for everybody, I guess it depends on the detail of access_log configuration in your httpd.conf. I use it as a prerotate command for logrotate in httpd section so it executes before access_log rotation, everyday at midnight.
This is sample output - yours may be different.
-2

cat /var/log/httpd/access_log | grep q= | awk '{print $11}' | awk -F 'q=' '{print $2}' | sed 's/+/ /g;s/%22/"/g;s/q=//' | cut -d "&" -f 1 | mail youremail@isp.com -s "[your-site] search strings for `date`"

isma · 2009-11-22 03:03:06 11

Blinking, Color Highlighted search for input/output and files, like grep --color

hb(){ sed "s/$$*$/`tput setaf 2;tput setab 0;tput blink`\1`tput sgr0`/gI"; } hb blinks, hc does a reverse color with background.. both very nice. hc(){ sed "s/$$*$/`tput setaf 0;tput setab 6`\1`tput sgr0`/gI"; } Run this: command ps -Hacl -F S -A f | hc ".*$PPID.*" | hb ".*$$.*" Your welcome ;) From my bash profile - http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html Show Sample Output

-2

hb(){ sed "s/$$*$/`tput setaf 2;tput setab 0;tput blink`\1`tput sgr0`/gI"; }

AskApache · 2010-04-07 08:45:26 4

Find files and list them sorted by modification time

Here's a version that doesn't use find.
This is sample output - yours may be different.
-2

ls -rl --time-style=+%s * | sed '/^$/,/^total [0-9]*$/d' | sort -nk6

putnamhill · 2010-05-27 19:14:12 4
Generate background office noise using Digg feeds and OSX.

Instead of having someone else read you the Digg headlines, Have OSX do it. Requires Curl+Sed+Say. This could probably be easily modified to use espeak for Linux.
This is sample output - yours may be different.
-2

IFS=`echo -en "\n\b"`; for i in $(curl http://feeds.digg.com/digg/container/technology/popular.rss | grep '<title>' | sed -e 's#<[^>]*>##g' | tail -n10); do echo $i; echo $i | sed 's/^/Did you hear about /g' | say; sleep 30; done

echosedawk · 2010-06-07 22:16:19 4
Shows users and 'virtual users' on your a unix-type system
This is sample output - yours may be different.
-2

cut -d: -f1 /etc/passwd | sort

dog · 2010-07-07 12:12:02 6
Display a random man page

Broaden your knowledge of the utilities available to you in no particular order whatsoever! Then use that knowledge to create more nifty one-liners that you can post here. =p Takes a random number modulo the number of files in $dir, prints the filename corresponding to that number, and passes it as an argument to man.
This is sample output - yours may be different.
-2

dir="/bin"; man $(ls $dir |sed -n "$(echo $(( $RANDOM % $(ls $dir |wc -l | awk "{ print $1; }" ) + 1 )) )p")

camocrazed · 2010-08-20 16:31:50 4
Display a random man page

Great idea camocrazed. Another twist would be to display a different man page based on the day of the year. The following will continuously cycle through all man pages: man $(ls /bin | sed -n $(($(date +%j) % $(ls /bin | wc -l)))p)
This is sample output - yours may be different.
-2

man $(ls /bin | sed -n $((RANDOM % $(ls /bin | wc -l) + 1))p)

putnamhill · 2010-08-20 17:15:33 5
Update all GPG keys in your keyring
This is sample output - yours may be different.
-2

gpg --refresh-keys

unixmonkey22522 · 2011-06-11 07:53:51 3
turn url and link text into a hyperlink

an extension of command 9986 by c3w, allows for link text. http://google.com,search engine will link the hyperlink with the text after the url instead of linking with the url as linktext Show Sample Output
This is sample output - yours may be different.
```
<a href="http://google.com">search engine</a>
```
-2

sed "s/$[a-zA-Z]*\:\/\/[^,]*$,$.*$/\<a href=\"\1\"\>\2\<\/a\>/"

chrismccoy · 2012-01-06 13:55:05 13
add title and alt-text to your collection of xkcd comics

full command: for fn in xkcd*.png xkcd*.jpg; do; echo $fn; read xw xh <<<$(identify -format '%w %h' $fn); nn="$(echo $fn | sed 's/xkcd-$[0-9]\+$-.*/\1/')"; wget -q -O xkcd-${nn}.json http://xkcd.com/$nn/info.0.json; tt="$(sed 's/.*"title": "$[^"]*$", .*/\1/' xkcd-${nn}.json)"; at="$(sed 's/.*alt": "$.*$", .*/\1/' xkcd-${nn}.json)"; convert -background white -fill black -font /usr/share/fonts/truetype/freefont/FreeSansBold.ttf -pointsize 26 -size ${xw}x -gravity Center caption:"$tt" tt.png; convert -background '#FFF9BD' -border 1x1 -bordercolor black -fill black -font /usr/share/fonts/truetype/freefont/FreeSans.ttf -pointsize 16 -size $(($xw - 2))x -gravity Center caption:"$at" at.png; th=$(identify -format '%h' tt.png); ah=$(identify -format '%h' at.png); convert -size ${xw}x$(($xh+$th+$ah+5)) "xc:white" tt.png -geometry +0+0 -composite $fn -geometry +0+$th -composite at.png -geometry +0+$(($th+$xh+5)) -composite ${fn%\.*}_cmp.png; echo -e "$fn $nn $xw $xh $th $ah \n$tt \n$at\n"; done this assumes that all comics are saved as xkcd-[number]-[title].{png|jpg}. it will then download the title and alt-text, create pictures from them, and put everything together in a new png-file. it's not perfect, but it worked for nearly all my comics. it uses the xkcd-json-interface. though it's poorly written, it doesn't completely break on http://xkcd.com/859/
This is sample output - yours may be different.
-2

for fn in xkcd*.png xkcd*.jpg; do echo $fn; read xw xh <<<$(identify -format '%w %h' $fn); nn="$(echo $fn | sed 's/xkcd-$[^-]\+$-.*/\1/')"; wget -q -O xkcd-${nn}.json http://xkcd.com/$nn/info.0.json; tt="$(sed 's/.*"title": "$[^"]\+$",.*/\1/' ...

fpunktk · 2012-01-06 20:26:11 8
Deleting / Ignoring tailer record from the file

sed '$ d' foo.txt.tmp ...deletes last line from the file
This is sample output - yours may be different.
-2

cp foo.txt foo.txt.tmp; sed '$ d' foo.txt.tmp > foo.txt; rm -f foo.txt.tmp

kaushalmehra · 2012-09-13 20:57:40 7
a find and replace within text-based files
This is sample output - yours may be different.
-2

find /path/ -type f -exec grep -l '<string of text>' {} \; | xargs sed -i -e 's%<string of text>%<new text string>%g'

leonteale · 2013-02-07 18:47:01 5
psgrepp
This is sample output - yours may be different.
-2

pgrep -lf

ajkaanbal · 2013-07-30 14:10:41 8
Print all lines containing the word 'jan' to a new file.
This is sample output - yours may be different.
-2

sed -n '/jan\|Jan\|JAN\|JAn\|jAn\|jAN\|jaN/p' data.txt > jan-only-data.txt

Kali_Root · 2013-11-15 20:23:53 8
‹ First < 12 13 14 15 16 >

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Mount a partition from dd disk image

Assuming we have a disk image, ie. created by $dd if=/dev/sda of=image.dd we can check the image's partition layout with $fdisk -ul image.dd then, we substitute "x" with starting sector of the partition we want to mount. This example assumes that the disk uses 512 B sectors

List latest 5 modified files recursively

The output format is given by the -printf parameter: %T@ = modify time in seconds since Jan. 1, 1970, 00:00 GMT, with fractional part. Mandatory, hidden in the end. %TY-%Tm-%Td %TH:%TM:%.2TS = modify time as YYYY-MM-DD HH:MM:SS. Optional. %p = file path Refer to http://linux.die.net/man/1/find for more about -printf formatting. ------------------------ sort -nr = sort numerically and reverse (higher values - most recent timestamp - first) head -n 5 = get only 5 first lines (change 5 to whatever you want) cut -f2- -d" " = trim first field (timestamp, used only for sorting) ------------------------ Very useful for building scripts for detecting malicious files upload and malware injections.

List your installed Chromium extensions (with url to each page)

Gives you a list for all installed chrome (chromium) extensions with URL to the page of the extension. With this you can easy add a new Bookmark folder called "extensions" add every URL to that folder, so it will be synced and you can access the names from every computer you are logged in. ------------------------------------------------------------------------------------------------------------------ Only tested with chromium, for chrome you maybe have to change the find $PATH.

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Swap a file or dir with quick resotre

This lets you replace a file or directory and quickly revert if something goes wrong. For example, the current version of a website's files are in public_html. Put a new version of the site in public_html~ and execute the command. The names are swapped. If anything goes wrong, execute it again (up arrow or !!).

Install pip with Proxy

Installs pip packages defining a proxy

Detach a process from the current shell

Continue to execute the command in background even though quitting the shell.

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

Get the size of all the directories in current directory (Sorted Human Readable)

This allows the output to be sorted from largest to smallest in human readable format.

Never rewrites a file while copying (or moving)

Allows you to preserve your files when using cp, mv, ln, install or patch. When the target file exists, it will generate a file named XXX.~N~ (N is an auto-incremental number) instead of deleting the target file.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged sed

Commands tagged sed (376) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged sed (376)

sorted by