Commands tagged sed sorted by votes

Commands tagged sed (376)

sorted by

Use exit codes that actually means something.

Use meaningful exit codes change "source" to "cat" to view output instead of assigning Show Sample Output

-1

source <(egrep '^#define EX_.*' /usr/include/sysexits.h | sed -e 's/#define/declare -r/g' | sed 's/\//#/g' | sed -e 's/\s\{1,\}/ /g' | sed -e 's/ $[0-9]$/\=\1/'g )

fishdaemon · 2012-09-21 13:30:37 10

Extract single table from a MySQL dump

Given a dump.sql file, extract table1 creation and data commands. table2 is the one following table1 in the dump file. You can also use the same idea to extract several consecutive tables.
This is sample output - yours may be different.
-1

cat dump.sql | sed -n -e '/Table structure for table .table1./,/Table structure for table .table2./p'

infojunkie · 2012-11-22 23:54:04 5
a find and replace within text-based files
This is sample output - yours may be different.
-1

sed -i 's/http:\/\/old\/new\///g' index.html

leonteale · 2013-02-07 18:45:23 5
Removes single line from known_hosts file

Quickly remove the conflicting line (key) from current users known_hosts file when there is an SSH host conflict. Very nice when you get tired of writing out full commands. Ideally you would place this into your .bash_profile Usage: rhost [n] Example: rhost 33 (removes line 33 from ~/.ssh/known_hosts) Function assumes the $HOME exists, you could alternatively use "~/.ssh/known_hosts" Mac OSX likes a space for sed -i "$1" d
This is sample output - yours may be different.
-1

rhost() { if [[ $1 =~ ^[0-9]+$ ]]; then sed -i "$1"d ${HOME}/.ssh/known_hosts; else echo "rhost [n]"; fi }

lowjax · 2013-08-01 21:10:34 13
Sort files in $PWD by year embedded anywhere in filename
This is sample output - yours may be different.
-1

ls --color=never -1| grep -E "[0-9]{4}"|sed -re "s/^(.*)([0-9]{4})(.*)$/\2 \1\2\3/" | sort -r

ysangkok · 2014-01-04 20:50:12 9
Edit a single line in multiple files with sed

Find and replace specific characters in a single line in multiple files with sed. Show Sample Output
This is sample output - yours may be different.
```
Original file
file1.txt:This is the MATCHING STRING and ORIGINAL some more text

Replaced file

file1.txt:This is the MATCHING STRING and REPLACEMENT some more text
```
-1

for f in `ls`; do sed -i '/MATCHING STRING/ { s/ORIGINAL/REPLACEMENT/; }' ${f} ; done

krizzo · 2015-05-21 19:37:42 15
shell bash iterate number range with for loop

"seq" has an additional parameter to use as INCREMENT. # seq FIRST INCREMENT LAST https://linux.die.net/man/1/seq Show Sample Output
This is sample output - yours may be different.
```
1
2
3
4
5
```
-1

for i in $(seq 1 5) ; do echo $i ; done

guilsson · 2019-07-29 18:34:12 214
Easy Regex based mass renaming

Allows for quick mass renaming, assuming the user has some familiarity with regular expressions. Basically, it replaces the original_file_name in the output of ls with "mv -v original_file_name new_file_name" and passes the output to sh. Show Sample Output
This is sample output - yours may be different.
```
$ ls ~/manga/ | sed -rn -e 's/naruto_(...\.zip)/mv -v & \1/p' | sh
`naruto_431.zip' -> `431.zip'
`naruto_432.zip' -> `432.zip'
`naruto_433.zip' -> `433.zip'
`naruto_434.zip' -> `434.zip'
$
```
-2

ls /some/directory | sed -rn -e 's/input_file_regex/mv -v & output_file_name/p' | sh

polar · 2009-03-25 09:20:15 10
print random commandlinefu.com submission

ok I'm sure it's not pretty Show Sample Output
This is sample output - yours may be different.
```
Terminal - runs a bash script in debugging mode    
bash -x ./post_to_commandlinefu.sh
```
-2

lynx -source http://www.commandlinefu.com/commands/random | sed 's/<[^>]*>//g' | head -1037 | tail -10 | sed -e 's/^[ \t]*//' | sed '/^$/d' | head -2

lxtips · 2009-06-02 09:48:59 11
Outputs a 10-digit random number
This is sample output - yours may be different.
-2

n=$RANDOM$RANDOM$RANDOM; let "n %= 10000000000"; echo $n

alset · 2009-10-15 05:10:00 4
Remove an unnecessary suffix from a file name for all files in a directory

For this example, all files in the current directory that end in '.xml.skippy' will have the '.skippy' removed from their names.
This is sample output - yours may be different.
-2

for f in $(ls *.xml.skippy); do mv $f `echo $f | sed 's|.skippy||'`; done

argherna · 2009-11-19 21:36:26 20
Checks apache's access_log file, strips the search queries and shoves them up your e-mail

It's not a big line, and it *may not* work for everybody, I guess it depends on the detail of access_log configuration in your httpd.conf. I use it as a prerotate command for logrotate in httpd section so it executes before access_log rotation, everyday at midnight.
This is sample output - yours may be different.
-2

cat /var/log/httpd/access_log | grep q= | awk '{print $11}' | awk -F 'q=' '{print $2}' | sed 's/+/ /g;s/%22/"/g;s/q=//' | cut -d "&" -f 1 | mail youremail@isp.com -s "[your-site] search strings for `date`"

isma · 2009-11-22 03:03:06 9

Blinking, Color Highlighted search for input/output and files, like grep --color

hb(){ sed "s/$$*$/`tput setaf 2;tput setab 0;tput blink`\1`tput sgr0`/gI"; } hb blinks, hc does a reverse color with background.. both very nice. hc(){ sed "s/$$*$/`tput setaf 0;tput setab 6`\1`tput sgr0`/gI"; } Run this: command ps -Hacl -F S -A f | hc ".*$PPID.*" | hb ".*$$.*" Your welcome ;) From my bash profile - http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html Show Sample Output

-2

hb(){ sed "s/$$*$/`tput setaf 2;tput setab 0;tput blink`\1`tput sgr0`/gI"; }

AskApache · 2010-04-07 08:45:26 4

Find files and list them sorted by modification time

Here's a version that doesn't use find.
This is sample output - yours may be different.
-2

ls -rl --time-style=+%s * | sed '/^$/,/^total [0-9]*$/d' | sort -nk6

putnamhill · 2010-05-27 19:14:12 4
Generate background office noise using Digg feeds and OSX.

Instead of having someone else read you the Digg headlines, Have OSX do it. Requires Curl+Sed+Say. This could probably be easily modified to use espeak for Linux.
This is sample output - yours may be different.
-2

IFS=`echo -en "\n\b"`; for i in $(curl http://feeds.digg.com/digg/container/technology/popular.rss | grep '<title>' | sed -e 's#<[^>]*>##g' | tail -n10); do echo $i; echo $i | sed 's/^/Did you hear about /g' | say; sleep 30; done

echosedawk · 2010-06-07 22:16:19 4
Shows users and 'virtual users' on your a unix-type system
This is sample output - yours may be different.
-2

cut -d: -f1 /etc/passwd | sort

dog · 2010-07-07 12:12:02 5
Display a random man page

Broaden your knowledge of the utilities available to you in no particular order whatsoever! Then use that knowledge to create more nifty one-liners that you can post here. =p Takes a random number modulo the number of files in $dir, prints the filename corresponding to that number, and passes it as an argument to man.
This is sample output - yours may be different.
-2

dir="/bin"; man $(ls $dir |sed -n "$(echo $(( $RANDOM % $(ls $dir |wc -l | awk "{ print $1; }" ) + 1 )) )p")

camocrazed · 2010-08-20 16:31:50 4
Display a random man page

Great idea camocrazed. Another twist would be to display a different man page based on the day of the year. The following will continuously cycle through all man pages: man $(ls /bin | sed -n $(($(date +%j) % $(ls /bin | wc -l)))p)
This is sample output - yours may be different.
-2

man $(ls /bin | sed -n $((RANDOM % $(ls /bin | wc -l) + 1))p)

putnamhill · 2010-08-20 17:15:33 5
Update all GPG keys in your keyring
This is sample output - yours may be different.
-2

gpg --refresh-keys

unixmonkey22522 · 2011-06-11 07:53:51 3
turn url and link text into a hyperlink

an extension of command 9986 by c3w, allows for link text. http://google.com,search engine will link the hyperlink with the text after the url instead of linking with the url as linktext Show Sample Output
This is sample output - yours may be different.
```
<a href="http://google.com">search engine</a>
```
-2

sed "s/$[a-zA-Z]*\:\/\/[^,]*$,$.*$/\<a href=\"\1\"\>\2\<\/a\>/"

chrismccoy · 2012-01-06 13:55:05 13
add title and alt-text to your collection of xkcd comics

full command: for fn in xkcd*.png xkcd*.jpg; do; echo $fn; read xw xh <<<$(identify -format '%w %h' $fn); nn="$(echo $fn | sed 's/xkcd-$[0-9]\+$-.*/\1/')"; wget -q -O xkcd-${nn}.json http://xkcd.com/$nn/info.0.json; tt="$(sed 's/.*"title": "$[^"]*$", .*/\1/' xkcd-${nn}.json)"; at="$(sed 's/.*alt": "$.*$", .*/\1/' xkcd-${nn}.json)"; convert -background white -fill black -font /usr/share/fonts/truetype/freefont/FreeSansBold.ttf -pointsize 26 -size ${xw}x -gravity Center caption:"$tt" tt.png; convert -background '#FFF9BD' -border 1x1 -bordercolor black -fill black -font /usr/share/fonts/truetype/freefont/FreeSans.ttf -pointsize 16 -size $(($xw - 2))x -gravity Center caption:"$at" at.png; th=$(identify -format '%h' tt.png); ah=$(identify -format '%h' at.png); convert -size ${xw}x$(($xh+$th+$ah+5)) "xc:white" tt.png -geometry +0+0 -composite $fn -geometry +0+$th -composite at.png -geometry +0+$(($th+$xh+5)) -composite ${fn%\.*}_cmp.png; echo -e "$fn $nn $xw $xh $th $ah \n$tt \n$at\n"; done this assumes that all comics are saved as xkcd-[number]-[title].{png|jpg}. it will then download the title and alt-text, create pictures from them, and put everything together in a new png-file. it's not perfect, but it worked for nearly all my comics. it uses the xkcd-json-interface. though it's poorly written, it doesn't completely break on http://xkcd.com/859/
This is sample output - yours may be different.
-2

for fn in xkcd*.png xkcd*.jpg; do echo $fn; read xw xh <<<$(identify -format '%w %h' $fn); nn="$(echo $fn | sed 's/xkcd-$[^-]\+$-.*/\1/')"; wget -q -O xkcd-${nn}.json http://xkcd.com/$nn/info.0.json; tt="$(sed 's/.*"title": "$[^"]\+$",.*/\1/' ...

fpunktk · 2012-01-06 20:26:11 8
Deleting / Ignoring tailer record from the file

sed '$ d' foo.txt.tmp ...deletes last line from the file
This is sample output - yours may be different.
-2

cp foo.txt foo.txt.tmp; sed '$ d' foo.txt.tmp > foo.txt; rm -f foo.txt.tmp

kaushalmehra · 2012-09-13 20:57:40 7
a find and replace within text-based files
This is sample output - yours may be different.
-2

find /path/ -type f -exec grep -l '<string of text>' {} \; | xargs sed -i -e 's%<string of text>%<new text string>%g'

leonteale · 2013-02-07 18:47:01 5
psgrepp
This is sample output - yours may be different.
-2

pgrep -lf

ajkaanbal · 2013-07-30 14:10:41 8
Print all lines containing the word 'jan' to a new file.
This is sample output - yours may be different.
-2

sed -n '/jan\|Jan\|JAN\|JAn\|jAn\|jAN\|jaN/p' data.txt > jan-only-data.txt

Kali_Root · 2013-11-15 20:23:53 8
‹ First < 12 13 14 15 16 >

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

download file1 file2 file3 file4 .... file 100

Check the age of the filesystem

Very useful set of commands to know when your file system was created.

Detect Language of a string

Usage: $ detectlanguage Example: $ detectlanguage hola

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

camelcase to underscore

For mac users !

Generate random valid mac addresses

Python Alternative

Detect illegal access to kernel space, potentially useful for Meltdown detection

Based on capsule8 agent examples, not rigorously tested

convert wav files to ogg

cd to the folder containing the wav files and convert them all to ogg format. in my sample output i use the -a and -l flags to set the author and album title. to get the oggenc program in ubuntu linux run: sudo apt-get install oggenc

Capture video of a linux desktop

Proper screencast with audio using ffmpeg and x264, as per http://verb3k.wordpress.com/2010/01/26/how-to-do-proper-screencasts-on-linux/

find duplicate messages in a Maildir

# find assumes email files start with a number 1-9 # sed joins the lines starting with " " to the previous line # gawk print the received and from lines # sort according to the second field (received+from) # uniq print the duplicated filename # a message is viewed as duplicate if it is received at the same time as another message, and from the same person. The command was intended to be run under cron. If run in a terminal, mutt can be used: mutt -e "push otD~=xq" -f $folder

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged sed

Commands tagged sed (376) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged sed (376)

sorted by