Commands tagged sed sorted by votes

Commands tagged sed (376)

sorted by

nmap scan hosts for IP, MAC Address and device Vendor/Manufacturer

In the field, I needed to script a process to scan a specific vendor devices in the network. With the help of nmap, I got all the devices of that particular vendor, and started a scripted netcat session to download configuration files from a tftp server. This is the nmap loop (part of the script). You can however, add another pipe with grep to filter the vendor/manufacturer devices only. If want to check the whole script, check in http://pastebin.com/ju7h4Xf4 Show Sample Output
This is sample output - yours may be different.
```
10.0.0.1 AA:BB:CC:DD:EE:FF (Vendor)
10.0.0.2 BB:CC:DD:EE:FF:AA (Manufacturer)
10.0.0.3 FF:FF:FF:FF:FF:FF (Unknown)
```
0

nmap -sP 10.0.0.0/8 | grep -v "Host" | tail -n +3 | tr '\n' ' ' | sed 's|Nmap|\nNmap|g' | grep "MAC Address" | cut -d " " -f5,8-15

jaimerosario · 2014-12-26 18:31:53 13
drop first column of output by piping to this

This is the easiest and shortest way :-)
This is sample output - yours may be different.
0

sed 1d

rantanplan · 2015-05-27 09:25:01 9
Evaluate simple formulas in a .csv spreadsheet by converting and piping to the venerable sc.

Requires psc, sed, sc, and cat. Working with csv spreadsheets with formulas in them to evaluate the formulas using sc. View the formulas in a numbered and lettered formated in command line. function sheet () { cat "$1" | sed '1s/^/a,b,c,d,e,f,g,h,j,k,l,m,n,o,p\n/' | column -s , -tn | nl -v 0 ; }
This is sample output - yours may be different.
0

cat FILE.csv |sed -e '1i,,,,,' |sed -e 's/=sum/@sum/g' -e 's/=SUM/@SUM/g' |psc -k -d, |sed -e 's/\"@SUM(/@SUM(/' -e 's/)"/)/' -e '/@SUM/ { s/rightstring/let/; }' -e '/= "=/s/rightstring/let/' -e '/= "=/s/"//g' -e 's/= =/= /g' |sc

eakinc · 2015-07-13 04:11:31 10
Display specific line in a text file

use this command to quickly display specific line. Show Sample Output
This is sample output - yours may be different.
```
seq 100 | sed "55q;d"
55
```
0

sed "<line no>q;d"

s_prapat · 2015-07-17 14:10:51 11
Printout a list of field numbers from a CSV file with headers as first line.

Take the header line from a comma-delimited CSV file and enumerate the fields. . First sed replaces all commas with newlines s/,/\n/g Then sed quits (q) after the first line. Finally, nl numbers all the lines Show Sample Output
This is sample output - yours may be different.
```
$ cat file.csv 
First Name,Family Name,Occupation
Albert,Einstein,Physicist
William,Shakespeare,Writer

$ sed 's/,/\n/g;q' file.csv | nl
     1	First Name
     2	Family Name
     3	Occupation
```
0

sed 's/,/\n/g;q' file.csv | nl

flatcap · 2015-08-26 11:38:56 13
search APT's cache for a regex and let it display name and short description of matches

I personally like it very much and have wrapped it into a function, named "apt-propos" ;), also you can use --names-only option for a sort-of "apt-whatis"
This is sample output - yours may be different.
0

apt-cache search byo | sed "s/^$[[:alnum:]\.-]*$ - /\1=%%%=- /" | column -s '=%%%=' -t

VoidDroid · 2015-10-18 10:55:34 11

Show a git log with offsets relative to HEAD

This is how you can do this without having to use oneline Show Sample Output

git log | nl -w9 -v0 --body-numbering='pcommit\ [0-9a-f]\{40\}' | sed 's/^ \+$[0-9]\+$\s\+/HEAD~\1 /'

guywithnose · 2015-11-23 21:53:33 10

easily strace all your apache *child* processes

On debian parent process is running as root, workers as www-data. You can run strace in backgroud, get its PID, curl your webpage, kill strace and read your stats.
This is sample output - yours may be different.
0

strace -c $(ps -u www-data o pid= | sed 's/^/-p/')

brablc · 2015-11-25 08:10:52 11
Bulk change of mail domains in Rainloop

I had to reconfigure all of my 150 domains to use "localhost" as IMAP/SMTP server instead of mail.[domain]. This little thing did the job in a fraction of a second!
This is sample output - yours may be different.
0

sed -i -E 's/mail\..*/localhost\"/g' *

Blagus · 2016-01-15 14:48:32 10
Display a random man page
This is sample output - yours may be different.
0

man $(ls /bin | shuf -n1)

jubnzv · 2016-06-28 18:34:46 12
Find 20 most frequently-used shell commands from (bash history)
This is sample output - yours may be different.
0

tr "\|\;" "\n" < ~/.bash_history | sed -e "s/^ //g" | cut -d " " -f 1 | sort | uniq -c | sort -rn | head -20

turrtle13 · 2016-07-01 19:27:12 10
sed 's:.*/::'

FQPN - Path = Filename
This is sample output - yours may be different.
0

Print everything after last slash

qdrizh · 2016-08-17 07:10:33 44

remove proxy reverse iP from apache log

remove the IP from proxy reverse server and parentesis from real IP obtained from X-forwarder_IP Show Sample Output

tr -s ' ' | cut -d' ' -f2- |cut -c2- |sed 's/)//1'

horaciod · 2016-09-12 19:25:23 16

Open VLC player with search results from YouTube

Search a string in YouTube using GET command, parse the response with a suitable replace pattern and pipe its result to VLC Show Sample Output
This is sample output - yours may be different.
```
https://www.youtube.com/watch?v=bg6vYLs5DKg
https://www.youtube.com/watch?v=NsWd15iLDHs
https://www.youtube.com/watch?v=aw088NHSjdA
https://www.youtube.com/watch?v=6VmmvhR2T4U
https://www.youtube.com/watch?v=Xnw3Mrm1nGs
https://www.youtube.com/watch?v=_vb2lCx36bA
https://www.youtube.com/watch?v=13O9ZPCnW3c
https://www.youtube.com/watch?v=9CS4jpY-IDI
(...)
```
0

GET https://www.youtube.com/results?search_query=shaun+the+sheep | sed -ne '/<a href="\/watch.*title="/s/.*<a href="$\/watch[^"]*$".* title="$[^"]*$".*/https:\/\/www.youtube.com\1/p' | vlc -

plokij · 2016-10-28 23:55:59 17
Colorized tail using sed

Tails make.out file and pipes it to sed which uses 3 colors: green: percentage (eg: 10%) yellow: warning (case insensitive) red: error (case insensitive)
This is sample output - yours may be different.
0

tail -f ~/make.out | sed -e 's/$...%$/\o033[32m\1\o033[39m/' -e 's/$.*[Ww][Aa][Rr][Nn][Ii][Nn][Gg].*$/\o033[33m\1\o033[39m/' -e 's/$.*[Ee][Rr][Rr][Oo][Rr].*$/\o033[31m\1\o033[39m/'

redowk · 2017-03-06 18:20:36 18
Remove last x lines from file using sed

Removes the last 5 lines from a file using sed
This is sample output - yours may be different.
0

sed -n -e :a -i -e '1,5!{P;N;D;};N;ba' /etc/apt/sources.list

redowk · 2017-03-06 18:22:48 20

Simply clean playlist

Remove all line from a playlist m3u that not finish with MP3 or mp3 or wma or flac creating a new clean plalist m3u Show Sample Output

sed -e '/MP3$\|mp3$\|wma$\|flac$/!d' <filename_source> > <filename_destination>

vinabb · 2017-03-21 22:14:08 17

Pretty-print user/group info for a given user
This is sample output - yours may be different.
0

id <user_name> | sed 's/,/\n/g' | tr ' ' '\n'

gadjodilo · 2017-12-24 02:33:40 25
Find German synonyms using OpenThesaurus

A function for retrieving and displaying a list of synonyms for a German word or phrase. Show Sample Output
This is sample output - yours may be different.
```
$ desyno Läuterung
Aufbesserung, Aufwertung, Besserung, Läuterung, Melioration, Optimierung, Verbesserung, Verfeinerung, Vervollkommnung, Katharsis, Klärung, Läuterung, Reinigung
$ desyno linux
GNU/Linux, Linux
```
0

desyno(){ wget -q -O- https://www.openthesaurus.de/synonyme/search\?q\="$*"\&format\=text/xml | sed 's/>/>\n/g' | grep "<term term=" | cut -d \' -f 2 | paste -s -d , | sed 's/,/, /g' | fold -s -w $(tput cols); }

lordtoran · 2019-02-09 05:06:42 32
Remove scripts tags from *.html and *.htm files under the current directory
This is sample output - yours may be different.
0

find ./ -type f $ -iname '*.html' -or -iname '*.htm' $ -exec sed -i '/<script/,/<\/script>/d' '{}' \;

mikhail · 2019-05-10 23:27:12 152
PHP7 - Fix incompatibility errors like: Parse error: syntax error, unexpected new (T_NEW) in file.php on line...

New objects cannot be assigned by reference. The result of the new statement can no longer be assigned to a variable by reference. Check the "Sample Output" example ("sample.php"). The Output of the above example in PHP 5: "Deprecated: Assigning the return value of new by reference is deprecated in sample.php on line 3". Output of the above example in PHP 7: "Parse error: syntax error, unexpected 'new' (T_NEW) in sample.php on line 3. Show Sample Output
This is sample output - yours may be different.
```
echo -e "<?php\nclass C {}\n\$c =& new C;\n?>" > sample.php
cat sample.php
<?php
class C {}
$c =& new C;
?>
busybox sh -c 'find "$(realpath ./)" -type f $ -iname "*.php" -or -iname "*.inc" $ -exec sed -i -r "s~=[[:space:]]*&[[:space:]]*new[[:space:]]+~= new ~gi" {} \; '
cat sample.php
<?php
class C {}
$c  = new C;
?>
```
0

find "$(realpath ./)" -type f $ -iname "*.php" -or -iname "*.inc" $ -exec sed -i -r "s~=[[:space:]]*&[[:space:]]*new[[:space:]]+~= new ~gi" {} \;

mikhail · 2019-05-29 18:20:45 38
Remove abstracts from a bibtex file

Remove lines from a bibtex file that have abstracts in them.
This is sample output - yours may be different.
0

sed '/^\s*abstract\s*=\s*{[^\n]*},$/ d' input.bib > output.bib

mirams · 2019-08-01 13:59:38 64
Remove all the characters after last space per line including it

It his example removes ' dog', last space included. Show Sample Output
This is sample output - yours may be different.
```
The quick brown fox jumps over the lazy
```
0

echo 'The quick brown fox jumps over the lazy dog' | sed 's|$.*$ .*|\1|'

bugmenot · 2021-07-15 20:01:32 174
Enlarge KiCad PCB footprint pads to 2mm for all smaller pads
This is sample output - yours may be different.
0

sed -E -i.bak 's/(^ +$pad.*\(size)([^$]+)(\) $drill)([^$]+)(.*)/\1 2 2\3 1\5/g' SOURCE_FILE.kicad_pcb

alikhalil · 2022-02-12 19:25:14 337
simulates the DOS tree command that you might be missing on your Mac or Linux box

NOT MINE! Taken from hackzine.com blog. It creates a tree-style output of all the (sub)folders and (sub)files from the current folder and down(deeper) Quoting some of hackzine's words "Murphy Mac sent us a link to a handy find/sed command that simulates the DOS tree command that you might be missing on your Mac or Linux box. [..split...] Like most things I've seen sed do, it does quite a bit in a single line of code and is completely impossible to read. Sure it's just a couple of substitutions, but like a jack in the box, it remains a surprise every time I run it." Show Sample Output
This is sample output - yours may be different.
```
$ cd amsn_received
$ find . -print | sed -e 's;[^/]*/;|____;g;s;____|; |;g'
.
|____amsn_received
| |____screenshot1.png
| |____DSCF1171.JPG
| |____DSCF1202.JPG
| |____DSC00887.jpg
| |____DSC00953.jpg
| |____DSC00595.JPG
| |____at92A3.tmp.jpg
| |____ReadMe 1.pdf
| |____Screenshot.png
| |____cpuz.html
```
-1

find . -print | sed -e 's;[^/]*/;|____;g;s;____|; |;g'

JesusSuperstar · 2009-03-12 22:25:26 8
‹ First < 10 11 12 13 14 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Combine two mp3's or more into 1 long mp3

This just combines multiple mp3's into one mp3 file. Basically it is a easy join for mp3's

Are the two lines anagrams?

This works by reading in two lines of input, turning each into a list of one-character matches that are sorted and compared.

Calculating series with awk: add numbers from 1 to 100

"seq 100" outputs 1,2,..,100, separated by newlines. awk adds them up and displays the sum. "seq 1 2 11" outputs 1,3,..,11. Variations: 1+3+...+(2n-1) = n^2 $ seq 1 2 19 | awk '{sum+=$1} END {print sum}' # displays 100 1/2 + 1/4 + ... = 1 $ seq 10 | awk '{sum+=1/(2**$1)} END {print sum}' # displays 0.999023

HTTP redirect

any HTTP requests to the machine on the specified port will be redirected to http://www.whatevs.com... quick, dirty, works fine for sites w/

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Single words from Amazon Kindle 3 notes

You can use any dictionary you want, in any language. This command will output all single-word annotations that you have underlined in your Kindle device (provided the file) given a list of language-specific words. If you want to learn vocabulary, this command is ideal.

Delete all empty lines from a file with vim

Rename files in batch

Add .gitignore files to all empty directories recursively from your current directory

check open ports without netstat or lsof

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged sed

Commands tagged sed (376) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged sed (376)

sorted by