Commands tagged sed sorted by votes

Commands tagged sed (376)

sorted by

nmap scan hosts for IP, MAC Address and device Vendor/Manufacturer

In the field, I needed to script a process to scan a specific vendor devices in the network. With the help of nmap, I got all the devices of that particular vendor, and started a scripted netcat session to download configuration files from a tftp server. This is the nmap loop (part of the script). You can however, add another pipe with grep to filter the vendor/manufacturer devices only. If want to check the whole script, check in http://pastebin.com/ju7h4Xf4 Show Sample Output
This is sample output - yours may be different.
```
10.0.0.1 AA:BB:CC:DD:EE:FF (Vendor)
10.0.0.2 BB:CC:DD:EE:FF:AA (Manufacturer)
10.0.0.3 FF:FF:FF:FF:FF:FF (Unknown)
```
0

nmap -sP 10.0.0.0/8 | grep -v "Host" | tail -n +3 | tr '\n' ' ' | sed 's|Nmap|\nNmap|g' | grep "MAC Address" | cut -d " " -f5,8-15

jaimerosario · 2014-12-26 18:31:53 13
drop first column of output by piping to this

This is the easiest and shortest way :-)
This is sample output - yours may be different.
0

sed 1d

rantanplan · 2015-05-27 09:25:01 9
Evaluate simple formulas in a .csv spreadsheet by converting and piping to the venerable sc.

Requires psc, sed, sc, and cat. Working with csv spreadsheets with formulas in them to evaluate the formulas using sc. View the formulas in a numbered and lettered formated in command line. function sheet () { cat "$1" | sed '1s/^/a,b,c,d,e,f,g,h,j,k,l,m,n,o,p\n/' | column -s , -tn | nl -v 0 ; }
This is sample output - yours may be different.
0

cat FILE.csv |sed -e '1i,,,,,' |sed -e 's/=sum/@sum/g' -e 's/=SUM/@SUM/g' |psc -k -d, |sed -e 's/\"@SUM(/@SUM(/' -e 's/)"/)/' -e '/@SUM/ { s/rightstring/let/; }' -e '/= "=/s/rightstring/let/' -e '/= "=/s/"//g' -e 's/= =/= /g' |sc

eakinc · 2015-07-13 04:11:31 10
Display specific line in a text file

use this command to quickly display specific line. Show Sample Output
This is sample output - yours may be different.
```
seq 100 | sed "55q;d"
55
```
0

sed "<line no>q;d"

s_prapat · 2015-07-17 14:10:51 11
Printout a list of field numbers from a CSV file with headers as first line.

Take the header line from a comma-delimited CSV file and enumerate the fields. . First sed replaces all commas with newlines s/,/\n/g Then sed quits (q) after the first line. Finally, nl numbers all the lines Show Sample Output
This is sample output - yours may be different.
```
$ cat file.csv 
First Name,Family Name,Occupation
Albert,Einstein,Physicist
William,Shakespeare,Writer

$ sed 's/,/\n/g;q' file.csv | nl
     1	First Name
     2	Family Name
     3	Occupation
```
0

sed 's/,/\n/g;q' file.csv | nl

flatcap · 2015-08-26 11:38:56 13
search APT's cache for a regex and let it display name and short description of matches

I personally like it very much and have wrapped it into a function, named "apt-propos" ;), also you can use --names-only option for a sort-of "apt-whatis"
This is sample output - yours may be different.
0

apt-cache search byo | sed "s/^$[[:alnum:]\.-]*$ - /\1=%%%=- /" | column -s '=%%%=' -t

VoidDroid · 2015-10-18 10:55:34 11

Show a git log with offsets relative to HEAD

This is how you can do this without having to use oneline Show Sample Output

git log | nl -w9 -v0 --body-numbering='pcommit\ [0-9a-f]\{40\}' | sed 's/^ \+$[0-9]\+$\s\+/HEAD~\1 /'

guywithnose · 2015-11-23 21:53:33 10

easily strace all your apache *child* processes

On debian parent process is running as root, workers as www-data. You can run strace in backgroud, get its PID, curl your webpage, kill strace and read your stats.
This is sample output - yours may be different.
0

strace -c $(ps -u www-data o pid= | sed 's/^/-p/')

brablc · 2015-11-25 08:10:52 11
Bulk change of mail domains in Rainloop

I had to reconfigure all of my 150 domains to use "localhost" as IMAP/SMTP server instead of mail.[domain]. This little thing did the job in a fraction of a second!
This is sample output - yours may be different.
0

sed -i -E 's/mail\..*/localhost\"/g' *

Blagus · 2016-01-15 14:48:32 10
Display a random man page
This is sample output - yours may be different.
0

man $(ls /bin | shuf -n1)

jubnzv · 2016-06-28 18:34:46 12
Find 20 most frequently-used shell commands from (bash history)
This is sample output - yours may be different.
0

tr "\|\;" "\n" < ~/.bash_history | sed -e "s/^ //g" | cut -d " " -f 1 | sort | uniq -c | sort -rn | head -20

turrtle13 · 2016-07-01 19:27:12 10
sed 's:.*/::'

FQPN - Path = Filename
This is sample output - yours may be different.
0

Print everything after last slash

qdrizh · 2016-08-17 07:10:33 44

remove proxy reverse iP from apache log

remove the IP from proxy reverse server and parentesis from real IP obtained from X-forwarder_IP Show Sample Output

tr -s ' ' | cut -d' ' -f2- |cut -c2- |sed 's/)//1'

horaciod · 2016-09-12 19:25:23 16

Open VLC player with search results from YouTube

Search a string in YouTube using GET command, parse the response with a suitable replace pattern and pipe its result to VLC Show Sample Output
This is sample output - yours may be different.
```
https://www.youtube.com/watch?v=bg6vYLs5DKg
https://www.youtube.com/watch?v=NsWd15iLDHs
https://www.youtube.com/watch?v=aw088NHSjdA
https://www.youtube.com/watch?v=6VmmvhR2T4U
https://www.youtube.com/watch?v=Xnw3Mrm1nGs
https://www.youtube.com/watch?v=_vb2lCx36bA
https://www.youtube.com/watch?v=13O9ZPCnW3c
https://www.youtube.com/watch?v=9CS4jpY-IDI
(...)
```
0

GET https://www.youtube.com/results?search_query=shaun+the+sheep | sed -ne '/<a href="\/watch.*title="/s/.*<a href="$\/watch[^"]*$".* title="$[^"]*$".*/https:\/\/www.youtube.com\1/p' | vlc -

plokij · 2016-10-28 23:55:59 17
Colorized tail using sed

Tails make.out file and pipes it to sed which uses 3 colors: green: percentage (eg: 10%) yellow: warning (case insensitive) red: error (case insensitive)
This is sample output - yours may be different.
0

tail -f ~/make.out | sed -e 's/$...%$/\o033[32m\1\o033[39m/' -e 's/$.*[Ww][Aa][Rr][Nn][Ii][Nn][Gg].*$/\o033[33m\1\o033[39m/' -e 's/$.*[Ee][Rr][Rr][Oo][Rr].*$/\o033[31m\1\o033[39m/'

redowk · 2017-03-06 18:20:36 18
Remove last x lines from file using sed

Removes the last 5 lines from a file using sed
This is sample output - yours may be different.
0

sed -n -e :a -i -e '1,5!{P;N;D;};N;ba' /etc/apt/sources.list

redowk · 2017-03-06 18:22:48 20

Simply clean playlist

Remove all line from a playlist m3u that not finish with MP3 or mp3 or wma or flac creating a new clean plalist m3u Show Sample Output

sed -e '/MP3$\|mp3$\|wma$\|flac$/!d' <filename_source> > <filename_destination>

vinabb · 2017-03-21 22:14:08 17

Pretty-print user/group info for a given user
This is sample output - yours may be different.
0

id <user_name> | sed 's/,/\n/g' | tr ' ' '\n'

gadjodilo · 2017-12-24 02:33:40 25
Find German synonyms using OpenThesaurus

A function for retrieving and displaying a list of synonyms for a German word or phrase. Show Sample Output
This is sample output - yours may be different.
```
$ desyno Läuterung
Aufbesserung, Aufwertung, Besserung, Läuterung, Melioration, Optimierung, Verbesserung, Verfeinerung, Vervollkommnung, Katharsis, Klärung, Läuterung, Reinigung
$ desyno linux
GNU/Linux, Linux
```
0

desyno(){ wget -q -O- https://www.openthesaurus.de/synonyme/search\?q\="$*"\&format\=text/xml | sed 's/>/>\n/g' | grep "<term term=" | cut -d \' -f 2 | paste -s -d , | sed 's/,/, /g' | fold -s -w $(tput cols); }

lordtoran · 2019-02-09 05:06:42 32
Remove scripts tags from *.html and *.htm files under the current directory
This is sample output - yours may be different.
0

find ./ -type f $ -iname '*.html' -or -iname '*.htm' $ -exec sed -i '/<script/,/<\/script>/d' '{}' \;

mikhail · 2019-05-10 23:27:12 152
PHP7 - Fix incompatibility errors like: Parse error: syntax error, unexpected new (T_NEW) in file.php on line...

New objects cannot be assigned by reference. The result of the new statement can no longer be assigned to a variable by reference. Check the "Sample Output" example ("sample.php"). The Output of the above example in PHP 5: "Deprecated: Assigning the return value of new by reference is deprecated in sample.php on line 3". Output of the above example in PHP 7: "Parse error: syntax error, unexpected 'new' (T_NEW) in sample.php on line 3. Show Sample Output
This is sample output - yours may be different.
```
echo -e "<?php\nclass C {}\n\$c =& new C;\n?>" > sample.php
cat sample.php
<?php
class C {}
$c =& new C;
?>
busybox sh -c 'find "$(realpath ./)" -type f $ -iname "*.php" -or -iname "*.inc" $ -exec sed -i -r "s~=[[:space:]]*&[[:space:]]*new[[:space:]]+~= new ~gi" {} \; '
cat sample.php
<?php
class C {}
$c  = new C;
?>
```
0

find "$(realpath ./)" -type f $ -iname "*.php" -or -iname "*.inc" $ -exec sed -i -r "s~=[[:space:]]*&[[:space:]]*new[[:space:]]+~= new ~gi" {} \;

mikhail · 2019-05-29 18:20:45 38
Remove abstracts from a bibtex file

Remove lines from a bibtex file that have abstracts in them.
This is sample output - yours may be different.
0

sed '/^\s*abstract\s*=\s*{[^\n]*},$/ d' input.bib > output.bib

mirams · 2019-08-01 13:59:38 63
Remove all the characters after last space per line including it

It his example removes ' dog', last space included. Show Sample Output
This is sample output - yours may be different.
```
The quick brown fox jumps over the lazy
```
0

echo 'The quick brown fox jumps over the lazy dog' | sed 's|$.*$ .*|\1|'

bugmenot · 2021-07-15 20:01:32 172
Enlarge KiCad PCB footprint pads to 2mm for all smaller pads
This is sample output - yours may be different.
0

sed -E -i.bak 's/(^ +$pad.*\(size)([^$]+)(\) $drill)([^$]+)(.*)/\1 2 2\3 1\5/g' SOURCE_FILE.kicad_pcb

alikhalil · 2022-02-12 19:25:14 336
simulates the DOS tree command that you might be missing on your Mac or Linux box

NOT MINE! Taken from hackzine.com blog. It creates a tree-style output of all the (sub)folders and (sub)files from the current folder and down(deeper) Quoting some of hackzine's words "Murphy Mac sent us a link to a handy find/sed command that simulates the DOS tree command that you might be missing on your Mac or Linux box. [..split...] Like most things I've seen sed do, it does quite a bit in a single line of code and is completely impossible to read. Sure it's just a couple of substitutions, but like a jack in the box, it remains a surprise every time I run it." Show Sample Output
This is sample output - yours may be different.
```
$ cd amsn_received
$ find . -print | sed -e 's;[^/]*/;|____;g;s;____|; |;g'
.
|____amsn_received
| |____screenshot1.png
| |____DSCF1171.JPG
| |____DSCF1202.JPG
| |____DSC00887.jpg
| |____DSC00953.jpg
| |____DSC00595.JPG
| |____at92A3.tmp.jpg
| |____ReadMe 1.pdf
| |____Screenshot.png
| |____cpuz.html
```
-1

find . -print | sed -e 's;[^/]*/;|____;g;s;____|; |;g'

JesusSuperstar · 2009-03-12 22:25:26 8
‹ First < 10 11 12 13 14 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Generate soothing noise

Substitute 'brown' with 'pink' or 'white' according to your taste. I put this on my headphones when I'm working in an "open concept" office, where there are always three to five conversations going in earshot, or if I'm working somewhere it is "rude" of me to tell a person to turn off their cubicle radio.

Create a large test file (taking no space).

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Simple Video Surveillance by email

This takes a picture (with the web cam) every 5 minutes, and send the picture to your e-mail. Some systems support mail -a "References: " so that all video surveillance emails are grouped in a single email thread. To keep your inbox clean, it is still possible to filter and move to trash video surveillance emails (and restore these emails only if you really get robbed!) For instance with Gmail, emails sent to me+trash@gmail.com can be filtered with "Matches: DeliveredTo:me+trash@gmail.com"

Create a new file

Stream system sounds over rtmp

sox (SOund eXchange) can capture the system audio be it a browser playing youtube or from hardware mic and can pipe it to ffmpeg which encodes it into flv and send it over rtmp. Tested using Red5 rtmp server.

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Fastest segmented parallel sync of a remote directory over ssh

Mirror a remote directory using some tricks to maximize network speed. lftp:: coolest file transfer tool ever -u: username and password (pwd is merely a placeholder if you have ~/.ssh/id_rsa) -e: execute internal lftp commands set sftp:connect-program: use some specific command instead of plain ssh ssh:: -a -x -T: disable useless things -c arcfour: use the most efficient cipher specification -o Compression=no: disable compression to save CPU mirror: copy remote dir subtree to local dir -v: be verbose (cool progress bar and speed meter, one for each file in parallel) -c: continue interrupted file transfers if possible --loop: repeat mirror until no differences found --use-pget-n=3: transfer each file with 3 independent parallel TCP connections -P 2: transfer 2 files in parallel (totalling 6 TCP connections) sftp://remotehost:22: use sftp protocol on port 22 (you can give any other port if appropriate) You can play with values for --use-pget-n and/or -P to achieve maximum speed depending on the particular network. If the files are compressible removing "-o Compression=n" can be beneficial. Better create an alias for the command.

Easy to extend one-liner for cron scripts that automate filesystem checking

This one-liner is for cron jobs that need to provide some basic information about a filesystem and the time it takes to complete the operation. You can swap out the di command for df or du if that's your thing. The |& redirections the stderr and stdout to the mail command. How to configure the variables. TOFSCK=/path/to/mount FSCKDEV=/dev/path/device or FSCKDEV=`grep $TOFSCK /proc/mounts | cut -f1 -d" "` MAILSUB="weekly file system check $TOFSCK "

Speed up upgrades for a debian/ubuntu based system.

Please install aria2c before you try the above command. On ubuntu the command to install aria2c would be: $sudo aptitude install aria2

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged sed

Commands tagged sed (376) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged sed (376)

sorted by