Commands tagged sed sorted by votes

Commands tagged sed (376)

sorted by

nmap scan hosts for IP, MAC Address and device Vendor/Manufacturer

In the field, I needed to script a process to scan a specific vendor devices in the network. With the help of nmap, I got all the devices of that particular vendor, and started a scripted netcat session to download configuration files from a tftp server. This is the nmap loop (part of the script). You can however, add another pipe with grep to filter the vendor/manufacturer devices only. If want to check the whole script, check in http://pastebin.com/ju7h4Xf4 Show Sample Output
This is sample output - yours may be different.
```
10.0.0.1 AA:BB:CC:DD:EE:FF (Vendor)
10.0.0.2 BB:CC:DD:EE:FF:AA (Manufacturer)
10.0.0.3 FF:FF:FF:FF:FF:FF (Unknown)
```
0

nmap -sP 10.0.0.0/8 | grep -v "Host" | tail -n +3 | tr '\n' ' ' | sed 's|Nmap|\nNmap|g' | grep "MAC Address" | cut -d " " -f5,8-15

jaimerosario · 2014-12-26 18:31:53 13
drop first column of output by piping to this

This is the easiest and shortest way :-)
This is sample output - yours may be different.
0

sed 1d

rantanplan · 2015-05-27 09:25:01 9
Evaluate simple formulas in a .csv spreadsheet by converting and piping to the venerable sc.

Requires psc, sed, sc, and cat. Working with csv spreadsheets with formulas in them to evaluate the formulas using sc. View the formulas in a numbered and lettered formated in command line. function sheet () { cat "$1" | sed '1s/^/a,b,c,d,e,f,g,h,j,k,l,m,n,o,p\n/' | column -s , -tn | nl -v 0 ; }
This is sample output - yours may be different.
0

cat FILE.csv |sed -e '1i,,,,,' |sed -e 's/=sum/@sum/g' -e 's/=SUM/@SUM/g' |psc -k -d, |sed -e 's/\"@SUM(/@SUM(/' -e 's/)"/)/' -e '/@SUM/ { s/rightstring/let/; }' -e '/= "=/s/rightstring/let/' -e '/= "=/s/"//g' -e 's/= =/= /g' |sc

eakinc · 2015-07-13 04:11:31 10
Display specific line in a text file

use this command to quickly display specific line. Show Sample Output
This is sample output - yours may be different.
```
seq 100 | sed "55q;d"
55
```
0

sed "<line no>q;d"

s_prapat · 2015-07-17 14:10:51 11
Printout a list of field numbers from a CSV file with headers as first line.

Take the header line from a comma-delimited CSV file and enumerate the fields. . First sed replaces all commas with newlines s/,/\n/g Then sed quits (q) after the first line. Finally, nl numbers all the lines Show Sample Output
This is sample output - yours may be different.
```
$ cat file.csv 
First Name,Family Name,Occupation
Albert,Einstein,Physicist
William,Shakespeare,Writer

$ sed 's/,/\n/g;q' file.csv | nl
     1	First Name
     2	Family Name
     3	Occupation
```
0

sed 's/,/\n/g;q' file.csv | nl

flatcap · 2015-08-26 11:38:56 13
search APT's cache for a regex and let it display name and short description of matches

I personally like it very much and have wrapped it into a function, named "apt-propos" ;), also you can use --names-only option for a sort-of "apt-whatis"
This is sample output - yours may be different.
0

apt-cache search byo | sed "s/^$[[:alnum:]\.-]*$ - /\1=%%%=- /" | column -s '=%%%=' -t

VoidDroid · 2015-10-18 10:55:34 11

Show a git log with offsets relative to HEAD

This is how you can do this without having to use oneline Show Sample Output

git log | nl -w9 -v0 --body-numbering='pcommit\ [0-9a-f]\{40\}' | sed 's/^ \+$[0-9]\+$\s\+/HEAD~\1 /'

guywithnose · 2015-11-23 21:53:33 10

easily strace all your apache *child* processes

On debian parent process is running as root, workers as www-data. You can run strace in backgroud, get its PID, curl your webpage, kill strace and read your stats.
This is sample output - yours may be different.
0

strace -c $(ps -u www-data o pid= | sed 's/^/-p/')

brablc · 2015-11-25 08:10:52 11
Bulk change of mail domains in Rainloop

I had to reconfigure all of my 150 domains to use "localhost" as IMAP/SMTP server instead of mail.[domain]. This little thing did the job in a fraction of a second!
This is sample output - yours may be different.
0

sed -i -E 's/mail\..*/localhost\"/g' *

Blagus · 2016-01-15 14:48:32 10
Display a random man page
This is sample output - yours may be different.
0

man $(ls /bin | shuf -n1)

jubnzv · 2016-06-28 18:34:46 12
Find 20 most frequently-used shell commands from (bash history)
This is sample output - yours may be different.
0

tr "\|\;" "\n" < ~/.bash_history | sed -e "s/^ //g" | cut -d " " -f 1 | sort | uniq -c | sort -rn | head -20

turrtle13 · 2016-07-01 19:27:12 10
sed 's:.*/::'

FQPN - Path = Filename
This is sample output - yours may be different.
0

Print everything after last slash

qdrizh · 2016-08-17 07:10:33 44

remove proxy reverse iP from apache log

remove the IP from proxy reverse server and parentesis from real IP obtained from X-forwarder_IP Show Sample Output

tr -s ' ' | cut -d' ' -f2- |cut -c2- |sed 's/)//1'

horaciod · 2016-09-12 19:25:23 16

Open VLC player with search results from YouTube

Search a string in YouTube using GET command, parse the response with a suitable replace pattern and pipe its result to VLC Show Sample Output
This is sample output - yours may be different.
```
https://www.youtube.com/watch?v=bg6vYLs5DKg
https://www.youtube.com/watch?v=NsWd15iLDHs
https://www.youtube.com/watch?v=aw088NHSjdA
https://www.youtube.com/watch?v=6VmmvhR2T4U
https://www.youtube.com/watch?v=Xnw3Mrm1nGs
https://www.youtube.com/watch?v=_vb2lCx36bA
https://www.youtube.com/watch?v=13O9ZPCnW3c
https://www.youtube.com/watch?v=9CS4jpY-IDI
(...)
```
0

GET https://www.youtube.com/results?search_query=shaun+the+sheep | sed -ne '/<a href="\/watch.*title="/s/.*<a href="$\/watch[^"]*$".* title="$[^"]*$".*/https:\/\/www.youtube.com\1/p' | vlc -

plokij · 2016-10-28 23:55:59 17
Colorized tail using sed

Tails make.out file and pipes it to sed which uses 3 colors: green: percentage (eg: 10%) yellow: warning (case insensitive) red: error (case insensitive)
This is sample output - yours may be different.
0

tail -f ~/make.out | sed -e 's/$...%$/\o033[32m\1\o033[39m/' -e 's/$.*[Ww][Aa][Rr][Nn][Ii][Nn][Gg].*$/\o033[33m\1\o033[39m/' -e 's/$.*[Ee][Rr][Rr][Oo][Rr].*$/\o033[31m\1\o033[39m/'

redowk · 2017-03-06 18:20:36 18
Remove last x lines from file using sed

Removes the last 5 lines from a file using sed
This is sample output - yours may be different.
0

sed -n -e :a -i -e '1,5!{P;N;D;};N;ba' /etc/apt/sources.list

redowk · 2017-03-06 18:22:48 20

Simply clean playlist

Remove all line from a playlist m3u that not finish with MP3 or mp3 or wma or flac creating a new clean plalist m3u Show Sample Output

sed -e '/MP3$\|mp3$\|wma$\|flac$/!d' <filename_source> > <filename_destination>

vinabb · 2017-03-21 22:14:08 17

Pretty-print user/group info for a given user
This is sample output - yours may be different.
0

id <user_name> | sed 's/,/\n/g' | tr ' ' '\n'

gadjodilo · 2017-12-24 02:33:40 25
Find German synonyms using OpenThesaurus

A function for retrieving and displaying a list of synonyms for a German word or phrase. Show Sample Output
This is sample output - yours may be different.
```
$ desyno Läuterung
Aufbesserung, Aufwertung, Besserung, Läuterung, Melioration, Optimierung, Verbesserung, Verfeinerung, Vervollkommnung, Katharsis, Klärung, Läuterung, Reinigung
$ desyno linux
GNU/Linux, Linux
```
0

desyno(){ wget -q -O- https://www.openthesaurus.de/synonyme/search\?q\="$*"\&format\=text/xml | sed 's/>/>\n/g' | grep "<term term=" | cut -d \' -f 2 | paste -s -d , | sed 's/,/, /g' | fold -s -w $(tput cols); }

lordtoran · 2019-02-09 05:06:42 32
Remove scripts tags from *.html and *.htm files under the current directory
This is sample output - yours may be different.
0

find ./ -type f $ -iname '*.html' -or -iname '*.htm' $ -exec sed -i '/<script/,/<\/script>/d' '{}' \;

mikhail · 2019-05-10 23:27:12 152
PHP7 - Fix incompatibility errors like: Parse error: syntax error, unexpected new (T_NEW) in file.php on line...

New objects cannot be assigned by reference. The result of the new statement can no longer be assigned to a variable by reference. Check the "Sample Output" example ("sample.php"). The Output of the above example in PHP 5: "Deprecated: Assigning the return value of new by reference is deprecated in sample.php on line 3". Output of the above example in PHP 7: "Parse error: syntax error, unexpected 'new' (T_NEW) in sample.php on line 3. Show Sample Output
This is sample output - yours may be different.
```
echo -e "<?php\nclass C {}\n\$c =& new C;\n?>" > sample.php
cat sample.php
<?php
class C {}
$c =& new C;
?>
busybox sh -c 'find "$(realpath ./)" -type f $ -iname "*.php" -or -iname "*.inc" $ -exec sed -i -r "s~=[[:space:]]*&[[:space:]]*new[[:space:]]+~= new ~gi" {} \; '
cat sample.php
<?php
class C {}
$c  = new C;
?>
```
0

find "$(realpath ./)" -type f $ -iname "*.php" -or -iname "*.inc" $ -exec sed -i -r "s~=[[:space:]]*&[[:space:]]*new[[:space:]]+~= new ~gi" {} \;

mikhail · 2019-05-29 18:20:45 38
Remove abstracts from a bibtex file

Remove lines from a bibtex file that have abstracts in them.
This is sample output - yours may be different.
0

sed '/^\s*abstract\s*=\s*{[^\n]*},$/ d' input.bib > output.bib

mirams · 2019-08-01 13:59:38 63
Remove all the characters after last space per line including it

It his example removes ' dog', last space included. Show Sample Output
This is sample output - yours may be different.
```
The quick brown fox jumps over the lazy
```
0

echo 'The quick brown fox jumps over the lazy dog' | sed 's|$.*$ .*|\1|'

bugmenot · 2021-07-15 20:01:32 172
Enlarge KiCad PCB footprint pads to 2mm for all smaller pads
This is sample output - yours may be different.
0

sed -E -i.bak 's/(^ +$pad.*\(size)([^$]+)(\) $drill)([^$]+)(.*)/\1 2 2\3 1\5/g' SOURCE_FILE.kicad_pcb

alikhalil · 2022-02-12 19:25:14 336
simulates the DOS tree command that you might be missing on your Mac or Linux box

NOT MINE! Taken from hackzine.com blog. It creates a tree-style output of all the (sub)folders and (sub)files from the current folder and down(deeper) Quoting some of hackzine's words "Murphy Mac sent us a link to a handy find/sed command that simulates the DOS tree command that you might be missing on your Mac or Linux box. [..split...] Like most things I've seen sed do, it does quite a bit in a single line of code and is completely impossible to read. Sure it's just a couple of substitutions, but like a jack in the box, it remains a surprise every time I run it." Show Sample Output
This is sample output - yours may be different.
```
$ cd amsn_received
$ find . -print | sed -e 's;[^/]*/;|____;g;s;____|; |;g'
.
|____amsn_received
| |____screenshot1.png
| |____DSCF1171.JPG
| |____DSCF1202.JPG
| |____DSC00887.jpg
| |____DSC00953.jpg
| |____DSC00595.JPG
| |____at92A3.tmp.jpg
| |____ReadMe 1.pdf
| |____Screenshot.png
| |____cpuz.html
```
-1

find . -print | sed -e 's;[^/]*/;|____;g;s;____|; |;g'

JesusSuperstar · 2009-03-12 22:25:26 8
‹ First < 10 11 12 13 14 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

write the output of a command to /var/log/user.log... each line will contain $USER, making this easy to grep for.

This command is useful if you want to copy the output of a series of commands to a file, for example if you want to pastebin the output from 'uname -a', 'lspci -vvv' and 'lsmod' for video driver trouble-shooting on your favorite Linux forum. 'log' takes all the following arguments as a command to execute, with STDOUT sent to /var/log/user.log. The command is echoed to the log before it is executed. The advantages of using logger (as opposed to appending output from commands to a file) are 1) commands are always appended to the logs... you don't have to worry about clobbering your log file accidentally by using '>' rather than '>>' 2) logs are automatically cleaned up by logrotate. The following functions allow you to mark the start and end of a section of /var/log/user.log. $ startlog() { export LOGMARK=$(date +%Y.%m.%d_%H:%M:%S); echo "$LOGMARK.START" | logger -t $USER; } then $ endlog() { echo "$LOGMARK.END" | logger -t $USER; } printlog will print all lines between $LOGMARK.START and $LOGMARK.END, removing everything that is prepended to each line by logger. $ printlog() { sudo sed -n -e "/$LOGMARK.START/,/$LOGMARK.END/p" /var/log/user.log| sed "s/.*$USER: //"; } The following command should dump just about all the information that you could possibly want about your linux configuration into the clipboard. $ startlog; for cmd in 'uname -a' 'cat /etc/issue' 'dmesg' 'lsusb' 'lspci' 'sudo lshw' 'lsmod'; do log $cmd; done; endlog; printlog | xsel --clipboard This is ready for a trip to http://pastebin.com/, and you don't have to worry about leaving temporary files lying around cluttering up $HOME. Caveats: I'm sure that startlog, endlog, and printlog could use some cleanup and error checking... there are unchecked dependencies between printlog and endlog, as well as between endlog and startlog. It might be useful for 'log' to send stderr to logger as well.

Rename files in batch

Working random fact generator

Though without infinite time and knowledge of how the site will be designed in the future this may stop working, it still will serve as a simple straight forward starting point. This uses the observation that the only item marked as strong on the page is the single logical line that includes the italicized fact. If future revisions of the page show failure, or intermittent failure, one may simply alter the above to read. $ wget randomfunfacts.com -O - 2>/dev/null | tee lastfact | grep \ | sed "s;^.*$.*$.*$;\1;" The file lastfact, can then be examined whenever the command fails.

Url Encode

It only encodes non-Basic-ASCII chars, as they are the only ones not well readed by UTF-8 and ISO-8859-1 (latin-1). It converts all * C3 X (some latin symbols like ASCII-extended ones) and * C2 X (some punctuation symbols like inverted exclamation) ...UTF-8 double byte symbols to escaped form that every parser understands to form the URLs. I didn't encode spaces and the rest of basic punctuation, but supposedly, space and others are coded as \x20, for example, in UTF-8, latin-1 and Windows-cp1252.... so its read perfectly. Please feel free to correct, the application to which I designe that function works as expected with my assumption. Note: I specify a w=999, I didn't find a flag to put unlimited value. I just suppose very improbable surpass the de-facto 255 (* 3 byte max) = 765 bytes length of URL

The BOFH Excuse Server

Put a console clock in top right corner

Gives not only date but also some interesting status about the System

find previously entered commands (requires configuring .inputrc)

[Click the "show sample output" link to see how to use this keystroke.] Meta-p is one of my all time most used and most loved features of working at the command line. It's also one that surprisingly few people know about. To use it with bash (actually in any readline application), you'll need to add a couple lines to your .inputrc then have bash reread the .inputrc using the bind command: $ echo '"\en": history-search-forward' >> ~/.inputrc $ echo '"\ep": history-search-backward' >> ~/.inputrc $ bind -f ~/.inputrc I first learned about this feature in tcsh. When I switched over to bash about fifteen years ago, I had assumed I'd prefer ^R to search in reverse. Intuitively ^R seemed better since you could search for an argument instead of a command. I think that, like using a microkernel for the Hurd, it sounded so obviously right fifteen years ago, but that was only because the older way had benefits we hadn't known about. I think many of you who use the command line as much as I do know that we can just be thinking about what results we want and our fingers will start typing the commands needed. I assume it's some sort of parallel processing going on with the linguistic part of the brain. Unfortunately, that parallelism doesn't seem to work (at least for me) with searching the history. I realize I can save myself typing using the history shortly after my fingers have already started "speaking". But, when I hit ^R in Bash, everything I've already typed gets ignored and I have to stop and think again about what I was doing. It's a small bump in the road but it can be annoying, especially for long-time command line users. Usually M-p is exactly what I need to save myself time and trouble. If you use the command line a lot, please give Meta-p a try. You may be surprised how it frees your brain to process more smoothly in parallel. (Or maybe it won't. Post here and let me know either way. ☺)

show the real times iso of epochs for a given column

When you have one of those (log)files that only has epoch for time (since no one will ever look at them as a date) this is a way to get the human readable date/time and do further inspection. Mostly perl-fu :-/

Streaming HTML5 video to icecast server using dvgrab, ffmpeg2theora and oggfwd

Streaming HTML5 compatible video (Ogg Theora video with Vorbis sound) to an Icecast server using dvgrab, ffmpeg2theora and oggfwd. In this example I'm merging stereo sound to mono (-c 1), saving the original dv for later higher quality on-demand video (tee dvstream.dv), saving the theora stream for immediate on-demand video, and publishing the stream in Xiph's stream directory (-p and the name and description). The URL of the video will be (depending on your server) http://my.icecastserver.com/stream.ogv which will play in newer Firefox, Chrome and Opera web browsers. Cortado (a Java player) can easily be used for IE. Note also that I'm using port 80, which is not the default port for Icecast, this is to avoid restrictive firewalls. Also note that ffmpeg2theora 0.25 and will heed the bitrates much better than former versions because of using libtheora 1.1 or newer.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged sed

Commands tagged sed (376) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged sed (376)

sorted by