Commands tagged sed sorted by votes

Commands tagged sed (376)

sorted by

nmap scan hosts for IP, MAC Address and device Vendor/Manufacturer

In the field, I needed to script a process to scan a specific vendor devices in the network. With the help of nmap, I got all the devices of that particular vendor, and started a scripted netcat session to download configuration files from a tftp server. This is the nmap loop (part of the script). You can however, add another pipe with grep to filter the vendor/manufacturer devices only. If want to check the whole script, check in http://pastebin.com/ju7h4Xf4 Show Sample Output
This is sample output - yours may be different.
```
10.0.0.1 AA:BB:CC:DD:EE:FF (Vendor)
10.0.0.2 BB:CC:DD:EE:FF:AA (Manufacturer)
10.0.0.3 FF:FF:FF:FF:FF:FF (Unknown)
```
0

nmap -sP 10.0.0.0/8 | grep -v "Host" | tail -n +3 | tr '\n' ' ' | sed 's|Nmap|\nNmap|g' | grep "MAC Address" | cut -d " " -f5,8-15

jaimerosario · 2014-12-26 18:31:53 13
drop first column of output by piping to this

This is the easiest and shortest way :-)
This is sample output - yours may be different.
0

sed 1d

rantanplan · 2015-05-27 09:25:01 9
Evaluate simple formulas in a .csv spreadsheet by converting and piping to the venerable sc.

Requires psc, sed, sc, and cat. Working with csv spreadsheets with formulas in them to evaluate the formulas using sc. View the formulas in a numbered and lettered formated in command line. function sheet () { cat "$1" | sed '1s/^/a,b,c,d,e,f,g,h,j,k,l,m,n,o,p\n/' | column -s , -tn | nl -v 0 ; }
This is sample output - yours may be different.
0

cat FILE.csv |sed -e '1i,,,,,' |sed -e 's/=sum/@sum/g' -e 's/=SUM/@SUM/g' |psc -k -d, |sed -e 's/\"@SUM(/@SUM(/' -e 's/)"/)/' -e '/@SUM/ { s/rightstring/let/; }' -e '/= "=/s/rightstring/let/' -e '/= "=/s/"//g' -e 's/= =/= /g' |sc

eakinc · 2015-07-13 04:11:31 10
Display specific line in a text file

use this command to quickly display specific line. Show Sample Output
This is sample output - yours may be different.
```
seq 100 | sed "55q;d"
55
```
0

sed "<line no>q;d"

s_prapat · 2015-07-17 14:10:51 11
Printout a list of field numbers from a CSV file with headers as first line.

Take the header line from a comma-delimited CSV file and enumerate the fields. . First sed replaces all commas with newlines s/,/\n/g Then sed quits (q) after the first line. Finally, nl numbers all the lines Show Sample Output
This is sample output - yours may be different.
```
$ cat file.csv 
First Name,Family Name,Occupation
Albert,Einstein,Physicist
William,Shakespeare,Writer

$ sed 's/,/\n/g;q' file.csv | nl
     1	First Name
     2	Family Name
     3	Occupation
```
0

sed 's/,/\n/g;q' file.csv | nl

flatcap · 2015-08-26 11:38:56 13
search APT's cache for a regex and let it display name and short description of matches

I personally like it very much and have wrapped it into a function, named "apt-propos" ;), also you can use --names-only option for a sort-of "apt-whatis"
This is sample output - yours may be different.
0

apt-cache search byo | sed "s/^$[[:alnum:]\.-]*$ - /\1=%%%=- /" | column -s '=%%%=' -t

VoidDroid · 2015-10-18 10:55:34 11

Show a git log with offsets relative to HEAD

This is how you can do this without having to use oneline Show Sample Output

git log | nl -w9 -v0 --body-numbering='pcommit\ [0-9a-f]\{40\}' | sed 's/^ \+$[0-9]\+$\s\+/HEAD~\1 /'

guywithnose · 2015-11-23 21:53:33 10

easily strace all your apache *child* processes

On debian parent process is running as root, workers as www-data. You can run strace in backgroud, get its PID, curl your webpage, kill strace and read your stats.
This is sample output - yours may be different.
0

strace -c $(ps -u www-data o pid= | sed 's/^/-p/')

brablc · 2015-11-25 08:10:52 11
Bulk change of mail domains in Rainloop

I had to reconfigure all of my 150 domains to use "localhost" as IMAP/SMTP server instead of mail.[domain]. This little thing did the job in a fraction of a second!
This is sample output - yours may be different.
0

sed -i -E 's/mail\..*/localhost\"/g' *

Blagus · 2016-01-15 14:48:32 10
Display a random man page
This is sample output - yours may be different.
0

man $(ls /bin | shuf -n1)

jubnzv · 2016-06-28 18:34:46 12
Find 20 most frequently-used shell commands from (bash history)
This is sample output - yours may be different.
0

tr "\|\;" "\n" < ~/.bash_history | sed -e "s/^ //g" | cut -d " " -f 1 | sort | uniq -c | sort -rn | head -20

turrtle13 · 2016-07-01 19:27:12 10
sed 's:.*/::'

FQPN - Path = Filename
This is sample output - yours may be different.
0

Print everything after last slash

qdrizh · 2016-08-17 07:10:33 44

remove proxy reverse iP from apache log

remove the IP from proxy reverse server and parentesis from real IP obtained from X-forwarder_IP Show Sample Output

tr -s ' ' | cut -d' ' -f2- |cut -c2- |sed 's/)//1'

horaciod · 2016-09-12 19:25:23 16

Open VLC player with search results from YouTube

Search a string in YouTube using GET command, parse the response with a suitable replace pattern and pipe its result to VLC Show Sample Output
This is sample output - yours may be different.
```
https://www.youtube.com/watch?v=bg6vYLs5DKg
https://www.youtube.com/watch?v=NsWd15iLDHs
https://www.youtube.com/watch?v=aw088NHSjdA
https://www.youtube.com/watch?v=6VmmvhR2T4U
https://www.youtube.com/watch?v=Xnw3Mrm1nGs
https://www.youtube.com/watch?v=_vb2lCx36bA
https://www.youtube.com/watch?v=13O9ZPCnW3c
https://www.youtube.com/watch?v=9CS4jpY-IDI
(...)
```
0

GET https://www.youtube.com/results?search_query=shaun+the+sheep | sed -ne '/<a href="\/watch.*title="/s/.*<a href="$\/watch[^"]*$".* title="$[^"]*$".*/https:\/\/www.youtube.com\1/p' | vlc -

plokij · 2016-10-28 23:55:59 17
Colorized tail using sed

Tails make.out file and pipes it to sed which uses 3 colors: green: percentage (eg: 10%) yellow: warning (case insensitive) red: error (case insensitive)
This is sample output - yours may be different.
0

tail -f ~/make.out | sed -e 's/$...%$/\o033[32m\1\o033[39m/' -e 's/$.*[Ww][Aa][Rr][Nn][Ii][Nn][Gg].*$/\o033[33m\1\o033[39m/' -e 's/$.*[Ee][Rr][Rr][Oo][Rr].*$/\o033[31m\1\o033[39m/'

redowk · 2017-03-06 18:20:36 18
Remove last x lines from file using sed

Removes the last 5 lines from a file using sed
This is sample output - yours may be different.
0

sed -n -e :a -i -e '1,5!{P;N;D;};N;ba' /etc/apt/sources.list

redowk · 2017-03-06 18:22:48 20

Simply clean playlist

Remove all line from a playlist m3u that not finish with MP3 or mp3 or wma or flac creating a new clean plalist m3u Show Sample Output

sed -e '/MP3$\|mp3$\|wma$\|flac$/!d' <filename_source> > <filename_destination>

vinabb · 2017-03-21 22:14:08 17

Pretty-print user/group info for a given user
This is sample output - yours may be different.
0

id <user_name> | sed 's/,/\n/g' | tr ' ' '\n'

gadjodilo · 2017-12-24 02:33:40 25
Find German synonyms using OpenThesaurus

A function for retrieving and displaying a list of synonyms for a German word or phrase. Show Sample Output
This is sample output - yours may be different.
```
$ desyno Läuterung
Aufbesserung, Aufwertung, Besserung, Läuterung, Melioration, Optimierung, Verbesserung, Verfeinerung, Vervollkommnung, Katharsis, Klärung, Läuterung, Reinigung
$ desyno linux
GNU/Linux, Linux
```
0

desyno(){ wget -q -O- https://www.openthesaurus.de/synonyme/search\?q\="$*"\&format\=text/xml | sed 's/>/>\n/g' | grep "<term term=" | cut -d \' -f 2 | paste -s -d , | sed 's/,/, /g' | fold -s -w $(tput cols); }

lordtoran · 2019-02-09 05:06:42 32
Remove scripts tags from *.html and *.htm files under the current directory
This is sample output - yours may be different.
0

find ./ -type f $ -iname '*.html' -or -iname '*.htm' $ -exec sed -i '/<script/,/<\/script>/d' '{}' \;

mikhail · 2019-05-10 23:27:12 152
PHP7 - Fix incompatibility errors like: Parse error: syntax error, unexpected new (T_NEW) in file.php on line...

New objects cannot be assigned by reference. The result of the new statement can no longer be assigned to a variable by reference. Check the "Sample Output" example ("sample.php"). The Output of the above example in PHP 5: "Deprecated: Assigning the return value of new by reference is deprecated in sample.php on line 3". Output of the above example in PHP 7: "Parse error: syntax error, unexpected 'new' (T_NEW) in sample.php on line 3. Show Sample Output
This is sample output - yours may be different.
```
echo -e "<?php\nclass C {}\n\$c =& new C;\n?>" > sample.php
cat sample.php
<?php
class C {}
$c =& new C;
?>
busybox sh -c 'find "$(realpath ./)" -type f $ -iname "*.php" -or -iname "*.inc" $ -exec sed -i -r "s~=[[:space:]]*&[[:space:]]*new[[:space:]]+~= new ~gi" {} \; '
cat sample.php
<?php
class C {}
$c  = new C;
?>
```
0

find "$(realpath ./)" -type f $ -iname "*.php" -or -iname "*.inc" $ -exec sed -i -r "s~=[[:space:]]*&[[:space:]]*new[[:space:]]+~= new ~gi" {} \;

mikhail · 2019-05-29 18:20:45 38
Remove abstracts from a bibtex file

Remove lines from a bibtex file that have abstracts in them.
This is sample output - yours may be different.
0

sed '/^\s*abstract\s*=\s*{[^\n]*},$/ d' input.bib > output.bib

mirams · 2019-08-01 13:59:38 63
Remove all the characters after last space per line including it

It his example removes ' dog', last space included. Show Sample Output
This is sample output - yours may be different.
```
The quick brown fox jumps over the lazy
```
0

echo 'The quick brown fox jumps over the lazy dog' | sed 's|$.*$ .*|\1|'

bugmenot · 2021-07-15 20:01:32 172
Enlarge KiCad PCB footprint pads to 2mm for all smaller pads
This is sample output - yours may be different.
0

sed -E -i.bak 's/(^ +$pad.*\(size)([^$]+)(\) $drill)([^$]+)(.*)/\1 2 2\3 1\5/g' SOURCE_FILE.kicad_pcb

alikhalil · 2022-02-12 19:25:14 336
simulates the DOS tree command that you might be missing on your Mac or Linux box

NOT MINE! Taken from hackzine.com blog. It creates a tree-style output of all the (sub)folders and (sub)files from the current folder and down(deeper) Quoting some of hackzine's words "Murphy Mac sent us a link to a handy find/sed command that simulates the DOS tree command that you might be missing on your Mac or Linux box. [..split...] Like most things I've seen sed do, it does quite a bit in a single line of code and is completely impossible to read. Sure it's just a couple of substitutions, but like a jack in the box, it remains a surprise every time I run it." Show Sample Output
This is sample output - yours may be different.
```
$ cd amsn_received
$ find . -print | sed -e 's;[^/]*/;|____;g;s;____|; |;g'
.
|____amsn_received
| |____screenshot1.png
| |____DSCF1171.JPG
| |____DSCF1202.JPG
| |____DSC00887.jpg
| |____DSC00953.jpg
| |____DSC00595.JPG
| |____at92A3.tmp.jpg
| |____ReadMe 1.pdf
| |____Screenshot.png
| |____cpuz.html
```
-1

find . -print | sed -e 's;[^/]*/;|____;g;s;____|; |;g'

JesusSuperstar · 2009-03-12 22:25:26 8
‹ First < 10 11 12 13 14 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Resize an image to at least a specific resolution

This command will resize an image (keeping the aspect ratio) to a specific resolution, meaning the resulting image will never be smaller than this resolution. For example, if we have a 2048x1000 image, the output would be 1229x600, not 1024x600 or 1024x500. Same thing for the height, if the image is 2000x1200, the output would be 1024x614.

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Change mysql prompt to be more verbose

You can put this into your shell sourced file like .bashrc or .zshrc to have a different mysql prompt. See http://dev.mysql.com/doc/refman/5.1/de/mysql-commands.html for more informations. Beware that currently with mysql 5.5 the seconds are buggy and won't be displayed if you put this into a .cnf file. With the enironment variable this will work.

copy string to clipboard

Copy the current path. Use -selection clipboard to copy the string to clipboard.

Write comments to your history.

A null operation with the name 'comment', allowing comments to be written to HISTFILE. Prepending '#' to a command will *not* write the command to the history file, although it will be available for the current session, thus '#' is not useful for keeping track of comments past the current session.

Search commandlinefu from the CLI

html2text: http://www.mbayer.de/html2text/

grep for minus (-) sign

Use flag "--" to stop switch parsing

Get your Firefox bookmarks

Extracts yours bookmarks out of sqlite with the format: dateAdded|url

Look up a unicode character by name

[Update! Thanks to a tip from ioggstream, I've fixed both of the bugs mentioned below.] You, yes, 𝙔𝙊𝙐, can be the terror of the Internet! Why use normal, boring bullet points in your text, when you could use a ROTATED HEAVY BLACK HEART BULLET (❥)!? (Which would also be an awesome band name, by the way). This script makes it easy to find unusual characters from the command line. You can then cut and paste them or, if you're using a GTK application, type Control+Shift+U followed by the code point number (e.g., 2765) and then a SPACE. USAGE: Put this script in a file (I called mine "ugrep") and make it executable. Run it from the command line like so, $ ugrep heart The output will look like this, ☙ U+2619 REVERSED ROTATED FLORAL HEART BULLET ♡ U+2661 WHITE HEART SUIT ♥ U+2665 BLACK HEART SUIT ❣ U+2763 HEAVY HEART EXCLAMATION MARK ORNAMENT ❤ U+2764 HEAVY BLACK HEART ❥ U+2765 ROTATED HEAVY BLACK HEART BULLET ❦ U+2766 FLORAL HEART ❧ U+2767 ROTATED FLORAL HEART BULLET ⺖ U+2E96 CJK RADICAL HEART ONE ⺗ U+2E97 CJK RADICAL HEART TWO ⼼ U+2F3C KANGXI RADICAL HEART You can, of course, use regular expressions. For example, if you are looking for the "pi" symbol, you could do this: $ ugrep '\bpi\b' REQUIREMENTS: Although this is written in Bash, it assumes you have Perl installed because it greps through the Perl Unicode character name module (/usr/lib/perl5/Unicode/CharName.pm). Note that it would not have made more sense to write this in Perl, since the CharName.pm module doesn't actually include a subroutine for looking up a character based on the description. (Weird.) BUGS: In order to fit this script in the commandlinefu limits, a couple bugs were added. ① Astral characters beyond the BMP (basic multilingual plane) are not displayed correctly, but see below. ② Perl code from the perl module being grepped is sometimes extraneously matched. MISFEATURES: Bash's printf cannot, given a Unicode codepoint, print the resulting character to the terminal. GNU's coreutils printf (usually "/usr/bin/printf") can do so, but it is brokenly pedantic about how many hexadecimal digits follow the escape sequence and will actually die with an error if you give the wrong number. This is especially annoying since Unicode code points are usually variable length with implied leading zeros. The CharNames.pm file represents BMP characters as 4 hexits, but astral characters as 5. In the actual version of this script that I use, I've kludged around this misfeature by zero-padding to 8 hexits like so, $ /usr/bin/printf "\U$(printf "%08x" 0x$hex)" TIP 1: The author recommends "xsel" for command line cut-and-paste. For example, $ ugrep biohazard | xsel TIP 2: In Emacs, instead of running this command in a subshell, you can type Unicode code points directly by pressing Control-Q first, but you'll likely want to change the default input from octal to hexadecimal. (setq read-quoted-char-radix 16). TIP 3: Of course, if you're using X, and you want to type one of the more common unusual characters, it's easiest of all to do it with your Compose (aka Multi) key. For example, hitting [Compose] <3 types ♥.

Parse YouTube url (get youtube video id)

url can be like any one of followings: $url="MejbOFk7H6c" $url="http://youtu.be/MejbOFk7H6c" $url="https://youtube.com/watch?feature=player_embedded&v=MejbOFk7H6c#t" $url="//www.youtube.com/v/MejbOFk7H6c?hl=ru_RU&version=3&rel=0" $url="http://www.youtube.com/embed/MejbOFk7H6c?feature=player_embedded" If url mismatching, whole url will be returned.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged sed

Commands tagged sed (376) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged sed (376)

sorted by