Commands using sed sorted by votes

Commands using sed (1,319)

sorted by

Find 20 most frequently-used shell commands from (bash history)
This is sample output - yours may be different.
0

tr "\|\;" "\n" < ~/.bash_history | sed -e "s/^ //g" | cut -d " " -f 1 | sort | uniq -c | sort -rn | head -20

turrtle13 · 2016-07-01 19:27:12 10
4chan image batch downloader

Replace thread_link with the link of the thread you want to download images of.
This is sample output - yours may be different.
0

wget thread_link -qO - | sed 's/\ /\n/g' | grep -e png -e jpg | grep href | sed 's/href\=\"/http:/g' | sed 's/"//g' | uniq | xargs wget

hztrance · 2016-07-16 20:43:33 12
Pretty print a simple csv in the command line +header coloring +multiple files support
This is sample output - yours may be different.
0

function csv() { C=`echo -e '\e[0;31m'`; N=`echo -e '\033[0m'`; for i in $@; do column -s, -t < $i | sed "1 s|^$.*$$|$C\1$N|gi"; done; }; csv test*.csv

oso · 2016-07-24 21:14:52 17
sort of automaticly install gems that are depend

When bundle install sucks ...This runs isuckat_ruby.rb and when stderror matches find gem ' it will gem install what ever is missing ... Show Sample Output
This is sample output - yours may be different.
```
Could not find gem 'metasploit-payloads (= 1.1.13) ruby', which is required by gem 'metasploit-framework (>= 0) ruby', in any of the sources.
```
0

gem install `ruby ./isuckat_ruby.rb 2>&1 | sed -e 's/.*find gem .//g' -e 's/ .*//g' | head -n 1`

operat0r · 2016-08-03 19:41:27 13
Merge two non-consecutive lines of a file with sed and bash

Using "", which allow bash commands to be interpreted by sed scripts, I've embedded a sed script in another sed substitution, in case, the 4th line of the file at the end of the second one. Show Sample Output
This is sample output - yours may be different.
```
[Desktop Entry]
Name=Sound Type=Application
Terminal=true
Type=Application
Exec=
Hidden=true
mpv /home/pibarnas/Sounds/loginsound.wav
```
0

$ sed "2s/$/ $(sed -n '4p' sound.desktop)/" sound.desktop

pibarnas · 2016-08-23 02:50:31 14
Watch PHP log, without knowing it's location (gets from php.ini)

Runs "php -i", filter the error_log location, then watches it using "tail"
This is sample output - yours may be different.
0

tail -v -f $(php -i | grep "^[ \t]*error_log" | awk -F"=>" '{ print $2; }' | sed 's/^[ ]*//g')

paulera · 2016-08-31 12:13:31 25
Purge configuration files of removed packages on debian based systems

Use dpkg-query to query packages.
This is sample output - yours may be different.
0

dpkg-query -W -f '${binary:Package} ${Status}\n' '*' |sed -n 's/ deinstall ok config-files//p'|xargs dpkg --purge

ceving · 2016-09-06 11:43:04 15
Remove color codes (special characters) with sed

... building upon Zhoul's EXCELLENT example... my 'expect' output had additional garbage. This script also: * converts the ESC-H sequence (reposition cursor) to new-line characters * removes BACKSPACES and BELLS * removes trailing spaces * removes NON-ASCII characters * and consolidates redundant lines (my input had multiple blank lines (100s))
This is sample output - yours may be different.
0

cat $* | sed -e "s,\x1B\[[0-9;]*[H],+++NEWLINE+++,g" -e "s,\x1B\[[0-9;]*[a-zA-Z],,g" -e "s,+++NEWLINE+++,\x0A,g" -e "s,\x07,,g" -e "s,\x08,,g" | sed -e "s, *$,,g" -e "s,[^ -~],,g" | uniq

quirkasaurus · 2016-09-09 15:32:32 18
Extract binary from .text section (shellcode)

Extracts the binary from the .text section and escapes it. This puts it in a form ready to use in a program. Show Sample Output
This is sample output - yours may be different.
```
\x31\xd2\x31\xc9\xbb\xb4\x90\x04\x08\xb0\x05\xcd\x80\xb2\x10\xb9\xc4\x90\x04\x08\x89\xc3\xb0\x03\xcd\x80\x89\xdf\xb2\x10\xb9\xc4\x90\x04\x08\xb3\x01\xb0\x04\xcd\x80\x89\xfb\xb0\x06\xcd\x80\xb0\x01\xcd\x80
```
0

objdump -d -j .text ExeHere | grep -e '^ ' | tr '[[:space:]]' '\n' | egrep '^[[:alnum:]]{2}$' | xargs | sed 's/ /\\x/g' | sed -e 's/^/\\x/g'

keyboardsage · 2016-09-11 07:15:00 16

remove the IP from proxy reverse server and parentesis from real IP obtained from X-forwarder_IP Show Sample Output

tr -s ' ' | cut -d' ' -f2- |cut -c2- |sed 's/)//1'

horaciod · 2016-09-12 19:25:23 16

Openstack, trigger ceilometer alarm webhook

Grab the multiline webhook URL definition from alarm-show. Basically it parse the following into an URL only: ```root@ctl01:/home/hombre# ceilometer alarm-show 1383a6be-fb73-4955-9991-8d65a8a23d60 +---------------------------+--------------------------------------------------------------------------+ | Property | Value | +---------------------------+--------------------------------------------------------------------------+ | alarm_actions | [u'http://10.40.50.20:8000/v1/signal/arn%3Aopenstack%3Aheat%3A%3A3d6118 | | | cc789c4db3b06fb3a382494b67%3Astacks%2Fhombre-V2R1%2Fd189e704-4f99-467 | | | 5-9ec2-eaadkc0ae8af5%2Fresources%2Fweb_server_scaleup_policy?Timestamp=20 | | | 16-10-03T14%3A05%3A27Z&SignatureMethod=HmacSHA256&AWSAccessKeyId=09sdkd4e | | | d854347189383aba11d6353c6&SignatureVersion=2&Signature=MXxlKLZ%2BT4y4y%2 | | | BOuuAmxTLIVQ9ONKx2jKSZKHYIy83Q%3D'] | ```
This is sample output - yours may be different.
0

curl -X POST -i `ceilometer alarm-show 1383a6be-fb73-4955-9991-8d65a8a23d60 | tr '\n' ' ' | sed -e 's/.*\[$.*$\].*/\1/' -e 's/[| ]*//g' -e 's/^u//' -e "s:'::g"`

epcim · 2016-10-03 15:15:21 17
Gets shellcode opcodes from binary file using objdump

Seems to work on Ubuntu 14.02 LTS Show Sample Output
This is sample output - yours may be different.
```
"\x31\xc0\xb0\x04\x31\xdb\xb3\x01\xeb\x11\x59\x31\xd2\xb2\x0e\xcd\x80\x31"
```
0

objdump -s ./HelloWorld | grep -v '^ [0-9a-f][0-9a-f][0-9a-f][0-9a-f] \b' | grep -v 'Contents' | grep -v './' | cut -d' ' -f 3-6| sed 's/ //g' | sed '/./!d' | tr -d '\n'| sed 's/.\{2\}/&\\x/g' | sed 's/^/\\x/'|sed 's/..$//'|sed 's/^/"/;s/$/"/g'

mark20 · 2016-10-05 23:31:05 17
Open VLC player with search results from YouTube

Search a string in YouTube using GET command, parse the response with a suitable replace pattern and pipe its result to VLC Show Sample Output
This is sample output - yours may be different.
```
https://www.youtube.com/watch?v=bg6vYLs5DKg
https://www.youtube.com/watch?v=NsWd15iLDHs
https://www.youtube.com/watch?v=aw088NHSjdA
https://www.youtube.com/watch?v=6VmmvhR2T4U
https://www.youtube.com/watch?v=Xnw3Mrm1nGs
https://www.youtube.com/watch?v=_vb2lCx36bA
https://www.youtube.com/watch?v=13O9ZPCnW3c
https://www.youtube.com/watch?v=9CS4jpY-IDI
(...)
```
0

GET https://www.youtube.com/results?search_query=shaun+the+sheep | sed -ne '/<a href="\/watch.*title="/s/.*<a href="$\/watch[^"]*$".* title="$[^"]*$".*/https:\/\/www.youtube.com\1/p' | vlc -

plokij · 2016-10-28 23:55:59 17
Get newest Nmap source code tarball URL.
This is sample output - yours may be different.
0

curl -Ls https://nmap.org/dist/ | sed -En '/nmap.*tgz/s@^.*href="([^"]+)".*$@https://nmap.org/dist/\1@p' | tail -n1

akanehara · 2017-02-10 05:46:27 20
Get your internal IP address and nothing but your internal IP address
This is sample output - yours may be different.
0

ifconfig eth0 | sed -n 's/.*inet addr:$[0-9\.]*$.*/\1/p'

cycne · 2017-02-18 15:53:37 18
Execute the last line of output from the previous command

alex@alex-box:~$ sl The program 'sl' is currently not installed. You can install it by typing: sudo apt-get install sl alex@alex-box:~$ dolast Reading package lists... Done Building dependency tree Reading state information... Done The following NEW packages will be installed: sl 0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
This is sample output - yours may be different.
0

alias dolast='$( $(history 2| head -n 1| sed "s/.* //") 2>&1 | tail -n 1)'

aheinous · 2017-02-25 01:26:49 19
Resume incomplete youtube-dl video files

Resume incomplete youtube-dl video files. Assuming mp4 format here.
This is sample output - yours may be different.
0

ls *.part | sed 's/^.*-$.\{11,11\}$\.mp4\.part$/\1/g' - | youtube-dl -i -f mp4 -a -

agp · 2017-02-28 23:31:55 21
Colorized tail using sed

Tails make.out file and pipes it to sed which uses 3 colors: green: percentage (eg: 10%) yellow: warning (case insensitive) red: error (case insensitive)
This is sample output - yours may be different.
0

tail -f ~/make.out | sed -e 's/$...%$/\o033[32m\1\o033[39m/' -e 's/$.*[Ww][Aa][Rr][Nn][Ii][Nn][Gg].*$/\o033[33m\1\o033[39m/' -e 's/$.*[Ee][Rr][Rr][Oo][Rr].*$/\o033[31m\1\o033[39m/'

redowk · 2017-03-06 18:20:36 18
Remove last x lines from file using sed

Removes the last 5 lines from a file using sed
This is sample output - yours may be different.
0

sed -n -e :a -i -e '1,5!{P;N;D;};N;ba' /etc/apt/sources.list

redowk · 2017-03-06 18:22:48 20

Simply clean playlist

Remove all line from a playlist m3u that not finish with MP3 or mp3 or wma or flac creating a new clean plalist m3u Show Sample Output

sed -e '/MP3$\|mp3$\|wma$\|flac$/!d' <filename_source> > <filename_destination>

vinabb · 2017-03-21 22:14:08 17

the executable that started the currently running oracle databases and the ORACLE_HOME relative to each

Show the executable that spawned the process and show the PID and ORACLE_HOME relative to the environment within which the process is running.
This is sample output - yours may be different.
0

ps -ef | grep [p]mon | awk '{print $2}' | xargs -I {} ps eww {} | awk '{print $1 " " $5 " " $6 " " $0}' | sed 's/$S*$ $S*$ .*ORACLE_HOME/\1 \2/g' | cut -f1,2,3 -d" "

Enirevlow · 2017-03-24 18:45:40 18
Do mathematical operation on every line of a given file for the first value found to be replaced (other lines stay untouched)

The given file may contain any kind of characters. This is compatible for most simple mathematical operation. For the first number found, it will be replaced by the result of a factor operation of 1000. To change the filename or multiplactor or number regular expression, change the first fixed values. Show Sample Output
This is sample output - yours may be different.
```
For a given filename such as test.csv, a new filename new_test.csv will be created containing the new values after the math operation.
command source: cat test.csv
command output: cat new_test.csv
```
0

n=1000;f="test.csv";r='([0-9]+.{0,1}[0-9]*)';echo -n "" > new_${f};cat $f | while read l;do val=`echo $l | egrep -o $r` ; if [ ! -z $val ];then newval=`echo $val \* $n | bc -l`;l=`echo $l | sed "s/$val/$newval/"`;fi;echo $l >> new_${f};unset val;done

s333 · 2017-04-26 18:04:07 19
Recursive convert all print statements in py files from python2 to python3 form

Use find . -iname "*.py" -type f -print0 | xargs -0 sed -ne 's/^$[ \t]*$print $.*$$/\1print(\2)/p' to see what would be changed.
This is sample output - yours may be different.
0

find . -iname "*.py" -type f -print0 | xargs -0 sed -i 's/^$[ \t]*$print $.*$$/\1print(\2)/g'

sleepprogger · 2017-05-22 22:39:58 16
find out true (according to xrandr) monitor DPI

see summary. if you want to set dpi right away try this: xrandr --query | sed -n 's@$[A-Z0-1-]*$.* $.*$x$.*$+.*+.* $[0-9]\+$mm x $[0-9]\+$mm@"--output \1 --dpi ";(\2/\4+\3/\5)*12.7@p;'|bc -l|xargs -L1 xrandr all syntax should be POSIX compliant. Show Sample Output
This is sample output - yours may be different.
```
LVDS-1: 100.96760151825521147108
HDMI-1: 92.60728755320785681297
```
0

xrandr --query | sed -n 's@$[A-Z0-1-]*$.* $.*$x$.*$+.*+.* $[0-9]\+$mm x $[0-9]\+$mm@"\1: ";(\2/\4+\3/\5)*12.7@p;'|bc -l

hydrogenization · 2017-06-23 03:44:40 16
the executable that started the currently running oracle databases and the ORACLE_HOME relative to each
This is sample output - yours may be different.
0

ps -ef |grep oracle |grep pmon |awk '{print $2}' |xargs -I {} ps eww {} |grep pmon |grep -v grep |awk '{print $5 " " $6 " " $0}' |sed 's/$S*$ $S*$ .*ORACLE_HOME/\1 \2/g' |cut -f1,2,3 -d" " 2010-03-23 20:36:59 User:

Izzamar075 · 2017-07-21 23:44:43 21
‹ First < 39 40 41 42 43 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Compare two directories

Output of this command is the difference of recursive file lists in two directories (very quick!). To view differences in content of files too, use the command submitted by mariusbutuc (very slow!): $ diff -rq path_to_dir1 path_to_dir2

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Lets Tux say the random fact. [add it to .bashrc to see it in new terminal window]

Harder, Faster, Stronger SSH clients

We force IPv4, compress the stream, specify the cypher stream to be Blowfish. I suppose you could use aes256-ctr as well for cypher spec. I'm of course leaving out things like master control sessions and such as that may not be available on your shell although that would speed things up as well.

list files recursively by size

find out how much space are occuipied by files smaller than 1024K (sic) - improved

The original didn't use -print0 which fails on weird file names eg with spaces. The original parsed the output of 'ls -l' which is always a bad idea.

FizzBuzz in one line of Bash

The (in)famous "FizzBuzz" programming challenge, answered in a single line of Bash code. The "|column" part at the end merely formats the output a bit, so if "column" is not installed on your machine you can simply omit that part. Without "|column", the solution only uses 75 characters. The version below is expanded to multiple lines, with comments added. for i in {1..100} # Use i to loop from "1" to "100", inclusive. do ((i % 3)) && # If i is not divisible by 3... x= || # ...blank out x (yes, "x= " does that). Otherwise,... x=Fizz # ...set x to the string "Fizz". ((i % 5)) || # If i is not divisible by 5, skip (there's no "&&")... x+=Buzz # ...Otherwise, append (not set) the string "Buzz" to x. echo ${x:-$i} # Print x unless it is blanked out. Otherwise, print i. done | column # Wrap output into columns (not part of the test).

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

gpg encrypt a file

gpg command to encrypt a file on the command line.

Update pandoc via cabal

An alternative to built-in package manager, keep pandoc in sync with upstream releases.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using sed

Commands using sed (1,319) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using sed (1,319)

sorted by