Commands using sed sorted by votes

Commands using sed (1,319)

sorted by

Find 20 most frequently-used shell commands from (bash history)
This is sample output - yours may be different.
0

tr "\|\;" "\n" < ~/.bash_history | sed -e "s/^ //g" | cut -d " " -f 1 | sort | uniq -c | sort -rn | head -20

turrtle13 · 2016-07-01 19:27:12 10
4chan image batch downloader

Replace thread_link with the link of the thread you want to download images of.
This is sample output - yours may be different.
0

wget thread_link -qO - | sed 's/\ /\n/g' | grep -e png -e jpg | grep href | sed 's/href\=\"/http:/g' | sed 's/"//g' | uniq | xargs wget

hztrance · 2016-07-16 20:43:33 12
Pretty print a simple csv in the command line +header coloring +multiple files support
This is sample output - yours may be different.
0

function csv() { C=`echo -e '\e[0;31m'`; N=`echo -e '\033[0m'`; for i in $@; do column -s, -t < $i | sed "1 s|^$.*$$|$C\1$N|gi"; done; }; csv test*.csv

oso · 2016-07-24 21:14:52 17
sort of automaticly install gems that are depend

When bundle install sucks ...This runs isuckat_ruby.rb and when stderror matches find gem ' it will gem install what ever is missing ... Show Sample Output
This is sample output - yours may be different.
```
Could not find gem 'metasploit-payloads (= 1.1.13) ruby', which is required by gem 'metasploit-framework (>= 0) ruby', in any of the sources.
```
0

gem install `ruby ./isuckat_ruby.rb 2>&1 | sed -e 's/.*find gem .//g' -e 's/ .*//g' | head -n 1`

operat0r · 2016-08-03 19:41:27 13
Merge two non-consecutive lines of a file with sed and bash

Using "", which allow bash commands to be interpreted by sed scripts, I've embedded a sed script in another sed substitution, in case, the 4th line of the file at the end of the second one. Show Sample Output
This is sample output - yours may be different.
```
[Desktop Entry]
Name=Sound Type=Application
Terminal=true
Type=Application
Exec=
Hidden=true
mpv /home/pibarnas/Sounds/loginsound.wav
```
0

$ sed "2s/$/ $(sed -n '4p' sound.desktop)/" sound.desktop

pibarnas · 2016-08-23 02:50:31 14
Watch PHP log, without knowing it's location (gets from php.ini)

Runs "php -i", filter the error_log location, then watches it using "tail"
This is sample output - yours may be different.
0

tail -v -f $(php -i | grep "^[ \t]*error_log" | awk -F"=>" '{ print $2; }' | sed 's/^[ ]*//g')

paulera · 2016-08-31 12:13:31 25
Purge configuration files of removed packages on debian based systems

Use dpkg-query to query packages.
This is sample output - yours may be different.
0

dpkg-query -W -f '${binary:Package} ${Status}\n' '*' |sed -n 's/ deinstall ok config-files//p'|xargs dpkg --purge

ceving · 2016-09-06 11:43:04 15
Remove color codes (special characters) with sed

... building upon Zhoul's EXCELLENT example... my 'expect' output had additional garbage. This script also: * converts the ESC-H sequence (reposition cursor) to new-line characters * removes BACKSPACES and BELLS * removes trailing spaces * removes NON-ASCII characters * and consolidates redundant lines (my input had multiple blank lines (100s))
This is sample output - yours may be different.
0

cat $* | sed -e "s,\x1B\[[0-9;]*[H],+++NEWLINE+++,g" -e "s,\x1B\[[0-9;]*[a-zA-Z],,g" -e "s,+++NEWLINE+++,\x0A,g" -e "s,\x07,,g" -e "s,\x08,,g" | sed -e "s, *$,,g" -e "s,[^ -~],,g" | uniq

quirkasaurus · 2016-09-09 15:32:32 18
Extract binary from .text section (shellcode)

Extracts the binary from the .text section and escapes it. This puts it in a form ready to use in a program. Show Sample Output
This is sample output - yours may be different.
```
\x31\xd2\x31\xc9\xbb\xb4\x90\x04\x08\xb0\x05\xcd\x80\xb2\x10\xb9\xc4\x90\x04\x08\x89\xc3\xb0\x03\xcd\x80\x89\xdf\xb2\x10\xb9\xc4\x90\x04\x08\xb3\x01\xb0\x04\xcd\x80\x89\xfb\xb0\x06\xcd\x80\xb0\x01\xcd\x80
```
0

objdump -d -j .text ExeHere | grep -e '^ ' | tr '[[:space:]]' '\n' | egrep '^[[:alnum:]]{2}$' | xargs | sed 's/ /\\x/g' | sed -e 's/^/\\x/g'

keyboardsage · 2016-09-11 07:15:00 16

remove the IP from proxy reverse server and parentesis from real IP obtained from X-forwarder_IP Show Sample Output

tr -s ' ' | cut -d' ' -f2- |cut -c2- |sed 's/)//1'

horaciod · 2016-09-12 19:25:23 16

Openstack, trigger ceilometer alarm webhook

Grab the multiline webhook URL definition from alarm-show. Basically it parse the following into an URL only: ```root@ctl01:/home/hombre# ceilometer alarm-show 1383a6be-fb73-4955-9991-8d65a8a23d60 +---------------------------+--------------------------------------------------------------------------+ | Property | Value | +---------------------------+--------------------------------------------------------------------------+ | alarm_actions | [u'http://10.40.50.20:8000/v1/signal/arn%3Aopenstack%3Aheat%3A%3A3d6118 | | | cc789c4db3b06fb3a382494b67%3Astacks%2Fhombre-V2R1%2Fd189e704-4f99-467 | | | 5-9ec2-eaadkc0ae8af5%2Fresources%2Fweb_server_scaleup_policy?Timestamp=20 | | | 16-10-03T14%3A05%3A27Z&SignatureMethod=HmacSHA256&AWSAccessKeyId=09sdkd4e | | | d854347189383aba11d6353c6&SignatureVersion=2&Signature=MXxlKLZ%2BT4y4y%2 | | | BOuuAmxTLIVQ9ONKx2jKSZKHYIy83Q%3D'] | ```
This is sample output - yours may be different.
0

curl -X POST -i `ceilometer alarm-show 1383a6be-fb73-4955-9991-8d65a8a23d60 | tr '\n' ' ' | sed -e 's/.*\[$.*$\].*/\1/' -e 's/[| ]*//g' -e 's/^u//' -e "s:'::g"`

epcim · 2016-10-03 15:15:21 17
Gets shellcode opcodes from binary file using objdump

Seems to work on Ubuntu 14.02 LTS Show Sample Output
This is sample output - yours may be different.
```
"\x31\xc0\xb0\x04\x31\xdb\xb3\x01\xeb\x11\x59\x31\xd2\xb2\x0e\xcd\x80\x31"
```
0

objdump -s ./HelloWorld | grep -v '^ [0-9a-f][0-9a-f][0-9a-f][0-9a-f] \b' | grep -v 'Contents' | grep -v './' | cut -d' ' -f 3-6| sed 's/ //g' | sed '/./!d' | tr -d '\n'| sed 's/.\{2\}/&\\x/g' | sed 's/^/\\x/'|sed 's/..$//'|sed 's/^/"/;s/$/"/g'

mark20 · 2016-10-05 23:31:05 17
Open VLC player with search results from YouTube

Search a string in YouTube using GET command, parse the response with a suitable replace pattern and pipe its result to VLC Show Sample Output
This is sample output - yours may be different.
```
https://www.youtube.com/watch?v=bg6vYLs5DKg
https://www.youtube.com/watch?v=NsWd15iLDHs
https://www.youtube.com/watch?v=aw088NHSjdA
https://www.youtube.com/watch?v=6VmmvhR2T4U
https://www.youtube.com/watch?v=Xnw3Mrm1nGs
https://www.youtube.com/watch?v=_vb2lCx36bA
https://www.youtube.com/watch?v=13O9ZPCnW3c
https://www.youtube.com/watch?v=9CS4jpY-IDI
(...)
```
0

GET https://www.youtube.com/results?search_query=shaun+the+sheep | sed -ne '/<a href="\/watch.*title="/s/.*<a href="$\/watch[^"]*$".* title="$[^"]*$".*/https:\/\/www.youtube.com\1/p' | vlc -

plokij · 2016-10-28 23:55:59 17
Get newest Nmap source code tarball URL.
This is sample output - yours may be different.
0

curl -Ls https://nmap.org/dist/ | sed -En '/nmap.*tgz/s@^.*href="([^"]+)".*$@https://nmap.org/dist/\1@p' | tail -n1

akanehara · 2017-02-10 05:46:27 20
Get your internal IP address and nothing but your internal IP address
This is sample output - yours may be different.
0

ifconfig eth0 | sed -n 's/.*inet addr:$[0-9\.]*$.*/\1/p'

cycne · 2017-02-18 15:53:37 18
Execute the last line of output from the previous command

alex@alex-box:~$ sl The program 'sl' is currently not installed. You can install it by typing: sudo apt-get install sl alex@alex-box:~$ dolast Reading package lists... Done Building dependency tree Reading state information... Done The following NEW packages will be installed: sl 0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
This is sample output - yours may be different.
0

alias dolast='$( $(history 2| head -n 1| sed "s/.* //") 2>&1 | tail -n 1)'

aheinous · 2017-02-25 01:26:49 19
Resume incomplete youtube-dl video files

Resume incomplete youtube-dl video files. Assuming mp4 format here.
This is sample output - yours may be different.
0

ls *.part | sed 's/^.*-$.\{11,11\}$\.mp4\.part$/\1/g' - | youtube-dl -i -f mp4 -a -

agp · 2017-02-28 23:31:55 21
Colorized tail using sed

Tails make.out file and pipes it to sed which uses 3 colors: green: percentage (eg: 10%) yellow: warning (case insensitive) red: error (case insensitive)
This is sample output - yours may be different.
0

tail -f ~/make.out | sed -e 's/$...%$/\o033[32m\1\o033[39m/' -e 's/$.*[Ww][Aa][Rr][Nn][Ii][Nn][Gg].*$/\o033[33m\1\o033[39m/' -e 's/$.*[Ee][Rr][Rr][Oo][Rr].*$/\o033[31m\1\o033[39m/'

redowk · 2017-03-06 18:20:36 18
Remove last x lines from file using sed

Removes the last 5 lines from a file using sed
This is sample output - yours may be different.
0

sed -n -e :a -i -e '1,5!{P;N;D;};N;ba' /etc/apt/sources.list

redowk · 2017-03-06 18:22:48 20

Simply clean playlist

Remove all line from a playlist m3u that not finish with MP3 or mp3 or wma or flac creating a new clean plalist m3u Show Sample Output

sed -e '/MP3$\|mp3$\|wma$\|flac$/!d' <filename_source> > <filename_destination>

vinabb · 2017-03-21 22:14:08 17

the executable that started the currently running oracle databases and the ORACLE_HOME relative to each

Show the executable that spawned the process and show the PID and ORACLE_HOME relative to the environment within which the process is running.
This is sample output - yours may be different.
0

ps -ef | grep [p]mon | awk '{print $2}' | xargs -I {} ps eww {} | awk '{print $1 " " $5 " " $6 " " $0}' | sed 's/$S*$ $S*$ .*ORACLE_HOME/\1 \2/g' | cut -f1,2,3 -d" "

Enirevlow · 2017-03-24 18:45:40 18
Do mathematical operation on every line of a given file for the first value found to be replaced (other lines stay untouched)

The given file may contain any kind of characters. This is compatible for most simple mathematical operation. For the first number found, it will be replaced by the result of a factor operation of 1000. To change the filename or multiplactor or number regular expression, change the first fixed values. Show Sample Output
This is sample output - yours may be different.
```
For a given filename such as test.csv, a new filename new_test.csv will be created containing the new values after the math operation.
command source: cat test.csv
command output: cat new_test.csv
```
0

n=1000;f="test.csv";r='([0-9]+.{0,1}[0-9]*)';echo -n "" > new_${f};cat $f | while read l;do val=`echo $l | egrep -o $r` ; if [ ! -z $val ];then newval=`echo $val \* $n | bc -l`;l=`echo $l | sed "s/$val/$newval/"`;fi;echo $l >> new_${f};unset val;done

s333 · 2017-04-26 18:04:07 19
Recursive convert all print statements in py files from python2 to python3 form

Use find . -iname "*.py" -type f -print0 | xargs -0 sed -ne 's/^$[ \t]*$print $.*$$/\1print(\2)/p' to see what would be changed.
This is sample output - yours may be different.
0

find . -iname "*.py" -type f -print0 | xargs -0 sed -i 's/^$[ \t]*$print $.*$$/\1print(\2)/g'

sleepprogger · 2017-05-22 22:39:58 16
find out true (according to xrandr) monitor DPI

see summary. if you want to set dpi right away try this: xrandr --query | sed -n 's@$[A-Z0-1-]*$.* $.*$x$.*$+.*+.* $[0-9]\+$mm x $[0-9]\+$mm@"--output \1 --dpi ";(\2/\4+\3/\5)*12.7@p;'|bc -l|xargs -L1 xrandr all syntax should be POSIX compliant. Show Sample Output
This is sample output - yours may be different.
```
LVDS-1: 100.96760151825521147108
HDMI-1: 92.60728755320785681297
```
0

xrandr --query | sed -n 's@$[A-Z0-1-]*$.* $.*$x$.*$+.*+.* $[0-9]\+$mm x $[0-9]\+$mm@"\1: ";(\2/\4+\3/\5)*12.7@p;'|bc -l

hydrogenization · 2017-06-23 03:44:40 16
the executable that started the currently running oracle databases and the ORACLE_HOME relative to each
This is sample output - yours may be different.
0

ps -ef |grep oracle |grep pmon |awk '{print $2}' |xargs -I {} ps eww {} |grep pmon |grep -v grep |awk '{print $5 " " $6 " " $0}' |sed 's/$S*$ $S*$ .*ORACLE_HOME/\1 \2/g' |cut -f1,2,3 -d" " 2010-03-23 20:36:59 User:

Izzamar075 · 2017-07-21 23:44:43 21
‹ First < 39 40 41 42 43 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Print a list of all hardlinks in the working directory, recursively

libpurple likes to hardlink files repeatedly. To ignore libpurple, use sed: | sed '/\.\/\.purple/d'

Generate a ZenCart-style MD5 password hash.

ZenCart uses a MD5 with a salt to secure its passwords. If you need to forcibly change someone's password to a known value within the database, this one-liner can generate the password. Change the value of 'p' to the password you want.

get the top 10 longest filenames

Get your external IP address if your machine has a DNS entry

Using DynDNS or a similar service not only allows access to your home machine from outside without needing to know what IP the ISP has assigned to it but it also comes in handy if you want to know your external IP address. The only purpose of the sed command is to remove the leading "host.na.me has address " part from the output. If you don't need to discard it you can simply use $ host $HOSTNAME

Burn CD/DVD from an iso, eject disc when finished.

cdrecord -scanbus will tell you the (x,y,z) value of your cdr (for example, mine is 3,0,0)

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

recursive base64 encoding -- Cipher for the Poor ?

Just for fun, I searched a simple way to encrypt some text. Simple base64 encoding seemed a good start so I decided to "amplify" encoding using repeted base64 encoding. Of course, this is not really secure but can be useful to hide datas to most part of humans ;). Do not hesitate to provide better solutions or else.

Print trending topics on Twitter

Load all files (including in subdirs), whose name matches a substring, into Vim

This command searches the current directory, and all of its subdirs, for files that have the string "foo" in their filename (foo.c, two-foo.txt, index-FOO-bar.php, etc), and opens them in Vim. It ignores any hidden .svn directories. Change -iname to -name if you want to do case-sensitive matches. Files open in buffers by default, so to verify that the correct files were opened, type ":list". You can load all the files in tabs by doing ":tab ball" or use 'vim -p' on the command-line to load files straight to tabs. If you get permission denied errors, do: vim $(find . ! -path \*.svn\* -type -f iname \*foo\* 2>/dev/null) To narrow it down to a single file extension, such as .php files, use \*foo\*.php (or '*foo*.php'. Which ever you prefer)

Are the two lines anagrams?

This is just a slight alternative that wraps all of #7917 in a function that can be executed

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using sed

Commands using sed (1,319) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using sed (1,319)

sorted by