Commands using sed sorted by votes

Commands using sed (1,319)

sorted by

Extract URLs from all anchors inside an HTML document with sed and grep

Extract all href links from an HTML document with sed and grep Show Sample Output
This is sample output - yours may be different.
```
#
./index.html
./index2.html
http://www.google.com
./ipl.html
```
0

cat index.html | grep -o '<a .*href=.*>' | sed -e 's/<a /\n<a /g' | sed -e 's/<a .*href=['"'"'"]//' -e 's/["'"'"'].*$//' -e '/^$/ d'

crisboot · 2012-08-06 10:31:38 7
detect partitions
This is sample output - yours may be different.
0

sudo file -bs /dev/sda | sed -e 's/.*partition 1$.*$ code offset.*/partition 1\1/g' -e 's/$.$;/\1\n/g'

jlaunay · 2012-08-17 12:54:05 5
Network Interfaces

Linux only Show Sample Output
This is sample output - yours may be different.
```
lo
eth0
```
0

awk '{print $1}' /proc/net/dev|grep :|sed "s/:.*//g"

kro · 2012-08-17 13:36:47 56
Replace nelines with spaces
This is sample output - yours may be different.
0

sed -e :a -e '$!N;s/\n/ /;ta'

T4b · 2012-08-21 09:45:16 6
Generate a Random (unicast) MAC address

- The last sed expression ensures the unicast/multicast bit is set to zero - The greedy space replacements are for portability across UNIX seds (note there's TWO spaces and not just one, as this web shows, in s/^ */) Show Sample Output
This is sample output - yours may be different.
```
e0:91:cd:46:f8:18
```
0

od -An -N6 -tx1 /dev/urandom | sed -e 's/^ *//' -e 's/ */:/g' -e 's/:$//' -e 's/^$.$[13579bdf]/\10/'

outly3r · 2012-08-31 13:15:03 8
Find highest context switches

This command will find the highest context switches on a server and give you the process listing. Show Sample Output
This is sample output - yours may be different.
```
Context Switches: 1097211 - Process : [migration/12]
Context Switches: 1500058 - Process : [migration/10]
Context Switches: 1558813 - Process : [migration/13]
Context Switches: 2207748 - Process : [migration/11]
Context Switches: 2516720 - Process : /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --log-error=/var/lib/mysql/server.err --open-files-limit=12288 --pid-file=/var/lib/mysql/server.pid
```
0

grep -H voluntary_ctxt /proc/*/status |gawk '{ split($1,proc,"/"); if ( $2 > 10000000 ) { printf $2 " - Process : "; system("ps h -o cmd -p "proc[3]) } }' | sort -nk1,1 | sed 's/^/Context Switches: /g'

jperkster · 2012-09-01 19:43:47 54
Short Information about loaded kernel modules
This is sample output - yours may be different.
0

lsmod | tail -n +2 | cut -d' ' -f1 | xargs modinfo | egrep '^file|^desc|^dep' | sed -e'/^dep/s/$/\n/g'

vlaad · 2012-09-03 17:59:49 4
Easy way to display yum repo priorities

This probably only works without modifications in RHEL/CentOS/Fedora. Show Sample Output
This is sample output - yours may be different.
```
priority = 1 [asl-3.0]
priority = 1 [asl-3.0-testing]
priority = 1 [base]
priority = 1 [virtualmin]
priority = 1 [virtualmin-universal]
priority = 50 [epel]
```
0

sed -n -e "/^\[/h; /priority *=/{ G; s/\n/ /; s/ity=/ity = /; p }" /etc/yum.repos.d/*.repo | sort -k3n

eddieb · 2012-09-06 00:09:09 5
Get Current CPU Usage

Get the current cpu % usage on your system. Show Sample Output
This is sample output - yours may be different.
```
13.50
```
0

top -n2 -d 0.5 | grep ^Cpu | sed 's/[[:alpha:]%]*//g' | awk 'NR == 2 {printf("%.2f\n",100-$5)}'

wizzra · 2012-09-06 12:56:26 5
replace dots in filenames with dashes, using sed

This command can rename all files in a folder changing all the dots in the filename for dashes, but respecting the final dot for the extension. Show Sample Output
This is sample output - yours may be different.
```
Image.1.2.png --> Image-1-2.png
```
0

for f in *; do fn=`echo $f | sed 's/$.*$\.$[^.]*$$/\1\n\2/;s/\./-/g;s/\n/./g'`; mv $f $fn; done

conradolandia · 2012-09-29 02:10:00 8

Extract list of packages installed on one server and generate 'apt' command to install them on a new server

This is sample output - yours may be different.

apt-get install acl adduser anthy-common apt apt-utils aptitude authbind avahi-daemon base-files base-passwd bash bind9-host binutils bsdmainutils bsdutils busybox bzip2 ca-certificates ca-certificates-java collectd collectd-core coreutils cpio cpp cpp-4.4 cron curl dash dbus debconf debconf-i18n debian-archive-keyring debianutils deborphan defoma dhcpcd dialog diffutils dmidecode dmsetup dnsutils dpkg dstat e2fslibs e2fsprogs emacs emacs23 emacs23-bin-common emacs23-common emacsen-common fancontrol file findutils firmware-linux-free fontconfig fontconfig-config fping gcc gcc-4.4 gcc-4.4-base gconf2-common geoip-database gettext-base gnupg gpgv grep groff-base grub grub-common grub-pc gsfonts gsfonts-x11 gzip hicolor-icon-theme hostname htop ifupdown info initramfs-tools initscripts insserv install-info iproute iptables iputils-ping java-common joe klibc-utils less lftp libaccess-bridge-java libaccess-bridge-java-jni libacl1 libanthy0 libasound2 libasyncns0 libatk1.0-0 libatk1.0-data libattr1 libavahi-client3 libavahi-common-data libavahi-common3 libavahi-core7 libbind9-60 libblkid1 libboost-iostreams1.42.0 libbsd0 libbz2-1.0 libc-bin libc-dev-bin libc6 libc6-dev libcairo2 libcap-ng0 libcap2 libcomerr2 libcommons-collections3-java libcommons-dbcp-java libcommons-pool-java libcroco3 libcups2 libcurl3 libcurl3-gnutls libcurses-perl libcurses-ui-perl libcwidget3 libdaemon0 libdatrie1 libdb4.7 libdb4.8 libdbi0 libdbi1 libdbus-1-3 libdbus-glib-1-2 libdevmapper1.02.1 libdns69 libecj-java libedit2 libept1 libesmtp6 libevtlog0 libexpat1 libflac8 libfont-freetype-perl libfontconfig1 libfontenc1 libfreetype6 libfribidi0 libgcc1 libgconf2-4 libgcrypt11 libgd2-noxpm libgdbm3 libgeoip1 libgif4 libglib2.0-0 libglib2.0-data libgmp3c2 libgnutls26 libgomp1 libgpg-error0 libgpm2 libgsf-1-114 libgsf-1-common libgssapi-krb5-2 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common libhal1 libice-dev libice6 libidl0 libidn11 libisc62 libisccc60 libisccfg62 libjasper1 libjpeg62 libk5crypto3 libkeyutils1 libklibc libkrb5-3 libkrb5support0 liblcms1 libldap-2.4-2 liblocale-gettext-perl liblockfile1 libltdl7 liblua5.1-0 liblwres60 liblzma2 libm17n-0 libmagic1 libmemcached10 libmodbus5 libmpfr4 libmysqlclient16 libncurses5 libncursesw5 libnet-snmp-perl libnet1 libnewt0.52 libnfnetlink0 libnl1 libnspr4-0d libnss-mdns

dpkg --list | rgrep ii | cut -d" " -f3 | sed ':a;N;$!ba;s/\n/ /g' | sed 's/^$.$/apt-get install \1/'

pablor44 · 2012-10-16 07:51:18 4

Compares two source directories, one original and one post configure and deletes the differences in the source folder

Good for when your working on building a clean source install for RPM packaging or what have you. After testing, run this command to compare the original extracted source to your working source directory and it will remove the differences that are created when running './configure' and 'make'.
This is sample output - yours may be different.
0

diff ../source-dir.orig/ ../source-dir.post/ | grep "Only in" | sed -e 's/^.*\:.$\<.*\>$/\1/g' | xargs rm -r

bigc00p · 2012-10-17 14:12:32 9

find geographical location of an ip address

Tries to avoid the fragile nature of scrapers by looking for user-input in the output as opposed to markup or headers on the web site. Show Sample Output

function ip-where { wget -qO- -U Mozilla http://www.ip-adress.com/ip_tracer/$1 | html2text -nobs -style pretty | sed -n /^$1/,/^$/p;}

tox2ik · 2012-10-22 21:39:53 5

Get Lorum Ipsum random text from lorumipsum.com

This fixes the extra lines you get when you request only 1 paragraph using a little bit of grep. Just set p to the number of paragraphs you want. Show Sample Output

p=1 ; lynx -source http://www.lipsum.com/feed/xml?amount=${p} | grep '<lipsum>' -A$(((p-1))) | perl -p -i -e 's/\n/\n\n/g' | sed -n '/<lipsum>/,/<\/lipsum>/p' | sed -e 's/<[^>]*>//g'

nublaii · 2012-10-24 14:11:52 4

List prime numbers from 2 to 100
This is sample output - yours may be different.
0

seq 2 100 | factor | sed '/ .* / d ; s/:.*//'

misof · 2012-10-25 15:19:35 4
comment / uncomment a line in a file using sed.

Show Sample Output
This is sample output - yours may be different.
```
comment:
$ sed -i 's/blah.*/#&/g' file.txt 
$ cat file.txt 
dugh
#blah
adfas
sdfkb
#blah
asdfkk
#blah

uncomment:
$ sed -i 's/.$blah*.$/\1/g' file.txt
$cat file.txt 
dugh
blah
adfas
sdfkb
blah
asdfkk
blah
```
0

(comment:) $ sed -i 's/blah.*/#&/g' file.txt (uncomment:) $ sed -i 's/.$blah*.$/\1/g' file.txt

omatictost · 2012-10-25 16:00:29 221
Pipe system log to espeak
This is sample output - yours may be different.
0

tail -f /var/log/messages.log | while read line ; do echo $line | cut -d \ -f5- | sed s/\\[[0-9]*\\]// | espeak ; done

asdfkajsdfh · 2012-10-27 23:00:53 4
Get external IP address

Retrieves the current WAN ipv4 address via checkip.dyn.com. Show Sample Output
This is sample output - yours may be different.
```
71.128.35.100
```
0

curl -qsL http://checkip.dyn.com | sed -E "s/^.*Address: ([0-9\.]+).*$/\1/"

wafflesnatcha · 2012-10-28 22:20:50 3
Remove lines ending or trailing slash (/)
This is sample output - yours may be different.
0

sed -i 'g/text/d' <filename>

vishnu81 · 2012-10-31 11:55:22 7
list uniq extensions of files from the current directory

find files recursively from the current directory, and list the extensions of files uniquely Show Sample Output
This is sample output - yours may be different.
```
bak
bat
cfg
conf
csv
doc
exe
exe_back
pyc
sql
txt
xls
```
0

find . -type f |egrep '^./.*\.' |sed -e "s/$^.*\.$$.*$$/\2/" |sort |uniq

dvst · 2012-11-12 17:17:55 8
Convert metasploit cachedump files to Hashcat format for cracking
This is sample output - yours may be different.
0

cd ~/.msf4/loot && cat *mscache* | cut -d '"' -f 2,4 | sed s/\"/\:/g | tr -cd '\11\12\40-\176' | grep -v Username | cut -d : -f 1,2 | awk -F':' '{print $2,$1}' | sed 's/ /:/g' > final.dcc.hash

purehate · 2012-11-26 02:10:08 6
Remove UTF-8 Byte Order Mark BOM
This is sample output - yours may be different.
0

find . -type f -regex '.*html$' -exec sed -i 's/\xEF\xBB\xBF//' '{}' \;

olekhy · 2012-11-26 09:56:00 4
get svn log by the user
This is sample output - yours may be different.
0

svn log -l1000 SVN_URL | sed -n '/USERNAME/,/-----$/ p'

olekhy · 2012-11-28 19:11:20 5
Screenshot in $1 seconds, upload and retrieve URI from ompdlr.org

Take a screenshot, give $1 seconds pause to choose what to screenshot, then upload and get URI of post in ompdlr.org Show Sample Output
This is sample output - yours may be different.
```
$ scrotit(){ echo "Screenshot in $1 seconds...";scrot -d $1 '%Y%m%d%h.png' -e 'curl -sF file1=@- http://ompldr.org/upload < $f | grep -P -o "(?<=File:).*(http://ompldr.org/.*)\<\/a\>";rm $f'| sed -r 's@.*(http://ompldr.org/\w{1,7}).*@\1@';}
$ scrotit 5
Sreenshot in 5 seconds...
http://ompldr.org/vZ2pqaQ
$
```
0

scrotit(){ echo "Screenshot in $1 seconds...";scrot -d $1 '%Y%m%d%h.png' -e 'curl -sF file1=@- http://ompldr.org/upload < $f | grep -P -o "(?<=File:).*(http://ompldr.org/.*)\<\/a\>";rm $f'| sed -r 's@.*(http://ompldr.org/\w{1,7}).*@\1@';}

dzup · 2012-12-03 01:21:19 4
Download the last most popular 20 pictures from 500px

This command downloads the actual 20 most popular pictures from the website 500px. It uses a random name due to the fact the the pictures in 500px are stored with the same name. UPDATED: doesn't work if no referrer is specified: --referer='http://500px.com/'
This is sample output - yours may be different.
0

for line in `wget --referer='http://500px.com/' --quiet -O- http://500px.com/popular | grep "from=popular" | sed -n 's/.*<img src="$[^"]*$".*/\1/p' | sed s/"3.jpg"/"4.jpg"/ | sed s/"?t".*$//`; do wget -O $RANDOM.jpg --quiet "$line"; done

bugmenot · 2012-12-07 16:14:36 5
‹ First < 32 33 34 35 36 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Multiplication table

The multiplication table for math study

Create a visually twisted effect by alternating the direction of the "staples" effect vertically. The effect is achieved by moving odd-numbered lines from right to left and even-numbered lines from left to right.

The effect is achieved by moving odd-numbered lines from right to left and even-numbered lines from left to right. For odd-numbered lines (with an index j), the ((j + i) % 2 == 0) condition is satisfied. In this case, the line width is set to i, resulting in the line moving from left to right. For even-numbered lines, the ((j + i) % 2 == 0) condition is not satisfied. The line width is set to $(tput cols) - i, causing the line to move from right to left. This alternating direction of movement creates a twisted visual effect as the lines appear to move in opposite directions. The code runs in a continuous loop, repeatedly updating the lines with changing background colors. There is a slight pause of 0.05 seconds between each iteration to control the speed of the animation.

Graphical tree of sub-directories

Prints a graphical directory tree from your current directory

Get info about a GitHub project

In this example we search for 'vim' but vim doesn't have a project on github right now. That's ok, this command still searches for every project that has 'vim' in their description (forks, plugins, etc). To get XML or JSON output just replace 'yaml' in the url with 'xml' or 'json'.

Create a mirror of a local folder, on a remote server

Create a exact mirror of the local folder "/root/files", on remote server 'remote_server' using SSH command (listening on port 22) (all files & folders on destination server/folder will be deleted)

Remove all .svn folders

Mortality Countdown

watch the seconds of your life tick away - replace YYYY-mm-dd HH:MM:ss w/ your birthtime.

shows history of logins on the server

outputs a history of logins on the server (top 10, when piped to 'head'); optional flags: '-a' put the hostname at the end of the line (good for long hostnames), '-i' post the IP instead of the hostname, '-F' put the full login and logout times, rather than short times.

Show errors in the kernel ring buffer

Much more useful then parsing syslog

Create a bunch of dummy text files

Using the 'time' command, running this with 'tr' took 28 seconds (and change) each time but using base64 only took 8 seconds (and change). If the file doesn't have to be viewable, pulling straight from urandom with head only took 6 seconds (and change)

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using sed

Commands using sed (1,319) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using sed (1,319)

sorted by