Commands using sed sorted by votes

Commands using sed (1,319)

sorted by

Extract URLs from all anchors inside an HTML document with sed and grep

Extract all href links from an HTML document with sed and grep Show Sample Output
This is sample output - yours may be different.
```
#
./index.html
./index2.html
http://www.google.com
./ipl.html
```
0

cat index.html | grep -o '<a .*href=.*>' | sed -e 's/<a /\n<a /g' | sed -e 's/<a .*href=['"'"'"]//' -e 's/["'"'"'].*$//' -e '/^$/ d'

crisboot · 2012-08-06 10:31:38 7
detect partitions
This is sample output - yours may be different.
0

sudo file -bs /dev/sda | sed -e 's/.*partition 1$.*$ code offset.*/partition 1\1/g' -e 's/$.$;/\1\n/g'

jlaunay · 2012-08-17 12:54:05 5
Network Interfaces

Linux only Show Sample Output
This is sample output - yours may be different.
```
lo
eth0
```
0

awk '{print $1}' /proc/net/dev|grep :|sed "s/:.*//g"

kro · 2012-08-17 13:36:47 56
Replace nelines with spaces
This is sample output - yours may be different.
0

sed -e :a -e '$!N;s/\n/ /;ta'

T4b · 2012-08-21 09:45:16 6
Generate a Random (unicast) MAC address

- The last sed expression ensures the unicast/multicast bit is set to zero - The greedy space replacements are for portability across UNIX seds (note there's TWO spaces and not just one, as this web shows, in s/^ */) Show Sample Output
This is sample output - yours may be different.
```
e0:91:cd:46:f8:18
```
0

od -An -N6 -tx1 /dev/urandom | sed -e 's/^ *//' -e 's/ */:/g' -e 's/:$//' -e 's/^$.$[13579bdf]/\10/'

outly3r · 2012-08-31 13:15:03 8
Find highest context switches

This command will find the highest context switches on a server and give you the process listing. Show Sample Output
This is sample output - yours may be different.
```
Context Switches: 1097211 - Process : [migration/12]
Context Switches: 1500058 - Process : [migration/10]
Context Switches: 1558813 - Process : [migration/13]
Context Switches: 2207748 - Process : [migration/11]
Context Switches: 2516720 - Process : /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --log-error=/var/lib/mysql/server.err --open-files-limit=12288 --pid-file=/var/lib/mysql/server.pid
```
0

grep -H voluntary_ctxt /proc/*/status |gawk '{ split($1,proc,"/"); if ( $2 > 10000000 ) { printf $2 " - Process : "; system("ps h -o cmd -p "proc[3]) } }' | sort -nk1,1 | sed 's/^/Context Switches: /g'

jperkster · 2012-09-01 19:43:47 54
Short Information about loaded kernel modules
This is sample output - yours may be different.
0

lsmod | tail -n +2 | cut -d' ' -f1 | xargs modinfo | egrep '^file|^desc|^dep' | sed -e'/^dep/s/$/\n/g'

vlaad · 2012-09-03 17:59:49 4
Easy way to display yum repo priorities

This probably only works without modifications in RHEL/CentOS/Fedora. Show Sample Output
This is sample output - yours may be different.
```
priority = 1 [asl-3.0]
priority = 1 [asl-3.0-testing]
priority = 1 [base]
priority = 1 [virtualmin]
priority = 1 [virtualmin-universal]
priority = 50 [epel]
```
0

sed -n -e "/^\[/h; /priority *=/{ G; s/\n/ /; s/ity=/ity = /; p }" /etc/yum.repos.d/*.repo | sort -k3n

eddieb · 2012-09-06 00:09:09 5
Get Current CPU Usage

Get the current cpu % usage on your system. Show Sample Output
This is sample output - yours may be different.
```
13.50
```
0

top -n2 -d 0.5 | grep ^Cpu | sed 's/[[:alpha:]%]*//g' | awk 'NR == 2 {printf("%.2f\n",100-$5)}'

wizzra · 2012-09-06 12:56:26 5
replace dots in filenames with dashes, using sed

This command can rename all files in a folder changing all the dots in the filename for dashes, but respecting the final dot for the extension. Show Sample Output
This is sample output - yours may be different.
```
Image.1.2.png --> Image-1-2.png
```
0

for f in *; do fn=`echo $f | sed 's/$.*$\.$[^.]*$$/\1\n\2/;s/\./-/g;s/\n/./g'`; mv $f $fn; done

conradolandia · 2012-09-29 02:10:00 8

Extract list of packages installed on one server and generate 'apt' command to install them on a new server

This is sample output - yours may be different.

apt-get install acl adduser anthy-common apt apt-utils aptitude authbind avahi-daemon base-files base-passwd bash bind9-host binutils bsdmainutils bsdutils busybox bzip2 ca-certificates ca-certificates-java collectd collectd-core coreutils cpio cpp cpp-4.4 cron curl dash dbus debconf debconf-i18n debian-archive-keyring debianutils deborphan defoma dhcpcd dialog diffutils dmidecode dmsetup dnsutils dpkg dstat e2fslibs e2fsprogs emacs emacs23 emacs23-bin-common emacs23-common emacsen-common fancontrol file findutils firmware-linux-free fontconfig fontconfig-config fping gcc gcc-4.4 gcc-4.4-base gconf2-common geoip-database gettext-base gnupg gpgv grep groff-base grub grub-common grub-pc gsfonts gsfonts-x11 gzip hicolor-icon-theme hostname htop ifupdown info initramfs-tools initscripts insserv install-info iproute iptables iputils-ping java-common joe klibc-utils less lftp libaccess-bridge-java libaccess-bridge-java-jni libacl1 libanthy0 libasound2 libasyncns0 libatk1.0-0 libatk1.0-data libattr1 libavahi-client3 libavahi-common-data libavahi-common3 libavahi-core7 libbind9-60 libblkid1 libboost-iostreams1.42.0 libbsd0 libbz2-1.0 libc-bin libc-dev-bin libc6 libc6-dev libcairo2 libcap-ng0 libcap2 libcomerr2 libcommons-collections3-java libcommons-dbcp-java libcommons-pool-java libcroco3 libcups2 libcurl3 libcurl3-gnutls libcurses-perl libcurses-ui-perl libcwidget3 libdaemon0 libdatrie1 libdb4.7 libdb4.8 libdbi0 libdbi1 libdbus-1-3 libdbus-glib-1-2 libdevmapper1.02.1 libdns69 libecj-java libedit2 libept1 libesmtp6 libevtlog0 libexpat1 libflac8 libfont-freetype-perl libfontconfig1 libfontenc1 libfreetype6 libfribidi0 libgcc1 libgconf2-4 libgcrypt11 libgd2-noxpm libgdbm3 libgeoip1 libgif4 libglib2.0-0 libglib2.0-data libgmp3c2 libgnutls26 libgomp1 libgpg-error0 libgpm2 libgsf-1-114 libgsf-1-common libgssapi-krb5-2 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common libhal1 libice-dev libice6 libidl0 libidn11 libisc62 libisccc60 libisccfg62 libjasper1 libjpeg62 libk5crypto3 libkeyutils1 libklibc libkrb5-3 libkrb5support0 liblcms1 libldap-2.4-2 liblocale-gettext-perl liblockfile1 libltdl7 liblua5.1-0 liblwres60 liblzma2 libm17n-0 libmagic1 libmemcached10 libmodbus5 libmpfr4 libmysqlclient16 libncurses5 libncursesw5 libnet-snmp-perl libnet1 libnewt0.52 libnfnetlink0 libnl1 libnspr4-0d libnss-mdns

dpkg --list | rgrep ii | cut -d" " -f3 | sed ':a;N;$!ba;s/\n/ /g' | sed 's/^$.$/apt-get install \1/'

pablor44 · 2012-10-16 07:51:18 4

Compares two source directories, one original and one post configure and deletes the differences in the source folder

Good for when your working on building a clean source install for RPM packaging or what have you. After testing, run this command to compare the original extracted source to your working source directory and it will remove the differences that are created when running './configure' and 'make'.
This is sample output - yours may be different.
0

diff ../source-dir.orig/ ../source-dir.post/ | grep "Only in" | sed -e 's/^.*\:.$\<.*\>$/\1/g' | xargs rm -r

bigc00p · 2012-10-17 14:12:32 9

find geographical location of an ip address

Tries to avoid the fragile nature of scrapers by looking for user-input in the output as opposed to markup or headers on the web site. Show Sample Output

function ip-where { wget -qO- -U Mozilla http://www.ip-adress.com/ip_tracer/$1 | html2text -nobs -style pretty | sed -n /^$1/,/^$/p;}

tox2ik · 2012-10-22 21:39:53 5

Get Lorum Ipsum random text from lorumipsum.com

This fixes the extra lines you get when you request only 1 paragraph using a little bit of grep. Just set p to the number of paragraphs you want. Show Sample Output

p=1 ; lynx -source http://www.lipsum.com/feed/xml?amount=${p} | grep '<lipsum>' -A$(((p-1))) | perl -p -i -e 's/\n/\n\n/g' | sed -n '/<lipsum>/,/<\/lipsum>/p' | sed -e 's/<[^>]*>//g'

nublaii · 2012-10-24 14:11:52 4

List prime numbers from 2 to 100
This is sample output - yours may be different.
0

seq 2 100 | factor | sed '/ .* / d ; s/:.*//'

misof · 2012-10-25 15:19:35 4
comment / uncomment a line in a file using sed.

Show Sample Output
This is sample output - yours may be different.
```
comment:
$ sed -i 's/blah.*/#&/g' file.txt 
$ cat file.txt 
dugh
#blah
adfas
sdfkb
#blah
asdfkk
#blah

uncomment:
$ sed -i 's/.$blah*.$/\1/g' file.txt
$cat file.txt 
dugh
blah
adfas
sdfkb
blah
asdfkk
blah
```
0

(comment:) $ sed -i 's/blah.*/#&/g' file.txt (uncomment:) $ sed -i 's/.$blah*.$/\1/g' file.txt

omatictost · 2012-10-25 16:00:29 221
Pipe system log to espeak
This is sample output - yours may be different.
0

tail -f /var/log/messages.log | while read line ; do echo $line | cut -d \ -f5- | sed s/\\[[0-9]*\\]// | espeak ; done

asdfkajsdfh · 2012-10-27 23:00:53 4
Get external IP address

Retrieves the current WAN ipv4 address via checkip.dyn.com. Show Sample Output
This is sample output - yours may be different.
```
71.128.35.100
```
0

curl -qsL http://checkip.dyn.com | sed -E "s/^.*Address: ([0-9\.]+).*$/\1/"

wafflesnatcha · 2012-10-28 22:20:50 3
Remove lines ending or trailing slash (/)
This is sample output - yours may be different.
0

sed -i 'g/text/d' <filename>

vishnu81 · 2012-10-31 11:55:22 7
list uniq extensions of files from the current directory

find files recursively from the current directory, and list the extensions of files uniquely Show Sample Output
This is sample output - yours may be different.
```
bak
bat
cfg
conf
csv
doc
exe
exe_back
pyc
sql
txt
xls
```
0

find . -type f |egrep '^./.*\.' |sed -e "s/$^.*\.$$.*$$/\2/" |sort |uniq

dvst · 2012-11-12 17:17:55 8
Convert metasploit cachedump files to Hashcat format for cracking
This is sample output - yours may be different.
0

cd ~/.msf4/loot && cat *mscache* | cut -d '"' -f 2,4 | sed s/\"/\:/g | tr -cd '\11\12\40-\176' | grep -v Username | cut -d : -f 1,2 | awk -F':' '{print $2,$1}' | sed 's/ /:/g' > final.dcc.hash

purehate · 2012-11-26 02:10:08 6
Remove UTF-8 Byte Order Mark BOM
This is sample output - yours may be different.
0

find . -type f -regex '.*html$' -exec sed -i 's/\xEF\xBB\xBF//' '{}' \;

olekhy · 2012-11-26 09:56:00 4
get svn log by the user
This is sample output - yours may be different.
0

svn log -l1000 SVN_URL | sed -n '/USERNAME/,/-----$/ p'

olekhy · 2012-11-28 19:11:20 5
Screenshot in $1 seconds, upload and retrieve URI from ompdlr.org

Take a screenshot, give $1 seconds pause to choose what to screenshot, then upload and get URI of post in ompdlr.org Show Sample Output
This is sample output - yours may be different.
```
$ scrotit(){ echo "Screenshot in $1 seconds...";scrot -d $1 '%Y%m%d%h.png' -e 'curl -sF file1=@- http://ompldr.org/upload < $f | grep -P -o "(?<=File:).*(http://ompldr.org/.*)\<\/a\>";rm $f'| sed -r 's@.*(http://ompldr.org/\w{1,7}).*@\1@';}
$ scrotit 5
Sreenshot in 5 seconds...
http://ompldr.org/vZ2pqaQ
$
```
0

scrotit(){ echo "Screenshot in $1 seconds...";scrot -d $1 '%Y%m%d%h.png' -e 'curl -sF file1=@- http://ompldr.org/upload < $f | grep -P -o "(?<=File:).*(http://ompldr.org/.*)\<\/a\>";rm $f'| sed -r 's@.*(http://ompldr.org/\w{1,7}).*@\1@';}

dzup · 2012-12-03 01:21:19 4
Download the last most popular 20 pictures from 500px

This command downloads the actual 20 most popular pictures from the website 500px. It uses a random name due to the fact the the pictures in 500px are stored with the same name. UPDATED: doesn't work if no referrer is specified: --referer='http://500px.com/'
This is sample output - yours may be different.
0

for line in `wget --referer='http://500px.com/' --quiet -O- http://500px.com/popular | grep "from=popular" | sed -n 's/.*<img src="$[^"]*$".*/\1/p' | sed s/"3.jpg"/"4.jpg"/ | sed s/"?t".*$//`; do wget -O $RANDOM.jpg --quiet "$line"; done

bugmenot · 2012-12-07 16:14:36 5
‹ First < 32 33 34 35 36 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Backup entire system through SSH

Remove an IP address ban that has been errantly blacklisted by denyhosts

download the denyhosts-remove script from http://www.atrixnet.com/remove-an-ip-address-ban-that-has-been-errantly-blacklisted-by-denyhosts/

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Add a progress counter to loop (see sample output)

For this hack you need following function: $ finit() { count=$#; current=1; for i in "$@" ; do echo $current $count; echo $i; current=$((current + 1)); done; } and alias: $ alias fnext='read cur total && echo -n "[$cur/$total] " && read' Inspired by CMake progress counters.

exclude a column with cut

Show all columns except 5th. This might help you save some typing if you are trying to exclude some columns from the output.

Make vim open in tabs by default (save to .profile)

I always add this to my .profile rc so I can do things like: "vim *.c" and the files are opened in tabs.

Get the 10 biggest files/folders for the current direcotry

get colorful side-by-side diffs of files in svn with vim

This will diff your local version of the file with the latest version in svn. I put this in a shell function like so: $svd() { vimdiff

Colorful man

That command installs "most" and make this command as the default man reader. The "most" works like "less" (the current man reader), but it render colors for manpages and may do more things. Read "man most". You can see a preview here: http://www.dicas-l.com.br/dicas-l/20090718.php

identify NEEDED sonames in a path

This works in combination with http://www.commandlinefu.com/commands/view/10496/identify-exported-sonames-in-a-path as it reports the NEEDED entries present in the files within a given path. You can then compare it with the libraries that are exported to make sure that, when cross-building a firmware image, you're not bringing in dependencies from the build host. The short version of it as can be seen in the same output is $ scanelf -RBnq -F "+n#f" $1 | tr ',' '\n' | sort -u

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using sed

Commands using sed (1,319) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using sed (1,319)

sorted by