Commands using sed sorted by votes

Commands using sed (1,319)

sorted by

Extract URLs from all anchors inside an HTML document with sed and grep

Extract all href links from an HTML document with sed and grep Show Sample Output
This is sample output - yours may be different.
```
#
./index.html
./index2.html
http://www.google.com
./ipl.html
```
0

cat index.html | grep -o '<a .*href=.*>' | sed -e 's/<a /\n<a /g' | sed -e 's/<a .*href=['"'"'"]//' -e 's/["'"'"'].*$//' -e '/^$/ d'

crisboot · 2012-08-06 10:31:38 7
detect partitions
This is sample output - yours may be different.
0

sudo file -bs /dev/sda | sed -e 's/.*partition 1$.*$ code offset.*/partition 1\1/g' -e 's/$.$;/\1\n/g'

jlaunay · 2012-08-17 12:54:05 5
Network Interfaces

Linux only Show Sample Output
This is sample output - yours may be different.
```
lo
eth0
```
0

awk '{print $1}' /proc/net/dev|grep :|sed "s/:.*//g"

kro · 2012-08-17 13:36:47 56
Replace nelines with spaces
This is sample output - yours may be different.
0

sed -e :a -e '$!N;s/\n/ /;ta'

T4b · 2012-08-21 09:45:16 6
Generate a Random (unicast) MAC address

- The last sed expression ensures the unicast/multicast bit is set to zero - The greedy space replacements are for portability across UNIX seds (note there's TWO spaces and not just one, as this web shows, in s/^ */) Show Sample Output
This is sample output - yours may be different.
```
e0:91:cd:46:f8:18
```
0

od -An -N6 -tx1 /dev/urandom | sed -e 's/^ *//' -e 's/ */:/g' -e 's/:$//' -e 's/^$.$[13579bdf]/\10/'

outly3r · 2012-08-31 13:15:03 8
Find highest context switches

This command will find the highest context switches on a server and give you the process listing. Show Sample Output
This is sample output - yours may be different.
```
Context Switches: 1097211 - Process : [migration/12]
Context Switches: 1500058 - Process : [migration/10]
Context Switches: 1558813 - Process : [migration/13]
Context Switches: 2207748 - Process : [migration/11]
Context Switches: 2516720 - Process : /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --log-error=/var/lib/mysql/server.err --open-files-limit=12288 --pid-file=/var/lib/mysql/server.pid
```
0

grep -H voluntary_ctxt /proc/*/status |gawk '{ split($1,proc,"/"); if ( $2 > 10000000 ) { printf $2 " - Process : "; system("ps h -o cmd -p "proc[3]) } }' | sort -nk1,1 | sed 's/^/Context Switches: /g'

jperkster · 2012-09-01 19:43:47 54
Short Information about loaded kernel modules
This is sample output - yours may be different.
0

lsmod | tail -n +2 | cut -d' ' -f1 | xargs modinfo | egrep '^file|^desc|^dep' | sed -e'/^dep/s/$/\n/g'

vlaad · 2012-09-03 17:59:49 4
Easy way to display yum repo priorities

This probably only works without modifications in RHEL/CentOS/Fedora. Show Sample Output
This is sample output - yours may be different.
```
priority = 1 [asl-3.0]
priority = 1 [asl-3.0-testing]
priority = 1 [base]
priority = 1 [virtualmin]
priority = 1 [virtualmin-universal]
priority = 50 [epel]
```
0

sed -n -e "/^\[/h; /priority *=/{ G; s/\n/ /; s/ity=/ity = /; p }" /etc/yum.repos.d/*.repo | sort -k3n

eddieb · 2012-09-06 00:09:09 5
Get Current CPU Usage

Get the current cpu % usage on your system. Show Sample Output
This is sample output - yours may be different.
```
13.50
```
0

top -n2 -d 0.5 | grep ^Cpu | sed 's/[[:alpha:]%]*//g' | awk 'NR == 2 {printf("%.2f\n",100-$5)}'

wizzra · 2012-09-06 12:56:26 5
replace dots in filenames with dashes, using sed

This command can rename all files in a folder changing all the dots in the filename for dashes, but respecting the final dot for the extension. Show Sample Output
This is sample output - yours may be different.
```
Image.1.2.png --> Image-1-2.png
```
0

for f in *; do fn=`echo $f | sed 's/$.*$\.$[^.]*$$/\1\n\2/;s/\./-/g;s/\n/./g'`; mv $f $fn; done

conradolandia · 2012-09-29 02:10:00 8

Extract list of packages installed on one server and generate 'apt' command to install them on a new server

This is sample output - yours may be different.

apt-get install acl adduser anthy-common apt apt-utils aptitude authbind avahi-daemon base-files base-passwd bash bind9-host binutils bsdmainutils bsdutils busybox bzip2 ca-certificates ca-certificates-java collectd collectd-core coreutils cpio cpp cpp-4.4 cron curl dash dbus debconf debconf-i18n debian-archive-keyring debianutils deborphan defoma dhcpcd dialog diffutils dmidecode dmsetup dnsutils dpkg dstat e2fslibs e2fsprogs emacs emacs23 emacs23-bin-common emacs23-common emacsen-common fancontrol file findutils firmware-linux-free fontconfig fontconfig-config fping gcc gcc-4.4 gcc-4.4-base gconf2-common geoip-database gettext-base gnupg gpgv grep groff-base grub grub-common grub-pc gsfonts gsfonts-x11 gzip hicolor-icon-theme hostname htop ifupdown info initramfs-tools initscripts insserv install-info iproute iptables iputils-ping java-common joe klibc-utils less lftp libaccess-bridge-java libaccess-bridge-java-jni libacl1 libanthy0 libasound2 libasyncns0 libatk1.0-0 libatk1.0-data libattr1 libavahi-client3 libavahi-common-data libavahi-common3 libavahi-core7 libbind9-60 libblkid1 libboost-iostreams1.42.0 libbsd0 libbz2-1.0 libc-bin libc-dev-bin libc6 libc6-dev libcairo2 libcap-ng0 libcap2 libcomerr2 libcommons-collections3-java libcommons-dbcp-java libcommons-pool-java libcroco3 libcups2 libcurl3 libcurl3-gnutls libcurses-perl libcurses-ui-perl libcwidget3 libdaemon0 libdatrie1 libdb4.7 libdb4.8 libdbi0 libdbi1 libdbus-1-3 libdbus-glib-1-2 libdevmapper1.02.1 libdns69 libecj-java libedit2 libept1 libesmtp6 libevtlog0 libexpat1 libflac8 libfont-freetype-perl libfontconfig1 libfontenc1 libfreetype6 libfribidi0 libgcc1 libgconf2-4 libgcrypt11 libgd2-noxpm libgdbm3 libgeoip1 libgif4 libglib2.0-0 libglib2.0-data libgmp3c2 libgnutls26 libgomp1 libgpg-error0 libgpm2 libgsf-1-114 libgsf-1-common libgssapi-krb5-2 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common libhal1 libice-dev libice6 libidl0 libidn11 libisc62 libisccc60 libisccfg62 libjasper1 libjpeg62 libk5crypto3 libkeyutils1 libklibc libkrb5-3 libkrb5support0 liblcms1 libldap-2.4-2 liblocale-gettext-perl liblockfile1 libltdl7 liblua5.1-0 liblwres60 liblzma2 libm17n-0 libmagic1 libmemcached10 libmodbus5 libmpfr4 libmysqlclient16 libncurses5 libncursesw5 libnet-snmp-perl libnet1 libnewt0.52 libnfnetlink0 libnl1 libnspr4-0d libnss-mdns

dpkg --list | rgrep ii | cut -d" " -f3 | sed ':a;N;$!ba;s/\n/ /g' | sed 's/^$.$/apt-get install \1/'

pablor44 · 2012-10-16 07:51:18 4

Compares two source directories, one original and one post configure and deletes the differences in the source folder

Good for when your working on building a clean source install for RPM packaging or what have you. After testing, run this command to compare the original extracted source to your working source directory and it will remove the differences that are created when running './configure' and 'make'.
This is sample output - yours may be different.
0

diff ../source-dir.orig/ ../source-dir.post/ | grep "Only in" | sed -e 's/^.*\:.$\<.*\>$/\1/g' | xargs rm -r

bigc00p · 2012-10-17 14:12:32 9

find geographical location of an ip address

Tries to avoid the fragile nature of scrapers by looking for user-input in the output as opposed to markup or headers on the web site. Show Sample Output

function ip-where { wget -qO- -U Mozilla http://www.ip-adress.com/ip_tracer/$1 | html2text -nobs -style pretty | sed -n /^$1/,/^$/p;}

tox2ik · 2012-10-22 21:39:53 5

Get Lorum Ipsum random text from lorumipsum.com

This fixes the extra lines you get when you request only 1 paragraph using a little bit of grep. Just set p to the number of paragraphs you want. Show Sample Output

p=1 ; lynx -source http://www.lipsum.com/feed/xml?amount=${p} | grep '<lipsum>' -A$(((p-1))) | perl -p -i -e 's/\n/\n\n/g' | sed -n '/<lipsum>/,/<\/lipsum>/p' | sed -e 's/<[^>]*>//g'

nublaii · 2012-10-24 14:11:52 4

List prime numbers from 2 to 100
This is sample output - yours may be different.
0

seq 2 100 | factor | sed '/ .* / d ; s/:.*//'

misof · 2012-10-25 15:19:35 4
comment / uncomment a line in a file using sed.

Show Sample Output
This is sample output - yours may be different.
```
comment:
$ sed -i 's/blah.*/#&/g' file.txt 
$ cat file.txt 
dugh
#blah
adfas
sdfkb
#blah
asdfkk
#blah

uncomment:
$ sed -i 's/.$blah*.$/\1/g' file.txt
$cat file.txt 
dugh
blah
adfas
sdfkb
blah
asdfkk
blah
```
0

(comment:) $ sed -i 's/blah.*/#&/g' file.txt (uncomment:) $ sed -i 's/.$blah*.$/\1/g' file.txt

omatictost · 2012-10-25 16:00:29 221
Pipe system log to espeak
This is sample output - yours may be different.
0

tail -f /var/log/messages.log | while read line ; do echo $line | cut -d \ -f5- | sed s/\\[[0-9]*\\]// | espeak ; done

asdfkajsdfh · 2012-10-27 23:00:53 4
Get external IP address

Retrieves the current WAN ipv4 address via checkip.dyn.com. Show Sample Output
This is sample output - yours may be different.
```
71.128.35.100
```
0

curl -qsL http://checkip.dyn.com | sed -E "s/^.*Address: ([0-9\.]+).*$/\1/"

wafflesnatcha · 2012-10-28 22:20:50 3
Remove lines ending or trailing slash (/)
This is sample output - yours may be different.
0

sed -i 'g/text/d' <filename>

vishnu81 · 2012-10-31 11:55:22 7
list uniq extensions of files from the current directory

find files recursively from the current directory, and list the extensions of files uniquely Show Sample Output
This is sample output - yours may be different.
```
bak
bat
cfg
conf
csv
doc
exe
exe_back
pyc
sql
txt
xls
```
0

find . -type f |egrep '^./.*\.' |sed -e "s/$^.*\.$$.*$$/\2/" |sort |uniq

dvst · 2012-11-12 17:17:55 8
Convert metasploit cachedump files to Hashcat format for cracking
This is sample output - yours may be different.
0

cd ~/.msf4/loot && cat *mscache* | cut -d '"' -f 2,4 | sed s/\"/\:/g | tr -cd '\11\12\40-\176' | grep -v Username | cut -d : -f 1,2 | awk -F':' '{print $2,$1}' | sed 's/ /:/g' > final.dcc.hash

purehate · 2012-11-26 02:10:08 6
Remove UTF-8 Byte Order Mark BOM
This is sample output - yours may be different.
0

find . -type f -regex '.*html$' -exec sed -i 's/\xEF\xBB\xBF//' '{}' \;

olekhy · 2012-11-26 09:56:00 4
get svn log by the user
This is sample output - yours may be different.
0

svn log -l1000 SVN_URL | sed -n '/USERNAME/,/-----$/ p'

olekhy · 2012-11-28 19:11:20 5
Screenshot in $1 seconds, upload and retrieve URI from ompdlr.org

Take a screenshot, give $1 seconds pause to choose what to screenshot, then upload and get URI of post in ompdlr.org Show Sample Output
This is sample output - yours may be different.
```
$ scrotit(){ echo "Screenshot in $1 seconds...";scrot -d $1 '%Y%m%d%h.png' -e 'curl -sF file1=@- http://ompldr.org/upload < $f | grep -P -o "(?<=File:).*(http://ompldr.org/.*)\<\/a\>";rm $f'| sed -r 's@.*(http://ompldr.org/\w{1,7}).*@\1@';}
$ scrotit 5
Sreenshot in 5 seconds...
http://ompldr.org/vZ2pqaQ
$
```
0

scrotit(){ echo "Screenshot in $1 seconds...";scrot -d $1 '%Y%m%d%h.png' -e 'curl -sF file1=@- http://ompldr.org/upload < $f | grep -P -o "(?<=File:).*(http://ompldr.org/.*)\<\/a\>";rm $f'| sed -r 's@.*(http://ompldr.org/\w{1,7}).*@\1@';}

dzup · 2012-12-03 01:21:19 4
Download the last most popular 20 pictures from 500px

This command downloads the actual 20 most popular pictures from the website 500px. It uses a random name due to the fact the the pictures in 500px are stored with the same name. UPDATED: doesn't work if no referrer is specified: --referer='http://500px.com/'
This is sample output - yours may be different.
0

for line in `wget --referer='http://500px.com/' --quiet -O- http://500px.com/popular | grep "from=popular" | sed -n 's/.*<img src="$[^"]*$".*/\1/p' | sed s/"3.jpg"/"4.jpg"/ | sed s/"?t".*$//`; do wget -O $RANDOM.jpg --quiet "$line"; done

bugmenot · 2012-12-07 16:14:36 5
‹ First < 32 33 34 35 36 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Twitpic upload and Tweet

Generate password

Backup a file with a date-time stamp

Appends the input file with the date format YYYY-MM-DD.bak. Also runs silently if you remove the -v on the cp at the end of the function.

removing syncronization problems between audio and video

This assumes that there is a 10.2 sec delay between the video and the audio (delayed). To extract the original video into a audio and video composites look at the command on extracting audio and video from a movie

delay execution of a command that needs lots of memory and CPU time until the resources are available

[ 2000 -ge "$(free -m | awk '/buffers.cache:/ {print $4}')" ] returns true if less than 2000 MB of RAM are available, so adjust this number to your needs. [ $(echo "$(uptime | awk '{print $10}' | sed -e 's/,$//' -e 's/,/./') >= $(grep -c ^processor /proc/cpuinfo)" | bc) -eq 1 ] returns true if the current machine load is at least equal to the number of CPUs. If either of the tests returns true we wait 10 seconds and check again. If both tests return false, i.e. 2GB are available and machine load falls below number of CPUs, we start our command and save it's output in a text file. The ( ( ... ) & ) construct lets the command run in background even if we log out. See http://www.commandlinefu.com/commands/view/3115/ .

Update twitter with Perl

Requires Net::Twitter. Just replace the double quoted strings with the appropriate info.

Find the package that installed a command

Speaking alarm clock

This ran on a ubuntu box using espeak for speaking text with the bash shell. On a mac you should use 'say'. Also you can change your alarm interval and your snooze interval which are currently 8 hours and 1 minute. I would run this via cron yet it's easier to disable if you run it as a command like this :P

Advanced python tracing

Trace python statement execution and syscalls invoked during that simultaneously

Grep Recursively Through Single File Extension

Trac 0.12.2-stable

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using sed

Commands using sed (1,319) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using sed (1,319)

sorted by