Commands using sed sorted by votes

Commands using sed (1,319)

sorted by

Extract URLs from all anchors inside an HTML document with sed and grep

Extract all href links from an HTML document with sed and grep Show Sample Output
This is sample output - yours may be different.
```
#
./index.html
./index2.html
http://www.google.com
./ipl.html
```
0

cat index.html | grep -o '<a .*href=.*>' | sed -e 's/<a /\n<a /g' | sed -e 's/<a .*href=['"'"'"]//' -e 's/["'"'"'].*$//' -e '/^$/ d'

crisboot · 2012-08-06 10:31:38 7
detect partitions
This is sample output - yours may be different.
0

sudo file -bs /dev/sda | sed -e 's/.*partition 1$.*$ code offset.*/partition 1\1/g' -e 's/$.$;/\1\n/g'

jlaunay · 2012-08-17 12:54:05 5
Network Interfaces

Linux only Show Sample Output
This is sample output - yours may be different.
```
lo
eth0
```
0

awk '{print $1}' /proc/net/dev|grep :|sed "s/:.*//g"

kro · 2012-08-17 13:36:47 56
Replace nelines with spaces
This is sample output - yours may be different.
0

sed -e :a -e '$!N;s/\n/ /;ta'

T4b · 2012-08-21 09:45:16 6
Generate a Random (unicast) MAC address

- The last sed expression ensures the unicast/multicast bit is set to zero - The greedy space replacements are for portability across UNIX seds (note there's TWO spaces and not just one, as this web shows, in s/^ */) Show Sample Output
This is sample output - yours may be different.
```
e0:91:cd:46:f8:18
```
0

od -An -N6 -tx1 /dev/urandom | sed -e 's/^ *//' -e 's/ */:/g' -e 's/:$//' -e 's/^$.$[13579bdf]/\10/'

outly3r · 2012-08-31 13:15:03 8
Find highest context switches

This command will find the highest context switches on a server and give you the process listing. Show Sample Output
This is sample output - yours may be different.
```
Context Switches: 1097211 - Process : [migration/12]
Context Switches: 1500058 - Process : [migration/10]
Context Switches: 1558813 - Process : [migration/13]
Context Switches: 2207748 - Process : [migration/11]
Context Switches: 2516720 - Process : /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --log-error=/var/lib/mysql/server.err --open-files-limit=12288 --pid-file=/var/lib/mysql/server.pid
```
0

grep -H voluntary_ctxt /proc/*/status |gawk '{ split($1,proc,"/"); if ( $2 > 10000000 ) { printf $2 " - Process : "; system("ps h -o cmd -p "proc[3]) } }' | sort -nk1,1 | sed 's/^/Context Switches: /g'

jperkster · 2012-09-01 19:43:47 54
Short Information about loaded kernel modules
This is sample output - yours may be different.
0

lsmod | tail -n +2 | cut -d' ' -f1 | xargs modinfo | egrep '^file|^desc|^dep' | sed -e'/^dep/s/$/\n/g'

vlaad · 2012-09-03 17:59:49 4
Easy way to display yum repo priorities

This probably only works without modifications in RHEL/CentOS/Fedora. Show Sample Output
This is sample output - yours may be different.
```
priority = 1 [asl-3.0]
priority = 1 [asl-3.0-testing]
priority = 1 [base]
priority = 1 [virtualmin]
priority = 1 [virtualmin-universal]
priority = 50 [epel]
```
0

sed -n -e "/^\[/h; /priority *=/{ G; s/\n/ /; s/ity=/ity = /; p }" /etc/yum.repos.d/*.repo | sort -k3n

eddieb · 2012-09-06 00:09:09 5
Get Current CPU Usage

Get the current cpu % usage on your system. Show Sample Output
This is sample output - yours may be different.
```
13.50
```
0

top -n2 -d 0.5 | grep ^Cpu | sed 's/[[:alpha:]%]*//g' | awk 'NR == 2 {printf("%.2f\n",100-$5)}'

wizzra · 2012-09-06 12:56:26 5
replace dots in filenames with dashes, using sed

This command can rename all files in a folder changing all the dots in the filename for dashes, but respecting the final dot for the extension. Show Sample Output
This is sample output - yours may be different.
```
Image.1.2.png --> Image-1-2.png
```
0

for f in *; do fn=`echo $f | sed 's/$.*$\.$[^.]*$$/\1\n\2/;s/\./-/g;s/\n/./g'`; mv $f $fn; done

conradolandia · 2012-09-29 02:10:00 8

Extract list of packages installed on one server and generate 'apt' command to install them on a new server

This is sample output - yours may be different.

apt-get install acl adduser anthy-common apt apt-utils aptitude authbind avahi-daemon base-files base-passwd bash bind9-host binutils bsdmainutils bsdutils busybox bzip2 ca-certificates ca-certificates-java collectd collectd-core coreutils cpio cpp cpp-4.4 cron curl dash dbus debconf debconf-i18n debian-archive-keyring debianutils deborphan defoma dhcpcd dialog diffutils dmidecode dmsetup dnsutils dpkg dstat e2fslibs e2fsprogs emacs emacs23 emacs23-bin-common emacs23-common emacsen-common fancontrol file findutils firmware-linux-free fontconfig fontconfig-config fping gcc gcc-4.4 gcc-4.4-base gconf2-common geoip-database gettext-base gnupg gpgv grep groff-base grub grub-common grub-pc gsfonts gsfonts-x11 gzip hicolor-icon-theme hostname htop ifupdown info initramfs-tools initscripts insserv install-info iproute iptables iputils-ping java-common joe klibc-utils less lftp libaccess-bridge-java libaccess-bridge-java-jni libacl1 libanthy0 libasound2 libasyncns0 libatk1.0-0 libatk1.0-data libattr1 libavahi-client3 libavahi-common-data libavahi-common3 libavahi-core7 libbind9-60 libblkid1 libboost-iostreams1.42.0 libbsd0 libbz2-1.0 libc-bin libc-dev-bin libc6 libc6-dev libcairo2 libcap-ng0 libcap2 libcomerr2 libcommons-collections3-java libcommons-dbcp-java libcommons-pool-java libcroco3 libcups2 libcurl3 libcurl3-gnutls libcurses-perl libcurses-ui-perl libcwidget3 libdaemon0 libdatrie1 libdb4.7 libdb4.8 libdbi0 libdbi1 libdbus-1-3 libdbus-glib-1-2 libdevmapper1.02.1 libdns69 libecj-java libedit2 libept1 libesmtp6 libevtlog0 libexpat1 libflac8 libfont-freetype-perl libfontconfig1 libfontenc1 libfreetype6 libfribidi0 libgcc1 libgconf2-4 libgcrypt11 libgd2-noxpm libgdbm3 libgeoip1 libgif4 libglib2.0-0 libglib2.0-data libgmp3c2 libgnutls26 libgomp1 libgpg-error0 libgpm2 libgsf-1-114 libgsf-1-common libgssapi-krb5-2 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common libhal1 libice-dev libice6 libidl0 libidn11 libisc62 libisccc60 libisccfg62 libjasper1 libjpeg62 libk5crypto3 libkeyutils1 libklibc libkrb5-3 libkrb5support0 liblcms1 libldap-2.4-2 liblocale-gettext-perl liblockfile1 libltdl7 liblua5.1-0 liblwres60 liblzma2 libm17n-0 libmagic1 libmemcached10 libmodbus5 libmpfr4 libmysqlclient16 libncurses5 libncursesw5 libnet-snmp-perl libnet1 libnewt0.52 libnfnetlink0 libnl1 libnspr4-0d libnss-mdns

dpkg --list | rgrep ii | cut -d" " -f3 | sed ':a;N;$!ba;s/\n/ /g' | sed 's/^$.$/apt-get install \1/'

pablor44 · 2012-10-16 07:51:18 4

Compares two source directories, one original and one post configure and deletes the differences in the source folder

Good for when your working on building a clean source install for RPM packaging or what have you. After testing, run this command to compare the original extracted source to your working source directory and it will remove the differences that are created when running './configure' and 'make'.
This is sample output - yours may be different.
0

diff ../source-dir.orig/ ../source-dir.post/ | grep "Only in" | sed -e 's/^.*\:.$\<.*\>$/\1/g' | xargs rm -r

bigc00p · 2012-10-17 14:12:32 9

find geographical location of an ip address

Tries to avoid the fragile nature of scrapers by looking for user-input in the output as opposed to markup or headers on the web site. Show Sample Output

function ip-where { wget -qO- -U Mozilla http://www.ip-adress.com/ip_tracer/$1 | html2text -nobs -style pretty | sed -n /^$1/,/^$/p;}

tox2ik · 2012-10-22 21:39:53 5

Get Lorum Ipsum random text from lorumipsum.com

This fixes the extra lines you get when you request only 1 paragraph using a little bit of grep. Just set p to the number of paragraphs you want. Show Sample Output

p=1 ; lynx -source http://www.lipsum.com/feed/xml?amount=${p} | grep '<lipsum>' -A$(((p-1))) | perl -p -i -e 's/\n/\n\n/g' | sed -n '/<lipsum>/,/<\/lipsum>/p' | sed -e 's/<[^>]*>//g'

nublaii · 2012-10-24 14:11:52 4

List prime numbers from 2 to 100
This is sample output - yours may be different.
0

seq 2 100 | factor | sed '/ .* / d ; s/:.*//'

misof · 2012-10-25 15:19:35 4
comment / uncomment a line in a file using sed.

Show Sample Output
This is sample output - yours may be different.
```
comment:
$ sed -i 's/blah.*/#&/g' file.txt 
$ cat file.txt 
dugh
#blah
adfas
sdfkb
#blah
asdfkk
#blah

uncomment:
$ sed -i 's/.$blah*.$/\1/g' file.txt
$cat file.txt 
dugh
blah
adfas
sdfkb
blah
asdfkk
blah
```
0

(comment:) $ sed -i 's/blah.*/#&/g' file.txt (uncomment:) $ sed -i 's/.$blah*.$/\1/g' file.txt

omatictost · 2012-10-25 16:00:29 221
Pipe system log to espeak
This is sample output - yours may be different.
0

tail -f /var/log/messages.log | while read line ; do echo $line | cut -d \ -f5- | sed s/\\[[0-9]*\\]// | espeak ; done

asdfkajsdfh · 2012-10-27 23:00:53 4
Get external IP address

Retrieves the current WAN ipv4 address via checkip.dyn.com. Show Sample Output
This is sample output - yours may be different.
```
71.128.35.100
```
0

curl -qsL http://checkip.dyn.com | sed -E "s/^.*Address: ([0-9\.]+).*$/\1/"

wafflesnatcha · 2012-10-28 22:20:50 3
Remove lines ending or trailing slash (/)
This is sample output - yours may be different.
0

sed -i 'g/text/d' <filename>

vishnu81 · 2012-10-31 11:55:22 7
list uniq extensions of files from the current directory

find files recursively from the current directory, and list the extensions of files uniquely Show Sample Output
This is sample output - yours may be different.
```
bak
bat
cfg
conf
csv
doc
exe
exe_back
pyc
sql
txt
xls
```
0

find . -type f |egrep '^./.*\.' |sed -e "s/$^.*\.$$.*$$/\2/" |sort |uniq

dvst · 2012-11-12 17:17:55 8
Convert metasploit cachedump files to Hashcat format for cracking
This is sample output - yours may be different.
0

cd ~/.msf4/loot && cat *mscache* | cut -d '"' -f 2,4 | sed s/\"/\:/g | tr -cd '\11\12\40-\176' | grep -v Username | cut -d : -f 1,2 | awk -F':' '{print $2,$1}' | sed 's/ /:/g' > final.dcc.hash

purehate · 2012-11-26 02:10:08 6
Remove UTF-8 Byte Order Mark BOM
This is sample output - yours may be different.
0

find . -type f -regex '.*html$' -exec sed -i 's/\xEF\xBB\xBF//' '{}' \;

olekhy · 2012-11-26 09:56:00 4
get svn log by the user
This is sample output - yours may be different.
0

svn log -l1000 SVN_URL | sed -n '/USERNAME/,/-----$/ p'

olekhy · 2012-11-28 19:11:20 5
Screenshot in $1 seconds, upload and retrieve URI from ompdlr.org

Take a screenshot, give $1 seconds pause to choose what to screenshot, then upload and get URI of post in ompdlr.org Show Sample Output
This is sample output - yours may be different.
```
$ scrotit(){ echo "Screenshot in $1 seconds...";scrot -d $1 '%Y%m%d%h.png' -e 'curl -sF file1=@- http://ompldr.org/upload < $f | grep -P -o "(?<=File:).*(http://ompldr.org/.*)\<\/a\>";rm $f'| sed -r 's@.*(http://ompldr.org/\w{1,7}).*@\1@';}
$ scrotit 5
Sreenshot in 5 seconds...
http://ompldr.org/vZ2pqaQ
$
```
0

scrotit(){ echo "Screenshot in $1 seconds...";scrot -d $1 '%Y%m%d%h.png' -e 'curl -sF file1=@- http://ompldr.org/upload < $f | grep -P -o "(?<=File:).*(http://ompldr.org/.*)\<\/a\>";rm $f'| sed -r 's@.*(http://ompldr.org/\w{1,7}).*@\1@';}

dzup · 2012-12-03 01:21:19 4
Download the last most popular 20 pictures from 500px

This command downloads the actual 20 most popular pictures from the website 500px. It uses a random name due to the fact the the pictures in 500px are stored with the same name. UPDATED: doesn't work if no referrer is specified: --referer='http://500px.com/'
This is sample output - yours may be different.
0

for line in `wget --referer='http://500px.com/' --quiet -O- http://500px.com/popular | grep "from=popular" | sed -n 's/.*<img src="$[^"]*$".*/\1/p' | sed s/"3.jpg"/"4.jpg"/ | sed s/"?t".*$//`; do wget -O $RANDOM.jpg --quiet "$line"; done

bugmenot · 2012-12-07 16:14:36 5
‹ First < 32 33 34 35 36 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Get a range on line with sed (first two)

Get the two first lines of a file and quit.

List open sockets protocol/address/port/state/PID/program name

Create a local compressed tarball from remote host directory

The command uses ssh(1) to get to a remote host, uses tar(1) to archive a remote directory, prints the result to STDOUT, which is piped to gzip(1) to compress to a local file. In other words, we are archiving and compressing a remote directory to our local box.

Save man pages to pdf

import gpg key from the web

imports a public key from the web. I know this by head.. but useful nevertheless

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

quickly change all .html extensions on files in folder to .htm

Brute force discover

Show the number of failed tries of login per account. If the user does not exist it is marked with *.

Find the package that installed a command

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using sed

Commands using sed (1,319) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using sed (1,319)

sorted by