Commands tagged sed sorted by votes

Commands tagged sed (376)

sorted by

subtraction between lines
This is sample output - yours may be different.
1

seq 1 3 20 | sed -n '1{h;d};H;x;s/\n/\t/p' | awk '{printf("%d - %d = %d\n", $2, $1, $2-$1)}'

kev · 2011-11-10 10:38:11 6
subtraction between lines

It's allways strange for me to see sed and awk in the same command line if you can avoid it
This is sample output - yours may be different.
1

seq 1 3 20 | awk '{ T[NR]=$1} END {for (i=1;i<=(NR-1);i++) print T[i+1],"-",T[i],"=" , T[i+1]-T[i]}'

benoit_c_lbn · 2011-11-13 10:36:18 6
Rebuild a Delimited File with a Unique Delimiter

Useful for CSV files. In the command, the file in question is comma delimited but contains double quoted fields containing commas and contains no @ symbols (as confirmed with http://www.commandlinefu.com/commands/view/9998/delimiter-hunting). This command converts the delimiting commas to @s while preserving the commas in the fields using the "uniqueString" to mark the ends of lines.
This is sample output - yours may be different.
1

sed 's/$/uniqueString/' file.old | sed 's/,/\n/g' | sed ':loop;/^\"[^\"]*$/N;s/\n/,/;/[^\"]$/t loop' | sed ':loop;N;s/\n/@/g;/uniqueString$/!b loop;s/uniqueString$//' > file.new

moogmusic · 2012-01-06 10:06:40 3
Top 20 commands in your bash history
This is sample output - yours may be different.
1

sed -e 's/[;|][[:space:]]*/\n/g' .bash_history | cut --delimiter=' ' --fields=1 | sort | uniq --count | sort --numeric-sort --reverse | head --lines=20

WissenForscher · 2012-02-17 23:34:16 5
Open the current project on Github by typing gh

Written for Mac OSX. When you are working in a project and want to open it on Github.com, just type "gh" and your default browser will open with the repo you are in. Works for submodules, and repo's that you don't own. You'll need to copy / paste this command into a gh.sh file, then create an alias in your bash or zsh profile to the gh.sh script. Detailed instructions here if you still need help: http://gist.github.com/1917716
This is sample output - yours may be different.
1

git remote -v | grep fetch | sed 's/$.*github.com$[:|/]$.*$.git (fetch)/\2/' | awk {'print "https://github.com/" $1'} | xargs open

brockangelo · 2012-04-15 20:48:46 20
Search google and show only urls

Get the first 10 google results form a querry, but showing only the urls from the results. Use + to search diferent terms, ex: commandlinefu+google . Show Sample Output
This is sample output - yours may be different.
```
$gg commandlinefu
http://www.commandlinefu.com/
http://twitter.com/#!/commandlinefu
http://twitter.com/#!/commandlinefu10
http://xkcd.com/196/
http://www.catonmat.net/blog/top-ten-one-liners-from-commandlinefu-explained/
http://www.makeuseof.com/tag/commandlinefu-amazing-collection-command-line-gems-linux-mac/
http://ankurs.com/2011/11/command-line-fu/
http://kresimirbojcic.com/2011/11/22/unix-command-line-fu.html
http://commandlinefu.uservoice.com/
http://samirahmed.github.com/fu/
```
1

gg(){ lynx -dump http://www.google.com/search?q=$@ | sed '/[0-9]*\..http:\/\/www.google.com\/search?q=related:/!d;s/...[0-9]*\..http:\/\/www.google.com\/search?q=related://;s/&hl=//';}

chon8a · 2012-04-21 03:31:26 6
Show crontabs for all users

This is flatcaps tweaked command to make it work on SLES 11.2
This is sample output - yours may be different.
1

for i in /var/spool/cron/tabs/*; do echo ${i##*/}; sed 's/^/\t/' $i; echo; done

harpo · 2012-07-12 08:07:20 4
Show git branches by date - useful for showing active branches
This is sample output - yours may be different.
1

git for-each-ref --sort='-authordate' --format='%(refname)%09%(authordate)' refs/heads | sed -e 's-refs/heads/--'

ptitfred · 2012-09-25 09:05:09 8
recursive search and replace old with new string, inside files

Search and replace recursively. :-) Shorter and simpler than the others. And allows more terms: replace old new [old new ...] -- `find -type f`
This is sample output - yours may be different.
1

replace old new -- `find -type f`

brian · 2012-12-13 20:22:17 6
Oneliner to get domain names list of all existing domain names (from wikipedia)

Quietly get a webpage from wikipedia: curl -s By default, don't output anything: sed -n Search for interesting lines: /<tr valign="top">/ With the matching lines: {} Search and replace any html tags: s/<[^>]*>//g Finally print the result: p Show Sample Output
This is sample output - yours may be different.
```
.aero
.asia
.biz
.cat
.com
.coop
.info
.int
.jobs
.mobi
.museum
... ETC
```
1

curl -s http://en.m.wikipedia.org/wiki/List_of_Internet_top-level_domains | sed -n '/<tr valign="top">/{s/<[^>]*>//g;p}'

flatcap · 2012-12-24 23:54:05 7
Put uppercase letters in curly brackets in a BibTeX database

It is often recommended to enclose capital letters in a BibTeX file in braces, so the letters will not be transformed to lower case, when imported from LaTeX. This is an attempt to apply this rule to a BibTeX database file. DO NOT USE sed '...' input.bib > input.bib as it will empty the file! How it works: /^\s*[^@%]/ Apply the search-and-replace rule to lines that start (^) with zero or more white spaces (\s*), followed by any character ([...]) that is *NOT* a "@" or a "%" (^@%). s=<some stuff>=<other stuff>=g Search (s) for some stuff and replace by other stuff. Do that globally (g) for all matches in each processed line. $[A-Z][A-Z]*$$[^}A-Z]\|},$$ Matches at least one uppercase letter ([A-Z][A-Z]*) followed by a character that is EITHER not "}" and not a capital letter ([^}A-Z]) OR (|) it actually IS a "}", which is followed by "," at the end of the line ($). Putting regular expressions in escaped parentheses ($ and $, respectively) allows to dereference the matched string later. {\1}\2 Replace the matched string by "{", followed by part 1 of the matched string (\1), followed by "}", followed by the second part of the matched string (\2). I tried this with GNU sed, only, version 4.2.1. Show Sample Output
This is sample output - yours may be different.
```
@ARTICLE{Duck06,
  author = {{D}onald {D}uck and {D}aisy {D}uck and {S}crooge {M}c{D}uck},
  title = {{T}he danger of magnetic storms for {D}uckburg},
  journal = {{D}uckburg {T}ribune},
  year = {2006},
  volume = {56},
  pages = {386--394},
  number = {2},
  month = {{A}ug},
  owner = {{D}ucky {D}uke}
}
```
1

sed '/^\s*[^@%]/s=$[A-Z][A-Z]*$$[^}A-Z]\|},$$={\1}\2=g' literature.bib > output.bib

michelsberg · 2013-01-15 22:24:17 10
display the hover text of the most recent xkcd

I look at xkcd in my news reader, but it displays the image's title attribute only for a few seconds which makes reading the longer ones more challenging. So I use this to display it in my console.
This is sample output - yours may be different.
1

curl -s 'http://xkcd.com/rss.xml' | xpath '//item[1]/description/text()' 2>&1 | sed -n 's/.*title="$[^"]*$".*/\1/p' | fold -s

putnamhill · 2013-02-16 22:38:26 7
Recursively search and replace old with new string, inside every instance of filename.ext

This is a slightly modified version of http://www.commandlinefu.com/commands/view/4283/recursive-search-and-replace-old-with-new-string-inside-files (which did not work due to incorrect syntax) with the added option to sed inside only files named filename.ext
This is sample output - yours may be different.
1

find . -type f -name filename.exe -exec sed -i "s/oldstring/oldstring/g" {} +;

eddieb · 2013-05-20 19:17:10 11
psgrepp

grep по ps aux
This is sample output - yours may be different.
1

ps aux | grep $(echo $1 | sed "s/^$.$/[\1]/g")

opexxx · 2013-07-16 10:10:51 6
Download all images from a 4chan thread

first grep all href images then sed the url part then wget
This is sample output - yours may be different.
1

curl -s $1 | grep -o -i '<a href="//images.4chan.org/[^>]*>' | sed -r 's%.*"//([^"]*)".*%\1%' | xargs wget

bugmenot · 2013-07-22 10:33:55 6
List your largest installed packages (on Debian/Ubuntu)

The other commands were good, but they included packages that were installed and then removed. This command only shows packages that are currently installed, sorts smallest to largest, and formats the sizes to be human readable. Show Sample Output
This is sample output - yours may be different.
```
0.021 MB         php5
0.025 MB         libjpeg8
0.025 MB         libjpeg-progs
0.025 MB         ttf-droid
0.026 MB         ubuntu-restricted-addons
0.028 MB         apache2
0.028 MB         libperl5.14
. . .
49.584 MB        thunderbird
142.796 MB       linux-image-3.2.0-49-generic
156.440 MB       google-chrome-stable
195.852 MB       nvidia-current
```
1

dpkg-query --show --showformat='${Package;-50}\t${Installed-Size}\n' `aptitude --display-format '%p' search '?installed!?automatic'` | sort -k 2 -n | grep -v deinstall | awk '{printf "%.3f MB \t %s\n", $2/(1024), $1}'

EvilDennisR · 2013-07-26 23:18:20 13
Get the current svn branch/tag (Good for PS1/PROMPT_COMMAND cases)

uses just one sed
This is sample output - yours may be different.
1

svn info | sed -n "/URL:/s/.*\///p"

massi · 2013-07-31 11:02:22 9
Search and replace in multiple files recursively

Replace "foo" with "bar" in all files in current directory recursively
This is sample output - yours may be different.
1

grep -lr "foo" . | xargs sed -i "s/foo/bar/g"

sergeylukin · 2013-10-28 13:02:47 10
Download latest NVIDIA Geforce x64 Windows driver

Download latest NVIDIA Geforce x64 Windows7-8 driver from Nvidia's website. Pulls the latest download version (which includes beta). This is the "English" version. The following command includes a 'sed' line to replace "english" with "international" if needed. You can also replace the starting subdomain with "eu." "uk." and others. Enjoy this one liner! 1 character under the max :) wget "us.download.nvidia.com$(wget -qO- "$(wget -qO- "nvidia.com/Download/processFind.aspx?psid=95&pfid=695&osid=19&lid=1&lang=en-us" | awk '/driverResults.aspx/ {print $4}' | cut -d "'" -f2 | head -n 1)" | awk '/url=/ {print $2}' | sed -e "s/english/international/" | cut -d '=' -f3 | cut -d '&' -f1)" Show Sample Output
This is sample output - yours may be different.
```
HTTP request sent, awaiting response... 200 OK
Length: 211183464 (201M) [application/octet-stream]
Saving to: ?331.82-desktop-win8-win7-winvista-64bit-english-whql.exe?
```
1

wget "us.download.nvidia.com$(wget -qO- "$(wget -qO- "nvidia.com/Download/processFind.aspx?psid=95&pfid=695&osid=19&lid=1&lang=en-us"|awk '/driverResults.aspx/ {print $4}'|cut -d "'" -f2|head -n 1)"|awk '/url=/ {print $2}'|cut -d '=' -f3|cut -d '&' -f1)"

lowjax · 2013-11-21 03:04:59 11
calculate how much bogomips one cpu core has (assuming you have 4 cores).

on some distro's you have to replace "BogoMIPS" with "bogomips". Show Sample Output
This is sample output - yours may be different.
```
#([04:33:58][root@fritz:~]#)cat /proc/cpuinfo | grep BogoMIPS | uniq | sed 's/^.*://g' | awk '{print($1 / 4) }'
52.8375
```
1

cat /proc/cpuinfo | grep BogoMIPS | uniq | sed 's/^.*://g' | awk '{print($1 / 4) }'

derpat · 2014-03-01 03:44:03 6
camelcase to underscore

Convert a camelCase string into snake_case. To complement senorpedro's command. Show Sample Output
This is sample output - yours may be different.
```
$ echo thisIsATest | sed -r 's/([A-Z])/_\L\1/g'
this_is_a_test
```
1

echo thisIsATest | sed -r 's/([A-Z])/_\L\1/g'

flatcap · 2014-04-11 13:36:08 11
Print the IP address and the Mac address in the same line

Print the IP address and the Mac address in the same line Show Sample Output
This is sample output - yours may be different.
```
mac:00:50:12:BD:5E:5B - adr:192.168.0.1
```
1

ifconfig | head -n 2 | tr -d '\n' | sed -n 's/.*$00:[^ ]*$.*$adr:[^ ]*$.*/mac:\1 - \2/p'

Koobiac · 2014-09-03 14:35:27 18

Parse compressed apache error log file and show top errors

credit shall fall to this for non-gzipped version: https://gist.github.com/marcanuy/a08d5f2d9c19ba621399 Show Sample Output

zanhsieh · 2014-09-24 05:26:24 8

Print the IPv4 address of a given interface
This is sample output - yours may be different.
1

ip a s eth0 | sed -nr 's!.*inet ([^/]+)/.*!\1!p'

swemarx · 2014-10-29 12:50:05 9
Change host name

With sed you can replace strings on the fly.
This is sample output - yours may be different.
1

sed -i 's/oldname/newname/' /etc/hosts /etc/hostname

adria · 2014-11-02 22:03:48 24
‹ First < 5 6 7 8 9 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Extract extention of a file

Create a git alias that will pull and fast-forward the current branch if there are no conflicts

This command will first add an alias known only to git, which will allow you to pull a remote and first-forward the current branch. However, if the remote/branch and your branch have diverged, it will stop before actually trying to merge the two, so you can back out the changes. http://www.kernel.org/pub/software/scm/git/docs/git-pull.html Tested on git 1.5.6.1, msysgit (Windows port) Actually this is not really the way I want it. I want it to attempt a fast-foward, but not attempt to merge or change my working copy. Unfortunately git pull doesn't have that functionality (yet?).

Truncate long strings in columns and use custom header names

Using the --table-truncate ( -T ) option, you can specify the columns you will allow to be truncated. This helps when you have some columns that are unusually long, or a small terminal window. In this example we will print out the /etc/passwd file in columns. We are using a colon as our separator ( -s: ), defining that we want table output ( -t ), defining the column names ( -N ) and allowing the column NAME to be truncated ( -T ).

Access to specific man page section

You can view the man pages from section five by passing the section number as an argument to the man command

Display top 5 processes consuming CPU

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

list files recursively by size

remote diff with side-by-side ordering.

more information: man sdiff

Show Shared Library Mappings

shows which shared lib files are pointed to by the dynamic linker.

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged sed

Commands tagged sed (376) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged sed (376)

sorted by