All commands

All commands (14,187)

sorted by

split a file by a specific number of lines

Splits the file "my_file" every 500 lines. Will create files called xx01 xx02 and so on. You can change the prefix by using the -f option. Comes in handy for splitting logfiles for example. I am using it for feeding a logfile parser with smaller files instead of one big file (due to performance reasons)
This is sample output - yours may be different.
1

csplit -k my_file 500 {*}

Bender · 2010-02-13 21:35:54 6
Url Encode

This one uses hex conversion to do the converting and is in shell/sed only (should probably still use the python/perl version).
This is sample output - yours may be different.
1

uri_escape(){ echo -E "$@" | sed 's/\\/\\\\/g;s/./&\n/g' | while read -r i; do echo $i | grep -q '[a-zA-Z0-9/.:?&=]' && echo -n "$i" || printf %%%x \'"$i" done }

infinull · 2010-02-13 01:39:51 41
Url Encode

Converts reserved characters in a URI to their percent encoded counterparts. Alternate python version: echo "$url" | python -c 'import sys,urllib;print urllib.quote(sys.stdin.read().strip())' Show Sample Output
This is sample output - yours may be different.
```
$ echo "this & that" | perl -MURI::Escape -ne 'chomp;print uri_escape($_),"\n"'
this%20%26%20that

$ echo "this & that" | python -c 'import sys,urllib;print urllib.quote(sys.stdin.read().strip())'
this%20%26%20that
```
7

echo "$url" | perl -MURI::Escape -ne 'chomp;print uri_escape($_),"\n"'

eightmillion · 2010-02-13 00:44:48 32
Url Encode
This is sample output - yours may be different.
2

echo "$@" | sed 's/ /%20/g;s/!/%21/g;s/"/%22/g;s/#/%23/g;s/\$/%24/g;s/\&/%26/g;s/'\''/%27/g;s/(/%28/g;s/)/%29/g;s/:/%3A/g'

matthewbauer · 2010-02-12 23:59:55 42
This allows you to find a string on a set of files recursivly

The -r is for recursive, -F for fixed strings, --include='*.txt' identifies you want all txt files to be search any wildcard will apply, then the string you are looking for and the final * to ensure you go through all files and folders within the folder you execute it. Show Sample Output
This is sample output - yours may be different.
```
maxleonca@lab:~$ grep -rF --include='*.txt' Tel *
apartamentos.txt:Tel?fono de habitaci?n: 2582-0391
apartamentos.txt:Tel?fono del celular: 8815-7608
apartamentos.txt:Tels:
Documents/RubyStart/vendor/rails/railties/doc/guides/source/security.txt:-- _Tell Rails not to put passwords in the log files._
Documents/RubyStart/vendor/railties/doc/guides/source/security.txt:-- _Tell Rails not to put passwords in the log files._
Documents/gutierrez_gongora.txt:Horarios y N?meros de Tel?fono
Documents/gutierrez_gongora.txt:Tel?fonos: 2225-6181 / 8395-5083
```
1

grep -rF --include='*.txt' stringYouLookFor *

maxleonca · 2010-02-12 18:07:07 4
Extract URL from SVN working copy

Can be used in a working copy to output the URL (extracted from svn info), or as part of another function, as $(svnurl some/path). Saves a lot of time in my SVN workflow.
This is sample output - yours may be different.
0

function svnurl() { svn info $1 | egrep '^URL: (.*)' | sed s/URL\:\ //; }

thebuckst0p · 2010-02-12 15:42:54 3
Bold matching string without skipping others
This is sample output - yours may be different.
-1

sed 's/pattern/^[[1m&^[[0m/g'

rmcb · 2010-02-12 14:05:34 3
ffmpeg command that transcodes a MythTV recording for Google Nexus One mobile phone

This command will transcode a MythTV recording. The target device is a Google Nexus One mobile phone. My recordings are from a HDHomerun with Over The Air content. Plays back nicely on the N1.
This is sample output - yours may be different.
2

ffmpeg -i /var/lib/mythtv/pretty/Chuck20100208800PMChuckVersustheMask.mpg -s 800x480 -vcodec mpeg4 -acodec libfaac -ac 2 -ar 16000 -r 13 -ab 32000 -aspect 16:9 Chuck20100208800PMChuckVersustheMask.mp4

PLA · 2010-02-12 12:11:02 7
convert a line to a space
This is sample output - yours may be different.
2

echo $(cat file)

tlacuache · 2010-02-11 19:07:44 6
convert a line to a space

The first version printed: tr: empty string2 The second version printed: sed: -i may not be used with stdin Maybe I misunderstood the orginal problem.
This is sample output - yours may be different.
0

sed 's/.*/ /'

putnamhill · 2010-02-11 17:45:56 3
Update all packages installed via homebrew

More information about what homebrew is all about: http://github.com/mxcl/homebrew
This is sample output - yours may be different.
-6

brew update && brew install `brew outdated`

zeroathome · 2010-02-11 12:17:24 8
convert a line to a space
This is sample output - yours may be different.
4

cat file | tr '\n' ''

bortoelnino · 2010-02-11 07:30:29 8

Geo Weather

This command will determine an individuals local weather, based on their I.P. address. I had to learn a lot about SED and a little about XMLStarlet in order to achieve this. This command is my original work and there is much room for improvement; I look forward to any constructive feedback. Show Sample Output

xmlstarlet fo "http://www.google.com/ig/api?weather=$(curl -s api.hostip.info/get_html.php?ip=$(curl -s icanhazip.com)... SEE SAMPLE OUTPUT

o0110o · 2010-02-11 06:32:44 5

Create a series of incrementing numbers in vim

given lines of the form 123|XXXX|1000 ... 123|XXXX|1011 each 'XXXX' will be replaced with a serial number between 0001 and 0004. Show Sample Output
This is sample output - yours may be different.
```
123|XXXX|1000
123|XXXX|1001
123|XXXX|1010
123|XXXX|1011
---
123|0001|1000
123|0002|1001
123|0003|1010
123|0004|1011
```
0

:.,$!perl -pne 'for $i ("0001".."0004"){ s/XXXX/$i/ if($i == $.) }'

bartonski · 2010-02-11 03:56:26 8
Get Google Reader unread count

Get Google Reader unread count from the command line. You'll have to define your auth token with $auth Or use: curl -s -H "Authorization: GoogleLogin auth=$(curl -sd "Email=$email&Passwd=$password&service=reader" https://www.google.com/accounts/ClientLogin | grep Auth | sed 's/Auth=$.*$/\1/')" "http://www.google.com/reader/api/0/unread-count?output=json" | tr '{' '\n' | sed 's/.*"count":$[0-9]*$,".*/\1/' | grep -E ^[0-9]+$ | tr '\n' '+' | sed 's/$.*$+/\1\n/' | bc Show Sample Output
This is sample output - yours may be different.
```
33
```
-1

curl -s -H "Authorization: GoogleLogin auth=$auth" "http://www.google.com/reader/api/0/unread-count?output=json" | tr '{' '\n' | sed 's/.*"count":$[0-9]*$,".*/\1/' | grep -E ^[0-9]+$ | tr '\n' '+' | sed 's/$.*$+/\1\n/' | bc

matthewbauer · 2010-02-11 00:42:57 7
Clean way of re-running bash startup scripts.

This replaces the current bash session with a new bash session, run as an interactive non-login shell... useful if you have changed /etc/bash.bashrc, or ~/.bashrc If you have changed a startup script for login shells, use exec bash -l Suitable for re-running /etc/profile, ~/.bash_login and ~/.profile. edit: chinmaya points out that env - HOME=$HOME TERM=$TERM bash -s "exec bash -l" will clear any shell variables which have been set... since this verges on unwieldy, might want to use alias bash_restart='env - HOME=$HOME TERM=$TERM bash -s "exec bash -l"'
This is sample output - yours may be different.
4

exec bash

bartonski · 2010-02-10 18:51:26 18
split a multi-page PDF into separate files

Simple alternative to the previous submitted one
This is sample output - yours may be different.
8

pdftk in.pdf burst

rodolfoap · 2010-02-10 13:31:36 15
split a multi-page PDF into separate files

Have to do this once per output file, because if device is 'pdfwrite', even if 'gs' sees '%d' in the OutputFile it still only creates one single output file. Embed it into a simple shell script if you want to split a document out into one file for every page.
This is sample output - yours may be different.
4

gs -dBATCH -dNOPAUSE -sDEVICE=pdfwrite -dFirstPage=2 -dLastPage=2 -sOutputFile=page2.pdf multipageinputfile.pdf

drewbenn · 2010-02-10 08:48:48 4
List users with running processes

This is different that `who` in that who only cares about logged-in users running shells, this command will show all daemon users and what not; also users logged in remotely via SSH but are running SFTP/SCP only and not a shell. Show Sample Output
This is sample output - yours may be different.
```
avahi
dbus
hal
mark
mysql
```
1

ps aux | sed -n '/USER/!s/$[^ ]$ .*/\1/p' | sort -u

infinull · 2010-02-10 05:56:26 5

Get the weather forecast for the next 24 to 48 for your location.

This shell function grabs the weather forecast for the next 24 to 48 hours from weatherunderground.com. Replace <YOURZIPORLOCATION> with your zip code or your "city, state" or "city, country", then calling the function without any arguments returns the weather for that location. Calling the function with a zip code or place name as an argument returns the weather for that location instead of your default. To add a bit of color formatting to the output, use the following instead: weather(){ curl -s "http://api.wunderground.com/auto/wui/geo/ForecastXML/index.xml?query=${@:-<YOURZIPORLOCATION>}"|perl -ne '/<title>([^<]+)/&&printf "\x1B[0;34m%s\x1B[0m: ",$1;/<fcttext>([^<]+)/&&print $1,"\n"';} Requires: perl, curl Show Sample Output

weather(){ curl -s "http://api.wunderground.com/auto/wui/geo/ForecastXML/index.xml?query=${@:-<YOURZIPORLOCATION>}"|perl -ne '/<title>([^<]+)/&&printf "%s: ",$1;/<fcttext>([^<]+)/&&print $1,"\n"';}

eightmillion · 2010-02-10 01:23:39 16

Function to split a string into an array
This is sample output - yours may be different.
0

Split() { SENT=${*} ; sentarry=( ${SENT} ) ; while [[ ${#sentarry[@]} -gt 0 ]] ; do printf "%s\n" "${sentarry[0]}" ; sentarry=( ${sentarry[@]:1} ) ; done ; }

unixhome · 2010-02-09 20:32:56 3
get detailed info about a lan card on HP-UX 11.31
This is sample output - yours may be different.
1

nwmgr -q info -c lan0

jreypo · 2010-02-09 16:19:18 3
Extend a logical volume to use up all the free space in a volume group
This is sample output - yours may be different.
8

lvextend -l +100%FREE /dev/VolGroup00/LogVol00

bortoelnino · 2010-02-09 07:06:54 8
Weather on the Command line

Will return temperature in Fahrenheit of a location (New York City in example). Uses a Google API. Show Sample Output
This is sample output - yours may be different.
```
35
```
-1

curl -s "http://www.google.com/ig/api?weather=New%20York" | sed 's|.*<temp_f data="$[^"]*$"/>.*|\1|'

matthewbauer · 2010-02-08 23:06:48 5
Function to split a string into an array

It works as a method applicated to a variable, converts the string variable into an array Show Sample Output
This is sample output - yours may be different.
```
Example usage :
$ TEST="jhfz:lkhf :lhf:h0258:r"
$ Split TEST ":"
$ echo ${TEST[@]}
"jhfz" "lkhf " "lhf" "h0258" "r"
```
1

Split() { eval "$1=( \"$(echo "${!1}" | sed "s/$2/\" \"/g")\" )"; }

frans · 2010-02-08 17:41:59 5
‹ First < 400 401 402 403 404 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Do some learning...

I like it sorted... 2> /dev/null was also needless, since our pipes already select stdin, only.

concatenate compressed and uncompressed logs

I use zgrep because it also parses non gzip files. With ls -tr, we parse logs in time order. Greping the empty string just concatenates all logs, but you can also grep an IP, an URL...

Find the package that installed a command

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

Show used disk space:

Replace Solaris vmstat numbers with human readable format

% cat ph-vmstat.awk # Return human readable numbers function hrnum(a) { b = a ; if (a > 1000000) { b = sprintf("%2.2fM", a/1000000) ; } else if (a > 1000) { b = sprintf("%2.2fK", a/1000) ; } return(b) ; } # Return human readable storage function hrstorage(a) { b = a ; if (a > 1024000) { b = sprintf("%2.2fG", a/1024/1024) ; } else if (a > 1024) { b = sprintf("%2.2fM", a/1024) ; } return(b) ; } OFS=" " ; $1 !~ /[0-9].*/ {print} $1 ~ /[0-9].*/ { $4 = hrstorage($4) ; $5 = hrstorage($5) ; $9 = hrnum($9) ; $10 = hrnum($10) ; $17 = hrnum($17) ; $18 = hrnum($18) ; $19 = hrnum($19) ; print ; }

Schedule a script or command in x num hours, silently run in the background even if logged out

doesn't require "at", change the "2h" to whatever you want... (deafult unit for sleep is seconds)

Generate random valid mac addresses

Python Alternative

view hex mode in vim

Perform a C-style loop in Bash.

Print 0 through 99, each on a separate line.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)

All commands (14,187) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

All commands (14,187)

sorted by