Hide

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again.

Delete that bloated snippets file you've been using and share your personal repository with the world. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Get involved!

You can sign-in using OpenID credentials, or register a traditional username and password.

OpenID
or
Sign in Register

First-time OpenID users will be automatically assigned a username which can be changed after signing in.

Universal configuration monitoring and system of record for IT.
Hide

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

Hide

News

May 19, 2015 - A Look At The New Commandlinefu
I've put together a short writeup on what kind of newness you can expect from the next iteration of clfu. Check it out here.
March 2, 2015 - New Management
I'm Jon, I'll be maintaining and improving clfu. Thanks to David for building such a great resource!
Hide

Top Tags


awk, bash, curl, find, grep, Linux, sed
Hide

Functions

Hide

Credits

Maintained by Jon H.

Site originally by David Winterbottom (user root).

Psst. Open beta.

Wow, didn't really expect you to read this far down. The latest iteration of the site is in open beta. It's a gentle open beta-- not in prime-time just yet. It's being hosted over at UpGuard (link) and you are more than welcome to give it a shot. Couple things:

  • » The open beta is running a copy of the database that will not carry over to the final version. Don't post anything you don't mind losing.
  • » If you wish to use your user account, you will probably need to reset your password.
Your feedback is appreciated via the form on the beta page. Thanks! -Jon & CLFU Team

Commands tagged perl from sorted by
Terminal - Commands tagged perl - 177 results
diff <(perl -wpl -e '$_ =~ s/^\s+|\s+$//g ;' file1) <(perl -wpl -e '$_ =~ s/^\s+|\s+$//g ;' file2)
2010-10-06 19:14:42
User: jemptymethod
Functions: diff perl
Tags: bash diff perl
2
Up
Down
diff files while disregarding indentation and trailing white space

**NOTE** Tekhne's alternative is much more succinct and its output conforms to the files actual contents rather than with white space removed

My command on the other hand uses bash process substitution (and "Minimal" Perl), instead of files, to first remove leading and trailing white space from lines, before diff'ing the streams. Very useful when differences in indentation, such as in programming source code files, may be irrelevant

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
find . -iname '*.jpg' -type f -print0 |perl -0 -ne '$a+=-s $_;END{print "$a\n"}'
2010-09-12 13:14:12
User: unixmonkey10455
Functions: find perl
Tags: size perl find du filesize
1
Up
Down
Summarize size of all files of given type in all subdirectories (in bytes)

This deals nicely with filenames containing special characters and can deal with more files than can fit on a commandline. It also avoids spawning du.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
perl -le 'chomp($w=`which $ARGV[0]`);$_=`file $w`;while(/link\b/){chomp($_=(split/`/,$_)[1]);chop$_;$w.=" -> $_";$_=`file $_`;}print "\n$w";' COMMAND_NAME
2010-07-30 19:26:35
User: dbbolton
Functions: perl
Tags: which perl binary file PATH command
0
Up
Down
Show full path followed by a command

This will show you any links that a command follows (unlike 'file -L'), as well as the ultimate binary or script.

Put the name of the command at the very end; this will be passed to perl as the first argument.

For obvious reasons, this doesn't work with aliases or functions.

Show sample output | Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
echo "text" | hd
2010-07-20 15:40:52
User: Vilemirth
Functions: echo
Tags: perl hex ascii
1
Up
Down
Convert ascii string to hex
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
echo "text" | od -t x1
2010-07-14 14:53:25
User: max_allan
Functions: echo od
Tags: perl hex ascii
0
Up
Down
Convert ascii string to hex

Just use "od" and it can also dump in decimal or octal.

(use -t x1 and not just -x or it confuses the byte order)

There is a load of other formatting options, I'm not sure if you can turn off the address at the start of the line.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
echo -n 'text' | perl -pe 's/(.)/sprintf("\\x%x", ord($1))/eg'
2010-07-14 12:20:42
User: putnamhill
Functions: echo perl
Tags: perl hex ascii
1
Up
Down
Convert ascii string to hex

Here's a version that uses perl. If you'd like a trailing newline:

perl -pe 's/(.)/sprintf("\\x%x", ord($1))/eg; END {print "\n"}'
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
perl -e 'print "\x41\x72\x74\x20\x6f\x66\x20\x68\x61\x63\x6b\x69\x6e\x67\x2e\x2e\x2e\n" x 100'
2010-07-11 16:32:00
User: gunslinger_
Functions: perl
Tags: perl shellcode
-15
Up
Down
Art of hacking on perl

Print "Art of hacking..." 100 times by perl

or you can this tools : http://packetstormsecurity.org/shellcode/shellcodeencdec.py.txt

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
cat file_with_tabs.txt | perl -pe 's/\t/ /g'
2010-07-11 13:01:22
User: nikc
Functions: cat perl
Tags: cat perl replace
-3
Up
Down
Replace tabs with spaces in file

Replaces tabs in output with spaces. Uses perl since sed seems to work differently across platforms.

Comments (4) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
perl -MNet::Twitter -e '$nt = Net::Twitter->new(traits => [qw/API::REST/], username => "YOUR USERNAME", password => "YOUR PASSWORD"); $ud = $nt->update("YOUR TWEET");'
2010-06-16 19:46:05
User: dbbolton
Functions: perl
Tags: net twitter perl update tweet
2
Up
Down
Update twitter with Perl

Requires Net::Twitter. Just replace the double quoted strings with the appropriate info.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
git log -p -z | perl -ln0e 'print if /[+-].*searchedstring/'
2010-06-13 07:41:22
User: takeshin
Functions: perl
Tags: git perl log search
1
Up
Down
See all the commits for which searchstring appear in the git diff
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
aptitude purge linux-image | grep ^i | grep -v $(uname -r)
2010-06-11 22:20:42
User: lgallardo
Functions: grep uname
Tags: Debian Linux perl kernel aptitude
-4
Up
Down
Remove all unused kernels with apt-get
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
perl -e 'chomp($k=`uname -r`); for (</boot/vm*>) {s/^.*vmlinuz-($k)?//; $l.="linux-image-$_ ";} system "aptitude remove $l";'
2010-06-10 22:16:47
User: dbbolton
Functions: perl
Tags: Debian Linux perl kernel aptitude
1
Up
Down
Remove all unused kernels with apt-get

TIMTOWTDI

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
for code in $(find . -type f -name '*.p[ml]'); do perl -c "$code"; done
2010-05-29 23:26:40
User: udog
Functions: find perl
Tags: perl directory syntax
0
Up
Down
Check syntax of all Perl modules or scripts underneath the current directory

Finds all *.p[ml]-files and runs a perl -c on them, checking whether Perl thinks they are syntactically correct

Show sample output | Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
perl -e 'foreach (@ARGV) [email protected]=stat($_); print localtime($T[8])." - ".$_."\n"}'
2010-05-20 16:19:17
User: putnamhill
Functions: perl
Tags: perl solaris ls file time
0
Up
Down
Print time and year of file in Solaris (or other Unix ls command that does not have a simple
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
perl -e [email protected] = `ls -1`;while (<@F>)[email protected] = stat($_);print "$_ = " . localtime($T[8]) . "\n";}'
2010-05-20 15:02:51
User: hckhckhck
Functions: perl
Tags: perl solaris ls file time
0
Up
Down
Print time and year of file in Solaris (or other Unix ls command that does not have a simple "--full-list")

Solaris 'ls' command does not have a nice '--full-time' arg to make the time show after a year has passed. So I spit this out quick. It hates spaces in file names.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
perl -MDigest::SHA -e 'print substr( Digest::SHA::sha256_base64( time() ), 0, $ARGV[0] ) . "\n"' <length>
2010-04-30 21:45:46
User: udog
Functions: perl
Tags: perl password random base64 sha256
1
Up
Down
Produce a pseudo random password with given length in base 64

Of course you will have to install Digest::SHA and perl before this will work :)

Maximum length is 43 for SHA256. If you need more, use SHA512 or the hexadecimal form: sha256_hex()

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
echo $hex | perl -pe 's/(..)/chr(hex($1))/ge'
2010-04-17 16:24:48
User: dfaulkner
Functions: echo perl
Tags: perl strings hex ascii convert
0
Up
Down
convert a string of hex characters into ascii chars
Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
perl -i -pe 's/\r/\n/g' file
2010-04-16 13:25:09
User: octopus
Functions: perl
Tags: Linux perl unix
0
Up
Down
Legacy MacOS to Unix text convert using perl
Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
perldoc perllocal
2010-04-14 10:57:56
User: octopus
Tags: version perl
3
Up
Down
List all installed PERL modules by CPAN

This command will give you the detailed information about the installed perl modules i.e. installed path, Link type, version, files etc.

Show sample output | Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
curl -s http://api.wunderground.com/auto/wui/geo/ForecastXML/index.xml?query=${@:-<YOURZIPORLOCATION>}|xmlstarlet sel -E utf-8 -t -m //forecast/txt_forecast/forecastday -v fcttext -n
2010-04-13 22:14:48
User: fanfani
Tags: perl curl function weather
-2
Up
Down
Get the weather forecast for the next 24 to 48 for your location.

you can use xmlstarlet to parse output instead of perl

Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
perl -MStatistics::Descriptive -alne 'my $stat = Statistics::Descriptive::Full->new; $stat->add_data(@F[1..4]); print $stat->variance' filename
2010-04-02 21:16:12
User: alperyilmaz
Functions: perl
Tags: statistics perl math
1
Up
Down
statistics in one line

In this example, file contains five columns where first column is text. Variance is calculated for columns 2 - 5 by using perl module Statistics::Descriptive. There are many more statistical functions available in the module.

Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
perl -pi -e 's/\r\n?/\n/g'
2010-03-18 17:48:16
User: putnamhill
Functions: perl
Tags: perl
3
Up
Down
Convert files from DOS line endings to UNIX line endings

This method will also convert mac line endings.

Comments (2) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
perl -ne 'BEGIN{undef $/}; print "$ARGV\t$.\t$1\n" if m/(first line.*\n.*second line)/mg'
2010-03-18 15:46:10
User: hfs
Functions: perl
Tags: perl grep
7
Up
Down
Multi-line grep

Using perl you can search for patterns spanning several lines, a thing that grep can't do. Append the list of files to above command or pipe a file through it, just as with regular grep. If you add the 's' modifier to the regex, the dot '.' also matches line endings, useful if you don't known how many lines you need are between parts of your pattern. Change '*' to '*?' to make it greedy, that is match only as few characters as possible.

See also http://www.commandlinefu.com/commands/view/1764/display-a-block-of-text-with-awk to do a similar thing with awk.

Edit: The undef has to be put in a begin-block, or a match in the first line would not be found.

Comments (1) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
echo "$url" | perl -MURI::Escape -ne 'chomp;print uri_escape($_),"\n"'
2010-02-13 00:44:48
User: eightmillion
Functions: echo perl
Tags: perl
6
Up
Down
Url Encode

Converts reserved characters in a URI to their percent encoded counterparts.

Alternate python version:

echo "$url" | python -c 'import sys,urllib;print urllib.quote(sys.stdin.read().strip())'
Show sample output | Comments (0) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate
weather(){ curl -s "http://api.wunderground.com/auto/wui/geo/ForecastXML/index.xml?query=${@:-<YOURZIPORLOCATION>}"|perl -ne '/<title>([^<]+)/&&printf "%s: ",$1;/<fcttext>([^<]+)/&&print $1,"\n"';}
2010-02-10 01:23:39
User: eightmillion
Functions: perl
Tags: perl curl function weather
7
Up
Down
Get the weather forecast for the next 24 to 48 for your location.

This shell function grabs the weather forecast for the next 24 to 48 hours from weatherunderground.com. Replace <YOURZIPORLOCATION> with your zip code or your "city, state" or "city, country", then calling the function without any arguments returns the weather for that location. Calling the function with a zip code or place name as an argument returns the weather for that location instead of your default.

To add a bit of color formatting to the output, use the following instead:

weather(){ curl -s "http://api.wunderground.com/auto/wui/geo/ForecastXML/index.xml?query=${@:-<YOURZIPORLOCATION>}"|perl -ne '/<title>([^<]+)/&&printf "\x1B[0;34m%s\x1B[0m: ",$1;/<fcttext>([^<]+)/&&print $1,"\n"';}

Requires: perl, curl

Show sample output | Comments (9) | Add to favourites | Report as malicious | Submit alternative | Report as a duplicate