All commands

All commands (14,187)

sorted by

Optimal way of deleting huge numbers of files

Using xargs is better than: find /path/to/dir -type f -exec rm \-f {} \; as the -exec switch uses a separate process for each remove. xargs splits the streamed files into more managable subsets so less processes are required.
This is sample output - yours may be different.
12

find /path/to/dir -type f -print0 | xargs -0 rm

root · 2009-01-26 11:30:47 63
Display PHP files that directly instantiate a given class

This greps all PHP files for a given classname and displays both the file and the usage. Show Sample Output
This is sample output - yours may be different.
```
tao/tests/filter/TestUrl.php:        $this->objFilter = new filter_Url();
tao/classes/local/view/Photos.php:        $objFilter  = new filter_Url();
```
1

find . -name "*.php" -exec grep \-H "new filter_" {} \;

root · 2009-01-26 10:43:09 73
Run the last command as root

Useful when you forget to use sudo for a command. "!!" grabs the last run command.
This is sample output - yours may be different.
1219

sudo !!

root · 2009-01-26 10:26:48 262
Creates a customized search command

Creates a command alias ('cr' in the above example) that searches the contents of files matching a set of file extensions (C & C++ source-code in the above example) recursively within the current directory. Search configured to be in colour, ignore-case, show line numbers and show 4 lines of context. Put in shell initialisation file of your choice. Trivially easy to use, e.g: cr sha1_init Show Sample Output
This is sample output - yours may be different.
```
./openssl/signatures.c-600-xmlSecOpenSSLDsaSha1EvpInit(EVP_MD_CTX *ctx)
./openssl/signatures.c-601-{
./openssl/signatures.c:602:    return SHA1_Init(ctx->md_data);
./openssl/signatures.c-603-}
./openssl/signatures.c-604-
--
./openssl/signatures.c-706-    NULL,
./openssl/signatures.c-707-#else /* XMLSEC_OPENSSL_096 */
./openssl/signatures.c:708:    SHA1_Init,
./openssl/signatures.c-709-    SHA1_Update,
./openssl/signatures.c-710-    SHA1_Final,
```
0

alias cr='find . 2>/dev/null -regex '\''.*\.$c\|cpp\|pc\|h\|hpp\|cc$$'\'' | xargs grep --color=always -ni -C2'

chrisdrew · 2009-01-26 08:54:25 56
Outputs a sorted list of disk usage to a text file

Recursively searches current directory and outputs sorted list of each directory's disk usage to a text file. Show Sample Output
This is sample output - yours may be different.
```
712     .
328     ./test
176     ./lib
144     ./doc
100     ./test/data
96      ./lib/rake
64      ./doc/release_notes
```
6

du | sort -gr > file_sizes

chrisdrew · 2009-01-26 01:12:54 62
Watch how fast the files in a drive are being deleted

This can be useful when a large remove operation is taking place.
This is sample output - yours may be different.
6

watch "df | grep /path/to/drive"

root · 2009-01-25 21:16:41 674
Execute a command at a given time

This is an alternative to cron which allows a one-off task to be scheduled for a certain time.
This is sample output - yours may be different.
266

echo "ls -l" | at midnight

root · 2009-01-25 21:07:42 85
Analyse an Apache access log for the most common IP addresses

This uses awk to grab the IP address from each request and then sorts and summarises the top 10.
This is sample output - yours may be different.
22

tail -10000 access_log | awk '{print $1}' | sort | uniq -c | sort -n | tail

root · 2009-01-25 21:01:52 47
Add SVN keywords property to all PHP and Javascript files
This is sample output - yours may be different.
3

find . $ -name "*.php" -o -name "*.js" $ -exec svn propset svn:keywords Id {} \;

root · 2009-01-24 00:54:35 63
Count files beneath current directory (including subfolders)
This is sample output - yours may be different.
18

find . -type f | wc -l

root · 2009-01-23 17:19:32 74

Display the top ten running processes - sorted by memory usage

ps returns all running processes which are then sorted by the 4th field in numerical order and the top 10 are sent to STDOUT. Show Sample Output

106

ps aux | sort -nk +4 | tail

root · 2009-01-23 17:12:33 295

Checks all MySQL tables

See http://dev.mysql.com/doc/refman/5.0/en/myisamchk.html for further details. You can also repair all tables by running: myisamchk -r *.MYI
This is sample output - yours may be different.
-2

myisamchk /path/to/mysql/files/*.MYI

root · 2009-01-22 10:20:00 133
‹ First < 566 567 568

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

List only directories, one per line

Alternatively, $ ls -F | grep /\$ but will break on directories containing newlines. Or the safe, POSIX sh way (but will miss dotfiles): $ for i in *; do test -d "./$i" && printf "%s\n" "$i"; done

To find the count of each open file on a system (that supports losf)

Repeatedly purge orphaned packages on Debian-like Linuxes

Upgraded Debian/Ubuntu/etc. systems may have a number of "orphaned" packages which are just taking up space, which can be found with the "deborphan" command. While you could just do "dpkg --purge $(deborphan)", the act of purging orphans will often create more orphans. This command will get them all in one shot.

wget multiple files (or mirror) from NTLM-protected Sharepoint

If you have to deal with MS Sharepoint which is (rarely, let's hope) used in e.g. certain corporate environments). This uses Cntlm. For single files, just use cURL -- its NTLM authentication works quite well. # /etc/cntlm.conf: # Username account # Domain domain # Password ############ # Proxy 10.20.30.40 (IP of the sharepoint site) # NoProxy * # Listen 3128

Get AWS temporary credentials ready to export based on a MFA virtual appliance

Clean up after a poorly-formed tar file

These days, most software distributed in tar files will just contain a directory at the top level, but some tar files don't have this and can leave you with a mess of files in the current folder if you blindly execute $ tar zxvf something.tar.gz This command can help you clean up after such a mistake. However, note that this has the potential to do bad things if someone has been *really* nasty with filenames.

Remove a line from a file using sed (useful for updating known SSH server keys when they change)

remove the host for the .ssh/know_host file

check the status of 'dd' in progress

Efficiently extract lines between markers

GNU Sed can 'address' between two regex, but it continues parsing through to the end of the file. This slight alteration causes it to terminate reading the input file once the STOP match is made. In my example I have included an extra '/START/d' as my 'start' marker line contains the 'stop' string (I'm extracting data between 'resets' and using the time stamp as the 'start'). My previous coding using grep is slightly faster near the end of the file, but overall (extracting all the reset cycles in turn) the new SED method is quicker and a lot neater.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)

All commands (14,187) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

All commands (14,187)

sorted by