Commands using file sorted by votes

Commands using file (166)

sorted by

Grab a list of MP3s out of Firefox's cache

Ever gone to a site that has an MP3 embedded into a pesky flash player, but no download link? Well, this one-liner will yank the names of those tunes straight out of FF's cache in a nice, easy to read list. What you do with them after that is *ahem* no concern of mine. ;) Show Sample Output
This is sample output - yours may be different.
```
4CF25EB3d01
```
4

for i in `ls ~/.mozilla/firefox/*/Cache`; do file $i | grep -i mpeg | awk '{print $1}' | sed s/.$//; done

BoxingOctopus · 2010-04-11 23:14:18 7

Sort on multiple dis-contiguous keys/fields (can even specify key number/field from the end)

Notes: 1) -n-1 means sort key is the last field 2) -l is important if each separate record is on a new line (usually so for text files) 3) -j tells msort not to create log file (msort.log) in the working directory 4) may need to install msort package. 5) msort does lot more. Check man msort Show Sample Output

file /bin/* | msort -j -l -n-1 -n2 2> /dev/null

b_t · 2010-10-05 00:37:33 4

Monitor a file with tail with timestamps added

Should be a bit more portable since echo -e/n and date's -Ins are not. Show Sample Output
This is sample output - yours may be different.
```
....
2010-11-24 05:46:58+0000        ##########
2010-11-24 05:46:59+0000        #  EOF   #
2010-11-24 05:46:59+0000        ##########
```
4

tail -f file | while read line; do printf "$(date -u '+%F %T%z')\t$line\n"; done

derekschrock · 2010-11-24 05:50:12 4
Copy all shared libraries for a binary to directory

When working with jailed environments you need to copy all the shared libraries to your jail environment. This is done by running ldd on a binary which needs to run inside the jail. This command will use the output from ldd to automatically copy the shared libraries to a folder of your choice. Show Sample Output
This is sample output - yours may be different.
```
# ldd /bin/bash | grep "=> /" | awk '{print $3}' | xargs -I '{}' cp -v '{}' test/
`/lib/libncurses.so.5' -> `test/libncurses.so.5'
`/lib/i686/cmov/libdl.so.2' -> `test/libdl.so.2'
`/lib/i686/cmov/libc.so.6' -> `test/libc.so.6'
```
4

ldd file | grep "=> /" | awk '{print $3}' | xargs -I '{}' cp -v '{}' /destination

rickard2 · 2012-02-11 17:50:10 11
Convert PDF to JPG

Without the bashisms and unnecessary sed dependency. Substitutions quoted so that filenames with whitespace will be handled correctly.
This is sample output - yours may be different.
4

for file in *.pdf; do convert -verbose -colorspace RGB -resize 800 -interlace none -density 300 -quality 80 "$file" "${file//.pdf/.jpg}"; done

malathion · 2014-06-19 15:52:42 7
Massive change of file extension (bash)

Using bash parameters expansion
This is sample output - yours may be different.
4

for file in *.txt; do mv "${file%.txt}{.txt,.xml}"; done

rgawenda · 2020-01-23 08:54:34 131
improve copy file over ssh showing progress

You set the file/dirname transfer variable, in the end point you set the path destination, this command uses pipe view to show progress, compress the file outut and takes account to change the ssh cipher. Support dirnames with spaces. Merged ideas and comments by http://www.commandlinefu.com/commands/view/4379/copy-working-directory-and-compress-it-on-the-fly-while-showing-progress and http://www.commandlinefu.com/commands/view/3177/move-a-lot-of-files-over-ssh Show Sample Output
This is sample output - yours may be different.
```
112MB 0:00:12 [8.78MB/s] [==============>     ] 96%
```
3

file='path to file'; tar -cf - "$file" | pv -s $(du -sb "$file" | awk '{print $1}') | gzip -c | ssh -c blowfish user@host tar -zxf - -C /opt/games

starchox · 2010-01-19 16:02:45 37
Extract all 7zip files in current directory taking filename spaces into account
This is sample output - yours may be different.
3

for file in *.7z; do 7zr e "$file"; done

jmcantrell · 2010-01-22 18:42:20 11
Monitor a file with tail with timestamps added
This is sample output - yours may be different.
3

tail -f file |xargs -IX printf "$(date -u)\t%s\n" X

unefunge · 2010-11-25 11:23:13 5
sed edit-in-place using -a option instead of -i option (no tmp file created)

does the -i option open a tmp file? this method does not.
This is sample output - yours may be different.
3

sedi(){ case $# in [01]|[3-9])echo usage: sedi sed-cmds file ;;2)sed -a ''"$1"';H;$!d;g;' $2 |sed -a '/^$/d;w '"$2"'' ;;esac;}

argv · 2011-07-27 02:36:53 3
Create backup copy of file, adding suffix of the date of the file modification (NOT today's date)

When I go to change a configuration file I always like to make a backup first. You can use "cp -p" to preserve the modification time, but it gets confusing to have file.prev, file.prev2, etc. So I like to add a YYMMDD suffix that shows when the file was last changed. "stat -c %Y" gives you the modification time in epoch seconds, then "date -d @" converts that to whatever format you specify in your "+format" string. Show Sample Output
This is sample output - yours may be different.
```
# ls -l
-rw-r--r-- 1 root root 0 Dec 31  2018 file
# cp -p file file.$(date -d @$(stat -c '%Y' file) "+%y%m%d")
 ls -l
-rw-r--r-- 1 root root 0 Dec 31  2018 file
-rw-r--r-- 1 root root 0 Dec 31  2018 file.181231
 
```
3

cp file file.$(date -d @$(stat -c '%Y' file) "+%y%m%d")

dmmst19 · 2019-07-18 18:09:09 163
Create backup copy of file, adding suffix of the date of the file modification (NOT today's date)

If your `date` command has `-r` option, you don't need `stat`
This is sample output - yours may be different.
3

cp file{,.$(date -r file "+%y%m%d")}

brx75x · 2019-09-19 09:42:38 171
Split and join with split and cat.

`split -b 1k file` splits files into 1k chunks. Rejoin them with `cat x* > file`.
This is sample output - yours may be different.
2

split -b 1k file ; cat x* > file

abcde · 2009-02-08 23:10:18 10
Join a folder full of split files

If you use newsgroups then you'll have come across split files before. Joining together a whole batch of them can be a pain so this will do the whole folder in one. Show Sample Output
This is sample output - yours may be different.
```
file.avi.001
file.avi.002
file.avi.003
file.avi.004
another.avi.001
another.avi.002
another.avi.003
another.avi.004
another.avi.005
another.avi.006
more.avi.001
more.avi.002
more.avi.003
more.avi.004
more.avi.005

becomes:

file.avi
another.avi
more.avi
```
2

for file in *.001; do NAME=`echo $file | cut -d. -f1,2`; cat "$NAME."[0-9][0-9][0-9] > "$NAME"; done

jaymzcd · 2009-07-29 10:04:26 6
Detect encoding of a text file

This command gives you the charset of a text file, which would be handy if you have no idea of the encoding. Show Sample Output
This is sample output - yours may be different.
```
file -i data.sql
data.sql: text/x-c charset=iso-8859-1
```
2

file -i <textfile>

juvenn · 2009-09-08 01:33:19 4

Make directories for and mount all iso files in a folder

Show Sample Output

for file in *.iso; do mkdir `basename $file | awk -F. '{print $1}'`; sudo mount -t iso9660 -o loop $file `basename $file | awk -F. '{print $1}'`; done

jaymzcd · 2009-10-17 20:07:31 4

Convert multiple flac files to mp3

make sure that flac and lame are installed sudo apt-get install lame flac
This is sample output - yours may be different.
2

for file in *.flac; do $(flac -cd "$file" | lame -h - "${file%.flac}.mp3"); done

schmiddim · 2010-03-08 13:37:25 9
Grab a list of MP3s out of Firefox's cache

Grab a list of MP3s (with full path) out of Firefox's cache Ever gone to a site that has an MP3 embedded into a pesky flash player, but no download link? Well, this one-liner will yank the *full path* of those tunes straight out of FF's cache in a clean list. Shorter and Intuitive version of the command submitted by (TuxOtaku) Show Sample Output
This is sample output - yours may be different.
```
/home/sata/.mozilla/firefox/xmr8lfrq.default/Cache/FD44AC63d01
/home/sata/.mozilla/firefox/xmr8lfrq.default/Cache/C4C20071d01
/home/sata/.mozilla/firefox/xmr8lfrq.default/Cache/CD40802Cd01
```
2

find ~/.mozilla/firefox/*/Cache -exec file {} \; | awk -F ': ' 'tolower($2)~/mpeg/{print $1}'

sata · 2010-04-19 06:59:55 3
Recursively remove all files in a CVS directory

This will search all directories and ignore the CVS ones. Then it will search all files in the resulting directories and act on them.
This is sample output - yours may be different.
2

for dir in $(find -type d ! -name CVS); do for file in $(find $dir -maxdepth 1 -type f); do rm $file; cvs delete $file; done; done

ubersoldat · 2010-04-27 16:03:33 9
Extract IPv4 addressess from file

Show Sample Output
This is sample output - yours may be different.
```
83.233.165.56
92.123.73.25
92.123.73.57
92.123.73.8
95.100.117.11
```
2

grep -Eo $[0-9]\{1,3\}[\.]$\{3\}[0-9] file | sort | uniq

rubenmoran · 2010-05-23 11:23:57 4
Count accesses per domain

count the times a domain appears on a file which lines are URLs in the form http://domain/resource. Show Sample Output
This is sample output - yours may be different.
```
6 www.domain.one.com
11 www.domain.two.com
3 www.otherdomain.com
2 www.domainfour.es
```
2

cut -d'/' -f3 file | sort | uniq -c

rubenmoran · 2010-05-23 16:02:51 8
Download a file securely via a remote SSH server

This command will download $file via server. I've used this when FTP was broken at the office and I needed to download some software packages.
This is sample output - yours may be different.
2

file=ftp://ftp.gimp.org/pub/gimp/v2.6/gimp-2.6.10.tar.bz2; ssh server "wget $file -O -" > $PWD/${file##*/}

michaelmior · 2010-08-02 15:59:45 5
scroll file one line at a time (w/only UNIX base utilities)

usage examples ls largedir |rd lynx -dump largewebsite.com |rd rd < largelogfile
This is sample output - yours may be different.
2

rd(){ while read a ;do printf "$a\n";sleep ${1-1};done ;} # usage: rd < file ; or ... | rd

argv · 2010-10-03 04:16:03 3
Annotate tail -f with timestamps

Uses the command ts in order to add a timestamp on each line. This command is provided in the moreutils package on Debian, and you may need libtime-duration-perl to be able to format the date.
This is sample output - yours may be different.
2

tail -f file | ts '%H:%M:%.S'

Vagrant · 2012-03-02 11:15:29 4
find which of the zip files contains the file you're searching for

This command find which of your zip (or jar) files (when you have lots of them) contains a file you're searching for. It's useful when you have a lot of zip (or jar) files and need to know in which of them the file is archived. It's most common with .jar files when you have to know which of the .jar files contains the java class you need. To find in jar files, you must change "zip" to "jar" in the "find" command. The [internal file name] must be changed to the file name you're searching that is archived into one of the zip/jar files. Before run this command you must step into the directory that contains the zip or jar files.
This is sample output - yours may be different.
2

find . -iname '*.zip' | while read file; do unzip -l "$file" | grep -q [internal file name] && echo $file; done

ricardofunke · 2012-03-23 18:08:35 10
< 1 2 3 4 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Execute a command with the last parameter of a previous command

Suppose that you had change in a directory like /home/user/mycode/code, and now you need to list it, instead of type entire path again, use ls !$ to recall path and list. Useful with many commands, this is only an example. (In this case, same result can be achivied with ls .)

Broadcast your shell thru ports 5000, 5001, 5002 ...

run 'nc yourip 5000', 'nc yourip 5001' or 'nc yourip 5002' elsewhere will produce an exact same mirror of your shell. This is handy when you want to show someone else some amazing stuff in your shell without giving them control over it.

Get information on your graphics card on linux (such as graphics memory size)

Loop is needed if you have more then one card.

Make changes in .bashrc immediately available

Any changes to BASH shell made in .bashrc will be active in the current terminal window from the moment you execute this command, ie. aliases, prompt settings etc. No need to restart terminal. (In BASH 'source' simile to 'eval' lets you generally execute any bunch of commands stacked in a text file).

Emulate tail using awk.

This awk codes emulates tail. For efficiency it uses a circular array, which stores only N number of records. Using awk gives the flexibility of modifying the output as needed, for example adding the record number (NR) at the output and much more.

Syntax Highlight your Perl code

This uses Text::Highlight to output the specified Perl file with syntax highlighting. A better alternative is my App::perlhl - find it on the CPAN: http://p3rl.org/App::perlhl

Create a mirror of a local folder, on a remote server

Create a exact mirror of the local folder "/root/files", on remote server 'remote_server' using SSH command (listening on port 22) (all files & folders on destination server/folder will be deleted)

run command on a group of nodes in parallel

Execute a command at a given time

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using file

Commands using file (166) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using file (166)

sorted by