Commands tagged grep sorted by votes

Commands tagged grep (409)

sorted by

Find all videos under current directory using MIME a.k.a not using extension

Videos are found using their MIME type. Thus no need to for an extension for the video file. This is a efficent version of "jnash" cmd (4086). Thanks for jnash. This cmd will only show video files while his cmd show files having "video" anywhere in path. Show Sample Output
This is sample output - yours may be different.
```
$ find ./ -type f -print0 | xargs -0 file -iNf - | grep ": video/" | cut -d: -f1

./.v.a-desk/atomic_city.wmv
./.mozilla/firefox/yhszbu0k.default/Cache/1/1A/9DD36d01
./.mozilla/firefox/yhszbu0k.default/Cache/7/A6/8BFE0d01
./.mozilla/firefox/yhszbu0k.default/Cache/6/63/FAE2Cd01
./.mozilla/firefox/yhszbu0k.default/Cache/9/D5/E16E0d01
$
```
1

allVideos() { find ./ -type f -print0 | xargs -0 file -iNf - | grep ": video/" | cut -d: -f1; }

totti · 2011-08-19 11:58:59 3
Displays the number of unread messages on your gmail at the top right corner of your terminal

Checks your gmail account every 30 seconds and display the number of new messages in the top right corner of the terminal. A kind of CLI "Gmail notifier" if you will. :-) This is a mashup of http://www.commandlinefu.com/commands/view/7916/put-a-console-clock-in-top-right-corner and http://www.commandlinefu.com/commands/view/3386/check-your-unread-gmail-from-the-command-line
This is sample output - yours may be different.
1

while sleep 30; do tput sc;tput cup 0 $(($(tput cols)-15));echo -n " New Emails: $(curl -u username:password --silent https://mail.google.com/mail/feed/atom | grep 'fullcount' | grep -o '[0-9]\+')";tput rc; done &

saze · 2011-09-07 08:40:28 8

Show git branches by date - useful for showing active branches

This fixes a bug found in the other scripts which fail when a branch has the same name as a file or directory in the current directory. Show Sample Output

for k in `git branch|sed s/^..//`;do echo -e `git log -1 --pretty=format:"%Cgreen%ci %Cblue%cr%Creset" "$k" --`\\t"$k";done|sort

ryan · 2011-11-02 06:16:22 7

Hide comments

Hide comments and empty lines, included XML comments, Show Sample Output

nocomments () { cat $1 | egrep -v '^[[:space:]]*#|^[[:space:]]*$|^[[:space:]]*;' | sed '//d' | sed '//d'; }

RuizTapiador · 2011-11-04 12:47:39 57

mysql bin log events per minute

shows number of mysql bin log events (which are mysql server events) per minute, useful to check stress times postmortem Show Sample Output
This is sample output - yours may be different.
```
....
      6  0:18
      1  0:17
     69  0:18
   4270  0:19
   7032  0:20
   1118  0:21
....
```
1

mysqlbinlog <logfiles> | grep exec | grep end_log_pos | cut -d' ' -f2- | cut -d: -f-2 | uniq -c

theist · 2012-05-30 09:42:21 7
Plaintext credentials sniffing with tcpdump and grep

Simple TCPDUMP grepping for common unsafe protocols (HTTP, POP3, SMTP, FTP) Show Sample Output
This is sample output - yours may be different.
```
.{D.ezENPOST /users/register HTTP/1.1
Host: www.commandlinefu.com
...
Referer: http://www.commandlinefu.com/users/register
...
Content-Type: application/x-www-form-urlencoded
Content-Length: 147

username=jseidl&password=MASKED&password-confirmation=MASKED&email-address=MASKED%MASKED.MASKEDhomepage=MASKED&submit=Sign+me+up
```
1

tcpdump port http or port ftp or port smtp or port imap or port pop3 -l -A | egrep -i 'pass=|pwd=|log=|login=|user=|username=|pw=|passw=|passwd=|password=|pass:|user:|username:|password:|login:|pass |user ' --color=auto --line-buffered -B20

jseidl · 2012-06-18 19:27:54 3
Clean config from # and empty strings
This is sample output - yours may be different.
1

egrep -v '(\t)?#.*|^$' /etc/apache2/sites-available/default

sc0rp1us · 2012-12-07 06:04:14 4
Grep inside Vim and navigate results

Will search for the given pattern and build a list of occurrences. Then you can use :copen and :cclose to toggle the list. When browsing the list, ENTER will take you to that line in the file.
This is sample output - yours may be different.
1

:vimgrep pattern %

Sebasg · 2012-12-30 06:51:10 4
Get the /dev/disk/by-id fragment for a physical drive

Substitute for #11720 Can probably be even shorter and easier. Show Sample Output
This is sample output - yours may be different.
```
ata-WDC_WD7500AYYS-01RCB4_WD-WCAPT1303421
```
1

ls -l /dev/disk/by-id/ | grep '/sda$' | grep -o 'ata[^ ]*'

michelsberg · 2013-01-16 17:28:11 7
Filter out all blank or commented (starting with #) lines
This is sample output - yours may be different.
1

egrep -v "(^#|^\b*$)"

FiloSottile · 2013-03-28 11:20:46 10
extract email adresses from some file (or any other pattern)

This will catch most separators in the section of the email: dot . dash - underscore _ plus + (added for gmail) ... and the basic dash '-' of host names. Show Sample Output
This is sample output - yours may be different.
```
jay@email.com
je-ff-rey@email.com
jo+e@email.com
jo.an@email.com
jose@em-ail.com
man-ish@email.com
mar_itza@em-ai-l.com
megha+emaillist@email.com
st.e-f+an@e-ma-il.com
```
1

grep -aEio '([[:alnum:]_.-\+\-]+@[[:alnum:]_.-]+?\.[[:alpha:].]{2,6})'

binarynomad · 2013-06-23 21:52:14 10
psgrepp

grep по ps aux
This is sample output - yours may be different.
1

ps aux | grep $(echo $1 | sed "s/^$.$/[\1]/g")

opexxx · 2013-07-16 10:10:51 6
Download all images from a 4chan thread

first grep all href images then sed the url part then wget
This is sample output - yours may be different.
1

curl -s $1 | grep -o -i '<a href="//images.4chan.org/[^>]*>' | sed -r 's%.*"//([^"]*)".*%\1%' | xargs wget

bugmenot · 2013-07-22 10:33:55 6
Colorizes an access log

Puts a splash of color in your access logs. IP addresses are gray, 200 and 304 are green, all 4xx errors are red. Works well with e.g. "colorize access_log | less -R" if you want to see your colors while paging. Use as inspiration for other things you might be tailing, like syslog or vmstat Usage: tail -f access.log | colorize
This is sample output - yours may be different.
1

function colorize() { c="--line-buffered --color=yes"; GREP_COLORS="mt=01;34" egrep $c '(^| 200 | 304 )' "${@}" | GREP_COLORS="mt=02;31" egrep $c '(^|"(GET|POST) .*[^0-9] 4[0-1][0-9] )' | GREP_COLORS="ms=02;37" egrep $c '(^|^[0-9\.]+) ';}

mogsie · 2013-08-14 21:05:34 8
Search and replace in multiple files recursively

Replace "foo" with "bar" in all files in current directory recursively
This is sample output - yours may be different.
1

grep -lr "foo" . | xargs sed -i "s/foo/bar/g"

sergeylukin · 2013-10-28 13:02:47 10
calculate how much bogomips one cpu core has (assuming you have 4 cores).

on some distro's you have to replace "BogoMIPS" with "bogomips". Show Sample Output
This is sample output - yours may be different.
```
#([04:33:58][root@fritz:~]#)cat /proc/cpuinfo | grep BogoMIPS | uniq | sed 's/^.*://g' | awk '{print($1 / 4) }'
52.8375
```
1

cat /proc/cpuinfo | grep BogoMIPS | uniq | sed 's/^.*://g' | awk '{print($1 / 4) }'

derpat · 2014-03-01 03:44:03 6
Grep all non-ascii character in file

It will highlight non-ascii character in a file. those character can cause problem for some application parsing ascii file.
This is sample output - yours may be different.
1

grep --color='auto' -P -n '[^\x00-\x7F]' my_file.txt

mrvkino · 2015-03-03 15:03:42 8
Search git logs (case-insensitive)

Normally, searching git log comments is case sensitive. The -i luckily applies to the --grep switch.
This is sample output - yours may be different.
1

git log -i --grep='needle'

sudopeople · 2015-08-11 23:07:55 10
Print all open regular files sorted by the number of file handles open to each.

List all open files of all processes. . find /proc/*/fd Look through the /proc file descriptors . -xtype f list only symlinks to file . -printf "%l\n" print the symlink target . grep -P '^/(?!dev|proc|sys)' ignore files from /dev /proc or /sys . sort | uniq -c | sort -n count the results . Many processes will create and immediately delete temporary files. These can the filtered out by adding: ... | grep -v " (deleted)$" | ... Show Sample Output
This is sample output - yours may be different.
```
...
3 /var/log/squid/cache.log
5 /home/flatcap/.cache/tracker/meta.db-shm
5 /home/flatcap/.mozilla/firefox/bjt6fky6.default/places.sqlite
5 /home/flatcap/.mozilla/firefox/bjt6fky6.default/places.sqlite-wal
7 /home/flatcap/.cache/tracker/meta.db
7 /home/flatcap/.cache/tracker/meta.db-wal
```
1

find /proc/*/fd -xtype f -printf "%l\n" | grep -P '^/(?!dev|proc|sys)' | sort | uniq -c | sort -n

flatcap · 2015-08-18 17:58:21 11
Download all files from podcast RSS feed

Neither of the others worked for me. This does.
This is sample output - yours may be different.
1

curl http://url/rss | grep -o '<enclosure url="[^"]*' | grep -o '[^"]*$' | xargs wget -c

dakira · 2016-05-29 12:07:21 21
Download latest released gitlab docker container

Download latest released gitlab docker container
This is sample output - yours may be different.
1

wget -qO- 'https://github.com'$(curl -s 'https://github.com'$(curl -s https://github.com/sameersbn/docker-gitlab/releases | grep -m 1 -o '<a.*[0-9\.]</a>' | cut -d '"' -f 2) | grep -o '<a.* rel="nofollow">' | grep 'tar.gz' | cut -d '"' -f 2)

BigZ · 2016-08-23 21:36:57 14
Find the package that installed a command

Put this one-line function somewhere in your shell init, re-login and try whatinstalled <command> This is an elaborate wrapper around "dpkg -S", with numerous safeguards. Symlinks and command aliases are resolved. If the searched command is not an existing executable file or was installed by some other means than dpkg/apt, nothing is printed to stdout, otherwise the package name. Show Sample Output
This is sample output - yours may be different.
```
$ whatinstalled ls  
coreutils

$ whatinstalled update-grub      
grub2-common
```
1

whatinstalled () { local cmdpath=$(realpath -eP $(which -a $1 | grep -E "^/" | tail -n 1) 2>/dev/null) && [ -x "$cmdpath" ] && dpkg -S $cmdpath 2>/dev/null | grep -E ": $cmdpath\$" | cut -d ":" -f 1; }

lordtoran · 2016-11-08 16:13:10 20
get all Google ipv4 subnets for a iptables firewall for example

a bit shorter, parenthesis not needed but added for clarity Show Sample Output
This is sample output - yours may be different.
```
35.190.247.0/24
64.233.160.0/19
66.102.0.0/20
66.249.80.0/20
72.14.192.0/18
74.125.0.0/16
108.177.8.0/21
173.194.0.0/16
209.85.128.0/17
216.58.192.0/19
216.239.32.0/19
```
1

nslookup -q=TXT _netblocks.google.com | grep -Eo 'ip4:([0-9\.\/]+)' | cut -d: -f2

jseppe · 2018-10-05 18:19:15 377
Generate a list of items from a couple of items lists A and B, getting (B - A ) set

ItemsListtoAvoid (A) could be a list of files with a special characteristic to exclude. It can be a result of previous processing list, ex. a list of files containing a special string. AlItemsList.txt (B) Is a complete list of items including some or all items in A. Difference is saved in ItemsDifference.txt
This is sample output - yours may be different.
1

grep -vxFf ItemsListtoAvoid.txt AllItemsList.txt > ItemsDifference.txt

neomefistox · 2018-10-27 02:20:05 422
get rid of lines with non ascii characters

found here: https://stackoverflow.com/a/9035939
This is sample output - yours may be different.
1

grep -v $'[^\t\r -~]' my-file-with-non-ascii-characters

saps · 2019-03-13 14:46:02 33
‹ First < 5 6 7 8 9 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Redirect STDIN

Several times, I find myself hitting my up arrow, and changing the search term. Unfortunately, I find myself wasting too much time typing: $ grep kernel /var/log/messages Redirecting STDIN allows me to put the search term at the end so I less cursor movement to change what I'm searching for: $ < /var/log/messages grep kernel If you're using the emacs keyboard binding, then after you press your up arrow, press CTRL+w to erase the word. If this has already been submitted, I couldn't find it with the search utility.

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Easy to extend one-liner for cron scripts that automate filesystem checking

This one-liner is for cron jobs that need to provide some basic information about a filesystem and the time it takes to complete the operation. You can swap out the di command for df or du if that's your thing. The |& redirections the stderr and stdout to the mail command. How to configure the variables. TOFSCK=/path/to/mount FSCKDEV=/dev/path/device or FSCKDEV=`grep $TOFSCK /proc/mounts | cut -f1 -d" "` MAILSUB="weekly file system check $TOFSCK "

Add prefix onto filenames

Best to try first with -n flag, to preview

urldecoding

My version uses printf and command substitution ($()) instead of echo -e and xargs, this is a few less chars, but not real substantive difference. Also supports lowercase hex letters and a backslash (\) will make it through unescaped

Mapreduce style processing

parallel can be installed on your central node and can be used to run a command multiple times. In this example, multiple ssh connections are used to run commands. (-j is the number of jobs to run at the same time). The result can then be piped to commands to perform the "reduce" stage. (sort then uniq in this example). This example assumes "keyless ssh login" has been set up between the central node and all machines in the cluster. bashreduce may also do what you want.

Replace duplicate files by hardlinks

Generate a 18 character password, print the password and sha512 salted hash

Generate a 18 character password from character set a-zA-Z0-9 from /dev/urandom, pipe the output to Python which prints the password on standard out and in crypt sha512 form.

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

To find the LDAP clients connected to LDAP service running on Solaris

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged grep

Commands tagged grep (409) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged grep (409)

sorted by