Commands tagged grep sorted by votes

Commands tagged grep (409)

sorted by

Find all videos under current directory using MIME a.k.a not using extension

Videos are found using their MIME type. Thus no need to for an extension for the video file. This is a efficent version of "jnash" cmd (4086). Thanks for jnash. This cmd will only show video files while his cmd show files having "video" anywhere in path. Show Sample Output
This is sample output - yours may be different.
```
$ find ./ -type f -print0 | xargs -0 file -iNf - | grep ": video/" | cut -d: -f1

./.v.a-desk/atomic_city.wmv
./.mozilla/firefox/yhszbu0k.default/Cache/1/1A/9DD36d01
./.mozilla/firefox/yhszbu0k.default/Cache/7/A6/8BFE0d01
./.mozilla/firefox/yhszbu0k.default/Cache/6/63/FAE2Cd01
./.mozilla/firefox/yhszbu0k.default/Cache/9/D5/E16E0d01
$
```
1

allVideos() { find ./ -type f -print0 | xargs -0 file -iNf - | grep ": video/" | cut -d: -f1; }

totti · 2011-08-19 11:58:59 3
Displays the number of unread messages on your gmail at the top right corner of your terminal

Checks your gmail account every 30 seconds and display the number of new messages in the top right corner of the terminal. A kind of CLI "Gmail notifier" if you will. :-) This is a mashup of http://www.commandlinefu.com/commands/view/7916/put-a-console-clock-in-top-right-corner and http://www.commandlinefu.com/commands/view/3386/check-your-unread-gmail-from-the-command-line
This is sample output - yours may be different.
1

while sleep 30; do tput sc;tput cup 0 $(($(tput cols)-15));echo -n " New Emails: $(curl -u username:password --silent https://mail.google.com/mail/feed/atom | grep 'fullcount' | grep -o '[0-9]\+')";tput rc; done &

saze · 2011-09-07 08:40:28 8

Show git branches by date - useful for showing active branches

This fixes a bug found in the other scripts which fail when a branch has the same name as a file or directory in the current directory. Show Sample Output

for k in `git branch|sed s/^..//`;do echo -e `git log -1 --pretty=format:"%Cgreen%ci %Cblue%cr%Creset" "$k" --`\\t"$k";done|sort

ryan · 2011-11-02 06:16:22 7

Hide comments

Hide comments and empty lines, included XML comments, Show Sample Output

nocomments () { cat $1 | egrep -v '^[[:space:]]*#|^[[:space:]]*$|^[[:space:]]*;' | sed '//d' | sed '//d'; }

RuizTapiador · 2011-11-04 12:47:39 57

mysql bin log events per minute

shows number of mysql bin log events (which are mysql server events) per minute, useful to check stress times postmortem Show Sample Output
This is sample output - yours may be different.
```
....
      6  0:18
      1  0:17
     69  0:18
   4270  0:19
   7032  0:20
   1118  0:21
....
```
1

mysqlbinlog <logfiles> | grep exec | grep end_log_pos | cut -d' ' -f2- | cut -d: -f-2 | uniq -c

theist · 2012-05-30 09:42:21 7
Plaintext credentials sniffing with tcpdump and grep

Simple TCPDUMP grepping for common unsafe protocols (HTTP, POP3, SMTP, FTP) Show Sample Output
This is sample output - yours may be different.
```
.{D.ezENPOST /users/register HTTP/1.1
Host: www.commandlinefu.com
...
Referer: http://www.commandlinefu.com/users/register
...
Content-Type: application/x-www-form-urlencoded
Content-Length: 147

username=jseidl&password=MASKED&password-confirmation=MASKED&email-address=MASKED%MASKED.MASKEDhomepage=MASKED&submit=Sign+me+up
```
1

tcpdump port http or port ftp or port smtp or port imap or port pop3 -l -A | egrep -i 'pass=|pwd=|log=|login=|user=|username=|pw=|passw=|passwd=|password=|pass:|user:|username:|password:|login:|pass |user ' --color=auto --line-buffered -B20

jseidl · 2012-06-18 19:27:54 3
Clean config from # and empty strings
This is sample output - yours may be different.
1

egrep -v '(\t)?#.*|^$' /etc/apache2/sites-available/default

sc0rp1us · 2012-12-07 06:04:14 4
Grep inside Vim and navigate results

Will search for the given pattern and build a list of occurrences. Then you can use :copen and :cclose to toggle the list. When browsing the list, ENTER will take you to that line in the file.
This is sample output - yours may be different.
1

:vimgrep pattern %

Sebasg · 2012-12-30 06:51:10 4
Get the /dev/disk/by-id fragment for a physical drive

Substitute for #11720 Can probably be even shorter and easier. Show Sample Output
This is sample output - yours may be different.
```
ata-WDC_WD7500AYYS-01RCB4_WD-WCAPT1303421
```
1

ls -l /dev/disk/by-id/ | grep '/sda$' | grep -o 'ata[^ ]*'

michelsberg · 2013-01-16 17:28:11 7
Filter out all blank or commented (starting with #) lines
This is sample output - yours may be different.
1

egrep -v "(^#|^\b*$)"

FiloSottile · 2013-03-28 11:20:46 10
extract email adresses from some file (or any other pattern)

This will catch most separators in the section of the email: dot . dash - underscore _ plus + (added for gmail) ... and the basic dash '-' of host names. Show Sample Output
This is sample output - yours may be different.
```
jay@email.com
je-ff-rey@email.com
jo+e@email.com
jo.an@email.com
jose@em-ail.com
man-ish@email.com
mar_itza@em-ai-l.com
megha+emaillist@email.com
st.e-f+an@e-ma-il.com
```
1

grep -aEio '([[:alnum:]_.-\+\-]+@[[:alnum:]_.-]+?\.[[:alpha:].]{2,6})'

binarynomad · 2013-06-23 21:52:14 10
psgrepp

grep по ps aux
This is sample output - yours may be different.
1

ps aux | grep $(echo $1 | sed "s/^$.$/[\1]/g")

opexxx · 2013-07-16 10:10:51 6
Download all images from a 4chan thread

first grep all href images then sed the url part then wget
This is sample output - yours may be different.
1

curl -s $1 | grep -o -i '<a href="//images.4chan.org/[^>]*>' | sed -r 's%.*"//([^"]*)".*%\1%' | xargs wget

bugmenot · 2013-07-22 10:33:55 6
Colorizes an access log

Puts a splash of color in your access logs. IP addresses are gray, 200 and 304 are green, all 4xx errors are red. Works well with e.g. "colorize access_log | less -R" if you want to see your colors while paging. Use as inspiration for other things you might be tailing, like syslog or vmstat Usage: tail -f access.log | colorize
This is sample output - yours may be different.
1

function colorize() { c="--line-buffered --color=yes"; GREP_COLORS="mt=01;34" egrep $c '(^| 200 | 304 )' "${@}" | GREP_COLORS="mt=02;31" egrep $c '(^|"(GET|POST) .*[^0-9] 4[0-1][0-9] )' | GREP_COLORS="ms=02;37" egrep $c '(^|^[0-9\.]+) ';}

mogsie · 2013-08-14 21:05:34 8
Search and replace in multiple files recursively

Replace "foo" with "bar" in all files in current directory recursively
This is sample output - yours may be different.
1

grep -lr "foo" . | xargs sed -i "s/foo/bar/g"

sergeylukin · 2013-10-28 13:02:47 10
calculate how much bogomips one cpu core has (assuming you have 4 cores).

on some distro's you have to replace "BogoMIPS" with "bogomips". Show Sample Output
This is sample output - yours may be different.
```
#([04:33:58][root@fritz:~]#)cat /proc/cpuinfo | grep BogoMIPS | uniq | sed 's/^.*://g' | awk '{print($1 / 4) }'
52.8375
```
1

cat /proc/cpuinfo | grep BogoMIPS | uniq | sed 's/^.*://g' | awk '{print($1 / 4) }'

derpat · 2014-03-01 03:44:03 6
Grep all non-ascii character in file

It will highlight non-ascii character in a file. those character can cause problem for some application parsing ascii file.
This is sample output - yours may be different.
1

grep --color='auto' -P -n '[^\x00-\x7F]' my_file.txt

mrvkino · 2015-03-03 15:03:42 8
Search git logs (case-insensitive)

Normally, searching git log comments is case sensitive. The -i luckily applies to the --grep switch.
This is sample output - yours may be different.
1

git log -i --grep='needle'

sudopeople · 2015-08-11 23:07:55 10
Print all open regular files sorted by the number of file handles open to each.

List all open files of all processes. . find /proc/*/fd Look through the /proc file descriptors . -xtype f list only symlinks to file . -printf "%l\n" print the symlink target . grep -P '^/(?!dev|proc|sys)' ignore files from /dev /proc or /sys . sort | uniq -c | sort -n count the results . Many processes will create and immediately delete temporary files. These can the filtered out by adding: ... | grep -v " (deleted)$" | ... Show Sample Output
This is sample output - yours may be different.
```
...
3 /var/log/squid/cache.log
5 /home/flatcap/.cache/tracker/meta.db-shm
5 /home/flatcap/.mozilla/firefox/bjt6fky6.default/places.sqlite
5 /home/flatcap/.mozilla/firefox/bjt6fky6.default/places.sqlite-wal
7 /home/flatcap/.cache/tracker/meta.db
7 /home/flatcap/.cache/tracker/meta.db-wal
```
1

find /proc/*/fd -xtype f -printf "%l\n" | grep -P '^/(?!dev|proc|sys)' | sort | uniq -c | sort -n

flatcap · 2015-08-18 17:58:21 11
Download all files from podcast RSS feed

Neither of the others worked for me. This does.
This is sample output - yours may be different.
1

curl http://url/rss | grep -o '<enclosure url="[^"]*' | grep -o '[^"]*$' | xargs wget -c

dakira · 2016-05-29 12:07:21 21
Download latest released gitlab docker container

Download latest released gitlab docker container
This is sample output - yours may be different.
1

wget -qO- 'https://github.com'$(curl -s 'https://github.com'$(curl -s https://github.com/sameersbn/docker-gitlab/releases | grep -m 1 -o '<a.*[0-9\.]</a>' | cut -d '"' -f 2) | grep -o '<a.* rel="nofollow">' | grep 'tar.gz' | cut -d '"' -f 2)

BigZ · 2016-08-23 21:36:57 14
Find the package that installed a command

Put this one-line function somewhere in your shell init, re-login and try whatinstalled <command> This is an elaborate wrapper around "dpkg -S", with numerous safeguards. Symlinks and command aliases are resolved. If the searched command is not an existing executable file or was installed by some other means than dpkg/apt, nothing is printed to stdout, otherwise the package name. Show Sample Output
This is sample output - yours may be different.
```
$ whatinstalled ls  
coreutils

$ whatinstalled update-grub      
grub2-common
```
1

whatinstalled () { local cmdpath=$(realpath -eP $(which -a $1 | grep -E "^/" | tail -n 1) 2>/dev/null) && [ -x "$cmdpath" ] && dpkg -S $cmdpath 2>/dev/null | grep -E ": $cmdpath\$" | cut -d ":" -f 1; }

lordtoran · 2016-11-08 16:13:10 20
get all Google ipv4 subnets for a iptables firewall for example

a bit shorter, parenthesis not needed but added for clarity Show Sample Output
This is sample output - yours may be different.
```
35.190.247.0/24
64.233.160.0/19
66.102.0.0/20
66.249.80.0/20
72.14.192.0/18
74.125.0.0/16
108.177.8.0/21
173.194.0.0/16
209.85.128.0/17
216.58.192.0/19
216.239.32.0/19
```
1

nslookup -q=TXT _netblocks.google.com | grep -Eo 'ip4:([0-9\.\/]+)' | cut -d: -f2

jseppe · 2018-10-05 18:19:15 391
Generate a list of items from a couple of items lists A and B, getting (B - A ) set

ItemsListtoAvoid (A) could be a list of files with a special characteristic to exclude. It can be a result of previous processing list, ex. a list of files containing a special string. AlItemsList.txt (B) Is a complete list of items including some or all items in A. Difference is saved in ItemsDifference.txt
This is sample output - yours may be different.
1

grep -vxFf ItemsListtoAvoid.txt AllItemsList.txt > ItemsDifference.txt

neomefistox · 2018-10-27 02:20:05 435
get rid of lines with non ascii characters

found here: https://stackoverflow.com/a/9035939
This is sample output - yours may be different.
1

grep -v $'[^\t\r -~]' my-file-with-non-ascii-characters

saps · 2019-03-13 14:46:02 33
‹ First < 5 6 7 8 9 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Count the total amount of hours of your music collection

First the find command finds all files in your current directory (.). This is piped to xargs to be able to run the next shell pipeline in parallel. The xargs -P argument specifies how many processes you want to run in parallel, you can set this higher than your core count as the duration reading is mainly IO bound. The -print0 and -0 arguments of find and xargs respectively are used to easily handle files with spaces or other special characters. A subshell is executed by xargs to have a shell pipeline for each file that is found by find. This pipeline extracts the duration and converts it to a format easily parsed by awk. ffmpeg reads the file and prints a lot of information about it, grep extracts the duration line. cut and sed cut out the time information, and tr converts the last . to a : to make it easier to split by awk. awk is a specialized programming language for use in shell scripts. Here we use it to split the time elements in 4 variables and add them up.

Find the package that installed a command

Rename files in batch

Get an IP address out of fail2ban jail

Removes an iptables rule created by fail2ban. This example shows how to remove a rule for an IP from the fail2ban-SSH chain. Can be used for any service monitored by fail2ban. For more on fail2ban, see http://www.fail2ban.org/wiki/index.php/Main_Page

quickly formats a fat partition. usefull for flash drives

Battery real life energy vs predicted remaining plotted

This time I added a print to reemaining energy, every minute, time stamped. The example shown here is complete and point to large discrepancies as time passes, converging to accuracy near the end.

Create a new file

Plaintext credentials sniffing with tcpdump and grep

Simple TCPDUMP grepping for common unsafe protocols (HTTP, POP3, SMTP, FTP)

Define words and phrases with google.

This version works on Mac (avoids grep -P, adding a sed step instead, and invokes /usr/bin/perl with full path in case you have another one installed). Still requires that you install perl module HTML::Entities ? here's how: http://www.perlmonks.org/?node_id=640489

Install pip with Proxy

Installs pip packages defining a proxy

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged grep

Commands tagged grep (409) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged grep (409)

sorted by