Commands tagged grep (409)
-
This command will use grep to read the shortcut (which in the above examle is file.url), and filter out all but the only important line, which contains the website URL, and some extra characters that will need to be removes (for example, URL=http://example.com). The cut command is then used to get rid of the URL= at the beginning. The output is then piped into Firefox, which should interpret the it as a web URL to be opened. Of course, you can replace Firefox with any other broswer. Tested in bash and sh.
0firefox "$(grep -i ^url=* file.url | cut -b 5-)" -
Google Cloud SDK comes with a package manager `gcloud components` but it needs a bit of `sed` to work. Modify the "^| Not" bit to change the package selection. (The gcloud --format option is currently broken) Show Sample Output
0gcloud components list | grep "^| Not" | sed "s/|\(.*\)|\(.*\)|\(.*\)|/\2/" | xargs echo gcloud components update -
Command returns valid IP addresses. Append the following regex to additionally filter out NAT and reserved IP addresses | grep -Ev "^0|\.0[0-9]|^10\.|^127\.|^169\.|^172\.(1[6-9]|2[0-9]|3[01])|^192.168.|^2(2[4-9]|3[0-9])|^2(4[0-9]|5[0-5])"
0grep -Eoa "\b(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\.(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\b" Filetosearch.txt -
For now just returns either "Success" or "Error". My awk-fu isn't strong enough to hackily parse out the error in case there is one, so I kept it simple. Show Sample Output
0cysm() { curl -sd port="$1" http://canyouseeme.org |grep -o 'Success\|Error' } -
Show top apps that use internet, sorted by count connections and grouped by TYPE and Protocol Show Sample Output
0sudo lsof -P -i -n | awk '{print $1,$5,$8}' | tail -n +2 | uniq -c | sort -nr -
In the field, I needed to script a process to scan a specific vendor devices in the network. With the help of nmap, I got all the devices of that particular vendor, and started a scripted netcat session to download configuration files from a tftp server. This is the nmap loop (part of the script). You can however, add another pipe with grep to filter the vendor/manufacturer devices only. If want to check the whole script, check in http://pastebin.com/ju7h4Xf4 Show Sample Output
0nmap -sP 10.0.0.0/8 | grep -v "Host" | tail -n +3 | tr '\n' ' ' | sed 's|Nmap|\nNmap|g' | grep "MAC Address" | cut -d " " -f5,8-15 -
Warnings and errors will be suppressed Show Sample Output
0grep --include=\*.html -R "some string" . 2>/dev/null -
us lsof, grep for any pid matching a given name such as "node". Show Sample Output
0lsof -i -n -P | grep -e "$(ps aux | grep node | grep -v grep | awk -F' ' '{print $2}' | xargs | awk -F' ' '{str = $1; for(i = 2; i < NF; i++) {str = str "\\|" $i} print str}')" -
0grep -R '[0-9]\{1,3\}\.[0-9]\{1,3\}\.[0-9]\{1,3\}\.[0-9]\{1,3\}' *
-
I like this method because I can make use of pgrep which also has the -f flag that can use regex to match patterns in the full command line string. It will also do ps -fww on all pids returned by pgrep, providing a list of process matching the regex provided. Show Sample Output
0ps -fwwp $(pgrep process_name) -
You have a clue... 5 Down: You're looking at it (8) You have some letters... C--SS-O-- You use the terminal... Show Sample Output
0grep -i "^c..ss.o..$" <(aspell dump master) -
Grep for: >> non-empty lines : denoted by -v -e '^$' >> that do not start with # (comments) or : denoted by -v -e '^[#\]' >> and does not include : denoted by -v -e '\' (Note that we use -v only once)
0grep -v -e '^$' -e '^[#\[]' -e '\/' some_file -
0man -a --regex "byobu" |grep --color=always -i3P 'key[a-z-]*?s' | less -R
-
Just added a little url encoding with sed - urls with spaces don't work well - this also works against instead of enclosure and adds a sample to show that you can filter against links at a certain domain Show Sample Output
0wget -q -O- http://www.yourfeed.com/rss | grep -o "<link[ -~][^>]*" | grep -o "http://www.myfeed.com[ -~][^\"]*" | sed "s: :%20:g" | xargs wget -c -
0nmap -n 10.0.0.50 | grep udp | cut -d":"-f3>> test02
-
0nmap -n 10.0.0.50 | grep udp | cut -d":"-f3>>
-
find '.odt' files that contain USAGE: grepodt
0grepodt () { W=$1;P=$2;ls *.odt > /dev/null 2>&1;if [[ $? -ne 0 ]];then exit 1;fi;if [[ ! "$P" ]];then P='*';fi;for i in $P.odt;do unzip -qq "$i" content.xml;grep -l $W content.xml>/dev/null;if [[ $? -eq 0 ]];then echo $i;fi;rm content.xml; done;} -
Only search source files directly related to current project. Everything under the "node_modules" directly are ignored.
0find * -type d -name node_modules -prune -o -type f -name \*.js -exec grep [opts] [pattern] {} \; -
Uses git grep for speed, relies on a valid she-bang, ignores leading whitespace when stripping comments and blank lines Show Sample Output
0egrep -v '^\s*($|#)' $(git grep -l '#!/bin/.*sh' *) | wc -l -
I wanted a method to display the last run of my script from my log file. I had a pattern I could grep for to find the beginning of each run. This command line greps for that pattern in the log, finds the last occurrence and gives me the line number. Then I use the line number in tail to give me everything from that line number to the end of the log file. I tested this on Linux Mint (variant of Ubuntu) and on RHEL, but I suspect it will run many Linux systems.
0grep -n PATTERN /logs/somelog.log | cut -f1 -d: | tail -1 | xargs -I num tail -n +num /logs/somelog.log -
I seem to do this compulsively every time I change directories, sometimes even when I don't, even if I know exactly what I need to do. (Don't worry, the sample output is just an exaggeration. :) Show Sample Output
0grep -cx ls ~/.bash_history -
Diverse trunk and branch, when last index is trunk, show trunk repository name when last index minus one is branches, show branch repository name
0svn info | grep ^URL | awk 'BEGIN {FS="\/"}; {if($(NF-1)=="branches") {print $NF} else if($NF=="trunk") {print $(NF-1)} else {print $NF} } ' -
This will be useful when checking for logs and have to omit specific weblogic or apache server's log information which are redundant and unnecessary. Show Sample Output
0tail -f test | grep -v "bea" -
grep pdf files easily
0pdfgrep pattern /the/path -
-name : base of filename -o : 'or' '*.c' : avoiding "paths must precede expression" error message -type f : only find file type --color: hightlight specific word with color -E : extended regexp Show Sample Output
0find ./$(PATH) -name '*.h' -o -name '*.c' -type f | xargs grep --color -E '*Data*' - ‹ First < 11 12 13 14 15 > Last ›
What's this?
commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.
Check These Out
Stay in the loop…
- Follow the Tweets.
-
Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.
» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10 - Subscribe to the feeds.
-
Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):
Subscribe to the feed for:
- » all commands
- » commands with 3 up-votes (commandlinefu3)
- » commands with 10 up-votes (commandlinefu10)
- » commands tagged grep