Commands tagged grep sorted by votes

Commands tagged grep (409)

sorted by

find potentially malicious PHP commands used in backdoors and aliked scripts

I have found that base64 encoded webshells and the like contain lots of data but hardly any newlines due to the formatting of their payloads. Checking the "width" will not catch everything, but then again, this is a fuzzy problem that relies on broad generalizations and heuristics that are never going to be perfect. What I have done is set an arbitrary threshold (200 for example) and compare the values that are produced by this script, only displaying those above the threshold. One webshell I tested this on scored 5000+ so I know it works for at least one piece of malware.
This is sample output - yours may be different.
0

for ii in $(find /path/to/docroot -type f -name \*.php); do echo $ii; wc -lc $ii | awk '{ nr=$2/($1 + 1); printf("%d\n",nr); }'; done

faceinthecrowd · 2013-04-05 19:06:17 10
Easily find an old command you run

this also can find the old command you used before
This is sample output - yours may be different.
0

history | tail -100 | grep cmd

datamining · 2013-04-22 03:49:43 9
Chrome sucks
This is sample output - yours may be different.
0

ps -A -o rss,command | grep [C]hrome | awk '{sum+=$1} END {printf("%sMB\n",sum/1024)}'

seanubis · 2013-05-08 13:30:59 5
Get the current svn branch/tag (Good for PS1/PROMPT_COMMAND cases)
This is sample output - yours may be different.
0

svn info | grep ^URL | awk -F\/ '{print $NF}'

mplf · 2013-05-18 15:34:09 7
grep all pdf files in a folder

This command is useful for searching through a whole folder worth of pdf files. Show Sample Output
This is sample output - yours may be different.
```
--------Lecture_VIII_LinkLayer.pdf-------

forwarding frame before CRC is checked (at end of frame)
--------Lecture_VII_IP.pdf-------

--------Lecture_VI_NetworkLayer.pdf-------
```
0

for i in *.pdf; do echo --------$i-------; echo; pdftotext $i - | grep -i Yourpattern; done

fangfufu · 2013-05-22 05:36:06 12
Batch JPEG rename to date using ImageMagick

Requires ImageMagick. Extracts date taken from image and renames it properly. Based on StackOverflow answer. Show Sample Output
This is sample output - yours may be different.
```
`IMG_0237.JPG' -> `2013_07_18_08_15_44.jpg'
`IMG_0238.JPG' -> `2013_07_18_16_47_24.jpg'
`IMG_0239.JPG' -> `2013_07_18_20_47_01.jpg'
`IMG_0240.JPG' -> `2013_07_18_20_47_15.jpg'
`IMG_0241.JPG' -> `2013_07_19_07_21_41.jpg'
```
0

for fil in *.JPG; do datepath="$(identify -verbose $fil | grep DateTimeOri | awk '{print $2"_"$3 }' | sed s%:%_%g)"; mv -v $fil $datepath.jpg; done

unixmonkey63215 · 2013-08-02 01:42:04 8
psgrep(command)

Pipes the header row of ps to STDERR, then greps for the command on the output of ps, removing the grep entry before that. Show Sample Output
This is sample output - yours may be different.
```
$ psgrep syslogd
USER PID %CPU %MEM     VSZ RSS TT STAT STARTED    TIME COMMAND
root  23  0.0  0.0 2457208 676 ?? Ss   Mon09AM 0:02.63 /usr/sbin/syslogd
```
0

psgrep() { ps aux | tee >(head -1>&2) | grep -v " grep $@" | grep "$@" -i --color=auto; }

fnl · 2013-08-02 12:44:32 165
Find a machine's IP address and FQDN
This is sample output - yours may be different.
0

for i in `ip addr show dev eth1 | grep inet | awk '{print $2}' | cut -d/ -f1`; do echo -n $i; echo -en '\t'; host $i | awk '{print $5}'; done

BoxingOctopus · 2013-09-05 17:50:33 7

This script can be used to download enclosed files from a RSS feed. For example, it can be used to download mp3 files from a podcasts RSS feed. Show Sample Output

wget -q -O- http://example-podcast-feed.com/rss | grep -o "<enclosure[ -~][^>]*" | grep -o "http://[ -~][^\"]*" | xargs wget -c

talha131 · 2013-09-24 12:38:08 22

List your largest installed packages.
This is sample output - yours may be different.
0

dpkg-query -Wf '${Installed-Size}\t${Status}\t${Package}\n' | sort -n | grep installed

falcald · 2013-09-29 15:12:03 7
Remove all unused kernels with apt-get
This is sample output - yours may be different.
0

% sudo yum remove streams-$(uname-r)

totalnut151 · 2013-11-21 17:41:19 6
Search history, return unique results
This is sample output - yours may be different.
0

function hgr() { grep --color -i "${1}" ~/.bash_history | sed -e 's/^ *//g' -e 's/ *$//g' | sort | uniq; }

doge · 2013-11-27 16:54:02 7
count match string lines from file(s)

-c will count the number of times your search matches in the file. Show Sample Output
This is sample output - yours may be different.
```
$ cat file.txt
hello
goodbye
hello
$
$ grep -c "hello" file.txt
2
$
```
0

grep -c "search_string" /path/to/file

meatflag · 2013-12-10 18:13:54 7
grep BTC last trading price from BTC-E, but u can change it.. they got em all

Show Sample Output
This is sample output - yours may be different.
```
719.00
```
0

wget -q -O- http://bitinfocharts.com/markets/btc-e/btc-usd.html |grep -o -P 'lastTrade">([0-9]{1,})(.){0,1}[0-9]{0,}' |grep -o -P '(\d)+(\.){0,1}(\d)*' |head -n 1

peter1337 · 2014-01-25 23:40:00 20
Get block device mapped parent PCI controller

Maps block devices to the PCIe nodes
This is sample output - yours may be different.
0

udevadm info -q all -n /dev/sdb | grep ID_PATH | cut -d'-' -f 2 | xargs -n 1 lspci -s

bp · 2014-02-18 06:23:39 7
watch iptables counters

This will highlight (with a box over it) any changes since the last refresh.
This is sample output - yours may be different.
0

watch -d -n 2 iptables -nvL

xxdesmus · 2014-02-23 16:35:03 31
get Windows OS architecture using Cygwin

Using "wmic get * /value" within any Cygwin shell will return lots of Win/Dos newline junk ie "^M$" at the end of found value line, two lines ("$" Unix newline) above, and three below. This makes storing and or evaluating wmic queries as variables a pain. The method i suggest strips the mentioned junk, only returns the value after "OSArchitecture=", and includes only one Unix style newline. Other methods using sed|awk|cut can only handle the output of wmic cleanly when piped or using multiple sed statements. wmic OS get OSArchitecture /value | sed 's/\r//g;s/^M$//;/^$/d;s/.*=//' making wmic OS get OSArchitecture /value | grep -Eo '[^=]*$' a much cleaner and slightly less costly alternative. Show Sample Output
This is sample output - yours may be different.
```
64-bit
```
0

wmic OS get OSArchitecture /value | grep -Eo '[^=]*$'

lowjax · 2014-03-15 02:04:08 13
Search for string through files

Grep can search files and directories recursively. Using the -Z option and xargs -0 you can get all results on one line with escaped spaces, suitable for other commands like rm. Show Sample Output
This is sample output - yours may be different.
```
# Write results to file:
grep -Rl --exclude "files.txt" "pattern" files_or_dir > files.txt

# Remove all found files:
grep -RlZ | xargs -0 rm
```
0

grep -Rl "pattern" files_or_dir

N1nsun · 2014-04-06 18:18:07 7
Get the URL for the git-annex webapp
This is sample output - yours may be different.
0

grep URL ~/annex/.git/annex/webapp.html | tr -d '">' | awk -F= '{print $4 "=" $5}'

kseistrup · 2014-04-20 08:46:37 8
Display a quote of the day in notification bubble

Just pulls a quote for each day and displays it in a notification bubble... or you can change it a bit and just have it run in the terminal wget -q -O "quote" https://www.goodreads.com/quotes_of_the_day;echo "Quote of the Day";cat quote | grep '“\|/author/show' | sed -e 's/<[a-zA-Z\/][^>]*>//g' | sed 's/“//g' | sed 's/”//g'; rm -f quote Show Sample Output
This is sample output - yours may be different.
```
As he caught his footing, his head fell back, and the Milky Way flowed down inside him with a roar.
    Yasunari Kawabata,
-OR-
```
0

wget -q -O "quote" https://www.goodreads.com/quotes_of_the_day;notify-send "$(echo "Quote of the Day";cat quote | grep '“\|/author/show' | sed -e 's/<[a-zA-Z\/][^>]*>//g' | sed 's/“//g' | sed 's/”//g')"; rm -f quote

nowhereman88 · 2014-06-15 03:17:19 61
Parse logs for IP addresses and how many hits from each IP

Original command: cat "log" | grep "text to grep" | awk '{print $1}' | sort -n | uniq -c | sort -rn | head -n 100 This is a waste of multiple cats and greps, esp when awk is being used
This is sample output - yours may be different.
0

awk '/text to grep/{print $1}' "log" | sort -n | uniq -c | sort -rn | head -n 100

kln0thing · 2014-07-09 08:48:06 9
show filenames in tail output with color

This shows the the filenames of tail output in color. Helpful if you have many log files to tail
This is sample output - yours may be different.
0

tail -f *.log | grep --color=always '|==>.+<=='

danimath · 2014-07-11 07:47:27 7
Tail -f: truncate and search

Outputs / monitors the content of the LOG_FILE , which matches the SEARCH_STR. The output is cutted by spaces (as delimiter) starting from column 7 till the end.
This is sample output - yours may be different.
0

tail -f LOG_FILE | grep --line-buffered SEARCH_STR | cut -d " " -f 7-

pjsb · 2014-08-07 10:40:45 8
Git branches I checked-out on a specific date

Replace "Oct 2" in the first grep pattern to be the date to view branch work from Show Sample Output
This is sample output - yours may be different.
```
my_new_feature
my_second_new_feature
master
```
0

git reflog --date=local | grep "Oct 2 .* checkout: moving from .* to" | grep -o "[a-zA-Z0-9\-]*$" | sort | uniq

Trindaz · 2014-10-03 15:12:22 8
Use grep to get multiple patterns.

Using egrep to search multiple patterns. Show Sample Output
This is sample output - yours may be different.
```
ERROR: This is an error message.
CRITICAL: This is a critical message.
WARNING: This is a warning message.
```
0

egrep -wi --color 'warning|error|critical'

krizzo · 2014-10-07 17:06:39 8
‹ First < 10 11 12 13 14 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

See how many more processes are allowed, awesome!

There is a limit to how many processes you can run at the same time for each user, especially with web hosts. If the maximum # of processes for your user is 200, then the following sets OPTIMUM_P to 100. $ OPTIMUM_P=$(( (`ulimit -u` - `find /proc -maxdepth 1 $ -user $USER -o -group $GROUPNAME $ -type d|wc -l`) / 2 )) This is very useful in scripts because this is such a fast low-resource-intensive (compared to ps, who, lsof, etc) way to determine how many processes are currently running for whichever user. The number of currently running processes is subtracted from the high limit setup for the account (see limits.conf, pam, initscript). An easy to understand example- this searches the current directory for shell scripts, and runs up to 100 'file' commands at the same time, greatly speeding up the command. $ find . -type f | xargs -P $OPTIMUM_P -iFNAME file FNAME | sed -n '/shell script text/p' I am using it in my http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html especially for the xargs command. Xargs has a -P option that lets you specify how many processes to run at the same time. For instance if you have 1000 urls in a text file and wanted to download all of them fast with curl, you could download 100 at a time (check ps output on a separate [pt]ty for proof) like this: $ cat url-list.txt | xargs -I '{}' -P $OPTIMUM_P curl -O '{}' I like to do things as fast as possible on my servers. I have several types of servers and hosting environments, some with very restrictive jail shells with 20processes limit, some with 200, some with 8000, so for the jailed shells my xargs -P10 would kill my shell or dump core. Using the above I can set the -P value dynamically, so xargs always works, like this. $ cat url-list.txt | xargs -I '{}' -P $OPTIMUM_P curl -O '{}' If you were building a process-killer (very common for cheap hosting) this would also be handy. Note that if you are only allowed 20 or so processes, you should just use -P1 with xargs.

tar via network

mp3 streaming

Reduce PDF size

Press Any Key to Continue

Remove job from crontab by commandline

The "-u USER" is optional if root user is used

NICs, IPs, and Mac

Needed to get the Mac of various devices on a solaris box, but didn't have root. This command used awk to display the Network device, the IP, and the MAC a line at a time.

bash-quine

this command prints itself out. it doesn't need to be stored in a file and it isn't as easy as $ echo $BASH_COMMAND for information on quines see http://en.wikipedia.org/wiki/Quine_(computing)

Escape potential tarbombs

This Anti-TarBomb function makes it easy to unpack a .tar.gz without worrying about the possibility that it will "explode" in your current directory. I've usually always created a temporary folder in which I extracted the tarball first, but I got tired of having to reorganize the files afterwards. Just add this function to your .zshrc / .bashrc and use it like this; $ atb arch1.tar.gz and it will create a folder for the extracted files, if they aren't already in a single folder. This only works for .tar.gz, but it's very easy to edit the function to suit your needs, if you want to extract .tgz, .tar.bz2 or just .tar. More info about tarbombs at http://www.linfo.org/tarbomb.html Tested in zsh and bash. UPDATE: This function works for .tar.gz, .tar.bz2, .tgz, .tbz and .tar in zsh (not working in bash): $ atb() { l=$(tar tf $1); if [ $(echo "$l" | wc -l) -eq $(echo "$l" | grep $(echo "$l" | head -n1) | wc -l) ]; then tar xf $1; else mkdir ${1%.t(ar.gz||ar.bz2||gz||bz||ar)} && tar xf $1 -C ${1%.t(ar.gz||ar.bz2||gz||bz||ar)}; fi ;} UPDATE2: From the comments; bepaald came with a variant that works for .tar.gz, .tar.bz2, .tgz, .tbz and .tar in bash: $ atb() {shopt -s extglob ; l=$(tar tf $1); if [ $(echo "$l" | wc -l) -eq $(echo "$l" | grep $(echo "$l" | head -n1) | wc -l) ]; then tar xf $1; else mkdir ${1%.t@(ar.gz|ar.bz2|gz|bz|ar)} && tar xf $1 -C ${1%.t@(ar.gz|ar.bz2|gz|bz|ar)}; fi ; shopt -u extglob}

Create a CD/DVD ISO image from disk.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged grep

Commands tagged grep (409) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged grep (409)

sorted by