Commands tagged grep sorted by votes

Commands tagged grep (409)

sorted by

find potentially malicious PHP commands used in backdoors and aliked scripts

I have found that base64 encoded webshells and the like contain lots of data but hardly any newlines due to the formatting of their payloads. Checking the "width" will not catch everything, but then again, this is a fuzzy problem that relies on broad generalizations and heuristics that are never going to be perfect. What I have done is set an arbitrary threshold (200 for example) and compare the values that are produced by this script, only displaying those above the threshold. One webshell I tested this on scored 5000+ so I know it works for at least one piece of malware.
This is sample output - yours may be different.
0

for ii in $(find /path/to/docroot -type f -name \*.php); do echo $ii; wc -lc $ii | awk '{ nr=$2/($1 + 1); printf("%d\n",nr); }'; done

faceinthecrowd · 2013-04-05 19:06:17 10
Easily find an old command you run

this also can find the old command you used before
This is sample output - yours may be different.
0

history | tail -100 | grep cmd

datamining · 2013-04-22 03:49:43 9
Chrome sucks
This is sample output - yours may be different.
0

ps -A -o rss,command | grep [C]hrome | awk '{sum+=$1} END {printf("%sMB\n",sum/1024)}'

seanubis · 2013-05-08 13:30:59 5
Get the current svn branch/tag (Good for PS1/PROMPT_COMMAND cases)
This is sample output - yours may be different.
0

svn info | grep ^URL | awk -F\/ '{print $NF}'

mplf · 2013-05-18 15:34:09 7
grep all pdf files in a folder

This command is useful for searching through a whole folder worth of pdf files. Show Sample Output
This is sample output - yours may be different.
```
--------Lecture_VIII_LinkLayer.pdf-------

forwarding frame before CRC is checked (at end of frame)
--------Lecture_VII_IP.pdf-------

--------Lecture_VI_NetworkLayer.pdf-------
```
0

for i in *.pdf; do echo --------$i-------; echo; pdftotext $i - | grep -i Yourpattern; done

fangfufu · 2013-05-22 05:36:06 12
Batch JPEG rename to date using ImageMagick

Requires ImageMagick. Extracts date taken from image and renames it properly. Based on StackOverflow answer. Show Sample Output
This is sample output - yours may be different.
```
`IMG_0237.JPG' -> `2013_07_18_08_15_44.jpg'
`IMG_0238.JPG' -> `2013_07_18_16_47_24.jpg'
`IMG_0239.JPG' -> `2013_07_18_20_47_01.jpg'
`IMG_0240.JPG' -> `2013_07_18_20_47_15.jpg'
`IMG_0241.JPG' -> `2013_07_19_07_21_41.jpg'
```
0

for fil in *.JPG; do datepath="$(identify -verbose $fil | grep DateTimeOri | awk '{print $2"_"$3 }' | sed s%:%_%g)"; mv -v $fil $datepath.jpg; done

unixmonkey63215 · 2013-08-02 01:42:04 8
psgrep(command)

Pipes the header row of ps to STDERR, then greps for the command on the output of ps, removing the grep entry before that. Show Sample Output
This is sample output - yours may be different.
```
$ psgrep syslogd
USER PID %CPU %MEM     VSZ RSS TT STAT STARTED    TIME COMMAND
root  23  0.0  0.0 2457208 676 ?? Ss   Mon09AM 0:02.63 /usr/sbin/syslogd
```
0

psgrep() { ps aux | tee >(head -1>&2) | grep -v " grep $@" | grep "$@" -i --color=auto; }

fnl · 2013-08-02 12:44:32 165
Find a machine's IP address and FQDN
This is sample output - yours may be different.
0

for i in `ip addr show dev eth1 | grep inet | awk '{print $2}' | cut -d/ -f1`; do echo -n $i; echo -en '\t'; host $i | awk '{print $5}'; done

BoxingOctopus · 2013-09-05 17:50:33 7

This script can be used to download enclosed files from a RSS feed. For example, it can be used to download mp3 files from a podcasts RSS feed. Show Sample Output

wget -q -O- http://example-podcast-feed.com/rss | grep -o "<enclosure[ -~][^>]*" | grep -o "http://[ -~][^\"]*" | xargs wget -c

talha131 · 2013-09-24 12:38:08 22

List your largest installed packages.
This is sample output - yours may be different.
0

dpkg-query -Wf '${Installed-Size}\t${Status}\t${Package}\n' | sort -n | grep installed

falcald · 2013-09-29 15:12:03 7
Remove all unused kernels with apt-get
This is sample output - yours may be different.
0

% sudo yum remove streams-$(uname-r)

totalnut151 · 2013-11-21 17:41:19 6
Search history, return unique results
This is sample output - yours may be different.
0

function hgr() { grep --color -i "${1}" ~/.bash_history | sed -e 's/^ *//g' -e 's/ *$//g' | sort | uniq; }

doge · 2013-11-27 16:54:02 7
count match string lines from file(s)

-c will count the number of times your search matches in the file. Show Sample Output
This is sample output - yours may be different.
```
$ cat file.txt
hello
goodbye
hello
$
$ grep -c "hello" file.txt
2
$
```
0

grep -c "search_string" /path/to/file

meatflag · 2013-12-10 18:13:54 7
grep BTC last trading price from BTC-E, but u can change it.. they got em all

Show Sample Output
This is sample output - yours may be different.
```
719.00
```
0

wget -q -O- http://bitinfocharts.com/markets/btc-e/btc-usd.html |grep -o -P 'lastTrade">([0-9]{1,})(.){0,1}[0-9]{0,}' |grep -o -P '(\d)+(\.){0,1}(\d)*' |head -n 1

peter1337 · 2014-01-25 23:40:00 20
Get block device mapped parent PCI controller

Maps block devices to the PCIe nodes
This is sample output - yours may be different.
0

udevadm info -q all -n /dev/sdb | grep ID_PATH | cut -d'-' -f 2 | xargs -n 1 lspci -s

bp · 2014-02-18 06:23:39 7
watch iptables counters

This will highlight (with a box over it) any changes since the last refresh.
This is sample output - yours may be different.
0

watch -d -n 2 iptables -nvL

xxdesmus · 2014-02-23 16:35:03 32
get Windows OS architecture using Cygwin

Using "wmic get * /value" within any Cygwin shell will return lots of Win/Dos newline junk ie "^M$" at the end of found value line, two lines ("$" Unix newline) above, and three below. This makes storing and or evaluating wmic queries as variables a pain. The method i suggest strips the mentioned junk, only returns the value after "OSArchitecture=", and includes only one Unix style newline. Other methods using sed|awk|cut can only handle the output of wmic cleanly when piped or using multiple sed statements. wmic OS get OSArchitecture /value | sed 's/\r//g;s/^M$//;/^$/d;s/.*=//' making wmic OS get OSArchitecture /value | grep -Eo '[^=]*$' a much cleaner and slightly less costly alternative. Show Sample Output
This is sample output - yours may be different.
```
64-bit
```
0

wmic OS get OSArchitecture /value | grep -Eo '[^=]*$'

lowjax · 2014-03-15 02:04:08 13
Search for string through files

Grep can search files and directories recursively. Using the -Z option and xargs -0 you can get all results on one line with escaped spaces, suitable for other commands like rm. Show Sample Output
This is sample output - yours may be different.
```
# Write results to file:
grep -Rl --exclude "files.txt" "pattern" files_or_dir > files.txt

# Remove all found files:
grep -RlZ | xargs -0 rm
```
0

grep -Rl "pattern" files_or_dir

N1nsun · 2014-04-06 18:18:07 7
Get the URL for the git-annex webapp
This is sample output - yours may be different.
0

grep URL ~/annex/.git/annex/webapp.html | tr -d '">' | awk -F= '{print $4 "=" $5}'

kseistrup · 2014-04-20 08:46:37 8
Display a quote of the day in notification bubble

Just pulls a quote for each day and displays it in a notification bubble... or you can change it a bit and just have it run in the terminal wget -q -O "quote" https://www.goodreads.com/quotes_of_the_day;echo "Quote of the Day";cat quote | grep '“\|/author/show' | sed -e 's/<[a-zA-Z\/][^>]*>//g' | sed 's/“//g' | sed 's/”//g'; rm -f quote Show Sample Output
This is sample output - yours may be different.
```
As he caught his footing, his head fell back, and the Milky Way flowed down inside him with a roar.
    Yasunari Kawabata,
-OR-
```
0

wget -q -O "quote" https://www.goodreads.com/quotes_of_the_day;notify-send "$(echo "Quote of the Day";cat quote | grep '“\|/author/show' | sed -e 's/<[a-zA-Z\/][^>]*>//g' | sed 's/“//g' | sed 's/”//g')"; rm -f quote

nowhereman88 · 2014-06-15 03:17:19 61
Parse logs for IP addresses and how many hits from each IP

Original command: cat "log" | grep "text to grep" | awk '{print $1}' | sort -n | uniq -c | sort -rn | head -n 100 This is a waste of multiple cats and greps, esp when awk is being used
This is sample output - yours may be different.
0

awk '/text to grep/{print $1}' "log" | sort -n | uniq -c | sort -rn | head -n 100

kln0thing · 2014-07-09 08:48:06 9
show filenames in tail output with color

This shows the the filenames of tail output in color. Helpful if you have many log files to tail
This is sample output - yours may be different.
0

tail -f *.log | grep --color=always '|==>.+<=='

danimath · 2014-07-11 07:47:27 7
Tail -f: truncate and search

Outputs / monitors the content of the LOG_FILE , which matches the SEARCH_STR. The output is cutted by spaces (as delimiter) starting from column 7 till the end.
This is sample output - yours may be different.
0

tail -f LOG_FILE | grep --line-buffered SEARCH_STR | cut -d " " -f 7-

pjsb · 2014-08-07 10:40:45 8
Git branches I checked-out on a specific date

Replace "Oct 2" in the first grep pattern to be the date to view branch work from Show Sample Output
This is sample output - yours may be different.
```
my_new_feature
my_second_new_feature
master
```
0

git reflog --date=local | grep "Oct 2 .* checkout: moving from .* to" | grep -o "[a-zA-Z0-9\-]*$" | sort | uniq

Trindaz · 2014-10-03 15:12:22 8
Use grep to get multiple patterns.

Using egrep to search multiple patterns. Show Sample Output
This is sample output - yours may be different.
```
ERROR: This is an error message.
CRITICAL: This is a critical message.
WARNING: This is a warning message.
```
0

egrep -wi --color 'warning|error|critical'

krizzo · 2014-10-07 17:06:39 8
‹ First < 10 11 12 13 14 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

a short counter

Maybe you know shorter ?

grep (or anything else) many files with multiprocessor power

Parallel does not suffer from the risk of mixing of output that xargs suffers from. -j+0 will run as many jobs in parallel as you have cores. With parallel you only need -0 (and -print0) if your filenames contain a '\n'. Parallel is from https://savannah.nongnu.org/projects/parallel/

Convert CSV to JSON

Replace 'csv_file.csv' with your filename.

Add all files in current directory to SVN

The --force option bypasses the warning if files are already in SVN.

Image to color palette generator

Extract a color palette from a image useful for designers. Example usage: $extract-palette myawesomeimage.jpg 4 Where the first argument is the image you want to extract a palette from. The second argument is the number of colors you want. It may be the case where you want to change the search space. In that case, change the -resize argument to a bigger or smaller result. See the ImageMagick documentation for the -resize argument.

MP3 player

I tried a few curses based mp3 players for playing back choir practice songs for my wife. Unfortunately none of the ones I tried were capable of scrubbing a track. Firefox saves the day.

Schedule a script or command in x num hours, silently run in the background even if logged out

This is helpful for shell scripts, I use it in my custom php install script to schedule to delete the build files in 3 hours, as the php install script is completely automated and is made to run slow. Does require at, which some environments without crontab still do have. You can add as many commands to the at you want. Here's how I delete them in case the script gets killed. (trapped) atq |awk '{print $1}'|xargs -iJ atrm J &>/dev/null

Print ASCII Character Chart

Prints out an ascii chart using builtin bash! Then formats using cat -t and column. The best part is: $ echo -e "${p: -3} \\0$(( $i/64*100 + $i%64/8*10 + $i%8 ))"; From: http://www.askapache.com/linux/ascii-codes-and-reference.html

Find usb device in realtime

Using this command you can track a moment when usb device was attached.

Recall “N”th command from your BASH history without executing it.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged grep

Commands tagged grep (409) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged grep (409)

sorted by