Commands tagged awk sorted by votes

Commands tagged awk (348)

sorted by

Sum up total size and count of all certain filename pattern/regex
This is sample output - yours may be different.
-1

find -regextype posix-egrep -regex ".*/[A-Z]{3}_201009[0-9]{2}.*" -printf "%f %s\n" | awk '{ SUM += $2;COUNT++ } END { print SUM/1024 " kb in " COUNT " files" }'

taintedkernel · 2010-09-21 15:41:45 3
AWK: Set Field Separator from command line

Set field separator char from command line. Prints first, second and lsat columns. Show Sample Output
This is sample output - yours may be different.
```
Input:
Col1,Col2,Col3,[...],ColLast

Output:
Col1 Col2 ColLast
```
-1

awk 'BEGIN {FS=","} { print $1 " " $2 " " $NF}' foo.txt

EBAH · 2010-11-12 15:26:04 4

remove all carriage return of a given file (or input, if used with | ) and replace them with a space (or whatever character is after %s) Show Sample Output

-1

awk ' { printf ("%s ", $0)} END {printf ("\n") } ' FILE

bouktin · 2011-02-02 11:51:41 6

pid list by httpd listen port

% lsof -v lsof version information: revision: 4.78
This is sample output - yours may be different.
-1

lsof | awk '/*:https?/{print $2}' | sort -u

sugitaro · 2011-02-04 01:37:17 3
easily strace all your apache processes
This is sample output - yours may be different.
-1

ps -C apache o pid= | sed 's/^/-p /' | xargs strace

depesz · 2011-03-15 08:46:33 3
Remove all unused kernels with apt-get

Same as 7272 but that one was too dangerous so i added -P to prompt users to continue or cancel Note the double space: "...^ii␣␣linux-image-2..." Like 5813, but fixes two bugs: [1]This leaves the meta-packages 'linux-headers-generic' and 'linux-image-generic' alone so that automatic upgrades work correctly in the future. [2]Kernels newer than the currently running one are left alone (this can happen if you didn't reboot after installing a new kernel).
This is sample output - yours may be different.
-1

sudo aptitude remove -P $(dpkg -l|awk '/^ii linux-image-2/{print $2}'|sed 's/linux-image-//'|awk -v v=`uname -r` 'v>$0'|sed 's/-generic//'|awk '{printf("linux-headers-%s\nlinux-headers-%s-generic\nlinux-image-%s-generic\n",$0,$0,$0)}')

Bonster · 2011-04-25 05:19:57 3
Show seconds since modified of newest modified file in directory
This is sample output - yours may be different.
-1

echo $(( $( date +%s ) - $( stat -c %Y * | sort -nr | head -n 1 ) ))

depesz · 2011-05-12 14:29:45 3
Time redis ping in thousands of a second.

Outputs the real time it takes a Redis ping to run in thousands of a second without any proceeding 0's. Useful for logging or scripted action.
This is sample output - yours may be different.
-1

TIME=$( { time redis-cli PING; } 2>&1 ) ; echo $TIME | awk '{print $3}' | sed 's/0m//; s/\.//; s/s//; s/^0.[^[1-9]*//g;'

allrightname · 2011-08-11 19:09:49 4
Generate an XKCD #936 style 4 word password

If you do not have shuf or an -R option in sort, you can fall back on awk. This provides maximum portability IMO. The command first collects words from the dictionary that match the criteria - in this case: lower case words with no punctuation that are 4 to 8 characters long. It then prints 4 random entries. I decided to print each word on a separate line to improve readability.
This is sample output - yours may be different.
-1

awk 'BEGIN {srand} /^[a-z]{4,8}$/ {w[i++]=$0} END {while (j++<4) print w[int(rand*i)]}' /usr/share/dict/words

putnamhill · 2011-08-18 02:09:42 3
speak a chat log file while it's running

like #9295, but awkish instead of perlish
This is sample output - yours may be different.
-1

tail -f LOGFILE | awk '{system("say \"" $0 "\"");}'

tamouse · 2011-09-16 06:20:06 9
Sequential revision numbers in Git

Git uses secure hash sums for its revision numbers. I'm sure this is fine and dandy for ultra-secure computing, but it's less than optimal for humans. Thus, this will give you sequential revision numbers in Git all the way from the first commit.
This is sample output - yours may be different.
-1

git rev-list --reverse HEAD | awk "/$(git log -n 1 --pretty="format:%h")/ {print NR}"

atoponce · 2011-11-15 21:49:32 4
Print the local ip on a wireless connection

On wired connections set 'eth0' instead of 'wlan0'
This is sample output - yours may be different.
-1

sudo ifconfig wlan0 | grep inet | awk 'NR==1 {print $2}' | cut -c 6-

mouths · 2013-02-18 14:10:07 8
Useful to check if the disks as of same size or not. Helpful in checking Raid configs
This is sample output - yours may be different.
-1

df | awk '{if ($2!=dspace) print "different"; dspace=$2;}'

adimania · 2013-03-08 12:09:35 14
print nearest multiples of 100 in a file
This is sample output - yours may be different.
-1

awk 'BEGIN {count=0;prev=-1} {if(count>0) { if(int($1/100) > int(prev/100)) {print $1} } ; prev=$1; count++}' inputFile > rounded

user1234 · 2013-10-05 18:30:08 7
Print starting line numbers of group of lines in a file, which have the same first and second column
This is sample output - yours may be different.
-1

awk '{pattern=$1$2; seen[pattern]++; if (seen[pattern] == 1) print NR}' inputFile

user1234 · 2013-10-05 18:51:50 15
Remove duplicate lines using awk
This is sample output - yours may be different.
-1

!a[$0]++

Dawn_of_the_Dead · 2014-03-16 01:50:30 6
display IP addresses with 5 or more unsuccessful login attempts today

display IP's that unsuccessfully attempted to login 5 or more times today may want to filter any trusted IP's and the localhost useful for obtaining a list IP addresses to block on the firewall Show Sample Output
This is sample output - yours may be different.
```
the output is zero or more IP addresses
```
-1

lastb -i | grep "$(date '+%a %b %d')" | awk '{ print $3 }' | sort | uniq -c | awk '{ if ($1 >= 5) print $2; }'

forestb · 2015-11-20 07:19:20 10
Checking total connections to each Ip inserver

Useful to check DDoS attacks on servers. Show Sample Output
This is sample output - yours may be different.
```
1 127.0.0.1
 8 192.168.1.147
 21 192.168.1.146
```
-2

netstat -alpn | grep :80 | awk '{print $4}' |awk -F: '{print $(NF-1)}' |sort | uniq -c | sort -n

nitins · 2009-02-19 04:59:32 9
count how many times a string appears in a (source code) tree

grep's -c outputs how may matches there are for a given file as "file:N", cut takes the N's and awk does the sum. Show Sample Output
This is sample output - yours may be different.
```
34
```
-2

grep -rc logged_in app/ | cut -d : -f 2 | awk '{sum+=$1} END {print sum}'

terceiro · 2009-07-15 14:16:44 9
List path of binaries
This is sample output - yours may be different.
-2

echo $PATH|awk -F: ' { for (i=1; i <= NF; i++) print $i }'

nitins · 2009-08-12 07:56:56 4
Show directories in the PATH, one per line

Removes trailing newline; colon becomes record separator and newline becomes field separator, only the first field is ever printed. Replaces empty entries with $PWD. Also prepend relative directories (like ".") with the current directory ($PWD). Can change PWD with env(1) to get tricky in (non-Bourne) scripts. Show Sample Output
This is sample output - yours may be different.
```
/tmp/src
/tmp
/usr/java/jdk1.6.0_11/bin
/home/arcege/local/bin
/home/arcege/bin
/usr/local/sbin
/usr/local/bin
/usr/sbin
/usr/bin
/sbin
/bin
/usr/games
/opt/real/RealPlayer
/tmp/.
/usr/java/apache-ant-1.7.0/bin
```
-2

echo src::${PATH} | awk 'BEGIN{pwd=ENVIRON["PWD"];RS=":";FS="\n"}!$1{$1=pwd}$1!~/^\//{$1=pwd"/"$1}{print $1}'

arcege · 2009-09-09 04:03:46 3
Delete all but the latest 5 files

I have a directory containing log files. This command delete all but the 5 latest logs. Here is how it works: * The ls -t command list all files with the latest ones at the top * The awk's expression means: for those lines greater than 5, delete.
This is sample output - yours may be different.
-2

ls -t | awk 'NR>5 {system("rm \"" $0 "\"")}'

haivu · 2009-09-16 04:58:08 4
Checks apache's access_log file, strips the search queries and shoves them up your e-mail

It's not a big line, and it *may not* work for everybody, I guess it depends on the detail of access_log configuration in your httpd.conf. I use it as a prerotate command for logrotate in httpd section so it executes before access_log rotation, everyday at midnight.
This is sample output - yours may be different.
-2

cat /var/log/httpd/access_log | grep q= | awk '{print $11}' | awk -F 'q=' '{print $2}' | sed 's/+/ /g;s/%22/"/g;s/q=//' | cut -d "&" -f 1 | mail youremail@isp.com -s "[your-site] search strings for `date`"

isma · 2009-11-22 03:03:06 10
Find all uses of PHP constants in a set of files
This is sample output - yours may be different.
-2

$class=ExampleClass; $path=src; for constant in `grep ' const ' $class.php | awk '{print $2;}'`; do grep -r "$class::$constant" $path; done

BluesDragon · 2009-12-24 11:32:24 4
Purge frozen messages in Exim

Although Exim will purge frozen (undeliverable) messages over time, the command "exim -Mrm #id#" where #id# is a particular message ID will purge a message immediately. Being lazy, I don't want to type the command for each frozen message, so I wrote the one-liner to do it for me.
This is sample output - yours may be different.
-2

for i in `mailq | awk '$6 ~ /^frozen$/ {print $3}'`; do exim -Mrm $i; done

rjamestaylor · 2010-01-13 21:28:45 3
‹ First < 11 12 13 14 >

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

The simplest way to transport information over a network

Einstein's razor: As simple as possible, but not simpler. On the destination machine netcat listens on any port (1234 in the example) and sends anything it receives into a file or pipe. On the source machine a separate netcat takes input from a file or pipe and sends it over the network to the listener. This is great between machines on a LAN where you don't care about authentication, encryption, or compression and I would recommend it for being simpler than anything else in this situation. Over the internet you should use something with better security.

Show a prettified list of nearby wireless APs

connect via ssh using mac address

Instead of looking for the right ip address, just pick whatever address you like and set a static ip mapping.

Google verbatim search on your terminal

Put it in your ~/.bashrc usage: google word1 word2 word3... google '"this search gets quoted"'

Top 15 processes with the largest number of open files

See the summary.

Grab a list of MP3s out of Firefox's cache

Grab a list of MP3s (with full path) out of Firefox's cache Ever gone to a site that has an MP3 embedded into a pesky flash player, but no download link? Well, this one-liner will yank the *full path* of those tunes straight out of FF's cache in a clean list. Shorter and Intuitive version of the command submitted by (TuxOtaku)

Display all shell functions set in the current shell environment

Uses the shell builtin `declare` with the '-f' flag to output only functions to grep out only the function names. You can use it as an alias or function like so: alias shfunctions="builtin declare -f | command grep --color=never -E '^[a-zA-Z_]+\ '" shfunctions () { builtin declare -f | command grep --color=never -E '^[a-zA-Z_]+\ '; }

get a rough estimate about how much disk space is used by all the currently installed debian packages

The vaule is expressed in megabytes

Convert seconds to [DD:][HH:]MM:SS

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands tagged awk

Commands tagged awk (348) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands tagged awk (348)

sorted by