Commands using xargs sorted by votes

Commands using xargs (769)

sorted by

tail from the last occurrence of a pattern to the end of the (log) file

I wanted a method to display the last run of my script from my log file. I had a pattern I could grep for to find the beginning of each run. This command line greps for that pattern in the log, finds the last occurrence and gives me the line number. Then I use the line number in tail to give me everything from that line number to the end of the log file. I tested this on Linux Mint (variant of Ubuntu) and on RHEL, but I suspect it will run many Linux systems.
This is sample output - yours may be different.
0

grep -n PATTERN /logs/somelog.log | cut -f1 -d: | tail -1 | xargs -I num tail -n +num /logs/somelog.log

goeltzec · 2016-07-29 15:47:26 30
Purge configuration files of removed packages on debian based systems

Use dpkg-query to query packages.
This is sample output - yours may be different.
0

dpkg-query -W -f '${binary:Package} ${Status}\n' '*' |sed -n 's/ deinstall ok config-files//p'|xargs dpkg --purge

ceving · 2016-09-06 11:43:04 15
Extract binary from .text section (shellcode)

Extracts the binary from the .text section and escapes it. This puts it in a form ready to use in a program. Show Sample Output
This is sample output - yours may be different.
```
\x31\xd2\x31\xc9\xbb\xb4\x90\x04\x08\xb0\x05\xcd\x80\xb2\x10\xb9\xc4\x90\x04\x08\x89\xc3\xb0\x03\xcd\x80\x89\xdf\xb2\x10\xb9\xc4\x90\x04\x08\xb3\x01\xb0\x04\xcd\x80\x89\xfb\xb0\x06\xcd\x80\xb0\x01\xcd\x80
```
0

objdump -d -j .text ExeHere | grep -e '^ ' | tr '[[:space:]]' '\n' | egrep '^[[:alnum:]]{2}$' | xargs | sed 's/ /\\x/g' | sed -e 's/^/\\x/g'

keyboardsage · 2016-09-11 07:15:00 16
List used Perl libraries in Perl project
This is sample output - yours may be different.
0

find . -type f $ -name '*.pm' -o -name '*.pl' $ | xargs grep "^use " | cut -d : -f2 | sort | uniq

tlezotte · 2016-09-28 19:59:38 16
Delete all Vagrant boxes

Combs through your home directory and destroys all Vagrant boxes.
This is sample output - yours may be different.
0

find $HOME -type d -name .vagrant | xargs -i% bash -c "pushd %; cd ..;vagrant destroy -f; popd"

gtirloni · 2016-10-06 17:02:20 17
Parallel recursive convert files to other format and move them in another directory

Used $(pwd) to get full path find to list files xargs to pass args bash to parse variables
This is sample output - yours may be different.
0

find $(pwd) -type f -not -path '*/\.*' -iname '*.tif' -print0| xargs -0 -n1 -P4 -I{} bash -c 'X="{}"; Y=${X##*/}; convert "$X" -resize 1920x1080 -density 72" newpath/${Y%.*}.jpg"'

ExtremeMultiman · 2016-10-21 15:53:46 16
Remove all docker images to cleanup disk
This is sample output - yours may be different.
0

docker images | awk '{ print $3 }' | grep -v IMAGE | xargs docker rmi

kofrezo · 2017-01-25 12:14:41 19
Diff 2 branches, for a type of file & having a string in the diff

Diff 2 branches, for a type of file & having a string in the diff
This is sample output - yours may be different.
0

git diff t1_clone tlocal4 --name-only | grep -i "swift" | xargs git diff t1_clone tlocal4 --word-diff-regex="NSLocalized"

ashish2 · 2017-02-08 11:50:45 17
Find text in contents with multiple filename

-name : base of filename -o : 'or' '*.c' : avoiding "paths must precede expression" error message -type f : only find file type --color: hightlight specific word with color -E : extended regexp Show Sample Output
This is sample output - yours may be different.
```
./test.c: int Data;
./test.c: int iData;
./test.h: float fnData();
```
0

find ./$(PATH) -name '*.h' -o -name '*.c' -type f | xargs grep --color -E '*Data*'

debpolaris · 2017-02-10 04:17:16 19
Execute md5sum and sha in the same files in a single command.

Stat -c %n #list files. A find command is also useful Tee #use stdout, but reseend to next comand. Can be other Tee ad infinitum xargs #use de name of files to execute md5 and sha diggest.
This is sample output - yours may be different.
0

stat -c %n * |tee >(xargs md5sum >estedir.md5) >(xargs sha512sum >estedir.sha)

Wallebot · 2017-02-27 18:43:28 15
Recursively remove all empty directories

This version handles directory names with spaces properly
This is sample output - yours may be different.
0

find . -type d | tac | xargs -I{} rmdir {} 2> /dev/null

makoniec · 2017-02-27 22:03:41 17
Batch Remove git tags from remote server

We had a number of git tags named similarly to: 2016.12.13.devel.feature 2016.12.14.master.release But we have multiple developers making commits and tags for testing purposes. I wanted to reduce the number of tags that displayed on our cloud hosting server when doing a deployment.
This is sample output - yours may be different.
0

git ls-remote --tags origin | awk '/^(.*)(\s+)(.*)(YOUR-TAG-SPECIFIC-SEARCH-TERM-HERE)(.*)(-+)(.*)[^{}]$/ {print ":" $2}' | xargs git push origin

shanford · 2017-03-06 21:59:15 20
Change permissions on a large number of directories quickly
This is sample output - yours may be different.
0

find . -type d -print0 | xargs -0 chmod 0770

mademedia · 2017-03-09 12:47:09 17
the executable that started the currently running oracle databases and the ORACLE_HOME relative to each

Show the executable that spawned the process and show the PID and ORACLE_HOME relative to the environment within which the process is running.
This is sample output - yours may be different.
0

ps -ef | grep [p]mon | awk '{print $2}' | xargs -I {} ps eww {} | awk '{print $1 " " $5 " " $6 " " $0}' | sed 's/$S*$ $S*$ .*ORACLE_HOME/\1 \2/g' | cut -f1,2,3 -d" "

Enirevlow · 2017-03-24 18:45:40 18
Convert all the png files in a directory to gif in parallel. Requires imagemagick.

Converts all the png files in a directory to a bunch of gifs - changing only the file extension. Converts them in parallel - simply change the '4' to match the number of CPUs you have, or the number you want to dedicate to the conversion process.
This is sample output - yours may be different.
0

find . -name "*.png" | xargs -I '{}' -P 4 mogrify -format gif '{}'

sbrl · 2017-03-27 18:21:32 18
Move lots files with AWK
This is sample output - yours may be different.
0

find . -maxdepth 1 -type f | awk 'BEGIN { c=0 } { if( c == <quantity_at_a_time> ) { print l; l=$0; c=1 } else { if( l != "") { l=l" "$0 } else { l=$0 }; c++}} END { print l }' | xargs mv -t <dir_dest>

mvrpl · 2017-04-26 16:48:14 22
Copying part of the files from one directory to another
This is sample output - yours may be different.
0

find dir1 -maxdepth 1 -type f | head -100000 | xargs mv -t dir2/subdir

rebirther · 2017-04-28 17:30:27 23
Keep the last 10 moodle backups
This is sample output - yours may be different.
0

ls -t /mcdata/archive/learn/backup-moodle2-course-* | tail -n +11 | xargs -I {} rm {}

tlezotte · 2017-05-04 13:50:02 17
Search for a string in all files recursively
This is sample output - yours may be different.
0

find . -type f | xargs grep <keyword>

tlezotte · 2017-05-04 13:57:01 19
One line keylogger

Taken from: https://unix.stackexchange.com/questions/129159/record-every-keystroke-and-store-in-a-file Author: Stephane Chazelas Show Sample Output
This is sample output - yours may be different.
```
key release 36 [Return]
key press   37 [Control_L]
key release 37 [Control_L]
key press   105 [Control_R]
key release 105 [Control_R]
key press   10 [1]
key release 10 [1]
key press   67 [F1]
key release 67 [F1]
key press   37 [Control_L]
key press   54 [c]
```
0

xinput list | grep -Po 'id=\K\d+(?=.*slave\s*keyboard)' | xargs -P0 -n1 xinput test

atemvm · 2017-05-09 16:56:14 158
shortcut to immediately view any script with less

Saves a step between which'ing to find out the full path of a script, then copy and pasting, and less'ing the full path.
This is sample output - yours may be different.
0

which script | xargs less

heavyseas · 2017-05-09 21:32:21 17

Find Duplicate Files (based on size, name, and md5sum)

It works extremely fast, because it calculates md5sum only on the files that have the same size and name. But there is nothing for free - it won't find duplicates with the different names. Show Sample Output

find -type f -printf '%20s\t%100f\t%p\n' | sort -n | uniq -Dw121 | awk -F'\t' '{print $3}' | xargs -d '\n' md5sum | uniq -Dw32 | cut -b 35- | xargs -d '\n' ls -lU

ant7 · 2017-05-21 02:26:16 16

Recursive convert all print statements in py files from python2 to python3 form

Use find . -iname "*.py" -type f -print0 | xargs -0 sed -ne 's/^$[ \t]*$print $.*$$/\1print(\2)/p' to see what would be changed.
This is sample output - yours may be different.
0

find . -iname "*.py" -type f -print0 | xargs -0 sed -i 's/^$[ \t]*$print $.*$$/\1print(\2)/g'

sleepprogger · 2017-05-22 22:39:58 16
Find process tree in friendly format
This is sample output - yours may be different.
0

pgrep <name> | xargs -i pstree -ps {}

kumarrav90 · 2017-05-31 14:28:57 17
Find latest modified log
This is sample output - yours may be different.
0

find . -name '*.log' | xargs ls -hlt > /tmp/logs.txt && vi /tmp/logs.txt

zluyuer · 2017-07-07 05:13:51 20
‹ First < 22 23 24 25 26 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Monitor all DNS queries seen by the local machine

Ensure that each machine that you log in to has its own history file

On systems where your home directory is shared across different machines, your bash history will be global, rather than being a separate history per machine. This setting in your .bashrc file will ensure that each machine has its own history file.

'micro' ps aux (by mem/cpu)

mac os x: ps aux | awk '{print($1" "$3" "$4" "$11);}' | grep -v "0,0" linux: ps aux | awk '{print($1" "$3" "$4" "$11);}' | grep -v "0.0"

Count number of Line for all the files in a directory recursively

Find usb device in realtime

Using this command you can track a moment when usb device was attached.

mysql bin log events per minute

shows number of mysql bin log events (which are mysql server events) per minute, useful to check stress times postmortem

Extract tarball from internet without local saving

Recursively find top 20 largest files (> 1MB) sort human readable format

from my bashrc ;)

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Show bash's function definitions you defined in .bash_profile or .bashrc

If you omit the function name, the command will display all definitions

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using xargs

Commands using xargs (769) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using xargs (769)

sorted by