Commands using xargs sorted by votes

Commands using xargs (769)

sorted by

tail from the last occurrence of a pattern to the end of the (log) file

I wanted a method to display the last run of my script from my log file. I had a pattern I could grep for to find the beginning of each run. This command line greps for that pattern in the log, finds the last occurrence and gives me the line number. Then I use the line number in tail to give me everything from that line number to the end of the log file. I tested this on Linux Mint (variant of Ubuntu) and on RHEL, but I suspect it will run many Linux systems.
This is sample output - yours may be different.
0

grep -n PATTERN /logs/somelog.log | cut -f1 -d: | tail -1 | xargs -I num tail -n +num /logs/somelog.log

goeltzec · 2016-07-29 15:47:26 22
Purge configuration files of removed packages on debian based systems

Use dpkg-query to query packages.
This is sample output - yours may be different.
0

dpkg-query -W -f '${binary:Package} ${Status}\n' '*' |sed -n 's/ deinstall ok config-files//p'|xargs dpkg --purge

ceving · 2016-09-06 11:43:04 15
Extract binary from .text section (shellcode)

Extracts the binary from the .text section and escapes it. This puts it in a form ready to use in a program. Show Sample Output
This is sample output - yours may be different.
```
\x31\xd2\x31\xc9\xbb\xb4\x90\x04\x08\xb0\x05\xcd\x80\xb2\x10\xb9\xc4\x90\x04\x08\x89\xc3\xb0\x03\xcd\x80\x89\xdf\xb2\x10\xb9\xc4\x90\x04\x08\xb3\x01\xb0\x04\xcd\x80\x89\xfb\xb0\x06\xcd\x80\xb0\x01\xcd\x80
```
0

objdump -d -j .text ExeHere | grep -e '^ ' | tr '[[:space:]]' '\n' | egrep '^[[:alnum:]]{2}$' | xargs | sed 's/ /\\x/g' | sed -e 's/^/\\x/g'

keyboardsage · 2016-09-11 07:15:00 16
List used Perl libraries in Perl project
This is sample output - yours may be different.
0

find . -type f $ -name '*.pm' -o -name '*.pl' $ | xargs grep "^use " | cut -d : -f2 | sort | uniq

tlezotte · 2016-09-28 19:59:38 16
Delete all Vagrant boxes

Combs through your home directory and destroys all Vagrant boxes.
This is sample output - yours may be different.
0

find $HOME -type d -name .vagrant | xargs -i% bash -c "pushd %; cd ..;vagrant destroy -f; popd"

gtirloni · 2016-10-06 17:02:20 17
Parallel recursive convert files to other format and move them in another directory

Used $(pwd) to get full path find to list files xargs to pass args bash to parse variables
This is sample output - yours may be different.
0

find $(pwd) -type f -not -path '*/\.*' -iname '*.tif' -print0| xargs -0 -n1 -P4 -I{} bash -c 'X="{}"; Y=${X##*/}; convert "$X" -resize 1920x1080 -density 72" newpath/${Y%.*}.jpg"'

ExtremeMultiman · 2016-10-21 15:53:46 16
Remove all docker images to cleanup disk
This is sample output - yours may be different.
0

docker images | awk '{ print $3 }' | grep -v IMAGE | xargs docker rmi

kofrezo · 2017-01-25 12:14:41 19
Diff 2 branches, for a type of file & having a string in the diff

Diff 2 branches, for a type of file & having a string in the diff
This is sample output - yours may be different.
0

git diff t1_clone tlocal4 --name-only | grep -i "swift" | xargs git diff t1_clone tlocal4 --word-diff-regex="NSLocalized"

ashish2 · 2017-02-08 11:50:45 17
Find text in contents with multiple filename

-name : base of filename -o : 'or' '*.c' : avoiding "paths must precede expression" error message -type f : only find file type --color: hightlight specific word with color -E : extended regexp Show Sample Output
This is sample output - yours may be different.
```
./test.c: int Data;
./test.c: int iData;
./test.h: float fnData();
```
0

find ./$(PATH) -name '*.h' -o -name '*.c' -type f | xargs grep --color -E '*Data*'

debpolaris · 2017-02-10 04:17:16 19
Execute md5sum and sha in the same files in a single command.

Stat -c %n #list files. A find command is also useful Tee #use stdout, but reseend to next comand. Can be other Tee ad infinitum xargs #use de name of files to execute md5 and sha diggest.
This is sample output - yours may be different.
0

stat -c %n * |tee >(xargs md5sum >estedir.md5) >(xargs sha512sum >estedir.sha)

Wallebot · 2017-02-27 18:43:28 15
Recursively remove all empty directories

This version handles directory names with spaces properly
This is sample output - yours may be different.
0

find . -type d | tac | xargs -I{} rmdir {} 2> /dev/null

makoniec · 2017-02-27 22:03:41 17
Batch Remove git tags from remote server

We had a number of git tags named similarly to: 2016.12.13.devel.feature 2016.12.14.master.release But we have multiple developers making commits and tags for testing purposes. I wanted to reduce the number of tags that displayed on our cloud hosting server when doing a deployment.
This is sample output - yours may be different.
0

git ls-remote --tags origin | awk '/^(.*)(\s+)(.*)(YOUR-TAG-SPECIFIC-SEARCH-TERM-HERE)(.*)(-+)(.*)[^{}]$/ {print ":" $2}' | xargs git push origin

shanford · 2017-03-06 21:59:15 20
Change permissions on a large number of directories quickly
This is sample output - yours may be different.
0

find . -type d -print0 | xargs -0 chmod 0770

mademedia · 2017-03-09 12:47:09 17
the executable that started the currently running oracle databases and the ORACLE_HOME relative to each

Show the executable that spawned the process and show the PID and ORACLE_HOME relative to the environment within which the process is running.
This is sample output - yours may be different.
0

ps -ef | grep [p]mon | awk '{print $2}' | xargs -I {} ps eww {} | awk '{print $1 " " $5 " " $6 " " $0}' | sed 's/$S*$ $S*$ .*ORACLE_HOME/\1 \2/g' | cut -f1,2,3 -d" "

Enirevlow · 2017-03-24 18:45:40 18
Convert all the png files in a directory to gif in parallel. Requires imagemagick.

Converts all the png files in a directory to a bunch of gifs - changing only the file extension. Converts them in parallel - simply change the '4' to match the number of CPUs you have, or the number you want to dedicate to the conversion process.
This is sample output - yours may be different.
0

find . -name "*.png" | xargs -I '{}' -P 4 mogrify -format gif '{}'

sbrl · 2017-03-27 18:21:32 18
Move lots files with AWK
This is sample output - yours may be different.
0

find . -maxdepth 1 -type f | awk 'BEGIN { c=0 } { if( c == <quantity_at_a_time> ) { print l; l=$0; c=1 } else { if( l != "") { l=l" "$0 } else { l=$0 }; c++}} END { print l }' | xargs mv -t <dir_dest>

mvrpl · 2017-04-26 16:48:14 22
Copying part of the files from one directory to another
This is sample output - yours may be different.
0

find dir1 -maxdepth 1 -type f | head -100000 | xargs mv -t dir2/subdir

rebirther · 2017-04-28 17:30:27 23
Keep the last 10 moodle backups
This is sample output - yours may be different.
0

ls -t /mcdata/archive/learn/backup-moodle2-course-* | tail -n +11 | xargs -I {} rm {}

tlezotte · 2017-05-04 13:50:02 17
Search for a string in all files recursively
This is sample output - yours may be different.
0

find . -type f | xargs grep <keyword>

tlezotte · 2017-05-04 13:57:01 19
One line keylogger

Taken from: https://unix.stackexchange.com/questions/129159/record-every-keystroke-and-store-in-a-file Author: Stephane Chazelas Show Sample Output
This is sample output - yours may be different.
```
key release 36 [Return]
key press   37 [Control_L]
key release 37 [Control_L]
key press   105 [Control_R]
key release 105 [Control_R]
key press   10 [1]
key release 10 [1]
key press   67 [F1]
key release 67 [F1]
key press   37 [Control_L]
key press   54 [c]
```
0

xinput list | grep -Po 'id=\K\d+(?=.*slave\s*keyboard)' | xargs -P0 -n1 xinput test

atemvm · 2017-05-09 16:56:14 149
shortcut to immediately view any script with less

Saves a step between which'ing to find out the full path of a script, then copy and pasting, and less'ing the full path.
This is sample output - yours may be different.
0

which script | xargs less

heavyseas · 2017-05-09 21:32:21 17

Find Duplicate Files (based on size, name, and md5sum)

It works extremely fast, because it calculates md5sum only on the files that have the same size and name. But there is nothing for free - it won't find duplicates with the different names. Show Sample Output

find -type f -printf '%20s\t%100f\t%p\n' | sort -n | uniq -Dw121 | awk -F'\t' '{print $3}' | xargs -d '\n' md5sum | uniq -Dw32 | cut -b 35- | xargs -d '\n' ls -lU

ant7 · 2017-05-21 02:26:16 16

Recursive convert all print statements in py files from python2 to python3 form

Use find . -iname "*.py" -type f -print0 | xargs -0 sed -ne 's/^$[ \t]*$print $.*$$/\1print(\2)/p' to see what would be changed.
This is sample output - yours may be different.
0

find . -iname "*.py" -type f -print0 | xargs -0 sed -i 's/^$[ \t]*$print $.*$$/\1print(\2)/g'

sleepprogger · 2017-05-22 22:39:58 16
Find process tree in friendly format
This is sample output - yours may be different.
0

pgrep <name> | xargs -i pstree -ps {}

kumarrav90 · 2017-05-31 14:28:57 17
Find latest modified log
This is sample output - yours may be different.
0

find . -name '*.log' | xargs ls -hlt > /tmp/logs.txt && vi /tmp/logs.txt

zluyuer · 2017-07-07 05:13:51 20
‹ First < 22 23 24 25 26 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Monitor progress of a command

Pipe viewer is a terminal-based tool for monitoring the progress of data through a pipeline. It can be inserted into any normal pipeline between two processes to give a visual indication of how quickly data is passing through, how long it has taken, how near to completion it is, and an estimate of how long it will be until completion. Source: http://www.catonmat.net/blog/unix-utilities-pipe-viewer/

Update zone file Serial numbers

Will edit *.db files in the same directory with todays date. Useful for doing a mass update to domains on a nameserver, adding spf records, etc. Looks for a string starting with 200 or 201 followed by 7 numbers, and replaces with todays date. This won't overwrite Ip's but i would still do some double checking after running this. Make sure your server's date is correct, otherwise insert your own serial number. $rndc reload should usually follow this command.

Convert seconds to [DD:][HH:]MM:SS

Converts any number of seconds into days, hours, minutes and seconds. sec2dhms() { declare -i SS="$1" D=$(( SS / 86400 )) H=$(( SS % 86400 / 3600 )) M=$(( SS % 3600 / 60 )) S=$(( SS % 60 )) [ "$D" -gt 0 ] && echo -n "${D}:" [ "$H" -gt 0 ] && printf "%02g:" "$H" printf "%02g:%02g\n" "$M" "$S" }

Create date based backups

This script creates date based backups of the files. It copies the files to the same place the original ones are but with an additional extension that is the timestamp of the copy on the following format: YearMonthDay-HourMinuteSecond

Send your terminfo to another machine

I frequently use this trick to send my terminal settings to HPUX and older RHEL systems. This is due to the fact that terminfo support for rxvt-unicode (my preferred terminal app) does not exist on many older Linux and Unices.

check open ports without netstat or lsof

Watch several log files in a single window

It works like a "tail -f" on several files. Use the number keys 0-9 to set a baseline in the numbered window. Pressing "b" let you scroll back in one of the windows.

Install pip with Proxy

Installs pip packages defining a proxy

Set pcap & SUID Bit for priv. network programs (like nmap)

Undo mkdir -p new/directory/path

Removes all directories on given path, working from right to left, and stops when reaching a non-empty directory Counterpart of $ mkdir -p new/directory/path Shortcut (must be issues as next command immediately after mkdir): $ ^mk^rm ( see http://www.commandlinefu.com/commands/view/19/runs-previous-command-but-replacing )

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using xargs

Commands using xargs (769) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using xargs (769)

sorted by