Commands using xargs sorted by votes

Commands using xargs (769)

sorted by

tail from the last occurrence of a pattern to the end of the (log) file

I wanted a method to display the last run of my script from my log file. I had a pattern I could grep for to find the beginning of each run. This command line greps for that pattern in the log, finds the last occurrence and gives me the line number. Then I use the line number in tail to give me everything from that line number to the end of the log file. I tested this on Linux Mint (variant of Ubuntu) and on RHEL, but I suspect it will run many Linux systems.
This is sample output - yours may be different.
0

grep -n PATTERN /logs/somelog.log | cut -f1 -d: | tail -1 | xargs -I num tail -n +num /logs/somelog.log

goeltzec · 2016-07-29 15:47:26 27
Purge configuration files of removed packages on debian based systems

Use dpkg-query to query packages.
This is sample output - yours may be different.
0

dpkg-query -W -f '${binary:Package} ${Status}\n' '*' |sed -n 's/ deinstall ok config-files//p'|xargs dpkg --purge

ceving · 2016-09-06 11:43:04 15
Extract binary from .text section (shellcode)

Extracts the binary from the .text section and escapes it. This puts it in a form ready to use in a program. Show Sample Output
This is sample output - yours may be different.
```
\x31\xd2\x31\xc9\xbb\xb4\x90\x04\x08\xb0\x05\xcd\x80\xb2\x10\xb9\xc4\x90\x04\x08\x89\xc3\xb0\x03\xcd\x80\x89\xdf\xb2\x10\xb9\xc4\x90\x04\x08\xb3\x01\xb0\x04\xcd\x80\x89\xfb\xb0\x06\xcd\x80\xb0\x01\xcd\x80
```
0

objdump -d -j .text ExeHere | grep -e '^ ' | tr '[[:space:]]' '\n' | egrep '^[[:alnum:]]{2}$' | xargs | sed 's/ /\\x/g' | sed -e 's/^/\\x/g'

keyboardsage · 2016-09-11 07:15:00 16
List used Perl libraries in Perl project
This is sample output - yours may be different.
0

find . -type f $ -name '*.pm' -o -name '*.pl' $ | xargs grep "^use " | cut -d : -f2 | sort | uniq

tlezotte · 2016-09-28 19:59:38 16
Delete all Vagrant boxes

Combs through your home directory and destroys all Vagrant boxes.
This is sample output - yours may be different.
0

find $HOME -type d -name .vagrant | xargs -i% bash -c "pushd %; cd ..;vagrant destroy -f; popd"

gtirloni · 2016-10-06 17:02:20 17
Parallel recursive convert files to other format and move them in another directory

Used $(pwd) to get full path find to list files xargs to pass args bash to parse variables
This is sample output - yours may be different.
0

find $(pwd) -type f -not -path '*/\.*' -iname '*.tif' -print0| xargs -0 -n1 -P4 -I{} bash -c 'X="{}"; Y=${X##*/}; convert "$X" -resize 1920x1080 -density 72" newpath/${Y%.*}.jpg"'

ExtremeMultiman · 2016-10-21 15:53:46 16
Remove all docker images to cleanup disk
This is sample output - yours may be different.
0

docker images | awk '{ print $3 }' | grep -v IMAGE | xargs docker rmi

kofrezo · 2017-01-25 12:14:41 19
Diff 2 branches, for a type of file & having a string in the diff

Diff 2 branches, for a type of file & having a string in the diff
This is sample output - yours may be different.
0

git diff t1_clone tlocal4 --name-only | grep -i "swift" | xargs git diff t1_clone tlocal4 --word-diff-regex="NSLocalized"

ashish2 · 2017-02-08 11:50:45 17
Find text in contents with multiple filename

-name : base of filename -o : 'or' '*.c' : avoiding "paths must precede expression" error message -type f : only find file type --color: hightlight specific word with color -E : extended regexp Show Sample Output
This is sample output - yours may be different.
```
./test.c: int Data;
./test.c: int iData;
./test.h: float fnData();
```
0

find ./$(PATH) -name '*.h' -o -name '*.c' -type f | xargs grep --color -E '*Data*'

debpolaris · 2017-02-10 04:17:16 19
Execute md5sum and sha in the same files in a single command.

Stat -c %n #list files. A find command is also useful Tee #use stdout, but reseend to next comand. Can be other Tee ad infinitum xargs #use de name of files to execute md5 and sha diggest.
This is sample output - yours may be different.
0

stat -c %n * |tee >(xargs md5sum >estedir.md5) >(xargs sha512sum >estedir.sha)

Wallebot · 2017-02-27 18:43:28 15
Recursively remove all empty directories

This version handles directory names with spaces properly
This is sample output - yours may be different.
0

find . -type d | tac | xargs -I{} rmdir {} 2> /dev/null

makoniec · 2017-02-27 22:03:41 17
Batch Remove git tags from remote server

We had a number of git tags named similarly to: 2016.12.13.devel.feature 2016.12.14.master.release But we have multiple developers making commits and tags for testing purposes. I wanted to reduce the number of tags that displayed on our cloud hosting server when doing a deployment.
This is sample output - yours may be different.
0

git ls-remote --tags origin | awk '/^(.*)(\s+)(.*)(YOUR-TAG-SPECIFIC-SEARCH-TERM-HERE)(.*)(-+)(.*)[^{}]$/ {print ":" $2}' | xargs git push origin

shanford · 2017-03-06 21:59:15 20
Change permissions on a large number of directories quickly
This is sample output - yours may be different.
0

find . -type d -print0 | xargs -0 chmod 0770

mademedia · 2017-03-09 12:47:09 17
the executable that started the currently running oracle databases and the ORACLE_HOME relative to each

Show the executable that spawned the process and show the PID and ORACLE_HOME relative to the environment within which the process is running.
This is sample output - yours may be different.
0

ps -ef | grep [p]mon | awk '{print $2}' | xargs -I {} ps eww {} | awk '{print $1 " " $5 " " $6 " " $0}' | sed 's/$S*$ $S*$ .*ORACLE_HOME/\1 \2/g' | cut -f1,2,3 -d" "

Enirevlow · 2017-03-24 18:45:40 18
Convert all the png files in a directory to gif in parallel. Requires imagemagick.

Converts all the png files in a directory to a bunch of gifs - changing only the file extension. Converts them in parallel - simply change the '4' to match the number of CPUs you have, or the number you want to dedicate to the conversion process.
This is sample output - yours may be different.
0

find . -name "*.png" | xargs -I '{}' -P 4 mogrify -format gif '{}'

sbrl · 2017-03-27 18:21:32 18
Move lots files with AWK
This is sample output - yours may be different.
0

find . -maxdepth 1 -type f | awk 'BEGIN { c=0 } { if( c == <quantity_at_a_time> ) { print l; l=$0; c=1 } else { if( l != "") { l=l" "$0 } else { l=$0 }; c++}} END { print l }' | xargs mv -t <dir_dest>

mvrpl · 2017-04-26 16:48:14 22
Copying part of the files from one directory to another
This is sample output - yours may be different.
0

find dir1 -maxdepth 1 -type f | head -100000 | xargs mv -t dir2/subdir

rebirther · 2017-04-28 17:30:27 23
Keep the last 10 moodle backups
This is sample output - yours may be different.
0

ls -t /mcdata/archive/learn/backup-moodle2-course-* | tail -n +11 | xargs -I {} rm {}

tlezotte · 2017-05-04 13:50:02 17
Search for a string in all files recursively
This is sample output - yours may be different.
0

find . -type f | xargs grep <keyword>

tlezotte · 2017-05-04 13:57:01 19
One line keylogger

Taken from: https://unix.stackexchange.com/questions/129159/record-every-keystroke-and-store-in-a-file Author: Stephane Chazelas Show Sample Output
This is sample output - yours may be different.
```
key release 36 [Return]
key press   37 [Control_L]
key release 37 [Control_L]
key press   105 [Control_R]
key release 105 [Control_R]
key press   10 [1]
key release 10 [1]
key press   67 [F1]
key release 67 [F1]
key press   37 [Control_L]
key press   54 [c]
```
0

xinput list | grep -Po 'id=\K\d+(?=.*slave\s*keyboard)' | xargs -P0 -n1 xinput test

atemvm · 2017-05-09 16:56:14 154
shortcut to immediately view any script with less

Saves a step between which'ing to find out the full path of a script, then copy and pasting, and less'ing the full path.
This is sample output - yours may be different.
0

which script | xargs less

heavyseas · 2017-05-09 21:32:21 17

Find Duplicate Files (based on size, name, and md5sum)

It works extremely fast, because it calculates md5sum only on the files that have the same size and name. But there is nothing for free - it won't find duplicates with the different names. Show Sample Output

find -type f -printf '%20s\t%100f\t%p\n' | sort -n | uniq -Dw121 | awk -F'\t' '{print $3}' | xargs -d '\n' md5sum | uniq -Dw32 | cut -b 35- | xargs -d '\n' ls -lU

ant7 · 2017-05-21 02:26:16 16

Recursive convert all print statements in py files from python2 to python3 form

Use find . -iname "*.py" -type f -print0 | xargs -0 sed -ne 's/^$[ \t]*$print $.*$$/\1print(\2)/p' to see what would be changed.
This is sample output - yours may be different.
0

find . -iname "*.py" -type f -print0 | xargs -0 sed -i 's/^$[ \t]*$print $.*$$/\1print(\2)/g'

sleepprogger · 2017-05-22 22:39:58 16
Find process tree in friendly format
This is sample output - yours may be different.
0

pgrep <name> | xargs -i pstree -ps {}

kumarrav90 · 2017-05-31 14:28:57 17
Find latest modified log
This is sample output - yours may be different.
0

find . -name '*.log' | xargs ls -hlt > /tmp/logs.txt && vi /tmp/logs.txt

zluyuer · 2017-07-07 05:13:51 20
‹ First < 22 23 24 25 26 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Upload a video to youtube

Google just released a new commend line tool offering all sorts of new services from the commend line. One of them is uploading a youtube video but there are plenty more google services to interact with. Download it here: http://code.google.com/p/googlecl/ Manual: http://code.google.com/p/googlecl/wiki/Manual

Get the current svn branch/tag (Good for PS1/PROMPT_COMMAND cases)

uses just one sed

Converts to PDF all the OpenOffice.org files in the directory

Requieres unoconv (debian package)

list files recursively by size

strace like SystemTap script

The stap script is : #! /usr/bin/env stap probe syscall.* { if (pid() == target()) printf("%s %s\n", name, argstr); }

Find files with the same names in several directories.

cat file1 file2 file3|sort|uniq -d finds the same lines in several files, especially in files with lists of files.

Forwards connections to your port 2000 to the port 22 of a remote host via ssh tunnel

Show max lengths of all fields in a pipe delimited file with header row

a function to find the fastest DNS server

http://public-dns.info gives a list of online dns servers. you need to change the country in url (br in this url) with your country code. this command need some time to ping all IP in list.

Backup (archive) your Gmail IMAP folders.

Copies an entire hierarchy of mailboxes from the named POP3/IMAP/etc. source to the named destination. Mailboxes are created on the destination as needed. NOTE: The 'mailutil' is Washington's University 'mailutil' (apt-get install uw-mailutils). More examples $ mailutil transfer {imap.gmail.com/ssl/user=you@gmail.com}INBOX Gmail/ ; mailutil check imap.gmail.com/ssl/user=you@gmail.com}\[Gmail\]/Spam If you use the utility in the first, append -v|-d flag(s) to the end the commands above (man mailutil).

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using xargs

Commands using xargs (769) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using xargs (769)

sorted by