Commands using xargs sorted by votes

Commands using xargs (769)

sorted by

tail from the last occurrence of a pattern to the end of the (log) file

I wanted a method to display the last run of my script from my log file. I had a pattern I could grep for to find the beginning of each run. This command line greps for that pattern in the log, finds the last occurrence and gives me the line number. Then I use the line number in tail to give me everything from that line number to the end of the log file. I tested this on Linux Mint (variant of Ubuntu) and on RHEL, but I suspect it will run many Linux systems.
This is sample output - yours may be different.
0

grep -n PATTERN /logs/somelog.log | cut -f1 -d: | tail -1 | xargs -I num tail -n +num /logs/somelog.log

goeltzec · 2016-07-29 15:47:26 26
Purge configuration files of removed packages on debian based systems

Use dpkg-query to query packages.
This is sample output - yours may be different.
0

dpkg-query -W -f '${binary:Package} ${Status}\n' '*' |sed -n 's/ deinstall ok config-files//p'|xargs dpkg --purge

ceving · 2016-09-06 11:43:04 15
Extract binary from .text section (shellcode)

Extracts the binary from the .text section and escapes it. This puts it in a form ready to use in a program. Show Sample Output
This is sample output - yours may be different.
```
\x31\xd2\x31\xc9\xbb\xb4\x90\x04\x08\xb0\x05\xcd\x80\xb2\x10\xb9\xc4\x90\x04\x08\x89\xc3\xb0\x03\xcd\x80\x89\xdf\xb2\x10\xb9\xc4\x90\x04\x08\xb3\x01\xb0\x04\xcd\x80\x89\xfb\xb0\x06\xcd\x80\xb0\x01\xcd\x80
```
0

objdump -d -j .text ExeHere | grep -e '^ ' | tr '[[:space:]]' '\n' | egrep '^[[:alnum:]]{2}$' | xargs | sed 's/ /\\x/g' | sed -e 's/^/\\x/g'

keyboardsage · 2016-09-11 07:15:00 16
List used Perl libraries in Perl project
This is sample output - yours may be different.
0

find . -type f $ -name '*.pm' -o -name '*.pl' $ | xargs grep "^use " | cut -d : -f2 | sort | uniq

tlezotte · 2016-09-28 19:59:38 16
Delete all Vagrant boxes

Combs through your home directory and destroys all Vagrant boxes.
This is sample output - yours may be different.
0

find $HOME -type d -name .vagrant | xargs -i% bash -c "pushd %; cd ..;vagrant destroy -f; popd"

gtirloni · 2016-10-06 17:02:20 17
Parallel recursive convert files to other format and move them in another directory

Used $(pwd) to get full path find to list files xargs to pass args bash to parse variables
This is sample output - yours may be different.
0

find $(pwd) -type f -not -path '*/\.*' -iname '*.tif' -print0| xargs -0 -n1 -P4 -I{} bash -c 'X="{}"; Y=${X##*/}; convert "$X" -resize 1920x1080 -density 72" newpath/${Y%.*}.jpg"'

ExtremeMultiman · 2016-10-21 15:53:46 16
Remove all docker images to cleanup disk
This is sample output - yours may be different.
0

docker images | awk '{ print $3 }' | grep -v IMAGE | xargs docker rmi

kofrezo · 2017-01-25 12:14:41 19
Diff 2 branches, for a type of file & having a string in the diff

Diff 2 branches, for a type of file & having a string in the diff
This is sample output - yours may be different.
0

git diff t1_clone tlocal4 --name-only | grep -i "swift" | xargs git diff t1_clone tlocal4 --word-diff-regex="NSLocalized"

ashish2 · 2017-02-08 11:50:45 17
Find text in contents with multiple filename

-name : base of filename -o : 'or' '*.c' : avoiding "paths must precede expression" error message -type f : only find file type --color: hightlight specific word with color -E : extended regexp Show Sample Output
This is sample output - yours may be different.
```
./test.c: int Data;
./test.c: int iData;
./test.h: float fnData();
```
0

find ./$(PATH) -name '*.h' -o -name '*.c' -type f | xargs grep --color -E '*Data*'

debpolaris · 2017-02-10 04:17:16 19
Execute md5sum and sha in the same files in a single command.

Stat -c %n #list files. A find command is also useful Tee #use stdout, but reseend to next comand. Can be other Tee ad infinitum xargs #use de name of files to execute md5 and sha diggest.
This is sample output - yours may be different.
0

stat -c %n * |tee >(xargs md5sum >estedir.md5) >(xargs sha512sum >estedir.sha)

Wallebot · 2017-02-27 18:43:28 15
Recursively remove all empty directories

This version handles directory names with spaces properly
This is sample output - yours may be different.
0

find . -type d | tac | xargs -I{} rmdir {} 2> /dev/null

makoniec · 2017-02-27 22:03:41 17
Batch Remove git tags from remote server

We had a number of git tags named similarly to: 2016.12.13.devel.feature 2016.12.14.master.release But we have multiple developers making commits and tags for testing purposes. I wanted to reduce the number of tags that displayed on our cloud hosting server when doing a deployment.
This is sample output - yours may be different.
0

git ls-remote --tags origin | awk '/^(.*)(\s+)(.*)(YOUR-TAG-SPECIFIC-SEARCH-TERM-HERE)(.*)(-+)(.*)[^{}]$/ {print ":" $2}' | xargs git push origin

shanford · 2017-03-06 21:59:15 20
Change permissions on a large number of directories quickly
This is sample output - yours may be different.
0

find . -type d -print0 | xargs -0 chmod 0770

mademedia · 2017-03-09 12:47:09 17
the executable that started the currently running oracle databases and the ORACLE_HOME relative to each

Show the executable that spawned the process and show the PID and ORACLE_HOME relative to the environment within which the process is running.
This is sample output - yours may be different.
0

ps -ef | grep [p]mon | awk '{print $2}' | xargs -I {} ps eww {} | awk '{print $1 " " $5 " " $6 " " $0}' | sed 's/$S*$ $S*$ .*ORACLE_HOME/\1 \2/g' | cut -f1,2,3 -d" "

Enirevlow · 2017-03-24 18:45:40 18
Convert all the png files in a directory to gif in parallel. Requires imagemagick.

Converts all the png files in a directory to a bunch of gifs - changing only the file extension. Converts them in parallel - simply change the '4' to match the number of CPUs you have, or the number you want to dedicate to the conversion process.
This is sample output - yours may be different.
0

find . -name "*.png" | xargs -I '{}' -P 4 mogrify -format gif '{}'

sbrl · 2017-03-27 18:21:32 18
Move lots files with AWK
This is sample output - yours may be different.
0

find . -maxdepth 1 -type f | awk 'BEGIN { c=0 } { if( c == <quantity_at_a_time> ) { print l; l=$0; c=1 } else { if( l != "") { l=l" "$0 } else { l=$0 }; c++}} END { print l }' | xargs mv -t <dir_dest>

mvrpl · 2017-04-26 16:48:14 22
Copying part of the files from one directory to another
This is sample output - yours may be different.
0

find dir1 -maxdepth 1 -type f | head -100000 | xargs mv -t dir2/subdir

rebirther · 2017-04-28 17:30:27 23
Keep the last 10 moodle backups
This is sample output - yours may be different.
0

ls -t /mcdata/archive/learn/backup-moodle2-course-* | tail -n +11 | xargs -I {} rm {}

tlezotte · 2017-05-04 13:50:02 17
Search for a string in all files recursively
This is sample output - yours may be different.
0

find . -type f | xargs grep <keyword>

tlezotte · 2017-05-04 13:57:01 19
One line keylogger

Taken from: https://unix.stackexchange.com/questions/129159/record-every-keystroke-and-store-in-a-file Author: Stephane Chazelas Show Sample Output
This is sample output - yours may be different.
```
key release 36 [Return]
key press   37 [Control_L]
key release 37 [Control_L]
key press   105 [Control_R]
key release 105 [Control_R]
key press   10 [1]
key release 10 [1]
key press   67 [F1]
key release 67 [F1]
key press   37 [Control_L]
key press   54 [c]
```
0

xinput list | grep -Po 'id=\K\d+(?=.*slave\s*keyboard)' | xargs -P0 -n1 xinput test

atemvm · 2017-05-09 16:56:14 153
shortcut to immediately view any script with less

Saves a step between which'ing to find out the full path of a script, then copy and pasting, and less'ing the full path.
This is sample output - yours may be different.
0

which script | xargs less

heavyseas · 2017-05-09 21:32:21 17

Find Duplicate Files (based on size, name, and md5sum)

It works extremely fast, because it calculates md5sum only on the files that have the same size and name. But there is nothing for free - it won't find duplicates with the different names. Show Sample Output

find -type f -printf '%20s\t%100f\t%p\n' | sort -n | uniq -Dw121 | awk -F'\t' '{print $3}' | xargs -d '\n' md5sum | uniq -Dw32 | cut -b 35- | xargs -d '\n' ls -lU

ant7 · 2017-05-21 02:26:16 16

Recursive convert all print statements in py files from python2 to python3 form

Use find . -iname "*.py" -type f -print0 | xargs -0 sed -ne 's/^$[ \t]*$print $.*$$/\1print(\2)/p' to see what would be changed.
This is sample output - yours may be different.
0

find . -iname "*.py" -type f -print0 | xargs -0 sed -i 's/^$[ \t]*$print $.*$$/\1print(\2)/g'

sleepprogger · 2017-05-22 22:39:58 16
Find process tree in friendly format
This is sample output - yours may be different.
0

pgrep <name> | xargs -i pstree -ps {}

kumarrav90 · 2017-05-31 14:28:57 17
Find latest modified log
This is sample output - yours may be different.
0

find . -name '*.log' | xargs ls -hlt > /tmp/logs.txt && vi /tmp/logs.txt

zluyuer · 2017-07-07 05:13:51 20
‹ First < 22 23 24 25 26 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

Restrict the bandwidth for the SCP command

the command is obvious, I know, but maybe not everyone knows that using the parameter "-l" you can limit the use of bandwidth command scp. In this example fetch all files from the directory zutaniddu and I copy them locally using only 10 Kbs

Find the modified time (mtime) for a file

Get IP from host

I just wanted a simple DNS request. Because host and nslookup commands are not on all systems, we use getent instead. Thanks aulem for that tip.

pngcrush all .png files in the directory

Nothing too magical here, just uses pngcrush to losslessly compress all your pngs!

Colorful man

That command installs "most" and make this command as the default man reader. The "most" works like "less" (the current man reader), but it render colors for manpages and may do more things. Read "man most". You can see a preview here: http://www.dicas-l.com.br/dicas-l/20090718.php

Remove all unused kernels with apt-get

This will remove all installed kernels on your debian based install, except the one you're currently using. From: http://tuxtweaks.com/2009/12/remove-old-kernels-in-ubuntu/comment-page-1/#comment-1590

Schedule Nice Background Commands That Won't Die on Logout - Alternative to nohup and at

Check out the usage of 'trap', you may not have seen this one much. This command provides a way to schedule commands at certain times by running them after sleep finishes sleeping. In the example 'sleep 2h' sleeps for 2 hours. What is cool about this command is that it uses the 'trap' builtin bash command to remove the SIGHUP trap that normally exits all processes started by the shell upon logout. The 'trap 1' command then restores the normal SIGHUP behaviour. It also uses the 'nice -n 19' command which causes the sleep process to be run with minimal CPU. Further, it runs all the commands within the 2nd parentheses in the background. This is sweet cuz you can fire off as many of these as you want. Very helpful for shell scripts.

Viewing Top Processes according to cpu, mem, swap size, etc.

I've wanted this for a long time, finally just sat down and came up with it. This shows you the sorted output of ps in a pretty format perfect for cron or startup scripts. You can sort by changing the k -vsz to k -pmem for example to sort by memory instead. If you want a function, here's one from my http://www.askapache.com/linux-unix/bash_profile-functions-advanced-shell.html $ aa_top_ps(){ local T N=${1:-10};T=${2:-vsz}; ps wwo pid,user,group,vsize:8,size:8,sz:6,rss:6,pmem:7,pcpu:7,time:7,wchan,sched=,stat,flags,comm,args k -${T} -A|sed -u "/^ *PID/d;${N}q"; }

Auto Rotate Cube (compiz)

Strip my code to: wmctrl -o 0,0 # autorotates to the first face. In fact [0-1279],0 wmctrl - 1280,0 # goes to the second face wmctrl -o 2560,0 # goes to the third face, and so on. # Use multiples of the horizontal display resolution. My example work for 1280x800 display, been 1280 the number of interest. Tweak the number, try a biiiig one and see your cube spinning... I put a complex example to show how fun things can be, even for my ademco and paradox alarm central network advisor interface xpto etc. It rotates two faces, print the alarm message, and goes back tho where it was. Tested on BIGLINUX 4.2, equivalent to ubuntu LTS hardy. Do not forget to activate 3D efects ( compiz cube )

a function to create a box of '=' characters around a given string.

First argument: string to put a box around. Second argument: character to use for box (default is '=') Same as command #4962, cleaned up, shortened, and more efficient. Now a ' * ' can be used as the box character, and the variables get unset so they don't mess with anything else you might have. They marked c++ as a function for this command, but I'm not sure why. Must be a bug.

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using xargs

Commands using xargs (769) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using xargs (769)

sorted by