Commands using sed sorted by votes

Commands using sed (1,319)

sorted by

Ensuring that the IP has no strange characters

This command validates if exist any character different in 0-255 and dot. If any characters different is typed the error menssage is showing. Show Sample Output
This is sample output - yours may be different.
```
IP="192.168.1.1"
checking=`echo ${IP} | sed "s/[0-9\.]//g"`;
if [ "${checking}" != "" ]; 
   then 
           echo "Please type only numeric characters separated for dot";
   exit;
fi
```
0

echo ${IP} | sed "s/[0-9\.]//g"

andregyn62 · 2015-10-19 18:20:03 11
Download files linked in a RSS feed

Just added a little url encoding with sed - urls with spaces don't work well - this also works against instead of enclosure and adds a sample to show that you can filter against links at a certain domain Show Sample Output
This is sample output - yours may be different.
```
Reusing existing connection to www.yourfeed.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 176975 (173K) [application/pdf]
Saving to: 'MyFile.pdf'

MyFile.pdf            100%[==================================================================================================================>] 172.83K   488KB/s   in 0.4s   

2015-10-30 15:06:24 (488 KB/s) - 'MyFile.pdf' saved [176975/176975]
```
0

wget -q -O- http://www.yourfeed.com/rss | grep -o "<link[ -~][^>]*" | grep -o "http://www.myfeed.com[ -~][^\"]*" | sed "s: :%20:g" | xargs wget -c

dermidgen · 2015-10-30 22:13:43 24
Search irssi logs for specific pattern and display time and matching lines
This is sample output - yours may be different.
0

find ~/irclogs/ -type f -printf "%T+\t%p\n" | sort | cut -f2 | xargs -I {} sed -n "/^\-\-\-/ {x; /searched phrase/ p;x;h}; /searched phrase/ {H;};" {}

jnxy · 2015-11-03 14:00:50 10
finds all bean ids in all xml files from the current folder

finds all xml files greps them for extracts the bean id sorts the ids creates a list of distinct entries, a unique list of bean ids Show Sample Output
This is sample output - yours may be different.
```
groupManager
groupPermissionsDelegate
groupPermissionsDelegate
handleResolver
hashRegistry
hazelcastCacheCompactor
hazelcastCacheConfigManager
```
0

find . -iname "*.xml" | xargs cat | grep '<bean[^>]\+id=' | sed 's/.*id="$[^"]\+$".*/\1/g' | sort | uniq -u

gruzilla · 2015-11-06 07:57:22 10
Efficiently print a line deep in a huge log file

Get two different lines like this: sed -n '1000000p;2000000{p;q;}' < massive-log-file.log See also: http://www.commandlinefu.com/commands/view/6043/print-just-line-4-from-a-textfile
This is sample output - yours may be different.
0

sed -n '1000000{p;q;}' < massive-log-file.log

bariumbitmap · 2015-11-20 19:43:41 28

Show a git log with offsets relative to HEAD

This is how you can do this without having to use oneline Show Sample Output

git log | nl -w9 -v0 --body-numbering='pcommit\ [0-9a-f]\{40\}' | sed 's/^ \+$[0-9]\+$\s\+/HEAD~\1 /'

guywithnose · 2015-11-23 21:53:33 10

easily strace all your apache *child* processes

On debian parent process is running as root, workers as www-data. You can run strace in backgroud, get its PID, curl your webpage, kill strace and read your stats.
This is sample output - yours may be different.
0

strace -c $(ps -u www-data o pid= | sed 's/^/-p/')

brablc · 2015-11-25 08:10:52 11
show number of established TCP connections
This is sample output - yours may be different.
0

ss -s | sed -n '/.*estab $[0-9]*$.*/s//\1/p'

phrik · 2015-12-08 12:35:22 11
remove all development packages in ubuntu

its not the prettiest but it should do the job. This one liner removes all ubuntu packages whose name ends with *-dev
This is sample output - yours may be different.
0

sudo apt-get remove $(dpkg -l \*-dev | grep ^ii | sed 's/\-dev.*/-dev/' | sed -r 's/.{4}//')

tarfoh · 2015-12-11 14:02:31 12
Google Authenticator. Setup a user and email them a QR code.

Requirements: Google Authenticator is configured as per document (http://blogs.vmware.com/consulting/files/2015/02/VMW_15Q1_TD_Horizon-View-Google-Authenticator_021715_FINAL_EMonjoin.pdf) including the patch at the end of the document. Login as the user to be provisioned. su username Command will: 1. Silently provision a user for Google Authenticator (TOTP) 2. Remove the unnecessary (and unsecure) code that uses google.com to create the QR code in browser. 3. Decode URL (first instance) 4. Decode URL (second instance) 5. Create a QR code 6. Send email to an account with the QR Code attached User scans QR code with Google Authenticator.
This is sample output - yours may be different.
0

google-authenticator -tdfo -i "Company" -l "GAuth" -r 3 -R 30 -w 17 -Q UTF8 | cut -c 62- | sed -e's/%$[0-9A-F][0-9A-F]$/\\\\\x\1/g' | xargs echo -e | qrencode -o qrcode.png | sendemail -t user@domain.com -f sender@domain.com -u "QR" -a qrcode.png

mooves · 2015-12-14 06:52:08 12
yet another random password generator.

this one includes special characters. note some some chars may be disallowed on windows systems. *nix will allow pretty much any character in a password except a carriage return. you do not want non printing characters in your password, so this is limited to the printable chars displayed on a keyboard , less space and return. edited to fix minor typo Show Sample Output
This is sample output - yours may be different.
```
3dV-fcb]t"
```
0

tr -dc '[:print:]' < /dev/urandom | fold -w10 |head -n1 |sed 's/ //g'

wr250 · 2016-01-09 13:43:16 12
Bulk change of mail domains in Rainloop

I had to reconfigure all of my 150 domains to use "localhost" as IMAP/SMTP server instead of mail.[domain]. This little thing did the job in a fraction of a second!
This is sample output - yours may be different.
0

sed -i -E 's/mail\..*/localhost\"/g' *

Blagus · 2016-01-15 14:48:32 10
grab all m4a file from bbc radio 4 extra for some easy audio ebbok listening

use get_iplay to download all listed content from http://www.bbc.co.uk/radio4extra run every night to make sure no episodes are missed
This is sample output - yours may be different.
0

get_iplayer --type=radio --channel "Radio 4 Extra" | grep : | awk '{ if ( NR > 1 ) { print } }'|sed 's/:.*//' |sed '$ d' > pidlist && while read p; do get_iplayer --get --fields=pid $p; done <pidlist && rm pidlist

dunryc · 2016-01-16 17:20:54 11
Show UDID of iPhone

this is what i needed on ubuntu 12.04 for ios 9
This is sample output - yours may be different.
0

lsusb -s `lsusb | grep "Apple" | cut -d ' ' -f 2`:`lsusb | grep "Apple" | cut -d ' ' -f 4 | sed 's/://'` -v | grep iSerial | awk '{print $3}'

dormi · 2016-01-19 09:08:27 10
Git reset added new files

1. No for-loop, but xargs. 2. Append "--" in git-reset HEAD command to deal with filenames contained leading hyphen/minus sign (-). 3. Add "--porcelain" option in git-status command for easy-to-parse format when scripting. 4. Add "--no-run-if-empty" option in xargs command to prevent you run it twice and accidentally reset all staged changes. 5. Use zero byte (NUL character) as line terminator instead of newline (\n) to make it more robust to deal with filename with whitespaces. pipe#1: git-status. pipe#2: Use "grep" to filter out "non-added" files. pipe#3: use "sed" to Trim out the leading three characters, reserve the filename. pipe#4: xargs + git-reset... p.s. The "HEAD" in git-reset can be omitted . And, maybe, the third part of this shell pipe (sed) has potential to be enhanced.
This is sample output - yours may be different.
0

git status --porcelain -z | grep -zZ '^A[ MD] ' | sed -z 's/^...//' | xargs -0 --no-run-if-empty git reset HEAD --

goldie · 2016-01-24 16:20:08 10
easily trace all Nginx processes

Nginx (and other webservers like Apache) can be awkward to trace. They run as root, then switch to another user once they're ready to serve web pages. They also have a "master" process and multiple worker processes. The given command finds the process IDs of all Nginx processes, joins them together with a comma, then traces all of them at once with "sudo strace." System trace output can be overwhelming, so we only capture "networking" output. TIP: to kill this complex strace, do "sudo killall strace". Compare with a similar command: http://www.commandlinefu.com/commands/view/11918/easily-strace-all-your-apache-processes Show Sample Output
This is sample output - yours may be different.
```
# grab an Nginx web page:
#     curl -so /dev/null localhost

[pid  1145] accept4(6, {sa_family=AF_INET, sin_port=htons(57358), sin_addr=inet_addr("127.0.0.1")}, [16], SOCK_NONBLOCK) = 10
[pid  1145] recvfrom(10, "GET / HTTP/1.1\r\nUser-Agent: curl"..., 1024, 0, NULL, NULL) = 73
[pid  1145] setsockopt(10, SOL_TCP, TCP_CORK, [1], 4) = 0
[pid  1145] sendfile(10, 11, [0], 612)  = 612
[pid  1145] setsockopt(10, SOL_TCP, TCP_CORK, [0], 4) = 0
[pid  1145] recvfrom(10, 0xa7e1c0, 1024, 0, 0, 0) = -1 EAGAIN (Resource temporarily unavailable)
[pid  1145] recvfrom(10, "", 1024, 0, NULL, NULL) = 0
```
0

sudo strace -e trace=network -p `pidof nginx | sed -e 's/ /,/g'`

shavenwarthog · 2016-01-28 18:48:16 12
underscore to camelCase

Convert Underscore to CamelCase Show Sample Output
This is sample output - yours may be different.
```
ThisIsLargeExampleWithUpperCaseToo
```
0

echo "this_is_a_large_example_With_Upper_case_too" | sed -re 's/(_([a-zA-Z]))+([a-zA-Z]+)+/\U\2\L\3/g;s/(^[a-z])/\U\1/')

iharob · 2016-01-31 17:03:19 13
Strip beginning numbers in a filename

This oneliner will remove the number which begins a filename.
This is sample output - yours may be different.
0

find . -type f | sed 's|$.*/$[^A-Z]*$[A-Z].*$|mv \"&\" \"\1\2\"|' | sh

leatherface · 2016-02-01 11:29:20 13
Takes and displays screenshot of Android phone over adb.
This is sample output - yours may be different.
0

adb shell "screencap -p | base64" | sed 's/\r$//' | base64 -d | display

killer · 2016-02-13 12:45:40 12
Get just LAN IP without all the extra stuff

I just needed to store the LAN IP (for ipv4) in a variable for a specific task in a bash script. I figured I'd share. I sent it to a variable with VAR=$(stuff) and used it later on. I put the exit 0 in the if statement to make it so that it breaks if there are more than one IPv4 addresses assigned. I only wanted the first one. Edit: Bear in mind, my network mask is a double digit number so if you have a smaller nw mask you'd need to edit the sed statement. Show Sample Output
This is sample output - yours may be different.
```
192.168.1.245
```
0

ip addr show | grep "inet " | while read INET IP TRASH; do if [ $IP != "127.0.0.1/8" ]; then echo $IP; exit 0; fi; done | sed s:/[1-9][1-9]:"":

Meh · 2016-04-07 17:46:20 11
Inverted cowsay

It's quite fun to invert text using "flip.pl" (ref: http://ubuntuforums.org/showthread.php?t=2078323 ). Slightly more challenging is to flip a whole "cowsay". :-) Show Sample Output
This is sample output - yours may be different.
```
$ echo Which way up? | flip.pl | cowsay | tac | sed -e "s,/,+,g" -e "s,\\\,/,g" -e "s,+,\\\,g" -e "s,_,-,g" -e "s,\^,v,g"
                ||     ||
                ||----w |
            (--)/       )/\/
         /  (oo)/-------
        /   v--v
 ------------------------ 
< ?dn &#654;&#592;&#653; &#613;&#596;&#305;&#613;&#653; >
 ------------------------ 
```
0

echo Which way up? | flip.pl | cowsay | tac | sed -e "s,/,+,g" -e "s,\\\,/,g" -e "s,+,\\\,g" -e "s,_,-,g" -e "s,\^,v,g"

mpb · 2016-04-08 11:41:44 28

Human readable docker stats output

Show Sample Output

docker stats --no-stream $( docker ps -q ) | sed -e "$( docker ps --format "{{.ID}} {{.Names}}" | sed -e "s/$.*$ $.*$/s\/\1\/\2\t\/g;/" )"

gtron · 2016-04-14 15:20:13 12

Solaris 11, test which version your IPS pkg will update you to.

Above example is upgrading Solaris from 11.1SRU20.0.5 to 11.2SRU15.0.5. Patches are not applied options "-nv" are for dryrun and verbose output. Show Sample Output
This is sample output - yours may be different.
```
# pkg update -nv | sed -n '/entire/{N;p;}'
  entire
    0.5.11,5.11-0.175.1.20.0.5.0:20140613T162323Z -> 0.5.11,5.11-0.175.2.15.0.5.1:20151026T231525Z
```
0

pkg update -nv | sed -n '/entire/{N;p;}'

apaton · 2016-04-15 20:48:49 12
Get HTTP Codes for All Websites in Apache Configuration files.

Check that all websites on the current server are working as expected. This is a quick easy way to do that. Show Sample Output
This is sample output - yours may be different.
```
projectivemotion.com,200
www.projectivemotion.com,301
amadomartinez.mx,200
anotherwebsite.com,301
somethinghappening.com,500
anothererror.com,500
```
0

grep -h 'Server$Name\|Alias$' /etc/httpd/conf.d/*.conf | sed 's#\s*Server$Name\|Alias$\s*##g' | tr ' ' "\n" | xargs -I{} sh -c 'echo {},`curl -s -o /dev/null -w "%{http_code}" {}`'

AmadoMartinez · 2016-05-13 17:16:52 10

Block all traffic from an Autonomous System (AS) Network (e.g. Facebook)

Retrieves AS route prefixes for IPv4 and IPv6, aggregates the routes to the minimal set, and adds netfilter rules to reject them. Relies on two helpers: IPv4 - "aggregate" by Joe Abley (package name 'aggregate'), IPv6 - "aggregate6" by Job Snijders ( https://github.com/job/aggregate6 ) Show Sample Output

ASN=32934; for IP in 4 6; do whois -h riswhois.ripe.net \!${IP/4/g}as${ASN} | sed -n '2 p' | tr \ \\n | aggregate${IP/4/} | while read NET; do ip${IP/4/}tables -I INPUT -S ${NET} -j REJECT; done; done

iam_TJ · 2016-05-29 09:45:34 10

‹ First < 38 39 40 41 42 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

move up through directories faster (set in your /etc/profile or .bash_profile)

Usage: $ up N I did not like two things in the submitted commands and fixed it here: 1) If I do cd - afterwards, I want to go back to the directory I've been before 2) If I call up without argument, I expect to go up one level It is sad, that I need eval (at least in bash), but I think it's safe here. eval is required, because in bash brace expansion happens before variable substitution, see http://rosettacode.org/wiki/Repeat_a_string#Using_printf

mysql bin log events per minute

shows number of mysql bin log events (which are mysql server events) per minute, useful to check stress times postmortem

Pull Total Memory Usage In Virtual Environment

This command basically adds up all of the individual instances processes and gives you a grand total for used memory in that instance alone.

Bruteforce Synology NAS Logins with Hydra

Periodic Log Deletion

deletes logs not modified in over [#] days - modify to compress or move, as needed

Get AWS temporary credentials ready to export based on a MFA virtual appliance

You might want to secure your AWS operations requiring to use a MFA token. But then to use API or tools, you need to pass credentials generated with a MFA token. This commands asks you for the MFA code and retrieves these credentials using AWS Cli. To print the exports, you can use: `awk '{ print "export AWS_ACCESS_KEY_ID=\"" $1 "\"\n" "export AWS_SECRET_ACCESS_KEY=\"" $2 "\"\n" "export AWS_SESSION_TOKEN=\"" $3 "\"" }'` You must adapt the command line to include: * $MFA_IDis ARN of the virtual MFA or serial number of the physical one * TTL for the credentials

Rename all files in a directory to the md5 hash

Which processes are listening on a specific port (e.g. port 80)

swap out "80" for your port of interest. Can use port number or named ports e.g. "http"

Monitor a file with tail with timestamps added

Should be a bit more portable since echo -e/n and date's -Ins are not.

FLV to AVI with subtitles and forcing audio sync using mencoder

Gives MPEG-4/DivX output video file ready for uploading to YouTube from FLV file downloaded from the site and your own subtitle file UTF-8 encoded. No resizing needed. (?)

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using sed

Commands using sed (1,319) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using sed (1,319)

sorted by