Commands using sed sorted by votes

Commands using sed (1,319)

sorted by

Ensuring that the IP has no strange characters

This command validates if exist any character different in 0-255 and dot. If any characters different is typed the error menssage is showing. Show Sample Output
This is sample output - yours may be different.
```
IP="192.168.1.1"
checking=`echo ${IP} | sed "s/[0-9\.]//g"`;
if [ "${checking}" != "" ]; 
   then 
           echo "Please type only numeric characters separated for dot";
   exit;
fi
```
0

echo ${IP} | sed "s/[0-9\.]//g"

andregyn62 · 2015-10-19 18:20:03 11
Download files linked in a RSS feed

Just added a little url encoding with sed - urls with spaces don't work well - this also works against instead of enclosure and adds a sample to show that you can filter against links at a certain domain Show Sample Output
This is sample output - yours may be different.
```
Reusing existing connection to www.yourfeed.com:80.
HTTP request sent, awaiting response... 200 OK
Length: 176975 (173K) [application/pdf]
Saving to: 'MyFile.pdf'

MyFile.pdf            100%[==================================================================================================================>] 172.83K   488KB/s   in 0.4s   

2015-10-30 15:06:24 (488 KB/s) - 'MyFile.pdf' saved [176975/176975]
```
0

wget -q -O- http://www.yourfeed.com/rss | grep -o "<link[ -~][^>]*" | grep -o "http://www.myfeed.com[ -~][^\"]*" | sed "s: :%20:g" | xargs wget -c

dermidgen · 2015-10-30 22:13:43 24
Search irssi logs for specific pattern and display time and matching lines
This is sample output - yours may be different.
0

find ~/irclogs/ -type f -printf "%T+\t%p\n" | sort | cut -f2 | xargs -I {} sed -n "/^\-\-\-/ {x; /searched phrase/ p;x;h}; /searched phrase/ {H;};" {}

jnxy · 2015-11-03 14:00:50 10
finds all bean ids in all xml files from the current folder

finds all xml files greps them for extracts the bean id sorts the ids creates a list of distinct entries, a unique list of bean ids Show Sample Output
This is sample output - yours may be different.
```
groupManager
groupPermissionsDelegate
groupPermissionsDelegate
handleResolver
hashRegistry
hazelcastCacheCompactor
hazelcastCacheConfigManager
```
0

find . -iname "*.xml" | xargs cat | grep '<bean[^>]\+id=' | sed 's/.*id="$[^"]\+$".*/\1/g' | sort | uniq -u

gruzilla · 2015-11-06 07:57:22 10
Efficiently print a line deep in a huge log file

Get two different lines like this: sed -n '1000000p;2000000{p;q;}' < massive-log-file.log See also: http://www.commandlinefu.com/commands/view/6043/print-just-line-4-from-a-textfile
This is sample output - yours may be different.
0

sed -n '1000000{p;q;}' < massive-log-file.log

bariumbitmap · 2015-11-20 19:43:41 28

Show a git log with offsets relative to HEAD

This is how you can do this without having to use oneline Show Sample Output

git log | nl -w9 -v0 --body-numbering='pcommit\ [0-9a-f]\{40\}' | sed 's/^ \+$[0-9]\+$\s\+/HEAD~\1 /'

guywithnose · 2015-11-23 21:53:33 10

easily strace all your apache *child* processes

On debian parent process is running as root, workers as www-data. You can run strace in backgroud, get its PID, curl your webpage, kill strace and read your stats.
This is sample output - yours may be different.
0

strace -c $(ps -u www-data o pid= | sed 's/^/-p/')

brablc · 2015-11-25 08:10:52 11
show number of established TCP connections
This is sample output - yours may be different.
0

ss -s | sed -n '/.*estab $[0-9]*$.*/s//\1/p'

phrik · 2015-12-08 12:35:22 11
remove all development packages in ubuntu

its not the prettiest but it should do the job. This one liner removes all ubuntu packages whose name ends with *-dev
This is sample output - yours may be different.
0

sudo apt-get remove $(dpkg -l \*-dev | grep ^ii | sed 's/\-dev.*/-dev/' | sed -r 's/.{4}//')

tarfoh · 2015-12-11 14:02:31 12
Google Authenticator. Setup a user and email them a QR code.

Requirements: Google Authenticator is configured as per document (http://blogs.vmware.com/consulting/files/2015/02/VMW_15Q1_TD_Horizon-View-Google-Authenticator_021715_FINAL_EMonjoin.pdf) including the patch at the end of the document. Login as the user to be provisioned. su username Command will: 1. Silently provision a user for Google Authenticator (TOTP) 2. Remove the unnecessary (and unsecure) code that uses google.com to create the QR code in browser. 3. Decode URL (first instance) 4. Decode URL (second instance) 5. Create a QR code 6. Send email to an account with the QR Code attached User scans QR code with Google Authenticator.
This is sample output - yours may be different.
0

google-authenticator -tdfo -i "Company" -l "GAuth" -r 3 -R 30 -w 17 -Q UTF8 | cut -c 62- | sed -e's/%$[0-9A-F][0-9A-F]$/\\\\\x\1/g' | xargs echo -e | qrencode -o qrcode.png | sendemail -t user@domain.com -f sender@domain.com -u "QR" -a qrcode.png

mooves · 2015-12-14 06:52:08 12
yet another random password generator.

this one includes special characters. note some some chars may be disallowed on windows systems. *nix will allow pretty much any character in a password except a carriage return. you do not want non printing characters in your password, so this is limited to the printable chars displayed on a keyboard , less space and return. edited to fix minor typo Show Sample Output
This is sample output - yours may be different.
```
3dV-fcb]t"
```
0

tr -dc '[:print:]' < /dev/urandom | fold -w10 |head -n1 |sed 's/ //g'

wr250 · 2016-01-09 13:43:16 12
Bulk change of mail domains in Rainloop

I had to reconfigure all of my 150 domains to use "localhost" as IMAP/SMTP server instead of mail.[domain]. This little thing did the job in a fraction of a second!
This is sample output - yours may be different.
0

sed -i -E 's/mail\..*/localhost\"/g' *

Blagus · 2016-01-15 14:48:32 10
grab all m4a file from bbc radio 4 extra for some easy audio ebbok listening

use get_iplay to download all listed content from http://www.bbc.co.uk/radio4extra run every night to make sure no episodes are missed
This is sample output - yours may be different.
0

get_iplayer --type=radio --channel "Radio 4 Extra" | grep : | awk '{ if ( NR > 1 ) { print } }'|sed 's/:.*//' |sed '$ d' > pidlist && while read p; do get_iplayer --get --fields=pid $p; done <pidlist && rm pidlist

dunryc · 2016-01-16 17:20:54 11
Show UDID of iPhone

this is what i needed on ubuntu 12.04 for ios 9
This is sample output - yours may be different.
0

lsusb -s `lsusb | grep "Apple" | cut -d ' ' -f 2`:`lsusb | grep "Apple" | cut -d ' ' -f 4 | sed 's/://'` -v | grep iSerial | awk '{print $3}'

dormi · 2016-01-19 09:08:27 10
Git reset added new files

1. No for-loop, but xargs. 2. Append "--" in git-reset HEAD command to deal with filenames contained leading hyphen/minus sign (-). 3. Add "--porcelain" option in git-status command for easy-to-parse format when scripting. 4. Add "--no-run-if-empty" option in xargs command to prevent you run it twice and accidentally reset all staged changes. 5. Use zero byte (NUL character) as line terminator instead of newline (\n) to make it more robust to deal with filename with whitespaces. pipe#1: git-status. pipe#2: Use "grep" to filter out "non-added" files. pipe#3: use "sed" to Trim out the leading three characters, reserve the filename. pipe#4: xargs + git-reset... p.s. The "HEAD" in git-reset can be omitted . And, maybe, the third part of this shell pipe (sed) has potential to be enhanced.
This is sample output - yours may be different.
0

git status --porcelain -z | grep -zZ '^A[ MD] ' | sed -z 's/^...//' | xargs -0 --no-run-if-empty git reset HEAD --

goldie · 2016-01-24 16:20:08 10
easily trace all Nginx processes

Nginx (and other webservers like Apache) can be awkward to trace. They run as root, then switch to another user once they're ready to serve web pages. They also have a "master" process and multiple worker processes. The given command finds the process IDs of all Nginx processes, joins them together with a comma, then traces all of them at once with "sudo strace." System trace output can be overwhelming, so we only capture "networking" output. TIP: to kill this complex strace, do "sudo killall strace". Compare with a similar command: http://www.commandlinefu.com/commands/view/11918/easily-strace-all-your-apache-processes Show Sample Output
This is sample output - yours may be different.
```
# grab an Nginx web page:
#     curl -so /dev/null localhost

[pid  1145] accept4(6, {sa_family=AF_INET, sin_port=htons(57358), sin_addr=inet_addr("127.0.0.1")}, [16], SOCK_NONBLOCK) = 10
[pid  1145] recvfrom(10, "GET / HTTP/1.1\r\nUser-Agent: curl"..., 1024, 0, NULL, NULL) = 73
[pid  1145] setsockopt(10, SOL_TCP, TCP_CORK, [1], 4) = 0
[pid  1145] sendfile(10, 11, [0], 612)  = 612
[pid  1145] setsockopt(10, SOL_TCP, TCP_CORK, [0], 4) = 0
[pid  1145] recvfrom(10, 0xa7e1c0, 1024, 0, 0, 0) = -1 EAGAIN (Resource temporarily unavailable)
[pid  1145] recvfrom(10, "", 1024, 0, NULL, NULL) = 0
```
0

sudo strace -e trace=network -p `pidof nginx | sed -e 's/ /,/g'`

shavenwarthog · 2016-01-28 18:48:16 12
underscore to camelCase

Convert Underscore to CamelCase Show Sample Output
This is sample output - yours may be different.
```
ThisIsLargeExampleWithUpperCaseToo
```
0

echo "this_is_a_large_example_With_Upper_case_too" | sed -re 's/(_([a-zA-Z]))+([a-zA-Z]+)+/\U\2\L\3/g;s/(^[a-z])/\U\1/')

iharob · 2016-01-31 17:03:19 13
Strip beginning numbers in a filename

This oneliner will remove the number which begins a filename.
This is sample output - yours may be different.
0

find . -type f | sed 's|$.*/$[^A-Z]*$[A-Z].*$|mv \"&\" \"\1\2\"|' | sh

leatherface · 2016-02-01 11:29:20 13
Takes and displays screenshot of Android phone over adb.
This is sample output - yours may be different.
0

adb shell "screencap -p | base64" | sed 's/\r$//' | base64 -d | display

killer · 2016-02-13 12:45:40 12
Get just LAN IP without all the extra stuff

I just needed to store the LAN IP (for ipv4) in a variable for a specific task in a bash script. I figured I'd share. I sent it to a variable with VAR=$(stuff) and used it later on. I put the exit 0 in the if statement to make it so that it breaks if there are more than one IPv4 addresses assigned. I only wanted the first one. Edit: Bear in mind, my network mask is a double digit number so if you have a smaller nw mask you'd need to edit the sed statement. Show Sample Output
This is sample output - yours may be different.
```
192.168.1.245
```
0

ip addr show | grep "inet " | while read INET IP TRASH; do if [ $IP != "127.0.0.1/8" ]; then echo $IP; exit 0; fi; done | sed s:/[1-9][1-9]:"":

Meh · 2016-04-07 17:46:20 11
Inverted cowsay

It's quite fun to invert text using "flip.pl" (ref: http://ubuntuforums.org/showthread.php?t=2078323 ). Slightly more challenging is to flip a whole "cowsay". :-) Show Sample Output
This is sample output - yours may be different.
```
$ echo Which way up? | flip.pl | cowsay | tac | sed -e "s,/,+,g" -e "s,\\\,/,g" -e "s,+,\\\,g" -e "s,_,-,g" -e "s,\^,v,g"
                ||     ||
                ||----w |
            (--)/       )/\/
         /  (oo)/-------
        /   v--v
 ------------------------ 
< ?dn &#654;&#592;&#653; &#613;&#596;&#305;&#613;&#653; >
 ------------------------ 
```
0

echo Which way up? | flip.pl | cowsay | tac | sed -e "s,/,+,g" -e "s,\\\,/,g" -e "s,+,\\\,g" -e "s,_,-,g" -e "s,\^,v,g"

mpb · 2016-04-08 11:41:44 28

Human readable docker stats output

Show Sample Output

docker stats --no-stream $( docker ps -q ) | sed -e "$( docker ps --format "{{.ID}} {{.Names}}" | sed -e "s/$.*$ $.*$/s\/\1\/\2\t\/g;/" )"

gtron · 2016-04-14 15:20:13 12

Solaris 11, test which version your IPS pkg will update you to.

Above example is upgrading Solaris from 11.1SRU20.0.5 to 11.2SRU15.0.5. Patches are not applied options "-nv" are for dryrun and verbose output. Show Sample Output
This is sample output - yours may be different.
```
# pkg update -nv | sed -n '/entire/{N;p;}'
  entire
    0.5.11,5.11-0.175.1.20.0.5.0:20140613T162323Z -> 0.5.11,5.11-0.175.2.15.0.5.1:20151026T231525Z
```
0

pkg update -nv | sed -n '/entire/{N;p;}'

apaton · 2016-04-15 20:48:49 12
Get HTTP Codes for All Websites in Apache Configuration files.

Check that all websites on the current server are working as expected. This is a quick easy way to do that. Show Sample Output
This is sample output - yours may be different.
```
projectivemotion.com,200
www.projectivemotion.com,301
amadomartinez.mx,200
anotherwebsite.com,301
somethinghappening.com,500
anothererror.com,500
```
0

grep -h 'Server$Name\|Alias$' /etc/httpd/conf.d/*.conf | sed 's#\s*Server$Name\|Alias$\s*##g' | tr ' ' "\n" | xargs -I{} sh -c 'echo {},`curl -s -o /dev/null -w "%{http_code}" {}`'

AmadoMartinez · 2016-05-13 17:16:52 10

Block all traffic from an Autonomous System (AS) Network (e.g. Facebook)

Retrieves AS route prefixes for IPv4 and IPv6, aggregates the routes to the minimal set, and adds netfilter rules to reject them. Relies on two helpers: IPv4 - "aggregate" by Joe Abley (package name 'aggregate'), IPv6 - "aggregate6" by Job Snijders ( https://github.com/job/aggregate6 ) Show Sample Output

ASN=32934; for IP in 4 6; do whois -h riswhois.ripe.net \!${IP/4/g}as${ASN} | sed -n '2 p' | tr \ \\n | aggregate${IP/4/} | while read NET; do ip${IP/4/}tables -I INPUT -S ${NET} -j REJECT; done; done

iam_TJ · 2016-05-29 09:45:34 10

‹ First < 38 39 40 41 42 > Last ›

What's this?

commandlinefu.com is the place to record those command-line gems that you return to again and again. That way others can gain from your CLI wisdom and you from theirs too. All commands can be commented on, discussed and voted up or down.

Share Your Commands

Check These Out

execute your commands hiding secret bits from history records

$ wget --user=username --password="$password" http://example.org/ Instead of hiding commands entirely from history, I prefer to use "read" to put the password into a variable, and then use that variable in the commands instead of the password. Without the "-e" and "-s" it should work in any bourne-type shell, but the -s is what makes sure the password doesn't get echoed to the screen at all. (-e makes editing work a bit better)

Broadcast your shell thru ports 5000, 5001, 5002 ...

run 'nc yourip 5000', 'nc yourip 5001' or 'nc yourip 5002' elsewhere will produce an exact same mirror of your shell. This is handy when you want to show someone else some amazing stuff in your shell without giving them control over it.

Compare two directories

Output of this command is the difference of recursive file lists in two directories (very quick!). To view differences in content of files too, use the command submitted by mariusbutuc (very slow!): $ diff -rq path_to_dir1 path_to_dir2

Command to logout all the users in one command

It's only to logout all other user's except "root"

Dump HTTP header using wget

Let me suggest using wget for obtaining the HTTP header only as the last resort because it generates considerable textual overhead. The first ellipsis of the sample output stands for Spider mode enabled. Check if remote file exists. --2009-03-31 20:42:46-- http://www.example.com/ Resolving www.example.com... 208.77.188.166 Connecting to www.example.com|208.77.188.166|:80... connected. HTTP request sent, awaiting response... and the second one looks for Length: 438 [text/html] Remote file exists and could contain further links, but recursion is disabled -- not retrieving.

Update twitter from command line without reveal your password

Update twitter from commandline, without revealing your password and without having to type it interactively. You 'll need to put a line "machine twitter.com login TWITTERUSER password TWITTERPASS" in $HOME/.netrc and better chmod 600 that file.

Analyse an Apache access log for the most common IP addresses

This uses awk to grab the IP address from each request and then sorts and summarises the top 10.

Convert CSV to JSON

Replace 'csv_file.csv' with your filename.

search the manual page names and descriptions

get colorful side-by-side diffs of files in svn with vim

This will diff your local version of the file with the latest version in svn. I put this in a shell function like so: $svd() { vimdiff

Stay in the loop…

Follow the Tweets.

Every new command is wrapped in a tweet and posted to Twitter. Following the stream is a great way of staying abreast of the latest commands. For the more discerning, there are Twitter accounts for commands that get a minimum of 3 and 10 votes - that way only the great commands get tweeted.

» http://twitter.com/commandlinefu
» http://twitter.com/commandlinefu3
» http://twitter.com/commandlinefu10

Subscribe to the feeds.

Use your favourite RSS aggregator to stay in touch with the latest commands. There are feeds mirroring the 3 Twitter streams as well as for virtually every other subset (users, tags, functions,…):

Subscribe to the feed for:

» all commands
» commands with 3 up-votes (commandlinefu3)
» commands with 10 up-votes (commandlinefu10)
» commands using sed

Commands using sed (1,319) the last day the last week the last month all time sorted by date votes

What's this?

Check These Out

Stay in the loop…

Commands using sed (1,319)

sorted by