Extract parent domain/subdomain name from a list of url through Bash ShellScripting

Question

I have list of URLs like this:

http://example.com/sdfsdf/sdfsa
https://example2.com/53lasfd/asdfs
http://www.example3.com/asdfas/asdfasdf.php?=asdfa
https://subdomain.example4.com/index.php?id=sadfa
https://www.subdomain.example5.com/asdfas/asdfasd

I need to extract only domains (and subdomains) without http, https, www and all after /:

exmaple.com
exmaple2.com
example3.com
subdomain.example4.com
subdomain.example5.com

I actually do not understand your question, because you said you want subdomain, but www is a subdomain. — MaXi32
– MaXi32, Commented Jul 31, 2021 at 6:54

sat · Accepted Answer · 2015-10-01 10:48:53Z

2

You can use awk,

awk -F/ '{sub(/^www\.?/,"",$3); print $3}' yourfile

Test:

$ awk -F/ '{sub(/^www\.?/,"",$3); print $3}' yourfile
example.com
example2.com
example3.com
subdomain.example4.com
subdomain.example5.com

edited Oct 1, 2015 at 10:48

answered Oct 1, 2015 at 10:42

sat

15k7 gold badges49 silver badges69 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Alex Ivanov akapulke Over a year ago

Exactly what I needed! Thanks!

Alex Ivanov akapulke Over a year ago

And what if I do not need subdomains but only domains?

sat Over a year ago

Try : awk -F/ '{sub(/^www\.?/,"",$3); print $3}' yourfile | awk -F\. 'NF==2'

Alex Ivanov akapulke Over a year ago

I definitely clicked UP, but it in someway gone -1, how can I edit this?

Collectives™ on Stack Overflow

Extract parent domain/subdomain name from a list of url through Bash ShellScripting

1 Answer 1

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related