Google search picking up items within design folder

(Qz02) #1

Hello,

 

It seems google search is picking up items within my design folder. This is outside of my site so i'm not sure how it is picking it up.

 

They are not actually "linked" from anywhere but some items are parts of nested content within templates.

 

i thought google only picked up "links".

 

Is there a way of somehow hiding them.

 

Thanks

(Nic Hubbard) #2

If they are just assets that are being nested you can actually remove the webpath for that asset since you would never need to view it by URL anyway.

(Bart Banda) #3

You might want to look into creating a robots.txt file to exclude certain paths from being indexed.

 

We usually set the following rules:

# Disallow some matrix defaults
User-agent: *
Disallow: /*?sq_content_src=
Disallow: /*_recache
Disallow: /*_edit
Disallow: /*_admin
Disallow: /*_login
Disallow: /*_performance
Disallow: /*_design
Disallow: /*_web_services
(Qz02) #4

Thanks everyone!