Robots.txt - General Support - ProcessWire
Hey guys,. It's been a while! Any rules of thumb as to exactly what are the minimum directories that need to be made open in robots.txt so ...
Environment-specific robots.txt - General Support - ProcessWire
Is there any way with PW to do environment-specific robots.txt, i.e. to block robots from staging sites without having to manually edit ...
TV Series on DVD
Old Hard to Find TV Series on DVD
Need help blocking a crawler - General Support - ProcessWire
I tried with robots.txt. but this crawler does not seem to respect what is configured. in robots.txt. I need something more powerfull with a ...
htaccess rewrite runs into processwire error - General Support ...
I have a site that has other ccTLDs, such as .co.za, .co.il, etc., I am trying to make a robots.txt for each of the different domains by following this article.
Can't reach admin page - General Support - ProcessWire
I have installed processwire on 2 of my domains which are hosted by different hosting company's but both of them fail to give me the admin page.
How to hide the admin (backend) login from bots and most people
I want to allow clients to login but I assume from a security POV it's better to not have a link to, say, /processwire/ in the footer as doing ...
htaccess 500 error - General Support - ProcessWire Support Forums
I know this error is caused by something simple in the htaccess file that I am overlooking, but I've been staring at it for hours with no luck.
Robots.txt Files - Search.gov
A /robots.txt file is a text file that instructs automated web bots on how to crawl and/or index a website. Web teams use them to provide information about ...
Hide files urls in site/assets/files directory? - ProcessWire
Is it possible to hide the URL to the various files in the site/assets/files directory from being indexed? For example, say I have a site at ...
Hide child pages but use their data - General Support - ProcessWire
set a 301 to their parent -> unsure on the seo effects and may cause trouble if the page tree needs to be changed; robots.txt disallow /faq-1 ...