[imc-sf-active] Search bug with hidden articles

[Emmanuel Paulus]

Hello,

There is a litle problem with the hidden articles and search-engines as
Google.

In alle pages with hidden content (hidden.php etc) there schould be a
Robots meta tag.
But the problem is the print and mail -page. These have no robot tag and
could be indexed bij Google or others.

Pratical, A user send a complain about a hidden issult but found by
Google as printpage (no 1 for his name).
 
Solution:
1) no print and mail for hidden pages (it is hidden why print/mail it?)
2) robot tag in print and mail page
3) use the robots.txt
This looks like more then needed but a page could be indexed by a search
machine when it was non hidden
Also there are other robots/searches then google who do things different.

In detail:
after new Article in printable.inc, mailable.inc (classes/pages) (no
print and mail for hidden page)
        if ($article->errorstatus!="" || $article->article["display"] ==
"f") {
          header("Location: /missing.php");
          exit;
        }

in het head-part of printable.tpl, mailable.tpl (templates/pages) (tell
robots to do nothing)
<meta name="ROBOTS"
content="NONE,NOINDEX,NOFOLLOW,NOARCHIVE,NOIMAGEINDEX" />

in robots.txt (website) (other method for robots)
User-agent: *
Disallow: /admin/
Disallow: /irc/
Disallow: /mirror/
Disallow: /refresh/
Disallow: hidden.php
Disallow: mail.php
Disallow: print.php

greetings,
 Emmanuel