Cotonti / Open Source PHP Content Management FrameworkContent Management Framework

Forums / Cotonti / Extensions / [IDEA] Robots.txt Autogeneration

#112 2008-08-05 17:25
Not quite on the topic, but also of the robots

At this time, perhaps not fully enjoy robots.txt
Because, all the links look like ID | param | param | ...
It would be great to bring links to such mean param | param | ID (if there is a string parameters)
Then in the robots.txt can be cut duplicate pages and lists with the parameters (if required)