Implement basic robots.txt #264

Merged
Dalai Felinto merged 2 commits from robots into main 2024-10-21 16:49:20 +02:00

2 Commits

Author SHA1 Message Date
f1c0157d3b Include simple unittest 2024-10-21 15:50:50 +02:00
e2d9a76109 Implement basic robots.txt
It basically makes sure that the approval queue does not get crawled.
2024-10-21 15:41:28 +02:00