GIAC
GSEC · Question #10
What file instructs programs like Web spiders NOT to search certain areas of a site?
Sign in or unlock GSEC to reveal the answer and full explanation for question #10. The question stem and answer options stay visible for context.
Penetration Testing Foundations & Reconnaissance
Question
What file instructs programs like Web spiders NOT to search certain areas of a site?
Options
- ARobots.txt
- BRestricted.txt
- CSpider.txt
- DSearch.txt
Unlock GSEC to see the answer
You've previewed enough free GSEC questions. Unlock GSEC for full answers, explanations, the timed quiz mode, progress tracking, and the master PDF. Question stem and options stay visible so you can still see what's on the exam.
Topics
#robots.txt#web crawling#OSINT#passive reconnaissance