Which of the following is NOT a function of the robots.txt file?
Choose an answer
Tap an option to check your answer.
Correct answer: Show search engine bots all the pages on a site.
Why this is the answer
The robots.txt file does not list all pages on a site; it instructs search engines on which pages to allow or disallow for crawling. It can also help prevent bots from overloading server resources and indicate the location of the sitemap. Proper configuration of robots.txt ensures efficient crawl management and protection of sensitive content.
Pass your exam — without the endless answer hunt
Get every verified question and explanation for this exam in one place, and save hours of prep. 1,000+ certifications · 20+ languages · free to start.
Pass your exam faster → No card needed