Appearance
Blocked due to unauthorized request (401)
Blocked due to unauthorized request (401)
This status indicates that Googlebot attempted to access a page but was denied authorization. This typically occurs when the page is protected by authentication or access restrictions, such as:
- Login requirements
- Password protection
- IP-based access control
- Security rules that block unknown or automated requests
As a result, Google is unable to crawl the page content.
Option 1: You do not want this page indexed
If the page is not intended to appear in Google search results, no action is required. Pages that require authentication are commonly excluded from indexing.
Option 2: You do want this page indexed
If the page should be crawlable and indexed by Google, please review the following settings:
1. Check authentication requirements
- If the page requires login credentials or other authentication methods, Googlebot will not be able to access it.
- Consider removing authentication from pages that need to be indexed.
- Restrict authentication only to sensitive or private content that should not appear in search results.
2. Allow Googlebot access (IP whitelist)
- If your website uses IP-based access restrictions, ensure that Googlebot’s IP addresses are whitelisted.
- Google provides an official list of Googlebot IP ranges that can be used for this configuration.
- Once Googlebot is authorized, it will be able to crawl and index the page normally.
Important Notes
Google can only index pages that it is able to access and crawl. Any authentication or security mechanism that blocks Googlebot will prevent indexing, even if the page is publicly accessible to logged-in users.
If you are unsure which restriction is causing the block, or need help adjusting your settings, please feel free to contact us for assistance.
