How to ask Google, Bing and Yandex to crawl a page

Each engine has its own way to request a crawl. Here is what works where, and which part you can run from your assistant.

What you can request, engine by engine

EngineHowFrom your assistant
GoogleURL Inspection, then Request Indexing in the Search Console web interfaceInspect only (gsc_inspect_url). mowteng cannot request indexing in Google.
BingSubmit URLs in Bing Webmaster Tools, or use IndexNowbing_submit_urls: up to 500 URLs, within the site's daily quota, which depends on its age and traffic
YandexRecrawl request in Yandex Webmaster, or IndexNowyandex_submit_urls: up to 100 URLs, within the daily recrawl quota
Bing, Yandex and othersIndexNowindexnow_submit: one call reaches every participating engine

Google does not take part in IndexNow, and mowteng has no tool that requests indexing in Google. For Google, inspect the URL with mowteng, then press Request Indexing in Search Console yourself.

Ask Google by hand

  1. In Search Console, paste the full URL into the inspection bar at the top.
  2. Read the result. If the page is not on Google, or the version Google has is outdated, use Request Indexing.
  3. Wait. Google queues the request and may need days. Repeating it does not speed anything up.

Google limits how many requests you can make per day, so keep them for pages that matter: new pages, and pages whose content changed in a way you want shown. Everything else is better served by a good sitemap.

Do the checking and the rest from your assistant

gsc_inspect_url returns Google's index status, the last crawl, the canonical and rich results for one URL. It uses the property's URL Inspection quota of 2,000 per day. After you have asked Bing, Yandex and the IndexNow engines, inspect again a few days later to see whether Google has picked the page up on its own.

Ask your assistant

I just published https://example.com/blog/new-post. Inspect it in Google, then submit it to Bing, Yandex and IndexNow.

Bing, Yandex and IndexNow submissions are write actions, so your assistant should ask before sending them. IndexNow needs a key file on your site first; see set up IndexNow.

A request is not a promise

No engine guarantees indexing after a request. If a page is crawled but stays out, the reason is usually content or quality, not crawling. Discovered and crawled, currently not indexed explains that status, and auditing which pages are not indexed finds the pattern across a whole site.

Connect Search Console, Bing and Yandex to your AI assistant with one URL. 7-day free trial.

Connect mowteng