In this article you will learn how to manually paste the HTML of pages that can't be crawled in Surfer's SERP Analyzer.

  1. When should you consider adding the HTML manually?

  2. How to copy a rendered HTML?

  3. How to add the HTML on your own?

When should you consider adding the HTML manually?

  • When you get "Oops... we were unable to crawl this page" error in the SERP analyzer

    Zrzut_ekranu_2021-04-15_o_11.30.57.png
  • When our crawlers get blocked by the geo-restrictions on your website

  • When you're not sure if the page got crawled fully

Tip: You can look up how do the crawl bots see your page by using our screenshot feature here:

Should something be off, you will be able to spot it there right away.

How to copy a rendered HTML?

OuterHTML is a fully rendered version of your HTML code. Thanks to that, the crawler won't get blocked by broken scripts or elements that load dynamically.

Google Chrome

1. Open the page you want to get the HTML of.

2. Open the Elements Panel using the following shortcut:

    • Windows: Control+Shift+C

    • Mac: Command+Option+C

3. Right-click the row that starts with <html..., hover on Copy, and pick Copy outerHTML.

Zrzut_ekranu_2021-04-15_o_12.08.48.png

Firefox

1. Open the page you want to get the HTML of.

2. Open the Inspector Panel using the following shortcut:

    • Windows: Control+Shift+C

    • Mac: Command+Option+C

3. Right-click the row that starts with <html..., hover on Copy, and pick Outer HTML.

Zrzut_ekranu_2021-04-15_o_12.26.57.png

How to add the HTML on your own?

URLs with crawl error

1. Scroll down to the list of results in the SERP Analyzer and find the page you want to add the HTML of.

2. Click on the < > Paste Source Code button.

Zrzut_ekranu_2021-04-15_o_12.47.58.png

3. Paste in the rendered HTML and click Submit.


Any URL

1. Scroll down to the list of results in the SERP Analyzer and find the page you want to add the HTML of.

2. Click on the three dots on the right side of that URL and choose < > Paste HTML.

3. Paste in the rendered HTML and click Submit.

Did this answer your question?