{"id":295,"date":"2014-07-20T04:34:57","date_gmt":"2014-07-19T22:34:57","guid":{"rendered":"http:\/\/promincproductions.com\/blog\/?p=295"},"modified":"2021-12-08T19:51:11","modified_gmt":"2021-12-09T01:51:11","slug":"seo-tools-bulk-http-header-response-checker","status":"publish","type":"post","link":"https:\/\/promincproductions.com\/blog\/seo-tools-bulk-http-header-response-checker\/","title":{"rendered":"SEO Tool: Bulk HTTP Header Response Checker"},"content":{"rendered":"

I was working in Google Webmaster Tools, looking at a (sadly) large list of 404 errors.  I found that there was an issue with the URL to a category, and thus the subsequent pages in that category ended up with bad URLs as well.  So I corrected the category level URL, tested a few URLs and all seemed good.  But Google was telling me that I had 320 URLs with issues…  Before I checked the “Marked as Fixed” button on all of the URLs, I wanted to verify that all 320 issues were fixed.<\/p>\n\n\n\n

That’s a lot of clicking and page checking…<\/p>\n\n\n\n

There has to be a better way, right?  So I did a bit of Googleing for a bulk link checking tool.  I came up with nothing that would do the trick.  Sad.  And odd.<\/p>\n\n\n\n

The Solution<\/h2>\n\n\n\n

Never the less, I did find a solution to my problem – just build it. \u00a0It’s a pretty simple task really, right? \u00a0I just need a bulk list of URLs, reach out to the server and check the header response, and that’s it, right? \u00a0Well the answer is yes – the hiccup in that though is I learned that PHP errors when you attempt\u00a0multiple get_headers<\/code> requests (despite them having multiple functions to do this). \u00a0So rather than using a PHP loop, I had my PHP loop call AJAX requests that will each do the PHP call individually.<\/p>\n\n\n\n

And to not be greedy and keep the solution to my self, here it is! \u00a0Feel free to use as you need. \u00a0It’s not pretty, and I’m aware I could do some polishing up around the edges, but it does work. \u00a0So good enough, right?<\/p>\n\n\n\n

\n
Use the Bulk HTTP Request Response Tool <\/a><\/div>\n<\/div>\n\n\n\n
\"Check
Check the HTTP Header Response from a large list of URLs at once. No need to load the page, click page by page, etc. This will give you a quick snapshot of which URLs need further investigation and which can be ignored. <\/figcaption><\/figure><\/div>\n\n\n\n

Usage Notes<\/h2>\n\n\n\n
  • URLs need to be complete – starting with http:\/\/<\/del><\/li>
  • Separate URLs with a semi-colon (;<\/code>) and no spaces. \u00a0This results in one really long string of URLs.<\/li>
  • Like I said, I used this for checking my Google Webmaster Tools URL Errors report. \u00a0So I downloaded the data to Excel, then used Excel and\/or a text editor to create the long string of URLs separated by the semi-colon.<\/li><\/ul>\n\n\n\n

    Update<\/h2>\n\n\n\n

    A few enhancements have been made since this post was written:<\/p>\n\n\n\n

    • You can separate URLs using multiple delimiter methods and select which it is via a radio button. \u00a0Options include a New Line (carriage return), comma, semi-colon, or tab.<\/li>
    • The tool now adds http:\/\/<\/code> to the beginning of a URL if it is not present<\/li>
    • Another counter was added to show how many need to be checked. \u00a0If you are processing a large number of URLs this will allow you to know when the tool has completed.<\/li><\/ul>","protected":false},"excerpt":{"rendered":"

      I was working in Google Webmaster Tools, looking at a (sadly) large list of 404 errors.  I found […]<\/p>\n","protected":false},"author":1,"featured_media":2263,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"wprm-recipe-roundup-name":"","wprm-recipe-roundup-description":"","_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[49,5],"tags":[327],"class_list":["post-295","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-seo","category-website-development","tag-seo-tool"],"jetpack_featured_media_url":"https:\/\/promincproductions.com\/blog\/wp-content\/uploads\/2021\/12\/image.png","jetpack_shortlink":"https:\/\/wp.me\/p4BbcR-4L","jetpack_sharing_enabled":true,"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/promincproductions.com\/blog\/wp-json\/wp\/v2\/posts\/295","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/promincproductions.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/promincproductions.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/promincproductions.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/promincproductions.com\/blog\/wp-json\/wp\/v2\/comments?post=295"}],"version-history":[{"count":5,"href":"https:\/\/promincproductions.com\/blog\/wp-json\/wp\/v2\/posts\/295\/revisions"}],"predecessor-version":[{"id":2264,"href":"https:\/\/promincproductions.com\/blog\/wp-json\/wp\/v2\/posts\/295\/revisions\/2264"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/promincproductions.com\/blog\/wp-json\/wp\/v2\/media\/2263"}],"wp:attachment":[{"href":"https:\/\/promincproductions.com\/blog\/wp-json\/wp\/v2\/media?parent=295"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/promincproductions.com\/blog\/wp-json\/wp\/v2\/categories?post=295"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/promincproductions.com\/blog\/wp-json\/wp\/v2\/tags?post=295"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}