Facebook scraper uses incorrect DNS data > my site is not gettng scraped

纵然是瞬间 提交于 2020-08-04 06:09:07

问题


I recently moved one of my sites (gezondbenjij.nl) to a new hosting account. This resulted in a new IP address.

Unfortunately, since the move, the Facebook scraper cannot find my site on the new IP address. It still uses the old IP. All DNS settings are correct, and every browser/client/tool finds the correct site at 178.22.57.204 (gezondbenjij.nl). Except for Facebook.. The facebook scraper lands in my old hosting account. So I guess their hostfile or DNS cache still holds the old data. Even after a couple of weeks.

I have set a domain alias at gezondbenjij.com --> gezondbenjij.nl, and redirected the old hosting account to this .com domain. In this way, facebook is redirected to the correct site via a bypass, but still is not able to scrape the site. So the URLs I try to share on facebook will not generate snippets at this moment.

Is there any way to force (or kindly ask) Facebook to update their DNS cache? I used the fb URL linter, but it will not solve the issue. It will only reset facebook's html cache, not the DNS cache..


回答1:


Check your IPv4 and IPv6 IP addresses in your DNS configuration. I had similar issue and the problem was that I've updated only IPv4 DNS record, while keeping old IPv6 (Facebook uses IPv6 in it's Tools). My hosting provider corrected it and problem was solved.



来源:https://stackoverflow.com/questions/23156867/facebook-scraper-uses-incorrect-dns-data-my-site-is-not-gettng-scraped

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!