Teaching or conference talk · for some experience
Design a Web Crawler: FAANG Interview Question
About this video
How would you design a web crawler for a system design interview? This walkthrough takes engineers through one possible answer.
Good to know: Aimed at interview preparation rather than SEOs
Why watch it
Walks through designing a web crawler as a system design interview question. Aimed at engineers preparing for interviews rather than SEOs.
On the same topics
Official source
Do sitemaps still matter?
Sells in this field
Sitemaps are often treated as an afterthought - Carlos Manuel Sánchez Donate
Trade press or conference
065: Optimizing “Crawl Budget” To Improve Your Web Traffic w/Vanessa Fox
Trade press or conference
Crawling, indexing and logfiles: The beauty and the beast - Andor Palau - brightonSEO October 2024