Design a distributed web crawler service
Filed under Microsoft
The question
Design a crawler service that returns all websites recursively reachable from a starting URL, operating as a distributed system where results cannot fit on a single node.
No write-up yet. Related questions below have one.
Related Microsoft questions
Collected from public candidate posts and coding forums. Updated Nov 2026.