โ† Microsoft questions

Design a distributed web crawler service

Filed under Microsoft

The question

Design a crawler service that returns all websites recursively reachable from a starting URL, operating as a distributed system where results cannot fit on a single node.

No write-up yet. Related questions below have one.

Related Microsoft questions

Collected from public candidate posts and coding forums. Updated Nov 2026.