I've seen suggestions of various tools that crawl sites and generate reports. I've seen people suggest combing server logs, or just simply going through a website page-by-page and link-by-link (although this quickly becomes untenable for larger architectures -- i.e. thousands of pages). But is there any accepted best-practice for making sure you didn't miss anything?
Or is the answer: You can't?