As an IA, I frequently take a detailed content inventory of a site, capturing basic things such as page titles, URL, and META keywords (to name a few).

What programs have people found success with?

I have used everything from:

Xenu (works great to get raw data)

Excel (tried but true method of inventorying smaller sites)

MindJet (client facing site maps, used to model and finalize an emerging site).

What other stuff is out there?

  • 2
    I've built a custom relational databases in Filemaker Pro to assist in manual IA inventory processes. Works much better than Excel.
    – Erics
    Dec 5, 2011 at 16:30
  • 2
    Another tactic is to grab web server traffic logs - they'll reveal a lot of URLs that are getting hit, even if they're no longer directly linked, or are linked from obscure corners of your site. The traffic logs can also assist in prioritizing which sections of your site to manually and laboriously inventory.
    – Erics
    Dec 5, 2011 at 16:33

1 Answer 1


I've tried a variety of techniques (and I'm excited to hear about new tools & methods from others), but our current go-to approach is to first run a quick audit using Website Auditor (yes, the website is kind of scuzzy-looking, but the tool is good). This app crawls your site structure and delivers a nested hierarchy view, including titles, URLs, meta tags, redirects, broken links, etc. It can also do more advanced things like HTML code errors and Page Rank, but we don't use those very frequently. Currently, we're using this as our reference data, and then hand translating it into a visual sitemap in OmniGraffle, but I'm sure you could develop a more automated process.

To make sure we don't miss anything, we also go through the files themselves via our content management system -- but then, I'm an in-house person, so I likely have more access to such things than an agency would.

Alternatively, I've used Site Sucker for Mac (which is free) to download a local copy of an entire site, and used the log file as my content inventory. However, it's not as useful because it doesn't generate a nested view nor any of the other niceties previously mentioned for Website Auditor, so it's definitely a "poor man's tool".

Not the answer you're looking for? Browse other questions tagged or ask your own question.