"The bulk of this category would be comprised of search engine spiders and other web robots that have no need for javascript - or even a user experience save for finding the next link."
But that's the point isn't it? If search engine spiders can't read your navigation menu because it's all buried in Javascript they won't be able to "find the next link" and your pages will go unspidered.
"Javascript is to the Web as fuel is to your vehicle."
No, Javascript is to the Web as
chrome is to your vehicle. Nice to have, makes it look much prettier but NOT vital. After all, it's perfectly possible to build a fully functioning web site without any Javascript at all.
Now I've little sympathy for the paranoid types that switch javascript off, still less for the paranoid sysadmins who enforce such a policy and should know better, but I recognise they exist and act accordingly. Why turn people away from your site when you don't have to. As any reader of Dilbert cartoons will know, stupid people are a lucrative market segment

!
My approach to non-javascript users is the same as to old browser users: the site is usable, though it may be more awkward to get around and will almost certainly be less pretty. If you have to use javascript for navigation, provide some alternative way of getting around using ordinary <a href...> tags, for example via a site map page accessible from the home page.
I use server-side solutions wherever possible, and try to rely as little as possible on what the end user may, or may not, have installed on their browsers.
-- Chris Hunt