Tek-Tips is the largest IT community on the Internet today!

Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!

  • Congratulations Mike Lewis on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!

ASP, URLs & search engines

Status
Not open for further replies.

lebisol

IS-IT--Management
Jan 3, 2003
3,325
US
anyone used this? (what is the $$$?)

what is the general approach to handeling dynamic <tites> -having the subject of the post in mind?

thank you posting!
All the best!

> need more info?
:: don't click HERE ::
 

(last one on the page)

Search engines have a vested interest in being able to catalog as much of the web's content as possible. If they have more data, they produce more hits per query, people believe they are 'better' than the competition, they recieve more traffic, they make more money.

Do you really think that search engines would not index ASP sites, given the amount of data out there dished up using ASP?

If so, there's a nice bridge I'd like to sell you.
 
Search engines actually don't handle query URLs (URLs with question marks) as well as regular links. It's a well known problem. Off Google's site:

( )

1. Reasons your site may not be included.

Your pages are dynamically generated. We are able to index dynamically generated pages. However, because our web crawler can easily overwhelm and crash sites serving dynamic content, we limit the amount of dynamic pages we index.

petey

News and views of some obscure guy
 
hi gang, thanx for the comments.....
and I do know about this issue AND that is why I posted this topic....that is why that link above calims to &quot;work arround this issue&quot;...my question was not about IF there is an issue , I am well aware of it. Also, what might not be known (and google did not post) is that actually google is the 1st to attempt(is) to work arround querry based sites...how and when --I don't know...that is why I am here :)
in anycase.....I was just wondering about the product that site above claims to &quot;fix&quot; the problem......smells like b.s. to me...but you never_know :hence the post here.
Thanx again!
All the best!


> need more info?
:: don't click HERE ::
 
Oops! Well, from what little I looked at the product, or whatever it is, it looked like an ASP library providing a method to route search engines (based on useragent in HTTP headers, I assume) to a temporary file containing the contents of the dynamic page. Or something very close to that. In effect, Google will spider a site and index these bogus URLs, which in turn redirect regular users to the normal dynamic page URLs.

Cheers,
petey

News and views of some obscure guy
 
well i have noticed something in search engines. google not only throws up static pages but also dynamic pages (PHP/ASP and the lot). when i search goole for some doubts my results come up with comments posted insdie forums!!! but these cn be viewd only by logging in to the forums.

so how does this work?

Known is handfull, Unknown is worldfull
 
petey: their &quot;logic&quot; is what intrugued me....I am just not sure it is worth the time or money....
vbkris: I have seen this A LOT as well....even on my pages that have not been registerd or &quot;tweaked&quot; to &quot;please the serach engines&quot;
how does one explain this google:


...and as we know CFM pages are as dynamic as anything else!
Thank you guys!
All the best!

> need more info?
:: don't click HERE ::
 
notice the listing:
====================
Visual Basic(Microsoft) -VB.NET - Making dsn-less connection
... for example this dsn-less connection to access: (&quot;Provider=Microsoft.Jet.OLEDB.4.0;Data
Source=C:\NewDB.mdb&quot;) I want to so ... Tek-Tips Forums is Member Supported. ...
4/lev3/32/pid/796/qid/619631 - 25k - Cached - Similar pages

> need more info?
:: don't click HERE ::
 
Hi guys,

Tek-tips uses this method as pointed out by lebisol. The spiders see URLs formed with slashes and when you are logged in, you see query strings.

I actually use this method on a dynamic site (using Coldfusion) and it's simple, I don't know about how to do it in ASP but if it's anything like the code required for Coldfusion to do this, you would be wasting your money. (Takes about 15 lines of code in CF)

Google does limit the amount of pages it indexes but only if the pages start getting into really high numbers.

Basically, all you need to do is get the page to extract the data from the URL in the following form:


So the following URL:


would become:


One problem that can happen with this is if you use relative links, the link you have to images/name.gif is looked for at which would return an error because the directory does not exist.

Do a search on Google for &quot;search engine friendly urls&quot; and it will pull up plenty of different ways to do it.

Hope this helps

Wullie


The pessimist complains about the wind. The optimist expects it to change.
The leader adjusts the sails. - John Maxwell
 
Hi guys.

First of all, thanks Wullie for giving that search phrase (yeah, I forgot it from when you gave it to me a few months ago :p). I was just going to try to search Google for how to do that when I saw this thread with your reply.

For everyone else, using that phrase, I was able to find this site, which contains a list of links a little down the page: A better tutorial, but without the external links, is this:
Now to actually implement the changes...

Rick

-----------------------------------------------------------
RISTMO Designs
Arab Church
Reference Guides
 
Now to actually implement the changes...

If you have a large site and it contains loads of relative links that you really don't want to sort through, the easiest way to correct all of the links is by using a base href tag. I do remember once reading about a problem with this though, I think it was MACs that ignored it.

Hope this helps


Wullie


The pessimist complains about the wind. The optimist expects it to change.
The leader adjusts the sails. - John Maxwell
 
MACs can't read <base> tags?! That's strange but good to know. I'm actually recreating Arab Church from scratch with real content, a much better template (hopefully), and a MUCH more search engine friendly website. I learned a lot from So simple, yet effective.

Rick

-----------------------------------------------------------
RISTMO Designs
Arab Church
Reference Guides
 
hi Gang!
thanx for showing interest ;-)
now....HOW do we do this in ASP +IIS and not on PHP+Apache?

> need more info?
:: don't click HERE ::
 
without - $ XXX.xx :)

> need more info?
:: don't click HERE ::
 
Don't use IIS or ASP
little late LOL......getting back to the topic of the post!
als the link above has this section:
which means it is not free....soooooooo I guess I have cash out for this solution?

> need more info?
:: don't click HERE ::
 
This is simplified edition of ISAPI_Rewrite. It does not support per-virtual-site configurations, proxiing, metabase monitoring and automatic cache cleanup but all other features are supported. ISAPI_Rewrite Lite is completely FREE! It may be an ideal solution for the server hosting the only site, development or testing purposes.

Which means it IS free!!! [noevil]

Just try searching for &quot;search engine friendly url iis&quot; or similar. As I don't use IIS (I'm an Apache man) I don't really have a clue what most of them are telling you to do.

Wullie


The pessimist complains about the wind. The optimist expects it to change.
The leader adjusts the sails. - John Maxwell
 
thanx Wullie!
p.s. I am on a shared host/virtual thing so....no cigar for me I guess :)
thank you anyhow!

> need more info?
:: don't click HERE ::
 
Status
Not open for further replies.

Part and Inventory Search

Sponsor

Back
Top