CF MX 7, VSpider, and creating a usable Collection... 1

[LaoTsu]

If someone could point me in the right direction with this, I'd be very grateful.

I've tried now for many many days (and nights) to spider my entire web site of dynamic content and get a usable collection in to ColdFusion MX 7. I have the same problem every time.

It spiders through every page on my site, and it appears to be working, and finally after about 5 minutes, it returns...

(ind010020) Vspider summary: Submitted 2668 documents for insert, 0 documents for deletion, 0 documents for update;
(ind010021) Vspider summary: Indexed 0 documents, Deleted 0 documents, 2668 bad documents;
(ind010022) Vspider summary: Skipped 411 keys, including 5 duplicate documents rejected;
(ind010023) Vspider summary: Failed to fetch 87 keys.

If I understand correctly, I should have some documents indexed, right? 2668 bad documents?

I have been able to get this collection in to ColdFusion Administrator, but again it shows '0' documents.

Anyway, I read on the Macromedia -> ColdFusion -> Verity forums ... that there was a problem/bug between the style files and VSpider (MX 7 Only). The Macromedia administrator (who was answering our VSpider questions) had included a zip file of 5 new style files that needed to be replaced. (Ayyone know if this is true?)

I replaced my old style files with the new files, and now after running VSPider, I get the same as above, plus:

Warn 2005/03/19 01:01:51(ind002006) VDK: Warn E3-0033 (VDK): Bad or undefined field name _CACHE_DELETE in C:/MyNewCollection/spider/bif/sn4000si.bif.
Warn 2005/03/19 01:01:51(ind002006) VDK: Warn E3-0033 (VDK): Bad or undefined field name _CACHE_FN in C:/MyNewCollection/spider/bif/sn4000si.bif.
Warn 2005/03/19 01:01:51(ind002006) VDK: Warn E3-0033 (VDK): Bad or undefined field name vlang in C:/MyNewCollection/spider/bif/sn4000si.bif.
Warn 2005/03/19 01:02:52(ind002006) VDK: Warn E3-0033 (VDK): Bad or undefined field name _CACHE_DELETE in C:/MyNewCollection/spider/bif/sn4001l0.bif.
Warn 2005/03/19 01:02:52(ind002006) VDK: Warn E3-0033 (VDK): Bad or undefined field name _CACHE_FN in C:/MyNewCollection/spider/bif/sn4001l0.bif.
Warn 2005/03/19 01:02:52(ind002006) VDK: Warn E3-0033 (VDK): Bad or undefined field name vlang in C:/MyNewCollection/spider/bif/sn4001l0.bif.


What is also interesting is that altough I have posted in the 'Verity' forum on Macromedia's site, it does not show up in the forums anymore. And, if I follow a Google link to the Verity forum, I get an, 'Access Denied'. Is it just me, or is the Verity forum restricted or shut down?

http://www.macromedia.com/cfusion/webforums/forum/messageview.cfm?

catid=142&threadid=953055&enterthread=y

Here are my VSpider settings:

-collection C:\MyNewCollection
-start

http://localhost:8500

-indinclude "*"
-cgiok
-locale english
-loglevel debug

I have used '-style' with this as well, but it makes no difference.

Am I doing something totally wrong?


TIA and be well,

- Thomas

 

[ETN]

Have you found an answer to your question? I am trying to find help me too on VSpider but there isn't a lot of ressources...

The forum is now at:

http://webforums.macromedia.com/coldfusion/

You can also go at the community ressources:

http://www.macromedia.com/devnet/community/coldfusion.html

 

[LaoTsu]

VSpider has had serious problems in ColdFusion MX 7, most of which are now fixed. You will need the additional/updated style files to get it working. The answer to my question (and hopefully yours) is answered in the following TechNote:

ColdFusion MX 7: Additional files for using Verity Spider

http://www.macromedia.com/cfusion/knowledgebase/index.cfm?id=50f419a

Hope that helps,
- Thomas