Monitoring the enterprise dataflow?

[DrDDT]

We want to monitor the enterprise dataflow (especially, if the indexer is still running), using an automatic monitoring system.

Is there a 'best way' to do this?

We researched several options:
- Use something like CUrl to retreive the enterprise dataflow webpage and parse it. The problem is you need admin permissions for this, and we don't want to grant those to our monitoring system user.
- Use the queue files on the filesystem, or the e-mail alerts generated by Livelink. The problem with this is, we can detect a 'quiet' dataflow, but that is not alway a 'bad thing'.

Any other ideas?

 

[appnair]

I would advise you to sign an NDA with your opentext rep and get the schema document.The objects that are to be indexed is flagged in one of these tables.If the count of this table goes abnormally large then it means that the extractor is probably not running.Don't know whether you would get what you need from this approach though

Well, if I called the wrong number, why did you answer the phone?
James Thurber, New Yorker cartoon caption, June 5, 1937

 

[DrDDT]

We have the schema document, I'll check it out.

 

[DrDDT]

I can get the queue lenght from this table, but I'd really like to get the info that is presented on the the Enterprise Data Flow Manager html page.

How is this page generated? Using database info, or querying the Adminserver somehow?

As long as the index is 'running' and the search is 'active', I'm happy.

 

[appnair]

as a test shut the extractor down and look at the table on the schema document.Sorry to be cat and mouse about this but that is proprietary OT info and hopefully you can understand.There is also a search and indexing white paper from OT when you execute an NDA.I have not seen it but this I am saying from my own experience.
Also if you read up on the admin's help documents there is a bunch of error codes and possible causes why your extractor,document(html) conversion and index engines are dying and stalled.

Well, if I called the wrong number, why did you answer the phone?
James Thurber, New Yorker cartoon caption, June 5, 1937

 

[davidt50]

Is there some reason the SOV email monitoring doesn't work for your needs? Is this beyond emailing people when something happens? Most issues take a manaual intervention to correct.

The generation of the data flow page is done via a combination of RDB and real-time information.

There are data flow control control rules which allow you to monitor various aspects of the indexing system and send out emails to the appropiate staff to react.

The ending question I have is, based on this information, what are you missing?

 

[DrDDT]

Email is not easily imported in our monitoring system, and in the past, we had problems not detected by the control rules.