Data from Website

[SNIRU9]

I am new to Mercator and took one class on fundamentals of data transformation. Working on an assignment to pull the data from Website and push it to AS400 system.

Website Database: Sequel

What is the best way to accomplish this task? Is it supports views on sequel tale? I am thinking of using Database Interface Designer. Any input on this is greatly appreciated.

Thank you very much for your help in advance.

Mercator 6.5
Sequel database

 

[eyetry]

How are you pulling data from website? Are you going to have pages post to your maps? Are they updating the DB and your map will extract/map data from there and push it to the AS400?

 

[SNIRU9]

Hi,
1. It is something like connecting to sql database and pulling the updated info from a shipment table(They have view on this table). No XML.

2.Supplier is going to update the shipment status on the website my map needs to pull that updated info and push is to the AS400.

Thanks for the reply. Hope this helps.

 

[BocaBurger]

Something like" is not enough information to answer the question. How are you connecting to the site? Will you have access directly to the database? Will you need to post data to the site to get a response?



BocaBurger
<===========================||////////////////|0
The pen is mightier than the sword, but the sword hurts more!

 

[SNIRU9]

Hi,

I am having access to the website database. I know the particular sql table(View name) name to pull the data from.

Thank you.

 

[eyetry]

So, your web pages are not posting data to the DB via maps. You simply need to extract table data sitting in a DB that is updated via a separate web process?

So, assuming this is the case, your maps need to extract data DB table and deliver it to the AS400. There are a few was to handle it. I'd use the DBID to extract table data and build my AS400 output. Others in my office might write a stored procedure. Either way we'd then need to decide if the map/procedure was pushing data to the AS400 or if a process on the AS400 was pulling.

 

[SNIRU9]

Hi All,

Thank you very much for all your previous responses.

I am trying build a new map and I did the following steps.

1. Created an MDQ file and generated type trees from query.

2. Developed a map to read MDQ file and out put data in CSV file.

3. There are total 561 records in the input file.

When I run my map it reads first one and writes to output only first record. It is identifying all other 560 records as unknown data.

Turned on trace it says the following message.


Row level settings:
1.Set range on row is set to (S).
2.Input card type tree has Terminator as <CR><LF>
3.Release as !


Thanks for your help in advance.

Level 0: Offset 0, len 343, comp 1 of 0, #1, DI 00000017
Data at offset 0 ('561|1|HYUNDAI CO') was found to be of TYPE
X'0003' (Row Website Data).

INPUT 1 was valid but contained 23164 bytes of unknown data at the end.


------------------------------------------
Level 1: Offset 318, len 23, comp 21 of 22, #1, DI 00000015
Data at offset 318 ('2005-11-29 00:00') was found to be of TYPE
X'0019' (ATACust Column Website Data).

(Level 1: Offset 342, len 1, comp 22 of 22, #1, DI 00000016
Data at offset 342 ('2') was found to be of TYPE
X'001A' (HotContainer Column Website Data).

(Level 0: Offset 0, len 343, comp 1 of 0, #1, DI 00000017
Data at offset 0 ('561|1|HYUNDAI CO') was found to be of TYPE
X'0003' (Row Website Data).

INPUT 1 was valid but contained 23164 bytes of unknown data at the end.

End of Validation messages for INPUT CARD 1.

 

[BocaBurger]

Your tree is not correct. Did you create as delimited or fixed? Also, why are you using v 6.5. (it could be sunsetted soon). 8.0 is current version.

BocaBurger
<===========================||////////////////|0
The pen is mightier than the sword, but the sword hurts more!

 

[SNIRU9]

Hi,

Type tree was created as delimited. We may go for 8.0 some time soon.

Thank you

 

[BocaBurger]

Turn on input backup, run map, change to file input against that file (so you can see what's in the data).




BocaBurger
<===========================||////////////////|0
The pen is mightier than the sword, but the sword hurts more!