Tek-Tips is the largest IT community on the Internet today!
Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!
-
Congratulations biv343 on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!
shell scripting
- Thread starter rose70
- Start date
- Thread starter
- #2
am totally new to unix environment it would be great if any body can suggest me
a good link to learn how informatica sessions,batches can be created by writing
shell scripts and anything w.r.t to unix that will be useful to work with informatica.
thanks in advance for your help !!
a good link to learn how informatica sessions,batches can be created by writing
shell scripts and anything w.r.t to unix that will be useful to work with informatica.
thanks in advance for your help !!
johnherman
MIS
some useful K-shell commands for ETL
tr - translate one or a list of characters to another. Useful to convert unprintable characters or characters with foreign accents.
uniq - runs across source file removing duplicate records.
diff or sdiff - finds differences between two files, lots of options.
-------------------------
The trouble with doing something right the first time is that noboby appreciates how difficult it was.
- Steven Wright
tr - translate one or a list of characters to another. Useful to convert unprintable characters or characters with foreign accents.
uniq - runs across source file removing duplicate records.
diff or sdiff - finds differences between two files, lots of options.
-------------------------
The trouble with doing something right the first time is that noboby appreciates how difficult it was.
- Steven Wright
I've seen and created ksh (Korn shell) scripts used in multiple ways in a DW environment, mostly having to do with the ETL process. For example .ksh scripts are called by a scheduler (Autosys, Maestro, etc) to execute SQL (and/or PL/SQL code for Oracle) packages in a batch process. These scripts can provide date/time stamping, auditing, and error checking/handling.
If you are using Informatica (or most ETL tools) they usually have a built-in scheduler and error/audit logs so I'm not sure of the usefulness of unix scripts in that area, unless you are only using Informatica for one part of the DW process and scripting for another? I know at my last job I was required to create file to staging loads in Informatica, but staging to target loads were created with Teradata BTEQ scripts called from ksh scripts.
If you are using Informatica (or most ETL tools) they usually have a built-in scheduler and error/audit logs so I'm not sure of the usefulness of unix scripts in that area, unless you are only using Informatica for one part of the DW process and scripting for another? I know at my last job I was required to create file to staging loads in Informatica, but staging to target loads were created with Teradata BTEQ scripts called from ksh scripts.
- Status