Informatica Workflow Recovery with High Availability for Auto Restartable Jobs

Informatica Workflow Recovery with High Availability for Auto Restartable Jobs

Restartable ETL jobs are very crucial to job failure recovery, supportability and data quality of any ETL system. In one of our prior articles we discussed different design techniques for ETL restartability, independent of the ETL tool used. We can also implement restartability in an ETL job using Informatica PowerCenter workflow recovery capabilities. In this article lets see what is required to setup an informatica workflow for recovery.

Continue Reading

Processing Multibyte Characters Like UNICODE Characters in Fixed Width Files

Processing Multibyte Characters Like UNICODE Characters in Fixed Width Files

Processing fixed width file in Informatica PowerCenter is not a big deal. But this can be bit tricky if the fixed file contins both multi byte and single byte characters such as unicode characters. This is because of the fact that fixed width flat files are byte oriented, which means the field width is measured in bytes. So if a single character takes two bytes for its representation, it will be treated as width two. In this article, lets see how such files are handled in Informatica PowerCenter.

Continue Reading

Pipeline Lookup Transformation, Beyond Relational and Flat File Data Sources

Pipeline Lookup Transformation, Beyond Relational and Flat File Data Sources

Lookup transformation is synonymous to SQL outer join, which is primarily used for relational and flat file data source lookups. But with the introduction of pipeline lookup, we can use all variety of data sources in the lookup transformation. This feature is really powerful just like Active Lookup Transformation. In this article lets see how pipeline lookup transformation can be configured in a mapping.

Continue Reading

User Defined Functions in Informatica PowerCenter

User Defined Functions in Informatica PowerCenter

Reusability is a great feature in Informatica PowerCenter which can be used by developers. Its general purpose is to reduce unnecessary coding which ultimately reduces development time and increases supportability. User Defined Functions is one among the reusability feature provided by Informatica PowerCenter. In this article lets understand User Defined Functions in detail.

Continue Reading

Re-Runnability for Informatica ETL Processes Which Uses Mapping Variables

Re-Runnability for Informatica ETL Processes Which Uses Mapping Variables

Informatica PowerCenter mapping variable can be effectively used to implement change data capture logic. The mapping variable is stored in the repository and its value is set to the new value only when the session execution is successful. This property makes the restartability of the ETL process easy. Since the last success point - variable value, is stored in repository, we cannot go back and reprocess an already processed data set.  In this article lets see how we can handle overriding the mapping variable value.

Continue Reading