The Utopian “E” Convergence - EAI, EII, ETL, MOM, B2Bi, BPM, B2B Gateway, BPI, IDM, MDM,…
All the Enterprise Information Management and Integration applications and approaches coming under one roof!
EAI, EII, ETL, MOM, B2Bi, BPM, B2B Gateway, BPI, IDM, MDM,… before anyone comes up with another acronym and glorifies how effective and important it is, there is a natural happening - An evolution of all the above into a utopian convergence of all the Enterprise Information Management and Integration applications and approaches.
The evolution is here!
1970’s were about simple, manual integration
1980’s were about distributed computing
1990s and early 21st century were about packaged enterprise applications. We saw new concepts, technologies, internet-based computing and tools that increased automation. We saw all the acronyms specified earlier and more emerging. Some made a mark and some didn’t.
Service-oriented architecture (SOA) emerges with the punch line “Let us unite everything everywhere and orchestrate them as services”. It applies successful concepts from the past like Object Oriented development, Component Based Design and Enterprise Application Integration technology to an architectural approach for IT system integration.
Performance Improvement Techniques in DataStage
I have come up with two set of superb documents on performance tuning:
1) DataStage Enterprise Edition (PX – Parallel Extender)
These documents are a result of experience gained across numerous successful deployments. It presents a practical handbook for performance improvement techniques which can be used for ETL architecture, job design and development as well as for review, analysis and performance optimization.
DataStage Overview | Tutorial | Essentials
Finally I got enough time to make “DataStage Overview” PPT deck online. A series of simple and informative slides about this great BI tool. This ppt deck provides an overview of DataStage and is a result of feedbacks and experience gained across numerous training sessions.
Size & Effort Estimation Model for ETL
This model will simplify and accelerate the process of size & effort estimation for ETL job development using a ETL tool. The purpose of this paper is to define a method for estimating ETL job development for DataStage / Informatica jobs by calculating job size and complexity based on the job pattern and specific challenges within the job. This Size & Effort Estimation model will help to predict how many Horizontal and vertical design blocks should be produced and how many developers are required and how long it will take. The approach is based on data typically produced during early stages of software development from various successfully executed projects.
Read more
Datastage Enterprise Edition with Teradata
DataStage (DS) has stages that allow you to use FastExport, MultiLoad, FastLoad and TPump. In addition, you can use the Teradata (TD) API stage and ODBC stage to do Extraction/loading/Lookup/manipulating of data. With IBM Information Server (DataStage 8x - The latest version of DataStage), the most awaited Teradata Connecter for Teradata Parallel Transporter (TPT / Teradata PT) stage joined the TD stages fleet. There is more good news coming with IBM Information Server:
>> Supports TD stored procedures
>> Supports TD macros
>> Supports restart capability and reject links for bulk loads