Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-tier ETL architectural structures.
- Crafting modular, reusable components.
- Implementing hybrid strategies across diverse systems.
Advanced Performance Engineering
- Optimizing at the step level.
- Strategies for parallelism and threading.
- Monitoring pipelines under high load.
Automation, Scripting, and Custom Extensions
- Embedding scripts within transformations.
- Building custom plugins.
- Expanding PDI functionality using Java and JavaScript.
Complex Data Processing and Integrations
- Real-time and streaming data integration.
- Interaction with big data platforms.
- Advanced handling of files and APIs.
Data Governance, Security, and Compliance
- Protecting transformations and credential management.
- Ensuring data lineage and traceability.
- Addressing regulatory and compliance requirements.
Enterprise Orchestration and Scheduling
- Overseeing extensive job networks.
- Designing error recovery and failover mechanisms.
- Orchestration at the environment level.
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories.
- Synchronizing PDI with Git.
- Implementing continuous deployment workflows.
Deployment, Monitoring, and Production Operations
- Migrating solutions across various environments.
- Utilizing operational tools and dashboards.
- Achieving full production readiness.
Conclusion and Future Directions
Requirements
- Foundational knowledge of ETL pipelines and data modeling.
- Practical experience with intermediate PDI transformations.
- Strong proficiency in SQL and scripting languages.
Target Audience
- Senior Data Engineers.
- ETL Architects.
- Professionals overseeing complex data integration operations.
21 Hours
Testimonials (1)
It's a hands-on session.
