Cloudera Solution Architect

Job Description

Title: Cloudera Solution Architect

Company Name: Reliable Business technologies Sdn Bhd

Vacancy: 5

Age: Na

Job Location: Malaysia

Salary: Tk. 250000 - 350000 (Monthly)

Experience: --

Published: 2026-05-29

Application Deadline: 2026-06-28

Education:

Requirements: --

Skills Required:

Additional Requirements:

Responsibilities & Context:

Cloudera Tech Lead / Solution Architect (Migration Specialist) Location: Kuala Lumpur, Malaysia

Business & Strategic Responsibilities

• Regulatory Alignment: Lead the architectural design to ensure all migrated data structures meet Bank Negara Malaysia (BNM) Project STREAM Phase-1 requirements.

• Workload Rationalization: Conduct a rationalization exercise on the legacy DataStage inventory (approx. 16,000 jobs) to identify and eliminate obsolete logic, aiming for at least a 20% reduction in workload volume.

• Single Source of Truth: Direct the transformation of fragmented data marts into a governed Common Enterprise Data Layer (Silver) to ensure consistent analytical performance across the bank.

• Dual-Stream Governance: Coordinate with the New Source Data Acquisitiion Team to ensure that migrated legacy data and new real-time data integrate seamlessly within the unified Lakehouse.

• Stakeholder Management: Act as the primary technical point of contact for Project Steering Committee and provide detailed technical evidence for regulatory dry runs

Detailed Technical Requirements

A. Core Infrastructure & Modern Lakehouse

• Bare-Metal Architecture: Design and provision CDP Base on bare-metal servers with HDFS and Ozone local storage to eliminate hypervisor overhead and restore data locality.

• Table Format Standardization: Standardize the Lakehouse on Apache Iceberg, implementing ACID-style consistency, row-level updates/deletes, and schema evolution.

• Serving Layer Optimization: Configure Impala + Kudu for high-concurrency, subsecond OLAP analytics to replace and outperform legacy Netezza BI workloads.

B. Workload Modernization & Automation

• ETL Re-Engineering: Lead the automated translation of DataStage job logic into Spark SQL and DataFrame operations using LLM-based code accelerators.

• Complex Refactoring: Manually refactor complex Netezza Stored Procedures and User Defined Functions (UDFs) that cannot be handled by automated tools.

• Orchestration Modernization: Migrate legacy ZENA workflows and shell scripts to Apache Airflow DAGs, implementing built-in retries, backfills, and SLA monitoring. C. Governance, Security, & Quality

• Access Control: Configure Apache Ranger and Ranger KMS for fine-grained security (RBAC/ABAC) and encryption key management.

• Data Quality Gates: Embed Great Expectations (GX) validation gates within Airflow and NiFi pipelines to automate source-to-target reconciliation (checksums, row counts, and hash totals)

Experience & Qualifications

Professional Background

Industry Experience: Minimum 10+ years in Data Architecture, with significant professional engagement. Experience in Malaysian banking sector preferred.

Proven Credentials: Demonstrated success in at least two enterprise-scale Data Warehouse Modernization programs. Experience involving Netezza Performance Server offloading is an added advantage.

Methodology Expertise: Expert knowledge of the Hybrid Waterfall-Agile delivery model and Wave-Based implementation strategies.

Technical Skills Matrix

Domain Required & Expertise

Big Data

• CDP Private Cloud Base, Spark 3 on YARN, Hive, NiFi

Storage

• Apache Iceberg, HDFS, Ozone local storage Legacy Stack IBM Netezza, IBM DataStage, Talend, Zena Scheduler

Governance

• OpenMetadata, Cloudera Atlas, Apache Ranger

Quality

• Great Expectations (GX), SQL/Python-based validation

Certifications

• Cloudera Certified professional (Required).

• Relevant Degrees in Computer Science or Information Technology.

• Provident fund,Insurance

• Air Fare ticket (One-way)

• 1 week accommodation (To allow you sufficient time to secure/find a new residence)

• Visa Application Employment Pass & Dependant pass (for spouse & children)

• Insurance for self

• Outpatient Medical for self (RM1000 per annum)

• Statutory Contribution Epf/Socso (2% EPF contribution and SOCSO contribution) from employer

• 14 days Annual Leave (per year)

• 14 days Medical Leave (per year