Experience
- At least 5 years
- The applicants should have experience in the following business area(s): Software Company, Artificial Intelligence (AI) Startup, IT Enabled Service
Education
- Bachelor of Science (BSc) in Computer Science & Engineering
Requirements
- At least 5 years
- The applicants should have experience in the following business area(s): Software Company, Artificial Intelligence (AI) Startup, IT Enabled Service
Additional Requirements
Experience in building data platforms or large-scale pipelines OR equivalent experience (for example self-built systems, open-source work or independent projects).
Experience running distributed processing (Spark, Flink or comparable) in production OR equivalent experience.
Strong data engineering in Python, SQL and at least one JVM or systems language
Data modelling and schema design that survives a changing business
Operating distributed processing systems reliably
Treating data quality as an engineering problem
Data from industrial or clinical sources: sensors, machines, instruments and scanned documents
Data governance, privacy or regulatory compliance.
Vector databases, embeddings and retrieval infrastructure.
Serving both analytics and machine learning consumers from one platform.
Responsibilities & Context
Design and operate Advanced AI Lab Ltd.’s data platform: Cloud Storage data lake, Cloud SQL PostgreSQL and Timescale DB, Big Query for analytical workloads, Memory store Redis, and ensuring availability, durability, and performance SLAs
Own orchestration infrastructure: Cloud Composer (Airflow) or equivalent, including DAG deployment standards, dependency management, retry logic frameworks, and platform-level failure alerting independent of individual pipeline logic
Implement and enforce data governance standards across the platform: metadata cataloguing, data lineage tracking, access control policies (IAM, column-level security), data retention schedules, and audit logging
Design and operate the observability layer: pipeline health dashboards, data freshness monitors, volume anomaly detectors, and cost attribution dashboards so issues surface before they affect products or models
Implement infrastructure as code, ensuring the platform is reproducible, version-controlled, and deployable to staging and production environments consistently
Manage the CI/CD framework for data infrastructure, pipeline configuration for infrastructure changes, automated testing of platform components, and safe promotion workflows
Optimize platform performance and cost: storage tiering, query optimization at the infrastructure level (partitioning, clustering, vacuuming), reserved capacity management, and monthly cost reporting against program allocation
Enforce security and compliance requirements at the platform level: encryption at rest and in transit, VPC configuration, private service connectivity, backup and disaster recovery procedures, and regulatory alignment for health data environments
Define and operate data platform standards: naming conventions, environment separation (dev, staging, production), secret management, service account governance, and platform runbooks
Evaluate and introduce new platform capabilities: new GCP services, open-source data infrastructure tools, and architectural patterns, along with documented cost-benefit assessments before adoption
Partner with the DevOps engineer on shared infrastructure boundaries like container registry, Kubernetes cluster configuration, and network security, ensuring data platform components integrate cleanly with the application platform
Job Other Benifits
- Provident fund,Medical allowance,Mobile bill,Weekly 2 holidays,Insurance,Gratuity
- Salary Review: Yearly
- Lunch Facilities: Partially Subsidize
- Festival Bonus: 2