Experience
- At least 2 years
- The applicants should have experience in the following business area(s): Software Company, IT Enabled Service, Artificial Intelligence (AI) Startup
Education
- Bachelor of Science (BSc) in Computer Science & Engineering
Requirements
- At least 2 years
- The applicants should have experience in the following business area(s): Software Company, IT Enabled Service, Artificial Intelligence (AI) Startup
Additional Requirements
Experience in building data pipelines and data stores OR equivalent experience (including self-taught work, personal projects, or analytics work developed into engineering).
Solid data engineering in Python and SQL
Data modelling, and understanding that a working pipeline is not necessarily a correct one
Familiarity with distributed processing such as Spark and with orchestration frameworks
Data validation and monitoring discipline
Data from industrial, clinical or retail systems
Document extraction, OCR pipelines or multilingual data
Supporting machine learning consumers, including feature and training data pipelines
Data governance, privacy or regulated data handling
Responsibilities & Context
Design and build domain-specific data pipelines for all programs of Advanced AI Lab Ltd., for example, ingesting from WAQI, OpenAQ, CAMS Copernicus, Open-Meteo, IQAir, NASA FIRMS, DHIS2, WAHIS, Open Supply Hub, BGMEA, hospital HIS, LIMS, and satellite data platforms (Landsat, Sentinel-2 via GEE)
Implement the agentic data pipeline self-healing logic: schema drift detection, automated remediation, dead-letter queue handling, and human-in-the-loop escalation triggers
Write and maintain dbt transformation models: defining business logic, intermediate models, and final analytical tables for all programs with full lineage documentation
Build and maintain data collection schedulers on the cloud: real-time (30-minute), hourly, daily, and event-driven cadences with failure alerting
Implement data quality validation at the pipeline level: cross-source consistency checks, domain-specific plausibility rules, completeness thresholds, and anomaly flagging before data enters any model or product
Engineer the ML feature store: computing, versioning, and serving engineered features for Data Scientist consumption in a consistent, reproducible format
Manage Redis caching strategy for API performance: TTL design per data type, cache warming, and invalidation logic coordinated with the Data Platform Engineer's infrastructure
Write and maintain the CI/CD pipeline configuration for data workloads, like automated testing, data contract validation, and staged promotion in the platform the Data Platform Engineer maintains
Maintain comprehensive data dictionaries, pipeline documentation, and schema changelogs accessible to non-engineering team members
Optimize SQL queries and data model performance in Timescale DB and PostgreSQL while working with the Data Platform Engineer on index design and partitioning strategy
Implement responsible data handling in pipeline logic: field-level encryption, PII masking, audit logging, and access-controlled output tables
Job Other Benifits
- Provident fund,Medical allowance,Mobile bill,Weekly 2 holidays,Insurance,Gratuity
- Lunch Facilities: Partially Subsidize
- Salary Review: Yearly
- Festival Bonus: 2