Cloud Data Engineer for ComputerInformation Technology/70k/Makati

Additional Information:
 Must be willing to work on a hybrid setup, with onsite reporting to UP Ayala
Technohub, Quezon City.
 Engagement is project-based for 6 months, with a possibility of extension.
 Work schedule is on a mid-shift and graveyard rotation.
 The role observes U.S. holidays instead of Philippine holidays.

Key Responsibilities:
 Design, build, and maintain cloud-based data pipelines and workflows that support
analytics and operational systems.
 Integrate data from various sources using APIs and cloud services.
 Develop clean, efficient, and test-driven code in Python for data ingestion and processing.
 Optimize data storage and retrieval using big data formats like Apache Parquet and ORC.
 Implement robust data models, including relational, dimensional, and NoSQL models.
 Collaborate with cross-functional teams to gather and refine requirements and deliver
high-quality solutions.
 Deploy infrastructure using Infrastructure as Code (IaC) tools such as AWS
CloudFormation or CDK.
 Monitor and orchestrate workflows using Apache Airflow or Dagster.
 Follow best practices in data governance, quality, and security.

Core Expertise:
 Experience: At least 3 years in a data engineering role working on data integration,
processing, and transformation use cases with open-source languages (i.e. Python) and
cloud technologies.
 Strong programming skills in Python specifically for API integration and data libraries,
with emphasis on quality and test-driven development.
 Demonstrated proficiency with big data storage formats (Apache Parquet, ORC) and
practical knowledge of pitfalls and optimization strategies.
 Demonstrated proficiency with SQL
 Experience with data modeling:
o Relational modeling
o Dimensional modeling
o NoSQL modeling
 Working knowledge of IaC on AWS (CloudFormation or CDK)
 Working knowledge of AWS Services:
o Required: Glue, IAM, Lambda, DynamoDb, Step Functions, S3,
CloudFormation or CDK
o Nice-to-have: Athena, Kinesis, MSK, MWAA, SQS
 Experience with orchestration of data flows/pipelines: Apache Airflow or Dagster
 Nice-to-have:
o Experience with data streaming (Kinesis, Kafka)
o Experience with Apache Spark
o Client-facing experience, multi-cultural team experience, technical leadership, team leadership

Key Competencies & Abilities:
 Ability to work independently and collaboratively in a team environment.
 High level of attention to detail and commitment to delivering quality work.
 Strong analytical and critical thinking skills.
 Effective time management and organizational skills.
 Strong customer focus and the ability to communicate technical concepts clearly to stakeholders.
 Excellent written and verbal communication skills.