Data Analyst Engineer

DUTIES & RESPONSIBILITIES
• Ensure that data is accurate, consistent, and reliable throughout its lifecycle, which is critical for making valid and trustworthy decisions
• Cleanse data and scrutinize computer-generated reports and outputs to identify and rectify coding errors
• Gather data from various sources, including databases, APIs, and third-party sources and ensure the upkeep of databases and data systems
• Create and maintain processes to generate accurate and timely reports that help stakeholders understand and act on key data insights
• Identify opportunities for process enhancements
• Engage with managers from various departments to specify data requirements and reports for analysis projects tailored to their unique business processes
• Design scripts, tools and processes to automatically extract large volumes of data from websites or other digital sources, including but not limited to transactional data, improving efficiency and availability
• Conduct in-depth data analyses using advanced statistical methods and tools to uncover patterns, correlations, and meaningful insights and trends, risk control data analysis, customer behavior analysis, and compliance auditing, which can then inform business decisions and strategies
• Entrusted with the responsibility of managing databases (logical) to ensure they are secure, accessible, and functioning properly. Your role is crucial in supporting ongoing data storage and retrieval needs

SKILLS & REQUIREMENTS
• Degree in Computer Science, Statistics, or related IT courses
• At least five (5) years in Data Engineer and Data Analyst role
• Experience and knowledge of MS Office, especially Excel functions, and other
data format such as CSV, JSON, XML for processing
• Experience with common data warehouse technologies, including Hive, HBase,
ClickHouse, and Greenplum.
• Experience with data warehouse layered architecture (e.g., ODS, DWD, DWS,
ADS), its standards and best practices.
• Broad experience with object-oriented/object function scripting languages:
Python, Java, C++, Scala, Shell script, etc.
• Broad experience with cloud computing services
• Broad experience with data pipeline and workflow management tools: Azkaban,
Luigi, Airflow, Flink, etc.
• Broad experience with stream-processing systems such as Storm, SparkStreaming, and similar.
• Expert experience with relational SQL and NoSQL databases, including
Postgres, MySQL, and Cassandra, and similar