广州外企 - Senior Data Platform Engineer - 40-70K

福利：每周 3 天 WFO ，2 天 WFH ，20 天年假
有意向可加微信：skyheaven2014 备注：姓名+岗位
另有 java 岗位在招，欢迎投递～
JD 如下：
Job Summary

The Platform Engineer designs, manages, and optimizes the underlying infrastructure supporting the Bank’s Global Data Platform. This role ensures high availability, scalability, and security for multi-tenant workloads while aligning with governance and regulatory frameworks. Platform Engineers work across Kubernetes, MinIO, and other modern tools like Airflow, Argo, OpenLineage, and DataHub deliver a robust infrastructure that supports streaming, batch processing, analytics, and query engines such as Trino. Additionally, the role includes setting up the analytics data store, near real-time data store, and query engine to meet business needs.
Strategy
• Platform Optimization: Continuously enhance the platform infrastructure, focusing on scalability, cost efficiency, and high availability.
• Infrastructure Management: Implement and maintain Kubernetes clusters for multi-tenancy
• Analytics Data Store: Set up and optimize an analytics data store for batch and ad-hoc querying with tools like Iceberg and Trino.
• Near Real-Time Data Store: Deploy and manage near real-time data stores to support low-latency streaming use cases and downstream applications.
• Query Engine Configuration: Install, configure, and optimize for efficient query execution over large datasets, ensuring compatibility with the data lakehouse.
• Observability: Set up monitoring solutions using Prometheus and Grafana to provide visibility into cluster health, job performance, query execution, and resource usage.
• Lineage and Governance: Integrate OpenLineage, DataHub for lineage tracking and metadata management.
Key Responsibilities

Business
• Service Levels: Maintain platform availability and performance above agreed service levels, ensuring smooth data operations.
• Stakeholder Support: Collaborate with data engineers and domain teams to optimize infrastructure usage and ensure the platform supports business objectives.
People & Talent
• Collaboration: Work with framework engineers and data engineers to ensure seamless platform operations and robust query engine integration.
• Mentorship: Provide technical guidance to peers, fostering a culture of continuous learning and technical excellence.
Governance
• Compliance & Regulatory Adherence: Ensure compliance with internal and external regulatory requirements, including data sovereignty, privacy, and resilience standards.
• Data Governance & Quality: Implement data governance policies implementation to maintain data quality, integrity, accuracy, and consistency across the platform. Implement monitoring tools to proactively address data quality issues.
Regulatory & Business Conduct
• Display exemplary conduct and live by the Group’s Values and Code of Conduct.
• Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct.
• Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.
Key stakeholders
• Rest of Data & Analytics team
• WRB/CIB/GF Architecture teams
• Business and Functions Data & Analytics Team
Skills and Experience

Data Architecture
Data Governance
Big Data Management
IT Governance
Service Platform Operations
Emerging Technologies
Cloud Computing
IT Standards, Procedures & Policies
Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
• Extensive experience with Kubernetes, MinIO, and orchestration tools like Airflow or Argo.
• Hands-on expertise in deploying and optimizing Trino for large-scale interactive querying.
• Strong understanding of multi-tenancy and resource management in distributed systems.
• Experience setting up and managing analytics data stores and near real-time data stores integrated with modern data lakehouses.
• Familiarity with governance tools such as Apache Ranger, OpenLineage, and DataHub.
Required skills
check
Information Architecture
check
Data Governance
check
Big Data
check
IT Governance
check
Customer Service Operations