Data Engineer (with DevOps Experience)

CreaThink Solutions

相談可能
ハイブリッドワーク - タギッグ1年以上3年未満の経験専門学校正社員
共有

職務内容

説明

About the Role

We are seeking a highly skilled Data Engineer with a strong DevOps mindset to help build a reusable Microsoft Fabric accelerator solution. This role is ideal for someone with a solid software and backend engineering background, with a deep understanding of building efficient, secure, and scalable data pipelines and orchestrating complex workflows.

You will play a key part in designing and developing infrastructure and data solutions that are high-performance, portable, and aligned with industry best practices in security and DevOps. This is not an analytics or data modeling role — the focus is on engineering excellence and infrastructure.


Key Responsibilities:

  • Design, develop, and maintain efficient and scalable data pipelines using best-in-class engineering practices.
  • Build orchestration workflows to extract and move data across cloud and hybrid environments.
  • Develop portable, metadata-driven solutions for rapid deployment across clients.
  • Collaborate with teams to implement CI/CD pipelines and infrastructure-as-code for data solutions.
  • Architect and implement cyber-secure systems that comply with enterprise security standards.
  • Contribute to the development of a Microsoft Fabric accelerator for client deployment.


Key Requirements:

  • Proven experience in backend/data engineering with a strong DevOps focus.
  • Proficient in Python, Spark, PySpark, and SQL.
  • Hands-on experience with ETL processes and real-time data ingestion.
  • Strong knowledge of data orchestration tools like Apache Airflow and Azure Data Factory.
  • Experience with Microsoft Fabric, including: Lakehouses, Pipelines, Dataflows Gen2,Notebooks
  • Familiarity with containerization and IaC tools: Docker, Kubernetes, Bicep, Terraform.
  • CI/CD best practices for data workflows and cloud deployments.
  • Experience with Delta Lake or Apache Iceberg in the Microsoft ecosystem.
  • Deep understanding of Azure services: Data Lake, Synapse Analytics, Event Hubs.
  • Experience with real-time streaming platforms such as Kafka or Azure Event Hubs.
  • API integration and Change Data Capture (CDC) methodologies.
  • Experience with PowerShell, C#, or .NET.
  • Familiarity with reusable solution templates in consultancy/client environments.
  • Relevant certifications including:
  • DP-700 (Analyzing and Visualizing Data with Microsoft Power BI)
  • Azure Data Engineer Associate
  • Databricks
  • Kubernetes Certifications



Minimum Requirements:

  • i5 10th Gen or equivalent, 8GB RAM, 2GB Video Card or Integrated Graphics Card, Windows 10 or macOS (no Netbooks or Chromebooks), Headset with noise cancellation feature
  • Main Internet should be minimum of 20MBPs, wired only
  • An Antivirus Software should be installed, activated and updated
  • Backup Internet


要件

Please refer to job description.

データ モデリングETL ProcessesSQLPythonData WarehousingBig Data TechnologiesCloud ComputingData Pipeline AutomationNoSQLData Quality Assurance
Preview

Boss

HR ManagerCreaThink Solutions

勤務地

Taguig, PH

掲載日 31 May 2025

CreaThink Solutions

<50 従業人数

その他

採用中の件の求人を表示

報告する

Bossjobの安全に関する注意事項

海外勤務をお考えの際は下記の事項に注意して下さい。まずパスポートなどの身分証明証は不必要に提示しない。

そして下記に該当する企業を見つけた際は、 直ちに報告をお願いいたします。

  • 保証や担保を要求する会社には注意
  • 投資や資金調達を勧誘する
  • 不当な利益を得ていると思われる企業
  • 違法と思われる状況
  • その他不審に感じた場合