Data Engineer - Archimedes

The Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and infrastructure that support enterprise analytics, reporting, and operational data flows. This role plays a critical part in enabling data-driven decision-making across Centene and SPM by ensuring the availability, integrity, and performance of data systems. The Data Engineer collaborates with data scientists, analysts, software developers, and business stakeholders to deliver robust ETL solutions, optimize data storage and retrieval, and implement secure, compliant data architectures in cloud and hybrid environments.

Operating within a healthcare-focused, compliance-heavy landscape, the Data Engineer ensures that data platforms align with regulatory standards such as HIPAA and SOC 2, while embedding automation and CI/CD practices into daily workflows. The role supports both AWS and Azure environments, leveraging cloud-native services and modern tooling to streamline data ingestion, transformation, and delivery.

Job Responsibilities:

Design, develop, and maintain ETL pipelines for structured and unstructured data across cloud and on-prem environments.
• Build and optimize data models, schemas, and storage solutions in SQL Server, PostgreSQL, and cloud-native databases.
• Implement CI/CD workflows for data pipeline deployment and monitoring using tools such as GitHub Actions, Azure DevOps, or Jenkins.
• Develop and maintain data integrations using AWS Glue, Azure Data Factory, Lambda, EventBridge, and other cloud-native services.
• Ensure data quality, lineage, and governance through automated validation, logging, and monitoring frameworks.
• Collaborate with cross-functional teams to gather requirements, design scalable solutions, and support analytics and reporting needs.
• Monitor and troubleshoot data pipeline performance, latency, and failures; implement proactive alerting and remediation strategies.
• Support data security and compliance by enforcing access controls, encryption standards, and audit logging aligned with HIPAA and SOC 2.
• Maintain documentation for data flows, architecture diagrams, and operational procedures.
• Participate in sprint planning, code reviews, and agile ceremonies to support iterative development and continuous improvement.
• Evaluate and integrate new data tools, frameworks, and cloud services to enhance platform capabilities.
• Partner with DevOps and Security teams to ensure infrastructure-as-code and secure deployment practices are followed.
• Participate in, adhere to, and support compliance, people and culture, and learning programs.
• Perform other duties as assigned.

Essential Background Requirements:

• Education: Bachelor's degree in Computer Science, Information Systems, Data Engineering, or related field required. Master's degree preferred.

• Certification/Licenses: AWS Certified Data Analytics or Solutions Architect required. Microsoft Certified: Azure Data Engineer Associate required. Certified Data Management Professional (CDMP) required.

• Experience:
  • 5+ years of experience in data engineering, ETL development, or cloud data architecture required.
  • Proven experience with SQL, ETL tools, and CI/CD pipelines required.
  • Hands-on experience with AWS and Azure data services and infrastructure required.
  • Familiarity with data governance, compliance frameworks (HIPAA, SOC 2), and secure data handling practices required.
  • Familiarity with CI/CD pipelines, automated testing, and version control systems required.
  • Skills & Technologies:
    • Languages & Tools: SQL, Python, Bash, Git, Terraform, PowerShell
    • ETL & Orchestration: AWS Glue, Azure Data Factory, Apache Airflow
    • CI/CD: GitHub Actions, Azure DevOps, Jenkins
    • Cloud Platforms: AWS (S3, Lambda, RDS, Redshift), Azure (Blob Storage, Synapse, Functions)
    • Monitoring & Logging: CloudWatch, Azure Monitor, ELK Stack
    • Data Governance: Data cataloging, lineage tracking, encryption, and access control.