Senior Data Platform Engineer - Remote

Company: Goodwin Recruiting
Location: San Diego
Posted on: June 25, 2022

Job Description:

Job DescriptionThe data platform team is responsible for architecting and engineering the core platform that s used for ingestion, cleansing, standardization, and storing all data received from the client s customers. The platform is built from the ground up to be massively scalable with cloud-native technologies, methodologies, and processes. The Senior Data Platform Engineer is a key engineering leader tasked with building and extending the platform by building " Bricks" that can be used by data analysts to solve business problems.Senior Data Platform EngineerResponsibilities

• Architects robust and automated transformation pipelines to ingest and process structured and unstructured data from source systems into analytical platforms leveraging cloud-native toolsets
• Designs custom applications using Apache Spark and Azure Services (e.G., Function Apps, Logic Apps, Data Factory)
• Designs solutions using data structures such as Apache Parquet, SQL Delta, and NoSQL based data stores
• Closely collaborates with other scrum team members in both platform and API/UI to estimate and deliver work inside of a sprintSenior Data Platform EngineerQualifications
  • Strong knowledge of Spark Framework and Architecture
  • Experience developing applications using Scala in Azure Databricks
  • Working knowledge of .Net and C#
  • Experience using Azure Data Factory to build orchestration pipelines, in a DevOps and CI/CD environment
  • Bachelor s Degree in Computer Science or Computer Information Systems focus or related field
  • Health Care Insurance or Revenue Cycle experience strongly preferredSenior Data Platform EngineerBenefits
    • Salary: $155K plus bonus
    • Health, Dental, and Vision Insurance
    • 401k with Safe Harbor match
    • Generous PTO Recruiter Managing this Job Job Number: JN -082021-65226

Keywords: Goodwin Recruiting, San Diego , Senior Data Platform Engineer - Remote, Engineering , San Diego, California