Data Engineer

Company: Itility US
Location: San Diego
Posted on: March 18, 2023

Job Description:

Do you have experience with writing code to ingest data? Do you like data wrangling, digging into data sources, and processing data to a readable and usable state? Do you love that feeling of accomplishment when data is flowing seamlessly into a data lake, day in day out, hour after hour, based on code that you have carefully crafted? Then this job opening is just what you are looking for!We need your expertiseFor multiple enterprise customers we create data connectors to make data flow from various sources to a data lake of choice: that can be Splunk, Databricks, Hadoop, or any other technical implementation. What they have in common, is that the data will be used in a production environment, so it must flow seamlessly and needs to be monitored for disruption. Data validation and data quality are also important.What you'll do

• Create data connectors, using Python or other coding languages.
• Define data validation tests to run in the data pipeline.
• Define monitoring and alerting to ensure visibility when the data flow is interrupted or corrupted.
• If incidents occur, you take the lead in getting to the root cause as soon as possible to solve the incident with as little impact on the end users as possible.
• You and the team are responsible for building, deploying, maintaining, and optimizing the data ingestion and data connectors to have data flow to the data lake.
• Building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets of structured, semi-structured and unstructured data.
• Build data products incrementally and integrating and managing data sets from multiple sources.
• Work side-by-side with software engineers and data scientists in designing modeled data sets to be used in many different applications, from proof-of-concept to production.
• Work alongside Business Analysts for requirements gathering, and decide how to implement data pipelines, identifying which data to use and define what tooling should be used.
• Collaborate with ETL/data services team, application teams to support the development of data solutions.
• Work side-by-side with software engineers and data scientists in designing modeled data sets to be used in many different applications, from proof-of-concept to production.Meet ItilityAt Itility we believe in merging technology and data to drive our customers one step beyond. Itility digital consultants are experts in data, cloud, software, and IT infrastructure. Our culture can be described as 'no-nonsense, with passion'. Working at Itility is about working with people, staying close to our customers. We work for large enterprises and innovative startups. Acting as the 'digital twin' of customers, we work shoulder-to-shoulder to exceed business goals and push the boundaries of what you thought was possible. Do you like to go above and beyond? Do you want to work with passion for what you do, in a team of people fueled by the same passion? Then we would love to meet you!This is what we offerYou will be given the opportunity to develop in the best way possible, under the personal guidance of fellow data engineers and architects of Itility. If you do not have the required expertise for the job but do have the passion for data engineering, we offer a substantial trainee program to get you up to speed for the job in a planned manner.Other requirements:
  • You have a bachelor's or master's degree.
  • You have experience creating data ingestion scripts.
  • You are a team player and you have good communication skills.
  • You have a good understanding of SQL and Python.
  • Experience with Linux is a prerequisite.
  • Knowledge of continuous integration & delivery tooling: e.g. Jira, Git, Jenkins, Bamboo.
  • Experience with big data platforms and tools such as Hadoop, Spark, Kafka.
  • AWS or Azure Cloud DevOps Services preferred.
  • You believe in scrum/agile way-of-working and in software practices that enable a professional data flow.
  • Ideally, you have worked with data platforms and data lakes within an enterprise environment.
  • You have a hands-on mindset, a strong customer focus, a problem-solving orientation and can show fast results.You will report to the Itility program manager and work in close harmony with team members while interfacing with the standing client IT organization.5-10% travel required.Screening is part of the hiring procedure.This is a hybrid position, so it is a requirement that you are based within 100 miles of the San Diego area.Anticipated salary range: $100,000-$135,000Factors in determining the appropriate compensation for a role include experience, skills, knowledge, abilities, education, licensure and certifications, and other business and organizational needs. The Hiring Pay Scale referenced in the job posting is the budgeted salary or hourly range that Itility reasonably expects to pay for this position. The Annual Full Pay Range may be broader than what Itility anticipates paying for this position, based on internal equity, level and budget. -LocationSan Diego, CA -Most of our positions are hybrid/remote. Unless otherwise indicated in the job post, it is a requirement that you are based within 100 miles of the job's stated location.Powered by JazzHR

Keywords: Itility US, San Diego , Data Engineer, Engineering , San Diego, California