Data Engineer
Company: Itility US
Location: San Diego
Posted on: March 18, 2023
Job Description:
Do you have experience with writing code to ingest data? Do you
like data wrangling, digging into data sources, and processing data
to a readable and usable state? Do you love that feeling of
accomplishment when data is flowing seamlessly into a data lake,
day in day out, hour after hour, based on code that you have
carefully crafted? Then this job opening is just what you are
looking for!We need your expertiseFor multiple enterprise customers
we create data connectors to make data flow from various sources to
a data lake of choice: that can be Splunk, Databricks, Hadoop, or
any other technical implementation. What they have in common, is
that the data will be used in a production environment, so it must
flow seamlessly and needs to be monitored for disruption. Data
validation and data quality are also important.What you'll do
- Create data connectors, using Python or other coding
languages.
- Define data validation tests to run in the data pipeline.
- Define monitoring and alerting to ensure visibility when the
data flow is interrupted or corrupted.
- If incidents occur, you take the lead in getting to the root
cause as soon as possible to solve the incident with as little
impact on the end users as possible.
- You and the team are responsible for building, deploying,
maintaining, and optimizing the data ingestion and data connectors
to have data flow to the data lake.
- Building/operating highly available, distributed systems of
data extraction, ingestion, and processing of large data sets of
structured, semi-structured and unstructured data.
- Build data products incrementally and integrating and managing
data sets from multiple sources.
- Work side-by-side with software engineers and data scientists
in designing modeled data sets to be used in many different
applications, from proof-of-concept to production.
- Work alongside Business Analysts for requirements gathering,
and decide how to implement data pipelines, identifying which data
to use and define what tooling should be used.
- Collaborate with ETL/data services team, application teams to
support the development of data solutions.
- Work side-by-side with software engineers and data scientists
in designing modeled data sets to be used in many different
applications, from proof-of-concept to production.Meet ItilityAt
Itility we believe in merging technology and data to drive our
customers one step beyond. Itility digital consultants are experts
in data, cloud, software, and IT infrastructure. Our culture can be
described as 'no-nonsense, with passion'. Working at Itility is
about working with people, staying close to our customers. We work
for large enterprises and innovative startups. Acting as the
'digital twin' of customers, we work shoulder-to-shoulder to exceed
business goals and push the boundaries of what you thought was
possible. Do you like to go above and beyond? Do you want to work
with passion for what you do, in a team of people fueled by the
same passion? Then we would love to meet you!This is what we
offerYou will be given the opportunity to develop in the best way
possible, under the personal guidance of fellow data engineers and
architects of Itility. If you do not have the required expertise
for the job but do have the passion for data engineering, we offer
a substantial trainee program to get you up to speed for the job in
a planned manner.Other requirements:
- You have a bachelor's or master's degree.
- You have experience creating data ingestion scripts.
- You are a team player and you have good communication
skills.
- You have a good understanding of SQL and Python.
- Experience with Linux is a prerequisite.
- Knowledge of continuous integration & delivery tooling: e.g.
Jira, Git, Jenkins, Bamboo.
- Experience with big data platforms and tools such as Hadoop,
Spark, Kafka.
- AWS or Azure Cloud DevOps Services preferred.
- You believe in scrum/agile way-of-working and in software
practices that enable a professional data flow.
- Ideally, you have worked with data platforms and data lakes
within an enterprise environment.
- You have a hands-on mindset, a strong customer focus, a
problem-solving orientation and can show fast results.You will
report to the Itility program manager and work in close harmony
with team members while interfacing with the standing client IT
organization.5-10% travel required.Screening is part of the hiring
procedure.This is a hybrid position, so it is a requirement that
you are based within 100 miles of the San Diego area.Anticipated
salary range: $100,000-$135,000Factors in determining the
appropriate compensation for a role include experience, skills,
knowledge, abilities, education, licensure and certifications, and
other business and organizational needs. The Hiring Pay Scale
referenced in the job posting is the budgeted salary or hourly
range that Itility reasonably expects to pay for this position. The
Annual Full Pay Range may be broader than what Itility anticipates
paying for this position, based on internal equity, level and
budget. -LocationSan Diego, CA -Most of our positions are
hybrid/remote. Unless otherwise indicated in the job post, it is a
requirement that you are based within 100 miles of the job's stated
location.Powered by JazzHR
Keywords: Itility US, San Diego , Data Engineer, Engineering , San Diego, California
Didn't find what you're looking for? Search again!
Loading more jobs...