Job description

This is a projected 6-month assignment.

Data Engineer Sr Lead

Job Summary/Purpose
The Data Engineer Sr Lead is an integral member of the product delivery teams, driving end-to-end technical designs for multiple projects to deliver analytic products to business customers. The Data Engineer Sr Lead interacts with multiple customer stakeholders, understands their business and functional requirements and works with the product team to design and deliver technical solutions, leveraging the data analytics platform where possible. The Data Engineer Sr Lead’s key knowledge set includes system agile development life cycle, integration architectures, technology tools, database architectures, data management principles, data modelling techniques and methodologies, communication and problem solving. The Data Engineer Sr Lead will design large scale, enterprise-wide data processing solutions, database schemas and interfaces to relational and non-relational databases. Additionally, the Data Engineer Sr Lead will design small, temporary architectural solutions to support product delivery schedules should the enterprise data analytics platform be unavailable at the time the product must be delivered to a business customer.

The Data Engineer Sr Lead will act as a member of product teams, ensuring product team members understand the Solution Architectures being designed and helps guide and oversee the implementation of solution architectures. The Data Engineer Sr Lead will work closely with the IT department to ensure solution architectures will successfully operate in current technology environments.

The Data Engineer Sr Lead will work with other team members on the data analytics platform team to create plans and strategies for adopting new tools, technologies, and alternative solution architectures including leveraging the cloud.

Job Duties/Responsibilities

1.

Design conceptual data architectures solution for data-centric analytics projects.

2.

Analyze data sources, design and evaluate feasible technical solutions to be implemented by data engineers. The solutions might include database modeling and design, relational database architecture, metadata and repository creation and configuration management.

3.

Understand the complexity of data and design systems and models to handle different data sources/formats, which includes structured, semi-structured, and unstructured, as well as stream processing.

4.

Use data mapping, data mining and data transformational analysis tools to design and develop technical solution architectures.

5.

Prepare and maintain accurate solution design and architectural documentations for delivery, platform and operations team.

6.

Play a contributing role in the development and update of enterprise data architectural strategies, patterns, standards, processes and tools as new/unique data sources, use cases and requirements come up.

7.

Support and adhere to the development of data management policies, standards and procedures.

8.

Define integrated views of data drawing together data from across the enterprise, both in real-time and as extracts.

9.

Collaborate with platform and IT to as need to finalize the right solution including pattern and architecture for the analytics use cases.

10.

Address governance and security challenges associated with solutions.

11.

Support the delivery team engineers in tuning queries for performance and scalability, help them package deployments and collaborate with IT to migrate code between Development, Quality Assurance (QA), and Production environments.

12.

Support test automation, troubleshooting ETL job functionality, validating data, as well as create test data and table structures through use of SQL.

13.

Design and develop data pipelines or ETL processes.

14.

Must be able to work in an agile, rapid delivery environment.

Minimum Requirements

Minimum education required of the position

Bachelor's degree

Minimum experience required of the position

· 3+ years of data strategy, architecture related experience designing, architecting, and implementing big data solutions.

· 7+ years of experience:

o ETL experience

o Natural Language Processing (NLP)

o Metadata tagging and link analysis

o Experience with script and/or parser development to extract structured and unstructured data from files

o Data warehousing, mining, analysis, self-service, or machine learning

o Data Modelling

o Technologies such as Informatica, SQL programming and hands-on experience in Python, R, APIs, Spark, Python or Kafka

o Big Data and Big data technologies

o Data visualization tools such as PowerBI, Qlik and Tableau

Minimum knowledge, skills and abilities required of the position

· Experience with traditional ETL integration tools as well as more modern real-time messaging/integration platforms.

· Experience with relational database modeling concepts and modeling for the modern big data platform.

· Strong understanding of Operational, Relational, Analytical, Master, and Reference data models.

· Deep understanding of data transfer formats such as XML, JSON, and Avro.

· Understanding of Cloud technologies such as Microsoft Azure, Google Cloud, Amazon Web Services (AWS).

· Knowledgeable in tools used to identify and manage structured and unstructured data.

· Expert using data governance technologies such as Collibra or Informatica EDC.

· Strong communicator at the technical levels

· Strong, demonstrated writing and presentation skills

Any certificates, licenses, etc. required for the position

None

Other Attributes

Functional Knowledge

Requires depth and/or breadth of expertise in own specialized discipline or field.

Business Expertise

Interprets internal/external business challenges and recommends best practices to improve products, processes or services.

Leadership

May lead functional teams or projects with moderate resource requirements, risk, and/or complexity.

Problem Solving

Leads others to solve complex problems; uses sophisticated analytical thought to exercise judgement and identify innovative solutions.

Impact

Impacts the achievement of customer, operational, project or service objectives; work is guided by functional policies.

Interpersonal Skills

Communicates difficult concepts and negotiates with others to adopt a different point of view.

Working Conditions

As a provider of essential services, Entergy expects its employees to be available to work additional hours, to work in alternate locations, and/or to perform additional duties in connection with storms, outages, emergencies, or other situations as deemed necessary by the company. Exempt employees may not be paid overtime associated with such duties.

Job Types: Full-time, Contract, Temporary

Pay: Up to $99.00 per hour

Benefits:

• 401(k)
• Health insurance

Schedule:

• 8 hour shift

colinoncars.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, colinoncars.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, colinoncars.com is the ideal place to find your next job.