Job description

Hello ,

Hope you are doing well. We are looking for a candidate for a position called Big Data Lead role for our renowned product based company

Included below is the job description, please go through it and let me know when we can talk regarding the same. You can reach me out at (279)-321-4297

Please help me with your updated Resume .

Please find The JD ,

ROLE: Big Data Lead
LOCATION: Irving, Texas

Work Responsibilities:

Education: Minimum Bachelor’s degree in Computer Science, Engineering, Business Information Systems, or related field. Masters in Computing related to scalable and distributed computing is a major plus

Key Responsibilities:

· Develop Big Data applications using PySpark or Scala-Spark on Hadoop, Hive and/or Kafka, HBase, MongoDB

· Build Feature Engineering, Scoring / Machine Learning models

· Deployment on Cloud platforms

Experience & Skillset

MUST-HAVE

· Total IT / development experience of 12+ years

· Experience in PySpark or Spark-Scala developing Big Data applications on Hadoop, Hive and/or Kafka, HBase, MongoDB

· Deep knowledge of Spark libraries on Python and Scala to develop and debug complex data engineering challenges

· Experience in developing sustainable data driven solutions with current new generation data technologies to drive our business and technology strategies

· Exposure in deploying on Cloud platforms

· At least 4 years of development experience on designing and developing Data Pipelines for Data Ingestion or Transformation using PySpark or Spark-Scala

· At least 5 years of development experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS

· At least 4 years of developing applications in Agile with Monitoring, Build Tools, Version Control, Shell Scripting, Unit Test, TDD, CI/CD, Change Management to support DevOps

· Prior experience on ETL or SQL or other Data technologies

GOOD-TO-HAVE

· Banking domain knowledge

· Hands-on experience in SAS toolset / statistical modelling migrating to Machine Learning models

· Digital Marketing Machine Learning models and use cases

· ETL / Data Warehousing and Data Modelling experience prior to Big Data experience

· Deep knowledge on AWS stack for big data and machine learning

Job Type: Full-time

Salary: $80,000.00 - $130,000.00 per year

Benefits:

• Dental insurance
• Flexible schedule
• Health insurance
• Life insurance
• Paid time off
• Vision insurance

Schedule:

• 8 hour shift
• Monday to Friday

Supplemental pay types:

• Signing bonus

Ability to commute/relocate:

• Irving, TX 75039: Reliably commute or planning to relocate before starting work (Required)

Application Question(s):

• Email Address
• Work authorization

Experience:

• Informatica: 1 year (Preferred)
• SQL: 1 year (Preferred)
• Data warehouse: 1 year (Preferred)
• PySpark or Spark-Scala: 1 year (Preferred)

Work Location: One location

colinoncars.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, colinoncars.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, colinoncars.com is the ideal place to find your next job.