Job description
Hello ,
Hope you are doing well. We are looking for a candidate for a position called Sr. Big Data Tech Lead role for our renowned product based company
Included below is the job description, please go through it and let me know when we can talk regarding the same. You can reach me out at (279)-321-4297
Please help me with your updated Resume .
Please find The JD ,
ROLE: Sr. Big Data Tech Lead
LOCATION: Initially 2 month remote then (Hybrid with 2-3 days a week at office)
Designation: Sr. Technology Specialist
Position Status: Immediate Full time W2
Work Responsibilities:
Education: Minimum Bachelor’s degree in Computer Science, Engineering, Business Information Systems, or related field. Masters in Computing related to scalable and distributed computing is a major plus
Key Responsibilities:
· Engage with business stakeholders to elicit requirements for Big Data applications
· Responsible for full Big Data development lifecycle from modelling, designing, developing, testing and deployment
· Develop Big Data applications using PySpark on Hadoop, Hive and/or Kafka, HBase, MongoDB
· Build / deploy Python Machine Learning models
· Deployment on-prem or AWS / Cloud platforms
Experience & Skillset
MUST-HAVE
· Total IT / development experience of 11+ years
· Experience in PySpark developing Big Data applications on Hadoop, Hive and/or Kafka, HBase, MongoDB
· Deep knowledge of Python and Spark to develop and debug complex data engineering challenges
· Experience in developing sustainable data driven solutions with current new generation data technologies to drive our business and technology strategies
· Exposure to SAS toolset to migrate SAS statistical models to Python Machine Learning models and hands-on experience on Jupyter-Python notebooks
· Experience in deploying to Amazon Web Services (AWS) or another cloud platform
· At least 2 years of development experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Scala-Spark or Python-PySpark
· At least 2 years of development experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS
· At least 2 years of developing applications in Agile with Monitoring, Build Tools, Version Control, Unit Test, TDD, CI/CD, Change Management to support DevOps
· At least 2 years of development experience with SQL and Shell Scripting experience
GOOD-TO-HAVE
· Banking domain knowledge
· Hands-on experience in Machine Learning models
· Digital Marketing Machine Learning models and use cases
· ETL / Data Warehousing and Data Modelling experience prior to Big Data experience
· Deep knowledge on AWS stack for big data and machine learning
Job Type: Full-time
Salary: $70,000.00 - $110,000.00 per year
Benefits:
- Dental insurance
- Flexible schedule
- Health insurance
- Life insurance
- Paid time off
- Vision insurance
Schedule:
- 8 hour shift
- Monday to Friday
Supplemental pay types:
- Signing bonus
Ability to commute/relocate:
- Dallas, TX: Reliably commute or planning to relocate before starting work (Required)
Application Question(s):
- Visa
Experience:
- Informatica: 1 year (Preferred)
- SQL: 1 year (Preferred)
- Data warehouse: 1 year (Preferred)
Work Location: One location
colinoncars.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, colinoncars.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, colinoncars.com is the ideal place to find your next job.