Location: Jersey City, NJ
Experience: 10+ years
Employment Type: Full-Time/ Contacting
Position Overview:
We are seeking a highly skilled Lead Data Engineer to design, build, and optimize data engineering solutions leveraging AWS and Snowflake. The ideal candidate will bring deep expertise in SQL, Python, PySpark, and Big Data concepts, while leading cross-functional teams to deliver scalable, secure, and high-performance data platforms. This role also requires strong knowledge of insurance data, particularly around claims and loss.
Key Responsibilities:
- Lead the design, development, and implementation of end-to-end data solutions using AWS and Snowflake
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions
- Develop and maintain ETL pipelines, ensuring data quality, integrity, and security
- Optimize data storage and retrieval processes to support warehousing and advanced analytics
- Provide technical leadership and mentorship to junior engineers
- Partner with business stakeholders to deliver actionable, data-driven insights
- Ensure adherence to industry standards and best practices in data engineering
- Apply insurance knowledge (claims and loss) to enhance solution effectiveness
Must-Have Skills:
- 10+ years of experience in Data Engineering and delivery
- Strong expertise in Big Data concepts and cloud implementations
- Hands-on experience with SQL, Python, and PySpark
- Solid understanding of data ingestion and processing frameworks
- Proven experience with Snowflake, AWS Glue, EMR, S3, Aurora, and RDS
- Strong problem-solving, analytical abilities, and ownership mindset
- Ability to code, debug, performance tune, and deploy into production
- Experience working in Agile/Scrum environments
Good-to-Have Skills
- Experience with DevOps tools (Jenkins, Git, CI/CD pipelines)
- Exposure to data migration, Data Vault 2.0, and advanced cloud implementations
Requirements:
- Bachelor’s or Master’s in Computer Science, Information Technology, or a related field
- Proven experience as a Data Engineer, with focus on AWS and Snowflake
- Strong understanding of data warehousing concepts and best practices
- Excellent communication skills, with ability to explain technical concepts to non-technical stakeholders
- Industry experience in insurance, ideally with claims and loss processes
- Strong attention to detail and ability to thrive in fast-paced environments
Preferred Qualifications:
- Experience in data modeling and ETL
- Familiarity with data governance and security best practices
- Certification in AWS or Snowflake
