Location: Jersey City (Onsite)
Experience: 15+ Years
Employment Type: Full-Time
Position Overview:
We are seeking an experienced Lead Data Engineer to design, build, and optimize enterprise-scale data solutions using AWS, Snowflake, and Big Data technologies. This role requires a hands-on technical leader who can mentor a team, drive best practices in data engineering, and partner with business stakeholders to deliver scalable, secure, and high-quality data platforms. The ideal candidate will have strong expertise in SQL, Python, PySpark, and proven experience working in insurance or similar data-intensive industries.
Key Responsibilities:
- Lead the design, development, and implementation of data solutions using AWS and Snowflake
- Collaborate with cross-functional teams to translate business requirements into technical designs
- Develop and maintain ETL/data pipelines, ensuring quality, integrity, and security
- Optimize data storage, retrieval, and query performance to support warehousing and analytics
- Provide technical leadership and mentorship to junior engineers and team members
- Ensure adherence to best practices, coding standards, and industry compliance in data engineering
- Conduct coding, debugging, performance tuning, and production deployments
- Work closely with stakeholders to deliver data-driven insights, with focus on insurance claims and loss data
- Support Agile delivery through sprint planning, backlog grooming, and iterative releases
Must-Have Skills:
- 10+ years of experience in Data Engineering and delivery
- Strong expertise in Big Data concepts and cloud implementations (AWS)
- Hands-on leadership of teams (minimum 4+ members)
- Proficiency in SQL, Python, and PySpark
- Deep knowledge of Snowflake, Glue, EMR, S3, Aurora, RDS, and AWS architecture
- Strong background in data ingestion and data processing frameworks
- Excellent communication, analytical, and problem-solving skills
- Ability to take ownership and deliver results in fast-paced environments
- Experience working in Agile/Scrum methodologies
Good-to-Have Skills
- Experience with DevOps tools (Jenkins, Git, etc.), CI/CD pipelines, and infrastructure automation
- Hands-on with data migration and frameworks such as Data Vault 2.0
- Familiarity with modern data modeling and ETL processes
Requirements:
- Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field
- Proven experience as a Data Engineer with a focus on AWS and Snowflake
- Strong understanding of data warehousing concepts and best practices
- Excellent communication skills to work across business and technical teams
- Industry experience in insurance, with exposure to claims and loss processes preferred
- Strong attention to detail, ownership mindset, and ability to work independently as well as in a team
Preferred Qualifications:
- AWS or Snowflake certifications
- Familiarity with data governance, lineage, and data security practices
- Experience in regulated industries such as finance, insurance, or healthcare
