Location: Jersey City, NJ
Experience: 10+ years
Employment Type: Full-time/Contracting
Position Overview
We are seeking a seasoned Senior Data Engineer with deep expertise in Big Data concepts and cloud implementations. You will own end-to-end data engineering—from ingestion and transformation through deployment—working closely with analytics, ML, and business teams in the insurance domain to deliver reliable, high-performance data pipelines.
Key Responsibilities
- Design, develop, and maintain scalable data ingestion and processing frameworks using AWS services (Glue, EMR, S3, Aurora, RDS) and Snowflake novasoft.ai.
- Write clean, efficient, and maintainable code in SQL, Python, and PySpark for batch and streaming workloads.
- Implement performance tuning, debugging, and optimization across large-scale ETL jobs.
- Build CI/CD pipelines for data applications using Jenkins and Git, ensuring automated testing and seamless deployments.
- Collaborate with architects to define and enforce data modeling and governance best practices.
- Monitor, troubleshoot, and resolve production issues; own SLAs and data quality metrics.
- Mentor junior engineers, conduct code reviews, and promote Agile methodologies across the team.
Required Qualifications
- Bachelor’s or Master’s in Computer Science, Information Technology, or related field.
- 10+ years of hands-on experience in Data Engineering and delivery, with a strong foundation in Big Data concepts and cloud implementations.
- Expert proficiency in SQL, Python, and PySpark.
- Solid understanding of data ingestion, ETL/ELT patterns, and processing frameworks (batch & streaming).
- Proven experience with Snowflake data warehouse and AWS ecosystem (Glue, EMR, S3, Aurora, RDS).
- Demonstrated ability to code, debug, and performance-tune applications for production.
- Strong problem-solving aptitude, analytical skills, and sense of ownership.
- Experience working in Agile/Scrum environments.
- Excellent verbal and written communication, with the ability to translate complex technical concepts for non-technical stakeholders.
- Insurance-domain experience, particularly claims and loss processes, is highly desirable.
Good to Have (Preferred)
- Hands-on experience with DevOps tools and practices (Jenkins, Git, Docker/Kubernetes).
- Familiarity with CI/CD pipelines for data projects.
- Background in cloud-based data migration initiatives and Data Vault 2.0 modeling.
- Certifications in AWS (e.g., AWS Certified Data Analytics – Specialty) or Snowflake.
Benefits
- Competitive salary and performance bonus
- Comprehensive health, dental, and vision insurance
- 401(k) with company match
- Flexible work arrangements
- Professional development and continuous learning opportunities
- Collaborative and innovative work environment
Our company is an Equal Opportunity Employer committed to diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.
Application Process: Qualified candidates should submit their resume, cover letter, and a brief description of relevant projects they’ve led.
