Senior Big Data Engineer
Requirements at a glance
Senior Big Data Engineer at Qualys is a role based in Pune. The posting mentions 5+ years of experience and a bachelor's degree. It does not mention visa sponsorship. Key skills include Python, Java, Scala, and Kafka. Applications are submitted through Workday.
- Experience
- 5+ years (mentioned)
- Education
- Bachelor's degree (mentioned)
- Visa sponsorship
- Not mentioned in the posting
- Application platform
- Workday
Skills in this posting
- Python
- Java
- Scala
- Kafka
- Spark
Extracted automatically from the job description. Confirm details in the full posting below.
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!
Senior Big Data Engineer
Job Description: We are seeking a Senior Big Data Engineer to design, build, and operate core components of the data platform and pipeline architecture behind Qualys' Enterprise TruRisk Platform, processing billions of daily transactions.
Responsibilities:
- Design, build, and maintain high-throughput data platform and pipeline components using Spark and Kafka.
- Debug, tune, and optimize Spark jobs and Kafka pipelines to manage growing data volumes.
- Collaborate with product, professional services, and sales engineering teams on architecture design and technical trade-offs.
- Establish and refine technical standards, system documentation, and best practices across the engineering team.
- Mentor junior and mid-level engineers on complex technical issues and pipeline performance.
Required Qualifications:
- Minimum 5 years of experience in data engineering or big data platform development.
- Bachelor's degree in Computer Science, Computer Engineering, or a related technical field.
- Demonstrated experience designing, building, and optimizing distributed pipelines using Apache Spark and Apache Kafka.
- Hands-on experience scaling data platform infrastructure to process high-volume/high-throughput transaction workloads.
Preferred Qualifications:
- Experience working with high-volume, multi-tenant enterprise platform environments.
- Proficiency in Scala, Java, or Python for data processing applications.
- Proven experience mentoring junior or mid-level engineering team members.