We are looking for a meticulous, detail-oriented Python Developer to work on key migration and optimization tasks involving PySpark and Kubernetes. You’ll focus on critical projects that involve scaling our systems and improving infrastructure. This role is perfect for an independent self-starter who thrives in a dynamic environment, enjoys tackling both complex and repetitive tasks, and is driven to deliver results. This is an AI-first environment—we expect engineers who actively use AI tools to enhance productivity and code quality.
Requirements
- Strong Python development skills and experience with dependency management using
Poetry; - Solid understanding of CI/CD processes and automated testing;
- Familiarity with PySpark and Kubernetes (K8s);
- Comfortable working independently and handling both technical challenges and routine
tasks; - Ability to understand complex code quickly and focus on the relevant components;
- Open to working on repetitive tasks as part of the larger goal of migrations and
optimizations; - Experience with testing frameworks such as pytest, unittest, testcontainers;
- Experience with cloud platforms (AWS, GCP, Azure) and containerization (Docker, Kubernetes);
- Familiarity with data processing libraries like PySpark, pandas, etc.;
- Experience working with high-availability services and troubleshooting in complex production environments;
- Experience with microservices architectures and managing dependencies in large-scale applications.
Will be a plus
- Bachelor’s degree in Computer Science, Software Engineering, or related field;
- Knowledge of Java.
Responsibilities
- Migrate and optimize Pyspark jobs currently running on standalone clusters to
Kubernetes Spark operators; - Deploy applications, conduct tests, and resolve any dependency issues to ensure
smooth end-to-end migrations; - Enhance and extend Python client libraries to replace legacy database and S3 read
operations; - Add tests, implement new functionality, and handle versioning for improved service
integration; - Work independently to contribute to testing, regression, and overall code quality
improvements; - Leverage and integrate modern LLM tools (e.g, Windsurf, Cursor) to enhance efficiency
and code quality; - Manage dependencies effectively using Python’s Poetry and ensure smooth CI/CD
workflows.
What we offer
- Direct cooperation with the already successful, long-term, and growing project;
- Flexible work arrangements;
- Collaborative and supportive team culture;
- Truly competitive salary;
- Help and support from our caring HR team.
Originally posted on Himalayas
Apply Now