<h4>Job title : Senior Software Engineer – Python (LLM Evaluation &amp; Repository Validation)</h4>Employment Type: Contractor Assignment (No medical / paid leave)Experience Required: 4+ YearsLocation: RemoteStart Date: ImmediateEngagement Length: 6 Weeks (5 days working) <h4>About the Role</h4>We are looking for experienced Software Engineers (Tech Lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. You should have experience working with well-maintained, widely-used repositories with 5000+ stars.This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality. <h4>Day-to-Day Responsibilities</h4><ul><li>Analyze and triage GitHub issues across trending open-source libraries.</li><li>Set up and configure code repositories, including Dockerization and environment setup.</li><li>Evaluate unit test coverage and quality.</li><li>Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.</li><li>Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.</li><li>Opportunity to lead a team of junior engineers collaborating on projects.</li></ul> <h4>Required Skills</h4><ul><li>Strong experience with Python</li><li>Proficiency with Git, Docker, and basic software pipeline setup</li><li>Ability to understand and navigate complex codebases</li><li>Comfortable running, modifying, and testing real-world projects locally</li><li>Experience contributing to or evaluating open-source projects is a plus</li></ul> <h4>Nice to Have</h4><ul><li>Previous participation in LLM research or evaluation projects</li><li>Experience building or testing developer tools or automation agents</li></ul><h4> </h4>