About the Role

This is a contract role as a Software Dev Engineer in Artificial General Intelligence, focusing on evaluating and improving AI-generated code from large language models. Responsibilities include analyzing code responses, selecting optimal solutions, and collaborating with AI research teams to enhance model performance.

Key Responsibilities

• Critically analyze and evaluate code responses generated by LLMs across various programming languages
• Select the most appropriate and efficient code solutions from multiple LLM-generated options
• Develop and write coding demonstrations to set benchmarks for quality and efficiency
• Provide detailed feedback to refine and improve the LLM's understanding and output
• Collaborate with the AI research team to identify areas for improvement in coding capabilities

Required Skills & Qualifications

Must Have:

• Bachelor's degree or equivalent
• 2+ years of non-internship design or architecture experience
• Experience programming with at least one software programming language

Nice to Have:

• 3+ years of full software development life cycle experience
• Master's degree in computer science or equivalent
• Previous experience working with or evaluating AI systems, particularly in code generation
• Understanding of machine learning concepts as they apply to natural language processing and code generation
• Data analysis skills, writing script to analyze model performance against human ground truth

Benefits & Perks

• Medical benefits
• Financial benefits
• Other benefits as part of total compensation package