NewFree base camp this Saturday: Agentic AI for Enterprise. Limited seats.

← All jobs

Senior SWE - Python / TypeScript

On-site · USA5–25 yrscontract

We're seeking a detail-driven engineer with expertise in preference datasets and evaluation rubrics. You'll work on developing and iterating on rubrics, reviewing datasets, and constructing pipelines. You'll thrive in dynamic settings and communicate complex technical efforts with precision.

The role

What you'll do

  • Develop and improve rubrics and evaluation frameworks
  • Review and annotate datasets with high quality bar
  • Construct and sustain pipelines and infrastructure
  • Consolidate insights into concise write-ups and progress updates
  • Work with researchers and engineers to convert qualitative assessments into repeatable processes

You bring

Requirements

  • 5+ years of expertise in Python or equivalent proficiency in other languages
  • Practical background in preference data collection and/or evaluation rubric development
  • Exceptional written and verbal communication skills
  • Proven high-caliber judgment

Skills

PythonPipeline DevelopmentInfrastructure ManagementTypeScriptGolangJavaScriptVSCodePreference Data Collection