Senior SWE - Python / TypeScript
On-site · USA5–25 yrscontract
We're seeking a detail-driven engineer with expertise in preference datasets and evaluation rubrics. You'll work on developing and iterating on rubrics, reviewing datasets, and constructing pipelines. You'll thrive in dynamic settings and communicate complex technical efforts with precision.
The role
What you'll do
- Develop and improve rubrics and evaluation frameworks
- Review and annotate datasets with high quality bar
- Construct and sustain pipelines and infrastructure
- Consolidate insights into concise write-ups and progress updates
- Work with researchers and engineers to convert qualitative assessments into repeatable processes
You bring
Requirements
- 5+ years of expertise in Python or equivalent proficiency in other languages
- Practical background in preference data collection and/or evaluation rubric development
- Exceptional written and verbal communication skills
- Proven high-caliber judgment
Skills
PythonPipeline DevelopmentInfrastructure ManagementTypeScriptGolangJavaScriptVSCodePreference Data Collection