Data Science Expert at Weekday AI — Remote
Full job description
This role is for one of our clients
Compensation: $120-$170 per hour
Join a leading AI research organization working on the next generation of intelligent systems. We are seeking experienced Data Science Experts to help evaluate how effectively AI performs real-world data science tasks. Rather than building models or delivering business analyses yourself, you will define what high-quality work looks like by creating robust evaluation frameworks and assessing AI-generated outputs with structured, evidence-based feedback.
This is an excellent opportunity to apply your industry expertise to improve advanced AI systems while influencing how they reason through complex analytical problems.
Requirements
### Key Responsibilities
- Design detailed, task-specific evaluation criteria for real-world data science deliverables, including:
- Data analyses
- Predictive and statistical models
- Dashboards and visualizations
- Experiment results
- Executive recommendations and business insights
•
- Evaluate AI-generated and human-produced work using objective scoring frameworks.
- Provide detailed written justifications for each evaluation, ensuring consistency and technical accuracy.
- Apply sound analytical judgment to produce reproducible and defensible assessments.
- Incorporate structured reviewer feedback and continuously refine evaluation methodologies.
- Collaborate with cross-functional teams to improve AI training quality and evaluation standards.
### Required Qualifications
- 5+ years of professional experience in Data Science within an industry environment.
- Strong background in business operations, product analytics, growth analytics, or similar data science functions at technology-driven organizations.
- Deep expertise in:
- Experimental design and A/B testing
- Statistical analysis
- SQL and Python
- Metric development and performance measurement
- Translating analytical findings into business recommendations
•
- Excellent written communication skills with the ability to clearly explain technical reasoning.
- Exceptional attention to detail and the ability to evaluate work consistently against structured rubrics.
- Comfortable receiving feedback and calibrating evaluation standards with peer reviewers.
### Preferred Qualifications
- Experience contributing to AI evaluation, model training, human feedback, or data annotation initiatives.
- Familiarity with large language models (LLMs), AI-assisted analytics, or machine learning workflows.
- Experience reviewing technical work or mentoring analytical teams is a plus.
### Application Process
- Submit your resume or relevant technical background to begin the application process.
- Qualified candidates may be invited to complete a short technical assessment or provide additional information relevant to their expertise.
### Why Join?
- Contribute to the development of next-generation AI systems used for real-world analytical reasoning.
- Apply your professional data science expertise to high-impact AI evaluation projects.
- Work remotely with flexible scheduling.
- Collaborate with a network of experienced technical professionals helping define the future of AI quality and reasoning.
### Contract Details
- Independent contractor engagement.
- Fully remote with flexible working hours.
- Project duration may be extended or concluded based on project requirements and performance.
- Weekly payments based on approved work completed.
- Please note that H1-B and STEM OPT sponsorship is not available for this engagement.
Required skills
- communication
- data science
- artificial intelligence
- next.js
- data analytics
- sql
- cross-functional
- machine learning
- python
- receiving