Home
Jobs
Crossing Hurdles
Technical Reviewer - RL Environment Terminal Benchmarking | $100/hr Remote

Technical Reviewer - RL Environment Terminal Benchmarking | $100/hr Remote

Remote

United states

$ 100 /hour

Freelance

03-11-2025

Share this job:

Score my CV

Skills

Critical Thinking Python Problem-solving Research Training PyTorch TensorFlow benchmarking

Job Specifications

At Crossing Hurdles, we work as a referral partner. We refer candidates to our partner that collaborates with world’s leading AI research labs to build and train cutting-edge AI models.

Position: Technical Reviewer - RL Environment Terminal Benchmarking (Agentic AI)

Type: Hourly Contract

Compensation: $80–$100/hour

Location: United States

Duration: Ongoing

Commitment: 10–40 hours/week

Role Responsibilities (Training support will be provided):

Review RL Environments: Evaluate terminal conditions, environment designs, and benchmarking protocols for correctness, consistency, and alignment with research goals.
Assess Benchmarks: Ensure fairness, reproducibility, and accuracy in benchmarking pipelines for RL tasks.
Provide Structured Technical Feedback: Offer feedback on code implementations, documentation, and theoretical formulations, focusing on experimental rigor and reproducibility.
Collaborate with Researchers: Work closely with researchers and engineers to refine evaluation metrics and methodologies, ensuring alignment with agentic AI objectives.
Validate Reproducibility: Confirm results across different runs, seeds, and hardware setups to ensure consistent and reliable findings.
Document Findings and Improvements: Capture feedback and recommend improvements for environment design, benchmarking practices, and evaluation standards.

Requirements:

Strong background in reinforcement learning, computer science, or applied AI research.
Experience with RL environments and benchmarking methodologies.
Proficient in reading and reviewing Python codebases (PyTorch/TensorFlow experience is a plus).
Strong critical thinking and problem-solving skills with an eye for detail.
Passion for experimental reproducibility, fairness, and standardization in agentic AI.

Application process: (Takes 20 min)

Upload resume
AI interview based on your resume (15 min)
Submit form

About the Company

At Crossing Hurdles, we specialise in customised recruitment and staffing solutions designed to drive success for businesses and professionals. Our focus is on connecting organisations with top-tier talent by sourcing, screening, and presenting only the top 1% of candidates across a wide range of industries. We work closely with clients to understand their unique needs, ensuring that we find candidates who not only fit the role but also align with their organizational culture. Over the past few quarters, we've successfully p... Know more