job Listed by Scholify

Ruby Engineer

SC

SME Careers

About the opportunity

As an hourly paid, fully remote Ruby Engineer for AI Data Training, you will review AI-generated Ruby and Rails code or generate your own solutions, evaluate the reasoning quality and step-by-step problem-solving, and provide expert feedback that helps models produce answers that are accurate, logical, and clearly explained. You will assess solutions for readability, maintainability, and correctness; identify errors in MVC structure, domain modeling, or control flow; fact-check information; write high-quality explanations and model solutions that demonstrate idiomatic Ruby patterns; and rate and compare multiple AI responses based on correctness and reasoning quality. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate that provides AI training data for many of the world’s largest AI companies and foundation model labs, and your work will directly help improve the world’s premier AI models while giving you the flexibility of impactful, detail-oriented remote contract work.

Important There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Key Responsibilities

Develop AI Training Content: Create detailed prompts in various topics and responses to guide AI learning, ensuring the models reflect a comprehensive understanding of diverse subjects.

Optimize AI Performance

Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance.

Ensure Model Integrity

Test AI models for potential inaccuracies or biases, validating their reliability across use cases. Your Profile 1–2+ years of professional Ruby programming experience in production environments. Strong understanding of Ruby on Rails, MVC architecture, and idiomatic Ruby patterns for structuring application code.

Hands-on software engineering experience building and maintaining Ruby or Rails applications, with exposure to real-world production constraints. Ability to evaluate readability, maintainability, and logical correctness in Ruby and Rails code, including model, controller, and service-layer design. Significant experience using LLMs or AI coding assistants while programming, combined with a disciplined approach to validating and reviewing their output.

Excellent English writing skills, capable of producing clear, structured, a…