Senior Research Engineer

HackerRank is at the forefront of innovation in machine learning and AI. We are launching an ambitious data commercialization program where we are creating a comprehensive benchmark to assess the performance of large language models (LLMs) on software development tasks and generating new content and data specifically to improve state-of-the-art LLMs on software engineering tasks. We are seeking a highly skilled and motivated research engineer to join our team and help us drive this initiative forward. This position is Full-Time and Remote within North America.

Key Responsibilities:

• Design & develop evaluation metrics and benchmark methodologies and conduct experiments to evaluate the performance of various LLMs on software engineering tasks.

• Develop & deploy data pipelines for LLM training and evaluation datasets.

• Contribute to the development and deployment of state-of-the-art machine learning models.

• Collaborate with cross-functional teams to ensure the seamless integration of the benchmark into our broader data commercialization strategy.

• Stay abreast of the latest machine learning and LLMs advancements to ensure our benchmarks and models remain cutting-edge.

Qualifications:

• Advanced degree (Master's) in Computer Science Machine Learning Data Science or a related field.

• Proven experience in machine learning with a strong emphasis on LLMs and natural language processing.

• Demonstrated experience in preparing and conducting evaluations of machine learning models.

• Experience developing large-scale data pipelines for research datasets.

• Proficiency in programming languages such as Python and familiarity with machine learning frameworks (e.g. TensorFlow PyTorch).

Preferred Qualifications:

• Experience in benchmarking and performance evaluation of LLMs & designing high-scale data pipelines

• Published research in relevant fields.

• Familiarity with coding challenges and competitive programming.

Benefits & Perks:

We have a full package of competitive benefits and perks which include the following:

• One-time home office set up stipend

• Monthly Remote Work Enablement Stipend

• Professional Development Reimbursement

• Wellbeing Benefits (Headspace etc)

• Flexible paid time off paid leave for new parents and flexible work hours

• Insurance for all employees (term life personal accident medical) along with medical insurance for their dependents

• Employee stock options

About HackerRank:

HackerRank is a Y Combinator alumnus backed by tier-one Silicon Valley VCs with total funding of over $100 million. The HackerRank Developer Skills Platform is the standard for assessing developer skills for 2500+ companies across industries and 23M+ developers worldwide. Companies like LinkedIn Stripe and Peloton rely on HackerRank to objectively evaluate skills against millions of developers at every hiring process allowing teams to hire the best and reduce engineering time. Developers rely on HackerRank to turn their skills into great jobs. We’re data-driven givers who take full ownership of our work and love delighting our customers!

HackerRank is a proud equal employment opportunity and affirmative action employer. We provide equal opportunity to everyone for employment based on individual performance and qualification. We never discriminate based on race religion national origin gender identity or expression sexual orientation age marital veteran or disability status. All your information will be kept confidential according to EEO guidelines.

We offer a comprehensive total rewards package where you’ll be rewarded based on your performance and recognized for the value you bring to the business.

Total compensation and benefits consist of salary quarterly performance incentives equity (stock options) medical dental vision life insurance travel insurance monthly work-from-home stipend learning and development reimbursements flexible remote-first work culture 401(K) flexible time off generous parental leave and more. Under our flexible paid time off policy you’ll decide how much time you need based on your circumstances.

Current base salary range: ($160000 - $180000). The exact salary may vary based on skills experience location market ranges and other compensation offered. The salary range does not include other compensation components commission (for sales-related roles) bonuses or benefits for which you may be eligible. Salary may be adjusted based on business needs.

Notice to prospective HackerRank job applicants: We’ve noticed fake accounts posing as HackerRank Recruiters on Linkedin and through text. These imposters trick you into paying them for jobs/providing credit check information. Here’s how to spot the real deal:

• Our Recruiters use @hackerrank.com email addresses.

• We never ask for payment or credit check information to apply interview or work here.

Thanks for your interest in HackerRank!