Sr. Machine Learning Research Engineer

At HackerRank we help over 2500 of the most prestigious logos across industries find hire and upskill amazing developer talent using our SaaS-based Developer Skills Platform. We pioneered and continue to lead the developer skills market. At HackerRank we are passionate about our mission to ' Change the world to value skills over pedigree . This position is Full-Time and Remote within the US.

HackerRank is at the forefront of innovation in machine learning and data science. We are launching an ambitious data commercialization program to create a comprehensive benchmark to assess the performance of large language models (LLMs) on coding challenges. We are seeking a highly skilled and motivated research engineer to join our team and drive this initiative forward.

You will be working on:

• Develop and implement a benchmark for assessing LLMs on coding challenges.

• Conduct research and experiments to evaluate the performance of various LLMs.

• Prepare and design evaluation metrics and methodologies.

• Collaborate with cross-functional teams to ensure the seamless integration of the benchmark into our broader data commercialization strategy.

• Stay abreast of machine learning and LLMs advancements to ensure our benchmarks and models remain cutting-edge.

• Contribute to the development and deployment of state-of-the-art machine learning models.

We are looking for:

• Advanced degree (Master's or Ph.D.) in Computer Science Machine Learning Data Science or a related field.

• Proven experience in machine learning with a strong emphasis on LLMs and natural language processing.

• Demonstrated experience in preparing and conducting evaluations of machine learning models.

• Proficiency in programming languages such as Python and familiarity with machine learning frameworks (e.g. TensorFlow PyTorch).

• Strong analytical and problem-solving skills.

• Excellent communication and teamwork abilities.

• Passion for staying current with emerging trends and technologies in the field.

Nice to have:

• Experience in benchmarking and performance evaluation of machine learning models.

• Familiarity with coding challenges and competitive programming.

• Published research in relevant fields.

Benefits & Perks:

We have a full package of competitive benefits and perks which include the following:

• One-time home office set up stipend

• Monthly Remote Work Enablement Stipend

• Professional Development Reimbursement

• Wellbeing Benefits (Headspace etc)

• Flexible paid time off paid leave for new parents and flexible work hours

• Insurance for all employees (term life personal accident medical) along with medical insurance for their dependents

• Employee stock options

About HackerRank:

HackerRank is a Y Combinator alumnus backed by tier-one Silicon Valley VCs with total funding of over $100 million. The HackerRank Developer Skills Platform is the standard for assessing developer skills for 2500+ companies across industries and 23M+ developers worldwide. Companies like LinkedIn Stripe and Peloton rely on HackerRank to objectively evaluate skills against millions of developers at every hiring process allowing teams to hire the best and reduce engineering time. Developers rely on HackerRank to turn their skills into great jobs. We’re data-driven givers who take full ownership of our work and love delighting our customers!

HackerRank is a proud equal employment opportunity and affirmative action employer. We provide equal opportunity to everyone for employment based on individual performance and qualification. We never discriminate based on race religion national origin gender identity or expression sexual orientation age marital veteran or disability status. All your information will be kept confidential according to EEO guidelines.

We offer a comprehensive total rewards package where you’ll be rewarded based on your performance and recognized for the value you bring to the business.

Total compensation and benefits consist of salary quarterly performance incentives equity (stock options) medical dental vision life insurance travel insurance monthly work-from-home stipend learning and development reimbursements flexible remote-first work culture 401(K) flexible time off generous parental leave and more. Under our flexible paid time off policy you’ll decide how much time you need based on your circumstances.

Current base salary range: ($160000 - $180000). The exact salary may vary based on skills experience location market ranges and other compensation offered. The salary range does not include other compensation components commission (for sales-related roles) bonuses or benefits for which you may be eligible. Salary may be adjusted based on business needs.

Notice to prospective HackerRank job applicants: We’ve noticed fake accounts posing as HackerRank Recruiters on Linkedin and through text. These imposters trick you into paying them for jobs/providing credit check information. Here’s how to spot the real deal:

• Our Recruiters use @hackerrank.com email addresses.

• We never ask for payment or credit check information to apply interview or work here.

Thanks for your interest in HackerRank!

#LI-Remote