Benchmarks AI answers to real German-law questions by comparing two platforms side by side and scoring each against a rubric. Suits German-qualified corporate and M&A lawyers with law-firm transactional experience.
This role is for one of our clients
Compensation: $140-$150 per hour
We are partnering with a leading legal AI company to benchmark how well AI systems answer real questions of German law . We are hiring experienced corporate/M&A lawyers to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric.
Requirements
What you'll do
- Run the same set of prompts across two AI (LLM) platforms
- Compare the outputs from both platforms side by side
- Score each response against a standardized rubric we provide
- Submit concise written feedback for every evaluation
- Submit concise written feedback for every evaluation
- Primarily law-firm experience — at least 2 years (3+ preferred) at a law firm in corporate/M&A or transactional practice. If you are currently in-house, that is fine only if you moved in-house within the last 2 years and your prior experience was at a law firm.
- Qualified to practise in Germany , with a strong command of German corporate and commercial law
- Native or fluent German , with precise written communication
- Able to work independently to a rubric and to deadlines
- Able to work independently to a rubric and to deadlines
- Initial commitment: ~10 hours, with strong potential for more
- Confidentiality: all work is covered by NDA
- Confidentiality: all work is covered by NDA
Listing from Weekday's job board. Details can change; the platform's page is the final word.
