How does a localisation agency score translation quality internally?
Many agencies have reviewers mark errors by type and severity, turn the marks into a score per job, and track scores by linguist and language pair over time. Ask to see the scoring sheet, a few scored examples with details removed, and what the agency does when a score falls below its own standard.
Ask what the categories are and who decided them. A useful system separates errors of meaning from errors of style and formatting, and does not treat them as the same. Ask how reviewers are trained to score consistently, and whether two reviewers given the same text would reach similar results.
Look at what the scores are used for. If they only sit in a file, they are not doing much. If they feed into assignment decisions, coaching and client reports, that is a sign the agency takes quality seriously. Ask for an example of a linguist whose scores improved, and one whose scores led to a change in the work given.
Finally, ask how the agency handles disputes with clients about quality. The scoring method should help settle them. Request the totals by month and language pair, with names removed, and see whether the trend is steady or bumpy. Ask last whether clients ever see the scores, and whether client complaints and internal scores tend to point at the same problems.
Key takeaways
- Ask to see the scoring sheet, its categories and how reviewers are trained to use it.
- Check that scores feed into assignments and coaching, not only a file.
- Review the trend by month and language pair, with names removed.
- Ask for an example where a score changed what the agency did next.
Related reading
12 pages on the same subject, grouped by topic.
Due diligence
Buying
- Expert answerHow do I check a translation agency’s pool of freelance translators for each language?
- Expert answerHow do I check a translation agency’s quoting method for per-word and per-page work?
- Expert answerHow do I find out how much a translation agency leans on machine translation with human review?
- Expert answerHow do I judge a translation agency’s marketing and website visibility with clients?
Selling
- Expert answerHow do I describe my translation agency’s project management software to a buyer?
- Expert answerHow do I introduce a buyer to my translation agency’s project managers without losing them?
- Expert answerHow do I keep my translation agency’s rush-job clients happy during the sale?
- Expert answerHow do I pass my translation agency’s relationships with interpreters to a buyer?
Sources
This answer is checked against primary sources. Links were last confirmed on the dates shown.
- 01Business Development Bank of CanadaGovernmentHow to conduct due diligence when buying a business
- 02Business Development Bank of CanadaGovernmentWhat are the steps to buying a business?
Deavo is an advertising and listings platform, not a brokerage, law firm or valuation firm. This page is general information, not legal, tax, accounting or valuation advice, and rules differ by province. Confirm anything you rely on with a qualified professional before you act on it.