How to shortlist a retail QA vendor

  1. Name the system and the moment before you name a vendor.A POS (point of sale: the till software and hardware that rings up store sales, takes card payments and prints receipts.) rollout, an OMS (order management system: software that routes, splits and tracks customer orders across stores, warehouses and carriers.) replacement and a peak-season load test (a test that sends a planned volume of simulated users or requests to a system and measures response times and errors.) need different evidence, so the shortlist starts from one of them.
  2. Keep only vendors with a published case that names your system.A service page lists what a vendor offers; a case study shows what it delivered, so the case is the filter.
  3. Open each case and sort its claims into checkable and not checkable.A metric repeated by the client or by press can be checked; a metric on the vendor's page alone cannot.
  4. Write down what each case leaves out.Baseline, measurement method, team size and dates are the gaps that most often hide behind a headline figure.
  5. Send every shortlisted vendor the same written questions.Identical questions make the answers comparable and show which vendor answers with evidence rather than adjectives.
  6. Ask for one reference per case you rely on.A reference call with the named client is the fastest way to move a claim from partial to verified.
  7. Use size and review counts only to break ties.Headcount says a vendor can staff a team; it does not say the team has tested your system.

Download this checklist

The checklist file holds the 7 steps above, one per row, with a column for your notes on each vendor.

how-to-shortlist-a-retail-qa-vendor-checklist.csvCSV1 KBCC BY 4.0

What the data on this site shows

Published by the editor of retailqavendors.com. Last reviewed .