Start from the system you need tested, not from the overall total. Then read the evidence behind each name on your shortlist and ask each vendor about the gaps this site lists.
Step 1. Name the system and the testing type
Write down the system (WMS, TMS, fleet and telematics, last-mile delivery, freight and forwarding, EDI and carrier integrations) and the testing type (automation, performance and peak load, mobile and handheld, integration). Use them to pick a scenario ranking.
- EDI and carrier integrations: 1 ranked vendors with evidence (below the threshold of 4, no page)
- fleet and telematics: 3 ranked vendors with evidence (below the threshold of 4, no page)
- freight and forwarding: 1 ranked vendors with evidence (below the threshold of 4, no page)
- last-mile delivery: 0 ranked vendors with evidence (below the threshold of 4, no page)
- TMS: 3 ranked vendors with evidence (below the threshold of 4, no page)
- WMS: 6 ranked vendors with evidence
Step 2. Open the scenario ranking
A scenario ranking re-scores vendors on case studies and reviews for that system only. Vendors without evidence for the system are not listed there. Take the vendors listed as your first shortlist.
- integration, EDI and API: 7 ranked vendors with evidence
- mobile and handheld: 6 ranked vendors with evidence
- performance and peak load: 6 ranked vendors with evidence
- test automation: 11 ranked vendors with evidence
Step 3. Check the absence matrix
The matrix below shows, for every ranked vendor, how many recorded case studies name each system. An empty cell means no published case study for that system, which is a question to ask, not a verdict.
| Vendor | WMS | TMS | fleet and telematics | last-mile delivery | freight and forwarding | EDI and carrier integrations |
|---|---|---|---|---|---|---|
| N-iX | 1 | 1 | none | none | none | none |
| a1qa | 2 | none | 1 | none | none | none |
| Qualitest | 1 | none | 1 | none | none | none |
| ScienceSoft | 1 | none | none | none | none | none |
| DeviQA | 1 | none | none | none | none | none |
| Crestech | none | none | 2 | none | none | none |
| HCLTech | 1 | none | none | none | none | 1 |
| ImpactQA | none | none | none | none | none | none |
| Codoid | none | none | none | none | 1 | none |
| TestingXperts | none | none | none | none | none | none |
| BugRaptors | none | none | none | none | none | none |
| auticon | none | 1 | none | none | none | none |
| Mindfire Solutions | none | 1 | none | none | none | none |
Step 4. Read two case studies per shortlisted vendor
Open the case study pages from each vendor profile. Prefer grade A and B case studies; note the "does not state" list on each page and turn it into questions.
Step 5. Ask for what is missing
For each vendor, take the "No published evidence for" list from its profile and ask for a reference or a sample deliverable for each line that matters to you. Compare answers against the methodology dimensions.