a1qa and an anonymised fashion and apparel retailer: Magento functional testing case analysed
Verdict: what is checkable
The evidence grade (this site's label for how a case is sourced: primary with client or press confirmation, secondary when vendor-hosted only.) is secondary: the only source is the vendor's own page; of 7 metrics, 0 are verifiable yes, 0 partial and 7 no. [ev-1537]
Client profile as published
- Client
One of the biggest online sellers of clothes, shoes, and home goods in the UK
(the vendor's description; the vendor does not name the client)- Segment
- Fashion and apparel
- Region
- United Kingdom
- Channels
- ecommerce
- Size indicators
One of the biggest online sellers of clothes, shoes, and home goods in the UK
;over 500 famous brands in fashion, beauty, and home goods
;new big sales every day
The client description and size indicators are quoted from the source; segment, region and channels are this site's classification. [ev-1537]
Systems in scope
- Ecommerce platform (Magento): named in the Solution section ("The website was managed by the Magento e-commerce platform.")
- Payments (PayPal, Braintree): named in the Challenges section ("new payment methods") and the project specifics list ("PayPal, Braintree")
- Integrations: named in the project specifics list ("SEKO Warehouse", "integration with other online sellers")
Where the source names each system is quoted or summarised from the case page. [ev-1537]
Problem as stated
The retailer wanted to deliver change requests coming from its marketing and customer support staff while it expanded the website. New features such as additional payment methods and delivery options were being added, and the page links rising sales to that new functionality. [ev-1537]
implement business requests from Marketing and Customer Support departments employees(quoted from the source)
Approach
- Testing types
- functional, performance, automation and mobile (main scope: functional)
- Team shape
- distributed team
- Duration
- 21 months of project duration
- Engagement model
- dedicated-team
- Tooling named in the source
- Php, MySQL, Google Chrome, Apple Safari, Java, Selenium, Mozilla Firefox, MS Internet Explorer
Metrics claimed
| Metric | Value | Unit | Claimed by | Verifiable | Evidence |
|---|---|---|---|---|---|
| brands presented on the website | over 500 | brands | vendor | no | ev-1538 |
| daily sale discounts | up to 70 | % | vendor | no | ev-1539 |
| mobile devices tested | 13 | mobile devices | vendor | no | ev-1540 |
| project effort (stat block) | 35,5 | months | vendor | no | ev-1541 |
| project duration (stat block) | 21 | months | vendor | no | ev-1542 |
| major and critical defects found (stat block)vendor claim, outside the typical range in this data set | 145 | defects | vendor | no | ev-1543 |
| test survey checks written and run (stat block)vendor claim, outside the typical range in this data set | 3,067 | checks | vendor | no | ev-1544 |
What the case does not say
- Baseline before the engagement.
- Measurement method.
- Duration over which the metric held.
- Team size on both sides.
- Cost.
- What was out of scope.
- Whether the client is still a client.
- Date of the work.
Reading notes for a buyer
This case speaks to the scenario “Payments and PCI scope” and feeds dimension D2 (Retail system coverage) of the methodology. A question to put to a1qa:
Which payment methods did the functional testing cover, and did the scope include any PCI DSS (Payment Card Industry Data Security Standard: the security rules for any business that stores, processes or transmits card data.) or card data checks? [ev-1537]
Source and verification
- Source
- Complex testing of e-commerce website
- Published
- not dated by the vendor
- Verified
- 2026-10-30
- Evidence grade
- secondary
- Corroborating sources
- none found
| Id | Claim | Source | Class | Grade | Published | Verified |
|---|---|---|---|---|---|---|
| ev-1537 | Complex testing of e-commerce website | Complex testing of e-commerce website | vendor-case-study | secondary | 2026-10-30 | |
| ev-1538 | The website under test presented over 500 famous brands in fashion, beauty, and home goods. | Complex testing of e-commerce website | vendor-case-study | secondary | 2026-10-30 | |
| ev-1539 | It launched new big sales every day including discounts up to 70%. | Complex testing of e-commerce website | vendor-case-study | secondary | 2026-10-30 | |
| ev-1540 | The website was tested on 13 mobile devices and various operating systems. | Complex testing of e-commerce website | vendor-case-study | secondary | 2026-10-30 | |
| ev-1541 | 35,5 months of project efforts | Complex testing of e-commerce website | vendor-case-study | secondary | 2026-10-30 | |
| ev-1542 | 21 months of project duration | Complex testing of e-commerce website | vendor-case-study | secondary | 2026-10-30 | |
| ev-1543 | 145 Major and Critical defects found | Complex testing of e-commerce website | vendor-case-study | secondary | 2026-10-30 | |
| ev-1544 | 3,067 test survey checks wrote and run | Complex testing of e-commerce website | vendor-case-study | secondary | 2026-10-30 |
Vendor profile: a1qa. System facet: Ecommerce platform testing vendors.
Positions on this page are computed from the methodology published at /methodology/ and from the evidence records linked on this page. Case study figures are the vendor's or the client's claims as published at the linked source; the "verifiable" column states what this site could check. The site does not recommend vendors, does not accept paid placement and does not publish rates. Last computed: 2026-11-03.
Published by the editor of retailqavendors.com. Last reviewed .