Key takeaways (TL;DR)
- Analyst reports are inputs, not answers. They tell you which vendors are credible and where the market is going. They cannot tell you which vendor fits your requirements.
- Methodology determines the result. Gartner's Magic Quadrant, Forrester's Wave and IDC's MarketScape measure different things and produce different pictures of the same market. Knowing what each measures is the whole skill.
- Inclusion criteria filter the market before evaluation begins — usually on revenue, customer count and geographic coverage. Strong vendors are routinely excluded for size alone, not capability.
- Vendors pay analyst firms for advisory and reprints. The evaluations themselves are not bought, but the commercial relationship is real and worth understanding.
- Use analyst research to build a longlist and understand the market. Use your own weighted evaluation to choose. See our comparison framework.
What are procurement analyst reports?
Procurement analyst reports are independent research publications from industry analyst firms that evaluate and compare software vendors, size the market, and forecast where it is heading. In procurement and source-to-pay software, three firms dominate: Gartner, Forrester and IDC.
They matter because enterprise buyers use them as a shortlist filter, and because procurement committees frequently require analyst-recognized vendors as a governance step. Whether that is a good practice is a separate question — but it is a real one that affects which vendors reach your evaluation.
How do Gartner, Forrester and IDC differ?
They differ in what they measure, how they score it, and how the result is visualized.
| Gartner Magic Quadrant | Forrester Wave | IDC MarketScape | |
|---|---|---|---|
| Axes | Ability to Execute × Completeness of Vision | Current Offering × Strategy (bubble size = market presence) | Capabilities × Strategies (bubble size = market share) |
| Output | Four quadrants: Leaders, Challengers, Visionaries, Niche Players | Four bands: Leaders, Strong Performers, Contenders, Challengers | Four bands: Leaders, Major Players, Contenders, Participants |
| Criteria transparency | Criteria published; individual vendor scores not published | Criteria and weights published; individual scores published per criterion | Criteria published; scores summarized |
| Distinctive strength | Widest recognition among executives and boards | Most transparent — you can see the underlying scoring | Strong regional and market-share grounding |
| Best used for | Establishing market credibility | Detailed capability comparison | Market sizing and regional context |
[VERIFY: confirm each firm's current published methodology before publishing. Methodologies are revised periodically. Cite each firm's own methodology documentation with an access date.]
The practical difference: if you want to know whether a vendor is a serious market participant, the Magic Quadrant answers that fastest. If you want to know how a vendor scores on a specific capability you care about, the Forrester Wave is far more useful, because Forrester publishes criterion-level scores you can re-weight against your own priorities. That re-weighting is the single most valuable thing a buyer can do with analyst research and almost nobody does it.
What do analyst reports actually measure?
They measure vendor viability and capability breadth at market level — not fit at organization level.
What they measure well: - Whether a vendor is financially stable and likely to exist in five years - Whether the product covers the functional breadth the market expects - Whether the vendor's roadmap aligns with where the market is moving - Relative capability across a defined feature set
What they do not measure: - Whether the product fits your requirements, industry, size or existing systems - Total cost of ownership for your specific configuration - Implementation quality and time-to-value in practice - Whether your team will actually use it — the single largest determinant of realized value - Support quality for accounts of your size
That last set is where selections actually succeed or fail. An analyst-recognized Leader implemented badly delivers less value than a Niche Player implemented well.
Why are strong vendors sometimes missing entirely?
Because inclusion criteria filter the market before any evaluation happens.
Analyst firms set threshold requirements — commonly minimum annual revenue in the relevant product line, a minimum number of production customers, and coverage across multiple geographic regions. [VERIFY: cite the specific published inclusion criteria from the most recent relevant report rather than generalizing.]
The effect is systematic and predictable: the reports over-represent large vendors and under-represent everyone else, regardless of product quality. A vendor built specifically for mid-market manufacturing may be excluded on revenue while a large generalist platform that fits you poorly appears as a Leader.
This is not a criticism of the firms — the criteria exist so evaluations are comparable and the research is manageable. But it means a report is a view of the large-vendor market, not the whole market. If you are a 400-person organization, a meaningful share of the vendors that best fit you will never appear in one.
How do the commercial relationships work?
Analyst firms sell subscriptions to buyers and advisory services, inquiry access and reprint licences to vendors. Placement in an evaluation is not purchased. But the relationships are real:
- Vendors pay for advisory time, which includes guidance on how to present themselves in evaluations.
- Vendors pay for reprint rights to distribute a report they appear in — which is why you can usually read a report for free on a Leader's website.
- Vendors that engage more actively tend to brief analysts more thoroughly, which affects how well their capabilities are understood.
The honest position: this does not make the research corrupt, and it does not make it neutral either. Read it as informed expert opinion produced inside a commercial system, which is what it is.
A practical tell: if you are reading a report hosted on a vendor's own site, you are reading a licensed reprint that vendor chose to distribute because it flatters them. Read the same report on other vendors' sites and the framing around it changes completely. The report is the same; the surrounding narrative is marketing.
How should you use analyst reports in a real evaluation?
Use them at the start, not at the end.
Stage 1 — Longlist (analyst reports are excellent here). Use the reports to understand who the credible participants are, what capabilities the market considers table stakes, and where the market is moving. Build a longlist of 8–12.
Stage 2 — Re-weight the criteria (the highest-value step). Take Forrester's published criterion-level scores and reapply your own weights. If integration matters five times more to you than sourcing optimization, weight it accordingly. The published ranking reflects the analyst's weights, not yours — and re-weighting frequently reorders the list substantially.
Stage 3 — Add the vendors the reports exclude. Deliberately add 2–3 vendors that fall below inclusion thresholds but fit your segment, industry or region. This is where mid-market buyers find their best-fit options.
Stage 4 — Run your own evaluation. Shortlist to 3, run scripted demos on your own scenarios, check references at your size and in your industry, and score against your own weighted framework. See how to compare procurement software.
What never to do: shortlist only from a single quadrant. "We only consider Leaders" is a governance shortcut that systematically excludes the vendors most likely to fit smaller and specialized buyers, and it delegates your selection criteria to an analyst who has never seen your requirements.
What about newer AI and market-guide formats?
Analyst firms also publish Market Guides, Hype Cycles, Critical Capabilities and equivalent formats that are often more useful than the headline graphics.
- Gartner Critical Capabilities scores products against defined use cases rather than a single ranking — usually more actionable than the Magic Quadrant it accompanies.
- Market Guides cover markets considered too immature or fragmented for a full evaluation, and typically list far more vendors, including smaller ones excluded from the quadrant.
- Hype Cycles are useful for calibrating expectations on emerging capability claims — particularly relevant given how much AI functionality is currently being marketed in procurement software.
[VERIFY: confirm current format names and definitions with each firm before publishing; report formats and naming change.]
If you are a mid-market or specialized buyer, the Market Guide is often more valuable to you than the Magic Quadrant, precisely because its inclusion bar is lower.
FAQ: procurement analyst reports
Q. What is the difference between a Gartner Magic Quadrant and a Forrester Wave? A. Both evaluate vendors on two dimensions, but Gartner plots Ability to Execute against Completeness of Vision into four quadrants, while Forrester plots Current Offering against Strategy into four bands. The key practical difference is transparency: Forrester publishes individual scores for each vendor against each criterion, allowing buyers to re-weight the analysis for their own priorities, while Gartner publishes the criteria but not vendor-level scores.
Q. Are procurement analyst reports worth paying for? A. For enterprise buyers running a large, high-risk selection, the subscription cost is usually small relative to the decision. For smaller organizations, it is often not — the free licensed reprints distributed by vendors cover the same content, and the reports systematically exclude the smaller vendors that best fit smaller buyers. Free market guides and peer review platforms typically deliver more relevant information per dollar at that size.
Q. Do vendors pay to appear in analyst reports? A. Vendors do not pay for placement or scores in the evaluations themselves. They do pay for advisory services, analyst inquiry access and reprint licences. The evaluation is not purchased, but the commercial relationship is real and worth factoring in when reading the research.
Q. Why is a vendor I like not in the Magic Quadrant? A. Almost always because it does not meet the inclusion criteria — typically minimum revenue, minimum customer count, or multi-region coverage — rather than because it was evaluated and scored poorly. Inclusion thresholds filter the market before evaluation begins, which systematically excludes smaller and regionally focused vendors regardless of product quality.
Q. Should I only shortlist Leaders? A. No. Leader placement measures market execution and vision breadth, not fit with your requirements. Restricting a shortlist to Leaders excludes vendors that may serve your size, industry or region far better, and delegates your selection criteria to an analyst who has not seen your requirements. Use the reports to build a longlist, then evaluate against your own weighted criteria.
Q. Where can I read analyst reports for free? A. Vendors that appear favorably in a report frequently license reprint rights and distribute it free from their own websites, usually behind a short form. Reading the same report as distributed by several different vendors is a useful exercise — the report is identical, but the surrounding framing differs entirely.
The bottom line
Analyst research is genuinely useful for the question it answers well: who are the credible participants in this market and where is it heading. It is not useful for the question buyers most often use it for: which product should we buy. Those are different questions, and conflating them is how organizations end up with a well-regarded platform that nobody in the building wants to use.
Use the reports to build your longlist. Re-weight the published criteria against your own priorities. Deliberately add the vendors the inclusion criteria excluded. Then make the decision yourself, on evidence you gathered, against requirements you wrote.
Talk to us about your requirements →
See Procurement VMS in action
Schedule an executive demo built around your industry, organization size, and procurement priorities.
Request Your Executive Demo →