Skip to content
02Delivery & Controls

The score that is not a number

A technical score on a qualitative criterion records what evaluators judged. The weighting decides how much of the award that judgement controls; it does not turn the judgement into a measurement. What makes the score answerable is a record that a reader outside the room can test against the solicitation and the proposal, and the instruments examined here require different parts of that record.

14%

of US federal bid protests decided on the merits in fiscal year 2025 were sustained, 53 of 380; GAO names unreasonable technical evaluation among three prevalent grounds for sustaining protests

9 min read

A tender gives 20 points to the proposed team. One bidder scores 14, another 17. The three points may be the right answer. What matters for everything that happens after the award is a narrower question: can anybody who was not on the panel find out what the 17 was given for, and what the 14 lacked?

What a technical score records

Some scores are produced by a defined calculation. A price scored by a published formula, or a criterion that awards points for a stated count or a stated threshold, can be recomputed by anyone holding the inputs, and two readers who do the arithmetic get the same answer. Other scores record a judgement: the quality of a methodology, the understanding shown of the scope, the strength of a team. There the number is the evaluators' conclusion written in digits. It is not less legitimate for that, and no instrument read here forbids it. It is a different kind of record, and it needs different support if anyone is to examine it.

The Saudi law's own wording allows for both. Non-price criteria must be objective and, to the extent practicable, quantifiable, which leaves room for criteria that cannot be quantified.

What the instruments require

Read side by side, the three do different work. The directive bounds the criterion and ties it to information that can be verified. The US regulation requires the reasons behind the evaluation to be written into the file. The Saudi law requires criteria stated in advance, a minute that gives the reasons for each opinion the committee reached, each losing bidder's own technical scores, and a binding forum. In the provisions quoted here it does not require a written reason for each score: the losing bidder is told the reasons for its exclusion and its technical scores, not the reasons for each score.

Why the weighting does not remove the judgement

A weighting converts a score into a share of the award. Twenty points out of 70 on the team decides how far the panel's view of the team can move the result. It says nothing about how the panel formed that view. The economic meaning of a weighting, what one point costs in price, is worked through in its own piece.

What a technical point costs under a published weighting

, read: Every award rule makes you publish the weighting. None makes you defend it.

What matters here is the direction of travel. The weighting multiplies whatever the score contains. A score resting on stated evidence becomes a large, defensible part of the award. A score resting on an impression becomes a large part of the award too, and the arithmetic around it makes it look as firm as the price.

What a reviewable record contains

Five things, and they are distinct. A system can have one without the next.

  1. The criterion and its weighting are published. The bidder knows what will be scored and how much it counts.
  2. The evidence that earns a score is defined. The solicitation says what a bidder must show, submit or commit to for the higher mark: named people with stated experience, a method that addresses named risks, a programme with stated durations.
  3. The reasons for the score are recorded. The file says what the evaluators found in the proposal against that evidence: the strength, the weakness, the missing commitment.
  4. The affected party and the review body can see the reasons. A score that is disclosed without its reasons can be disputed only in the abstract.
  5. The reasons can be tested against the solicitation and the proposal. A reader outside the panel can put the recorded reason beside the page of the proposal it refers to and the criterion it applies, and say whether they agree.

The 14 and the 17 become reviewable at step 3 and contestable at step 4. Before that, the losing bidder and the review body have a number and nothing to test it against.

What protest review can establish

GAO's annual report to Congress gives the figures for the US federal forum. In fiscal year 2025 GAO received 1,688 cases, 1,617 of them protests. It issued 380 decisions on the merits and sustained 53, a sustain rate of 14%. Its effectiveness rate, the share of protests closed in which the protester obtained some relief, either because GAO sustained the protest or because the agency took voluntary corrective action, was 52%. GAO names three "most prevalent reasons for sustaining protests": unreasonable technical evaluation, unreasonable cost or price evaluation and unreasonable rejection of a proposal. It numbers them in its list without saying that the order is a ranking, and gives no count for each. Its example of the technical ground: the agency credited the awardee with staffing for the required 11-month period when the awardee had proposed staffing for 9 months.

The example is worth reading for what made it decidable. The record said what the evaluators credited, the proposal said something else, and the solicitation set the requirement. Each was a document, and the error was the distance between them. That is step 5 in operation: a reason recorded clearly enough to be wrong in a way somebody could show.

The two rates measure different things and should not be run together. The 14% is a share of merit decisions. The 52% is a share of protests closed and includes cases where the agency changed course before any decision. GAO also counts docket numbers rather than procurements, so a supplemental protest on the same award is a separate case.

What review cannot establish

Review tests a recorded reason against documents. It does not supply a second, independent measure of quality against which the panel's judgement can be checked. Where the reason says the methodology was stronger because it addressed a named risk and the proposal does address it, a reviewer can confirm consistency and little more. A bounded judgement with a sound record is still a judgement.

Nor do the figures describe evaluations nobody protested. A sustain rate is a rate among cases brought and decided, and GAO states that agencies need not report their reasons for taking corrective action. A low rate of overturned technical evaluations can mean sound evaluations, or records too thin to contest, and the statistics alone cannot say which.

For the Saudi system the same caution runs further. The law provides the forum and the Regulations provide for its decisions to be made available. How the committee treats technical scores, and how completely its decisions can be read in practice, are not answered by the text of either.

What to examine

  • Take one judgement-based criterion and ask what a bidder would have had to submit to move from 14 to 17. If the solicitation cannot answer, the criterion measures preference, and the weighting multiplies it.
  • For a criterion on the team, apply the directive's test: can the quality of the staff assigned have a significant impact on the performance of this contract?
  • Ask for the evaluation minute. Check whether it gives reasons for scores or only for the committee's recommendations and any dissent, which is what Article 45(3) requires.
  • Take one recorded reason and find the page of the proposal it refers to. If the reason cannot be located in the proposal, the record cannot be reviewed, whatever the score.
  • Check what a losing bidder received under Regulations Article 85(2): its technical scores, and whether anything explained them.
  • Look for the Article 86 committee's past decisions where the Regulations say they are made available, and whether any of them turned on a technical evaluation.

Sources. Saudi Government Tenders and Procurement Law, Royal Decree M/128 of 2019, Articles 24, 25, 45, 53, 86 and 87, and its Executive Regulations, Articles 8 and 85, in the consolidated Arabic text published by the Ministry of Finance, with the Ministry's English translation used as a reading aid. Both remain in force until the law gazetted on 4 September 2026 takes effect, 120 days after publication. Directive 2014/24/EU, Article 67, Official Journal text at EUR-Lex. Federal Acquisition Regulation 15.305, FAC 2026-01, at Acquisition.gov. GAO, Bid Protest Annual Report to Congress for Fiscal Year 2025, B-158766, 12 December 2025.

Read the sources

  • Directive 2014/24/EU on public procurement, Article 67, contract award criteriaDirective 2014/24/EU, Article 67; read 2026-09-25.Free, the Official Journal text at EUR-Lex; Article 67 is in Title III, Chapter III. Article 67(4): award criteria shall not confer an unrestricted freedom of choice, shall ensure effective competition, and shall be accompanied by specifications that allow the information tenderers provide to be effectively verified; in case of doubt the authority shall verify it. Article 67(2)(b) admits the staff assigned as a criterion where their quality can have a significant impact on performance. Article 67(5) requires the relative weighting of each criterion to be specified in the procurement documents, permits it to be expressed as a range with an appropriate maximum spread, and falls back to decreasing order of importance where weighting is not possible for objective reasons; Article 67 read in full at EUR-Lex, 25 September 2026.
  • Federal Acquisition Regulation 15.305, Proposal evaluationFAC 2026-01, effective 13 March 2026; read 2026-09-07.Free. Proposals are assessed solely on the factors and subfactors in the solicitation; the relative strengths, deficiencies, significant weaknesses and risks supporting the evaluation shall be documented in the contract file; the technical evaluation record must include an assessment of each offeror’s ability and a summary, matrix or ranking with supporting narrative. Read 7 September 2026, FAC 2026-01.
  • GAO, Bid Protest Annual Report to Congress for Fiscal Year 2025, B-158766, 12 December 2025fiscal year 2025; read 2026-09-07.Free. 1,688 cases filed, 380 merit decisions, 53 sustained (14%), effectiveness rate 52% counting voluntary corrective action. GAO names three most prevalent reasons for sustaining protests: unreasonable technical evaluation, unreasonable cost or price evaluation and unreasonable rejection of a proposal, numbered without a stated ranking or a count for each. Its example of the technical-evaluation ground: an agency credited an awardee with staffing for the required 11 months when it had proposed 9. Read in full 7 September 2026.
  • Saudi Government Tenders and Procurement Law and its Executive Regulations, consolidated Arabic text, third editionthird edition, the law in force until the new law takes effect; amendments to the regulations after this edition are not consolidated in it; read 2026-09-25.Free in full, in Arabic, from the Ministry of Finance: each article of the 2019 Law printed beside the regulations that implement it, 117 pages. The enacted text on securities and receipt. Law Article 61(1) sets the final guarantee at 5% of the contract value within 15 working days of notice of the award, and 61(4) keeps it until the contractor has performed its obligations and the project is finally received. Regulations Article 101 requires the final guarantee to be extended in construction contracts where maintenance and warranty work runs «لما بعد انتهاء سنة الضمان المشار إليه في الفقرة (1) من المادة (الثامنة والعشرين بعد المائة)»; Article 111 pays a final statement of not less than 10% in public construction contracts after initial receipt; Article 128 sets a warranty period of not less than one year from initial receipt, keeps the warranty for shortcomings not dealt with at initial receipt, and makes final receipt follow the end of that period and the delivery of drawings, equipment specifications and project documents.
  • Executive Regulations of the Government Tenders and Procurement Law2019 Executive Regulations, amended 1 September 2026; to be re-issued with the new law; read 2026-09-03.Free in full. Article 127 sets the receipt procedure, 128 a warranty period of not less than one year, 99 the ten-year liability, and 109 the payment chain. Note that the 2007 regulations of the superseded 2006 law are still hosted on the same site and number these provisions differently. Searched in the Arabic on 7 September 2026 for a late payment remedy: فائدة and فوائد, interest, appear zero times in the 117 pages of the law and its regulations. What exists instead is the claims route under Article 68 of the Law: the contractor files within 60 days of the event, the consultant reports within 21 days of a COMPLETE claim, the agency studies within 45, the committee under Article 86 decides within 45 of a complete claim, compensation is capped at 20% of the contract value and anything beyond that goes to the Administrative Court. So the contractor must initiate, evidence and win, where FIDIC 14.8 accrues charges automatically and without notice. Article 108, immediately before the payment chain, is the offset and was read in the Arabic on 7 September 2026: يجوز, may, not shall, the government authority MAY disburse an advance payment not exceeding 10% of the total contract value, against a bank guarantee equal to it, recovered from the contractor’s dues in instalments at a percentage equal to the advance percentage, from the value of each certificate, starting with the first. So the advance is discretionary, capped, costs a guarantee fee, and amortises to zero across the contract rather than standing as a buffer.
  • Government Tenders and Procurement Law, new law published in Umm Al-Qura 22/3/1448 (4 September 2026), Arabicgazetted 4 September 2026; in force 120 days after publication; read 2026-09-05.Free in full, 101 articles, in the Official Gazette. Article 100 replaces Royal Decree M/128 (1440); Article 101 brings it into force 120 days after publication; Article 99 requires new Executive Regulations within the same period. Article 2 names life cycle cost, execution quality, operational efficiency and risk management among the law’s objectives. Article 59, read on 25 September 2026, keeps the final guarantee at 5% of the contract value, lodged within 15 working days of notice of the award and held until the contractor has performed its obligations and the project is finally received. Read on 5 September 2026.
ShareLinkedInX

Related reading

An extension of time is tested against records made during the delay

A claim for more time turns on three separate questions. Was the contract's notice procedure satisfied? Is the event one for which the contract allows an extension, or whose risk it otherwise places on the employer? Did it actually delay completion? Money is a separate claim, with its own proof of causation and amount. Each question is later tested against what was written down while the event was happening, by whichever party has to prove the point. Records do not create entitlement, a record of an event does not prove that it delayed completion, and the prevention principle does not rescue a claim under every contract or every governing law.

Read

Every award rule makes you publish the weighting. None makes you defend it.

The WTO agreement, the UNCITRAL Model Law and the EU directive all require the relative importance of the evaluation criteria to appear in the tender documents. None says what the weighting should be, and the Model Law's own commentary calls it discretionary. All three specify the arithmetic completely in exactly one situation, an electronic auction, where a machine does the ranking. Meanwhile a 70/30 split under the World Bank's own price formula prices one technical point at 3.4% of the contract and puts a 30 point quality lead beyond the reach of any price at all.

Read

Private projects overrun too. The difference is who counts.

Government projects are said to run late and over budget while private ones finish. The first study to test ownership statistically found privately owned bridges and tunnels escalated more than publicly owned ones, and its authors called the conventional view an oversimplification. What differs is not the outcome. It is who is counted, and what a private owner has that a public one does not, which is structure rather than virtue.

Read