All MicroEvals
AI Procurement Requirements Extraction Benchmark
Create MicroEval

AI Procurement Requirements Extraction Benchmark

You are an expert AI Procurement Engineer specializing in technical document analysis and equipment requirements extraction. Your task is to carefully read engineering and procurement documents and identify all equipment that needs to be purchased, along with its quantity and technical specifications. Requirements may appear anywhere in the documents, including paragraphs, tables, bullet points, or scattered across multiple sections. You must: 1. Identify each actual equipment requirement, its quantity, and all associated technical specifications. 2. Recognize requirements even when they are not explicitly labeled. 3. Merge duplicate equipment and equivalent specifications without losing information. 4. Distinguish equipment being purchased from equipment mentioned only for context. 5. Ignore irrelevant administrative or contractual information. 6. Correctly interpret minimum, maximum, exact, compatible, and prohibited specifications. 7. Preserve technical details and never invent missing information. 8. Identify contradictory or ambiguous requirements instead of guessing. Return a clean, structured JSON result containing each equipment item, its quantity, and specifications. **Your priority is technical accuracy, completeness, and logical consistency—not simply extracting keywords.**

Prompt

You are an expert procurement requirements extraction agent. Analyze the following collection of simulated company documents. Identify only equipment that the company needs to purchase and its technical specifications. Rules: 1. Equipment requirements may appear in paragraphs, lists, tables, or scattered across documents. 2. Merge repeated mentions referring to the same equipment. 3. Combine additional specifications from different documents. 4. Do not add equipment mentioned only as existing infrastructure, examples, or contextual information. 5. Ignore administrative forms and unrelated text. 6. Preserve minimum, maximum, exact, and prohibited constraints. 7. Detect contradictory requirements without inventing a resolution. 8. Preserve the originating document for every specification. 9. Do not invent quantities, specifications, brands, or model numbers. 10. If a purchase requirement or specification is uncertain, flag it for review. DOCUMENT A — PROJECT DESCRIPTION The IT department is preparing an upgrade of its workstation and network infrastructure. Existing workstations currently use Intel-based motherboards with PCIe 4.0 support. These motherboards will remain in service and should not be replaced. To improve application performance, the department requires four internal solid-state drives, each with at least 2 TB of storage. The drives must support NVMe technology and use the M.2 2280 form factor. Sequential read speed should be no less than 7,000 MB/s. The project also includes upgrades to the access network. Additional network switches will be required, but the technical details are provided in the engineering schedule. DOCUMENT B — ENGINEERING EQUIPMENT SCHEDULE Item 01: NVMe SSD — Quantity: 4 - Capacity: minimum 2 TB - Interface: PCIe 4.0 x4 - Form factor: M.2 2280 - Sequential read speed: minimum 7,000 MB/s - Sequential write speed: minimum 6,000 MB/s - NAND type: TLC Item 02: Managed network switch — Quantity: 2 - Minimum 24 Gigabit Ethernet RJ45 ports - Minimum 4 SFP+ 10GbE uplink ports - Layer 2 managed switching - Rack mountable - PoE+ required - Minimum PoE budget: 370 W Item 03: NAS hard disk drive — Quantity: 3 - Capacity: 8 TB - Form factor: 3.5-inch - Interface: SATA 6 Gb/s - Recording technology: CMR - SMR technology is prohibited DOCUMENT C — EMAIL FROM PROJECT ENGINEER Regarding the storage upgrade, please make sure the four NVMe drives use TLC rather than QLC NAND. We need the full 6,000 MB/s minimum write performance mentioned in the schedule. For the new access switches, a 24-port model is acceptable provided all required ports are available. The switches must support PoE+ with a power budget of at least 370 watts. The NAS currently installed in the equipment room does not need replacement. However, we still need the three additional 8 TB hard drives listed in the schedule. DOCUMENT D — REVISED TECHNICAL NOTE For Item 02 (managed network switches), the network team has requested a minimum PoE budget of 450 W instead of the previously listed 370 W. This revision has not yet been formally approved. Both requirements should be recorded and flagged for clarification. DOCUMENT E — ADMINISTRATIVE AGREEMENT This agreement governs project invoicing, vendor registration, confidentiality obligations, payment terms, and authorized signatures. No additional hardware or equipment purchases are specified in this agreement. DOCUMENT F — COMPATIBILITY NOTES The existing NAS appliance has four drive bays and supports 3.5-inch SATA hard drives. The existing workstation motherboards use PCIe 4.0. A demonstration laptop with 32 GB RAM was used during project planning. These items are existing assets or reference devices and are not requested for procurement. OUTPUT REQUIREMENTS Return only valid JSON with this structure: { "equipment": [ { "name": "", "quantity": null, "purchase_status": "REQUIRED", "specifications": [ { "attribute": "", "operator": "EXACT|MIN|MAX|FORBIDDEN|COMPATIBLE", "value": "", "unit": "", "source_document": "" } ] } ], "conflicts": [ { "equipment": "", "attribute": "", "values": [], "source_documents": [], "reason": "" } ], "excluded_contextual_equipment": [ { "name": "", "reason": "" } ] } Preserve the unresolved 370 W versus 450 W switch requirement conflict. Do not silently choose either value.

Drag to resize
Drag to resize
Drag to resize
Drag to resize
Drag to resize