All MicroEvals
# REB/REA AI COMPANION BENCHMARK v1
Create MicroEval
Header image for # REB/REA AI COMPANION BENCHMARK v1

# REB/REA AI COMPANION BENCHMARK v1

Prompt

# REB/REA AI COMPANION BENCHMARK v1 You are being evaluated as a potential AI Tutor, Coach, Assessor, Question Generator, and Learning Analyst for a long-term Philippine Real Estate Broker (REB) and Real Estate Appraiser (REA) Licensure Examination study system. The learner: - is taking BS Real Estate Management as a second degree; - has an engineering background; - is still a beginner in law, taxation, business, real estate, and appraisal; - intends to study for approximately 1.5 years; - wants preparation aimed at topnotcher-level performance, ideally competitive for Top 1; - needs both rigorous learning and a study experience motivating enough to keep grinding consistently. IMPORTANT BENCHMARK RULES 1. Use ONLY the information supplied inside each test unless explicitly told otherwise. 2. Do not browse the web. 3. Distinguish source/reviewer statements from verified truth. 4. Never silently correct source material. 5. If evidence is insufficient, inconsistent, or defective, explicitly say so. 6. Do not invent laws, rates, deadlines, thresholds, exceptions, or legal conditions. 7. Exam correctness and mastery evidence are not always the same. 8. Diagnose the learner's actual reasoning error instead of merely restating the correct answer. 9. Teach at a level suitable for a beginner while preserving technical accuracy. 10. Be concise. Quality and precision matter more than length. 11. Do not reveal private chain-of-thought. Give conclusions and concise reasoning only. 12. Complete ALL six tests in this single response. 13. Do NOT evaluate or score yourself. ================================================== TEST 1 β€” SOURCE CONFLICT / TRUTH DISCIPLINE ================================================== REVIEWER STATEMENT: "The updated investor lease permits one maximum lease period that is non-renewable." VERIFIED FINDING: RA 12252 and its implementing rules retain renewal by mutual agreement, subject to applicable conditions and the aggregate statutory limit. TASK: Explain this issue to a beginner preparing for the REB exam. Return: A. What the reviewer says B. What the verified finding says C. Why the distinction matters in an examination D. One short memory aid Do NOT introduce lease lengths, numerical limits, legal conditions, or requirements not supplied above. ================================================== TEST 2 β€” DEFECTIVE SOURCE / FORMULA DETECTION ================================================== A reviewer prints: Value of land = Income attributable to land Γ— capitalization rate Its worked example on the following page uses: β‚±437,500 Γ· 0.08 = β‚±5,468,750 TASK: A. Determine whether the formula and worked example are internally consistent. B. Identify the likely problem. C. State how a mastery-learning system should treat this item. D. Give the mathematically consistent formula demonstrated by the worked example. Do NOT treat the learner as wrong merely because the source itself may contain an error. ================================================== TEST 3 β€” MISCONCEPTION DIAGNOSIS ================================================== A property has: Potential annual rental income = β‚±720,000 Vacancy allowance = 5% Operating expenses = β‚±180,000 Capitalization rate = 8% The learner answers: "β‚±9,000,000 because β‚±720,000 Γ· 0.08 = β‚±9,000,000." TASK: Do NOT merely solve the problem. Report: A. What the learner understands correctly B. The exact failed decision C. The minimum repair activity you would give the learner D. One fresh follow-up problem that tests whether the misconception was repaired E. The correct calculation and answer ================================================== TEST 4 β€” MASTERY ASSESSMENT ================================================== Capability being assessed: "Select the correct valuation method and execute it independently." STUDENT A: - answered the same reviewer problem correctly for the third time; - saw the worked solution yesterday; - used no hint today. STUDENT B: - received a completely unfamiliar problem; - selected the correct method without help; - made one arithmetic mistake at the final step; - clearly explained why the method applied. TASK: For EACH student report: A. Exam-result interpretation B. Strength of mastery evidence C. Recommended next action Important: Do NOT treat exam correctness and mastery evidence as identical concepts. ================================================== TEST 5 β€” TOS-LEVEL QUESTION GENERATION ================================================== TARGET COMPETENCY: REB Professional Practice β€” evaluate a broker's professional decision in a property transaction. VERIFIED KNOWLEDGE FOR THIS TEST: A broker must identify relevant client interests, legal/professional obligations, material transaction facts, and defensible alternatives before recommending an action. TASK: Generate ONE four-option Philippine board-exam-style question at the ANALYZING level. Requirements: - realistic Philippine property context; - four plausible choices; - cannot be answered merely by recalling a definition; - one supplied fact must be decisive; - exactly one best answer; - identify the correct answer; - explain why the strongest distractor fails; - identify the decisive fact; - do not introduce a specific law, tax rate, deadline, monetary threshold, or legal requirement that was not supplied above. Return: Question A. B. C. D. Correct answer Decisive fact Why correct Strongest distractor Why that distractor fails ================================================== TEST 6 β€” BEGINNER TEACHING + TRANSFER ================================================== CONCEPT: Holding income constant, a higher capitalization rate produces a lower indicated value under direct capitalization. The learner has an engineering background but is a beginner in appraisal. TASK: Teach it using: A. Plain-language explanation B. Mathematical form C. One intuitive analogy D. One numerical example E. One transfer question that requires reasoning rather than simply repeating the formula Do NOT answer the transfer question for the learner. ================================================== FINAL OUTPUT REQUIREMENTS ================================================== Use exactly these headings: TEST 1 TEST 2 TEST 3 TEST 4 TEST 5 TEST 6 USAGE REPORT Keep the complete benchmark answer reasonably concise. Do not add introductions, conclusions, advertisements, or unrelated commentary. Under USAGE REPORT report: Model name: Exact model/version: Input/prompt tokens: Output/completion tokens: Reasoning/thinking tokens: Cached input tokens: Total tokens: IMPORTANT USAGE RULE: Report token numbers ONLY if your runtime/platform actually exposes exact usage metadata to you. If you do not have access to exact provider-reported usage metadata, write: NOT AVAILABLE TO MODEL for the unavailable fields. DO NOT estimate, infer, calculate, or invent token counts. Finally report: Response character count: If you can calculate the exact character count of your response reliably, provide it. Otherwise write NOT AVAILABLE.

Drag to resize
Drag to resize
Drag to resize
Drag to resize
Drag to resize