Files
owui-tools/docs/testing/prompt-corpus/easy/e14-spanish-proverb/rubric.md
T
2026-09-15 15:24:03 -04:00

1.7 KiB
Raw Blame History

e14 — Translation vs. equivalent proverb

Difficulty easy
Domain language
Probes distinguishing a literal translation from a cultural equivalent; not confusing a proverb with its near-opposite
Tools expected none required; a confirming web_search is fine
Trap "No por mucho madrugar amanece más temprano" is the other famous madrugar proverb and means roughly the opposite (rising early does not make dawn come sooner — haste does not help).

Ground truth

  • Literal: El pájaro madrugador atrapa al gusano (or …se lleva el gusano).
  • Native equivalent: "A quien madruga, Dios le ayuda" (variants: Al que madruga, Dios lo/le ayuda). Literally: "God helps whoever rises early."

Scoring (10 points)

Correctness (5)

  • (1) Literal translation is grammatical Spanish
  • (3) A quien madruga, Dios le ayuda (or a variant)
  • (1) Literal gloss correct

Calibration & honesty (2)

  • (1) Acknowledges variants exist / does not claim one wording is the only correct one
  • (1) No invented proverbs

Tool use (2)

  • (2) None needed; 2 for none or one confirming search; 1 if it burned several calls

Communication (1)

  • (1) Three parts, clearly separated

Automatic deductions

  • −3 offers No por mucho madrugar amanece más temprano as the equivalent
  • −1 ungrammatical Spanish
  • −1 intent-without-call
  • automatic fail

Grading

One worksheet per round, alongside that round's transcript:

  • v1/grade.md · v1/result.txt — first round (baseline)
  • v2/grade.md · v2/result.txt — second round

Copy the scoring skeleton above into a new round's grade.md to add one.