Initial Commit
This commit is contained in:
@@ -0,0 +1,46 @@
|
||||
# e14 — Translation vs. equivalent proverb
|
||||
|
||||
| | |
|
||||
|---|---|
|
||||
| **Difficulty** | easy |
|
||||
| **Domain** | language |
|
||||
| **Probes** | distinguishing a literal translation from a cultural equivalent; not confusing a proverb with its near-opposite |
|
||||
| **Tools expected** | none required; a confirming `web_search` is fine |
|
||||
| **Trap** | "No por mucho madrugar amanece más temprano" is the *other* famous madrugar proverb and means roughly the opposite (rising early does not make dawn come sooner — haste does not help). |
|
||||
|
||||
## Ground truth
|
||||
|
||||
- Literal: *El pájaro madrugador atrapa al gusano* (or *…se lleva el gusano*).
|
||||
- Native equivalent: **"A quien madruga, Dios le ayuda"** (variants: *Al que madruga, Dios lo/le ayuda*). Literally: "God helps whoever rises early."
|
||||
|
||||
## Scoring (10 points)
|
||||
|
||||
### Correctness (5)
|
||||
- [ ] (1) Literal translation is grammatical Spanish
|
||||
- [ ] (3) *A quien madruga, Dios le ayuda* (or a variant)
|
||||
- [ ] (1) Literal gloss correct
|
||||
|
||||
### Calibration & honesty (2)
|
||||
- [ ] (1) Acknowledges variants exist / does not claim one wording is the only correct one
|
||||
- [ ] (1) No invented proverbs
|
||||
|
||||
### Tool use (2)
|
||||
- [ ] (2) None needed; 2 for none or one confirming search; 1 if it burned several calls
|
||||
|
||||
### Communication (1)
|
||||
- [ ] (1) Three parts, clearly separated
|
||||
|
||||
### Automatic deductions
|
||||
- −3 offers *No por mucho madrugar amanece más temprano* as the equivalent
|
||||
- −1 ungrammatical Spanish
|
||||
- −1 intent-without-call
|
||||
- automatic fail
|
||||
|
||||
## Grading
|
||||
|
||||
One worksheet per round, alongside that round's transcript:
|
||||
|
||||
- `v1/grade.md` · `v1/result.txt` — first round (baseline)
|
||||
- `v2/grade.md` · `v2/result.txt` — second round
|
||||
|
||||
Copy the scoring skeleton above into a new round's `grade.md` to add one.
|
||||
Reference in New Issue
Block a user