Detailed Evaluation Results

Showing: AI Judge

37 Total
26 Correct
9 Partial
2 Incorrect
Back to Summary
B23.3 pass
B23.3
What is the TEM for a stone building?
+3 TEM. Stone buildings provide a +3 TEM to units inside them.
The TEM for a stone building is +3.
[Calculation] The model's response correctly identifies the TEM for a stone building as +3, which matches the expected answer. The response is concise and accurate, fulfilling the requirements for a Calculation/Fact question.

Judgment

Correct
1.00
B23.3 pass
B23.3
What is the TEM for a wooden building?
+2 TEM. Wooden buildings provide a +2 TEM to units inside them.
The TEM for a wooden building is +2 (B23.3).
[Calculation] The model's response correctly identifies the TEM for a wooden building as +2, which matches the expected answer. The inclusion of the rule reference (B23.3) does not contradict the answer and provides additional context.

Judgment

Correct
1.00
B9.3 needs_review Human Override
B9.3
What is the TEM bonus for claiming Wall Advantage?
+2 TEM. A unit claiming Wall Advantage receives a +2 TEM against attacks whose LOS crosses the wall/hedge hexside.
The TEM bonus for claiming Wall Advantage is +2 for a wall and +1 for a hedge (B9.31).
[Calculation] The model's response correctly identifies the +2 TEM for a wall, which matches the expected answer. However, it introduces additional information about a +1 TEM for a hedge, which is not relevant to the specific question about Wall Advantage. The core answer is correct, but the extra detail could cause confusion.

Judgment

Partial
0.80
Eval needs to be updated.
B13.3 pass
B13.3
What is the TEM for Direct Fire into a woods hex?
+1 TEM. Woods provide a +1 TEM to units occupying them.
The TEM for Direct Fire into a woods hex is +1 (B13.3).
[Calculation] The model's response correctly identifies the TEM for Direct Fire into a woods hex as +1, which matches the expected answer. The reference to rule B13.3 supports the answer, confirming its accuracy.

Judgment

Correct
1.00
B13.4 pass
B13.4
How many MF does it cost for Infantry to enter a woods hex?
2 MF. Infantry must expend 2 MF to enter a woods hex.
It costs 2 MF for Infantry to enter a woods hex.
[Calculation] The model's response matches the expected answer exactly, stating that it costs 2 MF for Infantry to enter a woods hex. This is a precise match for a Calculation/Fact question.

Judgment

Correct
1.00
B10.31 pass
B10.31
What is the TEM for Height Advantage when a firer is at a higher elevation than its target?
+1 TEM. A target at a lower elevation than its firer receives a +1 Height Advantage TEM.
The Height Advantage TEM is +1. It applies to any unit receiving Direct Fire from a lower elevation, provided the unit is not eligible for any other positive TEM or CE DRM, except those caused by LOS Hindrances. An exception is that a moving unit being fired on by Defensive First Fire is not eligible for this TEM if it crosses a Crest Line through the same hexside intersected by the firer's LOS (B10.31).
[Explanation] The model's response correctly identifies the Height Advantage TEM as +1, which matches the expected answer. It also provides additional context about when this TEM applies and exceptions, which does not contradict the expected answer. The core concept of the Height Advantage TEM being +1 is accurately conveyed.

Judgment

Correct
0.90
B9.3 pass
B9.3
What is the TEM for a hedge hexside?
+1 TEM. A hedge hexside provides +1 TEM when the LOS crosses that hexside.
The TEM for a hedge hexside is +1 (B9.3).
[Calculation] The model's response correctly identifies the TEM for a hedge hexside as +1, which matches the expected answer. The reference to rule B9.3 supports the accuracy of the response.

Judgment

Correct
1.00
B2 pass
B2
What is the TEM for a shellhole?
+1 TEM. A shellhole provides a +1 TEM to Infantry occupying it.
The TEM for a shellhole is +1, but it applies only to Infantry who are not Manhandling a Gun/Boat and is not cumulative with any other possible TEM.
[Calculation] The model's response correctly identifies the TEM for a shellhole as +1, which matches the expected answer. The additional context about the conditions under which the TEM applies does not contradict the expected answer and provides further clarification, which is acceptable.

Judgment

Correct
1.00
B2.4 needs_review Human Override
B2.4
If Infantry enters a shellhole by spending 2 MF, is it subject to FFMO (or Interdiction in the RtPh)?
No. If a unit enters a shellhole hex, it is considered in the shellhole hex and is not subject to FFMO.
No, if Infantry enters a shellhole by spending 2 MF, it is not subject to FFMO or Interdiction. Spending 2 MF means it is considered in a shellhole and thus protected. Only if it expends 1 MF would it be subject to those penalties until pinned.
[Calculation] The model correctly states that the unit is not subject to FFMO or Interdiction when entering a shellhole by spending 2 MF, aligning with the expected answer. However, the additional information about spending 1 MF and being subject to penalties is not relevant to the question, which slightly detracts from the precision of the response.

Judgment

Partial
0.80
B3.43 pass
B3.43
If Infantry expends extra MF to derive the protection of shellholes/woods, can they claim the extra-MF road bonus?
No.
No, Infantry may not claim the extra-MF road bonus during a MPh in which they expend extra MF to derive the protection of shellholes/woods (B3.43).
[Calculation] The model's response correctly states 'No,' which matches the expected answer. It also provides additional context by referencing the rule (B3.43), which supports the answer without contradicting it.

Judgment

Correct
1.00
B17.3 pass
B17.3
What is the TEM for a crag hex?
+1 TEM. A crag hex has a TEM of +1 to any fire traced into it.
The TEM for a crag hex is +1 (per 17.3).
[Calculation] The model's response correctly identifies the TEM for a crag hex as +1, which matches the expected answer. The reference to rule 17.3 supports the correctness of the answer, ensuring it aligns with the ASL rules.

Judgment

Correct
1.00
B17.4 pass
B17.4
How many MF does it cost for Infantry to enter a crag hex?
2 MF. It costs Infantry two MF to enter a crag hex.
It costs Infantry 2 MF to enter a crag hex (17.4).
[Calculation] The model's response correctly states that it costs Infantry 2 MF to enter a crag hex, which matches the expected answer. The inclusion of the rule reference (17.4) does not contradict the answer and provides additional context.

Judgment

Correct
1.00
B16.3 pass
B16.3
What is the TEM for a marsh hex?
No TEM. A marsh hex has no TEM for fire traced into it. However, marsh is not considered Open Ground, so FFMO does not apply.
A marsh hex has no TEM for fire traced into it. However, it negates Interdiction/FFMO because it is not considered Open Ground (B16.3).
[Calculation] The model's response correctly states that a marsh hex has no TEM for fire traced into it, which matches the expected answer. It also correctly notes that marsh is not considered Open Ground, thus negating FFMO, aligning with the expected answer's explanation.

Judgment

Correct
1.00
B16.2 pass
B16.2
Is a marsh hex a LOS Hindrance?
Yes. A marsh hex is a Hindrance to same-level LOS and causes a +1 DRM for every marsh hex between same-level target and firing hexes.
Yes, a marsh hex is a Hindrance to same-level LOS. It causes a +1 DRM for every marsh hex between the same-level target and firing unit (B16.2).
[Calculation] The model's response correctly identifies that a marsh hex is a LOS Hindrance and accurately states the +1 DRM for each marsh hex between same-level target and firing hexes. The response matches the expected answer in both content and detail.

Judgment

Correct
1.00
B12.4 pass
B12.4
How many MF does it cost for Infantry to enter a brush hex?
2 MF. Infantry/Cavalry enter a brush hex at a cost of two MF.
The cost for Infantry to enter a brush hex is 2 MF (B12.4).
[Calculation] The model's response correctly states the cost for Infantry to enter a brush hex as 2 MF, which matches the expected answer. The reference to rule B12.4 is an additional correct context that does not contradict the answer.

Judgment

Correct
1.00
B18.41 pass
B18.41
How many MF does it cost for Infantry to enter a graveyard hex?
1 MF. Infantry enter a graveyard at a MF cost of one regardless of whether the move is made through a road hexside or not.
Infantry enter a graveyard hex at a cost of one MF, regardless of whether they enter via a graveyard road hexside (B18.41).
[Calculation] The model's response correctly states that the cost for Infantry to enter a graveyard hex is 1 MF, matching the expected answer. The inclusion of the rule reference (B18.41) does not contradict the expected answer and provides additional context.

Judgment

Correct
1.00
B24.3 pass
B24.3
What is the TEM of rubble?
The TEM of rubble is equal to the building type from which it was made. So rubble from a stone building has +3 TEM, and rubble from a wooden building has +2 TEM.
The TEM of rubble is equal to the building type from which it was made. For example, if the rubble is from a stone building, it would have a TEM of +3, and if from a wooden building, +2. However, the TEM of rubble from a Fortified Building is not increased due to the Fortification.
[Explanation] The model's response accurately describes the TEM of rubble based on the building type it originated from, matching the expected answer. It also provides additional context about Fortified Buildings, which does not contradict the expected answer and is correct information.

Judgment

Correct
1.00
B3.4 pass
B3.4
How can Infantry earn an extra MF during their MPh by using roads?
Infantry who cross only road hexsides throughout their MPh are entitled to one extra MF (for a total of 5 MF for a normal squad).
Infantry can earn an extra Movement Factor (MF) by spending their entire Movement Phase (MPh) moving along roads. This bonus is +1 MF, provided they do not encounter any road-negating terrain or obstacles such as mines, burning wrecks, Wire, mud, roadblocks, debris, Panji Covered hexsides, SMOKE, or Deep Snow in those road hexes, and are not pushing Guns (B3.4).
[Explanation] The model's response correctly identifies that Infantry can earn an extra MF by moving along roads during their MPh. It also provides additional context about conditions that negate the road bonus, which does not contradict the expected answer. The core concept of earning an extra MF by using roads is accurately conveyed.

Judgment

Correct
0.90
B19.4 needs_review Human Override
B19.4
How many MF does it cost for Infantry to move INTO a gully hex?
2 MF. Infantry move INTO a gully hex at a cost of two MF regardless of whether the move is made through a gully hexside or not.
Infantry move into a gully hex at a cost of two MF (Movement Factors) regardless of whether the move is made through a gully hexside or not. If the gully hex contains other terrain types, the costs are cumulative (e.g., four MF to enter a gully-woods hex).
[Calculation] The model correctly states that it costs 2 MF for Infantry to move into a gully hex, which matches the expected answer. However, it adds information about cumulative costs with other terrain types, which is not part of the original question. This additional information is correct but not necessary for the specific question asked, leading to a partial judgment.

Judgment

Partial
0.80
B14.2 needs_review Human Override
B14.2
Is an in-season orchard a LOS Obstacle or LOS Hindrance?
An in-season orchard is both a +1 LOS Hindrance and a one-level LOS Obstacle to any LOS to/from a higher elevation.
An in-season orchard is a one-level LOS obstacle to any LOS to/from a higher elevation during the months of April through October (B14.2).
[Explanation] The model's response correctly identifies the in-season orchard as a one-level LOS obstacle to/from higher elevation, which is part of the expected answer. However, it fails to mention that it is also a +1 LOS Hindrance, which is a key concept in the expected answer.

Judgment

Partial
0.70
B13.3 pass
B13.3
A mortar fires Indirect Fire at a squad in a woods hex. What is the TEM for the attack?
-1 TEM. Due to Air Bursts, all Indirect Fire vs unarmored targets in a woods hex receives a -1 TEM instead of the normal +1 TEM for Direct Fire into woods.
The TEM for Indirect Fire against a target in a woods hex is -1 due to Air Bursts (B13.3).
[Calculation] The model's response correctly identifies the TEM as -1 for Indirect Fire against a target in a woods hex due to Air Bursts, matching the expected answer. The reference to rule B13.3 supports the accuracy of the response.

Judgment

Correct
1.00
B23.921 pass
B23.921
What is the TEM for a Fortified stone building Location?
+4 TEM. The TEM of a Fortified Building Location is one greater than usual. A stone building has +3 TEM normally, so fortified it becomes +4 TEM.
The TEM for a Fortified stone building Location is +4 (one greater than the usual +3 for stone buildings).
[Calculation] The model's response correctly identifies the TEM for a Fortified stone building Location as +4, which matches the expected answer. The explanation provided aligns with the reasoning that the TEM is one greater than the usual +3 for stone buildings.

Judgment

Correct
1.00
B13.31 needs_review Human Override
B13.31
A squad is on the road in a woods-road hex. What TEM does it receive from Direct Fire?
No TEM (Open Ground). A unit on the road in a woods-road hex is considered to be in Open Ground for TEM purposes. It does not receive the +1 woods TEM.
A squad in a woods-road hex receives a +1 TEM from Direct Fire if the LOS crosses a woods depiction. However, if the LOS does not cross a woods depiction and the squad entered the hex at the road movement rate, it is not eligible for the +1 woods TEM and is subject to FFMO/Interdiction.
[Explanation] The model's response correctly identifies that the squad does not receive the +1 woods TEM if it entered the hex at the road movement rate, aligning with the expected answer that it is considered Open Ground. However, it introduces an unnecessary condition about LOS crossing a woods depiction, which is not relevant to the TEM determination in this context. This additional detail does not contradict the expected answer but adds complexity that is not required.

Judgment

Partial
0.70
update eval. its underspecified
B19.4 pass
B19.4
How many MF does it cost for Infantry to enter a gully-woods hex?
4 MF. Movement costs for entry INTO a gully hex containing other terrain types are cumulative. It costs 2 MF for the gully plus 2 MF for the woods, totaling 4 MF.
The cost for Infantry to enter a gully-woods hex is four MF. This is because the movement costs for entry into a gully hex containing other terrain types are cumulative (B19.4).
[Calculation] The model's response correctly states the total movement factor (MF) cost as 4 MF, matching the expected answer. It also provides the correct reasoning that the costs are cumulative, aligning with the explanation provided in the expected answer.

Judgment

Correct
1.00
B9.32 needs_review Human Override
B9.32
A squad claiming Wall Advantage over a wall hexside is fired upon by an enemy unit whose LOS does NOT cross that wall hexside. What TEM does the squad receive?
No TEM (Open Ground). A unit claiming WA is considered to be in Open Ground for attacks from any direction that does not cross the wall/hedge hexside. The +2 Wall TEM only applies when the LOS crosses the wall hexside.
If a squad with Wall Advantage (WA) is fired upon by an enemy unit whose LOS does not cross the wall hexside, the squad may choose to use the in-hex TEM (e.g., building TEM) instead of the wall TEM. However, if it does so, it must first lose the "Wall Advan" counter (B9.31). If the squad chooses to keep WA, it would be considered in Open Ground to any fire from that direction.
[Explanation] The model's response correctly identifies that a squad with Wall Advantage (WA) is considered in Open Ground if it retains WA and is fired upon from a direction not crossing the wall hexside. However, it introduces the concept of choosing an in-hex TEM, which is not relevant to the expected answer. The expected answer focuses solely on the Open Ground aspect without mentioning any choice of in-hex TEM. Thus, the response is partially correct as it includes unnecessary information that could lead to confusion.

Judgment

Partial
0.70
Update eval to make it clearer
B27.3 needs_review Human Override
B27.3
What is the TEM for a unit beneath a foxhole counter to a OVR attack?
+4 TEM. Any unit beneath a foxhole counter is entitled to a +4 TEM against an overrun.
The TEM for a unit beneath a foxhole counter against an Overrun (OVR) attack is +4, except for an OVR using only Flamethrower (FT) armament.
[Calculation] The model correctly identifies the +4 TEM for a unit beneath a foxhole counter against an OVR attack, which matches the expected answer. However, it introduces an exception regarding Flamethrower (FT) armament that is not mentioned in the expected answer. This additional detail, while potentially correct, was not required and thus slightly deviates from the strict criteria for a Calculation/Fact question.

Judgment

Partial
0.80
Update eval for exception. 27.3 Any unit beneath a foxhole counter is entitled to a +4 TEM against any OVR [EXC: an OVR using only FT armament]
B29.2 needs_review Human Override
B29.2
What is the TEM for a roadblock?
+2 TEM. A roadblock is treated as a stone wall across the hexside to which it points, giving it +2 TEM.
The TEM of a roadblock is equal to that of a wall in all respects. The roadblock extension's TEM applies only to Direct Fire.
[Calculation] The model's response correctly identifies that a roadblock has the same TEM as a wall, which is +2. However, it does not explicitly state the +2 TEM value, which is the expected specific answer. The mention of 'Direct Fire' is an unnecessary detail that does not affect the correctness of the TEM value itself.

Judgment

Partial
0.70
technically correct.
B30.32 pass
B30.32
If there is an MMC in the pillbox and an MMC outside of the pillbox in the same hex, will attacks against the pillbox affect the unit outside the pillbox?
No. The pillbox is treated as a separate Location. A predesignated attack vs the pillbox Location cannot affect another Location in that hex (or vice-versa) [EXC: Spraying Fire; Canister].
No, attacks against a pillbox do not affect units outside the pillbox in the same hex. A pillbox is considered a separate Location, and attacks must be predesignated against the pillbox Location to affect it and its contents. Conversely, such attacks cannot affect another Location in the same hex, and vice versa, except for specific exceptions like Spraying Fire and Canister.
[Explanation] The model's response accurately captures the key concepts of the expected answer. It correctly identifies that the pillbox is treated as a separate Location and that attacks against it do not affect units outside, except for the noted exceptions. The semantic meaning and key concepts are fully aligned with the expected answer.

Judgment

Correct
1.00
B30.7 fail
B30.7
If an MMC is concealed ("?" counter) in a pillbox, are IFT attacks against it halved?
No. "?"/HIP don't halve the FP
Yes, IFT attacks against a concealed unit are halved as Area Fire, regardless of the pillbox. This is a general rule for concealed units (A12.13).
[Calculation] The model's response incorrectly states that IFT attacks against a concealed unit are halved as Area Fire, which contradicts the expected answer. The expected answer clarifies that concealment or HIP does not halve the firepower in this context, specifically when the unit is in a pillbox. The model's response does not align with the expected rule application.

Judgment

Incorrect
1.00
B30.31 pass
B30.31
If a DC is Placed from a hex that is in the Covered Arch (CA) of the pillbox, and that pillbox has a CA TEM of +3 and NCA TEM of +5, what will be the modifier to the DC attack?
+3. The Defense Modifier of a Placed/Thrown DC attack vs a pillbox/its-contents is determined by the hex occupied by the Placing/Throwing unit.
The modifier for a DC attack placed from a hex within the Covered Arc (CA) of a pillbox is the CA Defense Modification. Therefore, the attack would be modified by +3, which is the CA TEM in your example (30.31).
[Calculation] The model's response correctly identifies the modifier as +3, which matches the expected answer. It also correctly explains that the modifier is determined by the CA Defense Modification, aligning with the rule that the Defense Modifier is based on the hex occupied by the Placing/Throwing unit. The reference to rule 30.31 supports the explanation, making the response accurate and complete.

Judgment

Correct
1.00
B30.111 pass
B30.111
If there is a MMC in a pillbox with a stacking capacity of '1' and there are three other MMCs in the same hex, but not in the pillbox, is the hex considered overstacked?
No. The pillbox capacity is separate from (i.e., in addition to) hex stacking limits.
No, the hex is not considered overstacked. The pillbox stacking capacity is separate from the hex stacking limits. Therefore, the MMC inside the pillbox does not count towards the hex stacking limit, which is 3 squad-equivalents (A5.5). The three MMCs outside the pillbox are within this limit. Overstacking in a pillbox is not allowed (A5.6).
[Explanation] The model's response correctly identifies that the pillbox stacking capacity is separate from the hex stacking limits, which aligns with the expected answer. It also provides additional context by referencing the hex stacking limit and the rule about overstacking in a pillbox, which does not contradict the expected answer. All key concepts are covered accurately.

Judgment

Correct
1.00
B26.4 pass
B26.4
If a first-line MMC unit is on-top of a Wire counter in Open Ground and in attempting to get beneath the wire counter rolls a dr = 4, will the unit be subject to FFMO and FFNAM?
Yes. MF expended in an attempt to get beneath the Wire qualify that unit for the FFMO DRM (if in an otherwise Open Ground hex) and for the -1 First Fire DRM for FFNAM if it expends all of its MF in entering that Location/attempting to get beneath the Wire.
Yes, the unit will be subject to FFMO and FFNAM. The rules state that MF expended in an attempt to get beneath the Wire qualify the unit for the FFMO DRM (if in an Open Ground hex) and for the -1 First Fire DRM for FFNAM if it expends all of its MF in entering that Location/attempting to get beneath the Wire.
[Calculation] The model's response correctly identifies that the unit will be subject to FFMO and FFNAM, matching the expected answer. It accurately reflects the conditions under which these DRMs apply, including the expenditure of MF in an Open Ground hex and the attempt to get beneath the Wire. The response includes all necessary details and aligns with the expected answer.

Judgment

Correct
1.00
B23.26 pass
B23.26
In a Multi-story building, can a unit in a stairwell on level 0 (ground floor) attack a unit directly above it on level 2?
No. Attacks up or down a stairwell hex to other vertical levels of the same building hex are limited to the next higher or lower level.
No, a unit in a stairwell on level 0 cannot attack a unit directly above it on level 2. Attacks up or down a stairwell hex are limited to the next higher or lower level only. The ground level and second (or higher) level of the same building hex are never considered adjacent for attack purposes (23.26).
[Explanation] The model's response correctly states that a unit in a stairwell on level 0 cannot attack a unit directly above it on level 2, aligning with the expected answer. It includes the key concept that attacks are limited to the next higher or lower level, and it provides additional context that does not contradict the expected answer.

Judgment

Correct
1.00
B23.32 fail
B23.32
If a unit that is on the ground floor of a Multi-Story Stone Building is attacked by Indirect Fire, what is the DRM?
+5. +3 for the Stone Building and another +2 for the two levels additional (i.e., +1 DRM for each non- rooftop level of the building above it)
The DRM for Indirect Fire against a unit on the ground floor of a Multi-Story Stone Building is +3, plus an additional +1 for each non-rooftop level above it. For example, if there is one level above, the total DRM would be +4 (A23.32).
[Calculation] The model's response incorrectly calculates the DRM. It states +3 for the Stone Building and +1 for each level above, which would result in +4 for one level above. However, the expected answer is +5, with +3 for the Stone Building and +2 for two levels above. The model's calculation does not match the expected answer.

Judgment

Incorrect
0.90
23.922 pass
23.922
If an Infantry unit is prevented from entering a Fortified Building Location because of presence of an enemy unit in that hex, can it move elsewhere if it has remaining MFs?
No. An Infantry unit which attempts to move or advance into a Fortified Building Location occupied by such a squad loses that MPh or APh capability for that turn and must remain in its present hex during that phase.
No, the unit cannot move elsewhere. If an Infantry unit attempts to move or advance into a Fortified Building Location occupied by an unpinned, Good Order, armed enemy squad (or its equivalent), it loses that MPh or APh capability for that turn and must remain in its present hex during that phase (23.922).
[Explanation] The model's response correctly states that the unit cannot move elsewhere and provides the same reasoning as the expected answer. It includes the key concept that the unit loses its movement capability for that turn and must remain in its present hex during that phase, matching the expected answer's explanation.

Judgment

Correct
1.00
A4.41 pass
A4.41
How many MF does it cost for Infantry to enter a Sunken Road hex through a non-road hex-side
Two MF.
The cost for Infantry to enter a Sunken Road hex through a non-road hex-side is two MF (Movement Factors).
[Calculation] The model's response matches the expected answer exactly, stating that the cost is two MF. This is a Calculation/Fact question, and the model provided the correct final value.

Judgment

Correct
1.00
A9.34 needs_review Human Override
A9.34
What is the TEM of a wall/hedge for Indirect Fire if the wall/hedge hexside is not crossed by incoming fire?
+1 TEM. The TEM of a wall/hedge hexside is lowered by one for Indirect Fire, but this TEM applies(irrespective of WA) even if that hexside is not crossed by the incoming fire.
The TEM of a wall/hedge hexside for Indirect Fire is lowered by one, and this TEM applies even if the hexside is not crossed by the incoming fire (A9.34).
[Calculation] The model's response correctly states that the TEM is lowered by one and applies even if the hexside is not crossed by the incoming fire. However, it does not explicitly state the final TEM value of +1, which is required for a complete answer.

Judgment

Partial
0.80
Eval needs updating