Index
2026-09-02 — Analysis · 데이터 검수

find / restore 데이터 인스펙터 — bcaf2815 (100편 · find 589행 · restore 322행)

scene-mem-benchmark v1 · 예시 7편 3캠 영상 + 이벤트 타임라인 + 질의별 정답·증거 프레임 · 유형/다양성 분포 · 100편 전수 정합성 검사 · 전체 911행 표

TL;DR

100
편 / 84 하우스
15.4h
총 길이 (중앙 8.9분)
589
find (target 294 / distractor 295)
322
restore (정답 433 · first 259 / previous 63)
297
질의 프레임에 정답 보임 (find 141 / restore 156)
79
지시어 모호 후보 (find 55 / restore 24)

1데이터 구조 한눈에

컨텍스트 (contexts/type1/<house>__<seed>/) — 무겁고 불변
  • videos/ exo_camera_1 · exo_camera_2 · wrist_camera (640×480 @25fps)
  • traj.h5 액션·proprio·카메라 파라미터·tracked_obj_pixels(T,K,3) = 추적 물체 K개의 캠별 가시 픽셀
  • subtasks.json 이벤트(L1, task_description·outcome·tags) + 세그먼트(L2 nav/manip/carry/gaze)
  • states/final.npz 종료 상태(평가 에피소드 시작점) · meta.json
질의 (eval/<family>/queries.jsonl) — 가볍고 규칙 바뀌면 재생성
  • 공통 봉투 11필드: schema_version·family·kind·query_id·context·context_frames·start_state·query·budget_steps·oracle·tags
  • find: kind(target/distractor)·template(Pick/NavToObj)·steps·name·n_candidates·twin_nearby·answers[]·candidates[]
  • restore: origin(first/previous)·steps·name·shares_answer_with·answers[].from(지금)/to(되돌릴 곳)·d_xy·n_hops·approach·r_place

한 편에 find ≈5.9행 + restore ≈3.2행이 붙고, restore 답은 항상 어떤 find 답과 같은 물체다(shares_answer_with 322/322). 판정: find = 물체 body id 집기/도달, restore = 정답 전부가 각자 원래 자리 반경 0.15 m 안(상태 목표, 자세 무채점).

실제 find 행 원문 (find:train_1299__2:q01 — 서랍에 넣은 리모컨, hidden/open_pick)
{
 "schema_version": "1.0",
 "family": "find",
 "kind": "find_target",
 "query_id": "find:train_1299__2:q01",
 "context": "contexts/type1/train_1299__2",
 "context_frames": [
  0,
  17837
 ],
 "start_state": "states/final.npz",
 "query": "Pick up the remote control I moved earlier",
 "budget_steps": 2500,
 "oracle": null,
 "tags": [],
 "steps": "single",
 "name": "remote control",
 "template": "Pick",
 "n_candidates": 1,
 "twin_nearby": false,
 "answers": [
  {
   "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_4",
   "xyz": [
    12.197,
    12.389,
    0.659
   ],
   "room": 4,
   "surface": null,
   "on_floor": false,
   "misplaced": "no",
   "settled_frame": 8257,
   "frames_since_settled": 9580,
   "s_since_settled": 383.2,
   "last_seen_frame": 7779,
   "s_since_last_seen": 402.3,
   "twins": [],
   "concealment": "hidden",
   "scoring": "open_pick",
   "d_base_end": 11.8,
   "reach_min": 0.62,
   "r_support": 0.82,
   "r_margin": 0.2,
   "r_case": "reach+0.20",
   "observed": true,
   "seen_s": 10.88,
   "opened_during": true,
   "seen_while_open": true,
   "closed_at_end": true,
   "pickable": true,
   "pick_fail": null
  }
 ],
 "candidates": [
  {
   "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_4",
   "fixture": "chestofdrawers_11a5283cbdd2aaa77d17322d7a00ec20_1_0_4",
   "joints": [
    {
     "name": "chestofdrawers_11a5283cbdd2aaa77d17322d7a00ec20_1_2_4_joint_0",
     "type": "slide",
     "range": [
      0.0,
      0.338
     ],
     "limited": true
    },
    {
     "name": "chestofdrawers_11a5283cbdd2aaa77d17322d7a00ec20_1_4_4_DrawerMesh011_1",
     "type": "slide",
     "range": [
      0.0,
      0.338
     ],
     "limited": true
    },
    {
     "name": "chestofdrawers_11a5283cbdd2aaa77d17322d7a00ec20_1_6_4_DrawerMesh091_2",
     "type": "slide",
     "range": [
      0.0,
      0.338006
     ],
     "limited": true
    },
    {
     "name": "chestofdrawers_11a5283cbdd2aaa77d17322d7a00ec20_1_8_4_DrawerMesh061_3",
     "type": "slide",
     "range": [
      0.0,
      0.338
     ],
     "limited": true
    },
    {
     "name": "chestofdrawers_11a5283cbdd2aaa77d17322d7a00ec20_1_10_4_DrawerMesh021_4",
     "type": "slide",
     "range": [
      0.0,
      0.338
     ],
     "limited": true
    },
    {
     "name": "chestofdrawers_11a5283cbdd2aaa77d17322d7a00ec20_1_12_4_DrawerMesh101_5",
     "type": "slide",
     "range": [
      0.0,
      0.338
     ],
     "limited": true
    },
    {
     "name": "chestofdrawers_11a5283cbdd2aaa77d17322d7a00ec20_1_14_4_DrawerMesh071_6",
     "type": "slide",
     "range": [
      0.0,
      0.338
     ],
     "limited": true
    },
    {
     "name": "chestofdrawers_11a5283cbdd2aaa77d17322d7a00ec20_1_16_4_DrawerMesh031_7",
     "type": "slide",
     "range": [
      0.0,
      0.338
     ],
     "limited": true
    },
    {
     "name": "chestofdrawers_11a5283cbdd2aaa77d17322d7a00ec20_1_18_4_DrawerMesh111_8",
     "type": "slide",
     "range": [
      0.0,
      0.338
     ],
     "limited": true
    },
    {
     "name": "chestofdrawers_11a5283cbdd2aaa77d17322d7a00ec20_1_20_4_DrawerMesh081_9",
     "type": "slide",
     "range": [
      0.0,
      0.346
     ],
     "limited": true
    },
    {
     "name": "chestofdrawers_11a5283cbdd2aaa77d17322d7a00ec20_1_22_4_DrawerMesh041_10",
     "type": "slide",
     "range": [
      0.0,
      0.346
     ],
     "limited": true
    },
    {
     "name": "chestofdrawers_11a5283cbdd2aaa77d17322d7a00ec20_1_24_4_DrawerMesh121_11",
     "type": "slide",
     "range": [
      0.0,
      0.346
     ],
     "limited": true
    }
   ],
   "evidence": {
    "event": 2,
    "attempt": 0,
    "frames": [
     4011,
     8232
    ],
    "outcome": "ok",
    "seen_s": 10.88
   }
  }
 ]
}
실제 restore 행 원문 (restore:train_1299__2:q00 — 같은 리모컨을 원래 스탠드로)
{
 "schema_version": "1.0",
 "family": "restore",
 "kind": "restore",
 "query_id": "restore:train_1299__2:q00",
 "context": "contexts/type1/train_1299__2",
 "context_frames": [
  0,
  17837
 ],
 "start_state": "states/final.npz",
 "query": "Pick up the remote control and place it in or on where it first was",
 "budget_steps": 5900,
 "oracle": null,
 "tags": [
  "store_in"
 ],
 "steps": "single",
 "origin": "first",
 "name": "remote control",
 "template": "PickAndPlace(restore)",
 "n_candidates": 1,
 "twin_nearby": false,
 "shares_answer_with": [
  "find:train_1299__2:q01"
 ],
 "answers": [
  {
   "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_4",
   "from": {
    "xyz": [
     12.197,
     12.389,
     0.659
    ],
    "room": 4,
    "surface": null,
    "on_floor": false,
    "concealment": "hidden",
    "pickable": true,
    "pick_fail": null,
    "r_support": 0.82,
    "reach_min": 0.62,
    "r_margin": 0.2,
    "r_case": "reach+0.20",
    "d_base_end": 11.8,
    "settled_frame": 8257,
    "last_seen_frame": 7779,
    "s_since_settled": 383.2,
    "s_since_last_seen": 402.3,
    "fixture": "chestofdrawers_11a5283cbdd2aaa77d17322d7a00ec20_1_0_4",
    "joints": null
   },
   "to": {
    "xyz": [
     14.679,
     9.456,
     0.845
    ],
    "quat": [
     -0.0,
     -0.0,
     0.7071,
     0.7071
    ],
    "room": 4,
    "surface": "stand_6e40a42bfc4e336b800e55293d64f949_1_0_4",
    "on_floor": false,
    "concealment": "open",
    "fixture": null,
    "joints": null,
    "placeable": true,
    "place_fail": null,
    "r_support": 0.86,
    "reach_min": 0.66,
    "d_base_end": 14.834,
    "d_nearest_obj": 0.033,
    "d_nearest_then": 0.033,
    "origin_clear": true,
    "occupied_since": false,
    "seen_s_at_origin": 4.6,
    "origin_frames": [
     0,
     6721
    ]
   },
   "d_xy": 3.842,
   "same_room": true,
   "n_hops": 1,
   "other_origins": [],
   "twins": [],
   "r_place": 0.15,
   "check_quat": false,
   "approach": "navigate",
   "misplaced": "no",
   "tags": [
    "store_in"
   ]
  }
 ]
}

2어떤 유형이 있고 얼마나 다양한가

2-1. 질의 문장 형태 (실제 wording — 전수)

find (9형)
행수kindsteps질의 문장 형태
269find_distractorsinglePick up the {name}
216find_targetsinglePick up the {name} I moved earlier
44find_targetsingleNavigate to the {name} I moved earlier
33find_targetmultiPick up all the {name}s I moved earlier
15find_distractormultiPick up all the {name}s
6find_distractorsingleNavigate to the {name}
3find_distractormultiPick up all the {name}es
2find_distractormultiPick up all the butter knives
1find_targetmultiPick up all the {name}es I moved earlier
restore (7형)
행수originsteps질의 문장 형태
180restoresinglePick up the {name} and place it in or on where it first was
63restoresinglePick up the {name} and place it in or on where it was just before
42restoremultiPick up the {name} and place it in or on where it first was, then pick up the {name} and place it in or on where it first was
20restoremultiPick up the {name} and place it in or on where it first was, then pick up the {name} and place it in or on where it first was, and then pick up the {name} and place it in or on where it first was
10restoremultiPick up the {name}s and place them in or on where they first were, then pick up the {name} and place it in or on where it first was
5restoremultiPick up the {name}s and place them in or on where they first were
2restoremultiPick up the {name} and place it in or on where it first was, then pick up the {name}s and place them in or on where they first were
wording이 kind를 드러낸다: target은 항상 "…I moved earlier", distractor는 수식어 없음. 문장만 보고 "로봇이 옮겼는가"를 알 수 있어 distractor 행은 초기 장면 기억만 묻는 셈(260813 파일럿에서 blind distractor > chance로 확인된 상식 누출과 같은 결). 설계상 의도(채점 방식과 일치)지만 분석 시 kind별 분리 필수.

2-2. find 축

kind
find_distractor
295 (50%)
find_target
294 (50%)
template
Pick
539 (92%)
NavToObj
50 (8%)
steps (행)
single
535 (91%)
multi
54 (9%)
answers.scoring (답 645)
pick
542 (84%)
navigate_only
56 (9%)
open_pick
47 (7%)
answers.concealment
open
582 (90%)
hidden
63 (10%)
answers.misplaced
no
589 (91%)
wrong_surface
30 (5%)
on_floor
16 (2%)
not_moved
10 (2%)
twin_nearby (행)
False
495 (84%)
True
94 (16%)
hidden 답의 fixture 종류 (63)
chestofdrawers
35 (56%)
desk
12 (19%)
stand
11 (17%)
shelf
4 (6%)
none
1 (2%)
navigate_only 사유 (pick_fail)
ik/reach+관절한계+자세충돌
30 (56%)
ik/reach
20 (37%)
ik/reach+자세충돌
4 (7%)

2-3. restore 축

origin (행)
first
259 (80%)
previous
63 (20%)
n_candidates (행)
1
243 (75%)
2
47 (15%)
3
32 (10%)
answers.approach (답 433)
navigate
283 (65%)
in_reach
150 (35%)
answers.same_room
False
284 (66%)
True
149 (34%)
answers.n_hops (= 물체 이동 횟수, §4 참조)
1
265 (61%)
2
168 (39%)
from.concealment (지금 자리)
open
377 (87%)
hidden
56 (13%)
tags (행)
relocate
168 (30%)
twin_merge
164 (29%)
shift
104 (19%)
(none)
59 (11%)
store_in
56 (10%)
decoy
8 (1%)
answers.misplaced
no
417 (96%)
wrong_surface
9 (2%)
not_moved
7 (2%)
d_xy 변위 (답)
0-2m
30 (7%)
2-4m
107 (25%)
4-6m
96 (22%)
6-8m
94 (22%)
8-10m
57 (13%)
10-12m
27 (6%)
12-14m
17 (4%)
14-16m
3 (1%)
16-18m
2 (0%)
other_origins 개수 (답)
0
265 (61%)
1
133 (31%)
2
35 (8%)

2-4. 장면·이벤트 다양성 (100편, 이벤트 451)

편 길이 (분)
8-10
39 (39%)
10-12
32 (32%)
6-8
24 (24%)
12-14
3 (3%)
16-18
1 (1%)
4-6
1 (1%)
편당 이벤트 수
5
59 (59%)
4
40 (40%)
6
1 (1%)
편당 실패 이벤트
1
73 (73%)
0
25 (25%)
2
2 (2%)
편당 방 수(이름 유도된)
4
54 (54%)
3
41 (41%)
2
4 (4%)
1
1 (1%)
이벤트 outcome
ok
384 (85%)
failed
31 (7%)
failed_no_place
17 (4%)
failed_dropped
16 (4%)
failed_not_seen
3 (1%)
이벤트 tags
(none)
190 (33%)
relocate
100 (18%)
shift
99 (17%)
twin_merge
92 (16%)
store_in
80 (14%)
decoy
8 (1%)
방 (이벤트 slots)
kitchen
286 (32%)
bedroom
261 (29%)
living room
253 (28%)
bathroom
102 (11%)
표면/가구 (이벤트 slots)
dining table
232 (26%)
countertop
155 (17%)
dresser
58 (6%)
tv stand
53 (6%)
chair
51 (6%)
sofa
50 (6%)
drawer of the dresser
47 (5%)
toilet
45 (5%)
side table
43 (5%)
sink
33 (4%)
armchair
31 (3%)
bed
26 (3%)
desk
15 (2%)
drawer of the desk
11 (1%)
…외 8종
52
옮긴 물체 종류 (이벤트)
remote control
130 (29%)
mug
56 (12%)
cell phone
38 (8%)
key chain
34 (8%)
spatula
22 (5%)
irish potato
21 (5%)
bowl
18 (4%)
pen
18 (4%)
butter knife
17 (4%)
spoon
14 (3%)
tissue box
14 (3%)
candle
9 (2%)
salt shaker
9 (2%)
vase
8 (2%)
…외 12종
43
find 질의 물체 이름
remote control
73 (12%)
bowl
46 (8%)
mug
42 (7%)
cell phone
39 (7%)
potato
29 (5%)
key chain
26 (4%)
butter knife
24 (4%)
spatula
22 (4%)
pen
21 (4%)
watch
19 (3%)
salt shaker
18 (3%)
vase
17 (3%)
pepper shaker
16 (3%)
spoon
16 (3%)
…외 26종
181
restore 질의 물체 이름
remote control
119 (29%)
mug
47 (11%)
cell phone
38 (9%)
key chain
32 (8%)
spatula
19 (5%)
pen
18 (4%)
potato
18 (4%)
salt shaker
16 (4%)
butter knife
15 (4%)
tissue box
14 (3%)
bowl
13 (3%)
spoon
13 (3%)
candle
10 (2%)
vase
8 (2%)
…외 9종
36
세그먼트 종류 (L2)
manip
915 (51%)
nav
477 (26%)
carry
375 (21%)
gaze
38 (2%)
읽기: 이벤트 종류는 pick_and_place 하나뿐이고 변형은 tags로만 구분된다(relocate=다른 방으로, shift=같은 방 안, store_in=서랍/캐비닛에 넣기, twin_merge=같은 종류 물체 옆에 놓기, decoy=비운 자리에 같은 종류 물체 갖다 놓기 8건). 물체는 리모컨 편중(이벤트 29%, find 12%, restore 37%), 방은 4종 고정(AI2-THOR 계열). 편당 실패 이벤트 ≤1 게이트 때문에 misplaced 축(on_floor 16·wrong_surface 30)은 얇다.

3예시 7편 — 영상 · 이벤트 · 질의별 정답과 증거 프레임

영상은 exo_camera_1 | exo_camera_2 | wrist_camera 3캠을 나란히 붙인 10 fps 압축본(원본 25 fps 640×480). 키프레임을 클릭하면 영상이 그 시점으로 이동합니다. 증거 프레임은 traj.h5의 tracked_obj_pixels로 해당 물체가 가장 크게 보이는 프레임·카메라를 자동 선택(exo 우선, 50 px 미만이면 wrist). 방 이름은 채점기와 같은 room_name_map(이벤트 slots 조인)으로 유도.

train_1299__2 train_7845__2 train_9026__1 train_3060__2 train_2894__0 train_7428__2 train_3994__0

3-1. train_1299__2 — train_1299 seed 2 · 11.89 분 · 방 bathroom, bedroom, kitchen, living room · 이벤트 5 (성공 4) · 추적 물체 24 · find 6 / restore 3

선정 이유: 카나리아 편(팀 공통 참조). 첫 이벤트 실패(컵 바닥 낙하 → find on_floor·navigate_only), 리모컨 서랍 보관(store_in → hidden), 감자 2회 이동
exo_camera_1 · exo_camera_2 · wrist_camera (10 fps)

이벤트 타임라인 (subtasks.json)

#시간이벤트 (task_description) · 물체 · tagsoutcome키프레임
#00:00–0:56Pick up the cup from the dining table in the kitchen and place it in or on the chair
cup_846a15223bb43478575a27d2329db25d_1_0_6 · 이동 0.989 m shift
⚠️ 놓기 세그먼트가 없다 — 문장의 뒷절이 실제로 일어나지 않았다 / 집어서 옮겼지만 **바닥에 떨어졌다** — 실제 끝 위치는 settled_xyz
failed_dropped
집기
exo1 · t=0:21 (f534) · 565px
종료 시점
exo1 · t=0:59 (f1479) · 628px
#10:56–2:40Pick up the potato from the dining table in the kitchen and place it in or on the dresser in the living room
Irishpotato_27f41066f714b93c23f7a8f42a932407_2_0_6 · 이동 9.431 m 		ok
집기
exo1 · t=1:22 (f2059) · 902px
놓기/정착
exo1 · t=2:42 (f4059) · 2468px
#22:40–5:29Pick up the remote control from the side table in the bedroom and put it in the drawer of the dresser
remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_4 · 이동 3.848 m store_in obj_unresolved		ok
집기
exo1 · t=4:23 (f6584) · 531px
놓기/정착
exo1 · t=5:27 (f8184) · 0px
#35:29–8:16Pick up the potato from the dresser in the living room and place it in or on the countertop in the kitchen
Irishpotato_27f41066f714b93c23f7a8f42a932407_2_0_6 · 이동 12.226 m relocate twin_merge		ok
집기
exo1 · t=6:30 (f9759) · 888px
놓기/정착
exo1 · t=8:18 (f12454) · 1836px
#48:16–11:52Pick up the pen from the dining table in the living room and place it in or on the toilet in the bathroom
pen_4d17f13875116fae2c6b573c6744bf41_1_0_7 · 이동 16.705 m 		ok
집기
exo1 · t=9:10 (f13774) · 138px
놓기/정착
exo1 · t=11:52 (f17804) · 99px

find 질의 6행

find:train_1299__2:q00 target NavToObj single navigate_only on_floor
“Navigate to the cup I moved earlier”
정답 (body id 채점)
  • cup — — / 바닥 · xyz [5.654, 6.088, 0.049] · 마지막 관측 74.5 s 전 · 누적 관측 21.36 s cup_846a15223bb43478575a27d2329db25d_1_0_6 · 근거 이벤트 #0 (failed_dropped)
정답 위치 확정 직후 (cup)
exo1 · t=0:59 (f1479) · 628px
마지막 관측 (cup)
exo2 · t=10:37 (f15939) · 716px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=11:53 (f17835) · 0px
find:train_1299__2:q01 target Pick single open_pick hidden
“Pick up the remote control I moved earlier”
정답 (body id 채점)
  • remote control — bedroom / dresser 안(닫힘) · xyz [12.197, 12.389, 0.659] · 마지막 관측 402.3 s 전 · 누적 관측 10.88 s remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_4 · 근거 이벤트 #2 (ok)
정답 위치 확정 직후 (remote control)
exo1 · t=5:30 (f8259) · 0px
마지막 관측 (remote control)
exo2 · t=5:10 (f7774) · 471px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=11:53 (f17835) · 0px
find:train_1299__2:q02 target Pick single pick 마지막 이벤트 물체 ⚠ find_answer_seen_last5s ⚠ find_answer_visible_in_query_frame
“Pick up the pen I moved earlier”
정답 (body id 채점)
  • pen — bathroom / toilet · xyz [0.269, 14.256, 0.56] · 마지막 관측 0.1 s 전 · 누적 관측 34.4 s pen_4d17f13875116fae2c6b573c6744bf41_1_0_7 · 근거 이벤트 #4 (ok)
마지막 관측 (pen)
exo1 · t=11:52 (f17804) · 99px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=11:53 (f17835) · 98px
find:train_1299__2:q03 distractor Pick single pick
“Pick up the ladle”
정답 (body id 채점)
  • ladle — kitchen / dining table · xyz [3.973, 5.881, 0.79] · 마지막 관측 73.1 s 전 · 누적 관측 18.36 s ladle_9c306e3043202395854ae4a3cba13e79_1_0_6
마지막 관측 (ladle)
exo1 · t=10:38 (f15974) · 230px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=11:53 (f17835) · 0px
find:train_1299__2:q04 distractor Pick single pick
“Pick up the pencil”
정답 (body id 채점)
  • pencil — kitchen / dining table · xyz [4.64, 6.123, 0.785] · 마지막 관측 73.5 s 전 · 누적 관측 11.28 s pencil_bc899382af3e1ceff65bab5aa369d0b0_1_0_6
마지막 관측 (pencil)
exo1 · t=10:38 (f15964) · 88px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=11:53 (f17835) · 0px
find:train_1299__2:q05 distractor NavToObj single navigate_only
“Navigate to the vase”
정답 (body id 채점)
  • vase — living room / dresser · xyz [12.806, 8.291, 0.094] · 마지막 관측 98.5 s 전 · 누적 관측 20.32 s vase_b264007d115778c4f9c1d16f5c2fb6cb_1_0_7
마지막 관측 (vase)
exo1 · t=10:14 (f15359) · 397px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=11:53 (f17835) · 0px

restore 질의 3행

restore:train_1299__2:q00 restore origin=first single navigate same_room hops=1 from hidden store_in ⚠ restore_neighbor_inside_r_place
“Pick up the remote control and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_1299__2:q01
  • remote control: 지금 bedroom / dresser 안(닫힘) [12.197, 12.389, 0.659] → 되돌릴 곳 bedroom / tv stand [14.679, 9.456, 0.845] · 변위 3.842 m · 원래 자리 관측 4.6 s · 이웃 물체 0.033 m (< r_place 0.15) remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_4
원래 자리 증거 (remote control @ tv stand)
exo1 · t=4:16 (f6409) · 1045px
지금 자리 확정 직후 (remote control @ dresser 안(닫힘))
exo1 · t=5:30 (f8259) · 0px
질의 시점(최종 프레임)
exo1 · t=11:53 (f17835) · 0px
restore:train_1299__2:q01 restore origin=first single in_reach cross_room hops=1 마지막 이벤트 물체 ⚠ restore_from_seen_last5s ⚠ restore_from_visible_in_query_frame
“Pick up the pen and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_1299__2:q02
  • pen: 지금 bathroom / toilet [0.269, 14.256, 0.56] → 되돌릴 곳 living room / dining table [10.794, 1.285, 0.786] · 변위 16.704 m · 원래 자리 관측 3.76 s · 이웃 0.224 m pen_4d17f13875116fae2c6b573c6744bf41_1_0_7
원래 자리 증거 (pen @ dining table)
exo1 · t=9:04 (f13619) · 205px
질의 시점(최종 프레임)
exo1 · t=11:53 (f17835) · 98px
restore:train_1299__2:q02 restore origin=first multi navigate same_room hops=1 from hidden in_reach cross_room hops=1 store_in 마지막 이벤트 물체 ⚠ restore_from_seen_last5s ⚠ restore_from_visible_in_query_frame ⚠ restore_neighbor_inside_r_place
“Pick up the remote control and place it in or on where it first was, then pick up the pen and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_1299__2:q01, find:train_1299__2:q02, restore:train_1299__2:q00, restore:train_1299__2:q01
  • remote control: 지금 bedroom / dresser 안(닫힘) [12.197, 12.389, 0.659] → 되돌릴 곳 bedroom / tv stand [14.679, 9.456, 0.845] · 변위 3.842 m · 원래 자리 관측 4.6 s · 이웃 물체 0.033 m (< r_place 0.15) remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_4
  • pen: 지금 bathroom / toilet [0.269, 14.256, 0.56] → 되돌릴 곳 living room / dining table [10.794, 1.285, 0.786] · 변위 16.704 m · 원래 자리 관측 3.76 s · 이웃 0.224 m pen_4d17f13875116fae2c6b573c6744bf41_1_0_7
원래 자리 증거 (remote control @ tv stand)
exo1 · t=4:16 (f6409) · 1045px
지금 자리 확정 직후 (remote control @ dresser 안(닫힘))
exo1 · t=5:30 (f8259) · 0px
원래 자리 증거 (pen @ dining table)
exo1 · t=9:04 (f13619) · 205px
질의 시점(최종 프레임)
exo1 · t=11:53 (f17835) · 0px

3-2. train_7845__2 — train_7845 seed 2 · 8.4 분 · 방 bedroom, kitchen, living room · 이벤트 5 (성공 4) · 추적 물체 22 · find 6 / restore 4

선정 이유: 축 커버 최다: previous·multi·hidden·navigate_only·on_floor·twin, restore 2-hop·in_reach
exo_camera_1 · exo_camera_2 · wrist_camera (10 fps)

이벤트 타임라인 (subtasks.json)

#시간이벤트 (task_description) · 물체 · tagsoutcome키프레임
#00:00–1:40Pick up the remote control from the dining table in the living room and place it in or on the dining table in the kitchen
remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7 · 이동 5.369 m 		ok
집기
exo1 · t=0:17 (f434) · 526px
놓기/정착
exo1 · t=1:42 (f2559) · 2784px
#11:40–4:35Pick up the knife from the countertop in the kitchen and put it in the drawer of the dresser in the bedroom
knife_7db4ef03593a98cc5b883c623dde8d9f_1_0_6 · 이동 12.094 m store_in obj_unresolved		ok
집기
exo1 · t=3:15 (f4879) · 433px
놓기/정착
exo1 · t=4:33 (f6839) · 0px
#24:35–5:21Pick up the remote control from the tv stand in the bedroom and place it in or on the sink in the bathroom
remotecontrol_488ea7924f7cb4d329c991926df62222_1_0_4 · 이동 1.244 m
⚠️ 놓기 세그먼트가 없다 — 문장의 뒷절이 실제로 일어나지 않았다
failed_no_place
집기
exo1 · t=4:52 (f7319) · 375px
종료 시점
exo1 · t=5:45 (f8639) · 1140px
#35:21–6:55Pick up the apple from the dining table in the kitchen and place it in or on the countertop
apple_87e4661e0aaedff69f751b5ac78bd93c_1_0_6 · 이동 3.494 m shift		ok
집기
exo1 · t=5:51 (f8789) · 454px
놓기/정착
exo1 · t=6:56 (f10424) · 1194px
#46:55–8:23Pick up the remote control from the dining table in the kitchen and place it in or on the sofa in the living room
remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7 · 이동 7.107 m relocate twin_merge		ok
집기
exo1 · t=7:08 (f10709) · 567px
놓기/정착
exo1 · t=8:21 (f12529) · 483px

find 질의 6행

find:train_7845__2:q00 target Pick multi pick navigate_only on_floor twin_nearby 마지막 이벤트 물체 ⚠ find_answer_seen_last5s ⚠ find_answer_visible_in_query_frame
“Pick up all the remote controls I moved earlier”
정답 (body id 채점)
  • remote control — living room / sofa · xyz [1.544, 13.046, 0.429] · 마지막 관측 0.1 s 전 · 누적 관측 43.88 s remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7 · 근거 이벤트 #4 (ok)
  • remote control — — / 바닥 · xyz [6.552, 9.121, -0.009] · 마지막 관측 47.1 s 전 · 누적 관측 13.48 s remotecontrol_488ea7924f7cb4d329c991926df62222_1_0_4 · 근거 이벤트 #2 (failed)
마지막 관측 (remote control)
exo1 · t=8:22 (f12554) · 480px
정답 위치 확정 직후 (remote control)
exo1 · t=5:47 (f8699) · 1139px
마지막 관측 (remote control)
exo2 · t=7:35 (f11399) · 466px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:23 (f12590) · 477px
find:train_7845__2:q01 target Pick single open_pick hidden
“Pick up the knife I moved earlier”
정답 (body id 채점)
  • knife — bedroom / dresser 안(닫힘) · xyz [3.502, 0.493, 0.292] · 마지막 관측 231.5 s 전 · 누적 관측 16.56 s knife_7db4ef03593a98cc5b883c623dde8d9f_1_0_6 · 근거 이벤트 #1 (ok)
정답 위치 확정 직후 (knife)
exo1 · t=4:36 (f6914) · 0px
마지막 관측 (knife)
exo2 · t=4:30 (f6754) · 316px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:23 (f12590) · 0px
find:train_7845__2:q02 target Pick single pick
“Pick up the apple I moved earlier”
정답 (body id 채점)
  • apple — kitchen / countertop · xyz [9.539, 10.907, 0.986] · 마지막 관측 86.5 s 전 · 누적 관측 24.36 s apple_87e4661e0aaedff69f751b5ac78bd93c_1_0_6 · 근거 이벤트 #3 (ok)
정답 위치 확정 직후 (apple)
exo1 · t=6:56 (f10424) · 1194px
마지막 관측 (apple)
exo1 · t=6:56 (f10424) · 1194px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:23 (f12590) · 0px
find:train_7845__2:q03 distractor Pick single pick
“Pick up the salt shaker”
정답 (body id 채점)
  • salt shaker — kitchen / countertop · xyz [9.162, 10.964, 0.963] · 마지막 관측 85.7 s 전 · 누적 관측 17.44 s saltshaker_fae1c48e1d061403dc3bc39cef9e979a_1_0_6
마지막 관측 (salt shaker)
exo1 · t=6:57 (f10439) · 981px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:23 (f12590) · 0px
find:train_7845__2:q04 distractor Pick single pick
“Pick up the egg”
정답 (body id 채점)
  • egg — kitchen / countertop · xyz [8.804, 10.935, 0.977] · 마지막 관측 84.1 s 전 · 누적 관측 17.88 s egg_45a3d68915c9f19164541ddf4da76856_1_0_6
마지막 관측 (egg)
exo1 · t=6:59 (f10479) · 811px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:23 (f12590) · 0px
find:train_7845__2:q05 distractor Pick single pick
“Pick up the spray bottle”
정답 (body id 채점)
  • atomizer — kitchen / dining table · xyz [7.674, 8.708, 0.906] · 마지막 관측 58.9 s 전 · 누적 관측 21.4 s atomizer_c60254aae031ecd4e316a5add61459a4_1_0_6
마지막 관측 (atomizer)
exo1 · t=7:23 (f11099) · 1702px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:23 (f12590) · 0px

restore 질의 4행

restore:train_7845__2:q00 restore origin=first single in_reach same_room hops=2 relocate twin_merge twin_nearby 마지막 이벤트 물체 ⚠ restore_from_seen_last5s ⚠ restore_from_visible_in_query_frame ⚠ restore_same_room_but_hops ⚠ restore_referent_ambiguous
“Pick up the remote control and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_7845__2:q00
  • remote control: 지금 living room / sofa [1.544, 13.046, 0.429] → 되돌릴 곳 living room / dining table [2.2, 7.953, 0.792] · 변위 5.135 m · 원래 자리 관측 3.84 s · 이웃 0.247 m · other_origins [[7.445, 9.103, 0.791]] remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7
원래 자리 증거 (remote control @ dining table)
exo1 · t=0:10 (f254) · 1052px
질의 시점(최종 프레임)
exo1 · t=8:23 (f12590) · 477px
restore:train_7845__2:q01 restore origin=previous single in_reach cross_room hops=2 relocate twin_merge twin_nearby 마지막 이벤트 물체 ⚠ restore_from_seen_last5s ⚠ restore_from_visible_in_query_frame ⚠ restore_referent_ambiguous
“Pick up the remote control and place it in or on where it was just before”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_7845__2:q00
  • remote control: 지금 living room / sofa [1.544, 13.046, 0.429] → 되돌릴 곳 kitchen / dining table [7.445, 9.103, 0.791] · 변위 7.097 m · 원래 자리 관측 13.0 s · 이웃 0.263 m · other_origins [[2.2, 7.953, 0.792]] remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7
원래 자리 증거 (remote control @ dining table)
exo1 · t=1:42 (f2559) · 2784px
질의 시점(최종 프레임)
exo1 · t=8:23 (f12590) · 477px
restore:train_7845__2:q02 restore origin=first single navigate same_room hops=1 shift ⚠ restore_neighbor_inside_r_place
“Pick up the apple and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_7845__2:q02
  • apple: 지금 kitchen / countertop [9.539, 10.907, 0.986] → 되돌릴 곳 kitchen / dining table [6.565, 9.08, 0.825] · 변위 3.49 m · 원래 자리 관측 12.76 s · 이웃 물체 0.043 m (< r_place 0.15) apple_87e4661e0aaedff69f751b5ac78bd93c_1_0_6
원래 자리 증거 (apple @ dining table)
exo1 · t=2:59 (f4479) · 720px
지금 자리 확정 직후 (apple @ countertop)
exo1 · t=6:56 (f10424) · 1194px
질의 시점(최종 프레임)
exo1 · t=8:23 (f12590) · 0px
restore:train_7845__2:q03 restore origin=first multi in_reach same_room hops=2 navigate same_room hops=1 relocate shift twin_merge twin_nearby 마지막 이벤트 물체 ⚠ restore_from_seen_last5s ⚠ restore_from_visible_in_query_frame ⚠ restore_neighbor_inside_r_place ⚠ restore_same_room_but_hops ⚠ restore_referent_ambiguous
“Pick up the remote control and place it in or on where it first was, then pick up the apple and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_7845__2:q00, find:train_7845__2:q02, restore:train_7845__2:q00, restore:train_7845__2:q02
  • remote control: 지금 living room / sofa [1.544, 13.046, 0.429] → 되돌릴 곳 living room / dining table [2.2, 7.953, 0.792] · 변위 5.135 m · 원래 자리 관측 3.84 s · 이웃 0.247 m · other_origins [[7.445, 9.103, 0.791]] remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7
  • apple: 지금 kitchen / countertop [9.539, 10.907, 0.986] → 되돌릴 곳 kitchen / dining table [6.565, 9.08, 0.825] · 변위 3.49 m · 원래 자리 관측 12.76 s · 이웃 물체 0.043 m (< r_place 0.15) apple_87e4661e0aaedff69f751b5ac78bd93c_1_0_6
원래 자리 증거 (remote control @ dining table)
exo1 · t=0:10 (f254) · 1052px
원래 자리 증거 (apple @ dining table)
exo1 · t=2:59 (f4479) · 720px
지금 자리 확정 직후 (apple @ countertop)
exo1 · t=6:56 (f10424) · 1194px
질의 시점(최종 프레임)
exo1 · t=8:23 (f12590) · 477px

3-3. train_9026__1 — train_9026 seed 1 · 7.88 분 · 방 bathroom, bedroom, kitchen, living room · 이벤트 5 (성공 4) · 추적 물체 27 · find 7 / restore 5

선정 이유: hidden restore(서랍에서 꺼내 되돌리기)·wrong_surface·store_in 실패 사례
exo_camera_1 · exo_camera_2 · wrist_camera (10 fps)

이벤트 타임라인 (subtasks.json)

#시간이벤트 (task_description) · 물체 · tagsoutcome키프레임
#00:00–1:16Pick up the remote control from the sofa in the living room and place it in or on the countertop in the kitchen
remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_3_0_7 · 이동 5.722 m 		ok
집기
exo1 · t=0:11 (f289) · 467px
놓기/정착
exo1 · t=1:17 (f1949) · 1616px
#11:16–2:39Pick up the vase from the side table in the living room and place it in or on the dining table
vase_6036f2984fad087344d3e0313b088eaf_1_0_7 · 이동 1.812 m shift		ok
집기
exo1 · t=1:42 (f2574) · 808px
놓기/정착
exo1 · t=2:40 (f4019) · 5237px
#22:39–4:52Pick up the remote control from the countertop in the kitchen and place it in or on the bed in the bedroom
remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_3_0_7 · 이동 8.653 m relocate twin_merge		failed
집기
exo1 · t=3:04 (f4609) · 627px
종료 시점
exo1 · t=4:54 (f7369) · 1319px
#34:52–6:39Pick up the potato from the dining table in the kitchen and put it in the drawer of the dresser in the bedroom
Irishpotato_121f03310f70f545adbe1151e4ea4b7f_1_0_6 · 이동 5.021 m store_in obj_unresolved		ok
집기
exo1 · t=5:35 (f8379) · 386px
놓기/정착
exo1 · t=6:37 (f9939) · 0px
#46:39–7:52Pick up the bowl from the dresser in the bedroom and place it in or on the sink in the bathroom
bowl_9ba419563c05c6548d5cece5273f15fa_1_0_4 · 이동 4.476 m 		ok
집기
exo1 · t=6:49 (f10229) · 1192px
놓기/정착
exo1 · t=7:49 (f11744) · 1313px

find 질의 7행

find:train_9026__1:q00 target Pick single pick wrong_surface
“Pick up the remote control I moved earlier”
정답 (body id 채점)
  • remote control — bedroom / bed · xyz [0.231, 7.094, 0.712] · 마지막 관측 46.1 s 전 · 누적 관측 53.36 s remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_3_0_7 · 근거 이벤트 #2 (failed)
정답 위치 확정 직후 (remote control)
exo1 · t=4:57 (f7439) · 1531px
마지막 관측 (remote control)
exo1 · t=7:05 (f10634) · 2554px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=7:52 (f11814) · 0px
find:train_9026__1:q01 target Pick single pick
“Pick up the vase I moved earlier”
정답 (body id 채점)
  • vase — living room / dining table · xyz [13.586, 4.8, 0.873] · 마지막 관측 311.3 s 전 · 누적 관측 17.04 s vase_6036f2984fad087344d3e0313b088eaf_1_0_7 · 근거 이벤트 #1 (ok)
정답 위치 확정 직후 (vase)
exo1 · t=2:40 (f4019) · 5237px
마지막 관측 (vase)
exo1 · t=2:40 (f4019) · 5237px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=7:52 (f11814) · 0px
find:train_9026__1:q02 target Pick single open_pick hidden
“Pick up the potato I moved earlier”
정답 (body id 채점)
  • irish potato — bedroom / dresser 안(닫힘) · xyz [0.304, 7.357, 0.419] · 마지막 관측 95.7 s 전 · 누적 관측 11.48 s Irishpotato_121f03310f70f545adbe1151e4ea4b7f_1_0_6 · 근거 이벤트 #3 (ok)
정답 위치 확정 직후 (irish potato)
exo1 · t=6:40 (f10014) · 0px
마지막 관측 (irish potato)
wrist · t=6:14 (f9374) · 11409px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=7:52 (f11814) · 0px
find:train_9026__1:q03 target Pick single pick 마지막 이벤트 물체 ⚠ find_answer_seen_last5s ⚠ find_answer_visible_in_query_frame
“Pick up the bowl I moved earlier”
정답 (body id 채점)
  • bowl — bathroom / sink · xyz [3.864, 10.047, 0.968] · 마지막 관측 0.1 s 전 · 누적 관측 38.28 s bowl_9ba419563c05c6548d5cece5273f15fa_1_0_4 · 근거 이벤트 #4 (ok)
마지막 관측 (bowl)
exo1 · t=7:50 (f11764) · 465px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=7:52 (f11814) · 317px
find:train_9026__1:q04 distractor Pick single pick
“Pick up the salt shaker”
정답 (body id 채점)
  • salt shaker — kitchen / dining table · xyz [5.287, 7.518, 0.879] · 마지막 관측 122.5 s 전 · 누적 관측 9.2 s saltshaker_4a6645cf2cdf6c8afa19b4998a0f4061_1_0_6
마지막 관측 (salt shaker)
exo1 · t=5:49 (f8749) · 1666px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=7:52 (f11814) · 0px
find:train_9026__1:q05 distractor Pick single pick
“Pick up the soap bottle”
정답 (body id 채점)
  • soapdispenser — kitchen / countertop · xyz [7.091, 2.7, 1.059] · 마지막 관측 142.7 s 전 · 누적 관측 20.72 s soapdispenser_ec614f6ef194c09f09317f1fcefc55e0_1_0_6
마지막 관측 (soapdispenser)
exo1 · t=5:28 (f8219) · 144px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=7:52 (f11814) · 0px
find:train_9026__1:q06 distractor Pick multi pick pick
“Pick up all the ladles”
정답 (body id 채점)
  • ladle — kitchen / dining table · xyz [5.413, 6.846, 0.792] · 마지막 관측 123.3 s 전 · 누적 관측 7.0 s ladle_efa098c0c2ee65d40f3e065a96e92161_2_0_6
  • ladle — kitchen / countertop · xyz [6.861, 2.385, 0.949] · 마지막 관측 269.9 s 전 · 누적 관측 8.92 s ladle_7a7203c58f86b622645b1721d02cab3c_1_0_6
마지막 관측 (ladle)
exo1 · t=5:49 (f8729) · 400px
마지막 관측 (ladle)
exo1 · t=3:21 (f5039) · 113px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=7:52 (f11814) · 0px

restore 질의 5행

restore:train_9026__1:q00 restore origin=first single navigate cross_room hops=1 wrong_surface ⚠ restore_misplaced_answer
“Pick up the remote control and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_9026__1:q00
  • remote control: 지금 bedroom / bed [0.231, 7.094, 0.712] → 되돌릴 곳 living room / sofa [12.098, 5.991, 0.444] · 변위 11.918 m · 원래 자리 관측 3.32 s · 이웃 1.906 m remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_3_0_7
원래 자리 증거 (remote control @ sofa)
exo1 · t=0:11 (f289) · 467px
지금 자리 확정 직후 (remote control @ bed)
exo1 · t=4:57 (f7439) · 1531px
질의 시점(최종 프레임)
exo1 · t=7:52 (f11814) · 0px
restore:train_9026__1:q01 restore origin=first single navigate same_room hops=1 shift
“Pick up the vase and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_9026__1:q01
  • vase: 지금 living room / dining table [13.586, 4.8, 0.873] → 되돌릴 곳 living room / tv stand [14.648, 6.231, 0.542] · 변위 1.782 m · 원래 자리 관측 8.36 s · 이웃 0.152 m vase_6036f2984fad087344d3e0313b088eaf_1_0_7
원래 자리 증거 (vase @ tv stand)
exo1 · t=1:38 (f2454) · 808px
지금 자리 확정 직후 (vase @ dining table)
exo1 · t=2:40 (f4019) · 5237px
질의 시점(최종 프레임)
exo1 · t=7:52 (f11814) · 0px
restore:train_9026__1:q02 restore origin=first single navigate cross_room hops=1 from hidden store_in
“Pick up the potato and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_9026__1:q02
  • irish potato: 지금 bedroom / dresser 안(닫힘) [0.304, 7.357, 0.419] → 되돌릴 곳 kitchen / dining table [5.298, 7.29, 0.818] · 변위 4.994 m · 원래 자리 관측 6.56 s · 이웃 0.228 m Irishpotato_121f03310f70f545adbe1151e4ea4b7f_1_0_6
원래 자리 증거 (irish potato @ dining table)
exo1 · t=3:50 (f5769) · 1237px
지금 자리 확정 직후 (irish potato @ dresser 안(닫힘))
exo1 · t=6:40 (f10014) · 0px
질의 시점(최종 프레임)
exo1 · t=7:52 (f11814) · 0px
restore:train_9026__1:q03 restore origin=first single in_reach cross_room hops=1 마지막 이벤트 물체 ⚠ restore_from_seen_last5s ⚠ restore_from_visible_in_query_frame ⚠ restore_neighbor_inside_r_place
“Pick up the bowl and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_9026__1:q03
  • bowl: 지금 bathroom / sink [3.864, 10.047, 0.968] → 되돌릴 곳 bedroom / dresser [0.27, 7.389, 0.746] · 변위 4.47 m · 원래 자리 관측 26.8 s · 이웃 물체 0.046 m (< r_place 0.15) bowl_9ba419563c05c6548d5cece5273f15fa_1_0_4
원래 자리 증거 (bowl @ dresser)
exo1 · t=4:55 (f7389) · 4966px
질의 시점(최종 프레임)
exo1 · t=7:52 (f11814) · 317px
restore:train_9026__1:q04 restore origin=first multi navigate cross_room hops=1 wrong_surface navigate same_room hops=1 navigate cross_room hops=1 from hidden shift store_in ⚠ restore_misplaced_answer
“Pick up the remote control and place it in or on where it first was, then pick up the vase and place it in or on where it first was, and then pick up the potato and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_9026__1:q00, find:train_9026__1:q01, find:train_9026__1:q02, restore:train_9026__1:q00, restore:train_9026__1:q01, restore:train_9026__1:q02
  • remote control: 지금 bedroom / bed [0.231, 7.094, 0.712] → 되돌릴 곳 living room / sofa [12.098, 5.991, 0.444] · 변위 11.918 m · 원래 자리 관측 3.32 s · 이웃 1.906 m remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_3_0_7
  • vase: 지금 living room / dining table [13.586, 4.8, 0.873] → 되돌릴 곳 living room / tv stand [14.648, 6.231, 0.542] · 변위 1.782 m · 원래 자리 관측 8.36 s · 이웃 0.152 m vase_6036f2984fad087344d3e0313b088eaf_1_0_7
  • irish potato: 지금 bedroom / dresser 안(닫힘) [0.304, 7.357, 0.419] → 되돌릴 곳 kitchen / dining table [5.298, 7.29, 0.818] · 변위 4.994 m · 원래 자리 관측 6.56 s · 이웃 0.228 m Irishpotato_121f03310f70f545adbe1151e4ea4b7f_1_0_6
원래 자리 증거 (remote control @ sofa)
exo1 · t=0:11 (f289) · 467px
지금 자리 확정 직후 (remote control @ bed)
exo1 · t=4:57 (f7439) · 1531px
원래 자리 증거 (vase @ tv stand)
exo1 · t=1:38 (f2454) · 808px
지금 자리 확정 직후 (vase @ dining table)
exo1 · t=2:40 (f4019) · 5237px
원래 자리 증거 (irish potato @ dining table)
exo1 · t=3:50 (f5769) · 1237px
지금 자리 확정 직후 (irish potato @ dresser 안(닫힘))
exo1 · t=6:40 (f10014) · 0px
질의 시점(최종 프레임)
exo1 · t=7:52 (f11814) · 0px

3-4. train_3060__2 — train_3060 seed 2 · 8.35 분 · 방 bedroom, kitchen, living room · 이벤트 5 (성공 4) · 추적 물체 21 · find 5 / restore 1

선정 이유: decoy 이벤트(빈 자리에 같은 종류 물체 갖다 놓기) + 질의 시점 정답 가시 사례
exo_camera_1 · exo_camera_2 · wrist_camera (10 fps)

이벤트 타임라인 (subtasks.json)

#시간이벤트 (task_description) · 물체 · tagsoutcome키프레임
#00:00–1:45Pick up the mug from the dining table in the kitchen and place it in or on the chair in the living room
mug_3ebc45568ed53a18c8797978b3744a99_1_0_6 · 이동 4.682 m 		ok
집기
exo1 · t=0:23 (f584) · 715px
놓기/정착
exo1 · t=1:48 (f2714) · 650px
#11:45–3:53Pick up the remote control from the tv stand in the living room and place it in or on the armchair in the bedroom
remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_7 · 이동 11.341 m 		ok
집기
exo1 · t=2:09 (f3249) · 689px
놓기/정착
exo1 · t=3:54 (f5864) · 1076px
#23:53–5:29Pick up the mug from the chair in the living room and place it in or on the chair in the kitchen
mug_3ebc45568ed53a18c8797978b3744a99_1_0_6 · 이동 4.627 m relocate		ok
집기
exo1 · t=4:27 (f6699) · 614px
놓기/정착
exo1 · t=5:32 (f8314) · 1402px
#35:29–8:20Pick up the mug from the dining table in the bedroom and place it in or on the dining table in the kitchen
mug_38903e9f02926f380b587d1b9de9c00b_1_0_2 · 이동 6.002 m decoy		ok
집기
exo1 · t=6:20 (f9519) · 800px
놓기/정착
exo1 · t=8:17 (f12444) · 824px
—제외된 이벤트 #4: 액션을 하나도 안 낸 이벤트 (계획 단계에서 실패)

find 질의 5행

find:train_3060__2:q00 target Pick multi pick pick 마지막 이벤트 물체 ⚠ find_answer_seen_last5s ⚠ find_answer_visible_in_query_frame
“Pick up all the mugs I moved earlier”
정답 (body id 채점)
  • mug — kitchen / chair · xyz [8.991, 5.717, 0.558] · 마지막 관측 57.4 s 전 · 누적 관측 38.64 s mug_3ebc45568ed53a18c8797978b3744a99_1_0_6 · 근거 이벤트 #2 (ok)
  • mug — kitchen / dining table · xyz [7.303, 5.953, 0.836] · 마지막 관측 0.0 s 전 · 누적 관측 27.36 s mug_38903e9f02926f380b587d1b9de9c00b_1_0_2 · 근거 이벤트 #3 (ok)
정답 위치 확정 직후 (mug)
exo1 · t=5:33 (f8329) · 1712px
마지막 관측 (mug)
exo2 · t=7:23 (f11079) · 159px
정답 위치 확정 직후 (mug)
exo1 · t=8:20 (f12519) · 542px
마지막 관측 (mug)
exo1 · t=8:18 (f12469) · 805px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:20 (f12517) · 0px
find:train_3060__2:q01 target NavToObj single navigate_only
“Navigate to the remote control I moved earlier”
정답 (body id 채점)
  • remote control — bedroom / armchair · xyz [0.401, 2.379, 0.562] · 마지막 관측 99.0 s 전 · 누적 관측 26.96 s remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_7 · 근거 이벤트 #1 (ok)
정답 위치 확정 직후 (remote control)
exo1 · t=3:54 (f5864) · 1076px
마지막 관측 (remote control)
exo1 · t=6:41 (f10034) · 315px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:20 (f12517) · 0px
find:train_3060__2:q02 distractor Pick single pick ⚠ find_answer_seen_last5s ⚠ find_answer_visible_in_query_frame
“Pick up the fork”
정답 (body id 채점)
  • fork — kitchen / dining table · xyz [8.26, 5.714, 0.792] · 마지막 관측 0.0 s 전 · 누적 관측 14.16 s fork_a17d780ca6a79038b069eb7768c962c4_1_0_6
마지막 관측 (fork)
exo1 · t=8:18 (f12474) · 157px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:20 (f12517) · 157px
find:train_3060__2:q03 distractor Pick single pick ⚠ find_answer_seen_last5s ⚠ find_answer_visible_in_query_frame
“Pick up the butter knife”
정답 (body id 채점)
  • butter knife — kitchen / dining table · xyz [7.815, 5.698, 0.796] · 마지막 관측 0.0 s 전 · 누적 관측 11.4 s butterknife_f211d9b5a6beb604cda0c1df985a0093_1_0_6
마지막 관측 (butter knife)
exo1 · t=8:18 (f12469) · 173px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:20 (f12517) · 173px
find:train_3060__2:q04 distractor Pick single pick ⚠ find_answer_seen_last5s ⚠ find_answer_visible_in_query_frame
“Pick up the bowl”
정답 (body id 채점)
  • bowl — kitchen / dining table · xyz [8.481, 5.495, 0.825] · 마지막 관측 0.0 s 전 · 누적 관측 30.92 s bowl_ab2df3cd7ba6e36f1f725f462a622119_1_0_6
마지막 관측 (bowl)
exo1 · t=8:19 (f12479) · 604px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:20 (f12517) · 604px

restore 질의 1행

restore:train_3060__2:q00 restore origin=first single in_reach cross_room hops=1 decoy 마지막 이벤트 물체 ⚠ restore_from_seen_last5s ⚠ restore_from_visible_in_query_frame ⚠ restore_referent_ambiguous
“Pick up the mug and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_3060__2:q00
  • mug: 지금 kitchen / dining table [7.303, 5.953, 0.836] → 되돌릴 곳 bedroom / dining table [1.307, 6.2, 0.812] · 변위 6.001 m · 원래 자리 관측 8.4 s · 이웃 0.22 m mug_38903e9f02926f380b587d1b9de9c00b_1_0_2
원래 자리 증거 (mug @ dining table)
exo1 · t=6:04 (f9119) · 981px
지금 자리 확정 직후 (mug @ dining table)
exo1 · t=8:20 (f12519) · 542px
질의 시점(최종 프레임)
exo1 · t=8:20 (f12517) · 542px

3-5. train_2894__0 — train_2894 seed 0 · 5.44 분 · 방 kitchen · 이벤트 5 (성공 4) · 추적 물체 21 · find 5 / restore 4

선정 이유: 방 1개(kitchen만) 편 — 최단 5.4분, not_moved(왕복) + previous 대조쌍
exo_camera_1 · exo_camera_2 · wrist_camera (10 fps)

이벤트 타임라인 (subtasks.json)

#시간이벤트 (task_description) · 물체 · tagsoutcome키프레임
#00:00–1:17Pick up the spatula from the countertop in the kitchen and place it in or on the dresser in the living room
spatula_291e31b285474249721c8a7b1bac877a_2_0_6 · 이동 6.908 m 		ok
집기
exo1 · t=0:09 (f234) · 416px
놓기/정착
exo1 · t=1:18 (f1969) · 391px
#11:17–2:37Pick up the spatula from the dresser in the living room and place it in or on the countertop in the kitchen
spatula_291e31b285474249721c8a7b1bac877a_2_0_6 · 이동 6.991 m relocate twin_merge		ok
집기
exo1 · t=1:22 (f2054) · 392px
놓기/정착
exo1 · t=2:39 (f3984) · 930px
#22:37–4:00Pick up the pen from the dining table in the living room and place it in or on the sofa
pen_6868af7336df691a6aad3bad70b207dc_1_0_7 · 이동 2.957 m shift		ok
집기
exo1 · t=2:59 (f4499) · 111px
놓기/정착
exo1 · t=4:01 (f6034) · 166px
#34:00–5:25Pick up the remote control from the sofa in the living room and place it in or on the dining table in the bedroom
remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_7 · 이동 7.752 m 		ok
집기
exo1 · t=4:10 (f6274) · 499px
놓기/정착
exo1 · t=5:23 (f8094) · 541px
—제외된 이벤트 #1: 액션을 하나도 안 낸 이벤트 (계획 단계에서 실패)

find 질의 5행

find:train_2894__0:q00 distractor Pick multi pick not_moved pick twin_nearby ⚠ find_distractor_obj_was_moved ⚠ find_distractor_misplaced
“Pick up all the spatulas”
정답 (body id 채점)
  • spatula — kitchen / countertop · xyz [7.27, 2.756, 0.947] · 마지막 관측 165.0 s 전 · 누적 관측 32.24 s spatula_291e31b285474249721c8a7b1bac877a_2_0_6 · 근거 이벤트 #2 (ok)
  • spatula — kitchen / countertop · xyz [7.576, 2.23, 0.947] · 마지막 관측 167.8 s 전 · 누적 관측 10.52 s spatula_291e31b285474249721c8a7b1bac877a_1_0_6
정답 위치 확정 직후 (spatula)
exo1 · t=2:40 (f4024) · 969px
마지막 관측 (spatula)
exo1 · t=2:40 (f4024) · 969px
마지막 관측 (spatula)
exo1 · t=2:38 (f3959) · 192px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=5:26 (f8151) · 0px
find:train_2894__0:q01 target Pick single pick ⚠ answer_room_name_unresolved
“Pick up the pen I moved earlier”
정답 (body id 채점)
  • pen — room#7(이름 미유도) / sofa · xyz [8.757, 7.229, 0.418] · 마지막 관측 59.4 s 전 · 누적 관측 28.16 s pen_6868af7336df691a6aad3bad70b207dc_1_0_7 · 근거 이벤트 #3 (ok)
정답 위치 확정 직후 (pen)
exo1 · t=4:01 (f6034) · 166px
마지막 관측 (pen)
exo1 · t=4:24 (f6619) · 112px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=5:26 (f8151) · 0px
find:train_2894__0:q02 target Pick single pick 마지막 이벤트 물체 ⚠ find_answer_seen_last5s ⚠ find_answer_visible_in_query_frame ⚠ answer_room_name_unresolved
“Pick up the remote control I moved earlier”
정답 (body id 채점)
  • remote control — room#2(이름 미유도) / dining table · xyz [1.226, 7.187, 0.793] · 마지막 관측 0.2 s 전 · 누적 관측 22.8 s remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_7 · 근거 이벤트 #4 (ok)
마지막 관측 (remote control)
exo1 · t=5:23 (f8099) · 535px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=5:26 (f8151) · 369px
find:train_2894__0:q03 distractor Pick single pick
“Pick up the fork”
정답 (body id 채점)
  • fork — kitchen / countertop · xyz [7.398, 1.547, 0.948] · 마지막 관측 168.6 s 전 · 누적 관측 9.28 s fork_a17d780ca6a79038b069eb7768c962c4_1_0_6
마지막 관측 (fork)
exo1 · t=2:37 (f3939) · 91px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=5:26 (f8151) · 0px
find:train_2894__0:q04 distractor Pick single pick
“Pick up the knife”
정답 (body id 채점)
  • knife — kitchen / countertop · xyz [7.321, 1.284, 0.944] · 마지막 관측 168.8 s 전 · 누적 관측 7.0 s knife_2933d9425c8587a7d4ddaae661ac7598_1_0_6
마지막 관측 (knife)
exo1 · t=2:35 (f3884) · 81px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=5:26 (f8151) · 0px

restore 질의 4행

restore:train_2894__0:q00 restore origin=previous single navigate cross_room hops=2 not_moved relocate twin_merge twin_nearby ⚠ restore_misplaced_answer ⚠ answer_room_name_unresolved ⚠ restore_shares_with_distractor
“Pick up the spatula and place it in or on where it was just before”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_2894__0:q00
  • spatula: 지금 kitchen / countertop [7.27, 2.756, 0.947] → 되돌릴 곳 room#7(이름 미유도) / dresser [5.765, 9.579, 0.708] · 변위 6.987 m · 원래 자리 관측 2.32 s · 이웃 0.598 m · other_origins [[7.265, 2.84, 0.947]] spatula_291e31b285474249721c8a7b1bac877a_2_0_6
원래 자리 증거 (spatula @ dresser)
exo1 · t=1:22 (f2054) · 392px
지금 자리 확정 직후 (spatula @ countertop)
exo1 · t=2:40 (f4024) · 969px
질의 시점(최종 프레임)
exo1 · t=5:26 (f8151) · 0px
restore:train_2894__0:q01 restore origin=first single navigate same_room hops=1 shift ⚠ answer_room_name_unresolved ⚠ answer_room_name_unresolved
“Pick up the pen and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_2894__0:q01
  • pen: 지금 room#7(이름 미유도) / sofa [8.757, 7.229, 0.418] → 되돌릴 곳 room#7(이름 미유도) / dining table [6.268, 8.792, 0.75] · 변위 2.939 m · 원래 자리 관측 13.68 s · 이웃 0.216 m pen_6868af7336df691a6aad3bad70b207dc_1_0_7
원래 자리 증거 (pen @ dining table)
exo1 · t=2:52 (f4319) · 369px
지금 자리 확정 직후 (pen @ sofa)
exo1 · t=4:01 (f6034) · 166px
질의 시점(최종 프레임)
exo1 · t=5:26 (f8151) · 0px
restore:train_2894__0:q02 restore origin=first single in_reach cross_room hops=1 마지막 이벤트 물체 ⚠ restore_from_seen_last5s ⚠ restore_from_visible_in_query_frame ⚠ answer_room_name_unresolved ⚠ answer_room_name_unresolved
“Pick up the remote control and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_2894__0:q02
  • remote control: 지금 room#2(이름 미유도) / dining table [1.226, 7.187, 0.793] → 되돌릴 곳 room#7(이름 미유도) / sofa [8.925, 6.357, 0.425] · 변위 7.744 m · 원래 자리 관측 14.84 s · 이웃 0.56 m remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_7
원래 자리 증거 (remote control @ sofa)
exo1 · t=4:04 (f6109) · 1384px
질의 시점(최종 프레임)
exo1 · t=5:26 (f8151) · 369px
restore:train_2894__0:q03 restore origin=first multi navigate same_room hops=1 in_reach cross_room hops=1 shift 마지막 이벤트 물체 ⚠ restore_from_seen_last5s ⚠ restore_from_visible_in_query_frame ⚠ answer_room_name_unresolved ⚠ answer_room_name_unresolved ⚠ answer_room_name_unresolved ⚠ answer_room_name_unresolved
“Pick up the pen and place it in or on where it first was, then pick up the remote control and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_2894__0:q01, find:train_2894__0:q02, restore:train_2894__0:q01, restore:train_2894__0:q02
  • pen: 지금 room#7(이름 미유도) / sofa [8.757, 7.229, 0.418] → 되돌릴 곳 room#7(이름 미유도) / dining table [6.268, 8.792, 0.75] · 변위 2.939 m · 원래 자리 관측 13.68 s · 이웃 0.216 m pen_6868af7336df691a6aad3bad70b207dc_1_0_7
  • remote control: 지금 room#2(이름 미유도) / dining table [1.226, 7.187, 0.793] → 되돌릴 곳 room#7(이름 미유도) / sofa [8.925, 6.357, 0.425] · 변위 7.744 m · 원래 자리 관측 14.84 s · 이웃 0.56 m remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_7
원래 자리 증거 (pen @ dining table)
exo1 · t=2:52 (f4319) · 369px
지금 자리 확정 직후 (pen @ sofa)
exo1 · t=4:01 (f6034) · 166px
원래 자리 증거 (remote control @ sofa)
exo1 · t=4:04 (f6109) · 1384px
질의 시점(최종 프레임)
exo1 · t=5:26 (f8151) · 0px

3-6. train_7428__2 — train_7428 seed 2 · 6.09 분 · 방 bedroom, kitchen, living room · 이벤트 4 (성공 3) · 추적 물체 21 · find 6 / restore 4

선정 이유: 3절 multi restore(정답 3개) 최단 편
exo_camera_1 · exo_camera_2 · wrist_camera (10 fps)

이벤트 타임라인 (subtasks.json)

#시간이벤트 (task_description) · 물체 · tagsoutcome키프레임
#00:00–1:10Pick up the cell phone from the dining table in the kitchen and place it in or on the armchair in the bedroom
cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_1_0_6 · 이동 3.419 m 		ok
집기
exo1 · t=0:07 (f179) · 644px
놓기/정착
exo1 · t=1:12 (f1804) · 919px
#11:11–2:51Pick up the salt shaker from the dining table in the kitchen and put it in the drawer of the shelving unit
saltshaker_ae8db92b68885e8a5331b49cf1534319_1_0_6 · 이동 1.295 m shift store_in obj_unresolved		ok
집기
exo1 · t=1:57 (f2944) · 242px
놓기/정착
exo2 · t=2:52 (f4319) · 6px
#22:51–5:00Pick up the remote control from the armchair in the bedroom and place it in or on the tv stand in the living room
remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_2 · 이동 6.249 m 		ok
집기
exo1 · t=3:17 (f4939) · 326px
놓기/정착
exo1 · t=5:01 (f7539) · 1075px
#35:00–6:05Pick up the cell phone from the armchair in the bedroom and place it in or on the bed
cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_1_0_6 · 이동 0.013 m relocate twin_merge obj_unresolved
⚠️ 놓기 세그먼트가 없다 — 문장의 뒷절이 실제로 일어나지 않았다
failed_no_place
집기
exo1 · t=5:48 (f8704) · 386px
종료 시점
exo1 · t=6:02 (f9069) · 233px

find 질의 6행

find:train_7428__2:q00 target Pick single pick ⚠ find_answer_seen_last5s ⚠ find_answer_visible_in_query_frame
“Pick up the cell phone I moved earlier”
정답 (body id 채점)
  • cell phone — bedroom / armchair · xyz [3.156, 2.764, 0.326] · 마지막 관측 0.0 s 전 · 누적 관측 21.72 s cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_1_0_6 · 근거 이벤트 #0 (ok)
정답 위치 확정 직후 (cell phone)
exo1 · t=1:12 (f1804) · 919px
마지막 관측 (cell phone)
exo1 · t=6:03 (f9089) · 233px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=6:05 (f9138) · 233px
find:train_7428__2:q01 target Pick single open_pick hidden
“Pick up the salt shaker I moved earlier”
정답 (body id 채점)
  • salt shaker — kitchen / shelf 안(닫힘) · xyz [6.952, 0.235, 0.476] · 마지막 관측 5.8 s 전 · 누적 관측 16.12 s saltshaker_ae8db92b68885e8a5331b49cf1534319_1_0_6 · 근거 이벤트 #1 (ok)
정답 위치 확정 직후 (salt shaker)
exo2 · t=2:52 (f4319) · 6px
마지막 관측 (salt shaker)
exo1 · t=5:59 (f8994) · 51px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=6:05 (f9138) · 4px
find:train_7428__2:q02 target Pick single pick twin_nearby 마지막 이벤트 물체
“Pick up the remote control I moved earlier”
정답 (body id 채점)
  • remote control — living room / tv stand · xyz [8.572, 5.692, 0.528] · 마지막 관측 63.4 s 전 · 누적 관측 27.8 s remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_2 · 근거 이벤트 #2 (ok)
정답 위치 확정 직후 (remote control)
exo1 · t=5:01 (f7539) · 1075px
마지막 관측 (remote control)
exo1 · t=5:01 (f7539) · 1075px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=6:05 (f9138) · 0px
find:train_7428__2:q03 distractor Pick single pick ⚠ find_answer_seen_last5s ⚠ find_answer_visible_in_query_frame
“Pick up the wine bottle”
정답 (body id 채점)
  • wine bottle — kitchen / dining table · xyz [5.534, 0.619, 0.924] · 마지막 관측 0.0 s 전 · 누적 관측 25.2 s winebottle_201eb4050e30f10e57909e4c975910e9_1_0_6
마지막 관측 (wine bottle)
exo1 · t=6:03 (f9089) · 298px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=6:05 (f9138) · 298px
find:train_7428__2:q04 distractor Pick single pick twin_nearby ⚠ find_answer_seen_last5s ⚠ find_answer_visible_in_query_frame ⚠ find_referent_ambiguous
“Pick up the bottle”
정답 (body id 채점)
  • bottle — kitchen / dining table · xyz [5.366, 0.538, 0.887] · 마지막 관측 0.0 s 전 · 누적 관측 21.8 s bottle_8382d4ed00ffcc00a477337974541bb1_2_0_6
마지막 관측 (bottle)
exo1 · t=6:03 (f9089) · 214px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=6:05 (f9138) · 214px
find:train_7428__2:q05 distractor Pick single pick ⚠ find_answer_seen_last5s ⚠ find_answer_visible_in_query_frame
“Pick up the statue”
정답 (body id 채점)
  • statue — kitchen / dining table · xyz [6.038, 0.546, 1.051] · 마지막 관측 0.0 s 전 · 누적 관측 26.88 s statue_da4a8f1a0bdae66afec8d4581e3d4544_1_0_6
마지막 관측 (statue)
exo1 · t=6:03 (f9089) · 562px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=6:05 (f9138) · 562px

restore 질의 4행

restore:train_7428__2:q00 restore origin=first single navigate cross_room hops=1 ⚠ restore_from_seen_last5s ⚠ restore_from_visible_in_query_frame
“Pick up the cell phone and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_7428__2:q00
  • cell phone: 지금 bedroom / armchair [3.156, 2.764, 0.326] → 되돌릴 곳 kitchen / dining table [5.702, 0.538, 0.763] · 변위 3.382 m · 원래 자리 관측 2.84 s · 이웃 0.186 m cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_1_0_6
원래 자리 증거 (cell phone @ dining table)
exo1 · t=0:02 (f74) · 1201px
지금 자리 확정 직후 (cell phone @ armchair)
exo1 · t=1:12 (f1804) · 919px
질의 시점(최종 프레임)
exo1 · t=6:05 (f9138) · 233px
restore:train_7428__2:q01 restore origin=first single navigate same_room hops=1 from hidden shift store_in
“Pick up the salt shaker and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_7428__2:q01
  • salt shaker: 지금 kitchen / shelf 안(닫힘) [6.952, 0.235, 0.476] → 되돌릴 곳 kitchen / dining table [5.702, 0.297, 0.808] · 변위 1.252 m · 원래 자리 관측 12.16 s · 이웃 0.344 m saltshaker_ae8db92b68885e8a5331b49cf1534319_1_0_6
원래 자리 증거 (salt shaker @ dining table)
exo1 · t=0:25 (f649) · 1241px
지금 자리 확정 직후 (salt shaker @ shelf 안(닫힘))
exo2 · t=2:52 (f4319) · 6px
질의 시점(최종 프레임)
exo1 · t=6:05 (f9138) · 4px
restore:train_7428__2:q02 restore origin=first single navigate cross_room hops=1 twin_nearby 마지막 이벤트 물체
“Pick up the remote control and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_7428__2:q02
  • remote control: 지금 living room / tv stand [8.572, 5.692, 0.528] → 되돌릴 곳 bedroom / armchair [2.914, 3.046, 0.348] · 변위 6.246 m · 원래 자리 관측 8.32 s · 이웃 0.223 m remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_2
원래 자리 증거 (remote control @ armchair)
exo1 · t=3:09 (f4744) · 798px
지금 자리 확정 직후 (remote control @ tv stand)
exo1 · t=5:01 (f7539) · 1075px
질의 시점(최종 프레임)
exo1 · t=6:05 (f9138) · 0px
restore:train_7428__2:q03 restore origin=first multi navigate cross_room hops=1 navigate same_room hops=1 from hidden navigate cross_room hops=1 shift store_in twin_nearby 마지막 이벤트 물체 ⚠ restore_from_seen_last5s ⚠ restore_from_visible_in_query_frame
“Pick up the cell phone and place it in or on where it first was, then pick up the salt shaker and place it in or on where it first was, and then pick up the remote control and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_7428__2:q00, find:train_7428__2:q01, find:train_7428__2:q02, restore:train_7428__2:q00, restore:train_7428__2:q01, restore:train_7428__2:q02
  • cell phone: 지금 bedroom / armchair [3.156, 2.764, 0.326] → 되돌릴 곳 kitchen / dining table [5.702, 0.538, 0.763] · 변위 3.382 m · 원래 자리 관측 2.84 s · 이웃 0.186 m cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_1_0_6
  • salt shaker: 지금 kitchen / shelf 안(닫힘) [6.952, 0.235, 0.476] → 되돌릴 곳 kitchen / dining table [5.702, 0.297, 0.808] · 변위 1.252 m · 원래 자리 관측 12.16 s · 이웃 0.344 m saltshaker_ae8db92b68885e8a5331b49cf1534319_1_0_6
  • remote control: 지금 living room / tv stand [8.572, 5.692, 0.528] → 되돌릴 곳 bedroom / armchair [2.914, 3.046, 0.348] · 변위 6.246 m · 원래 자리 관측 8.32 s · 이웃 0.223 m remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_2
원래 자리 증거 (cell phone @ dining table)
exo1 · t=0:02 (f74) · 1201px
지금 자리 확정 직후 (cell phone @ armchair)
exo1 · t=1:12 (f1804) · 919px
원래 자리 증거 (salt shaker @ dining table)
exo1 · t=0:25 (f649) · 1241px
지금 자리 확정 직후 (salt shaker @ shelf 안(닫힘))
exo2 · t=2:52 (f4319) · 6px
원래 자리 증거 (remote control @ armchair)
exo1 · t=3:09 (f4744) · 798px
지금 자리 확정 직후 (remote control @ tv stand)
exo1 · t=5:01 (f7539) · 1075px
질의 시점(최종 프레임)
exo1 · t=6:05 (f9138) · 233px

3-7. train_3994__0 — train_3994 seed 0 · 8.65 분 · 방 bedroom, kitchen, living room · 이벤트 5 (성공 3) · 추적 물체 23 · find 7 / restore 3

선정 이유: 실패 이벤트 2건 편(가장 지저분한 편) — find 7행
exo_camera_1 · exo_camera_2 · wrist_camera (10 fps)

이벤트 타임라인 (subtasks.json)

#시간이벤트 (task_description) · 물체 · tagsoutcome키프레임
#00:00–1:56Pick up the cell phone from the sofa in the living room and place it in or on the chair in the kitchen
cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_2_0_7 · 이동 7.427 m 		failed
집기
exo1 · t=0:10 (f269) · 435px
종료 시점
exo1 · t=1:56 (f2924) · 765px
#11:56–4:02Pick up the salt shaker from the dining table in the kitchen and put it in the drawer of the dresser in the bedroom
saltshaker_ae8db92b68885e8a5331b49cf1534319_1_0_6 · 이동 3.803 m store_in obj_unresolved		ok
집기
exo1 · t=2:51 (f4289) · 299px
놓기/정착
exo1 · t=4:00 (f6014) · 0px
#24:02–5:08Pick up the pen from the chair in the bedroom and place it in or on the toilet in the bathroom
pen_4d17f13875116fae2c6b573c6744bf41_1_0_4 · 이동 1.188 m
⚠️ 놓기 세그먼트가 없다 — 문장의 뒷절이 실제로 일어나지 않았다 / 집어서 옮겼지만 **바닥에 떨어졌다** — 실제 끝 위치는 settled_xyz
failed_dropped
집기
exo1 · t=4:30 (f6769) · 73px
종료 시점
exo1 · t=5:09 (f7749) · 80px
#35:08–7:18Pick up the remote control from the dining table in the bedroom and place it in or on the dresser
remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_1_0_4 · 이동 4.842 m shift obj_unresolved		ok
집기
exo1 · t=5:33 (f8334) · 681px
놓기/정착
exo1 · t=7:19 (f10999) · 1121px
#47:18–8:38Pick up the cell phone from the chair in the kitchen and place it in or on the dining table in the bedroom
cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_2_0_7 · 이동 2.823 m relocate twin_merge		ok
집기
exo1 · t=7:36 (f11414) · 540px
놓기/정착
exo1 · t=8:36 (f12904) · 635px

find 질의 7행

find:train_3994__0:q00 target Pick single pick twin_nearby 마지막 이벤트 물체 ⚠ find_answer_seen_last5s ⚠ find_answer_visible_in_query_frame
“Pick up the cell phone I moved earlier”
정답 (body id 채점)
  • cell phone — bedroom / dining table · xyz [3.341, 7.43, 0.785] · 마지막 관측 0.0 s 전 · 누적 관측 42.44 s cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_2_0_7 · 근거 이벤트 #4 (ok)
마지막 관측 (cell phone)
exo1 · t=8:36 (f12924) · 635px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:38 (f12973) · 634px
find:train_3994__0:q01 target Pick single open_pick hidden
“Pick up the salt shaker I moved earlier”
정답 (body id 채점)
  • salt shaker — bedroom / dresser 안(닫힘) · xyz [3.786, 10.408, 0.555] · 마지막 관측 284.6 s 전 · 누적 관측 22.52 s saltshaker_ae8db92b68885e8a5331b49cf1534319_1_0_6 · 근거 이벤트 #1 (ok)
정답 위치 확정 직후 (salt shaker)
exo1 · t=4:03 (f6089) · 0px
마지막 관측 (salt shaker)
exo1 · t=3:52 (f5814) · 219px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:38 (f12973) · 0px
find:train_3994__0:q02 target NavToObj single navigate_only on_floor ⚠ find_answer_seen_last5s
“Navigate to the pen I moved earlier”
정답 (body id 채점)
  • pen — — / 바닥 · xyz [4.109, 7.207, 0.005] · 마지막 관측 0.0 s 전 · 누적 관측 7.36 s pen_4d17f13875116fae2c6b573c6744bf41_1_0_4 · 근거 이벤트 #2 (failed_dropped)
정답 위치 확정 직후 (pen)
exo1 · t=5:09 (f7749) · 80px
마지막 관측 (pen)
wrist · t=8:37 (f12929) · 127px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:38 (f12973) · 0px
find:train_3994__0:q03 target Pick single pick
“Pick up the remote control I moved earlier”
정답 (body id 채점)
  • remote control — bedroom / dresser · xyz [3.862, 10.727, 0.682] · 마지막 관측 34.2 s 전 · 누적 관측 28.84 s remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_1_0_4 · 근거 이벤트 #3 (ok)
정답 위치 확정 직후 (remote control)
exo1 · t=7:19 (f10999) · 1121px
마지막 관측 (remote control)
exo1 · t=8:04 (f12109) · 52px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:38 (f12973) · 0px
find:train_3994__0:q04 distractor Pick multi open_pick hidden pick
“Pick up all the bowls”
정답 (body id 채점)
  • bowl — bedroom / dresser · xyz [3.971, 10.477, 0.732] · 마지막 관측 32.2 s 전 · 누적 관측 43.76 s bowl_e39b26ad821ce047b69262973c668c88_1_0_4
  • bowl — kitchen / dining table · xyz [6.089, 6.919, 0.785] · 마지막 관측 44.2 s 전 · 누적 관측 18.48 s bowl_35a8ca16071e718d87f34cf4e287937b_1_0_6
마지막 관측 (bowl)
exo1 · t=8:05 (f12129) · 1027px
마지막 관측 (bowl)
exo1 · t=7:53 (f11844) · 2199px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:38 (f12973) · 0px
find:train_3994__0:q05 distractor Pick single pick ⚠ find_referent_ambiguous
“Pick up the watch”
정답 (body id 채점)
  • watch — bedroom / dining table · xyz [2.601, 6.466, 0.798] · 마지막 관측 134.6 s 전 · 누적 관측 9.96 s watch_2c183ccd1b97775b41d0d0980e57d860_1_0_4
마지막 관측 (watch)
exo1 · t=6:24 (f9604) · 304px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:38 (f12973) · 1px
find:train_3994__0:q06 distractor Pick single pick ⚠ find_answer_seen_last5s ⚠ find_referent_ambiguous
“Pick up the key chain”
정답 (body id 채점)
  • key chain — bedroom / dining table · xyz [2.593, 7.32, 0.784] · 마지막 관측 0.0 s 전 · 누적 관측 7.56 s keyring_38a2d58fb440223e3e220a82f38a2261_1_0_4
마지막 관측 (key chain)
exo2 · t=8:36 (f12924) · 98px
질의 시점(최종 프레임, 정책 입력)
exo1 · t=8:38 (f12973) · 16px

restore 질의 3행

restore:train_3994__0:q00 restore origin=first single navigate cross_room hops=1 from hidden store_in
“Pick up the salt shaker and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_3994__0:q01
  • salt shaker: 지금 bedroom / dresser 안(닫힘) [3.786, 10.408, 0.555] → 되돌릴 곳 kitchen / dining table [6.561, 7.818, 0.791] · 변위 3.796 m · 원래 자리 관측 12.48 s · 이웃 0.719 m saltshaker_ae8db92b68885e8a5331b49cf1534319_1_0_6
원래 자리 증거 (salt shaker @ dining table)
exo1 · t=1:06 (f1674) · 1114px
지금 자리 확정 직후 (salt shaker @ dresser 안(닫힘))
exo1 · t=4:03 (f6089) · 0px
질의 시점(최종 프레임)
exo1 · t=8:38 (f12973) · 0px
restore:train_3994__0:q01 restore origin=first single navigate same_room hops=1 shift
“Pick up the remote control and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_3994__0:q03
  • remote control: 지금 bedroom / dresser [3.862, 10.727, 0.682] → 되돌릴 곳 bedroom / dining table [2.726, 6.022, 0.792] · 변위 4.84 m · 원래 자리 관측 10.56 s · 이웃 0.22 m remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_1_0_4
원래 자리 증거 (remote control @ dining table)
exo1 · t=5:23 (f8094) · 1541px
지금 자리 확정 직후 (remote control @ dresser)
exo1 · t=7:19 (f10999) · 1121px
질의 시점(최종 프레임)
exo1 · t=8:38 (f12973) · 0px
restore:train_3994__0:q02 restore origin=first multi navigate cross_room hops=1 from hidden navigate same_room hops=1 shift store_in
“Pick up the salt shaker and place it in or on where it first was, then pick up the remote control and place it in or on where it first was”
정답 (지금 → 원래, 반경 0.15 m 상태 목표) · 공유: find:train_3994__0:q01, find:train_3994__0:q03, restore:train_3994__0:q00, restore:train_3994__0:q01
  • salt shaker: 지금 bedroom / dresser 안(닫힘) [3.786, 10.408, 0.555] → 되돌릴 곳 kitchen / dining table [6.561, 7.818, 0.791] · 변위 3.796 m · 원래 자리 관측 12.48 s · 이웃 0.719 m saltshaker_ae8db92b68885e8a5331b49cf1534319_1_0_6
  • remote control: 지금 bedroom / dresser [3.862, 10.727, 0.682] → 되돌릴 곳 bedroom / dining table [2.726, 6.022, 0.792] · 변위 4.84 m · 원래 자리 관측 10.56 s · 이웃 0.22 m remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_1_0_4
원래 자리 증거 (salt shaker @ dining table)
exo1 · t=1:06 (f1674) · 1114px
지금 자리 확정 직후 (salt shaker @ dresser 안(닫힘))
exo1 · t=4:03 (f6089) · 0px
원래 자리 증거 (remote control @ dining table)
exo1 · t=5:23 (f8094) · 1541px
지금 자리 확정 직후 (remote control @ dresser)
exo1 · t=7:19 (f10999) · 1121px
질의 시점(최종 프레임)
exo1 · t=8:38 (f12973) · 0px

4전수 검수 결과 (100편 · 911행 · 답 1,078)

검사 스크립트 tmp/hf_check/inspect_bcaf2815.py. 가시성은 traj.h5 tracked_obj_pixels(캠별 픽셀 수) 기준 ≥50 px(README의 observed 기준과 동일). 순서: 확인 필요 → 문서/라벨 → 알려진 한계 → 통과.

등급검사건수설명 · 목록
🔴 확인 필요find_answer_visible_in_query_frame(exo1 최종)141정책 입력인 질의 프레임(exo1, steps_emitted-1 이하 마지막 유효 픽셀 행)에서 정답 물체 ≥50 px. 기억 없이 지각으로 답 가능(A1 위반 후보). 픽셀 크기별 층화:
가족≥50 px
≈7×7		≥200 px
≈14×14		≥500 px
≈22×22		≥1000 px
≈32×32		≥3000 px데이터셋 자체 s_since_last_seen ≤0.2 s (어느 캠이든)
find (답 645)141 (22%)
마지막 이벤트 물체 79 · target 90 / distractor 51		96 (15%)
마지막 이벤트 물체 56 · target 64 / distractor 32		47 (7%)
마지막 이벤트 물체 24 · target 26 / distractor 21		17 (3%)
마지막 이벤트 물체 4 · target 5 / distractor 12		6 (1%)
마지막 이벤트 물체 0 · target 0 / distractor 6		159
restore (답 433)156 (36%)
마지막 이벤트 물체 151		110 (25%)
마지막 이벤트 물체 107		55 (13%)
마지막 이벤트 물체 54		9 (2%)
마지막 이벤트 물체 9		0 (0%)
마지막 이벤트 물체 0		162
권고: 러너에서 ≥200 px(또는 s_since_last_seen=0) 행을 제외하거나 'perception-answerable' 층으로 병기. 주의: tracked_obj_pixels는 5프레임 희소 샘플(-1 행)이라 마지막 행을 그대로 쓰면 과소집계됨(첫 집계 26건 → 정정 141건).
목록 40/141
{"qid": "find:train_1299__2:q02", "obj": "pen_4d17f13875116fae2c6b573c6744bf41_1_0_7", "px_last": 98, "s_since_last_seen": 0.1, "concealment": "open", "kind": "find_
{"qid": "find:train_1362__0:q01", "obj": "vase_e3478e74916159222cb33c5c329dc2b8_2_0_2", "px_last": 866, "s_since_last_seen": 0.0, "concealment": "open", "kind": "fin
{"qid": "find:train_1362__2:q01", "obj": "mug_92c42ca5366a9cee73d1919f977d8b28_1_0_6", "px_last": 721, "s_since_last_seen": 0.2, "concealment": "open", "kind": "find
{"qid": "find:train_1847__1:q01", "obj": "cellulartelephone_8c2887320948bf2580f27f36caf806e5_1_0_6", "px_last": 280, "s_since_last_seen": 0.0, "concealment": "open", "kind&quo
{"qid": "find:train_1847__1:q04", "obj": "boiler_335af387651d9869b84abf1fb099bf69_1_0_6", "px_last": 967, "s_since_last_seen": 0.0, "concealment": "open", "kind": "f
{"qid": "find:train_1949__2:q03", "obj": "box_376bd8a46eebebb53a1cbbec2a1cada0_1_0_4", "px_last": 5896, "s_since_last_seen": 0.2, "concealment": "open", "kind": "fin
{"qid": "find:train_2102__1:q01", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "px_last": 629, "s_since_last_seen": 0.1, "concealment": "open", "kind":
{"qid": "find:train_2159__2:q00", "obj": "keyring_d00ffcd9ee39d88e4515ebf84ba49223_2_0_7", "px_last": 111, "s_since_last_seen": 0.2, "concealment": "open", "kind": "
{"qid": "find:train_2169__1:q00", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_1_0_6", "px_last": 61, "s_since_last_seen": 0.1, "concealment": "open", "kind": &qu
{"qid": "find:train_2169__1:q02", "obj": "Irishpotato_7e99b9af5fea5d3c6962e0b45b535d9a_1_0_6", "px_last": 310, "s_since_last_seen": 0.1, "concealment": "open", "kind": &q
{"qid": "find:train_2169__1:q03", "obj": "apple_3ba162ab0dad65eea7fa36524aba6825_1_0_6", "px_last": 174, "s_since_last_seen": 0.1, "concealment": "open", "kind": "fi
{"qid": "find:train_2224__0:q00", "obj": "remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_4", "px_last": 347, "s_since_last_seen": 0.1, "concealment": "open", "kind":
{"qid": "find:train_2224__2:q02", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_1_0_7", "px_last": 141, "s_since_last_seen": 0.1, "concealment": "open", "kind":
{"qid": "find:train_2277__2:q03", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7", "px_last": 752, "s_since_last_seen": 0.0, "concealment": "open", "kind":
{"qid": "find:train_2571__0:q01", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7", "px_last": 469, "s_since_last_seen": 0.1, "concealment": "open", "kind":
{"qid": "find:train_2571__0:q02", "obj": "knife_7db4ef03593a98cc5b883c623dde8d9f_1_0_6", "px_last": 81, "s_since_last_seen": 0.1, "concealment": "open", "kind": "fin
{"qid": "find:train_2571__0:q03", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_3_0_6", "px_last": 89, "s_since_last_seen": 0.1, "concealment": "open", "kind": &qu
{"qid": "find:train_2571__0:q04", "obj": "cup_dae0e5a693f3ef8e56f0000c68e4dafe_1_0_6", "px_last": 71, "s_since_last_seen": 0.1, "concealment": "open", "kind": "find_
{"qid": "find:train_2571__1:q03", "obj": "cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_1_0_4", "px_last": 303, "s_since_last_seen": 0.2, "concealment": "open", "kind&quo
{"qid": "find:train_2738__0:q02", "obj": "mug_3ebc45568ed53a18c8797978b3744a99_1_0_6", "px_last": 367, "s_since_last_seen": 0.2, "concealment": "open", "kind": "find
{"qid": "find:train_2788__2:q00", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_1_0_2", "px_last": 414, "s_since_last_seen": 0.0, "concealment": "open", "kind":
{"qid": "find:train_2850__2:q01", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "px_last": 114, "s_since_last_seen": 0.2, "concealment": "open", "kind": "fi
{"qid": "find:train_2850__2:q03", "obj": "boiler_335af387651d9869b84abf1fb099bf69_1_0_6", "px_last": 3165, "s_since_last_seen": 0.2, "concealment": "open", "kind": "
{"qid": "find:train_2850__2:q04", "obj": "vase_e3478e74916159222cb33c5c329dc2b8_1_0_6", "px_last": 487, "s_since_last_seen": 0.2, "concealment": "open", "kind": "fin
{"qid": "find:train_2853__0:q00", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "px_last": 276, "s_since_last_seen": 0.1, "concealment": "open", "kind":
{"qid": "find:train_2853__2:q00", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_2_0_7", "px_last": 362, "s_since_last_seen": 0.0, "concealment": "open", "kind":
{"qid": "find:train_2853__2:q03", "obj": "vase_6cb319ff57e79d3745bd6ac29c8adb3d_1_0_7", "px_last": 4369, "s_since_last_seen": 0.0, "concealment": "open", "kind": "fi
{"qid": "find:train_2894__0:q02", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_7", "px_last": 369, "s_since_last_seen": 0.2, "concealment": "open", "kind":
{"qid": "find:train_3058__1:q02", "obj": "bowl_9ba419563c05c6548d5cece5273f15fa_1_0_7", "px_last": 1048, "s_since_last_seen": 0.0, "concealment": "open", "kind": "fi
{"qid": "find:train_3058__1:q04", "obj": "ladle_9c306e3043202395854ae4a3cba13e79_1_0_6", "px_last": 165, "s_since_last_seen": 0.0, "concealment": "open", "kind": "fi
{"qid": "find:train_3058__1:q05", "obj": "cup_a4bc4557e863c56d9b0accc2703dbbe4_1_0_6", "px_last": 362, "s_since_last_seen": 0.0, "concealment": "open", "kind": "find
{"qid": "find:train_3060__1:q01", "obj": "mug_3ebc45568ed53a18c8797978b3744a99_1_0_6", "px_last": 492, "s_since_last_seen": 0.1, "concealment": "open", "kind": "find
{"qid": "find:train_3060__2:q00", "obj": "mug_38903e9f02926f380b587d1b9de9c00b_1_0_2", "px_last": 542, "s_since_last_seen": 0.0, "concealment": "open", "kind": "find
{"qid": "find:train_3060__2:q02", "obj": "fork_a17d780ca6a79038b069eb7768c962c4_1_0_6", "px_last": 157, "s_since_last_seen": 0.0, "concealment": "open", "kind": "fin
{"qid": "find:train_3060__2:q03", "obj": "butterknife_f211d9b5a6beb604cda0c1df985a0093_1_0_6", "px_last": 173, "s_since_last_seen": 0.0, "concealment": "open", "kind": &q
{"qid": "find:train_3060__2:q04", "obj": "bowl_ab2df3cd7ba6e36f1f725f462a622119_1_0_6", "px_last": 604, "s_since_last_seen": 0.0, "concealment": "open", "kind": "fin
{"qid": "find:train_3426__1:q01", "obj": "spatula_291e31b285474249721c8a7b1bac877a_3_0_6", "px_last": 319, "s_since_last_seen": 0.0, "concealment": "open", "kind": "
{"qid": "find:train_3553__2:q01", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "px_last": 243, "s_since_last_seen": 0.0, "concealment": "open", "kind": "fi
{"qid": "find:train_3553__2:q05", "obj": "butterknife_f211d9b5a6beb604cda0c1df985a0093_1_0_6", "px_last": 286, "s_since_last_seen": 0.0, "concealment": "open", "kind": &q
{"qid": "find:train_3655__0:q02", "obj": "tissuepaper_1f28299e6e99a63de7abb400051cb351_1_0_4", "px_last": 3145, "s_since_last_seen": 0.2, "concealment": "open", "kind": &
… 외 101건
🔴 확인 필요restore_from_visible_in_query_frame(exo1 최종)156위와 같음(restore의 '지금 자리'). 되돌릴 곳(to)은 여전히 기억 필요하므로 절반 위반 — 그러나 '어디서 집을지'는 지각으로 해결되어 난이도가 크게 내려감. 151/156이 마지막 이벤트 물체.
목록 40/156
{"qid": "restore:train_1299__2:q01", "obj": "pen_4d17f13875116fae2c6b573c6744bf41_1_0_7", "px_last": 98, "s_since_last_seen": 0.1}
{"qid": "restore:train_1299__2:q02", "obj": "pen_4d17f13875116fae2c6b573c6744bf41_1_0_7", "px_last": 98, "s_since_last_seen": 0.1}
{"qid": "restore:train_1362__0:q00", "obj": "vase_e3478e74916159222cb33c5c329dc2b8_2_0_2", "px_last": 866, "s_since_last_seen": 0.0}
{"qid": "restore:train_1362__0:q01", "obj": "vase_e3478e74916159222cb33c5c329dc2b8_2_0_2", "px_last": 866, "s_since_last_seen": 0.0}
{"qid": "restore:train_1362__0:q03", "obj": "vase_e3478e74916159222cb33c5c329dc2b8_2_0_2", "px_last": 866, "s_since_last_seen": 0.0}
{"qid": "restore:train_1362__2:q01", "obj": "mug_92c42ca5366a9cee73d1919f977d8b28_1_0_6", "px_last": 721, "s_since_last_seen": 0.2}
{"qid": "restore:train_1362__2:q02", "obj": "mug_92c42ca5366a9cee73d1919f977d8b28_1_0_6", "px_last": 721, "s_since_last_seen": 0.2}
{"qid": "restore:train_2102__1:q00", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "px_last": 629, "s_since_last_seen": 0.1}
{"qid": "restore:train_2102__1:q01", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "px_last": 629, "s_since_last_seen": 0.1}
{"qid": "restore:train_2102__1:q03", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "px_last": 629, "s_since_last_seen": 0.1}
{"qid": "restore:train_2159__2:q00", "obj": "keyring_d00ffcd9ee39d88e4515ebf84ba49223_2_0_7", "px_last": 111, "s_since_last_seen": 0.2}
{"qid": "restore:train_2159__2:q01", "obj": "keyring_d00ffcd9ee39d88e4515ebf84ba49223_2_0_7", "px_last": 111, "s_since_last_seen": 0.2}
{"qid": "restore:train_2159__2:q05", "obj": "keyring_d00ffcd9ee39d88e4515ebf84ba49223_2_0_7", "px_last": 111, "s_since_last_seen": 0.2}
{"qid": "restore:train_2169__1:q00", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_1_0_6", "px_last": 61, "s_since_last_seen": 0.1}
{"qid": "restore:train_2224__0:q01", "obj": "remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_4", "px_last": 347, "s_since_last_seen": 0.1}
{"qid": "restore:train_2277__2:q02", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7", "px_last": 752, "s_since_last_seen": 0.0}
{"qid": "restore:train_2277__2:q03", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7", "px_last": 752, "s_since_last_seen": 0.0}
{"qid": "restore:train_2571__0:q01", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7", "px_last": 469, "s_since_last_seen": 0.1}
{"qid": "restore:train_2571__0:q02", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7", "px_last": 469, "s_since_last_seen": 0.1}
{"qid": "restore:train_2571__1:q04", "obj": "cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_1_0_4", "px_last": 303, "s_since_last_seen": 0.2}
{"qid": "restore:train_2738__0:q00", "obj": "mug_3ebc45568ed53a18c8797978b3744a99_1_0_6", "px_last": 367, "s_since_last_seen": 0.2}
{"qid": "restore:train_2788__2:q01", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_1_0_2", "px_last": 414, "s_since_last_seen": 0.0}
{"qid": "restore:train_2850__2:q01", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "px_last": 114, "s_since_last_seen": 0.2}
{"qid": "restore:train_2853__0:q01", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "px_last": 276, "s_since_last_seen": 0.1}
{"qid": "restore:train_2853__2:q01", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_2_0_7", "px_last": 362, "s_since_last_seen": 0.0}
{"qid": "restore:train_2894__0:q02", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_7", "px_last": 369, "s_since_last_seen": 0.2}
{"qid": "restore:train_2894__0:q03", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_7", "px_last": 369, "s_since_last_seen": 0.2}
{"qid": "restore:train_3058__1:q01", "obj": "bowl_9ba419563c05c6548d5cece5273f15fa_1_0_7", "px_last": 1048, "s_since_last_seen": 0.0}
{"qid": "restore:train_3058__1:q02", "obj": "bowl_9ba419563c05c6548d5cece5273f15fa_1_0_7", "px_last": 1048, "s_since_last_seen": 0.0}
{"qid": "restore:train_3060__1:q00", "obj": "mug_3ebc45568ed53a18c8797978b3744a99_1_0_6", "px_last": 492, "s_since_last_seen": 0.1}
{"qid": "restore:train_3060__2:q00", "obj": "mug_38903e9f02926f380b587d1b9de9c00b_1_0_2", "px_last": 542, "s_since_last_seen": 0.0}
{"qid": "restore:train_3426__1:q01", "obj": "spatula_291e31b285474249721c8a7b1bac877a_3_0_6", "px_last": 319, "s_since_last_seen": 0.0}
{"qid": "restore:train_3553__2:q01", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "px_last": 243, "s_since_last_seen": 0.0}
{"qid": "restore:train_3553__2:q02", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "px_last": 243, "s_since_last_seen": 0.0}
{"qid": "restore:train_3553__2:q04", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "px_last": 243, "s_since_last_seen": 0.0}
{"qid": "restore:train_3655__2:q00", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "px_last": 629, "s_since_last_seen": 0.0}
{"qid": "restore:train_3655__2:q01", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "px_last": 629, "s_since_last_seen": 0.0}
{"qid": "restore:train_3655__2:q03", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "px_last": 629, "s_since_last_seen": 0.0}
{"qid": "restore:train_3679__1:q01", "obj": "cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_1_0_4", "px_last": 443, "s_since_last_seen": 0.1}
{"qid": "restore:train_3912__0:q02", "obj": "tennisracket_edf5e4729620638cc9e4a4ff5550c4ff_1_0_4", "px_last": 1012, "s_since_last_seen": 0.0}
… 외 116건
🟠 문서/라벨find_answer_seen_last5s(any cam)166마지막 5 s 안에 어느 카메라든 ≥50 px. 대부분 wrist(108)·마지막 이벤트가 방금 놓은 물체. 영상 전체를 보는 모델에겐 '끝부분 보기'로 환원되는 행 — 최근성 편중의 근거.
목록 40/166
{"qid": "find:train_1299__2:q02", "obj": "pen_4d17f13875116fae2c6b573c6744bf41_1_0_7", "px": {"wrist_camera": 3157, "exo_camera_1": 102, "exo_camera_2": 95}, "kind": &quo
{"qid": "find:train_1362__0:q01", "obj": "vase_e3478e74916159222cb33c5c329dc2b8_2_0_2", "px": {"wrist_camera": 40849, "exo_camera_1": 867, "exo_camera_2": 864}, "kind": &
{"qid": "find:train_1362__2:q01", "obj": "mug_92c42ca5366a9cee73d1919f977d8b28_1_0_6", "px": {"wrist_camera": 24697, "exo_camera_1": 777, "exo_camera_2": 724}, "kind": &q
{"qid": "find:train_1847__1:q00", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_2_0_6", "px": {"wrist_camera": 0, "exo_camera_1": 50, "exo_camera_2": 0}, "kind": &
{"qid": "find:train_1847__1:q01", "obj": "cellulartelephone_8c2887320948bf2580f27f36caf806e5_1_0_6", "px": {"wrist_camera": 0, "exo_camera_1": 292, "exo_camera_2": 106}, "kind
{"qid": "find:train_1847__1:q04", "obj": "boiler_335af387651d9869b84abf1fb099bf69_1_0_6", "px": {"wrist_camera": 0, "exo_camera_1": 1043, "exo_camera_2": 46}, "kind": &qu
{"qid": "find:train_188__2:q02", "obj": "mug_92c42ca5366a9cee73d1919f977d8b28_1_0_4", "px": {"wrist_camera": 24442, "exo_camera_1": 10, "exo_camera_2": 0}, "kind": "
{"qid": "find:train_1949__2:q03", "obj": "box_376bd8a46eebebb53a1cbbec2a1cada0_1_0_4", "px": {"wrist_camera": 0, "exo_camera_1": 5897, "exo_camera_2": 2891}, "kind": &quo
{"qid": "find:train_2102__1:q01", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "px": {"wrist_camera": 31531, "exo_camera_1": 640, "exo_camera_2": 637}, "kind
{"qid": "find:train_2159__2:q00", "obj": "keyring_d00ffcd9ee39d88e4515ebf84ba49223_2_0_7", "px": {"wrist_camera": 6646, "exo_camera_1": 131, "exo_camera_2": 156}, "kind":
{"qid": "find:train_2169__1:q00", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_1_0_6", "px": {"wrist_camera": 0, "exo_camera_1": 61, "exo_camera_2": 126}, "kind":
{"qid": "find:train_2169__1:q02", "obj": "Irishpotato_7e99b9af5fea5d3c6962e0b45b535d9a_1_0_6", "px": {"wrist_camera": 23919, "exo_camera_1": 311, "exo_camera_2": 307}, "kind&q
{"qid": "find:train_2169__1:q03", "obj": "apple_3ba162ab0dad65eea7fa36524aba6825_1_0_6", "px": {"wrist_camera": 0, "exo_camera_1": 174, "exo_camera_2": 0}, "kind": "
{"qid": "find:train_2224__0:q00", "obj": "remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_4", "px": {"wrist_camera": 15388, "exo_camera_1": 353, "exo_camera_2": 353}, "kind
{"qid": "find:train_2224__2:q02", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_1_0_7", "px": {"wrist_camera": 34959, "exo_camera_1": 218, "exo_camera_2": 437}, "kind
{"qid": "find:train_2277__2:q03", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7", "px": {"wrist_camera": 34179, "exo_camera_1": 753, "exo_camera_2": 745}, "kind
{"qid": "find:train_2571__0:q01", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7", "px": {"wrist_camera": 0, "exo_camera_1": 471, "exo_camera_2": 605}, "kind&quo
{"qid": "find:train_2571__0:q02", "obj": "knife_7db4ef03593a98cc5b883c623dde8d9f_1_0_6", "px": {"wrist_camera": 0, "exo_camera_1": 81, "exo_camera_2": 0}, "kind": "f
{"qid": "find:train_2571__0:q03", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_3_0_6", "px": {"wrist_camera": 0, "exo_camera_1": 89, "exo_camera_2": 218}, "kind":
{"qid": "find:train_2571__0:q04", "obj": "cup_dae0e5a693f3ef8e56f0000c68e4dafe_1_0_6", "px": {"wrist_camera": 0, "exo_camera_1": 71, "exo_camera_2": 107}, "kind": "f
{"qid": "find:train_2571__1:q03", "obj": "cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_1_0_4", "px": {"wrist_camera": 26677, "exo_camera_1": 797, "exo_camera_2": 889}, "
{"qid": "find:train_2738__0:q02", "obj": "mug_3ebc45568ed53a18c8797978b3744a99_1_0_6", "px": {"wrist_camera": 29830, "exo_camera_1": 626, "exo_camera_2": 666}, "kind": &q
{"qid": "find:train_2788__2:q00", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_7", "px": {"wrist_camera": 0, "exo_camera_1": 21, "exo_camera_2": 88}, "kind"
{"qid": "find:train_2788__2:q00", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_1_0_2", "px": {"wrist_camera": 29536, "exo_camera_1": 534, "exo_camera_2": 584}, "kind
{"qid": "find:train_2850__2:q01", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "px": {"wrist_camera": 9549, "exo_camera_1": 150, "exo_camera_2": 146}, "kind": &
{"qid": "find:train_2850__2:q03", "obj": "boiler_335af387651d9869b84abf1fb099bf69_1_0_6", "px": {"wrist_camera": 25385, "exo_camera_1": 3174, "exo_camera_2": 604}, "kind"
{"qid": "find:train_2850__2:q04", "obj": "vase_e3478e74916159222cb33c5c329dc2b8_1_0_6", "px": {"wrist_camera": 0, "exo_camera_1": 487, "exo_camera_2": 787}, "kind": "
{"qid": "find:train_2853__0:q00", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "px": {"wrist_camera": 0, "exo_camera_1": 286, "exo_camera_2": 275}, "kind&quo
{"qid": "find:train_2853__2:q00", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "px": {"wrist_camera": 58, "exo_camera_1": 9, "exo_camera_2": 12}, "kind"
{"qid": "find:train_2853__2:q00", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_2_0_7", "px": {"wrist_camera": 20951, "exo_camera_1": 626, "exo_camera_2": 626}, "kind
{"qid": "find:train_2853__2:q03", "obj": "vase_6cb319ff57e79d3745bd6ac29c8adb3d_1_0_7", "px": {"wrist_camera": 12875, "exo_camera_1": 4370, "exo_camera_2": 2836}, "kind":
{"qid": "find:train_2894__0:q02", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_7", "px": {"wrist_camera": 30269, "exo_camera_1": 541, "exo_camera_2": 551}, "kind
{"qid": "find:train_3058__1:q02", "obj": "bowl_9ba419563c05c6548d5cece5273f15fa_1_0_7", "px": {"wrist_camera": 57961, "exo_camera_1": 1053, "exo_camera_2": 1051}, "kind":
{"qid": "find:train_3058__1:q04", "obj": "ladle_9c306e3043202395854ae4a3cba13e79_1_0_6", "px": {"wrist_camera": 0, "exo_camera_1": 166, "exo_camera_2": 0}, "kind": "
{"qid": "find:train_3058__1:q05", "obj": "cup_a4bc4557e863c56d9b0accc2703dbbe4_1_0_6", "px": {"wrist_camera": 0, "exo_camera_1": 364, "exo_camera_2": 0}, "kind": "fi
{"qid": "find:train_3060__1:q01", "obj": "mug_3ebc45568ed53a18c8797978b3744a99_1_0_6", "px": {"wrist_camera": 17147, "exo_camera_1": 707, "exo_camera_2": 730}, "kind": &q
{"qid": "find:train_3060__2:q00", "obj": "mug_38903e9f02926f380b587d1b9de9c00b_1_0_2", "px": {"wrist_camera": 16968, "exo_camera_1": 827, "exo_camera_2": 837}, "kind": &q
{"qid": "find:train_3060__2:q02", "obj": "fork_a17d780ca6a79038b069eb7768c962c4_1_0_6", "px": {"wrist_camera": 2, "exo_camera_1": 160, "exo_camera_2": 81}, "kind": "
{"qid": "find:train_3060__2:q03", "obj": "butterknife_f211d9b5a6beb604cda0c1df985a0093_1_0_6", "px": {"wrist_camera": 690, "exo_camera_1": 174, "exo_camera_2": 114}, "kind&quo
{"qid": "find:train_3060__2:q04", "obj": "bowl_ab2df3cd7ba6e36f1f725f462a622119_1_0_6", "px": {"wrist_camera": 5, "exo_camera_1": 619, "exo_camera_2": 685}, "kind": "
… 외 126건
🔴 확인 필요find_referent_ambiguous(tracked 기준)55지시어 '{name}'가 답이 아닌 같은 종류의 (distractor: 안 옮겨진 / target: 옮겨진) 추적 물체도 가리킴. other_seen=true면 그 물체가 영상에 ≥1 s 보였음(에이전트 입장에서도 모호). body id 채점이라 다른 놈을 집으면 오답.
목록 40/55
{"qid": "find:train_2102__1:q05", "kind": "find_distractor", "name": "mug", "others": [{"obj": "mug_8caf1bb3f88e9a00e02dfe9e6518ae", "seen_s": 81.2, "moved
{"qid": "find:train_2169__1:q00", "kind": "find_distractor", "name": "butter knife", "others": [{"obj": "butterknife_b2b8a251c5e331c4017267", "seen_s": 116.0, &
{"qid": "find:train_2224__0:q03", "kind": "find_distractor", "name": "bowl", "others": [{"obj": "bowl_e39b26ad821ce047b69262973c668", "seen_s": 125.4, "mov
{"qid": "find:train_2224__2:q03", "kind": "find_distractor", "name": "bowl", "others": [{"obj": "bowl_e39b26ad821ce047b69262973c668", "seen_s": 110.0, "mov
{"qid": "find:train_2277__2:q03", "kind": "find_target", "name": "remote control", "others": [{"obj": "remotecontrol_bbeb7464bb8b20b11df7", "seen_s": 234.5, &qu
{"qid": "find:train_2571__1:q05", "kind": "find_distractor", "name": "statue", "others": [{"obj": "statue_59b4e93be5e649fe613e418b442", "seen_s": 76.2, "mo
{"qid": "find:train_2738__0:q02", "kind": "find_target", "name": "mug", "others": [{"obj": "mug_92c42ca5366a9cee73d1919f977d8b", "seen_s": 230.2, "moved_m&
{"qid": "find:train_2788__2:q03", "kind": "find_distractor", "name": "cell phone", "others": [{"obj": "cellulartelephone_43b2396be97b1322", "seen_s": 0.0, "
{"qid": "find:train_2850__2:q01", "kind": "find_distractor", "name": "spoon", "others": [{"obj": "spoon_573130d7496422c068be3abf14b0", "seen_s": 86.2, "mov
{"qid": "find:train_3060__1:q04", "kind": "find_distractor", "name": "egg", "others": [{"obj": "egg_143cc099b6d14cc76bd777884d9115", "seen_s": 0.0, "moved_
{"qid": "find:train_306__0:q02", "kind": "find_distractor", "name": "bowl", "others": [{"obj": "bowl_050ccb7961f5339621100e94a140a", "seen_s": 98.6, "moved
{"qid": "find:train_306__0:q04", "kind": "find_distractor", "name": "vase", "others": [{"obj": "vase_0db9e9dc4d41a9e8ceaa58f142da5", "seen_s": 97.6, "moved
{"qid": "find:train_3377__1:q03", "kind": "find_distractor", "name": "statue", "others": [{"obj": "statue_c1ca41050692ad4a2d2e80d2a1b", "seen_s": 135.8, "m
{"qid": "find:train_3377__1:q04", "kind": "find_distractor", "name": "bowl", "others": [{"obj": "bowl_ab2df3cd7ba6e36f1f725f462a622", "seen_s": 37.2, "move
{"qid": "find:train_3426__1:q03", "kind": "find_distractor", "name": "watch", "others": [{"obj": "watch_2c183ccd1b97775b41d0d0980e57", "seen_s": 38.6, "mov
{"qid": "find:train_3667__0:q04", "kind": "find_distractor", "name": "statue", "others": [{"obj": "statue_8f60e95827b135b407ff02f97b9", "seen_s": 35.4, "mo
{"qid": "find:train_3679__1:q00", "kind": "find_distractor", "name": "remote control", "others": [{"obj": "remotecontrol_488ea7924f7cb4d329c9", "seen_s": 72.2,
{"qid": "find:train_3679__2:q00", "kind": "find_distractor", "name": "remote control", "others": [{"obj": "remotecontrol_488ea7924f7cb4d329c9", "seen_s": 71.0,
{"qid": "find:train_3916__0:q05", "kind": "find_distractor", "name": "pen", "others": [{"obj": "pen_9e010d48d638214946c4f369c6b49f", "seen_s": 71.2, "moved
{"qid": "find:train_3994__0:q05", "kind": "find_distractor", "name": "watch", "others": [{"obj": "watch_2c183ccd1b97775b41d0d0980e57", "seen_s": 0.0, "move
{"qid": "find:train_3994__0:q06", "kind": "find_distractor", "name": "key chain", "others": [{"obj": "keyring_d00ffcd9ee39d88e4515ebf84b", "seen_s": 0.0, "
{"qid": "find:train_4136__1:q01", "kind": "find_distractor", "name": "butter knife", "others": [{"obj": "butterknife_b2b8a251c5e331c4017267", "seen_s": 85.8, &q
{"qid": "find:train_4360__2:q04", "kind": "find_distractor", "name": "mug", "others": [{"obj": "mug_ac3a060b0c3963b34d55fe717f30ee", "seen_s": 0.0, "moved_
{"qid": "find:train_5258__1:q02", "kind": "find_distractor", "name": "bowl", "others": [{"obj": "bowl_3de66decf562bae81288daf307c42", "seen_s": 50.0, "move
{"qid": "find:train_5374__2:q02", "kind": "find_distractor", "name": "statue", "others": [{"obj": "statue_c1ca41050692ad4a2d2e80d2a1b", "seen_s": 6.4, "mov
{"qid": "find:train_6233__1:q03", "kind": "find_distractor", "name": "pencil", "others": [{"obj": "pencil_3ac298d0e9edd6f3e95879aa253", "seen_s": 82.6, "mo
{"qid": "find:train_6242__1:q03", "kind": "find_distractor", "name": "pencil", "others": [{"obj": "pencil_bc899382af3e1ceff65bab5aa36", "seen_s": 8.0, "mov
{"qid": "find:train_6659__1:q00", "kind": "find_distractor", "name": "spoon", "others": [{"obj": "spoon_573130d7496422c068be3abf14b0", "seen_s": 80.8, "mov
{"qid": "find:train_6659__1:q05", "kind": "find_distractor", "name": "bowl", "others": [{"obj": "bowl_ab2df3cd7ba6e36f1f725f462a622", "seen_s": 0.0, "moved
{"qid": "find:train_6728__2:q03", "kind": "find_distractor", "name": "cell phone", "others": [{"obj": "cellulartelephone_79d8184170561922", "seen_s": 49.4, &quo
{"qid": "find:train_6762__1:q03", "kind": "find_distractor", "name": "bowl", "others": [{"obj": "bowl_80746f55d05634985152668dea787", "seen_s": 86.8, "move
{"qid": "find:train_6818__2:q03", "kind": "find_distractor", "name": "cell phone", "others": [{"obj": "cellulartelephone_43b2396be97b1322", "seen_s": 99.4, &quo
{"qid": "find:train_6818__2:q04", "kind": "find_distractor", "name": "bowl", "others": [{"obj": "bowl_4d97da0c296398947839b0e020453", "seen_s": 36.0, "move
{"qid": "find:train_6878__2:q04", "kind": "find_distractor", "name": "watch", "others": [{"obj": "watch_2c183ccd1b97775b41d0d0980e57", "seen_s": 0.0, "move
{"qid": "find:train_6878__2:q05", "kind": "find_distractor", "name": "spray bottle", "others": [{"obj": "atomizer_6f646752c976a94a62a697958", "seen_s": 111.6, &
{"qid": "find:train_6998__0:q04", "kind": "find_distractor", "name": "cell phone", "others": [{"obj": "cellulartelephone_f65c71e22b7e94dd", "seen_s": 76.0, &quo
{"qid": "find:train_6998__0:q06", "kind": "find_distractor", "name": "statue", "others": [{"obj": "statue_69507cc77982294b42ae477f429", "seen_s": 97.6, "mo
{"qid": "find:train_6998__2:q04", "kind": "find_distractor", "name": "cell phone", "others": [{"obj": "cellulartelephone_f65c71e22b7e94dd", "seen_s": 79.4, &quo
{"qid": "find:train_6998__2:q06", "kind": "find_distractor", "name": "statue", "others": [{"obj": "statue_69507cc77982294b42ae477f429", "seen_s": 102.2, "m
{"qid": "find:train_7152__1:q04", "kind": "find_distractor", "name": "bowl", "others": [{"obj": "bowl_b389900f385a224adfc6bfda9c92f", "seen_s": 0.0, "moved
… 외 15건
🔴 확인 필요restore_referent_ambiguous(tracked 기준)24같은 종류의 다른 물체도 ≥1 m 옮겨졌는데 답에 없음(README '한 지시어 한 지시대상' 규칙 위반 후보). twin_nearby 14 / 아님 10.
목록 24/24
{"qid": "restore:train_1362__0:q02", "kind": "restore", "name": "mug", "others": [{"obj": "mug_38903e9f02926f380b587d1b9de9c0", "seen_s": 132.6, "moved_m&q
{"qid": "restore:train_1362__0:q03", "kind": "restore", "name": "vase+mug", "others": [{"obj": "mug_38903e9f02926f380b587d1b9de9c0", "seen_s": 132.6, "move
{"qid": "restore:train_1362__2:q01", "kind": "restore", "name": "mug", "others": [{"obj": "mug_38903e9f02926f380b587d1b9de9c0", "seen_s": 138.0, "moved_m&q
{"qid": "restore:train_1362__2:q02", "kind": "restore", "name": "vase+mug", "others": [{"obj": "mug_38903e9f02926f380b587d1b9de9c0", "seen_s": 138.0, "move
{"qid": "restore:train_2277__2:q02", "kind": "restore", "name": "remote control", "others": [{"obj": "remotecontrol_bbeb7464bb8b20b11df7", "seen_s": 234.5, &quo
{"qid": "restore:train_2277__2:q03", "kind": "restore", "name": "salt shaker+tissue box+remote control", "others": [{"obj": "remotecontrol_bbeb7464bb8b20b11df7", "se
{"qid": "restore:train_2738__0:q00", "kind": "restore", "name": "mug", "others": [{"obj": "mug_92c42ca5366a9cee73d1919f977d8b", "seen_s": 230.2, "moved_m&q
{"qid": "restore:train_3060__2:q00", "kind": "restore", "name": "mug", "others": [{"obj": "mug_3ebc45568ed53a18c8797978b3744a", "seen_s": 212.1, "moved_m&q
{"qid": "restore:train_6056__2:q02", "kind": "restore", "name": "remote control", "others": [{"obj": "remotecontrol_dbbd4afce0b009e98224", "seen_s": 113.8, &quo
{"qid": "restore:train_6056__2:q03", "kind": "restore", "name": "mug+remote control", "others": [{"obj": "remotecontrol_dbbd4afce0b009e98224", "seen_s": 113.8,
{"qid": "restore:train_6728__2:q02", "kind": "restore", "name": "remote control", "others": [{"obj": "remotecontrol_9e0a946ebd9862fe7ffb", "seen_s": 185.2, &quo
{"qid": "restore:train_6728__2:q03", "kind": "restore", "name": "spatula+remote control", "others": [{"obj": "remotecontrol_9e0a946ebd9862fe7ffb", "seen_s": 185
{"qid": "restore:train_6844__2:q00", "kind": "restore", "name": "key chain", "others": [{"obj": "keyring_38a2d58fb440223e3e220a82f3", "seen_s": 80.0, "move
{"qid": "restore:train_6844__2:q01", "kind": "restore", "name": "key chain", "others": [{"obj": "keyring_38a2d58fb440223e3e220a82f3", "seen_s": 80.0, "move
{"qid": "restore:train_6844__2:q03", "kind": "restore", "name": "key chain+cell phone", "others": [{"obj": "keyring_38a2d58fb440223e3e220a82f3", "seen_s": 80.0,
{"qid": "restore:train_7036__0:q03", "kind": "restore", "name": "cell phone", "others": [{"obj": "cellulartelephone_8c2887320948bf25", "seen_s": 266.6, "mo
{"qid": "restore:train_7036__0:q04", "kind": "restore", "name": "remote control+potato+cell phone", "others": [{"obj": "cellulartelephone_8c2887320948bf25", "seen_s&
{"qid": "restore:train_7845__2:q00", "kind": "restore", "name": "remote control", "others": [{"obj": "remotecontrol_488ea7924f7cb4d329c9", "seen_s": 77.6, "
{"qid": "restore:train_7845__2:q01", "kind": "restore", "name": "remote control", "others": [{"obj": "remotecontrol_488ea7924f7cb4d329c9", "seen_s": 77.6, "
{"qid": "restore:train_7845__2:q03", "kind": "restore", "name": "remote control+apple", "others": [{"obj": "remotecontrol_488ea7924f7cb4d329c9", "seen_s": 77.6,
{"qid": "restore:train_9320__2:q03", "kind": "restore", "name": "mug", "others": [{"obj": "mug_ac3a060b0c3963b34d55fe717f30ee", "seen_s": 284.5, "moved_m&q
{"qid": "restore:train_9320__2:q04", "kind": "restore", "name": "remote control+spatula+mug", "others": [{"obj": "mug_ac3a060b0c3963b34d55fe717f30ee", "seen_s":
{"qid": "restore:train_9797__1:q02", "kind": "restore", "name": "mug", "others": [{"obj": "mug_3ebc45568ed53a18c8797978b3744a", "seen_s": 188.4, "moved_m&q
{"qid": "restore:train_9797__1:q03", "kind": "restore", "name": "candle+mug", "others": [{"obj": "mug_3ebc45568ed53a18c8797978b3744a", "seen_s": 188.4, "mo
🟠 문서/라벨restore_same_room_but_hops40README는 n_hops를 '건넌 방 수'라 하지만 same_room=True에 n_hops=2가 40답. other_origins 개수 분포(0:265·1:133·2:35)와 n_hops(1:265·2:168)가 정확히 일치 → n_hops = 물체 이동 횟수. 문서 수정 필요.
목록 40/40
{"qid": "restore:train_2102__1:q00", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "n_hops": 2}
{"qid": "restore:train_2102__1:q03", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "n_hops": 2}
{"qid": "restore:train_2224__0:q01", "obj": "remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_4", "n_hops": 2}
{"qid": "restore:train_2788__2:q01", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_7", "n_hops": 2}
{"qid": "restore:train_3377__1:q00", "obj": "ladle_9c306e3043202395854ae4a3cba13e79_1_0_6", "n_hops": 2}
{"qid": "restore:train_3377__1:q03", "obj": "ladle_9c306e3043202395854ae4a3cba13e79_1_0_6", "n_hops": 2}
{"qid": "restore:train_3553__2:q01", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "n_hops": 2}
{"qid": "restore:train_3553__2:q04", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "n_hops": 2}
{"qid": "restore:train_3912__0:q01", "obj": "cellulartelephone_8c2887320948bf2580f27f36caf806e5_2_0_7", "n_hops": 2}
{"qid": "restore:train_3912__2:q01", "obj": "cellulartelephone_8c2887320948bf2580f27f36caf806e5_2_0_7", "n_hops": 2}
{"qid": "restore:train_3916__0:q00", "obj": "spatula_291e31b285474249721c8a7b1bac877a_2_0_6", "n_hops": 2}
{"qid": "restore:train_3916__0:q03", "obj": "spatula_291e31b285474249721c8a7b1bac877a_2_0_6", "n_hops": 2}
{"qid": "restore:train_4360__2:q01", "obj": "keyring_d00ffcd9ee39d88e4515ebf84ba49223_1_0_7", "n_hops": 2}
{"qid": "restore:train_4360__2:q03", "obj": "keyring_d00ffcd9ee39d88e4515ebf84ba49223_1_0_7", "n_hops": 2}
{"qid": "restore:train_5258__1:q00", "obj": "butterknife_f211d9b5a6beb604cda0c1df985a0093_1_0_6", "n_hops": 2}
{"qid": "restore:train_5258__1:q03", "obj": "butterknife_f211d9b5a6beb604cda0c1df985a0093_1_0_6", "n_hops": 2}
{"qid": "restore:train_5374__2:q00", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_2_0_4", "n_hops": 2}
{"qid": "restore:train_5374__2:q03", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_2_0_4", "n_hops": 2}
{"qid": "restore:train_573__0:q00", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_2_0_4", "n_hops": 2}
{"qid": "restore:train_573__0:q03", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_2_0_4", "n_hops": 2}
{"qid": "restore:train_573__2:q00", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_1_0_4", "n_hops": 2}
{"qid": "restore:train_573__2:q03", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_1_0_4", "n_hops": 2}
{"qid": "restore:train_597__2:q01", "obj": "tissuepaper_1f28299e6e99a63de7abb400051cb351_1_0_4", "n_hops": 2}
{"qid": "restore:train_6242__1:q00", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_4", "n_hops": 2}
{"qid": "restore:train_6242__1:q03", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_4", "n_hops": 2}
{"qid": "restore:train_6376__2:q00", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_2_0_6", "n_hops": 2}
{"qid": "restore:train_6376__2:q03", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_2_0_6", "n_hops": 2}
{"qid": "restore:train_6728__2:q00", "obj": "spatula_291e31b285474249721c8a7b1bac877a_1_0_6", "n_hops": 2}
{"qid": "restore:train_6728__2:q03", "obj": "spatula_291e31b285474249721c8a7b1bac877a_1_0_6", "n_hops": 2}
{"qid": "restore:train_7385__0:q00", "obj": "remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_4", "n_hops": 2}
{"qid": "restore:train_7385__0:q04", "obj": "remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_4", "n_hops": 2}
{"qid": "restore:train_7650__2:q01", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_1_0_6", "n_hops": 2}
{"qid": "restore:train_7650__2:q04", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_1_0_6", "n_hops": 2}
{"qid": "restore:train_7845__2:q00", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7", "n_hops": 2}
{"qid": "restore:train_7845__2:q03", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7", "n_hops": 2}
{"qid": "restore:train_8239__1:q01", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_2_0_6", "n_hops": 2}
{"qid": "restore:train_8239__1:q04", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_2_0_6", "n_hops": 2}
{"qid": "restore:train_899__1:q01", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_1_0_7", "n_hops": 2}
{"qid": "restore:train_9651__2:q00", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "n_hops": 2}
{"qid": "restore:train_9651__2:q03", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "n_hops": 2}
🟠 문서/라벨find_distractor_obj_was_moved10README 'never touched'와 달리 로봇이 옮겼다가 원래 자리로 되돌린(왕복, misplaced=not_moved) 물체가 distractor로 분류됨. wording에 'I moved earlier'가 없으므로 기억상 '초기 자리'가 답인 건 맞음 — 문서화만 필요.
목록 10/10
{"qid": "find:train_2169__1:q00", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_1_0_6"}
{"qid": "find:train_2850__2:q01", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6"}
{"qid": "find:train_2894__0:q00", "obj": "spatula_291e31b285474249721c8a7b1bac877a_2_0_6"}
{"qid": "find:train_3679__1:q00", "obj": "remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_4"}
{"qid": "find:train_3679__2:q00", "obj": "remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_4"}
{"qid": "find:train_4136__1:q01", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_2_0_6"}
{"qid": "find:train_4360__2:q02", "obj": "knife_0bc93f198121d33ac4030a34bfc944a4_1_0_6"}
{"qid": "find:train_5258__1:q02", "obj": "bowl_9ba419563c05c6548d5cece5273f15fa_1_0_7"}
{"qid": "find:train_6659__1:q00", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_1_0_6"}
{"qid": "find:train_9584__2:q02", "obj": "cup_dae0e5a693f3ef8e56f0000c68e4dafe_1_0_6"}
🟠 문서/라벨find_distractor_misplaced10위 10행과 동일(not_moved 라벨).
목록 10/10
{"qid": "find:train_2169__1:q00", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_1_0_6", "misplaced": "not_moved"}
{"qid": "find:train_2850__2:q01", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "misplaced": "not_moved"}
{"qid": "find:train_2894__0:q00", "obj": "spatula_291e31b285474249721c8a7b1bac877a_2_0_6", "misplaced": "not_moved"}
{"qid": "find:train_3679__1:q00", "obj": "remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_4", "misplaced": "not_moved"}
{"qid": "find:train_3679__2:q00", "obj": "remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_4", "misplaced": "not_moved"}
{"qid": "find:train_4136__1:q01", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_2_0_6", "misplaced": "not_moved"}
{"qid": "find:train_4360__2:q02", "obj": "knife_0bc93f198121d33ac4030a34bfc944a4_1_0_6", "misplaced": "not_moved"}
{"qid": "find:train_5258__1:q02", "obj": "bowl_9ba419563c05c6548d5cece5273f15fa_1_0_7", "misplaced": "not_moved"}
{"qid": "find:train_6659__1:q00", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_1_0_6", "misplaced": "not_moved"}
{"qid": "find:train_9584__2:q02", "obj": "cup_dae0e5a693f3ef8e56f0000c68e4dafe_1_0_6", "misplaced": "not_moved"}
🟠 문서/라벨restore_shares_with_distractor7위 왕복 물체의 restore(origin=previous) 7행 — 정상 동작(이전 자리=왕복 전 자리).
목록 7/7
{"qid": "restore:train_2169__1:q00", "share": "find:train_2169__1:q00"}
{"qid": "restore:train_2850__2:q01", "share": "find:train_2850__2:q01"}
{"qid": "restore:train_2894__0:q00", "share": "find:train_2894__0:q00"}
{"qid": "restore:train_3679__1:q00", "share": "find:train_3679__1:q00"}
{"qid": "restore:train_3679__2:q00", "share": "find:train_3679__2:q00"}
{"qid": "restore:train_4136__1:q01", "share": "find:train_4136__1:q01"}
{"qid": "restore:train_6659__1:q00", "share": "find:train_6659__1:q00"}
🟠 문서/라벨restore_misplaced_answer16restore 답의 misplaced≠no (wrong_surface 9 · not_moved 7). find 쪽 라벨 복사값이며 restore 채점엔 무관. not_moved는 전부 origin=previous 왕복 사례.
목록 16/16
{"qid": "restore:train_1847__1:q00", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_2_0_6", "misplaced": "wrong_surface", "d_xy": 3.492}
{"qid": "restore:train_1847__1:q02", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_2_0_6", "misplaced": "wrong_surface", "d_xy": 3.492}
{"qid": "restore:train_2169__1:q00", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_1_0_6", "misplaced": "not_moved", "d_xy": 3.612}
{"qid": "restore:train_2850__2:q01", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "misplaced": "not_moved", "d_xy": 3.225}
{"qid": "restore:train_2853__0:q01", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "misplaced": "wrong_surface", "d_xy": 11.23}
{"qid": "restore:train_2853__2:q01", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_2_0_7", "misplaced": "wrong_surface", "d_xy": 11.217}
{"qid": "restore:train_2894__0:q00", "obj": "spatula_291e31b285474249721c8a7b1bac877a_2_0_6", "misplaced": "not_moved", "d_xy": 6.987}
{"qid": "restore:train_3679__1:q00", "obj": "remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_4", "misplaced": "not_moved", "d_xy": 6.262}
{"qid": "restore:train_3679__2:q00", "obj": "remotecontrol_488ea7924f7cb4d329c991926df62222_2_0_4", "misplaced": "not_moved", "d_xy": 6.261}
{"qid": "restore:train_4133__1:q00", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_2_0_7", "misplaced": "wrong_surface", "d_xy": 6.174}
{"qid": "restore:train_4133__1:q01", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_2_0_7", "misplaced": "wrong_surface", "d_xy": 6.174}
{"qid": "restore:train_4136__1:q01", "obj": "butterknife_b2b8a251c5e331c4017267a6e05c76d5_2_0_6", "misplaced": "not_moved", "d_xy": 8.819}
{"qid": "restore:train_4584__0:q00", "obj": "cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_1_0_6", "misplaced": "wrong_surface", "d_xy": 5.446}
{"qid": "restore:train_6659__1:q00", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_1_0_6", "misplaced": "not_moved", "d_xy": 6.849}
{"qid": "restore:train_9026__1:q00", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_3_0_7", "misplaced": "wrong_surface", "d_xy": 11.918}
{"qid": "restore:train_9026__1:q04", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_3_0_7", "misplaced": "wrong_surface", "d_xy": 11.918}
🟠 문서/라벨answer_room_name_unresolved(방 채점 제외)13GT room 정수에 이름을 못 붙인 답(3편). 채점기는 이 답의 방을 채점하지 않음. 생성 쪽에서 방 이름을 직접 내보내면 해소.
목록 13/13
{"qid": "find:train_2894__0:q01", "where": "answer", "room": 7, "surface": "sofa_179bd1ab75baca31cb0ae3e9477b3351_1_0_7"}
{"qid": "find:train_2894__0:q02", "where": "answer", "room": 2, "surface": "diningtable_62e787a3885245c34cc3330240910beb_1_0_2"}
{"qid": "restore:train_2894__0:q00", "where": "to", "room": 7, "surface": "chestofdrawers_fdf8ab53e7ce731f1fcbde4be80ad603_1_0_7"}
{"qid": "restore:train_2894__0:q01", "where": "from", "room": 7, "surface": "sofa_179bd1ab75baca31cb0ae3e9477b3351_1_0_7"}
{"qid": "restore:train_2894__0:q01", "where": "to", "room": 7, "surface": "diningtable_089acb80b74f0348b7337b13ac73b412_1_0_7"}
{"qid": "restore:train_2894__0:q02", "where": "from", "room": 2, "surface": "diningtable_62e787a3885245c34cc3330240910beb_1_0_2"}
{"qid": "restore:train_2894__0:q02", "where": "to", "room": 7, "surface": "sofa_179bd1ab75baca31cb0ae3e9477b3351_1_0_7"}
{"qid": "restore:train_2894__0:q03", "where": "from", "room": 7, "surface": "sofa_179bd1ab75baca31cb0ae3e9477b3351_1_0_7"}
{"qid": "restore:train_2894__0:q03", "where": "to", "room": 7, "surface": "diningtable_089acb80b74f0348b7337b13ac73b412_1_0_7"}
{"qid": "restore:train_2894__0:q03", "where": "from", "room": 2, "surface": "diningtable_62e787a3885245c34cc3330240910beb_1_0_2"}
{"qid": "restore:train_2894__0:q03", "where": "to", "room": 7, "surface": "sofa_179bd1ab75baca31cb0ae3e9477b3351_1_0_7"}
{"qid": "find:train_6376__2:q01", "where": "answer", "room": 2, "surface": null}
{"qid": "find:train_9909__2:q02", "where": "answer", "room": 5, "surface": "crapper_cd6fa77f725b7ec4a4ced5913731ae93_1_0_5"}
🟠 문서/라벨find_hidden_without_fixture1hidden인데 candidates.fixture=null (train_4584__0 q01, relabel_note: 2026-08-27 수동 예외). B 규칙(fixture=정답 표면) 적용 불가 → 표면 채점 불가.
목록 1/1
{"qid": "find:train_4584__0:q01", "obj": "atomizer_106cc065bd80d8fb1bc55c4321a47876_1_0_5"}
🟡 알려진 한계restore_neighbor_inside_r_place82r_place 0.15 m 안에 다른 물체(README 명시 82/433, 중앙 0.113 m). 이웃 위에 놓아도 성공 판정. d_nearest_obj로 행별 반경 축소 가능.
목록 40/82
{"qid": "restore:train_1299__2:q00", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_4", "d_nearest_obj": 0.033, "twin_nearby": false}
{"qid": "restore:train_1299__2:q02", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_4", "d_nearest_obj": 0.033, "twin_nearby": false}
{"qid": "restore:train_1362__0:q00", "obj": "vase_e3478e74916159222cb33c5c329dc2b8_2_0_2", "d_nearest_obj": 0.14, "twin_nearby": true}
{"qid": "restore:train_1362__0:q03", "obj": "vase_e3478e74916159222cb33c5c329dc2b8_2_0_2", "d_nearest_obj": 0.14, "twin_nearby": true}
{"qid": "restore:train_1362__2:q00", "obj": "vase_e3478e74916159222cb33c5c329dc2b8_2_0_2", "d_nearest_obj": 0.14, "twin_nearby": true}
{"qid": "restore:train_1362__2:q02", "obj": "vase_e3478e74916159222cb33c5c329dc2b8_2_0_2", "d_nearest_obj": 0.14, "twin_nearby": true}
{"qid": "restore:train_2159__2:q04", "obj": "mug_ac3a060b0c3963b34d55fe717f30ee52_1_0_4", "d_nearest_obj": 0.119, "twin_nearby": false}
{"qid": "restore:train_2224__2:q00", "obj": "keyring_38a2d58fb440223e3e220a82f38a2261_1_0_4", "d_nearest_obj": 0.053, "twin_nearby": false}
{"qid": "restore:train_2224__2:q02", "obj": "keyring_38a2d58fb440223e3e220a82f38a2261_1_0_4", "d_nearest_obj": 0.053, "twin_nearby": false}
{"qid": "restore:train_2277__2:q01", "obj": "tissuepaper_1f28299e6e99a63de7abb400051cb351_1_0_7", "d_nearest_obj": 0.1, "twin_nearby": false}
{"qid": "restore:train_2277__2:q03", "obj": "tissuepaper_1f28299e6e99a63de7abb400051cb351_1_0_7", "d_nearest_obj": 0.1, "twin_nearby": false}
{"qid": "restore:train_2571__0:q01", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7", "d_nearest_obj": 0.113, "twin_nearby": false}
{"qid": "restore:train_2571__0:q02", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7", "d_nearest_obj": 0.113, "twin_nearby": false}
{"qid": "restore:train_2571__1:q01", "obj": "mug_ac3a060b0c3963b34d55fe717f30ee52_2_0_6", "d_nearest_obj": 0.092, "twin_nearby": true}
{"qid": "restore:train_2571__1:q03", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7", "d_nearest_obj": 0.113, "twin_nearby": false}
{"qid": "restore:train_2571__1:q05", "obj": "mug_ac3a060b0c3963b34d55fe717f30ee52_2_0_6", "d_nearest_obj": 0.092, "twin_nearby": true}
{"qid": "restore:train_2571__1:q05", "obj": "remotecontrol_9e0a946ebd9862fe7ffbf14025fdf9f9_1_0_7", "d_nearest_obj": 0.113, "twin_nearby": true}
{"qid": "restore:train_2853__0:q00", "obj": "tissuepaper_1f28299e6e99a63de7abb400051cb351_1_0_4", "d_nearest_obj": 0.105, "twin_nearby": false}
{"qid": "restore:train_2853__0:q01", "obj": "tissuepaper_1f28299e6e99a63de7abb400051cb351_1_0_4", "d_nearest_obj": 0.105, "twin_nearby": false}
{"qid": "restore:train_3426__1:q00", "obj": "fabric_1d4926b5c1b42cd47346841d572270a6_1_0_2", "d_nearest_obj": 0.072, "twin_nearby": false}
{"qid": "restore:train_3553__2:q01", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "d_nearest_obj": 0.126, "twin_nearby": true}
{"qid": "restore:train_3553__2:q03", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_7", "d_nearest_obj": 0.098, "twin_nearby": false}
{"qid": "restore:train_3553__2:q04", "obj": "spoon_573130d7496422c068be3abf14b0dcf0_2_0_6", "d_nearest_obj": 0.126, "twin_nearby": true}
{"qid": "restore:train_3553__2:q04", "obj": "remotecontrol_dbbd4afce0b009e98224c7453fb4cfc5_1_0_7", "d_nearest_obj": 0.098, "twin_nearby": true}
{"qid": "restore:train_3655__0:q00", "obj": "candle_ef48126e155d4ed0804b46d4b3a42ca2_1_0_7", "d_nearest_obj": 0.123, "twin_nearby": false}
{"qid": "restore:train_3655__2:q02", "obj": "candle_ef48126e155d4ed0804b46d4b3a42ca2_1_0_7", "d_nearest_obj": 0.123, "twin_nearby": false}
{"qid": "restore:train_3655__2:q03", "obj": "candle_ef48126e155d4ed0804b46d4b3a42ca2_1_0_7", "d_nearest_obj": 0.123, "twin_nearby": true}
{"qid": "restore:train_3912__0:q00", "obj": "cellulartelephone_8c2887320948bf2580f27f36caf806e5_2_0_7", "d_nearest_obj": 0.132, "twin_nearby": true}
{"qid": "restore:train_3912__0:q03", "obj": "cellulartelephone_8c2887320948bf2580f27f36caf806e5_2_0_7", "d_nearest_obj": 0.132, "twin_nearby": true}
{"qid": "restore:train_3944__0:q00", "obj": "cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_2_0_7", "d_nearest_obj": 0.116, "twin_nearby": true}
{"qid": "restore:train_3944__0:q02", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_1_0_4", "d_nearest_obj": 0.106, "twin_nearby": true}
{"qid": "restore:train_3944__0:q02", "obj": "cellulartelephone_f65c71e22b7e94dd68f01167ec92b467_2_0_7", "d_nearest_obj": 0.116, "twin_nearby": true}
{"qid": "restore:train_4136__1:q00", "obj": "Irishpotato_19522f313a33f0a662dcc0b1aa19547c_1_0_6", "d_nearest_obj": 0.086, "twin_nearby": false}
{"qid": "restore:train_4136__1:q03", "obj": "Irishpotato_19522f313a33f0a662dcc0b1aa19547c_1_0_6", "d_nearest_obj": 0.086, "twin_nearby": false}
{"qid": "restore:train_4304__0:q00", "obj": "keyring_d00ffcd9ee39d88e4515ebf84ba49223_3_0_4", "d_nearest_obj": 0.053, "twin_nearby": true}
{"qid": "restore:train_4304__0:q02", "obj": "keyring_d00ffcd9ee39d88e4515ebf84ba49223_3_0_4", "d_nearest_obj": 0.053, "twin_nearby": true}
{"qid": "restore:train_4355__0:q01", "obj": "egg_7fd793a25a1787b313419b96729cfc58_1_0_6", "d_nearest_obj": 0.107, "twin_nearby": false}
{"qid": "restore:train_4355__0:q02", "obj": "egg_7fd793a25a1787b313419b96729cfc58_1_0_6", "d_nearest_obj": 0.107, "twin_nearby": false}
{"qid": "restore:train_4392__2:q00", "obj": "remotecontrol_bbeb7464bb8b20b11df78329c1bd9460_1_0_4", "d_nearest_obj": 0.143, "twin_nearby": true}
{"qid": "restore:train_4887__0:q00", "obj": "mug_3ebc45568ed53a18c8797978b3744a99_1_0_2", "d_nearest_obj": 0.127, "twin_nearby": false}
… 외 42건
통과restore_no_find_share0find 공유 답 없는 restore 행.
통과restore_shares_missing_find0shares_answer_with의 find id 부재.
통과restore_shares_missing_restore0shares_answer_with의 restore id 부재.
통과restore_from_xyz_vs_find0공유 find 답과 from.xyz 불일치(>1 cm).
통과restore_from_concealment_vs_find0공유 find 답과 concealment 불일치.
통과restore_shares_obj_mismatch0공유 find 행에 같은 물체 없음.
통과n_candidates_mismatch0n_candidates ≠ len(answers).
통과steps_vs_answers0steps(multi) ↔ 답 수 불일치.
통과context_frames_vs_meta0context_frames ≠ [0, n_steps-1].
통과find_budget_formula0find budget ≠ 1500/2500(hidden).
통과restore_budget_formula0restore budget ≠ 5000 + 900·hidden + 3500·(절-1).
통과plural_form0multi 질의 복수형 오류(-s/-es/-ies/knives 규칙).
통과find_duplicate_query_text0한 편 안 find 질의문 완전 중복.
통과find_same_name_target_and_distractor0한 편 안 target·distractor 같은 name.
통과find_target_obj_not_in_events0target 답이 이벤트 물체가 아님.
통과find_target_failed_but_not_misplaced0근거 이벤트 실패인데 misplaced=no.
통과find_pick_but_unpickable0scoring=pick인데 pickable=false.
통과find_navonly_but_pickable0navigate_only인데 pickable=true.
통과find_answer_never_observed0답 물체가 영상에 안 나옴.
통과find_answer_seen_lt_1s0답 물체 누적 관측 <1 s.
통과find_answer_not_tracked0답 물체가 tracked_obj_pixels에 없음.
통과find_surface_unlabeled(eval 제외)0표면 미라벨(C 규칙, 러너 제외 대상).
통과restore_surface_unlabeled(eval 제외)0restore from/to 표면 미라벨(러너 제외 대상).
통과restore_obj_not_in_events0restore 답이 이벤트 물체가 아님.
통과restore_d_xy_lt_1m0변위 <1 m.
통과restore_not_placeable0placeable=false.
통과restore_origin_occupied_since0원래 자리가 나중에 점유됨.
통과restore_origin_seen_lt_1s0원래 자리 관측 <1 s.
통과restore_previous_without_other_origins0origin=previous인데 other_origins 없음.
통과restore_same_room_inconsistent0same_room ↔ from/to room 불일치.
통과restore_hidden_from_without_fixture0from hidden인데 fixture 없음.
통과meta_vs_h5_steps0meta.n_steps ≠ steps_emitted+2.
통과visibility_shape0visibility.objects 수 ≠ tracked_obj_pixels K.

검사에 안 잡히지만 알아둘 것

4b후속 질문 — 격자 결과(e987b40f 7모델×7전략, find 질의 파일은 bcaf2815와 바이트 동일)로 확인

Q1. 질의 프레임에 정답이 보이면 blind도 다 맞히나?

다 맞히진 못하지만 3~4배 잘 맞힌다. blind는 메모리 턴 0개 + 질의 프레임 1장(exo1, 정책 입력과 동일)을 받는다. API 4모델 평균 loc: 안 보임 0.15 → 50–199 px 0.56 / 200–499 px 0.39 / ≥500 px 0.51. 보여도 절반은 틀리는 이유는 답이 (방, 표면) 이름이라 프레임에서 방을 알아내야 하고, 작은 물체(50–199 px)는 우연히 로봇이 방금 놓은 자리(마지막 이벤트)라 사전확률로 맞히는 경우가 섞여 있기 때문. 모델별로 blind 적중의 35–50%가 가시 행(139/526)에서 나온다 → G1(blind ≤ chance)과 "blind 대비 이득"이 이 행들에 좌우된다.

모델 (blind)안 보임 (<50px)50–199px200–499px≥500pxhiddenblind 전체(비hidden 526)적중 중 가시 행 몫
flash-3.60.20 (n=387)0.60 (n=45)0.37 (n=49)0.51 (n=45)0.16 (n=63)0.2846%
flash-3.70.14 (n=387)0.60 (n=45)0.43 (n=49)0.58 (n=45)0.08 (n=63)0.2458%
sonnet-50.10 (n=387)0.44 (n=45)0.37 (n=49)0.49 (n=45)0.06 (n=63)0.1862%
luna0.18 (n=387)0.60 (n=45)0.41 (n=49)0.44 (n=45)0.08 (n=63)0.2650%
qwen3vl-8b0.24 (n=387)0.47 (n=45)0.41 (n=49)0.31 (n=45)0.05 (n=63)0.2837%
cosmos-r2-8b0.38 (n=387)0.56 (n=45)0.35 (n=49)0.33 (n=45)0.08 (n=63)0.3928%
molmo2-8b0.31 (n=387)0.47 (n=45)0.20 (n=49)0.38 (n=45)0.13 (n=63)0.3229%
blind by kind (API 평균)안 보임 (<50px)50–199px200–499px≥500pxhidden
blind · target0.15 (n=152)0.54 (n=26)0.31 (n=38)0.53 (n=25)0.10 (n=53)
blind · distractor0.16 (n=235)0.59 (n=19)0.68 (n=11)0.47 (n=20)0.05 (n=10)

전략별로도 가시 행에서 일괄 상승(textlog 0.37→0.78, frames 0.44→0.66). 즉 가시 행은 모든 전략에 '지각 보너스'를 주고, 그 크기가 전략마다 달라 순위에도 영향.

전략 (API 4모델 평균 loc)안 보임 (<50px)50–199px200–499px≥500pxhidden
blind0.150.560.390.510.10
textlog0.370.780.780.760.81
frames-uniform0.440.660.430.610.34
rollforward-v20.330.490.460.420.37
rollforward-v30.380.530.470.470.33
rollforward-vis-pure0.510.670.510.580.39
tagmem-r30.390.540.560.560.37
권고: 본표는 ≥200 px 가시 행(96행)을 제외하거나 별도 층으로 병기. blind의 '안 보임' 열(0.10–0.20)이 진짜 대조군 수준이며 chance 0.287보다 확실히 아래 — 가시 행을 빼면 G1은 더 깨끗하게 통과한다.

Q2. 지시어 모호 = 같은 종류 물체가 여러 개 보였다는 뜻인가?

맞다. 예: "Pick up the mug"(distractor)인데 집 안에 로봇이 손대지 않은 다른 머그가 추적 물체로 있고, 그 머그도 영상에 ≥1 s 보였다(55행 중 46). 질의는 'the mug'라서 어느 머그인지 특정할 수 없는데 채점은 body id로 한 개만 정답. target 쪽은 "the mug I moved earlier"인데 로봇이 머그를 2개 옮긴 경우(2행). restore는 같은 종류의 다른 물체도 ≥1 m 옮겨졌는데 답에 없는 경우(24행, 그중 twin_nearby 14 = 바로 옆 쌍둥이).

query_id질의문채점 정답(body id)답이 아닌 같은 종류 추적 물체 (영상 관측 s · 로봇 이동 m)
find:train_2102__1:q05Pick up the mugmug @ kitchen/dining tablemug_8caf1bb3f88e9a00e0… 관측 81.2 s · 이동 0.0 m
find:train_2169__1:q00Pick up all the butter knivesbutter knife @ kitchen/dining table; butter knife @ kitchen/countertopbutterknife_b2b8a251c5… 관측 116.0 s · 이동 0.0 mtwin
find:train_2224__0:q03Pick up the bowlbowl @ bedroom/dining tablebowl_e39b26ad821ce047b… 관측 125.4 s · 이동 0.0 m; bowl_f159d8f5528715d01… 관측 127.4 s · 이동 0.0 m
find:train_2224__2:q03Pick up the bowlbowl @ bedroom/dining tablebowl_e39b26ad821ce047b… 관측 110.0 s · 이동 0.0 m
find:train_2277__2:q03Pick up the remote control I moved earlierremote control @ bedroom/dresserremotecontrol_bbeb7464… 관측 234.5 s · 이동 2.923 m
find:train_2571__1:q05Pick up the statuestatue @ kitchen/dining tablestatue_59b4e93be5e649f… 관측 76.2 s · 이동 0.0 m
find:train_2738__0:q02Pick up the mug I moved earliermug @ bedroom/dining tablemug_92c42ca5366a9cee73… 관측 230.2 s · 이동 3.098 m
find:train_2850__2:q01Pick up the spoonspoon @ kitchen/countertopspoon_573130d7496422c0… 관측 86.2 s · 이동 0.0 mtwin
restore:train_1362__0:q02Pick up the mug and place it in or on where it first wasmug living room/dining table → kitchen/countertopmug_38903e9f02926f380b… 관측 132.6 s · 이동 1.311 m
restore:train_1362__0:q03Pick up the vase and place it in or on where it first was, then pick up the mug and place it in or on where it first wasvase living room/tv stand → bedroom/tv stand; mug living room/dining table → kitchen/countertopmug_38903e9f02926f380b… 관측 132.6 s · 이동 1.311 mtwin
restore:train_1362__2:q01Pick up the mug and place it in or on where it first wasmug living room/dining table → kitchen/countertopmug_38903e9f02926f380b… 관측 138.0 s · 이동 1.311 m
restore:train_1362__2:q02Pick up the vase and place it in or on where it first was, then pick up the mug and place it in or on where it first wasvase living room/tv stand → bedroom/tv stand; mug living room/dining table → kitchen/countertopmug_38903e9f02926f380b… 관측 138.0 s · 이동 1.311 mtwin

읽기 평가(방/표면 이름 채점)에서는 두 물체가 같은 방·표면에 있으면 구분이 안 되므로 적중률 차이가 거의 없다(아래). 실행 평가(body id 집기)에서만 실제 오답으로 드러난다.

distractor(비hidden) 전략 (API 평균 loc)모호(다른 같은 종류 물체 있음)명확
blind0.24 (n=51)0.23 (n=234)
textlog0.28 (n=51)0.14 (n=234)
frames-uniform0.47 (n=51)0.52 (n=234)
rollforward-v20.38 (n=51)0.32 (n=234)
rollforward-v30.42 (n=51)0.43 (n=234)
rollforward-vis-pure0.51 (n=51)0.58 (n=234)
tagmem-r30.39 (n=51)0.40 (n=234)

Q3. 최근성 편중은 Q1과 다른 문제인가? 초반/중간/최근 분포는?

다른 문제다. Q1은 지금 프레임에 보이느냐(지각), Q3은 답이 몇 번째 사건이냐(기억 거리). 겹치긴 한다 — 마지막 이벤트 물체는 로봇이 그 앞에 서 있어서 자주 보인다(가시 141답 중 79가 마지막 이벤트 물체).

find_target 답의 근거 이벤트 위치 (294행)
첫 이벤트
30 (10%)
중간 이벤트
172 (59%)
마지막 성공 이벤트
92 (31%)
restore 답 물체의 마지막 이동 이벤트 위치 (322행)
중간 이벤트
131 (41%)
마지막 성공 이벤트
177 (55%)
첫 이벤트
14 (4%)
find_target: 정답 위치 확정 후 경과 시간 (s_since_settled)
≥360 s
44 (15%)
<60 s
90 (31%)
60–180 s
76 (26%)
180–360 s
84 (29%)

find_target은 첫 30 / 중간 172 / 마지막 92, 경과 시간은 <60 s 90 · 60–180 s 76 · 180–360 s 84 · ≥360 s 44로 대체로 고르다(첫 이벤트 물체가 30으로 얇은 건 첫 이벤트 물체가 뒤에서 다시 옮겨지는 경우가 많아서). restore는 마지막 이벤트 물체가 177/322(55%)로 쏠림 — multi 절에 마지막 물체가 거의 항상 들어가기 때문. 적중률은 모든 전략이 최근일수록 높다(textlog 0.72→0.93, blind 0.18→0.44).

find_target(비hidden) 전략 (API 평균 loc)위치: 첫 이벤트위치: 중간 이벤트위치: 마지막 성공 이벤트정착 후 <60 s정착 후 60–180 s정착 후 180–360 s정착 후 ≥360 s
blind0.18 (n=24)0.15 (n=131)0.44 (n=86)0.44 (n=85)0.17 (n=64)0.14 (n=55)0.15 (n=37)
textlog0.72 (n=24)0.82 (n=131)0.93 (n=86)0.89 (n=85)0.82 (n=64)0.84 (n=55)0.83 (n=37)
frames-uniform0.35 (n=24)0.38 (n=131)0.55 (n=86)0.52 (n=85)0.43 (n=64)0.44 (n=55)0.28 (n=37)
rollforward-v20.49 (n=24)0.36 (n=131)0.44 (n=86)0.42 (n=85)0.38 (n=64)0.41 (n=55)0.37 (n=37)
rollforward-v30.39 (n=24)0.34 (n=131)0.48 (n=86)0.45 (n=85)0.39 (n=64)0.35 (n=55)0.32 (n=37)
rollforward-vis-pure0.50 (n=24)0.42 (n=131)0.58 (n=86)0.53 (n=85)0.50 (n=64)0.43 (n=55)0.43 (n=37)
tagmem-r30.50 (n=24)0.42 (n=131)0.54 (n=86)0.51 (n=85)0.51 (n=64)0.43 (n=55)0.37 (n=37)

Q4. n_hops가 "건넌 방 수"라고 적혀 있나?

README.md 228행 원문: | `n_hops` *(answers)* | rooms crossed: 1 (265) · 2 (168) |. 그런데 same_room=true인 답에도 n_hops=2가 40개 있고(예: restore:train_2102__1:q00 리모컨, 같은 방 같은 식탁 위 1.1 m 이동), n_hops 분포(1:265·2:168)가 other_origins 개수(0:265·1+2:168)와 정확히 같다 → n_hops = 그 물체가 옮겨진 횟수. eval/restore/README.md(필드 사전)에는 n_hops 설명 자체가 없다.

Q5. distractor는 "명령에 포함돼 로봇이 실제로 행동한 물체"가 아니면 되는 것 아닌가?

그 조건도 10행 모두 위반이다. 8행은 로봇이 두 번 명령을 받아 옮겼다가 원래 자리로 되돌린 물체(relocate+twin_merge, 둘 다 ok), 2행은 store_in 명령을 받아 집으려다 실패한 물체(failed_no_place, 이동 0.03–0.05 m). 종료 위치가 초기 위치와 같아서 misplaced=not_moved → distractor로 분류된 것. 기억상 "되돌려졌다"를 알아야 하는 정당한 질문이지만 wording에 'I moved earlier'가 없어 무기억 모델이 유리하다 → 별도 kind(예: find_roundtrip)로 빼거나 제외 권고.

query_id질의문misplaced이 물체가 등장한 이벤트 (subtasks.json)
find:train_2169__1:q00Pick up all the butter knivesnot_moved#0 ok · 3.719 m · - — Pick up the butter knife from the dining table in the kitchen and place it in or on the armchair in the living room
#2 ok · 3.625 m · relocate,twin_merge — Pick up the butter knife from the armchair in the living room and place it in or on the dining table in the kitchen
find:train_2850__2:q01Pick up the spoonnot_moved#1 ok · 3.201 m · - — Pick up the spoon from the countertop in the kitchen and place it in or on the dining table in the living room
#3 ok · 3.23 m · relocate,twin_merge — Pick up the spoon from the dining table in the living room and place it in or on the countertop in the kitchen
find:train_2894__0:q00Pick up all the spatulasnot_moved#0 ok · 6.908 m · - — Pick up the spatula from the countertop in the kitchen and place it in or on the dresser in the living room
#1 ok · 6.991 m · relocate,twin_merge — Pick up the spatula from the dresser in the living room and place it in or on the countertop in the kitchen
find:train_3679__1:q00Pick up the remote controlnot_moved#0 ok · 6.26 m · - — Pick up the remote control from the bed in the bedroom and place it in or on the clothes dryer in the bathroom
#2 ok · 6.265 m · relocate,twin_merge — Pick up the remote control from the clothes dryer in the bathroom and place it in or on the bed in the bedroom
find:train_3679__2:q00Pick up the remote controlnot_moved#0 ok · 6.26 m · - — Pick up the remote control from the bed in the bedroom and place it in or on the clothes dryer in the bathroom
#2 ok · 6.265 m · relocate,twin_merge — Pick up the remote control from the clothes dryer in the bathroom and place it in or on the bed in the bedroom
find:train_4136__1:q01Pick up the butter knifenot_moved#1 ok · 8.556 m · - — Pick up the butter knife from the countertop in the kitchen and place it in or on the dining table in the living room
#2 ok · 8.823 m · relocate,twin_merge — Pick up the butter knife from the dining table in the living room and place it in or on the countertop in the kitchen
find:train_4360__2:q02Pick up the knifenot_moved#2 failed_no_place · 0.034 m · store_in — Pick up the knife from the countertop in the kitchen and put it in the drawer of the dresser in the bedroom
find:train_5258__1:q02Pick up the bowlnot_moved#2 failed · 0.205 m · store_in — Pick up the bowl from the dining table in the living room and put it in the drawer of the dresser in the bedroom
find:train_6659__1:q00Pick up the spoonnot_moved#0 ok · 6.838 m · - — Pick up the spoon from the countertop in the kitchen and place it in or on the shelving unit in the living room
#3 ok · 6.853 m · relocate,twin_merge — Pick up the spoon from the shelving unit in the living room and place it in or on the countertop in the kitchen
find:train_9584__2:q02Pick up the cupnot_moved#3 failed_no_place · 0.047 m · store_in — Pick up the cup from the dining table in the kitchen and put it in the drawer of the shelving unit in the living room

4chidden 분리 보기 — find 63행 · restore from-hidden 56행

hidden = 문이 닫힌 가구(chest of drawers / desk / stand / shelf) 안에 있는 답. 63답 전부 closed_at_end=true. 채점 계약 B: fixture가 정답 표면(엄격). find hidden 63행 = target 53 / distractor 10, scoring open_pick 47 / navigate_only 16, 55편. restore from-hidden 56행 = 전부 origin=first, single 28 / multi 28, 32편, fixture chestofdrawers 31 · desk 15 · shelf 6 · stand 4. 본표(hidden 제외 526행) 결정과 별개로 이 층은 온라인 탐색 성격이라 별도 표.

hidden 63행 loc (전략 × 모델)flash-3.6flash-3.7sonnet-5lunaqwen3vl-8bcosmos-r2-8bmolmo2-8bAPI 평균
blind0.160.080.060.080.050.080.130.10
textlog0.810.810.830.810.680.630.540.81
frames-uniform0.410.440.300.210.100.160.290.34
rollforward-v20.370.570.370.170.140.080.080.37
rollforward-v30.430.380.290.240.020.100.080.33
rollforward-vis-pure0.560.590.210.220.100.110.140.39
tagmem-r30.570.570.170.160.020.050.030.37
읽기: hidden에서 textlog(오라클)만 0.81이고 나머지 전략은 0.33–0.39, blind 0.10 — 문 뒤에 넣는 장면을 기억에서 꺼내는 능력이 갈리는 층. 예시 편 3-1(1299__2 리모컨→서랍), 3-3(9026__1)에서 영상으로 확인 가능.
find hidden 63행 전체
find hidden 63행질의문축정답 (fixture = 채점 표면)
find:train_1299__2:q01Pick up the remote control I moved earliertarget · single · open_pickremote control @ bedroom / dresser 안
find:train_1362__0:q02Pick up the remote controldistractor · single · open_pickremote control @ bedroom / tv stand 안
find:train_1362__0:q03Pick up the cell phonedistractor · single · open_pickcell phone @ bedroom / tv stand 안
find:train_1362__2:q02Pick up the remote controldistractor · single · open_pickremote control @ bedroom / tv stand 안
find:train_1362__2:q03Pick up the cell phonedistractor · single · open_pickcell phone @ bedroom / tv stand 안
find:train_1847__1:q02Pick up the remote control I moved earliertarget · single · open_pickremote control @ bedroom / dresser 안
find:train_188__2:q01Navigate to the egg I moved earliertarget · single · navigate_onlyegg @ living room / tv stand 안
find:train_1949__2:q02Pick up the salt shaker I moved earliertarget · single · open_picksalt shaker @ bedroom / desk 안
find:train_2102__1:q02Pick up the potato I moved earliertarget · single · open_pickirish potato @ bedroom / dresser 안
find:train_2159__2:q01Pick up the egg I moved earliertarget · single · open_pickegg @ bedroom / desk 안
find:train_2169__1:q01Pick up the vase I moved earliertarget · single · open_pickvase @ bedroom / dresser 안
find:train_2224__2:q00Pick up the key chain I moved earliertarget · single · open_pickkey chain @ bedroom / dresser 안
find:train_2571__0:q00Pick up the cell phone I moved earliertarget · single · open_pickcell phone @ bedroom / dresser 안
find:train_2571__1:q02Pick up the remote control I moved earliertarget · single · open_pickremote control @ bedroom / dresser 안
find:train_2853__0:q01Navigate to the egg I moved earliertarget · single · navigate_onlyegg @ bedroom / dresser 안
find:train_2853__0:q03Pick up all the vasesdistractor · multi · open_pick/pickvase @ bedroom / dresser 안; vase @ kitchen / dining table; vase @ living room / dining table
find:train_2853__2:q01Navigate to the egg I moved earliertarget · single · navigate_onlyegg @ bedroom / dresser 안
find:train_2853__2:q03Pick up all the vasesdistractor · multi · open_pick/pickvase @ bedroom / dresser 안; vase @ living room / dining table
find:train_306__0:q00Navigate to the pen I moved earliertarget · single · navigate_onlypen @ bedroom / dresser 안
find:train_3553__2:q02Pick up the remote control I moved earliertarget · single · open_pickremote control @ bedroom / dresser 안
find:train_3655__0:q00Pick up all the mugs I moved earliertarget · multi · navigate_only/pickmug @ bedroom / dresser 안; mug @ bathroom / sink
find:train_3655__2:q01Pick up all the mugs I moved earliertarget · multi · navigate_only/pickmug @ bedroom / dresser 안; mug @ bathroom / sink
find:train_3912__0:q02Pick up the spoon I moved earliertarget · single · open_pickspoon @ bedroom / desk 안
find:train_3912__2:q01Pick up the fork I moved earliertarget · single · open_pickfork @ bedroom / desk 안
find:train_3916__0:q02Pick up the remote control I moved earliertarget · single · open_pickremote control @ bedroom / dresser 안
find:train_3994__0:q01Pick up the salt shaker I moved earliertarget · single · open_picksalt shaker @ bedroom / dresser 안
find:train_3994__0:q04Pick up all the bowlsdistractor · multi · open_pick/pickbowl @ bedroom / dresser 안; bowl @ kitchen / dining table
find:train_4133__1:q02Pick up all the mugs I moved earliertarget · multi · open_pick/pickmug @ bedroom / dresser 안; mug @ bathroom / toilet
find:train_4304__0:q00Pick up the key chain I moved earliertarget · single · open_pickkey chain @ bedroom / dresser 안
find:train_4355__0:q01Navigate to the cell phone I moved earliertarget · single · navigate_onlycell phone @ bedroom / dresser 안
find:train_4584__0:q01Navigate to the spray bottle I moved earliertarget · single · navigate_onlyatomizer @ bathroom / ? 안
find:train_4887__0:q02Pick up the salt shaker I moved earliertarget · single · open_picksalt shaker @ living room / shelf 안
find:train_4887__2:q01Pick up the salt shaker I moved earliertarget · single · open_picksalt shaker @ living room / shelf 안
find:train_5374__2:q01Pick up the cell phone I moved earliertarget · single · open_pickcell phone @ bedroom / dresser 안
find:train_5374__2:q02Navigate to the statuedistractor · single · navigate_onlystatue @ bedroom / dresser 안
find:train_573__0:q00Navigate to the mug I moved earliertarget · single · navigate_onlymug @ bedroom / tv stand 안
find:train_573__2:q02Navigate to the mug I moved earliertarget · single · navigate_onlymug @ bedroom / tv stand 안
find:train_597__0:q01Navigate to the key chain I moved earliertarget · single · navigate_onlykey chain @ bedroom / tv stand 안
find:train_597__2:q00Navigate to the key chain I moved earliertarget · single · navigate_onlykey chain @ bedroom / tv stand 안
find:train_6222__0:q00Pick up all the potatos I moved earliertarget · multi · open_pick/pickirish potato @ kitchen / chair; irish potato @ bedroom / dresser 안
find:train_6222__1:q01Pick up all the potatos I moved earliertarget · multi · navigate_only/open_pickirish potato @ bedroom / dresser 안; irish potato @ kitchen / chair
find:train_6233__1:q01Pick up the spatula I moved earliertarget · single · open_pickspatula @ bedroom / desk 안
find:train_6233__1:q03Pick up the pencildistractor · single · open_pickpencil @ bedroom / desk 안
find:train_6242__1:q02Navigate to the cup I moved earliertarget · single · navigate_onlycup @ bathroom / dresser 안
find:train_6278__1:q00Navigate to the key chain I moved earliertarget · single · navigate_onlykey chain @ bedroom / dresser 안
find:train_6278__2:q02Pick up the key chain I moved earliertarget · single · open_pickkey chain @ bedroom / dresser 안
find:train_6376__2:q01Pick up the cell phone I moved earliertarget · single · open_pickcell phone @ — / dresser 안
find:train_7047__1:q00Pick up the mug I moved earliertarget · single · open_pickmug @ bedroom / dresser 안
find:train_7152__1:q00Pick up all the mugs I moved earliertarget · multi · open_pick/pickmug @ bedroom / dresser 안; mug @ bathroom / toilet
find:train_7385__0:q02Pick up the pepper shaker I moved earliertarget · single · open_pickpepper shaker @ living room / tv stand 안
find:train_7428__1:q02Pick up the bottle I moved earliertarget · single · open_pickbottle @ kitchen / shelf 안
find:train_7428__2:q01Pick up the salt shaker I moved earliertarget · single · open_picksalt shaker @ kitchen / shelf 안
find:train_7661__1:q01Pick up the candle I moved earliertarget · single · open_pickcandle @ bedroom / desk 안
find:train_7845__2:q01Pick up the knife I moved earliertarget · single · open_pickknife @ bedroom / dresser 안
find:train_8102__2:q01Pick up the cell phone I moved earliertarget · single · open_pickcell phone @ bedroom / dresser 안
find:train_8171__0:q00Pick up all the mugs I moved earliertarget · multi · open_pick/pickmug @ bedroom / desk 안; mug @ bathroom / sink
find:train_8171__1:q00Pick up all the mugs I moved earliertarget · multi · open_pick/pickmug @ bedroom / desk 안; mug @ bathroom / sink
find:train_8287__1:q01Pick up the remote control I moved earliertarget · single · open_pickremote control @ bedroom / desk 안
find:train_8287__1:q03Pick up the c ddistractor · single · open_pickCD @ bedroom / desk 안
find:train_899__1:q01Pick up the candle I moved earliertarget · single · open_pickcandle @ living room / tv stand 안
find:train_9026__1:q02Pick up the potato I moved earliertarget · single · open_pickirish potato @ bedroom / dresser 안
find:train_9651__2:q01Navigate to the pen I moved earliertarget · single · navigate_onlypen @ bedroom / dresser 안
find:train_9778__1:q02Pick up the cell phone I moved earliertarget · single · open_pickcell phone @ bedroom / desk 안
restore from-hidden 56행 전체
restore from-hidden 56행질의문축정답 (지금: fixture 안 → 되돌릴 곳)
restore:train_1299__2:q00Pick up the remote control and place it in or on where it first wasorigin=first · single · store_inremote control: dresser 안(bedroom) → bedroom / tv stand
restore:train_1299__2:q02Pick up the remote control and place it in or on where it first was, then pick up the pen and place it in or on where it first wasorigin=first · multi · store_inremote control: dresser 안(bedroom) → bedroom / tv stand; pen: bathroom/toilet → living room/dining table
restore:train_1847__1:q01Pick up the remote control and place it in or on where it first wasorigin=first · single · store_inremote control: dresser 안(bedroom) → living room / dining table
restore:train_1847__1:q02Pick up the butter knife and place it in or on where it first was, then pick up the remote control and place it in or on where it first wasorigin=first · multi · store_inbutter knife: kitchen/countertop → kitchen/countertop; remote control: dresser 안(bedroom) → living room / dining table
restore:train_1949__2:q02Pick up the salt shaker and place it in or on where it first wasorigin=first · single · store_insalt shaker: desk 안(bedroom) → kitchen / countertop
restore:train_1949__2:q03Pick up the pen and place it in or on where it first was, then pick up the salt shaker and place it in or on where it first wasorigin=first · multi · shift,store_inpen: living room/dresser → living room/dining table; salt shaker: desk 안(bedroom) → kitchen / countertop
restore:train_2102__1:q02Pick up the potato and place it in or on where it first wasorigin=first · single · store_inirish potato: dresser 안(bedroom) → kitchen / countertop
restore:train_2102__1:q03Pick up the remote control and place it in or on where it first was, then pick up the potato and place it in or on where it first wasorigin=first · multi · relocate,store_in,twin_mergeremote control: living room/dining table → living room/dining table; irish potato: dresser 안(bedroom) → kitchen / countertop
restore:train_2159__2:q02Pick up the egg and place it in or on where it first wasorigin=first · single · store_inegg: desk 안(bedroom) → kitchen / countertop
restore:train_2159__2:q05Pick up the key chain and place it in or on where it first was, then pick up the egg and place it in or on where it first was, and then pick up the remote control and place it in or on where it first wasorigin=first · multi · relocate,shift,store_in,twin_mergekey chain: bedroom/dresser → living room/dining table; egg: desk 안(bedroom) → kitchen / countertop; remote control: living room/tv stand → living room/sofa
restore:train_2169__1:q01Pick up the vase and place it in or on where it first wasorigin=first · single · store_invase: dresser 안(bedroom) → living room / tv stand
restore:train_2224__2:q00Pick up the key chain and place it in or on where it first wasorigin=first · single · shift,store_inkey chain: dresser 안(bedroom) → bedroom / tv stand
restore:train_2224__2:q02Pick up the key chain and place it in or on where it first was, then pick up the potato and place it in or on where it first wasorigin=first · multi · shift,store_inkey chain: dresser 안(bedroom) → bedroom / tv stand; irish potato: living room/chair → kitchen/countertop
restore:train_2571__0:q00Pick up the cell phone and place it in or on where it first wasorigin=first · single · shift,store_incell phone: dresser 안(bedroom) → bedroom / dining table
restore:train_2571__0:q02Pick up the cell phone and place it in or on where it first was, then pick up the remote control and place it in or on where it first wasorigin=first · multi · shift,store_incell phone: dresser 안(bedroom) → bedroom / dining table; remote control: kitchen/dining table → living room/tv stand
restore:train_2571__1:q03Pick up the remote control and place it in or on where it first wasorigin=first · single · store_inremote control: dresser 안(bedroom) → living room / tv stand
restore:train_2571__1:q05Pick up the knife and place it in or on where it first was, then pick up the mug and place it in or on where it first was, and then pick up the remote control and place it in or on where it first wasorigin=first · multi · relocate,shift,store_in,twin_mergeknife: kitchen/chair → kitchen/dining table; mug: bedroom/dresser → kitchen/countertop; remote control: dresser 안(bedroom) → living room / tv stand
restore:train_3553__2:q03Pick up the remote control and place it in or on where it first wasorigin=first · single · store_inremote control: dresser 안(bedroom) → living room / dining table
restore:train_3553__2:q04Pick up the bowl and place it in or on where it first was, then pick up the spoon and place it in or on where it first was, and then pick up the remote control and place it in or on where it first wasorigin=first · multi · relocate,shift,store_in,twin_mergebowl: kitchen/dining table → kitchen/countertop; spoon: kitchen/countertop → kitchen/countertop; remote control: dresser 안(bedroom) → living room / dining table
restore:train_3912__2:q02Pick up the fork and place it in or on where it first wasorigin=first · single · store_infork: desk 안(bedroom) → kitchen / dining table
restore:train_3912__2:q04Pick up the cell phone and place it in or on where it first was, then pick up the fork and place it in or on where it first was, and then pick up the tennis racket and place it in or on where it first wasorigin=first · multi · relocate,store_in,twin_mergecell phone: kitchen/dining table → living room/tv stand; fork: desk 안(bedroom) → kitchen / dining table; tennisracket: bathroom/clothes dryer → bedroom/dining table
restore:train_3916__0:q02Pick up the remote control and place it in or on where it first wasorigin=first · single · store_inremote control: dresser 안(bedroom) → living room / dining table
restore:train_3994__0:q00Pick up the salt shaker and place it in or on where it first wasorigin=first · single · store_insalt shaker: dresser 안(bedroom) → kitchen / dining table
restore:train_3994__0:q02Pick up the salt shaker and place it in or on where it first was, then pick up the remote control and place it in or on where it first wasorigin=first · multi · shift,store_insalt shaker: dresser 안(bedroom) → kitchen / dining table; remote control: bedroom/dresser → bedroom/dining table
restore:train_4133__1:q01Pick up the remote control and place it in or on where it first was, then pick up the mugs and place them in or on where they first wereorigin=first · multi · store_inremote control: bedroom/tv stand → living room/tv stand; mug: dresser 안(bedroom) → kitchen / dining table; mug: bathroom/toilet → bedroom/dining table
restore:train_4304__0:q00Pick up the key chain and place it in or on where it first wasorigin=first · single · shift,store_inkey chain: dresser 안(bedroom) → bedroom / tv stand
restore:train_4304__0:q02Pick up the key chain and place it in or on where it first was, then pick up the cup and place it in or on where it first wasorigin=first · multi · shift,store_inkey chain: dresser 안(bedroom) → bedroom / tv stand; cup: living room/armchair → kitchen/dining table
restore:train_4887__0:q03Pick up the salt shaker and place it in or on where it first wasorigin=first · single · store_insalt shaker: shelf 안(living room) → kitchen / countertop
restore:train_4887__0:q04Pick up the mug and place it in or on where it first was, then pick up the key chain and place it in or on where it first was, and then pick up the salt shaker and place it in or on where it first wasorigin=first · multi · relocate,shift,store_in,twin_mergemug: bedroom/armchair → bedroom/tv stand; key chain: living room/dining table → bedroom/armchair; salt shaker: shelf 안(living room) → kitchen / countertop
restore:train_4887__2:q02Pick up the salt shaker and place it in or on where it first wasorigin=first · single · store_insalt shaker: shelf 안(living room) → kitchen / countertop
restore:train_4887__2:q04Pick up the key chain and place it in or on where it first was, then pick up the salt shaker and place it in or on where it first was, and then pick up the tissue box and place it in or on where it first wasorigin=first · multi · relocate,shift,store_in,twin_mergekey chain: living room/dining table → bedroom/armchair; salt shaker: shelf 안(living room) → kitchen / countertop; tissue box: bedroom/tv stand → bedroom/dresser
restore:train_5374__2:q02Pick up the cell phone and place it in or on where it first wasorigin=first · single · shift,store_incell phone: dresser 안(bedroom) → bedroom / desk
restore:train_5374__2:q03Pick up the remote control and place it in or on where it first was, then pick up the cell phone and place it in or on where it first wasorigin=first · multi · relocate,shift,store_in,twin_mergeremote control: bedroom/dresser → bedroom/desk; cell phone: dresser 안(bedroom) → bedroom / desk
restore:train_6233__1:q02Pick up the spatula and place it in or on where it first wasorigin=first · single · store_inspatula: desk 안(bedroom) → kitchen / countertop
restore:train_6233__1:q04Pick up the remote control and place it in or on where it first was, then pick up the spatula and place it in or on where it first was, and then pick up the cell phone and place it in or on where it first wasorigin=first · multi · relocate,shift,store_in,twin_mergeremote control: bedroom/desk → living room/sofa; spatula: desk 안(bedroom) → kitchen / countertop; cell phone: living room/sofa → living room/dining table
restore:train_6278__2:q02Pick up the key chain and place it in or on where it first wasorigin=first · single · shift,store_inkey chain: dresser 안(bedroom) → bedroom / dining table
restore:train_6278__2:q03Pick up the remote control and place it in or on where it first was, then pick up the key chain and place it in or on where it first wasorigin=first · multi · relocate,shift,store_in,twin_mergeremote control: living room/tv stand → bedroom/bed; key chain: dresser 안(bedroom) → bedroom / dining table
restore:train_7047__1:q00Pick up the mug and place it in or on where it first wasorigin=first · single · shift,store_inmug: dresser 안(bedroom) → bedroom / tv stand
restore:train_7047__1:q04Pick up the mug and place it in or on where it first was, then pick up the remote control and place it in or on where it first was, and then pick up the butter knife and place it in or on where it first wasorigin=first · multi · relocate,shift,store_in,twin_mergemug: dresser 안(bedroom) → bedroom / tv stand; remote control: living room/tv stand → bedroom/tv stand; butter knife: living room/cart → kitchen/countertop
restore:train_7152__1:q02Pick up the mugs and place them in or on where they first were, then pick up the remote control and place it in or on where it first wasorigin=first · multi · relocate,shift,store_in,twin_mergemug: dresser 안(bedroom) → bedroom / dining table; mug: bathroom/toilet → kitchen/countertop; remote control: bedroom/chair → living room/dining table
restore:train_7385__0:q03Pick up the pepper shaker and place it in or on where it first wasorigin=first · single · store_inpepper shaker: tv stand 안(living room) → kitchen / dining table
restore:train_7385__0:q04Pick up the remote control and place it in or on where it first was, then pick up the pen and place it in or on where it first was, and then pick up the pepper shaker and place it in or on where it first wasorigin=first · multi · relocate,shift,store_in,twin_mergeremote control: bedroom/bed → bedroom/bed; pen: bedroom/bed → bedroom/dresser; pepper shaker: tv stand 안(living room) → kitchen / dining table
restore:train_7428__2:q01Pick up the salt shaker and place it in or on where it first wasorigin=first · single · shift,store_insalt shaker: shelf 안(kitchen) → kitchen / dining table
restore:train_7428__2:q03Pick up the cell phone and place it in or on where it first was, then pick up the salt shaker and place it in or on where it first was, and then pick up the remote control and place it in or on where it first wasorigin=first · multi · shift,store_incell phone: bedroom/armchair → kitchen/dining table; salt shaker: shelf 안(kitchen) → kitchen / dining table; remote control: living room/tv stand → bedroom/armchair
restore:train_7661__1:q00Pick up the candle and place it in or on where it first wasorigin=first · single · store_incandle: desk 안(bedroom) → living room / tv stand
restore:train_7661__1:q03Pick up the candle and place it in or on where it first was, then pick up the mug and place it in or on where it first was, and then pick up the cell phone and place it in or on where it first wasorigin=first · multi · shift,store_incandle: desk 안(bedroom) → living room / tv stand; mug: kitchen/chair → kitchen/countertop; cell phone: bathroom/toilet → bedroom/dining table
restore:train_8102__2:q01Pick up the cell phone and place it in or on where it first wasorigin=first · single · store_incell phone: dresser 안(bedroom) → living room / sofa
restore:train_8171__0:q00Pick up the mugs and place them in or on where they first wereorigin=first · multi · shift,store_inmug: desk 안(bedroom) → bedroom / tv stand; mug: bathroom/sink → kitchen/countertop
restore:train_8171__1:q00Pick up the mugs and place them in or on where they first wereorigin=first · multi · shift,store_inmug: desk 안(bedroom) → bedroom / tv stand; mug: bathroom/sink → kitchen/countertop
restore:train_8287__1:q01Pick up the remote control and place it in or on where it first wasorigin=first · single · shift,store_inremote control: desk 안(bedroom) → bedroom / dining table
restore:train_899__1:q00Pick up the candle and place it in or on where it first wasorigin=first · single · shift,store_incandle: tv stand 안(living room) → living room / tv stand
restore:train_899__1:q01Pick up the remote controls and place them in or on where they first were, then pick up the candle and place it in or on where it first wasorigin=first · multi · decoy,relocate,shift,store_inremote control: living room/sofa → living room/dining table; remote control: living room/dining table → living room/sofa; candle: tv stand 안(living room) → living room / tv stand
restore:train_9026__1:q02Pick up the potato and place it in or on where it first wasorigin=first · single · store_inirish potato: dresser 안(bedroom) → kitchen / dining table
restore:train_9026__1:q04Pick up the remote control and place it in or on where it first was, then pick up the vase and place it in or on where it first was, and then pick up the potato and place it in or on where it first wasorigin=first · multi · shift,store_inremote control: bedroom/bed → living room/sofa; vase: living room/dining table → living room/tv stand; irish potato: dresser 안(bedroom) → kitchen / dining table
restore:train_9778__1:q00Pick up the cell phone and place it in or on where it first wasorigin=first · single · store_incell phone: desk 안(bedroom) → kitchen / dining table
restore:train_9778__1:q02Pick up the cell phone and place it in or on where it first was, then pick up the key chain and place it in or on where it first wasorigin=first · multi · store_incell phone: desk 안(bedroom) → kitchen / dining table; key chain: bathroom/sink → bedroom/desk

4d가시성 ablation 미리보기 — pseudo-label(GT 픽셀) 기준, 정식 라벨 오면 같은 표로 교체

취지: "정답이 질의 프레임에 보이면 지각으로 이만큼 나오고, 안 보이면 메모리가 필요해서 이만큼 나온다"를 보이는 ablation. 지금은 exo1 질의 프레임의 GT 픽셀 수(§4 표 참조)로 pseudo-label을 붙였고, 데이터 팀이 가시 여부를 표시해 주면 그 라벨로 같은 스크립트(tmp/hf_check/ablation_visibility.py)를 다시 돌리면 된다. find 격자 e987b40f, hidden 63행 제외(526행), 지표 loc(방+표면), API4 = flash-3.6·3.7·sonnet-5·luna 평균, OPEN3 = qwen3vl·cosmos-r2·molmo2 8B 평균.

분할 A — 임계 50 px (보임 139행 / 안 보임 387행)

전략 (loc)API4 보임 (n=139)API4 안 보임 (n=387)Δ 보임−안보임blind 대비 이득 · 보임blind 대비 이득 · 안 보임OPEN3 보임OPEN3 안 보임API4 target 보임/안보임API4 distractor 보임/안보임
blind0.480.15+0.33+0.00+0.000.380.310.44 / 0.150.57 / 0.16
textlog(오라클)0.770.37+0.40+0.29+0.220.590.370.87 / 0.840.60 / 0.07
frames-uniform0.560.44+0.12+0.08+0.290.380.360.52 / 0.390.65 / 0.48
rf-v20.460.33+0.13-0.03+0.180.230.140.44 / 0.380.50 / 0.29
rf-v30.490.38+0.10+0.00+0.230.260.130.47 / 0.350.52 / 0.41
vis-pure0.580.51+0.08+0.10+0.360.450.290.54 / 0.450.66 / 0.55
tagmem-r30.550.39+0.16+0.07+0.240.260.090.53 / 0.440.59 / 0.36
모델별 (보임 / 안 보임)
모델blindtextlog(오라클)frames-uniformrf-v2rf-v3vis-puretagmem-r3
flash-3.60.49 / 0.200.80 / 0.370.63 / 0.540.48 / 0.310.48 / 0.440.62 / 0.640.61 / 0.47
flash-3.70.53 / 0.140.79 / 0.360.66 / 0.530.55 / 0.430.52 / 0.420.60 / 0.670.68 / 0.51
sonnet-50.43 / 0.100.73 / 0.370.42 / 0.350.40 / 0.390.46 / 0.370.49 / 0.340.45 / 0.26
luna0.48 / 0.180.77 / 0.390.55 / 0.350.40 / 0.190.49 / 0.300.63 / 0.390.47 / 0.32
qwen3vl-8b0.40 / 0.240.58 / 0.350.37 / 0.340.21 / 0.090.24 / 0.090.40 / 0.220.24 / 0.09
cosmos-r2-8b0.41 / 0.380.57 / 0.360.43 / 0.380.24 / 0.150.30 / 0.180.52 / 0.300.35 / 0.13
molmo2-8b0.35 / 0.310.62 / 0.400.33 / 0.370.24 / 0.170.23 / 0.130.42 / 0.330.19 / 0.06
최근성 2×2 (API4): 보임·마지막 / 보임·그 외 / 안 보임·마지막 / 안 보임·그 외
전략보임·마지막 이벤트보임·그 외안 보임·마지막안 보임·그 외
blind0.48 (n=78)0.49 (n=61)0.07 (n=14)0.16 (n=373)
textlog(오라클)0.93 (n=78)0.57 (n=61)1.00 (n=14)0.35 (n=373)
frames-uniform0.56 (n=78)0.56 (n=61)0.34 (n=14)0.45 (n=373)
rf-v20.46 (n=78)0.45 (n=61)0.27 (n=14)0.33 (n=373)
rf-v30.50 (n=78)0.47 (n=61)0.30 (n=14)0.39 (n=373)
vis-pure0.56 (n=78)0.61 (n=61)0.46 (n=14)0.51 (n=373)
tagmem-r30.54 (n=78)0.57 (n=61)0.38 (n=14)0.39 (n=373)

분할 B — 임계 200 px (보임 94행 / 안 보임 387행, 50–199 px 94행은 회색지대로 제외)

전략 (loc)API4 보임 (n=94)API4 안 보임 (n=387)Δ 보임−안보임blind 대비 이득 · 보임blind 대비 이득 · 안 보임OPEN3 보임OPEN3 안 보임API4 target 보임/안보임API4 distractor 보임/안보임
blind0.450.15+0.29+0.00+0.000.330.310.40 / 0.150.55 / 0.16
textlog(오라클)0.770.37+0.40+0.32+0.220.590.370.84 / 0.840.63 / 0.07
frames-uniform0.520.44+0.07+0.07+0.290.340.360.48 / 0.390.60 / 0.48
rf-v20.440.33+0.12-0.00+0.180.230.140.43 / 0.380.48 / 0.29
rf-v30.470.38+0.08+0.02+0.230.250.130.46 / 0.350.48 / 0.41
vis-pure0.540.51+0.03+0.10+0.360.400.290.49 / 0.450.65 / 0.55
tagmem-r30.560.39+0.17+0.11+0.240.250.090.51 / 0.440.65 / 0.36
모델별 (보임 / 안 보임)
모델blindtextlog(오라클)frames-uniformrf-v2rf-v3vis-puretagmem-r3
flash-3.60.44 / 0.200.80 / 0.370.57 / 0.540.49 / 0.310.47 / 0.440.55 / 0.640.62 / 0.47
flash-3.70.50 / 0.140.79 / 0.360.61 / 0.530.55 / 0.430.49 / 0.420.60 / 0.670.68 / 0.51
sonnet-50.43 / 0.100.74 / 0.370.43 / 0.350.39 / 0.390.46 / 0.370.46 / 0.340.46 / 0.26
luna0.43 / 0.180.74 / 0.390.46 / 0.350.34 / 0.190.46 / 0.300.56 / 0.390.48 / 0.32
qwen3vl-8b0.36 / 0.240.59 / 0.350.33 / 0.340.21 / 0.090.23 / 0.090.37 / 0.220.24 / 0.09
cosmos-r2-8b0.34 / 0.380.56 / 0.360.39 / 0.380.24 / 0.150.29 / 0.180.44 / 0.300.32 / 0.13
molmo2-8b0.29 / 0.310.61 / 0.400.29 / 0.370.23 / 0.170.22 / 0.130.40 / 0.330.19 / 0.06
최근성 2×2 (API4): 보임·마지막 / 보임·그 외 / 안 보임·마지막 / 안 보임·그 외
전략보임·마지막 이벤트보임·그 외안 보임·마지막안 보임·그 외
blind0.43 (n=55)0.47 (n=39)0.07 (n=14)0.16 (n=373)
textlog(오라클)0.90 (n=55)0.59 (n=39)1.00 (n=14)0.35 (n=373)
frames-uniform0.50 (n=55)0.53 (n=39)0.34 (n=14)0.45 (n=373)
rf-v20.44 (n=55)0.45 (n=39)0.27 (n=14)0.33 (n=373)
rf-v30.49 (n=55)0.44 (n=39)0.30 (n=14)0.39 (n=373)
vis-pure0.50 (n=55)0.60 (n=39)0.46 (n=14)0.51 (n=373)
tagmem-r30.52 (n=55)0.62 (n=39)0.38 (n=14)0.39 (n=373)
읽기: ① 보이는 행에서는 blind 0.45–0.48이 메모리 전략(0.44–0.58)과 거의 같다 — 오라클 textlog(0.77)만 확실히 위. 즉 blind 대비 이득이 0~+0.11로 메모리가 거의 기여하지 않는 구간. ② 안 보이는 행에서는 blind 0.15로 떨어지고 메모리 전략은 0.33–0.51을 유지 → 이득 +0.18~+0.36. vis-pure(+0.36)·frames(+0.29)·tagmem(+0.24)·오라클(+0.22; distractor 기권 때문에 낮음, target만 보면 ≈0.9). ③ 8B 오픈 모델은 보여도 0.33–0.38, 안 보여도 0.31로 지각 보너스 자체가 작고 메모리 이득도 대부분 음수(cosmos·molmo blind가 사전확률 추측으로 높음) — G1 깨짐의 다른 얼굴. ④ 임계 50→200으로 올려도 결론 불변(Δ 열 0.03 이내).
논문 팀 전달(260903): 핸드오프 claude/260903/progress-paper_handoff_visibility_ablation.md(논문 레포 사본 HANDOFF_visibility_ablation.md), 표 파일 scene_bench_paper/tables/visibility_ablation.tex(+ _200px.tex, .md/.csv/.json). 정식 라벨은 ablation_visibility.py --labels <file>로 넣으면 표 파일이 통째로 재생성됨(query_id, visible 두 열). 2×2(최근성) 결과: blind seen·last 0.48 vs seen·not-last 0.49 → 가시 효과는 최근성과 독립.
주의: 가시 행의 79/141이 마지막 이벤트 물체라 "보임"에는 최근성 효과가 섞여 있다(§4b Q3). 정식 ablation에서는 (보임/안 보임) × (마지막 이벤트/그 외) 2×2로 나눠 보고하는 것을 권장. 또 textlog가 안 보임에서 0.37인 것은 distractor 기권(오라클 로그에 정보 없음) 때문이므로 kind별 병기 필요.

5전체 질의 911행 (필터 가능)

query_id질의문kind/origin축정답 (카테고리 @ 방 / 표면)플래그
find:train_1299__2:q00Navigate to the cup I moved earliertarget
single		navigate_only open on_floorcup @ — / 바닥
find:train_1299__2:q01Pick up the remote control I moved earliertarget
single		open_pick hiddenremote control @ bedroom / dresser 안
find:train_1299__2:q02Pick up the pen I moved earliertarget
single		pick openpen @ bathroom / toiletfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_1299__2:q03Pick up the ladledistractor
single		pick openladle @ kitchen / dining table
find:train_1299__2:q04Pick up the pencildistractor
single		pick openpencil @ kitchen / dining table
find:train_1299__2:q05Navigate to the vasedistractor
single		navigate_only openvase @ living room / dresser
find:train_1362__0:q00Pick up all the mugs I moved earliertarget
multi		pick open wrong_surfacemug @ bedroom / tv stand; mug @ living room / dining table
find:train_1362__0:q01Pick up the vase I moved earliertarget
single		pick open twinvase @ living room / tv standfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_1362__0:q02Pick up the remote controldistractor
single		open_pick hiddenremote control @ bedroom / tv stand
find:train_1362__0:q03Pick up the cell phonedistractor
single		open_pick hiddencell phone @ bedroom / tv stand
find:train_1362__0:q04Pick up the watchdistractor
single		pick openwatch @ bedroom / tv stand
find:train_1362__2:q00Pick up the vase I moved earliertarget
single		pick open twinvase @ living room / tv stand
find:train_1362__2:q01Pick up all the mugs I moved earliertarget
multi		pick open wrong_surfacemug @ bedroom / tv stand; mug @ living room / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_1362__2:q02Pick up the remote controldistractor
single		open_pick hiddenremote control @ bedroom / tv stand
find:train_1362__2:q03Pick up the cell phonedistractor
single		open_pick hiddencell phone @ bedroom / tv stand
find:train_1362__2:q04Pick up the watchdistractor
single		pick openwatch @ bedroom / tv stand
find:train_1847__1:q00Pick up the butter knife I moved earliertarget
single		pick open wrong_surfacebutter knife @ kitchen / countertopfind_answer_seen_last5s
find:train_1847__1:q01Pick up the cell phone I moved earliertarget
single		pick opencell phone @ kitchen / chairfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_1847__1:q02Pick up the remote control I moved earliertarget
single		open_pick hiddenremote control @ bedroom / dresser 안last_event_obj
find:train_1847__1:q03Pick up the spoondistractor
single		pick openspoon @ kitchen / countertop
find:train_1847__1:q04Pick up the kettledistractor
single		pick openboiler @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_1847__1:q05Pick up the potatodistractor
single		pick openirish potato @ kitchen / countertop
find:train_188__2:q00Navigate to the pen I moved earliertarget
single		navigate_only openpen @ bathroom / sink
find:train_188__2:q01Navigate to the egg I moved earliertarget
single		navigate_only hiddenegg @ living room / tv stand 안
find:train_188__2:q02Pick up the mug I moved earliertarget
single		pick openmug @ bedroom / bedfind_answer_seen_last5s last_event_obj
find:train_188__2:q03Pick up the knifedistractor
single		pick openknife @ kitchen / countertop
find:train_188__2:q04Pick up the ladledistractor
single		pick openladle @ kitchen / dining table
find:train_188__2:q05Pick up the salt shakerdistractor
single		pick opensalt shaker @ kitchen / dining table
find:train_1949__2:q00Pick up the remote control I moved earliertarget
single		pick open twinremote control @ living room / tv stand
find:train_1949__2:q01Pick up the pen I moved earliertarget
single		pick openpen @ living room / dresser
find:train_1949__2:q02Pick up the salt shaker I moved earliertarget
single		open_pick hiddensalt shaker @ bedroom / desk 안last_event_obj
find:train_1949__2:q03Pick up the boxdistractor
single		pick openbox @ bedroom / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_1949__2:q04Pick up all the bowlsdistractor
multi		pick openbowl @ kitchen / countertop; bowl @ living room / tv stand
find:train_1949__2:q05Pick up the potatodistractor
single		pick openirish potato @ kitchen / countertop
find:train_2102__1:q00Navigate to the key chain I moved earliertarget
single		navigate_only open wrong_surfacekey chain @ living room / tv stand
find:train_2102__1:q01Pick up the remote control I moved earliertarget
single		pick open twinremote control @ living room / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_2102__1:q02Pick up the potato I moved earliertarget
single		open_pick hiddenirish potato @ bedroom / dresser 안
find:train_2102__1:q03Pick up the bowldistractor
single		pick openbowl @ kitchen / dining table
find:train_2102__1:q04Pick up the bottledistractor
single		pick openbottle @ kitchen / chair
find:train_2102__1:q05Pick up the mugdistractor
single		pick openmug @ kitchen / dining tablefind_referent_ambiguous
find:train_2159__2:q00Pick up the key chain I moved earliertarget
single		pick open twinkey chain @ bedroom / dresserfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_2159__2:q01Pick up the egg I moved earliertarget
single		open_pick hiddenegg @ bedroom / desk 안
find:train_2159__2:q02Pick up the remote control I moved earliertarget
single		pick openremote control @ living room / tv stand
find:train_2159__2:q03Pick up the mug I moved earliertarget
single		pick openmug @ bathroom / sink
find:train_2159__2:q04Navigate to the butter knifedistractor
single		navigate_only openbutter knife @ kitchen / countertop
find:train_2159__2:q05Pick up the tissue boxdistractor
single		pick opentissue box @ living room / tv stand
find:train_2159__2:q06Pick up the cell phonedistractor
single		pick opencell phone @ living room / dining table
find:train_2169__1:q00Pick up all the butter knivesdistractor
multi		pick open not_moved twinbutter knife @ kitchen / dining table; butter knife @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame find_referent_ambiguous find_distractor_obj_was_moved find_distractor_misplaced
find:train_2169__1:q01Pick up the vase I moved earliertarget
single		open_pick hiddenvase @ bedroom / dresser 안
find:train_2169__1:q02Pick up the potato I moved earliertarget
single		pick openirish potato @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_2169__1:q03Pick up the appledistractor
single		pick openapple @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_2169__1:q04Pick up the spoondistractor
single		pick openspoon @ kitchen / countertop
find:train_2224__0:q00Pick up all the remote controls I moved earliertarget
multi		pick open twinremote control @ bedroom / tv stand; remote control @ bathroom / toiletfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_2224__0:q01Pick up the potato I moved earliertarget
single		pick openirish potato @ living room / dining table
find:train_2224__0:q02Pick up the key chain I moved earliertarget
single		pick open wrong_surfacekey chain @ bedroom / dresser
find:train_2224__0:q03Pick up the bowldistractor
single		pick openbowl @ bedroom / dining tablefind_referent_ambiguous
find:train_2224__0:q04Pick up the watchdistractor
single		pick openwatch @ bedroom / dining table
find:train_2224__0:q05Pick up the appledistractor
single		pick openapple @ kitchen / countertop
find:train_2224__2:q00Pick up the key chain I moved earliertarget
single		open_pick hiddenkey chain @ bedroom / dresser 안
find:train_2224__2:q01Pick up the potato I moved earliertarget
single		pick openirish potato @ living room / chair
find:train_2224__2:q02Pick up all the remote controls I moved earliertarget
multi		pick open twinremote control @ bedroom / tv stand; remote control @ bathroom / sinkfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_2224__2:q03Pick up the bowldistractor
single		pick openbowl @ bedroom / dining tablefind_referent_ambiguous
find:train_2224__2:q04Pick up the watchdistractor
single		pick openwatch @ bedroom / dining table
find:train_2224__2:q05Pick up the appledistractor
single		pick openapple @ kitchen / countertop
find:train_2277__2:q00Pick up the egg I moved earliertarget
single		pick open wrong_surfaceegg @ kitchen / dining table
find:train_2277__2:q01Pick up the salt shaker I moved earliertarget
single		pick opensalt shaker @ living room / dining table
find:train_2277__2:q02Pick up the tissue box I moved earliertarget
single		pick opentissue box @ living room / dining table
find:train_2277__2:q03Pick up the remote control I moved earliertarget
single		pick openremote control @ bedroom / dresserfind_answer_seen_last5s find_answer_visible_in_query_frame find_referent_ambiguous last_event_obj
find:train_2277__2:q04Pick up the spatuladistractor
single		pick openspatula @ kitchen / countertop
find:train_2277__2:q05Pick up the pandistractor
single		pick opencooking pan @ kitchen / countertop
find:train_2277__2:q06Pick up the watchdistractor
single		pick openwatch @ living room / dining table
find:train_2571__0:q00Pick up the cell phone I moved earliertarget
single		open_pick hiddencell phone @ bedroom / dresser 안
find:train_2571__0:q01Pick up the remote control I moved earliertarget
single		pick openremote control @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_2571__0:q02Pick up the knifedistractor
single		pick open twinknife @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_2571__0:q03Pick up the butter knifedistractor
single		pick openbutter knife @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_2571__0:q04Pick up the cupdistractor
single		pick opencup @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_2571__1:q00Pick up the knife I moved earliertarget
single		pick open twinknife @ kitchen / chair
find:train_2571__1:q01Pick up the mug I moved earliertarget
single		pick open twinmug @ bedroom / dresser
find:train_2571__1:q02Pick up the remote control I moved earliertarget
single		open_pick hiddenremote control @ bedroom / dresser 안
find:train_2571__1:q03Pick up the cell phone I moved earliertarget
single		pick opencell phone @ bathroom / clothes dryerfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_2571__1:q04Pick up the potdistractor
single		pick openpot @ kitchen / dining table
find:train_2571__1:q05Pick up the statuedistractor
single		pick openstatue @ kitchen / dining tablefind_referent_ambiguous
find:train_2571__1:q06Pick up the butter knifedistractor
single		pick openbutter knife @ kitchen / dining table
find:train_2738__0:q00Pick up the pepper shaker I moved earliertarget
single		pick open wrong_surfacepepper shaker @ kitchen / dining table
find:train_2738__0:q01Pick up the spatula I moved earliertarget
single		pick openspatula @ living room / dining table
find:train_2738__0:q02Pick up the mug I moved earliertarget
single		pick openmug @ bedroom / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame find_referent_ambiguous last_event_obj
find:train_2738__0:q03Pick up the potatodistractor
single		pick openirish potato @ kitchen / countertop
find:train_2738__0:q04Pick up the cupdistractor
single		pick opencup @ kitchen / countertop
find:train_2738__0:q05Pick up the bowldistractor
single		pick openbowl @ living room / dining table
find:train_2788__2:q00Pick up all the remote controls I moved earliertarget
multi		pick openremote control @ living room / armchair; remote control @ living room / dining tablefind_answer_seen_last5s find_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_2788__2:q01Pick up the knife I moved earliertarget
single		pick openknife @ bedroom / dining table
find:train_2788__2:q02Pick up the bowldistractor
single		pick openbowl @ bedroom / dining table
find:train_2788__2:q03Pick up the cell phonedistractor
single		pick opencell phone @ bedroom / dining tablefind_referent_ambiguous
find:train_2788__2:q04Navigate to the butter knifedistractor
single		navigate_only openbutter knife @ kitchen / countertop
find:train_2850__2:q00Pick up the potato I moved earliertarget
single		pick openirish potato @ kitchen / chair
find:train_2850__2:q01Pick up the spoondistractor
single		pick open not_moved twinspoon @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame find_referent_ambiguous find_distractor_obj_was_moved find_distractor_misplaced last_event_obj
find:train_2850__2:q02Pick up the mug I moved earliertarget
single		pick openmug @ kitchen / toilet
find:train_2850__2:q03Pick up the kettledistractor
single		pick open twinboiler @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_2850__2:q04Pick up the vasedistractor
single		pick openvase @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_2853__0:q00Pick up all the remote controls I moved earliertarget
multi		pick open wrong_surfaceremote control @ bedroom / tv stand; remote control @ living room / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_2853__0:q01Navigate to the egg I moved earliertarget
single		navigate_only hiddenegg @ bedroom / dresser 안
find:train_2853__0:q02Pick up the tissue box I moved earliertarget
single		pick opentissue box @ bathroom / toiletlast_event_obj
find:train_2853__0:q03Pick up all the vasesdistractor
multi		open_pick pick hidden openvase @ bedroom / dresser; vase @ kitchen / dining table; vase @ living room / dining table
find:train_2853__0:q04Pick up the pepper shakerdistractor
single		pick openpepper shaker @ kitchen / dining table
find:train_2853__0:q05Pick up the wine bottledistractor
single		pick openwine bottle @ kitchen / dining table
find:train_2853__2:q00Pick up all the remote controls I moved earliertarget
multi		pick open wrong_surfaceremote control @ bedroom / tv stand; remote control @ living room / dining tablefind_answer_seen_last5s find_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_2853__2:q01Navigate to the egg I moved earliertarget
single		navigate_only hiddenegg @ bedroom / dresser 안
find:train_2853__2:q02Pick up the tissue box I moved earliertarget
single		pick opentissue box @ bathroom / toilet
find:train_2853__2:q03Pick up all the vasesdistractor
multi		open_pick pick hidden openvase @ bedroom / dresser; vase @ living room / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_2853__2:q04Pick up the knifedistractor
single		pick open twinknife @ kitchen / countertop
find:train_2894__0:q00Pick up all the spatulasdistractor
multi		pick open not_moved twinspatula @ kitchen / countertop; spatula @ kitchen / countertopfind_distractor_obj_was_moved find_distractor_misplaced
find:train_2894__0:q01Pick up the pen I moved earliertarget
single		pick openpen @ — / sofaanswer_room_name_unresolved
find:train_2894__0:q02Pick up the remote control I moved earliertarget
single		pick openremote control @ — / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame answer_room_name_unresolved last_event_obj
find:train_2894__0:q03Pick up the forkdistractor
single		pick openfork @ kitchen / countertop
find:train_2894__0:q04Pick up the knifedistractor
single		pick openknife @ kitchen / countertop
find:train_3058__1:q00Navigate to the remote control I moved earliertarget
single		navigate_only openremote control @ living room / sofa
find:train_3058__1:q01Pick up the pen I moved earliertarget
single		pick openpen @ bedroom / bed
find:train_3058__1:q02Pick up the bowl I moved earliertarget
single		pick openbowl @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_3058__1:q03Pick up the mugdistractor
single		pick openmug @ bedroom / dining table
find:train_3058__1:q04Pick up the ladledistractor
single		pick openladle @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_3058__1:q05Pick up the cupdistractor
single		pick opencup @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_3060__1:q00Navigate to the salt shaker I moved earliertarget
single		navigate_only opensalt shaker @ kitchen / chair
find:train_3060__1:q01Pick up all the mugs I moved earliertarget
multi		pick openmug @ kitchen / countertop; mug @ bedroom / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_3060__1:q02Pick up the pepper shakerdistractor
single		pick openpepper shaker @ kitchen / dining table
find:train_3060__1:q03Pick up the ladledistractor
single		pick openladle @ kitchen / countertop
find:train_3060__1:q04Pick up the eggdistractor
single		pick openegg @ kitchen / countertopfind_referent_ambiguous
find:train_3060__2:q00Pick up all the mugs I moved earliertarget
multi		pick openmug @ kitchen / chair; mug @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_3060__2:q01Navigate to the remote control I moved earliertarget
single		navigate_only openremote control @ bedroom / armchair
find:train_3060__2:q02Pick up the forkdistractor
single		pick openfork @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_3060__2:q03Pick up the butter knifedistractor
single		pick openbutter knife @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_3060__2:q04Pick up the bowldistractor
single		pick openbowl @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_306__0:q00Navigate to the pen I moved earliertarget
single		navigate_only hiddenpen @ bedroom / dresser 안
find:train_306__0:q01Pick up the key chain I moved earliertarget
single		pick openkey chain @ kitchen / countertoplast_event_obj
find:train_306__0:q02Pick up the bowldistractor
single		pick openbowl @ bedroom / dining tablefind_referent_ambiguous
find:train_306__0:q03Pick up the mugdistractor
single		pick openmug @ kitchen / countertop
find:train_306__0:q04Pick up the vasedistractor
single		pick openvase @ living room / tv standfind_referent_ambiguous
find:train_3377__1:q00Pick up the ladle I moved earliertarget
single		pick open twinladle @ kitchen / dining tablelast_event_obj
find:train_3377__1:q01Pick up the remote control I moved earliertarget
single		pick openremote control @ living room / sofa
find:train_3377__1:q02Navigate to the cup I moved earliertarget
single		navigate_only open on_floorcup @ — / 바닥
find:train_3377__1:q03Pick up the statuedistractor
single		pick openstatue @ bedroom / dining tablefind_referent_ambiguous
find:train_3377__1:q04Pick up the bowldistractor
single		pick openbowl @ kitchen / dining tablefind_referent_ambiguous
find:train_3377__1:q05Pick up all the potatosdistractor
multi		pick openirish potato @ kitchen / dining table; irish potato @ kitchen / countertop
find:train_3426__1:q00Pick up the cloth I moved earliertarget
single		pick openfabric @ bedroom / bed
find:train_3426__1:q01Pick up the spatula I moved earliertarget
single		pick open twinspatula @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_3426__1:q02Pick up the cell phone I moved earliertarget
single		pick open wrong_surfacecell phone @ bedroom / tv stand
find:train_3426__1:q03Pick up the watchdistractor
single		pick openwatch @ bedroom / tv standfind_referent_ambiguous
find:train_3426__1:q04Pick up the tissue boxdistractor
single		pick opentissue box @ bedroom / tv stand
find:train_3426__1:q05Pick up the mugdistractor
single		pick openmug @ bedroom / tv stand
find:train_3553__2:q00Pick up the bowl I moved earliertarget
single		pick openbowl @ kitchen / dining table
find:train_3553__2:q01Pick up the spoon I moved earliertarget
single		pick open twinspoon @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_3553__2:q02Pick up the remote control I moved earliertarget
single		open_pick hiddenremote control @ bedroom / dresser 안
find:train_3553__2:q03Pick up the pepper shakerdistractor
single		pick openpepper shaker @ kitchen / countertop
find:train_3553__2:q04Pick up the spatuladistractor
single		pick openspatula @ kitchen / countertop
find:train_3553__2:q05Pick up the butter knifedistractor
single		pick openbutter knife @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_3655__0:q00Pick up all the mugs I moved earliertarget
multi		navigate_only pick hidden openmug @ bedroom / dresser 안; mug @ bathroom / sink
find:train_3655__0:q01Pick up the candle I moved earliertarget
single		pick opencandle @ living room / sofa
find:train_3655__0:q02Pick up the tissue boxdistractor
single		pick opentissue box @ bedroom / dresserfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_3655__0:q03Pick up the butter knifedistractor
single		pick openbutter knife @ kitchen / dining table
find:train_3655__0:q04Pick up the bottledistractor
single		pick openbottle @ kitchen / dining table
find:train_3655__2:q00Pick up the remote control I moved earliertarget
single		pick open twinremote control @ bedroom / dresserfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_3655__2:q01Pick up all the mugs I moved earliertarget
multi		navigate_only pick hidden openmug @ bedroom / dresser 안; mug @ bathroom / sink
find:train_3655__2:q02Pick up the candle I moved earliertarget
single		pick opencandle @ living room / sofa
find:train_3655__2:q03Pick up the tissue boxdistractor
single		pick opentissue box @ bedroom / dresserfind_answer_seen_last5s
find:train_3655__2:q04Pick up the butter knifedistractor
single		pick openbutter knife @ kitchen / dining table
find:train_3655__2:q05Pick up the bottledistractor
single		pick openbottle @ kitchen / dining table
find:train_3667__0:q00Pick up the cell phone I moved earliertarget
single		pick opencell phone @ living room / chair
find:train_3667__0:q01Pick up all the bowls I moved earliertarget
multi		pick openbowl @ bathroom / toilet; bowl @ living room / dining tablelast_event_obj
find:train_3667__0:q02Pick up the butter knifedistractor
single		pick openbutter knife @ kitchen / dining table
find:train_3667__0:q03Pick up the appledistractor
single		pick openapple @ kitchen / dining table
find:train_3667__0:q04Pick up the statuedistractor
single		pick openstatue @ living room / dining tablefind_referent_ambiguous
find:train_3679__1:q00Pick up the remote controldistractor
single		pick open not_moved twinremote control @ bedroom / bedfind_referent_ambiguous find_distractor_obj_was_moved find_distractor_misplaced
find:train_3679__1:q01Pick up the spatula I moved earliertarget
single		pick openspatula @ living room / dining table
find:train_3679__1:q02Pick up the cell phone I moved earliertarget
single		pick opencell phone @ bedroom / bedfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_3679__1:q03Pick up the watchdistractor
single		pick openwatch @ bedroom / dining table
find:train_3679__1:q04Pick up the baseball batdistractor
single		pick openbaseball bat @ bedroom / bedfind_answer_seen_last5s
find:train_3679__2:q00Pick up the remote controldistractor
single		pick open not_moved twinremote control @ bedroom / bedfind_referent_ambiguous find_distractor_obj_was_moved find_distractor_misplaced
find:train_3679__2:q01Pick up the cell phone I moved earliertarget
single		pick opencell phone @ bedroom / bed
find:train_3679__2:q02Pick up the spatula I moved earliertarget
single		pick openspatula @ living room / dining tablefind_answer_seen_last5s last_event_obj
find:train_3679__2:q03Pick up the watchdistractor
single		pick openwatch @ bedroom / dining table
find:train_3679__2:q04Pick up the baseball batdistractor
single		pick openbaseball bat @ bedroom / bed
find:train_3912__0:q00Pick up the candle I moved earliertarget
single		pick opencandle @ living room / desk
find:train_3912__0:q01Pick up the cell phone I moved earliertarget
single		pick open twincell phone @ kitchen / dining table
find:train_3912__0:q02Pick up the spoon I moved earliertarget
single		open_pick hidden wrong_surfacespoon @ bedroom / desk 안
find:train_3912__0:q03Pick up the tennis racket I moved earliertarget
single		pick opentennisracket @ bathroom / clothes dryerfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_3912__0:q04Pick up the wine bottledistractor
single		pick openwine bottle @ kitchen / dining table
find:train_3912__0:q05Pick up the spatuladistractor
single		pick openspatula @ kitchen / countertop
find:train_3912__0:q06Pick up the forkdistractor
single		pick openfork @ kitchen / dining table
find:train_3912__2:q00Pick up the cell phone I moved earliertarget
single		pick open twincell phone @ kitchen / dining table
find:train_3912__2:q01Pick up the fork I moved earliertarget
single		open_pick hiddenfork @ bedroom / desk 안
find:train_3912__2:q02Navigate to the candle I moved earliertarget
single		navigate_only open on_floorcandle @ — / 바닥
find:train_3912__2:q03Pick up the tennis racket I moved earliertarget
single		pick opentennisracket @ bathroom / clothes dryerfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_3912__2:q04Pick up the wine bottledistractor
single		pick openwine bottle @ kitchen / dining table
find:train_3912__2:q05Pick up the spoondistractor
single		pick openspoon @ kitchen / countertop
find:train_3912__2:q06Pick up the kettledistractor
single		pick openboiler @ kitchen / dining table
find:train_3916__0:q00Pick up all the bowls I moved earliertarget
multi		pick openbowl @ kitchen / chair; bowl @ bathroom / sinkfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_3916__0:q01Pick up the spatula I moved earliertarget
single		pick open twinspatula @ kitchen / countertop
find:train_3916__0:q02Pick up the remote control I moved earliertarget
single		open_pick hiddenremote control @ bedroom / dresser 안
find:train_3916__0:q03Pick up the vasedistractor
single		pick openvase @ kitchen / dining table
find:train_3916__0:q04Pick up the potdistractor
single		pick openpot @ kitchen / dining table
find:train_3916__0:q05Pick up the pendistractor
single		pick openpen @ living room / dining tablefind_referent_ambiguous
find:train_3944__0:q00Pick up all the remote controls I moved earliertarget
multi		pick openremote control @ living room / dining table; remote control @ bedroom / sink
find:train_3944__0:q01Pick up the cell phone I moved earliertarget
single		pick open twincell phone @ kitchen / dresserfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_3944__0:q02Pick up the pencildistractor
single		pick openpencil @ kitchen / tv stand
find:train_3944__0:q03Pick up the pepper shakerdistractor
single		pick openpepper shaker @ bedroom / countertop
find:train_3944__0:q04Pick up all the tomatosdistractor
multi		pick opentomato @ bedroom / countertop; tomato @ bedroom / dining table
find:train_3994__0:q00Pick up the cell phone I moved earliertarget
single		pick open twincell phone @ bedroom / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_3994__0:q01Pick up the salt shaker I moved earliertarget
single		open_pick hiddensalt shaker @ bedroom / dresser 안
find:train_3994__0:q02Navigate to the pen I moved earliertarget
single		navigate_only open on_floorpen @ — / 바닥find_answer_seen_last5s
find:train_3994__0:q03Pick up the remote control I moved earliertarget
single		pick openremote control @ bedroom / dresser
find:train_3994__0:q04Pick up all the bowlsdistractor
multi		open_pick pick hidden openbowl @ bedroom / dresser; bowl @ kitchen / dining table
find:train_3994__0:q05Pick up the watchdistractor
single		pick openwatch @ bedroom / dining tablefind_referent_ambiguous
find:train_3994__0:q06Pick up the key chaindistractor
single		pick openkey chain @ bedroom / dining tablefind_answer_seen_last5s find_referent_ambiguous
find:train_4133__1:q00Pick up the remote control I moved earliertarget
single		pick open wrong_surface twinremote control @ bedroom / tv stand
find:train_4133__1:q01Navigate to the cell phone I moved earliertarget
single		navigate_only opencell phone @ living room / armchair
find:train_4133__1:q02Pick up all the mugs I moved earliertarget
multi		open_pick pick hidden openmug @ bedroom / dresser 안; mug @ bathroom / toiletfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_4133__1:q03Pick up the potatodistractor
single		pick openirish potato @ kitchen / dining table
find:train_4133__1:q04Pick up the butter knifedistractor
single		pick openbutter knife @ kitchen / dining table
find:train_4133__1:q05Pick up the candledistractor
single		pick opencandle @ living room / tv stand
find:train_4136__1:q00Pick up the potato I moved earliertarget
single		pick openirish potato @ kitchen / chair
find:train_4136__1:q01Pick up the butter knifedistractor
single		pick open not_moved twinbutter knife @ kitchen / countertopfind_referent_ambiguous find_distractor_obj_was_moved find_distractor_misplaced
find:train_4136__1:q02Pick up the remote control I moved earliertarget
single		pick openremote control @ bathroom / sinkfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_4136__1:q03Pick up the tennis racketdistractor
single		pick opentennisracket @ bedroom / bed
find:train_4136__1:q04Pick up the knifedistractor
single		pick openknife @ kitchen / countertop
find:train_4304__0:q00Pick up the key chain I moved earliertarget
single		open_pick hidden twinkey chain @ bedroom / dresser 안
find:train_4304__0:q01Navigate to the pen I moved earliertarget
single		navigate_only openpen @ bathroom / toilet
find:train_4304__0:q02Pick up the cup I moved earliertarget
single		pick opencup @ living room / armchairlast_event_obj
find:train_4304__0:q03Pick up the statuedistractor
single		pick openstatue @ bedroom / dining table
find:train_4304__0:q04Pick up the cell phonedistractor
single		pick opencell phone @ kitchen / chair
find:train_4304__0:q05Pick up the potdistractor
single		pick openpot @ kitchen / dining table
find:train_4355__0:q00Pick up the key chain I moved earliertarget
single		pick openkey chain @ kitchen / dining table
find:train_4355__0:q01Navigate to the cell phone I moved earliertarget
single		navigate_only hiddencell phone @ bedroom / dresser 안
find:train_4355__0:q02Pick up the egg I moved earliertarget
single		pick openegg @ living room / tv standfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_4355__0:q03Pick up all the bowlsdistractor
multi		pick openbowl @ kitchen / countertop; bowl @ living room / tv standfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_4355__0:q04Pick up the pepper shakerdistractor
single		pick openpepper shaker @ kitchen / countertop
find:train_4355__0:q05Pick up the knifedistractor
single		pick openknife @ kitchen / dining table
find:train_4360__2:q00Pick up the remote control I moved earliertarget
single		pick openremote control @ living room / tv standfind_answer_seen_last5s
find:train_4360__2:q01Pick up the key chain I moved earliertarget
single		pick open twinkey chain @ living room / tv standfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_4360__2:q02Pick up the knifedistractor
single		pick open not_movedknife @ kitchen / countertopfind_distractor_obj_was_moved find_distractor_misplaced
find:train_4360__2:q03Pick up the spatuladistractor
single		pick openspatula @ kitchen / countertop
find:train_4360__2:q04Pick up the mugdistractor
single		pick openmug @ kitchen / dining tablefind_referent_ambiguous
find:train_4392__2:q00Pick up the remote control I moved earliertarget
single		pick open twinremote control @ living room / sofafind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_4392__2:q01Pick up the pepper shaker I moved earliertarget
single		pick openpepper shaker @ living room / sofafind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_4392__2:q02Pick up the pen I moved earliertarget
single		pick open wrong_surfacepen @ bedroom / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_4392__2:q03Pick up the watchdistractor
single		pick openwatch @ bedroom / dining table
find:train_4392__2:q04Pick up the tissue boxdistractor
single		pick opentissue box @ bedroom / desk
find:train_4392__2:q05Pick up the knifedistractor
single		pick openknife @ kitchen / countertop
find:train_4584__0:q00Pick up the cell phone I moved earliertarget
single		pick open wrong_surfacecell phone @ living room / tv standfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_4584__0:q01Navigate to the spray bottle I moved earliertarget
single		navigate_only hiddenatomizer @ bathroom / ?find_hidden_without_fixture
find:train_4584__0:q02Pick up all the tissue boxes I moved earliertarget
multi		navigate_only pick open on_floortissue box @ bathroom / dresser; tissue box @ — / 바닥last_event_obj
find:train_4584__0:q03Pick up the vasedistractor
single		pick openvase @ bedroom / dresser
find:train_4584__0:q04Pick up the mugdistractor
single		pick openmug @ kitchen / countertop
find:train_4584__0:q05Navigate to the remote controldistractor
single		navigate_only openremote control @ living room / tv stand
find:train_4887__0:q00Pick up the mug I moved earliertarget
single		pick openmug @ bedroom / armchair
find:train_4887__0:q01Pick up the key chain I moved earliertarget
single		pick open twinkey chain @ living room / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_4887__0:q02Pick up the salt shaker I moved earliertarget
single		open_pick hiddensalt shaker @ living room / shelf 안
find:train_4887__0:q03Navigate to the remote controldistractor
single		navigate_only openremote control @ bedroom / tv stand
find:train_4887__0:q04Pick up the candledistractor
single		pick opencandle @ living room / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_4887__2:q00Pick up the key chain I moved earliertarget
single		pick open twinkey chain @ living room / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_4887__2:q01Pick up the salt shaker I moved earliertarget
single		open_pick hiddensalt shaker @ living room / shelf 안
find:train_4887__2:q02Pick up the tissue box I moved earliertarget
single		pick open twintissue box @ bedroom / tv standfind_answer_seen_last5s
find:train_4887__2:q03Pick up the mugdistractor
single		pick openmug @ bedroom / tv stand
find:train_4887__2:q04Pick up the remote controldistractor
single		pick openremote control @ bedroom / tv stand
find:train_4887__2:q05Pick up the candledistractor
single		pick opencandle @ living room / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_4913__1:q00Pick up the cell phone I moved earliertarget
single		pick open twincell phone @ bedroom / dining table
find:train_4913__1:q01Navigate to the vase I moved earliertarget
single		navigate_only openvase @ bedroom / chair
find:train_4913__1:q02Pick up the pen I moved earliertarget
single		pick openpen @ bathroom / toiletlast_event_obj
find:train_4913__1:q03Navigate to the cup I moved earliertarget
single		navigate_only open on_floorcup @ — / 바닥
find:train_4913__1:q04Pick up the mugdistractor
single		pick openmug @ bedroom / dining table
find:train_4913__1:q05Pick up the potatodistractor
single		pick openirish potato @ kitchen / countertop
find:train_5258__1:q00Pick up the butter knife I moved earliertarget
single		pick openbutter knife @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_5258__1:q01Pick up the spatula I moved earliertarget
single		pick openspatula @ kitchen / chair
find:train_5258__1:q02Pick up the bowldistractor
single		pick open not_movedbowl @ living room / dining tablefind_referent_ambiguous find_distractor_obj_was_moved find_distractor_misplaced
find:train_5258__1:q03Pick up the pendistractor
single		pick openpen @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_5258__1:q04Pick up the potatodistractor
single		pick openirish potato @ kitchen / countertop
find:train_5374__2:q00Pick up the remote control I moved earliertarget
single		pick open twinremote control @ bedroom / dresserlast_event_obj
find:train_5374__2:q01Pick up the cell phone I moved earliertarget
single		open_pick hiddencell phone @ bedroom / dresser 안
find:train_5374__2:q02Navigate to the statuedistractor
single		navigate_only hiddenstatue @ bedroom / dresserfind_referent_ambiguous
find:train_5374__2:q03Pick up the pendistractor
single		pick openpen @ bedroom / desk
find:train_5374__2:q04Pick up the dumbbelldistractor
single		pick opendumbbell @ bedroom / desk
find:train_5464__0:q00Pick up the remote control I moved earliertarget
single		pick open twinremote control @ living room / tv stand
find:train_5464__0:q01Pick up the key chain I moved earliertarget
single		pick openkey chain @ kitchen / countertop
find:train_5464__0:q02Pick up the pen I moved earliertarget
single		pick openpen @ living room / sofafind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_5464__0:q03Pick up the spatuladistractor
single		pick open twinspatula @ kitchen / countertop
find:train_5464__0:q04Pick up the spoondistractor
single		pick openspoon @ kitchen / countertop
find:train_5464__0:q05Pick up the potdistractor
single		pick openpot @ kitchen / countertop
find:train_5691__1:q00Pick up all the key chains I moved earliertarget
multi		pick open twinkey chain @ bedroom / tv stand; key chain @ living room / sofafind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_5691__1:q01Navigate to the cup I moved earliertarget
single		navigate_only open on_floorcup @ — / 바닥
find:train_5691__1:q02Pick up the remote control I moved earliertarget
single		pick openremote control @ bathroom / toilet
find:train_5691__1:q03Pick up the bottledistractor
single		pick openbottle @ kitchen / dining table
find:train_5691__1:q04Pick up the potatodistractor
single		pick openirish potato @ kitchen / dining table
find:train_5691__1:q05Pick up the spoondistractor
single		pick openspoon @ kitchen / dining table
find:train_573__0:q00Navigate to the mug I moved earliertarget
single		navigate_only hiddenmug @ bedroom / tv stand 안
find:train_573__0:q01Pick up the remote control I moved earliertarget
single		pick open twinremote control @ bedroom / chairfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_573__0:q02Pick up the salt shaker I moved earliertarget
single		pick opensalt shaker @ bathroom / toilet
find:train_573__0:q03Pick up all the watchesdistractor
multi		pick open twinwatch @ bedroom / chair; watch @ bedroom / dining table; watch @ living room / dining tablefind_answer_seen_last5s find_answer_seen_last5s find_answer_visible_in_query_frame
find:train_573__0:q04Pick up the bowldistractor
single		pick openbowl @ bedroom / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_573__0:q05Pick up the potdistractor
single		pick openpot @ kitchen / countertop
find:train_573__2:q00Pick up the remote control I moved earliertarget
single		pick open twinremote control @ bedroom / bedfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_573__2:q01Pick up the key chain I moved earliertarget
single		pick openkey chain @ kitchen / countertop
find:train_573__2:q02Navigate to the mug I moved earliertarget
single		navigate_only hiddenmug @ bedroom / tv stand 안
find:train_573__2:q03Pick up the spatula I moved earliertarget
single		pick openspatula @ bathroom / clothes dryer
find:train_573__2:q04Pick up all the watchesdistractor
multi		pick open twinwatch @ bedroom / chair; watch @ living room / dining table
find:train_573__2:q05Pick up the bowldistractor
single		pick openbowl @ bedroom / dining table
find:train_573__2:q06Pick up the potdistractor
single		pick openpot @ kitchen / countertop
find:train_5890__0:q00Pick up the remote control I moved earliertarget
single		pick open twinremote control @ living room / tv standfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_5890__0:q01Navigate to the cell phone I moved earliertarget
single		navigate_only opencell phone @ living room / sofa
find:train_5890__0:q02Pick up the spoon I moved earliertarget
single		pick openspoon @ living room / dresser
find:train_5890__0:q03Pick up the statuedistractor
single		pick openstatue @ bedroom / dining table
find:train_5890__0:q04Pick up the bowldistractor
single		pick openbowl @ bedroom / dining table
find:train_5890__0:q05Pick up the salt shakerdistractor
single		pick opensalt shaker @ kitchen / countertop
find:train_5902__2:q00Pick up the fork I moved earliertarget
single		pick open twinfork @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_5902__2:q01Pick up the bowl I moved earliertarget
single		pick openbowl @ bedroom / desk
find:train_5902__2:q02Pick up the spatula I moved earliertarget
single		pick openspatula @ kitchen / chair
find:train_5902__2:q03Pick up the tissue boxdistractor
single		pick opentissue box @ bedroom / desk
find:train_5902__2:q04Pick up the statuedistractor
single		pick openstatue @ bedroom / desk
find:train_5902__2:q05Pick up the pandistractor
single		pick opencooking pan @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_597__0:q00Pick up the tissue box I moved earliertarget
single		pick open twintissue box @ bathroom / dresser
find:train_597__0:q01Navigate to the key chain I moved earliertarget
single		navigate_only hiddenkey chain @ bedroom / tv stand 안
find:train_597__0:q02Pick up the apple I moved earliertarget
single		pick openapple @ living room / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_597__0:q03Pick up the forkdistractor
single		pick openfork @ kitchen / dining table
find:train_597__0:q04Pick up the pepper shakerdistractor
single		pick openpepper shaker @ kitchen / dining table
find:train_597__0:q05Pick up the breaddistractor
single		pick openbread @ kitchen / dining table
find:train_597__2:q00Navigate to the key chain I moved earliertarget
single		navigate_only hiddenkey chain @ bedroom / tv stand 안
find:train_597__2:q01Pick up the tissue box I moved earliertarget
single		pick open twintissue box @ bathroom / dresserfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_597__2:q02Pick up the fork I moved earliertarget
single		pick openfork @ living room / dining table
find:train_597__2:q03Pick up the appledistractor
single		pick openapple @ kitchen / dining table
find:train_597__2:q04Pick up the cupdistractor
single		pick opencup @ kitchen / dining table
find:train_597__2:q05Pick up the pepper shakerdistractor
single		pick openpepper shaker @ kitchen / dining table
find:train_6056__2:q00Pick up the mug I moved earliertarget
single		pick open twinmug @ bedroom / dining table
find:train_6056__2:q01Pick up all the remote controls I moved earliertarget
multi		navigate_only pick open on_floorremote control @ bedroom / dresser; remote control @ — / 바닥
find:train_6056__2:q02Pick up the fork I moved earliertarget
single		pick openfork @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_6056__2:q03Pick up all the pencilsdistractor
multi		pick open twinpencil @ bedroom / chair; pencil @ living room / dining table
find:train_6056__2:q04Pick up the key chaindistractor
single		pick openkey chain @ bedroom / dining table
find:train_6056__2:q05Pick up the vasedistractor
single		pick openvase @ bedroom / dining table
find:train_6222__0:q00Pick up all the potatos I moved earliertarget
multi		open_pick pick hidden openirish potato @ kitchen / chair; irish potato @ bedroom / dresser 안
find:train_6222__0:q01Pick up the bowl I moved earliertarget
single		pick openbowl @ bathroom / toilet
find:train_6222__0:q02Pick up the boxdistractor
single		pick openbox @ bedroom / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_6222__0:q03Pick up the pepper shakerdistractor
single		pick openpepper shaker @ kitchen / countertop
find:train_6222__0:q04Pick up the forkdistractor
single		pick open twinfork @ kitchen / dining table
find:train_6222__1:q00Pick up the remote control I moved earliertarget
single		pick open twinremote control @ bedroom / dining table
find:train_6222__1:q01Pick up all the potatos I moved earliertarget
multi		navigate_only open_pick hidden openirish potato @ bedroom / dresser 안; irish potato @ kitchen / chairfind_answer_seen_last5s last_event_obj
find:train_6222__1:q02Pick up the bowl I moved earliertarget
single		pick openbowl @ bathroom / toilet
find:train_6222__1:q03Pick up the boxdistractor
single		pick openbox @ bedroom / dining table
find:train_6222__1:q04Pick up the pepper shakerdistractor
single		pick openpepper shaker @ kitchen / countertopfind_answer_seen_last5s
find:train_6222__1:q05Pick up the forkdistractor
single		pick open twinfork @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_6233__1:q00Pick up the remote control I moved earliertarget
single		pick open twinremote control @ bedroom / desk
find:train_6233__1:q01Pick up the spatula I moved earliertarget
single		open_pick hiddenspatula @ bedroom / desk 안
find:train_6233__1:q02Pick up the cell phone I moved earliertarget
single		pick opencell phone @ living room / sofafind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_6233__1:q03Pick up the pencildistractor
single		open_pick hiddenpencil @ bedroom / deskfind_referent_ambiguous
find:train_6233__1:q04Pick up the forkdistractor
single		pick openfork @ kitchen / countertop
find:train_6233__1:q05Pick up the salt shakerdistractor
single		pick opensalt shaker @ kitchen / countertop
find:train_6242__1:q00Pick up the remote control I moved earliertarget
single		pick open twinremote control @ bedroom / tv standfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_6242__1:q01Pick up the cell phone I moved earliertarget
single		pick opencell phone @ kitchen / dining table
find:train_6242__1:q02Navigate to the cup I moved earliertarget
single		navigate_only hiddencup @ bathroom / dresser 안
find:train_6242__1:q03Pick up the pencildistractor
single		pick openpencil @ bedroom / chairfind_referent_ambiguous
find:train_6242__1:q04Pick up the wine bottledistractor
single		pick openwine bottle @ kitchen / dining table
find:train_6242__1:q05Pick up the knifedistractor
single		pick openknife @ kitchen / dining table
find:train_6278__1:q00Navigate to the key chain I moved earliertarget
single		navigate_only hiddenkey chain @ bedroom / dresser 안
find:train_6278__1:q01Pick up the remote control I moved earliertarget
single		pick open twinremote control @ living room / tv standfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_6278__1:q02Pick up the potato I moved earliertarget
single		pick open wrong_surfaceirish potato @ living room / tv stand
find:train_6278__1:q03Pick up the watchdistractor
single		pick openwatch @ bedroom / dining table
find:train_6278__1:q04Pick up the appledistractor
single		pick openapple @ kitchen / countertop
find:train_6278__1:q05Pick up the forkdistractor
single		pick openfork @ kitchen / countertop
find:train_6278__2:q00Pick up the remote control I moved earliertarget
single		pick open twinremote control @ living room / tv standfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_6278__2:q01Pick up the potato I moved earliertarget
single		pick open wrong_surfaceirish potato @ living room / tv stand
find:train_6278__2:q02Pick up the key chain I moved earliertarget
single		open_pick hiddenkey chain @ bedroom / dresser 안
find:train_6278__2:q03Pick up the watchdistractor
single		pick openwatch @ bedroom / dining table
find:train_6278__2:q04Pick up the kettledistractor
single		pick openboiler @ kitchen / dining table
find:train_6278__2:q05Pick up the salt shakerdistractor
single		pick opensalt shaker @ kitchen / dining table
find:train_6376__2:q00Pick up the butter knife I moved earliertarget
single		pick open twinbutter knife @ kitchen / countertop
find:train_6376__2:q01Pick up the cell phone I moved earliertarget
single		open_pick hidden wrong_surfacecell phone @ — / dresser 안answer_room_name_unresolved
find:train_6376__2:q02Pick up the fork I moved earliertarget
single		pick openfork @ kitchen / chairfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_6376__2:q03Pick up the spoondistractor
single		pick openspoon @ kitchen / countertop
find:train_6376__2:q04Pick up all the bowlsdistractor
multi		pick openbowl @ kitchen / dining table; bowl @ living room / dining tablefind_answer_seen_last5s
find:train_6376__2:q05Pick up the salt shakerdistractor
single		pick opensalt shaker @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_6659__1:q00Pick up the spoondistractor
single		pick open not_moved twinspoon @ kitchen / countertopfind_referent_ambiguous find_distractor_obj_was_moved find_distractor_misplaced
find:train_6659__1:q01Navigate to the candle I moved earliertarget
single		navigate_only open on_floorcandle @ — / 바닥
find:train_6659__1:q02Pick up the mug I moved earliertarget
single		pick openmug @ bathroom / toilet
find:train_6659__1:q03Pick up the apple I moved earliertarget
single		pick openapple @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_6659__1:q04Pick up the pepper shakerdistractor
single		pick openpepper shaker @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_6659__1:q05Pick up the bowldistractor
single		pick openbowl @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame find_referent_ambiguous
find:train_6728__2:q00Pick up the spatula I moved earliertarget
single		pick open twinspatula @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_6728__2:q01Navigate to the potato I moved earliertarget
single		navigate_only openirish potato @ kitchen / countertop
find:train_6728__2:q02Pick up all the remote controls I moved earliertarget
multi		pick open wrong_surfaceremote control @ bedroom / chair; remote control @ bathroom / toilet
find:train_6728__2:q03Pick up the cell phonedistractor
single		pick opencell phone @ kitchen / dining tablefind_referent_ambiguous
find:train_6728__2:q04Pick up all the bowlsdistractor
multi		pick openbowl @ kitchen / dining table; bowl @ living room / chair
find:train_6728__2:q05Pick up the breaddistractor
single		pick openbread @ kitchen / dining table
find:train_6762__1:q00Pick up all the remote controls I moved earliertarget
multi		pick open twinremote control @ bedroom / dining table; remote control @ bathroom / toiletfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_6762__1:q01Pick up the cell phone I moved earliertarget
single		pick open wrong_surfacecell phone @ bedroom / dresser
find:train_6762__1:q02Pick up the key chain I moved earliertarget
single		pick openkey chain @ living room / dining table
find:train_6762__1:q03Pick up the bowldistractor
single		pick openbowl @ bedroom / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame find_referent_ambiguous
find:train_6762__1:q04Pick up the potdistractor
single		pick openpot @ kitchen / countertop
find:train_6818__2:q00Pick up the key chain I moved earliertarget
single		pick openkey chain @ living room / chair
find:train_6818__2:q01Pick up the remote control I moved earliertarget
single		pick open twinremote control @ bedroom / dresserfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_6818__2:q02Pick up the mug I moved earliertarget
single		pick open wrong_surfacemug @ bedroom / armchair
find:train_6818__2:q03Pick up the cell phonedistractor
single		pick opencell phone @ kitchen / countertopfind_referent_ambiguous
find:train_6818__2:q04Pick up the bowldistractor
single		pick openbowl @ kitchen / dining tablefind_referent_ambiguous
find:train_6818__2:q05Pick up the forkdistractor
single		pick openfork @ kitchen / countertop
find:train_6844__2:q00Pick up all the key chains I moved earliertarget
multi		pick open wrong_surface twinkey chain @ living room / tv stand; key chain @ bedroom / bed
find:train_6844__2:q01Pick up the butter knife I moved earliertarget
single		pick openbutter knife @ living room / tv stand
find:train_6844__2:q02Pick up the cell phone I moved earliertarget
single		pick opencell phone @ bedroom / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_6844__2:q03Pick up the vasedistractor
single		pick openvase @ bedroom / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_6844__2:q04Pick up the bowldistractor
single		pick openbowl @ bedroom / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_6844__2:q05Pick up all the spatulasdistractor
multi		pick open twinspatula @ kitchen / countertop; spatula @ kitchen / countertop
find:train_6878__2:q00Pick up the cell phone I moved earliertarget
single		pick open twincell phone @ kitchen / tv standfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_6878__2:q01Pick up the key chain I moved earliertarget
single		pick open wrong_surfacekey chain @ kitchen / toilet
find:train_6878__2:q02Pick up the remote control I moved earliertarget
single		pick openremote control @ bedroom / dresser
find:train_6878__2:q03Pick up the bowldistractor
single		pick openbowl @ bedroom / dining table
find:train_6878__2:q04Pick up the watchdistractor
single		pick open twinwatch @ bedroom / dining tablefind_referent_ambiguous
find:train_6878__2:q05Pick up the spray bottledistractor
single		pick openatomizer @ kitchen / tv standfind_answer_seen_last5s find_answer_visible_in_query_frame find_referent_ambiguous
find:train_6998__0:q00Pick up the mug I moved earliertarget
single		pick open twinmug @ bedroom / dresser
find:train_6998__0:q01Pick up the remote control I moved earliertarget
single		pick openremote control @ bedroom / dresser
find:train_6998__0:q02Navigate to the bowl I moved earliertarget
single		navigate_only open on_floorbowl @ — / 바닥
find:train_6998__0:q03Pick up the potato I moved earliertarget
single		pick openirish potato @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_6998__0:q04Pick up the cell phonedistractor
single		pick opencell phone @ bedroom / dresserfind_referent_ambiguous
find:train_6998__0:q05Pick up the cupdistractor
single		pick opencup @ kitchen / countertop
find:train_6998__0:q06Pick up the statuedistractor
single		pick openstatue @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame find_referent_ambiguous
find:train_6998__2:q00Pick up the mug I moved earliertarget
single		pick open twinmug @ bedroom / dresserfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_6998__2:q01Pick up the remote control I moved earliertarget
single		pick openremote control @ bedroom / dresserfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_6998__2:q02Navigate to the bowl I moved earliertarget
single		navigate_only open on_floorbowl @ — / 바닥
find:train_6998__2:q03Pick up the ladle I moved earliertarget
single		pick openladle @ kitchen / dining table
find:train_6998__2:q04Pick up the cell phonedistractor
single		pick opencell phone @ bedroom / dresserfind_answer_seen_last5s find_answer_visible_in_query_frame find_referent_ambiguous
find:train_6998__2:q05Pick up the potatodistractor
single		pick openirish potato @ kitchen / countertop
find:train_6998__2:q06Pick up the statuedistractor
single		pick openstatue @ kitchen / dining tablefind_referent_ambiguous
find:train_7036__0:q00Pick up the remote control I moved earliertarget
single		pick open twinremote control @ bedroom / chair
find:train_7036__0:q01Pick up the potato I moved earliertarget
single		pick openirish potato @ kitchen / chair
find:train_7036__0:q02Pick up all the cell phones I moved earliertarget
multi		pick open wrong_surface twincell phone @ bedroom / dining table; cell phone @ bathroom / toiletfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_7036__0:q03Pick up the statuedistractor
single		pick openstatue @ bedroom / dining table
find:train_7036__0:q04Pick up the mugdistractor
single		pick openmug @ kitchen / countertop
find:train_7036__0:q05Pick up the ladledistractor
single		pick openladle @ kitchen / dining table
find:train_7047__1:q00Pick up the mug I moved earliertarget
single		open_pick hiddenmug @ bedroom / dresser 안
find:train_7047__1:q01Pick up the remote control I moved earliertarget
single		pick open twinremote control @ living room / tv standfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_7047__1:q02Navigate to the soap bottle I moved earliertarget
single		navigate_only opensoapdispenser @ kitchen / countertop
find:train_7047__1:q03Pick up the butter knife I moved earliertarget
single		pick openbutter knife @ living room / cart
find:train_7047__1:q04Pick up the kettledistractor
single		pick openboiler @ kitchen / countertop
find:train_7047__1:q05Pick up the cupdistractor
single		pick opencup @ kitchen / countertop
find:train_7047__1:q06Pick up the watchdistractor
single		pick open twinwatch @ living room / tv standfind_answer_seen_last5s
find:train_7151__1:q00Pick up the tissue box I moved earliertarget
single		pick opentissue box @ bedroom / dining table
find:train_7151__1:q01Pick up the remote control I moved earliertarget
single		pick open twinremote control @ living room / sofafind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_7151__1:q02Pick up the pen I moved earliertarget
single		pick open twinpen @ living room / coffee table
find:train_7151__1:q03Pick up the bowldistractor
single		pick openbowl @ bedroom / desk
find:train_7151__1:q04Pick up all the watchesdistractor
multi		pick openwatch @ bedroom / dresser; watch @ bedroom / dining table
find:train_7151__1:q05Pick up the vasedistractor
single		pick openvase @ living room / coffee table
find:train_7152__1:q00Pick up all the mugs I moved earliertarget
multi		open_pick pick hidden openmug @ bedroom / dresser 안; mug @ bathroom / toilet
find:train_7152__1:q01Pick up the remote control I moved earliertarget
single		pick open twinremote control @ bedroom / chairfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_7152__1:q02Pick up the vasedistractor
single		pick openvase @ bedroom / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_7152__1:q03Pick up the eggdistractor
single		pick openegg @ kitchen / countertop
find:train_7152__1:q04Pick up the bowldistractor
single		pick openbowl @ kitchen / countertopfind_referent_ambiguous
find:train_7385__0:q00Pick up the remote control I moved earliertarget
single		pick open twinremote control @ bedroom / bedfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_7385__0:q01Pick up the pen I moved earliertarget
single		pick openpen @ bedroom / bed
find:train_7385__0:q02Pick up the pepper shaker I moved earliertarget
single		open_pick hiddenpepper shaker @ living room / tv stand 안
find:train_7385__0:q03Pick up the bowldistractor
single		pick openbowl @ kitchen / dining table
find:train_7385__0:q04Pick up the vasedistractor
single		pick openvase @ kitchen / dining table
find:train_7385__0:q05Pick up the spray bottledistractor
single		pick openatomizer @ kitchen / dining table
find:train_7428__1:q00Pick up the pen I moved earliertarget
single		pick openpen @ living room / cart
find:train_7428__1:q01Pick up all the remote controls I moved earliertarget
multi		pick open twinremote control @ bedroom / tv stand; remote control @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_7428__1:q02Pick up the bottle I moved earliertarget
single		open_pick hiddenbottle @ kitchen / shelf 안
find:train_7428__1:q03Pick up the salt shakerdistractor
single		pick opensalt shaker @ kitchen / dining tablefind_answer_seen_last5s
find:train_7428__1:q04Pick up all the statuesdistractor
multi		pick openstatue @ kitchen / dining table; statue @ living room / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_7428__1:q05Pick up the cell phonedistractor
single		pick opencell phone @ kitchen / dining tablefind_answer_seen_last5s find_referent_ambiguous
find:train_7428__2:q00Pick up the cell phone I moved earliertarget
single		pick opencell phone @ bedroom / armchairfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_7428__2:q01Pick up the salt shaker I moved earliertarget
single		open_pick hiddensalt shaker @ kitchen / shelf 안
find:train_7428__2:q02Pick up the remote control I moved earliertarget
single		pick open twinremote control @ living room / tv standlast_event_obj
find:train_7428__2:q03Pick up the wine bottledistractor
single		pick openwine bottle @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_7428__2:q04Pick up the bottledistractor
single		pick open twinbottle @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame find_referent_ambiguous
find:train_7428__2:q05Pick up the statuedistractor
single		pick openstatue @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_7650__2:q00Pick up the pepper shaker I moved earliertarget
single		pick openpepper shaker @ kitchen / dining tablefind_answer_seen_last5s
find:train_7650__2:q01Pick up the spoon I moved earliertarget
single		pick open twinspoon @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_7650__2:q02Navigate to the remote control I moved earliertarget
single		navigate_only open on_floorremote control @ — / 바닥
find:train_7650__2:q03Pick up the bowl I moved earliertarget
single		pick openbowl @ bathroom / sink
find:train_7650__2:q04Pick up the soap bottledistractor
single		pick opensoapdispenser @ kitchen / countertopfind_referent_ambiguous
find:train_7650__2:q05Pick up the mugdistractor
single		pick openmug @ kitchen / dining tablefind_answer_seen_last5s find_referent_ambiguous
find:train_7650__2:q06Pick up the pencildistractor
single		pick openpencil @ kitchen / dining tablefind_answer_seen_last5s find_referent_ambiguous
find:train_7661__1:q00Navigate to the butter knife I moved earliertarget
single		navigate_only openbutter knife @ living room / tv stand
find:train_7661__1:q01Pick up the candle I moved earliertarget
single		open_pick hiddencandle @ bedroom / desk 안
find:train_7661__1:q02Pick up the mug I moved earliertarget
single		pick openmug @ kitchen / chair
find:train_7661__1:q03Pick up the cell phone I moved earliertarget
single		pick opencell phone @ bathroom / toiletfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_7661__1:q04Pick up the bottledistractor
single		pick openbottle @ kitchen / chair
find:train_7661__1:q05Pick up the pencildistractor
single		pick openpencil @ kitchen / dining tablefind_referent_ambiguous
find:train_7661__1:q06Pick up the pepper shakerdistractor
single		pick openpepper shaker @ kitchen / dining table
find:train_7845__2:q00Pick up all the remote controls I moved earliertarget
multi		navigate_only pick open on_floor twinremote control @ living room / sofa; remote control @ — / 바닥find_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_7845__2:q01Pick up the knife I moved earliertarget
single		open_pick hiddenknife @ bedroom / dresser 안
find:train_7845__2:q02Pick up the apple I moved earliertarget
single		pick openapple @ kitchen / countertop
find:train_7845__2:q03Pick up the salt shakerdistractor
single		pick opensalt shaker @ kitchen / countertop
find:train_7845__2:q04Pick up the eggdistractor
single		pick openegg @ kitchen / countertop
find:train_7845__2:q05Pick up the spray bottledistractor
single		pick openatomizer @ kitchen / dining table
find:train_8077__2:q00Pick up the mug I moved earliertarget
single		pick open twinmug @ bedroom / dining tablelast_event_obj
find:train_8077__2:q01Pick up the pen I moved earliertarget
single		pick openpen @ kitchen / countertop
find:train_8077__2:q02Navigate to the remote control I moved earliertarget
single		navigate_only openremote control @ bathroom / toilet
find:train_8077__2:q03Pick up the bottle I moved earliertarget
single		pick open wrong_surfacebottle @ kitchen / dresserfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_8077__2:q04Pick up all the bowlsdistractor
multi		pick openbowl @ bedroom / dining table; bowl @ living room / dining tablefind_referent_ambiguous
find:train_8077__2:q05Pick up the salt shakerdistractor
single		pick opensalt shaker @ kitchen / dining table
find:train_8077__2:q06Pick up the spatuladistractor
single		pick open twinspatula @ kitchen / countertopfind_referent_ambiguous
find:train_8102__2:q00Pick up the spatula I moved earliertarget
single		pick open twinspatula @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_8102__2:q01Pick up the cell phone I moved earliertarget
single		open_pick hiddencell phone @ bedroom / dresser 안
find:train_8102__2:q02Navigate to the tissue box I moved earliertarget
single		navigate_only opentissue box @ living room / sofa
find:train_8102__2:q03Pick up the dumbbelldistractor
single		pick opendumbbell @ bedroom / desk
find:train_8102__2:q04Pick up the mugdistractor
single		pick openmug @ bedroom / desk
find:train_8102__2:q05Pick up the butter knifedistractor
single		pick openbutter knife @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_8171__0:q00Pick up all the mugs I moved earliertarget
multi		open_pick pick hidden openmug @ bedroom / desk 안; mug @ bathroom / sinklast_event_obj
find:train_8171__0:q01Navigate to the remote control I moved earliertarget
single		navigate_only openremote control @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_8171__0:q02Pick up the statuedistractor
single		pick openstatue @ bedroom / tv standfind_referent_ambiguous
find:train_8171__0:q03Pick up the bowldistractor
single		pick openbowl @ kitchen / countertop
find:train_8171__0:q04Pick up the pandistractor
single		pick opencooking pan @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_8171__1:q00Pick up all the mugs I moved earliertarget
multi		open_pick pick hidden openmug @ bedroom / desk 안; mug @ bathroom / sinklast_event_obj
find:train_8171__1:q01Navigate to the remote control I moved earliertarget
single		navigate_only openremote control @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_8171__1:q02Pick up the statuedistractor
single		pick openstatue @ bedroom / tv standfind_referent_ambiguous
find:train_8171__1:q03Pick up the bowldistractor
single		pick openbowl @ kitchen / countertop
find:train_8171__1:q04Pick up the pandistractor
single		pick opencooking pan @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_8190__1:q00Pick up the spatula I moved earliertarget
single		pick open twinspatula @ kitchen / countertop
find:train_8190__1:q01Navigate to the bowl I moved earliertarget
single		navigate_only open on_floorbowl @ — / 바닥
find:train_8190__1:q02Pick up the remote control I moved earliertarget
single		pick openremote control @ bathroom / toilet
find:train_8190__1:q03Pick up the potato I moved earliertarget
single		pick openirish potato @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_8190__1:q04Pick up the boxdistractor
single		pick openbox @ bedroom / dining tablefind_referent_ambiguous
find:train_8190__1:q05Pick up the pandistractor
single		pick opencooking pan @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_8190__1:q06Pick up the butter knifedistractor
single		pick openbutter knife @ kitchen / countertop
find:train_8239__1:q00Pick up the potato I moved earliertarget
single		pick openirish potato @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_8239__1:q01Pick up the butter knife I moved earliertarget
single		pick open twinbutter knife @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_8239__1:q02Pick up the egg I moved earliertarget
single		pick open wrong_surfaceegg @ living room / tv stand
find:train_8239__1:q03Pick up the mug I moved earliertarget
single		pick openmug @ bathroom / toilet
find:train_8239__1:q04Pick up the statuedistractor
single		pick openstatue @ bedroom / tv stand
find:train_8239__1:q05Pick up the appledistractor
single		pick openapple @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_8239__1:q06Pick up the credit carddistractor
single		pick opencredit card @ kitchen / chair
find:train_8287__1:q00Pick up the tissue box I moved earliertarget
single		pick open twintissue box @ bedroom / desk
find:train_8287__1:q01Pick up the remote control I moved earliertarget
single		open_pick hiddenremote control @ bedroom / desk 안
find:train_8287__1:q02Pick up the apple I moved earliertarget
single		pick openapple @ living room / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_8287__1:q03Pick up the c ddistractor
single		open_pick hidden twinCD @ bedroom / desk
find:train_8287__1:q04Pick up the pendistractor
single		pick openpen @ bedroom / dining table
find:train_8287__1:q05Pick up the knifedistractor
single		pick open twinknife @ kitchen / countertop
find:train_8843__1:q00Pick up the spatula I moved earliertarget
single		pick open twinspatula @ kitchen / countertop
find:train_8843__1:q01Pick up the remote control I moved earliertarget
single		pick openremote control @ bedroom / tv stand
find:train_8843__1:q02Navigate to the potato I moved earliertarget
single		navigate_only open on_floorirish potato @ — / 바닥
find:train_8843__1:q03Pick up the spoon I moved earliertarget
single		pick openspoon @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_8843__1:q04Pick up the pendistractor
single		pick openpen @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_8843__1:q05Pick up all the butter knivesdistractor
multi		pick openbutter knife @ kitchen / dining table; butter knife @ kitchen / countertopfind_answer_seen_last5s
find:train_8843__1:q06Pick up the pepper shakerdistractor
single		pick openpepper shaker @ kitchen / dining tablefind_answer_seen_last5s
find:train_899__1:q00Pick up all the remote controls I moved earliertarget
multi		pick openremote control @ living room / sofa; remote control @ living room / dining tablelast_event_obj
find:train_899__1:q01Pick up the candle I moved earliertarget
single		open_pick hiddencandle @ living room / tv stand 안
find:train_899__1:q02Pick up the spoon I moved earliertarget
single		pick open wrong_surfacespoon @ bathroom / sinkfind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_899__1:q03Pick up the pencildistractor
single		pick openpencil @ kitchen / dining tablefind_referent_ambiguous
find:train_899__1:q04Pick up the pandistractor
single		pick opencooking pan @ kitchen / dining table
find:train_899__1:q05Pick up the potatodistractor
single		pick openirish potato @ kitchen / dining table
find:train_9018__2:q00Pick up all the remote controls I moved earliertarget
multi		pick open twinremote control @ living room / dining table; remote control @ living room / cartfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_9018__2:q01Navigate to the tennis racket I moved earliertarget
single		navigate_only open on_floortennisracket @ — / 바닥
find:train_9018__2:q02Pick up the watchdistractor
single		pick openwatch @ living room / dining tablefind_answer_seen_last5s
find:train_9018__2:q03Pick up the cell phonedistractor
single		pick opencell phone @ living room / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame find_referent_ambiguous
find:train_9018__2:q04Pick up the bowldistractor
single		pick openbowl @ living room / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame
find:train_9026__1:q00Pick up the remote control I moved earliertarget
single		pick open wrong_surfaceremote control @ bedroom / bed
find:train_9026__1:q01Pick up the vase I moved earliertarget
single		pick openvase @ living room / dining table
find:train_9026__1:q02Pick up the potato I moved earliertarget
single		open_pick hiddenirish potato @ bedroom / dresser 안
find:train_9026__1:q03Pick up the bowl I moved earliertarget
single		pick openbowl @ bathroom / sinkfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_9026__1:q04Pick up the salt shakerdistractor
single		pick opensalt shaker @ kitchen / dining table
find:train_9026__1:q05Pick up the soap bottledistractor
single		pick opensoapdispenser @ kitchen / countertop
find:train_9026__1:q06Pick up all the ladlesdistractor
multi		pick openladle @ kitchen / dining table; ladle @ kitchen / countertop
find:train_9320__2:q00Pick up the remote control I moved earliertarget
single		pick open twinremote control @ bedroom / dining table
find:train_9320__2:q01Pick up the spatula I moved earliertarget
single		pick openspatula @ kitchen / dining table
find:train_9320__2:q02Pick up all the mugs I moved earliertarget
multi		pick open wrong_surfacemug @ bedroom / tv stand; mug @ bathroom / sinkfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_9320__2:q03Pick up the watchdistractor
single		pick openwatch @ bedroom / dining table
find:train_9320__2:q04Pick up the key chaindistractor
single		pick openkey chain @ bedroom / dining table
find:train_9320__2:q05Pick up the bowldistractor
single		pick openbowl @ kitchen / dining table
find:train_9584__2:q00Pick up the mug I moved earliertarget
single		pick open twinmug @ kitchen / countertoplast_event_obj
find:train_9584__2:q01Pick up the remote control I moved earliertarget
single		pick openremote control @ living room / armchair
find:train_9584__2:q02Pick up the cupdistractor
single		pick open not_movedcup @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame find_distractor_obj_was_moved find_distractor_misplaced
find:train_9584__2:q03Pick up the bowldistractor
single		pick openbowl @ kitchen / dining tablefind_answer_seen_last5s find_answer_visible_in_query_frame find_referent_ambiguous
find:train_9584__2:q04Pick up the spoondistractor
single		pick openspoon @ kitchen / countertop
find:train_9651__2:q00Pick up the spoon I moved earliertarget
single		pick open twinspoon @ kitchen / countertopfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_9651__2:q01Navigate to the pen I moved earliertarget
single		navigate_only hiddenpen @ bedroom / dresser 안
find:train_9651__2:q02Pick up the salt shaker I moved earliertarget
single		pick opensalt shaker @ kitchen / dining table
find:train_9651__2:q03Pick up the knifedistractor
single		pick openknife @ kitchen / dining table
find:train_9651__2:q04Pick up the bowldistractor
single		pick openbowl @ kitchen / chair
find:train_9651__2:q05Pick up the potatodistractor
single		pick openirish potato @ kitchen / dining table
find:train_9778__1:q00Navigate to the remote control I moved earliertarget
single		navigate_only openremote control @ kitchen / chair
find:train_9778__1:q01Pick up the butter knife I moved earliertarget
single		pick openbutter knife @ kitchen / chair
find:train_9778__1:q02Pick up the cell phone I moved earliertarget
single		open_pick hiddencell phone @ bedroom / desk 안
find:train_9778__1:q03Pick up the key chain I moved earliertarget
single		pick openkey chain @ bathroom / sinkfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_9778__1:q04Pick up the bottledistractor
single		pick openbottle @ kitchen / dining table
find:train_9778__1:q05Pick up the bowldistractor
single		pick openbowl @ kitchen / dining tablefind_referent_ambiguous
find:train_9797__1:q00Pick up the candle I moved earliertarget
single		pick open twincandle @ bathroom / toiletfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_9797__1:q01Navigate to the bowl I moved earliertarget
single		navigate_only openbowl @ living room / armchair
find:train_9797__1:q02Pick up all the mugs I moved earliertarget
multi		pick open wrong_surfacemug @ kitchen / toilet; mug @ bathroom / sinkfind_answer_seen_last5s
find:train_9797__1:q03Pick up the knifedistractor
single		pick openknife @ kitchen / dining table
find:train_9797__1:q04Pick up the appledistractor
single		pick openapple @ kitchen / dining table
find:train_9797__1:q05Pick up the bottledistractor
single		pick openbottle @ kitchen / dining table
find:train_9909__2:q00Pick up all the remote controls I moved earliertarget
multi		pick openremote control @ living room / armchair; remote control @ bedroom / armchairfind_answer_seen_last5s find_answer_visible_in_query_frame last_event_obj
find:train_9909__2:q01Pick up the key chain I moved earliertarget
single		pick openkey chain @ bedroom / dresser
find:train_9909__2:q02Pick up the mug I moved earliertarget
single		pick open wrong_surfacemug @ — / toiletanswer_room_name_unresolved
find:train_9909__2:q03Pick up the forkdistractor
single		pick openfork @ kitchen / countertop
find:train_9909__2:q04Pick up the potatodistractor
single		pick openirish potato @ kitchen / dining table
find:train_9909__2:q05Pick up the butter knifedistractor
single		pick openbutter knife @ kitchen / countertop
restore:train_1299__2:q00Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_inremote control: bedroom/dresser 안 → bedroom/tv stand (3.842 m)restore_neighbor_inside_r_place
restore:train_1299__2:q01Pick up the pen and place it in or on where it first wasfirst
single		in_reach hops1pen: bathroom/toilet → living room/dining table (16.704 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_1299__2:q02Pick up the remote control and place it in or on where it first was, then pick up the pen and place it in or on where it first wasfirst
multi		in_reach navigate hops1 from_hidden store_inremote control: bedroom/dresser 안 → bedroom/tv stand (3.842 m); pen: bathroom/toilet → living room/dining table (16.704 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_1362__0:q00Pick up the vase and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinvase: living room/tv stand → bedroom/tv stand (8.806 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_1362__0:q01Pick up the vase and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinvase: living room/tv stand → kitchen/chair (2.323 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_1362__0:q02Pick up the mug and place it in or on where it first wasfirst
single		navigate hops1mug: living room/dining table → kitchen/countertop (6.359 m)restore_referent_ambiguous
restore:train_1362__0:q03Pick up the vase and place it in or on where it first was, then pick up the mug and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate twin_merge twinvase: living room/tv stand → bedroom/tv stand (8.806 m); mug: living room/dining table → kitchen/countertop (6.359 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_referent_ambiguous last_event_obj
restore:train_1362__2:q00Pick up the vase and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinvase: living room/tv stand → bedroom/tv stand (8.818 m)restore_neighbor_inside_r_place
restore:train_1362__2:q01Pick up the mug and place it in or on where it first wasfirst
single		in_reach hops1mug: living room/dining table → kitchen/countertop (6.36 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_referent_ambiguous last_event_obj
restore:train_1362__2:q02Pick up the vase and place it in or on where it first was, then pick up the mug and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate twin_merge twinvase: living room/tv stand → bedroom/tv stand (8.818 m); mug: living room/dining table → kitchen/countertop (6.36 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_referent_ambiguous last_event_obj
restore:train_1847__1:q00Pick up the butter knife and place it in or on where it first wasfirst
single		navigate hops1butter knife: kitchen/countertop → kitchen/countertop (3.492 m)restore_from_seen_last5s restore_misplaced_answer
restore:train_1847__1:q01Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_inremote control: bedroom/dresser 안 → living room/dining table (12.087 m)last_event_obj
restore:train_1847__1:q02Pick up the butter knife and place it in or on where it first was, then pick up the remote control and place it in or on where it first wasfirst
multi		navigate hops1 from_hidden store_inbutter knife: kitchen/countertop → kitchen/countertop (3.492 m); remote control: bedroom/dresser 안 → living room/dining table (12.087 m)restore_from_seen_last5s restore_misplaced_answer last_event_obj
restore:train_188__2:q00Pick up the mug and place it in or on where it first wasfirst
single		in_reach hops1 shiftmug: bedroom/bed → bedroom/dining table (5.47 m)restore_from_seen_last5s last_event_obj
restore:train_1949__2:q00Pick up the remote control and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinremote control: living room/tv stand → kitchen/countertop (6.621 m)
restore:train_1949__2:q01Pick up the pen and place it in or on where it first wasfirst
single		navigate hops1 shiftpen: living room/dresser → living room/dining table (3.057 m)
restore:train_1949__2:q02Pick up the salt shaker and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_insalt shaker: bedroom/desk 안 → kitchen/countertop (12.977 m)last_event_obj
restore:train_1949__2:q03Pick up the pen and place it in or on where it first was, then pick up the salt shaker and place it in or on where it first wasfirst
multi		navigate hops1 from_hidden shift store_inpen: living room/dresser → living room/dining table (3.057 m); salt shaker: bedroom/desk 안 → kitchen/countertop (12.977 m)last_event_obj
restore:train_2102__1:q00Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinremote control: living room/dining table → living room/dining table (1.112 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_2102__1:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: living room/dining table → kitchen/dining table (4.706 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_2102__1:q02Pick up the potato and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_inirish potato: bedroom/dresser 안 → kitchen/countertop (12.078 m)
restore:train_2102__1:q03Pick up the remote control and place it in or on where it first was, then pick up the potato and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 from_hidden relocate store_in twin_merge twinremote control: living room/dining table → living room/dining table (1.112 m); irish potato: bedroom/dresser 안 → kitchen/countertop (12.078 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_2159__2:q00Pick up the key chain and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinkey chain: bedroom/dresser → living room/dining table (12.582 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_2159__2:q01Pick up the key chain and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinkey chain: bedroom/dresser → kitchen/countertop (6.549 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_2159__2:q02Pick up the egg and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_inegg: bedroom/desk 안 → kitchen/countertop (10.181 m)
restore:train_2159__2:q03Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1 shiftremote control: living room/tv stand → living room/sofa (3.053 m)
restore:train_2159__2:q04Pick up the mug and place it in or on where it first wasfirst
single		navigate hops1mug: bathroom/sink → bedroom/desk (6.641 m)restore_neighbor_inside_r_place
restore:train_2159__2:q05Pick up the key chain and place it in or on where it first was, then pick up the egg and place it in or on where it first was, and then pick up the remote control and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 from_hidden relocate shift store_in twin_merge twinkey chain: bedroom/dresser → living room/dining table (12.582 m); egg: bedroom/desk 안 → kitchen/countertop (10.181 m); remote control: living room/tv stand → living room/sofa (3.053 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_2169__1:q00Pick up the butter knife and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinbutter knife: kitchen/dining table → living room/armchair (3.612 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_misplaced_answer restore_shares_with_distractor
restore:train_2169__1:q01Pick up the vase and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_invase: bedroom/dresser 안 → living room/tv stand (8.164 m)
restore:train_2224__0:q00Pick up the potato and place it in or on where it first wasfirst
single		navigate hops1irish potato: living room/dining table → kitchen/countertop (5.303 m)
restore:train_2224__0:q01Pick up the remote controls and place them in or on where they first were, then pick up the potato and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate twin_merge twinremote control: bedroom/tv stand → bedroom/dining table (6.019 m); remote control: bathroom/toilet → living room/dining table (4.114 m); irish potato: living room/dining table → kitchen/countertop (5.303 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_2224__2:q00Pick up the key chain and place it in or on where it first wasfirst
single		navigate hops1 from_hidden shift store_inkey chain: bedroom/dresser 안 → bedroom/tv stand (6.14 m)restore_neighbor_inside_r_place
restore:train_2224__2:q01Pick up the potato and place it in or on where it first wasfirst
single		navigate hops1irish potato: living room/chair → kitchen/countertop (5.649 m)
restore:train_2224__2:q02Pick up the key chain and place it in or on where it first was, then pick up the potato and place it in or on where it first wasfirst
multi		navigate hops1 from_hidden shift store_inkey chain: bedroom/dresser 안 → bedroom/tv stand (6.14 m); irish potato: living room/chair → kitchen/countertop (5.649 m)restore_neighbor_inside_r_place
restore:train_2277__2:q00Pick up the salt shaker and place it in or on where it first wasfirst
single		navigate hops1salt shaker: living room/dining table → kitchen/countertop (1.963 m)
restore:train_2277__2:q01Pick up the tissue box and place it in or on where it first wasfirst
single		navigate hops1 shifttissue box: living room/dining table → living room/tv stand (5.565 m)restore_neighbor_inside_r_place
restore:train_2277__2:q02Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops1 decoyremote control: bedroom/dresser → living room/tv stand (5.699 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_referent_ambiguous last_event_obj
restore:train_2277__2:q03Pick up the salt shaker and place it in or on where it first was, then pick up the tissue box and place it in or on where it first was, and then pick up the remote control and place it in or on where it first wasfirst
multi		in_reach navigate hops1 decoy shiftsalt shaker: living room/dining table → kitchen/countertop (1.963 m); tissue box: living room/dining table → living room/tv stand (5.565 m); remote control: bedroom/dresser → living room/tv stand (5.699 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_referent_ambiguous last_event_obj
restore:train_2571__0:q00Pick up the cell phone and place it in or on where it first wasfirst
single		navigate hops1 from_hidden shift store_incell phone: bedroom/dresser 안 → bedroom/dining table (2.918 m)
restore:train_2571__0:q01Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1remote control: kitchen/dining table → living room/tv stand (7.118 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_2571__0:q02Pick up the cell phone and place it in or on where it first was, then pick up the remote control and place it in or on where it first wasfirst
multi		navigate hops1 from_hidden shift store_incell phone: bedroom/dresser 안 → bedroom/dining table (2.918 m); remote control: kitchen/dining table → living room/tv stand (7.118 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_2571__1:q00Pick up the knife and place it in or on where it first wasfirst
single		navigate hops1 shift twinknife: kitchen/chair → kitchen/dining table (1.001 m)
restore:train_2571__1:q01Pick up the mug and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinmug: bedroom/dresser → kitchen/countertop (11.25 m)restore_neighbor_inside_r_place
restore:train_2571__1:q02Pick up the mug and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinmug: bedroom/dresser → living room/dining table (1.818 m)
restore:train_2571__1:q03Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_inremote control: bedroom/dresser 안 → living room/tv stand (2.516 m)restore_neighbor_inside_r_place
restore:train_2571__1:q04Pick up the cell phone and place it in or on where it first wasfirst
single		in_reach hops1cell phone: bathroom/clothes dryer → bedroom/dining table (5.96 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_2571__1:q05Pick up the knife and place it in or on where it first was, then pick up the mug and place it in or on where it first was, and then pick up the remote control and place it in or on where it first wasfirst
multi		navigate hops1 hops2 from_hidden relocate shift store_in twin_merge twinknife: kitchen/chair → kitchen/dining table (1.001 m); mug: bedroom/dresser → kitchen/countertop (11.25 m); remote control: bedroom/dresser 안 → living room/tv stand (2.516 m)restore_neighbor_inside_r_place restore_neighbor_inside_r_place
restore:train_2738__0:q00Pick up the mug and place it in or on where it first wasfirst
single		in_reach hops1 decoymug: bedroom/dining table → kitchen/countertop (6.726 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_referent_ambiguous last_event_obj
restore:train_2788__2:q00Pick up the knife and place it in or on where it first wasfirst
single		navigate hops1knife: bedroom/dining table → kitchen/countertop (6.431 m)
restore:train_2788__2:q01Pick up the remote controls and place them in or on where they first were, then pick up the knife and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 decoy relocateremote control: living room/armchair → living room/dining table (2.956 m); remote control: living room/dining table → bedroom/bed (5.397 m); knife: bedroom/dining table → kitchen/countertop (6.431 m)restore_from_seen_last5s restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_2850__2:q00Pick up the potato and place it in or on where it first wasfirst
single		navigate hops1 shiftirish potato: kitchen/chair → kitchen/countertop (2.733 m)
restore:train_2850__2:q01Pick up the spoon and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinspoon: kitchen/countertop → bedroom/dining table (3.225 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_misplaced_answer restore_shares_with_distractor last_event_obj
restore:train_2850__2:q02Pick up the mug and place it in or on where it first wasfirst
single		navigate hops1mug: kitchen/toilet → living room/dining table (6.448 m)
restore:train_2850__2:q03Pick up the potato and place it in or on where it first was, then pick up the mug and place it in or on where it first wasfirst
multi		navigate hops1 shiftirish potato: kitchen/chair → kitchen/countertop (2.733 m); mug: kitchen/toilet → living room/dining table (6.448 m)
restore:train_2853__0:q00Pick up the tissue box and place it in or on where it first wasfirst
single		navigate hops1tissue box: bathroom/toilet → bedroom/dresser (11.509 m)restore_neighbor_inside_r_place last_event_obj
restore:train_2853__0:q01Pick up the remote controls and place them in or on where they first were, then pick up the tissue box and place it in or on where it first wasfirst
multi		navigate hops1 shiftremote control: bedroom/tv stand → living room/sofa (11.23 m); remote control: living room/dining table → living room/sofa (4.389 m); tissue box: bathroom/toilet → bedroom/dresser (11.509 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_misplaced_answer last_event_obj
restore:train_2853__2:q00Pick up the tissue box and place it in or on where it first wasfirst
single		navigate hops1tissue box: bathroom/toilet → bedroom/dresser (11.551 m)
restore:train_2853__2:q01Pick up the remote controls and place them in or on where they first were, then pick up the tissue box and place it in or on where it first wasfirst
multi		in_reach navigate hops1 shiftremote control: bedroom/tv stand → living room/sofa (11.217 m); remote control: living room/dining table → living room/sofa (4.389 m); tissue box: bathroom/toilet → bedroom/dresser (11.551 m)restore_from_seen_last5s restore_from_seen_last5s restore_from_visible_in_query_frame restore_misplaced_answer last_event_obj
restore:train_2894__0:q00Pick up the spatula and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinspatula: kitchen/countertop → —/dresser (6.987 m)restore_misplaced_answer answer_room_name_unresolved restore_shares_with_distractor
restore:train_2894__0:q01Pick up the pen and place it in or on where it first wasfirst
single		navigate hops1 shiftpen: —/sofa → —/dining table (2.939 m)answer_room_name_unresolved answer_room_name_unresolved
restore:train_2894__0:q02Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops1remote control: —/dining table → —/sofa (7.744 m)restore_from_seen_last5s restore_from_visible_in_query_frame answer_room_name_unresolved answer_room_name_unresolved last_event_obj
restore:train_2894__0:q03Pick up the pen and place it in or on where it first was, then pick up the remote control and place it in or on where it first wasfirst
multi		in_reach navigate hops1 shiftpen: —/sofa → —/dining table (2.939 m); remote control: —/dining table → —/sofa (7.744 m)restore_from_seen_last5s restore_from_visible_in_query_frame answer_room_name_unresolved answer_room_name_unresolved answer_room_name_unresolved answer_room_name_unresolved last_event_obj
restore:train_3058__1:q00Pick up the pen and place it in or on where it first wasfirst
single		navigate hops1 shiftpen: bedroom/bed → bedroom/dining table (2.294 m)
restore:train_3058__1:q01Pick up the bowl and place it in or on where it first wasfirst
single		in_reach hops1bowl: kitchen/dining table → living room/dining table (5.52 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_3058__1:q02Pick up the pen and place it in or on where it first was, then pick up the bowl and place it in or on where it first wasfirst
multi		in_reach navigate hops1 shiftpen: bedroom/bed → bedroom/dining table (2.294 m); bowl: kitchen/dining table → living room/dining table (5.52 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_3060__1:q00Pick up the mugs and place them in or on where they first werefirst
multi		in_reach navigate hops1 hops2 decoy relocatemug: kitchen/countertop → bedroom/dining table (6.034 m); mug: bedroom/dining table → kitchen/dining table (7.016 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_3060__2:q00Pick up the mug and place it in or on where it first wasfirst
single		in_reach hops1 decoymug: kitchen/dining table → bedroom/dining table (6.001 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_referent_ambiguous last_event_obj
restore:train_306__0:q00Pick up the key chain and place it in or on where it first wasfirst
single		navigate hops1key chain: kitchen/countertop → living room/dining table (6.881 m)last_event_obj
restore:train_3377__1:q00Pick up the ladle and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinladle: kitchen/dining table → kitchen/countertop (3.02 m)restore_same_room_but_hops last_event_obj
restore:train_3377__1:q01Pick up the ladle and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinladle: kitchen/dining table → bedroom/armchair (7.058 m)last_event_obj
restore:train_3377__1:q02Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1remote control: living room/sofa → bedroom/dining table (5.965 m)
restore:train_3377__1:q03Pick up the ladle and place it in or on where it first was, then pick up the remote control and place it in or on where it first wasfirst
multi		navigate hops1 hops2 relocate twin_merge twinladle: kitchen/dining table → kitchen/countertop (3.02 m); remote control: living room/sofa → bedroom/dining table (5.965 m)restore_same_room_but_hops last_event_obj
restore:train_3426__1:q00Pick up the cloth and place it in or on where it first wasfirst
single		navigate hops1 shiftfabric: bedroom/bed → bedroom/tv stand (7.72 m)restore_neighbor_inside_r_place
restore:train_3426__1:q01Pick up the spatula and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinspatula: kitchen/countertop → living room/dining table (2.127 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_3553__2:q00Pick up the bowl and place it in or on where it first wasfirst
single		navigate hops1 shiftbowl: kitchen/dining table → kitchen/countertop (5.895 m)
restore:train_3553__2:q01Pick up the spoon and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinspoon: kitchen/countertop → kitchen/countertop (1.735 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_same_room_but_hops last_event_obj
restore:train_3553__2:q02Pick up the spoon and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinspoon: kitchen/countertop → living room/sofa (5.445 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_3553__2:q03Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_inremote control: bedroom/dresser 안 → living room/dining table (9.854 m)restore_neighbor_inside_r_place
restore:train_3553__2:q04Pick up the bowl and place it in or on where it first was, then pick up the spoon and place it in or on where it first was, and then pick up the remote control and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 from_hidden relocate shift store_in twin_merge twinbowl: kitchen/dining table → kitchen/countertop (5.895 m); spoon: kitchen/countertop → kitchen/countertop (1.735 m); remote control: bedroom/dresser 안 → living room/dining table (9.854 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_neighbor_inside_r_place restore_same_room_but_hops last_event_obj
restore:train_3655__0:q00Pick up the candle and place it in or on where it first wasfirst
single		navigate hops1 shiftcandle: living room/sofa → living room/tv stand (3.036 m)restore_neighbor_inside_r_place
restore:train_3655__2:q00Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinremote control: bedroom/dresser → living room/dining table (4.824 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_3655__2:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: bedroom/dresser → kitchen/shelf (9.693 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_3655__2:q02Pick up the candle and place it in or on where it first wasfirst
single		navigate hops1 shiftcandle: living room/sofa → living room/tv stand (3.034 m)restore_neighbor_inside_r_place
restore:train_3655__2:q03Pick up the remote control and place it in or on where it first was, then pick up the candle and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinremote control: bedroom/dresser → living room/dining table (4.824 m); candle: living room/sofa → living room/tv stand (3.034 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_3667__0:q00Pick up the bowls and place them in or on where they first werefirst
multi		navigate hops1 hops2 decoy relocatebowl: bathroom/toilet → living room/dining table (4.358 m); bowl: living room/dining table → kitchen/chair (7.0 m)last_event_obj
restore:train_3679__1:q00Pick up the remote control and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinremote control: bedroom/bed → bathroom/clothes dryer (6.262 m)restore_misplaced_answer restore_shares_with_distractor
restore:train_3679__1:q01Pick up the cell phone and place it in or on where it first wasfirst
single		in_reach hops1 shiftcell phone: bedroom/bed → bedroom/dining table (7.448 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_3679__2:q00Pick up the remote control and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinremote control: bedroom/bed → bathroom/clothes dryer (6.261 m)restore_misplaced_answer restore_shares_with_distractor
restore:train_3679__2:q01Pick up the cell phone and place it in or on where it first wasfirst
single		navigate hops1 shiftcell phone: bedroom/bed → bedroom/dining table (7.377 m)
restore:train_3912__0:q00Pick up the cell phone and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twincell phone: kitchen/dining table → living room/tv stand (2.702 m)restore_neighbor_inside_r_place
restore:train_3912__0:q01Pick up the cell phone and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twincell phone: kitchen/dining table → kitchen/countertop (2.944 m)restore_same_room_but_hops
restore:train_3912__0:q02Pick up the tennis racket and place it in or on where it first wasfirst
single		in_reach hops1tennisracket: bathroom/clothes dryer → bedroom/dining table (4.16 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_3912__0:q03Pick up the cell phone and place it in or on where it first was, then pick up the tennis racket and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate twin_merge twincell phone: kitchen/dining table → living room/tv stand (2.702 m); tennisracket: bathroom/clothes dryer → bedroom/dining table (4.16 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_3912__2:q00Pick up the cell phone and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twincell phone: kitchen/dining table → living room/tv stand (2.701 m)
restore:train_3912__2:q01Pick up the cell phone and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twincell phone: kitchen/dining table → kitchen/countertop (2.946 m)restore_same_room_but_hops
restore:train_3912__2:q02Pick up the fork and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_infork: bedroom/desk 안 → kitchen/dining table (7.308 m)
restore:train_3912__2:q03Pick up the tennis racket and place it in or on where it first wasfirst
single		in_reach hops1tennisracket: bathroom/clothes dryer → bedroom/dining table (4.16 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_3912__2:q04Pick up the cell phone and place it in or on where it first was, then pick up the fork and place it in or on where it first was, and then pick up the tennis racket and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 from_hidden relocate store_in twin_merge twincell phone: kitchen/dining table → living room/tv stand (2.701 m); fork: bedroom/desk 안 → kitchen/dining table (7.308 m); tennisracket: bathroom/clothes dryer → bedroom/dining table (4.16 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_3916__0:q00Pick up the spatula and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinspatula: kitchen/countertop → kitchen/countertop (2.353 m)restore_same_room_but_hops
restore:train_3916__0:q01Pick up the spatula and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinspatula: kitchen/countertop → living room/tv stand (11.318 m)
restore:train_3916__0:q02Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_inremote control: bedroom/dresser 안 → living room/dining table (11.971 m)
restore:train_3916__0:q03Pick up the bowls and place them in or on where they first were, then pick up the spatula and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinbowl: kitchen/chair → kitchen/dining table (1.124 m); bowl: bathroom/sink → bedroom/dining table (9.417 m); spatula: kitchen/countertop → kitchen/countertop (2.353 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_3944__0:q00Pick up the cell phone and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twincell phone: kitchen/dresser → living room/tv stand (12.629 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_3944__0:q01Pick up the cell phone and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twincell phone: kitchen/dresser → bedroom/dining table (7.463 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_3944__0:q02Pick up the remote controls and place them in or on where they first were, then pick up the cell phone and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinremote control: living room/dining table → living room/sofa (3.604 m); remote control: bedroom/sink → kitchen/tv stand (3.366 m); cell phone: kitchen/dresser → living room/tv stand (12.629 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_neighbor_inside_r_place last_event_obj
restore:train_3994__0:q00Pick up the salt shaker and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_insalt shaker: bedroom/dresser 안 → kitchen/dining table (3.796 m)
restore:train_3994__0:q01Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1 shiftremote control: bedroom/dresser → bedroom/dining table (4.84 m)
restore:train_3994__0:q02Pick up the salt shaker and place it in or on where it first was, then pick up the remote control and place it in or on where it first wasfirst
multi		navigate hops1 from_hidden shift store_insalt shaker: bedroom/dresser 안 → kitchen/dining table (3.796 m); remote control: bedroom/dresser → bedroom/dining table (4.84 m)
restore:train_4133__1:q00Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1 twinremote control: bedroom/tv stand → living room/tv stand (6.174 m)restore_misplaced_answer
restore:train_4133__1:q01Pick up the remote control and place it in or on where it first was, then pick up the mugs and place them in or on where they first werefirst
multi		in_reach navigate hops1 from_hidden store_in twinremote control: bedroom/tv stand → living room/tv stand (6.174 m); mug: bedroom/dresser 안 → kitchen/dining table (5.642 m); mug: bathroom/toilet → bedroom/dining table (11.825 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_misplaced_answer last_event_obj
restore:train_4136__1:q00Pick up the potato and place it in or on where it first wasfirst
single		navigate hops1 shiftirish potato: kitchen/chair → kitchen/countertop (3.874 m)restore_neighbor_inside_r_place
restore:train_4136__1:q01Pick up the butter knife and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinbutter knife: kitchen/countertop → living room/dining table (8.819 m)restore_misplaced_answer restore_shares_with_distractor
restore:train_4136__1:q02Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops1remote control: bathroom/sink → bedroom/bed (7.068 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_4136__1:q03Pick up the potato and place it in or on where it first was, then pick up the remote control and place it in or on where it first wasfirst
multi		in_reach navigate hops1 shiftirish potato: kitchen/chair → kitchen/countertop (3.874 m); remote control: bathroom/sink → bedroom/bed (7.068 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_4304__0:q00Pick up the key chain and place it in or on where it first wasfirst
single		navigate hops1 from_hidden shift store_in twinkey chain: bedroom/dresser 안 → bedroom/tv stand (7.023 m)restore_neighbor_inside_r_place
restore:train_4304__0:q01Pick up the cup and place it in or on where it first wasfirst
single		navigate hops1cup: living room/armchair → kitchen/dining table (7.252 m)last_event_obj
restore:train_4304__0:q02Pick up the key chain and place it in or on where it first was, then pick up the cup and place it in or on where it first wasfirst
multi		navigate hops1 from_hidden shift store_in twinkey chain: bedroom/dresser 안 → bedroom/tv stand (7.023 m); cup: living room/armchair → kitchen/dining table (7.252 m)restore_neighbor_inside_r_place last_event_obj
restore:train_4355__0:q00Pick up the key chain and place it in or on where it first wasfirst
single		navigate hops1key chain: kitchen/dining table → bedroom/armchair (7.444 m)
restore:train_4355__0:q01Pick up the egg and place it in or on where it first wasfirst
single		in_reach hops1egg: living room/tv stand → kitchen/countertop (8.197 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_4355__0:q02Pick up the key chain and place it in or on where it first was, then pick up the egg and place it in or on where it first wasfirst
multi		in_reach navigate hops1key chain: kitchen/dining table → bedroom/armchair (7.444 m); egg: living room/tv stand → kitchen/countertop (8.197 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_4360__2:q00Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops1 shiftremote control: living room/tv stand → living room/sofa (2.287 m)restore_from_seen_last5s
restore:train_4360__2:q01Pick up the key chain and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinkey chain: living room/tv stand → living room/dining table (2.108 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_4360__2:q02Pick up the key chain and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinkey chain: living room/tv stand → kitchen/dining table (3.776 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_4360__2:q03Pick up the remote control and place it in or on where it first was, then pick up the key chain and place it in or on where it first wasfirst
multi		in_reach hops1 hops2 relocate shift twin_merge twinremote control: living room/tv stand → living room/sofa (2.287 m); key chain: living room/tv stand → living room/dining table (2.108 m)restore_from_seen_last5s restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_4392__2:q00Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinremote control: living room/sofa → bedroom/dresser (9.528 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_4392__2:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: living room/sofa → bathroom/toilet (9.831 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_4584__0:q00Pick up the cell phone and place it in or on where it first wasfirst
single		navigate hops1cell phone: living room/tv stand → kitchen/countertop (5.446 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_misplaced_answer
restore:train_4887__0:q00Pick up the mug and place it in or on where it first wasfirst
single		navigate hops1 shiftmug: bedroom/armchair → bedroom/tv stand (5.74 m)restore_neighbor_inside_r_place
restore:train_4887__0:q01Pick up the key chain and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinkey chain: living room/dining table → bedroom/armchair (9.652 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_4887__0:q02Pick up the key chain and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinkey chain: living room/dining table → kitchen/countertop (2.336 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_4887__0:q03Pick up the salt shaker and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_insalt shaker: living room/shelf 안 → kitchen/countertop (8.164 m)
restore:train_4887__0:q04Pick up the mug and place it in or on where it first was, then pick up the key chain and place it in or on where it first was, and then pick up the salt shaker and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 from_hidden relocate shift store_in twin_merge twinmug: bedroom/armchair → bedroom/tv stand (5.74 m); key chain: living room/dining table → bedroom/armchair (9.652 m); salt shaker: living room/shelf 안 → kitchen/countertop (8.164 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_4887__2:q00Pick up the key chain and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinkey chain: living room/dining table → bedroom/armchair (9.651 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_4887__2:q01Pick up the key chain and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinkey chain: living room/dining table → kitchen/countertop (2.333 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_4887__2:q02Pick up the salt shaker and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_insalt shaker: living room/shelf 안 → kitchen/countertop (8.167 m)
restore:train_4887__2:q03Pick up the tissue box and place it in or on where it first wasfirst
single		navigate hops1 shift twintissue box: bedroom/tv stand → bedroom/dresser (1.462 m)restore_from_seen_last5s
restore:train_4887__2:q04Pick up the key chain and place it in or on where it first was, then pick up the salt shaker and place it in or on where it first was, and then pick up the tissue box and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 from_hidden relocate shift store_in twin_merge twinkey chain: living room/dining table → bedroom/armchair (9.651 m); salt shaker: living room/shelf 안 → kitchen/countertop (8.167 m); tissue box: bedroom/tv stand → bedroom/dresser (1.462 m)restore_from_seen_last5s restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_4913__1:q00Pick up the cell phone and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twincell phone: bedroom/dining table → kitchen/countertop (8.662 m)restore_neighbor_inside_r_place
restore:train_4913__1:q01Pick up the cell phone and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twincell phone: bedroom/dining table → living room/dining table (11.099 m)
restore:train_4913__1:q02Pick up the pen and place it in or on where it first wasfirst
single		navigate hops1pen: bathroom/toilet → bedroom/dresser (5.599 m)last_event_obj
restore:train_4913__1:q03Pick up the cell phone and place it in or on where it first was, then pick up the pen and place it in or on where it first wasfirst
multi		navigate hops1 hops2 relocate twin_merge twincell phone: bedroom/dining table → kitchen/countertop (8.662 m); pen: bathroom/toilet → bedroom/dresser (5.599 m)restore_neighbor_inside_r_place last_event_obj
restore:train_5258__1:q00Pick up the butter knife and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_mergebutter knife: kitchen/countertop → kitchen/countertop (1.352 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_5258__1:q01Pick up the butter knife and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_mergebutter knife: kitchen/countertop → living room/dresser (8.438 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_5258__1:q02Pick up the spatula and place it in or on where it first wasfirst
single		navigate hops1 shiftspatula: kitchen/chair → kitchen/countertop (4.998 m)
restore:train_5258__1:q03Pick up the butter knife and place it in or on where it first was, then pick up the spatula and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_mergebutter knife: kitchen/countertop → kitchen/countertop (1.352 m); spatula: kitchen/chair → kitchen/countertop (4.998 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_5374__2:q00Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinremote control: bedroom/dresser → bedroom/desk (6.495 m)restore_same_room_but_hops last_event_obj
restore:train_5374__2:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinremote control: bedroom/dresser → bathroom/toilet (8.0 m)last_event_obj
restore:train_5374__2:q02Pick up the cell phone and place it in or on where it first wasfirst
single		navigate hops1 from_hidden shift store_incell phone: bedroom/dresser 안 → bedroom/desk (6.11 m)
restore:train_5374__2:q03Pick up the remote control and place it in or on where it first was, then pick up the cell phone and place it in or on where it first wasfirst
multi		navigate hops1 hops2 from_hidden relocate shift store_in twin_merge twinremote control: bedroom/dresser → bedroom/desk (6.495 m); cell phone: bedroom/dresser 안 → bedroom/desk (6.11 m)restore_same_room_but_hops last_event_obj
restore:train_5464__0:q00Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinremote control: living room/tv stand → bedroom/bed (6.563 m)
restore:train_5464__0:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinremote control: living room/tv stand → bathroom/sink (5.607 m)
restore:train_5464__0:q02Pick up the key chain and place it in or on where it first wasfirst
single		navigate hops1key chain: kitchen/countertop → living room/tv stand (5.301 m)
restore:train_5464__0:q03Pick up the remote control and place it in or on where it first was, then pick up the key chain and place it in or on where it first wasfirst
multi		navigate hops1 hops2 relocate twin_merge twinremote control: living room/tv stand → bedroom/bed (6.563 m); key chain: kitchen/countertop → living room/tv stand (5.301 m)
restore:train_5691__1:q00Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1remote control: bathroom/toilet → bedroom/tv stand (6.18 m)
restore:train_5691__1:q01Pick up the key chains and place them in or on where they first were, then pick up the remote control and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinkey chain: bedroom/tv stand → living room/desk (2.49 m); key chain: living room/sofa → living room/dining table (2.417 m); remote control: bathroom/toilet → bedroom/tv stand (6.18 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_573__0:q00Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinremote control: bedroom/chair → bedroom/bed (2.842 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_573__0:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: bedroom/chair → living room/cart (4.822 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_573__0:q02Pick up the salt shaker and place it in or on where it first wasfirst
single		navigate hops1salt shaker: bathroom/toilet → kitchen/countertop (1.042 m)restore_neighbor_inside_r_place
restore:train_573__0:q03Pick up the remote control and place it in or on where it first was, then pick up the salt shaker and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate twin_merge twinremote control: bedroom/chair → bedroom/bed (2.842 m); salt shaker: bathroom/toilet → kitchen/countertop (1.042 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_same_room_but_hops last_event_obj
restore:train_573__2:q00Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinremote control: bedroom/bed → bedroom/chair (2.617 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_same_room_but_hops last_event_obj
restore:train_573__2:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: bedroom/bed → living room/cart (4.344 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_573__2:q02Pick up the spatula and place it in or on where it first wasfirst
single		navigate hops1spatula: bathroom/clothes dryer → kitchen/countertop (4.287 m)
restore:train_573__2:q03Pick up the remote control and place it in or on where it first was, then pick up the spatula and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate twin_merge twinremote control: bedroom/bed → bedroom/chair (2.617 m); spatula: bathroom/clothes dryer → kitchen/countertop (4.287 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_same_room_but_hops last_event_obj
restore:train_5890__0:q00Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinremote control: living room/tv stand → bedroom/dining table (3.712 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_5890__0:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: living room/tv stand → kitchen/countertop (7.012 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_5890__0:q02Pick up the spoon and place it in or on where it first wasfirst
single		navigate hops1spoon: living room/dresser → kitchen/countertop (5.012 m)
restore:train_5890__0:q03Pick up the remote control and place it in or on where it first was, then pick up the spoon and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate twin_merge twinremote control: living room/tv stand → bedroom/dining table (3.712 m); spoon: living room/dresser → kitchen/countertop (5.012 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_5902__2:q00Pick up the fork and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinfork: kitchen/countertop → living room/sofa (6.998 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_5902__2:q01Pick up the bowl and place it in or on where it first wasfirst
single		navigate hops1bowl: bedroom/desk → living room/dining table (7.321 m)
restore:train_597__0:q00Pick up the apple and place it in or on where it first wasfirst
single		in_reach hops1apple: living room/dining table → kitchen/dining table (5.42 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_597__2:q00Pick up the tissue box and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twintissue box: bathroom/dresser → bedroom/tv stand (7.857 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_597__2:q01Pick up the tissue box and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twintissue box: bathroom/dresser → bathroom/sink (3.625 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_597__2:q02Pick up the fork and place it in or on where it first wasfirst
single		navigate hops1fork: living room/dining table → kitchen/dining table (5.507 m)
restore:train_597__2:q03Pick up the tissue box and place it in or on where it first was, then pick up the fork and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate twin_merge twintissue box: bathroom/dresser → bedroom/tv stand (7.857 m); fork: living room/dining table → kitchen/dining table (5.507 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_6056__2:q00Pick up the mug and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinmug: bedroom/dining table → kitchen/countertop (7.049 m)
restore:train_6056__2:q01Pick up the mug and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinmug: bedroom/dining table → living room/chair (9.253 m)
restore:train_6056__2:q02Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1remote control: bedroom/dresser → living room/sofa (9.835 m)restore_referent_ambiguous
restore:train_6056__2:q03Pick up the mug and place it in or on where it first was, then pick up the remote control and place it in or on where it first wasfirst
multi		navigate hops1 hops2 relocate twin_merge twinmug: bedroom/dining table → kitchen/countertop (7.049 m); remote control: bedroom/dresser → living room/sofa (9.835 m)restore_referent_ambiguous
restore:train_6222__0:q00Pick up the bowl and place it in or on where it first wasfirst
single		navigate hops1bowl: bathroom/toilet → bedroom/dining table (9.385 m)
restore:train_6222__1:q00Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinremote control: bedroom/dining table → living room/sofa (7.037 m)
restore:train_6222__1:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinremote control: bedroom/dining table → kitchen/dining table (5.979 m)
restore:train_6222__1:q02Pick up the bowl and place it in or on where it first wasfirst
single		navigate hops1bowl: bathroom/toilet → bedroom/dining table (9.385 m)
restore:train_6222__1:q03Pick up the remote control and place it in or on where it first was, then pick up the bowl and place it in or on where it first wasfirst
multi		navigate hops1 hops2 relocate twin_merge twinremote control: bedroom/dining table → living room/sofa (7.037 m); bowl: bathroom/toilet → bedroom/dining table (9.385 m)
restore:train_6233__1:q00Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinremote control: bedroom/desk → living room/sofa (9.015 m)
restore:train_6233__1:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinremote control: bedroom/desk → kitchen/dining table (8.267 m)
restore:train_6233__1:q02Pick up the spatula and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_inspatula: bedroom/desk 안 → kitchen/countertop (4.744 m)restore_neighbor_inside_r_place
restore:train_6233__1:q03Pick up the cell phone and place it in or on where it first wasfirst
single		in_reach hops1 shiftcell phone: living room/sofa → living room/dining table (2.634 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6233__1:q04Pick up the remote control and place it in or on where it first was, then pick up the spatula and place it in or on where it first was, and then pick up the cell phone and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 from_hidden relocate shift store_in twin_merge twinremote control: bedroom/desk → living room/sofa (9.015 m); spatula: bedroom/desk 안 → kitchen/countertop (4.744 m); cell phone: living room/sofa → living room/dining table (2.634 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_6242__1:q00Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinremote control: bedroom/tv stand → bedroom/dining table (4.464 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_6242__1:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: bedroom/tv stand → living room/cart (5.701 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6242__1:q02Pick up the cell phone and place it in or on where it first wasfirst
single		navigate hops1cell phone: kitchen/dining table → living room/sofa (9.235 m)
restore:train_6242__1:q03Pick up the remote control and place it in or on where it first was, then pick up the cell phone and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate twin_merge twinremote control: bedroom/tv stand → bedroom/dining table (4.464 m); cell phone: kitchen/dining table → living room/sofa (9.235 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_6278__1:q00Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinremote control: living room/tv stand → bedroom/bed (14.18 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6278__1:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: living room/tv stand → bathroom/toilet (6.26 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6278__2:q00Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinremote control: living room/tv stand → bedroom/bed (14.107 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6278__2:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: living room/tv stand → bathroom/toilet (6.199 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6278__2:q02Pick up the key chain and place it in or on where it first wasfirst
single		navigate hops1 from_hidden shift store_inkey chain: bedroom/dresser 안 → bedroom/dining table (4.745 m)
restore:train_6278__2:q03Pick up the remote control and place it in or on where it first was, then pick up the key chain and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 from_hidden relocate shift store_in twin_merge twinremote control: living room/tv stand → bedroom/bed (14.107 m); key chain: bedroom/dresser 안 → bedroom/dining table (4.745 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6376__2:q00Pick up the butter knife and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinbutter knife: kitchen/countertop → kitchen/dining table (2.107 m)restore_same_room_but_hops
restore:train_6376__2:q01Pick up the butter knife and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinbutter knife: kitchen/countertop → living room/dining table (7.89 m)
restore:train_6376__2:q02Pick up the fork and place it in or on where it first wasfirst
single		in_reach hops1 shiftfork: kitchen/chair → kitchen/countertop (2.527 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6376__2:q03Pick up the butter knife and place it in or on where it first was, then pick up the fork and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinbutter knife: kitchen/countertop → kitchen/dining table (2.107 m); fork: kitchen/chair → kitchen/countertop (2.527 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_6659__1:q00Pick up the spoon and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinspoon: kitchen/countertop → living room/shelf (6.849 m)restore_misplaced_answer restore_shares_with_distractor
restore:train_6659__1:q01Pick up the mug and place it in or on where it first wasfirst
single		navigate hops1mug: bathroom/toilet → bedroom/chair (7.659 m)
restore:train_6659__1:q02Pick up the apple and place it in or on where it first wasfirst
single		in_reach hops1 shiftapple: kitchen/dining table → kitchen/chair (1.359 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6659__1:q03Pick up the mug and place it in or on where it first was, then pick up the apple and place it in or on where it first wasfirst
multi		in_reach navigate hops1 shiftmug: bathroom/toilet → bedroom/chair (7.659 m); apple: kitchen/dining table → kitchen/chair (1.359 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6728__2:q00Pick up the spatula and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinspatula: kitchen/countertop → kitchen/countertop (1.096 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_6728__2:q01Pick up the spatula and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinspatula: kitchen/countertop → living room/dining table (7.431 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6728__2:q02Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1remote control: bathroom/toilet → bedroom/sofa (8.543 m)restore_referent_ambiguous
restore:train_6728__2:q03Pick up the spatula and place it in or on where it first was, then pick up the remote control and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate twin_merge twinspatula: kitchen/countertop → kitchen/countertop (1.096 m); remote control: bathroom/toilet → bedroom/sofa (8.543 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops restore_referent_ambiguous last_event_obj
restore:train_6762__1:q00Pick up the key chain and place it in or on where it first wasfirst
single		navigate hops1 shiftkey chain: living room/dining table → living room/tv stand (4.798 m)
restore:train_6762__1:q01Pick up the remote controls and place them in or on where they first were, then pick up the key chain and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinremote control: bedroom/dining table → living room/sofa (9.737 m); remote control: bathroom/toilet → bedroom/tv stand (5.403 m); key chain: living room/dining table → living room/tv stand (4.798 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_6818__2:q00Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: bedroom/dresser → kitchen/chair (5.372 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6844__2:q00Pick up the key chain and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinkey chain: living room/tv stand → bedroom/dining table (12.975 m)restore_referent_ambiguous
restore:train_6844__2:q01Pick up the key chain and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinkey chain: living room/tv stand → bathroom/toilet (6.778 m)restore_referent_ambiguous
restore:train_6844__2:q02Pick up the cell phone and place it in or on where it first wasfirst
single		in_reach hops1 shiftcell phone: bedroom/dining table → bedroom/dresser (3.781 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_6844__2:q03Pick up the key chain and place it in or on where it first was, then pick up the cell phone and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinkey chain: living room/tv stand → bedroom/dining table (12.975 m); cell phone: bedroom/dining table → bedroom/dresser (3.781 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_referent_ambiguous last_event_obj
restore:train_6878__2:q00Pick up the cell phone and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twincell phone: kitchen/tv stand → bedroom/dining table (10.682 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6878__2:q01Pick up the cell phone and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twincell phone: kitchen/tv stand → bathroom/toilet (8.088 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_6878__2:q02Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1 shiftremote control: bedroom/dresser → bedroom/bed (1.237 m)
restore:train_6878__2:q03Pick up the cell phone and place it in or on where it first was, then pick up the remote control and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twincell phone: kitchen/tv stand → bedroom/dining table (10.682 m); remote control: bedroom/dresser → bedroom/bed (1.237 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6998__0:q00Pick up the mug and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinmug: bedroom/dresser → kitchen/countertop (8.311 m)
restore:train_6998__0:q01Pick up the mug and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinmug: bedroom/dresser → living room/dining table (5.326 m)
restore:train_6998__0:q02Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1remote control: bedroom/dresser → living room/dining table (5.506 m)
restore:train_6998__0:q03Pick up the potato and place it in or on where it first wasfirst
single		in_reach hops1 shiftirish potato: kitchen/dining table → kitchen/countertop (2.275 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6998__0:q04Pick up the mug and place it in or on where it first was, then pick up the remote control and place it in or on where it first was, and then pick up the potato and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinmug: bedroom/dresser → kitchen/countertop (8.311 m); remote control: bedroom/dresser → living room/dining table (5.506 m); irish potato: kitchen/dining table → kitchen/countertop (2.275 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6998__2:q00Pick up the mug and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinmug: bedroom/dresser → kitchen/countertop (8.266 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6998__2:q01Pick up the mug and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinmug: bedroom/dresser → living room/dining table (5.176 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_6998__2:q02Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops1remote control: bedroom/dresser → living room/dining table (5.48 m)restore_from_seen_last5s restore_from_visible_in_query_frame
restore:train_6998__2:q03Pick up the ladle and place it in or on where it first wasfirst
single		navigate hops1 shiftladle: kitchen/dining table → kitchen/countertop (2.048 m)
restore:train_6998__2:q04Pick up the mug and place it in or on where it first was, then pick up the remote control and place it in or on where it first was, and then pick up the ladle and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinmug: bedroom/dresser → kitchen/countertop (8.266 m); remote control: bedroom/dresser → living room/dining table (5.48 m); ladle: kitchen/dining table → kitchen/countertop (2.048 m)restore_from_seen_last5s restore_from_seen_last5s restore_from_visible_in_query_frame restore_from_visible_in_query_frame last_event_obj
restore:train_7036__0:q00Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinremote control: bedroom/chair → living room/dining table (7.828 m)restore_neighbor_inside_r_place
restore:train_7036__0:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinremote control: bedroom/chair → kitchen/chair (10.654 m)
restore:train_7036__0:q02Pick up the potato and place it in or on where it first wasfirst
single		navigate hops1 shiftirish potato: kitchen/chair → kitchen/countertop (7.19 m)
restore:train_7036__0:q03Pick up the cell phone and place it in or on where it first wasfirst
single		in_reach hops1 twincell phone: bathroom/toilet → bedroom/dining table (7.946 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_referent_ambiguous last_event_obj
restore:train_7036__0:q04Pick up the remote control and place it in or on where it first was, then pick up the potato and place it in or on where it first was, and then pick up the cell phone and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinremote control: bedroom/chair → living room/dining table (7.828 m); irish potato: kitchen/chair → kitchen/countertop (7.19 m); cell phone: bathroom/toilet → bedroom/dining table (7.946 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_referent_ambiguous last_event_obj
restore:train_7047__1:q00Pick up the mug and place it in or on where it first wasfirst
single		navigate hops1 from_hidden shift store_inmug: bedroom/dresser 안 → bedroom/tv stand (2.62 m)
restore:train_7047__1:q01Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinremote control: living room/tv stand → bedroom/tv stand (6.506 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_7047__1:q02Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: living room/tv stand → bathroom/washing machine (1.79 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_7047__1:q03Pick up the butter knife and place it in or on where it first wasfirst
single		navigate hops1butter knife: living room/cart → kitchen/countertop (6.638 m)restore_neighbor_inside_r_place
restore:train_7047__1:q04Pick up the mug and place it in or on where it first was, then pick up the remote control and place it in or on where it first was, and then pick up the butter knife and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 from_hidden relocate shift store_in twin_merge twinmug: bedroom/dresser 안 → bedroom/tv stand (2.62 m); remote control: living room/tv stand → bedroom/tv stand (6.506 m); butter knife: living room/cart → kitchen/countertop (6.638 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_7151__1:q00Pick up the tissue box and place it in or on where it first wasfirst
single		navigate hops1 shifttissue box: bedroom/dining table → bedroom/dresser (2.325 m)
restore:train_7151__1:q01Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinremote control: living room/sofa → bedroom/desk (10.27 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_7151__1:q02Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: living room/sofa → bathroom/washing machine (5.762 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_7151__1:q03Pick up the pen and place it in or on where it first wasfirst
single		navigate hops1 twinpen: living room/coffee table → kitchen/countertop (3.459 m)
restore:train_7151__1:q04Pick up the tissue box and place it in or on where it first was, then pick up the remote control and place it in or on where it first was, and then pick up the pen and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twintissue box: bedroom/dining table → bedroom/dresser (2.325 m); remote control: living room/sofa → bedroom/desk (10.27 m); pen: living room/coffee table → kitchen/countertop (3.459 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_7152__1:q00Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinremote control: bedroom/chair → living room/dining table (3.512 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_7152__1:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: bedroom/chair → kitchen/countertop (8.134 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_7152__1:q02Pick up the mugs and place them in or on where they first were, then pick up the remote control and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 from_hidden relocate shift store_in twin_merge twinmug: bedroom/dresser 안 → bedroom/dining table (3.535 m); mug: bathroom/toilet → kitchen/countertop (6.018 m); remote control: bedroom/chair → living room/dining table (3.512 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_7385__0:q00Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinremote control: bedroom/bed → bedroom/bed (4.572 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_7385__0:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: bedroom/bed → bathroom/toilet (8.944 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_7385__0:q02Pick up the pen and place it in or on where it first wasfirst
single		navigate hops1 shiftpen: bedroom/bed → bedroom/dresser (2.131 m)
restore:train_7385__0:q03Pick up the pepper shaker and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_inpepper shaker: living room/tv stand 안 → kitchen/dining table (9.084 m)
restore:train_7385__0:q04Pick up the remote control and place it in or on where it first was, then pick up the pen and place it in or on where it first was, and then pick up the pepper shaker and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 from_hidden relocate shift store_in twin_merge twinremote control: bedroom/bed → bedroom/bed (4.572 m); pen: bedroom/bed → bedroom/dresser (2.131 m); pepper shaker: living room/tv stand 안 → kitchen/dining table (9.084 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_7428__1:q00Pick up the pen and place it in or on where it first wasfirst
single		navigate hops1 shiftpen: living room/cart → living room/dining table (1.718 m)restore_neighbor_inside_r_place
restore:train_7428__1:q01Pick up the pen and place it in or on where it first was, then pick up the remote controls and place them in or on where they first werefirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinpen: living room/cart → living room/dining table (1.718 m); remote control: bedroom/tv stand → living room/dining table (6.067 m); remote control: kitchen/dining table → bedroom/armchair (4.203 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_neighbor_inside_r_place last_event_obj
restore:train_7428__2:q00Pick up the cell phone and place it in or on where it first wasfirst
single		navigate hops1cell phone: bedroom/armchair → kitchen/dining table (3.382 m)restore_from_seen_last5s restore_from_visible_in_query_frame
restore:train_7428__2:q01Pick up the salt shaker and place it in or on where it first wasfirst
single		navigate hops1 from_hidden shift store_insalt shaker: kitchen/shelf 안 → kitchen/dining table (1.252 m)
restore:train_7428__2:q02Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1 twinremote control: living room/tv stand → bedroom/armchair (6.246 m)last_event_obj
restore:train_7428__2:q03Pick up the cell phone and place it in or on where it first was, then pick up the salt shaker and place it in or on where it first was, and then pick up the remote control and place it in or on where it first wasfirst
multi		navigate hops1 from_hidden shift store_in twincell phone: bedroom/armchair → kitchen/dining table (3.382 m); salt shaker: kitchen/shelf 안 → kitchen/dining table (1.252 m); remote control: living room/tv stand → bedroom/armchair (6.246 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_7650__2:q00Pick up the pepper shaker and place it in or on where it first wasfirst
single		navigate hops1 shiftpepper shaker: kitchen/dining table → kitchen/countertop (3.66 m)restore_from_seen_last5s restore_neighbor_inside_r_place
restore:train_7650__2:q01Pick up the spoon and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinspoon: kitchen/dining table → kitchen/countertop (3.266 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_7650__2:q02Pick up the spoon and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinspoon: kitchen/dining table → living room/dining table (4.033 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_7650__2:q03Pick up the bowl and place it in or on where it first wasfirst
single		navigate hops1bowl: bathroom/sink → bedroom/chair (3.66 m)
restore:train_7650__2:q04Pick up the pepper shaker and place it in or on where it first was, then pick up the spoon and place it in or on where it first was, and then pick up the bowl and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinpepper shaker: kitchen/dining table → kitchen/countertop (3.66 m); spoon: kitchen/dining table → kitchen/countertop (3.266 m); bowl: bathroom/sink → bedroom/chair (3.66 m)restore_from_seen_last5s restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_same_room_but_hops last_event_obj
restore:train_7661__1:q00Pick up the candle and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_incandle: bedroom/desk 안 → living room/tv stand (10.615 m)
restore:train_7661__1:q01Pick up the mug and place it in or on where it first wasfirst
single		navigate hops1 shiftmug: kitchen/chair → kitchen/countertop (4.407 m)
restore:train_7661__1:q02Pick up the cell phone and place it in or on where it first wasfirst
single		in_reach hops1cell phone: bathroom/toilet → bedroom/dining table (7.896 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_7661__1:q03Pick up the candle and place it in or on where it first was, then pick up the mug and place it in or on where it first was, and then pick up the cell phone and place it in or on where it first wasfirst
multi		in_reach navigate hops1 from_hidden shift store_incandle: bedroom/desk 안 → living room/tv stand (10.615 m); mug: kitchen/chair → kitchen/countertop (4.407 m); cell phone: bathroom/toilet → bedroom/dining table (7.896 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_7845__2:q00Pick up the remote control and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinremote control: living room/sofa → living room/dining table (5.135 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops restore_referent_ambiguous last_event_obj
restore:train_7845__2:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinremote control: living room/sofa → kitchen/dining table (7.097 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_referent_ambiguous last_event_obj
restore:train_7845__2:q02Pick up the apple and place it in or on where it first wasfirst
single		navigate hops1 shiftapple: kitchen/countertop → kitchen/dining table (3.49 m)restore_neighbor_inside_r_place
restore:train_7845__2:q03Pick up the remote control and place it in or on where it first was, then pick up the apple and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinremote control: living room/sofa → living room/dining table (5.135 m); apple: kitchen/countertop → kitchen/dining table (3.49 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_same_room_but_hops restore_referent_ambiguous last_event_obj
restore:train_8077__2:q00Pick up the mug and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinmug: bedroom/dining table → kitchen/dining table (6.763 m)last_event_obj
restore:train_8077__2:q01Pick up the mug and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinmug: bedroom/dining table → living room/dining table (8.99 m)last_event_obj
restore:train_8077__2:q02Pick up the pen and place it in or on where it first wasfirst
single		navigate hops1 shiftpen: kitchen/countertop → kitchen/dining table (5.547 m)
restore:train_8077__2:q03Pick up the mug and place it in or on where it first was, then pick up the pen and place it in or on where it first wasfirst
multi		navigate hops1 hops2 relocate shift twin_merge twinmug: bedroom/dining table → kitchen/dining table (6.763 m); pen: kitchen/countertop → kitchen/dining table (5.547 m)last_event_obj
restore:train_8102__2:q00Pick up the spatula and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinspatula: kitchen/countertop → living room/sofa (6.309 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_8102__2:q01Pick up the cell phone and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_incell phone: bedroom/dresser 안 → living room/sofa (9.202 m)
restore:train_8171__0:q00Pick up the mugs and place them in or on where they first werefirst
multi		navigate hops1 from_hidden shift store_inmug: bedroom/desk 안 → bedroom/tv stand (4.109 m); mug: bathroom/sink → kitchen/countertop (11.236 m)restore_neighbor_inside_r_place last_event_obj
restore:train_8171__1:q00Pick up the mugs and place them in or on where they first werefirst
multi		navigate hops1 from_hidden shift store_inmug: bedroom/desk 안 → bedroom/tv stand (4.109 m); mug: bathroom/sink → kitchen/countertop (11.236 m)restore_neighbor_inside_r_place last_event_obj
restore:train_8190__1:q00Pick up the spatula and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinspatula: kitchen/countertop → living room/dining table (8.784 m)
restore:train_8190__1:q01Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1remote control: bathroom/toilet → bedroom/dining table (7.66 m)
restore:train_8239__1:q00Pick up the potato and place it in or on where it first wasfirst
single		navigate hops1 shiftirish potato: kitchen/countertop → kitchen/dining table (2.813 m)restore_from_seen_last5s restore_from_visible_in_query_frame
restore:train_8239__1:q01Pick up the butter knife and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinbutter knife: kitchen/dining table → kitchen/countertop (3.72 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_same_room_but_hops last_event_obj
restore:train_8239__1:q02Pick up the butter knife and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinbutter knife: kitchen/dining table → living room/sofa (2.022 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_8239__1:q03Pick up the mug and place it in or on where it first wasfirst
single		navigate hops1mug: bathroom/toilet → bedroom/tv stand (3.333 m)restore_neighbor_inside_r_place
restore:train_8239__1:q04Pick up the potato and place it in or on where it first was, then pick up the butter knife and place it in or on where it first was, and then pick up the mug and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinirish potato: kitchen/countertop → kitchen/dining table (2.813 m); butter knife: kitchen/dining table → kitchen/countertop (3.72 m); mug: bathroom/toilet → bedroom/tv stand (3.333 m)restore_from_seen_last5s restore_from_seen_last5s restore_from_visible_in_query_frame restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_neighbor_inside_r_place restore_same_room_but_hops last_event_obj
restore:train_8287__1:q00Pick up the tissue box and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twintissue box: bedroom/desk → bathroom/sink (5.675 m)
restore:train_8287__1:q01Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1 from_hidden shift store_inremote control: bedroom/desk 안 → bedroom/dining table (2.584 m)
restore:train_8843__1:q00Pick up the spatula and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinspatula: kitchen/countertop → living room/dining table (5.205 m)
restore:train_8843__1:q01Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1remote control: bedroom/tv stand → living room/dining table (5.263 m)
restore:train_899__1:q00Pick up the candle and place it in or on where it first wasfirst
single		navigate hops1 from_hidden shift store_incandle: living room/tv stand 안 → living room/tv stand (2.631 m)restore_neighbor_inside_r_place
restore:train_899__1:q01Pick up the remote controls and place them in or on where they first were, then pick up the candle and place it in or on where it first wasfirst
multi		navigate hops1 hops2 from_hidden decoy relocate shift store_inremote control: living room/sofa → living room/dining table (2.391 m); remote control: living room/dining table → living room/sofa (2.643 m); candle: living room/tv stand 안 → living room/tv stand (2.631 m)restore_neighbor_inside_r_place restore_same_room_but_hops last_event_obj
restore:train_9018__2:q00Pick up the remote controls and place them in or on where they first werefirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinremote control: living room/dining table → living room/sofa (3.577 m); remote control: living room/cart → living room/sofa (1.787 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_9026__1:q00Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1remote control: bedroom/bed → living room/sofa (11.918 m)restore_misplaced_answer
restore:train_9026__1:q01Pick up the vase and place it in or on where it first wasfirst
single		navigate hops1 shiftvase: living room/dining table → living room/tv stand (1.782 m)
restore:train_9026__1:q02Pick up the potato and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_inirish potato: bedroom/dresser 안 → kitchen/dining table (4.994 m)
restore:train_9026__1:q03Pick up the bowl and place it in or on where it first wasfirst
single		in_reach hops1bowl: bathroom/sink → bedroom/dresser (4.47 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_9026__1:q04Pick up the remote control and place it in or on where it first was, then pick up the vase and place it in or on where it first was, and then pick up the potato and place it in or on where it first wasfirst
multi		navigate hops1 from_hidden shift store_inremote control: bedroom/bed → living room/sofa (11.918 m); vase: living room/dining table → living room/tv stand (1.782 m); irish potato: bedroom/dresser 안 → kitchen/dining table (4.994 m)restore_misplaced_answer
restore:train_9320__2:q00Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinremote control: bedroom/dining table → living room/dining table (6.738 m)
restore:train_9320__2:q01Pick up the remote control and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinremote control: bedroom/dining table → kitchen/dining table (9.21 m)
restore:train_9320__2:q02Pick up the spatula and place it in or on where it first wasfirst
single		navigate hops1 shiftspatula: kitchen/dining table → kitchen/countertop (4.485 m)
restore:train_9320__2:q03Pick up the mug and place it in or on where it first wasfirst
single		in_reach hops1mug: bathroom/sink → bedroom/tv stand (8.486 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_referent_ambiguous last_event_obj
restore:train_9320__2:q04Pick up the remote control and place it in or on where it first was, then pick up the spatula and place it in or on where it first was, and then pick up the mug and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinremote control: bedroom/dining table → living room/dining table (6.738 m); spatula: kitchen/dining table → kitchen/countertop (4.485 m); mug: bathroom/sink → bedroom/tv stand (8.486 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place restore_referent_ambiguous last_event_obj
restore:train_9584__2:q00Pick up the mug and place it in or on where it first wasfirst
single		navigate hops2 relocate twin_merge twinmug: kitchen/countertop → bedroom/dresser (6.96 m)restore_neighbor_inside_r_place last_event_obj
restore:train_9584__2:q01Pick up the mug and place it in or on where it was just beforeprevious
single		navigate hops2 relocate twin_merge twinmug: kitchen/countertop → bathroom/toilet (12.432 m)last_event_obj
restore:train_9584__2:q02Pick up the remote control and place it in or on where it first wasfirst
single		navigate hops1 shiftremote control: living room/armchair → living room/tv stand (3.746 m)
restore:train_9584__2:q03Pick up the mug and place it in or on where it first was, then pick up the remote control and place it in or on where it first wasfirst
multi		navigate hops1 hops2 relocate shift twin_merge twinmug: kitchen/countertop → bedroom/dresser (6.96 m); remote control: living room/armchair → living room/tv stand (3.746 m)restore_neighbor_inside_r_place last_event_obj
restore:train_9651__2:q00Pick up the spoon and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twinspoon: kitchen/countertop → kitchen/dining table (4.824 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_9651__2:q01Pick up the spoon and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twinspoon: kitchen/countertop → living room/dining table (8.131 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_9651__2:q02Pick up the salt shaker and place it in or on where it first wasfirst
single		navigate hops1 shiftsalt shaker: kitchen/dining table → kitchen/countertop (4.471 m)
restore:train_9651__2:q03Pick up the spoon and place it in or on where it first was, then pick up the salt shaker and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate shift twin_merge twinspoon: kitchen/countertop → kitchen/dining table (4.824 m); salt shaker: kitchen/dining table → kitchen/countertop (4.471 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_same_room_but_hops last_event_obj
restore:train_9778__1:q00Pick up the cell phone and place it in or on where it first wasfirst
single		navigate hops1 from_hidden store_incell phone: bedroom/desk 안 → kitchen/dining table (10.079 m)
restore:train_9778__1:q01Pick up the key chain and place it in or on where it first wasfirst
single		in_reach hops1key chain: bathroom/sink → bedroom/desk (4.618 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_9778__1:q02Pick up the cell phone and place it in or on where it first was, then pick up the key chain and place it in or on where it first wasfirst
multi		in_reach navigate hops1 from_hidden store_incell phone: bedroom/desk 안 → kitchen/dining table (10.079 m); key chain: bathroom/sink → bedroom/desk (4.618 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_neighbor_inside_r_place last_event_obj
restore:train_9797__1:q00Pick up the candle and place it in or on where it first wasfirst
single		in_reach hops2 relocate twin_merge twincandle: bathroom/toilet → living room/dining table (13.41 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_9797__1:q01Pick up the candle and place it in or on where it was just beforeprevious
single		in_reach hops2 relocate twin_merge twincandle: bathroom/toilet → bedroom/dresser (9.795 m)restore_from_seen_last5s restore_from_visible_in_query_frame last_event_obj
restore:train_9797__1:q02Pick up the mug and place it in or on where it first wasfirst
single		navigate hops1mug: bathroom/sink → bedroom/dining table (12.201 m)restore_referent_ambiguous
restore:train_9797__1:q03Pick up the candle and place it in or on where it first was, then pick up the mug and place it in or on where it first wasfirst
multi		in_reach navigate hops1 hops2 relocate twin_merge twincandle: bathroom/toilet → living room/dining table (13.41 m); mug: bathroom/sink → bedroom/dining table (12.201 m)restore_from_seen_last5s restore_from_visible_in_query_frame restore_referent_ambiguous last_event_obj
restore:train_9909__2:q00Pick up the key chain and place it in or on where it first wasfirst
single		navigate hops1 shiftkey chain: bedroom/dresser → bedroom/dining table (2.511 m)

6Takeaway · 권고

데이터 자체는 릴리즈 가능한 수준, 평가 프로토콜 쪽에서 세 가지를 결정해야 함

  1. 질의 시점 가시 행 처리 — find 26 / restore 20 답이 정책 입력 프레임에 보인다. (a) 러너에서 제외, (b) 별도 "perception-answerable" 층으로 병기, (c) 질의 관측을 마지막 프레임이 아닌 '로봇이 다른 방을 보는 프레임'으로 교체 중 택1. 지금까지의 격자 수치(e987b40f)에도 같은 행이 들어 있으므로 결정 후 재집계 필요.
  2. 지시어 모호 후보 find 55 / restore 24 — 생성 쪽 ambiguity 필터를 '질의 vs 장면의 모든 같은 종류 추적 물체'로 확장하거나, 채점을 '같은 카테고리 아무거나'로 완화(README의 body-id 원칙과 충돌) 중 택1. 최소한 other_seen=true 행은 부록에 목록화.
  3. 문서 정정 — n_hops 정의(이동 횟수), distractor의 "never touched"(왕복 물체 10행 포함), obj_unresolved 의미, 방 이름 미유도 3편.

다양성 관점: 축은 충분히 넓지만(hidden 63·navigate_only 56·multi 54/79·previous 63·2회 이동 168·decoy 8) 물체(리모컨 편중)·방(4종)·이벤트 종류(pick_and_place 단일)는 좁다. 논문에서는 "이벤트 문법 1종 × 태그 5종"으로 솔직하게 기술하는 편이 안전.

bcaf2815 · 분석 tmp/hf_check/inspect_bcaf2815.py · 페이지 tmp/hf_check/build_data_inspector.py · 영상 tmp/hf_check/compress_examples.sh