온라인 컨트롤 1칸 샘플 — 턴 전수

```json
{
  "note": null,
  "reasoning": "According to the plan and notes, mug #2 was moved from the kitchen countertop to the dining table in the living room. To put it back where it first was, I need to go to the dining table in the living room to pick up the mug.",
  "next": {
    "skill": "navigate",
    "category": "mug",
    "surface": "dining table",
    "room": "living room"
  }
}
```

{'texts': ['Your current view:', 'Your notes so far:\nHere are my running notes from the episode, written by me while acting (subgoal by subgoal):\n\n[context] [    0s–  114s] I tried to move mug #1 from the side table in the bedroom to the drawer of the side table in the bedroom, but the attempt failed.\n[context] [  114s–  221s] I picked up the vase from the side table in the bedroom and placed it on the chair in the kitchen.\n[context] [  221s–  330s] I picked up mug #2 from the countertop in the kitchen and placed it on the dining table in the living room.\n[context] [  330s–  464s] I picked up the vase from the chair in the kitchen and placed it on the tv stand in the living room.', 'Object names used in this house:\nCD, alarm clock, apple, baseball bat, bed, book, bottle, bowl, box, bread, butter knife, candle, cart, cell phone, chair, countertop, credit card, cup, dining table, dresser, egg, floor lamp, fork, fridge, garbage can, house plant, key chain, ladle, microwave, mug, newspaper, painting, pen, pencil, pepper shaker, pillow, plate, potato, remote control, shelving unit, side table, soap bottle, sofa, spatula, spray bottle, statue, stool, teddy bear, tissue box, tomato, tv stand, vase, watch', 'Room names used in this house:\nbedroom, kitchen, living room', 'Your plan:\n1. [ ] put the mug back — it is now on the dining table in the living room; return it to the countertop in the kitchen', 'Goal: Pick up the mug and place it in or on where it first was', 'Reply with the JSON object only.'], 'n_images': 1}

```json
{"note": null, "reasoning": "I am standing at the dining table in the living room where the mug is located. I need to pick up the mug.", "next": {"skill": "pick", "category": "mug", "surface": null, "room": null}}
```

{'texts': ['Frames captured while your previous subgoal was executing:', 'Your current view:', 'Your notes so far:\nHere are my running notes from the episode, written by me while acting (subgoal by subgoal):\n\n[context] [    0s–  114s] I tried to move mug #1 from the side table in the bedroom to the drawer of the side table in the bedroom, but the attempt failed.\n[context] [  114s–  221s] I picked up the vase from the side table in the bedroom and placed it on the chair in the kitchen.\n[context] [  221s–  330s] I picked up mug #2 from the countertop in the kitchen and placed it on the dining table in the living room.\n[context] [  330s–  464s] I picked up the vase from the chair in the kitchen and placed it on the tv stand in the living room.', 'Object names used in this house:\nCD, alarm clock, apple, baseball bat, bed, book, bottle, bowl, box, bread, butter knife, candle, cart, cell phone, chair, countertop, credit card, cup, dining table, dresser, egg, floor lamp, fork, fridge, garbage can, house plant, key chain, ladle, microwave, mug, newspaper, painting, pen, pencil, pepper shaker, pillow, plate, potato, remote control, shelving unit, side table, soap bottle, sofa, spatula, spray bottle, statue, stool, teddy bear, tissue box, tomato, tv stand, vase, watch', 'Room names used in this house:\nbedroom, kitchen, living room', 'Your plan:\n1. [ ] put the mug back — it is now on the dining table in the living room; return it to the countertop in the kitchen', 'Goal: Pick up the mug and place it in or on where it first was', 'Reply with the JSON object only.'], 'n_images': 4}

```json
{
  "note": null,
  "reasoning": "I am already holding the mug. I need to navigate to the countertop in the kitchen to return it to where it was originally.",
  "next": {
    "skill": "navigate",
    "category": "mug",
    "surface": "countertop",
    "room": "kitchen"
  }
}
```

{'texts': ['Frames captured while your previous subgoal was executing:', 'Your current view:', 'Your notes so far:\nHere are my running notes from the episode, written by me while acting (subgoal by subgoal):\n\n[context] [    0s–  114s] I tried to move mug #1 from the side table in the bedroom to the drawer of the side table in the bedroom, but the attempt failed.\n[context] [  114s–  221s] I picked up the vase from the side table in the bedroom and placed it on the chair in the kitchen.\n[context] [  221s–  330s] I picked up mug #2 from the countertop in the kitchen and placed it on the dining table in the living room.\n[context] [  330s–  464s] I picked up the vase from the chair in the kitchen and placed it on the tv stand in the living room.', 'Object names used in this house:\nCD, alarm clock, apple, baseball bat, bed, book, bottle, bowl, box, bread, butter knife, candle, cart, cell phone, chair, countertop, credit card, cup, dining table, dresser, egg, floor lamp, fork, fridge, garbage can, house plant, key chain, ladle, microwave, mug, newspaper, painting, pen, pencil, pepper shaker, pillow, plate, potato, remote control, shelving unit, side table, soap bottle, sofa, spatula, spray bottle, statue, stool, teddy bear, tissue box, tomato, tv stand, vase, watch', 'Room names used in this house:\nbedroom, kitchen, living room', 'Your plan:\n1. [ ] put the mug back — it is now on the dining table in the living room; return it to the countertop in the kitchen', 'Goal: Pick up the mug and place it in or on where it first was', 'Reply with the JSON object only.'], 'n_images': 4}

```json
{"note": null, "reasoning": "The mug has been returned to the kitchen countertop where it originally was. The goal is fulfilled.", "next": {"skill": "done", "category": null, "surface": null, "room": null}}
```

{'texts': ['Frames captured while your previous subgoal was executing:', 'Your current view:', 'Your notes so far:\nHere are my running notes from the episode, written by me while acting (subgoal by subgoal):\n\n[context] [    0s–  114s] I tried to move mug #1 from the side table in the bedroom to the drawer of the side table in the bedroom, but the attempt failed.\n[context] [  114s–  221s] I picked up the vase from the side table in the bedroom and placed it on the chair in the kitchen.\n[context] [  221s–  330s] I picked up mug #2 from the countertop in the kitchen and placed it on the dining table in the living room.\n[context] [  330s–  464s] I picked up the vase from the chair in the kitchen and placed it on the tv stand in the living room.', 'Object names used in this house:\nCD, alarm clock, apple, baseball bat, bed, book, bottle, bowl, box, bread, butter knife, candle, cart, cell phone, chair, countertop, credit card, cup, dining table, dresser, egg, floor lamp, fork, fridge, garbage can, house plant, key chain, ladle, microwave, mug, newspaper, painting, pen, pencil, pepper shaker, pillow, plate, potato, remote control, shelving unit, side table, soap bottle, sofa, spatula, spray bottle, statue, stool, teddy bear, tissue box, tomato, tv stand, vase, watch', 'Room names used in this house:\nbedroom, kitchen, living room', 'Your plan:\n1. [ ] put the mug back — it is now on the dining table in the living room; return it to the countertop in the kitchen', 'Goal: Pick up the mug and place it in or on where it first was', 'Reply with the JSON object only.'], 'n_images': 4}