Routine 메모리 예시 — Uniform · MemER · tagmem frame-only · tagmem full

헤더: "Here are snapshots from my episode, in order:" — 프레임 사이에 들은 발화가 시간순으로 끼워진다(reader 가 규칙 문장을 그대로 읽는다). [t=0.0s] <IMG f0> [t=0.0s] heard: "Put the clothes from the countertop on the sofa." [t=0.0s] heard: "Put the bottles from the dining table on the shelving unit." [t=0.0s] heard: "Put the food from the dining table into the laundry basket." [t=51.5s] <IMG f1288> [t=103.0s] <IMG f2575> [t=154.5s] <IMG f3863> [t=206.0s] <IMG f5151> [t=257.6s] <IMG f6439> [t=309.0s] <IMG f7726> [t=360.6s] <IMG f9014>

헤더: "Here are the frames I chose to keep as memory during the episode:" — writer 가 발화를 듣고 고른 프레임만, 텍스트 없음. [t=10.0s] <IMG f250> [t=90.0s] <IMG f2249> [t=110.0s] <IMG f2749> [t=120.0s] <IMG f2999> [t=140.0s] <IMG f3499> [t=160.0s] <IMG f4000> [t=250.0s] <IMG f6250> [t=350.0s] <IMG f8749>

질의 태그 {'obj': ['bread'], 'act': ['place'], 'room': [], 'surf': ['countertop']} · 정확 히트 4 · 꼬리 3 · 채움 4 헤더: vis-pure 와 같은 형식(프레임+시각만). 아래 태그는 검색에만 쓰였고 reader 에겐 안 보임: [t=0.0s] <IMG f0> (obj=bottle act=look surf=dining table) [t=10.0s] <IMG f250> (obj=fabric,bread act=look surf=countertop) [t=30.0s] <IMG f750> (obj=fabric,bread act=look room=kitchen surf=countertop) [t=150.0s] <IMG f3749> (obj=soapdispenser act=navigate room=bedroom) [t=270.0s] <IMG f6749> (obj=bread act=look room=kitchen surf=countertop | act=navigate room=kitchen) [t=270.0s] <IMG f6750> (obj=bread act=look room=kitchen surf=countertop) [t=360.0s] <IMG f9000> (obj=house plant,vase act=look room=living room surf=side table) (검색됐지만 frames 분기가 버린 텍스트 항목: Heard the user say: "Put the clothes from the countertop on the sofa." / Heard the user say: "Put the bottles from the dining table on the shelving unit." / Heard the user say: "Put the food from the dining table into the laundry basket.")

질의 태그 {'obj': ['bread'], 'act': ['place'], 'room': [], 'surf': ['countertop']} · 정확 히트 2 · 꼬리 3 헤더: "Entries from my memory index relevant to this question (44 stored in total):" [t=0s] IMG 0 <image f0> (obj=dining table,cup,countertop act=look room=kitchen surf=dining table) [t=0s] IMG 1 <image f250> (obj=fabric,bread,countertop act=look room=kitchen surf=countertop) [t=0s] IMG 3 <image f749> (obj=fabric,dining table act=pick room=kitchen surf=countertop) [t=0s] Heard the user say: "Put the clothes from the countertop on the sofa." (obj=clothes act=instruct surf=sofa) [t=0s] Heard the user say: "Put the bottles from the dining table on the shelving unit." (obj=bottles,bottle act=instruct surf=shelving unit) [t=0s] Heard the user say: "Put the food from the dining table into the laundry basket." (obj=food act=instruct surf=laundry basket) [t=30s] IMG 5 <image f750> (obj=fabric,candle,irish potato,countertop,dining table act=look room=kitchen surf=dining table) [t=150s] IMG 17 <image f4000> (act=look room=bedroom surf=floor) [t=210s] IMG 26 <image f5999> (obj=apple,irish potato act=look room=kitchen surf=side table) [t=240s] IMG 29 <image f6749> (obj=apple,bread,soapdispenser act=navigate room=kitchen surf=floor) [t=360s] IMG 39 <image f9000> (obj=laundry basket,house plant,vase act=look room=bedroom surf=floor) LEDGER: place fabric → sofa [living room]: ×1 (n=1 · t=60) / place soapdispenser → shelf [kitchen]: ×1 (n=? · t=210) / place apple → laundry basket [bedroom]: ×1 (n=1 · t=330) / rooms seen so far: kitchen (t=0) · living room (t=30) · bedroom (t=90)

헤더: "Here are snapshots from my episode, in order:" — 프레임 사이에 들은 발화가 시간순으로 끼워진다(reader 가 규칙 문장을 그대로 읽는다). [t=0.0s] <IMG f0> [t=0.0s] heard: "Put the gadgets from the dining table on the side table." [t=0.0s] heard: "Put the kitchen utensils from the dining table on the sofa." [t=65.5s] <IMG f1637> [t=130.9s] <IMG f3273> [t=196.4s] <IMG f4910> [t=261.8s] <IMG f6546> [t=327.3s] <IMG f8183> [t=392.8s] <IMG f9819> [t=458.2s] <IMG f11456>

헤더: "Here are the frames I chose to keep as memory during the episode:" — writer 가 발화를 듣고 고른 프레임만, 텍스트 없음. [t=80.0s] <IMG f1999> [t=100.0s] <IMG f2500> [t=210.0s] <IMG f5249> [t=280.0s] <IMG f7000> [t=310.0s] <IMG f7750> [t=330.0s] <IMG f8250> [t=390.0s] <IMG f9749> [t=455.5s] <IMG f11387>

질의 태그 {'obj': ['alarm clock', 'cell phone', 'fork', 'spatula'], 'act': [], 'room': [], 'surf': ['dining table']} · 정확 히트 15 · 꼬리 3 · 채움 0 헤더: vis-pure 와 같은 형식(프레임+시각만). 아래 태그는 검색에만 쓰였고 reader 에겐 안 보임: [t=270.0s] <IMG f6749> (obj=alarm clock,butter knife,cell phone,spatula,spoon act=look room=bedroom surf=desk) [t=270.0s] <IMG f6750> (obj=alarm clock,butter knife,cell phone,spatula,spoon act=look room=bedroom surf=desk) [t=280.0s] <IMG f7000> (obj=alarm clock,butter knife,cell phone,spatula,spoon act=look room=bedroom surf=desk) [t=290.0s] <IMG f7249> (obj=bed,side table act=look room=bedroom) [t=330.0s] <IMG f8249> (obj=spoon,spatula,pen,cell phone act=look room=bedroom surf=desk) [t=330.0s] <IMG f8250> (obj=spoon,spatula,pen,cell phone,watch act=look room=bedroom surf=desk) [t=350.0s] <IMG f8749> (obj=spatula,pen,cell phone,watch act=look room=bedroom surf=desk) [t=390.0s] <IMG f9749> (obj=apple,bottle,bowl,pot act=look room=kitchen surf=dining table) (검색됐지만 frames 분기가 버린 텍스트 항목: Heard the user say: "Put the gadgets from the dining table on the side table." / Heard the user say: "Put the kitchen utensils from the dining table on the sofa.")

질의 태그 {'obj': ['alarm clock', 'cell phone', 'fork', 'spatula'], 'act': [], 'room': [], 'surf': ['dining table']} · 정확 히트 21 · 꼬리 3 헤더: "Entries from my memory index relevant to this question (64 stored in total):" [t=0s] The robot picked up the alarm clock from the dining table. (obj=alarm clock act=pick room=bedroom surf=dining table) [t=0s] Heard the user say: "Put the gadgets from the dining table on the side table." (obj=gadgets,gadget act=instruct surf=side table) [t=0s] Heard the user say: "Put the kitchen utensils from the dining table on the sofa." (obj=kitchen utensils,utensils act=instruct surf=sofa) [t=30s] The robot placed the alarm clock on the side table. (obj=alarm clock act=place room=bedroom surf=side table) [t=270s] The robot picked up a cell phone from the desk in the bedroom. (obj=cell phone,remote control act=pick room=bedroom surf=desk) [t=300s] The robot placed the cell phone on the white side table in the bedroom. (obj=cell phone act=place room=bedroom surf=side table n=1) [t=300s] IMG 38 <image f7750> (obj=cell phone,remote control,side table act=place room=bedroom surf=side table) [t=300s] IMG 39 <image f7999> (obj=cell phone,remote control,side table act=look room=bedroom surf=side table) [t=300s] IMG 41 <image f8249> (obj=spoon,spatula,butter knife,cell phone,desk act=look room=bedroom surf=desk) [t=330s] IMG 43 <image f8250> (obj=spoon,spatula,butter knife,cell phone,desk act=pick room=bedroom surf=desk) [t=330s] IMG 44 <image f8749> (obj=spoon,desk,spatula,cell phone,knickknack act=navigate room=bedroom surf=desk) [t=360s] IMG 49 <image f9499> (obj=spoon,dining table,apple,bottle,bowl,pot act=navigate room=living room surf=floor) [t=360s] IMG 50 <image f9749> (obj=spoon,dining table,apple,bottle,bowl,pot act=navigate room=living room surf=floor) [t=390s] IMG 52 <image f9750> (obj=spoon,dining table,apple,bottle,bowl,pot act=navigate room=living room surf=floor) LEDGER: place alarm clock → side table [bedroom]: ×1 (n=? · t=30) / place butter knife → sofa [living room]: ×1 (n=1 · t=180) / place cell phone → side table [bedroom]: ×1 (n=1 · t=300) / place spoon → sofa [living room]: ×1 (n=1 · t=450) / rooms seen so far: bedroom (t=0) · kitchen (t=120) · living room (t=150)

헤더: "Here are snapshots from my episode, in order:" — 프레임 사이에 들은 발화가 시간순으로 끼워진다(reader 가 규칙 문장을 그대로 읽는다). [t=0.0s] <IMG f0> [t=0.0s] heard: "Put the bottles from the countertop on the armchair." [t=95.2s] <IMG f2379> [t=190.3s] <IMG f4758> [t=285.5s] <IMG f7137> [t=380.7s] <IMG f9517> [t=475.8s] <IMG f11896> [t=571.0s] <IMG f14275> [t=666.2s] <IMG f16654>

헤더: "Here are the frames I chose to keep as memory during the episode:" — writer 가 발화를 듣고 고른 프레임만, 텍스트 없음. [t=0.0s] <IMG f0> [t=310.0s] <IMG f7750> [t=350.0s] <IMG f8749> [t=410.0s] <IMG f10249> [t=470.0s] <IMG f11749> [t=490.0s] <IMG f12250> [t=540.0s] <IMG f13499> [t=664.1s] <IMG f16603>

질의 태그 {'obj': [], 'act': ['place'], 'room': [], 'surf': ['countertop']} · 정확 히트 0 · 꼬리 3 · 채움 5 헤더: vis-pure 와 같은 형식(프레임+시각만). 아래 태그는 검색에만 쓰였고 reader 에겐 안 보임: [t=210.0s] <IMG f5249> (obj=box,tissue box act=navigate room=living room surf=floor) [t=320.0s] <IMG f7999> (obj=countertop act=navigate room=kitchen surf=floor) [t=390.0s] <IMG f9750> (obj=bread,lettuce,bottle,atomizer,spoon act=look room=kitchen surf=dining table) [t=490.0s] <IMG f12250> (act=look room=living room surf=armchair) [t=580.0s] <IMG f14500> (obj=soapdispenser,bottle act=look room=kitchen surf=countertop) [t=660.0s] <IMG f16499> (obj=atomizer act=place room=bedroom surf=armchair n=1) [t=660.0s] <IMG f16500> (obj=soapdispenser,atomizer,cell phone,tissue box act=look room=bedroom surf=armchair) [t=664.1s] <IMG f16603> (obj=soapdispenser,atomizer,cell phone,tissue box,house plant,table lamp act=look room=bedroom surf=floor) (검색됐지만 frames 분기가 버린 텍스트 항목: Heard the user say: "Put the bottles from the countertop on the armchair.")

질의 태그 {'obj': [], 'act': ['place'], 'room': [], 'surf': ['countertop']} · 정확 히트 0 · 꼬리 3 헤더: "Entries from my memory index relevant to this question (91 stored in total):" [t=0s] Heard the user say: "Put the bottles from the countertop on the armchair." (obj=bottles,bottle act=instruct surf=armchair) [t=150s] IMG 22 <image f4249> (obj=countertop,bottle,soapdispenser,atomizer act=navigate room=bathroom surf=countertop) [t=150s] IMG 23 <image f4499> (obj=countertop,bottle,soapdispenser act=navigate room=bathroom surf=countertop) [t=180s] IMG 25 <image f4500> (obj=countertop,soapdispenser,bottle act=pick room=bathroom surf=countertop) [t=300s] IMG 45 <image f8249> (obj=tennisracket,baseball bat,bottle,credit card,statue,countertop act=navigate room=kitchen surf=countertop) [t=330s] IMG 46 <image f8250> (obj=soapdispenser,atomizer,bottle,credit card,statue,countertop act=look room=kitchen surf=countertop) [t=330s] IMG 48 <image f8500> (obj=soapdispenser,atomizer,cooking pan,bread,bottle,countertop,dining table act=pick room=kitchen surf=countertop) [t=330s] IMG 49 <image f8999> (obj=soapdispenser,atomizer,countertop act=pick room=kitchen surf=countertop) [t=570s] IMG 75 <image f14500> (obj=cooking pan,bread,lettuce,bottle,soapdispenser act=look room=kitchen surf=dining table,countertop) LEDGER: place bottle → armchair [bedroom]: ×1 (n=1 · t=120) / place soapdispenser → armchair [bedroom]: ×1 (n=1 · t=240) / place atomizer → countertop [kitchen]: ×1 (n=1 · t=510) / place atomizer → armchair [bedroom]: ×1 (n=2 · t=630) / rooms seen so far: kitchen (t=30) · living room (t=30) · bedroom (t=60) · bathroom (t=150)