EgoX_wan2.2

Project Plan & Roadmap
15Total Phases
12Completed
1In Progress
2Remaining
Overall Progress 80%
12 / 15 phases

Phase Checklist

PhaseStatusNotes
환경 세팅✓egoxv2 conda, PyTorch nightly 2.12+cu128, B200 GPU
Phase 1: GGA 제거✓6개 파일에서 GGA 코드 전부 제거
Phase 2: DROID 전처리 (샘플)✓155 에피소드
Phase 2: DROID 전처리 (풀)✎~3998 에피소드, 진행 중
Phase 3-1: Stitching Layer 탐색✓enc_blocks_2, Conv3D init weights
Phase 3-2: Stitching Training✓distillation loss, 1 epoch, loss ~1.3-2.3
Phase 3-3: DRF + 3D Rendering Loss✓diffusion SFT + 3D rendering loss, 디버깅 완료
SLURM 스크립트✓run_all.sh 전체 파이프라인
시각화 도구✓GT vs rendered 비교, loss curve
Wan 2.2 Migration✓Base model upgrade 완료
81f Training Collapse Fix✓Gradient clipping + warmup
Phase 2 Validation✓Auto FID/LPIPS 측정
Auto-Resume✓SLURM preemption 자동 복구
EgoExo4D Fine-tuning✗미시작
정량 평가 (FVD, LPIPS)✗미시작
12 completed 1 in progress 2 pending

Architecture

Text + Ego Video → Wan Transformer (LoRA) → Denoised Latent
                                                    │
                                              Wan VAE Latent
                                                    │
                                    ┌───────────────┴──────────────┐
                                VAE Decode              Stitching Layer (Conv3D)
                                (2D video)                      │
                                    │                    AnySplat Decoder
                                    │                           │
                                    │                    3D Gaussians → gsplat
                                    └──────── Losses ───────────┘

Key Files

Milestones