EgoX_wan2.2

Project Plan & Roadmap
15Total Phases
12Completed
1In Progress
2Remaining
Overall Progress 80%
12 / 15 phases

Phase Checklist

PhaseStatusNotes
환경 세팅egoxv2 conda, PyTorch nightly 2.12+cu128, B200 GPU
Phase 1: GGA 제거6개 파일에서 GGA 코드 전부 제거
Phase 2: DROID 전처리 (샘플)155 에피소드
Phase 2: DROID 전처리 (풀)~3998 에피소드, 진행 중
Phase 3-1: Stitching Layer 탐색enc_blocks_2, Conv3D init weights
Phase 3-2: Stitching Trainingdistillation loss, 1 epoch, loss ~1.3-2.3
Phase 3-3: DRF + 3D Rendering Lossdiffusion SFT + 3D rendering loss, 디버깅 완료
SLURM 스크립트run_all.sh 전체 파이프라인
시각화 도구GT vs rendered 비교, loss curve
Wan 2.2 MigrationBase model upgrade 완료
81f Training Collapse FixGradient clipping + warmup
Phase 2 ValidationAuto FID/LPIPS 측정
Auto-ResumeSLURM preemption 자동 복구
EgoExo4D Fine-tuning미시작
정량 평가 (FVD, LPIPS)미시작
12 completed 1 in progress 2 pending

Architecture

Text + Ego Video → Wan Transformer (LoRA) → Denoised Latent
                                                    │
                                              Wan VAE Latent
                                                    │
                                    ┌───────────────┴──────────────┐
                                VAE Decode              Stitching Layer (Conv3D)
                                (2D video)                      │
                                    │                    AnySplat Decoder
                                    │                           │
                                    │                    3D Gaussians → gsplat
                                    └──────── Losses ───────────┘

Key Files

Milestones