WiFi-3D-Fusion – Real-time 3D motion sensing with Wi-Fi

Summary

Live local Wi-Fi sensing with CSI: real-time motion detection + visualization, with optional bridges to: Person-in-WiFi-3D (multi-person 3D pose from Wi-Fi) [CVPR 2024]. (multi-person from Wi-Fi) [CVPR 2024]. NeRF² (neural RF radiance fields). (neural RF radiance fields). 3D Wi-Fi Scanner (RSSI volumetric mapping). This monorepo is production-oriented: robust CSI ingestion from local Wi-Fi (ESP32-CSI via UDP, or Nexmon via tcpdump + csiread ), a realtime movement detector, and a 3D viewer. 🧩 Architecture High-level runtime flowchart LR subgraph Capture A1(ESP32 UDP JSON):::node -->|csi_batch| B[esp32_udp.py] A2(Nexmon + tcpdump):::node -->|pcap| C[nexmon_pcap.py] A3(Monitor Radiotap):::node -->|RSSI stream| D[monitor_radiotap.py] end B & C & D --> E[realtime_detector.py] E --> F[fusion rf/rssi] F --> G[Open3D live viewer] classDef node fill:#0b7285,stroke:#083344,color:#fff; Loading Model Training Processing loop sequenceDiagram participant SRC as CSI/RSSI Source participant DET as MovementDetector participant FUS as Fusion participant VIZ as Open3D Viewer loop Frames SRC->>DET: (ts, vector) DET-->>DET: sliding var / threshold DET->>FUS: events + buffers FUS-->>VIZ: point cloud + overlays VIZ-->>User: interactive 3D scene end Loading 🚀 Quick Start Guide Method 1: Web-Based Real-Time Visualization (Recommended) # Install dependencies bash scripts/install_all.sh # Start web-based real-time visualization source venv/bin/activate python run_js_visualizer.py # Open browser to http://localhost:5000 Method 2: Traditional Pipeline # ESP32-CSI UDP (default port 5566): ./scripts/run_realtime.sh --source esp32 # Or Nexmon (requires monitor-mode interface) sudo ./scripts/run_realtime.sh --source nexmon 🎯 Model Training & Continuous Learning Train Your Own Detection Model # Basic training with current configuration ./train_wifi3d.sh # Quick training session with continuous learning ./train_wifi3d.sh --quick --continuous # Train with specific device source ./train_wifi3d.sh --sou...