|
| 1 | +WiFi-Mat v3.2 - AI Thermal Monitor + WiFi CSI Sensing |
| 2 | +====================================================== |
| 3 | + |
| 4 | +Embedded AI system combining thermal monitoring with WiFi-based |
| 5 | +presence detection, inspired by WiFi-DensePose technology. |
| 6 | + |
| 7 | +For Heltec ESP32-S3 with OLED Display |
| 8 | + |
| 9 | +CORE CAPABILITIES: |
| 10 | +------------------ |
| 11 | +* Thermal Pattern Learning - Spiking Neural Network (LIF neurons) |
| 12 | +* WiFi CSI Sensing - Through-wall motion/presence detection |
| 13 | +* Breathing Detection - Respiratory rate from WiFi phase |
| 14 | +* Anomaly Detection - Ruvector-inspired attention weights |
| 15 | +* HNSW Indexing - Fast O(log n) pattern matching |
| 16 | +* Power Optimization - Adaptive sleep modes |
| 17 | + |
| 18 | +VISUAL INDICATORS: |
| 19 | +------------------ |
| 20 | +* Animated motion figure when movement detected |
| 21 | +* Radar sweep with detection blips |
| 22 | +* Breathing wave visualization with BPM |
| 23 | +* Status bar: WiFi/Motion/Alert icons |
| 24 | +* Screen flash on anomaly or motion alerts |
| 25 | +* Dynamic confidence bars |
| 26 | + |
| 27 | +DISPLAY MODES (cycle with double-tap): |
| 28 | +-------------------------------------- |
| 29 | +1. STATS - Temperature, zone, patterns, attention level |
| 30 | +2. GRAPH - Temperature history graph (40 samples) |
| 31 | +3. PTRNS - Learned pattern list with scores |
| 32 | +4. ANOM - Anomaly detection with trajectory view |
| 33 | +5. AI - Power optimization metrics |
| 34 | +6. CSI - WiFi CSI motion sensing with radar |
| 35 | +7. RF - RF device presence detection |
| 36 | +8. INFO - Device info, uptime, memory |
| 37 | + |
| 38 | +AI POWER OPTIMIZATION (AI mode): |
| 39 | +-------------------------------- |
| 40 | +* Mode: ACTIVE/LIGHT/DEEP sleep states |
| 41 | +* Energy: Estimated power savings (0-95%) |
| 42 | +* Neurons: Active vs idle neuron ratio |
| 43 | +* HNSW: Hierarchical search efficiency |
| 44 | +* Spikes: Neural spike efficiency |
| 45 | +* Attn: Pattern attention weights |
| 46 | + |
| 47 | +WIFI CSI SENSING (CSI mode): |
| 48 | +---------------------------- |
| 49 | +Uses WiFi Channel State Information for through-wall sensing: |
| 50 | + |
| 51 | +* MOTION/STILL - Real-time motion detection |
| 52 | +* Radar Animation - Sweep with confidence blips |
| 53 | +* Breathing Wave - Sine wave + BPM when detected |
| 54 | +* Confidence % - Detection confidence level |
| 55 | +* Detection Count - Cumulative motion events |
| 56 | +* Variance Metrics - Signal variance analysis |
| 57 | + |
| 58 | +Technology based on WiFi-DensePose concepts: |
| 59 | +- Phase unwrapping for movement detection |
| 60 | +- Amplitude variance for presence sensing |
| 61 | +- Frequency analysis for breathing rate |
| 62 | +- No cameras needed - works through walls |
| 63 | + |
| 64 | +BUTTON CONTROLS: |
| 65 | +---------------- |
| 66 | +* TAP (quick) - Learn current thermal pattern |
| 67 | +* DOUBLE-TAP - Cycle display mode |
| 68 | +* HOLD 1 second - Pause/Resume monitoring |
| 69 | +* HOLD 2 seconds - Reset all learned patterns |
| 70 | +* HOLD 3+ seconds - Show device info |
| 71 | + |
| 72 | +INSTALLATION: |
| 73 | +------------- |
| 74 | +1. Connect Heltec ESP32-S3 via USB |
| 75 | +2. Run flash.bat (Windows) or flash.ps1 (PowerShell) |
| 76 | +3. Enter COM port when prompted (e.g., COM7) |
| 77 | +4. Wait for flash to complete (~60 seconds) |
| 78 | +5. Device auto-connects to configured WiFi |
| 79 | + |
| 80 | +REQUIREMENTS: |
| 81 | +------------- |
| 82 | +* espflash tool: cargo install espflash |
| 83 | +* Heltec WiFi LoRa 32 V3 (ESP32-S3) |
| 84 | +* USB-C cable |
| 85 | +* Windows 10/11 |
| 86 | + |
| 87 | +WIFI CONFIGURATION: |
| 88 | +------------------- |
| 89 | +Default network: ruv.net |
| 90 | + |
| 91 | +To change WiFi credentials, edit source and rebuild: |
| 92 | + C:\esp\src\main.rs (lines 43-44) |
| 93 | + |
| 94 | +HARDWARE PINOUT: |
| 95 | +---------------- |
| 96 | +* OLED SDA: GPIO17 |
| 97 | +* OLED SCL: GPIO18 |
| 98 | +* OLED RST: GPIO21 |
| 99 | +* OLED PWR: GPIO36 (Vext) |
| 100 | +* Button: GPIO0 (PRG) |
| 101 | +* Thermal: MLX90614 on I2C |
| 102 | + |
| 103 | +TECHNICAL SPECS: |
| 104 | +---------------- |
| 105 | +* MCU: ESP32-S3 dual-core 240MHz |
| 106 | +* Flash: 8MB |
| 107 | +* RAM: 512KB SRAM + 8MB PSRAM |
| 108 | +* Display: 128x64 OLED (SSD1306) |
| 109 | +* WiFi: 802.11 b/g/n (2.4GHz) |
| 110 | +* Bluetooth: BLE 5.0 |
| 111 | + |
| 112 | +NEURAL NETWORK: |
| 113 | +--------------- |
| 114 | +* Architecture: Leaky Integrate-and-Fire (LIF) |
| 115 | +* Neurons: 16 configurable |
| 116 | +* Patterns: Up to 32 learned |
| 117 | +* Features: 6 sparse dimensions |
| 118 | +* Indexing: 3-layer HNSW hierarchy |
| 119 | + |
| 120 | +SOURCE CODE: |
| 121 | +------------ |
| 122 | +Full Rust source: C:\esp\src\main.rs |
| 123 | +WiFi CSI module: C:\esp\src\wifi_csi.rs |
| 124 | +Build script: C:\esp\build.ps1 |
| 125 | + |
| 126 | +BASED ON: |
| 127 | +--------- |
| 128 | +* Ruvector - Vector database with HNSW indexing |
| 129 | +* WiFi-DensePose - WiFi CSI for pose estimation |
| 130 | +* esp-rs - Rust on ESP32 |
| 131 | + |
| 132 | +LICENSE: |
| 133 | +-------- |
| 134 | +Created with Claude Code |
| 135 | +https://github.com/ruvnet/wifi-densepose |
0 commit comments