"When Einstein Meets Deep Learning" โ We make radio signals elegantly dance to the laws of physics in virtual cities. ๐
๐ [NEW!] Our paper has been accepted by ACM MM BNI 2025 as an Oral Presentation! ๐
๐ All code is now available โ Ready for researchers and practitioners to explore and build upon our work! ๐ป
๐ฏ Pre-trained model weights are now available โ Download from Baidu Netdisk: Link (Code: dnd4) ๐ฆ
- ๐ง Physics-Informed AI: Equipping neural networks with electromagnetic wisdom, enabling AI to think using Helmholtz equations.
- ๐ญ Dual U-Net Architecture: Two neural netsโone handling physical laws, the other refining detailsโworking seamlessly to reconstruct radio maps.
- ๐ Record-Breaking Accuracy: Achieved an unprecedented 0.0031 NMSE error in static scenarios, 2ร better than state-of-the-art methods!
- ๐ช๏ธ Dynamic Scene Mastery: Robust reconstruction in dynamic, interference-rich environments (vehicles, moving obstacles) with an impressive 0.0047 NMSE.
- ๐ต๏ธ Sparse Data Champion: Capable of accurately reconstructing complete radio maps even from a mere 1% samplingโlike Sherlock deducing from minimal clues.
- ๐งฉ Signal Reconstruction Puzzle: Restoring complete electromagnetic fields from fragmented measurements.
- ๐ Urban Maze Complexity: Seamlessly handling complex obstructions from buildings, moving vehicles, and urban environments.
- โก Real-Time Performance: Achieving inference speeds up to 10ร faster than traditional methodsโideal for real-time 5G/6G applications.
- Physics-Conductor U-Net: Embeds physical laws (Helmholtz equations) through Physics-Informed Neural Networks (PINNs).
- Detail-Sculptor U-Net: Uses advanced diffusion models for ultra-fine precision in radio map reconstruction.
- ๐ฏ Anchor Conditional Mechanism: Precisely locking onto critical physical landmarks (like GPS for radio signals).
- ๐ RF-Space Attention: Models "frequency symphonies" enabling focused learning of electromagnetic signal characteristics.
- โ๏ธ Multi-Objective Loss: Harmonizing physics-based constraints and data-driven fitting to achieve optimal results.
Leveraged the authoritative RadioMapSeer dataset:
- 700+ real-world urban scenarios (London, Berlin, Tel Aviv, etc.)
- 80 base stations per map with high-resolution 256ร256 grids
- Incorporates static and dynamic challenges (buildings, vehicles)
- Python: 3.8+
- PyTorch: 2.0+ with CUDA support
- GPU: NVIDIA GPU with 8GB+ VRAM (recommended)
- Dataset: RadioMapSeer dataset
- Clone the repository:
git clone git@github.com:Hxxxz0/RMDM.git
cd PhyRMDM- Create and activate conda environment:
conda create -n RMDM python=3.8
conda activate RMDM- Install dependencies:
# Install PyTorch with CUDA support
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121
# Install all other dependencies
pip install -r requirement.txt- Verify installation:
python -c "import torch; print(f'PyTorch {torch.__version__}, CUDA: {torch.cuda.is_available()}')"Download and organize the RadioMapSeer dataset:
RadioMapSeer/
โโโ gain/
โ โโโ DPM/
โ โโโ IRT2/
โ โโโ cars*/
โโโ png/
โ โโโ buildings_complete/
โ โโโ antennas/
โ โโโ cars/
โโโ dataset.csv
Single GPU Training (SRM):
conda activate RMDM
python train.py \
--data_name Radio \
--data_dir /path/to/RadioMapSeer \
--batch_size 16 \
--mixed_precision no \
--use_checkpoint True \
--num_channels 96 \
--attention_resolutions 16 \
--log_interval 50 \
--max_steps 100000 \
--save_interval 10000 \
--save_dir ./checkpoints_phyMulti-GPU Training (SRM):
accelerate launch --num_processes=2 --multi_gpu --mixed_precision=no \
train.py \
--data_name Radio \
--data_dir /path/to/RadioMapSeer \
--batch_size 32 \
--mixed_precision no \
--use_checkpoint True \
--num_channels 96 \
--attention_resolutions 16 \
--log_interval 50 \
--max_steps 100000 \
--save_interval 10000 \
--save_dir ./checkpoints_phyResume Training:
python train.py \
--resume_from ./checkpoints_phy/model_phy_step5000.pth \
--data_name Radio \
--data_dir /path/to/RadioMapSeer \
--batch_size 16 \
--mixed_precision no \
--save_dir ./checkpoints_phyQuick Inference Test (SRM):
python sample_test.py \
--scheduler_type ddpm \
--data_dir /path/to/RadioMapSeer \
--checkpoint_path ./checkpoints_phy/model_phy_step100000.pth \
--output_dir ./inference_results \
--ddpm_steps 1000 \
--batch_size 4 \
--num_samples 100Full Test Set Evaluation (SRM):
python sample_test.py \
--scheduler_type ddpm \
--data_dir /path/to/RadioMapSeer \
--checkpoint_path ./checkpoints_phy/model_phy_step10000.pth \
--output_dir ./full_evaluation \
--ddpm_steps 1000 \
--batch_size 4 \
--num_samples -1Inference with Image Saving ๐ผ๏ธ:
python sample_test.py \
--scheduler_type ddpm \
--data_dir /path/to/RadioMapSeer \
--checkpoint_path ./checkpoints_phy/model_phy_step10000.pth \
--output_dir ./results_with_images \
--ddpm_steps 1000 \
--batch_size 4 \
--num_samples 50 \
--save_imagesThis will generate:
- ๐ Generated radio maps:
generated/folder - ๐ฏ Ground truth maps:
ground_truth/folder - ๐๏ธ Input conditions:
conditions/folder (buildings + transmitters) - ๐ Comparison plots:
comparison/folder (generated vs. ground truth vs. difference)
@misc{jia2025rmdmradiomapdiffusion,
title={RMDM: Radio Map Diffusion Model with Physics Informed},
author={Haozhe Jia and Wenshuo Chen and Zhihui Huang and Hongru Xiao and Nanqian Jia and Keming Wu and Songning Lai and Yutao Yue},
year={2025},
eprint={2501.19160},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2501.19160},
}Special thanks to:
- ๐ซ Joint Laboratory of Hong Kong University of Science and Technology (Guangzhou) & Shandong University
- ๐ Guangzhou Education Bureau's Key Research Project
- ๐ค DIILab for generous computational support
License: This project is distributed under the Academic Free License v3.0. Please cite accordingly for academic use. For commercial applications, contact the authors directly.