GAP-URGENet: A Generative-Predictive Fusion Framework
for Universal Speech Enhancement

Xiaobin Rong1,2, Yushi Wang1,2, Zheng Wang1,2, Jing Lu1,2
1Key Laboratory of Modern Acoustics, Nanjing University
2NJU-Horizon Intelligent Audio Lab, Horizon Robotics
🏆 Challenge Leaderboard 📄 ArXiv Paper
Challenge Leaderboard
Figure: Rankings in the objective stage of the final leaderboard, with our team (WR) achieving first place.
Audio Demos from the Validation Set
fileid_1.flac: moderate noise with clipping distortion.
Noisy Signal
Noisy 1
Pred. Branch Output
Pred 1
Gen. Branch Output
Gen 1
GAP-URGENet Output
GAP-URGENet 1
Clean Signal
Clean 1
fileid_2.flac: Strong noise.
Noisy Signal
Noisy 2
Pred. Branch Output
Pred 2
Gen. Branch Output
Gen 2
GAP-URGENet Output
GAP-URGENet 2
Clean Signal
Clean 2
fileid_35.flac: Mild noise with frequent packet loss.
Noisy Signal
Noisy 35
Pred. Branch Output
Pred 35
Gen. Branch Output
Gen 35
GAP-URGENet Output
GAP-URGENet 35
Clean Signal
Clean 35
fileid_64.flac: Medium-level babble noise.
Noisy Signal
Noisy 64
Pred. Branch Output
Pred 64
Gen. Branch Output
Gen 64
GAP-URGENet Output
GAP-URGENet 64
Clean Signal
Clean 64
fileid_110.flac: Medium-level noise with medium-gap packet loss (max burst ~0.2s).
Noisy Signal
Noisy 110
Pred. Branch Output
Pred 110
Gen. Branch Output
Gen 110
GAP-URGENet Output
GAP-URGENet 110
Clean Signal
Clean 110
fileid_123.flac: Mild noise with medium-gap packet loss (max burst ~0.18s)
Noisy Signal
Noisy 123
Pred. Branch Output
Pred 123
Gen. Branch Output
Gen 123
GAP-URGENet Output
GAP-URGENet 123
Clean Signal
Clean 123
fileid_124.flac: Mild noise with codec artifact.
Noisy Signal
Noisy 123
Pred. Branch Output
Pred 123
Gen. Branch Output
Gen 123
GAP-URGENet Output
GAP-URGENet 123
Clean Signal
Clean 123
fileid_133.flac: Milde noise with long-gap packet loss (max burst ~0.3s)
Noisy Signal
Noisy 123
Pred. Branch Output
Pred 123
Gen. Branch Output
Gen 123
GAP-URGENet Output
GAP-URGENet 123
Clean Signal
Clean 123
fileid_218.flac: Multiple noise types with packet loss.
Noisy Signal
Noisy 123
Pred. Branch Output
Pred 123
Gen. Branch Output
Gen 123
GAP-URGENet Output
GAP-URGENet 123
Clean Signal
Clean 123
fileid_224.flac: Mild noise with reverberation.
Noisy Signal
Noisy 123
Pred. Branch Output
Pred 123
Gen. Branch Output
Gen 123
GAP-URGENet Output
GAP-URGENet 123
Clean Signal
Clean 123
fileid_269.flac: Strong noise.
Noisy Signal
Noisy 123
Pred. Branch Output
Pred 123
Gen. Branch Output
Gen 123
GAP-URGENet Output
GAP-URGENet 123
Clean Signal
Clean 123
fileid_481.flac: Syren noise.
Noisy Signal
Noisy 123
Pred. Branch Output
Pred 123
Gen. Branch Output
Gen 123
GAP-URGENet Output
GAP-URGENet 123
Clean Signal
Clean 123
fileid_584.flac: Music noise.
Noisy Signal
Noisy 123
Pred. Branch Output
Pred 123
Gen. Branch Output
Gen 123
GAP-URGENet Output
GAP-URGENet 123
Clean Signal
Clean 123
fileid_748.flac: Extreme noise.
Noisy Signal
Noisy 123
Pred. Branch Output
Pred 123
Gen. Branch Output
Gen 123
GAP-URGENet Output
GAP-URGENet 123
Clean Signal
Clean 123
Audio Demos from the Blind Test Set
fileid_538.flac: Real-recorded music noise.
Noisy Signal
Noisy 123
Pred. Branch Output
Pred 123
Gen. Branch Output
Gen 123
GAP-URGENet Output
GAP-URGENet 123
fileid_658.flac: Vocal separation.
Noisy Signal
Noisy 123
Pred. Branch Output
Pred 123
Gen. Branch Output
Gen 123
GAP-URGENet Output
GAP-URGENet 123
fileid_672.flac: Vocal separation.
Noisy Signal
Noisy 123
Pred. Branch Output
Pred 123
Gen. Branch Output
Gen 123
GAP-URGENet Output
GAP-URGENet 123
fileid_830.flac: Whispered speech.
Noisy Signal
Noisy 123
Pred. Branch Output
Pred 123
Gen. Branch Output
Gen 123
GAP-URGENet Output
GAP-URGENet 123