Soil moisture is an essential climate variable that directly influences many hydrological, agricultural, and water-cycle processes. Many satellites have been launched and are still being launched to map soil moisture accurately at a global scale. Motivated by the coarse resolution of existing satellite products, many statistical, physics-based, and machine learning-based methods have been proposed to downscale soil moisture to much finer spatial scales. In this paper, we propose a novel deep learning approach that is constrained by the Tau-omega radiative transfer model to enhance the resolution of surface soil moisture. We demonstrate the proposed framework by downscaling Soil Moisture Active Passive (SMAP) L-band brightness temperature (TB) with C-band synthetic aperture radar (SAR) backscattering coefficient (σ0) imagery from Sentinel-1A/B and subsequently retrieving high spatial resolution (1km) soil moisture.