3DGS3: Joint Super Sampling and Frame Interpolation for Real-Time Large-Scale 3DGS Rendering

3D Gaussian Splatting (3DGS) enables high-quality real-time 3D rendering but faces challenges in efficiently scaling to ultra-dense scenes and high resolutions due to computational bottlenecks thatlimit its use in latency-sensitive applications. Instead of optimizing thesplatting pipeline itself, we propose 3DGS3 , a unified post-renderingframework that jointly performs super sampling and frame interpolationthrough differentiable processing of low-resolution outputs to achieveboth high-resolution and high-frame-rate rendering. Our Gradient -Aware Super Sampling (GASS) module leverages the continuousdifferentiability of 3DGS to extract image gradients that guide a GRU-based refinement network to enable high-fidelity super sampling. Fur-thermore, a Lightweight Temporal Frame Interpolation (LTFI)module based on a compact U-Net-like backbone fuses temporal anddifferentiable spatial cues from consecutive frames to synthesize tem-porally coherent intermediate frames. Experiments on public datasetsdemonstrate that 3DGS3 achieves superior rendering efficiency and vi-sual quality when compared with state-of-the-art methods and remainscompatible with existing 3DGS acceleration techniques. The project codeis available at: https://github.com/Eabo20001/3DGS3.