DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streaming

3D Gaussian Splatting (3DGS) has emerged as a promis-ing paradigm for reconstructing streamable free-viewpoint video (FVV)from multi-view videos. However, 3DGS-based FVVs typically lack userinteraction and editing capabilities, which diminishes the immersive ex-perience. Recent research has integrated language features from CLIPinto 3DGS via distillation, enabling open-vocabulary queries and sup-porting many downstream applications. Nevertheless, the stringent re-quirements of FVV, low frame size and high FPS, make current languageGaussian representations unsuitable for language-embedded FVV. In thispaper, we propose DLGStream, a novel language-embedded FVV repre-sentation that streams time-varying language features alongside Gaus-sian attributes to support 4D environment interaction, scene editing, andspatial intelligence. Specifically, we propose a dual-opacity dynamic lan-guage Gaussian representation, which maintains two opacity attributesfor color and language features to deal with performance degradationthat occurs when colors and features are jointly optimized. Further-more, we introduce an interpolation-based deformation field to reducetemporal redundancy. This deformation field can also be used for 4Dframe interpolation, boosting FVV sequences from low to high FPS. Ex-perimental results demonstrate that DLGStream achieves superior per-formance in both on open-vocabulary segmentation and reconstructionquality with an average frame size of merely 43 KB. The code is availableon https://github.com/kkkzh/DLGStream.