“Vector Forge” is a high-efficiency model that utilizes a content-based model as its core technology, designed to suppress performance degradation over time. Based on our experience with recommendations in LINE News, we improved and extended the model across different services. We discuss here about the importance of integrating content models with sequence recommendation models, as well as the construction of a model evaluation system.