A scalable parallel information system for evidence-grounded weekly report generation from multi-source news
摘要
Generating weekly reports from multi-source news at operational scale is a high-throughput information processing task that requires scalable ingestion, evidence selection, redundancy control, temporal grounding, and auditable human revision. This paper presents a scalable parallel information system for evidence-grounded weekly report generation, using Association of Southeast Asian Nations (ASEAN)-related news as a case study. The system organizes web-based job orchestration, document-level parallel preprocessing, batched semantic encoding, constrained drafting, interactive revision, and version archiving into an evidence-first workflow. Its core algorithm layer consists of three coordinated modules: an entropy-adaptive relevance-diversity selector that combines SBERT semantic scores, TF–IDF lexical evidence, lexical uncertainty, and redundancy-aware Top-N filtering; a dual-evidence summarizer that fuses position-decayed TextRank, semantic centrality, and structured evidence cues; and a metadata–text temporal grounding module that separates current-week primary time from historical/background references. Experiments on 9989 one-week ASEAN news documents show that the proposed selector detects no Top-N near-duplicate pairs under