区块链技术的去中心化新闻检索与聚合架构研究

doi:10.19678/j.issn.1000-3428.0253167

计算机工程 ›› 2026, Vol. 52 ›› Issue (5): 303-325. doi: 10.19678/j.issn.1000-3428.0253167

区块链技术的去中心化新闻检索与聚合架构研究

李亮¹, 肖名志², 陈曦³^,*()

1. 武昌工学院信息工程学院, 湖北武汉 430065
2. 武昌首义学院信息科学与工程学院, 湖北武汉 430064
3. 华中科技大学人工智能与自动化学院, 湖北武汉 430074

收稿日期:2025-10-20 修回日期:2025-12-04 出版日期:2026-05-15 发布日期:2026-01-27
通讯作者: 陈曦
作者简介:
李亮(CCF会员), 男, 讲师、硕士, 主研方向为云存储、区块链技术
肖名志, 讲师、硕士
陈曦(通信作者), 教授、博士
基金资助:
国家自然科学基金(72374077); 湖北省优秀中青年科技创新团队计划项目(T2021042); 武昌工学院校级重点学科(群)项目(2021XK01)

Decentralized News-Retrieval and Aggregation Architecture Using Blockchain Technology

LI Liang¹, XIAO Mingzhi², CHEN Xi³^,*()

1. Information Engineering Institute, Wuchang Institute of Technology, Wuhan 430065, Hubei, China
2. College of Information Science and Engineering, Wuchang Shouyi University, Wuhan 430064, Hubei, China
3. School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, Hubei, China

Received:2025-10-20 Revised:2025-12-04 Online:2026-05-15 Published:2026-01-27
Contact: CHEN Xi

摘要/Abstract

摘要：

针对集中式新闻架构存在单点故障、篡改风险、验证不透明、虚假信息扩散等问题, 提出一种基于区块链的去中心化新闻检索与聚合架构, 实现多源新闻数据的可信存储、可验证检索与透明治理。该架构融合区块链、智能合约与分布式存储, 形成"链-合约-存储"一体化信任体系。通过共识机制保障数据来源可信, 智能合约自动执行治理规则, 实现可追溯与高可信性。提出多值模函数(MVF)鲁棒任务分配算法与关键/交易默克尔-帕特里夏树(KMPT/TMPT)双层可验证索引机制, 用于优化任务调度与索引验证, 以提升检索与验证效率。系统引入Merkle哈希树(MHT)完整性验证与多源信誉加权机制, 实现信源信誉自适应调整, 增强检索准确性和系统鲁棒性。系统在OpenStack私有云环境下完成分布式部署, 并基于2024年采集的106 532条新闻数据进行实验验证。实验结果表明, 相较传统方案, 该架构的可信验证准确率提升15.6%(P < 0.01), 抗篡改检测成功率达99.6%, 虚假新闻抑制率达92.4%。检索与验证流程的深度融合使可信检索综合效能提升22.3%(P < 0.05)。该研究结果验证了区块链在可信检索与数据治理中的可行性与工程有效性, 为构建高透明度、可追溯的新闻生态体系提供了理论支持与工程参考。

关键词: 区块链技术, 去中心化新闻检索, Merkle验证, 动态权重调度, 可信数据治理

Abstract:

To address issues such as a single point of failure, risk of tampering, opaque verification, and the proliferation of false information in centralized news architectures, a blockchain-based decentralized news-retrieval and aggregation architecture is proposed for trusted storage, verifiable retrieval, and transparent governance of multi-source news data. This architecture integrates blockchain, smart contracts, and distributed storage to form an integrated trust system of "chain-contract-storage." The consensus mechanism ensures the credibility of the data sources, whereas smart contracts automatically enforce governance rules for traceability and credibility. A Multi-Valued modulo Function (MVF) robust task allocation algorithm and a Key/Transaction Merkle-Patricia Tree (KMPT/TMPT) dual-layer verifiable indexing mechanism are proposed to optimize task scheduling and index verification, thereby enhancing retrieval and verification efficiency. The system incorporates Merkle Hash Tree (MHT) integrity verification and a multi-source reputation weighting mechanism to achieve adaptive adjustment of the source reputation, thereby enhancing retrieval accuracy and system robustness. The system is deployed in a private cloud environment on an OpenStack and experimentally validated using 106 532 news data collected in 2024. Experimental results show that compared to traditional solutions, the credibility verification accuracy of this architecture is improved by 15.6% (P < 0.01), the tamper resistance detection success rate reaches 99.6%, and the false news suppression rate is 92.4%. Deep integration of the retrieval and verification processes enhances the comprehensive effectiveness of trusted retrieval by 22.3% (P < 0.05). This study verifies the feasibility and engineering effectiveness of blockchain in trusted retrieval and data governance, providing theoretical support and an engineering reference for building a highly transparent and traceable news ecosystem.

Key words: blockchain technology, decentralized news-retrieval, Merkle verification, dynamic weight scheduling, trusted data governance

李亮, 肖名志, 陈曦. 区块链技术的去中心化新闻检索与聚合架构研究[J]. 计算机工程, 2026, 52(5): 303-325.

LI Liang, XIAO Mingzhi, CHEN Xi. Decentralized News-Retrieval and Aggregation Architecture Using Blockchain Technology[J]. Computer Engineering, 2026, 52(5): 303-325.

https://www.ecice06.com/CN/Y2026/V52/I5/303

图/表 34

图1 去中心化新闻检索与聚合系统整体架构

Fig.1 Overall architecture of the decentralized news-retrieval and aggregation system

图2 区块链与云服务融合的分层架构及接口逻辑

Fig.2 Layered architecture and interface logic of the integration of blockchain and cloud services

图3 Merkle哈希树结构

Fig.3 Structure of the Merkle hash tree

图4 新闻网站URL及文章信息提取系统示意图

Fig.4 Schematic diagram of news website URL and article information extraction system

图5 MVF分配算法架构

Fig.5 Architecture of the MVF allocation algorithm

图6 新闻检索系统的总体架构

Fig.6 Overall architecture of the news-retrieval system

图7 爬虫/抓取器的数据分配架构

Fig.7 Data distribution architecture of the crawler/scraper

图8 WebCrawler与OffchainCore的通信流程

Fig.8 Communication workflow between WebCrawler and OffchainCore

图9 WebScraper与OffchainCore的通信流程

Fig.9 Communication workflow between WebScraper and OffchainCore

图10 检索方法的时间复杂度对比

Fig.10 Comparison of time complexity of retrieval methods

图11 去中心化新闻检索与聚合系统的整体设计逻辑

Fig.11 The overall design logic of the decentralized news-retrieval and aggregation system

图12 部署于OpenStack云平台的WebCrawler与WebScraper组件架构

Fig.12 The architecture of WebCrawler and WebScraper components deployed on the OpenStack cloud platform

图13 优化前后性能对比

Fig.13 Performance comparison before and after optimization

图14 在不同文件规模下Merkle哈希树的初始化时间

Fig.14 Initialization time of Merkle hash tree under different file sizes

图15 基于Merkle树的新闻检索系统性能提升效果

Fig.15 Performance improvement effect of news-retrieval system based on Merkle tree

图16 不同并发量下的上链延迟与处理吞吐量对比(模拟数据)

Fig.16 Comparison of on-chain latency and processing throughput under different concurrency levels (simulated data)

图17 不同网络环境与请求量下的系统组件性能变化

Fig.17 Performance variations of system components under different network environments and request volumes

图18 异常节点识别率对比

Fig.18 Comparison of abnormal node recognition rates

图19 系统成功率对比

Fig.19 Comparison of system success rates

图20 各新闻网站每页提取链接平均数量对比

Fig.20 Comparison of the average number of links extracted from each page of various news websites

图21 基于区块链的隐私保护数据流转示意图

Fig.21 Schematic diagram of privacy-protected data flow based on blockchain

图22 不同并发量下系统检索延迟与响应时间对比

Fig.22 Comparison of system retrieval latency and response time under different concurrency levels

参考文献 34

1	WU Y Y , NGAI E W T , WU P K , et al. Fake news on the Internet: a literature review, synthesis and directions for future research. Internet Research, 2022, 32 (5): 1662- 1699. doi: 10.1108/INTR-05-2021-0294
2	CHEN C H, MA Y W, LAI Y H, et al. Analyzing disinformation with the active propagation strategy[C]//Proceedings of the 24th International Conference on Advanced Communication Technology (ICACT). Washington D.C., USA: IEEE Press, 2022: 262-266.
3	DOWSE A , BACHMANN S D . Information warfare: methods to counter disinformation. Defense & Security Analysis, 2022, 38 (4): 453- 469.
4	SCHNEIDER E J , BOMAN C D . Using message strategies to attenuate the effects of disinformation on credibility. Communication Studies, 2023, 74 (5): 393- 411. doi: 10.1080/10510974.2023.2219704
5	ALOTAIBI T , AL-DOSSARI H . A review of fake news detection techniques for Arabic language. International Journal of Advanced Computer Science and Applications, 2024, 15 (1): 15- 22.
6	GUTTMANN A. Survey: index of respondents' trust towards media in European Union (EU 28) countries in 2019[EB/OL]. [2025-05-05]. https://www.statista.com/statistics/454409/europe-media-trust-index/.
7	ALJALOUD A , RAZZAQ A . Modernizing the legacy healthcare system to decentralize platform using blockchain technology. Technologies, 2023, 11 (4): 7- 15.
8	OUYANG L. Newspaper3k: article scraping & curation[EB/OL]. [2025-05-05]. https://newspaper.readthedocs.io/en/latest/.
9	王栋, 王合建, 玄佳兴, 等. 面向电力调度指令的区块链隐私可追踪存证方案. 计算机工程, 2024, 50 (5): 158- 166.
	WANG D , WANG H J , XUAN J X , et al. Blockchain privacy-traceable deposit scheme for power-dispatch instructions. Computer Engineering, 2024, 50 (5): 158- 166.
10	谢树泳, 刘之亮. 基于朴素贝叶斯模型和PageRank算法的电网事故主题爬虫算法. 河南师范大学学报(自然科学版), 2025, 53 (2): 124- 130. doi: 10.16366/j.cnki.1000-2367.2023.12.26.0001
	XIE S Y , LIU Z L . A focused crawler algorithm based on Naive Bayes model and PageRank on power grid accidents. Journal of Henan Normal University (Natural Science Edition), 2025, 53 (2): 124- 130. doi: 10.16366/j.cnki.1000-2367.2023.12.26.0001
11	原旭, 黄笠煌, 陈志奎, 等. 基于状态树的链上数据高效可信查询索引模型及方法. 重庆大学学报, 2023, 46 (7): 9- 22. doi: 10.11835/j.issn.1000-582X.2023.07.002
	YUAN X , HUANG L H , CHEN Z K , et al. Efficient and trusted query index model and method for blockchain data based on Merkle patricia tree. Journal of Chongqing University, 2023, 46 (7): 9- 22. doi: 10.11835/j.issn.1000-582X.2023.07.002
12	ALEXANDRESCU A , BUTINCU C N . Decentralized news-retrieval architecture using blockchain technology. Mathematics, 2023, 11 (21): 4542. doi: 10.3390/math11214542
13	FiDisD—fighting disinformation using decentralized actors featuring AI and blockchain technologies[EB/OL]. [2025-05-05]. https://www.trublo.eu/fidisd/.
14	BUTINCU C N , ALEXANDRESCU A . Blockchain-based platform to fight disinformation using crowd wisdom and artificial intelligence. Applied Sciences, 2023, 13 (10): 6088. doi: 10.3390/app13106088
15	徐飞, 王涛, 杨波, 等. 支持去中心化存储的分块可搜索对称加密. 密码学报, 2024, 11 (3): 621- 636. doi: 10.13868/j.cnki.jcr.000698
	XU F , WANG T , YANG B , et al. A searchable symmetric encryption scheme for block-wise decentralized storage. Journal of Cryptologic Reseatch, 2024, 11 (3): 621- 636. doi: 10.13868/j.cnki.jcr.000698
16	韩益亮, 宋超越, 吴旭光, 等. 区块链与隐私计算融合技术综述. 科学技术与工程, 2024, 24 (28): 11945- 11963. doi: 10.12404/j.issn.1671-1815.2308483
	HAN Y L , SONG C Y , WU X G , et al. Review of integrated technology of blockchain and privacy computing. Science Technology and Engineering, 2024, 24 (28): 11945- 11963. doi: 10.12404/j.issn.1671-1815.2308483
17	王有恒, 冯开开, 李汝佳, 等. 区块链智能合约隐私保护技术研究综述. 计算机学报, 2025, 48 (6): 1373- 1416. doi: 10.11897/SP.J.1016.2025.01373
	WANG Y H , FENG K K , LI R J , et al. Privacy-preserving technologies for blockchain smart contracts: a survey. Chinese Journal of Computers, 2025, 48 (6): 1373- 1416. doi: 10.11897/SP.J.1016.2025.01373
18	吴方权, 刘亦驰, 胡骏涵. 一种基于区块链的去中心化数据聚合模型. 粘接, 2025, 52 (5): 151- 154. doi: 10.3969/j.issn.1001-5922.2025.05.039
	WU F Q , LIU Y C , HU J H . A blockchain-based decentralized data aggregation model. Adhesion, 2025, 52 (5): 151- 154. doi: 10.3969/j.issn.1001-5922.2025.05.039
19	XIANG P , LIU X , HAN Y . Design and implementation of blockchain-based anti-counterfeit traceability system for beef cattle products. Advances in Computer, Signals and Systems, 2023, 7 (7): 10- 20.
20	肖珂, 刘颖, 何云华, 等. 基于多链的能源数据链上链下安全检索方案. 计算机工程, 2025, 51 (8): 238- 249. doi: 10.19678/j.issn.1000-3428.0069363
	XIAO K , LIU Y , HE Y H , et al. On-chain and off-chain secure retrieval scheme for energy data based on multi-chain. Computer Engineering, 2025, 51 (8): 238- 249. doi: 10.19678/j.issn.1000-3428.0069363
21	胡云帆, 熊虎, 方黎明, 等. 适用于区块链的分布式密码技术综述. 计算机学报, 2025, 48 (7): 1670- 1695. doi: 10.11897/SP.J.1016.2025.01670
	HU Y F , XIONG H , FANG L M , et al. A survey of distributed cryptography suitable for blockchain. Chinese Journal of Computers, 2025, 48 (7): 1670- 1695. doi: 10.11897/SP.J.1016.2025.01670
22	杨潇, 吴黎兵, 张壮壮, 等. 基于区块链的云数据完整性验证研究综述. 小型微型计算机系统, 2023, 44 (11): 2369- 2376. doi: 10.20009/j.cnki.21-1106/TP.2023-0012
	YANG X , WU L B , ZHANG Z Z , et al. Survey on blockchain-based integrity validating for cloud data. Journal of Chinese Computer Systems, 2023, 44 (11): 2369- 2376. doi: 10.20009/j.cnki.21-1106/TP.2023-0012
23	何蒲, 于戈, 张岩峰, 等. 区块链技术与应用前瞻综述. 计算机科学, 2017, 44 (4): 1-7, 15. doi: 10.16660/j.cnki.1674-098X.2020.14.126
	HE P , YU G , ZHANG Y F , et al. Survey on blockchain technology and its application prospect. Computer Science, 2017, 44 (4): 1-7, 15. doi: 10.16660/j.cnki.1674-098X.2020.14.126
24	OpenStack[EB/OL]. [2025-05-05]. https://www.openstack.org/.
25	彭宇琪, 陈娇龙, 颜嘉麒. 基于区块链的去中心化科学系统运行机制综述. 计算机应用, 2025, 45 (11): 3407- 3415. doi: 10.11772/j.issn.1001-9081.2024121847
	PENG Y Q , CHEN J L , YAN J Q . Review of operational mechanisms for blockchain-based decentralized science systems. Journal of Computer Applications, 2025, 45 (11): 3407- 3415. doi: 10.11772/j.issn.1001-9081.2024121847
26	李逸凡, 吴怡, 杨辉. 基于OpenStack私有云平台的资源动态调度方法. 福建师范大学学报(自然科学版), 2025, 41 (2): 1- 8. doi: 10.12046/j.issn.1000-5277.2024040032
	LI Y F , WU Y , YANG H . Dynamic resource scheduling method for OpenStack-based private cloud platform. Journal of Fujian Normal University (Natural Science Edition), 2025, 41 (2): 1- 8. doi: 10.12046/j.issn.1000-5277.2024040032
27	翁彬月, 秦永彬, 黄瑞章, 等. NEMTF: 基于多维度文本特征的新闻网页信息提取方法. 计算机应用研究, 2022, 39 (4): 1043- 1048. doi: 10.19734/j.issn.1001-3695.2021.10.0407
	WENG B Y , QIN Y B , HUANG R Z , et al. NEMTF: method of news web content extraction based on multi-dimensional text features. Application Research of Computers, 2022, 39 (4): 1043- 1048. doi: 10.19734/j.issn.1001-3695.2021.10.0407
28	BARBARESI A. Trafilatura: a web scraping library and command-line tool for text discovery and extraction[C]//Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: System Demonstrations. Stroudsburg, PA, USA: ACL, 2021: 122-131.
29	QUDUS K F , TSARAMIRSIS G , ULLAH N , et al. Smart algorithmic based web crawling and scraping with template autoupdate capabilities. Concurrency and Computation: Practice and Experience, 2021, 33 (22): e6042. doi: 10.1002/cpe.6042
30	吴飞, 金圣洁, 林晓琛. 基于Mask R-CNN和关键点提取的抓取位姿估计方法. 合肥工业大学学报(自然科学版), 2023, 46 (9): 1178- 1184. doi: 10.3969/j.issn.1003-5060.2023.09.005
	WU F , JIN S J , LIN X C . Grasping pose estimation method based on Mask R-CNN and key point extraction. Journal of Hefei University of Technology (Natural Science), 2023, 46 (9): 1178- 1184. doi: 10.3969/j.issn.1003-5060.2023.09.005
31	DONG F M , WANG P H , LI R D , et al. Poisoning attacks and defenses to learned Bloom filters for malicious URL detection. IEEE Transactions on Dependable and Secure Computing, 2025, 22 (4): 3275- 3288. doi: 10.1109/TDSC.2025.3528993
32	安浩杨, 何德彪, 包子健, 等. 基于SM9数字签名的环签名及其在区块链隐私保护中的应用. 计算机研究与发展, 2023, 60 (11): 2545- 2554. doi: 10.7544/issn1000-1239.202330265
	AN H Y , HE D B , BAO Z J , et al. Ring signature based on the SM9 digital signature and its application in blockchain privacy protection. Journal of Computer Research and Development, 2023, 60 (11): 2545- 2554. doi: 10.7544/issn1000-1239.202330265
33	WANG J , ZHANG Y . NewsBlockchain: a blockchain-based reliable news verification framework. IEEE Access, 2020, 8, 12543- 12556.
34	LI H , CHEN S . RumorLens: multimodal representation learning for rumor detection on social media. Information Processing & Management, 2019, 56 (5): 1578- 1590.

[1]	刘亚雪, 杨小宝, 刘圆, 惠小强. 一种基于区块链的多应用证书系统模型[J]. 计算机工程, 2020, 46(9): 44-53.
[2]	傅易文晋, 陈华辉, 钱江波, 董一鸿. 面向时空数据的区块链研究综述[J]. 计算机工程, 2020, 46(3): 1-10.

选择文件类型/文献管理软件名称

选择包含的内容

区块链技术的去中心化新闻检索与聚合架构研究

Decentralized News-Retrieval and Aggregation Architecture Using Blockchain Technology

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 34

参考文献 34

相关文章 2

编辑推荐

Metrics

本文评价

模态框（Modal）标题

选择文件类型/文献管理软件名称

选择包含的内容

区块链技术的去中心化新闻检索与聚合架构研究

Decentralized News-Retrieval and Aggregation Architecture Using Blockchain Technology

RichHTML

PDF

可视化

被引次数

摘要/Abstract

引用本文

使用本文

图/表 34

参考文献 34

相关文章 2

编辑推荐

Metrics

本文评价