Liu Wei Chen Xiaoyang Jin Jiaqin Liu Peng
Journal of Information and Management.
Online available: 2026-05-28
Generative artificial intelligence is reshaping the production of academic texts. Conventional plagiarism detection based on textual similarity is increasingly insufficient for identifying AI-generated texts with original expressions. In Chinese academic contexts, the key issue is not merely whether a text can be classified as machine-generated, but how uncertain detection signals can be transformed into interpretable and reviewable risk clues for human academic review. Taking the ScholarGuard platform as a case, this study develops a multi-source evidence fusion framework for Chinese academic text detection by integrating perplexity perturbation, statistical features, and BERT-based semantic discrimination. The detection results are represented through RiskScore, risk levels, and paragraph-level prompts. Based on an exploratory test set of 120 Chinese academic texts covering law, political science, economics, and sociology, the study evaluates the system in terms of overall performance, disciplinary differences, baseline comparison, and ablation results. Under controlled test conditions, ScholarGuard achieves an accuracy of 82.5%, a precision of 86.3%, a recall of 78.3%, an F1 score of 82.1%, and an AUROC of 0.89. The results suggest that multi-source evidence fusion can improve the stability of AI-generated text risk identification in Chinese academic contexts. However, detection results should not be used as an automatic basis for assigning responsibility. AI-generated text detection is more appropriately positioned as a risk-indication tool in academic information quality governance, supporting source transparency, human verification, editorial review, and academic integrity management.