DiscoverAI InsidersConflict-Aware Meta-Review Generation via Cognitive Alignment
Conflict-Aware Meta-Review Generation via Cognitive Alignment

Conflict-Aware Meta-Review Generation via Cognitive Alignment

Update: 2025-03-20
Share

Description

This paper addresses the challenge of automating high-stakes meta-review generation, a critical task in academic peer review that involves synthesizing conflicting evaluations and deriving consensus. The authors argue that current Large Language Model (LLM)-based methods for this task are underdeveloped and susceptible to cognitive biases like the anchoring effect and conformity bias, hindering their ability to effectively handle disagreements. To overcome these limitations, the paper introduces the Cognitive Alignment Framework (CAF), a novel dual-process architecture inspired by Kahneman's dual-process theory of human cognition. CAF employs a three-step cognitive pipeline: review initialisation, incremental integration, and cognitive alignment. Empirical validation on the PeerSum dataset demonstrates that CAF outperforms existing LLM-based methods in terms of sentiment and content consistency.
Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Conflict-Aware Meta-Review Generation via Cognitive Alignment

Conflict-Aware Meta-Review Generation via Cognitive Alignment