← Back to all development cases
This case was judged by an anonymized AI reviewer and has not been independently reviewed by people; inspect the draft, cards, and both outputs to assess it.
AutocompleteWithout cards better159 / 280 · beu-0ab27ad84228b326

A Review of Graph Neural Networks in Epidemic Modeling

Quantitative biology · 2403.19852v4

FLOWING EVIDENCE BENCHMARK

How do we compare writing with and without cards?

At the same writing position, the same model produces one first result with cards and one without. All 280 pairs enter the overall anonymized review, which assesses whether a decision not to continue fits the draft.

Overall: 138 with-card wins, 26 ties, 107 no-card wins, 5 pairs where neither was usable, and 4 inconclusive judgments. Both sides wrote text in 218 pairs; 48 had a deliberate stop and 14 included an invalid output.

SAME DRAFT · WITH OR WITHOUT CARDS

01 · FIXED WRITING POSITION

MANUSCRIPT

Same writing position ▌

Matched autocomplete at the same draft position

02 · TWO MATCHED VERSIONS

SHARED BY BOTH

Draft, writing task, and generation model

A · With cards

Relevant literature cards supplied

B · Without cards

No literature cards supplied

Generation model

Same model and version

A → first output

B → first output

Anonymized AI judge

First outputs are anonymized as X and Y

Continuation review: accuracy, fit to the writing task and usability
Returns: X preferred / tie / Y preferred / both unusable

Review again with the answer order swapped

HOW DOES BLIND JUDGING WORK?

① Anonymize both outputs
The AI judge sees the same draft and both first outputs without knowing which received cards.

② Compare and swap order
The judge applies task-specific criteria in X/Y and then Y/X order.

③ Review disagreements
A third pass resolves disagreements. Incomplete reviews remain in the denominator.

How are positions and cards selected?

We selected 40 writing positions in each of seven fields, for 280 comparisons. The position and relevant literature cards were set before each comparison, so both versions began from the same draft.

The main result retains every frozen position, including places where cards might not add a useful next move. This avoids selecting cases based on their outputs, but 49% describes the whole cohort, not a win rate where evidence clearly had an opportunity to help. This cohort did not record that opportunity label for each position before generation, so those two groups cannot yet be separated reliably.

CARD USE · 140/280

Reported card use in continuations with text

The model reports whether a card affected its continuation. In 140 of 280 tests it produced continuation text and reported card use. The previous count of 150 included 10 cases without continuation text and has been corrected.

COMPARISON · 70 / 7 / 30

Which written version was better?

Of the 107 reported-use cases where both versions produced text, the blinded AI judge preferred the with-card version 70 times, found 7 about the same, and preferred the without-card version 30 times.

How are the two table percentages calculated?

ADOPTION COVERAGE

140reported use with text
÷
280all positions
=
50%

WITH-CARD VERSION PREFERRED

70with cards better
÷
107comparable tests
=
65%

The percentages use different groups: 50% counts continuations with text reporting card use among all 280 tests; 65% covers the 107 such cases with text on both sides. The generating model reports card use, while an anonymized AI judge compares writing quality.

Card use is self-reported by the generator. The anonymized AI judge sees the draft and source snippets, so source-aware preference remains possible; there was no independent human review. The overall result describes these 280 frozen positions, not a win probability for any writing task.

Manuscript writing position

Text excerpt · not a PDF page

Research manuscript · excerpt

A Review of Graph Neural Networks in Epidemic Modeling

5. Future Work > 5.3. Epidemic Diffusion Process

Meanwhile, scalability must also be considered for numerous reasons: (1) A smaller granularity results in the expansion of graph data. (2) Some tasks require real-time processing Wang et al. 2023a . While the number of countries or provinces can be small, the graph for individuals or other necessary parts in epidemic models can be extremely large, e.g., contact information graphs in metropolises, which could make the current methods very time-consuming. Furthermore, the use of multi-scale data and the requirements for real-time processing make the problem even harder.

…es can not only serve as augmentations for each other but also compensate for noise from single-modality data. In recent years, some works have successfully incorporated multi-modality in GNNs. Although GNNs are very suitable for information aggregation and handling multi-modality data, there has not been much work exploring the multi-modality of GNNs in an epidemiology setting. Some related works Lin et al. 2023a ; Han et al. 2023 have utilized unstructured data like textual or image data to construct node features. However, there is no cross-modality in their work in terms of node features.

↓ Next paragraph was generated here

The highlighted text is near the writing position. This is a layout of the evaluation input, not a PDF screenshot.

A matched comparison at the same writing positionOverall AI review: Without cards better

Both arms use the same model, task and manuscript context. Only the retrieved passages differ. The first recorded output from each arm is shown below.

Read overall AI review rationale

A = without cards · B = with cards

Both outputs provide usable continuations, but Output A is significantly better suited to this position in the manuscript. The draft ends by noting that existing works use unstructured data for node features but lack cross-modality in node features. Output A directly addresses this gap by pivoting to another key challenge (partially observable transmission mechanisms) and proposing a concrete future direction (integrating mechanistic compartmental priors into message passing). This maintains the paper's forward-looking argumentative momentum and connects naturally to the epidemiology setting that the draft has established. Output B, while topically related to GNNs, introduces airway extraction from CT scans—a medical imaging task that is tangential to the epidemiology/GNN multi-modality focus of the current paragraph. The draft discusses using textual/image data for node features in epidemic models, not extracting anatomical tree structures from medical images. Output B's discussion of 'contact or transmission structures' is a stretch; the airway extraction work models bronchial tree topology, not human contact networks for disease spread. Output A's proposed integration of 'mechanistic compartmental priors' directly addresses epidemic dynamics and offers a methodological advance coherent with the draft's concerns about scalability, real-time processing, and multi-scale data mentioned earlier.

Evidence

Same model and position · retrieved passages supplied · first output

Not preferred in this comparison

A related line of work has begun to address the extraction of structured connectivity from imaging data by casting it as a graph refinement task, in which a graph auto-encoder with a GNN encoder learns node embeddings and a decoder predicts the connections between nodes. Such formulations offer a concrete route to recovering the contact or transmission structures that epidemic diffusion models require, yet they have so far been developed and evaluated outside the epidemiological setting.

Passages supplied to the Evidence version

Card 1 · PGCN: Pyramidal Graph Convolutional Network for EEG Emotion Recognition

Emotion recognition is essential in the diagnosis and rehabilitation of various mental diseases. In the last decade, electroencephalogram (EEG)-based emotion recognition has been intensively investigated due to its prominative accuracy and reliability, and graph convolutional network (GCN) has becom…

Read full passage excerpt

Emotion recognition is essential in the diagnosis and rehabilitation of various mental diseases. In the last decade, electroencephalogram (EEG)-based emotion recognition has been intensively investigated due to its prominative accuracy and reliability, and graph convolutional network (GCN) has become a mainstream model to decode emotions from EEG signals. However, the electrode relationship, especially long-range electrode dependencies across the scalp, may be underutilized by GCNs, although such relationships have been proven to be important in emotion recognition. The small receptive field makes shallow GCNs only aggregate local nodes. On the other hand, stacking too many layers leads to over-smoothing. To solve these problems, we propose the pyramidal graph convolutional network (PGCN), which aggregates features at three levels: local, mesoscopic, and global. First, we construct a vanilla GCN based on the 3D topological relationships of electrodes, which is used to integrate two-ord …

Card 2 · Prot2Text: Multimodal Protein’s Function Generation with GNNs and Transformers

In recent years, significant progress has been made in the field of protein function prediction with the development of various machine-learning approaches. However, most existing methods formulate the task as a multi-classification problem, i.e. assigning predefined labels to proteins. In this work…

Read full passage excerpt

In recent years, significant progress has been made in the field of protein function prediction with the development of various machine-learning approaches. However, most existing methods formulate the task as a multi-classification problem, i.e. assigning predefined labels to proteins. In this work, we propose a novel approach, Prot2Text, which predicts a protein's function in a free text style, moving beyond the conventional binary or categorical classifications. By combining Graph Neural Networks(GNNs) and Large Language Models(LLMs), in an encoder-decoder framework, our model effectively integrates diverse data types including protein sequence, structure, and textual annotation and description. This multimodal approach allows for a holistic representation of proteins' functions, enabling the generation of detailed and accurate functional descriptions. To evaluate our model, we extracted a multimodal protein dataset from SwissProt, and demonstrate empirically the effectiveness of Pr …

Card 3 · Deep Representation Learning For Multimodal Brain Networks

Applying network science approaches to investigate the functions and anatomy of the human brain is prevalent in modern medical imaging analysis. Due to the complex network topology, for an individual brain, mining a discriminative network representation from the multimodal brain networks is non-triv…

Read full passage excerpt

Applying network science approaches to investigate the functions and anatomy of the human brain is prevalent in modern medical imaging analysis. Due to the complex network topology, for an individual brain, mining a discriminative network representation from the multimodal brain networks is non-trivial. The recent success of deep learning techniques on graph-structured data suggests a new way to model the non-linear cross-modality relationship. However, current deep brain network methods either ignore the intrinsic graph topology or require a network basis shared within a group. To address these challenges, we propose a novel end-to-end deep graph representation learning (Deep Multimodal Brain Networks - DMBN) to fuse multimodal brain networks. Specifically, we decipher the cross-modality relationship through a graph encoding and decoding process. The higher-order network mappings from brain structural networks to functional networks are learned in the node domain. The learned network …

Card 4 · Multimodal spatiotemporal graph neural networks for improved prediction of 30-day all-cause hospital readmission

Measures to predict 30-day readmission are considered an important quality factor for hospitals as accurate predictions can reduce the overall cost of care by identifying high risk patients before they are discharged. While recent deep learning-based studies have shown promising empirical results on…

Read full passage excerpt

Measures to predict 30-day readmission are considered an important quality factor for hospitals as accurate predictions can reduce the overall cost of care by identifying high risk patients before they are discharged. While recent deep learning-based studies have shown promising empirical results on readmission prediction, several limitations exist that may hinder widespread clinical utility, such as (a) only patients with certain conditions are considered, (b) existing approaches do not leverage data temporality, (c) individual admissions are assumed independent of each other, which is unrealistic, (d) prior studies are usually limited to single source of data and single center data. To address these limitations, we propose a multimodal, modality-agnostic spatiotemporal graph neural network (MM-STGNN) for prediction of 30-day all-cause hospital readmission that fuses multimodal in-patient longitudinal data. By training and evaluating our methods using longitudinal chest radiographs an …

Card 5 · Extraction of Airways using Graph Neural Networks

We present extraction of tree structures, such as airways, from image data as a graph refinement task. To this end, we propose a graph auto-encoder model that uses an encoder based on graph neural networks (GNNs) to learn embeddings from input node features and a decoder to predict connections betwe…

Read full passage excerpt

We present extraction of tree structures, such as airways, from image data as a graph refinement task. To this end, we propose a graph auto-encoder model that uses an encoder based on graph neural networks (GNNs) to learn embeddings from input node features and a decoder to predict connections between nodes. Performance of the GNN model is compared with mean-field networks in their ability to extract airways from 3D chest CT scans.

Model-reported card use

Card 5 · fact

Affected output: casting it as a graph refinement task, in which a graph auto-encoder with a GNN encoder learns node embeddings and a decoder predicts the connections between nodes

Model explanation: This row supplied the only concrete, bounded prior-work proposition available for the future-work paragraph, allowing the continuation to name a specific GNN-based structure-extraction approach rather than generic filler.

No Evidence

Same model and position · no retrieved passages · first output

Preferred by blind review

Beyond multi-modality, epidemic diffusion processes themselves remain challenging to model with GNNs because the underlying transmission mechanisms are only partially observable. Future work could integrate mechanistic compartmental priors into message passing so that learned representations respect the constraints of epidemic dynamics.

Earlier card-use comparison

The earlier diagnostic compared only cases with reported card use and text on both sides; its scope differs from the overall AI review above.

The blinded model review preferred the Evidence version. Its original rationale appears below.

Read the original model judgment

Output A is grounded in the sources and draft. It draws on the 'Extraction of Airways using Graph Neural Networks' source, which describes graph auto-encoders with GNN encoders learning node embeddings and decoders predicting connections—exactly the mechanism A describes. A carefully notes this has been 'developed and evaluated outside the epidemiological setting,' which is accurate (the source is about airways from CT scans, not epidemiology) and matches the draft's framing that related work exists but not in epidemiology. Output B introduces multiple unsupported claims: (1) 'epidemic diffusion processes themselves remain challenging to model with GNNs because the underlying transmission mechanisms are only partially observable'—no source or draft text supports this claim about partial observability being a challenge; (2) 'Future work could integrate mechanistic compartmental priors into message passing'—no source or draft mentions compartmental models, mechanistic priors, or this specific technical direction; (3) 'so that learned representations respect the constraints of epidemic dynamics'—unsupported purpose/benefit claim. The draft discusses scalability, multi-modality, and noise compensation, but never mentions partial observability, compartmental models, or epidemic dynamics constraints. These are substantive invented claims, making B unsupported and unusable.

The passages are input material; their presence does not mean an output used them or that they support every claim. Draft and source passages are excerpted; no simulated scores or PDF appear here.