← Back to all development cases
This case was judged by an anonymized AI reviewer and has not been independently reviewed by people; inspect the draft, cards, and both outputs to assess it.
AutocompleteWithout cards better4 / 280 · beu-40adbed355c2a3b5

A Review of Link Prediction Applications in Network Biology

Quantitative biology · 2312.01275v1

FLOWING EVIDENCE BENCHMARK

How do we compare writing with and without cards?

At the same writing position, the same model produces one first result with cards and one without. All 280 pairs enter the overall anonymized review, which assesses whether a decision not to continue fits the draft.

Overall: 138 with-card wins, 26 ties, 107 no-card wins, 5 pairs where neither was usable, and 4 inconclusive judgments. Both sides wrote text in 218 pairs; 48 had a deliberate stop and 14 included an invalid output.

SAME DRAFT · WITH OR WITHOUT CARDS

01 · FIXED WRITING POSITION

MANUSCRIPT

Same writing position ▌

Matched autocomplete at the same draft position

02 · TWO MATCHED VERSIONS

SHARED BY BOTH

Draft, writing task, and generation model

A · With cards

Relevant literature cards supplied

B · Without cards

No literature cards supplied

Generation model

Same model and version

A → first output

B → first output

Anonymized AI judge

First outputs are anonymized as X and Y

Continuation review: accuracy, fit to the writing task and usability
Returns: X preferred / tie / Y preferred / both unusable

Review again with the answer order swapped

HOW DOES BLIND JUDGING WORK?

① Anonymize both outputs
The AI judge sees the same draft and both first outputs without knowing which received cards.

② Compare and swap order
The judge applies task-specific criteria in X/Y and then Y/X order.

③ Review disagreements
A third pass resolves disagreements. Incomplete reviews remain in the denominator.

How are positions and cards selected?

We selected 40 writing positions in each of seven fields, for 280 comparisons. The position and relevant literature cards were set before each comparison, so both versions began from the same draft.

The main result retains every frozen position, including places where cards might not add a useful next move. This avoids selecting cases based on their outputs, but 49% describes the whole cohort, not a win rate where evidence clearly had an opportunity to help. This cohort did not record that opportunity label for each position before generation, so those two groups cannot yet be separated reliably.

CARD USE · 140/280

Reported card use in continuations with text

The model reports whether a card affected its continuation. In 140 of 280 tests it produced continuation text and reported card use. The previous count of 150 included 10 cases without continuation text and has been corrected.

COMPARISON · 70 / 7 / 30

Which written version was better?

Of the 107 reported-use cases where both versions produced text, the blinded AI judge preferred the with-card version 70 times, found 7 about the same, and preferred the without-card version 30 times.

How are the two table percentages calculated?

ADOPTION COVERAGE

140reported use with text
÷
280all positions
=
50%

WITH-CARD VERSION PREFERRED

70with cards better
÷
107comparable tests
=
65%

The percentages use different groups: 50% counts continuations with text reporting card use among all 280 tests; 65% covers the 107 such cases with text on both sides. The generating model reports card use, while an anonymized AI judge compares writing quality.

Card use is self-reported by the generator. The anonymized AI judge sees the draft and source snippets, so source-aware preference remains possible; there was no independent human review. The overall result describes these 280 frozen positions, not a win probability for any writing task.

Manuscript writing position

Text excerpt · not a PDF page

Research manuscript · excerpt

A Review of Link Prediction Applications in Network Biology

1. Introduction

… has been applied successfully to build recommender systems for social networks, collaborative filtering, viral marketing, etc, based on similarity in individual profiles ( su2020link ) . In the realm of network biology, this translates to the capability to anticipate relationships among biological entities, such as genes, proteins, or metabolites. These predictive techniques rely on the analysis of existing network topology, incorporating knowledge from diverse sources like protein-protein interaction databases, gene expression profiles, or disease association data ( breit2020openbiolink ) .

… connections, link prediction contributes significantly to our understanding of complex biological systems, facilitating the discovery of novel biomarkers, drug targets, and insights into the intricate web of biological interactions. Furthermore, LP techniques can help researchers model and predict these temporal dynamics by forecasting how network connections will develop or weaken over time ( divakaran2020temporal ) . This temporal understanding is particularly crucial for tracking disease progression, understanding gene expression changes, or following the evolution of biological pathways.

↓ Next paragraph was generated here

The highlighted text is near the writing position. This is a layout of the evaluation input, not a PDF screenshot.

A matched comparison at the same writing positionOverall AI review: Without cards better

Both arms use the same model, task and manuscript context. Only the retrieved passages differ. The first recorded output from each arm is shown below.

Read overall AI review rationale

A = without cards · B = with cards

Both outputs provide coherent continuations, but they serve different argumentative functions at this position. The draft establishes link prediction's applications in social networks and biology, then discusses temporal dynamics and their importance for disease progression. Output A identifies a critical methodological gap—biological networks being sparse, noisy, and incomplete with heterogeneous edge meanings—that directly follows from the preceding comparison between social/technological and biological domains. This creates a productive tension: after establishing LP's successes and biological relevance, Output A pivots to challenges that generic methods face, setting up potential methodological innovations. Output B instead extends the systems-level view, but this largely restates what the draft already accomplished (the paragraph before the blank already covers 'anticipate relationships among biological entities' and 'intricate web of biological interactions'). Output B's content about disease-gene-pathway associations from expression data, while plausible given the sources, is somewhat redundant with the draft's existing claims and doesn't advance the argument structurally. Output A's move to methodological challenges is more rhetorically sophisticated and necessary for a complete academic argument: establishing a problem space before proposing solutions. The heterogeneous edge meanings point is particularly apt given the sources' emphasis on pathway topology and multi-scale organization. Output A wins on fit to current argument and appropriate scope—it makes a distinct next move rather than amplifying existing claims.

Evidence

Same model and position · retrieved passages supplied · first output

Not preferred in this comparison

By inferring associations between diseases, genes, and pathways from expression data, link prediction extends beyond pairwise interaction recovery toward a systems-level view of how molecular alterations propagate through cellular organization.

Passages supplied to the Evidence version

Card 1 · Unveiling new disease, pathway, and gene associations via multi-scale neural network

Diseases involve complex modifications to the cellular machinery. The gene expression profile of the affected cells contains characteristic patterns linked to a disease. Hence, new biological knowledge about a disease can be extracted from these profiles, improving our ability to diagnose and assess…

Read full passage excerpt

Diseases involve complex modifications to the cellular machinery. The gene expression profile of the affected cells contains characteristic patterns linked to a disease. Hence, new biological knowledge about a disease can be extracted from these profiles, improving our ability to diagnose and assess disease risks. This knowledge can be used for drug re-purposing, or by physicians to evaluate a patient's condition and co-morbidity risk. Here, we consider differential gene expressions obtained by microarray technology for patients diagnosed with various diseases. Based on these data and cellular multi-scale organization, we aim at uncovering disease-disease, disease-gene and disease-pathway associations. We propose a neural network with structure based on the multi-scale organization of proteins in a cell into biological pathways. We show that this model is able to correctly predict the diagnosis for the majority of patients. Through the analysis of the trained model, we predict disease- …

Card 2 · Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Prediction

Integrating whole-slide images (WSIs) and bulk transcriptomics for predicting patient survival can improve our understanding of patient prognosis. However, this multimodal task is particularly challenging due to the different nature of these data: WSIs represent a very high-dimensional spatial descr…

Read full passage excerpt

Integrating whole-slide images (WSIs) and bulk transcriptomics for predicting patient survival can improve our understanding of patient prognosis. However, this multimodal task is particularly challenging due to the different nature of these data: WSIs represent a very high-dimensional spatial description of a tumor, while bulk transcriptomics represent a global description of gene expression levels within that tumor. In this context, our work aims to address two key challenges: (1) how can we tokenize transcriptomics in a semantically meaningful and interpretable way?, and (2) how can we capture dense multimodal interactions between these two modalities? Specifically, we propose to learn biological pathway tokens from transcriptomics that can encode specific cellular functions. Together with histology patch tokens that encode the different morphological patterns in the WSI, we argue that they form appropriate reasoning units for downstream interpretability analyses. We propose fusing …

Card 3 · Network Methods for Pathway Analysis of Genomic Data

Rapid advances in high-throughput technologies have led to considerable interest in analyzing genome-scale data in the context of biological pathways, with the goal of identifying functional systems that are involved in a given phenotype. In the most common approaches, biological pathways are modele…

Read full passage excerpt

Rapid advances in high-throughput technologies have led to considerable interest in analyzing genome-scale data in the context of biological pathways, with the goal of identifying functional systems that are involved in a given phenotype. In the most common approaches, biological pathways are modeled as simple sets of genes, neglecting the network of interactions comprising the pathway and treating all genes as equally important to the pathway's function. Recently, a number of new methods have been proposed to integrate pathway topology in the analyses, harnessing existing knowledge and enabling more nuanced models of complex biological systems. However, there is little guidance available to researches choosing between these methods. In this review, we discuss eight topology-based methods, comparing their methodological approaches and appropriate use cases. In addition, we present the results of the application of these methods to a curated set of ten gene expression profiling studies …

Card 4 · Transcriptional landscape of SARS-CoV-2 infection dismantles pathogenic pathways activated by the virus, proposes unique sex-specific differences and predicts tailored therapeutic strategies

The emergence of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) disease (COVID-19) has posed a serious threat to global health. As no specific therapeutics are yet available to control disease evolution, more in-depth understanding of the pathogenic mechanisms induced by SARS-CoV-2…

Read full passage excerpt

The emergence of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) disease (COVID-19) has posed a serious threat to global health. As no specific therapeutics are yet available to control disease evolution, more in-depth understanding of the pathogenic mechanisms induced by SARS-CoV-2 will help to characterize new targets for the management of COVID-19. The present study identified a specific set of biological pathways altered in primary human lung epithelium upon SARS-CoV-2 infection, and a comparison with SARS-CoV from the 2003 pandemic was studied. The transcriptomic profiles were also exploited as possible novel therapeutic targets, and anti-signature perturbation analysis predicted potential drugs to control disease progression. Among them, Mitogen-activated protein kinase kinase (MEK), serine-threonine kinase (AKT), mammalian target of rapamycin (mTOR) and I kappa B Kinase (IKK) inhibitors emerged as candidate drugs. Finally, sex-specific differences that may under …

Card 5 · Identification and Query of Activated Gene Pathways in Disease Progression

Disease occurs due to aberrant expression of genes and modulation of the biological pathways along which they lie. Inference of activated gene pathways, using gene expression data during disease progression, is an important problem. In this work, we have developed a generalizable framework for the i…

Read full passage excerpt

Disease occurs due to aberrant expression of genes and modulation of the biological pathways along which they lie. Inference of activated gene pathways, using gene expression data during disease progression, is an important problem. In this work, we have developed a generalizable framework for the identification of interacting pathways while incorporating biological realism, using functional data analysis and manifold embedding techniques. Additionally, we have also developed a new method to query for the differential co-ordinated activity of any desired pathway during disease progression. The methods developed in this work can be generalized to any conditions of interest.

Model-reported card use

Card 1 · fact

Affected output: inferring associations between diseases, genes, and pathways from expression data

Model explanation: The row supplied the concrete association types (disease-disease, disease-gene, disease-pathway) inferred from expression data, which the sentence presents as the scope of link prediction in network biology.

Card 3 · terminology

Affected output: a systems-level view of how molecular alterations propagate through cellular organization

Model explanation: The row's framing of pathway-level analysis as identifying functional systems involved in a phenotype guided the systems-level phrasing rather than a generic 'biological interactions' wording.

No Evidence

Same model and position · no retrieved passages · first output

Preferred by blind review

Despite this broad applicability, the translation of link prediction from social and technological domains to network biology raises distinct methodological challenges. Biological networks are typically sparse, noisy, and incomplete, and their edges carry heterogeneous meanings that generic similarity-based predictors were not designed to accommodate.

Earlier card-use comparison

The earlier diagnostic compared only cases with reported card use and text on both sides; its scope differs from the overall AI review above.

The blinded model review preferred the no-Evidence version. Its original rationale appears below.

Read the original model judgment

Output A provides a coherent continuation grounded in the draft's established concepts. It transitions logically from the broad applicability described in the first paragraph to methodological challenges specific to biological networks, maintaining the manuscript's focus on link prediction in network biology without inventing unsupported claims. The points about sparsity, noise, incompleteness, and heterogeneous edge meanings are reasonable extrapolations from the draft's discussion of biological network complexity. Output B makes an unsupported claim: it states that link prediction 'extends beyond pairwise interaction recovery toward a systems-level view of how molecular alterations propagate through cellular organization.' The draft discusses link prediction as predicting relationships among biological entities based on network topology, but does not claim LP achieves 'systems-level view of how molecular alterations propagate through cellular organization.' This is a substantive conceptual leap not supported by the draft or sources. The sources discuss pathway analysis, disease-gene associations, and expression data, but none establish that link prediction methods themselves provide this systems-level propagation view. The phrase 'extends beyond pairwise interaction recovery' is particularly unsupported—the draft frames LP as predicting connections/relationships, not as transcending pairwise analysis.

The passages are input material; their presence does not mean an output used them or that they support every claim. Draft and source passages are excerpted; no simulated scores or PDF appear here.