← Back to all development cases
This case was judged by an anonymized AI reviewer and has not been independently reviewed by people; inspect the draft, cards, and both outputs to assess it.
AutocompleteWith cards better155 / 280 · beu-20a544e3761848a8

A Review of Link Prediction Applications in Network Biology

Quantitative biology · 2312.01275v1

FLOWING EVIDENCE BENCHMARK

How do we compare writing with and without cards?

At the same writing position, the same model produces one first result with cards and one without. All 280 pairs enter the overall anonymized review, which assesses whether a decision not to continue fits the draft.

Overall: 138 with-card wins, 26 ties, 107 no-card wins, 5 pairs where neither was usable, and 4 inconclusive judgments. Both sides wrote text in 218 pairs; 48 had a deliberate stop and 14 included an invalid output.

SAME DRAFT · WITH OR WITHOUT CARDS

01 · FIXED WRITING POSITION

MANUSCRIPT

Same writing position ▌

Matched autocomplete at the same draft position

02 · TWO MATCHED VERSIONS

SHARED BY BOTH

Draft, writing task, and generation model

A · With cards

Relevant literature cards supplied

B · Without cards

No literature cards supplied

Generation model

Same model and version

A → first output

B → first output

Anonymized AI judge

First outputs are anonymized as X and Y

Continuation review: accuracy, fit to the writing task and usability
Returns: X preferred / tie / Y preferred / both unusable

Review again with the answer order swapped

HOW DOES BLIND JUDGING WORK?

① Anonymize both outputs
The AI judge sees the same draft and both first outputs without knowing which received cards.

② Compare and swap order
The judge applies task-specific criteria in X/Y and then Y/X order.

③ Review disagreements
A third pass resolves disagreements. Incomplete reviews remain in the denominator.

How are positions and cards selected?

We selected 40 writing positions in each of seven fields, for 280 comparisons. The position and relevant literature cards were set before each comparison, so both versions began from the same draft.

The main result retains every frozen position, including places where cards might not add a useful next move. This avoids selecting cases based on their outputs, but 49% describes the whole cohort, not a win rate where evidence clearly had an opportunity to help. This cohort did not record that opportunity label for each position before generation, so those two groups cannot yet be separated reliably.

CARD USE · 140/280

Reported card use in continuations with text

The model reports whether a card affected its continuation. In 140 of 280 tests it produced continuation text and reported card use. The previous count of 150 included 10 cases without continuation text and has been corrected.

COMPARISON · 70 / 7 / 30

Which written version was better?

Of the 107 reported-use cases where both versions produced text, the blinded AI judge preferred the with-card version 70 times, found 7 about the same, and preferred the without-card version 30 times.

How are the two table percentages calculated?

ADOPTION COVERAGE

140reported use with text
÷
280all positions
=
50%

WITH-CARD VERSION PREFERRED

70with cards better
÷
107comparable tests
=
65%

The percentages use different groups: 50% counts continuations with text reporting card use among all 280 tests; 65% covers the 107 such cases with text on both sides. The generating model reports card use, while an anonymized AI judge compares writing quality.

Card use is self-reported by the generator. The anonymized AI judge sees the draft and source snippets, so source-aware preference remains possible; there was no independent human review. The overall result describes these 280 frozen positions, not a win probability for any writing task.

Manuscript writing position

Text excerpt · not a PDF page

Research manuscript · excerpt

A Review of Link Prediction Applications in Network Biology

6. Challenges and Future Directions > 6.4. Heterogeneity in Knowledge Graphs

…o provide biological context to the predicted associations ( guo2022challenges ) . To be of utility to biologists and clinicians, the network construction phase should emphasize incorporating domain knowledge and the link prediction metrics should be able to accurately predict the nature of the association between entities ( zhou2021progresses ) . Once again, accurate link prediction rests on overcoming computational challenges in network structure learning. For instance, standard approaches like Bayesian inference become intractable as the number of variables increases ( zhang2014network ) .

…eep machine learning-based dynamic embedding techniques ( koutrouli2020guide ) as well as higher-order analysis that takes into account network substructures (or motifs ) ( roy2020motifs ) . There have been a few efforts to predict links based on the motif participation of nodes ( abuoda2020link ) or the presence or absence of motifs ( roy2023inferring ) . A recent embedding algorithm combines motifs with deep learning approaches to predict associations ( wang2020model ) . Finally, others have combined network reconstruction to meet link prediction goals ( wang2017kernel ; wu2019enhancing ) .

↓ Next paragraph was generated here

The highlighted text is near the writing position. This is a layout of the evaluation input, not a PDF screenshot.

A matched comparison at the same writing positionOverall AI review: With cards better

Both arms use the same model, task and manuscript context. Only the retrieved passages differ. The first recorded output from each arm is shown below.

Read overall AI review rationale

A = with cards · B = without cards

The draft discusses link prediction in biological networks, covering computational challenges, dynamic embeddings, higher-order analysis with motifs, and combinations of network reconstruction with link prediction. The paragraph ends with citations about combining network reconstruction to meet link prediction goals. This is a substantive, ongoing argument that clearly needs continuation—there is no natural stopping point or completed thought. Output A provides a coherent next move: it introduces heterogeneity in biological knowledge graphs as a further complication, discusses multiplex/multiplex-heterogeneous network embedding methods, and notes limited application to biological knowledge graphs. This fits the argument flow (extending from network reconstruction challenges to heterogeneous network challenges) and connects to the sources provided (particularly the MultiVERSE source on multiplex-heterogeneous networks). The text could be inserted with minimal repair. Output B's 'complete' action is inappropriate here because the draft clearly needs a next move—the paragraph ends mid-argument with 'Finally, others have combined...' suggesting more discussion is warranted, and the overall section is building toward recommendations about what biologists and clinicians need. Continuing would not be redundant or speculative.

Evidence

Same model and position · retrieved passages supplied · first output

Preferred by blind review

A further complication arises from the fact that knowledge graphs in biology are rarely homogeneous: nodes may represent genes, proteins, diseases, or drugs, and edges may encode heterogeneous relations such as regulation, interaction, or association. Embedding methods designed for multiplex and multiplex-heterogeneous networks have been proposed to learn representations in such settings, although their application to biological knowledge graphs remains limited.

Passages supplied to the Evidence version

Card 1 · MultiVERSE: a multiplex and multiplex-heterogeneous network embedding approach

Network embedding approaches are gaining momentum to analyse a large variety of networks. Indeed, these approaches have demonstrated their effectiveness in tasks such as community detection, node classification, and link prediction. However, very few network embedding methods have been specifically…

Read full passage excerpt

Network embedding approaches are gaining momentum to analyse a large variety of networks. Indeed, these approaches have demonstrated their effectiveness in tasks such as community detection, node classification, and link prediction. However, very few network embedding methods have been specifically designed to handle multiplex networks, i.e. networks composed of different layers sharing the same set of nodes but having different types of edges. Moreover, to our knowledge, existing approaches cannot embed multiple nodes from multiplex-heterogeneous networks, i.e. networks composed of several multiplex networks containing both different types of nodes and edges. In this study, we propose MultiVERSE, an extension of the VERSE framework using Random Walks with Restart on Multiplex (RWR-M) and Multiplex-Heterogeneous (RWR-MH) networks. MultiVERSE is a fast and scalable method to learn node embeddings from multiplex and multiplex-heterogeneous networks. We evaluate MultiVERSE on several biol …

Card 2 · Deep learning-based electroencephalography analysis: a systematic review

CONTEXT: Electroencephalography (EEG) is a complex signal and can require several years of training, as well as advanced signal processing and feature extraction methodologies to be correctly interpreted. Recently, deep learning (DL) has shown great promise in helping make sense of EEG signals due t…

Read full passage excerpt

CONTEXT: Electroencephalography (EEG) is a complex signal and can require several years of training, as well as advanced signal processing and feature extraction methodologies to be correctly interpreted. Recently, deep learning (DL) has shown great promise in helping make sense of EEG signals due to its capacity to learn good feature representations from raw data. Whether DL truly presents advantages as compared to more traditional EEG processing approaches, however, remains an open question. OBJECTIVE: In this work, we review 154 papers that apply DL to EEG, published between January 2010 and July 2018, and spanning different application domains such as epilepsy, sleep, brain-computer interfacing, and cognitive and affective monitoring. We extract trends and highlight interesting approaches from this large body of literature in order to inform future research and formulate recommendations. METHODS: Major databases spanning the fields of science and engineering were queried to identif …

Card 3 · Symmetry-driven network reconstruction through pseudobalanced coloring optimization

Abstract Symmetries found through automorphisms or graph fibrations provide important insights in network analysis. Symmetries identify clusters of robust synchronization in the network which improves the understanding of the functionality of complex biological systems. Network symmetries can be det…

Read full passage excerpt

Abstract Symmetries found through automorphisms or graph fibrations provide important insights in network analysis. Symmetries identify clusters of robust synchronization in the network which improves the understanding of the functionality of complex biological systems. Network symmetries can be determined by finding a balanced coloring of the graph, which is a node partition in which each cluster of nodes receives the same information (color) from the rest of the graph. In recent work we saw that biological networks such as gene regulatory networks, metabolic networks and neural networks in organisms ranging from bacteria to yeast and humans are rich in fibration symmetries related to the graph balanced coloring. Networks based on real systems, however, are built on experimental data which are inherently incomplete, due to missing links, collection errors, and natural variations within specimens of the same biological species. Therefore, it is fair to assume that some of the existing …

Card 4 · Uncertainty-Aware Null Space Networks for Data-Consistent Image Reconstruction

Reconstructing an image from noisy and incomplete measurements is a central task in several image processing applications. In recent years, state-of-the-art reconstruction methods have been developed based on recent advances in deep learning. Especially for highly underdetermined problems, maintaini…

Read full passage excerpt

Reconstructing an image from noisy and incomplete measurements is a central task in several image processing applications. In recent years, state-of-the-art reconstruction methods have been developed based on recent advances in deep learning. Especially for highly underdetermined problems, maintaining data consistency is a key goal. This can be achieved either by iterative network architectures or by a subsequent projection of the network reconstruction. However, for such approaches to be used in safety-critical domains such as medical imaging, the network reconstruction should not only provide the user with a reconstructed image, but also with some level of confidence in the reconstruction. In order to meet these two key requirements, this paper combines deep null-space networks with uncertainty quantification. Evaluation of the proposed method includes image reconstruction from undersampled Radon measurements on a toy CT dataset and accelerated MRI reconstruction on the fastMRI datas …

Card 5 · Systems Aliasing in Dynamic Network Reconstruction: Issues on Low Sampling Frequencies

Network reconstruction of dynamical continuous-time (CT) systems is motivated by applications in many fields. Due to experimental limitations, especially in biology, data could be sampled at low frequencies, leading to significant challenges in network inference. We introduce the concept of "system…

Read full passage excerpt

Network reconstruction of dynamical continuous-time (CT) systems is motivated by applications in many fields. Due to experimental limitations, especially in biology, data could be sampled at low frequencies, leading to significant challenges in network inference. We introduce the concept of "system aliasing" and characterize the minimal sampling frequency that allows reconstruction of CT systems from low sampled data. A test criterion is also proposed to check whether system aliasing is presented. With no system aliasing, the paper provides an algorithm to reconstruct dynamic network from data in the presence of noise. In addition, when there is system aliasing we perform studies that add additional prior information of the system such as sparsity. This paper opens new directions in modelling of network systems where samples have significant costs. Such tools are essential to process the available data in applications subject to current experimental limitations.

Model-reported card use

Card 1 · fact

Affected output: Embedding methods designed for multiplex and multiplex-heterogeneous networks have been proposed to learn representations in such settings

Model explanation: This row supplied the concrete prior-work fact that embedding methods exist for multiplex and multiplex-heterogeneous networks, which the sentence uses as an attributed example.

No Evidence

Same model and position · no retrieved passages · first output

Not preferred in this comparison

No continuation text was produced.

Model action:complete

Earlier card-use comparison

The earlier diagnostic compared only cases with reported card use and text on both sides; its scope differs from the overall AI review above.

The with-card arm produced text and reported card use, but the no-card arm produced no text. This counts as reported use, without entering the two-text preference comparison.

The passages are input material; their presence does not mean an output used them or that they support every claim. Draft and source passages are excerpted; no simulated scores or PDF appear here.