FlowingFlowing
← Back to all development cases
This case was judged by an anonymized AI reviewer and has not been independently reviewed by people; inspect the draft, cards, and both outputs to assess it.
AutocompleteWith cards better55 / 280 · beu-634ee62b29fe9831

Quantum Computational Complexity -- From Quantum Information to Black Holes and Back

Astrophysics · 2110.14672v1

FLOWING EVIDENCE BENCHMARK

How do we compare writing with and without cards?

At the same writing position, the same model produces one first result with cards and one without. All 280 pairs enter the overall anonymized review, which assesses whether a decision not to continue fits the draft.

Overall: 138 with-card wins, 26 ties, 107 no-card wins, 5 pairs where neither was usable, and 4 inconclusive judgments. Both sides wrote text in 218 pairs; 48 had a deliberate stop and 14 included an invalid output.

SAME DRAFT · WITH OR WITHOUT CARDS

01 · FIXED WRITING POSITION

MANUSCRIPT

Same writing position ▌

Matched autocomplete at the same draft position

02 · TWO MATCHED VERSIONS

SHARED BY BOTH

Draft, writing task, and generation model

A · With cards

Relevant literature cards supplied

B · Without cards

No literature cards supplied

Generation model

Same model and version

A → first output

B → first output

Anonymized AI judge

First outputs are anonymized as X and Y

Continuation review: accuracy, fit to the writing task and usability
Returns: X preferred / tie / Y preferred / both unusable

Review again with the answer order swapped

HOW DOES BLIND JUDGING WORK?

① Anonymize both outputs
The AI judge sees the same draft and both first outputs without knowing which received cards.

② Compare and swap order
The judge applies task-specific criteria in X/Y and then Y/X order.

③ Review disagreements
A third pass resolves disagreements. Incomplete reviews remain in the denominator.

How are positions and cards selected?

We selected 40 writing positions in each of seven fields, for 280 comparisons. The position and relevant literature cards were set before each comparison, so both versions began from the same draft.

The main result retains every frozen position, including places where cards might not add a useful next move. This avoids selecting cases based on their outputs, but 49% describes the whole cohort, not a win rate where evidence clearly had an opportunity to help. This cohort did not record that opportunity label for each position before generation, so those two groups cannot yet be separated reliably.

CARD USE · 140/280

Reported card use in continuations with text

The model reports whether a card affected its continuation. In 140 of 280 tests it produced continuation text and reported card use. The previous count of 150 included 10 cases without continuation text and has been corrected.

COMPARISON · 70 / 7 / 30

Which written version was better?

Of the 107 reported-use cases where both versions produced text, the blinded AI judge preferred the with-card version 70 times, found 7 about the same, and preferred the without-card version 30 times.

How are the two table percentages calculated?

ADOPTION COVERAGE

140reported use with text
÷
280all positions
=
50%

WITH-CARD VERSION PREFERRED

70with cards better
÷
107comparable tests
=
65%

The percentages use different groups: 50% counts continuations with text reporting card use among all 280 tests; 65% covers the 107 such cases with text on both sides. The generating model reports card use, while an anonymized AI judge compares writing quality.

Card use is self-reported by the generator. The anonymized AI judge sees the draft and source snippets, so source-aware preference remains possible; there was no independent human review. The overall result describes these 280 frozen positions, not a win probability for any writing task.

Manuscript writing position

Text excerpt · not a PDF page

Research manuscript · excerpt

Quantum Computational Complexity -- From Quantum Information to Black Holes and Back

1 Introduction

… complexity for generic quantum systems; in particular, we focus on Gaussian states in QFT, both pure and mixed, and on certain classes of CFT states. We then present the conjectured relation to gravitational quantities within the holographic correspondence and discuss several examples in which different versions of the conjectures have been tested. We highlight the relation between complexity, chaos and scrambling in chaotic systems. We conclude with a discussion of open problems and future directions. This article was written for the special issue of EPJ-C Frontiers in Holographic Duality .

… hole. The discovery of the AdS/CFT correspondence – the observation that certain gauge theories are equivalent (or “dual”) to gravitational theories in one higher dimension (see e.g., [ 3 , 4 ] ) – enabled putting the relation between gravity and information on firm ground. Specifically, it permitted Ryu and Takayanagi (RT) to formulate a proposal [ 5 ] (later proven by [ 6 ] ) that relates the entanglement entropy – a quantity characterizing quantum correlations between two regions in conformal field theory (CFT) – and areas of minimal surfaces in asymptotically anti-de Sitter (AdS) spaces.

The RT proposal was the starting point for many interesting developments. It was used to study entanglement in

↓ Next paragraph was generated here

The highlighted text is near the writing position. This is a layout of the evaluation input, not a PDF screenshot.

A matched comparison at the same writing positionOverall AI review: With cards better

Both arms use the same model, task and manuscript context. Only the retrieved passages differ. The first recorded output from each arm is shown below.

Read overall AI review rationale

A = with cards · B = without cards

Both outputs provide grammatically correct and topically relevant continuations of the sentence about the RT (Ryu-Takayanagi) proposal. However, Output A is substantially more useful and precise. The draft mentions 'many interesting developments,' and Output A delivers on this by specifying two major, well-documented applications: (1) studying entanglement in strongly coupled systems where perturbative methods fail, and (2) using entanglement entropy scaling to characterize quantum phase transitions. Both applications are strongly supported by the sources, which mention that AdS/CFT relates 'physical observables in strongly coupled quantum many-body systems to certain classical quantities in gravity' and that entanglement entropy can be used 'to study various phase transitions by regarding the entanglement entropy as order parameters.' Output B, while not incorrect, is notably less informative: 'various holographic setups, including black holes and quantum quenches' is vague ('various holographic setups' is redundant given the context) and 'quantum quenches' are not mentioned in any source. The phrase 'including black holes' is somewhat misleading—the RT proposal concerns minimal surfaces in AdS, not black holes directly (though black hole entropy is mentioned as a conceptual parallel). Output A's broader scope and stronger connection to the documented applications of holographic entanglement entropy make it the more useful continuation.

Evidence

Same model and position · retrieved passages supplied · first output

Preferred by blind review

strongly coupled quantum field theories, where conventional perturbative methods are unavailable, and to characterize phases of matter through the scaling of entanglement entropy across quantum phase transitions.

Passages supplied to the Evidence version

Card 1 · Holographic Derivation of Entanglement Entropy from the anti–de Sitter Space/Conformal Field Theory Correspondence

A holographic derivation of the entanglement entropy in quantum (conformal) field theories is proposed from anti-de Sitter/conformal field theory (AdS/CFT) correspondence. We argue that the entanglement entropy in d + 1 dimensional conformal field theories can be obtained from the area of d dimensio…

Read full passage excerpt

A holographic derivation of the entanglement entropy in quantum (conformal) field theories is proposed from anti-de Sitter/conformal field theory (AdS/CFT) correspondence. We argue that the entanglement entropy in d + 1 dimensional conformal field theories can be obtained from the area of d dimensional minimal surfaces in AdS(d+2), analogous to the Bekenstein-Hawking formula for black hole entropy. We show that our proposal agrees perfectly with the entanglement entropy in 2D CFT when applied to AdS(3). We also compare the entropy computed in AdS(5)XS(5) with that of the free N=4 super Yang-Mills theory.

Card 2 · Holographic entanglement entropy: an overview

In this paper, we review recent progress on the holographic understanding of the entanglement entropy in the anti-de Sitter space/conformal field theory (AdS/CFT) correspondence. In general, the AdS/CFT relates physical observables in strongly coupled quantum many-body systems to certain classical q…

Read full passage excerpt

In this paper, we review recent progress on the holographic understanding of the entanglement entropy in the anti-de Sitter space/conformal field theory (AdS/CFT) correspondence. In general, the AdS/CFT relates physical observables in strongly coupled quantum many-body systems to certain classical quantities in gravity plus matter theories. In the case of our holographic entanglement entropy, its gravity dual turns out to be purely geometric, i.e. the area of minimal area surfaces in AdS spaces. One interesting application is to study various phase transitions by regarding the entanglement entropy as order parameters. Indeed we will see that our holographic calculations nicely reproduce the confinement/deconfinement transition. Our results can also be applied to understanding the microscopic origins of black hole entropy.

Card 3 · Entanglement entropy of spherical domains in anti-de Sitter space

It was proposed by Ryu and Takayanagi that the entanglement entropy in conformal field theory (CFT) is related through AdS/CFT correspondence to the area of a minimal surface in the bulk. We apply this holographic geometrical method of calculation of the entanglement entropy to study the vacuum case…

Read full passage excerpt

It was proposed by Ryu and Takayanagi that the entanglement entropy in conformal field theory (CFT) is related through AdS/CFT correspondence to the area of a minimal surface in the bulk. We apply this holographic geometrical method of calculation of the entanglement entropy to study the vacuum case of CFT which is holographically dual to empty anti-de Sitter (AdS) spacetime. We present all possible minimal surfaces spanned on one or two spherical boundaries at AdS infinity. We give exact analytical expressions for regularized areas of these surfaces and identify finite renormalized quantities.

Card 4 · Minimal surfaces and entanglement entropy in anti-de Sitter space

According to Ryu and Takayanagi, the entanglement entropy in conformal field theory (CFT) is related through the AdS/CFT correspondence to the area of a minimal surface in the bulk. We study this holographic geometrical method of calculating the entanglement entropy in the vacuum case of a CFT which…

Read full passage excerpt

According to Ryu and Takayanagi, the entanglement entropy in conformal field theory (CFT) is related through the AdS/CFT correspondence to the area of a minimal surface in the bulk. We study this holographic geometrical method of calculating the entanglement entropy in the vacuum case of a CFT which is holographically dual to empty anti-de Sitter (AdS) spacetime. Namely, we investigate the minimal surfaces spanned on boundaries of spherical domains at infinity of hyperbolic space, which represents a time-slice of AdS spacetime. We consider a generic position of two spherical domains: two disjoint domains, overlapping domains, and touching domains. All these cases are treated in a unified way. We find exact expressions in a closed form for the minimal surfaces and the renormalized expression for the area. We study also the embedding of the minimal surfaces into full AdS spacetime and we find that for a proper choice of the static Killing vector we can model a dynamical situation of “tea …

Card 5 · New holographic generalization of entanglement entropy

We introduce a new quantity, called pseudo-entropy, as a generalization of entanglement entropy via postselection. We expect this quantity to provide a new class of order parameters in quantum many-body systems. In the anti--de Sitter space (AdS)/conformal field theory (CFT) correspondence, this qua…

Read full passage excerpt

We introduce a new quantity, called pseudo-entropy, as a generalization of entanglement entropy via postselection. We expect this quantity to provide a new class of order parameters in quantum many-body systems. In the anti--de Sitter space (AdS)/conformal field theory (CFT) correspondence, this quantity is dual to areas of minimal area surfaces in time-dependent Euclidean spaces which are asymptotically AdS. We call this geometric computation of pseudo-entropy via the $\mathrm{AdS}/\mathrm{CFT}$ the holographic pseudo-entropy. We study its basic properties and classifications in qubit systems. In specific examples, we provide a quantum information theoretic meaning of this new quantity as an averaged number of Bell pairs when the post-selection is performed. We also present properties of the pseudo-entropy for random states. We then calculate the pseudo-entropy in the presence of local operator excitations for both the two dimensional free massless scalar CFT and two dimensional holog …

Model-reported card use

Card 2 · fact

Affected output: strongly coupled quantum field theories

Model explanation: This row supplied the fact that the holographic framework applies to strongly coupled systems, which shaped the claim about where the RT proposal was applied.

Card 2 · fact

Affected output: to characterize phases of matter through the scaling of entanglement entropy across quantum phase transitions

Model explanation: This row supplied the specific application of entanglement entropy as an order parameter for phase transitions, which determined the second half of the continuation.

No Evidence

Same model and position · no retrieved passages · first output

Not preferred in this comparison

various holographic setups, including black holes and quantum quenches.

Earlier card-use comparison

The earlier diagnostic compared only cases with reported card use and text on both sides; its scope differs from the overall AI review above.

The blinded model review preferred the no-Evidence version. Its original rationale appears below.

Read the original model judgment

Output A contains unsupported claims. The sources discuss using holographic entanglement entropy to study phase transitions (source 2 mentions 'confinement/deconfinement transition'), but the specific claims that RT was used 'to characterize phases of matter through the scaling of entanglement entropy across quantum phase transitions' and specifically 'where conventional perturbative methods are unavailable' introduce details not directly supported. The 'quantum phase transitions' framing and 'phases of matter' language go beyond the 'confinement/deconfinement transition' mentioned in source 2, and 'conventional perturbative methods are unavailable' extrapolates from general AdS/CFT duality descriptions without direct source support for this specific application of RT. Output B's 'various holographic setups, including black holes and quantum quenches' is more conservative: source 2 explicitly mentions 'microscopic origins of black hole entropy' and source 3-4 discuss vacuum AdS cases. While 'quantum quenches' is not explicitly in snippets, the sources do discuss time-dependent situations and dynamical scenarios ('tearing' of minimal surfaces when domains move). More importantly, B's claims are closer to source-supported territory without adding unsupported specifics about perturbative methods or quantum phase transitions. Both are grammatical continuations, but A's additional claims about characterization methodology and perturbative limitations lack direct source grounding.

The passages are input material; their presence does not mean an output used them or that they support every claim. Draft and source passages are excerpted; no simulated scores or PDF appear here.