FlowingFlowing
← Back to all development cases
This case was judged by an anonymized AI reviewer and has not been independently reviewed by people; inspect the draft, cards, and both outputs to assess it.
AutocompleteWithout cards better187 / 280 · beu-8b1404ec57fa37ff

Status and perspectives of Continuous Gravitational Wave searches

Astrophysics · 2202.01088v3

FLOWING EVIDENCE BENCHMARK

How do we compare writing with and without cards?

At the same writing position, the same model produces one first result with cards and one without. All 280 pairs enter the overall anonymized review, which assesses whether a decision not to continue fits the draft.

Overall: 138 with-card wins, 26 ties, 107 no-card wins, 5 pairs where neither was usable, and 4 inconclusive judgments. Both sides wrote text in 218 pairs; 48 had a deliberate stop and 14 included an invalid output.

SAME DRAFT · WITH OR WITHOUT CARDS

01 · FIXED WRITING POSITION

MANUSCRIPT

Same writing position ▌

Matched autocomplete at the same draft position

02 · TWO MATCHED VERSIONS

SHARED BY BOTH

Draft, writing task, and generation model

A · With cards

Relevant literature cards supplied

B · Without cards

No literature cards supplied

Generation model

Same model and version

A → first output

B → first output

Anonymized AI judge

First outputs are anonymized as X and Y

Continuation review: accuracy, fit to the writing task and usability
Returns: X preferred / tie / Y preferred / both unusable

Review again with the answer order swapped

HOW DOES BLIND JUDGING WORK?

① Anonymize both outputs
The AI judge sees the same draft and both first outputs without knowing which received cards.

② Compare and swap order
The judge applies task-specific criteria in X/Y and then Y/X order.

③ Review disagreements
A third pass resolves disagreements. Incomplete reviews remain in the denominator.

How are positions and cards selected?

We selected 40 writing positions in each of seven fields, for 280 comparisons. The position and relevant literature cards were set before each comparison, so both versions began from the same draft.

The main result retains every frozen position, including places where cards might not add a useful next move. This avoids selecting cases based on their outputs, but 49% describes the whole cohort, not a win rate where evidence clearly had an opportunity to help. This cohort did not record that opportunity label for each position before generation, so those two groups cannot yet be separated reliably.

CARD USE · 140/280

Reported card use in continuations with text

The model reports whether a card affected its continuation. In 140 of 280 tests it produced continuation text and reported card use. The previous count of 150 included 10 cases without continuation text and has been corrected.

COMPARISON · 70 / 7 / 30

Which written version was better?

Of the 107 reported-use cases where both versions produced text, the blinded AI judge preferred the with-card version 70 times, found 7 about the same, and preferred the without-card version 30 times.

How are the two table percentages calculated?

ADOPTION COVERAGE

140reported use with text
÷
280all positions
=
50%

WITH-CARD VERSION PREFERRED

70with cards better
÷
107comparable tests
=
65%

The percentages use different groups: 50% counts continuations with text reporting card use among all 280 tests; 65% covers the 107 such cases with text on both sides. The generating model reports card use, while an anonymized AI judge compares writing quality.

Card use is self-reported by the generator. The anonymized AI judge sees the draft and source snippets, so source-aware preference remains possible; there was no independent human review. The overall result describes these 280 frozen positions, not a win probability for any writing task.

Manuscript writing position

Text excerpt · not a PDF page

Research manuscript · excerpt

Status and perspectives of Continuous Gravitational Wave searches

1 Introduction

…ompact binary coalescence signals are not the only type of gravitational waves potentially detectable by LIGO, Virgo, and KAGRA. An interesting family of still undetected signals, and the ones that are considered in this review, are the so-called continuous waves, paradigmatically exemplified by the gravitational radiation emitted by galactic, fast-spinning isolated neutron stars with a certain degree of asymmetry in their mass distribution. In this work, I will review the status and the latest results from the analyses of advanced detector data, including searches for dark matter signatures.

↓ Next paragraph was generated here

The highlighted text is near the writing position. This is a layout of the evaluation input, not a PDF screenshot.

A matched comparison at the same writing positionOverall AI review: Without cards better

Both arms use the same model, task and manuscript context. Only the retrieved passages differ. The first recorded output from each arm is shown below.

Read overall AI review rationale

A = without cards · B = with cards

Both outputs are usable continuations, but they serve different rhetorical purposes at this position. The draft has just introduced continuous waves as the topic of the review, mentioned they come from fast-spinning isolated neutron stars with mass asymmetry, and stated the author will review status, latest results, and dark matter searches. Output A provides a structural roadmap ('The review is organized as follows...') that directly follows this introductory framing and sets up the reader for what comes next. This is a natural and expected move in a review article introduction. Output B restates the physics of continuous wave emission (already covered in the preceding sentence) and adds a claim about equation of state information that, while plausible, slightly drifts toward advocacy rather than moving the argument forward. The draft already established what continuous waves are; it doesn't need to re-explain the emission mechanism. Output A better advances the manuscript by making a clear, necessary organizational move that fits the review genre.

Evidence

Same model and position · retrieved passages supplied · first output

Not preferred in this comparison

Continuous gravitational waves are expected to be emitted by rapidly rotating, non-axisymmetric neutron stars, and their detection would provide direct information on the internal structure and equation of state of these compact objects.

Passages supplied to the Evidence version

Card 1 · Prospects for observing and localizing gravitational-wave transients with Advanced LIGO, Advanced Virgo and KAGRA

We present our current best estimate of the plausible observing scenarios for the Advanced LIGO, Advanced Virgo and KAGRA gravitational-wave detectors over the next several years, with the intention of providing information to facilitate planning for multi-messenger astronomy with gravitational wave…

Read full passage excerpt

We present our current best estimate of the plausible observing scenarios for the Advanced LIGO, Advanced Virgo and KAGRA gravitational-wave detectors over the next several years, with the intention of providing information to facilitate planning for multi-messenger astronomy with gravitational waves. We estimate the sensitivity of the network to transient gravitational-wave signals for the third (O3), fourth (O4) and fifth observing (O5) runs, including the planned upgrades of the Advanced LIGO and Advanced Virgo detectors. We study the capability of the network to determine the sky location of the source for gravitational-wave signals from the inspiral of binary systems of compact objects, that is binary neutron star, neutron star–black hole, and binary black hole systems. The ability to localize the sources is given as a sky-area probability, luminosity distance, and comoving volume. The median sky localization area (90% credible region) is expected to be a few hundreds of square de …

Card 2 · Narrowband Searches for Continuous and Long-duration Transient Gravitational Waves from Known Pulsars in the LIGO-Virgo Third Observing Run

Abstract Isolated neutron stars that are asymmetric with respect to their spin axis are possible sources of detectable continuous gravitational waves. This paper presents a fully coherent search for such signals from eighteen pulsars in data from LIGO and Virgo’s third observing run (O3). For known…

Read full passage excerpt

Abstract Isolated neutron stars that are asymmetric with respect to their spin axis are possible sources of detectable continuous gravitational waves. This paper presents a fully coherent search for such signals from eighteen pulsars in data from LIGO and Virgo’s third observing run (O3). For known pulsars, efficient and sensitive matched-filter searches can be carried out if one assumes the gravitational radiation is phase-locked to the electromagnetic emission. In the search presented here, we relax this assumption and allow both the frequency and the time derivative of the frequency of the gravitational waves to vary in a small range around those inferred from electromagnetic observations. We find no evidence for continuous gravitational waves, and set upper limits on the strain amplitude for each target. These limits are more constraining for seven of the targets than the spin-down limit defined by ascribing all rotational energy loss to gravitational radiation. In an additional se …

Card 3 · All-sky search for continuous gravitational waves from isolated neutron stars using Advanced LIGO and Advanced Virgo O3 data

We present results of an all-sky search for continuous gravitational waves which can be produced by spinning neutron stars with an asymmetry around their rotation axis, using data from the third observing run of the Advanced LIGO and Advanced Virgo detectors. Four different analysis methods are used…

Read full passage excerpt

We present results of an all-sky search for continuous gravitational waves which can be produced by spinning neutron stars with an asymmetry around their rotation axis, using data from the third observing run of the Advanced LIGO and Advanced Virgo detectors. Four different analysis methods are used to search in a gravitational-wave frequency band from 10 to 2048 Hz and a first frequency derivative from $\ensuremath{-}{10}^{\ensuremath{-}8}$ to ${10}^{\ensuremath{-}9}\text{ }\text{ }\mathrm{Hz}/\mathrm{s}$. No statistically significant periodic gravitational-wave signal is observed by any of the four searches. As a result, upper limits on the gravitational-wave strain amplitude ${h}_{0}$ are calculated. The best upper limits are obtained in the frequency range of 100 to 200 Hz and they are $\ensuremath{\sim}1.1\ifmmode\times\else\texttimes\fi{}{10}^{\ensuremath{-}25}$ at 95% confidence level. The minimum upper limit of $1.10\ifmmode\times\else\texttimes\fi{}{10}^{\ensuremath{-}25}$ is …

Card 4 · Probing gravitational wave polarizations with Advanced LIGO, Advanced Virgo, and KAGRA

Assuming that, for a given source of gravitational waves (GWs), we know its sky position, as is the case for GW events with an electromagnetic counterpart such as GW170817, we discuss a null stream method to probe GW polarizations including spin-0 (scalar) GW modes and spin-1 (vector) modes, especia…

Read full passage excerpt

Assuming that, for a given source of gravitational waves (GWs), we know its sky position, as is the case for GW events with an electromagnetic counterpart such as GW170817, we discuss a null stream method to probe GW polarizations including spin-0 (scalar) GW modes and spin-1 (vector) modes, especially with an expected network of Advanced LIGO, Advanced Virgo, and KAGRA. For two independent null streams for four noncoaligned GW detectors, we study a location on the sky, exactly at which the spin-0 modes of GWs vanish in any null stream for the GW detector network, though the strain output at a detector may contain the spin-0 modes. Our numerical calculations show that there exist 70 sky positions that satisfy this condition of killing the spin-0 modes in the null streams. If a GW source with an electromagnetic counterpart is found in one of the 70 sky positions, the spin-1 modes will be testable separately from the spin-0 modes by the null stream method. In addition, we study a superpo …

Card 5 · All-sky search for continuous gravitational waves from isolated neutron stars in the early O3 LIGO data

We report on an all-sky search for continuous gravitational waves in the frequency band 20--2000 Hz and with a frequency time derivative in the range of $[\ensuremath{-}1.0,+0.1]\ifmmode\times\else\texttimes\fi{}{10}^{\ensuremath{-}8}\text{ }\text{ }\mathrm{Hz}/\mathrm{s}$. Such a signal could be pr…

Read full passage excerpt

We report on an all-sky search for continuous gravitational waves in the frequency band 20--2000 Hz and with a frequency time derivative in the range of $[\ensuremath{-}1.0,+0.1]\ifmmode\times\else\texttimes\fi{}{10}^{\ensuremath{-}8}\text{ }\text{ }\mathrm{Hz}/\mathrm{s}$. Such a signal could be produced by a nearby, spinning and slightly nonaxisymmetric isolated neutron star in our Galaxy. This search uses the LIGO data from the first six months of Advanced LIGO's and Advanced Virgo's third observational run, O3. No periodic gravitational wave signals are observed, and 95% confidence-level (C.L.) frequentist upper limits are placed on their strengths. The lowest upper limits on worst-case (linearly polarized) strain amplitude ${h}_{0}$ are $\ensuremath{\sim}1.7\ifmmode\times\else\texttimes\fi{}{10}^{\ensuremath{-}25}$ near 200 Hz. For a circularly polarized source (most favorable orientation), the lowest upper limits are $\ensuremath{\sim}6.3\ifmmode\times\else\texttimes\fi{}{10}^{\e …

Model-reported card use

Card 2 · fact

Affected output: Continuous gravitational waves are expected to be emitted by rapidly rotating, non-axisymmetric neutron stars

Model explanation: This row supplied the source premise that non-axisymmetric spinning neutron stars are candidate continuous-wave emitters, which the Draft had not yet stated explicitly.

Card 3 · terminology

Affected output: non-axisymmetric neutron stars

Model explanation: This row provided the field-native phrasing for the neutron-star asymmetry that generates continuous waves.

No Evidence

Same model and position · no retrieved passages · first output

Preferred by blind review

The review is organized as follows: I first summarize the main emission mechanisms and the expected signal properties of continuous-wave sources, then describe the analysis methods and the latest results obtained with advanced detector data, and finally discuss the prospects for future observations.

Earlier card-use comparison

The earlier diagnostic compared only cases with reported card use and text on both sides; its scope differs from the overall AI review above.

The blinded model review preferred the no-Evidence version. Its original rationale appears below.

Read the original model judgment

Both outputs are grounded and usable, but A better serves the autocomplete task. The draft explicitly states 'In this work, I will review the status and the latest results from the analyses of advanced detector data, including searches for dark matter signatures.' This sets up an expectation of a review paper structure. Output A directly continues this by providing the organizational structure of the review—summarizing emission mechanisms, describing analysis methods and latest results, and discussing future prospects—which naturally follows from the draft's self-description. Output B, while factually correct about continuous gravitational waves and neutron stars, largely restates information already present in the draft (fast-spinning isolated neutron stars with asymmetry emit continuous waves) without advancing the narrative. The draft already established what continuous waves are and that the paper will review results; Output A tells the reader how the review will proceed, which is the logical next step for a paragraph following the introduction's scope statement. Output A's content about 'latest results obtained with advanced detector data' also aligns with the sources provided, which discuss O3 data and upper limits from LIGO/Virgo searches.

The passages are input material; their presence does not mean an output used them or that they support every claim. Draft and source passages are excerpted; no simulated scores or PDF appear here.