← Back to all development cases
This case was judged by an anonymized AI reviewer and has not been independently reviewed by people; inspect the draft, cards, and both outputs to assess it.
AutocompleteWith cards better100 / 280 · beu-df1aa3395ce29787

Review on development of a scalable high-order nonhydrostatic multi-moment constrained finite volume dynamical core

Climate and environmental science · 2004.05784v1

FLOWING EVIDENCE BENCHMARK

How do we compare writing with and without cards?

At the same writing position, the same model produces one first result with cards and one without. All 280 pairs enter the overall anonymized review, which assesses whether a decision not to continue fits the draft.

Overall: 138 with-card wins, 26 ties, 107 no-card wins, 5 pairs where neither was usable, and 4 inconclusive judgments. Both sides wrote text in 218 pairs; 48 had a deliberate stop and 14 included an invalid output.

SAME DRAFT · WITH OR WITHOUT CARDS

01 · FIXED WRITING POSITION

MANUSCRIPT

Same writing position ▌

Matched autocomplete at the same draft position

02 · TWO MATCHED VERSIONS

SHARED BY BOTH

Draft, writing task, and generation model

A · With cards

Relevant literature cards supplied

B · Without cards

No literature cards supplied

Generation model

Same model and version

A → first output

B → first output

Anonymized AI judge

First outputs are anonymized as X and Y

Continuation review: accuracy, fit to the writing task and usability
Returns: X preferred / tie / Y preferred / both unusable

Review again with the answer order swapped

HOW DOES BLIND JUDGING WORK?

① Anonymize both outputs
The AI judge sees the same draft and both first outputs without knowing which received cards.

② Compare and swap order
The judge applies task-specific criteria in X/Y and then Y/X order.

③ Review disagreements
A third pass resolves disagreements. Incomplete reviews remain in the denominator.

How are positions and cards selected?

We selected 40 writing positions in each of seven fields, for 280 comparisons. The position and relevant literature cards were set before each comparison, so both versions began from the same draft.

The main result retains every frozen position, including places where cards might not add a useful next move. This avoids selecting cases based on their outputs, but 49% describes the whole cohort, not a win rate where evidence clearly had an opportunity to help. This cohort did not record that opportunity label for each position before generation, so those two groups cannot yet be separated reliably.

CARD USE · 140/280

Reported card use in continuations with text

The model reports whether a card affected its continuation. In 140 of 280 tests it produced continuation text and reported card use. The previous count of 150 included 10 cases without continuation text and has been corrected.

COMPARISON · 70 / 7 / 30

Which written version was better?

Of the 107 reported-use cases where both versions produced text, the blinded AI judge preferred the with-card version 70 times, found 7 about the same, and preferred the without-card version 30 times.

How are the two table percentages calculated?

ADOPTION COVERAGE

140reported use with text
÷
280all positions
=
50%

WITH-CARD VERSION PREFERRED

70with cards better
÷
107comparable tests
=
65%

The percentages use different groups: 50% counts continuations with text reporting card use among all 280 tests; 65% covers the 107 such cases with text on both sides. The generating model reports card use, while an anonymized AI judge compares writing quality.

Card use is self-reported by the generator. The anonymized AI judge sees the draft and source snippets, so source-aware preference remains possible; there was no independent human review. The overall result describes these 280 frozen positions, not a win probability for any writing task.

Manuscript writing position

Text excerpt · not a PDF page

Research manuscript · excerpt

Review on development of a scalable high-order nonhydrostatic multi-moment constrained finite volume dynamical core

7 Summary and future works

… The multi-moment finite volume method is a numerical framework lies between the conventional finite volume methods and other high-order methods using local spectrum-like reconstructions, such as DG (discontinuous Galerkin) and SE (spectral element) methods. It well balances among different requirements, such as solution quality, robustness, computational efficiency, parallelization, flexibility and adaptibility to different model configurations, and thus provides a very promising platform of great practical significance and potential to construct next generation atmospheric and oceanic GCMs.

…uniform spherical grids and nonhydrostatic compressible atmospheric flow have been developed. These models have been systematically and extensively verified by widely used bechmark tests. All numerical results justify that the MCV-based models have competitive numerical accuracy and efficiency in comparison to other existing numerical models. The 3D prototype of global nonhydrostatic compressible atmospheric model has been also developed by using the IMEX/HEVI time integration scheme as the base to develop a scalable high-order dynamic core for weather and climate predictions and simulations.

Next, we will focus on developing continuously the fully compressible nonhydrostatic atmospheric MCV dynamical cores on cubed sphere grid in presence

↓ Next paragraph was generated here

The highlighted text is near the writing position. This is a layout of the evaluation input, not a PDF screenshot.

A matched comparison at the same writing positionOverall AI review: With cards better

Both arms use the same model, task and manuscript context. Only the retrieved passages differ. The first recorded output from each arm is shown below.

Read overall AI review rationale

A = with cards · B = without cards

The draft sentence is clearly incomplete, ending with 'in presence' which grammatically and substantively demands a completion. Both outputs provide completions, but Output A is far superior in fit and specificity. Output A continues with 'of the IMEX/HEVI time integration strategy, which treats the fast acoustic and gravity wave modes implicitly while advancing the slower advective terms explicitly.' This precisely matches the technical context: (1) 'IMEX/HEVI' directly connects to the sources about nonhydrostatic dynamical cores on cubed sphere grids, where HEVI (Horizontal Explicit and Vertical Implicit) and IMEX Runge-Kutta schemes are specifically used to address CFL restrictions from small vertical grid spacing; (2) the description of treating fast acoustic/gravity waves implicitly while advective terms are explicit accurately reflects the numerical challenge and solution described in the HOMME-NH and multi-moment finite volume papers; (3) 'in presence of [the IMEX/HEVI strategy]' is grammatically coherent and completes the sentence's intended meaning about what development will occur in the presence of. Output B continues with 'of more realistic physical parameterizations and refined grid resolutions, with the aim of improving...' While grammatically completing 'in presence of,' this is vague and generic—'physical parameterizations' and 'refined grid resolutions' are boilerplate atmospheric modeling goals that don't specifically address what 'presence' refers to in this technical context. The draft emphasizes 'developing continuously the fully compressible nonhydrostatic atmospheric MCV dynamical cores on cubed sphere grid'—a specific numerical/algorithmic focus. Output B drifts toward general model improvement aims rather than the specific numerical infrastructure (time integration strategy) that enables such cores to function. The phrase 'in presence of more realistic physical parameterizations' is also somewhat awkward semantically—one develops cores 'with' or 'including' parameterizations, not typically 'in presence of' them. Output A requires no repair and advances the precise technical argument; Output B is usable but less accurate in scope and fit.

Evidence

Same model and position · retrieved passages supplied · first output

Preferred by blind review

of the IMEX/HEVI time integration strategy, which treats the fast acoustic and gravity wave modes implicitly while advancing the slower advective terms explicitly.

Passages supplied to the Evidence version

Card 1 · IMEX based multi‐scale time advancement in ODTLES

Abstract In this paper we overcome a key problem in an otherwise highly potential approach to study turbulent flows, ODTLES (One‐Dimensional Turbulence Large Eddy Simulation). From a methodological point of view, ODTLES is an approach in between Direct Numerical Simulations (DNS) and averaged/filter…

Read full passage excerpt

Abstract In this paper we overcome a key problem in an otherwise highly potential approach to study turbulent flows, ODTLES (One‐Dimensional Turbulence Large Eddy Simulation). From a methodological point of view, ODTLES is an approach in between Direct Numerical Simulations (DNS) and averaged/filtered approaches like RANS (Reynolds Averaged Navier‐Stokes) or LES (Large Eddy Simulations). In ODTLES, a set of 1D ODT models is embedded in a coarse grained 3D LES. On the ODT scale, the turbulent advection is modeled as a sequence of stochastic eddy events, also known as triplet maps, while the other (deterministic) terms are fully resolved in space (along the ODT‐line) and time. Schmidt et al. first (2008) introduced ODTLES and Gonzalez et al. (2011) applied the model for a variety of wall‐bounded flow problems. Although the results were notable for a first proof of concept, the numerical methods used are subject to debate. First of all, an unstable discretization for the large scale 3D ad …

Card 2 · A global nonhydrostatic dynamical core on cubed sphere using multi-moment finite volume method: formulation and preliminary test

A nonhydrostatic dynamical core has been developed by using the multi-moment finite volume method that ensures the rigorous numerical conservation. To represent the spherical geometry free of polar problems, the cubed-sphere grid is adopted. A fourth-order multi-moment discretization formulation is…

Read full passage excerpt

A nonhydrostatic dynamical core has been developed by using the multi-moment finite volume method that ensures the rigorous numerical conservation. To represent the spherical geometry free of polar problems, the cubed-sphere grid is adopted. A fourth-order multi-moment discretization formulation is applied to the nonhydrostatic governing equations cast in local curvilinear coordinates on each patch of cubed sphere through a gnomonic projection. In vertical direction, the height-based terrain-following grid is used to represent the topography. To get around the CFL stability restriction imposed by relatively small grid spacing in the vertical direction, the dimensional-splitting time integration using the HEVI (Horizontal Explicit and Vertical Implicit) strategy is implemented by applying the IMEX Runge-Kutta scheme. The proposed dynamical core preserves the fourth-order accuracy in spherical geometry and has been verified by the widely-used benchmark tests. The results of our numerical …

Card 3 · Evaluation of Implicit‐Explicit Additive Runge‐Kutta Integrators for the HOMME‐NH Dynamical Core

Abstract The nonhydrostatic High‐Order Method Modeling Environment (HOMME‐NH) atmospheric dynamical core supports acoustic waves that propagate significantly faster than the advective wind speed, thus greatly limiting the time step size that can be used with standard explicit time integration method…

Read full passage excerpt

Abstract The nonhydrostatic High‐Order Method Modeling Environment (HOMME‐NH) atmospheric dynamical core supports acoustic waves that propagate significantly faster than the advective wind speed, thus greatly limiting the time step size that can be used with standard explicit time integration methods. Resolving acoustic waves is unnecessary for accurate climate and weather prediction. This numerical stiffness is addressed herein by considering implicit‐explicit additive Runge‐Kutta (ARK IMEX) methods that can treat the acoustic waves in a stable manner without requiring implicit treatment of nonstiff modes. Various ARK IMEX methods are evaluated for their efficiency in producing accurate solutions, ability to take large time step sizes, and sensitivity to grid cell length ratio. Both the gravity wave test and baroclinic instability test from the 2012 Dynamical Core Model Intercomparison Project are used to recommend 5 of the 27 ARK IMEX methods tested for use in HOMME‐NH.

Card 4 · A Discontinuous Galerkin Time-Domain Method With Dynamically Adaptive Cartesian Mesh for Computational Electromagnetics

A discontinuous Galerkin time-domain (DGTD) method based on dynamically adaptive Cartesian mesh (ACM) is developed for a full-wave analysis of electromagnetic (EM) fields. The benefits of hierarchical Cartesian grids and adaptive mesh refinement are demonstrated for linear EM propagation problems. T…

Read full passage excerpt

A discontinuous Galerkin time-domain (DGTD) method based on dynamically adaptive Cartesian mesh (ACM) is developed for a full-wave analysis of electromagnetic (EM) fields. The benefits of hierarchical Cartesian grids and adaptive mesh refinement are demonstrated for linear EM propagation problems. The developed DGTD-ACM achieves a desired accuracy by refining nonconformal meshes near material interfaces to reduce stair-casing errors without sacrificing the high efficiency afforded with uniform Cartesian meshes. More importantly, DGTD-ACM can dynamically refine the mesh to resolve the local variation of the fields during propagation of EM pulses. A local time-stepping scheme is adopted to alleviate the constraint on the time-step size due to the stability condition of the explicit time integration. It is shown by numerical examples that the proposed method can achieve a good numerical accuracy and reduce the computational time effectively for linear problems of EM propagation in dispers …

Card 5 · Fast IMEX Time Integration of Nonlinear Stiff Fractional Differential Equations

Efficient long-time integration of nonlinear fractional differential equations is significantly challenging due to the integro-differential nature of the fractional operators. In addition, the inherent non-smoothness introduced by the inverse power-law kernels deteriorates the accuracy and efficienc…

Read full passage excerpt

Efficient long-time integration of nonlinear fractional differential equations is significantly challenging due to the integro-differential nature of the fractional operators. In addition, the inherent non-smoothness introduced by the inverse power-law kernels deteriorates the accuracy and efficiency of many existing numerical methods. We develop two efficient first- and second-order implicit-explicit (IMEX) methods for accurate time-integration of stiff/nonlinear fractional differential equations with fractional order $α\in (0,1]$ and prove their convergence and linear stability properties. The developed methods are based on a linear multi-step fractional Adams-Moulton method (FAMM), followed by the extrapolation of the nonlinear force terms. In order to handle the singularities nearby the initial time, we employ Lubich-like corrections to the resulting fractional operators. The obtained linear stability regions of the developed IMEX methods are larger than existing IMEX methods in th …

Model-reported card use

Card 2 · terminology

Affected output: IMEX/HEVI time integration strategy

Model explanation: Supplied the field-native pairing of IMEX with the HEVI strategy as the name for the time integration approach being adopted.

Card 3 · fact

Affected output: treats the fast acoustic and gravity wave modes implicitly while advancing the slower advective terms explicitly

Model explanation: Establishes that acoustic modes are the fast, stiffness-inducing waves relative to advective transport, licensing the implicit-fast/explicit-slow split described in the sentence.

No Evidence

Same model and position · no retrieved passages · first output

Not preferred in this comparison

of more realistic physical parameterizations and refined grid resolutions, with the aim of improving the representation of multi-scale atmospheric processes in global weather and climate models.

Earlier card-use comparison

The earlier diagnostic compared only cases with reported card use and text on both sides; its scope differs from the overall AI review above.

The blinded model review preferred the Evidence version. Its original rationale appears below.

Read the original model judgment

Output A is grounded in the draft and sources. The draft mentions 'fully compressible nonhydrostatic atmospheric MCV dynamical cores on cubed sphere grid' — the source 'A global nonhydrostatic dynamical core on cubed sphere using multi-moment finite volume method' explicitly discusses nonhydrostatic dynamical cores on cubed sphere grids using IMEX Runge-Kutta with HEVI (Horizontal Explicit and Vertical Implicit) strategy to handle CFL restrictions from vertical grid spacing. The source 'Evaluation of Implicit-Explicit Additive Runge-Kutta Integrators for the HOMME-NH Dynamical Core' also discusses IMEX methods for nonhydrostatic dynamical cores treating acoustic waves implicitly while advective terms remain explicit. The completion 'of the IMEX/HEVI time integration strategy, which treats the fast acoustic and gravity wave modes implicitly while advancing the slower advective terms explicitly' directly continues the sentence with content well-supported by these sources. Output B adds 'more realistic physical parameterizations and refined grid resolutions, with the aim of improving the representation of multi-scale atmospheric processes in global weather and climate models.' None of the sources mention 'physical parameterizations,' 'refined grid resolutions,' or 'multi-scale atmospheric processes in global weather and climate models' as aims of this specific work. The source about the global nonhydrostatic dynamical core mentions 'A new unified model for numerical weather prediction and global atmospheric circulation simulation based on this dynamical core is under development' — but this is stated as future work for that specific model, not as the aim of 'developing continuously the fully compressible nonhydrostatic atmospheric MCV dynamical cores.' The phrase 'MCV' (Multi-Conservation/Constrained Version or similar specific scheme) in the draft does not appear in any source, and the sources do not support the claim that the aim is improving 'multi-scale atmospheric processes' through 'physical parameterizations.' This is an unsupported extrapolation about purpose and scope that goes beyond what the sources establish.

The passages are input material; their presence does not mean an output used them or that they support every claim. Draft and source passages are excerpted; no simulated scores or PDF appear here.