FlowingFlowing
← Back to all development cases
This case was judged by an anonymized AI reviewer and has not been independently reviewed by people; inspect the draft, cards, and both outputs to assess it.
AutocompleteWith cards better82 / 280 · beu-07fedd1abe12ecea

Review on development of a scalable high-order nonhydrostatic multi-moment constrained finite volume dynamical core

Climate and environmental science · 2004.05784v1

FLOWING EVIDENCE BENCHMARK

How do we compare writing with and without cards?

At the same writing position, the same model produces one first result with cards and one without. All 280 pairs enter the overall anonymized review, which assesses whether a decision not to continue fits the draft.

Overall: 138 with-card wins, 26 ties, 107 no-card wins, 5 pairs where neither was usable, and 4 inconclusive judgments. Both sides wrote text in 218 pairs; 48 had a deliberate stop and 14 included an invalid output.

SAME DRAFT · WITH OR WITHOUT CARDS

01 · FIXED WRITING POSITION

MANUSCRIPT

Same writing position ▌

Matched autocomplete at the same draft position

02 · TWO MATCHED VERSIONS

SHARED BY BOTH

Draft, writing task, and generation model

A · With cards

Relevant literature cards supplied

B · Without cards

No literature cards supplied

Generation model

Same model and version

A → first output

B → first output

Anonymized AI judge

First outputs are anonymized as X and Y

Continuation review: accuracy, fit to the writing task and usability
Returns: X preferred / tie / Y preferred / both unusable

Review again with the answer order swapped

HOW DOES BLIND JUDGING WORK?

① Anonymize both outputs
The AI judge sees the same draft and both first outputs without knowing which received cards.

② Compare and swap order
The judge applies task-specific criteria in X/Y and then Y/X order.

③ Review disagreements
A third pass resolves disagreements. Incomplete reviews remain in the denominator.

How are positions and cards selected?

We selected 40 writing positions in each of seven fields, for 280 comparisons. The position and relevant literature cards were set before each comparison, so both versions began from the same draft.

The main result retains every frozen position, including places where cards might not add a useful next move. This avoids selecting cases based on their outputs, but 49% describes the whole cohort, not a win rate where evidence clearly had an opportunity to help. This cohort did not record that opportunity label for each position before generation, so those two groups cannot yet be separated reliably.

CARD USE · 140/280

Reported card use in continuations with text

The model reports whether a card affected its continuation. In 140 of 280 tests it produced continuation text and reported card use. The previous count of 150 included 10 cases without continuation text and has been corrected.

COMPARISON · 70 / 7 / 30

Which written version was better?

Of the 107 reported-use cases where both versions produced text, the blinded AI judge preferred the with-card version 70 times, found 7 about the same, and preferred the without-card version 30 times.

How are the two table percentages calculated?

ADOPTION COVERAGE

140reported use with text
÷
280all positions
=
50%

WITH-CARD VERSION PREFERRED

70with cards better
÷
107comparable tests
=
65%

The percentages use different groups: 50% counts continuations with text reporting card use among all 280 tests; 65% covers the 107 such cases with text on both sides. The generating model reports card use, while an anonymized AI judge compares writing quality.

Card use is self-reported by the generator. The anonymized AI judge sees the draft and source snippets, so source-aware preference remains possible; there was no independent human review. The overall result describes these 280 frozen positions, not a win probability for any writing task.

Manuscript writing position

Text excerpt · not a PDF page

Research manuscript · excerpt

Review on development of a scalable high-order nonhydrostatic multi-moment constrained finite volume dynamical core

7 Summary and future works

… The multi-moment finite volume method is a numerical framework lies between the conventional finite volume methods and other high-order methods using local spectrum-like reconstructions, such as DG (discontinuous Galerkin) and SE (spectral element) methods. It well balances among different requirements, such as solution quality, robustness, computational efficiency, parallelization, flexibility and adaptibility to different model configurations, and thus provides a very promising platform of great practical significance and potential to construct next generation atmospheric and oceanic GCMs.

…uniform spherical grids and nonhydrostatic compressible atmospheric flow have been developed. These models have been systematically and extensively verified by widely used bechmark tests. All numerical results justify that the MCV-based models have competitive numerical accuracy and efficiency in comparison to other existing numerical models. The 3D prototype of global nonhydrostatic compressible atmospheric model has been also developed by using the IMEX/HEVI time integration scheme as the base to develop a scalable high-order dynamic core for weather and climate predictions and simulations.

↓ Next paragraph was generated here

The highlighted text is near the writing position. This is a layout of the evaluation input, not a PDF screenshot.

A matched comparison at the same writing positionOverall AI review: With cards better

Both arms use the same model, task and manuscript context. Only the retrieved passages differ. The first recorded output from each arm is shown below.

Read overall AI review rationale

A = without cards · B = with cards

Both outputs provide reasonable completions that extend the manuscript's discussion of future directions for MCV-based models. However, Output B is preferable for several reasons. First, the draft specifically mentions 'IMEX/HEVI time integration scheme' as the base for the 3D prototype, and Output B's mention of 'more advanced time integration schemes' directly connects to this established technical thread, whereas Output A's focus on 'parallel scalability' is less grounded in the draft's emphasis. Second, Output B's reference to 'higher resolutions and more complex physical processes' appropriately broadens the scope from the specific atmospheric model already discussed toward the 'next generation atmospheric and oceanic GCMs' mentioned in the opening paragraph. Output A's 'wider range of atmospheric and oceanic modeling problems' is somewhat vague and repetitive of the draft's existing claims. Both outputs are appropriately scoped as single paragraphs and require no substantial repair, but Output B better maintains continuity with the specific technical content (time integration schemes) and the progressive expansion from prototype to operational capability implied by the draft's narrative arc.

Evidence

Same model and position · retrieved passages supplied · first output

Preferred by blind review

Future work will focus on further improving the computational efficiency and scalability of the MCV-based dynamical core, particularly through the development of more advanced time integration schemes and the extension of the model to higher resolutions and more complex physical processes.

Passages supplied to the Evidence version

Card 1 · IMEX based multi‐scale time advancement in ODTLES

Abstract In this paper we overcome a key problem in an otherwise highly potential approach to study turbulent flows, ODTLES (One‐Dimensional Turbulence Large Eddy Simulation). From a methodological point of view, ODTLES is an approach in between Direct Numerical Simulations (DNS) and averaged/filter…

Read full passage excerpt

Abstract In this paper we overcome a key problem in an otherwise highly potential approach to study turbulent flows, ODTLES (One‐Dimensional Turbulence Large Eddy Simulation). From a methodological point of view, ODTLES is an approach in between Direct Numerical Simulations (DNS) and averaged/filtered approaches like RANS (Reynolds Averaged Navier‐Stokes) or LES (Large Eddy Simulations). In ODTLES, a set of 1D ODT models is embedded in a coarse grained 3D LES. On the ODT scale, the turbulent advection is modeled as a sequence of stochastic eddy events, also known as triplet maps, while the other (deterministic) terms are fully resolved in space (along the ODT‐line) and time. Schmidt et al. first (2008) introduced ODTLES and Gonzalez et al. (2011) applied the model for a variety of wall‐bounded flow problems. Although the results were notable for a first proof of concept, the numerical methods used are subject to debate. First of all, an unstable discretization for the large scale 3D ad …

Card 2 · A global nonhydrostatic dynamical core on cubed sphere using multi-moment finite volume method: formulation and preliminary test

A nonhydrostatic dynamical core has been developed by using the multi-moment finite volume method that ensures the rigorous numerical conservation. To represent the spherical geometry free of polar problems, the cubed-sphere grid is adopted. A fourth-order multi-moment discretization formulation is…

Read full passage excerpt

A nonhydrostatic dynamical core has been developed by using the multi-moment finite volume method that ensures the rigorous numerical conservation. To represent the spherical geometry free of polar problems, the cubed-sphere grid is adopted. A fourth-order multi-moment discretization formulation is applied to the nonhydrostatic governing equations cast in local curvilinear coordinates on each patch of cubed sphere through a gnomonic projection. In vertical direction, the height-based terrain-following grid is used to represent the topography. To get around the CFL stability restriction imposed by relatively small grid spacing in the vertical direction, the dimensional-splitting time integration using the HEVI (Horizontal Explicit and Vertical Implicit) strategy is implemented by applying the IMEX Runge-Kutta scheme. The proposed dynamical core preserves the fourth-order accuracy in spherical geometry and has been verified by the widely-used benchmark tests. The results of our numerical …

Card 3 · Evaluation of Implicit‐Explicit Additive Runge‐Kutta Integrators for the HOMME‐NH Dynamical Core

Abstract The nonhydrostatic High‐Order Method Modeling Environment (HOMME‐NH) atmospheric dynamical core supports acoustic waves that propagate significantly faster than the advective wind speed, thus greatly limiting the time step size that can be used with standard explicit time integration method…

Read full passage excerpt

Abstract The nonhydrostatic High‐Order Method Modeling Environment (HOMME‐NH) atmospheric dynamical core supports acoustic waves that propagate significantly faster than the advective wind speed, thus greatly limiting the time step size that can be used with standard explicit time integration methods. Resolving acoustic waves is unnecessary for accurate climate and weather prediction. This numerical stiffness is addressed herein by considering implicit‐explicit additive Runge‐Kutta (ARK IMEX) methods that can treat the acoustic waves in a stable manner without requiring implicit treatment of nonstiff modes. Various ARK IMEX methods are evaluated for their efficiency in producing accurate solutions, ability to take large time step sizes, and sensitivity to grid cell length ratio. Both the gravity wave test and baroclinic instability test from the 2012 Dynamical Core Model Intercomparison Project are used to recommend 5 of the 27 ARK IMEX methods tested for use in HOMME‐NH.

Card 4 · A Discontinuous Galerkin Time-Domain Method With Dynamically Adaptive Cartesian Mesh for Computational Electromagnetics

A discontinuous Galerkin time-domain (DGTD) method based on dynamically adaptive Cartesian mesh (ACM) is developed for a full-wave analysis of electromagnetic (EM) fields. The benefits of hierarchical Cartesian grids and adaptive mesh refinement are demonstrated for linear EM propagation problems. T…

Read full passage excerpt

A discontinuous Galerkin time-domain (DGTD) method based on dynamically adaptive Cartesian mesh (ACM) is developed for a full-wave analysis of electromagnetic (EM) fields. The benefits of hierarchical Cartesian grids and adaptive mesh refinement are demonstrated for linear EM propagation problems. The developed DGTD-ACM achieves a desired accuracy by refining nonconformal meshes near material interfaces to reduce stair-casing errors without sacrificing the high efficiency afforded with uniform Cartesian meshes. More importantly, DGTD-ACM can dynamically refine the mesh to resolve the local variation of the fields during propagation of EM pulses. A local time-stepping scheme is adopted to alleviate the constraint on the time-step size due to the stability condition of the explicit time integration. It is shown by numerical examples that the proposed method can achieve a good numerical accuracy and reduce the computational time effectively for linear problems of EM propagation in dispers …

Card 5 · Fast IMEX Time Integration of Nonlinear Stiff Fractional Differential Equations

Efficient long-time integration of nonlinear fractional differential equations is significantly challenging due to the integro-differential nature of the fractional operators. In addition, the inherent non-smoothness introduced by the inverse power-law kernels deteriorates the accuracy and efficienc…

Read full passage excerpt

Efficient long-time integration of nonlinear fractional differential equations is significantly challenging due to the integro-differential nature of the fractional operators. In addition, the inherent non-smoothness introduced by the inverse power-law kernels deteriorates the accuracy and efficiency of many existing numerical methods. We develop two efficient first- and second-order implicit-explicit (IMEX) methods for accurate time-integration of stiff/nonlinear fractional differential equations with fractional order $α\in (0,1]$ and prove their convergence and linear stability properties. The developed methods are based on a linear multi-step fractional Adams-Moulton method (FAMM), followed by the extrapolation of the nonlinear force terms. In order to handle the singularities nearby the initial time, we employ Lubich-like corrections to the resulting fractional operators. The obtained linear stability regions of the developed IMEX methods are larger than existing IMEX methods in th …

Model-reported card use

The model did not report that any card materially affected this completion.

No Evidence

Same model and position · no retrieved passages · first output

Not preferred in this comparison

Future work will focus on further improving the computational efficiency and parallel scalability of the MCV-based dynamical core, and on extending its application to a wider range of atmospheric and oceanic modeling problems.

Earlier card-use comparison

The earlier diagnostic compared only cases with reported card use and text on both sides; its scope differs from the overall AI review above.

This case does not have both with-card continuation text and a model-reported use record. It remains among all 280 tests but does not enter the reported-use comparison.

The passages are input material; their presence does not mean an output used them or that they support every claim. Draft and source passages are excerpted; no simulated scores or PDF appear here.