← Back to all development cases
This case was judged by an anonymized AI reviewer and has not been independently reviewed by people; inspect the draft, cards, and both outputs to assess it.
AutocompleteWith cards better230 / 280 · beu-99129a0494ed8ecf

State Estimation of the Stefan PDE: A Tutorial on Design and Applications to Polar Ice and Batteries

Climate and environmental science · 2111.11617v1

FLOWING EVIDENCE BENCHMARK

How do we compare writing with and without cards?

At the same writing position, the same model produces one first result with cards and one without. All 280 pairs enter the overall anonymized review, which assesses whether a decision not to continue fits the draft.

Overall: 138 with-card wins, 26 ties, 107 no-card wins, 5 pairs where neither was usable, and 4 inconclusive judgments. Both sides wrote text in 218 pairs; 48 had a deliberate stop and 14 included an invalid output.

SAME DRAFT · WITH OR WITHOUT CARDS

01 · FIXED WRITING POSITION

MANUSCRIPT

Same writing position ▌

Matched autocomplete at the same draft position

02 · TWO MATCHED VERSIONS

SHARED BY BOTH

Draft, writing task, and generation model

A · With cards

Relevant literature cards supplied

B · Without cards

No literature cards supplied

Generation model

Same model and version

A → first output

B → first output

Anonymized AI judge

First outputs are anonymized as X and Y

Continuation review: accuracy, fit to the writing task and usability
Returns: X preferred / tie / Y preferred / both unusable

Review again with the answer order swapped

HOW DOES BLIND JUDGING WORK?

① Anonymize both outputs
The AI judge sees the same draft and both first outputs without knowing which received cards.

② Compare and swap order
The judge applies task-specific criteria in X/Y and then Y/X order.

③ Review disagreements
A third pass resolves disagreements. Incomplete reviews remain in the denominator.

How are positions and cards selected?

We selected 40 writing positions in each of seven fields, for 280 comparisons. The position and relevant literature cards were set before each comparison, so both versions began from the same draft.

The main result retains every frozen position, including places where cards might not add a useful next move. This avoids selecting cases based on their outputs, but 49% describes the whole cohort, not a win rate where evidence clearly had an opportunity to help. This cohort did not record that opportunity label for each position before generation, so those two groups cannot yet be separated reliably.

CARD USE · 140/280

Reported card use in continuations with text

The model reports whether a card affected its continuation. In 140 of 280 tests it produced continuation text and reported card use. The previous count of 150 included 10 cases without continuation text and has been corrected.

COMPARISON · 70 / 7 / 30

Which written version was better?

Of the 107 reported-use cases where both versions produced text, the blinded AI judge preferred the with-card version 70 times, found 7 about the same, and preferred the without-card version 30 times.

How are the two table percentages calculated?

ADOPTION COVERAGE

140reported use with text
÷
280all positions
=
50%

WITH-CARD VERSION PREFERRED

70with cards better
÷
107comparable tests
=
65%

The percentages use different groups: 50% counts continuations with text reporting card use among all 280 tests; 65% covers the 107 such cases with text on both sides. The generating model reports card use, while an anonymized AI judge compares writing quality.

Card use is self-reported by the generator. The anonymized AI judge sees the draft and source snippets, so source-aware preference remains possible; there was no independent human review. The overall result describes these 280 frozen positions, not a win probability for any writing task.

Manuscript writing position

Text excerpt · not a PDF page

Research manuscript · excerpt

State Estimation of the Stefan PDE: A Tutorial on Design and Applications to Polar Ice and Batteries

1 Introduction > 1.2 Stefan model

…d the consequent movement of the domain’s boundary, can be seen in some non-thermal chemical, biological, and social dynamics such as tumor growth in a patient’s body Spangler et al. (2016) , axonal elongation for neurons’ signal transmission Diehl et al. (2014) ; Demir et al. (2021) , lithiated region in electrodes of lithium-ion batteries Thomas et al. (2002) , crystallization process Braatz (2002) ; Nagy and Braatz (2012) ; Fujiwara et al. (2005) , domain walls in ferroelectric nanomaterials McGilly et al. (2015) , spreading of invasive species to a new environment Du and Lin (2010) , etc.

…distributed in space and changes in time. Hence, the mathematical formulation incorporates partial differential equations (PDEs) defined on a time-varying spatial domain, whereas the dynamics of the position of the moving boundary is governed by an ordinary differential equation (ODE) whose input depends on the PDE state. This configuration gives rise to nonlinear coupling of the PDE and ODE dynamics. As a result, though seemingly consisting of just a linear PDE and a linear scalar ODE, the Stefan problem is mathematically peculiar and not amendable to conventional analysis for PDEs and ODEs.

↓ Next paragraph was generated here

The highlighted text is near the writing position. This is a layout of the evaluation input, not a PDF screenshot.

A matched comparison at the same writing positionOverall AI review: With cards better

Both arms use the same model, task and manuscript context. Only the retrieved passages differ. The first recorded output from each arm is shown below.

Read overall AI review rationale

A = with cards · B = without cards

The draft ends by establishing that the Stefan problem is 'mathematically peculiar and not amendable to conventional analysis for PDEs and ODEs' — this sets up a clear need for a next move: what approaches *have* been developed to handle this difficulty? Output A directly addresses this by transitioning to the control-theoretic literature on the Stefan problem, describing backstepping approaches for stabilizing the moving interface. This fits the argument flow perfectly: after explaining why conventional methods fail, it introduces specialized methods that succeed. The content is accurate and well-scoped, drawing on established research (consistent with the provided sources on backstepping control of Stefan problems) without overreaching. Output B's abstention with 'complete' is inappropriate here because the paragraph clearly needs continuation — the draft introduces a problem (nonlinear coupling makes conventional analysis fail) and the natural academic move is to describe what alternative approaches exist. Ending here would leave the argument hanging and the paragraph functionally incomplete.

Evidence

Same model and position · retrieved passages supplied · first output

Preferred by blind review

This nonlinear coupling has motivated a substantial control-theoretic literature on the Stefan problem, in which the moving interface is stabilized to a desired setpoint through boundary actuation. For the one-phase Stefan problem, a nonlinear backstepping transformation for moving-boundary systems maps the coupled PDE-ODE dynamics into a target system whose exponential stability is proved, with the full-state boundary feedback controller ensuring exponential convergence of the interface to a reference setpoint.

Passages supplied to the Evidence version

Card 1 · Single-Boundary Control of the Two-Phase Stefan System

This paper presents the control design of the two-phase Stefan problem. The two-phase Stefan problem is a representative model of liquid-solid phase transition by describing the time evolutions of the temperature profile which is divided by subdomains of liquid and solid phases as the liquid-solid m…

Read full passage excerpt

This paper presents the control design of the two-phase Stefan problem. The two-phase Stefan problem is a representative model of liquid-solid phase transition by describing the time evolutions of the temperature profile which is divided by subdomains of liquid and solid phases as the liquid-solid moving interface position. The mathematical formulation is given by two diffusion partial differential equations (PDEs) defined on a time-varying spatial domain described by an ordinary differential equation (ODE) driven by the Neumann boundary values of both PDE states, resulting in a nonlinear coupled PDE-ODE-PDE system. We design a state feedback control law by means of energy-shaping to stabilize the interface position to a desired setpoint by using single boundary heat input. We prove that the closed-loop system under the control law ensures some conditions for model validity and the global exponential stability estimate is shown in $L_2$ norm. Furthermore, the robustness of the closed-l …

Card 2 · Backstepping Control of the One-Phase Stefan Problem

In this paper, a backstepping control of the one-phase Stefan Problem, which is a 1-D diffusion Partial Differential Equation (PDE) defined on a time varying spatial domain described by an ordinary differential equation (ODE), is studied. A new nonlinear backstepping transformation for moving bounda…

Read full passage excerpt

In this paper, a backstepping control of the one-phase Stefan Problem, which is a 1-D diffusion Partial Differential Equation (PDE) defined on a time varying spatial domain described by an ordinary differential equation (ODE), is studied. A new nonlinear backstepping transformation for moving boundary problem is utilized to transform the original coupled PDE-ODE system into a target system whose exponential stability is proved. The full-state boundary feedback controller ensures the exponential stability of the moving interface to a reference setpoint and the ${\cal H}_1$-norm of the distributed temperature by a choice of the setpint satisfying given explicit inequality between initial states that guarantees the physical constraints imposed by the melting process.

Card 3 · ODE$^2$VAE: Deep generative second order ODEs with Bayesian neural networks

We present Ordinary Differential Equation Variational Auto-Encoder (ODE$^2$VAE), a latent second order ODE model for high-dimensional sequential data. Leveraging the advances in deep generative models, ODE$^2$VAE can simultaneously learn the embedding of high dimensional trajectories and infer arbit…

Read full passage excerpt

We present Ordinary Differential Equation Variational Auto-Encoder (ODE$^2$VAE), a latent second order ODE model for high-dimensional sequential data. Leveraging the advances in deep generative models, ODE$^2$VAE can simultaneously learn the embedding of high dimensional trajectories and infer arbitrarily complex continuous-time latent dynamics. Our model explicitly decomposes the latent space into momentum and position components and solves a second order ODE system, which is in contrast to recurrent neural network (RNN) based time series models and recently proposed black-box ODE techniques. In order to account for uncertainty, we propose probabilistic latent ODE dynamics parameterized by deep Bayesian neural networks. We demonstrate our approach on motion capture, image rotation and bouncing balls datasets. We achieve state-of-the-art performance in long term motion prediction and imputation tasks.

Card 4 · Probabilistic simulation of partial differential equations

Computer simulations of differential equations require a time discretization, which inhibits to identify the exact solution with certainty. Probabilistic simulations take this into account via uncertainty quantification. The construction of a probabilistic simulation scheme can be regarded as Bayesi…

Read full passage excerpt

Computer simulations of differential equations require a time discretization, which inhibits to identify the exact solution with certainty. Probabilistic simulations take this into account via uncertainty quantification. The construction of a probabilistic simulation scheme can be regarded as Bayesian filtering by means of probabilistic numerics. Gaussian prior based filters, specifically Gauss-Markov priors, have successfully been applied to simulation of ordinary differential equations (ODEs) and give rise to filtering problems that can be solved efficiently. This work extends this approach to partial differential equations (PDEs) subject to periodic boundary conditions and utilizes continuous Gaussian processes in space and time to arrive at a Bayesian filtering problem structurally similar to the ODE setting. The usage of a process that is Markov in time and statistically homogeneous in space leads to a probabilistic spectral simulation method that allows for an efficient realizati …

Model-reported card use

Card 2 · fact

Affected output: For the one-phase Stefan problem, a nonlinear backstepping transformation for moving-boundary systems maps the coupled PDE-ODE dynamics into a target system whose exponential stability is proved, with the full-state boundary feedback controller ensuring exponential convergence of the interface to a reference setpoint.

Model explanation: This row supplied the concrete prior-work fact that backstepping control of the one-phase Stefan problem achieves exponential interface stabilization, which the paragraph uses as its representative control-theoretic study.

Card 1 · direction

Affected output: This nonlinear coupling has motivated a substantial control-theoretic literature on the Stefan problem, in which the moving interface is stabilized to a desired setpoint through boundary actuation.

Model explanation: This row established that the control literature on the Stefan problem is organized around stabilizing the interface position to a desired setpoint via boundary actuation, which guided the framing of the opening sentence.

No Evidence

Same model and position · no retrieved passages · first output

Not preferred in this comparison

No continuation text was produced.

Model action:complete

Earlier card-use comparison

The earlier diagnostic compared only cases with reported card use and text on both sides; its scope differs from the overall AI review above.

The with-card arm produced text and reported card use, but the no-card arm produced no text. This counts as reported use, without entering the two-text preference comparison.

The passages are input material; their presence does not mean an output used them or that they support every claim. Draft and source passages are excerpted; no simulated scores or PDF appear here.