The Temporal Correspondence Limitation of Evidence-Based Policy Making - A Preliminary Discussion Towards an Astrophysics-Inspired State-Aware Epistemology of Governance
Abstract
Evidence-based policy making assesses evidence for its reliability, for the credibility of its
causal identification, and for its transportability to a target population. This paper identifies
a further requirement that the established apparatus of assessment leaves unstated: the system
state that a body of evidence represents must correspond to the system state obtaining at the
moment of decision. Evidence is generated from a system at one time and intervention acts on that
system at a later time, so a body of evidence may be reliable, well identified and appropriately
transported, and still describe a condition the system has left. The requirement is called
temporal correspondence, and it is distinguished from the classical problem of induction:
granting the uniformity of nature leaves it in force, since a stable law applied to a superseded
state yields a decision addressed to no existing condition.
The paper develops the requirement by comparison with astrophysics, an observational science
whose object is accessible only through signals that departed it in the past, and which has
accordingly built its epistemology on the assumption that observation is historical. Fifteen
elements of that discipline’s practice are examined in turn and tested for transfer to
governance, in three families: the reconstruction of a past state from a present signal, the
constraints imposed by the observing situation, and the self-discipline of the observing
community. The pattern of what fails to transfer is treated as the object of the enquiry, on the
ground that it characterises governance as an observational situation.
Six contributions are claimed. The paper states the requirement and establishes its independence
from the problem of induction. It shows by inspection of the instruments, in place of
inference from their consequences, that the dominant apparatus of evidence assessment contains no
corresponding category, and it accounts for the omission. It classifies the ways in which the
practices of a mature observational science fail to transfer, and it identifies the limit beyond
which the comparison supplies nothing. It derives a set of requirements on the handling of
evidence, each of which costs discipline in place of apparatus. And it allocates the burden of
justification where the requirement fails and a course would be irreversible. The inspiration the
comparison affords is accordingly a discipline of observation and report, and no technique for
recovering the present condition of a governed system from lagged observation of it.
Keywords: evidence-based policy making; temporal correspondence; observation
Notices
Draft. This paper is circulated for comment as a working draft. Corrections
and objections are welcome and may be sent to the author at huangwanhong@serendip.ngo.
Licence. © 2026 Wanhong Huang. This work is made available under
the Creative Commons Attribution-NonCommercial 4.0 International Licence. The work may be
copied, distributed and adapted for non-commercial purposes with attribution to the author.
The licence terms are available at https://creativecommons.org/licenses/by-nc/4.0/.
Use of generative AI. Claude and ChatGPT were used in the preparation of this
paper, for discussion of its argument, for surveying prior formulations, and for drafting
assistance. The paper reports no simulation and no empirical result of its own; its arguments are
discursive throughout, and the two tables summarise the approaches examined and the
transfer analysis conducted in the body. Every claim has been reviewed and decided by the author. The bibliography has been checked
against publisher, journal and library records, and where sources disagree on the details of a
citation the entry records the disagreement in place of asserting one reading.
Suggested citation. Huang, Wanhong. “The Temporal Correspondence Limitation
of Evidence-Based Policy Making: A Preliminary Discussion Towards an Astrophysics-Inspired
State-Aware Epistemology of Governance.” Working draft, 2026.
1. Introduction
A body of evidence assembled to inform a decision describes a system as that system stood when
the evidence was generated. The decision it informs takes effect later, and the system
continues to move in the interval. This paper takes that interval as its object. It argues
that correspondence between the state a body of evidence represents and the state obtaining at
the moment of decision is a requirement on the use of evidence in governance, that the
apparatus by which evidence-based policy making assesses evidence leaves the requirement
unstated, and that the requirement fails in ways that the established assessment categories
cannot register. The paper’s method is comparative: it examines an observational science whose
object is available only through signals that departed it in the past, catalogues the elements
of practice by which that science works under the condition, and tests each element for
transfer to governance, treating the failures of transfer as findings.
The requirement can be stated in one line. Let $x(t)$ denote the condition of a governed system,
$t_e$ the time at which a body of evidence was generated, and $t_d$ the time at which a decision
informed by that evidence takes effect. Evidence-based policy making assesses whether the
evidence supports a claim about $x(t_e)$. Governance acts on $x(t_d)$. The two coincide only
where the system has been still. Three forms of divergence are available: the state may have
moved, $x(t_e) \neq x(t_d)$; the dynamics may have changed, so that relations estimated under
one regime govern behaviour under another; and the relational structure connecting the system’s
components may have been reorganised, so that quantities measured at $t_e$ stand in different
relations at $t_d$. The first is a matter of degree, the second is the structural problem
identified in macroeconomics by Lucas (Lucas, Robert E., Jr. “Econometric Poli, 1976), and the third is the condition under
which the categories of measurement themselves come loose.
The limitation is distinguishable from the classical epistemological objection to induction, and
the distinction carries weight. Hume’s problem concerns whether regularities observed in the
past license expectations about the future (Hume, David. extit A Treatise of Human N, n.d.). Temporal correspondence concerns
something else, and survives the concession of everything Hume’s problem places in doubt. Grant
that nature is uniform. Grant that the causal relation established by a well-conducted trial
holds at the moment of decision exactly as it held during the trial. The decision is still
addressed to a state the system has left, and a stable law applied to a superseded state issues
in an intervention aimed at no existing condition. The correspondence failure is therefore
reachable from inside an empiricist position, using only claims about measurement latency and
system dynamics that any empiricist already licenses. This paper treats that internal character
as the limitation’s principal argumentative property.
The absence of the requirement from the assessment apparatus is a matter of record, open to
settlement by inspection, and Section 3 settles it by examining the
instruments. The reason for the absence is instructive. The evidence hierarchies that
evidence-based policy making inherited from clinical epidemiology were developed for a setting
in which the interval between measurement and action is short and the system under study is
held as nearly fixed as the design permits. Under those conditions temporal correspondence
holds by construction and needs no name. Carrying the hierarchies into governance carries the
silence with them, and the silence becomes consequential in a setting where the interval is
long, the system moves on its own, and the intervention itself is one of the things moving it.
Astrophysics is the comparison case, and the choice requires a word of justification, since a
comparison across such a distance invites the charge of metaphor. The justification is that
astrophysics shares the structural condition exactly. Its object is accessible only through
signals that left the object in the past; the delay is a property of the observing situation and
survives every improvement in instruments; and the discipline has responded by building an
epistemology in which the historical character of observation is assumed at the outset. The
comparison is used here for a specific purpose. Astrophysics supplies a worked inventory of what
a science does when it accepts that its observations are historical, and that inventory can be
put to governance as a set of questions. For each element of practice, what does the element
presuppose, does governance satisfy the presupposition, and what remains if it does not. This
paper asks those questions of fifteen elements and reports the answers, including the negative
ones. An element that transfers badly is retained in the exposition and its failure analysed,
because the pattern of failure is what characterises governance as an observational situation.
The paper accordingly makes no methodological proposal. It recommends the construction of no
estimation system, and it should be read as declining that route explicitly. The reason is
internal to the critique the limitation belongs to. Where the response to lagged evidence is a
more elaborate apparatus for inferring the present state, the resulting estimate is a further
symbolic object standing between the decision and the world, produced by machinery whose
assumptions are inspectable by fewer parties than the evidence was. A limitation whose remedy
deepens the conditions its companion limitations describe is not remedied. The paper’s
consequences are therefore stated as conditions on the admissibility of intervention and as an
allocation of the burden of justification.
Two results are argued. The first is a partition. The reconstruction of an unobserved state from
observed signals requires an observability condition, and where the condition fails no
accumulation of data recovers the state, since the failure is structural and not statistical.
The state space of a governed system therefore divides into a region in which estimation is
legitimate and a region in which it is undefined, and the division is a condition on method,
with the force of a constraint and none of the character of a counsel of modesty. The second concerns the escape route. Astrophysics converts
its lookback problem into an advantage by substituting an ensemble for a time series: objects at
many distances are many epochs of one physics, observed together. The substitution requires that
the instances share a law. Governance has one system and no such law, and its only available
ensemble is comparative, across jurisdictions or populations, which exchanges the temporal
mismatch for the contextual mismatch that Cartwright and Hardie (Cartwright, Nancy, and Jeremy Hardie. ex, n.d.) analyse.
The two mismatches trade against one another, and the choice of which to bear is a choice that
is ordinarily neither made nor stated.
The paper proceeds in seven parts. Part I states the requirement and establishes its absence
from the assessment apparatus, situates it among three limitations of evidence-based policy
making already argued in the literature and in the author’s prior work, and reviews prior
formulations that approach the same territory from adjacent directions. Part II describes the
comparison case and fixes the structure of the transfer test. Parts III to V run the test over
the three families of astrophysical practice. Part VI reports the results: the disanalogy of
reflexivity, the trade between the ensemble and the time series, the classification of transfer
failures, and the connection between the grammatical tense in which evidence is reported and the
displacement of responsibility onto it. Part VII draws the consequences for governance and
states the paper’s limits.
2. The Evidence-Quality Apparatus and Its Domains of Assessment
This section establishes by inspection that the instruments through which evidence-based policy
making assesses evidence contain no category for temporal correspondence. Its objective is
evidential: the claim that a requirement is unstated is a claim about documents, and the section
examines the documents. It proceeds in three steps. It sets out the
structure of the dominant assessment instrument and enumerates the grounds on which that
instrument permits the certainty of a body of evidence to be lowered. It examines the
neighbouring category that comes closest to the requirement and states the boundary of that
category. It then turns to an operating national programme, where the instruments of assessment
are administrative in origin, and finds the same absence in a different
vocabulary.
2.1 The Structure of Certainty Assessment
The Grading of Recommendations, Assessment, Development and Evaluations approach is the most
widely adopted system for rating the certainty of a body of evidence, and its categories have
been carried well beyond clinical medicine into the assessment of evidence for policy. Under
that approach a body of evidence receives an initial rating determined by study design and is
then lowered on the strength of assessments in five domains: risk of bias, inconsistency,
indirectness, imprecision, and publication bias (Sch unemann, Holger J., Julian P. T. Hig, n.d.). Three further
considerations permit an initial rating to be raised. The result is reported as one of four
levels of certainty, and the assessments are recorded with explicit reasons in a summary table.
The five domains are exhaustive in the operative sense: an assessor working within the approach
lowers certainty on these grounds and records the reason under one of these headings. It is
therefore possible to ask directly whether a body of evidence describing a system that has since
changed can be downgraded, and under which heading. Risk of bias concerns the conduct of the
studies. Inconsistency concerns disagreement among their results. Imprecision concerns the width
of the interval around the estimate. Publication bias concerns what has been withheld from the
record. None of the four is available for the case in view, in which every study was well
conducted, the results agree, the interval is narrow, nothing has been withheld, and the system
has moved.
2.2 The Boundary of Indirectness
Indirectness is the domain that comes closest, and its scope is worth stating precisely because
the closeness is instructive. The domain covers the distance between the evidence in hand and
the question being asked, and it is elaborated in terms of the population studied, the
intervention delivered, the comparator against which it was tested, and the outcome measured
(Zhang, Yuqing, Pablo Alonso-Coello, Gord, 2018). An assessor invoking indirectness is recording that the studies were conducted
on people, treatments, comparisons or endpoints differing from those at issue in the decision.
The elaboration is spatial and populational throughout. It anticipates that evidence generated
in one setting will be applied in another and asks how far apart the settings are. What it does
not anticipate is that the setting of application may be the setting of generation at a later
moment, and that the two may have come apart through the passage of time alone. A population may
be the same population, an intervention the same intervention, a comparator and an outcome
identically specified, and the system in which they are now embedded may nevertheless be a
different system. The domain has a category for the distance between here and elsewhere and no
category for the distance between then and now.
The gap can be stated as a claim about the apparatus.
Claim2.1Absence of a temporal domain
Under the dominant instrument for assessing the certainty of a body of evidence, no ground is
available for lowering certainty on the sole basis that the interval between the generation of
the evidence and the moment of decision is long, or that the system described has moved
materially within that interval. The nearest available ground concerns distance between
settings and is elaborated without reference to elapsed time.
Two qualifications belong with the claim. Practitioners are aware that evidence ages, and the
awareness is documented: an early study of clinical practice guidelines estimated that about
half were outdated within some six years, with about a tenth outdated within four, and observed
that the rate of deterioration varies strongly by topic (Shekelle, Paul G., Eduardo Ortiz, Shanno, 2001). A later survival
analysis of individual recommendations put the same phenomenon on a firmer empirical footing
(Mart inez Garc ia, Laura, Andrea Juliana, 2014). The response to this awareness has taken the form of periodic
revision schedules. A schedule is a procedural remedy applied to a body of evidence as a whole,
and Claim 2.1 concerns something narrower and more consequential: whether a particular body of
evidence, offered in support of a particular decision at a particular moment, can be assessed
for its correspondence to the state then obtaining. The schedule answers when to look again. It
does not answer whether what is in hand supports the decision now being taken.
2.3 Administrative Instruments of an Operating Programme
Assessment instruments developed in clinical epidemiology are one route by which the
requirement might have been registered. A second route runs through the administrative
machinery of governments that have institutionalised the approach, and it is worth examining
because its vocabulary is independent.
Japan supplies a developed instance. A programme of evidence-based policy making was
established following the final report of the Statistical Reform Promotion Council in 2017,
supported by a promotion committee under the administrative reform apparatus and by units
within the Cabinet Office and the Ministry of Internal Affairs and Communications
(Cabinet Secretariat, Government of Japan, n.d.; Cabinet Office, Government of Japan. “N, n.d.). Its working instruments are the logic model, the administrative
project review sheet, and the policy dashboard. The logic model articulates the chain from
activity through output to intended outcome. The review sheet records the articulation and the
measurement against it. The dashboard renders the relevant indicators visible.
Each instrument carries a temporal structure and none carries a temporal correspondence check.
A logic model states the mechanism by which an activity is expected to produce an outcome and
is assessed for the coherence of that statement. The assessment asks whether the chain is
plausible and whether its links are evidenced. It does not ask when the state was measured that
the chain was designed against, nor how far that state may have moved by the time the activity
begins. An indicator on a dashboard is presented as a current value, and its reference period,
where recorded at all, is recorded as a property of the statistic, carrying no qualification on
the inference the dashboard supports. The review sheet records measurement against targets
set earlier, and the interval between the setting and the measurement is treated as the period
over which effects accumulate, never as an interval over which the premise of the target may
have expired.
The point generalises beyond the instance. Administrative evidence systems index data by
reference period as a matter of statistical practice, and the indexing is real. What is absent
is the inferential step that would convert the index into a qualification: a statement that the
support the evidence lends to a claim about the present is a function of the interval and of the
system’s movement within it. The index is present in the data and absent from the reasoning.
3. Established Limitations of Evidence-Based Policy Making and Their Grounds
This section situates the requirement stated in Section 3 within a set of
three limitations of evidence-based policy making that have been argued elsewhere, and
establishes the property that distinguishes the fourth from the other three. Its objective is
placement: each of the three is stated in the form its proponents give it,
with attention to the kind of premise it requires, and the section closes by identifying what
each premise costs an interlocutor who declines it. The method is comparative in a narrow sense.
The three limitations are compared along one axis, the character of the ground on which each
rests, and the comparison prepares the argument of Section 5 that the fourth
occupies a position none of the three occupies.
3.1 The Inferential Gap between Evidence and Prescription
The first limitation is the oldest and concerns the passage from statements of fact to
statements of what ought to be done. Evidence establishes what has been observed. A policy is a
prescription. The passage between them requires a premise that no quantity of observation
supplies, and the requirement holds however good the observation is (Hume, David. extit A Treatise of Human N, n.d.). A body of
evidence establishing that an intervention produced an effect establishes nothing about whether
the effect is to be sought.
The limitation is well understood by proponents of evidence-based policy making and is
ordinarily met by a division of labour: evidence settles matters of fact and the political
process settles matters of value. The division is coherent as far as it goes. What it concedes
is that the authority of evidence is bounded at the point where the prescription is issued, so
that the phrase describing policy as based on evidence overstates the relation. The premise the
limitation requires is a claim about the logical relation between two classes of statement, and
an interlocutor declining it must hold that a prescription follows from a description alone.
3.2 The Remainder Left by Quantification
The second limitation concerns what is lost in the operation by which a condition becomes a
measurement. To bring a human situation into an evidence base is to select from it the features
an instrument registers, and the selection is not neutral with respect to what the situation is.
Suffering enters as an index, participation as a rate, the quality of a relation as a score.
The remainder is unavailable to the assessment and therefore unavailable to the decision, and
its unavailability is systematic, since it follows from the very operation that made the
assessment possible.
The premise this limitation requires is substantive: that features of human situations exist
which resist exhaustive representation by the instruments in use, and that their resistance is
a property of the features and not a temporary limitation of the instruments. An interlocutor
who holds that any relevant feature is in principle measurable declines the premise coherently,
and the dispute between the two positions is old and unresolved. The limitation is therefore
argumentatively expensive: it can be pressed only against an opponent who has already conceded
a claim about the limits of measurement.
3.3 The Displacement of Decision onto a Symbolic Authority
The third limitation concerns the position that an appeal to evidence occupies in the structure
of a decision. In its administrative form the observation is familiar. Where a decision is
contested and its author accountable, the invocation of evidence relocates the ground of the
decision from the person deciding to a procedure, and a decision defended by the statement that
it followed the evidence attributes the decision to an authority that occupies no office and can
be asked no questions. The structure is recognisable in ordinary practice, where referral to a
committee, a framework or a standard operates so that the outcome is attributable to a process
and to no participant in it.
The administrative form leaves a question unanswered, and the question is what gives the
limitation its force. A relocation of this kind succeeds only where something is available to
receive what is relocated, and the appeal to evidence therefore presupposes that evidence
occupies a position of authority that no participant in the decision occupies. The account of
that position taken here is the psychoanalytic one.
A decision requires a warrant it cannot supply from within itself, and the place from which such
a warrant is taken to issue is what Lacan describes as the locus of the Other: a position,
internal to the symbolic order and occupied by no person, from which utterances are taken to
receive their guarantee (Lacan, Jacques. extit Ecrits: The First , n.d.). The position is structural, which is to say that it
persists across the successive occupants installed in it, and the history of political authority
may be read as a sequence of such installations, from revelation through natural law and the
sovereign will to History. What matters for the present argument is that the position is
constant and its occupant is not, so that the vacancy left by a departing occupant is a vacancy
requiring to be filled.
Two routes by which a contemporary governing arrangement might supply the warrant from within
itself are unavailable to it. Genuine collective deliberation, in which a warrant issues from an
organised constituency, is impeded by the atomisation of the constituencies that would conduct
it. Delegation to a class of expert decision-makers is impeded on two counts at once, since the
bounded rationality of any such class undermines the epistemic claim and the absence of a mandate
undermines the democratic one. The place is accordingly empty and the pressure to fill it is a
pressure the arrangement cannot resolve internally, which is the condition Habermas describes as
a crisis of legitimation (Habermas, J urgen. extit Legitimation Cr, n.d.).
Evidence is installed in that place. What follows for responsibility is the consequence stated
in the administrative form above, and it now has a reason: the party deciding is not evading
accountability by a manoeuvre available to it, but occupying a position in which the warrant for
its act is structurally located elsewhere. This is why the deflection is so stable, why it is
performed by parties who are acting in good faith, and why exhortations to take responsibility
have so little purchase against it.
The premise this limitation requires is correspondingly substantial. It is a structural account
of where the authority of a decision is located, and an interlocutor who holds that the appeal
to evidence disciplines decisions more than it shelters them may decline the account and confine
himself to the administrative observation, which is weaker and is contestable by observation of
practice. The limitation is therefore available in two strengths, and the stronger requires a
premise drawn from outside the epistemology it criticises. Like the second limitation, it
concerns the uses to which evidence is put and leaves untouched the question of what the evidence
supports.
3.4 The Character of the Grounds
The three limitations rest on grounds of three kinds. The first rests on a claim about logical
relations between classes of statement. The second rests on a substantive claim about the limits
of representation. The third rests on a structural account of where the authority of a decision
is located, and admits a weaker form resting on observation of administrative practice. Each is
defensible, and each requires its proponent to secure a premise that an interlocutor committed
to the sufficiency of empirical method may decline. The first is conceded readily and absorbed
by a division of labour. The second and third are argued from positions outside that commitment,
and an opponent who holds the commitment may hold his ground.
This is the position the fourth limitation occupies differently, and the difference is the
subject of Section 5. The proposition that a measurement takes time to
produce is a proposition about measurement. The proposition that a system continues to change
while the measurement is being produced is a proposition about the system. Both are of exactly
the kind that empirical method licenses and neither requires a premise drawn from outside it.
An interlocutor committed to the sufficiency of empirical method is therefore committed to the
materials from which the fourth limitation is constructed, and the limitation is pressed against
him with his own resources.
4. The Temporal Correspondence Requirement
This section states the requirement formally and fixes the vocabulary that the remainder of the
paper uses. Its objective is to make the limitation precise enough to be tested against
particular practices, and to establish two properties of it that the later argument relies on:
that it is independent of the classical problem of induction, and that it is constructible from
premises an empiricist already holds. The section proceeds by definition and then by argument.
It fixes the temporal indices attaching to an item of evidence, defines correspondence in a form
that is relative to the decision at hand, distinguishes three ways in which correspondence
fails, and then argues the independence and internality properties. It closes by stating what
the requirement does not assert, since a limitation of this kind is easily inflated into a
general scepticism it does not support.
4.1 Temporal Indices on an Item of Evidence
An item of evidence carries several distinct times, and the practice of reporting a single date
conceals the distinction.
Definition4.1Indices of an evidence item
Let $S$ be a governed system whose condition at time $t$ is $x(t)$. An item of evidence $e$
concerning $S$ carries a reference time $t_e$, the time of the condition it represents;
a release time $t_r \geq t_e$, the time at which it becomes available to a party
deciding; and, where it has been revised, a vintage, the release at which its present
values were fixed. A decision informed by $e$ is taken at $t_d \geq t_r$ and takes effect over
an interval beginning at $t_d + \delta$.
The interval $t_r - t_e$ is the production interval, comprising collection, processing,
verification and publication. The interval $t_d - t_r$ is the deliberative interval. The
interval $\delta$ is the implementation lag. The quantity that matters for the present argument
spans the first two.
Definition4.2Governance lookback time
The governance lookback time of an item of evidence relative to a decision is
$\tau_G = t_d - t_e$, the interval between the condition the evidence represents and the moment
at which the decision it informs is taken. Where the effects of the decision are at issue, the
relevant interval extends to $t_d + \delta - t_e$.
The vintage index deserves emphasis because it is established practice in one field and absent
in most others. Macroeconomic statistics are revised after release, and the analysis of policy
conducted on revised figures differs from the analysis available to the party who decided.
Croushore and Stark (Croushore, Dean, and Tom Stark. “A Real, 2001) constructed a data set of successive vintages precisely
to test whether published results survive the substitution, and the exercise established that
the release index carries content. An evidence base without vintage indices cannot reconstruct
what any past decision was taken on.
4.2 Correspondence Stated Relative to a Decision
A definition of correspondence in terms of the distance between $x(t_e)$ and $x(t_d)$ would
require a metric on the state space, and governed systems seldom supply one. The definition
below avoids the requirement by fixing correspondence relative to the decision the evidence is
offered to support.
Definition4.3Temporal correspondence
Let a decision be a choice among alternatives $a_1, \dots, a_k$, and let $E$ be a body of
evidence offered in support of that choice. Temporal correspondence holds for $E$
relative to the decision when the movement of $S$ over the interval $[t_e, t_d]$ is insufficient
to alter which alternative $E$ supports. Correspondence fails when the movement is
sufficient to alter it.
Three consequences follow from the relativisation and are worth stating. Correspondence is a
property of a body of evidence together with a decision, so the same evidence may correspond for
one choice and fail for another; a coarse choice between acting and declining to act tolerates a
larger $\tau_G$ than a choice among calibrated intensities. Correspondence admits no assessment
from the evidence alone, since the assessment requires a claim about how the system moves, and
that claim is a further empirical commitment. And correspondence is not a matter of the evidence
being wrong. A body of evidence that fails correspondence remains an accurate description of
$x(t_e)$; what has lapsed is its bearing on the choice.
4.3 Modes of Correspondence Failure
Correspondence fails in three structurally distinct ways, and the distinctions organise
Parts III to V.
Definition4.4Modes of correspondence failure
Correspondence fails in state where $x(t_e) \neq x(t_d)$ with the dynamics and the
descriptive categories unchanged. It fails in dynamics where the relations governing
the system’s evolution at $t_d$ differ from those obtaining at $t_e$, so that a relation
estimated under the earlier regime misdescribes the later one. It fails in articulation
where the categories by which $S$ was described at $t_e$ stand in altered relations at $t_d$, so
that a quantity retaining its name has changed what it measures.
Failure in state is the mode most readily acknowledged and the least severe, since it is a
matter of degree and is in principle correctable by more recent measurement. Failure in dynamics
is the structural problem identified by Lucas (Lucas, Robert E., Jr. “Econometric Poli, 1976) for econometric policy
evaluation: relations estimated under one policy regime alter when the regime alters, so the
estimated relation supplies no guide to behaviour under the contemplated policy. The mode is
general beyond economics wherever the governed parties adjust to the rule. Failure in
articulation is the least discussed and the most damaging to longitudinal reasoning, since it
defeats comparison itself; where a definition of employment, of poverty or of a diagnosis has
been revised between two measurements, the series presenting them together presents two
quantities under one name. Section 19 treats this mode directly.
4.4 Independence from the Problem of Induction
The requirement is distinct from the classical objection to induction, and the distinction is
established by concession.
Proposition4.5Independence of the correspondence failure
Correspondence failure is not a consequence of the problem of induction, and the concession of
everything that problem places in doubt leaves the failure in force.
The argument proceeds by granting the strongest available position to an opponent. Grant that
nature is uniform, so that regularities observed hold generally. Grant further that the causal
relation established by a well-conducted study at $t_e$ obtains at $t_d$ in exactly the form
established. Neither concession bears on where the system stands. A stable relation between an
intervention and an outcome describes what follows from the intervention given the condition on
which it acts, and where that condition has changed the relation issues in a different outcome,
or in no outcome, without ceasing to hold. The uniformity of nature is a premise about laws.
Correspondence is a requirement on states. Securing the former settles nothing about the latter,
and the failure therefore survives the concession.
The converse holds as well and is worth recording. Where a system is genuinely still, the
problem of induction remains in full force and correspondence is satisfied. The two conditions
vary independently, which is what establishes them as distinct requirements on the use of
evidence.
4.5 Constructibility from Empirical Premises
The property that gives the requirement its argumentative reach is that it can be assembled from
materials an empiricist already accepts.
Claim4.6Internal constructibility
The correspondence failure is derivable from two propositions of a kind that empirical method
licenses: that the production of a measurement occupies an interval, and that a system under
observation continues to change during that interval. An interlocutor committed to the
sufficiency of empirical method is committed to both, and therefore to the failure.
Both propositions are themselves matters of observation. The production interval of an official
statistic is a documented administrative fact. The movement of a governed system across an
interval is measurable by the same instruments that measured its earlier condition. Neither
proposition requires a claim about the limits of representation, about what quantification
omits, or about what institutions do with an epistemic authority. The limitation therefore
occupies the position identified at the close of Section 4: it is pressed
against a commitment to empirical method using the resources that commitment supplies, and an
opponent who declines it must deny either that measurement takes time or that systems move.
4.6 Heterogeneity of the Evidence Base
Definitions 4.1 and 4.2 attach indices to a single item. A decision is ordinarily informed by a
body of items, and the indices differ across them.
Definition4.7Temporal heterogeneity
An evidence base $E = {e_1, \dots, e_n}$ is temporally heterogeneous relative to a
decision when the reference times $t_{e,1}, \dots, t_{e,n}$ differ. Its lookback profile is the
collection ${\tau_{G,i}}$ of item-wise lookback times.
The heterogeneity has consequences beyond the aggregation of a set of delays into an average,
and Section 14 develops them. It is recorded here because it defeats a natural
simplification. Where the profile is heterogeneous, no single state of the system is described
by the base as a whole, and the object the base appears to describe, the condition of the system
at a moment, is assembled from fragments belonging to different moments and exists in no source.
4.7 Restrictions on the Scope of the Requirement
Four restrictions bound the claim, and each is required to keep the limitation from expanding
into a general scepticism it cannot support.
The requirement asserts no general staleness. Correspondence is satisfied for a great many
decisions, since a great many governed systems move slowly relative to the intervals at issue.
The claim is conditional, and the conditions under which it fires are the subject of
Sections 11 and 17.
The requirement supplies no argument against the use of evidence. A decision taken without
evidence stands in a worse relation to the system’s condition, since it corresponds to no state
at all. The requirement bears on how the support that evidence lends should be characterised and
on what follows where the support has lapsed.
The requirement licenses no ranking of evidence types. Nothing here establishes that
observational evidence corresponds better than experimental evidence, or the reverse. The
lookback profile of a body of evidence is a fact about its production and is largely independent
of its design.
The requirement is stated for a system whose movement is independent of the decision the
evidence informs. Where the parties within a governed system anticipate an intervention, part of
their response occurs before it is adopted and is recorded at reference times preceding the
decision, so that the interval between a cause and its recorded effect is not of fixed sign.
Section 24 develops the consequence, which qualifies Definition 4.3 in a
direction the present section does not accommodate.
The requirement supplies no measure. Definition 4.3 fixes correspondence relative to a decision
and delivers no quantity, and the paper introduces none. Section 11 develops
a notion of an interval beyond which support lapses, and states there the conditions under which
that interval can be bounded and the wide class of cases in which it cannot.
5. Relation to Prior Work
This section places the requirement of Section 5 among formulations that
approach the same territory from adjacent directions, and identifies what each owns. Its
objective is to concede priority where priority is owed and to isolate what remains unclaimed.
The order runs from the formulation nearest to the present one, through treatments of the
spatial counterpart of the problem, then through fields that have confronted lag in their own
practice, and closes with work on the political conditions of evidence use and on decision under
deep uncertainty. Each subsection states what the formulation establishes and where its boundary
falls. The section ends with a statement of the residue.
5.1 Temporal Validity and the Decay of Knowledge
The nearest formulation is Munger’s (Munger, Kevin. “Temporal Validity as Me, 2023), and it holds a substantial part of the
present ground. Munger names the problem temporal validity, treats it as a species of external
validity, and argues that the accumulation of internally valid causal estimates cannot deliver
generalisable knowledge where the world changes at a rate comparable to the rate of
accumulation. He introduces a rate parameter for the change of the world, observes that all
published knowledge comes from the past while all action lies in the future, and concludes that
assumption-free external validity is unavailable when the target context is future. The
argument is anchored in Hume and pressed as a case for reallocating methodological effort.
Everything in that formulation is conceded. Two features fix its boundary and open the space the
present paper occupies. Its object is the causal effect estimate, and the question is whether an
estimate transports to a target; the present object is the condition of the system, and the
question is whether any claim about that condition is supported at the moment of decision. And
its remedy runs toward descriptive knowledge, on the ground that description is cheaper and
decays more slowly than causal estimation. The requirement stated in
Section 5 bears directly on that remedy. Descriptive knowledge carries its
own production interval, its own vintage, and its own lookback profile, so a retreat from causal
estimation toward description relocates the difficulty and leaves it in place. The present paper
may therefore be read as taking up Munger’s argument at the point where his recommendation
begins.
Two further differences are structural. Munger’s rate parameter is a single quantity attaching
to a field of inquiry, where Definition 4.7 requires a profile of item-wise intervals within one
evidence base. And the conclusion drawn there concerns the allocation of research effort, where
the present conclusions concern the admissibility of intervention.
The same territory has been entered from development economics under the description of temporal
external validity, where the observation is that a causal effect estimated in one year embeds
the realisation of aggregate conditions in that year, so that a confidence interval computed
from a single-year study understates the uncertainty attaching to any later application
(Rosenzweig, Mark R., and Christopher Udr, n.d.). The term is therefore occupied and is used here as the ancestor’s term.
5.2 The Spatial Counterpart and Its Formal Treatment
The problem of carrying a finding from the setting that produced it to the setting in which it
will be applied is the subject of a developed literature, and the present requirement is its
temporal counterpart.
Cartwright and Hardie (Cartwright, Nancy, and Jeremy Hardie. ex, n.d.) argue that instruments ranking methods by the
trustworthiness of the evidence they produce leave unaddressed the question of what is required
for a finding to hold where it is to be used, and that the support factors present in the
original setting must be present in the target for the finding to carry. Deaton and Cartwright
(Deaton, Angus, and Nancy Cartwright. “U, 2018) press the point against the standing of randomised trials as a general
warrant. Formal treatments of the same problem, developed within the graphical approach to
causation, state conditions under which an effect may be transported across populations
(Bareinboim, Elias, and Judea Pearl. “Ca, 2016), and within the potential-outcomes framework state conditions under which
an estimate generalises to a target context (Egami, Naoki, and Erin Hartman. “Elemen, 2022). Reiss (Reiss, Julian. “Against External Validi, 2019) argues that
external validity is defined in terms of internal validity in a way that misconstrues the
practical question.
The boundary of this family is the same throughout. Its target is elsewhere, and its variables
of interest are the features by which one setting differs from another. Where the target is the
same setting at a later moment, the machinery has no purchase, since the population, the
intervention, the comparator and the outcome may be specified identically at both times. The
retreat that Egami and Hartman propose, from generalising the magnitude of an effect to
generalising only its sign, is instructive here: it is a principled response to the
unavailability of the required data about the target, and the present paper reaches a
structurally similar retreat by a different route in Section 11.
5.3 Lag in the Analysis of Economic Policy
Economics has confronted the interval directly and has a settled vocabulary for it. The
distinction among the interval before a change is recognised, the interval before a decision is
taken, the interval before the decision is implemented, and the interval before its effects
appear is standard, and Friedman (Friedman, Milton. “The Lag in Effect of, 1961) argued from the length and variability of
these intervals that activist stabilisation policy may destabilise, since a measure calibrated
to a condition may take effect on its opposite. The argument is the present requirement stated
for one domain and drawn toward one conclusion.
Two things follow for the present paper. The claim that the interval has gone unnoticed would be
false, and the paper makes no such claim. What has gone unregistered is narrower and concerns
the instruments of assessment examined in Section 3: a field that reasons
carefully about lags in its own subject matter may still assess a body of evidence by criteria
containing no place for them. The vocabulary developed in economics is used here, and the term
vintage is taken from that literature (Croushore, Dean, and Tom Stark. “A Real, 2001) in preference to a coinage.
5.4 Delay in Cybernetic and System-Dynamics Treatments of Governance
A further tradition treats government as an information-processing arrangement and makes delay
one of its governing parameters. Deutsch (Deutsch, Karl W. extit The Nerves of Gov, n.d.) analysed political systems in terms
of the intervals and gains characterising their response to information, and argued that the
performance of a governing arrangement depends on these parameters at least as much as on the
intentions of those within it. Work in system dynamics established that delays between action
and consequence produce characteristic failures in systems operated by people who reason about
them without accounting for the delay (Forrester, Jay W. “Counterintuitive Beh, n.d.; Sterman, John D. extit Business Dynamics, n.d.).
The boundary of this tradition is its object. Its concern is the behaviour of the governing
arrangement, and delay enters as a parameter of that behaviour. The present concern is the
epistemic standing of a body of evidence offered in support of a particular decision. The two
are compatible and the second is presupposed by the first, since a claim about how a system
responds to delayed information presumes that the information is delayed and that the delay
bears on what the information supports.
5.5 Obsolescence in Clinical Practice
Clinical epidemiology has produced the most direct empirical measurements of the phenomenon.
Shekelle et al. (Shekelle, Paul G., Eduardo Ortiz, Shanno, 2001) estimated the rate at which practice guidelines cease to be
valid and found the rate strongly dependent on the subject matter. A later survival analysis of
individual recommendations (Mart inez Garc ia, Laura, Andrea Juliana, 2014) treated validity as a duration and
estimated its distribution. Both were discussed in Section 3.
Their boundary was stated there and is restated for the record. The response the field has drawn
from these findings is a schedule of revision applied to a body of guidance as a whole. The
present requirement concerns a particular body of evidence offered for a particular decision,
and is a question about support at a moment, which a schedule does not address. The empirical
work nonetheless supplies something the present paper needs: an existence proof that the
duration of validity is measurable in at least one domain, which Section 11
takes up.
5.6 The Political Conditions of Evidence Use
Parkhurst (Parkhurst, Justin. extit The Politics of, n.d.) distinguishes the technical bias by which evidence is distorted
in its use from the issue bias by which the selection of what to evidence forecloses normative
debate, and argues for institutional arrangements governing evidence use in place of exhortation
to use more of it. He locates one source of difficulty in the inheritance of assessment
hierarchies from clinical medicine, where the near-universality of the underlying mechanisms
supports a generality that policy settings lack.
That diagnosis and the present one are complementary and address different objects. Parkhurst’s
subject is the use to which a body of evidence is put and the interests that shape its selection
and interpretation. The present subject is a property of the evidence itself, which holds
whatever the interests of the parties. The two meet at one point, developed in
Section 27: where the support a body of evidence lends has lapsed and the report of
it retains the grammatical form of a present-tense claim, the conditions Parkhurst describes
operate with less resistance.
5.7 Decision under Deep Uncertainty and Adaptive Planning
A body of work addresses decision where the parties lack agreement on the system model, on the
distributions over its inputs, or on the outcomes that matter (Marchau, Vincent A. W. J., Warren E. Wal, n.d.). Robust decision
making (Lempert, Robert J. “Robust Decision Mak, n.d.) seeks strategies performing acceptably across many plausible futures
in place of optimising against a predicted one. Dynamic adaptive policy pathways
(Haasnoot, Marjolijn, Andrew Warren, and , n.d.) designs a plan as a sequence of options with conditions, specifying in
advance the observable signals at which the plan switches from one pathway to another.
The last of these is the nearest ancestor of the conclusions drawn in Part VII, and its boundary
is precise. The pathways approach handles uncertainty about the future by pre-specifying signals
whose observation triggers adaptation. It presupposes that the signals are observable when they
occur and that their observation is timely enough for the switch to be made. The present
requirement bears on that presupposition: a signal is observed through the same apparatus that
produces the rest of the evidence base, with the same production interval, and a trigger
evaluated on a lagged signal fires late by the length of the lag. The family handles uncertainty
about futures, and the present paper concerns uncertainty about the present.
5.8 The Residue Left by Prior Formulations
The formulations surveyed cover a great deal of the territory, and the claim of this paper is
confined to what they leave.
Claim5.1The unclaimed residue
Where a body of evidence is internally valid, where the causal relation it establishes is stable
and holds at the moment of decision, where the target population, the intervention, the
comparator and the outcome are specified identically to those of the studies, and where the
context of application is the context of production, the evidence may still fail correspondence
in the sense of Definition 4.3, and no assessment instrument surveyed here supplies a ground on
which the failure is recorded.
The class is not marginal. It contains every decision taken about a system that has moved since
it was measured, which is to say every decision taken about a system in motion. The temporal
validity literature registers the difficulty for causal estimates transported to a future target
and directs the response toward research strategy. The external validity literature registers it
for settings separated in space. Policy economics and the cybernetic tradition register it as a
parameter of governing behaviour. The clinical work measures its rate and answers it with a
schedule of revision. The politics of evidence concerns the interests shaping evidence use. The
deep uncertainty family addresses uncertainty about what is to come. What remains unaddressed is the standing of a particular body of evidence
in support of a particular decision at the moment the decision is taken, and it is that standing
that Parts III to V examine by comparison with a science whose observations are historical by
construction.
6. Observation Under Lookback in Astrophysical Practice
This section describes the comparison case and justifies the comparison. Its objective is to
establish that astrophysics stands in the same structural relation to its object as governance
stands to a governed system, to set out what that discipline has done about the relation, and to
state in advance the respects in which the two situations differ, so that the transfer tests of
Parts III to V run against a boundary fixed beforehand. The section proceeds by describing the
observational condition, identifying the concession the discipline has made in response to it,
enumerating the elements of practice that the remainder of the paper examines, and setting out
the correspondences and the disanalogies.
6.1 The Observational Condition
Astrophysical objects are accessible through radiation and through other signals that propagate
at finite speed. An object at distance $d$ is observed as it stood approximately $d/c$ earlier,
and the interval is called the lookback time. The interval is a property of the observing
situation and survives every improvement in instruments: a better telescope collects more of the
signal that has arrived and creates no channel by which a signal might arrive sooner. An
observer therefore has access to a hypersurface through the history of the universe, the past
light cone of the observation event, on which objects at different distances appear at different
epochs.
Three features of this condition are worth isolating, since they are the features that recur in
governance.
The delay is structural. It follows from the geometry of the observing situation and from a
constant of nature, and no expenditure removes it.
The observed collection is heterochronous. An image of the sky assembles objects observed at
many different epochs into a single frame, and the frame therefore depicts no single moment. The
apparent simultaneity of the display is an artefact of the display.
The object continues to evolve during the interval. A galaxy observed as it stood eight billion
years ago has undergone eight billion years of evolution that the observation does not record,
and inferences about its present condition are inferences and not observations.
6.2 The Concession of the Present Tense
The response of the discipline to this condition is worth stating as a matter of language before
it is stated as a matter of method, because the linguistic form is the more consequential of the
two.
Astrophysics has given up the present tense about its objects. A well-formed astrophysical
statement carries an epoch: a quantity is reported at a redshift, a property is attributed to a
population at a stated cosmic time, and a claim about how an object stands now is marked as an
extrapolation and defended as such. The discipline does not report that a distant quasar is
accreting at a given rate. It reports that the quasar was accreting at that rate at the epoch
observed, and any claim about the present is carried by a model that is named.
The concession is a loss, and the discipline absorbed it. What it purchased is that every
inference from observation to present condition became visible as an inference, which is to say
that it acquired an assumption, a defender, and a place where an objection can be lodged.
Section 27 returns to this point and argues that it is the element of astrophysical
practice with the largest bearing on governance, since evidence in governance is ordinarily
reported in a present tense that its production interval does not support.
6.3 The Elements Examined
The methods and observing disciplines by which astrophysics works under the lookback condition
are examined individually in Parts III to V, in three families.
The first family concerns the reconstruction of a past state from a present signal, and contains
inverse inference from the received signal to a distribution over source conditions; forward
modelling, in which an assumed state is evolved and the resulting predicted observation compared
with the actual one; the propagation of uncertainty alongside the propagation of state; data
assimilation, in which a running model is corrected by arriving observations; and retrodiction
with consistency checking, in which evidence from separated epochs is required to cohere through
the dynamics connecting them.
The second family concerns constraints imposed by the observing situation itself, and contains
the past light cone and the heterochrony it produces; the horizon, beyond which observation is
unavailable in principle; selection effects that grow with distance, so that the sample observed
at depth is systematically unrepresentative; the cadence of a survey, which determines what
classes of variation are detectable at all; the single realisation of the universe and the
ergodic substitution by which cosmology partly escapes it; and standard rulers, features of
known extent used to calibrate across epochs.
The third family concerns the self-discipline of the observing community, and contains blind
analysis, in which the result is concealed from the analyst until the analysis is fixed
(Klein, Joshua R., and Aaron Roodman. “B, 2005); the recording of provenance and the re-reduction of archival data under
improved calibration; the construction of mock observations, in which a simulated universe is
passed through a simulated instrument and pipeline so that the measurement system is tested and
not only the model (Cranmer, Kyle, Johann Brehmer, and Gille, 2020); and the calibration of distance ladders, together with
the discipline’s handling of persistent disagreement between independent measurement routes
(Verde, Licia, Tommaso Treu, and Adam G. , 2019).
6.4 Notation for the Comparison
The examinations of Parts III to V use a common notation, fixed here so that the presupposition
identified in each case may be stated as a condition on an object in it.
Let $x(t) \in \mathcal{X}$ denote the condition of the system under study and $\theta$ the
parameters of its dynamics and of the process by which it is observed. Let
$$F_{\Delta}: \mathcal{X} \to \mathcal{X}, \qquad x(t+\Delta) = F_{\Delta}\bigl(x(t);\theta\bigr),$$
denote the flow carrying a condition forward by an interval $\Delta$, and let
$$h: \mathcal{X} \to \mathcal{Y}, \qquad y = h(x;\theta) + \varepsilon,$$
denote the observation operator carrying a condition to a recorded quantity, with $\varepsilon$
the error of the recording. In astrophysics the flow of Equation 1 is supplied by
physical theory and the operator of Equation 2 by the physics of emission, propagation
and instrumentation. In governance the flow is the unstated account of how the governed system
evolves and the operator is the measurement system: the definitions, the sampling frame, the
recording practice and the processing described in §2.3.
The temporal indices are those of Definition 4.1. An item of evidence $e_i$ carries a reference
time $t_{e,i}$ and a governance lookback time $\tau_{G,i} = t_d - t_{e,i}$, and an evidence base
is written $E = {e_i}$ with the lookback profile ${\tau_{G,i}}$ of Definition 4.7.
Table 1 states the six approaches by which astrophysics works under the
lookback condition, together with the operation each performs in this notation and the position
each occupies in governance. The table is a summary of the material examined in
Sections 9 to 14 and settles nothing by itself.
| @p2.6cmp5.1cmp5.1cm@
| Approach | Operation in astrophysics | Position in governance | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Inverse inference | $y \mapsto p(x,\theta \mid y) \propto p(y \mid x,\theta),p(x,\theta)$ | $E \mapsto p\bigl(x(t_e) \mid E\bigr)$, with $h$ constituted administratively | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Forward modelling | $x(t_0) \xrightarrow{F_{\Delta}} x(t_1)$, then $\hat y = h(x(t_1))$ compared with $y$ | articulated mechanism $\mapsto$ predicted evidence stream, compared with the recorded one | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Uncertainty propagation | $p(x(t_0)) \mapsto (F_{\Delta})_, p\bigl(x(t_0)\bigr),$$
with the parameters $\theta$ varied across an ensemble so that uncertainty about the dynamics is Two elements of the practice bear on the transfer. Uncertainty in the model is carried alongside 10.2 Presuppositions of the PropagationThree conditions are required. A dynamical law is available through which to propagate. The error structure is specified well enough that the propagated distribution means something, The uncertainty in the model is representable by variation within a family. Ensembles explore All three admit failure. The first fails where no law is available. The second fails where the 10.3 The Governance CounterpartPolicy evidence is ordinarily reported with an interval. A survey estimate carries a sampling The observation to be made about that counterpart is that the operation is absent, and its Claim10.1Misattribution of the reported interval The claim is a statement about a mismatch of reference and admits a direct illustration. A 10.4 Status of the Presuppositions in GovernanceThe first presupposition fails generally. Governance possesses no dynamical law for the systems The second fails in a specific and consequential way. Where a propagation is attempted, the The third fails without qualification. The space of candidate models for a governed system is 10.5 The Transferable ResidueThe element yields a concept and an ordering, and withholds a magnitude. Definition10.2Evidence horizon $$H(E,\mathcal{A}) ;=; \sup\bigl{, \Delta \ge 0 ;:; the interval beyond the reference time after which the distribution over conditions consistent The horizon of Equation 10 inherits the decision-relativity of Definition 4.3 and Two results attach to the definition, and they differ in strength. Claim10.3Measurability in a bounded domain Claim10.4Ordering under sensitivity Claim 10.4 requires a restriction that is stated here and observed throughout. The ordering is Assignment10.5Class of the element 11. Data Assimilation and the Observability ConditionThis section examines the element that most directly promises what governance appears to want, a 11.1 The Structure of the Practice in Astrophysics and Its NeighboursData assimilation maintains an estimate of the condition of a system by alternating two $$\hat x^{-}{t} = F{\Delta}\bigl(\hat x^{+}{t-1}\bigr), where $\nu_t$ is the innovation, the discrepancy between the observation anticipated and the one The practice belongs most centrally to numerical weather prediction and to the earth and space 11.2 Presuppositions of AssimilationThree conditions are required, and the first is the one that matters. The system is observable through the available measurements. Observability is a structural $$\mathcal{O} = \bigl(h,; h \circ F_{\Delta},; h \circ F_{2\Delta},; \dots \bigr)$$ for the map carrying a condition to the sequence of observations it would generate, the system is A dynamical model is available with which to advance the estimate between observations. The relative confidence attaching to the forecast and to the observation is correctly specified. All three admit failure, and the third fails in a direction with a name. 11.3 The Governance CounterpartThe counterpart is any arrangement maintaining a running account of the condition of a governed 11.4 Status of the Presuppositions in GovernanceThe first presupposition fails for a substantial part of what governance would need to know, and Proposition11.1The observability partition $$p\bigl(x_{\mathcal{N}} \mid y_{0:t}\bigr) = p\bigl(x_{\mathcal{N}}\bigr) so that the posterior equals the prior however long the observation continues. No increase in the Equation 13 converts a familiar counsel into a condition on method. The recommendation that The partition has two boundaries, and their difference is consequential. Claim11.2The inner and the outer boundary The claim links the two failures of Part III. A party may enlarge the unobservable region by The second presupposition fails for the reasons recorded in Section 11. The third presupposition fails in a direction with a documented pathology. Claim11.3Hardening of the estimate under understated model error The counterpart is worth stating carefully, since a metaphor drawn from a filter would be an 11.5 The Transferable ResidueThe element yields one requirement, and it costs no apparatus because it discards the estimator Requirement11.4Monitoring of the residual Three features recommend the requirement. It presupposes no dynamical model, since the What fails to survive is the estimator. A governing arrangement is not in a position to maintain Assignment11.5Class of the element 12. Retrodiction and Cross-Epoch ConsistencyThis section examines the last element of the first family, the practice of requiring evidence 12.1 The Structure of the Practice in AstrophysicsCosmology holds evidence from widely separated epochs. The microwave background records $$F_{t_2 - t_1}\bigl(\hat x(t_1)\bigr) ;\overset{?}{=}; \hat x(t_2),$$ within the uncertainties attaching to each. Disagreement indicts the model, the parameters or the assumptions, and the location of The comparison of Equation 14 treats each epoch as a separate constraint on one 12.2 Presuppositions of the Consistency CheckTwo conditions are required. A dynamics is available through which evidence from one epoch can be projected onto another, so The system is one system. The evidence from separated epochs concerns the same object at The first admits failure where no dynamics is available. The second admits failure where the 12.3 The Governance CounterpartThe counterpart is the synthesis of a body of studies into a single estimate, which is the The temporal structure of this operation is worth stating explicitly, since it is ordinarily Claim12.1Pooling across epochs under an invariance assumption 12.4 Status of the Presuppositions in GovernanceThe first presupposition fails, for the reasons established in The second holds, and its holding is what makes this element transfer. Studies conducted at What follows is a modification of the astrophysical procedure in a direction the absence of 12.5 The Transferable ResidueThe element yields a requirement, and the requirement bears on an established procedure. Requirement12.2Temporal consistency in place of temporal pooling The instruments for such an examination exist and require no development. Cumulative synthesis, The change of interpretation is where the paper’s claim meets a substantial existing literature, Claim12.3Underdetermination of the temporal trend The claim states a research problem and supplies no solution, which is the honest position. Three The applied consequence stands independently of the resolution of Claim 12.3, and it is worth Assignment12.4Class of the element 13. The Past Light Cone and the Temporal Heterogeneity of the Evidence BaseThis section opens the second family, which concerns constraints imposed by the observing 13.1 The Structure of the Situation in AstrophysicsAn observation event $O$ has a past light cone $\mathcal{L}^{-}(O)$, and what is observable at $$\bigl{, y_i = h\bigl(x_i(t - \tau_i)\bigr) ,\bigr}_{i}, \qquad \tau_i \approx d_i / c ,$$ and the catalogue depicts no moment. Astrophysics handles this by carrying the epoch with the datum. A source is recorded with its 13.2 Presuppositions of the HandlingTwo conditions are required. The interval attaching to each datum is known. It follows from a measured distance and a constant The intervals are commensurable. Two sources at different redshifts are located on a common time Both admit failure. The first fails where the interval attaching to a datum is unrecorded or 13.3 The Governance CounterpartThe evidence base of a governing party has the same structure and lacks the handling. A decision The presentation ordinarily suppresses this. A dashboard displays indicators side by side, and 13.4 Status of the Presuppositions in GovernanceThe first fails in practice. Reference periods are recorded in statistical documentation and are The second fails more deeply, and the failure is structural. Reference times in governance are The consequence for the correspondence requirement is direct. Definition 4.2 defines the 13.5 The Transferable ResidueThe handling does not transfer, and the situation yields a finding. Claim13.1Direction of the recency preference The claim becomes consequential when joined to a feature of systems approaching a transition. The Claim13.2Blindness of a recency-weighted base The claim requires two restrictions. It concerns the composition of a base and not the quality of What survives as a requirement is modest and follows from the first presupposition alone: an Assignment13.3Class of the element 14. The Horizon and the Limits of Observability in PrincipleThis section examines a feature of the observing situation distinct from the delay treated in 14.1 The Structure of the Situation in AstrophysicsThe past light cone bounds what an observer can have received. Regions of the universe lie Two features distinguish this from lookback. Lookback concerns material that has arrived and Astrophysics states its horizons explicitly and reasons about what lies beyond them by 14.2 Presuppositions of the HandlingOne condition is required, and it is a condition on the observer. The location of the horizon is determinable. An observer can say which material lies inside the The condition admits failure where the boundary is undetermined, in which case claims about the 14.3 The Governance CounterpartThe counterpart is the region identified by Proposition 11.1, on which the instituted Three kinds of content ordinarily occupy the region. There are quantities no instrument 14.4 Status of the Presupposition in GovernanceThe condition fails in practice and is satisfiable in principle, which is why the element It fails in practice because the boundary is ordinarily undeclared. A briefing states what is It is satisfiable in principle because the boundary is determinable by inspection of the 14.5 The Transferable ResidueThe element yields a requirement and a distinction, and both are available at the cost of Requirement14.1Declaration of the unobserved region Claim14.2Standing of a claim beyond the boundary The distinction between the two boundaries of Claim 11.2 acquires its practical form here. Where The requirement carries one consequence worth stating, since it bears against a party that Assignment14.3Class of the element 15. Selection at Depth and the Compounding of Age with SelectivityThis section examines a feature of observation at distance that has no counterpart in the 15.1 The Structure of the Situation in AstrophysicsA survey complete to a limiting apparent brightness detects, at greater distance, only objects of Its structure is what matters here. Depth in such a survey is lookback, so the same coordinate Astrophysics corrects by characterising the selection. Where the luminosity distribution of the 15.2 Presuppositions of the CorrectionTwo conditions are required. The selection function is characterisable. What entered the sample and what failed to enter is The selection operates on a stated dimension. Objects are excluded on a property that is Both admit failure. The first fails where the process determining what entered the record is 15.3 The Governance CounterpartThe counterpart is the dependence of an evidence base’s composition on the age of its contents, What was recorded at a past time was determined by what the then-current measurement system What survives from a past time is a subset of what was recorded, and the subset is not random. What was published from a past time is a subset of what was found, and the selection operating on 15.4 Status of the Presuppositions in GovernanceThe first fails. The process determining what entered and remained in the historical record of a The second fails as well, and its failure is the more consequential. Exclusion from the The claim that follows is the section’s result. Claim15.1Association of age with selectivity The association has a consequence for the operation examined in Section 13. A 15.5 The Transferable ResidueThe correction does not transfer. What transfers is the recognition that the defect exists and Requirement15.2Statement of the recording régime The requirement is weaker than the astrophysical correction and is what the failure of the two One further observation belongs here, since it bears on the strength of the claim. The three Assignment15.3Class of the element 16. Survey Cadence, Aliasing, and the Fabrication of TrendThis section examines the constraint that a schedule of observation places on what can be 16.1 The Structure of the Constraint in AstrophysicsA survey observes on a cadence: a sampling interval, a total baseline, and a pattern of gaps The formal statement of the limit is standard. A signal sampled at regular intervals of length $$f < \frac{1}{2\Delta},$$ so that variation with periods shorter than $2\Delta$ is indistinguishable from variation at a Survey design accordingly proceeds from a statement of the phenomena the survey is intended to 16.2 Presuppositions of the HandlingTwo conditions are required. The cadence is set against a stated class of target phenomena, so that what the design excludes The sampling structure is known well enough that the limit and the aliasing pattern are The first admits failure where the schedule is fixed by considerations unrelated to the 16.3 The Governance CounterpartThe counterpart is the release schedule of a statistical system. National accounts appear The correspondence is exact and the practice differs at both presuppositions. 16.4 Status of the Presuppositions in GovernanceThe first fails generally. Release schedules are set by administrative convention, by the fiscal The second, by contrast, is satisfied and unused. The release schedule is documented, so the Claim16.1Determination of the observable class by the schedule Claim16.2Fabrication of slow structure from fast variation The second claim bears directly on the correspondence requirement, and the bearing is worth 16.5 The Transferable ResidueThe element yields a requirement whose satisfaction requires arithmetic and no apparatus, and it Requirement16.3Statement of the resolution limit Claim16.4Defect at each end of the composition Claim 16.4 states the compound and requires the same restriction as its components. The Assignment16.5Class of the element 17. Single Realisation and the Unavailability of an Ergodic SubstituteThis section examines the condition of holding one instance of the object studied. Its objective 17.1 The Structure of the Condition in AstrophysicsCosmology studies one universe. A theory of the early universe predicts a distribution of The discipline escapes this condition in part by a substitution. Under the assumption that the 17.2 Presuppositions of the SubstitutionTwo conditions are required. The parts are drawn from a common distribution, so that the variation observed across them is the The parts are approximately independent, so that averaging across them reduces the uncertainty in The first fails where the parts differ systematically. The second fails where they influence one 17.3 The Governance CounterpartGovernance holds one history of the system it governs. The counterpart of the cosmological 17.4 Status of the Presuppositions in GovernanceBoth fail, and they fail for reasons that the literature reviewed in §5.2 has established The first fails because jurisdictions differ in the support factors on which an intervention’s The second fails because the cases influence one another. Jurisdictions imitate one another’s Claim17.1Unavailability of the ergodic substitute 17.5 The Transferable ResidueThe substitution does not transfer and the recognition of the floor does. Claim17.2An irreducible component of the uncertainty The claim is offered as a restriction on what improved evidence can deliver, and its practical What remains is the trade between the two escapes, and it is the subject of Assignment17.3Class of the element 18. Standard Rulers and the Drift of Measurement DefinitionsThis section closes the second family with the element that bears most directly on the third mode 18.1 The Structure of the Practice in AstrophysicsComparison across epochs requires a quantity whose meaning is stable across them. Cosmology The property that makes such a feature useful is worth isolating. Its extent is determined by 18.2 Presuppositions of the CalibrationTwo conditions are required. The reference is invariant across the epochs compared, or its variation is known and corrected. The reference is administered by no party to the comparison, so that its stability requires no The first fails where the reference changes. The second fails where the reference is a 18.3 The Governance CounterpartGovernance possesses no reference of this kind, and its counterpart is the definition. Whether a Such definitions perform the office of the standard ruler: they fix what a measured value means 18.4 Status of the Presuppositions in GovernanceThe first fails routinely and the failures are documented, since a statistical agency revising a The second fails structurally, and its failure is the one this paper adds to the familiar Claim18.1Attribution under a revised definition The claim completes the treatment of the mode of failure named in articulation at A further consequence bears on the interval itself, and it was anticipated in 18.5 The Transferable ResidueThe element transfers as a requirement and withholds the property that makes the astrophysical Requirement18.2Statement of definitional vintage The requirement is satisfiable from documentation that statistical agencies already produce, and What does not transfer is the invariance itself. Governance has no quantity whose meaning is Assignment18.3Class of the element 19. Blind Analysis and the Interested ObserverThis section opens the third family, which concerns the disciplines an observing community 19.1 The Structure of the Practice in PhysicsA blind analysis withholds the result from the analyst until the procedure that produces it has The rationale is a claim about a mechanism and not about the honesty of analysts. An analyst who 19.2 Presuppositions of the PracticeThree conditions are required. The analytical procedure can be fixed before the result is seen, which requires that the The result can be concealed from the analyst, which requires that it be unavailable through The community accepts the result the fixed procedure produces, which requires that no party hold The first fails where the analysis is exploratory and its decisions arise from the data. The 19.3 The Governance CounterpartThe counterpart is the analysis of evidence bearing on a policy whose outcome a party has an Two established practices occupy positions adjacent to blinding. Pre-registration fixes the 19.4 Status of the Presuppositions in GovernanceThe first is satisfiable for a defined and substantial class. Where a question is stated in The first fails for the complementary class. Where the object is to characterise a situation The second is satisfiable with effort and is frequently violated in fact. A governing arrangement The third is where the practice meets its principal obstacle. Acceptance of a result the fixed Claim19.1Displacement of the selection 19.5 The Transferable ResidueThe element transfers, with a restriction of range and an addition that the governance setting Requirement19.2Fixed procedure and complete record The addition in the second sentence is what Claim 19.1 requires, and it is the point at which the The requirement costs no apparatus and costs something else, which should be stated plainly. It Assignment19.3Class of the element 20. Provenance, Re-Reduction, and the Time-Indexed Evidence RecordThis section examines the practices by which an observing community preserves the conditions 20.1 The Structure of the Practice in AstrophysicsObservations are retained in a form independent of the processing applied to them, together with The operation this makes possible is re-reduction. An archive processed under a later 20.2 Presuppositions of the PracticeTwo conditions are required. The raw observation is retained separately from its processed form, so that a later processing The conditions of production are recorded with the observation in sufficient detail that a later Both admit failure. The first fails where only processed values are kept. The second fails where 20.3 The Governance CounterpartStatistical systems satisfy both conditions at origin and to a substantial degree. Microdata are The failure occurs downstream. A value assembled into a briefing, a dashboard, a review sheet or 20.4 Status of the Presuppositions in GovernanceBoth are satisfied at origin and both fail at the point of use, and the location of the failure The failure is not a failure of the statistical system. An agency that documents its The consequence is that the qualifications developed in the preceding sections are unavailable at 20.5 The Transferable ResidueThe element transfers as a record structure, and the structure collects the requirements of the Requirement20.1The indexed evidence item The requirement collects Requirement 16.3, Requirement 18.2 and the recording obligation Three features of the requirement are worth stating. Its cost falls on the transmission chain and not on collection. Nothing new is measured, and the Its violation is detectable by inspection. A briefing can be examined for whether its figures Its satisfaction is asymmetric in time. An index recorded at origin is cheap and an index Claim20.2The assessment of past decisions The claim connects the requirement to a matter beyond epistemology. Where governing parties are Assignment20.3Class of the element 21. Mock Pipelines and the Testing of the Measurement SystemThis section examines the practice of testing an analysis by applying it to synthetic data whose 21.1 The Structure of the Practice in AstrophysicsA mock catalogue is a synthetic universe generated under a stated model, from which a synthetic The distinction that matters is between simulating the world and simulating the observation of 21.2 Presuppositions of the PracticeTwo conditions are required. The measurement system is simulable, so that the transformation from a condition of the world to A ground truth can be posited, so that the output of the analysis has something to be compared The first fails where the transformation is undocumented. The second fails where no statement of 21.3 The Governance CounterpartThe governance counterpart is the simulation of a statistical or administrative measurement Policy analysis simulates models of governed systems: microsimulation of a tax and benefit The nearest existing practice is the power calculation, which asks whether a study of a stated 21.4 Status of the Presuppositions in GovernanceBoth are satisfiable, and their satisfaction is what places this element in the transferring The first is satisfiable because statistical systems document their transformations. A sampling The second is satisfiable in the specific form the test needs. The requirement is a posited 21.5 The Transferable ResidueThe element transfers, and its transfer converts three earlier findings into a testable Requirement21.1Recovery test of the measurement system The requirement operationalises what Part IV established by argument. Claim 16.1 held that the Two features distinguish the requirement from the others in Part V. It is the only one whose The limit of the requirement follows from the first presupposition. A simulation of a measurement Assignment21.2Class of the element 22. Ladder Calibration and the Retention of Persistent TensionThis section closes the third family with the practice by which a discipline handles two 22.1 The Structure of the Practice in AstrophysicsDistances in cosmology are established by calibrated chains, each rung of which is anchored to The handling of that disagreement is what concerns the present argument. The disciplines have not 22.2 Presuppositions of the PracticeThree conditions are required. The routes are genuinely independent, so that a disagreement between them bears on something The uncertainties are stated well enough that a disagreement can be distinguished from a No party holds authority to require a single number, so that the disagreement may be retained Each admits failure. The first fails where the routes share a calibration or a frame. The second 22.3 The Governance CounterpartGovernance frequently possesses two routes to one quantity. Employment is measured by a household The routes disagree, and the disagreements are documented by the agencies producing them. What 22.4 Status of the Presuppositions in GovernanceThe first is partly satisfied. The routes named above differ in frame and in method to a degree The second is partly satisfied. Sampling uncertainty is stated for survey routes; the uncertainty The third fails, and its failure is the section’s principal finding on the negative side. A 22.5 The Transferable ResidueThe practice transfers as a requirement, and the comparison yields one result of a kind the rest Requirement22.1Retention of a disagreement between routes Claim22.2Information carried by a disagreement between routes of differing age The claim requires care, and three restrictions belong with it. It supplies a comparison and no absolute quantity. What is recovered is the change over the Its estimation requires periods of overlap, and the overlap must be one in which the two routes It rests on the frame and definitional differences being stable across the interval. Where a Subject to those restrictions the claim supplies something the paper has otherwise withheld. The Assignment22.3Class of the element 23. The Disanalogy of ReflexivityThis section opens Part VI, which assembles the results of the transfer tests. Its subject is the 23.1 The Interval in Its Coupling FormAn astrophysical source emits, the signal propagates, and the observer receives. Nothing the A governing party observes in order to act, and acts on the system it observes. The condition Claim23.1The interval as a coupling The claim has a consequence for Requirement 11.4. The residual monitoring recommended there 23.2 Inversion of the Lag Under AnticipationThe second element of the disanalogy produces an effect with no counterpart at all in the Parties within a governed system read descriptions of that system, including descriptions Claim23.2Anticipatory inversion The claim bears against a natural reading of the correspondence requirement. Sections 5 through 19 have treated the problem as one of evidence describing a The phenomenon is documented in domains where anticipation is strong. Announcements of tax 23.3 The Constitution of the Object by Its DescriptionA third element completes the disanalogy. The categories through which a governed system is Claim23.3Reconstruction under constitution Claim 23.3 supplies the general form of the failure that Section 9 and 23.4 Conditions Under Which the Disanalogy Is WeakA claim of this generality requires a boundary, and the boundary is stated in terms of what Reflexivity requires that parties within the system have access to the description, that they Three classes of governance question satisfy the conditions weakly. Physical and ecological The boundary has a consequence worth recording. The elements of Part III whose failure was 24. The Ensemble and the Time SeriesThis section states the paper’s principal negative result. Its objective is to establish that the 24.1 The Conversion of Lookback into an InstrumentThe condition described in Section 7 is a limitation, and astrophysics has made it The manoeuvre substitutes an ensemble for a time series. A time series of one object over the 24.2 The Requirement of the SubstitutionThe substitution requires that the instances be instances of one thing. Where objects at Section 18 recorded the two conditions in the form the cosmological case requires, 24.3 The Trade Between the Two MismatchesGovernance holds one system and one history. Its available substitute for an ensemble is Proposition24.1The trade between temporal and contextual mismatch The proposition is stated as a trade and not as an impossibility, and the distinction matters. 24.4 Consequences of the TradeThree consequences follow, and the third is the sharpest. Claim24.2The undeclared choice Claim24.3Ambiguity in the demand for further evidence Claim24.4Simultaneous incurrence in meta-analytic synthesis Claim 24.4 completes the argument begun at Claim 12.1 and identifies why the operation examined 24.5 The Position the Result LeavesThe result is negative and its consequence for the paper’s conclusion is direct. Where a decision concerns a system’s present condition, the evidence available describes that The result also fixes the limit of the paper’s comparison. Astrophysics has been used throughout 25. The Classification of Transfer FailuresThis section assembles the assignments recorded at the close of each element section and states | @p4.5cmp6.4cml@
Table. Classification of the fifteen elements by the presupposition that fails in governance. 25.1 The Distribution of Primary AssignmentsTable 2 records the assignments. Read by primary class, five elements fall The distribution across families is the feature that carries the argument. The first family, the The pattern admits a statement that does not depend on the counts. Claim25.1The line the classification draws 25.2 Class III Read Across the TableClass iii appears twice as a primary assignment and seven times as a secondary one, and Where the interested observer is the primary failure, the element requires a measurement Claim25.2Interest as a modifier Claim 25.2 identifies the respect in which the class iv results are weaker than their 25.3 Class II Read Across the TableClass ii appears once as a primary assignment, and the appearance understates the reach The reason is a feature of the classification. An element is assigned to class ii where The counts therefore understate class ii and the table should be read with 25.4 The Character of the Transferable RequirementsThe elements assigned primarily to class iv yield the following requirements: Claim25.3The character of the transferable Claim 25.3 states the result the paper has been assembling and hands it to Part VII. Its two 26. Grammatical Tense and the Displacement of ResponsibilityThis section closes Part VI with the element of astrophysical practice identified at §6.2 as 26.1 The Concession RestatedAstrophysics reports its objects in the past tense of a stated epoch. A quantity is given at a Three things follow from that discipline, and they were stated at §6.2 in a form the present 26.2 The Tense of Policy EvidencePolicy evidence speaks in the present. An unemployment rate is reported as what unemployment is; Claim26.1Surplus of the grammatical form over the warrant The claim is modest in what it asserts and consequential in what follows. It does not hold that 26.3 The Connection to the Displacement of ResponsibilitySection 4 recorded as the third established limitation that an appeal to Claim26.2Dependence of the displacement on the tense One consequence of the claim belongs with the account given in Section 4. The claim also identifies the point at which the present paper meets the analysis of the 26.4 The Requirement and Its WeaknessRequirement26.3Tense of a report of condition The requirement costs nothing in apparatus and it is the weakest of the paper’s requirements in a Its value lies elsewhere and is worth stating precisely. It relocates the inference from the One objection deserves an answer. It may be held that governing arrangements require assertive 27. The Partition of the State Space and the Domain of EstimationThis section opens Part VII by stating the consequence of Proposition 11.1 for the standing of 27.1 The Region in Which Estimation Is LegitimateWhere the quantities bearing on a decision lie within the component recoverable from the Epidemic surveillance is the standing instance and its standing is literal. The estimation of Claim27.1The domain of legitimate estimation Two features of the claim are worth stating. Its three conditions are conjunctive, so a domain 27.2 The Region in Which the Question Does Not AriseWhere the quantities bearing on a decision lie in the unobservable component, no estimate of their Claim27.2Priority of the partition over the choice of method The claim supplies the answer to a question the introduction left open. Section 2 27.3 The Obligation at the BoundaryThe boundary between the regions is partly a matter of what the world permits and partly a matter Requirement 14.1 stated the obligation in its general form: an account of a system’s condition Claim27.3Attribution of the boundary The claim gives the partition its political form. An arrangement may enlarge the unobservable 28. Restraint Under Temporal Correspondence FailureThis section states the paper’s normative content. Its objective is to convert the findings of 28.1 The CriterionCriterion28.1Allocation of the burden under correspondence failure Three terms carry the criterion and are fixed here. A course is anything a party may do, including declining to act, and the subsection on symmetry below states why Substantial irreversibility concerns the effects and is relative to available means and Correspondence failure is established by the conditions of the following subsection and 28.2 The Conditions Establishing FailureThe transfer tests supply six determinate conditions, each of which was derived in its own The interval exceeds the evidence horizon of Definition 10.2 and Equation 10, so the A quantity on which the choice turns lies in the unobservable component of Proposition 11.1 and The residual sequence of Requirement 11.4 exhibits consistent sign or growing magnitude, so the The estimates constituting the evidence base exhibit trend by reference date under The recovery test of Requirement 21.1 fails, so the source relied upon would not register the Two routes to a quantity disagree beyond their stated uncertainties under Requirement 22.1, and The list is a set of sufficient conditions and makes no claim to completeness. Each is 28.3 Symmetry Across Acting and DecliningThe criterion is stated over courses, and the inclusion of deferral within that term is required Claim28.2Irreversibility on the side of delay The consequence for the present criterion is direct and is the paper’s principal protection 28.4 The Discharge of the BurdenThe burden is argumentative and is discharged by argument, since by hypothesis the evidence does The fourth element is Requirement 9.2 operating as a component of discharge, and it is what keeps 28.5 Differentiation from PrecautionThe criterion resembles the precautionary principle and differs from it on two axes, and the Its trigger is narrower. Precaution in its familiar forms fires on uncertainty together with the Its consequence is weaker. Precaution in its strong forms operates as a bar, requiring a The pairing of a narrower trigger with a weaker consequence is what permits the criterion to 28.6 The Positive RecommendationThe argument supports one recommendation that is more than a discipline of reporting, and it Production intervals and sampling intervals are set by administrative convention and by the cost Claim28.3Measurement effort as a governance choice The claim is the one place at which the paper recommends the expenditure of resources, and the 29. Scope, Residue, and DirectionsThis section states what the paper establishes, what it withholds, and where its arguments are 29.1 The Boundary of the ClaimsThe paper establishes that the instruments by which evidence-based policy making assesses It establishes that the requirement is independent of the problem of induction, in the sense that It establishes, by comparison with a discipline whose observations are historical by It establishes that the manoeuvre by which that discipline converts its lookback condition into It establishes nothing about astrophysics, proposes no method, supplies no measure of staleness, 29.2 The Weakest PointsFour weaknesses are stated here by the paper, in preference to leaving them to be found in it. The requirements yielded by the transfer test are self-imposed. Claim 25.2 established that the The criterion of Section 29 fires on a property whose instantiation is The paper supplies no procedure and administers its requirements through no office, and the cost The association on which two of the paper’s sharper claims rest is empirical and contingent. 29.3 Questions the Argument Raises and Leaves OpenFour questions are recorded, in descending order of tractability. Claim 22.2 supplies a means of estimating the movement of a quantity over an interval from the Claim 12.3 identified the underdetermination of a temporal trend in pooled estimates between the Claim 23.2 established that anticipation places effects of an intervention at reference times The evidence horizon of Definition 10.2 has been defined, shown measurable in one domain, and 29.4 The PositionEvidence describes a condition a system occupied. Governance acts on the condition a system A discipline that met the same condition in a purer form gave up the present tense about its Where the recovery is unavailable and the effects of a course are irreversible, what remains is ReferencesBareinboim, Elias, and Judea Pearl. “Causal Inference and the Data-Fusion Problem.” Proceedings of the National Academy of Sciences 113, no. 27 (2016): 7345–7352. Campbell, Donald T. “Assessing the Impact of Planned Social Change.” Evaluation and Program Planning 2, no. 1 (1979): 67–90. Cabinet Office, Government of Japan. “Naikakufu ni okeru EBPM e no torikumi” [Efforts toward EBPM in the Cabinet Office]. https://www.cao.go.jp/others/kichou/ebpm/ebpm.html (accessed 19 August 2026). Cartwright, Nancy, and Jeremy Hardie. Evidence-Based Policy: A Practical Guide to Doing It Better. Oxford: Oxford University Press, 2012. Schünemann, Holger J., Julian P. T. Higgins, Gunn E. Vist, Paul Glasziou, Elie A. Akl, Nicole Skoetz, and Gordon H. Guyatt. “Completing Summary of Findings Tables and Grading the Certainty of the Evidence.” In Cochrane Handbook for Systematic Reviews of Interventions, chapter 14. Cochrane, current version. Cranmer, Kyle, Johann Brehmer, and Gilles Louppe. “The Frontier of Simulation-Based Inference.” Proceedings of the National Academy of Sciences 117, no. 48 (2020): 30055–30062. Croushore, Dean, and Tom Stark. “A Real-Time Data Set for Macroeconomists.” Journal of Econometrics 105 (2001): 111–130. Deaton, Angus, and Nancy Cartwright. “Understanding and Misunderstanding Randomized Controlled Trials.” Social Science and Medicine 210 (2018): 2–21. Deutsch, Karl W. The Nerves of Government: Models of Political Communication and Control. New York: Free Press of Glencoe, 1963. Egami, Naoki, and Erin Hartman. “Elements of External Validity: Framework, Design, and Analysis.” American Political Science Review (2022). Eisenstein, Daniel J., et al. “Detection of the Baryon Acoustic Peak in the Large-Scale Correlation Function of SDSS Luminous Red Galaxies.” The Astrophysical Journal 633, no. 2 (2005): 560–574. Forrester, Jay W. “Counterintuitive Behavior of Social Systems.” Technology Review 73, no. 3 (January 1971): 52–68. Friedman, Milton. “The Lag in Effect of Monetary Policy.” Journal of Political Economy 69, no. 5 (1961): 447–466. Giddens, Anthony. The Constitution of Society: Outline of the Theory of Structuration. Cambridge: Polity Press, 1984. Goodhart, Charles A. E. “Problems of Monetary Management: The U.K. Experience.” First circulated in Papers in Monetary Economics, vol. 1 (Reserve Bank of Australia, 1975); reprinted in Monetary Theory and Practice: The U.K. Experience, 91–121. London: Macmillan, 1984. Zhang, Yuqing, Pablo Alonso-Coello, Gordon H. Guyatt, et al. “GRADE Guidelines: 19. Assessing the Certainty of Evidence in the Importance of Outcomes or Values and Preferences: Risk of Bias and Indirectness.” Journal of Clinical Epidemiology (2018). Cabinet Secretariat, Government of Japan, Administrative Reform Promotion Headquarters. “EBPM no suishin” [Promotion of EBPM]. Materials of the EBPM Promotion Committee, including the EBPM policy for fiscal year 2026 adopted 17 February 2026. https://www.gyoukaku.go.jp/ebpm/index.html (accessed 19 August 2026). Haasnoot, Marjolijn, Andrew Warren, and Jan H. Kwakkel. “Dynamic Adaptive Policy Pathways (DAPP).” In Decision Making under Deep Uncertainty: From Theory to Practice, edited by Vincent A. W. J. Marchau, Warren E. Walker, Pieter J. T. M. Bloemen, and Steven W. Popper. Cham: Springer, 2019. Habermas, Jürgen. Legitimation Crisis. Translated by Thomas McCarthy. Boston: Beacon Press, 1975. Originally published as Legitimationsprobleme im Spätkapitalismus (Frankfurt: Suhrkamp, 1973). Höhle, Michael, and Matthias an der Heiden. “Bayesian Nowcasting during the STEC O104:H4 Outbreak in Germany, 2011.” Biometrics 70, no. 4 (2014): 993–1002. Hume, David. A Treatise of Human Nature. London, 1739–40. Ioannidis, John P. A. “Contradicted and Initially Stronger Effects in Highly Cited Clinical Research.” JAMA 294, no. 2 (2005): 218–228. Kalman, Rudolf E. “A New Approach to Linear Filtering and Prediction Problems.” Transactions of the ASME, Journal of Basic Engineering 82, no. 1 (1960): 35–45. Kalnay, Eugenia. Atmospheric Modeling, Data Assimilation and Predictability. Cambridge: Cambridge University Press, 2003. Klein, Joshua R., and Aaron Roodman. “Blind Analysis in Nuclear and Particle Physics.” Annual Review of Nuclear and Particle Science 55 (2005): 141–163. Lacan, Jacques. Écrits: The First Complete Edition in English. Translated by Bruce Fink. New York: W. W. Norton, 2006. Lawless, Jerald F. “Adjustments for Reporting Delays and the Prediction of Occurred but Not Reported Events.” Canadian Journal of Statistics 22 (1994): 15–31. Lempert, Robert J. “Robust Decision Making (RDM).” In Decision Making under Deep Uncertainty: From Theory to Practice, edited by Vincent A. W. J. Marchau, Warren E. Walker, Pieter J. T. M. Bloemen, and Steven W. Popper, 23–51. Cham: Springer, 2019. Lucas, Robert E., Jr. “Econometric Policy Evaluation: A Critique.” Carnegie-Rochester Conference Series on Public Policy 1 (1976): 19–46. Malmquist, Karl Gunnar. “On Some Relations in Stellar Statistics.” Meddelanden fr n Lunds Astronomiska Observatorium, Series I, no. 100 (1922); also Arkiv för Matematik, Astronomi och Fysik 16 (1922). The effect is elaborated in Malmquist’s later papers and is surveyed in P. Teerikorpi, “Observational Selection Bias Affecting the Determination of the Extragalactic Distance Scale,” Annual Review of Astronomy and Astrophysics 35 (1997): 101–136. Marchau, Vincent A. W. J., Warren E. Walker, Pieter J. T. M. Bloemen, and Steven W. Popper, eds. Decision Making under Deep Uncertainty: From Theory to Practice. Cham: Springer, 2019. Martínez García, Laura, Andrea Juliana Sanabria, et al. “The Validity of Recommendations from Clinical Guidelines: A Survival Analysis.” Canadian Medical Association Journal 186 (2014): 1211–1219. Munger, Kevin. “Temporal Validity as Meta-Science.” Research and Politics 10, no. 3 (2023). Parkhurst, Justin. The Politics of Evidence: From Evidence-Based Policy to the Good Governance of Evidence. Abingdon: Routledge, 2017. Pawson, Ray, and Nick Tilley. Realistic Evaluation. London: Sage, 1997. Reiss, Julian. “Against External Validity.” Synthese 196, no. 8 (2019): 3103–3121. Rosenzweig, Mark R., and Christopher Udry. “External Validity in a Stochastic World.” NBER Working Paper 22449, 2016. Shannon, Claude E. “Communication in the Presence of Noise.” Proceedings of the IRE 37, no. 1 (1949): 10–21. Shekelle, Paul G., Eduardo Ortiz, Shannon Rhodes, Sally C. Morton, Martin P. Eccles, Jeremy M. Grimshaw, and Steven H. Woolf. “Validity of the Agency for Healthcare Research and Quality Clinical Practice Guidelines: How Quickly Do Guidelines Become Outdated?” JAMA 286, no. 12 (2001): 1461–1467. Sterman, John D. Business Dynamics: Systems Thinking and Modeling for a Complex World. Boston: Irwin/McGraw-Hill, 2000. Verde, Licia, Tommaso Treu, and Adam G. Riess. “Tensions between the Early and the Late Universe.” Nature Astronomy 3 (2019): 891–895. thebibliography
0%
|