Random-Seed Stability

Scientific meaning

What it measures

Assesses random-seed stability using evidence appropriate to reproducibility and replication, distinguishing random uncertainty from systematic error.

Why it matters

Material weakness in random-seed stability can change the direction, magnitude, certainty, or biological interpretation of the research conclusion.

Measurement criteria

Independent repeats; between-run/site/analyst variability; concordance of effect direction and magnitude; predefined reproducibility thresholds.

Typical methods of assessment

Structured critical appraisal; quantitative estimation with uncertainty; prespecified thresholds; independent replication; sensitivity and subgroup analyses.

Computation profile

Computation mode

ContextSpecificMetricComputation

Readiness

OperationalDefinitionRequired

Formula status

ContextSpecificProtocolRequired

Method family

metric-specific quantitative or qualitative assessment

Output datatype

xsd:anySimpleType

Unit or scale

Metric-specific continuous, categorical, or ordinal scale

Numeric range

Context dependent

Directionality

ContextDependentDirection

Required inputs

• evidence_records
• assessment_context
• operational_definition
• computation_protocol_version

Optional inputs

• weights
• thresholds
• reference_standard
• expert_adjudication

Machine-readable expression

{
  "language": "BEMO-Expression-JSON",
  "operator": "external_protocol",
  "protocolRef": "REQUIRED"
}

Computation policies

Aggregation

Not specified in source; must be defined and versioned before composite use.

Normalization

None by default; any normalization must be justified, versioned, and validated.

Missing data

Must be declared before computation; report missingness; no silent imputation; perform sensitivity analysis when material.

Uncertainty required

Yes

Uncertainty method

Confidence interval, credible interval, bootstrap distribution, inter-rater reliability, or sensitivity analysis as scientifically applicable.

Confidence interval required

Yes

Threshold policy

Prespecify, justify, version, and sensitivity-test thresholds; do not derive and evaluate on the same data without correction.

Decision thresholds

No universal threshold declared

Quality control

Source provenance; input validation; duplicate control; uncertainty reporting; independent or orthogonal validation where applicable.

Calibration

As applicable; mandatory for probabilistic or normalized outputs.

Applicability and validation

Evidence object

Result / experiment / study / body of evidence, as applicable

Evidence level

Result / experiment / study / body of evidence, as applicable

Study types

All experimental, computational, clinical, and omics studies

Domain

Reproducibility and Replication

Required data sources

Context-specific; use source references, registered studies, primary data, and authoritative biomedical resources as applicable.

Validation status

Source maturity: Established; BEMO computation profile requires independent validation.

Benchmark

A representative, versioned benchmark set is required before production use.

Reference standard

Use an independent reference standard when one exists; document expert-adjudicated alternatives.

External validation required

Yes

Interpretation safeguards

Common misinterpretations

Treating random-seed stability as interchangeable with overall study quality, or interpreting a favorable value as proof that all other bias and validity domains are satisfactory.

Limitations

Depends on context, operational definition, thresholds, data quality, and evaluator judgment; it should not be used as a stand-alone summary score without domain-level evidence.

Dependency status

Not yet curated. Closely related metrics are represented; causal or computational dependencies require expert curation.

Source provenance

Source workbook

Pure_Biomedical_Evidence_Research_Metrics_Part_2(3).xlsx

Source worksheet

Biomedical Evidence Metrics

Source row

409

Source record SHA-256

c1a5a2e956afa3ff1606fb1893282ee7b8d5d3733fbd04798630fe0746f86074

Definition source

Pure_Biomedical_Evidence_Research_Metrics_Part_2(3).xlsx row 409; see source_references

Ontology IRI

https://w3id.org/bemo/BEMO_2000402

Profile IRI

https://w3id.org/bemo/profile/BEMO_2000402

SHACL shape

https://w3id.org/bemo/shapes/BEMO_2000402_AssessmentShape

Scientific references (6)

1. https://www.prisma-statement.org/prisma-2020-checklistSource framework, standard, guideline, or originSource-preserved; URL reachability not asserted by this package
2. https://www.consort-spirit.org/Source framework, standard, guideline, or originSource-preserved; URL reachability not asserted by this package
3. https://www.fged.org/projects/miameSource framework, standard, guideline, or originSource-preserved; URL reachability not asserted by this package
4. https://www.fged.org/projects/minseqe/Source framework, standard, guideline, or originSource-preserved; URL reachability not asserted by this package
5. https://www.psidev.info/miapeSource framework, standard, guideline, or originSource-preserved; URL reachability not asserted by this package
6. https://arriveguidelines.org/arrive-guidelinesSource framework, standard, guideline, or originSource-preserved; URL reachability not asserted by this package

Governance and FAIR status

Lifecycle

Candidate

Approval

Draft

Owner

BEMO Project

Curator

Unassigned

Reviewer

Unassigned

License

Pending owner approval; CC BY 4.0 recommended for OBO compatibility.

Findable

Provisional: stable local ID assigned; public namespace registration pending.

Accessible

Provisional: package is distributable; permanent public release location pending.

Interoperable

Yes: OWL 2, RDF, SKOS, SHACL, JSON-LD, CSV, and OBO-style identifiers.

Reusable

Provisional: rich metadata supplied; open-license owner approval pending.

Governance note

Candidate term pending scientific, ontology-engineering, and computation-method review.

Editor note

Source content preserved verbatim; computation metadata is a generated default and must be curated before normative use.