Reproducibility Information Completeness

Scientific meaning

What it measures

Assesses reproducibility information completeness using evidence appropriate to research transparency and reporting completeness, distinguishing random uncertainty from systematic error.

Why it matters

Material weakness in reproducibility information completeness can change the direction, magnitude, certainty, or biological interpretation of the research conclusion.

Measurement criteria

Independent repeats; between-run/site/analyst variability; concordance of effect direction and magnitude; predefined reproducibility thresholds.

Typical methods of assessment

Structured critical appraisal; quantitative estimation with uncertainty; prespecified thresholds; independent replication; sensitivity and subgroup analyses.

Computation profile

Computation mode

QuantitativeProportionComputation

Readiness

TemplateComputable

Formula status

GenericTemplateDefined

Method family

proportion estimation

Output datatype

xsd:decimal

Unit or scale

Proportion or percentage (0–1 or 0–100%)

Numeric range

0 to 1

Directionality

ContextDependentDirection

Required inputs

• numerator
• denominator
• operational_definition
• assessment_context

Optional inputs

• weight
• stratum
• confidence_level

Machine-readable expression

{
  "language": "BEMO-Expression-JSON",
  "operator": "divide",
  "arguments": [
    "numerator",
    "denominator"
  ],
  "constraints": [
    "denominator > 0"
  ]
}

Computation policies

Aggregation

Not specified in source; must be defined and versioned before composite use.

Normalization

None by default; any normalization must be justified, versioned, and validated.

Missing data

Must be declared before computation; report missingness; no silent imputation; perform sensitivity analysis when material.

Uncertainty required

Yes

Uncertainty method

Confidence interval, credible interval, bootstrap distribution, inter-rater reliability, or sensitivity analysis as scientifically applicable.

Confidence interval required

Yes

Threshold policy

Prespecify, justify, version, and sensitivity-test thresholds; do not derive and evaluate on the same data without correction.

Decision thresholds

No universal threshold declared

Quality control

Source provenance; input validation; duplicate control; uncertainty reporting; independent or orthogonal validation where applicable.

Calibration

As applicable; required when interpreted probabilistically.

Applicability and validation

Evidence object

Study report / dataset / evidence package

Evidence level

Study report / dataset / evidence package

Study types

All biomedical study reports and data releases

Domain

Research Transparency and Reporting Completeness

Required data sources

Context-specific; use source references, registered studies, primary data, and authoritative biomedical resources as applicable.

Validation status

Source maturity: Established; BEMO computation profile requires independent validation.

Benchmark

A representative, versioned benchmark set is required before production use.

Reference standard

Use an independent reference standard when one exists; document expert-adjudicated alternatives.

External validation required

Yes

Interpretation safeguards

Common misinterpretations

Treating reproducibility information completeness as interchangeable with overall study quality, or interpreting a favorable value as proof that all other bias and validity domains are satisfactory.

Limitations

Depends on context, operational definition, thresholds, data quality, and evaluator judgment; it should not be used as a stand-alone summary score without domain-level evidence.

Dependency status

Not yet curated. Closely related metrics are represented; causal or computational dependencies require expert curation.

Source provenance

Source workbook

Pure_Biomedical_Evidence_Research_Metrics_Part_2(3).xlsx

Source worksheet

Biomedical Evidence Metrics

Source row

437

Source record SHA-256

3aaeec4ac26a2a3b26b615c686a2f19768e2153bd9e1e676bdcd1f2ba2812fc8

Definition source

Pure_Biomedical_Evidence_Research_Metrics_Part_2(3).xlsx row 437; see source_references

Ontology IRI

https://w3id.org/bemo/BEMO_2000430

Profile IRI

https://w3id.org/bemo/profile/BEMO_2000430

SHACL shape

https://w3id.org/bemo/shapes/BEMO_2000430_AssessmentShape

Scientific references (8)

1. https://www.equator-network.org/Source framework, standard, guideline, or originSource-preserved; URL reachability not asserted by this package
2. https://www.prisma-statement.org/prisma-2020-checklistSource framework, standard, guideline, or originSource-preserved; URL reachability not asserted by this package
3. https://www.consort-spirit.org/Source framework, standard, guideline, or originSource-preserved; URL reachability not asserted by this package
4. https://www.equator-network.org/reporting-guidelines/strobe/Source framework, standard, guideline, or originSource-preserved; URL reachability not asserted by this package
5. https://www.equator-network.org/reporting-guidelines/stard/Source framework, standard, guideline, or originSource-preserved; URL reachability not asserted by this package
6. https://www.tripod-statement.org/Source framework, standard, guideline, or originSource-preserved; URL reachability not asserted by this package
7. https://www.care-statement.org/Source framework, standard, guideline, or originSource-preserved; URL reachability not asserted by this package
8. https://www.equator-network.org/reporting-guidelines/cheers/Source framework, standard, guideline, or originSource-preserved; URL reachability not asserted by this package

Governance and FAIR status

Lifecycle

Candidate

Approval

Draft

Owner

BEMO Project

Curator

Unassigned

Reviewer

Unassigned

License

Pending owner approval; CC BY 4.0 recommended for OBO compatibility.

Findable

Provisional: stable local ID assigned; public namespace registration pending.

Accessible

Provisional: package is distributable; permanent public release location pending.

Interoperable

Yes: OWL 2, RDF, SKOS, SHACL, JSON-LD, CSV, and OBO-style identifiers.

Reusable

Provisional: rich metadata supplied; open-license owner approval pending.

Governance note

Candidate term pending scientific, ontology-engineering, and computation-method review.

Editor note

Source content preserved verbatim; computation metadata is a generated default and must be curated before normative use.