Table 1 Evidence Communication Rules for Policy (ECR-P) critical appraisal tool

Domain 1: Inform not persuade

Study level

1.1 Were the aims/objectives for the study defined?

Y/PY

N/PN

NI

1.2 Were the limitations of the study findings reported?

Y/PY

N/PN

NI

If Y/PY to 1.2:

1.2.1 Did the study propose ways to reduce limitations in the future?

Y/PY

N/PN

NI/NA

1.3 Were the study conclusions clearly connected to the findings of the study?

Y/PY

N/PN

NI

1.4 Was emotive language avoided in communicating study findings and/or conclusions?

Y/PY

N/PN

NI

Policy recommendations level

1.5 Were the aims/objectives for the policy recommendations defined?

Y/PY

N/PN

NI

1.6 Were the limitations of the policy recommendations reported?

Y/PY

N/PN

NI

1.7 Were the policy recommendations clearly connected to the findings of the study?

Y/PY

N/PN

NI

1.8 Was accessible language used for the policy recommendations?

Y/PY

N/PN

NI

1.9 Was emotive language avoided in policy recommendations?

Y/PY

N/PN

NI

Domain 2: Offer balance, not false balance

Study level

2.1 Were all aspects of the study findings reported?

Y/PY

N/PN

NI

2.2 Was an appropriate reporting guideline used for constructing the manuscript?

Y/PY

N/PN

NI

Policy recommendations level

2.3 Were multiple implications of the policy recommendations considered?

Y/PY

N/PN

NI

2.4 Was the existence of a current policy discussed?

Y/PY

N/PN

NI

If Y/PY to 2.4

2.4.1 Was not changing the current policy considered?

Y/PY

N/PN

NI/NA

Domain 3: Disclose uncertainties

Study level

3.1. Were uncertainties of the study findings reported?

Y/PY

N/PN

NI

If Y/PY to 3.1

3.1.1 Did the study propose ways to reduce uncertainties in the future?

Y/PY

N/PN

NI/NA

Policy recommendations level

3.2 Were uncertainties of the policy recommendations reported?

Y/PY

N/PN

NI

If Y/PY to 3.2

3.2.1 Did the study adopt a precautionary principle perspective?

Y/PY

N/PN

NI/NA

Domain 4: State evidence quality

Study level

4.1 Was the quality of the evidence used in the analysis considered**?

Y/PY

N/PN

NI

If Y/PY to 4.1

4.1.1 Were specific metrics of evidence quality used?

Y/PY

N/PN

NI/NA

Policy recommendations level

4.2 Was the quality of the study findings, that formulated the evidence base for the policy recommendations, considered?

Y/PY

N/PN

NI

Domain 5: Pre-empty misunderstandings

Study level

5.1 Were potential misunderstandings about the study findings and conclusions pre-emptively addressed?

Y/PY

N/PN

NI

Policy recommendations level

5.2 Was the targeted audience for policy recommendations defined?

Y/PY

N/PN

NI

5.3 Were potential misunderstandings for policy recommendations and potential concerns of the policy makers pre-emptively addressed?

Y/PY

N/PN

NI