Skip to main content

Table 6 Rating criteria for the operational characteristics of the evaluation framework for injury surveillance systems

From: The development of an evaluation framework for injury surveillance systems

Operational characteristics

EFISS definition1

 

Rating criteria

Purpose and objectives

The purpose of the injury surveillance system, the reason why the system exists, and objectives of the injury surveillance system, what the information from the system is used for, should be described.

I

If the purpose and/or objectives of the data collection include injury surveillance, it rates as very high.

  

II

If the purpose and/or objectives of the data collection include monitoring of trends or conducting research, it rates as high.

  

III

If the purpose and/or objectives of the data collection include other rationales, such as resource allocation or planning, it rates as low.

  

IV

If the purpose and/or objectives of the data collection are not stated, it rates as very low.

Data collection process

The method of data collection for an injury surveillance system and the number of steps involved in data collection should be examined using a data collection flow chart.

I

If the data collection process takes one to three steps to complete, it rates as very high.

  

II

If the data collection process takes four to six steps to complete, it rates as high.

  

III

If the data collection process takes seven to nine steps to complete, it rates as low.

  

IV

If the data collection process takes ten or more steps to complete, it rates as very low.

Case definition

The injury case definition adopted by an injury surveillance system to identify cases should be described.

I

If variables in the data collection can identify the injury cases of interest it rates as very high.

  

IV

If variables in the data collection can not identify injury cases of interest it rates as very low.

Timeliness

Timeliness will refer to the time taken to accomplish each of the three surveillance phases of: (i) data collection; (ii) data analysis and interpretation; and (iii) dissemination.

I

If the time taken to complete data collection, data analysis, interpretation and dissemination is daily to monthly, it rates as very high.

  

II

If the time taken to complete data collection, data analysis, interpretation and dissemination is annual to biennial, it rates as high.

  

III

If the time taken to complete data collection, data analysis, interpretation and dissemination is greater than biennial, it rates as low

  

IV

If data is not either routinely collected, analysed, interpreted or disseminated, it rates as very low.

Uniform classification systems

The classification system(s) used to record information in the injury surveillance system for variables in the WHO's core minimum and optimal data sets for injury surveillance should be identified.

I

If standard classification systems are used to record information for 76 to 100% of variables in the core minimum and optional data sets for injury surveillance, it rates as very high.

  

II

If standard classification systems are used to record information for 51 to 75% of variables in the core minimum and optional data sets for injury surveillance, it rates as high.

  

III

If standard classification systems are used to record information for 26 to 50% of variables in the core minimum and optional data sets for injury surveillance, it rates as low.

  

IV

If standard classification systems are not used or are used to record information for less than 25% of variables in the core minimum and optional data sets for injury surveillance, it rates as very low.

Quality control measures

The quality control measures regularly utilised by the agency responsible for the injury surveillance system should be identified.

I

If quality control measures are in place and are conducted, it rates as very high.

  

IV

If there are no quality control measures in place, it rates as very low.

Confidentiality and privacy

The methods by which an individual's information in the injury surveillance system is safe guarded against disclosure should be described.

I

If data users are required to sign a confidentiality and/or data security agreement, it rates as very high.

  

IV

If data users are not required to sign a confidentiality and/or data security agreement, it rates as very low.

System security

The data access requirements (e.g. password protection) that safe guard against the disclosure of confidential information should be described.

I

If there are data access procedures in place (e.g. password protection) to safe guard against the disclosure of confidential information, it rates as very high.

  

IV

If there are no data access procedures in place to safe guard against the disclosure of confidential information, it rates as very low.

  1. 1 WHO's core minimum data set for injury surveillance includes information regarding individual demographics (i.e. age, sex), the circumstances of the injury event (i.e. intent, activity, place of occurrence, mechanism of injury), and the injury outcome (i.e. nature of injury).