The Systematised Nomenclature of Medicine – Clinical Terms (SNOMED-CT) coding system has been adopted by the Ministry of Health in Aotearoa New Zealand.1
SNOMED-CT is designed to provide a standardised method to represent clinical phrases (CT=clinical terms). According to the International Health Terminology Standards Development Organisation (IHTSDO), the uses of SNOMED-CT are multiple, including for clinical purposes, population monitoring and audit/research.1 In emergency departments (EDs), the presenting complaint combined with triage category (urgency to be seen) is used by clinicians to decide which patient should be seen next, so its use is primarily clinical and secondarily for audit and research.
Adoption of SNOMED-CT allows for the first time a standardised approach for recording the reasons people present for care to emergency departments, by using a SNOMED concept code for a patient’s chief presenting complaint (CPC), in line with international recommendations.2 The New Zealand ED reference set for CPCs was developed by clinicians and is a trade-off between the vast number of possible SNOMED-CT concepts (currently over 350,000)3 and the need for ease of use and clinical utility at the bedside in the ED.4 With this in mind, there are only 155 concepts in the New Zealand ED reference set for CPCs.5 Other jurisdictions have independently developed similar size ED CPC reference sets,6,7 with a high concordance between the number of concepts and concept terms selected. Others have recommended larger reference sets,8,9 although if a reference set is too large, it may become unusable.9 A common feature of all of these reference sets is that they draw upon concepts from different hierarchies within SNOMED-CT that are clinically meaningful.
A previous audit at our site found that the SNOMED-CT concept ‘Referral for investigation’ was being used as the CPC for many primary care referrals to ED.2 As this implies the source of referral rather than what the patient presented with, this CPC lacks clinical relevance. Approximately 5% of ED presentations were being coded this way, with an alternative CPC evident from the clinician’s notes in 86% of cases.10 However, this data was limited by the small sample size of 43. If ‘Referral for investigation’ is being used when an alternative CPC is available, then the usefulness of CPC coding is reduced. This may limit the usefulness of CPC coding for surveillance of emerging viral diseases, emerging trends in recreational drug toxicity and mental health presentations.11–13 It also means that audit or research of any condition using CPCs will require a manual search of all cases of ‘Referral for investigation’ to ensure that the CPCs of interest is not missed, which would be a waste of time and resources.
The primary aim of the current audit was to find out how often a more specific CPC could have been used for those cases coded as ‘Referral for investigation’. The secondary aim was to explore which types of cases were more likely to be coded this way.
This was a cross-sectional audit of routinely collected presenting complaint data, supplemented by a retrospective case note review.
Auckland City Hospital is an urban tertiary academic centre that has an annual census of approximately 76,000 patients 15 years of age or older.
Consecutive presentations to ED were selected between 1 March and 30 April 2020. Two months was chosen to give a sample size of approximately 600 cases of ‘Referral for investigation’, based on our usual annual presentations (5% x 76,000 annual presentations / 6).
Real-time CPCs were recorded by triage nurses for all ED presentations except those ambulance patients requiring immediate resuscitation or primary care referrals to inpatient teams. Clerical staff recorded the CPCs for patients referred from their primary care provider or patients requiring immediate resuscitation (while clinical staff provided immediate care).
The following data was retrieved from the hospital data warehouse by one author (MG): event number, National Health Index (NHI), date/time of presentation, age, sex, ethnicity, Accident Compensation Corporation (ACC) status, triage code, arrival mode, real-time CPC and free-text triage comments fields. This was stored on a password protected USB stick.
The triage comments fields were scanned manually for text that mapped to the current SNOMED-CT CPC reference set.3 If there were multiple CPCs recorded in the triage comments field, the first CPC recorded was used. If there were no CPCs recorded in the triage comments field, the clinical records system Concerto (Orion Health, Auckland, New Zealand) was accessed using a password protected virtual private network connection on a password protected computer. One author (PJ) recorded CPCs based on the first treating clinician’s clinical notes. The first treating clinician was either an independent nurse practitioner or doctor. When there was more than one presenting complaint recorded by the first treating clinician, the first recorded presenting complaint was used.
All data were entered into a purpose-built electronic data collection form in Microsoft Excel (Microsoft Corporation, Redmond, Washington, US) on a password protected USB stick.
The CPCs recorded were tabulated and described using number and proportion with a 95% confidence interval (95%CI). The 95%CI was calculated using Graphpad QuickCalcs (https://www.graphpad.com/quickcalcs/confInterval1; San Diego, CA, US).
As an audit of the data quality undertaken by staff in the department where this data was collected, and as no identifying data would be reported, this study did not meet the threshold to require ethical approval. Institutional approval was obtained from the Auckland District Health Board Research Review Committee, A+8901.
Over the period of the audit, there were 9,067 presentations to ED. ‘Referral for investigation’ was used for 497 presentations: 497/9,067=5.5% (95%CI 5–6%). Table 1 shows the baseline demographics of this group compared to those cases with other CPCs. Those with ‘Referral for investigation’ as their CPC were more likely to be older or male or to have arrived by ambulance and have higher triage acuity compared to other patients.
Table 1: Demographics of sample population.
In 467/497 (94.0% (95%CI 92–96%)) cases there was a more specific CPC from the current ED reference set recorded in the triage comments, primary care referral letter or clinical notes. In total, 98 different CPCs were used; these are shown in Figure 1.
Figure 1: Specific CPCs.
The most commonly used alternative CPCs were: ‘Chest pain’ (32, 6.4%), ‘Shortness of breath’ (21, 4.2%), ‘Abdominal pain’ (18, 3.6%), ‘Altered mental status’ (17, 3.4%) and ‘Postoperative complication’ (16, 3.2%). Six of 13 cardiac arrests (46%) and eight of 63 of multiple trauma cases (13%) were coded as ‘Referral for investigation’.
The 30 cases where no specific CPC was available were: nine referrals for treatment of a specific condition, eighteen abnormal blood tests (seven hyperkalaemia, three abnormal liver function, two anaemia and one each for hypercalcaemia, d-dimer, creatinine, hypoglycaemia, hyponatremia and polycythaemia) and three were for specific radiology tests (one computerised tomography (CT) scan and two ultrasound).
This comprehensive audit of use of the CPC ‘Referral for investigation’ in a New Zealand ED found that approximately 5% of all ED presentations were coded as ‘Referral for investigation’. This is consistent with a previous audit in our department in 2019.10 In nearly every case, an alternative and more specific CPC was available from the triage comments, primary care referral letter or clinical notes.
The cases where this non-specific CPC was used were more likely to be those arriving by ambulance and in the most urgent triage categories. This means that our data on the sickest patients are of lower quality than that of other patients. The need to rapidly load urgent cases onto the hospital information system and focus clinical staff on patient care immediately on arrival means that this CPC was used for expediency by some staff. However, as most urgent cases were being coded with a more specific CPC, this was likely due to individual variation in practice rather than intrinsic to the urgency of the situation.
We identified this issue with use of ‘Referral for investigation’ in 201910 and have attempted to reduce its use by a process of education and feedback for triage nurses and clerks. This process included departmental presentations, engagement of the opinion leaders within each craft group, email reminders and individual feedback. Despite these efforts, there has been no change over time. It is likely that other hospitals introducing SNOMED-CT as part of the Ministry of Health’s requirements may encounter similar problems. We therefore believe that the simplest solution to improve data quality is to remove the CPC ‘Referral for investigation’ from the New Zealand reference set. We also suggest that the following codes be added for presenting complaints that are not currently available in the reference set: ‘Abnormal blood test’ (151271000119102) and ‘Radiographic imaging procedure requested’ (168495003). The alternative to this change is to improve the delivery and uptake of education about more appropriate use of the ‘Referral for investigation’ CPC. This may be feasible in smaller departments with a limited number of staff involved: in our setting, the time and resources required to embark on further efforts at education for the more than 150 staff potentially entering this information would be considerable, especially when there is no guarantee of success. We believe the most efficient and practicable solution is to make the changes suggested above.
‘Referral for investigation’ was used for 5% of all cases presenting to our ED, particularly for the most urgent cases, despite more accurate and specific presenting complaints being readily accessible. ‘Referral for investigation’ should be removed from the New Zealand emergency department reference set for chief presenting complaints to improve data quality.
AIM: The Ministry of Health has mandated that all emergency department (ED) presentations are coded using the Systematised Nomenclature of Medicine – Clinical Terms (SNOMED-CT) from 2021. The current ED reference set contains the non-specific term ‘Referral for investigation’ in the list of available chief presenting complaints (CPCs). The aim of this study was to determine the rate of use of this term and how often a more specific (and therefore more clinically useful) term was used. METHOD: This was a cross-sectional audit of routinely collected presenting complaint data, supplemented by a retrospective case note review. RESULTS: ‘Referral for investigation’ was used for 497/9,067 (5.5%, 95%CI 5–6%) presentations, with increased use for urgent cases. An alternative CPC was available in 467/497 (94.0%, 95%CI 92–96%) of cases from the existing reference set. Of 98 different CPCs, the common alternatives were: ‘Chest pain’ (6.4%), ‘Shortness of breath’ (4.2%) ‘Abdominal pain’ (3.6%), ‘Altered mental status’ (3.4%) and ‘Postoperative complication’ (3.2%). Six of 13 cardiac arrests and eight of 63 of multiple trauma cases were coded as ‘Referral for investigation’. With the addition of two new terms to the New Zealand reference set (‘Abnormal blood test’ and ‘Radiology request’), each of the remaining 30 presentations would have an alternative and more accurate CPC. CONCLUSION: ‘Referral for investigation’ should be removed from the New Zealand emergency department reference set for chief presenting complaints to improve data quality.
1. International Health Terminology Standards Development Organisation SNOMED CT Starter Guide http://www.snomed.org/starterguide.pdf Accessed 28/09/2020.
2. Mowafi H, Dworkis D, Bisanzo M, Hansoti B, Seidenberg P, Obermeyer Z, et al. Making Recording and Analysis of Chief Complaint a Priority for Global Emergency Care Research in Low-income Countries. Academic Emergency Medicine. 2013;20(12):1241-5.
3. International Health Terminology Standards Development Organisation SNOMED CT Five Step Briefing (http://www.snomed.org/snomed-ct/five-step-briefing). Accessed 28/10/20.
4. Jones P, Hughes T, Morton T. Information technology coding systems in the emergency department: It is not the tools, it is how we use them. Emergency Medicine Australasia. 2019;31(5):700-1.
5. MOH: HISO 10048 Emergency Care Data Standard [20/4/20]. Available from: https://www.health.govt.nz/publication/hiso-10048-emergency-care-data-standard Accessed 28/10/20.
6. Grafstein E, Bullard MJ, Warren D, Unger B. Revision of the Canadian Emergency Department Information System (CEDIS) Presenting Complaint List version 1.1. Cjem. 2008;10(2):151-73.
7. Emergency Care Data Set. Royal College of Emergency Medicine https://www.rcem.ac.uk/docs/Informatics/ECDS%20Flyer.pdf Accessed 2/10/2020.
8. Horng S, Greenbaum NR, Nathanson LA, McClay JC, Goss FR, Nielson JA. Consensus Development of a Modern Ontology of Emergency Department Presenting Problems-The Hierarchical Presenting Problem Ontology (HaPPy). Appl Clin Inform. 2019;10(3):409-20.
9. Dinh MM, Berendsen Russell S, Bein KJ. Diagnoses, damned diagnoses and statistics: Dealing with disparate diagnostic coding systems within the New South Wales Emergency Department Data Collection. Emergency Medicine Australasia. 2019;31(5):830-6.
10. Jones PG, Dance A, Shah N. Accuracy of SNOMED-CT Chief Presenting Complaint Codes: an audit of 1,000 cases. The New Zealand medical journal. 2020;133(1526):67-75.
11. Elkin PL, Brown SH, Balas A, Temesgen Z, Wahner-Roedler D, Froehling D, et al. Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial): coverage of chief complaints. Studies in Health Technology & Informatics. 2008;136:797-802.
12. Morbey R, Hughes H, Smith G, Challen K, Hughes TC, Elliot AJ. Potential added value of the new emergency care dataset to ED-based public health surveillance in England: an initial concept analysis. Emergency medicine journal : EMJ. 2019;36(8):459-64.
13. Liljeqvist HT, Muscatello D, Sara G, Dinh M, Lawrence GL. Accuracy of automatic syndromic classification of coded emergency department diagnoses in identifying mental health-related presentations for public health surveillance. BMC Medical Informatics & Decision Making. 2014;14:84.
The Systematised Nomenclature of Medicine – Clinical Terms (SNOMED-CT) coding system has been adopted by the Ministry of Health in Aotearoa New Zealand.1
SNOMED-CT is designed to provide a standardised method to represent clinical phrases (CT=clinical terms). According to the International Health Terminology Standards Development Organisation (IHTSDO), the uses of SNOMED-CT are multiple, including for clinical purposes, population monitoring and audit/research.1 In emergency departments (EDs), the presenting complaint combined with triage category (urgency to be seen) is used by clinicians to decide which patient should be seen next, so its use is primarily clinical and secondarily for audit and research.
Adoption of SNOMED-CT allows for the first time a standardised approach for recording the reasons people present for care to emergency departments, by using a SNOMED concept code for a patient’s chief presenting complaint (CPC), in line with international recommendations.2 The New Zealand ED reference set for CPCs was developed by clinicians and is a trade-off between the vast number of possible SNOMED-CT concepts (currently over 350,000)3 and the need for ease of use and clinical utility at the bedside in the ED.4 With this in mind, there are only 155 concepts in the New Zealand ED reference set for CPCs.5 Other jurisdictions have independently developed similar size ED CPC reference sets,6,7 with a high concordance between the number of concepts and concept terms selected. Others have recommended larger reference sets,8,9 although if a reference set is too large, it may become unusable.9 A common feature of all of these reference sets is that they draw upon concepts from different hierarchies within SNOMED-CT that are clinically meaningful.
A previous audit at our site found that the SNOMED-CT concept ‘Referral for investigation’ was being used as the CPC for many primary care referrals to ED.2 As this implies the source of referral rather than what the patient presented with, this CPC lacks clinical relevance. Approximately 5% of ED presentations were being coded this way, with an alternative CPC evident from the clinician’s notes in 86% of cases.10 However, this data was limited by the small sample size of 43. If ‘Referral for investigation’ is being used when an alternative CPC is available, then the usefulness of CPC coding is reduced. This may limit the usefulness of CPC coding for surveillance of emerging viral diseases, emerging trends in recreational drug toxicity and mental health presentations.11–13 It also means that audit or research of any condition using CPCs will require a manual search of all cases of ‘Referral for investigation’ to ensure that the CPCs of interest is not missed, which would be a waste of time and resources.
The primary aim of the current audit was to find out how often a more specific CPC could have been used for those cases coded as ‘Referral for investigation’. The secondary aim was to explore which types of cases were more likely to be coded this way.
This was a cross-sectional audit of routinely collected presenting complaint data, supplemented by a retrospective case note review.
Auckland City Hospital is an urban tertiary academic centre that has an annual census of approximately 76,000 patients 15 years of age or older.
Consecutive presentations to ED were selected between 1 March and 30 April 2020. Two months was chosen to give a sample size of approximately 600 cases of ‘Referral for investigation’, based on our usual annual presentations (5% x 76,000 annual presentations / 6).
Real-time CPCs were recorded by triage nurses for all ED presentations except those ambulance patients requiring immediate resuscitation or primary care referrals to inpatient teams. Clerical staff recorded the CPCs for patients referred from their primary care provider or patients requiring immediate resuscitation (while clinical staff provided immediate care).
The following data was retrieved from the hospital data warehouse by one author (MG): event number, National Health Index (NHI), date/time of presentation, age, sex, ethnicity, Accident Compensation Corporation (ACC) status, triage code, arrival mode, real-time CPC and free-text triage comments fields. This was stored on a password protected USB stick.
The triage comments fields were scanned manually for text that mapped to the current SNOMED-CT CPC reference set.3 If there were multiple CPCs recorded in the triage comments field, the first CPC recorded was used. If there were no CPCs recorded in the triage comments field, the clinical records system Concerto (Orion Health, Auckland, New Zealand) was accessed using a password protected virtual private network connection on a password protected computer. One author (PJ) recorded CPCs based on the first treating clinician’s clinical notes. The first treating clinician was either an independent nurse practitioner or doctor. When there was more than one presenting complaint recorded by the first treating clinician, the first recorded presenting complaint was used.
All data were entered into a purpose-built electronic data collection form in Microsoft Excel (Microsoft Corporation, Redmond, Washington, US) on a password protected USB stick.
The CPCs recorded were tabulated and described using number and proportion with a 95% confidence interval (95%CI). The 95%CI was calculated using Graphpad QuickCalcs (https://www.graphpad.com/quickcalcs/confInterval1; San Diego, CA, US).
As an audit of the data quality undertaken by staff in the department where this data was collected, and as no identifying data would be reported, this study did not meet the threshold to require ethical approval. Institutional approval was obtained from the Auckland District Health Board Research Review Committee, A+8901.
Over the period of the audit, there were 9,067 presentations to ED. ‘Referral for investigation’ was used for 497 presentations: 497/9,067=5.5% (95%CI 5–6%). Table 1 shows the baseline demographics of this group compared to those cases with other CPCs. Those with ‘Referral for investigation’ as their CPC were more likely to be older or male or to have arrived by ambulance and have higher triage acuity compared to other patients.
Table 1: Demographics of sample population.
In 467/497 (94.0% (95%CI 92–96%)) cases there was a more specific CPC from the current ED reference set recorded in the triage comments, primary care referral letter or clinical notes. In total, 98 different CPCs were used; these are shown in Figure 1.
Figure 1: Specific CPCs.
The most commonly used alternative CPCs were: ‘Chest pain’ (32, 6.4%), ‘Shortness of breath’ (21, 4.2%), ‘Abdominal pain’ (18, 3.6%), ‘Altered mental status’ (17, 3.4%) and ‘Postoperative complication’ (16, 3.2%). Six of 13 cardiac arrests (46%) and eight of 63 of multiple trauma cases (13%) were coded as ‘Referral for investigation’.
The 30 cases where no specific CPC was available were: nine referrals for treatment of a specific condition, eighteen abnormal blood tests (seven hyperkalaemia, three abnormal liver function, two anaemia and one each for hypercalcaemia, d-dimer, creatinine, hypoglycaemia, hyponatremia and polycythaemia) and three were for specific radiology tests (one computerised tomography (CT) scan and two ultrasound).
This comprehensive audit of use of the CPC ‘Referral for investigation’ in a New Zealand ED found that approximately 5% of all ED presentations were coded as ‘Referral for investigation’. This is consistent with a previous audit in our department in 2019.10 In nearly every case, an alternative and more specific CPC was available from the triage comments, primary care referral letter or clinical notes.
The cases where this non-specific CPC was used were more likely to be those arriving by ambulance and in the most urgent triage categories. This means that our data on the sickest patients are of lower quality than that of other patients. The need to rapidly load urgent cases onto the hospital information system and focus clinical staff on patient care immediately on arrival means that this CPC was used for expediency by some staff. However, as most urgent cases were being coded with a more specific CPC, this was likely due to individual variation in practice rather than intrinsic to the urgency of the situation.
We identified this issue with use of ‘Referral for investigation’ in 201910 and have attempted to reduce its use by a process of education and feedback for triage nurses and clerks. This process included departmental presentations, engagement of the opinion leaders within each craft group, email reminders and individual feedback. Despite these efforts, there has been no change over time. It is likely that other hospitals introducing SNOMED-CT as part of the Ministry of Health’s requirements may encounter similar problems. We therefore believe that the simplest solution to improve data quality is to remove the CPC ‘Referral for investigation’ from the New Zealand reference set. We also suggest that the following codes be added for presenting complaints that are not currently available in the reference set: ‘Abnormal blood test’ (151271000119102) and ‘Radiographic imaging procedure requested’ (168495003). The alternative to this change is to improve the delivery and uptake of education about more appropriate use of the ‘Referral for investigation’ CPC. This may be feasible in smaller departments with a limited number of staff involved: in our setting, the time and resources required to embark on further efforts at education for the more than 150 staff potentially entering this information would be considerable, especially when there is no guarantee of success. We believe the most efficient and practicable solution is to make the changes suggested above.
‘Referral for investigation’ was used for 5% of all cases presenting to our ED, particularly for the most urgent cases, despite more accurate and specific presenting complaints being readily accessible. ‘Referral for investigation’ should be removed from the New Zealand emergency department reference set for chief presenting complaints to improve data quality.
AIM: The Ministry of Health has mandated that all emergency department (ED) presentations are coded using the Systematised Nomenclature of Medicine – Clinical Terms (SNOMED-CT) from 2021. The current ED reference set contains the non-specific term ‘Referral for investigation’ in the list of available chief presenting complaints (CPCs). The aim of this study was to determine the rate of use of this term and how often a more specific (and therefore more clinically useful) term was used. METHOD: This was a cross-sectional audit of routinely collected presenting complaint data, supplemented by a retrospective case note review. RESULTS: ‘Referral for investigation’ was used for 497/9,067 (5.5%, 95%CI 5–6%) presentations, with increased use for urgent cases. An alternative CPC was available in 467/497 (94.0%, 95%CI 92–96%) of cases from the existing reference set. Of 98 different CPCs, the common alternatives were: ‘Chest pain’ (6.4%), ‘Shortness of breath’ (4.2%) ‘Abdominal pain’ (3.6%), ‘Altered mental status’ (3.4%) and ‘Postoperative complication’ (3.2%). Six of 13 cardiac arrests and eight of 63 of multiple trauma cases were coded as ‘Referral for investigation’. With the addition of two new terms to the New Zealand reference set (‘Abnormal blood test’ and ‘Radiology request’), each of the remaining 30 presentations would have an alternative and more accurate CPC. CONCLUSION: ‘Referral for investigation’ should be removed from the New Zealand emergency department reference set for chief presenting complaints to improve data quality.
1. International Health Terminology Standards Development Organisation SNOMED CT Starter Guide http://www.snomed.org/starterguide.pdf Accessed 28/09/2020.
2. Mowafi H, Dworkis D, Bisanzo M, Hansoti B, Seidenberg P, Obermeyer Z, et al. Making Recording and Analysis of Chief Complaint a Priority for Global Emergency Care Research in Low-income Countries. Academic Emergency Medicine. 2013;20(12):1241-5.
3. International Health Terminology Standards Development Organisation SNOMED CT Five Step Briefing (http://www.snomed.org/snomed-ct/five-step-briefing). Accessed 28/10/20.
4. Jones P, Hughes T, Morton T. Information technology coding systems in the emergency department: It is not the tools, it is how we use them. Emergency Medicine Australasia. 2019;31(5):700-1.
5. MOH: HISO 10048 Emergency Care Data Standard [20/4/20]. Available from: https://www.health.govt.nz/publication/hiso-10048-emergency-care-data-standard Accessed 28/10/20.
6. Grafstein E, Bullard MJ, Warren D, Unger B. Revision of the Canadian Emergency Department Information System (CEDIS) Presenting Complaint List version 1.1. Cjem. 2008;10(2):151-73.
7. Emergency Care Data Set. Royal College of Emergency Medicine https://www.rcem.ac.uk/docs/Informatics/ECDS%20Flyer.pdf Accessed 2/10/2020.
8. Horng S, Greenbaum NR, Nathanson LA, McClay JC, Goss FR, Nielson JA. Consensus Development of a Modern Ontology of Emergency Department Presenting Problems-The Hierarchical Presenting Problem Ontology (HaPPy). Appl Clin Inform. 2019;10(3):409-20.
9. Dinh MM, Berendsen Russell S, Bein KJ. Diagnoses, damned diagnoses and statistics: Dealing with disparate diagnostic coding systems within the New South Wales Emergency Department Data Collection. Emergency Medicine Australasia. 2019;31(5):830-6.
10. Jones PG, Dance A, Shah N. Accuracy of SNOMED-CT Chief Presenting Complaint Codes: an audit of 1,000 cases. The New Zealand medical journal. 2020;133(1526):67-75.
11. Elkin PL, Brown SH, Balas A, Temesgen Z, Wahner-Roedler D, Froehling D, et al. Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial): coverage of chief complaints. Studies in Health Technology & Informatics. 2008;136:797-802.
12. Morbey R, Hughes H, Smith G, Challen K, Hughes TC, Elliot AJ. Potential added value of the new emergency care dataset to ED-based public health surveillance in England: an initial concept analysis. Emergency medicine journal : EMJ. 2019;36(8):459-64.
13. Liljeqvist HT, Muscatello D, Sara G, Dinh M, Lawrence GL. Accuracy of automatic syndromic classification of coded emergency department diagnoses in identifying mental health-related presentations for public health surveillance. BMC Medical Informatics & Decision Making. 2014;14:84.
The Systematised Nomenclature of Medicine – Clinical Terms (SNOMED-CT) coding system has been adopted by the Ministry of Health in Aotearoa New Zealand.1
SNOMED-CT is designed to provide a standardised method to represent clinical phrases (CT=clinical terms). According to the International Health Terminology Standards Development Organisation (IHTSDO), the uses of SNOMED-CT are multiple, including for clinical purposes, population monitoring and audit/research.1 In emergency departments (EDs), the presenting complaint combined with triage category (urgency to be seen) is used by clinicians to decide which patient should be seen next, so its use is primarily clinical and secondarily for audit and research.
Adoption of SNOMED-CT allows for the first time a standardised approach for recording the reasons people present for care to emergency departments, by using a SNOMED concept code for a patient’s chief presenting complaint (CPC), in line with international recommendations.2 The New Zealand ED reference set for CPCs was developed by clinicians and is a trade-off between the vast number of possible SNOMED-CT concepts (currently over 350,000)3 and the need for ease of use and clinical utility at the bedside in the ED.4 With this in mind, there are only 155 concepts in the New Zealand ED reference set for CPCs.5 Other jurisdictions have independently developed similar size ED CPC reference sets,6,7 with a high concordance between the number of concepts and concept terms selected. Others have recommended larger reference sets,8,9 although if a reference set is too large, it may become unusable.9 A common feature of all of these reference sets is that they draw upon concepts from different hierarchies within SNOMED-CT that are clinically meaningful.
A previous audit at our site found that the SNOMED-CT concept ‘Referral for investigation’ was being used as the CPC for many primary care referrals to ED.2 As this implies the source of referral rather than what the patient presented with, this CPC lacks clinical relevance. Approximately 5% of ED presentations were being coded this way, with an alternative CPC evident from the clinician’s notes in 86% of cases.10 However, this data was limited by the small sample size of 43. If ‘Referral for investigation’ is being used when an alternative CPC is available, then the usefulness of CPC coding is reduced. This may limit the usefulness of CPC coding for surveillance of emerging viral diseases, emerging trends in recreational drug toxicity and mental health presentations.11–13 It also means that audit or research of any condition using CPCs will require a manual search of all cases of ‘Referral for investigation’ to ensure that the CPCs of interest is not missed, which would be a waste of time and resources.
The primary aim of the current audit was to find out how often a more specific CPC could have been used for those cases coded as ‘Referral for investigation’. The secondary aim was to explore which types of cases were more likely to be coded this way.
This was a cross-sectional audit of routinely collected presenting complaint data, supplemented by a retrospective case note review.
Auckland City Hospital is an urban tertiary academic centre that has an annual census of approximately 76,000 patients 15 years of age or older.
Consecutive presentations to ED were selected between 1 March and 30 April 2020. Two months was chosen to give a sample size of approximately 600 cases of ‘Referral for investigation’, based on our usual annual presentations (5% x 76,000 annual presentations / 6).
Real-time CPCs were recorded by triage nurses for all ED presentations except those ambulance patients requiring immediate resuscitation or primary care referrals to inpatient teams. Clerical staff recorded the CPCs for patients referred from their primary care provider or patients requiring immediate resuscitation (while clinical staff provided immediate care).
The following data was retrieved from the hospital data warehouse by one author (MG): event number, National Health Index (NHI), date/time of presentation, age, sex, ethnicity, Accident Compensation Corporation (ACC) status, triage code, arrival mode, real-time CPC and free-text triage comments fields. This was stored on a password protected USB stick.
The triage comments fields were scanned manually for text that mapped to the current SNOMED-CT CPC reference set.3 If there were multiple CPCs recorded in the triage comments field, the first CPC recorded was used. If there were no CPCs recorded in the triage comments field, the clinical records system Concerto (Orion Health, Auckland, New Zealand) was accessed using a password protected virtual private network connection on a password protected computer. One author (PJ) recorded CPCs based on the first treating clinician’s clinical notes. The first treating clinician was either an independent nurse practitioner or doctor. When there was more than one presenting complaint recorded by the first treating clinician, the first recorded presenting complaint was used.
All data were entered into a purpose-built electronic data collection form in Microsoft Excel (Microsoft Corporation, Redmond, Washington, US) on a password protected USB stick.
The CPCs recorded were tabulated and described using number and proportion with a 95% confidence interval (95%CI). The 95%CI was calculated using Graphpad QuickCalcs (https://www.graphpad.com/quickcalcs/confInterval1; San Diego, CA, US).
As an audit of the data quality undertaken by staff in the department where this data was collected, and as no identifying data would be reported, this study did not meet the threshold to require ethical approval. Institutional approval was obtained from the Auckland District Health Board Research Review Committee, A+8901.
Over the period of the audit, there were 9,067 presentations to ED. ‘Referral for investigation’ was used for 497 presentations: 497/9,067=5.5% (95%CI 5–6%). Table 1 shows the baseline demographics of this group compared to those cases with other CPCs. Those with ‘Referral for investigation’ as their CPC were more likely to be older or male or to have arrived by ambulance and have higher triage acuity compared to other patients.
Table 1: Demographics of sample population.
In 467/497 (94.0% (95%CI 92–96%)) cases there was a more specific CPC from the current ED reference set recorded in the triage comments, primary care referral letter or clinical notes. In total, 98 different CPCs were used; these are shown in Figure 1.
Figure 1: Specific CPCs.
The most commonly used alternative CPCs were: ‘Chest pain’ (32, 6.4%), ‘Shortness of breath’ (21, 4.2%), ‘Abdominal pain’ (18, 3.6%), ‘Altered mental status’ (17, 3.4%) and ‘Postoperative complication’ (16, 3.2%). Six of 13 cardiac arrests (46%) and eight of 63 of multiple trauma cases (13%) were coded as ‘Referral for investigation’.
The 30 cases where no specific CPC was available were: nine referrals for treatment of a specific condition, eighteen abnormal blood tests (seven hyperkalaemia, three abnormal liver function, two anaemia and one each for hypercalcaemia, d-dimer, creatinine, hypoglycaemia, hyponatremia and polycythaemia) and three were for specific radiology tests (one computerised tomography (CT) scan and two ultrasound).
This comprehensive audit of use of the CPC ‘Referral for investigation’ in a New Zealand ED found that approximately 5% of all ED presentations were coded as ‘Referral for investigation’. This is consistent with a previous audit in our department in 2019.10 In nearly every case, an alternative and more specific CPC was available from the triage comments, primary care referral letter or clinical notes.
The cases where this non-specific CPC was used were more likely to be those arriving by ambulance and in the most urgent triage categories. This means that our data on the sickest patients are of lower quality than that of other patients. The need to rapidly load urgent cases onto the hospital information system and focus clinical staff on patient care immediately on arrival means that this CPC was used for expediency by some staff. However, as most urgent cases were being coded with a more specific CPC, this was likely due to individual variation in practice rather than intrinsic to the urgency of the situation.
We identified this issue with use of ‘Referral for investigation’ in 201910 and have attempted to reduce its use by a process of education and feedback for triage nurses and clerks. This process included departmental presentations, engagement of the opinion leaders within each craft group, email reminders and individual feedback. Despite these efforts, there has been no change over time. It is likely that other hospitals introducing SNOMED-CT as part of the Ministry of Health’s requirements may encounter similar problems. We therefore believe that the simplest solution to improve data quality is to remove the CPC ‘Referral for investigation’ from the New Zealand reference set. We also suggest that the following codes be added for presenting complaints that are not currently available in the reference set: ‘Abnormal blood test’ (151271000119102) and ‘Radiographic imaging procedure requested’ (168495003). The alternative to this change is to improve the delivery and uptake of education about more appropriate use of the ‘Referral for investigation’ CPC. This may be feasible in smaller departments with a limited number of staff involved: in our setting, the time and resources required to embark on further efforts at education for the more than 150 staff potentially entering this information would be considerable, especially when there is no guarantee of success. We believe the most efficient and practicable solution is to make the changes suggested above.
‘Referral for investigation’ was used for 5% of all cases presenting to our ED, particularly for the most urgent cases, despite more accurate and specific presenting complaints being readily accessible. ‘Referral for investigation’ should be removed from the New Zealand emergency department reference set for chief presenting complaints to improve data quality.
AIM: The Ministry of Health has mandated that all emergency department (ED) presentations are coded using the Systematised Nomenclature of Medicine – Clinical Terms (SNOMED-CT) from 2021. The current ED reference set contains the non-specific term ‘Referral for investigation’ in the list of available chief presenting complaints (CPCs). The aim of this study was to determine the rate of use of this term and how often a more specific (and therefore more clinically useful) term was used. METHOD: This was a cross-sectional audit of routinely collected presenting complaint data, supplemented by a retrospective case note review. RESULTS: ‘Referral for investigation’ was used for 497/9,067 (5.5%, 95%CI 5–6%) presentations, with increased use for urgent cases. An alternative CPC was available in 467/497 (94.0%, 95%CI 92–96%) of cases from the existing reference set. Of 98 different CPCs, the common alternatives were: ‘Chest pain’ (6.4%), ‘Shortness of breath’ (4.2%) ‘Abdominal pain’ (3.6%), ‘Altered mental status’ (3.4%) and ‘Postoperative complication’ (3.2%). Six of 13 cardiac arrests and eight of 63 of multiple trauma cases were coded as ‘Referral for investigation’. With the addition of two new terms to the New Zealand reference set (‘Abnormal blood test’ and ‘Radiology request’), each of the remaining 30 presentations would have an alternative and more accurate CPC. CONCLUSION: ‘Referral for investigation’ should be removed from the New Zealand emergency department reference set for chief presenting complaints to improve data quality.
1. International Health Terminology Standards Development Organisation SNOMED CT Starter Guide http://www.snomed.org/starterguide.pdf Accessed 28/09/2020.
2. Mowafi H, Dworkis D, Bisanzo M, Hansoti B, Seidenberg P, Obermeyer Z, et al. Making Recording and Analysis of Chief Complaint a Priority for Global Emergency Care Research in Low-income Countries. Academic Emergency Medicine. 2013;20(12):1241-5.
3. International Health Terminology Standards Development Organisation SNOMED CT Five Step Briefing (http://www.snomed.org/snomed-ct/five-step-briefing). Accessed 28/10/20.
4. Jones P, Hughes T, Morton T. Information technology coding systems in the emergency department: It is not the tools, it is how we use them. Emergency Medicine Australasia. 2019;31(5):700-1.
5. MOH: HISO 10048 Emergency Care Data Standard [20/4/20]. Available from: https://www.health.govt.nz/publication/hiso-10048-emergency-care-data-standard Accessed 28/10/20.
6. Grafstein E, Bullard MJ, Warren D, Unger B. Revision of the Canadian Emergency Department Information System (CEDIS) Presenting Complaint List version 1.1. Cjem. 2008;10(2):151-73.
7. Emergency Care Data Set. Royal College of Emergency Medicine https://www.rcem.ac.uk/docs/Informatics/ECDS%20Flyer.pdf Accessed 2/10/2020.
8. Horng S, Greenbaum NR, Nathanson LA, McClay JC, Goss FR, Nielson JA. Consensus Development of a Modern Ontology of Emergency Department Presenting Problems-The Hierarchical Presenting Problem Ontology (HaPPy). Appl Clin Inform. 2019;10(3):409-20.
9. Dinh MM, Berendsen Russell S, Bein KJ. Diagnoses, damned diagnoses and statistics: Dealing with disparate diagnostic coding systems within the New South Wales Emergency Department Data Collection. Emergency Medicine Australasia. 2019;31(5):830-6.
10. Jones PG, Dance A, Shah N. Accuracy of SNOMED-CT Chief Presenting Complaint Codes: an audit of 1,000 cases. The New Zealand medical journal. 2020;133(1526):67-75.
11. Elkin PL, Brown SH, Balas A, Temesgen Z, Wahner-Roedler D, Froehling D, et al. Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial): coverage of chief complaints. Studies in Health Technology & Informatics. 2008;136:797-802.
12. Morbey R, Hughes H, Smith G, Challen K, Hughes TC, Elliot AJ. Potential added value of the new emergency care dataset to ED-based public health surveillance in England: an initial concept analysis. Emergency medicine journal : EMJ. 2019;36(8):459-64.
13. Liljeqvist HT, Muscatello D, Sara G, Dinh M, Lawrence GL. Accuracy of automatic syndromic classification of coded emergency department diagnoses in identifying mental health-related presentations for public health surveillance. BMC Medical Informatics & Decision Making. 2014;14:84.
The Systematised Nomenclature of Medicine – Clinical Terms (SNOMED-CT) coding system has been adopted by the Ministry of Health in Aotearoa New Zealand.1
SNOMED-CT is designed to provide a standardised method to represent clinical phrases (CT=clinical terms). According to the International Health Terminology Standards Development Organisation (IHTSDO), the uses of SNOMED-CT are multiple, including for clinical purposes, population monitoring and audit/research.1 In emergency departments (EDs), the presenting complaint combined with triage category (urgency to be seen) is used by clinicians to decide which patient should be seen next, so its use is primarily clinical and secondarily for audit and research.
Adoption of SNOMED-CT allows for the first time a standardised approach for recording the reasons people present for care to emergency departments, by using a SNOMED concept code for a patient’s chief presenting complaint (CPC), in line with international recommendations.2 The New Zealand ED reference set for CPCs was developed by clinicians and is a trade-off between the vast number of possible SNOMED-CT concepts (currently over 350,000)3 and the need for ease of use and clinical utility at the bedside in the ED.4 With this in mind, there are only 155 concepts in the New Zealand ED reference set for CPCs.5 Other jurisdictions have independently developed similar size ED CPC reference sets,6,7 with a high concordance between the number of concepts and concept terms selected. Others have recommended larger reference sets,8,9 although if a reference set is too large, it may become unusable.9 A common feature of all of these reference sets is that they draw upon concepts from different hierarchies within SNOMED-CT that are clinically meaningful.
A previous audit at our site found that the SNOMED-CT concept ‘Referral for investigation’ was being used as the CPC for many primary care referrals to ED.2 As this implies the source of referral rather than what the patient presented with, this CPC lacks clinical relevance. Approximately 5% of ED presentations were being coded this way, with an alternative CPC evident from the clinician’s notes in 86% of cases.10 However, this data was limited by the small sample size of 43. If ‘Referral for investigation’ is being used when an alternative CPC is available, then the usefulness of CPC coding is reduced. This may limit the usefulness of CPC coding for surveillance of emerging viral diseases, emerging trends in recreational drug toxicity and mental health presentations.11–13 It also means that audit or research of any condition using CPCs will require a manual search of all cases of ‘Referral for investigation’ to ensure that the CPCs of interest is not missed, which would be a waste of time and resources.
The primary aim of the current audit was to find out how often a more specific CPC could have been used for those cases coded as ‘Referral for investigation’. The secondary aim was to explore which types of cases were more likely to be coded this way.
This was a cross-sectional audit of routinely collected presenting complaint data, supplemented by a retrospective case note review.
Auckland City Hospital is an urban tertiary academic centre that has an annual census of approximately 76,000 patients 15 years of age or older.
Consecutive presentations to ED were selected between 1 March and 30 April 2020. Two months was chosen to give a sample size of approximately 600 cases of ‘Referral for investigation’, based on our usual annual presentations (5% x 76,000 annual presentations / 6).
Real-time CPCs were recorded by triage nurses for all ED presentations except those ambulance patients requiring immediate resuscitation or primary care referrals to inpatient teams. Clerical staff recorded the CPCs for patients referred from their primary care provider or patients requiring immediate resuscitation (while clinical staff provided immediate care).
The following data was retrieved from the hospital data warehouse by one author (MG): event number, National Health Index (NHI), date/time of presentation, age, sex, ethnicity, Accident Compensation Corporation (ACC) status, triage code, arrival mode, real-time CPC and free-text triage comments fields. This was stored on a password protected USB stick.
The triage comments fields were scanned manually for text that mapped to the current SNOMED-CT CPC reference set.3 If there were multiple CPCs recorded in the triage comments field, the first CPC recorded was used. If there were no CPCs recorded in the triage comments field, the clinical records system Concerto (Orion Health, Auckland, New Zealand) was accessed using a password protected virtual private network connection on a password protected computer. One author (PJ) recorded CPCs based on the first treating clinician’s clinical notes. The first treating clinician was either an independent nurse practitioner or doctor. When there was more than one presenting complaint recorded by the first treating clinician, the first recorded presenting complaint was used.
All data were entered into a purpose-built electronic data collection form in Microsoft Excel (Microsoft Corporation, Redmond, Washington, US) on a password protected USB stick.
The CPCs recorded were tabulated and described using number and proportion with a 95% confidence interval (95%CI). The 95%CI was calculated using Graphpad QuickCalcs (https://www.graphpad.com/quickcalcs/confInterval1; San Diego, CA, US).
As an audit of the data quality undertaken by staff in the department where this data was collected, and as no identifying data would be reported, this study did not meet the threshold to require ethical approval. Institutional approval was obtained from the Auckland District Health Board Research Review Committee, A+8901.
Over the period of the audit, there were 9,067 presentations to ED. ‘Referral for investigation’ was used for 497 presentations: 497/9,067=5.5% (95%CI 5–6%). Table 1 shows the baseline demographics of this group compared to those cases with other CPCs. Those with ‘Referral for investigation’ as their CPC were more likely to be older or male or to have arrived by ambulance and have higher triage acuity compared to other patients.
Table 1: Demographics of sample population.
In 467/497 (94.0% (95%CI 92–96%)) cases there was a more specific CPC from the current ED reference set recorded in the triage comments, primary care referral letter or clinical notes. In total, 98 different CPCs were used; these are shown in Figure 1.
Figure 1: Specific CPCs.
The most commonly used alternative CPCs were: ‘Chest pain’ (32, 6.4%), ‘Shortness of breath’ (21, 4.2%), ‘Abdominal pain’ (18, 3.6%), ‘Altered mental status’ (17, 3.4%) and ‘Postoperative complication’ (16, 3.2%). Six of 13 cardiac arrests (46%) and eight of 63 of multiple trauma cases (13%) were coded as ‘Referral for investigation’.
The 30 cases where no specific CPC was available were: nine referrals for treatment of a specific condition, eighteen abnormal blood tests (seven hyperkalaemia, three abnormal liver function, two anaemia and one each for hypercalcaemia, d-dimer, creatinine, hypoglycaemia, hyponatremia and polycythaemia) and three were for specific radiology tests (one computerised tomography (CT) scan and two ultrasound).
This comprehensive audit of use of the CPC ‘Referral for investigation’ in a New Zealand ED found that approximately 5% of all ED presentations were coded as ‘Referral for investigation’. This is consistent with a previous audit in our department in 2019.10 In nearly every case, an alternative and more specific CPC was available from the triage comments, primary care referral letter or clinical notes.
The cases where this non-specific CPC was used were more likely to be those arriving by ambulance and in the most urgent triage categories. This means that our data on the sickest patients are of lower quality than that of other patients. The need to rapidly load urgent cases onto the hospital information system and focus clinical staff on patient care immediately on arrival means that this CPC was used for expediency by some staff. However, as most urgent cases were being coded with a more specific CPC, this was likely due to individual variation in practice rather than intrinsic to the urgency of the situation.
We identified this issue with use of ‘Referral for investigation’ in 201910 and have attempted to reduce its use by a process of education and feedback for triage nurses and clerks. This process included departmental presentations, engagement of the opinion leaders within each craft group, email reminders and individual feedback. Despite these efforts, there has been no change over time. It is likely that other hospitals introducing SNOMED-CT as part of the Ministry of Health’s requirements may encounter similar problems. We therefore believe that the simplest solution to improve data quality is to remove the CPC ‘Referral for investigation’ from the New Zealand reference set. We also suggest that the following codes be added for presenting complaints that are not currently available in the reference set: ‘Abnormal blood test’ (151271000119102) and ‘Radiographic imaging procedure requested’ (168495003). The alternative to this change is to improve the delivery and uptake of education about more appropriate use of the ‘Referral for investigation’ CPC. This may be feasible in smaller departments with a limited number of staff involved: in our setting, the time and resources required to embark on further efforts at education for the more than 150 staff potentially entering this information would be considerable, especially when there is no guarantee of success. We believe the most efficient and practicable solution is to make the changes suggested above.
‘Referral for investigation’ was used for 5% of all cases presenting to our ED, particularly for the most urgent cases, despite more accurate and specific presenting complaints being readily accessible. ‘Referral for investigation’ should be removed from the New Zealand emergency department reference set for chief presenting complaints to improve data quality.
AIM: The Ministry of Health has mandated that all emergency department (ED) presentations are coded using the Systematised Nomenclature of Medicine – Clinical Terms (SNOMED-CT) from 2021. The current ED reference set contains the non-specific term ‘Referral for investigation’ in the list of available chief presenting complaints (CPCs). The aim of this study was to determine the rate of use of this term and how often a more specific (and therefore more clinically useful) term was used. METHOD: This was a cross-sectional audit of routinely collected presenting complaint data, supplemented by a retrospective case note review. RESULTS: ‘Referral for investigation’ was used for 497/9,067 (5.5%, 95%CI 5–6%) presentations, with increased use for urgent cases. An alternative CPC was available in 467/497 (94.0%, 95%CI 92–96%) of cases from the existing reference set. Of 98 different CPCs, the common alternatives were: ‘Chest pain’ (6.4%), ‘Shortness of breath’ (4.2%) ‘Abdominal pain’ (3.6%), ‘Altered mental status’ (3.4%) and ‘Postoperative complication’ (3.2%). Six of 13 cardiac arrests and eight of 63 of multiple trauma cases were coded as ‘Referral for investigation’. With the addition of two new terms to the New Zealand reference set (‘Abnormal blood test’ and ‘Radiology request’), each of the remaining 30 presentations would have an alternative and more accurate CPC. CONCLUSION: ‘Referral for investigation’ should be removed from the New Zealand emergency department reference set for chief presenting complaints to improve data quality.
1. International Health Terminology Standards Development Organisation SNOMED CT Starter Guide http://www.snomed.org/starterguide.pdf Accessed 28/09/2020.
2. Mowafi H, Dworkis D, Bisanzo M, Hansoti B, Seidenberg P, Obermeyer Z, et al. Making Recording and Analysis of Chief Complaint a Priority for Global Emergency Care Research in Low-income Countries. Academic Emergency Medicine. 2013;20(12):1241-5.
3. International Health Terminology Standards Development Organisation SNOMED CT Five Step Briefing (http://www.snomed.org/snomed-ct/five-step-briefing). Accessed 28/10/20.
4. Jones P, Hughes T, Morton T. Information technology coding systems in the emergency department: It is not the tools, it is how we use them. Emergency Medicine Australasia. 2019;31(5):700-1.
5. MOH: HISO 10048 Emergency Care Data Standard [20/4/20]. Available from: https://www.health.govt.nz/publication/hiso-10048-emergency-care-data-standard Accessed 28/10/20.
6. Grafstein E, Bullard MJ, Warren D, Unger B. Revision of the Canadian Emergency Department Information System (CEDIS) Presenting Complaint List version 1.1. Cjem. 2008;10(2):151-73.
7. Emergency Care Data Set. Royal College of Emergency Medicine https://www.rcem.ac.uk/docs/Informatics/ECDS%20Flyer.pdf Accessed 2/10/2020.
8. Horng S, Greenbaum NR, Nathanson LA, McClay JC, Goss FR, Nielson JA. Consensus Development of a Modern Ontology of Emergency Department Presenting Problems-The Hierarchical Presenting Problem Ontology (HaPPy). Appl Clin Inform. 2019;10(3):409-20.
9. Dinh MM, Berendsen Russell S, Bein KJ. Diagnoses, damned diagnoses and statistics: Dealing with disparate diagnostic coding systems within the New South Wales Emergency Department Data Collection. Emergency Medicine Australasia. 2019;31(5):830-6.
10. Jones PG, Dance A, Shah N. Accuracy of SNOMED-CT Chief Presenting Complaint Codes: an audit of 1,000 cases. The New Zealand medical journal. 2020;133(1526):67-75.
11. Elkin PL, Brown SH, Balas A, Temesgen Z, Wahner-Roedler D, Froehling D, et al. Biosurveillance evaluation of SNOMED CT's terminology (BEST Trial): coverage of chief complaints. Studies in Health Technology & Informatics. 2008;136:797-802.
12. Morbey R, Hughes H, Smith G, Challen K, Hughes TC, Elliot AJ. Potential added value of the new emergency care dataset to ED-based public health surveillance in England: an initial concept analysis. Emergency medicine journal : EMJ. 2019;36(8):459-64.
13. Liljeqvist HT, Muscatello D, Sara G, Dinh M, Lawrence GL. Accuracy of automatic syndromic classification of coded emergency department diagnoses in identifying mental health-related presentations for public health surveillance. BMC Medical Informatics & Decision Making. 2014;14:84.
The full contents of this pages only available to subscribers.
Login, subscribe or email nzmj@nzma.org.nz to purchase this article.