Data linkage across systems
13th June 2022QNADAfocus
Maria Ortiz
There is limited use of data to understand the engagement of people who use drugs (PWUD) in other systems such as the Child Safety, Criminal Justice and Youth Justice systems. Capturing and reporting of data is a critical part of informing and supporting better policy decisions by identifying the needs of PWUD and their families and friends in Queensland. We need this information to build an understanding of the effect that multiple contacts with different systems have on people with complex needs.
Data is also key to support a continuous improvement approach to Alcohol and other Drugs (AOD) treatment service delivery. Improved data collection would strengthen the development of policies to reduce harm and improve the ability to report on the prevalence of AOD treatment services across different systems in Queensland. With the support and perspective from multiple agencies, this would lead to better capturing of the frequency in which people with complex needs are involved in different systems.
The use of existing data (such as the National Drug Household Survey, AOD Treatment Services NMDS or the National Alcohol Indicators Project – the most prominent sources for drug-related data) is a cost effective way of identifying patterns of substance consumption and treatment within a community, and a reliable way to assess trends over time.[1] However, there are some limitations with the use of datasets that are not designed to answer the question of interest, and caution shall be taken when making conclusions to avoid misleading findings. Substantial amounts of data are collected throughout all systems, but it is gathered in ways that constrain the potential information we can obtain from it. Therefore, even though the system is data rich, it is also information poor.
Why is it important that we address data gaps?
Data quality is a measure based on validity, completeness, accuracy, and how current the data is. Advocates give data-based arguments to policy-makers in reports or inquiries, this is significant as the policy implementation approaches often draw upon the findings of these reports. The growing demand for transparent, accountable and responsive reporting from our governments is progressing the availability and volume of data. This is why it is important we address current data issues.
All information comes from raw data that without being organised can be challenging to understand. Drawing insights from raw data involves losing a certain amount of data to facilitate its interpretation. This is when there is greater risk to make misleading or invalid statements. Often these statements are somewhat correct but don’t give the full context.
Inaccurate data needs to be identified to ensure that decision-makers and other users are working with accurate information. Improved data collection/reporting methodologies would not only bring significant benefit to inform governments on the efficient use of funds across systems, but would also “inform clinicians and other service providers [across systems] on the effectiveness and appropriateness of intervention,”[2] and referral options across systems, and “consumers on the choice of service providers and treatment options.”[3]
Common issues with existing AOD data sources
Current data sources do not provide enough information to ensure system responses to people who use alcohol and other drugs is multi-dimensional and “distinguishes between occasional substance use, problematic substance use and dependence so that treatment intensity is matched to need.”[4]
One of the most common issues with the existing data sets is that the sample used to inform findings is usually not representative of the population of interest. This could be due to multiple reasons such as the sample size being too small compared to the actual population or the exclusion of particular subgroups of the sample. For example, there is currently minimal information collected to identify individuals who are members of diverse communities, especially those from culturally diverse communities.[5] According to the Queensland Mental Health Commission Don’t Judge and Listen Report, the NDSHS excludes homeless people, and those who are travelling or are in institutions such as hospitals and prisons,[6] additionally, its sampling methods assume linguistic and cultural understanding between interviewers and participants. This limitation may lead to misrepresentation of actual AOD consumption.[7] Similarly, the Drug Use Monitoring in Australia (DUMA) dataset which collects information from police detainees on drug use, interviews a low number of female detainees, thus, “caution should be exercised when interpreting the results or making gender-based comparisons.”[8]
Likewise, the AODTS NMDS which provides information on publicly funded alcohol and other drug treatment services and their clients, cannot provide information on the total number of clients who access AOD treatment. Since not all treatment services contribute to the AODTS NMDS, this dataset undercounts the number of services for young people engaged in the youth justice system and it is likely to underestimate the extent to which youth justice clients access AOD treatment services.[9]
As well, reporting biases lead to misrepresentation of the ‘average’ individual being studied (i.e. PWUD). Data completeness and uniformity are important to avoid overlooking confounding factors that create some sort of distortion of the true effect that AOD use has on PWUD. For example, the Queensland Family and Child Commission (QFCC) requested information from key government departments about the Queensland Government’s Youth Justice Strategy 2019–23 and they were told that adolescent alcohol and drug services and mental health services, especially when relating to “people with a mental disorder and a history of criminal offending,” only assess and treat clients when issues are significant, “when they may already be offending or re-offending to obtain more drugs or because of other issues in their life.”[10] The information collected in this process shall then not be used to draw conclusions about young people who use drugs and are in contact with the youth justice system, as it will over represent the severity of the issues and the effect of alcohol and other drugs. This is why it is important that datasets collect all significant information across systems, including social determinants of health to avoid perpetuating stigma.
Similarly, administrative data collected by public officers is problematic. Determining the contribution of alcohol to calls for service is constrained by “inconsistent and subjective assessments by frontline officers about the contribution of alcohol, and or poly-drug use to an incident.”[11] In the same way, reporting biases can lead to overrepresentation of particular groups in the criminal justice system such as Aboriginal and Torres Strait Islander peoples, since recording of Indigenous status in police datasets is often based on a “subjective judgement of physical appearance alone.”[12]
Data on the problematic use of alcohol among Aboriginal and Torres Strait Islander people needs to be understood within the historical and social context of colonisation, dispossession of land and culture, and social and economic disadvantage and exclusion. Factors contributing to alcohol use among Aboriginal and Torres Strait Islander people include the availability, price and marketing of alcohol, racism, and personal factors like stress, early life experiences, educational and employment disadvantage, and food insecurity. [13] (Gray, 2018)
Data consistency across jurisdictions is necessary to be able to standardise data across systems and provide a complete picture. This is why, the ongoing commitment to a cross-agency approaches is key to the success of consistent and accurate data collection that leads to complete and reliable datasets and, consequentially, leads to better-informed policy implementation.
—————————————
[1] Peter G. Miller, John Strang and Peter M., Addiction Research Methods. Blackwell Publishing Ltd, 2010.
[2] “Productivity Commission Inquiry Report on Mental Health.” Productivity Commission, 2020.
[3] Ibid.
[4] “Systemic Responses Position Paper.” QNADA, 2021.
[5]Christine Fleming, Robyn Bond, Samantha Holder and Chris Jeffries, “Evaluation of the Specialist Domestic and Family Violence Court Trial in Southport.” 15: Griffith University, 2017.
[6] “Don’t Judge and Listen: Experiences of Stigma and Discrimination Related to Problematic Alcohol and Other Drug Use.” Queensland Mental Health Commission, 2020.
[7] Ibid.
[8] “Drug and Specialist Court Review: Final Report.” Queensland Courts, 2016.
[9] “Overlap between Youth Justice Supervision and Alcohol and Other Drug Treatment Services.” Australian Institute of Health and Welfare, 2018.
[10] “Changing the Sentence: Overseeing Queensland’s Youth Justice Reforms.” Queensland Family & Child Commission, 2021.
[11] “Inquiry into Alcohol-Related Violence- Final Report.” Legislative Assembly of Queensland, Law, Justice and Safety Committee, 2010.
[12] Jacqueline Joudo, “Responding to Substance Abuse and Offending in Indigenous Communities: Review of Diversion Programs.” In Research and Public Policy Series: Australian Institute of Criminology, 2008.
[13] Dennis Gray, Kimberly Cartwright, Anna Stearne, Sherry Saggers, Edward Wilkes and Mandy Wilson, “Review of the Harmful Use of Alcohol among Aboriginal and Torres Strait Islander People.” Australian Indigenous Health Bulletin 18 (2018).