Retrospective analysis of treatment effectiveness among patients in Mianyang Municipality enrolled in the national community management program for schizophrenia

Qingjin LI*, Xuanyin HUANG, Hong WEN, Xiaoqiong LIANG, Lei LEI, Junlin WU

· Original article ·

Retrospective analysis of treatment effectiveness among patients in Mianyang Municipality enrolled in the national community management program for schizophrenia

Qingjin LI1*, Xuanyin HUANG2, Hong WEN2, Xiaoqiong LIANG2, Lei LEI1, Junlin WU3

Background:Over the last six years China has developed the largest community-based service network for persons with serious mental illness in the world (the ‘686 Project’) but the effectiveness of this program has not been assessed in detail.Aim:Compare the characteristics of patients with schizophrenia enrolled in the program whose clinical status has improved with the characteristics of patients whose clinical status has not improved.

Methods: The records of 3090 patients with schizophrenia in Mianyang Municipality, Sichuan (a community with 60% rural residents) who participated in the 686 Project at any time during 2011 were extracted from the national electronic registry system for the project and the demographic and treatment characteristics of individuals rated by treating clinicians as‘recovered’ or ‘improved’ at the time of their last evaluation in 2011 (n=1866) were compared to those of patients rated as‘unchanged’ or ‘worsened’ (n=1224). The factors considered included gender, age, ethnicity, occupation, education, family economic status, marital status, family history of mental illness, duration of illness, time of enrolled in the 686 Program, and adherence to medication.

Results:In the univariate analysis there were significant differences between the two groups in all variables considered except for gender, ethnicity, and family history of mental illness. The recorded treatment outcome was better in patients who were younger, who had a shorter duration of illness, who were more educated, who came from better-off families, who were more adherent to treatment and who had participated in the program for a shorter period of time. Logistic regression analysis found that patients classified as unchanged or worsened were more likely to be non-adherent to drug treatment, to come from families living below the local poverty line, and to be enrolled in the 686 Program for a longer period of time.

Conclusion:Poor treatment adherence and poverty seriously limit the effectiveness of the 686 Program. New approaches to improving adherence and for providing basic financial support to families with a mentally ill member will be needed to enhance the efficacy of the program.

1. Introduction

Schizophrenia is a severe mental disorder with a lifetime prevalence of 7.2 per 1000 persons that usually starts between the ages of 15 and 35.[1]Due to its protracted course and disability, schizophrenia severely affects the social functioning of the individual, undermines the quality of life of family members, and results in a huge socioeconomic burden for the community.[2]

In order to standardize the management of patients with severe psychiatric diseases, China launched a nationally subsidized program for the registration and treatment of such individuals in 2005: the National Continuing Management and Intervention Program for Psychoses. This project is referred to as the ‘686 Project’because the funding for the first year of the program was 6.86 million Renminbi. Individuals with schizophrenia, one of the most common severe mental illnesses,[3]have gradually been enrolled in the management network, which is operated by the national public health system. Over the first six years of development the 686 Project has been expanding and evolving to meet the changing needs of patients, their family members and communities. The treatment model is now standardizedand data on all cases is kept up-to-date in a national electronic registry system so it is now feasible to conduct a formal assessment of the factors that are associated with successful outcomes among patients enrolled in the program.

2. Subjects and Methods

2.1 The 686 Program

Mianyang is a municipality of approximately 5.22 million people[4]in Sichuan Province, 60% of whom live in rural areas. The 686 Program provides services to permanent residents of the municipality with serious mental illnesses who have received treatment at specialist psychiatric hospitals, general hospitals and community health clinics throughout the municipality. Patients and their guardians identified through this service network are invited to participate in the program; those who provide written informed consent are enrolled. The enrollment of patients in the 686 Program started in 2006 but initially enrollment was quite slow. A renewed effort to expand enrollment and to standardize the services provided by the program started in July 2010. This initiative included the following steps:

Step 1: Medical records including information from a key informant screening questionnaire of mental disorders, emergency room records, and discharge summaries from clinics and community hospitals in Mianyang were scrutinized to identify individuals with serious mental illnesses.

Step 2: Psychiatric specialists reviewed the recorded data for the suspected cases and completed the ‘case finding registration form.’ If the case already had a diagnosis of schizophrenia from a specialist psychiatric service this was considered definitive, other suspected cases were individually assessed by psychiatrists who visited the individuals’ homes.

Step 3: Individuals the specialists identified as suffering from schizophrenia or other serious mental disorders were registered in the system and township or community. Physicians then completed patients' basic personal information forms and supplemental forms, and established a health file for the individual.

Step 4: The patient or family were contacted to obtain written informed consent that would allow the details of the patient’s condition to be entered into the 686 data system by the township or community physicians. All baseline, treatment, follow-up, and outcome information on these patients is regularly recorded and updated in the electronic 686 Project Management and Treatment System.

Step 5: Township doctors followed the patients at least once every 3 months and a psychiatrist saw each patient at least once every 6 months to supervise their treatment. Stable patients were primarily followed by township doctors, unstable patients were primarily followed by psychiatrists. Medications were provided free-of-charge by the government.

2.1.1 Diagnostic criteria

The diagnosis of schizophrenia was based on the 3rd edition of theChinese Classification and Diagnostic Criteria of Mental Disorders.[5]Doctors participating in the review of diagnoses were either psychiatric resident physicians or psychiatrists with more than 5 years of experience.

2.1.2 Instruments

The standardized instruments developed for the national registry program[6]are employed in the 686 Program in Mianyang: a checklist for identifying individuals with abnormal behaviors, an emergency medical treatment record sheet, information sheets on hospitalization of enrolled patients, baseline personal information forms and supplemental forms for severe cases, informed consent forms, assessment forms of dangerous behaviors, and consent forms for release of information.

2.1.3 Program management

The 686 Program is supervised by the Sichuan Provincial Health Department and coordinated by the Center for Chronic Non-Communicable Diseases under the Sichuan Centers for Disease Control. The Expert Committee for the Division of Chronic Non-Communicable Disease’s Mental Health Group is responsible for providing expert advice. The program covers all 276 townships within Mianyang Municipality. To ensure that procedures were conducted according to the protocol, the Sichuan Provincial Mental Health Center provided standardized training to all of the over 600 individuals involved in the data collection. Input and quality control components of the project and these individuals had to pass an examination prior to participating in the project.

2.1.4 Quality control

Three different methods were used to ensure quality control. a) The Mianyang Municipal Health Bureau established regulations for assessing the effectiveness of the management and treatment of individuals with serious mental illnesses and incorporated these regulations into the annual evaluation metrics foreach county's health bureau. These criteria included the proportion of all mentally ill patients under management; the proportion of managed patients who are taking medication; the level of awareness of mental health issues in the community, and so forth. b) The municipal psychiatric hospital, in accordance with the National Regulations on the Essential Public Health Services for the Management and Treatment of Serious Mental Illness (2011),[7]supervised the mental health services for persons with severe mental illnesses provided at township hospitals and reported the results to the Sichuan Provincial Health Department. And c) the Sichuan Provincial Health Department organized experts to provide technical support and supervision of the project.

2.2 Data extraction

The identification of patients included in this analysis is shown in Figure 1. For the current retrospective analysis we abstracted information from the electronic registry system for patients in Mianyang Municipality who received services from the 686 Program during 2011, who were 15 years of age or older, and who met the diagnostic criteria for schizophrenia according to the 3rd edition of theChinese Classification and Diagnostic Criteria of Mental Disorders(CCMD-3 ).[5]The data collected included gender, age, ethnicity, occupation, education level, family economic status (i.e., below or above the local poverty line), marital status, family history of mental disorders, duration of illness (i.e., time from first onset to last assessment in 2011), time enrolled in the 686 Program at the time of the last visit, and treatment compliance and effectiveness at the time of the last clinical assessment in 2011. Treatment effectiveness was recorded by the clinician who evaluated the patient (approximately 40% were psychiatrists and 60% were township or community physicians), covered the time period since the last visit (i.e., from 1 month to 6 months), and was classified as ‘recovered’, ‘improved’, ‘unchanged’ or ‘worsened’based on the overall judgment of the clinician. These follow-up visits were either conducted in patients’homes or, if the patient was stabilized, at the township hospital.

As shown in the flowchart, 35 of the 3125 (1.1%) identified patients were dropped from the program during 2011 due to migration out of the district, death or other causes; so a total of 3090 individuals were included in the analysis.

2.3 Statistical analysis

SPSS 19.0 software[8]was used for the analysis. Univariate differences in the characteristics of patients classified as ‘recovered’ or ‘improved’ (hereafter,‘improved’) and those classified as ‘unchanged’ or‘worsened’ (hereafter, ‘not improved’) at the time of the last clinical evaluation in 2011 were conducted using t-tests and chi-square tests. Follow-up multiple comparison tests for categorical variables use a Tukeytype multiple comparison method based on an arcsin transformation of the original proportions.[9]Variables that were statistically significant in the univariate analysis were entered into a forward stepwise regression analysis to identify independent factors associated with good outcomes in the program. All statistical tests weretwo-tailed and the level of significance was set at p＜0.05.

Figure 1. Flowchart of case identification

The 686 Program has been approved by the Ethics Review Board of the Sichuan Provincial Mental Health Center.

3. Results

3.1 Univariate analysis

The 3090 enrolled patients who completed the follow-up assessments had a mean age of 49 years and a mean duration of illness of 15.1 years. At the time of the final evaluation in 2011 the median duration of participation in the 686 Program was 5 months (interquartile range, 2–8 months), though a small minority of patients had participated in the program since its inception 6 years previously. Farming was the main occupation of 85% (2622/3090) of the participants, reflecting the fact that Mianyang Municipality is primarily a rural community.

With the exception of gender, ethnicity and family history of mental illness, all the other variables showed statistically significant differences between patients classified as ‘improved’ and those classified as ‘not improved’ at the time of the last clinical evaluation in 2011. As shown in Table 1, improved patients were younger, had a shorter duration of illness and had participated in the 686 treatment program for a shorter length of time than patients who were not improved. As expected there was a step-wise relationship betweenbetter treatment adherence and clinical improvement. Patients with higher educational status or better family economic conditions were also more likely to be classified as improved. Farmers were less likely to be classified as clinically improved than factory workers and those who had been widowed were less likely to be clinically improved than those who had never married or were currently married.

Table 1. Comparison of the characteristics of patients with schizophrenia enrolled in the 686 Program in Mianyang, China who were classified as improved or not improved by the treating clinician at the time of the last clinical evaluation in 2011

3.2 Multivariate analysis

All eight statistically significant variables in the univariate analyses were entered as independent variables in the stepwise logistic regression of factors related to clinical improvement. As shown in Table 2, only duration of illness and age did not enter the final model, indicating that the remaining six factors are independent predictors of clinical improvement. Similar to the univariate analysis, being classified as clinically improved at the time of the last clinical evaluation in 2011 was associated with better adherence, better family economic status and shorter times of participation in the 686 Program. There was a clear ‘dose-response’relationship between adherence and outcome; patients with good adherence had better outcomes than those with fair adherence and they all had better outcomes than those who were non-adherent.

The results for the other three variables that were retained in the multivariate model – marital status, educational background, and occupation – were not as clear cut, probably because of the relativelysmall numbers of patients in some of the categories. Individuals who were divorced or widowed were less likely to be classified as improved than those who have never married, but there was no difference in the outcome classification between those who were currently married and those who had never married. There was a non-significant trend of better outcomes for individuals with higher levels of education. Patients with some education were all more likely to be classified as improved than those who had no education (i.e., illiterate) but this difference was only statistically significant for those with a middle school education. Interestingly, those who had no educational status recorded had worse clinical outcomes than illiterate patients. And individuals with ‘other’ occupations (e.g., self-employed, management positions, etc.) were more likely to be classified as clinically improved than farmers but there were no other differences by occupational status.

4. Discussion

4.1 Main findings

Patients enrolled in the 686 Program classified as having no clinical improvement at the time of the last evaluation in 2011 were more likely to be non-adherent to treatment (primarily mediation), to be members of families that were living below the poverty line, to be widowed or divorced, and to have been enrolled in the program for longer periods of time.

The finding that treatment adherence was the strongest predictor of effectiveness confirms a long list of previous studies in China and elsewhere[10-13]in this new, primarily rural, community-based setting in China. The characteristic symptoms of schizophrenia and adverse reactions to many of the commonly used medications for schizophrenia make adherence to recommended treatments a particularly difficult problem in the management of patients with chronic schizophrenia.[14,15]The lower rate of improvement among patients living in poverty confirms other studies that find better outcomes in patients with better economic conditions.[16,17]Patients who are divorced or widowed (9% of the current sample) have lost an important component of their social support network (who often help in the supervision of medication) so it is not surprising that these individuals have poorer clinical outcomes.

Perhaps the most unexpected findings were that occupational status was not clearly related to outcome and that outcomes were worse in patients who had been enrolled in the 686 Program for longer periods of time. As reported by others[18]the vast majority of individuals with schizophrenia enrolled in the program had low occupational status (85% of the current sample were classified as ‘farmer’) so the numbers of cases in the other occupational classes are too few to make meaningful comparisons (e.g., there were only 27 subjects in our study classified as factory workers). Moreover, family economic status is related to occupational status of the patient so inclusion of family economic status in the model weakens the independent predictive power of the patient’s occupational status.

The 686 Program in Mianyang Municipality started enrolling patients in 2006 so there are some participants who have been in the program for up to 6 years, but most of the current participants have been enrolled since the new effort to enroll patients started in July 2010. As of the end of 2011, 25% of participants had been in the program for 3 months or less, 50% of participants had been in the program for 5 months or less and 75% of participants had been in the program for 8 months or less. We expect that patients who were enrolled before the new initiative to increase enrollment started and those identified soon after the initiative started may have been patients with more severe, intractable problems (who were well known by the local providers) and that those enrolled more recently were less severely affected by their illness. If this is the case, patients who are enrolled for longer periods in the program would be more likely to be clinically classified as ‘unchanged’ or‘worsened’ and those enrolled for shorter periods would be more likely to be clinically classified as ‘recovered’ or‘improved’. Further analysis of the severity of symptoms at the time of entry in the program would be needed to assess this hypothesis.

4.2 Limitations

The current analysis is primarily limited by the narrow range of variables recorded in the electronic registry system for the 686 Program and by the uncertain validity of some of the variables included in the registry. The most important consideration for the current analysis is the validity of the outcome evaluation and the assessment of adherence by the treating clinicians. The more than 600 clinicians involved in the project were provided training in these determinations, but the decision about how to classify a specific patient at a particular point in time inevitably involves some subjective clinical judgment. There has been no assessment of the interrater reliability of participating clinicians regarding these assessments so the accuracy of the determinations of outcome and adherence remains uncertain. Another problem is that the time frame for assessing outcome and adherence is uncertain because the duration of follow-up is so variable between different patients. And the status of patients at the time of the last clinical evaluation at the end of 2011 does not necessarily reflect the outcome and adherence during 2011 or (for the majority of patients who were enrolled for less than 1 year) during the time of enrollment in the program. Moreover, the simultaneous evaluation of clinical outcome and adherence by the same clinician inevitably magnifies the correlation of these variables becauseclinicians have a strong bias that assumes adherence is essential to good outcomes.

There are several other problems that will need to be addressed in subsequent studies. It is unclear what proportion of all patients with schizophrenia in Mianyang are enrolled in the 686 Program so it is not possible to say how representative the sample is or how generalizable the result would be for all community-based patients. Without data on the relapse rate, re-hospitalization rate (or duration) and re-employment rate it is hard to assess the social important outcomes of the patients. Similarly, without data on the medications used, the dosages and the rates of adverse reactions it is hard to relate the outcomes to the interventions provided. And the‘time enrolled in the program’ variable generated some unexpected results that were, possibly, related to the highly skewed distribution of enrollment times; it may have been better to convert this to a categorical variable in the analysis (e.g., greater than 1 year, 3-12 months, under 3 months) rather than using it as a continuous measure.

4.3 Significance

Despite these limitations this large study is one of the first reports on the efficacy of the 686 Program. The clear relationship of poor clinical outcomes with poor adherence and with poverty is not new but it highlights the urgency to developing creative methods of improving adherence and of providing financial assistance to families that have a member with a serious mental illness. The ultimate success or failure of the 686 Program will depend on its ability to overcome these two major barriers to improving patient outcomes.

This analysis also highlights important problems in the 686 Program that need to be rectified. Outcome measures included in the registry system need to include‘hard’ variables such as relapses, re-hospitalizations, and full-time employment. Treatment variables need to include medication type, dosage and serious side effects. The reliability of the clinical ratings need to be evaluated and, if lacking, additional training should be provided until the reliability of the ratings is satisfactory. The assessment of outcomes needs to be integrated over time periods (say one year) rather than cross-sectional one-time assessments. And economic data need to be integrated into the information system so that the cost-effectiveness of the program can be assessed and compared to that of other community-based programs for persons with severe mental illnesses. These revisions to the training and data collection system for the 686 Program are essential to enhance the validity of the assessment of its efficacy and, thus, provide the data needed to alter the program in ways that will improve outcomes for patients with severe mental illnesses.

Conflict of interest

The authors report no conflict of interest.

Funding

This project was supported by funds from the‘National Project on Management and Treatment of Severe Mental Illness’ and the ‘National Fund for Equalizing Public Health Services’.

1. McGrath J, Saha S, Chant D, Welham J. Schizophrenia: a concise overview of incidence, prevalence, and mortality.Epidemiol Rev2008; 30: 67-76.

2. Rice DP. The economic impact of schizophrenia.J Clin Psychiatry1999; 60 (suppl 1): 4-6; 28-30 (discussion).

3. National Center for Mental Health, Chinese Centers for Disease Prevention and Control.Training in Quality Control Assessment of the Management System for Severe Mental Illnesses. Beijing: National Mental Health Project Office, 2007: 14. (in Chinese)

4. Bureau of Statistics of Mianyang Municipality.2010 Mianyang Statistical Yearbook. Beiing: China Statistics Press, 2010: 20. (in Chinese)

5. Chinese Society of Psychiatry, Chinese Medical Association.Chinese Classification and Diagnostic Criteria of Mental Disorders. 3rd ed. Jinan: Shandong Science and Technology Press, 2004: 75-91. (in Chinese)

6. Ministry of Health of the People’s Republic of China.Standards for the Management and Treatment of Severe Mental Disorders.http://www.moh.gov.cn/publicfiles/business/htmlfiles/ mohjbyfkzj/s5889/200911/44384.htm. [Accessed 18 June, 2012] (in Chinese)

7. Ministry of Health of the People’s Republic of China.National Regulations on the Essential Public Health Services for the Management and Treatment of Serious Mental Illness. http://www.moh.gov.cn/publicfiles/business/htmlfiles/ mohfybjysqwss/s3577/201105/51780.htm [accessed on 13 June, 2012] (in Chinese)

8. Ma BR.Use of SPSS (PASW) 17.0 in Medical Statistics. 4th ed. Beijing: Science Press, 2010: 73-82. (in Chinese)

9. Zar HG.Biostatistical Analysis. 4th ed. New Jersey: Prentice Hall, 1999: 563-565.

10. Cai ZJ, Weng YZ.Pathogenesis, Diagnosis, Treatment and Rehabilitation of Schizophrenia. Beijing: Science Press, 2000: 191-192. (in Chinese)

11. Fan LZ, Wang YL, Guo ZY, Zhang MS. Comparison of treatment compliance of patients with schizophrenia using the oral liquid preparation of risperidone and the tablet preparation of quetiapine.Chin J Nerv Ment Dis2005; 31(5): 367-368. (in Chinese)

12. Ciudad A, Alvarez E, Bobes J, San L, Polavieja P, Gilaberte I. Remission in schizophrenia: results from a 1-year follow-up observational study.Schizophr Res2009; 108(1-3): 214-222.

13. Ji Q, Yang QP, Zhang H. The influence of free medication in community on compliance and relapse of schizophrenia.J Clin Psychiatry2011; 21(6): 404-405. (in Chinese)

14. Quan YB. Effects of rehabilitation on medication compliance in patients with schizophrenia.China Practical Medicine2011, 6(25): 238-239. (in Chinese)

15. Chen YX, Li GL, Lu QH, Wen HL. Relationship between treatment adherence and relapse after a first episode of schizophrenia.Guangdong Pharmaceutical Journal2001; 11(5): 41-42. (in Chinese)

16. Ran MS, Chen S, Chen EY, Ran BY, Tang CP, Lin FR, et al. Risk factors for poor work functioning of persons with schizophrenia in rural China.Soc Psychiatry Psychiatr Epidemiol2011; 46(11): 1087-1093.

17. Xie KK, Zhang GF, Li Y, Luo XN. The correlation of economic burden and quality of life of the family members of schizophrenic patients in Beijing.J Clin Psychiatry2011; 21(2): 84-86. (in Chinese)

18. Chen KQ, Zhang QY. Occupation status of inpatients with schizophrenia.Journal of Xianning College (Medical Sciences)2003; 17(4): 275-276. (in Chinese)

· 论著 ·

背景在过去的6年里，中国开展了世界上最大规模的重性精神病社区管理治疗项目（简称686项目），但项目实施的效果并未得到详细的评估。

目的对参与该项目的精神分裂症患者的临床有效者与临床无效者的特征进行比较。

方法从该项目的全国登记系统电子数据库中，提取2011年在四川省绵阳市（农村人口占60%）参加该项目的精神分裂症患者的资料，共3090份。根据精神科医生2011年的末次评估，将患者的疗效为“治愈”或“好转”者归为有效组（n=1866），将 “无变化”或“加重”者归为无效组（n=1224），比较两组之间的社会人口学特征和治疗特点。收集的资料包括性别、年龄、民族、职业、文化程度、家庭经济状况、婚姻状况、精神疾病家族史、患病时间、参加686项目的时间以及治疗依从性等。

结果单因素分析结果显示，除性别、民族和精神疾病家族史外，其他因素的组间差异均有统计学意义。年龄小、病程短、受教育时间长、家庭经济状况好、治疗依从性好、参与686项目时间短的患者疗效更好。Logistic回归分析结果显示，服药依从性差、家庭贫困以及参加686项目时间长等因素更多见于疗效“无变化”或“加重”的患者。

结论治疗依从性差和家庭贫困严重地影响了686项目的效果。想方设法提高精神疾病患者的治疗依从性，向患者家庭提供基本的经济支持，将有助于提高该项目的成效。

绵阳市规范管理的精神分裂症患者治疗效果的回顾性分析

李清金1* 黄宣银2文红2梁晓琼2雷蕾1吴俊林3

1泸州医学院临床医学院，四川泸州

2四川省精神卫生中心，四川绵阳

3川北医学院临床医学院，四川南充

*通信作者：2002lqj@163.com

2012-02-20; accepted: 2012-03-28)

10.3969/j.issn.1002-0829.2012.03.002

1Luzhou Medical College, Luzhou, Sichuan Province, China

2Sichuan Provincial Mental Health Center, Mianyang, Sichuan Province, China3North Sichuan Medical College, Nanchong, Sichuan Province, China

*Correspondence: 2002lqj@163.com