Introduction

“The Epidemiological Survey of Mental Disorders” in Korea has been conducted every 5 years starting from 2001, and has reported that mental illness including depression, has been gradually on the rise. Prevalence of mental illness rose from 9.1% in 2006 to 10.2% in 2011, and a prevalence of a lifetime of mental illness increased from 12.6% to 14.4% [1,2] In spite of the high prevalence of mental illness, it was found that the proportion of patients receiving counseling from a psychiatrist or another mental health professional was 15.3% in 2011, and thereby approximately 85% of the patients had no experience of using mental health services [3]. Compared to 39.2% in the US (2010), 34.9% in Australia (2009) and 38.9% in New Zealand (2006), mental health services were significantly underutilized [4]. Thus, it is important to prepare national strategies for mental health problems in all age groups in Korea.

The paradigm shift in treatment of patients with mental illnesses in hospital to mental health promotion among the general population [5], early detection of mental illness and integration of these patients into local communities, requires a change in the direction of mental health research and development (R&D) projects. The financial support for mental health R&D provided by the Ministry of Education, Ministry of Science, Information and Communications Technologies (ICT) and Future Planning, and Ministry of Health and Welfare in Korea, was roughly increased by 8.9% for 5 years, from about 24 billion won in 2010 to about 33.9 billion won in 2014, however, the proportion of investment is still only 2.6% of the whole national health service R&D budget per year [6–8]. The proportion of the R&D research budget for national mental health treatment from 2008 to 2012 was 53.5% for basic mechanism research, followed by 35.4% for the first stages of translational research (T1), and 5.3% for the second stage of translational research (T2). By 2014, 47.9% of the R&D budget was allocated for basic mechanism research, 30.8% for T1, and 10.3% for T2 [9].

Developed countries such as US, United Kingdom, and Australia are promoting national mental health R&D projects, and R&D investment in national (public) mental health, accounts for about 6%–10% of total healthcare research expenditure [10]. Three research institutes affiliated with the National Institutes of Health (NIH) in the US, (i.e. the National Institute of Mental Health, the National Institute on Drug Abuse (NIDA), and the National Institute on Alcohol Abuse and Alcoholism), spent approximately 16%–17% of the total NIH budget in 2016 on R&D [10–13]. With respect to the proportion of investment, translational research, service and intervention research accounts for 35% or more in National Institute of Mental Health, and NIDA invests approximately 42.1% in translational clinical research and epidemiological research. The National Institute on Alcohol Abuse and Alcoholism actively performs and supports research for the prevention of alcohol abuse and addiction and its development, and carries out an exchange program with other nations and state governments [10]. In the UK, the R&D budget to support mental health was increased by 1.5% (about 58 million euros) from 2004 to 2014 [14], with approximately 45% of the proportion of national R&D healthcare investment for basic research (fundamental research, research for investigating the causes) from 2004 to 2014, 10%–17% for T1 (screening and diagnostic research, treatment development research), and about 45% for T2 (treatment evaluation research, research for prevention and health promotion, disease control research, and research for healthcare service), thereby indicating a high percentage of investment for translational and service research [14]. Australia emphasized mental health promotion amongst the general population, focusing on chronic mental illness patient care (1st–2nd plan), and prevention of mental illness in the high-risk group, and enhancement of mental health research support and service quality improvement (3rd plan) by establishing national mental health strategies as a 5-year plan from 1992. Currently in the 4th plan, the focus has been on prevention of mental illness and early intervention [15].

Developed countries recognize the importance of mental health research, making aggressive investments in science and technology which is directly connected with the national economy. In particular, it was shown that mental health R&D projects have great effectiveness in reducing socio-economic costs relative to the investment [8,16]. This is because disease prevention through early intervention and mental health promotion, may reduce national health expenditure, and indirectly improve human productivity, and reduce public sector expenses (for instance judicial administrative expenses) [8,16]. Mental health R&D investment in Korea, may be disparate at each research stage, and application and diffusion of research outcomes to local communities are insufficient compared to developed countries. Therefore, support and enhancement of translational research are required to improve mental health research [8,16–18]. This study was conducted as a preliminary analysis to examine R&D projects in mental health in Korea, and to evaluate crucial projects according to the relative priority of national policy coordination meetings assessing the mental health problem in 2016 [5]. This may be considered as the current national mental health policy of Korea. The aim of this study was to assess the validity in establishing medium- and long-term plans for national mental health R&D strategies.

Materials and Methods

1. Study design and data collection

The questionnaire was created to evaluate mental health R&D core projects, utilizing a comprehensive plan reported in a national policy coordination meeting in February 2016. The plan was based on 12 strategies, 214 detailed contents of 32 policy projects for achieving each strategy, according to 4 policy objectives [5].

The questionnaire items were categorized into 3 sections: 1) relative importance of policy objectives, 2) relative importance of policy projects and detailed contents of strategies, and 3) socio-demographic characteristics.

For measuring priorities of policy objectives, 3 items were identified; 1) necessity of a national response, 2) possibility of technology development success and 3) magnitude of the ripple effect.

Scores ranged from 1 to 9 points, with the higher the score, the stronger the relative influence. The relative importance was deduced using a pairwise comparison method. The evaluation criteria for deducing priority weighting are presented in Table 1. The items for measuring the relative importance of policy projects and detailed content of strategies for a comprehensive plan on mental health promotion are shown in Table 2. They consist of 4 policy objectives; 1) promotion of national mental health, 2) integration of patients with serious mental illness into local communities, 3) minimization of health impediment and social harmful effects caused by addiction, 4) realization of a safe society without suicidal risk and strategies in accordance with each policy objective. The relative importance was evaluated by presenting policy projects and detailed contents of each strategy (see a comprehensive plan for mental health promotion reported in February 2016) [5], and a multi-criteria evaluation method (which measured 3 evaluation items together such as ‘possibility of technology development success,’ ‘magnitude of the ripple effect,’ and ‘necessity of a national response’) was selected. A score of 9 points (high importance), 3 points (average), or 1 point (low importance) was used depending on the degree to which each detailed content had an effect on each evaluation item. To identify social demographic characteristics age, major field of study, currently affiliated institution, and work experience were surveyed.

There were 84 experts including psychiatrists, medical employees, social welfare experts, employees working in a psychological autopsy center, and policy researchers. This survey was conducted over a 3-week period (13^th July 2016 to 5^th August 2016), following e-mail responses to the questionnaires. The number of questionnaires that were completed in full was 27. The online survey was implemented through a technology policy research center of Worldwide Intellectual Property Service (WIPS). This study was approved by the Institutional Review Board of the National Center for Mental Health of Korea (approval number: 116271-2017-29).

2. Measurement of the variables

Pairwise comparison among 4 policy objectives of a comprehensive plan on mental health promotion

Pairwise comparison was performed to derive weighted values for the 4 policies, and the relative importance between 2 policy objectives was evaluated considering detailed criteria according to the evaluation items. Moreover, it was utilized to provide weighted values while evaluating 32 policy projects involved in the subcategory of 4 policy objectives. Table 3 shows an example of the method for evaluating the relative importance.

Multi-criteria evaluation of 214 detailed contents of a comprehensive plan on mental health promotion

The importance of 214 detailed contents was evaluated by considering detailed criteria, with emphasis on multi-criteria to determine preferential support areas. It was utilized as a basic score to decide the priorities of 32 policy projects which were the parent category of the 214 detailed contents. Table 4 shows an example of the multi-criteria evaluation measurement of the 214 detailed contents.

3. Statistical Analysis

The Analytic Hierarchy Process (AHP) was used for identification of qualitative factors that support systematic evaluation or evaluation criteria that were complex. It was useful as quantitative results were obtained by systematically scaling the ratio of the relative importance or preferences. It can also be employed in the decision-making process in the private and public sector (plans for higher education, presidential election, and establishment of environmental policies). The AHP was used in pairwise comparisons according to each index; (step 1), implementation of pairwise comparison between detailed areas (step 2), preparation of comparison matrix for pairwise comparison results (step 3), and confirmation of the deduced relative priorities (step 4) were conducted in sequence.

The scores of 32 policy projects (parent category of detailed contents), were calculated by adding average scores according to the items of the 214 detailed contents. The priorities of these 32 policy projects were evaluated on this basis. Weighted values were then given to 32 policy projects after pairwise comparison. AHP analysis was performed with Expert Choice (ver. 11.5) software.

Results

1. Participant characteristics

As a result of the online survey, 27 questionnaires were used for analysis. Sociodemographic characteristics of the respondent experts according to age were included; 7 people in their 30s, 17 people in their 40s, and 3 people in their 50s. Their majors were psychiatry, nursing science, preventive medicine, health science, social welfare, clinical psychology, medical biotechnology, medical informatics, and humanities and social sciences (sociology, education, economy, science and technology policy), and they also had work experience relevant to mental health and worked in hospitals, national and private universities, research centers and companies, and their employment history in each major field of study was as follows: 5 people were employed for less than 10 years, 16 people were employed for 10 years or more, 5 people were employed for 20 years or more, and 1 person was employed for 30 years or more.

2. Assessment and values for 32 policy projects of a comprehensive plan on mental health promotion

Table 5 illustrates the assessment of the respondents’ questionnaire and average values for the 3 evaluation criteria, such as the possibility of technology development success, necessity of a nation response, and magnitude of the ripple effect. With respect to the possibility of technology development success, ‘Establishment of evidence-based research systems for suicide prevention’ (6.12), ‘Establishment of a response to suicidal risk and post-management systems’ (5.99), ‘Improvement of health insurance and medical benefit cost system’ (5.45), ‘Reinforcement of education related to suicide prevention’ (5.33), and ‘Establishment of a social support system for suicide prevention’ (5.32 ) were evaluated in the sequence listed, and with respect to necessity of a national response, ‘Establishment of a response to suicidal risk and post-management system’ (6.76), ‘Establishment of evidence-based research systems for suicide prevention’ (6.73), ‘Establishment of a social support system for suicide prevention’ (6.15), ‘Reinforcement of crisis psychological support such as that for disaster victims’ (6.07), and ‘Improvement of suicidal risk circumstances’ (5.74) were evaluated. With respect to the magnitude of the ripple effect, the results involving ‘Establishment of a response to suicidal risk and post-management systems’ (6.59), ‘Establishment of evidence-based research systems for suicide prevention’ (6.41), ‘Establishment of a social support systems for suicide prevention’ (5.69), ‘Improvement of health insurance and medical benefit cost system’ (5.34), ‘Reinforcement of crisis psychological support such as that for disaster victims’ (5.25) were ranked in the order named. In all 3 types of evaluation criteria, the average values of policies related to suicide were high, and in the case of the other criteria, the importance of policies strengthening crisis psychological support, such as improvement of health insurance and medical benefit cost system for disaster victims appeared to be high. The overall priorities for 32 policy projects showed that the necessity of a national response ranked first, magnitude of the ripple effect ranked second, and possibility of technology development success ranked third. As these results were equal to the results of the evaluation criteria priority, the questionnaire results were verified as being reliable.

3. Deducing the weighted average value

Table 6 indicates the analytic process calculating the weighted average values. The results such as necessity of a national response (5.23), magnitude of the ripple effect (4.76), and possibility of technology development success (4.63) are ranked in the sequence listed.

4. Priorities of 32 policy projects

Figure 1 illustrates the results of drawing priorities of 32 policy projects by providing the weighted values derived from pairwise comparison among policy objectives.

After comparing the average values of the 3 evaluation criteria according to each policy project, 3 projects among the upper 5 projects turned out to be suicide-related policy projects. The policy of ‘Establishment of a response to suicidal risk and post-management systems’ was evaluated as high at 6.45 points, the policy of ‘Establishment of evidence-based research systems for suicide prevention’ was evaluated as 6.42 points, and the policy of ‘Establishment of a social support systems for suicide prevention’ was evaluated as 5.72 points. Moreover, the policy of ‘Improvement of health insurance and medical benefit cost system’ (5.50) from the institutional aspect relevant to the rate of mental health care service use was evaluated as the 4th priority, and the 5th priority turned out to be the policy of ‘Reinforcement of crisis psychological support such as that for disaster victims’ (5.47).

Discussion

In this study the grounds for suggesting strategies, and policy projects that should be prioritized in mental health service R&D, were based on the possibility of successful technology development, necessity of a national response, and magnitude of the ripple effect.

Analysis of the online survey contents using AHP, supported by the application of weighted values to the questionnaire results, proved reliable. The relative priority evaluation of 32 policy projects of a comprehensive plan on mental health promotion, showed that suicidal problems ranked high. R&D project support in the field of mental healthcare service, related to a number of policies, such as establishment of a social support system, enforcement of lifetime suicide prevention plans and establishment of a response to suicidal risk and post-management system, reinforcement of education relevant to suicide prevention, and establishment of an evidence-based suicide prevention research system are required.

Establishment of a suicide prevention research system, using a cohort study for analyzing the causes of suicide, and establishment of a gatekeeper training system and reinforcement of specialized education for building infrastructure, can serve as examples for national policy development.

Compared with developed countries, there is a lot of potential for development if research support is provided [17,18]. National R&D and support are necessary where there have been social problems such as addiction and suicide in Korea. Currently, aggressive investment in translational research is required to increase basic research. Meanwhile, the rate of mental healthcare services should be increased by making a political effort to improve health insurance and medical benefit cost systems, to reduce the national burden of suicide caused by mental illnesses. Social issues involving a murder case at Gangnam station, indiscriminate sex crimes, child abuse, and PTSD induced by a calamity/disaster such as the Sewol ferry accident, are problems that are difficult to solve individually [19,20]. A response to public demand related to a disaster and psychological crisis support, would generate greater support for R&D policies. For example, among governmental R&D projects responses to infectious diseases were given priority in 2016, as a result of a series of national disasters such as novel influenza (2012), and the Middle East Respiratory Syndrome (MERS) outbreak (2015).

The expansion of mental health R&D projects is necessary to reduce the prevalence of domestic mental illness and social problems [21–23]. According to the results of this study, the deduced R&D projects in the field of mental health are based on 4 national policy objectives of a comprehensive plan on mental health promotion:

Firstly, the policy objective of ‘Promotion of national mental health’ should consider promotion of mental health in local communities, management of mental health through lifestyle choices for prevention/diagnosis, development of treatments, and mental health management in high risk groups. The aim is for emotional anxiety of people involved in disasters such as the Sewol ferry accident and earthquakes, to have a national mental healthcare response policy for these crises. Projects including development of mental health management programs customized according to age/region/special group targeting ordinary people and verification of clinical effectiveness (conducting application evaluation of the samples), development of indices for mental health and community restoration models, development of mental illness treatment and intervention models and verification of their effects, and model development for early detection of mental illnesses and prevention would provide useful information for generating national policies.

Secondly, the policy objective of ‘Integration of patients with serious mental disease into local communities’ puts emphasis on system improvement, rehabilitation through local community programs, and the importance of improving recognition. Establishment of policy enables the rehabilitation of patients with mental illness that would reduce economic costs by avoiding unnecessary hospitalization. Rehabilitation of patients with mental illness should be encouraged by providing the necessary information related to mental illness, increasing treatment, whilst preventing long term intensive treatment. Projects such as construction of effective mental disease management systems and local community models, reduction of the stigma and discrimination relevant to mental illness, and reduction of rehospitalization rate for mental disease may help to increase rehabilitation.

Thirdly, the policy objective of ‘Minimization of health impediment and social harmful effects caused by addiction’ focuses on development of addiction prevention models, development of early selection/diagnosis of addiction treatment and restoration and development of social connection, establishment of countermeasures for prevention of long term addiction, and minimization of socially harmful effects. Addiction problems can cause all types of crimes and vulnerable social groups requiring national prevention management [24]. One out of 8 Koreans is an addict within the 4 major addiction groups (alcohol, drugs, gambling, and internet), and the cost of socio-economic loss is estimated to be more than 109 trillion won [25,26]. In particular, addiction problems among adolescents may affect the national economy in the future. Development of projects and guidelines for treatments at each stage of addiction and verification of clinical effectiveness, would enable an effective national response.

Fourthly, the policy objective of ‘Realization of a safe society without suicidal risk’ considers establishment of suicide prevention countermeasures and construction of systems managing a suicide high risk group as crucial factors. Analyzing the psychological, biological and social factors required for a targeted and separate suicide prevention strategy in Korea. Projects involved with obtaining data (i.e. creating a suicide statistics database, psychological autopsy), for establishing customized suicide prevention plans may enable continuous monitoring systems for persons vulnerable to committing suicide (development of a platform).

T2 translational research applied to local communities centered on clinical application, as well as T1 translational research including basic mechanistic studies for major mental illnesses, and development of treatments, should be strengthened to conduct evidence-based national mental health promotion and management projects, to obtain effectiveness of local community mental health promotion projects. However, study outcomes of field applications in Korea are unsatisfactory because of lack of translational research for mental health problems, especially investment for T2 translational research. Total periodic approaches to develop technologies that enable us to solve mental health problems from basic original research to clinical or business applications, have not yet been performed [7,16]. In addition, there are insufficient independent R&D projects, medium- and long-term R&D promotion strategies, and roadmaps that can play a central/integrated role in national mental health R&D [27]. In Europe, mental health research is developed through a medium- and long-term roadmap which focuses on 6 major priority fields for mental health and wellbeing in Europe. This process is based on translational research essential to field applications to offer assistance in solving mental health problems connected with overall issues including politics, society, and economy in Europe [28,29]. The National Institute of Mental Health in the USA also set 4 strategic objectives as a roadmap for mental health promotion. It promotes brain and behavioral science discoveries as priority, with a broad roadmap to influence public health for the next 5 years [30]. Therefore, the national mental health R&D investment and its supporting systems in Korea should be secured as a long-term policy.

Lastly, only a small number of questionnaires were analyzed from the online survey carried out by the experts, reflecting the limitation of this study. The collection rate of questionnaires was low because the survey contents required professional knowledge related to R&D in the field of mental health, and there were many measurement items. This led to partial and untrustworthy responses being excluded. Further follow-up studies will need to increase the sample size of the survey in subsequent studies.

Acknowledgements

Acknowledgments

This study was supported by a grant from the Korean Mental Health Technology R&D Project, Ministry of Health & Welfare, Republic of Korea (HM14C-2166).

Article information

Conflicts of Interest

No potential conflicts of interest relevant to this article was reported.

References

• 1. Cho MJ, Chang SM, Lee YM, et al. Prevalence of DSM-IV major mental disorders among Korean adults: a 2006 National Epidemiologic Survey (KECA-R). Asian J Psychiatr 2010;3(1). 26−30. PMID: 10.1016/j.ajp.2010.01.009. PMID: 23051134.ArticlePubMed
• 2. Cho MJ, Seong SJ, Park JE, et al. Prevalence and correlates of DSM-IV mental disorders in South Korean adults: the Korean epidemiologic catchment area study 2011. Psychiatry Investig 2015;12(2). 164−70. PMID: 10.4306/pi.2015.12.2.164. PMID: 25866515. PMID: 4390585.ArticlePubMedPMC
• 3. Seoul National University College of Medicine. The epidemiological survey of mental disorders in Korea 2011. Seoul (Korea): Ministry of Health and Welfare; 2012.
• 4. SAMHSA, U.S. Department of Health and Human Services. Results from the 2010 National Survey on Drug Use and Health: Mental Health Findings. 2012.
• 5. Ministry of Health and Welfare. Comprehensive plan on mental health. 2016.
• 6. Ministry of Education and Human Resources Development, Ministry of Science and Technology, Ministry of Commerce, Industry and Energy, Ministry of Information and Communication, Ministry of Health and Welfare. Second basic plan for promoting brain research. Anyang (Korea): Ministry of Science and Technology; 2007.
• 7. Medical Observer [Internet]. The budget of Ministry of Health and Welfare in 2015 is 5190 million Won 2016 Apr 25 Available from: http://www.monews.co.kr/news/articleView.html?idxno=76802.
• 8. Caleb & Company. Research on the reasonable size of research budget for Korea National Institute of Mental Health. Seoul (Korea): Seoul National Hospital; 2013.
• 9. Ministry of Health and Welfare, Caleb & Company. A Study on Mental Health R&D Services Planning. 2013.
• 10. National Institute of Mental Health [Internet]. Available from: https://www.nimh.nih.gov/about/budget/cj2016_final149031.pdf.
• 11. National Institute of Mental Health [Internet]. Bethesda: National Institute of Mental Health; 2013 Oct 16 Available from: http://www.nimh.nih.gov.
• 12. National Institute on Alcohol Abuse and Alcoholism [Internet]. Bethesda: National Institute on Alcohol Abuse and Alcoholism; 2013 Oct 16 Available from: http://www.niaaa.nih.gov.
• 13. National Institute on Drug Abuse [Internet]. Bethesda: National Institute on Drug Abuse; 2013 Oct 16 Available from: http://www.drugabuse.gov.
• 14. UK Clinical Research Collaboration [Internet]. UK Health Research Analysis 2014 2015 Available from: http://www.hrcsonline.net/pages/uk-health-research-analysis-2014.
• 15. Mental Health Research-Principles and Priorities for the Future. Mental Illness Fellowship of Australia Inc; 2010.
• 16. Korea Intellectual Property Strategy Institute. Mental health R&D project planning patent trend report. Daejeon, Sejong (Korea): Korea Intellectual Property Office, Ministry of Health and Welfare; 2013.
• 17. Roh S, Lee SU, Sho M, et al. Mental health services and R&D in South Korea. Int J Mental Health Syst 2016;10(1). 45PMID: 10.1186/s13033-016-0077-3.Article
• 18. Roh S, Han H, Kim Y, et al. Activation Plans for Psychiatric Research. J Korean Neuropsychiatr Assoc 2014;53(3). 137−43. PMID: 10.4306/jknpa.2014.53.3.137.Article
• 19. The Segye Times [Internet]. ‘I could suffer too’ The safety of Korea is getting lower 2016 Aug 8 [cited 2017 Apr 11]. Available from: http://www.segye.com/content/html/2016/08/18/20160818003480.html?OutUrl=naver.
• 20. Korea Biomedical Review [Internet]. Sewol ferry survivors struggle with PTSD 2016 Apr 14 [cited 2017 Apr 11]. Available from: http://www.koreabiomed.com/news/articleView.html?idxno=464.
• 21. Kim WJ. Epidemiology, clinical manifestations, and management of pandemic novel Influenza A (H1N1). Korean J Med 2009;77(2). 157−64.
• 22. Kim H. The government’s research and development policies and institutions for health technology. J Korean Med Assoc 2014;57(11). 912−18. PMID: 10.5124/jkma.2014.57.11.912.Article
• 23. Ministry of Education and Science Technology; Ministry for Food, Agriculture, Forestry and Fisheries; Ministry of Know-ledge Economy; Ministry of Health and Welfare; Ministry of Environment; Ministry of Land, Transport and Maritime Affairs. Bio-Vision 2016 2nd Biotechnology 2nd step master plan (2012–2016). Seoul (Korea): Ministry of Education and Science Technology; 2012.
• 24. Ministry of Health and Welfare. Development of national policies for addiction prevention management and service delivery systems. 2012.
• 25. Korean Academy of Addiction Psychiatry [Internet]. Data for hospitals treating addictions 2016 Apr 25 Available from: http://www.addictionacademy.org/link/?part=ME01.
• 26. Lee H, Lee B. The current status and cause of the addiction problem. Health Welf Policy Forum 2013;200(6). 30−42.
• 27. Ministry of Health and Welfare. Government-wide R&D Mid to Long-Term Plan for National Health. 2013.
• 28. A Roadmap for Mental Health Research in Europe, ROAMER, Final Roadmap. 2015. Mar.
• 29. Forsman A, Wahlbeck K, Aarø L, et al. Research priorities for public mental health in Europe: recommendations of the ROAMER project. Eur J Public Health 2015;25(2). 249−54. PMID: 10.1093/eurpub/cku232. PMID: 25678606.ArticlePubMedPDF
• 30. National Institute of Mental Health Strategic Plan for Research [Internet]. 2015 [revised 2015]. Available from: https://www.nimh.nih.gov/about/strategic-planning-reports/nimh_strategicplanforresearch_508compliant_corrected_final_149979.pdf.

Figure 1

Evaluation results of 32 policy projects. White bar charts mean the results of top 10 priorities of 32 policy projects.

Table 1

Evaluation criteria for deducing priority weighted values (evaluation items for multi-criteria evaluation).

Evaluation items	Detailed criteria	Evaluation emphasis
Possibility of technology development success	Technology development level	Degree of securing a domestic precedent or similar research to the applicable ones, and research level compared to that in developed countries
	R&D capacity	Degree of securing reasonable research manpower that enables us to conduct R&D in the applicable research areas
Magnitude of the ripple effect	Social preference	Public receptiveness of a society expected to be changed by securing technologies (reduction of social expenses, etc.)
	Contribution of sustainable development	Contribution to competitiveness of mental health projects, environmental competitiveness, and response to environmental changes
Necessity of a national response	Areas of market failure Areas of private advantage	Areas in which the government has to invest in R&D because the private sector finds it difficult to invest in these areas (scale of the study budget, etc.)
	Improvement in national competitiveness	Technology areas required for improvement in quality of life of the people or social contribution promotion through mental health promotion

Table 2

The contents of strategies for a comprehensive plan on mental health promotion.

4 policy objectives	12 strategies	32 policy projects
Promotion of national mental health	Promotion of mental health service use by improving recognition	Promotion of mental health improvement service accessibility Promotion of national interest for mental health Improvement in irrational discrimination of patients with mental illness and mental illnesses
	Early detection of mental health problems and reinforcement of intervention	Reinforcement of local community services for depression, anxiety Intensive management support to high risk groups of stress Reinforcement of crisis psychological support such as that for disaster victims
	Construction of mental health support systems across generations	Mental health support to infants Mental health support to children and adolescents Mental health support to young and middle-aged people Mental health support to the elderly
Integration of patients with serious mental illness into local communities	Prevention of early intensive treatment	Improvement of health insurance and medical benefit cost system Development of incipient mental illness patient management models and treatments
	Improvement of quality of life of patients with serious chronic mental illness	Construction of local community support systems Expansion and substantiality of rehabilitation facilities Function reestablishment of psychiatric institutions and mental health care facilities and reinforcement of this capacity
	Reinforcement of human rights of patients with mental illness	Improvement of systems in and out of psychiatric institutions Reinforcement of self-determination of patients with mental illness Reinforcement of human rights within psychiatric institutions and mental health care facilities
Minimization of health impediment and social harmful effects caused by addiction	Construction of social environment for addiction prevention	Improvement of social recognition for harmful effects of addiction
		Improvement of addiction risk circumstances
	Construction of intervention systems for early detection of addiction problems	Reinforcement of addiction selection systems by subjects Intervention service provision for high risk groups of addiction
	Reinforcement of treatment and restoration support for addicts	Reinforcement of treatment service accessibility Establishment of support systems for restoration of addicts
Realization of a safe society without suicidal risk	Construction of total social environment for suicide prevention	Improvement of social recognition Establishment of social support systems for suicide prevention Improvement of suicidal risk circumstances
	Provision of customized suicide prevention services	Promotion of countermeasures for suicide prevention across generations Reinforcement of preventive systems for high risk groups of suicide Establishment of a response to suicidal risk and post-management systems
	Reinforcement of the basis pushing suicide prevention policies	Reinforcement of education related to suicide prevention Establishment of evidence-based research systems for suicide prevention

Table 3

Evaluation of the relative importance (an example).

Items			← A is more important								Equal	B is more important →
A		B	9	8	7	6	5	4	3	2	1	2	3	4	5	6	7	8	9
Promotion of national mental health	vs	Integration of patients with serious mental illness into local communities
Promotion of national mental health	vs	Minimization of health impediment and social harmful effects caused by addiction
Promotion of national mental health	vs	Realization of a safe society without suicidal risk
Integration of patients with serious mental illness into local communities	vs	Minimization of health impediment and social harmful effects caused by addiction
Integration of patients with serious mental illness into local communities	vs	Realization of a safe society without suicidal risk
Minimization of health impediment and social harmful effects caused by addiction	vs	Realization of a safe society without suicidal risk

Table 4

Multi-criteria evaluation measurement of 214 detailed contents of a comprehensive plan on mental health promotion (an example).

Items		Possibility of technology development success			Magnitude of the ripple effect			Necessity of a national response
Policy project	Detailed contents	9	3	1	9	3	1	9	3	1
Promotion of mental health improvement service accessibility	(Expansion of infrastructure) Installation of mental health promotion centers in all states, provinces and counties, expansion of additional infrastructure according to the population after installation (2016)
	(Budget support) Placement of staff exclusively responsible for mental health promotion within a mental health promotion center to raise mental health service quality and for expansion of budget support (2017)
	(Self-management support) Self-diagnosis of mental health problems by a smartphone, evidence-based programs suitable to user characteristics* and provision of information related to mental health *Cognitive behavior treatment (CBT), Sleeping/hygiene management, meditation, relaxation therapy, etc.
	(Connection with high risk groups) Supporting connection with mental health promotion centers or medical institutions located in the user region in case subjects are selected as the high-risk group by self-screening
	(Moving bus for psychological support) Operation of ‘Moving bus for psychological support’ mainly in 5 national hospitals, provision of psychological support by directly visiting schools and work places
	(Connection with visiting health and welfare projects) Combining screening and counseling support for depression, etc., during a home visit, connection with specialized institutions for high risk groups

Table 5

The questionnaire results for 32 policy projects of a comprehensive plan on mental health promotion.

4 policy objectives	12 strategies	32 policy projects	Possibility of technology development success	Necessity of a national response	Magnitude of the ripple effect	Average
Promotion of national mental health	Promotion of mental health service use by improving recognition	Promotion of mental health improvement service accessibility	4.78	4.69	3.66	4.38
		Promotion of national interest for mental health	4.02	4.4	4.1	4.17
		Improvement in irrational discrimination of patients with mental illness and mental illnesses	4.96	5.51	4.66	5.04
	Early detection of mental health problems and reinforcement of intervention	Reinforcement of local community services for depression, anxiety, etc.	4.8	5.07	5.02	4.96
		Intensive management support to high risk groups of stress	4.46	4.81	4.37	4.55
		Reinforcement of crisis psychological support such as that for disaster victims	5.09	6.07	5.25	5.47
	Construction of mental health support systems across generations	Mental health support to infants	3.95	4.85	4.38	4.39
		Mental health support to children and adolescents	4.62	5.34	4.59	4.85
		Mental health support to young and middle-aged people	3.58	3.67	3.54	3.60
		Mental health support to the elderly	4.24	5.06	4.3	4.53
Integration of patients with serious mental illness into local communities	Prevention of early intensive treatment	Improvement of health insurance and medical benefit cost system	5.45	5.7	5.34	5.50
		Development of incipient mental illness patient management models and treatments	5.09	5.5	5.1	5.23
Integration of patients with serious mental illness into local communities	Improvement of quality of life of patients with serious chronic mental illness	Construction of local community support systems	4.16	5.36	4.52	4.68
		Expansion and substantiality of rehabilitation facilities	3.78	4.38	4.01	4.06
		Function reestablishment of psychiatric institutions and mental health care facilities and reinforcement of this capacity	4.24	5.06	4.3	4.53
	Reinforcement of human rights of patients with mental illness	Improvement of systems in and out of psychiatric institutions	4.05	4.78	4.26	4.36
		Reinforcement of self-determination of patients with mental illness	3.82	4.36	4.13	4.10
		Reinforcement of human rights within psychiatric institutions and mental health care facilities	3.61	4.27	4.01	3.96
Minimization of health impediment and social harmful effects caused by addiction	Construction of social environment for addiction prevention	Improvement of social recognition for harmful effects of addiction	3.84	4.88	4.18	4.30
		Improvement of addiction risk circumstances	3.79	4.6	4.34	4.24
	Construction of intervention systems for early detection of addiction problems	Reinforcement of addiction selection systems by subjects	4.84	5.45	4.68	4.99
		Intervention service provision for high risk groups of addiction	3.9	4.43	4.23	4.19
	Reinforcement of treatment and restoration support for addicts	Reinforcement of treatment service accessibility	4.02	4.04	3.91	3.99
		Establishment of support systems for supporting restoration of addicts	3.88	4.42	4.2	4.17
Realization of a safe society without suicidal risk	Construction of total social environment for suicide prevention	Improvement of social recognition	4.6	4.88	4.74	4.74
		Establishment of social support systems for suicide prevention	5.32	6.15	5.69	5.72
		Improvement of suicidal risk circumstances	4.9	5.74	5.09	5.24
	Provision of customized suicide prevention services	Promotion of countermeasures for suicide prevention across generations	4.82	5.36	4.84	5.01
		Reinforcement of preventive systems for high risk groups of suicide	5.17	5.7	5.1	5.32
		Establishment of a response to suicidal risk and post-management systems	5.99	6.76	6.59	6.45
	Reinforcement of the basis pushing suicide prevention policies	Reinforcement of education related to suicide prevention	5.33	5.55	5.11	5.33
		Establishment of evidence-based research systems for suicide prevention	6.12	6.73	6.41	6.42
	Average		4.54	4.65	5.11
	Weighted average value		4.63	4.76	5.23

Table 6

Analytic process for deducing the weighted average value.

Evaluation criteria	Core projects (items)	Weighted values	Questionnaire values	Weighted average values
Possibility of technology development success	Projects for national mental health promotion	0.216	4.45	0.96
	Projects for rehabilitation support to patients with mental illness	0.243	4.28	1.04
	Projects for technology development of total periodic addiction management	0.184	4.05	0.74
	Projects for reinforcement of social safety networks for suicide prevention	0.357	5.28	1.88
	Total	1.000	-	4.63
Magnitude of the ripple effect	Projects for national mental health promotion	0.299	4.39	1.31
	Projects for rehabilitation support to patients with mental illness	0.172	4.46	0.77
	Projects for technology development of total periodic addiction management	0.170	4.26	0.72
	Projects for reinforcement of social safety networks for suicide prevention	0.359	5.45	1.95
	Total	1.000	-	4.76
Necessity of a national response	Projects for national mental health promotion	0.195	4.95	0.96
	Projects for rehabilitation support to patients with mental illness	0.237	4.93	1.17
	Projects for technology development of total periodic addiction management	0.186	4.64	0.86
	Projects for reinforcement of social safety networks for suicide prevention	0.382	5.86	2.24
	Total	1.000	-	5.23

Figure & Data

References

Citations

Citations to this article as recorded by