Clinical Decision Support Systems: A Visual Survey

Kamran Farooq, Bisma S Khan, Muaz A. Niazi, Stephen J Leslie, Amir Hussain


Clinical Decision Support Systems (CDSS) form an important area of research. In spite of its importance, it is difficult for researchers to evaluate the domain primarily because of a considerable spread of relevant literature in interdisciplinary domains. Previous surveys of CDSS have examined the domain from the perspective of individual disciplines. However, to the best of our knowledge, no visual scientometric survey of CDSS has previously been conducted which provides a broader spectrum of the domain from the perspective of multiple disciplines. While traditional systematic literature surveys focus on analyzing literature using arbitrary results, visual surveys allow for the analysis of domains by using complex network-based analytical models. In this paper, we present a detailed visual survey of CDSS literature using important papers selected from highly cited sources on the Clarivate Analytics’ Web of Science. Our key results include the discovery of the articles which have served as key turning points in literature. Additionally, we have identified highly cited authors and the key country of origin of top publications. We also present the universities with the strongest citation bursts. Finally, our network analysis also identifies the key journals and subject categories both in terms of centrality and frequency. It is our belief that this paper will thus serve as an important guide for researchers as well as clinical practitioners interested in identifying key literature and resources in the domain of clinical decision support systems.

Full Text:



Abidi, S., J. Cox, S. Abidi and M. Shepherd (2012). Using OWL ontologies for clinical guidelines based comorbid decision support. System Science (HICSS), 2012 45th Hawaii International Conference on, IEEE.

Ahmadian, L., M. van Engen-Verheul, F. Bakhshi-Raiez, N. Peek, R. Cornet and N. F. de Keizer (2011). "The role of standardized data and terminological systems in computerized clinical decision support systems: literature review and survey." International journal of medical informatics 80(2): 81-93.

Ahn, J. T., G. H. Park, J. Son, C. S. Lim, J. Kang, J. Cha, K. Park and D. M. Kim (2014). "Development of test toolkit of hard review to evaluate a random clinical decision support system for the management of chronic adult diseases." Wireless Personal Communications 79(4): 2469-2484.

Ali, S. M., R. Giordano, S. Lakhani and D. M. Walker (2016). "A review of randomized controlled trials of medical record powered clinical decision support system to improve quality of diabetes care." International journal of medical informatics 87: 91-100.

Alickovic, E. and A. Subasi (2016). "Medical decision support system for diagnosis of heart arrhythmia using dwt and random forests classifier." Journal of medical systems 40(4): 1-12.

Alther, M. and C. K. Reddy (2015). Clinical decision support systems, Healthcare Data Analytics, Chapman and Hall/CRC Press.

Ba, S. and L. Wang (2013). "Digital health communities: The effect of their motivation mechanisms." Decision Support Systems 55(4): 941-947.

Bertanza, G., P. Baroni and M. Canato (2016). "Ranking sewage sludge management strategies by means of Decision Support Systems: A case study." Resources, Conservation and Recycling 110: 1-15.

Bonini, C. P. (1963). Simulation of Information and Decision System in the Firm, Prentice-Hall.

Bonney, W. (2011). Impacts and risks of adopting clinical decision support systems, INTECH Open Access Publisher.

Bose, R. and V. Sugumaran (1999). "Application of intelligent agent technology for managerial data analysis and mining." ACM SIGMIS Database 30(1): 77-94.

Bouamrane, M.-M., A. Rector and M. Hurrell (2009). A hybrid architecture for a preoperative decision support system using a rule engine and a reasoner on a clinical ontology. Web Reasoning and Rule Systems, Springer: 242-253.

Bright, T. J., A. Wong, R. Dhurjati, E. Bristow, L. Bastian, R. R. Coeytaux, G. Samsa, V. Hasselblad, J. W. Williams and M. D. Musty (2012). "Effect of clinical decision-support systems: a systematic review." Annals of internal medicine 157(1): 29-43.

Chen, C. (2006). "CiteSpace II: Detecting and visualizing emerging trends and transient patterns in scientific literature." Journal of the American Society for information Science and Technology 57(3): 359-377.

Chen, C. (2016). CiteSpace: A Practical Guide for Mapping Scientific Literature. New York, USA, Nova Science Publishers.

Chen, C. and Y. Chen (2005). Searching for clinical evidence in CiteSpace. AMIA Annual Symposium Proceedings, American Medical Informatics Association.

Chen, W.-C., T.-P. Hong and R. Jeng (1999). "A framework of decision support systems for use on the World Wide Web." Journal of Network and Computer Applications 22(1): 1-17.

Chuang, J.-H., G. Hripcsak and R. A. Jenders (2000). Considering clustering: a methodological review of clinical decision support system studies. Proceedings of the AMIA Symposium, American Medical Informatics Association.

Clancey, W. J., E. H. Shortliffe and B. G. Buchanan (1979). Intelligent computer-aided instruction for medical diagnosis. Proceedings of the Annual Symposium on Computer Application in Medical Care, American Medical Informatics Association.

Classen, D. C., S. Phansalkar and D. W. Bates (2011). "Critical drug-drug interactions for use in electronic health records systems with computerized physician order entry: review of leading approaches." Journal of patient safety 7(2): 61-65.

Clauser, S. B., E. H. Wagner, E. J. A. Bowles, L. Tuzzio and S. M. Greene (2011). "Improving modern cancer care through information technology." American journal of preventive medicine 40(5): S198-S207.

DeBusk, R. F., N. Houston-Miller and L. Raby (2010). "CLINICAL VALIDATION OF A DECISION SUPPORT SYSTEM FOR ACUTE CORONARY SYNDROMES." Journal of the American College of Cardiology 10(55): A132. E1240.

Diaby, V., K. Campbell and R. Goeree (2013). "Multi-criteria decision analysis (MCDA) in health care: a bibliometric analysis." Operations Research for Health Care 2(1): 20-24.

Dong, Y., D. M. Frangopol and S. Sabatino (2016). "A decision support system for mission-based ship routing considering multiple performance criteria." Reliability Engineering & System Safety 150: 190-201.

Druzdzel, M. J. and R. R. Flynn (1999). "Decision support systems. Encyclopedia of library and information science. A. Kent." Marcel Dekker, Inc. Last Login 10(03): 2010.

Eom, S. B., S. M. Lee, E. Kim and C. Somarajan (1998). "A survey of decision support system applications (1988–1994)." Journal of the Operational Research Society 49(2): 109-120.

Eslami, S., N. F. de Keizer and A. Abu-Hanna (2008). "The impact of computerized physician medication order entry in hospitalized patients—a systematic review." International journal of medical informatics 77(6): 365-376.

Fang, Y. (2015). "Visualizing the structure and the evolving of digital medicine: a scientometrics review." Scientometrics 105(1): 5-21.

Farooq, K. and A. Hussain (2016). "A novel ontology and machine learning driven hybrid cardiovascular clinical prognosis as a complex adaptive clinical system." Complex Adaptive Systems Modeling 4(1): 1-21.

Farooq, K., A. Hussain, S. Leslie, C. Eckl, C. MacRae and W. Slack (2012). An ontology driven and bayesian network based cardiovascular decision support framework. Advances in Brain Inspired Cognitive Systems, Springer: 31-41.

Farooq, K., A. Hussain, S. Leslie, C. Eckl, C. MacRae and W. Slack (2012). Semantically Inspired Electronic Healthcare Records. Advances in Brain Inspired Cognitive Systems, Springer: 42-51.

Farooq, K., A. Hussain, S. Leslie, C. Eckl and W. Slack (2011). Ontology-driven cardiovascular decision support system. Pervasive Computing Technologies for Healthcare (PervasiveHealth), 2011 5th International Conference on, IEEE.

Fathima, M., D. Peiris, P. Naik-Panvelkar, B. Saini and C. L. Armour (2014). "Effectiveness of computerized clinical decision support systems for asthma and chronic obstructive pulmonary disease in primary care: a systematic review." BMC pulmonary medicine 14(1): 1.

Finlay, P. N. (1994). Introducing decision support systems, NCC Blackwell.

Fitzmaurice, D., F. Hobbs, B. Delaney, S. Wilson and R. McManus (1998). "Review of computerized decision support systems for oral anticoagulation management." British journal of haematology 102: 907-909.

Gwo-Hshiung, T. (2010). "Multiple attribute decision making: methods and applications." Multiple Attribute Decision Making: Methods and Applications.

Haettenschwiler, P. (2001). "Neues anwenderfreundliches konzept der entscheidungsunterstützung." Zurich, vdf Hochschulverlag AG: 189-208.

Hahn, G. J. and H. Kuhn (2012). "Designing decision support systems for value-based management: A survey and an architecture." Decision Support Systems 53(3): 591-598.

Haynes, R. B. and N. L. Wilczynski (2010). "Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: Methods of a decision-maker-researcher partnership systematic review." Implement Sci 5(1): 12.

Holsapple, C. W. (2008). DSS architecture and types. Handbook on Decision Support Systems 1, Springer: 163-189.

Hunt, D. L., R. B. Haynes, S. E. Hanna and K. Smith (1998). "Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review." Jama 280(15): 1339-1346.

Inglezakis, V., M. Ambăruş, N. Ardeleanu, K. Moustakas and M. Loizidou (2016). "WASTE MANAGEMENT IN ROMANIA: CURRENT DATA AND APPLICATION OF A DECISION SUPPORT TOOL." Environmental Engineering & Management Journal (EEMJ) 15(3).

Ivbijaro, G., L. Kolkiewicz, L. McGee and M. Gikunoo (2008). "Addressing long-term physical healthcare needs in a forensic mental health inpatient population using the UK primary care Quality and Outcomes Framework (QOF): an audit." Mental health in family medicine 5(1): 51.

Jaspers, M. W., M. Smeulers, H. Vermeulen and L. W. Peute (2011). "Effects of clinical decision-support systems on practitioner performance and patient outcomes: a synthesis of high-quality systematic review findings." Journal of the American Medical Informatics Association 18(3): 327-334.

Kawamoto, K., G. Del Fiol, C. Orton and D. F. Lobach (2010). "System-agnostic clinical decision support services: benefits and challenges for scalable decision support." The open medical informatics journal 4: 245.

Kawamoto, K., C. A. Houlihan, E. A. Balas and D. F. Lobach (2005). "Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success." Bmj 330(7494): 765.

Keen, P. G. (1980). "Decision support systems: a research perspective." Decision Support Systems: Issues and Challenges (New York: Pergamon Press, 1980): 23-44.

Keen, P. G. and M. Scott (1978). Decisión support systems; an organizational perspective.

Khong, P. and R. Ren (2011). "Healthcare information system: building a cyber database for educated decision making." International Journal of Modelling, Identification and Control 12(1-2): 133-140.

Kuperman, G. J., A. Bobb, T. H. Payne, A. J. Avery, T. K. Gandhi, G. Burns, D. C. Classen and D. W. Bates (2007). "Medication-related clinical decision support in computerized provider order entry systems: a review." Journal of the American Medical Informatics Association 14(1): 29-40.

Kuperman, G. J., R. M. Gardner and T. A. Pryor (2013). HELP: a dynamic hospital information system, Springer Science & Business Media.

Ledley, R. and L. B. Lusted (1959). "The use of electronic computers to aid in medical diagnosis." Proceedings of the IRE 47(11): 1970-1977.

Lindgren, H. (2011). Integrating clinical decision support system development into a development process of clinical practice–experiences from dementia care. Artificial Intelligence in Medicine, Springer: 129-138.

Loya, S. R., K. Kawamoto, C. Chatwin and V. Huser (2014). "Service oriented architecture for clinical decision support: A systematic review and future directions." Journal of medical systems 38(12): 1-22.

Luitjes, S. H., M. G. Wouters, A. Franx, H. C. Scheepers, V. M. Coupé, H. Wollersheim, E. A. Steegers, M. P. Heringa, R. P. Hermens and M. W. van Tulder (2010). "STUDY PROTOCOL Open Access."

Madani, F. (2015). "Technology Mining'bibliometrics analysis: applying network analysis and cluster analysis." Scientometrics 105(1): 323-335.

Marakas, G. Decision Support Systems in the Twenty-First Century, 1999, Prentice Hall, Inc. Upper Saddle River, NJ, ISBN: 0-13-744186-X.

Marasinghe, K. M. (2015). "Computerised clinical decision support systems to improve medication safety in long-term care homes: a systematic review." BMJ open 5(5): e006539.

Martínez-Pérez, B., I. de la Torre-Díez, M. López-Coronado, B. Sainz-De-Abajo, M. Robles and J. M. García-Gómez (2014). "Mobile clinical decision support systems and applications: a literature and commercial review." Journal of medical systems 38(1): 1-10.

Mendoza, G. A., W. Sprouse, W. G. Luppold, P. Araman and R. J. Meimban (1991). "An integrated management support and production control system for hardwood forest products." Computers in Industry 16(4): 343-351.

Musen, M. A., B. Middleton and R. A. Greenes (2014). Clinical decision-support systems. Biomedical informatics, Springer: 643-674.

Niazi, M. and A. Hussain (2011). "Agent-based computing from multi-agent systems to agent-based models: a visual survey." Scientometrics 89(2): 479-499.

Niazi, M. A. K. (2011). Towards a novel unified framework for developing formal, network and validated agent-based simulation models of complex adaptive systems, University of Stirling.

Njie, G. J., K. K. Proia, A. B. Thota, R. K. Finnie, D. P. Hopkins, S. M. Banks, D. B. Callahan, N. P. Pronk, K. J. Rask and D. T. Lackland (2015). "Clinical decision support systems and prevention: a community guide cardiovascular disease systematic review." American journal of preventive medicine 49(5): 784-795.

Nugent, C. A., H. R. Warner, J. T. Dunn and F. H. Tyler (1964). "Probability theory in the diagnosis of Cushing's syndrome." The Journal of Clinical Endocrinology & Metabolism 24(7): 621-627.

O’Connor, P. J., J. M. Sperl-Hillen, W. A. Rush, P. E. Johnson, G. H. Amundson, S. E. Asche, H. L. Ekstrom and T. P. Gilmer (2011). "Impact of electronic health record clinical decision support on diabetes care: a randomized trial." The Annals of Family Medicine 9(1): 12-21.

Osheroff, J. A. and A. M. I. Association (2006). A roadmap for national action on clinical decision support, June 13, 2006, American Medical Informatics Association.

Power, D. (1997). "What is a DSS." The On-Line Executive Journal for Data-Intensive Decision Support 1(3): 223-232.

Power, D. (2002). "Decision Support Systems: Concepts and Resources for Managers." Studies in Informatics and Control 11(4): 349-350.

Power, D. J. (2000). "Web-based and model-driven decision support systems: concepts and issues." AMCIS 2000 Proceedings: 387.

Ralph, J., H. Sprague and H. Watson (1986). Decision Support Systems: Putting Theory into Practice, Prentice Hall.

Rauscher, H. M. (1999). "Ecosystem management decision support for federal forests in the United States: a review." Forest ecology and management 114(2): 173-197.

Reuters, T. (2008). Web of science. Online factsheet Thomson Reuters, Philadelphia, Pennsylvania.

Rongying, Z. and C. Rui (2011). Visual analysis on the research of cross-language information retrieval. Uncertainty Reasoning and Knowledge Engineering (URKE), 2011 International Conference on, IEEE.

Sauter, V. (1997). Decision support systems: an applied managerial approach, John Wiley & Sons, Inc.

Schroff, A. M. (1998). An approach to user oriented decision support systems.

Scott, M. M. (1971). Management decision systems: computer-based support for decision making, Harvard University, Cambridge, MA.

Shortliffe, E. H. (1986). "Update on ONCOCIN: a chemotherapy advisor for clinical oncology." Informatics for Health and Social Care 11(1): 19-21.

Silver, M. S. (1991). Systems that support decision makers: description and analysis, John Wiley & Sons, Inc.

Son, Y.-J., S. Jeong, B.-G. Kang, S.-H. Kim and S.-K. Lee (2015). "Visualization of e-Health research topics and current trends using social network analysis." Telemedicine and e-Health 21(5): 436-442.

Sprague Jr, R. H. and E. D. Carlson (1982). Building effective decision support systems, Prentice Hall Professional Technical Reference.

Steinman, M. A., S. M. Handler, J. H. Gurwitz, G. D. Schiff and K. E. Covinsky (2011). "Beyond the prescription: medication monitoring and adverse drug events in older adults." Journal of the American Geriatrics Society 59(8): 1513-1520.

Tate, A. R., J. Underwood, D. M. Acosta, M. Julià‐Sapé, C. Majós, À. Moreno‐Torres, F. A. Howe, M. Van Der Graaf, V. Lefournier and M. M. Murphy (2006). "Development of a decision support system for diagnosis and grading of brain tumours using in vivo magnetic resonance single voxel spectra." NMR in Biomedicine 19(4): 411-434.

Turban, E. (1990). Decision support and expert systems: management support systems, Prentice Hall PTR.

Vaghela, C., N. Bhatt and D. Mistry (2015). "A Survey on Various Classification Techniques for Clinical Decision Support System." International Journal of Computer Applications 116(23).

Warner, H. R. (1979). "Computer--Assisted Medical Decision-Making."

Wright, A., D. F. Sittig, J. S. Ash, D. W. Bates, J. Feblowitz, G. Fraser, S. M. Maviglia, C. McMullen, W. P. Nichol and J. E. Pang (2011). "Governance for clinical decision support: case studies and recommended practices from leading institutions." Journal of the American Medical Informatics Association 18(2): 187-194.

Wu, J. and Q. Chen (2012). Mapping the emerging field of cloud computing: Insights from a visualization analysis. Systems, Man, and Cybernetics (SMC), 2012 IEEE International Conference on, IEEE.

Xie, P. (2015). "Study of international anticancer research trends via co-word and document co-citation visualization analysis." Scientometrics 105(1): 611-622.

Yu, D. (2015). "A scientometrics review on aggregation operator research." Scientometrics 105(1): 115-133.

Zhu, S., H. H. Yang and L. Feng (2015). Visualizing and Understanding the Digital Divide. International Conference on Hybrid Learning and Continuing Education, Springer.

Zopounidis, C., M. Doumpos and N. F. Matsatsinis (1997). "On the use of knowledge-based decision support systems in financial management: a survey." Decision Support Systems 20(3): 259-277.

Zuccotti, G., F. Maloney, J. Feblowitz, L. Samal, L. Sato and A. Wright (2014). "Reducing risk with clinical decision support." Appl Clin Inform 5(3): 746-756.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.