Developing AI enabled sensors and decision support for military operators in the field


      Wearable sensors enable down range data collection of physiological and cognitive performance of the warfighter. However, autonomous teams may find the sensor data impractical to interpret and hence influence real-time decisions without the support of subject matter experts. Decision support tools can reduce the burden of interpreting physiological data in the field and incorporate a systems perspective where noisy field data can contain useful additional signals. We present a methodology of how artificial intelligence can be used for modeling human performance with decision-making to achieve actionable decision support. We provide a framework for systems design and advancing from the laboratory to real world environments. The result is a validated measure of down-range human performance with a low burden of operation.


      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Journal of Science and Medicine in Sport
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Sutton R.T.
        An overview of clinical decision support systems: benefits, risks, and strategies for success.
        NPJ Digit Med. 2020; : 1-10
        • Friedl K.E.
        Military applications of soldier physiological monitoring.
        J Sci Med Sport. 2018; 21: 1147-1153
        • Beard B.L.
        • Russell B.K.
        • Krihak M.
        • et al.
        Supporting Crew Medical Decisions on Deep Space Missions: A Real-time Performance Monitoring Capability.
        Int Assoc Adv Space Saf., IAASS, Leiden, The Netherlands2021
        • Medlock S.
        • Wyatt J.C.
        • Patel V.L.
        • et al.
        Modeling information flows in clinical decision support: key insights for enhancing system effectiveness.
        J Am Med Inform Assoc. 2016; 23: 1001-1006
        • Frost S.A.
        A briefing on metrics and risks for autonomous decision making in aerospace applications.
        NASA Tech Memo. 2018; : 1-13
        • Lipshitz R.
        • Strauss O.
        Coping with uncertainty: a naturalistic decision making analysis.
        Organ Behav Hum Decis Process. 1997; 69: 149-163
        • Klein G.
        The reinvention of decision making.
        Hum Factors. 2008; 50: 456-460
        • Boyd J.A.
        Patterns of conflict.
        in: Discourse on Winning and Losing. Maxwell Air Force Base: Air University Press, 2018: 19
        • Woods D.
        • Hollnagel E.
        Joint cognitive systems.
        in: Jt Cogn Syst Patterns Cogn Syst Eng. Taylor and Francis, Boca Raton2006: 69-96
        • Davis Z.
        Artificial intelligence on the battlefield.
        Inst Natl Strateg Secur. 2019; 8: 117-131
        • Esteva A.
        • Robicquet A.
        • Ramsundar B.
        • et al.
        A guide to deep learning in healthcare.
        Nat Med. 2019; 25: 24-29
        • Harrison C.J.
        • Sidey-Gibbons C.J.
        Machine learning in medicine: a practical introduction to natural language processing.
        BMC Med Res Methodol. 2021; 21: 1-18
        • Mishra R.
        • Li B.
        The application of artificial intelligence in the genetic study of Alzheimer’s disease.
        Aging Dis. 2020; 11: 1567-1584
        • Milanesi L.
        • Romano P.
        • Castellani G.
        • et al.
        Trends in modeling biomedical complex systems.
        BMC Bioinformatics. 2009; 10: 1-13
        • Pedersen M.
        • Verspoor K.
        • Jenkinson M.
        Artificial intelligence for clinical decision support in neurology.
        Brain Commun. 2020; 1: 1-11
        • Farzaneh N.
        • Williamson C.A.
        • Gryak J.
        • et al.
        A hierarchical expert-guided machine learning framework for clinical decision support systems: an application to traumatic brain injury prognostication.
        Npj Digit Med. 2021; 4: 1-9
        • Ahn A.C.
        • Tewari M.
        • Poon C.S.
        • et al.
        The limits of reductionism in medicine: could systems biology offer an alternative?.
        PLoS Med. 2006; 3: 0709-0713
        • Parekh V.
        • Shah D.
        • Shah M.
        Fatigue detection using artificial intelligence framework.
        Augment Hum Res. 2020; 5
        • Russell B.
        • McDaid A.
        • Tscano W.
        • et al.
        Moving the lab into the mountains: a pilot study of human activity recognition in unstructured environments.
        Sensors. 2021; 21: 654
        • Russell B.
        • McDaid A.
        • Toscano W.
        • et al.
        Predicting fatigue in long duration mountain events with a single sensor and deep learning model.
        Sensors. 2021; 21
        • Crump C.
        • Schlachta-Fairchild L.M.
        Achieving a Trusted, Reliable, AI-ready Infrastructure for Military Medicine and Civilian Trauma Care.
        2020: 19
        • Nweke H.F.
        • Teh Y.W.
        • Mujtaba G.
        • et al.
        Data fusion and multiple classifier systems for human activity detection and health monitoring: review and open research directions.
        Inf Fusion. 2019; 46: 147-170
        • Pilcher J.J.
        • Nadler E.
        • Busch C.
        Effects of hot and cold temperature exposure on performance: a meta-analytic review.
        Ergonomics. 2002; 45: 682-698
        • Attridge N.
        • Noonan D.
        • Eccleston C.
        • et al.
        The disruptive effects of pain on n-back task performance in a large general population sample.
        Pain. 2015; 156: 1885-1891
      1. Prakash RS, Voss MW, Erickson KI, et al. Physical activity and cognitive vitality n.d.

        • Cacioppo J.T.
        • Cacioppo S.
        Social relationships and health: the toxic effects of percieved social isolation.
        Soc Pers Psychol Compass. 2014; 8: 58-72
        • Kerstholt J.H.
        Decision Making in a Dynamic Task Environment: The Effect of Time Pressure.
        Institute for Perception, TNO Soesterberg Newtherlands, 1992
        • Schatz P.
        • Pardini J.E.
        • Lovell M.R.
        • et al.
        Sensitivity and specificity of the ImPACT test battery for concussion in athletes.
        . 2006; 21: 91-99
        • Fothergill S.
        • Neal A.
        The Effect of Workload on Conflict Decision Making Strategies in Air Traffic Control.
        2008: 39-43
        • Anastasios P.
        • Nasser M.
        • Hanoch Y.
        • et al.
        Impact of time pressure on dentists diagnostic performance.
        Dentistry. 2019; 01
        • Collins M.W.
        • Grindel S.H.
        • Lovell M.R.
        • et al.
        Relationshp between concussion and neuropsychological performance in college football players.
        Am Med Assoc. 1999; 282: 964-970
        • Pérez-olmos I.
        • Ibáñez-pinilla M.
        Night Shifts, Sleep Deprivation, and Attention Performance in Medical Students.
        2014: 56-62
        • Cowings P.
        • Toscano W.
        • Deroshia C.
        • et al.
        Converging indicators for assessing individual differences in adaptation to extreme environments.
        Aviat Sp Environ Med. 2007; 78: 195-215
        • Fillingim R.B.
        Inidividual differences in pain: understanding the mosaic that makes pain personal.
        . 2018; 158: 1-18
        • Beard B.L.
        Characterization of how CO2 level may impact crew performance related to the HSIA risk.
        in: NASA Technical Meorandum, NASA/TM-20205011433. 2020
        • Manzey D.
        • Lorenz B.
        • Plojakov V.
        Mental performance in extreme environments: results from a performance monitoring study during a 438-day spaceflight.
        Ergonomics. 1998; 41: 537-559
        • Gonzalez C.
        Task workload and cognitive abilities in dynamic decision making.
        Hum Factors. 2005; 47: 92-101
        • Van Cutsem J.
        • Marcora S.
        • De Pauw K.
        • et al.
        The effects of mental fatigue on physical performance: a systematic review.
        Sports Med. 2017; 47: 1569-1588
        • St. Clair Gibson A.
        • Baden D.A.
        • Lambert M.I.
        • et al.
        The conscious perception of the sensation of fatigue.
        Sports Med. 2003; : 167-176
        • Meyer R.A.
        A linear model of muscle respiration explains monoexponential phosphocreatine changes.
        Am J Physiol Cell Physiol. 1988; 254: 3-8
        • Khanday M.A.
        Numerical study of partial differential equations to estimate thermoregulation in human dermal regions for temperature dependent thermal conductivity.
        J Egypt Math Soc. 2014; 22: 152-155
        • Krzywinski M.
        • Altman N.
        Analysis of variance and blocking.
        Nat Methods. 2014; 11: 699-700
        • Dorn G.W.
        The fuzzy logic of physiological cardiac hypertrophy.
        Hypertension. 2007; 49: 962-970
        • Bours M.J.
        Bayes’ rule in diagnosis.
        J Clin Epidemiol. 2021; 131: 158-160
        • Ellis K.
        • Kerr J.
        • Godbole S.
        • et al.
        A random forest classifier for the prediction of energy expenditure and type of physical activity from wrist and hip accelerometers.
        Physiol Meas. 2014; 35: 2191-2203
        • Prelich M.T.
        • Matar M.
        • Gokoglu S.A.
        • et al.
        Predicting space radiation single ion exposure in rodents: a Machine Learning Approach.
        Front Syst Neurosci. 2021; : 15
        • Johnson W.R.
        • Member S.
        • Alderson J.
        • et al.
        Predicting athlete ground reaction forces and moments from spatio-temporal driven CNN models.
        IEEE Trans Biomed Eng. 2019; 66: 689-694
        • Gallardo-Antolin A.
        • Montera J.M.
        External attention LSTM models for cognitive load classification from speech.
        in: Carlos M.-V. Matthew P. Senja P. Stat. Lang. speech Process. 2019: 139-151 (Ljubljana, Slovenia)