-
LEVIOSA: Natural Language-Based Uncrewed Aerial Vehicle Trajectory Generation
Aikins, Godwyll,
Dao, Mawaba Pascal,
Moukpe, Koboyo Josias,
Eskridge, Thomas C.,
and Nguyen, Kim-Doang
Electronics
2024
[Abs]
This paper presents LEVIOSA, a novel framework for text- and speech-based uncrewed aerial vehicle (UAV) trajectory generation. By leveraging multimodal large language models (LLMs) to interpret natural language commands, the system converts text and audio inputs into executable flight paths for UAV swarms. The approach aims to simplify the complex task of multi-UAV trajectory generation, which has significant applications in fields such as search and rescue, agriculture, infrastructure inspection, and entertainment. The framework involves two key innovations: a multi-critic consensus mechanism to evaluate trajectory quality and a hierarchical prompt structuring for improved task execution. The innovations ensure fidelity to user goals. The framework integrates several multimodal LLMs for high-level planning, converting natural language inputs into 3D waypoints that guide UAV movements and per-UAV low-level controllers to control each UAV in executing its assigned 3D waypoint path based on the high-level plan. The methodology was tested on various trajectory types with promising accuracy, synchronization, and collision avoidance results. The findings pave the way for more intuitive human–robot interactions and advanced multi-UAV coordination.
-
Superteams: The effect of adaptive AI systems on operational performance
Demirjian, Eric,
Eskridge, Thomas C,
Walton, Abram,
Sandall, Darrel L,
Shah, Natalie,
Bailey, Ryan,
and Henderson, John
Naval Engineering Journal
2024
-
Generalized Nudging
Eskridge, Thomas C
2024
-
Ethics of Artificial Intelligence
Eskridge, Thomas C
2024
-
What is Artificial Intelligence?
Eskridge, Thomas C
2024
-
Teamwork and Input Compositionality: UI Design for Taskwork or Teamwork?
Momose, Kazuhiko,
Mehta, Rahul,
Moukpe, Josias,
Almashayhkhi, Ali,
Samkari, Waseem,
Weekes, Troy R,
Eskridge, Thomas C,
and Kidwell, Daniel
2024
[PDF]
-
Human-AI Teamwork Interface Design Using Patterns of Interactions
Momose, Kazuhiko,
Mehta, Rahul,
Moukpe, Josias,
Weekes, Troy R.,
and Eskridge, Thomas C.
International Journal of Human–Computer Interaction
2024
-
Nudging automated planners with learned user preferences
Yaman, Fusun,
Eskridge, Thomas C,
Scott, Ron,
Lin, Li,
Miller, Jeff,
and Carpenter, Daniel
In invited submission to 16th International Conference on Agents and Artificial Intelligence
2024
[PDF]
-
A Federated Defense Community and Ecosystem in Practice
Eskridge, T. C.,
and Carvalho, M.M.
2019
[PDF]
-
A case-based reasoning approach to cybersecurity reasoning
Eskridge, Thomas C,
Carvalho, Marco M,
Rodgers, Andrew V,
and Tassel, Richard
2019
-
Using Bayes Networks to predict information gain on experiment trial
Eskridge, Thomas C,
Mehta, Dhanish,
Granados, Adrián,
Carvalho, Marco M,
Atighetchi, M,
Costa, Paulo,
and Myers, David
2019
-
Intelligent Trial Generation for Cyber Security Experimentation
Eskridge, Thomas C,
Mehta, Dhanish,
Granados, Adrián,
Carvalho, Marco M,
Atighetchi, M,
and Myers, David
2019
-
Semantic Composition of the User Interface
Eskridge, Thomas C,
Nyffenegger, W,
Akerman, Shea,
Ghaderpour Taleghani, Shayesteh,
Metha, Dhanish,
and Carvalho, Marco
2019
-
User Display Providing Obstacle Avoidance
Eskridge, Thomas Charles,
Johnson, Matthew,
and Chua, Kenny Wei Liang
2019
[PDF]
-
A framework for automated cyber experimentation
Mehta, Dhanish,
Eskridge, Thomas C,
and Carvalho, Marco M
2019
[PDF]
-
Towards the application of recommender systems to secure coding
Nembhard, F.,
Carvalho, Marco M,
and Eskridge, Thomas C
EURASIP Journal on Information Security
2019
[PDF]
-
Nudging into Flow: Optimizing Productivity with a Choice Architecture
Weekes, Troy,
and Eskridge, Thomas C
In Cognitive Economics Workshop
2019
[PDF]
-
Formal Assurance for Cooperative Intelligent Autonomous Agents
Bhattacharyya, Siddhartha,
Eskridge, Thomas C.,
Neogi, Natasha A.,
Carvalho, Marco,
and Stafford, Milton
In NASA Formal Methods
2018
[Abs]
[PDF]
Developing trust in intelligent agents requires understanding the full capabilities of the agent, including the boundaries beyond which the agent is not designed to operate. This paper focuses on applying formal verification methods to identify these boundary conditions in order to ensure the proper design for the effective operation of the human-agent team. The approach involves creating an executable specification of the human-machine interaction in a cognitive architecture, which incorporates the expression of learning behavior. The model is then translated into a formal language, where verification and validation activities can occur in an automated fashion. We illustrate our approach through the design of an intelligent copilot that teams with a human in a takeoff operation, while a contingency scenario involving an engine-out is potentially executed. The formal verification and counterexample generation enables increased confidence in the designed procedures and behavior of the intelligent copilot system.
-
Innovation in Action: The Florida Institute for Human & Machine Cognition (IHMC)
Bradshaw, J. M.,
Bunch, L,
Carvalho, M,
Eskridge, T. C.,
Feltovich, P. J.,
and Johnson, M. J.
Technology & Innovation
2018
-
Multi-Tier Orchestration Frameowrk for Cyber Operations and Defense
Carvalho, M.M.,
Eskridge, T. C.,
and Nyffenegger, W
2018
-
User interface supporting an integrated decision engine for evolving defenses
Eskridge, T.,
Carvalho, M.,
Benyo, B.,
Atighetchi, M,
Yaman, F.,
and Adler, A.
2018
-
Experimenting with C2 Implementations
Eskridge, Thomas C
2018
-
Experimenting with C2 Implementations
Eskridge, Thomas C
2018
-
Extracting Knowledge from Open Source Projects to Improve Program Security
Nembhard, Fitzroy,
Carvalho, Marco M,
and Eskridge, Thomas C
In 2018 IEEE SoutheastCon
2018
-
Assurance for Cyberfacturing
Newton, M,
Eskridge, T. C.,
and Bhattacharyya, Siddhartha
2018
-
Coactive emergence as a sensemaking strategy for cyber operations
Bradshaw, J.M.,
Carvalho, M.M.,
Bunch, L.,
Eskridge, T.C.,
Feltovich, P.J.,
Forsythe, C.,
Hoffman, R.R.,
Johnson, M. J.,
Kidwell, D.,
and Woods, D.D.
In ICST (Institute for Computer Science, Social Informatics, and Telecommunications Engineering) Transactions on Security and Safety. Special section on The Cognitive Science of Cyber Defense Analysis
2013
-
The KAoS policy services framework
Bradshaw, Jeffrey M,
Uszok, Andrzej,
Breedy, Maggie,
Bunch, Larry,
Eskridge, T,
Feltovich, P,
Johnson, Matthew,
Lott, James,
and Vignati, Micael
In Proc. 8th Cyber Security and Information Intelligence Research Workshop
2013
-
MTC2: A command and control framework for moving target defense and cyber resilience
Carvalho, Marco,
Eskridge, Thomas C,
Bunch, Larry,
Dalton, Adam,
Hoffman, Robert,
Bradshaw, Jeffrey M,
Feltovich, Paul J,
Kidwell, Daniel,
and Shanklin, Teresa
In Resilient Control Systems (ISRCS), 2013 6th International Symposium on
2013
[PDF]
-
A human-agent teamwork command and control framework for moving target defense (MTC2)
Carvalho, Marco M,
Eskridge, Thomas C,
Bunch, Larry,
Bradshaw, Jeffrey M,
Dalton, Adam,
Feltovich, Paul,
Lott, James,
and Kidwell, Daniel
In Proceedings of the Eighth Annual Cyber Security and Information Intelligence Research Workshop
2013
-
Visualizing Multi-Agent Systems
Polack Jr, Peter J,
Carvalho, Marco,
and Eskridge, Thomas C
In EEE/WIC/ACM International Conference on Web Intelligence
2013
[PDF]
-
Sol: An agent-based framework for cyber situation awareness
Bradshaw, J. M.,
Carvalho, Marco,
Bunch, L.,
Eskridge, Thomas C,
Feltovich, P. J.,
Johnson, Matthew,
and Kiddwell, Dan
2012
-
Human-agent teamwork in cyber operations: supporting co-evolution of tasks and artifacts with Luna
Bunch, Larry,
Bradshaw, Jeffrey M,
Carvalho, Marco,
Eskridge, Tom,
Feltovich, Paul J,
Lott, James,
and Uszok, Andrzej
In German Conference on Multiagent System Technologies
2012
-
Policy-Based Governance within Luna: Why We Developed Yet Another Agent Framework
Bunch, Larry,
Bradshaw, Jeffrey M,
Eskridge, Tom,
Feltovich, Paul J,
Lott, James,
Uszok, Andrzej,
and Carvalho, Marco
In Web Intelligence and Intelligent Agent Technology (WI-IAT), 2012 IEEE/WIC/ACM International Conferences on
2012
-
A human-agent teamwork approach to moving target defense command and control
Carvalho, M,
Bradshaw, JM,
Bunch, L,
Eskridge, T,
Feltovich, P,
Hoffman, R,
Lott, J,
and Kidwell, D
In Poster presented at the Moving Target Research Workshop, Washington, DC
2012
-
A human-agent teamwork approach to moving target defense command and control
Carvalho, M,
Bradshaw, JM,
Bunch, L,
Eskridge, T,
Feltovich, P,
Hoffman, R,
Lott, J,
and Kidwell, D
In Poster presented at the Moving Target Research Workshop, Washington, DC
2012
-
Command and control requirements for moving target defense
Carvalho, M.M.,
Bradshaw, J.M.,
Bunch, L.,
Eskridge, T.C.,
Feltovich, P.J.,
Hoffman, Robert H.,
and Kidwell, D.
2012
[PDF]
-
Ontology Creation as a Sensemaking Activity
Eskridge, T. C.,
and Hoffman, R.
2012
[PDF]
-
Continuous flow analogical reasoning
Eskridge, Thomas Charles
2012
-
From Tools to Teammates: Joint Activity in Human-Agent-Robot Teams
Bradshaw, Jeffrey M,
Feltovich, Paul,
Johnson, Matthew,
Breedy, Maggie,
Bunch, Larry,
Eskridge, Tom,
Jung, Hyuckchul,
Lott, James,
Uszok, Andrzej,
and Diggelen, Jurriaan
2009
-
Network Situational Awareness: A Representative Study.
Eskridge, Thomas C,
Lecoutre, David,
Johnson, Matt,
and Bradshaw, Jeffrey M
In Software Engineering (Workshops)
2009
[PDF]
-
Varieties of analogical reasoning
Hoffman, Robert R,
and Eskridge, Thomas C
In Proceedings of the 9th Bi-annual International Conference on Naturalistic Decision Making (NDM’09), London, UK, June
2009
-
A naturalistic exploration of forms and functions of analogizing.
Hoffman, Robert R.,
Eskridge, Tom,
and Shelley, Cameron
Metaphor and Symbol
2009
[Abs]
The purpose of this article is to invigorate debate concerning the nature of analogy, and to broaden the scope of current conceptions of analogy. We argue that analogizing is not a single or even a fundamental cognitive process. The argument relies on an analysis of the history of the concept of analogy, case studies on the use of analogy in scientific problem solving, cognitive research on analogy comprehension and problem solving, and a survey of computational mechanisms of analogy comprehension. Analogizing is regarded as a macrocognitive phenomenon having a number of supporting processes. These include the apperception of resemblances and distinctions, metaphor, and the balancing of semantic flexibility and inference constraint. Psychological theories and computational models have generally relied on (a) a sparse set of ontological concepts (a property called “similarity” and a structuralist categorization of types of semantic relations), (b) a single form category (i.e., the classic four-term analogy), and (c) a single set of morphological distinctions (e.g., verbal vs. pictorial analogies). This article presents a classification based on a “naturalistic” exploration of the variety of uses of analogical reasoning in pragmatically distinct contexts. The resultant taxonomy distinguishes pre-hoc, ad-hoc, post-hoc, pro-hoc, contra-hoc, and trans-hoc analogy. Each will require its own macrocognitive modeling, and each presents an opportunity for research on phenomena of reasoning that have been neglected. (PsycINFO Database Record (c) 2016 APA, all rights reserved)
-
A naturalistic exploration of forms and functions of analogizing.
Hoffman, Robert R.,
Eskridge, Tom,
and Shelley, Cameron
Metaphor and Symbol
2009
[Abs]
The purpose of this article is to invigorate debate concerning the nature of analogy, and to broaden the scope of current conceptions of analogy. We argue that analogizing is not a single or even a fundamental cognitive process. The argument relies on an analysis of the history of the concept of analogy, case studies on the use of analogy in scientific problem solving, cognitive research on analogy comprehension and problem solving, and a survey of computational mechanisms of analogy comprehension. Analogizing is regarded as a macrocognitive phenomenon having a number of supporting processes. These include the apperception of resemblances and distinctions, metaphor, and the balancing of semantic flexibility and inference constraint. Psychological theories and computational models have generally relied on (a) a sparse set of ontological concepts (a property called “similarity” and a structuralist categorization of types of semantic relations), (b) a single form category (i.e., the classic four-term analogy), and (c) a single set of morphological distinctions (e.g., verbal vs. pictorial analogies). This article presents a classification based on a “naturalistic” exploration of the variety of uses of analogical reasoning in pragmatically distinct contexts. The resultant taxonomy distinguishes pre-hoc, ad-hoc, post-hoc, pro-hoc, contra-hoc, and trans-hoc analogy. Each will require its own macrocognitive modeling, and each presents an opportunity for research on phenomena of reasoning that have been neglected. (PsycINFO Database Record (c) 2016 APA, all rights reserved)
-
KEA: A Knowledge Exchange Architecture Based on Web Services, Concept Maps, and CmapTools
Cañas, Alberto J,
Hill, Greg,
Bunch, Larry,
Carff, Roger,
Eskridge, Thomas,
and Pérez, Carlos
In Concept maps: theory, methodology, technology: Proceedings of the Second International Conference on Concept Mapping
2006
-
-
Ranking concept map retrieval in the CmapTools network
Eskridge, Thomas C,
Granados, Adrián,
and Cañas, Alberto J
In Concept maps: theory, methodology, technology. Proceedings of the Second International Conference on Concept Mapping
2006
-
Concept Maps: Integrating Knowledge and Information Visualization
Cañas, Alberto J.,
Carff, Roger,
Hill, Greg,
Carvalho, Marco,
Arguedas, Marco,
Eskridge, Thomas C.,
Lott, James,
and Carvajal, Rodrigo
2005
[Abs]
[PDF]
Information visualization has been a research topic for many years, leading to a mature field where guidelines and practices are well established. Knowledge visualization, in contrast, is a relatively new area of research that has received more attention recently due to the interest from the business community in Knowledge Management. In this paper we present the CmapTools software as an example of how concept maps, a knowledge visualization tool, can be combined with recent technology to provide integration between knowledge and information visualizations. We show how concept map-based knowledge models can be used to organize repositories of information in a way that makes them easily browsable, and how concept maps can improve searching algorithms for the Web. We also report on how information can be used to complement knowledge models and, based on the searching algorithms, improve the process of constructing concept maps.
-
Knowledge Acquisition and Modeling in a Technical Knowledge Domain
Coffey, John W,
and Eskridge, Tom
In Proceedings of the 9th World MultiConference on Systemics, Cybernetics and Informatics (SCI2005)
2005
-
Knowledge Acquisition and Modeling in a Technical Knowledge Domain
Coffey, John W,
and Eskridge, Tom
In Proceedings of the 9th World MultiConference on Systemics, Cybernetics and Informatics (SCI2005)
2005
-
User Interface For Automated Optical Inspection Systems
Eskridge, Thomas C,
Newberry, Jeff E,
Deyong, Mark R,
Dunn, Scott A,
and Huffstutter, Wesley K
2005
-
Advanced Information Displays
Eskridge, Thomas C
2005
-
COE: tools for collaborative ontology development and reuse
Hayes, Pat,
Eskridge, Thomas C,
Mehrotra, Mala,
Bobrovnikoff, Dmitri,
Reichherzer, Thomas,
and Saavedra, Raul
In Knowledge Capture Conference (K-CAP) 2005
2005
-
Collaborative knowledge capture in ontologies
Hayes, Pat,
Eskridge, Thomas C,
Saavedra, Raul,
Reichherzer, Thomas,
Mehrotra, Mala,
and Bobrovnikoff, Dmitri
In Proceedings of the 3rd International Conference on Knowledge Capture
2005
[PDF]
-
Applications of Connectionism to Analogical Reasoning
Eskridge, T. C.,
and Barnden, John A.
1991
-
ASTRA: A Computational Model of Continuous Analogical Reasoning
Eskridge, T. C.
1991
-
A Hybrid Connectionist Model of Human Analogical Reasoning
Eskridge, T. C.
1991
-
Continuous Analogical Learning
Eskridge, T. C.
1991
-
Proceedings of the Second Workshop on Weather and Terrain for the Intelligence Preparation of the Battlefield (IPB)
Eskridge, T. C.
1991
-
Integrated reasoning through associative retrieval
Eskridge, T. C.
1991
-
Continuous analogical learning
Eskridge, Thomas C
1991
-
Knowledge Representation and Control in “gm1”, an Automated DNA Sequence Analysis System Based on the MGR Architecture
Fields, C. A.,
Pfeiffer, H. D.,
and Eskridge, T. C.
1991
-
Expert system for fusing weather and doctrinal information used in the intelligence preparation of the battlefield
McWilliams, G,
Kirby, S,
Eskridge, T. C.,
and Newberry, J. E.
1991
-
Expert system for fusing weather and doctrinal information used in the intelligence preparation of the battlefield
McWilliams, Gary,
Kirby, Steve,
Eskridge, Thomas C.,
and Newberry, Jeff E.
In Applications of Artificial Intelligence IX
1991
-
Representing Strategic Knowledge in Continuous, Dynamic Control Functions
Eskridge, T. C.,
and Fields, C. A.
1989
-
Investigating Dynamic Control in Symbolic Problem Solvers
Eskridge, T. C.,
and Fields, C. A.
1989
-
Representing Knowledge for Analogical Reasoning
Eskridge, T. C.
1989
-
Continuous Analogical Reasoning and Learning
Eskridge, T. C.
1989
-
Continuous analogical reasoning: A summary of current research
Eskridge, T. C.
1989
-
Principles of continuous analogical reasoning
Eskridge, Thomas
Journal of Experimental & Theoretical Artificial Intelligence
1989
-
ARCHITECTURE OF THE MERCURY MESOSCALE METEOROLOGICAL DATA FUSION
Fields, C,
Cavendish, C,
Coombs, M,
Eskridge, T,
Hartley, R,
Pfeiffer, H,
Soderlund, C,
Kirby, S,
and McWilliams, G
1989
-
Architecture of the MERCURY mesoscale meteorological data fusion system
Fields, C,
Coombs, M,
Eskridge, T,
Hartley, R,
Pfeiffer, H,
Soderlund, C,
McWilliams, G,
and Kirby, S
In Fifth International Conference on Interactive Information and Processing Systems for Meteorology, Oceanography, and Hydrology
1989
-
Architecture of the MERCURY mesoscale meteorological data fusion system
Fields, C,
Coombs, M,
Eskridge, T,
Hartley, R,
Pfeiffer, H,
Soderlund, C,
McWilliams, G,
and Kirby, S
In Fifth International Conference on Interactive Information and Processing Systems for Meteorology, Oceanography, and Hydrology
1989
-
Experimental Analysis of Dynamic Control Strategies for the MGR Architecture: Simulation Environment and Initial Results architecture: Simulation environment and initial results
Fields, CA,
Eskridge, TC,
Hartley, RT,
and Coombs, MJ
In Proceedings of the Seventh Conference (AISB89) on Artificial Intelligence and Simulation of Behaviour
1989
-
Army requirements for an intelligent interface to real-time meteorological databases
McWilliams, G,
Kirby, C,
Fields, C,
Cavendish, C,
Coombs, M,
Eskridge, T,
Hartley, R,
Pfeiffer, H,
and Soderlund, C
In Pre-prints of the Fifth International Conference on Interactive and Information Processing Systems for Meteorology, Oceanography and Hydrology
1989