-
LEVIOSA: Natural Language-Based Uncrewed Aerial Vehicle Trajectory Generation
Aikins, Godwyll,
Dao, Mawaba Pascal,
Moukpe, Koboyo Josias,
Eskridge, Thomas C.,
and Nguyen, Kim-Doang
Electronics,
2024
[Abs]
This paper presents LEVIOSA, a novel framework for text- and speech-based uncrewed aerial vehicle (UAV) trajectory generation. By leveraging multimodal large language models (LLMs) to interpret natural language commands, the system converts text and audio inputs into executable flight paths for UAV swarms. The approach aims to simplify the complex task of multi-UAV trajectory generation, which has significant applications in fields such as search and rescue, agriculture, infrastructure inspection, and entertainment. The framework involves two key innovations: a multi-critic consensus mechanism to evaluate trajectory quality and a hierarchical prompt structuring for improved task execution. The innovations ensure fidelity to user goals. The framework integrates several multimodal LLMs for high-level planning, converting natural language inputs into 3D waypoints that guide UAV movements and per-UAV low-level controllers to control each UAV in executing its assigned 3D waypoint path based on the high-level plan. The methodology was tested on various trajectory types with promising accuracy, synchronization, and collision avoidance results. The findings pave the way for more intuitive human–robot interactions and advanced multi-UAV coordination.
-
Superteams: The effect of adaptive AI systems on operational performance
Demirjian, Eric,
Eskridge, Thomas C,
Walton, Abram,
Sandall, Darrel L,
Shah, Natalie,
Bailey, Ryan,
and Henderson, John
Naval Engineering Journal,
2024
-
Generalized Nudging
Eskridge, Thomas C
2024
-
Ethics of Artificial Intelligence
Eskridge, Thomas C
2024
-
What is Artificial Intelligence?
Eskridge, Thomas C
2024
-
Teamwork and Input Compositionality: UI Design for Taskwork or Teamwork?
Momose, Kazuhiko,
Mehta, Rahul,
Moukpe, Josias,
Almashayhkhi, Ali,
Samkari, Waseem,
Weekes, Troy R,
Eskridge, Thomas C,
and Kidwell, Daniel
2024
[PDF]
-
Human-AI Teamwork Interface Design Using Patterns of Interactions
Momose, Kazuhiko,
Mehta, Rahul,
Moukpe, Josias,
Weekes, Troy R.,
and Eskridge, Thomas C.
International Journal of Human–Computer Interaction,
2024
-
Nudging automated planners with learned user preferences
Yaman, Fusun,
Eskridge, Thomas C,
Scott, Ron,
Lin, Li,
Miller, Jeff,
and Carpenter, Daniel
invited submission to 16th International Conference on Agents and Artificial Intelligence,
2024
[PDF]
-
A Federated Defense Community and Ecosystem in Practice
Eskridge, T. C.,
and Carvalho, M.M.
2019 S&T Cybersecurity and Innovation Showcase,
2019
[PDF]
-
A case-based reasoning approach to cybersecurity reasoning
Eskridge, Thomas C,
Carvalho, Marco M,
Rodgers, Andrew V,
and Tassel, Richard
Harris Institute for Assured Information, Florida Institute of Technology,
2019
-
Using Bayes Networks to predict information gain on experiment trial
Eskridge, Thomas C,
Mehta, Dhanish,
Granados, Adrián,
Carvalho, Marco M,
Atighetchi, M,
Costa, Paulo,
and Myers, David
Harris Institute for Assured Information, Florida Institute of Technology,
2019
-
Intelligent Trial Generation for Cyber Security Experimentation
Eskridge, Thomas C,
Mehta, Dhanish,
Granados, Adrián,
Carvalho, Marco M,
Atighetchi, M,
and Myers, David
Harris Institute for Assured Information, Florida Institute of Technology,
2019
-
Semantic Composition of the User Interface
Eskridge, Thomas C,
Nyffenegger, W,
Akerman, Shea,
Ghaderpour Taleghani, Shayesteh,
Metha, Dhanish,
and Carvalho, Marco
Harris Institute for Assured Information, Florida Institute of Technology,
2019
-
User Display Providing Obstacle Avoidance
Eskridge, Thomas Charles,
Johnson, Matthew,
and Chua, Kenny Wei Liang
US Patent No. 10,410,071,
2019
[PDF]
-
A framework for automated cyber experimentation
Mehta, Dhanish,
Eskridge, Thomas C,
and Carvalho, Marco M
Harris Institute for Assured Information, Florida Institute of Technology,
2019
[PDF]
-
Towards the application of recommender systems to secure coding
Nembhard, F.,
Carvalho, Marco M,
and Eskridge, Thomas C
EURASIP Journal on Information Security,
2019
[PDF]
-
Nudging into Flow: Optimizing Productivity with a Choice Architecture
Weekes, Troy,
and Eskridge, Thomas C
In Cognitive Economics Workshop,
2019
[PDF]
-
Formal Assurance for Cooperative Intelligent Autonomous Agents
Bhattacharyya, Siddhartha,
Eskridge, Thomas C.,
Neogi, Natasha A.,
Carvalho, Marco,
and Stafford, Milton
In NASA Formal Methods,
2018
[Abs]
[PDF]
Developing trust in intelligent agents requires understanding the full capabilities of the agent, including the boundaries beyond which the agent is not designed to operate. This paper focuses on applying formal verification methods to identify these boundary conditions in order to ensure the proper design for the effective operation of the human-agent team. The approach involves creating an executable specification of the human-machine interaction in a cognitive architecture, which incorporates the expression of learning behavior. The model is then translated into a formal language, where verification and validation activities can occur in an automated fashion. We illustrate our approach through the design of an intelligent copilot that teams with a human in a takeoff operation, while a contingency scenario involving an engine-out is potentially executed. The formal verification and counterexample generation enables increased confidence in the designed procedures and behavior of the intelligent copilot system.
-
Innovation in Action: The Florida Institute for Human & Machine Cognition (IHMC)
Bradshaw, J. M.,
Bunch, L,
Carvalho, M,
Eskridge, T. C.,
Feltovich, P. J.,
and Johnson, M. J.
Technology & Innovation,
2018
-
Multi-Tier Orchestration Frameowrk for Cyber Operations and Defense
Carvalho, M.M.,
Eskridge, T. C.,
and Nyffenegger, W
Harris Institute for Assured Information,
2018
-
Experimenting with C2 Implementations
Eskridge, Thomas C
2018
-
Experimenting with C2 Implementations
Eskridge, Thomas C
2018
-
Extracting Knowledge from Open Source Projects to Improve Program Security
Nembhard, Fitzroy,
Carvalho, Marco M,
and Eskridge, Thomas C
2018 IEEE SoutheastCon,
2018
-
Assurance for Cyberfacturing
Newton, M,
Eskridge, T. C.,
and Bhattacharyya, Siddhartha
HIAI Tech Report,
2018
-
Coactive emergence as a sensemaking strategy for cyber operations
Bradshaw, J.M.,
Carvalho, M.M.,
Bunch, L.,
Eskridge, T.C.,
Feltovich, P.J.,
Forsythe, C.,
Hoffman, R.R.,
Johnson, M. J.,
Kidwell, D.,
and Woods, D.D.
In ICST (Institute for Computer Science, Social Informatics, and Telecommunications Engineering) Transactions on Security and Safety. Special section on The Cognitive Science of Cyber Defense Analysis,
2013
-
The KAoS policy services framework
Bradshaw, Jeffrey M,
Uszok, Andrzej,
Breedy, Maggie,
Bunch, Larry,
Eskridge, T,
Feltovich, P,
Johnson, Matthew,
Lott, James,
and Vignati, Micael
In Proc. 8th Cyber Security and Information Intelligence Research Workshop,
2013
-
MTC2: A command and control framework for moving target defense and cyber resilience
Carvalho, Marco,
Eskridge, Thomas C,
Bunch, Larry,
Dalton, Adam,
Hoffman, Robert,
Bradshaw, Jeffrey M,
Feltovich, Paul J,
Kidwell, Daniel,
and Shanklin, Teresa
In Resilient Control Systems (ISRCS), 2013 6th International Symposium on,
2013
[PDF]
-
A human-agent teamwork command and control framework for moving target defense (MTC2)
Carvalho, Marco M,
Eskridge, Thomas C,
Bunch, Larry,
Bradshaw, Jeffrey M,
Dalton, Adam,
Feltovich, Paul,
Lott, James,
and Kidwell, Daniel
In Proceedings of the Eighth Annual Cyber Security and Information Intelligence Research Workshop,
2013
-
Visualizing Multi-Agent Systems
Polack Jr, Peter J,
Carvalho, Marco,
and Eskridge, Thomas C
In EEE/WIC/ACM International Conference on Web Intelligence,
2013
[PDF]
-
Sol: An agent-based framework for cyber situation awareness
Bradshaw, J. M.,
Carvalho, Marco,
Bunch, L.,
Eskridge, Thomas C,
Feltovich, P. J.,
Johnson, Matthew,
and Kiddwell, Dan
Kuenstliche Intelligenz,
2012
-
Human-agent teamwork in cyber operations: supporting co-evolution of tasks and artifacts with Luna
Bunch, Larry,
Bradshaw, Jeffrey M,
Carvalho, Marco,
Eskridge, Tom,
Feltovich, Paul J,
Lott, James,
and Uszok, Andrzej
In German Conference on Multiagent System Technologies,
2012
-
Policy-Based Governance within Luna: Why We Developed Yet Another Agent Framework
Bunch, Larry,
Bradshaw, Jeffrey M,
Eskridge, Tom,
Feltovich, Paul J,
Lott, James,
Uszok, Andrzej,
and Carvalho, Marco
In Web Intelligence and Intelligent Agent Technology (WI-IAT), 2012 IEEE/WIC/ACM International Conferences on,
2012
-
A human-agent teamwork approach to moving target defense command and control
Carvalho, M,
Bradshaw, JM,
Bunch, L,
Eskridge, T,
Feltovich, P,
Hoffman, R,
Lott, J,
and Kidwell, D
In Poster presented at the Moving Target Research Workshop, Washington, DC,
2012
-
A human-agent teamwork approach to moving target defense command and control
Carvalho, M,
Bradshaw, JM,
Bunch, L,
Eskridge, T,
Feltovich, P,
Hoffman, R,
Lott, J,
and Kidwell, D
In Poster presented at the Moving Target Research Workshop, Washington, DC,
2012
-
Command and control requirements for moving target defense
Carvalho, M.M.,
Bradshaw, J.M.,
Bunch, L.,
Eskridge, T.C.,
Feltovich, P.J.,
Hoffman, Robert H.,
and Kidwell, D.
IEEE Intelligent Systems,
2012
[PDF]
-
Ontology Creation as a Sensemaking Activity
Eskridge, T. C.,
and Hoffman, R.
Intelligent Systems, IEEE,
2012
[PDF]
-
Continuous flow analogical reasoning
Eskridge, Thomas Charles
2012
-
From Tools to Teammates: Joint Activity in Human-Agent-Robot Teams
Bradshaw, Jeffrey M,
Feltovich, Paul,
Johnson, Matthew,
Breedy, Maggie,
Bunch, Larry,
Eskridge, Tom,
Jung, Hyuckchul,
Lott, James,
Uszok, Andrzej,
and Diggelen, Jurriaan
In Human Centered Design: First International Conference,
2009
-
Network Situational Awareness: A Representative Study.
Eskridge, Thomas C,
Lecoutre, David,
Johnson, Matt,
and Bradshaw, Jeffrey M
In Software Engineering (Workshops),
2009
[PDF]
-
Varieties of analogical reasoning
Hoffman, Robert R,
and Eskridge, Thomas C
In Proceedings of the 9th Bi-annual International Conference on Naturalistic Decision Making (NDM’09), London, UK, June,
2009
-
A naturalistic exploration of forms and functions of analogizing.
Hoffman, Robert R.,
Eskridge, Tom,
and Shelley, Cameron
Metaphor and Symbol,
2009
[Abs]
The purpose of this article is to invigorate debate concerning the nature of analogy, and to broaden the scope of current conceptions of analogy. We argue that analogizing is not a single or even a fundamental cognitive process. The argument relies on an analysis of the history of the concept of analogy, case studies on the use of analogy in scientific problem solving, cognitive research on analogy comprehension and problem solving, and a survey of computational mechanisms of analogy comprehension. Analogizing is regarded as a macrocognitive phenomenon having a number of supporting processes. These include the apperception of resemblances and distinctions, metaphor, and the balancing of semantic flexibility and inference constraint. Psychological theories and computational models have generally relied on (a) a sparse set of ontological concepts (a property called “similarity” and a structuralist categorization of types of semantic relations), (b) a single form category (i.e., the classic four-term analogy), and (c) a single set of morphological distinctions (e.g., verbal vs. pictorial analogies). This article presents a classification based on a “naturalistic” exploration of the variety of uses of analogical reasoning in pragmatically distinct contexts. The resultant taxonomy distinguishes pre-hoc, ad-hoc, post-hoc, pro-hoc, contra-hoc, and trans-hoc analogy. Each will require its own macrocognitive modeling, and each presents an opportunity for research on phenomena of reasoning that have been neglected. (PsycINFO Database Record (c) 2016 APA, all rights reserved)
-
A naturalistic exploration of forms and functions of analogizing.
Hoffman, Robert R.,
Eskridge, Tom,
and Shelley, Cameron
Metaphor and Symbol,
2009
[Abs]
The purpose of this article is to invigorate debate concerning the nature of analogy, and to broaden the scope of current conceptions of analogy. We argue that analogizing is not a single or even a fundamental cognitive process. The argument relies on an analysis of the history of the concept of analogy, case studies on the use of analogy in scientific problem solving, cognitive research on analogy comprehension and problem solving, and a survey of computational mechanisms of analogy comprehension. Analogizing is regarded as a macrocognitive phenomenon having a number of supporting processes. These include the apperception of resemblances and distinctions, metaphor, and the balancing of semantic flexibility and inference constraint. Psychological theories and computational models have generally relied on (a) a sparse set of ontological concepts (a property called “similarity” and a structuralist categorization of types of semantic relations), (b) a single form category (i.e., the classic four-term analogy), and (c) a single set of morphological distinctions (e.g., verbal vs. pictorial analogies). This article presents a classification based on a “naturalistic” exploration of the variety of uses of analogical reasoning in pragmatically distinct contexts. The resultant taxonomy distinguishes pre-hoc, ad-hoc, post-hoc, pro-hoc, contra-hoc, and trans-hoc analogy. Each will require its own macrocognitive modeling, and each presents an opportunity for research on phenomena of reasoning that have been neglected. (PsycINFO Database Record (c) 2016 APA, all rights reserved)
-
Concept Maps: Integrating Knowledge and Information Visualization
Cañas, Alberto J.,
Carff, Roger,
Hill, Greg,
Carvalho, Marco,
Arguedas, Marco,
Eskridge, Thomas C.,
Lott, James,
and Carvajal, Rodrigo
In Knowledge and Information Visualization: Searching for Synergies,
2005
[Abs]
[PDF]
Information visualization has been a research topic for many years, leading to a mature field where guidelines and practices are well established. Knowledge visualization, in contrast, is a relatively new area of research that has received more attention recently due to the interest from the business community in Knowledge Management. In this paper we present the CmapTools software as an example of how concept maps, a knowledge visualization tool, can be combined with recent technology to provide integration between knowledge and information visualizations. We show how concept map-based knowledge models can be used to organize repositories of information in a way that makes them easily browsable, and how concept maps can improve searching algorithms for the Web. We also report on how information can be used to complement knowledge models and, based on the searching algorithms, improve the process of constructing concept maps.
-
Knowledge Acquisition and Modeling in a Technical Knowledge Domain
Coffey, John W,
and Eskridge, Tom
In Proceedings of the 9th World MultiConference on Systemics, Cybernetics and Informatics (SCI2005),
2005
-
Knowledge Acquisition and Modeling in a Technical Knowledge Domain
Coffey, John W,
and Eskridge, Tom
In Proceedings of the 9th World MultiConference on Systemics, Cybernetics and Informatics (SCI2005),
2005
-
User Interface For Automated Optical Inspection Systems
Eskridge, Thomas C,
Newberry, Jeff E,
Deyong, Mark R,
Dunn, Scott A,
and Huffstutter, Wesley K
Taiwan Patent No. TW I225984 B,
2005
[PDF]
-
Advanced Information Displays
Eskridge, Thomas C
2005
-
COE: tools for collaborative ontology development and reuse
Hayes, Pat,
Eskridge, Thomas C,
Mehrotra, Mala,
Bobrovnikoff, Dmitri,
Reichherzer, Thomas,
and Saavedra, Raul
In Knowledge Capture Conference (K-CAP) 2005,
2005
-
Collaborative knowledge capture in ontologies
Hayes, Pat,
Eskridge, Thomas C,
Saavedra, Raul,
Reichherzer, Thomas,
Mehrotra, Mala,
and Bobrovnikoff, Dmitri
In Proceedings of the 3rd International Conference on Knowledge Capture,
2005
[PDF]
-
Gold Surface Inspection for Direct Chip Attach Technologies
Dunn, S. A.,
and Eskridge, T. C.
In Proceedings of the NEPCON 2000 Technical Conference,
2000
-
Post-reflow implementation strategies for automated optical inspection
Eskridge, T. C.
Circuits Assembly,
2000
-
SMT Step-by-Step: Test and Inspection
Eskridge, T. C.
SMT Magazine,
2000
-
In Process Quality Control: The Route to Zero Defect Manufacture
Eskridge, Thomas C
2000
-
In-process Quality Control: The Route to Zero-defect Manufacture
Eskridge, Thomas C
Surface Mount Technology Magazine,
2000
-
Implementation Strategies for Automated Optical Inspection: Case Studies and Results
Huffstutter, W. K.,
Ortiz, H.,
and Eskridge, T. C.
In Proceedings of the 2000 Nepcon Technical Conference,
2000
-
Applications of Connectionism to Analogical Reasoning
Eskridge, T. C.,
and Barnden, John A.
3rd Annual Midwest Artificial Intelligence and Cognitive Science Society Conference,
1991
-
ASTRA: A Computational Model of Continuous Analogical Reasoning
Eskridge, T. C.
New Mexico State University,
1991
-
A Hybrid Connectionist Model of Human Analogical Reasoning
Eskridge, T. C.
New Mexico State University,
1991
-
Continuous Analogical Learning
Eskridge, T. C.
In The First International Conference on the Learning Sciences,
1991
-
Proceedings of the Second Workshop on Weather and Terrain for the Intelligence Preparation of the Battlefield (IPB)
Eskridge, T. C.
1991
-
Integrated reasoning through associative retrieval
Eskridge, T. C.
In Sixth International Symposium on Methodologies for Intelligent Systems,
1991
-
Continuous analogical learning
Eskridge, Thomas C
Computing Research Laboratory, New Mexico State University,
1991
-
Knowledge Representation and Control in “gm1”, an Automated DNA Sequence Analysis System Based on the MGR Architecture
Fields, C. A.,
Pfeiffer, H. D.,
and Eskridge, T. C.
International Journal of Man-Machine Studies,
1991
-
Expert system for fusing weather and doctrinal information used in the intelligence preparation of the battlefield
McWilliams, G,
Kirby, S,
Eskridge, T. C.,
and Newberry, J. E.
In The SPIE Applications of Artificial Intelligence IX,
1991
-
Expert system for fusing weather and doctrinal information used in the intelligence preparation of the battlefield
McWilliams, Gary,
Kirby, Steve,
Eskridge, Thomas C.,
and Newberry, Jeff E.
In Applications of Artificial Intelligence IX,
1991
-
Representing Strategic Knowledge in Continuous, Dynamic Control Functions
Eskridge, T. C.,
and Fields, C. A.
In International Symposium on Methodologies for Intelligent Systems,
1989
-
Investigating Dynamic Control in Symbolic Problem Solvers
Eskridge, T. C.,
and Fields, C. A.
In The 1st Annual IEEE Symposium on Parallel and Distributed Processing,
1989
-
Representing Knowledge for Analogical Reasoning
Eskridge, T. C.
In The 1st Annual IEEE Symposium on Parallel and Distributed Processing,
1989
-
Continuous Analogical Reasoning and Learning
Eskridge, T. C.
In ONR Workshop on Models of Complex Human Learning,
1989
-
Continuous analogical reasoning: A summary of current research
Eskridge, T. C.
In Proceedings of the DARPA Workshop on Case-based Reasoning,
1989
-
Principles of continuous analogical reasoning
Eskridge, Thomas
Journal of Experimental & Theoretical Artificial Intelligence,
1989
-
ARCHITECTURE OF THE MERCURY MESOSCALE METEOROLOGICAL DATA FUSION
Fields, C,
Cavendish, C,
Coombs, M,
Eskridge, T,
Hartley, R,
Pfeiffer, H,
Soderlund, C,
Kirby, S,
and McWilliams, G
New Mexico State University,
1989
-
Architecture of the MERCURY mesoscale meteorological data fusion system
Fields, C,
Coombs, M,
Eskridge, T,
Hartley, R,
Pfeiffer, H,
Soderlund, C,
McWilliams, G,
and Kirby, S
In Fifth International Conference on Interactive Information and Processing Systems for Meteorology, Oceanography, and Hydrology,
1989
-
Architecture of the MERCURY mesoscale meteorological data fusion system
Fields, C,
Coombs, M,
Eskridge, T,
Hartley, R,
Pfeiffer, H,
Soderlund, C,
McWilliams, G,
and Kirby, S
In Fifth International Conference on Interactive Information and Processing Systems for Meteorology, Oceanography, and Hydrology,
1989
-
Experimental Analysis of Dynamic Control Strategies for the MGR Architecture: Simulation Environment and Initial Results architecture: Simulation environment and initial results
Fields, CA,
Eskridge, TC,
Hartley, RT,
and Coombs, MJ
In Proceedings of the Seventh Conference (AISB89) on Artificial Intelligence and Simulation of Behaviour,
1989
-
Army requirements for an intelligent interface to real-time meteorological databases
McWilliams, G,
Kirby, C,
Fields, C,
Cavendish, C,
Coombs, M,
Eskridge, T,
Hartley, R,
Pfeiffer, H,
and Soderlund, C
In Pre-prints of the Fifth International Conference on Interactive and Information Processing Systems for Meteorology, Oceanography and Hydrology,
1989