Design Interactive, Inc. — Department of Defense SBIR Phase II: HR001119S0035-17

Description

There is an opportunity to consolidate interrelated, emerging technological capabilities for rapidly translating 2D visual content into 3D models and building human behavior models (HBMs) to make immersive training environments. Advances in machine learning (ML) offer potential for automating aspects of the scenario generation process, including the rapid permutation of environmental models and realistic HBMs, to vary and increase the number of scenarios. Design Interactive Inc. will develop the Generative Immersive Scenario Testbed (GIST), an integrated ecosystem for rapidly generating training scenarios, including realistic virtual humans, from 2D visual inputs from real settings. GIST integrates 3D modeling from crowdsourcing, photogrammetry, and ML analysis with human behavior modeling approaches to convert 2D content into 3D immersive environments. GIST provides an interface so that instructors can select multiple parameters for varying the realistic training experience. Components include: a user interface, reality modeling technology, ML, a game engine, and AR/VR technology.