SOAR TECHNOLOGY, LLC — Department of Defense SBIR Phase II: SB163-007
SOAR TECHNOLOGY, LLC — SBIR Phase II award from Department of Defense.
Phase II SBIR prototype / development signal
- Phase II is where Department of Defense funds deeper R&D after feasibility. Incumbents with Phase II history are serious competitors on adjacent topics.
- Use this award as past-performance context and to map customer organizations for STRATFI/TACFI-style transition planning.
- At $1,795,734, this is a large obligation for typical SBIR Phase sizing — worth reviewing for scope breadth and teaming opportunity.
- Topic code SB163-007 links this award to a solicitation family — search the same topic stem for incumbents and recompete timing.
- Amount
- $1,795,734
- Agency
- Department of Defense · Defense Advanced Research Projects Agency
- Program / Phase
- SBIR · Phase II
- Topic
- SB163-007
- Solicitation
- 16.3
- NAICS
- —
- Place of performance
- MI
- Period
- 2022-10-01 → 2024-09-30
Description
Extending research on scalable Transformer models performed on previous SBIR-funded work for DARPA, Soar-Tech proposes an investigation into Scalable Language Association Models for Domain-specific Utterances in Novel Contexts (SLAMDUNK), a Phase II SBIR research effort focused on developing novel synthetic data generating pipelines and extending these pipelines with novel index-learning, token grouping, sparse approximation, and model mixture techniques that will enable orders-of-magnitude increases in the performance of Transformer models and will explore the application of these scalability techniques in improving the performance of emerging multilingual Transformer models. SLAMDUNK addresses core scalability issues in modern language models including applying index learning to accelerate performance when in search and retrieval applications, applying token grouping and sparse approximation methods to reduce the number of floating-point operations required to execute language models, and applying mixture techniques to combine results obtained in smaller language models. We anticipate SLAMDUNK to result in research that demonstrates a dramatic reduction in the time and cost required to apply Transformer models in both English and multilingual information processing domains.