# What changed
# Why it matters
# Core capabilities introduced
- Unified multimodal vector space: text, raster images, rendered document pages, spreadsheet tables, and charts are embedded into the same semantic space for consistent retrieval.
- Crossmodal retrieval: natural language queries can retrieve visual components (text-to-visual) and visual inputs can retrieve relevant text (visual-to-text) without manual tagging.
- Layout-aware document embedding: pages are embedded as rendered images, keeping callouts, multi-column layouts, and spatial hierarchies intact instead of breaking content into arbitrary text blocks.
- Heterogeneous format bridging: the system supports.docx,.xlsx,.pdf,.pptx,.png, and.csv while preserving modality-specific structure.
# How this changes agent behavior
# Three design patterns where multimodal agents add value 1) Complex financial and analytical reporting The embedding of rendered tables and charts preserves row/column relationships so agents can surface exact supporting tables or flag discrepancies between written claims and visual trends.
2) Multimodal clinical decision support
3) Cross-format operational workflows
# Practical effects for teams
- Faster, more accurate retrieval of visual evidence and structured data.
- Reduced need for manual tagging or format conversions when preparing corpora for agent use.
# What to watch next Adoption will depend on how teams pipeline existing Box content into layout-aware embeddings and how agents are trained to interpret those multimodal vectors for tasks like trend detection, anomaly identification, and document-level sourcing.
# Short summary Box plus Gemini Multimodal Embeddings 2 moves enterprise agents beyond text by embedding images, pages, tables, and charts into a unified vector space. That preserves spatial and structural meaning across mixed file types and enables agents to retrieve and reason over the precise visual or structured element that supports a query.