method: SMoLA-PaLI-X Specialist Model2023-11-15

Authors: SMoLA PaLI Team

Affiliation: Google Research

Description: Omni-SMoLA uses the Soft MoE approach to (softly) mix many multimodal low rank experts. The specialist model is further lora tuned on the InfoVQA task from the SMoLA-PaLI-X generalist model.