Comment on: Google Gemma 4 12B

Encoder-free multimodal architecture is a bold call. Folding visual understanding directly into the transformer avoids the latency of separate encoder forward passes and reduces memory significantly. We've been wrestling with the privacy tradeoffs of calling external APIs for customer data, so local inference changes that calculus entirely. How does this affect LoRA fine-tuning? Can you still do efficient adapter-based approaches across both modalities?