ROIpad ← Back to Search
github.com › issue comment

Comment on: Featured Proposal:Supervisory Interface for Long-Horizon Interaction-Empirical Evidence from 180-Day LSO Trace

Repo: MoonshotAI/Attention-Residuals by Flora-architecture
Posted: Apr 1, 2026
def interaction_residual(q_base, q_human, lambda_val, K, V): """ Minimal interaction-level modulation over attention residuals. q_base: base pseudo-query (learned) q_human: human modulation vector lambda_val: modulation strength (externally triggered) K, V: keys and values (stacked layer/block outputs) """ q = q_base + lambda_val * q_human attn = (q @ K.transpose(-1, -2)).softmax(dim=-1) return attn @ V Here, lambda_val is not continuously optimized, but externally triggered based on interaction-level stability conditions.
Other Comments / Reviews