Comment on: Featured Proposal:Supervisory Interface for Long-Horizon Interaction-Empirical Evidence from 180-Day LSO Trace
Repo: MoonshotAI/Attention-Residuals by Flora-architecture
def interaction_residual(q_base, q_human, lambda_val, K, V):
"""
Minimal interaction-level modulation over attention residuals.
q_base: base pseudo-query (learned)
q_human: human modulation vector
lambda_val: modulation strength (externally triggered)
K, V: keys and values (stacked layer/block outputs)
"""
q = q_base + lambda_val * q_human
attn = (q @ K.transpose(-1, -2)).softmax(dim=-1)
return attn @ V
Here, lambda_val is not continuously optimized, but externally triggered based on interaction-level stability conditions.
GitHub Issue
Parent Entity
State: Open • Comments: 1
Other Comments / Reviews
SaaS Metrics