Skip to content

feat: GF-T nonlinear (ReLU) on-chip trainer (proven on AX7203) - #1819

Merged
gHashTag merged 1 commit into
masterfrom
feat/gft-train2relu
Aug 7, 2026
Merged

feat: GF-T nonlinear (ReLU) on-chip trainer (proven on AX7203)#1819
gHashTag merged 1 commit into
masterfrom
feat/gft-train2relu

Conversation

@gHashTag

@gHashTag gHashTag commented Aug 7, 2026

Copy link
Copy Markdown
Owner

New spec gft_train2relu.t27 — on-chip SGD step of a NONLINEAR 2-input neuron y=relu(w0x0+w1x1). Forward applies relu(z); gradient GATED by relu'(z) (d=erelu_prime(z), g_i=dx_i); updates w_i-eta*g_i; returns (w0'<<32)|w1'. In-spec tests (active z>0 updates, dead z<0 no-update) PASS. Proven on a live AX7203 (uart_train2relu.v): active learning converges; a dead-ReLU probe (z<0, huge error) leaves weights FROZEN (relu' gates the gradient); resuming active resumes learning. docs/NOW.md updated. Refs #1764

gft_train2relu.t27: on-chip SGD step of a NONLINEAR 2-input neuron
y=relu(w0*x0+w1*x1). Forward applies relu(z); the gradient is GATED by
relu'(z) (d=e*relu_prime(z), g_i=d*x_i), then w_i'=w_i-eta*g_i, returning both
weights packed (w0'<<32)|w1'. Reuses the verified smul/sadd/neg/mag* helpers.

Proven on a live AX7203 (uart_train2relu.v): active-region learning converges;
a dead-ReLU probe (z<0, huge error) leaves the weights FROZEN because relu'=0
gates the update; resuming active resumes learning -- the defining nonlinear
behavior, on silicon. In-spec tests (active/dead) PASS. docs/NOW.md updated.

Refs #1764

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

PR Dashboard

Generated at: 2026-08-07 00:37:14 UTC

Summary

Status Count
Total Open PRs 4
PRs with Failing Checks 0
PRs with All Checks Green 4
READY 3
FAILING 0
PENDING 0

Seal Status

  • ⚠️ STALE -- sha256(compiler.rs)=4c1aaad5309a != manifest seal=87e5cbd3ad94.
    The committed NMSE numbers were certified against an older compiler.rs.
    Run scripts/reseal-check.sh locally for the two-step reseal command (advisory; not a merge gate).

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

📓 NotebookLM Notebook linked to this PR

This notebook contains session context, decisions, and artifacts for this work.

@gHashTag
gHashTag merged commit c1ddaea into master Aug 7, 2026
17 checks passed
@gHashTag
gHashTag deleted the feat/gft-train2relu branch August 7, 2026 00:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant