From 662aa0c185b3fa616366e52c0e2ff0a13cd366b4 Mon Sep 17 00:00:00 2001 From: tannevaled Date: Wed, 23 Sep 2026 19:11:58 +0200 Subject: [PATCH 1/3] conformance: the measured ruby/spec numbers, and the claims that had drifted MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit The ruby/spec section described the ratchet mechanism well but carried no number at all — no pass count, no floor value, nothing a reader could compare against. Measured on rbgo main (68cb53a), darwin/arm64, against the pinned corpus, four consecutive runs: 21845 / 21903 / 21901 / 21902, floor 21740. A second sweep captured the whole RBGO_RESULT line for a real denominator: 21901 pass, 1349 fail, 794 error, 473 skip, 15 of 2206 files producing no result. conformance.md: * new "Where it stands" with those figures, and an admonition saying which number is the gate and which is the result -- FLOOR is a shrink-only ratchet raised deliberately after a wave, so the measured total normally sits above it * new "Not every gain is VM conformance": the mspec shim (#624/#621, where the same file scored 0/28 under MRI 4.0.5 too) and parser v0.2.0 (#625, 13 language spec files that had never parsed) are gains in what the measurement can SEE, not in what the VM can DO * new "Known limitations", led by __LINE__ always being 0 -- no line map, so const_source_location, warn(uplevel:) and backtrace line numbers all go -- then a table carrying #610 #615 #631 #632 #633 #635 #636, with #630 and #621 set apart as harness rather than VM * "What CI enforces" said the 100% gate ran across all six architectures and three OSes; per ci.yml it is ubuntu + macOS only, per-PR arch cover is amd64/arm64 without coverage, the exotic four are nightly QEMU + scheduled hardware, and there is a wasip1 lane * the Rails/Puppet figures are now dated 2026-06-27 against 2026-06-25 clones and marked not re-measured since; Puppet was stated as both 2 156 and 2 154 * removed a duplicate Rails/Puppet section restating the same table * "Run it yourself" now shows how to run the ratchet, and says to run it more than once because of #615 index.md: the 100% claim as above; 181 bound modules -> 178 across 176 orgs; seven links pointed at go-ruby-/ orgs that do not exist (commonmark, kramdown, liquid, mustache, nokogiri, rouge, xslt live at go-/); `set` is not bound at all (Set is in-tree); activeldap, ldap and fast-gettext-locale were missing. roadmap.md: phases 2 and 5 said "In progress" where the interpreter's own plan-rbgo.md marks them DONE (core), and 6 is "substantially landed"; phase 8 now carries the runtime-conformance campaign. phases/phase0.md: the ~92% coverage figure is scoped to when the phase closed; blocks are Phase 1, not Phase 3. Co-Authored-By: Claude Opus 5 --- docs/conformance.md | 144 +++++++++++++++++++++++++++++++++++------- docs/index.md | 14 ++-- docs/phases/phase0.md | 7 +- docs/roadmap.md | 8 +-- 4 files changed, 139 insertions(+), 34 deletions(-) diff --git a/docs/conformance.md b/docs/conformance.md index 2148131..1e9c777 100644 --- a/docs/conformance.md +++ b/docs/conformance.md @@ -50,12 +50,21 @@ scripts/oracle.sh -b scripts/conformance/core_ext.txt On top of the oracle, the interpreter holds a hard CI gate: -- **100% statement coverage**, enforced as a CI gate; -- across **all six 64-bit architectures** — amd64, arm64, riscv64, loong64, - ppc64le, s390x; -- across **three OSes**; +- **100% statement coverage**, gated on the two **POSIX** lanes — ubuntu and + macOS. The full `-race` suite also runs on **windows**, but the gate is not + applied there: a handful of POSIX-only paths (opening `/dev/null` as a + character device) are unreachable, so its measured coverage is structurally + below 100 %; +- **per-PR architecture cover is the two native lanes**, `amd64` and `arm64`, + which run `go test ./...` — not the coverage gate. The four exotic 64-bit + targets (riscv64, loong64, ppc64le, s390x) are validated **off** the per-PR + critical path: nightly under QEMU and on scheduled real hardware (below); +- a **`wasip1/wasm`** lane builds the interpreter and runs it under wazero; - with **every feature differential-tested against MRI 4.0.5**. +[`ci.yml`](https://github.com/go-embedded-ruby/ruby/blob/main/.github/workflows/ci.yml) +is the authority on which lane runs what. + A feature does not count as landed until it agrees with the reference and the lines that implement it are covered. @@ -98,6 +107,96 @@ floor is a deliberately **conservative lower bound**. The [`rubyspec-ratchet`](https://github.com/go-embedded-ruby/ruby/blob/main/.github/workflows/rubyspec-ratchet.yml) workflow enforces it on every push and pull request. +### Where it stands — measured 2026-09-23 + +On `main` (68cb53a), darwin/arm64, against the pinned corpus +(`SPEC_SHA=87b1631992bd00cf0c4934474766d54dad088191`): + +| | | +| --- | --- | +| **passing examples** | **21 901** — four consecutive runs: 21 845 · 21 903 · 21 901 · 21 902 | +| fail / error | 1 349 / 794 | +| skipped | 473 | +| pass rate of the examples that ran | **91.1 %** (21 901 of 24 044) | +| spec files | 2 191 of 2 206 produce a result; 15 produce none | +| **`FLOOR`** | **21 740** | + +!!! warning "The floor is a gate, not a score" + `FLOOR` says *"no run may come in below this"*. It is raised deliberately, in + its own PR, after a wave lands — so the measured total normally sits **above** + it. Today the gap is ~160 examples. Quoting the floor as the conformance + figure understates rbgo; quoting the measured total as a guarantee overstates + it. The floor is what CI enforces; the measured total is what rbgo does. + +The 58-example spread across those four runs is **one file**. +`core/module/autoload_spec.rb` crashes on roughly one run in four while popping a +frame ([#615](https://github.com/go-embedded-ruby/ruby/issues/615)), and the whole +file's examples are lost when it does. Read the **low** run as the guaranteed +figure. + +There is no honest denominator for "percent of Ruby". The 91.1 % above is the +share of the examples *this shim actually ran*: the shim is not mspec, 473 skips +sit outside the ratio entirely, and 15 files produce no result at all. + +### Not every gain is VM conformance + +Two of the recent jumps came from fixing the **measurement**, not the +interpreter, and blurring the two would be misleading: + +- **The mspec shim** ([#624](https://github.com/go-embedded-ruby/ruby/pull/624), + refs [#621](https://github.com/go-embedded-ruby/ruby/issues/621)) ran each + example under `instance_eval`, so a helper defined with `def` in an outer + `describe` was unreachable from a nested one. + `core/string/valid_encoding/utf_8_spec.rb` scored **0 of 28 — and 0 of 28 under + MRI 4.0.5 as well**, run through the same shim. Fixing the shim moved the + corpus 20 905 → 20 936, of which **28 are attributable**. +- **The parser upgrade to v0.2.0** + ([#625](https://github.com/go-embedded-ruby/ruby/pull/625)) made **13 + `language/*_spec.rb` files parseable that had never parsed at all**. They had + been contributing zero to *both* columns — not failing, invisible. `language/` + went 1 443 → 1 776 passing (**+333**), while `fail+error` rose 283 → 436 at the + same time, because those files brought their own failures with them. + +Both are gains in what the measurement can **see**, not in what the VM can +**do**. The rest of the climb is the VM: the floor went from **6 000** when the +ratchet landed on 2026-08-03 +([#263](https://github.com/go-embedded-ruby/ruby/pull/263)) to **21 740** today, +across 26 conformance waves. + +### Known limitations + +Named plainly, each with an open issue. **`__LINE__` is always `0`** — rbgo +records no line map — which costs `const_source_location`, `warn(uplevel:)` and +every backtrace line number entirely: + +```ruby +puts __LINE__ # rbgo: 0 MRI 4.0.5: 1 +Object.const_source_location(:Comparable) # rbgo: nil MRI 4.0.5: [] +# e.backtrace.first -> "probe.rb:0:in '
'" against MRI's "probe.rb:4:…" +``` + +| | | +| --- | --- | +| `Errno` has **28** constants, not MRI's 158 | [#633](https://github.com/go-embedded-ruby/ruby/issues/633) | +| `FileTest` carries **11** of MRI's 26 predicates | — | +| `Thread#backtrace` answers for the **current** thread only; another thread raises `NotImplementedError` | — | +| `Process.fork` **does not exist** — Go's runtime cannot be forked safely | — | +| `Numeric#to_int` is not defined | [#631](https://github.com/go-embedded-ruby/ruby/issues/631) | +| `File::Stat#==` answers identity, not `Comparable#==` | [#632](https://github.com/go-embedded-ruby/ruby/issues/632) | +| `File#stat` cannot answer for a file unlinked while open | [#635](https://github.com/go-embedded-ruby/ruby/issues/635) | +| `BEGIN { }` / `END { }` do not parse | front-end | +| **Windows:** no text-mode newline translation | [#610](https://github.com/go-embedded-ruby/ruby/issues/610) | +| **Windows:** `File::Stat#atime`/`#ctime` fall back to mtime | [#635](https://github.com/go-embedded-ruby/ruby/issues/635) | +| **Windows:** `File.realpath` does not expand 8.3 short names | [#636](https://github.com/go-embedded-ruby/ruby/issues/636) | + +Two more are **harness**, not interpreter, and are listed apart so they are not +read as VM gaps: the shim's `SPEC_TMP_BASE` is `/tmp`, a symlink on darwin, which +fails 11 `realpath`/`realdirpath` examples on paths that are correct +([#630](https://github.com/go-embedded-ruby/ruby/issues/630)) — **MRI 4.0.5 fails +them the same way through the same shim** — and the `instance_eval` rebinding +above ([#621](https://github.com/go-embedded-ruby/ruby/issues/621)), largely fixed +but not closed. + ## Real-world corpora Synthetic tests prove a feature works in isolation; they do not prove the idioms @@ -123,12 +222,15 @@ considers valid? A released gem / framework file is valid Ruby (`ruby -c` clean) so a rejection is a genuine front-end gap. After the 2026-06 conformance campaign (5 go-ruby-parser rounds interleaved with -5 rbgo activation rounds), the final figures against the MRI 4.0.5 oracle: +5 rbgo activation rounds), the final figures against the MRI 4.0.5 oracle. +**Measured 2026-06-27 against clones of `rails/rails` and `puppetlabs/puppet` +taken on 2026-06-25; not re-measured since** — reproduce with +`scripts/conformance/heavyweight/sweep.sh`: | Repo | `.rb` files | rbgo **parses** | rbgo **parses + compiles** | |--------|------------:|----------------:|---------------------------:| | Rails | 3 423 | **100.00 %** | **99.82 %** | -| Puppet | 2 156 | **100.00 %** (of valid) | **100.00 %** | +| Puppet | 2 156 | **100.00 %** (of valid: 2 154) | **100.00 %** (2 154 / 2 154) | | **Total** | 5 579 | **99.96 %** | **99.89 %** | - **Parse: 99.96 %** of the combined corpus (5577 / 5579). The only 2 misses are @@ -173,23 +275,6 @@ suite: whole applications on the runtime stdlib + C-extension surface is the next, ongoing rung. -## Heavyweight front-end sweep: Rails & Puppet - -The two largest reference Ruby codebases — **Rails** and **Puppet** — are run -through the pure-Go front-end (`parser.Parse` → `compiler.Compile`, no execution) -as a conformance stress test, with **MRI `ruby -c`** as the oracle for "is this -valid Ruby?". - -| Repo | Parse | Parse + compile | -| ------ | ----: | --------------: | -| Rails | 100.00 % (3 423 / 3 423) | **99.82 %** (3 417 / 3 423) | -| Puppet | 100.00 % (2 154 / 2 154) | **100.00 %** (2 154 / 2 154) | - -Across the corpus rbgo parses **100 % of all valid Ruby** (the only 2 misses are -intentional syntax-error fixtures MRI itself rejects), with **0 over-permissive** -(rbgo never accepts Ruby MRI rejects). See -[`CONFORMANCE-RAILS-PUPPET.md`](https://github.com/go-embedded-ruby/ruby/blob/main/CONFORMANCE-RAILS-PUPPET.md) -in the interpreter repo for the full report and the reproducible sweep. These are **front-end (parse + compile) acceptance** figures, not whole-app execution. Running a real application additionally needs the runtime stdlib @@ -256,3 +341,16 @@ scripts/oracle.sh -b scripts/conformance/core_ext.txt ``` Either invocation exits non-zero if any implementation disagrees. + +The ruby/spec ratchet, against a corpus you already have (it clones one at +`SPEC_SHA` otherwise): + +```sh +CGO_ENABLED=0 SPECDIR=/path/to/ruby-spec CACHE=/path/to/ruby-spec \ + scripts/conformance/rubyspec/run.sh +``` + +It prints the measured total and the frozen floor. Run it **more than once**: +`core/module/autoload_spec.rb` crashes intermittently +([#615](https://github.com/go-embedded-ruby/ruby/issues/615)) and a single run can +read ~57 examples low. diff --git a/docs/index.md b/docs/index.md index 38493e4..1a0edbb 100644 --- a/docs/index.md +++ b/docs/index.md @@ -17,9 +17,12 @@ targets **Ruby 4.0** semantics and is grown test-first against a *differential oracle* — every snippet's output is checked against **two independent reference implementations, MRI (CRuby) 4.0.5 and JRuby** ([`scripts/oracle.sh`](https://github.com/go-embedded-ruby/ruby/blob/main/scripts/oracle.sh) -runs all three side by side) — with **100% coverage enforced in CI across all six -64-bit architectures** (amd64, arm64, riscv64, loong64, ppc64le, s390x) and three -OSes. Beyond synthetic tests, the bar is real-world Ruby: idioms and test suites +runs all three side by side) — with **100% coverage enforced in CI** on the two +POSIX lanes (ubuntu, macOS; the full `-race` suite also runs on windows, where a +few POSIX-only paths make the gate unreachable). Per-PR architecture cover is the +native `amd64` and `arm64` lanes; the four exotic 64-bit targets (riscv64, +loong64, ppc64le, s390x) are validated nightly under QEMU and on scheduled real +hardware. See [Conformance](conformance.md#what-ci-enforces). Beyond synthetic tests, the bar is real-world Ruby: idioms and test suites from **reference applications such as Rails** (ActiveSupport's pure-Ruby `core_ext`) and **OpenVox**/Puppet drive the remaining work and double as performance baselines against MRI and JRuby. @@ -222,7 +225,8 @@ still ships as a **single CGO=0 static binary**; every extracted piece is independently reusable, tested and 6-arch by any Go program. The family is a growing set of **standalone pure-Go modules — all CI-green, 100% -coverage and 6-arch**. The `go.mod` currently **binds 181 of them into rbgo** as +coverage and 6-arch**. The `go.mod` currently **binds 178 such modules across 176 +orgs into rbgo** as native modules — including the front-end ([go-ruby-parser](https://github.com/go-ruby-parser)), the regexp engine ([go-ruby-regexp](https://github.com/go-ruby-regexp)), and [go-ruby-erb](https://github.com/go-ruby-erb), @@ -234,7 +238,7 @@ the regexp engine ([go-ruby-regexp](https://github.com/go-ruby-regexp)), and The full bound family (alphabetical, all native modules in `go.mod`): -[`aasm`](https://github.com/go-ruby-aasm/aasm), [`abbrev`](https://github.com/go-ruby-abbrev/abbrev), [`acme`](https://github.com/go-ruby-acme/acme), [`actioncable`](https://github.com/go-ruby-actioncable/actioncable), [`actionmailer`](https://github.com/go-ruby-actionmailer/actionmailer), [`actionpack`](https://github.com/go-ruby-actionpack/actionpack), [`actionview`](https://github.com/go-ruby-actionview/actionview), [`activejob`](https://github.com/go-ruby-activejob/activejob), [`activemodel`](https://github.com/go-ruby-activemodel/activemodel), [`activerecord`](https://github.com/go-ruby-activerecord/activerecord), [`activestorage`](https://github.com/go-ruby-activestorage/activestorage), [`activesupport`](https://github.com/go-ruby-activesupport/activesupport), [`addressable`](https://github.com/go-ruby-addressable/addressable), [`age`](https://github.com/go-ruby-age/age), [`arrow`](https://github.com/go-ruby-arrow/arrow), [`async`](https://github.com/go-ruby-async/async), [`augeas`](https://github.com/go-ruby-augeas/augeas), [`base64`](https://github.com/go-ruby-base64/base64), [`bbolt`](https://github.com/go-ruby-bbolt/bbolt), [`bcrypt`](https://github.com/go-ruby-bcrypt/bcrypt), [`benchmark`](https://github.com/go-ruby-benchmark/benchmark), [`bigdecimal`](https://github.com/go-ruby-bigdecimal/bigdecimal), [`bleve`](https://github.com/go-ruby-bleve/bleve), [`builder`](https://github.com/go-ruby-builder/builder), [`bundler`](https://github.com/go-ruby-bundler/bundler), [`cancancan`](https://github.com/go-ruby-cancancan/cancancan), [`capistrano`](https://github.com/go-ruby-capistrano/capistrano), [`capybara`](https://github.com/go-ruby-capybara/capybara), [`cgi`](https://github.com/go-ruby-cgi/cgi), [`chronic`](https://github.com/go-ruby-chronic/chronic), [`cmath`](https://github.com/go-ruby-cmath/cmath), [`commonmark`](https://github.com/go-ruby-commonmark/commonmark), [`concurrent-ruby`](https://github.com/go-ruby-concurrent-ruby/concurrent-ruby), [`confd`](https://github.com/go-ruby-confd/confd), [`connection-pool`](https://github.com/go-ruby-connection-pool/connection-pool), [`csv`](https://github.com/go-ruby-csv/csv), [`date`](https://github.com/go-ruby-date/date), [`deep-merge`](https://github.com/go-ruby-deep-merge/deep-merge), [`devise`](https://github.com/go-ruby-devise/devise), [`did-you-mean`](https://github.com/go-ruby-did-you-mean/did-you-mean), [`digest`](https://github.com/go-ruby-digest/digest), [`dotenv`](https://github.com/go-ruby-dotenv/dotenv), [`dry-struct`](https://github.com/go-ruby-dry-struct/dry-struct), [`dry-types`](https://github.com/go-ruby-dry-types/dry-types), [`dry-validation`](https://github.com/go-ruby-dry-validation/dry-validation), [`erb`](https://github.com/go-ruby-erb/erb), [`erubi`](https://github.com/go-ruby-erubi/erubi), [`etcd`](https://github.com/go-ruby-etcd/etcd), [`excon`](https://github.com/go-ruby-excon/excon), [`facter`](https://github.com/go-ruby-facter/facter), [`factory-bot`](https://github.com/go-ruby-factory-bot/factory-bot), [`faker`](https://github.com/go-ruby-faker/faker), [`faraday`](https://github.com/go-ruby-faraday/faraday), [`fast-gettext`](https://github.com/go-ruby-fast-gettext/fast-gettext), [`find`](https://github.com/go-ruby-find/find), [`format`](https://github.com/go-ruby-format/format), [`friendly-id`](https://github.com/go-ruby-friendly-id/friendly-id), [`getoptlong`](https://github.com/go-ruby-getoptlong/getoptlong), [`grape`](https://github.com/go-ruby-grape/grape), [`graphql`](https://github.com/go-ruby-graphql/graphql), [`grpc`](https://github.com/go-ruby-grpc/grpc), [`haml`](https://github.com/go-ruby-haml/haml), [`hanami`](https://github.com/go-ruby-hanami/hanami), [`hcl2`](https://github.com/go-ruby-hcl2/hcl2), [`hiera`](https://github.com/go-ruby-hiera/hiera), [`hocon`](https://github.com/go-ruby-hocon/hocon), [`http`](https://github.com/go-ruby-http/http), [`httparty`](https://github.com/go-ruby-httparty/httparty), [`i18n`](https://github.com/go-ruby-i18n/i18n), [`images`](https://github.com/go-ruby-images/images), [`ipaddr`](https://github.com/go-ruby-ipaddr/ipaddr), [`irb`](https://github.com/go-ruby-irb/irb), [`jbuilder`](https://github.com/go-ruby-jbuilder/jbuilder), [`jekyll`](https://github.com/go-ruby-jekyll/jekyll), [`json`](https://github.com/go-ruby-json/json), [`jwt`](https://github.com/go-ruby-jwt/jwt), [`kafka`](https://github.com/go-ruby-kafka/kafka), [`kaminari`](https://github.com/go-ruby-kaminari/kaminari), [`kramdown`](https://github.com/go-ruby-kramdown/kramdown), [`liquid`](https://github.com/go-ruby-liquid/liquid), [`logger`](https://github.com/go-ruby-logger/logger), [`mail`](https://github.com/go-ruby-mail/mail), [`marshal`](https://github.com/go-ruby-marshal/marshal), [`matrix`](https://github.com/go-ruby-matrix/matrix), [`mime-types`](https://github.com/go-ruby-mime-types/mime-types), [`minitest`](https://github.com/go-ruby-minitest/minitest), [`money`](https://github.com/go-ruby-money/money), [`mongodb`](https://github.com/go-ruby-mongodb/mongodb), [`msgpack`](https://github.com/go-ruby-msgpack/msgpack), [`multi-json`](https://github.com/go-ruby-multi-json/multi-json), [`mustache`](https://github.com/go-ruby-mustache/mustache), [`mysql`](https://github.com/go-ruby-mysql/mysql), [`nats`](https://github.com/go-ruby-nats/nats), [`net-ftp`](https://github.com/go-ruby-net-ftp/net-ftp), [`net-http`](https://github.com/go-ruby-net-http/net-http), [`net-imap`](https://github.com/go-ruby-net-imap/net-imap), [`net-pop`](https://github.com/go-ruby-net-pop/net-pop), [`net-sftp`](https://github.com/go-ruby-net-sftp/net-sftp), [`net-smtp`](https://github.com/go-ruby-net-smtp/net-smtp), [`nokogiri`](https://github.com/go-ruby-nokogiri/nokogiri), [`oauth2`](https://github.com/go-ruby-oauth2/oauth2), [`observer`](https://github.com/go-ruby-observer/observer), [`oidc`](https://github.com/go-ruby-oidc/oidc), [`omniauth`](https://github.com/go-ruby-omniauth/omniauth), [`openbao`](https://github.com/go-ruby-openbao/openbao), [`openstack`](https://github.com/go-ruby-openstack/openstack), [`opentelemetry`](https://github.com/go-ruby-opentelemetry/opentelemetry), [`opentype`](https://github.com/go-ruby-opentype/opentype), [`optparse`](https://github.com/go-ruby-optparse/optparse), [`ostruct`](https://github.com/go-ruby-ostruct/ostruct), [`pagy`](https://github.com/go-ruby-pagy/pagy), [`paper-trail`](https://github.com/go-ruby-paper-trail/paper-trail), [`parquet`](https://github.com/go-ruby-parquet/parquet), [`parser`](https://github.com/go-ruby-parser/parser), [`pathname`](https://github.com/go-ruby-pathname/pathname), [`pg`](https://github.com/go-ruby-pg/pg), [`prawn`](https://github.com/go-ruby-prawn/prawn), [`prettyprint`](https://github.com/go-ruby-prettyprint/prettyprint), [`prime`](https://github.com/go-ruby-prime/prime), [`protobuf`](https://github.com/go-ruby-protobuf/protobuf), [`pstore`](https://github.com/go-ruby-pstore/pstore), [`public-suffix`](https://github.com/go-ruby-public-suffix/public-suffix), [`puma`](https://github.com/go-ruby-puma/puma), [`pundit`](https://github.com/go-ruby-pundit/pundit), [`puppet`](https://github.com/go-ruby-puppet/puppet), [`puppet-resource-api`](https://github.com/go-ruby-puppet-resource-api/puppet-resource-api), [`racc`](https://github.com/go-ruby-racc/racc), [`rack`](https://github.com/go-ruby-rack/rack), [`rails`](https://github.com/go-ruby-rails/rails), [`railties`](https://github.com/go-ruby-railties/railties), [`rake`](https://github.com/go-ruby-rake/rake), [`ransack`](https://github.com/go-ruby-ransack/ransack), [`rdoc`](https://github.com/go-ruby-rdoc/rdoc), [`redis`](https://github.com/go-ruby-redis/redis), [`regexp`](https://github.com/go-ruby-regexp/regexp), [`reline`](https://github.com/go-ruby-reline/reline), [`resolv`](https://github.com/go-ruby-resolv/resolv), [`resque`](https://github.com/go-ruby-resque/resque), [`rexml`](https://github.com/go-ruby-rexml/rexml), [`roda`](https://github.com/go-ruby-roda/roda), [`rolify`](https://github.com/go-ruby-rolify/rolify), [`rouge`](https://github.com/go-ruby-rouge/rouge), [`rqrcode`](https://github.com/go-ruby-rqrcode/rqrcode), [`rspec`](https://github.com/go-ruby-rspec/rspec), [`rss`](https://github.com/go-ruby-rss/rss), [`rubocop`](https://github.com/go-ruby-rubocop/rubocop), [`rubygems`](https://github.com/go-ruby-rubygems/rubygems), [`saml`](https://github.com/go-ruby-saml/saml), [`sass`](https://github.com/go-ruby-sass/sass), [`scanf`](https://github.com/go-ruby-scanf/scanf), [`securerandom`](https://github.com/go-ruby-securerandom/securerandom), [`semantic-puppet`](https://github.com/go-ruby-semantic-puppet/semantic-puppet), [`sequel`](https://github.com/go-ruby-sequel/sequel), [`set`](https://github.com/go-ruby-set/set), [`shellwords`](https://github.com/go-ruby-shellwords/shellwords), [`shrine`](https://github.com/go-ruby-shrine/shrine), [`sidekiq`](https://github.com/go-ruby-sidekiq/sidekiq), [`simplecov`](https://github.com/go-ruby-simplecov/simplecov), [`sinatra`](https://github.com/go-ruby-sinatra/sinatra), [`slim`](https://github.com/go-ruby-slim/slim), [`sodium`](https://github.com/go-ruby-sodium/sodium), [`sqlite3`](https://github.com/go-ruby-sqlite3/sqlite3), [`strscan`](https://github.com/go-ruby-strscan/strscan), [`thor`](https://github.com/go-ruby-thor/thor), [`timecop`](https://github.com/go-ruby-timecop/timecop), [`toml`](https://github.com/go-ruby-toml/toml), [`tsort`](https://github.com/go-ruby-tsort/tsort), [`typhoeus`](https://github.com/go-ruby-typhoeus/typhoeus), [`tzinfo`](https://github.com/go-ruby-tzinfo/tzinfo), [`unicode-normalize`](https://github.com/go-ruby-unicode-normalize/unicode-normalize), [`uri`](https://github.com/go-ruby-uri/uri), [`vcr`](https://github.com/go-ruby-vcr/vcr), [`warden`](https://github.com/go-ruby-warden/warden), [`webauthn`](https://github.com/go-ruby-webauthn/webauthn), [`webmock`](https://github.com/go-ruby-webmock/webmock), [`webrick`](https://github.com/go-ruby-webrick/webrick), [`widgets`](https://github.com/go-ruby-widgets/widgets), [`xslt`](https://github.com/go-ruby-xslt/xslt), [`yaml`](https://github.com/go-ruby-yaml/yaml), [`zeitwerk`](https://github.com/go-ruby-zeitwerk/zeitwerk), [`zlib`](https://github.com/go-ruby-zlib/zlib) — each at `github.com/go-ruby-/`. +[`aasm`](https://github.com/go-ruby-aasm/aasm), [`abbrev`](https://github.com/go-ruby-abbrev/abbrev), [`acme`](https://github.com/go-ruby-acme/acme), [`actioncable`](https://github.com/go-ruby-actioncable/actioncable), [`actionmailer`](https://github.com/go-ruby-actionmailer/actionmailer), [`actionpack`](https://github.com/go-ruby-actionpack/actionpack), [`actionview`](https://github.com/go-ruby-actionview/actionview), [`activejob`](https://github.com/go-ruby-activejob/activejob), [`activemodel`](https://github.com/go-ruby-activemodel/activemodel), [`activerecord`](https://github.com/go-ruby-activerecord/activerecord), [`activestorage`](https://github.com/go-ruby-activestorage/activestorage), [`activesupport`](https://github.com/go-ruby-activesupport/activesupport), [`addressable`](https://github.com/go-ruby-addressable/addressable), [`age`](https://github.com/go-ruby-age/age), [`arrow`](https://github.com/go-ruby-arrow/arrow), [`async`](https://github.com/go-ruby-async/async), [`augeas`](https://github.com/go-ruby-augeas/augeas), [`base64`](https://github.com/go-ruby-base64/base64), [`bbolt`](https://github.com/go-ruby-bbolt/bbolt), [`bcrypt`](https://github.com/go-ruby-bcrypt/bcrypt), [`benchmark`](https://github.com/go-ruby-benchmark/benchmark), [`bigdecimal`](https://github.com/go-ruby-bigdecimal/bigdecimal), [`bleve`](https://github.com/go-ruby-bleve/bleve), [`builder`](https://github.com/go-ruby-builder/builder), [`bundler`](https://github.com/go-ruby-bundler/bundler), [`cancancan`](https://github.com/go-ruby-cancancan/cancancan), [`capistrano`](https://github.com/go-ruby-capistrano/capistrano), [`capybara`](https://github.com/go-ruby-capybara/capybara), [`cgi`](https://github.com/go-ruby-cgi/cgi), [`chronic`](https://github.com/go-ruby-chronic/chronic), [`cmath`](https://github.com/go-ruby-cmath/cmath), [`commonmark`](https://github.com/go-commonmark/commonmark), [`concurrent-ruby`](https://github.com/go-ruby-concurrent-ruby/concurrent-ruby), [`confd`](https://github.com/go-ruby-confd/confd), [`connection-pool`](https://github.com/go-ruby-connection-pool/connection-pool), [`csv`](https://github.com/go-ruby-csv/csv), [`date`](https://github.com/go-ruby-date/date), [`deep-merge`](https://github.com/go-ruby-deep-merge/deep-merge), [`devise`](https://github.com/go-ruby-devise/devise), [`did-you-mean`](https://github.com/go-ruby-did-you-mean/did-you-mean), [`digest`](https://github.com/go-ruby-digest/digest), [`dotenv`](https://github.com/go-ruby-dotenv/dotenv), [`dry-struct`](https://github.com/go-ruby-dry-struct/dry-struct), [`dry-types`](https://github.com/go-ruby-dry-types/dry-types), [`dry-validation`](https://github.com/go-ruby-dry-validation/dry-validation), [`erb`](https://github.com/go-ruby-erb/erb), [`erubi`](https://github.com/go-ruby-erubi/erubi), [`etcd`](https://github.com/go-ruby-etcd/etcd), [`excon`](https://github.com/go-ruby-excon/excon), [`facter`](https://github.com/go-ruby-facter/facter), [`factory-bot`](https://github.com/go-ruby-factory-bot/factory-bot), [`faker`](https://github.com/go-ruby-faker/faker), [`faraday`](https://github.com/go-ruby-faraday/faraday), [`fast-gettext`](https://github.com/go-ruby-fast-gettext/fast-gettext), [`find`](https://github.com/go-ruby-find/find), [`format`](https://github.com/go-ruby-format/format), [`friendly-id`](https://github.com/go-ruby-friendly-id/friendly-id), [`getoptlong`](https://github.com/go-ruby-getoptlong/getoptlong), [`grape`](https://github.com/go-ruby-grape/grape), [`graphql`](https://github.com/go-ruby-graphql/graphql), [`grpc`](https://github.com/go-ruby-grpc/grpc), [`haml`](https://github.com/go-ruby-haml/haml), [`hanami`](https://github.com/go-ruby-hanami/hanami), [`hcl2`](https://github.com/go-ruby-hcl2/hcl2), [`hiera`](https://github.com/go-ruby-hiera/hiera), [`hocon`](https://github.com/go-ruby-hocon/hocon), [`http`](https://github.com/go-ruby-http/http), [`httparty`](https://github.com/go-ruby-httparty/httparty), [`i18n`](https://github.com/go-ruby-i18n/i18n), [`images`](https://github.com/go-ruby-images/images), [`ipaddr`](https://github.com/go-ruby-ipaddr/ipaddr), [`irb`](https://github.com/go-ruby-irb/irb), [`jbuilder`](https://github.com/go-ruby-jbuilder/jbuilder), [`jekyll`](https://github.com/go-ruby-jekyll/jekyll), [`json`](https://github.com/go-ruby-json/json), [`jwt`](https://github.com/go-ruby-jwt/jwt), [`kafka`](https://github.com/go-ruby-kafka/kafka), [`kaminari`](https://github.com/go-ruby-kaminari/kaminari), [`kramdown`](https://github.com/go-kramdown/kramdown), [`liquid`](https://github.com/go-liquid/liquid), [`logger`](https://github.com/go-ruby-logger/logger), [`mail`](https://github.com/go-ruby-mail/mail), [`marshal`](https://github.com/go-ruby-marshal/marshal), [`matrix`](https://github.com/go-ruby-matrix/matrix), [`mime-types`](https://github.com/go-ruby-mime-types/mime-types), [`minitest`](https://github.com/go-ruby-minitest/minitest), [`money`](https://github.com/go-ruby-money/money), [`mongodb`](https://github.com/go-ruby-mongodb/mongodb), [`msgpack`](https://github.com/go-ruby-msgpack/msgpack), [`multi-json`](https://github.com/go-ruby-multi-json/multi-json), [`mustache`](https://github.com/go-mustache/mustache), [`mysql`](https://github.com/go-ruby-mysql/mysql), [`nats`](https://github.com/go-ruby-nats/nats), [`net-ftp`](https://github.com/go-ruby-net-ftp/net-ftp), [`net-http`](https://github.com/go-ruby-net-http/net-http), [`net-imap`](https://github.com/go-ruby-net-imap/net-imap), [`net-pop`](https://github.com/go-ruby-net-pop/net-pop), [`net-sftp`](https://github.com/go-ruby-net-sftp/net-sftp), [`net-smtp`](https://github.com/go-ruby-net-smtp/net-smtp), [`nokogiri`](https://github.com/go-nokogiri/nokogiri), [`oauth2`](https://github.com/go-ruby-oauth2/oauth2), [`observer`](https://github.com/go-ruby-observer/observer), [`oidc`](https://github.com/go-ruby-oidc/oidc), [`omniauth`](https://github.com/go-ruby-omniauth/omniauth), [`openbao`](https://github.com/go-ruby-openbao/openbao), [`openstack`](https://github.com/go-ruby-openstack/openstack), [`opentelemetry`](https://github.com/go-ruby-opentelemetry/opentelemetry), [`opentype`](https://github.com/go-ruby-opentype/opentype), [`optparse`](https://github.com/go-ruby-optparse/optparse), [`ostruct`](https://github.com/go-ruby-ostruct/ostruct), [`pagy`](https://github.com/go-ruby-pagy/pagy), [`paper-trail`](https://github.com/go-ruby-paper-trail/paper-trail), [`parquet`](https://github.com/go-ruby-parquet/parquet), [`parser`](https://github.com/go-ruby-parser/parser), [`pathname`](https://github.com/go-ruby-pathname/pathname), [`pg`](https://github.com/go-ruby-pg/pg), [`prawn`](https://github.com/go-ruby-prawn/prawn), [`prettyprint`](https://github.com/go-ruby-prettyprint/prettyprint), [`prime`](https://github.com/go-ruby-prime/prime), [`protobuf`](https://github.com/go-ruby-protobuf/protobuf), [`pstore`](https://github.com/go-ruby-pstore/pstore), [`public-suffix`](https://github.com/go-ruby-public-suffix/public-suffix), [`puma`](https://github.com/go-ruby-puma/puma), [`pundit`](https://github.com/go-ruby-pundit/pundit), [`puppet`](https://github.com/go-ruby-puppet/puppet), [`puppet-resource-api`](https://github.com/go-ruby-puppet-resource-api/puppet-resource-api), [`racc`](https://github.com/go-ruby-racc/racc), [`rack`](https://github.com/go-ruby-rack/rack), [`rails`](https://github.com/go-ruby-rails/rails), [`railties`](https://github.com/go-ruby-railties/railties), [`rake`](https://github.com/go-ruby-rake/rake), [`ransack`](https://github.com/go-ruby-ransack/ransack), [`rdoc`](https://github.com/go-ruby-rdoc/rdoc), [`redis`](https://github.com/go-ruby-redis/redis), [`regexp`](https://github.com/go-ruby-regexp/regexp), [`reline`](https://github.com/go-ruby-reline/reline), [`resolv`](https://github.com/go-ruby-resolv/resolv), [`resque`](https://github.com/go-ruby-resque/resque), [`rexml`](https://github.com/go-ruby-rexml/rexml), [`roda`](https://github.com/go-ruby-roda/roda), [`rolify`](https://github.com/go-ruby-rolify/rolify), [`rouge`](https://github.com/go-rouge/rouge), [`rqrcode`](https://github.com/go-ruby-rqrcode/rqrcode), [`rspec`](https://github.com/go-ruby-rspec/rspec), [`rss`](https://github.com/go-ruby-rss/rss), [`rubocop`](https://github.com/go-ruby-rubocop/rubocop), [`rubygems`](https://github.com/go-ruby-rubygems/rubygems), [`saml`](https://github.com/go-ruby-saml/saml), [`sass`](https://github.com/go-ruby-sass/sass), [`scanf`](https://github.com/go-ruby-scanf/scanf), [`securerandom`](https://github.com/go-ruby-securerandom/securerandom), [`semantic-puppet`](https://github.com/go-ruby-semantic-puppet/semantic-puppet), [`sequel`](https://github.com/go-ruby-sequel/sequel), [`shellwords`](https://github.com/go-ruby-shellwords/shellwords), [`shrine`](https://github.com/go-ruby-shrine/shrine), [`sidekiq`](https://github.com/go-ruby-sidekiq/sidekiq), [`simplecov`](https://github.com/go-ruby-simplecov/simplecov), [`sinatra`](https://github.com/go-ruby-sinatra/sinatra), [`slim`](https://github.com/go-ruby-slim/slim), [`sodium`](https://github.com/go-ruby-sodium/sodium), [`sqlite3`](https://github.com/go-ruby-sqlite3/sqlite3), [`strscan`](https://github.com/go-ruby-strscan/strscan), [`thor`](https://github.com/go-ruby-thor/thor), [`timecop`](https://github.com/go-ruby-timecop/timecop), [`toml`](https://github.com/go-ruby-toml/toml), [`tsort`](https://github.com/go-ruby-tsort/tsort), [`typhoeus`](https://github.com/go-ruby-typhoeus/typhoeus), [`tzinfo`](https://github.com/go-ruby-tzinfo/tzinfo), [`unicode-normalize`](https://github.com/go-ruby-unicode-normalize/unicode-normalize), [`uri`](https://github.com/go-ruby-uri/uri), [`vcr`](https://github.com/go-ruby-vcr/vcr), [`warden`](https://github.com/go-ruby-warden/warden), [`webauthn`](https://github.com/go-ruby-webauthn/webauthn), [`webmock`](https://github.com/go-ruby-webmock/webmock), [`webrick`](https://github.com/go-ruby-webrick/webrick), [`widgets`](https://github.com/go-ruby-widgets/widgets), [`xslt`](https://github.com/go-xslt/xslt), [`yaml`](https://github.com/go-ruby-yaml/yaml), [`zeitwerk`](https://github.com/go-ruby-zeitwerk/zeitwerk), [`zlib`](https://github.com/go-ruby-zlib/zlib), [`activeldap`](https://github.com/go-ruby-activeldap/activeldap), [`ldap`](https://github.com/go-ruby-ldap/ldap), [`fast-gettext-locale`](https://github.com/go-ruby-fast-gettext-locale/fast-gettext-locale) — each at `github.com/go-ruby-/`, except `commonmark`, `kramdown`, `liquid`, `mustache`, `nokogiri`, `rouge` and `xslt`, which are bound from `github.com/go-/`. (`set` is **not** bound: `Set` is implemented in-tree, over rbgo's own `object.Hash`.) The scientific / container stack ([go-ndarray](https://github.com/go-ndarray/ndarray), [go-fft](https://github.com/go-fft/fft), [go-images](https://github.com/go-images/images), diff --git a/docs/phases/phase0.md b/docs/phases/phase0.md index 71ed7e4..2f3760f 100644 --- a/docs/phases/phase0.md +++ b/docs/phases/phase0.md @@ -54,7 +54,10 @@ puts fib(20) # => 6765 - `puts 1 + 2` prints `3` end to end. - `fib(20)` evaluates to `6765` end to end. -- **~92% test coverage**, with the `object` package at **100%**. +- **~92% test coverage**, with the `object` package at **100%** — the bar + *at the time this phase closed*. The interpreter has since been held to a + **100% gate** on the POSIX CI lanes; see + [Conformance](../conformance.md#what-ci-enforces). - Behaviour is **differential-tested against MRI**: the same programs are run on reference Ruby and the outputs compared. @@ -65,7 +68,7 @@ Phase 0 and arrive in later [phases](../roadmap.md): - **No receiver method calls yet** — only top-level/`self` calls and the built-ins above (the object model and dispatch are Phase 1). -- **No blocks** (Phase 3). +- **No blocks** (Phase 1). - **No bignum promotion** — in the Phase 0 slice integers are plain `int64` and do not promote on overflow. (Automatic **Bignum** promotion and arbitrary-precision literals have since landed — see the diff --git a/docs/roadmap.md b/docs/roadmap.md index 2706864..16eb233 100644 --- a/docs/roadmap.md +++ b/docs/roadmap.md @@ -8,12 +8,12 @@ building whole subsystems in isolation. There are nine phases, 0 through 8. | --- | --- | --- | --- | | 0 | Vertical slice | Integers, floats, strings, locals, arithmetic, control flow, `def`/recursion, `puts`/`p` — a thin slice running end to end on the VM. | **Done** | | 1 | Object model & dispatch | `RObject`/`RClass`, per-class method tables, ancestor-chain lookup, `method_missing`, classes + inheritance, `@ivars`, `new`/`initialize`, constants, **modules + `include`**, **`super`**, **blocks & `yield`** (closures, `block_given?`, `Integer#times`), and — landed since — `Proc`/`lambda` and `do…end`. | **Done** | -| 2 | Core types & mixins | Symbols (incl. variable-name `:name`), Array, ordered Hash, Range (incl. **beginless/endless**), and `Comparable`/`Enumerable` written once in an embedded-Ruby prelude over `<=>`/`each` (Comparable into Integer/Float/String, Enumerable into Array/Range/Hash). The **full argument system** — required/optional/`*splat`/keyword (`a:`, `b: 2`)/`**rest`/`&block`, plus splat call-args. **Blocks/Procs/lambdas**: `&block` capture, `proc`/`lambda`, the **stabby lambda `->(){}`**, `&proc` block-pass and `Symbol#to_proc` (`&:sym`). **Object model**: **class methods `def self.foo`**, **`attr_accessor`/`reader`/`writer`**, **`Struct.new`**, setter defs `def name=`, **constant assignment** and **attribute assignment**, **endless methods `def foo = expr`**. Plus `&&`/`\|\|`, ternary, `case`/`when`, `**`, string interpolation, `%`/`format`/`sprintf`, a broad String method set, Integer/Float numeric methods, block auto-splat, `{name: value}` label hashes, `break`/`next`, compound assignment, and top-level ivars. | **In progress** | +| 2 | Core types & mixins | Symbols (incl. variable-name `:name`), Array, ordered Hash, Range (incl. **beginless/endless**), and `Comparable`/`Enumerable` written once in an embedded-Ruby prelude over `<=>`/`each` (Comparable into Integer/Float/String, Enumerable into Array/Range/Hash). The **full argument system** — required/optional/`*splat`/keyword (`a:`, `b: 2`)/`**rest`/`&block`, plus splat call-args. **Blocks/Procs/lambdas**: `&block` capture, `proc`/`lambda`, the **stabby lambda `->(){}`**, `&proc` block-pass and `Symbol#to_proc` (`&:sym`). **Object model**: **class methods `def self.foo`**, **`attr_accessor`/`reader`/`writer`**, **`Struct.new`**, setter defs `def name=`, **constant assignment** and **attribute assignment**, **endless methods `def foo = expr`**. Plus `&&`/`\|\|`, ternary, `case`/`when`, `**`, string interpolation, `%`/`format`/`sprintf`, a broad String method set, Integer/Float numeric methods, block auto-splat, `{name: value}` label hashes, `break`/`next`, compound assignment, and top-level ivars. | **Done** (core) | | 3 | Control flow, exceptions & Fiber | Real exception objects and status-return propagation; Fiber-on-goroutine. **Exception hierarchy, `is_a?`/`kind_of?`/`instance_of?`, `raise`, `begin`/`rescue`/`ensure`/`else`/`retry` (block- and method-level), non-local `break`/`next`, `Kernel#loop`, and the eager `Enumerator` done** — every blockless iterator returns one, with `next`/`peek`/`rewind`/`with_index`/`to_a` and full `Enumerable` chaining, **plus `Enumerator::Lazy`** — `lazy` over arrays, ranges (incl. endless / `Float::INFINITY`-bounded) and enumerators, with deferred map/select/reject/filter_map/take_while/drop_while/take/drop and first/to_a/force terminals, **and `Fiber`** — cooperative coroutines on goroutines (`Fiber.new`/`resume`/`Fiber.yield`/`alive?`, values both ways, `FiberError`). | **Done** | | 4 | Metaprogramming | `define_method`, `send`, singleton classes, reflection, monkey-patching surfaced as API. **Done so far:** `define_method`, `instance_eval`/`instance_exec`, `class_eval`/`module_eval`/`class_exec`, `send`/`public_send`, `respond_to?`, `instance_variable_get`/`set`/`defined?`, `itself`/`tap`/`then`/`yield_self`, the `Integer`/`Float`/`String`/`Array` conversion methods, the hooks `included`/`inherited`/`method_added`/`extended`, `define_singleton_method`/`extend` and **`def obj.foo` / `def Const.foo` singleton-method syntax**, **`@@class variables`**, **`$global variables`**, string `eval`, **`Binding`** (`binding`, `Binding#eval`, `eval(str, binding)`, `local_variable_get`/`set`/`defined?`, `local_variables`, `receiver` — eval against a captured frame's locals), and **`prepend`** — with an ancestor-chain `super` that walks included/prepended modules and the singleton chain (`Module#ancestors`/`include?`, `Kernel` modelled). | **Done** | -| 5 | Full front-end | Complete the lexer/parser/compiler to full Ruby 4.0 syntax (or settle the Prism-on-wazero decision). **Landed:** string interpolation, keyword args, endless methods (`def foo = expr`), beginless/endless ranges, the stabby lambda, **multiple assignment / destructuring**, **full pattern matching `case`/`in`** (value/bind/class/array/hash/find/pin/alternative patterns, guards, one-line `=>`/`in`, `deconstruct`/`deconstruct_keys`), **safe navigation `&.`**, **numbered params (`_1`/`_2`) and `it`**, **heredocs** (`<<`/`<<-`/`<<~`, interpolating and literal), **`%w`/`%i` arrays**, and the **`%q`/`%Q`/`%W`/`%I` literals**. | **In progress** | -| 6 | Standard library | Pure-Go stdlib coverage, with the regexp engine from the `go-ruby-regexp` sibling org. **Regexp bridge landed:** `/re/imx` literals + `Regexp`/`MatchData` (`source`/`match`/`match?`/`=~`/`===`, `[]` by index or name, `pre_match`/`post_match`/`captures`/`named_captures`/`begin`/`end`/`size`), `String#=~`/`match`/`match?`/`scan`, and `sub`/`gsub`/`split` over a Regexp (backref templates, blocks, captured-group interpolation, field limit). CGO=0 via `go-ruby-regexp`; differential-tested against MRI. **Also landed:** `Time`/`Date`/`BigDecimal`, `Set`/`Bag`, and the Go-native leaves `JSON` (generate/parse/pretty_generate + `to_json`), `Digest` (MD5/SHA1/SHA256/SHA512), `Base64`, **`File`** (path helpers + read/write/stat/delete, `Errno::ENOENT`), a **MRI-faithful `Random`** (seeded MT19937, bit-exact), **`Zlib`** (crc32/adler32 + Deflate/Inflate), a **byte-exact `Marshal`** (`dump`/`load`, on the pure-Go `go-ruby-marshal` engine), **`Thread`/`Mutex`/`Queue`** on an emulated GVL (one Ruby thread at a time, MRI memory model, race-free), **`IO`/`StringIO`** (`$stdout`/`$stderr`/`$stdin` as real objects; `puts`/`print`/`p` route through `$stdout` so reassigning it to a `StringIO` captures output) and **`Dir`** (entries/children/glob, mkdir/rmdir/chdir, `Errno::ENOENT`/`Errno::EEXIST`), and **`File.open` streams** (`File < IO`, modes `r`/`w`/`a`/`+`, block form auto-flush/close, `File.readlines`/`foreach`). | **In progress** | +| 5 | Full front-end | Complete the lexer/parser/compiler to full Ruby 4.0 syntax (or settle the Prism-on-wazero decision). **Landed:** string interpolation, keyword args, endless methods (`def foo = expr`), beginless/endless ranges, the stabby lambda, **multiple assignment / destructuring**, **full pattern matching `case`/`in`** (value/bind/class/array/hash/find/pin/alternative patterns, guards, one-line `=>`/`in`, `deconstruct`/`deconstruct_keys`), **safe navigation `&.`**, **numbered params (`_1`/`_2`) and `it`**, **heredocs** (`<<`/`<<-`/`<<~`, interpolating and literal), **`%w`/`%i` arrays**, and the **`%q`/`%Q`/`%W`/`%I` literals**. | **Done** (core) | +| 6 | Standard library | Pure-Go stdlib coverage, with the regexp engine from the `go-ruby-regexp` sibling org. **Regexp bridge landed:** `/re/imx` literals + `Regexp`/`MatchData` (`source`/`match`/`match?`/`=~`/`===`, `[]` by index or name, `pre_match`/`post_match`/`captures`/`named_captures`/`begin`/`end`/`size`), `String#=~`/`match`/`match?`/`scan`, and `sub`/`gsub`/`split` over a Regexp (backref templates, blocks, captured-group interpolation, field limit). CGO=0 via `go-ruby-regexp`; differential-tested against MRI. **Also landed:** `Time`/`Date`/`BigDecimal`, `Set`/`Bag`, and the Go-native leaves `JSON` (generate/parse/pretty_generate + `to_json`), `Digest` (MD5/SHA1/SHA256/SHA512), `Base64`, **`File`** (path helpers + read/write/stat/delete, `Errno::ENOENT`), a **MRI-faithful `Random`** (seeded MT19937, bit-exact), **`Zlib`** (crc32/adler32 + Deflate/Inflate), a **byte-exact `Marshal`** (`dump`/`load`, on the pure-Go `go-ruby-marshal` engine), **`Thread`/`Mutex`/`Queue`** on an emulated GVL (one Ruby thread at a time, MRI memory model, race-free), **`IO`/`StringIO`** (`$stdout`/`$stderr`/`$stdin` as real objects; `puts`/`print`/`p` route through `$stdout` so reassigning it to a `StringIO` captures output) and **`Dir`** (entries/children/glob, mkdir/rmdir/chdir, `Errno::ENOENT`/`Errno::EEXIST`), and **`File.open` streams** (`File < IO`, modes `r`/`w`/`a`/`+`, block form auto-flush/close, `File.readlines`/`foreach`). | **Substantially landed** | | 7 | Build toolchain | `rbgo build`. **Landed:** ahead-of-time **method compilation** to native Go (bytecode → Go → machine code), with **unboxed `int64` integer kernels** that deopt to the interpreter on overflow/`÷0` — the generated `fib(30)` beats **MRI + YJIT ~4×** while staying correct for every input ([AOT compiler](architecture/build.md#ahead-of-time-method-compilation-landed)). **Closed-world builds landed** (`rbgo build --closed`): the program is baked in as bytecode (and the prelude loads from frozen bytecode), the **lexer/parser/compiler are dropped** behind the `rbgo_closed` build tag, and a require-graph scan reports any `eval`/`require` that would then raise — yielding a smaller, self-contained binary that runs with no source file. (Per-class stdlib tree-shaking beyond the front-end was measured and skipped — the Go-implemented bindings are small pure-Go libraries, under 2% of a runtime-dominated binary; the front-end drop is the real saving.) | **Done** | -| 8 | Conformance & performance | ruby/spec conformance and representation/perf work (tagging, fast paths, allocation). **Started:** allocation cuts — **small-integer interning** (`object.IntValue` reuses a shared box for ints in [-256, 1024]; a small-int loop drops from ~245k allocs to 1) and **frame-environment recycling** (`exec` pools per-call `*Env`s via a capture-tracked free-list — fib's call allocations halve, ~14% faster). **Conformance & benchmark ladder:** a three-way differential oracle (rbgo / **MRI** / **JRuby**, `scripts/oracle.sh`), then pure-Ruby gem test suites as corpora (ActiveSupport `core_ext`), then real-world workloads. A heavyweight front-end sweep now accepts **~100% of all valid Ruby** across Rails + Puppet (**parse + compile** Rails 99.82% / Puppet 100%, 0 over-permissive), and on the runtime side **the real `puppet apply` CLI runs end-to-end** (Puppet 8.11.0): `require "puppet"` boots the framework and the genuine `Puppet::Util::CommandLine` → `Puppet::Application::Apply` path (real `OptionParser`, all types + providers, settings catalog applied to disk, then the user catalog via the transaction / RAL) applies a `notify` resource and emits real Puppet output (`Notice: hi from rbgo cli`), exiting 0. **Active next milestone:** real file/package/service resource *providers* (host convergence) + run-report persistence. | **In progress** | +| 8 | Conformance & performance | ruby/spec conformance and representation/perf work (tagging, fast paths, allocation). **Started:** allocation cuts — **small-integer interning** (`object.IntValue` reuses a shared box for ints in [-256, 1024]; a small-int loop drops from ~245k allocs to 1) and **frame-environment recycling** (`exec` pools per-call `*Env`s via a capture-tracked free-list — fib's call allocations halve, ~14% faster). **Conformance & benchmark ladder:** a three-way differential oracle (rbgo / **MRI** / **JRuby**, `scripts/oracle.sh`), then pure-Ruby gem test suites as corpora (ActiveSupport `core_ext`), then real-world workloads. A heavyweight front-end sweep now accepts **~100% of all valid Ruby** across Rails + Puppet (**parse + compile** Rails 99.82% / Puppet 100%, 0 over-permissive), and on the runtime side **the real `puppet apply` CLI runs end-to-end** (Puppet 8.11.0): `require "puppet"` boots the framework and the genuine `Puppet::Util::CommandLine` → `Puppet::Application::Apply` path (real `OptionParser`, all types + providers, settings catalog applied to disk, then the user catalog via the transaction / RAL) applies a `notify` resource and emits real Puppet output (`Notice: hi from rbgo cli`), exiting 0. **Runtime conformance, since July:** the ruby/spec `language/` + `core/` suites run in CI as a shrink-only ratchet; across 26 waves the floor has gone from **6 000** (2026-08-03) to **21 740**, and a run on `main` measures **21 901** passing examples (2026-09-23) — see [Conformance](conformance.md#where-it-stands-measured-2026-09-23). **Active next milestone:** real file/package/service resource *providers* (host convergence) + run-report persistence. | **In progress** | See [Phase 0 — Vertical slice](phases/phase0.md) for what runs today. From 8cf49901eb56f5fd32ff61dc648c283c8c645b61 Mon Sep 17 00:00:00 2001 From: tannevaled Date: Wed, 23 Sep 2026 19:25:42 +0200 Subject: [PATCH 2/3] =?UTF-8?q?conformance:=20re-measure=20against=20d498d?= =?UTF-8?q?dc=20=E2=80=94=20#629=20merged=20after=20the=20first=20baseline?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit #629 (FileTest, the Errno subsystem, realpath_rec, the stat surface) merged at 17:10Z, after the 68cb53a baseline this branch was written against, which left two limitation rows wrong in the conservative direction. Re-measured on d498ddc, darwin/arm64, pinned corpus. Four consecutive ratchet runs: 21982, all four identical. Detail sweep: 21983 pass, 1321 fail, 740 error, 473 skip, 2191 of 2206 files, 91.4% of the 24044 examples that ran. The floor on main is still 21740; #638 is open to take it to 21970. The page now says which floor it means and names #638 rather than carrying a number that goes stale when that PR merges. Errno: was "28 constants, not MRI's 158". Measured, Errno.constants is 158 under both rbgo and MRI 4.0.5. Dumping every name/value pair from both and joining: all 158 names in both, 32 disagree, all in one direction -- rbgo reports 0 where MRI on darwin has a real number -- and the other 126 match exactly. That is what #633 is, and 32 is the number that matters: MRI itself reads 0 for 49 of them. FileTest: was "11 of MRI's 26 predicates". Measured, it is 26 under both, name for name. Differentially tested all 26 against MRI over a temp tree: 252 assertions, 0 disagreements. The row is gone rather than restated. The #615 paragraph now says spread is possible but did not fire in these four runs, instead of describing a 58-example range that no longer appears. Co-Authored-By: Claude Opus 5 --- docs/conformance.md | 41 ++++++++++++++++++++++++----------------- docs/roadmap.md | 2 +- 2 files changed, 25 insertions(+), 18 deletions(-) diff --git a/docs/conformance.md b/docs/conformance.md index 1e9c777..c40b5ee 100644 --- a/docs/conformance.md +++ b/docs/conformance.md @@ -109,32 +109,40 @@ workflow enforces it on every push and pull request. ### Where it stands — measured 2026-09-23 -On `main` (68cb53a), darwin/arm64, against the pinned corpus +On `main` (`d498ddc`), darwin/arm64, against the pinned corpus (`SPEC_SHA=87b1631992bd00cf0c4934474766d54dad088191`): | | | | --- | --- | -| **passing examples** | **21 901** — four consecutive runs: 21 845 · 21 903 · 21 901 · 21 902 | -| fail / error | 1 349 / 794 | +| **passing examples** | **21 982** — four consecutive runs, all four identical | +| fail / error | 1 321 / 740 | | skipped | 473 | -| pass rate of the examples that ran | **91.1 %** (21 901 of 24 044) | +| pass rate of the examples that ran | **91.4 %** (21 983 of 24 044) | | spec files | 2 191 of 2 206 produce a result; 15 produce none | -| **`FLOOR`** | **21 740** | +| **`FLOOR`** | **21 740** on `main` as of this writing | + +The ratchet reports 21 982; a separate sweep that also captures +`fail`/`error`/`skip` read 21 983. The one-example difference is the `#615` noise +described below. !!! warning "The floor is a gate, not a score" `FLOOR` says *"no run may come in below this"*. It is raised deliberately, in its own PR, after a wave lands — so the measured total normally sits **above** - it. Today the gap is ~160 examples. Quoting the floor as the conformance - figure understates rbgo; quoting the measured total as a guarantee overstates - it. The floor is what CI enforces; the measured total is what rbgo does. - -The 58-example spread across those four runs is **one file**. -`core/module/autoload_spec.rb` crashes on roughly one run in four while popping a + it. Today the gap is ~240 examples, and + [#638](https://github.com/go-embedded-ruby/ruby/pull/638) is open to raise the + floor to 21 970. Quoting the floor as the conformance figure understates rbgo; + quoting the measured total as a guarantee overstates it. The floor is what CI + enforces; the measured total is what rbgo does. + +Run-to-run spread is possible, and it is a **known bug rather than noise in the +method**. `core/module/autoload_spec.rb` crashes intermittently while popping a frame ([#615](https://github.com/go-embedded-ruby/ruby/issues/615)), and the whole -file's examples are lost when it does. Read the **low** run as the guaranteed -figure. +file's examples are lost when it does — an earlier set of four runs, on the commit +before this one, spread 21 845–21 903 for exactly that reason. The four runs above +happened not to hit it. Run it more than once and read the **low** run as the +guaranteed figure. -There is no honest denominator for "percent of Ruby". The 91.1 % above is the +There is no honest denominator for "percent of Ruby". The 91.4 % above is the share of the examples *this shim actually ran*: the shim is not mspec, 473 skips sit outside the ratio entirely, and 15 files produce no result at all. @@ -161,7 +169,7 @@ Both are gains in what the measurement can **see**, not in what the VM can **do**. The rest of the climb is the VM: the floor went from **6 000** when the ratchet landed on 2026-08-03 ([#263](https://github.com/go-embedded-ruby/ruby/pull/263)) to **21 740** today, -across 26 conformance waves. +across 27 conformance waves. ### Known limitations @@ -177,8 +185,7 @@ Object.const_source_location(:Comparable) # rbgo: nil MRI 4.0.5: [] | | | | --- | --- | -| `Errno` has **28** constants, not MRI's 158 | [#633](https://github.com/go-embedded-ruby/ruby/issues/633) | -| `FileTest` carries **11** of MRI's 26 predicates | — | +| `Errno` carries all **158** of MRI's constants, but **32** of them report errno `0` on darwin where MRI has a real number (`EAUTH` 0 vs 80, `EBADRPC` 0 vs 72, …); the other 126 match exactly | [#633](https://github.com/go-embedded-ruby/ruby/issues/633) | | `Thread#backtrace` answers for the **current** thread only; another thread raises `NotImplementedError` | — | | `Process.fork` **does not exist** — Go's runtime cannot be forked safely | — | | `Numeric#to_int` is not defined | [#631](https://github.com/go-embedded-ruby/ruby/issues/631) | diff --git a/docs/roadmap.md b/docs/roadmap.md index 16eb233..59f1ccb 100644 --- a/docs/roadmap.md +++ b/docs/roadmap.md @@ -14,6 +14,6 @@ building whole subsystems in isolation. There are nine phases, 0 through 8. | 5 | Full front-end | Complete the lexer/parser/compiler to full Ruby 4.0 syntax (or settle the Prism-on-wazero decision). **Landed:** string interpolation, keyword args, endless methods (`def foo = expr`), beginless/endless ranges, the stabby lambda, **multiple assignment / destructuring**, **full pattern matching `case`/`in`** (value/bind/class/array/hash/find/pin/alternative patterns, guards, one-line `=>`/`in`, `deconstruct`/`deconstruct_keys`), **safe navigation `&.`**, **numbered params (`_1`/`_2`) and `it`**, **heredocs** (`<<`/`<<-`/`<<~`, interpolating and literal), **`%w`/`%i` arrays**, and the **`%q`/`%Q`/`%W`/`%I` literals**. | **Done** (core) | | 6 | Standard library | Pure-Go stdlib coverage, with the regexp engine from the `go-ruby-regexp` sibling org. **Regexp bridge landed:** `/re/imx` literals + `Regexp`/`MatchData` (`source`/`match`/`match?`/`=~`/`===`, `[]` by index or name, `pre_match`/`post_match`/`captures`/`named_captures`/`begin`/`end`/`size`), `String#=~`/`match`/`match?`/`scan`, and `sub`/`gsub`/`split` over a Regexp (backref templates, blocks, captured-group interpolation, field limit). CGO=0 via `go-ruby-regexp`; differential-tested against MRI. **Also landed:** `Time`/`Date`/`BigDecimal`, `Set`/`Bag`, and the Go-native leaves `JSON` (generate/parse/pretty_generate + `to_json`), `Digest` (MD5/SHA1/SHA256/SHA512), `Base64`, **`File`** (path helpers + read/write/stat/delete, `Errno::ENOENT`), a **MRI-faithful `Random`** (seeded MT19937, bit-exact), **`Zlib`** (crc32/adler32 + Deflate/Inflate), a **byte-exact `Marshal`** (`dump`/`load`, on the pure-Go `go-ruby-marshal` engine), **`Thread`/`Mutex`/`Queue`** on an emulated GVL (one Ruby thread at a time, MRI memory model, race-free), **`IO`/`StringIO`** (`$stdout`/`$stderr`/`$stdin` as real objects; `puts`/`print`/`p` route through `$stdout` so reassigning it to a `StringIO` captures output) and **`Dir`** (entries/children/glob, mkdir/rmdir/chdir, `Errno::ENOENT`/`Errno::EEXIST`), and **`File.open` streams** (`File < IO`, modes `r`/`w`/`a`/`+`, block form auto-flush/close, `File.readlines`/`foreach`). | **Substantially landed** | | 7 | Build toolchain | `rbgo build`. **Landed:** ahead-of-time **method compilation** to native Go (bytecode → Go → machine code), with **unboxed `int64` integer kernels** that deopt to the interpreter on overflow/`÷0` — the generated `fib(30)` beats **MRI + YJIT ~4×** while staying correct for every input ([AOT compiler](architecture/build.md#ahead-of-time-method-compilation-landed)). **Closed-world builds landed** (`rbgo build --closed`): the program is baked in as bytecode (and the prelude loads from frozen bytecode), the **lexer/parser/compiler are dropped** behind the `rbgo_closed` build tag, and a require-graph scan reports any `eval`/`require` that would then raise — yielding a smaller, self-contained binary that runs with no source file. (Per-class stdlib tree-shaking beyond the front-end was measured and skipped — the Go-implemented bindings are small pure-Go libraries, under 2% of a runtime-dominated binary; the front-end drop is the real saving.) | **Done** | -| 8 | Conformance & performance | ruby/spec conformance and representation/perf work (tagging, fast paths, allocation). **Started:** allocation cuts — **small-integer interning** (`object.IntValue` reuses a shared box for ints in [-256, 1024]; a small-int loop drops from ~245k allocs to 1) and **frame-environment recycling** (`exec` pools per-call `*Env`s via a capture-tracked free-list — fib's call allocations halve, ~14% faster). **Conformance & benchmark ladder:** a three-way differential oracle (rbgo / **MRI** / **JRuby**, `scripts/oracle.sh`), then pure-Ruby gem test suites as corpora (ActiveSupport `core_ext`), then real-world workloads. A heavyweight front-end sweep now accepts **~100% of all valid Ruby** across Rails + Puppet (**parse + compile** Rails 99.82% / Puppet 100%, 0 over-permissive), and on the runtime side **the real `puppet apply` CLI runs end-to-end** (Puppet 8.11.0): `require "puppet"` boots the framework and the genuine `Puppet::Util::CommandLine` → `Puppet::Application::Apply` path (real `OptionParser`, all types + providers, settings catalog applied to disk, then the user catalog via the transaction / RAL) applies a `notify` resource and emits real Puppet output (`Notice: hi from rbgo cli`), exiting 0. **Runtime conformance, since July:** the ruby/spec `language/` + `core/` suites run in CI as a shrink-only ratchet; across 26 waves the floor has gone from **6 000** (2026-08-03) to **21 740**, and a run on `main` measures **21 901** passing examples (2026-09-23) — see [Conformance](conformance.md#where-it-stands-measured-2026-09-23). **Active next milestone:** real file/package/service resource *providers* (host convergence) + run-report persistence. | **In progress** | +| 8 | Conformance & performance | ruby/spec conformance and representation/perf work (tagging, fast paths, allocation). **Started:** allocation cuts — **small-integer interning** (`object.IntValue` reuses a shared box for ints in [-256, 1024]; a small-int loop drops from ~245k allocs to 1) and **frame-environment recycling** (`exec` pools per-call `*Env`s via a capture-tracked free-list — fib's call allocations halve, ~14% faster). **Conformance & benchmark ladder:** a three-way differential oracle (rbgo / **MRI** / **JRuby**, `scripts/oracle.sh`), then pure-Ruby gem test suites as corpora (ActiveSupport `core_ext`), then real-world workloads. A heavyweight front-end sweep now accepts **~100% of all valid Ruby** across Rails + Puppet (**parse + compile** Rails 99.82% / Puppet 100%, 0 over-permissive), and on the runtime side **the real `puppet apply` CLI runs end-to-end** (Puppet 8.11.0): `require "puppet"` boots the framework and the genuine `Puppet::Util::CommandLine` → `Puppet::Application::Apply` path (real `OptionParser`, all types + providers, settings catalog applied to disk, then the user catalog via the transaction / RAL) applies a `notify` resource and emits real Puppet output (`Notice: hi from rbgo cli`), exiting 0. **Runtime conformance, since July:** the ruby/spec `language/` + `core/` suites run in CI as a shrink-only ratchet; across 27 waves the floor has gone from **6 000** (2026-08-03) to **21 740**, and a run on `main` (`d498ddc`) measures **21 982** passing examples (2026-09-23) — see [Conformance](conformance.md#where-it-stands-measured-2026-09-23). **Active next milestone:** real file/package/service resource *providers* (host convergence) + run-report persistence. | **In progress** | See [Phase 0 — Vertical slice](phases/phase0.md) for what runs today. From 21f0a6ba9c141782defcdc217d934f8d682e3148 Mon Sep 17 00:00:00 2001 From: tannevaled Date: Wed, 23 Sep 2026 20:05:18 +0200 Subject: [PATCH 3/3] =?UTF-8?q?conformance:=20the=20floor=20IS=2021,970=20?= =?UTF-8?q?=E2=80=94=20#638=20merged?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit #638 merged at 18:02Z; FLOOR on origin/main is 21970, re-read from the tree. The page phrased it as a pending proposal. The arithmetic mattered more than the link: the admonition computed the gap as "~240 examples" against a floor of 21,740. The margin is 12. Rewrote the admonition rather than swapping the number in. The old wording said the measured total "normally sits above" the floor and the floor is "raised deliberately after a wave", which leaves a reader wondering why 21 982 and 21 970 are nearly equal. #638 states the rule, and its own numbers confirm it (lowest run 21981, floor 21970, eleven below): the floor is set a handful of examples below the LOWEST observed run -- enough for the #615 jitter and no more, because a floor slack enough to hide the loss of a whole spec file would defeat what the ratchet exists to catch. A small gap is the ratchet working. Provenance: measured on d498ddc; main is now 2200e17, whose only change is the FLOOR file, and the binary rebuilt from it is byte-identical, so the figures carry over rather than being assumed to. #638 now appears once, as that provenance, not as a pending proposal. roadmap.md: the same 21 740 -> 21 970. Co-Authored-By: Claude Opus 5 --- docs/conformance.md | 35 +++++++++++++++++++++++------------ docs/roadmap.md | 2 +- 2 files changed, 24 insertions(+), 13 deletions(-) diff --git a/docs/conformance.md b/docs/conformance.md index c40b5ee..522b0da 100644 --- a/docs/conformance.md +++ b/docs/conformance.md @@ -109,8 +109,11 @@ workflow enforces it on every push and pull request. ### Where it stands — measured 2026-09-23 -On `main` (`d498ddc`), darwin/arm64, against the pinned corpus -(`SPEC_SHA=87b1631992bd00cf0c4934474766d54dad088191`): +On darwin/arm64 against the pinned corpus +(`SPEC_SHA=87b1631992bd00cf0c4934474766d54dad088191`), on `d498ddc` — the tip of +`main` at the time. `main` has since advanced to `2200e17`, whose only change is +the `FLOOR` file ([#638](https://github.com/go-embedded-ruby/ruby/pull/638)); the +interpreter built from it is byte-identical, so these figures stand unchanged. | | | | --- | --- | @@ -119,20 +122,28 @@ On `main` (`d498ddc`), darwin/arm64, against the pinned corpus | skipped | 473 | | pass rate of the examples that ran | **91.4 %** (21 983 of 24 044) | | spec files | 2 191 of 2 206 produce a result; 15 produce none | -| **`FLOOR`** | **21 740** on `main` as of this writing | +| **`FLOOR`** | **21 970** | The ratchet reports 21 982; a separate sweep that also captures `fail`/`error`/`skip` read 21 983. The one-example difference is the `#615` noise described below. -!!! warning "The floor is a gate, not a score" - `FLOOR` says *"no run may come in below this"*. It is raised deliberately, in - its own PR, after a wave lands — so the measured total normally sits **above** - it. Today the gap is ~240 examples, and - [#638](https://github.com/go-embedded-ruby/ruby/pull/638) is open to raise the - floor to 21 970. Quoting the floor as the conformance figure understates rbgo; - quoting the measured total as a guarantee overstates it. The floor is what CI - enforces; the measured total is what rbgo does. +!!! warning "The floor is a gate, not a score — and they are close on purpose" + `FLOOR` says *"no run may come in below this"*. It is raised in its own PR + after a wave lands. The measured total sits **above** it, but only just: + 21 982 against 21 970 is a margin of **12**, and that is deliberate. + + The floor is set a handful of examples below the **lowest observed run** — + enough to absorb the run-to-run jitter of + [#615](https://github.com/go-embedded-ruby/ruby/issues/615), and no more, + because a floor slack enough to hide the loss of a whole spec file would + defeat the thing the ratchet exists to catch. A small gap is therefore the + ratchet working; a large one would mean it had gone slack. + + They remain different claims. The floor is the **guarantee CI enforces**; the + measured total is **what rbgo does** on a given run. Quoting the floor as the + conformance figure understates rbgo by the margin; quoting the measured total + as a guarantee overstates it by the same amount. Run-to-run spread is possible, and it is a **known bug rather than noise in the method**. `core/module/autoload_spec.rb` crashes intermittently while popping a @@ -168,7 +179,7 @@ interpreter, and blurring the two would be misleading: Both are gains in what the measurement can **see**, not in what the VM can **do**. The rest of the climb is the VM: the floor went from **6 000** when the ratchet landed on 2026-08-03 -([#263](https://github.com/go-embedded-ruby/ruby/pull/263)) to **21 740** today, +([#263](https://github.com/go-embedded-ruby/ruby/pull/263)) to **21 970** today, across 27 conformance waves. ### Known limitations diff --git a/docs/roadmap.md b/docs/roadmap.md index 59f1ccb..3c6b7a1 100644 --- a/docs/roadmap.md +++ b/docs/roadmap.md @@ -14,6 +14,6 @@ building whole subsystems in isolation. There are nine phases, 0 through 8. | 5 | Full front-end | Complete the lexer/parser/compiler to full Ruby 4.0 syntax (or settle the Prism-on-wazero decision). **Landed:** string interpolation, keyword args, endless methods (`def foo = expr`), beginless/endless ranges, the stabby lambda, **multiple assignment / destructuring**, **full pattern matching `case`/`in`** (value/bind/class/array/hash/find/pin/alternative patterns, guards, one-line `=>`/`in`, `deconstruct`/`deconstruct_keys`), **safe navigation `&.`**, **numbered params (`_1`/`_2`) and `it`**, **heredocs** (`<<`/`<<-`/`<<~`, interpolating and literal), **`%w`/`%i` arrays**, and the **`%q`/`%Q`/`%W`/`%I` literals**. | **Done** (core) | | 6 | Standard library | Pure-Go stdlib coverage, with the regexp engine from the `go-ruby-regexp` sibling org. **Regexp bridge landed:** `/re/imx` literals + `Regexp`/`MatchData` (`source`/`match`/`match?`/`=~`/`===`, `[]` by index or name, `pre_match`/`post_match`/`captures`/`named_captures`/`begin`/`end`/`size`), `String#=~`/`match`/`match?`/`scan`, and `sub`/`gsub`/`split` over a Regexp (backref templates, blocks, captured-group interpolation, field limit). CGO=0 via `go-ruby-regexp`; differential-tested against MRI. **Also landed:** `Time`/`Date`/`BigDecimal`, `Set`/`Bag`, and the Go-native leaves `JSON` (generate/parse/pretty_generate + `to_json`), `Digest` (MD5/SHA1/SHA256/SHA512), `Base64`, **`File`** (path helpers + read/write/stat/delete, `Errno::ENOENT`), a **MRI-faithful `Random`** (seeded MT19937, bit-exact), **`Zlib`** (crc32/adler32 + Deflate/Inflate), a **byte-exact `Marshal`** (`dump`/`load`, on the pure-Go `go-ruby-marshal` engine), **`Thread`/`Mutex`/`Queue`** on an emulated GVL (one Ruby thread at a time, MRI memory model, race-free), **`IO`/`StringIO`** (`$stdout`/`$stderr`/`$stdin` as real objects; `puts`/`print`/`p` route through `$stdout` so reassigning it to a `StringIO` captures output) and **`Dir`** (entries/children/glob, mkdir/rmdir/chdir, `Errno::ENOENT`/`Errno::EEXIST`), and **`File.open` streams** (`File < IO`, modes `r`/`w`/`a`/`+`, block form auto-flush/close, `File.readlines`/`foreach`). | **Substantially landed** | | 7 | Build toolchain | `rbgo build`. **Landed:** ahead-of-time **method compilation** to native Go (bytecode → Go → machine code), with **unboxed `int64` integer kernels** that deopt to the interpreter on overflow/`÷0` — the generated `fib(30)` beats **MRI + YJIT ~4×** while staying correct for every input ([AOT compiler](architecture/build.md#ahead-of-time-method-compilation-landed)). **Closed-world builds landed** (`rbgo build --closed`): the program is baked in as bytecode (and the prelude loads from frozen bytecode), the **lexer/parser/compiler are dropped** behind the `rbgo_closed` build tag, and a require-graph scan reports any `eval`/`require` that would then raise — yielding a smaller, self-contained binary that runs with no source file. (Per-class stdlib tree-shaking beyond the front-end was measured and skipped — the Go-implemented bindings are small pure-Go libraries, under 2% of a runtime-dominated binary; the front-end drop is the real saving.) | **Done** | -| 8 | Conformance & performance | ruby/spec conformance and representation/perf work (tagging, fast paths, allocation). **Started:** allocation cuts — **small-integer interning** (`object.IntValue` reuses a shared box for ints in [-256, 1024]; a small-int loop drops from ~245k allocs to 1) and **frame-environment recycling** (`exec` pools per-call `*Env`s via a capture-tracked free-list — fib's call allocations halve, ~14% faster). **Conformance & benchmark ladder:** a three-way differential oracle (rbgo / **MRI** / **JRuby**, `scripts/oracle.sh`), then pure-Ruby gem test suites as corpora (ActiveSupport `core_ext`), then real-world workloads. A heavyweight front-end sweep now accepts **~100% of all valid Ruby** across Rails + Puppet (**parse + compile** Rails 99.82% / Puppet 100%, 0 over-permissive), and on the runtime side **the real `puppet apply` CLI runs end-to-end** (Puppet 8.11.0): `require "puppet"` boots the framework and the genuine `Puppet::Util::CommandLine` → `Puppet::Application::Apply` path (real `OptionParser`, all types + providers, settings catalog applied to disk, then the user catalog via the transaction / RAL) applies a `notify` resource and emits real Puppet output (`Notice: hi from rbgo cli`), exiting 0. **Runtime conformance, since July:** the ruby/spec `language/` + `core/` suites run in CI as a shrink-only ratchet; across 27 waves the floor has gone from **6 000** (2026-08-03) to **21 740**, and a run on `main` (`d498ddc`) measures **21 982** passing examples (2026-09-23) — see [Conformance](conformance.md#where-it-stands-measured-2026-09-23). **Active next milestone:** real file/package/service resource *providers* (host convergence) + run-report persistence. | **In progress** | +| 8 | Conformance & performance | ruby/spec conformance and representation/perf work (tagging, fast paths, allocation). **Started:** allocation cuts — **small-integer interning** (`object.IntValue` reuses a shared box for ints in [-256, 1024]; a small-int loop drops from ~245k allocs to 1) and **frame-environment recycling** (`exec` pools per-call `*Env`s via a capture-tracked free-list — fib's call allocations halve, ~14% faster). **Conformance & benchmark ladder:** a three-way differential oracle (rbgo / **MRI** / **JRuby**, `scripts/oracle.sh`), then pure-Ruby gem test suites as corpora (ActiveSupport `core_ext`), then real-world workloads. A heavyweight front-end sweep now accepts **~100% of all valid Ruby** across Rails + Puppet (**parse + compile** Rails 99.82% / Puppet 100%, 0 over-permissive), and on the runtime side **the real `puppet apply` CLI runs end-to-end** (Puppet 8.11.0): `require "puppet"` boots the framework and the genuine `Puppet::Util::CommandLine` → `Puppet::Application::Apply` path (real `OptionParser`, all types + providers, settings catalog applied to disk, then the user catalog via the transaction / RAL) applies a `notify` resource and emits real Puppet output (`Notice: hi from rbgo cli`), exiting 0. **Runtime conformance, since July:** the ruby/spec `language/` + `core/` suites run in CI as a shrink-only ratchet; across 27 waves the floor has gone from **6 000** (2026-08-03) to **21 970**, and a run measures **21 982** passing examples (2026-09-23) — see [Conformance](conformance.md#where-it-stands-measured-2026-09-23). **Active next milestone:** real file/package/service resource *providers* (host convergence) + run-report persistence. | **In progress** | See [Phase 0 — Vertical slice](phases/phase0.md) for what runs today.