Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 1 addition & 2 deletions ARCHITECTURE.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ OLRC Website (uscode.house.gov)
|
v
+-----------+
| Pipeline | (orchestration)
| Workflow | (orchestration)
+-----------+
|
v
Expand All @@ -37,7 +37,6 @@ OLRC Website (uscode.house.gov)
| `@civic-source/fetcher` | `packages/fetcher` | Downloads release point listings and ZIP archives from the OLRC. Includes SHA-256 hash-based caching (`HashStore`) to skip unchanged content, exponential backoff retry, and a structured logger. |
| `@civic-source/transformer` | `packages/transformer` | Parses USLM XML using `fast-xml-parser` in `preserveOrder` mode and generates per-section Markdown files with YAML frontmatter. Handles namespace-aware element traversal. |
| `@civic-source/annotator` | `packages/annotator` | Queries CourtListener's full-text search API to find cases citing a given statute section. Maps results to the `PrecedentAnnotation` schema. Rate-limited. |
| `@civic-source/pipeline` | `packages/pipeline` | Orchestrates the end-to-end flow: fetch release points, transform each title's XML to Markdown, write files, and optionally annotate with case law. Per-title failures do not block other titles. |
| `@civic-source/web` | `apps/web` | Astro v5 static site that renders statute Markdown with Tailwind CSS styling, Pagefind search, and Svelte interactive components. |

## Dual-Repo Strategy
Expand Down
6 changes: 2 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,8 +34,6 @@ Automated pipeline that fetches U.S. Code XML releases from the Office of the La
| `@civic-source/fetcher` | OLRC release point fetcher with retry and idempotency |
| `@civic-source/transformer` | USLM XML to Markdown converter with status detection |
| `@civic-source/annotator` | CourtListener precedent annotation generator |
| `@civic-source/pipeline` | Orchestration pipeline for bulk conversion |
| `@civic-source/observability` | Pipeline metrics collector and reporting |
| `@civic-source/shared` | Shared utilities (logger, retry, token bucket) |
| `@civic-source/web` | Astro 6 static site with Svelte components |

Expand All @@ -44,12 +42,12 @@ Automated pipeline that fetches U.S. Code XML releases from the Office of the La
```bash
pnpm install
pnpm build
pnpm test # 267 tests across 8 packages
pnpm test # run all workspace tests
pnpm lint
pnpm typecheck
```

Requires Node.js 22.x LTS and pnpm 9.x.
Requires Node.js 24.x LTS and pnpm 11.x.

## Architecture

Expand Down
29 changes: 0 additions & 29 deletions packages/observability/package.json

This file was deleted.

111 changes: 0 additions & 111 deletions packages/observability/src/__tests__/observability.test.ts

This file was deleted.

4 changes: 0 additions & 4 deletions packages/observability/src/index.ts

This file was deleted.

129 changes: 0 additions & 129 deletions packages/observability/src/metrics.ts

This file was deleted.

31 changes: 0 additions & 31 deletions packages/observability/src/timer.ts

This file was deleted.

13 changes: 0 additions & 13 deletions packages/observability/tsconfig.build.json

This file was deleted.

9 changes: 0 additions & 9 deletions packages/observability/tsconfig.json

This file was deleted.

Loading
Loading