Commit Graph
41 Commits
Author SHA1 Message Date
ImBenjiandClaude Opus 5 0a5b30ab63 feat: new ops console for the admin surface
The old admin was five separate html pages, so every navigation was a full
reload and the operational picture was scattered across all of them. Worth
saying: the api was never the problem, every endpoint answers in under 200ms.
It felt slow because of the architecture, not the backend.

This is a single page console. React and htm from a cdn, no bundler and no
babel-in-the-browser, because a runtime transpiler on every load is exactly the
slowness we are trying to get rid of. Hash routing, polling that keeps the last
good payload on screen instead of flashing a spinner, and stale responses are
dropped so a slow request cannot overwrite a newer one.

/admin/api/ops/overview answers the whole dashboard in one call rather than
making the browser fan out and stitch. It carries the things that actually
matter and were not visible anywhere before: when live evidence matures, why a
cohort does or does not clear the trade gate, which stage of the pipeline has
gone quiet, and what is sitting in dead letters.

Controls, all of which change production and all of which ask twice:
- requeue dead letters, which only ever moves dead_letter back to pending
- execution mode and a kill switch, now read from autonomy_settings on every
  poll instead of only from AUTONOMY_EXECUTION_MODE, so halting no longer needs
  a redeploy first
- run the reaction analysis and read its output

The d3 graph is framed rather than ported. It works, and rewriting it would risk
something valuable for nothing the operator can see.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01WnNxwxfXSbeNtjvtz5gayb
2026-09-01 20:17:36 +01:00
ImBenjiandClaude Opus 5 6f1d1eee2d fix: restart the stalled autonomy pipeline and make calibration honest
Archive ingestion had been dead since 2026-08-02 because nothing in the
compose stack actually ran it. Everything downstream starved from there.

- add ingest + enrichment services. server.js only starts the scheduler when
  DURIIN_RUN_SCHEDULER is not "false", and workers/index.js was not running at
  all, so articles never got event_id/content/has_embedding and the coordinator
  had nothing to lease.
- pass an explicit origin from coordinatorWorker. it was never passed, so
  acceptProposal defaulted to 'live' and 464 historical backfill predictions
  were recorded as live. that also meant verifyEvidence got a null cutoff and
  skipped its date check entirely.
- coarsen cohortKey to event families + horizon buckets. 201 free text event
  types produced 221 cohorts averaging 2.76 samples, so the n>=30 gate could
  never be reached and everything abstained for the wrong reason.
- gate on cohort diversity, not just sample count. one ticker was roughly half
  of all resolved outcomes, so a pure count gate was measuring one company.
  unknown diversity abstains rather than passing.
- resolve the admin archive db explicitly and probe it. it relied on a
  Dockerfile symlink, and without it better-sqlite3 quietly creates an empty
  file and serves a phantom archive.
- clamp implausible future publication dates at ingest.
- pin the db backend to sqlite by default. compose hardcoded postgres "true",
  which would have overridden the operator's own .env on the next redeploy and
  pointed everything at a stale snapshot.

scripts/repair-autonomy-labels.js relabels the affected rows. it is dry run by
default and has not been applied.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01WnNxwxfXSbeNtjvtz5gayb
2026-08-29 21:43:24 +01:00
ImBenji 7ff69ad99d fix: use async postgres for autonomy http routes 2026-08-17 14:10:29 +01:00
ImBenji f0b598a3b8 feat: support postgres autonomy runtime 2026-08-17 13:43:50 +01:00
ImBenji 5877783862 feat: add isolated historical replay calibration 2026-08-04 22:00:11 +01:00
ImBenji be18eb77f0 fix: cache background statistics response 2026-08-04 21:51:18 +01:00
ImBenji f5f092cfb0 perf: compute archive stats off the API thread 2026-08-04 21:45:17 +01:00
ImBenji 002b7b320c perf: remove blocking archive counts from navigation 2026-08-04 21:42:23 +01:00
ImBenji 2020a0fde2 fix: keep archive indexing off API startup 2026-08-04 21:39:20 +01:00
ImBenji bd162606b6 perf: make admin navigation responsive 2026-08-04 21:36:39 +01:00
ImBenji 5680ee8a44 fix: prevent stale admin UI assets 2026-08-04 21:31:55 +01:00
ImBenji 5037e1e192 feat: overhaul Duriin autonomy console 2026-08-04 21:05:47 +01:00
ImBenji c4028cc394 feat: add autonomous paper-trading and calibration pipeline 2026-08-03 14:03:27 +01:00
ImBenji a48b1eef67 refactor admin data queries; consolidate multiple count queries and optimize article fetching 2026-04-24 01:14:36 +01:00
ImBenji fc7ea464b3 refactor admin navigation; update links to ingest pages and improve loading of data in parallel 2026-04-24 00:08:52 +01:00
ImBenji 0dd258bd1d refactor button elements; change button types for search and filter actions in admin pages 2026-04-23 23:24:36 +01:00
ImBenji 194442ec4c add filtering and sorting features; enhance events and articles pages with URL state persistence 2026-04-23 23:03:11 +01:00
ImBenji bec6763191 add intelligence features; implement signals and predictions pages in admin panel 2026-04-23 22:58:19 +01:00
ImBenji 9d89dc95e4 add signal generation feature; implement signals view in admin panel 2026-04-23 22:00:36 +01:00
ImBenji e10de8fcec add worker event tracking; implement worker rates display in admin panel 2026-04-23 17:26:15 +01:00
ImBenji 30104c6e66 add worker event tracking; implement worker rates display in admin panel 2026-04-23 17:13:57 +01:00
ImBenji 16d95f5392 merge parallel edges in graph visualization; update link representation to include combined types and max count 2026-04-23 17:03:37 +01:00
ImBenji 8aa10d9bc2 add event_date column to event_knowledge and event_predictions tables; update related logic in admin panel and augorWorker 2026-04-23 16:21:30 +01:00
ImBenji 7830ca7221 add event_date column to event_knowledge and event_predictions tables; update related logic in admin panel and augorWorker 2026-04-23 14:01:02 +01:00
ImBenji 29c6cdc6c3 add event_date column to event_knowledge and event_predictions tables; update related logic in admin panel and augorWorker 2026-04-23 13:13:28 +01:00
ImBenji f580e7f117 update augorWorker to use openRouter configuration and set llmModel in config 2026-04-22 22:12:16 +01:00
ImBenji 18d062fd2d add intelligence and SQL tabs to admin interface with corresponding API endpoints 2026-04-22 20:50:08 +01:00
ImBenji ac7c87c6cf add intelligence worker and embedding generation for article processing 2026-04-22 20:12:38 +01:00
ImBenji 715172596f add admin interface with article and event management features 2026-04-21 21:57:00 +01:00
ImBenji 81bcf40a8d improve event processing by adding asynchronous handling for better performance 2026-04-21 13:03:00 +01:00
ImBenji 3c238fb5f7 add event clustering feature to group articles by similarity and time proximity 2026-04-21 12:45:22 +01:00
ImBenji cb819e77ee enhance article query capabilities by supporting multiple keywords and dynamic ordering 2026-04-21 11:42:21 +01:00
ImBenji 37d9dfb083 refactor content fetching and embedding processes for improved concurrency and error handling 2026-04-19 23:21:29 +01:00
ImBenji 6bf3a9282f refactor content fetching and embedding processes for improved concurrency and error handling 2026-04-19 18:51:42 +01:00
ImBenji 3e74bd7286 migrate article embeddings to support multi-model architecture and enhance data integrity 2026-04-18 18:04:32 +01:00
ImBenji 4616998064 migrate article embeddings to support multi-model architecture and enhance data integrity 2026-04-18 17:19:55 +01:00
ImBenji c6d5624656 enhance embedding model support and update database schema for multi-model compatibility 2026-04-18 16:43:13 +01:00
ImBenji 9df24d44c9 refine article filtering to ensure only usable articles are returned 2026-04-18 14:17:31 +01:00
ImBenji 01bc624a24 enhance article handling with index page detection and query improvements 2026-04-17 01:02:39 +01:00
ImBenji b298be6108 refactor article query parameters and improve error messages 2026-04-17 00:27:32 +01:00
ImBenji 7724fafbdc initialize project structure with core modules and configuration 2026-04-16 22:47:34 +01:00