refactor content fetching and embedding processes for improved concurrency and error handling

2026-04-19 23:21:29 +01:00
parent 6bf3a9282f
commit 37d9dfb083
8 changed files with 176 additions and 10 deletions
@@ -68,6 +68,10 @@ const BODY_PREFIX_BLOCKLIST = [
  "checking your browser before",
  "this site requires javascript",
  "please make sure your browser supports",
+
+  // yahoo finance serves its global nav when the article body is js-rendered
+  // and the plain fetch only gets the static shell
+  "today's news us politics world weather",
 ];