Skip to main content
⚙ Methodology How the signal gets made v2.0 · 2026-08

How we score the signal.

Source authority, story importance and publication value are three different decisions. This page shows how LLMgram keeps them separate from ingestion to AI Signal, Telegram and X.

LLMgram is a curation and publication layer. The current intake contains 110 built-in feeds and 102 curated expansion feeds—212 configured feeds across official labs, original research, independent reporting, specialist analysis, practitioner posts, communities and discovery services. A source being monitored does not make every item important, and a popular aggregator does not become evidence by repeating a claim.

Sources and coverage

Each configured feed receives an editorial role. The role describes what the source can prove; it is not a permanent quality bonus for its publisher. Articles are then evaluated individually. The Decoder, Reuters, The Verge or any other newsroom use the same reporting rules. Techmeme is useful for discovery, but cannot make a story MUST on its own.

Source roleWhat it contributesAuthority bound
PrimaryOfficial release, product documentation, filing or company newsroom statement5 / 5
First-party socialOfficial account statement; the post stays below MUST while linked primary evidence or independent reporting may carry the event4 / 5
Original researchPaper, institute result, method or benchmark owner5 / 5
Independent reportingReported facts, interviews, corroboration and context4 / 5
PractitionerObserved setup, measured result or field report3 / 5
CommunityLead, discussion, reproduction attempt or early warning3 / 5
DiscoveryPointer to a story that still needs its underlying source2 / 5
Coverage has three separate numbers. Configured means the feed is in the manifest. Reached this run means the fetch or parser returned normally. Represented means at least one accepted item from that source exists in the indexed history. The public source drawer exposes all three instead of presenting one inflated “sources” total.

Surface inventory

Every public surface pulls from a named upstream. A few products, including Hardware Red Room, remain conservative curated graphs and are labelled as such.

SurfaceUpstreamMethodCadence
AI Signal212 configured RSS, scrape and X feedsFetch + LLMgram URL Reader enrichment + local structured analysis2 h target; freshness target ≤6 h
Hermes / Claude / Muse / Grok Live / GPT LivesThe activated Signal Core snapshot, built from AI Signal observations and bounded adaptersFive deterministic profile projections with stable event identity, exact source provenance and bounded term matchingBuilt and uploaded with every critical signal sync
Use CasesHand-curated evidence registryHuman review against a public repo, documentation, demo, or reproducible workflowOn verified editorial update
Weekly / DigestAI Signal snapshotEditorial Top 10 digest from scored articles; public URL /digest/ is the fail-closed extract. The /weekly/ archive stays liveBuilt with AI Signal critical sync
Daily MUST packetExisting AI Signal / weekly snapshotFail-closed 0–3 item packet; score≥13, impact≥4, corroboration, human allowlist. Empty packets stay emptyBuild-time only, never padded
Git SignalCurated GitHub repo list / API snapshotRepo metadata + README + analysisOps sync script
AI Papersai-papers-data.json research graphScored/grouped paper index for the AI Papers surfaceOn dataset sync
Skills SignalExternal skills snapshot → skills-signal-data.jsonSync + publishOps sync script
Compute MapEpoch AI — AI Data Centers datasetCompacted static JSON for the globe UIOn refresh script run
Hardware Red RoomCurated seed graph (AI Signal candidates planned)Conservative source-backed seed MVPOn curated update
LLM ArchitecturesSebastian Raschka LLM Architecture GalleryGallery scrape/builder + attributionSuggested every 6 h
Company RadarsLabs registry + public profiles / evidence queueRadar pipeline + roster verificationRotation / varies by lab
AI MercatoLabs registry + roster-backed affiliationsVerified people/movements graphOn rebuild
WikiAI Signal-derived entity graphSeed/enrich from signal (full sync)Scheduled full sync
AcademyTutorial-like items filtered from AI SignalRegex prefilter + optional Grok verificationWith Academy builder / signal

Story ranking

Source authority and story importance are calculated separately. The editorial score runs from 1 to 15. It starts from source authority and estimated impact, then adds bounded evidence for corroboration, discriminative technical content and—only for community items—visible interest. Paywalls do not reduce importance. Repetition on an aggregator does not increase authority.

LaneDeterministic gateReading job
MUSTCore story, score ≥12, impact ≥4 and primary research, first-party evidence, independent corroboration or an exceptional high-authority reportThe small set worth interrupting the feed for
DEEPCore story, score ≥8, impact ≥3 and not discovery-onlyUseful context, tests and field reports
FASTEverything else, including discovery leads, unconfirmed opinion and the adjacent archiveScan, verify or keep for search

Analysis and provenance

Weak excerpts and title-only pages are enriched through llmgram-url-reader, the LLMgram-owned extraction contract. Structured analysis runs locally by default; Grok remains an explicit fallback or legacy path, not a hidden requirement. The model can propose categories, impact and interpretation, but it cannot promote its own prose into source evidence.

Known limitations

English-language feeds still dominate. Scrapers can break when a publisher changes markup. A source can be reachable but quiet, or represented in history while failing today. The coverage manifest exposes these states; it does not turn them into certainty.

Eight publication scenarios

A story is not sent through one universal template. Its scenario defines the reader's job on AI Signal and the kind of contribution X must add.

ScenarioAI Signal keepsX must add
Product releaseCapability, availability, proof, limits and a useful testA test, comparison or builder consequence
Benchmark / researchMethod, baseline, result and caveatA reusable comparison or reproducibility limit
Builder field reportSetup, measured result and failure modesA transferable lesson anchored to the practitioner
Security / policyTimeline, affected scope, evidence boundary and unknownsAn operator decision or concrete limit
Market moveConfirmed terms, fit, chronology and undisclosed detailsA grounded strategic consequence
Infrastructure shiftScale, constraints, geography and economicsAn honest comparison or operator consequence
Opinion / unconfirmedClaim, context, counter-evidence and uncertaintyA trusted requote with one bounded question
Breaking eventChronology, corroboration, consequence and unknownsA distinct implication—or no X post
One signal, three different jobs.
Telegram states the verified actor, action, object and source. AI Signal keeps evidence, context, limits and what to watch. X publishes a separate test, comparison, decision or bounded disagreement. If that contribution does not exist, the X plan is disabled.

Engagement without bait

The target action depends on the scenario: bookmarks for a reproducible test or checklist, reposts for a legible comparison, qualified replies for a real trade-off, and profile visits when the work demonstrates a distinctive operator view. Native media, a trusted requote or the AI Signal page is selected according to the evidence available—not by forcing every story into the same format.

After publication, a read-only collector records visible metrics at 1 h, 24 h and 72 h and joins them to scenario, angle and format. A late start marks earlier windows as missed instead of inventing historical measurements. Bookmarks indicate utility; qualified replies indicate a real discussion; reposts and quotes indicate transferable value. These results inform later editorial choices, but never upgrade source authority or rewrite a published post.

Selected examples continue on @llmgram. The source link remains available; the X paragraph is not the Telegram caption with different punctuation.

Refresh and automation

Different surfaces refresh at different rates. Exact scheduler definitions live on the ops host; the public contracts below match the scripts and health checks in this repository.

Signal Core and Policy Lens

AI Signal Lite is one bounded projection of a shared, versioned event layer rather than the data contract every other page must copy. The full AI Signal archive remains an editorial input and public history, not a second event-identity ledger. Signal Core keeps raw observations separate from stable events, persists event identity when a new source joins a cluster, and exposes bounded entity references and surface routes. Existing AI Signal cards remain backward-compatible while Policy Lens, the Wiki and all five Lives consume dedicated projections from the same activated snapshot.

Use Cases evidence gate

Use Cases turns selected capabilities into evergreen workflows. AI Signal and other sources may surface candidates, but no model can publish a case automatically. A public case requires a concrete outcome, explicit inputs and steps, at least one reachable evidence link, and a dated editorial verification.

What we don't do

Provenance & source code

LLMgram is built and operated at llmgram.app as a public lab notebook. The public data files can be inspected directly, and the implementation lives in the LLMgram repository. Every content item keeps its upstream attribution.

If you find a miscategorized item, a stale score, or a bug in the scoring, ping @iamsupersocks on X/Twitter or @llmgram.

Changelog