Skip to content
 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

201 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Noetic Geodesic Framework (Alpha)

🚀 The Noetic Geodesic Framework (NGF) is a geometric approach to deterministic AI reasoning. It reframes reasoning in latent space as geodesic traversals through warped manifolds, where semantic structure is enforced by energy wells. This allows us to suppress hallucinations and enforce stable, truth-aligned reasoning.

NGF builds on two key pillars:

  • Latent Vector Embeddings — high-dimensional representations (used across modern AI, including LLMs).
  • Warp → Detect → Denoise Doctrine (Stage 11) — our pipeline that shapes these embeddings into deterministic geodesic trajectories.

LLMs vs Vector Embeddings

  • LLMs (Large Language Models): Sequence models that operate on tokens, typically built on transformer architectures. They internally rely on vector embeddings (hidden states) but expose only the text interface.
  • Vector Embeddings: High-dimensional vectors that encode semantic meaning. These can be obtained independently of an LLM (e.g., sentence embeddings, ARC synthetic embeddings) and are directly manipulable.

NGF operates at the embedding level, not at the text level. This means NGF methods are pluggable into any LLM or embedding model. Instead of manipulating prompts or fine-tuning weights, NGF directly reshapes latent trajectories in vector space.

Research Plan Stages

The NGF follows a 12-step research plan, with 10 completed stages posted here. Step 10 is the public rollout with NVIDIA A100 results. Steps 11-12 (milestone reports) are in progress.

Stage Description Phase Hardware Folder/Code
1 Toy Example Toy Example $R^4$ CPU toy-example/
2 Embed Grid Intelligently Toy Example $R^4$ CPU embed-grid/
3 Rotation Matrix Integration Toy Example $R^4$ CPU rotation-matrix/
4 Simulate Pattern Completion Toy Example $R^4$ CPU pattern-completion/
5 Higher-Dim Embeddings Higher Dim $R^9$ CPU higher-dim-embeddings/
6 Integrate Dynamic Intelligence Higher Dim $R^9$ CPU dynamic-intelligence/
7 ARC Question Higher Dim $R^9$ CPU rudimentary-arc/
8 LLM Latent Embedding LLM System CPU llm-latent-embedding/
9 Warp LLM Interference LLM System CPU warp-interference/
10 Rudimentary Benchmarks LLM System* CPU rudimentary-interference/
11 Small Benchmarks LLM System* CPU small-benchmarks/
12 Large Benchmark (coming) LLM System* A100 milestone-benchmark/

(*) Note: Integration of NGF with LLM pending

Illustration: NGF Warped vs Flat Paths (Re: Stage 5)

This animation shows how warped paths converge to correct answers in high-dimensional semantic space:

NGF Warped vs Flat Paths

Requirements

  • Python 3.x
  • transformers==4.55.2
  • torch==2.8.0
  • numpy==2.0.2
  • scikit-learn==1.6.1
  • NVIDIA A100 GPU (e.g., Colab Pro+)

Setup

Install dependencies:

!pip install transformers==4.55.2 torch==2.8.0 numpy==2.0.2 scikit-learn==1.6.1

Stage-11 (Current): Warp → Detect → Denoise

Stage-11 introduced the breakthrough:

  • Warp: Embed latents into PCA(3) space, warp into a single dominant well.
  • Detect: Use matched filters with null calibration to identify the true well.
  • Denoise: Apply smoothing, phantom guards, and jitter averaging to suppress false wells.

Latent-ARC Results (n=100)

Model Exact Acc Precision Recall F1 Halluc. Omission
Denoise (Stage 11) 1.000 0.9977 0.9989 0.9983 0.0045 0.0023
Geodesic (pre) 0.640 0.8450 1.0000 0.8980 0.1550 0.0000
Stock baseline 0.490 0.8900 0.7767 0.7973 0.1100 0.2233

Note: Stock baseline approximates what you’d see if you used simple thresholds on LLM latents/logits without NGF’s Warp→Detect→Denoise.

How This Relates to LLMs

  • NGF is not a new LLM. It is a geometry-on-latents module.
  • You can integrate NGF with any embedding-producing model (LLMs, encoders, diffusion models).
  • Example: an LLM provides hidden states → NGF warps them → trajectories follow deterministic geodesics instead of drifting probabilistically. This separation is critical: LLMs handle language; NGF handles geometry.

Run latest benchmark:

python -u arc-benchmark-latest.py \
      --samples 100 --seed 42 \
      --latent_arc --latent_dim 64 --latent_arc_noise 0.05 \
      --denoise_mode hybrid --ema_decay 0.85 --median_k 3 \
      --probe_k 5 --probe_eps 0.02 --conf_gate 0.65 --noise_floor 0.03 \
      --seed_jitter 2 --log INFO \
      --out_json latent_arc_denoise_100.json --out_csv latent_arc_denoise_100.csv

Stage-11 (What’s Next): Deploying NGF with Real LLMs

  • Hook NGF into LLM hidden states – tap embeddings from mid/upper layers of GPT-2/GPT-Neo, warp into a single cognition well, and apply the Warp → Detect → Denoise pipeline.
  • Compare NGF-augmented vs stock outputs – run side-by-side on MMLU, ARC, or QA tasks, measuring exact accuracy, hallucination rates, and stability.
  • Iterate lightweight integration modes – start with scoring-only (rerank logits), then projection alignment, and finally soft attention gating, balancing determinism with compute cost.

Technical Paper - WORK IN PROGRESS

  • Moore, I. C. (2025). Noetic Geodesic Framework: Deterministic AI Reasoning via Warped Manifolds (Early Preprint). Zenodo. https://zenodo.org/records/17032117 (DOI: 10.5281/zenodo.17032116), Sept 2025.
  • Disclaimer: This is a preliminary alpha-stage document (Sept 1, 2025) avaliable here from repos , subject to change. Feedback is welcome!
  • Provisional patents filed as #63/864,726, #63/865,437, 63/871,647, and 63/872,334.

References

  • Moore, I. C. (2025). Warped Semantic Manifolds: A Geometric Framework for Deterministic AI Reasoning (Preliminary Memo). Zenodo. https://zenodo.org/records/16908227 (DOI: 10.5281/zenodo.16730759), Aug 2025; see code

Medium Articles

Onboarding

As these techniques are uncommon in AI, onboarding requires some prerequisites background knowledge in general relativity and differential geometry, coupled with a good understanding of the objectives behind each of the steps in the 12-staged research plan. If this interests you, please see the onboarding docs for further detail.

Contribute

This is alpha software! Help us refine prompts, test on other hardware, or improve the nudge. Contributors must sign the CLA and email it to ngeodesic@gmail.com before submitting pull requests.

If you find this helpful, please leave a ⭐!

About

Noetic Geodesic Framework for AI

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages