FlahaINTEL

FlahaINTEL is a local-first OSINT and news intelligence platform for Flaha Agri Tech (Precision Agriculture Division).

It combines:

1. Authoritative RSS collection — hardened transport, dedupe, search, and a reviewed source registry
2. Governed multi-channel ingestion (FlahaINGEST) — durable jobs for websites and documents
3. Analyst governance — review candidates, immutable decisions, promotion eligibility (not auto-publish)
4. Operational product shell — React web UI + Fastify API with roles and production-like ops

Submit website / document
  → acquisition → extraction → normalization
  → governance candidate → human decision → promotion eligibility

RSS remains a first-class, compatibility-preserved path alongside the general pipeline.

• Node.js 20 or newer
• PostgreSQL on localhost:5432 (database flaha_intel)
• All Prisma migrations under apps/api/prisma/migrations applied
• Optional for full ingestion: pinned Scrapy / Playwright / Docling / Tika runtimes (see Phase 3N)

1. npm install
2. Copy .env.example to .env and set DATABASE_URL (never commit real secrets)
3. npm run prisma:generate
4. npm run prisma:status --workspace=@flaha-intel/api (must be up to date)
5. Bootstrap governed data and a local operator:

npm run governance:seed
npm run bootstrap:local
npm run bootstrap:rss-accepted
npm run governance:backfill-sources

6. Run apps:

npm run dev --workspace=@flaha-intel/api
npm run dev --workspace=@flaha-intel/web

API default: 127.0.0.1:3003 · Web default: port 5174.

Development uses AUTH_MODE=development (membership-verified session; optional bootstrap user from bootstrap:local).

Dashboard · Sources · Submit · Jobs · Content · Governance · Artifacts · Settings

Errors use a stable envelope:

{
  "error": {
    "code": "VALIDATION_ERROR",
    "message": "Request validation failed.",
    "details": []
  }
}

Production template: ops/config/production.env.example
Crawl policy: ops/config/crawl-policy.json

RSS downloading is separate from parsing. The transport:

• accepts only HTTP/HTTPS URLs without embedded credentials;
• rejects loopback/private/link-local destinations;
• pins connections and revalidates redirects;
• bounds time, redirects, and response sizes.

These controls are defense-in-depth, not a claim of complete SSRF prevention.

Reviewed registry: docs/rss-source-registry.json
Onboarding notes: docs/rss-source-onboarding.md

Bootstrap on an empty database:

npm run bootstrap:rss-accepted
npm run governance:backfill-sources

NASA JPL remains disabled and REJECTED when present.

Taxonomy under docs/taxonomy seeds 186 classification terms and 20 organization types.
The foundation does not auto-classify articles or invent organizations/events/products.

npm run governance:seed

Workers (separate processes, no TCP):

npm run worker:acquisition --workspace=@flaha-intel/api
npm run worker:extraction --workspace=@flaha-intel/api
npm run worker:normalization --workspace=@flaha-intel/api
npm run worker:submission-advance --workspace=@flaha-intel/api
npm run worker:stale-recovery --workspace=@flaha-intel/api

Documentation:

• docs/ingestion/phase-3n-windows-production-like.md
• docs/ingestion/gate-3n-acceptance-checklist.md
• docs/ingestion/phase-3n-evidence.md

Ops commands:

npm run ops:provision-runtimes
npm run ops:provision-verify
npm run ops:residual-acceptance
npm run ops:smoke

• Unrestricted web crawling or open discovery
• Automatic public publication
• Embeddings / semantic search / AI classification or summarization
• OCR and PPTX processing
• Cloud object storage as primary artifact store
• Public self-service SaaS onboarding

• Final product lock (north star): docs/program/flahaintel-final-product-lock.md
• Program frame, audit, plan & backlog: docs/program/flahaintel-program-frame-audit-plan-backlog.md
• Agent rules and verified gates: AGENTS.md
• Phase 3 architecture roadmap: docs/ingestion/phase-3a-architecture-and-engine-evaluation.md
• Phase 3N evidence: docs/ingestion/phase-3n-evidence.md
• Production hardening: docs/ingestion/phase-3m-production-hardening.md
• Runbooks: ops/runbooks/