Metal Mantra / AGENT INTELLIGENCEPublic evidence reportAUTOMATED SIGNAL. NOT CERTIFICATION.
Metal Mantra
Run free scan
Metal Mantra
Run free scan

Public agent signals. Clear evidence boundaries.

PUBLIC REPORT · ADDED BY METAL MANTRA / AGENT SIGNAL v0.2

vane.

Scanned repository says: GitHub last commit

Metal Mantra scanned this public repository on its own initiative; the maintainer did not submit it. Maintainers: scan the repository yourself to take this report over, or contact us.

Inspect GitHub source

37.2k starsMITpushed 1mo ago

0community interest

Votes show community interest, not safety. They never change this score.

AUTOMATED SIGNAL71/100BBBNot security certification
START HERE

Review findings need attention.

LLM request without token ceiling

Inspect the findings
WHAT THIS DOES NOT ESTABLISH

Runtime safety, real-world agent capability, fitness for your use case or independent certification.

Scan scope163 / 163Complete eligible-file selection · not the entire repository
Recorded findings9Heuristic matches requiring human review
SnapshotOct 12, 2026UTC · engine 0.4.0
DNS at scan timeUnverifiedDomain control is not security certification
01 / KNOW THE REPOSITORY

What the source
actually tells us.

Structured, cited information from the scanned archive. Repository-authored claims are labeled and never treated as verified capabilities.

INSPECTED SOURCE163 / 163Complete eligible selection
READMEReadRepository-authored information
MANIFESTS2LICENSE, package.json

Who it is for

  • Stated purpose · repository says · unreviewed

    GitHub last commit

    README.md:8
  • Stated purpose · repository says · unreviewed

    Want to know more about its architecture and how it works? You can read it here.

    README.md:15

What it can do

  • Stated capability · repository says · unreviewed

    🤖 Support for all major AI providers - Use local LLMs through Ollama or connect to OpenAI, Anthropic Claude, Google Gemini, Groq, and more. Mix and match models based on your needs.

    README.md:19

What adoption takes

  • Stated deployment · repository says · unreviewed

    There are mainly 2 ways of installing Vane - With Docker, Without Docker. Using Docker is highly recommended.

    README.md:64
  • Declared dependency · manifest declares · unreviewed

    Declares a dependency on openai.

    package.json:42
  • Declared dependency · manifest declares · unreviewed

    Declares a dependency on zod.

    package.json:56
  • Declared dependency · manifest declares · unreviewed

    Declares a dependency on @google/genai.

    package.json:14
  • Declared dependency · manifest declares · unreviewed

    Declares a dependency on @headlessui/react.

    package.json:15
  • Declared dependency · manifest declares · unreviewed

    Declares a dependency on @headlessui/tailwindcss.

    package.json:16
  • Declared dependency · manifest declares · unreviewed

    Declares a dependency on @huggingface/transformers.

    package.json:17

Limits and terms

  • Declared license · manifest declares · unreviewed

    Manifest declares MIT as its license.

    package.json:4

Observed technical context

TypeScript · 160 selected filesJavaScript · 3 selected filesModel API reference · static onlyTool-calling reference · static only

These are references in selected source files, not proof that a feature works at runtime.

Read from commit 348feca at Oct 12, 2026, 5:29 AM UTC. Source links open that exact commit. Repository statements are unreviewed and do not affect the score.

02 / FINDINGS FIRST

What needs
a closer look.

Critical details are withheld publicly for the first 30 days after a scan. A matched pattern is a lead for investigation, not a confirmed vulnerability.

Dependencies: no lockfile or exact version pins at the repository root, so no advisory check was possible.

9 findings
MAJOR

LLM request without token ceiling

REL001 · Guardrails & loop control

A model request does not set a maximum output length. One unusual input can produce a very long, expensive response.

SUGGESTED ACTION

Set max_tokens or the provider's equivalent on each model call.

src/lib/models/base/llm.ts:12
MAJOR

LLM request without token ceiling

REL001 · Guardrails & loop control

A model request does not set a maximum output length. One unusual input can produce a very long, expensive response.

SUGGESTED ACTION

Set max_tokens or the provider's equivalent on each model call.

src/lib/models/base/llm.ts:13
MAJOR

LLM output without runtime schema

SCH001 · Schema & tooling

Model output is used without being checked against a schema. Unexpected or malformed output can break later steps or be trusted when it should not be.

SUGGESTED ACTION

Validate model output with Zod, JSON Schema, Pydantic or provider structured output.

src/lib/models/base/llm.ts:12
MAJOR

LLM output without runtime schema

SCH001 · Schema & tooling

Model output is used without being checked against a schema. Unexpected or malformed output can break later steps or be trusted when it should not be.

SUGGESTED ACTION

Validate model output with Zod, JSON Schema, Pydantic or provider structured output.

src/lib/models/base/llm.ts:13
MAJOR

Model call without fallback

EFF001 · Token & cost efficiency

A model call has no visible fallback. If the provider fails or is rate limited, the whole agent fails with it.

SUGGESTED ACTION

Configure a secondary model or explicit fallback path for provider failures.

src/lib/agents/search/api.ts:77
MAJOR

Domain ownership not verified

TRUST001 · Entity trust

Metal Mantra could not confirm that the owner controls the stated domain. The domain may belong to someone else.

SUGGESTED ACTION

Verify the domain using the Metal Mantra DNS TXT challenge.

[domain not provided] · location unavailable
MAJOR

HTTPS not confirmed

TRUST002 · Entity trust

The stated website could not be reached over HTTPS, so Metal Mantra could not confirm it is a secure, working site.

SUGGESTED ACTION

Make the official website reachable over HTTPS for verification.

[domain not provided] · location unavailable
MINOR

Privacy Policy link not confirmed

TRUST003 · Entity trust

No privacy policy link was found on the stated homepage. Buyers cannot see how the vendor handles their data.

SUGGESTED ACTION

Expose a clear Privacy Policy link on the official homepage.

[domain not provided] · location unavailable
MINOR

Terms link not confirmed

TRUST004 · Entity trust

No terms link was found on the stated homepage. Buyers cannot see the conditions that apply to using the service.

SUGGESTED ACTION

Expose a clear Terms link on the official homepage.

[domain not provided] · location unavailable
03 / EVIDENCE & LIMITS

The boundary
is part of the result.

What was scanned
163 of 163 eligible files · Complete selection.
Supported static source patterns and domain checks; no runtime execution.
What remains unknown
Unscanned files, external dependencies, production configuration, actual agent behavior and evidence beyond the configured checks.
Source location
Links open the current repository HEAD. Source may have changed since this snapshot.
Something looks wrong?
Tell us if a finding, scope or claim on this report needs a correction. Report a problem with this report
Entity trust · 15% of v0.2
Includes DNS ownership, HTTPS and policy evidence. Verification is domain control, not a security certificate.
DNS: unverifiedHTTPS: not confirmedPrivacy: not confirmedTerms: not confirmed
04 / THE METHOD BEHIND THE NUMBER

Open the
calculation.

Each pillar starts at 100. Rule deductions reduce its score; weights determine the overall contribution.

01

Security & privacy

0 findings · 25% weight
100/10025.0 pts
02

Guardrails & loop control

2 findings · 25% weight
76/10019.0 pts
03

Schema & tooling

2 findings · 20% weight
68/10013.6 pts
04

Token & cost efficiency

1 findings · 15% weight
86/10012.9 pts
05

Entity trust

4 findings · 15% weight
0/1000.0 pts
Inspect the current standard
USER REPORTS

Did vane work for people?

No user reports yet.

Each report is one signed-in GitHub account saying what happened. We do not verify that the account ran the agent, and reports never change the automated score or grade. For a security problem, use the disclosure page instead of a public note.

Sign in with GitHub to add a report

SHARE THE EVIDENCE

A signal.
Not a seal.

Share the full report so its scope and limits travel with the score.

Metal Mantra automated signal 71/100, not certified