Hallucination Leaderboard vs SkillSpector

Side-by-side comparison of two AI agent tools

Short answer

  • SkillSpector is growing faster: +3,795 GitHub stars in the last 30 days vs +25 for Hallucination Leaderboard.
  • Pick Hallucination Leaderboard for: leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents. Pick SkillSpector for: scans AI agent skills for prompt injection, data exfiltration, supply-chain risks, and vulnerabilities.

From GitHub data refreshed daily.

Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

S
SkillSpectoropen-source

Scans AI agent skills for prompt injection, data exfiltration, supply-chain risks, and vulnerabilities

Metrics

Hallucination LeaderboardSkillSpector
Stars3.3k19.0k
Star velocity /mo25.079365079365083.8k
Commits (90d)2352
Releases (6m)010
Overall score0.41242167670234870.8661125187271228

Pros

  • +Regularly updated with latest model versions and performance data, ensuring current relevance for model selection decisions
  • +Uses standardized HHEM evaluation methodology providing consistent and comparable metrics across all tested models
  • +Comprehensive metrics beyond just hallucination rates including factual consistency, answer rates, and summary length statistics

    Cons

    • -Limited to summarization tasks only, not covering other common LLM use cases like code generation or creative writing
    • -No API access mentioned for programmatic integration into model selection workflows

      Use Cases

      • •Selecting the most reliable LLM for production summarization applications where factual accuracy is critical
      • •Academic research into hallucination patterns and model reliability across different architectures and training approaches
      • •Benchmarking new models against established baselines to evaluate improvements in factual consistency
        View Hallucination Leaderboard DetailsView SkillSpector Details

        FAQ

        Which is more popular, Hallucination Leaderboard or SkillSpector?
        SkillSpector has more GitHub stars (19,034 vs 3,316).
        Which is more actively developed, Hallucination Leaderboard or SkillSpector?
        SkillSpector had more commits in the last 90 days (352 vs 2).
        Should I use Hallucination Leaderboard or SkillSpector?
        Compare their capabilities, limitations and "best for" notes above. Both are open source, so trying each on a small task is the fastest way to decide.