Which is more popular, Hallucination Leaderboard or UQLM?

Hallucination Leaderboard has more GitHub stars (3,316 vs 1,207).

Which is more actively developed, Hallucination Leaderboard or UQLM?

UQLM had more commits in the last 90 days (91 vs 2).

Should I use Hallucination Leaderboard or UQLM?

Compare their capabilities, limitations and "best for" notes above. Both are open source, so trying each on a small task is the fastest way to decide.

Hallucination Leaderboard vs UQLM

Side-by-side comparison of two AI agent tools

Short answer

Hallucination Leaderboard is growing faster: +25 GitHub stars in the last 30 days vs +12 for UQLM.
Pick Hallucination Leaderboard for: leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents. Pick UQLM for: uQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination.

From GitHub data refreshed daily.

Hallucination Leaderboardopen-source

Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

UQLMopen-source

UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

Metrics

	Hallucination Leaderboard	UQLM
Stars	3.3k	1.2k
Star velocity /mo	24.947368421052634	12.157894736842104
Commits (90d)	2	91
Releases (6m)	0	10
Overall score	0.3884668157765224	0.5096030701293031

Pros

+Regularly updated with latest model versions and performance data, ensuring current relevance for model selection decisions
+Uses standardized HHEM evaluation methodology providing consistent and comparable metrics across all tested models
+Comprehensive metrics beyond just hallucination rates including factual consistency, answer rates, and summary length statistics

+Research-backed uncertainty quantification methods published in top-tier academic journals (JMLR, TMLR)
+Multiple scorer types offering different trade-offs between latency, cost, and accuracy for flexible deployment
+Simple installation and integration with existing LLM workflows through PyPI distribution

Cons

-Limited to summarization tasks only, not covering other common LLM use cases like code generation or creative writing
-No API access mentioned for programmatic integration into model selection workflows

-Requires Python 3.10+ which may limit compatibility with older environments
-Different scorers add varying levels of latency and computational cost to LLM inference
-Limited to response-level scoring rather than token-level or real-time uncertainty detection

Use Cases

•Selecting the most reliable LLM for production summarization applications where factual accuracy is critical
•Academic research into hallucination patterns and model reliability across different architectures and training approaches
•Benchmarking new models against established baselines to evaluate improvements in factual consistency

•Production LLM applications requiring confidence scores to filter or flag potentially unreliable outputs
•Research and development of hallucination detection systems and uncertainty quantification methods
•Quality assurance workflows for LLM-generated content in critical domains like healthcare or finance

View Hallucination Leaderboard Details View UQLM Details

FAQ

Which is more popular, Hallucination Leaderboard or UQLM?: Hallucination Leaderboard has more GitHub stars (3,316 vs 1,207).
Which is more actively developed, Hallucination Leaderboard or UQLM?: UQLM had more commits in the last 90 days (91 vs 2).
Should I use Hallucination Leaderboard or UQLM?: Compare their capabilities, limitations and "best for" notes above. Both are open source, so trying each on a small task is the fastest way to decide.