AI Evaluation New Paradigm: How Yupp Utilizes Blockchain and Incentive Mechanisms to Reshape Model Evaluation

With the rapid development of AI technology, accurately assessing model performance and enhancing user trust has become a pressing issue. Traditional centralized evaluation methods struggle to cover diverse scenarios and fail to truly reflect user preferences. At the same time, the "hallucination" problem of AI models occurs frequently, causing users to often fall into information silos when making choices.

In this context, Yupp, as an emerging platform, is attempting to redefine the discovery, comparison, and use of AI models through a unique crowdsourcing model and incentive mechanism, bringing a revolution to the field of AI evaluation.

Innovative Evaluation Model

Yupp is committed to building a "trustless" AI feedback market, allowing diverse user feedback to circulate freely under the protection of blockchain and cryptocurrency incentives, forming a scalable, fair, and transparent model evaluation layer. By incentivizing the distribution of high-quality human-annotated data, Yupp can promptly capture the real needs and preferences of users in different scenarios, helping AI developers continuously optimize model performance.

The project was founded by Pankaj Gupta and Gilad Mishne in June 2024, with Chief Scientist Jimmy Lin also involved. The three have previously worked together at Twitter, building and optimizing large-scale recommendation and search systems, and later gained extensive experience at Google and Coinbase.

Financing and Support

Yupp recently completed a $33 million seed round financing, receiving high recognition from well-known figures in the tech industry and top venture capitalists. Investors include A16z partner Chris Dixon, Google Chief Scientist Jeff Dean, Twitter co-founder Biz Stone, Pinterest co-founder Evan Sharp, Perplexity CEO Aravind Srinivas, and 45 other well-known angels and corporate executives, as well as Coinbase Ventures.

User Experience and Features

Yupp upholds the concept of "AI for Everyone" which allows users to easily discover, compare, and utilize the latest AI models. The uniqueness of the platform lies in its ability to return answers from multiple models simultaneously for each prompt, forming an "AI parliament." This design not only meets users' demand for diverse choices but also effectively identifies potential "hallucinations" that models may exhibit, helping users make more informed decisions through comparison.

Currently, Yupp supports over 500 AI models, covering the fields of text and image generation. The platform has also launched the "QuickTake" feature, which can condense lengthy replies into concise summaries. In terms of privacy protection, Yupp defaults to keeping all chat records private, allowing users to have complete control over the content and scope of sharing.

Economic Model and Incentive Mechanism

Yupp measures the usage of models and user contributions through the "Yupp Points" system. New users can receive 5000 points upon registration, and can earn more points by rating the responses of models, selecting preferences, and explaining their reasons. The higher the quality of feedback, the greater the rewards, ensuring users can sustainably use high-end models for free.

Points can be exchanged for various currencies, with every 1000 points equivalent to 1 dollar. Users can withdraw up to 10 dollars daily, and a maximum of 50 dollars monthly. The platform also integrates Base Ethernet L2 and Solana stablecoins, providing global users with instant, fee-free rewards.

Yupp VIBE Rating System

To address the issues of transparency and fairness in the existing leaderboard, Yupp has launched the beta version of the AI leaderboard and the "Yupp VIBE (Vibe Intelligence Benchmark) Score" rating system. This system aggregates preference data generated by global users during natural interactions, aiming to provide robust and reliable evaluation results.

The evaluation principles of Yupp include robustness (covering diverse scenarios, reflecting real user concerns, resisting malicious behavior) and reliability (fairness and neutrality, transparency and openness, rigorous and scientific). The platform not only collects binary preferences but also encourages users to point out the strengths and weaknesses of responses, and conducts cluster analysis based on users' demographic information to show preference differences among different groups.

On a technical level, Yupp is exploring the use of Blockchain, cryptographic primitives, and zero-knowledge proofs to ensure that the evaluation process is fair, transparent, and verifiable. At the same time, the platform has partnered with professional AI data providers to calibrate scorers through multi-layer quality checks and eliminate malicious data.

Development History and Future Outlook

Yupp officially launched on June 13, 2025, after six months of internal testing. Since its launch, the product has continuously iterated, adding features such as multimodal support, voice interaction, real-time information inquiry, and constantly introducing new AI models.

Yupp's mission is "empowering humanity to shape the future of AI". Through multi-perspective AI responses and user feedback, Yupp not only helps users make better decisions but also provides momentum for the continuous evolution of AI.

However, Yupp still faces some challenges. How to continuously ensure data quality, resist potential cheating behaviors under large-scale user participation, and strike a balance between commercialization and user incentives will be directions that need constant exploration and optimization in its future development.

Overall, Yupp has opened up a new path for AI assessment through an innovative crowdsourcing model, incentive mechanisms, and a user preference-driven evaluation system. It not only provides users with free and diverse AI interaction experiences but also transforms user feedback into high-value training data, promoting continuous model optimization. With an experienced team and top-tier capital support, Yupp is expected to play an important role in the future AI ecosystem, realizing the vision of "AI for everyone, shaped by everyone."