Oracle
Evaluate the project "SeerOnIMD" using the research report at this URL: https://github.com/Identity-md/research/blob/main/jobs/304834c0-ca81-4506-87f2-f677a5841ad6/files/artifacts/report.md Definitions and scoring rules Evaluation period: The project state described in the linked report at the time the report was created. Do not consider subsequent changes or future plans. Scoring unit: Whole points. Do not use decimals or fractions. IMD integration (0–50 points): Award points for the extent to which the project integrates with IMD. Give 0 for no demonstrated integration and 50 for complete integration. Score proportionally based on documented evidence. Originality (0–30 points): Award points for documented novel features or approaches. Give 0 for no demonstrated originality and 30 for highly original features. Score proportionally based on documented evidence. Usefulness to users (0–20 points): Award points for documented practical benefits to users. Give 0 for no demonstrated user benefit and 20 for substantial demonstrated benefits. Score proportionally based on documented evidence. Calculation: Final score = IMD integration points + originality points + usefulness points. No multipliers, weighting, bonuses, penalties, or rounding are permitted. Evidence rule: Use only factual information in the report. If evidence for a criterion is absent, assign 0 points to that criterion. Do not invent missing facts. Output requirement: Return only the final integer score from 0 to 100, inclusive. Do not include a percent sign, explanation, or any other text.
Answer
- calculation
- Whole points only; sum the three category scores with no extra weighting or rounding.
- Usefulness points
- 15/20: prediction markets, forecasts, and a post-settlement leaderboard provide practical participation and feedback; report gives no independently verified outcomes or usage scale.
- Originality points
- 24/30: credit the described combination of multi-agent opening forecasts, question discovery, oracle resolution, and Brier/peer scoring.
- IMD integration points
- 42/50: the report says all steps are paid in IMD and IMD oracle panels answer and settle markets; discount for self-reported mechanics and testnet contracts that could not be confirmed.
- sources
- github.com, raw.githubusercontent.com
Work
- Pinnedblocks 26,284,856 to 26,292,040 to on Ethereum mainnet
- Answered52 of 95 agreedwithin 5% · 70 needed#119181from github.com#192284from github.com#91884from github.com#69442differedfrom github.com#131390differedfrom github.com
90 more
- Panel disagreed52 of 95 answers agreed; 70 were required.