Overview of TRIED: WITNESS’ Truly Innovative and Effective AI Detection Benchmark
The proliferation of generative AI and deceptive synthetic media poses a significant threat to the global information ecosystem, particularly among the Global Majority. This report highlights the limitations of current AI detection tools, which often underperform in real-world scenarios due to challenges related to explainability, fairness, accessibility, and contextual relevance. In response, WITNESS introduces the Truly Innovative and Effective AI Detection (TRIED) Benchmark, a new framework for evaluating detection tools based on their real-world impact and capacity for innovation. Drawing on frontline experiences, deceptive AI cases, and global consultations, the report outlines how detection tools must evolve to become truly innovative and relevant by meeting diverse linguistic, cultural, and technological contexts. It offers practical guidance for developers, policy actors, and standards bodies on designing accountable, transparent, and user-centered detection solutions, as well as incorporating sociotechnical considerations into future AI standards, procedures, and evaluation frameworks. By adopting the TRIED Benchmark, stakeholders can drive innovation, safeguard public trust, strengthen AI literacy, and contribute to a more resilient global information credibility.
| Collection(s) | All resources, Technology, Threats & Opportunities: Research & Analysis |
|---|---|
| Region/Country | Global |
| Topic(s) | Deepfakes, Digital Safety, Open Source Investigations |
| Type | Report |
| Language | English |
