![\"YouTube](\"https:\/\/websites.fraunhofer.de\/video-dev\/wp-content\/uploads\/2024\/11\/Bild1-698x427.png\")
<\/figure>\n\n\n\nFigure 1: Screenshot from YouTube, published by The New York Times4<\/a><\/sup><\/p>\n\n\n\n In science and the economy, misinformation and disinformation (including deepfakes) are now among the biggest challenges that not only occupy research and innovation teams but also force governments and companies to act. No wonder, as these dangers threaten to shake the stability of our democracies and erode trust in social institutions. Social media is a powerful amplifier. Its reach and speed make it the perfect channel for disinformation campaigns. In an era where artificial intelligence can create deceptively real content faster and cheaper than ever before, we face an unprecedented challenge. A worrying study by the World Economic Forum shows that 53% of surveyed risk experts rank AI-generated disinformation and misinformation as the second greatest risk for a global material crisis5<\/a><\/sup>.<\/p>\n\n\n\n There is no silver bullet that can solve all problems related to misinformation and manipulated media content. But we need to rebuild the trust in media content again and help the end user to make a trust decision based on as much and solid data as possible. Figure 2: C2PA Architecture, as published in the C2PA Specification8<\/a><\/sup><\/p>\n\n\n\n Their approach relies on so called C2PA manifests. A C2PA manifest is a cryptographically verifiable dataset that contains assertions about an asset as well as its associations. It enables actors, such as validators or consumers, to verify the authenticity and integrity of digital content by validating the signature and evaluating the assertions. This manifest ensures that the digital content remains traceable and trustworthy throughout its lifecycle.<\/p>\n\n\n\n In the scope of our FAMIUM Provenance and Authentication Solution<\/a>, we are also working with C2PA. To explore how C2PA enhances the protection and verification of digital content, we developed a demo using C2PA open-source tools to test how the standard performs in practice and examined its look and feel. The demo allows to authenticate videos against existing manifests and add new or additional manifests to video content. Figure 3: Our demo using C2PA to explore technical solutions for content provenance<\/p>\n\n\n\n While C2PA provides a standardised way to add metadata to different file types, it lacks guidance on how to apply the technology in modern real-world scenarios that go beyond concentrating on existing known and complete files. Questions arise on topics such as user acceptance and quality of experience, dynamic packaging, multi-CDN handling, live streaming and what to do if access to the original manifest data in a file is not possible.<\/p>\n\n\n\n Figure 4: Interim status of the demo we are currently working on<\/p>\n\n\n\n Another aspect we are working on is the handling of metadata loss and end-user acceptance.<\/p>\n\n\n\n The complex playout infrastructure with production and delivery infrastructures, including encoders and packagers, and even third parties like CDNs, presents multiple challenges. The question is how can it be ensured that C2PA manifests are preserved or enriched as the content is distributed through all intermediate steps until reaching the playback client? Typically, components that are not C2PA compliant loose the embedded information during a processing step. For example, just open an image that has embedded C2PA data in MS Paint and save the image again. The embedded data is lost.<\/p>\n\n\n\n What happens if media content is, for example, recorded from screens? Or just sent as broadcast transport streams via satellite? In those cases, the embedded C2PA data does not reach the end user. So how can metadata loss be restored in these cases? Methods such as watermarking or fingerprinting might help in this regard to identify media items. Using these methods, manifest data can be retrieved from additional services that are decoupled from the media itself.<\/p>\n\n\n\n Finally, user acceptance of approaches like C2PA needs to be evaluated. How can the C2PA manifest be made understandable for the user? How can changes during live streams be signaled, where every second could essentially originate from a different source and may or may not be authentic? How can users be educated about the technology (“user education”)? What information does the user need to make an informed trust decision?<\/p>\n\n\n\n <\/p>\n","protected":false},"excerpt":{"rendered":" To find a suitable opener for this blog article, I truly fell down the rabbit hole. In my search on Google for the latest deepfakes over the past 24 hours, I came across 21 pages of search results. I got…<\/p>\n","protected":false},"author":22,"featured_media":1857,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"[{\"id\":\"e4579bff-28c2-4e0b-a633-8243c0059105\",\"content\":\"https:\\\/\\\/www.nytimes.com\\\/interactive\\\/2024\\\/08\\\/14\\\/technology\\\/elon-musk-ai-deepfake-scam.html<\\\/a> Zugriff am 11. November 2024\"},{\"id\":\"66fd2549-052e-4031-b2d0-cd0d447068be\",\"content\":\"https:\\\/\\\/news.bitcoin.com\\\/de\\\/betrueger-verwenden-deepfake-elon-musk-video-um-waehrend-des-bitcoin-2024-events-krypto-zu-stehlen\\\/<\\\/a> Zugriff am 11. November 2024\"},{\"id\":\"7cb8fba9-b247-4646-906a-35e03495e400\",\"content\":\"https:\\\/\\\/www.reddit.com\\\/r\\\/Bitcoin\\\/comments\\\/1ecpnwg\\\/ youtube_is_full_of_live_scam_shit_especially_now\\\/<\\\/a> Zugriff am 11. November 2024\"},{\"id\":\"ed7049e6-931e-4389-b1da-3cb0c19609f7\",\"content\":\"https:\\\/\\\/www.nytimes.com\\\/interactive\\\/2024\\\/08\\\/14\\\/technology\\\/elon-musk-ai-deepfake-scam.html<\\\/a> Zugriff am 11. November 2024\"},{\"id\":\"c35f8e76-eced-41f1-a668-360cab5c17b7\",\"content\":\"World Economic Forum. (10. Januar, 2024). Welche f\\u00fcnf Risiken werden Ihrer Meinung nach im Jahr 2024 am ehesten eine globale materielle Krise darstellen? [Graph]. In Statista. Zugriff am 01. November 2024, von https:\\\/\\\/de.statista.com\\\/statistik\\\/daten\\\/studie\\\/1458887\\\/umfrage\\\/die-groessten-akuten-risiken-fuer-wohlstand-und-frieden-auf-der-welt-des-jahres<\\\/a>\"},{\"id\":\"e6aa8c6b-4082-42a4-93af-432a761927e0\",\"content\":\"By Jon Bateman and Dean Jackson Bateman, Jon; Jackson, Dean: \\u201cCountering Disinformation Effectively. Countering Disinformation Effectively: An Evidence-Based Policy Guide. 31. Januar 2024. URL: https:\\\/\\\/carnegieendowment.org\\\/research\\\/2024\\\/01\\\/countering-disinformation-effectively-an-evidence-based-policy-guide?lang=en<\\\/a>\"},{\"id\":\"fbabcdf1-f06b-4b43-8a62-550ee90c3d58\",\"content\":\"https:\\\/\\\/c2pa.org\\\/<\\\/a>\"},{\"id\":\"09960bd2-9777-4a34-8e00-362a6fb805aa\",\"content\":\"https:\\\/\\\/c2pa.org\\\/specifications\\\/specifications\\\/1.4\\\/specs\\\/C2PA_Specification.html<\\\/a>\"},{\"id\":\"2d4a352b-6377-4e3b-8b90-ae9befc0b536\",\"content\":\"https:\\\/\\\/github.com\\\/contentauth\\\/dash.js\\\/tree\\\/c2pa-dash<\\\/a>\"}]"},"categories":[77],"tags":[73,72,70,75,74,71],"coauthors":[69],"class_list":["post-1843","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-provenance-and-authenticity","tag-authenticity-and-provenance","tag-c2pa","tag-deepfake-prevention","tag-famium","tag-media-manipulation","tag-media-trust"],"yoast_head":"\nScience & the economy<\/h2>\n\n\n\n
Complex problems require complex solutions<\/h2>\n\n\n\n
Experts in media and research agree: the key lies in multi-layered, comprehensive approaches to combat disinformation6<\/a><\/sup>. One example of a pioneering initiative is the Coalition for Content Provenance and Authenticity (C2PA)7<\/a><\/sup>. This group, including major companies like Google, Adobe, Microsoft, and Sony, is working on solutions to ensure that the authenticity and provenance of media content can be verified. All elements from the C2PA architecture are shown in Figure 2.<\/p>\n\n\n\n![\"C2PA](\"https:\/\/websites.fraunhofer.de\/video-dev\/wp-content\/uploads\/2024\/11\/Bild4.svg\")
<\/figure>\n\n\n\nOur experiment with C2PA<\/h2>\n\n\n\n
Additionally, we tested the integration of the dash.js player with C2PA9<\/a><\/sup> (explore our DASH activities<\/a>). The integration validates the hashes of the DASH segments with the ones stated in the C2PA manifest . In case of mismatches, the user is informed that the content was tampered with. Further, the C2PA manifest is displayed to give the user information about the origin and author of the video. This is a promising step towards more trustworthy digital media and improved transparency for viewers and creators. Nevertheless, the goal has not been achieved yet.<\/p>\n\n\n\n![\"Our](\"https:\/\/websites.fraunhofer.de\/video-dev\/wp-content\/uploads\/2024\/11\/Bild2-698x286.png\")
<\/figure>\n\n\n\nChallenges in the application in real-world scenarios:<\/h3>\n\n\n\n
Currently, we are working on a proof of concept for using C2PA manifests in live streaming context with dash.js and ffmpeg (see intermediate status in Figure 4). This involves signing, sending, and checking the individual segments against the C2PA manifest in real-time. The key difference is that the video content is sent as a live stream \u2013 piece by piece – and is not fully available beforehand. This means that a cryptographic hash cannot be calculated about the full content but needs to be updated in real-time. A cryptographic function is essential to authenticate manifest data and the related media. Authentication and provenance data must be calculated regularly, secured, sent to the client, and evaluated. These are costly and complex steps, but the aim is to implement a solution that does not affect the user\u2019s quality of experience.<\/p>\n\n\n\n![\"Interim](\"https:\/\/websites.fraunhofer.de\/video-dev\/wp-content\/uploads\/2024\/11\/Bild3-1-698x358.png\")
<\/figure>\n\n\n\nPlayout Infrastructure<\/strong>:<\/h4>\n\n\n\n
Overcoming Barriers to Metadata Access<\/strong>:<\/h4>\n\n\n\n
Educating Users and Enhancing Trust in Media Authenticity<\/strong><\/h4>\n\n\n\n
Lots of work to do around media provenance and fighting fake news and misinformation. We\u2019ll keep you updated. In the meantime, check out our website for FAMIUM solutions<\/a>, such as Content Provenance<\/a> and DASH<\/a>.<\/p>\n\n\n\n
\n\n\n