{"id":25208,"date":"2025-04-27T13:07:20","date_gmt":"2025-04-27T11:07:20","guid":{"rendered":"https:\/\/www.wjst.de\/blog\/?p=25208"},"modified":"2025-04-27T13:08:27","modified_gmt":"2025-04-27T11:08:27","slug":"fighting-ai-with-ai","status":"publish","type":"post","link":"https:\/\/www.wjst.de\/blog\/sciencesurf\/2025\/04\/fighting-ai-with-ai\/","title":{"rendered":"Fighting AI with AI"},"content":{"rendered":"<p>Here is our newest paper &#8211; a nice collaboration with<a href=\"https:\/\/jamanetwork.com\/journals\/jamaophthalmology\/article-abstract\/2832967\"> Andrea Taloni et al.\u00a0<\/a> along <a href=\"https:\/\/jamanetwork.com\/journals\/jamaophthalmology\/article-abstract\/2832965\">with a nice commentary<\/a> &#8211; to recognize <a href=\"https:\/\/www.the-scientist.com\/the-surgisphere-scandal-what-went-wrong--67955\">surgisphere-like<\/a> fraud<\/p>\n<blockquote>\n<p class=\"p1\">Recently, it was proved that the large language model Generative Pre-trained Transformer 4 (GPT-4; OpenAI) can fabricate synthetic medical datasets designed to support false scientific evidence. To uncover statistical patterns that may suggest fabrication in datasets produced by large language models and to improve these synthetic datasets by attempting to remove detectable marks of nonauthenticity, investigating the limits of generative artificial intelligence.<\/p>\n<p class=\"p1\">[&#8230;] synthetic datasets were produced for 3 fictional clinical studies designed to compare the outcomes of 2 alternative treatments for specific ocular diseases. Synthetic datasets were produced using the default GPT-4o model and a custom GPT. Data fabrication was conducted in November 2024. Prompts were submitted to GPT-4o to produce 12 \u201cunrefined\u201d datasets, which underwent forensic examination. Based on the outcomes of this analysis, the custom GPT Synthetic Data Creator was built with detailed instructions to generate 12 \u201crefined\u201d datasets designed to evade authenticity checks. Then, forensic analysis was repeated on these enhanced datasets.\u00a0 [&#8230;]<\/p>\n<p class=\"p1\">Sufficiently sophisticated custom GPTs can perform complex statistical tasks and may be abused to fabricate synthetic datasets that can pass forensic analysis as authentic.<\/p>\n<\/blockquote>\n<p>&nbsp;<\/p>\n\n<p>&nbsp;<\/p>\n<div class=\"bottom-note\">\n  <span class=\"mod1\">CC-BY-NC Science Surf , accessed 13.05.2026<\/span>\n <\/div>","protected":false},"excerpt":{"rendered":"<p>Here is our newest paper &#8211; a nice collaboration with Andrea Taloni et al.\u00a0 along with a nice commentary &#8211; to recognize surgisphere-like fraud Recently, it was proved that the large language model Generative Pre-trained Transformer 4 (GPT-4; OpenAI) can fabricate synthetic medical datasets designed to support false scientific evidence. To uncover statistical patterns that &hellip; <a href=\"https:\/\/www.wjst.de\/blog\/sciencesurf\/2025\/04\/fighting-ai-with-ai\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Fighting AI with AI<\/span> <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20,9],"tags":[3358,1661,1164,218],"class_list":["post-25208","post","type-post","status-publish","format-standard","hentry","category-note-worthy","category-computer-software","tag-ai","tag-forensics","tag-integrity","tag-science"],"_links":{"self":[{"href":"https:\/\/www.wjst.de\/blog\/wp-json\/wp\/v2\/posts\/25208","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.wjst.de\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.wjst.de\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.wjst.de\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.wjst.de\/blog\/wp-json\/wp\/v2\/comments?post=25208"}],"version-history":[{"count":3,"href":"https:\/\/www.wjst.de\/blog\/wp-json\/wp\/v2\/posts\/25208\/revisions"}],"predecessor-version":[{"id":25211,"href":"https:\/\/www.wjst.de\/blog\/wp-json\/wp\/v2\/posts\/25208\/revisions\/25211"}],"wp:attachment":[{"href":"https:\/\/www.wjst.de\/blog\/wp-json\/wp\/v2\/media?parent=25208"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.wjst.de\/blog\/wp-json\/wp\/v2\/categories?post=25208"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.wjst.de\/blog\/wp-json\/wp\/v2\/tags?post=25208"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}