dorsal/arxiv
View SchemaA Marketplace for AI-Generated Adult Content and Deepfakes
| Authors | Shalmoli Ghosh, Matthew R. DeVerna, Filippo Menczer |
|---|---|
| Categories | |
| ArXiv ID | 2601.09117vv2 |
| URL | https://arxiv.org/abs/2601.09117 |
| License | http://creativecommons.org/licenses/by/4.0/ |
Abstract
Generative AI systems increasingly enable the production of highly realistic synthetic media. Civitai, a popular community-driven platform for AI-generated content, operates a monetized feature called Bounties, which allows users to commission the generation of content in exchange for payment. To examine how this mechanism is used and what content it incentivizes, we conduct a longitudinal analysis of all publicly available bounty requests collected over a 14-month period following the platform's launch. We find that the bounty marketplace is dominated by tools that let users steer AI models toward content they were not trained to generate. At the same time, requests for content that is "Not Safe For Work" are widespread and have increased steadily over time, now comprising a majority of all bounties. Participation in bounty creation is uneven, with 20% of requesters accounting for roughly half of requests. Requests for "deepfake" - media depicting identifiable real individuals - exhibit a higher concentration than other types of bounties. A nontrivial subset of these requests involves explicit deepfakes despite platform policies prohibiting such content. These bounties disproportionately target female celebrities, revealing a pronounced gender asymmetry in social harm. Together, these findings show how monetized, community-driven generative AI platforms can produce gendered harms, raising questions about consent, governance, and enforcement.
{
"annotation_id": "3b69e5e6-e2f9-48ac-9607-4a1b5e6e2625",
"date_created": "2026-02-17T05:53:20.064000Z",
"date_modified": "2026-02-17T05:53:20.064000Z",
"file_hash": "53801397367a019c0cda2d2eadca4d4421b275b287b4db9dfc695dca6d697e5d",
"private": false,
"record": {
"abstract": "Generative AI systems increasingly enable the production of highly realistic synthetic media. Civitai, a popular community-driven platform for AI-generated content, operates a monetized feature called Bounties, which allows users to commission the generation of content in exchange for payment. To examine how this mechanism is used and what content it incentivizes, we conduct a longitudinal analysis of all publicly available bounty requests collected over a 14-month period following the platform\u0027s launch. We find that the bounty marketplace is dominated by tools that let users steer AI models toward content they were not trained to generate. At the same time, requests for content that is \"Not Safe For Work\" are widespread and have increased steadily over time, now comprising a majority of all bounties. Participation in bounty creation is uneven, with 20% of requesters accounting for roughly half of requests. Requests for \"deepfake\" - media depicting identifiable real individuals - exhibit a higher concentration than other types of bounties. A nontrivial subset of these requests involves explicit deepfakes despite platform policies prohibiting such content. These bounties disproportionately target female celebrities, revealing a pronounced gender asymmetry in social harm. Together, these findings show how monetized, community-driven generative AI platforms can produce gendered harms, raising questions about consent, governance, and enforcement.",
"arxiv_id": "2601.09117",
"authors": [
"Shalmoli Ghosh",
"Matthew R. DeVerna",
"Filippo Menczer"
],
"categories": [
"cs.CY",
"cs.AI"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"title": "A Marketplace for AI-Generated Adult Content and Deepfakes",
"url": "https://arxiv.org/abs/2601.09117",
"version": "v2"
},
"schema_id": "dorsal/arxiv",
"source": {
"execution_id": "b845c1f7-3ba4-49b4-af38-d6af75134cca",
"id": "arXiv Dataset",
"type": "Model",
"variant": "snapshot-2026-01-17",
"version": "0.1.0"
},
"user_id": 1000002
}