Received: October 4, 2025
Accepted: June 30, 2026
This article examines the ethical implications of deepfake technology, focusing on the interplay between consent and communicative acts. Enabled by generative artificial intelligence, deepfakes blur the boundary between authentic and synthetic media, creating images and videos that appear real while depicting events that never occurred. Although these technologies can serve legitimate artistic, educational, or therapeutic purposes, their use in the production of non-consensual pornographic content poses serious ethical and social risks. Building on debates in the philosophy of language and technology ethics, the paper argues that sexually explicit deepfakes are not ethically neutral: their circulation constitutes communicative acts—such as insult, silencing, or humiliation—that inflict harm regardless of their factual veracity. Beyond individual autonomy, these practices endanger fundamental rights to privacy, image, and dignity, while also eroding public trust in audiovisual evidence. The analysis concludes by proposing an ethical framework that places informed consent, legitimate purpose, and respect for fundamental rights at the center of any responsible use of deepfake technology.
Keywords: pornographic deepfakes, generative artificial intelligence, derogatory language, responsible use of AI.
Este artículo examina las implicaciones éticas de la tecnología deepfake, poniendo el foco en la relación entre consentimiento y actos comunicativos. Los deepfakes, posibilitados por la inteligencia artificial generativa, desdibujan la frontera entre lo auténtico y lo sintético, creando imágenes y videos que parecen reales aunque representen eventos que nunca ocurrieron. Si bien estas tecnologías pueden emplearse con fines artísticos, educativos o terapéuticos legítimos, su uso en la producción de contenidos pornográficos no consentidos expone riesgos éticos y sociales de gran envergadura. A partir de distintos debates en la filosofía del lenguaje y la ética de la tecnología, el trabajo sostiene que los deepfakes con contenido sexual no son éticamente neutrales, sino que su circulación constituye actos comunicativos (como insultar, silenciar o humillar) que generan daños, al margen de su veracidad fáctica. Más allá de las cuestiones de autonomía individual, estas prácticas ponen en peligro derechos fundamentales como la privacidad, la imagen y la dignidad, al mismo tiempo que erosionan la confianza pública en la evidencia audiovisual. El análisis concluye proponiendo un marco ético que ubica el consentimiento informado, la finalidad legítima y el respeto por los derechos fundamentales en el centro de cualquier uso responsable de los deepfakes.
Palabras clave: deepfakes pornográficos, inteligencia artificial generativa, lenguaje denigrante, uso responsable de la IA.
In recent years, the ability to generate content using Artificial Intelligence (AI), whether in the form of text, images, or sound, has revolutionized Western societies. In this sense, deepfakes are one of the most sophisticated applications of the technology known as Generative Artificial Intelligence (GAI). Unlike usual images, audio, or videos representing some form of recording of real sounds or objects, GAI tools create digital artifacts with false data. The constant refinement of this technology is making it increasingly difficult to distinguish between AI-generated materials and authentic texts, images, sounds, or videos. The former includes photos of unreal people; paintings, music, or texts “in the style of” an artist; fabricated videos of public figures; and fake sex videos featuring individuals who never filmed such scenes. Instances of the latter are photos of real-world events; paintings, music, or texts created by actual artists; and videos of real subjects performing various actions they certainly did. Furthermore, greater accessibility to these tools, through increasingly affordable and user-friendly applications, has led to a surge in the creation of this type of representations. In combination with the internet and social media, which globally disseminate attention-grabbing content that quickly goes viral, GAI used for this purpose is transforming not only the digital environments but also the lives of millions of people.
Like all technology, GAI can be used for noble or ethically questionable purposes.
This article focuses on an ethically reprehensible use: the production of deepfakes with sexual content.
Deepfakes constitute a highly advanced application of GAI to create synthetic media for specific purposes. It entails the use of enhanced techniques to generate fake content—including images or sounds or a combination of both—with such a high level of realism that it can hardly be distinguished from original materials (
Its name comes from the fusion of “deep learning,” a type of AI architecture, and “fake,” making direct reference to the underlying technology that uses this type of algorithm to produce fabricated images, audio, or video. Thus, deepfakes do not capture the real world but reproduce content created through digital GAI -powered tools (
The origins of the technology behind deepfakes dates back at least to 1997. In that year, computer scientists Christoph Bregler, Michele Covell, and Malcolm Slaney modified images from a video of a person speaking to make them appear as though they were pronouncing words from a different audio track. In the years that followed, various researchers continued to develop algorithms for facial tracking and matching. In the 3rd International Conference on Face and Gesture Recognition, the Active Appearance Model computer vision algorithm was presented. This approach enabled the alignment of a statistical model of an object’s shape and appearance with a new image, making it the most significant precursor to this technology (
Today, this type of technology has become increasingly accessible and its results are sometimes very convincing. Thanks to open-source tools, powerful AI-trained models, and relatively inexpensive hardware, anyone with basic computer skills can now create hyper-realistic videos featuring altered faces or voices.
In technical terms, deepfakes are based on deep neural networks, particularly on models known as autoencoders and Generative Adversarial Networks (GANS). Autoencoders are used to encode an image (for example, a face) into a compressed representation that is then reconstructed with a “decoder.” For face swapping—just as happened with the video of Obama allegedly insulting Trump (
The data used to train these deep neural networks is key to their success. In the case of the Obama video, hundreds or thousands of images of his face were required, along with the video of the body onto which it was superimposed—in this case, that of an actor. This data is typically obtained from freely available videos on YouTube, social media, or imagery indexed by search engines like Google. Specialized software is then used to segment the faces, identify key points (eyes, nose, mouth), align the faces, and train the models to reproduce expressions, lighting, and angles. Training can take from a few hours to several days, depending on the desired quality and computational capacity.
With regard to hardware requirements, only a laptop with a modern graphics processing unit—such as those in the Nvidia RTX series—is necessary, as well as enough random-access memory. As for software, the most common programs and applications vary over time because the industry is constantly evolving. However, some of the most popular environments for creating deepfakes at the time of writing this article include DeepFaceLab, an open-source tool; FaceSwap, another open-source project with a more user-friendly interface; and Avatarify, which can create deepfakes in real time during video calls and when using applications.
The level of realism and the deceptive capacity of a deepfake depend on several factors. One key element is the quantity and quality of the training data—the greater the diversity of facial images, the more effectively the model can learn to reproduce natural expressions. Video resolution also plays a significant role, as lower-resolution source and output videos tend to obscure imperfections, making detection more difficult. In addition, lip synchronization is essential to ensure that facial movements align convincingly and that the face integrates seamlessly with the body and background—simply overlaying a face is insufficient. Finally, deepfakes require a careful matching of skin tones, lighting, shadows, and depth.
According to
Considering what has been presented so far, it is worth noting that deepfakes are barely distinguishable from photos and videos that document everyday situations and events. Therefore, a common initial reaction is to accept them as images and sounds that provide information about real-life situations and subjects. As
Turning to the topic that will be the focus of this paper, deepfakes with pornographic content became a hot topic starting in 2017, following allegations by several popular Hollywood actresses regarding audiovisual manipulation (
Subsequently, there was a surge in videos in which this technology (especially face swapping) was employed to depict famous women in explicit sexual situations, exploiting their image without their consent. Actresses such as Scarlett Johansson and Emma Watson and singers such as Katy Perry were victims of these practices. In 2024, the musician Taylor Swift was the target of fake pornographic images that are believed to have originated from 4chan—a website that allows users to post content anonymously—using Microsoft Designer. The material was then shared via a Telegram channel and through various user accounts on the social media platform X. This case once again brought the issue of how this technology is used into the media spotlight (
Consent is a central issue in research on new technologies. In the age of social media and internet-based communication, people often agree to relinquishing both their rights and control over substantial amounts of personal information and imagery, including those of their close relations. It is difficult not to consent because in many situations some privacy has to be given up to be able to access desired or needed services, platforms, or websites. When accepting the terms and conditions, individuals also agree to share certain personal data.
Among the uses consented to when accepting the terms and conditions of the platform to which content is uploaded, there are some to which people would not otherwise allow. Given that the quantity and quality of training data are crucial for producing convincing deepfakes, the way in which such materials are obtained is of profound importance.
Leaving aside for the moment the controversies that may arise regarding why the creation of pornographic deepfakes can be objectionable (
There seems to be no disagreement that the use and distribution of sexual photographs or videos obtained without the authorization of the people being depicted—for example, if they are filmed by hidden cameras or from a distance—constitutes an illegal and a morally impermissible act. The same applies when such images are produced by individuals who appear in them but then are illegally obtained—for example, through theft or hacking. Now, why should not the same apply in the case of deepfakes? Just as the viewing or distribution of a sexual act is legal and permissible if the subject involved consent to it, the creation of sexual media should be illegal and impermissible if the individuals represented did not agree on it.
Why does the use of recognizable images of a person in a pornographic deepfake constitute a violation of consent? On the one hand, it violates the right to privacy. These images depict situations that are socially regarded as “private,” whether they involve acts or body parts. On the other hand, this imagery could be considered a form of defamation, insofar as they convey a falsehood about the people who appear in them. In turn, in the case of pornography, they can be understood as a violation of the right to the non-alteration of social identity. This is based on the protection of the individuals’ ability to exercise autonomy over how social relationships with others are formed (
If an original photograph without sexual content is used to generate a deepfake and if that image is publicly available and was shared with the consent of the individual depicted, the distribution of the original does not constitute a violation of privacy or a form of defamation. However, why is the simulated image—which is not “real” nor shows a private act—considered a violation? Precisely because what underpins the requirement for consent in the case of photographs and videos is the identification of a person. If pornographic deepfakes depict recognizable subjects,
The creation of sexual imagery that involve the use of someone’s likeness or photographs raises a specific requirement for consent. As mentioned at the beginning of this section, authorization to use certain images is not sufficient to allow those visual representations to be deployed in all possible scenarios. Particularly, they should not be employed as inputs to generate deepfakes about the subject who gave consent.
One could argue that, in certain cases, the person who shared their images gave permission for them to be used in any way. In this respect, the standard of consent, as it appears in many terms and conditions, is heavily criticized (
Furthermore, consent required in relation to issues such as sex or pornography does not function in the same way as other types of consent. Besides the reasons mentioned above, this is due to the taboo status of such practices in society and the importance of the right to privacy.
Beyond the ethical issues involved in the process of creating deepfakes, which include the issue of consent for the use of data and images, it is necessary to consider how these images will be employed once they have been generated.
Indeed, one might contemplate a strictly private use of deepfakes. In this case, the image would be like a drawing in a personal diary, created solely for the author’s eyes. This use could hardly be regarded as unethical because it does not involve third parties. The case of imagery that sexualize people would be similar to that of a sexual fantasy, which does not seem to be ethically reprehensible in any way.
In addition to strictly private uses (if such uses are possible), the dissemination of these deepfakes through various channels, generally via online platforms, websites, or social media, is more common and problematic. In this way, deepfakes become an act of communication and may be considered offensive, insofar as they elicit an emotional—and often automatic—reaction of rejection in the viewer (
It might also be interesting to analyze the communicative acts involving deepfakes in the context of freedom of expression (
An additional problem is that the role of GAI companies, platforms, and dissemination networks is unclear, given that they allow such images to be generated and spread.
On the other hand, one might claim that social media has become a public forum. Thus, the same laws that apply elsewhere should govern it in order to preserve individual rights, such as the right not to be harmed or the right to reply. To put it differently, social media should be subject to the laws in force in each country regarding defamatory acts. The challenge in this case is that the subject generating a deepfake, the individual posting it, the GAI platform enabling its generation, the company operating the platform where it was posted, and the person whose reputation was damaged might all belong to different countries. This is why AI and social media governance is not easily confined to national laws. Furthermore, it can also be argued that, given the recommendation algorithms employed by these platforms, users cannot choose not to be exposed to certain types of content they find offensive. Therefore, these platforms are violating their right not to see certain things and undermining their autonomy.
Pornographic deepfakes evidence two central issues in the overall deepfake discussion: that of consent and that of ethically reprehensible practices when understood as communicative acts. These problems must be extended beyond the case mentioned. Furthermore, there are other rights that may be violated in all kinds of deepfakes. In fact, due to their high degree of realism, they pose one of the most concerning threats to fundamental rights such as the right to one’s image, the right to privacy, and the right to dignity.
The right to one’s image is an expression of the right to personality and is linked to each individual’s ability to control the dissemination of their own visual representation. In this sense, the image—understood as one of the primary attributes of a person, insofar as it reveals their unique characteristics—is also an essential component of the free development of personality. In other words, as
Traditionally, the protection of this right has been linked to the need for the consent of the individual depicted, but with the advent of this new technology, that requirement is being objected (
The second section showed that the unethical use of deepfakes poses a threat to the right to privacy, a fundamental pillar of democratic societies. In the digital era, this right has taken on even greater significance, given the volume of personal information circulating on the internet and the ease with which it can be used without consent (
The right to dignity, which is closely linked to protection against defamation, exploitation, and dehumanization, is a fundamental principle that is also threatened when AI-generated videos or images are used to humiliate, manipulate, or discredit people. In the personal sphere, the case of non-consensual pornography analyzed here is a clear example, as it causes profound moral and emotional harm, affecting the victim’s self-esteem and psychological well-being (
The development and proliferation of deepfakes pose unprecedented challenges to the protection of fundamental rights such as image, privacy, and dignity. Although technology itself is not inherently harmful, its malicious use has proven to have serious consequences for individuals and society as a whole. The problematic deployment of deepfakes goes beyond the creation of fake content to fulfill sexual fantasies. It also enables tactics such as harassment, intimidation, and the silencing of people, creating a digital environment where fear and instability increasingly prevail. These actions can significantly hinder freedom of expression and inhibit participation in public discourse, particularly among vulnerable groups and individuals (
This study delved into the phenomenon of deepfakes as one of the most complex and disruptive manifestations of GAI. It outlined the technology’s evolution, from its earliest stages to its current ubiquity and accessibility, as well as how its increasing realism and availability have amplified its social and political impacts. Its most problematic uses were examined in detail, particularly in the context of non-consensual sexual content and political manipulation, highlighting how this technology can infringe upon fundamental rights such as privacy, image, and dignity.
Additionally, the study explored the technical mechanisms that enable the creation of deepfakes, the most widely used software, and the type of data required, revealing that the training of these models often relies on materials obtained without consent. The article also analyzed how, even when the generated content is not authentic, real harm can result—the mere suspicion that something has been manipulated is enough to undermine public trust, enabling phenomena such as the liar’s dividend.
However, deepfakes are not inherently damaging. Their ethical evaluation depends on how they are employed and the context in which they circulate. Drawing on the analysis conducted, it is proposed that the ethical use of this technology requires compliance with three simultaneous conditions:
As noted in the introduction, these technologies have a wide range of applications, many of which bring enormous benefits to humanity. A prime example is the application of deepfakes for voice restoration in patients with neurodegenerative diseases or stroke-related damage, allowing them to reclaim their voices with their own tones and nuances, and even create new artistic works. Another possible ethical scenario is the recreation of historical figures in immersive educational, cultural, or artistic experiences, provided that the synthetic nature of the content is explicitly stated and the memory and dignity of the person depicted are respected. In these situations, deepfakes can be a powerful tool for accessibility, education, or creative expression.
There are also cases of complex deepfake legitimacy. For instance, in the 2020 Delhi Assembly elections, the Bharatiya Janata Party, a Hindu nationalist party, deployed deepfakes of its leader, Manoj Tiwari, to reach more voters. Party members created AI videos in which Tiwari spoke in languages he does not speak fluently in real life, such as Haryanvi and English, and sent them to potential voters via WhatsApp (
For all these reasons, the ethical debate should not focus on whether to ban or allow deepfakes in the abstract. Instead, it should center on building regulatory, cultural, and philosophical frameworks that help discern when, how, and for what purposes their use can be compatible with a just, pluralistic, and democratic society. Otherwise, a tool with enormous transformative potential could risk becoming an instrument of control, humiliation, or mass manipulation. In the face of this threat, critical thinking, ethical commitment, and informed regulatory action are more necessary than ever.
The authors declare that there are no financial, professional, or personal conflicts of interest that could have inappropriately influenced the results or the interpretations presented in this manuscript.
The three authors contributed equally to the completion of this paper.