San Francisco authorities have issued a formal demand to tech giants Apple and Google, ordering the immediate removal of dozens of “nudify” applications from their respective app stores. These controversial software programs utilize artificial intelligence to digitally alter photographs and depict individuals without clothing. The city’s legal action highlights growing concerns over the proliferation of non-consensual deepfake pornography and the role major distribution platforms play in facilitating its spread.

Under California law, facilitating or recklessly aiding the creation of non-consensual deepfake pornography is a criminal offense. Furthermore, legislation enacted in 2025 permits victims to pursue civil damages against third-party facilitators. San Francisco City Attorney David Chiu asserted that both Apple and Google have continued to host and financially benefit from these applications despite being repeatedly notified of their presence. Reports indicate the tech giants may have generated millions of dollars in transaction fees from these services, effectively steering users toward tools that generate non-consensual intimate imagery.

The formal letters sent by the city attorney’s office warn of potential civil penalties if the companies fail to comply, giving both firms 28 days to respond. In response to the pressure, both companies have taken action. Apple stated that such applications are strictly prohibited on its platform, confirming it has removed several offending apps, terminated associated developer accounts, and flagged others for review. Similarly, Google announced it has suspended the specific apps flagged by the city and restricted search terms like “nudify” on its store, emphasizing its commitment to taking swift action against policy violations.

Key Takeaways

• San Francisco has ordered Apple and Google to remove AI-powered 'nudify' apps that generate non-consensual deepfake pornography.
• The tech giants face potential civil penalties under California laws that hold third-party facilitators liable for aiding the creation of such material.
• Both companies have responded by removing several flagged applications and restricting related search terms, though critics argue they must be more proactive.

Editor’s Analysis & Impact

This legal escalation represents a pivotal moment in the regulation of generative AI and platform accountability. For years, app store operators have shielded themselves behind intermediary liability protections. However, California’s aggressive legislative framework is shifting the burden of vigilance onto the distributors. By targeting the financial pipeline—specifically the transaction fees Apple and Google collect—regulators are hitting tech giants where it hurts most. This case will likely set a precedent, forcing mobile ecosystems to implement more robust, proactive AI-detection filters rather than relying on reactive, report-based moderation. As deepfake technology becomes more accessible to the general public, the pressure on platforms to police their marketplaces will only intensify, potentially reshaping the economics of app distribution.

Frequently Asked Questions

Q: What are 'nudify' apps?
A: Nudify apps are software programs that use artificial intelligence to digitally alter photos of clothed individuals to make them appear nude without their consent.

Q: Why are Apple and Google being targeted by San Francisco?
A: The city alleges that both companies have hosted, promoted, and profited from these illegal apps through app store fees, violating California laws against facilitating non-consensual deepfake pornography.

Q: How have the tech companies responded to the order?
A: Both Apple and Google have stated that these apps violate their policies. They have removed several of the flagged applications, terminated offending developer accounts, and restricted related search terms on their platforms.