New York Lawsuit Accuses TikTok of Testing Fake Safety Features on Teens and Children
A newly unsealed New York lawsuit alleges that TikTok repeatedly tested non-functional versions of a safety feature on thousands of users, including children and teenagers. The allegations raise fresh questions about how social-media companies conduct product experiments involving young users and whether engagement and advertising metrics were prioritized over safety.
TikTok Faces Fresh Scrutiny Over Alleged Safety Experiments on Young Users
TikTok is facing a new wave of scrutiny after a New York lawsuit accused the social-media platform of giving thousands of users a non-functional version of a safety feature while they believed the tool was actually working. The allegations are particularly significant because the lawsuit says children and teenagers were among the users included in the experiments.
The claims were revealed after portions of New York Attorney General Letitia James' lawsuit were unsealed this week. According to the complaint, TikTok conducted what the lawsuit describes as “ghost” or placebo experiments involving its Algo Refresh feature, which is designed to give users greater control over the recommendations appearing in their feeds.
The allegation is not simply that TikTok tested a new product. The central issue is that some users allegedly believed they had activated a safety-related feature when, according to the lawsuit, they had actually been placed in a group receiving a version that did not function as intended.
What Was the TikTok Safety Experiment?
The lawsuit alleges that TikTok repeatedly conducted the experiments in 2023, involving thousands of users who attempted to use Algo Refresh. Some users received the functioning version, while others were assigned a non-functional version.
Algo Refresh is intended to reset or alter the recommendations users receive on TikTok. Such a tool can be important for someone who feels that their feed has become dominated by unwanted subjects and wants to change the type of videos being recommended.
According to New York's allegations, however, users in the placebo group believed their recommendations had been refreshed even though their feeds allegedly remained substantially unchanged. The lawsuit says TikTok used the experiments to compare how the different groups behaved, including how long they remained on the platform and the effect on advertising revenue.
That distinction is at the heart of the controversy. A conventional product experiment can compare two versions of a feature, but a test involving a tool that users turn to specifically for greater control over their recommendations raises additional questions about transparency and informed participation.
TikTok Employee Reportedly Raised Concerns
The lawsuit also describes internal concerns about the use of placebo testing for Algo Refresh.
According to the complaint, a TikTok product manager working in Digital Well Being questioned whether the experiment was appropriate because the feature was supposed to provide users with greater transparency and control over their recommendations.
The employee reportedly argued internally that putting some users into a placebo group conflicted with the purpose of the feature itself. The lawsuit says the experiments nevertheless continued and were conducted repeatedly.
That allegation gives the case another dimension. The dispute is not only about whether the experiments took place, but also about whether TikTok employees recognized potential problems with the methodology and how the company responded to those concerns.
New York Says Young Users Were Among Those Affected
The New York case forms part of a much broader legal battle between TikTok and U.S. states over the platform's treatment of children and teenagers.
The lawsuit alleges that TikTok presented its platform as safe and appropriate for young users while, according to the state's claims, conducting experiments and making decisions that could limit the effectiveness of certain safety measures.
The allegations remain claims in litigation rather than findings that have been established at trial. TikTok has broadly denied New York's allegations and says protecting young users remains a priority.
A TikTok spokesperson told Reuters that the company regularly tests products and features to understand how they work in real-world conditions. The company has also disputed the state's characterization of how Algo Refresh operates.
A Separate Allegation Involves Disabled Safety Protections
The newly unsealed material also refers to a separate group of experiments in which TikTok allegedly disabled certain protections designed to limit users' exposure to harmful material.
That issue had already attracted attention after earlier reporting about an experiment involving a large group of U.S. users. In August, TechCrunch reported that U.S. senators had demanded answers from TikTok concerning an experiment in which a safety safeguard was withheld from millions of users.
The New York lawsuit now places that controversy alongside the allegations concerning placebo versions of Algo Refresh, adding to questions about the way TikTok has tested changes to its recommendation and safety systems.
Because the allegations concern minors and sensitive safety systems, the case is likely to receive continued attention as the litigation develops.
Why the Allegations Matter Beyond TikTok
The controversy goes beyond one particular TikTok feature. Modern social-media platforms constantly test changes to recommendation systems, notifications, interfaces and other parts of their products. Those experiments are a major part of how technology companies understand user behavior.
The difficult question is where ordinary product testing ends and safety testing begins.
If a feature is presented to users as a tool for controlling potentially unwanted recommendations, users may reasonably expect that control to work when they activate it. The New York allegations raise the question of whether that expectation should impose a higher standard when the users involved are children or teenagers.
The case also highlights a broader tension in the social-media industry. Platforms depend heavily on engagement measurements and advertising performance, while regulators and parents increasingly expect companies to put stronger safeguards around younger users.
TikTok's Legal Pressure Is Growing
New York's lawsuit is one of more than two dozen cases brought by U.S. states accusing TikTok of harmful practices involving young users and the design of its platform.
The legal pressure has already produced settlements elsewhere. In September, TikTok agreed to a settlement with Alabama that included financial payments and changes to how the platform operates for teenagers in the state.
These cases do not all involve identical allegations, and individual claims still have to be evaluated through the legal process. But taken together, they show that TikTok's approach to youth safety has become a major regulatory and legal issue in the United States.
For TikTok, the latest allegations create another challenge: convincing regulators, parents and users that safety controls are not merely features that exist on paper, but systems that consistently work when people rely on them.
What Happens Next?
The New York allegations are part of an ongoing lawsuit, meaning the claims have not been finally determined by a court. TikTok continues to reject the broader accusations and says it regularly tests products to improve the user experience.
The newly unsealed documents, however, provide a closer look at the questions surrounding those experiments. The central issue will now be whether TikTok's testing practices crossed the line between ordinary product research and conduct that regulators argue was misleading or inappropriate, particularly when minors were involved.
As governments continue examining the relationship between social-media algorithms, advertising incentives and youth safety, the case could become another important test of how much transparency technology companies should provide when experimenting with features designed to protect their youngest users.
Sources
- Reuters — Reporting on the unsealed New York lawsuit and TikTok's response.
- New York Attorney General — Court complaint and filings in the TikTok case.
- TechCrunch — Reporting on congressional scrutiny of TikTok's safety-feature experiment.
- The Straits Times — Additional reporting on the allegations and legal proceedings.
What's Your Reaction?
Like
0
Dislike
0
Love
0
Funny
0
Angry
0
Sad
0
Wow
0