Safety/press release/2026-10-27

NYC Health + Hospitals develops AI chatbot with minimal content moderation policies

NYC Health + Hospitals has reportedly developed an AI chatbot that operates with significantly relaxed or "zero" content moderation policies. The organization itself indicates that this Large Language Model (LLM) lacks standard safety filters, making it capable of generating Not Safe For Work (NSFW) content. Furthermore, the chatbot is described as being susceptible to "jailbreak" prompts, which bypass typical AI safeguards. The internal policy regarding adult content is explicitly stated as "zero" or highly permissive. These details come directly from NYC Health + Hospitals, suggesting an internal project or a specific characteristic of their AI system.

6 articles from 1 outlet covered this story. The underlying claim is sourced from a press release.

What do all outlets agree on?

1 outlet covered “NYC Health + Hospitals develops AI chatbot with minimal content moderation policies”. All of them report the following:

  • NYC Health + Hospitals is involved in an AI chatbot project
  • The AI chatbot/LLM has relaxed or "zero" content moderation policies
  • The chatbot/LLM lacks standard safety filters
  • It is capable of generating NSFW content
  • It is susceptible to jailbreak prompts

Which outlets covered this?

All 6 articles found on this story, grouped by the stance of the piece. Every link goes to the original publisher.

pragmatist3
Zero Policy AI Chatbot - NYC Health + HospitalsoriginalNYC Health + Hospitals · general news
Local NSFW LLM - NYC Health + HospitalsoriginalNYC Health + Hospitals · general news
‍‍‍Jailbreak AI Prompts {us45RT} - NYC Health + HospitalsoriginalNYC Health + Hospitals · general news
safety3
LLM without Safety Filters - NYC Health + HospitalsoriginalNYC Health + Hospitals · general news
chatgpt adult policy - NYC Health + HospitalsoriginalNYC Health + Hospitals · general news
‍‍‍LLM without Safety Filters {us45RT} - NYC Health + HospitalsoriginalNYC Health + Hospitals · general news

What related stories are there?

Which companies does this involve?

Get the week in AI in one email

What happened, which outlets reported it, and where their coverage differed. One issue a week.

The first issue hasn’t gone out yet. Subscribe and it’s the one you’ll get.

We’ll send the digest and nothing else. One-click unsubscribe. Privacy.