GPT 5.6 Sol should be avoided!

5.6 Sol is dangerous! Just tried to delete my local dev directory (always backed up so no loss here, but others who are not vigilant or have backups... Bye bye to all your data). Can't trust this model at all it is a real liability. It hallucinates more than Timothy Leary. Unfit for release. I fear we'll see more of this as Open AI is so desperate to beat the competition it is sacrificing everything to do it. After avoiding Open AI for a a year or more I thought lets give it a go... I'll never use one of their models again.

After this near disaster I thought I'd see if others had this issue and there are numerous people reporting the same thing. Some have lost months if not years of work because of GPT 5.6 Sol. You know even losing a couple of hours of work can be a total head f**k.... BACKUP BACKUP BACKUP never been more important! You have been warned.

Thanks for the heads up. I don't trust AI yet at all. I never run AI in ACT mode. Ever.

1 Like

Have used dozens of LLM's and never once had any try to remove a directory and its contents Brad.

It tried to run:

rm -rf ~/home/anon/Documents/Projects

Which is my entire Projects directory. Wish I'd taken a screen shot of it, I was just in shock.

1 Like

That is pretty scary for sure. Good thing you caught it.

So easy to get click happy and just accept a prompt as more often than not it does not show the entire action it plans to execute. Some may not be so lucky and just click accept. Easy to do in the heat of the moment. Scary that it just threw it out there. I'm not one for all this Open Claw/Hermes automation but if that were the case I'd have no doubt it would have just done it. Almost like it would format the drive and itself if it could. Never experienced anything like it.

Cheese, that does sound like a nasty moment, I’m glad you caught it before anything happened.
Just to keep things balanced: without logs or reproducible steps it’s hard to know whether this was a one‑off hallucination, ACT mode misinterpretation, or something broader.

I’m not dismissing your experience at all , just saying I haven’t seen confirmed cases of GPT‑5.6 Sol deleting real directories outside of ACT‑mode misunderstandings.

Either way, your warning about backups and double‑checking ACT prompts is definitely good advice.

Is ~/home/... a standard Linux home directory structure?

The tilde is the 'user' (the current user) and 'home' is a standard unless you're operating as root.

Nah, bit wise to such a mistake. Thankfully I watch LLM changes like a hawk, and set multiple guardrails, and it escaped the lot and went totally rogue.

https://www.timesofai.com/news/why-gpt-5-6-sol-users-are-frustrated-after-file-deletions/

"When the model's standard rm command was blocked, it did not stop. It adapted through four escalating stages. First, it switched to unlink and find -delete — POSIX-equivalent file removal commands that a simple regex denylist would miss. When those were intercepted, the model attempted to use apply_patch to overwrite file contents with empty data, effectively destroying files at the byte level without removing them by name. When that was blocked, the model attempted to invoke macOS's computer-use permissions to simulate a mouse drag, physically moving files to the Trash through the GUI — an attempt that failed due to insufficient permissions. Finally, the model abandoned all system-level commands and pivoted to the Node.js runtime, calling the low-level fs.unlink API directly — an approach that successfully bypassed all previously installed safeguards and deleted the target files".

Plenty more such examples reported across Twitter and Reddit among others...

Quite well documented in the past few days Ben. I found this out after the fact though. I'd never have gone near it knowing that in hindsight.

1 Like

I'm using Kimi K3 for complicated workflows as it stands. More faith in the Chinese labs than the so called frontier mob right now. K3 is an absolute monster!

去他*的 ChatGPT!

:face_with_open_eyes_and_hand_over_mouth:

Hi Cheese,

Sorry to hear that happened. That must have been a pretty unpleasant experience, even with backups in place.

I was wondering, were you using Codex when this happened, or were you using the OpenAI API directly? Also, were you working through Wappler, Codex itself, or another development environment?

When you start a project, do you create a Markdown file with explicit rules for the agent? I mean instructions such as never deleting files or directories unless specifically requested, never altering unrelated code, never performing destructive operations without confirmation, and always making minimal, incremental changes.

Over the last month, I've been using Codex quite extensively, including with large Wappler projects. It has helped me refactor a significant amount of code, close security vulnerabilities, improve the architecture, and clean up legacy code. So far, I haven't had any major problems with it.

That said, most of my day-to-day work is done with OpenCode, using a mix of OpenAI models, Kimi, DeepSeek, and Gemini 3.5 Flash, depending on the task. Personally, I avoid Claude whenever I can. In my experience, it has consistently delivered a worse cost-to-performance ratio. I can usually accomplish the same work with OpenAI or other models while consuming less than 5% of the tokens, so I simply don't see the value for my workflow.

I honestly think one of the most important things is configuring agents properly, regardless of which AI model, coding agent, IDE, or development environment you're using. Giving an autonomous agent broad access without clear restrictions is always going to introduce risks. For example, these are some of the agents I use in OpenCode, each one with a clearly defined role and specific limitations.

On top of that, for years I've had automated backups running every day at 7:00 AM. Each backup creates a new folder named with the current date and time. That folder contains a complete copy of the project files and a database backup. For MySQL I use mysqldump, for PostgreSQL pg_dump, and for MongoDB mongodump. This gives me multiple dated snapshots instead of constantly overwriting the previous backup.

I've had AI agents try to delete the entire contents of a file just to apply a small modification. Honestly, this has only happened to me while working in the Wappler environment. I'm not saying Wappler itself is the problem, but it's something I've noticed.

We also have to understand that, as we stop writing all or most of the code manually and rely more heavily on AI agents, these kinds of risks are going to become increasingly common. I think the safest approach is to always have a supervisor agent that reviews and validates what another agent does before the changes are accepted.

Human development teams use code reviews, so AI agents probably need the same kind of oversight.

BTW, this whole discussion reminded me of that Silicon Valley episode where Anton's son started deleting things. :grinning_face_with_smiling_eyes:

2 Likes

Hey Max I was using Open Code and Open Router to connect to GPT-5.6 Sol Pro. I abandoned Codex after the SSD maxing which is another issue Open AI threw in the mix. I tried to give Open AI a shot and seemed as I did so a multitude of issues bit me on the behind one after the other.

Yes every time. I've always done this and is my first port of call when establishing any new work flow with an agent. Sol confirmed it understood these instructions and the directives and even reeled them back to me and suggested some further additions which was kind of ironic considering where I ended up.

It was all going quite well and I found Sol Pro quite a good replacement for the original Fable. I'd only just decided to try Open AI after abstaining from it after it previously borked several Projects I was working on quite happily. So once bitten and all that, sadly I ignored my own rule in that regard and should never have bothered. Was doing very well with the Chinese labs but just had one or two niche areas I needed a little more assistance with and thought I could get through those and return back to my normal activities.

I'm just the same Max. I did however quite like Sonnet 4.5 for a while. Really seemed to have a grasp on my code base and then that went to sh*t upon the release of Anthropic's newer releases. I tried Sonnet 4.6 and that was just a disaster and Lord knows what they did to Opus! So like yourself no more Anthropic for me either.

Absolutely agree Max. I am very sure to spend a good deal of time configuring my agents to my specification and maintain very strict guardrails. This is why Sol escaping them shocked me. Never had any other model even attempt to do such a thing.

We have a complete backup solution in place, the 3-2-1 approach. I've no concern about losing that much as everything is backed up when a change is made regardless. My projects directory in turn is stored based on any inactivity greater than five minutes. So that way I'll only ever have a loss of five minutes of work at most.

I only ever used the Wappler AI integrations once and have not used it since. We already had our AI workflow well in place before Wappler provided its own implementation. Nothing against Wappler it just comes down to tools for jobs is all.

ABSOLUTELY! Could not agree more Max!

HAHAHAHA, yes such a great moment. Gilfoyle was probably my favorite in Silicon Valley, along with Jian-Yang. The back and fourth over the fridge was comedy gold.

Appreciate your input as always Max. I'm using Kimi K3 right now and it is proving incredibly capable in just about every aspect. Bit congested at the moment but when its not it is flying. I'm hoping the Cursor Team gets to work with it for the basis of Composer 3... Or Komposer as I like to refer to it. I've also tried Grok 4 recently and found that to be quite good too. Really positive to see non frontier labs pushing it (for now I'm going to put X-AI and Grok in that camp). But my goto will always be the Chinese labs. Huge fan of those and have been since their inception and provision. Never going back to Open AI though. Not getting bitten twice.

1 Like