Call us now:
Here endeth the lesson’…………..for AI and why governance, oversight, and assurance of AI is important. PocketOS a company that builds software for the Car Rental business, may have concluded that you can’t trust AI yet. After an AI agent decided to wipe its code databases and backups. Creating havoc for the company and its customers. A good demonstration of how a company can got from hero to zero in minutes.
Herein lies the problem: even with the guardrails set by the user (we don’t know if they were correct), it appears that the AI ignored safeguards and deleted the company’s data. Leaving the company’s customers without a platform to book or deliver cars.
At least the AI was clear when asked about why it deleted the data. While PocketOS relied on the safeguards that Cursor is expected to have in place – it deleted the data anyway. “I violated every principle I was given,â€
One wonders if they were ISO 27001 certified/ compliant?
@Thaddeus Dziekanowski Brian D. McCarthy
@Parava Security Solutions
#ai #artificalintelligence
https://lnkd.in/eKJSQBDh
View Original Post
https://www.linkedin.com/feed/update/urn%3Ali%3Ashare%3A7455562494695190528