The Pulse #82: Why did ChatGPT start to produce gibberish?
Understanding the architecture of ChatGPT we can better pinpoint what exactly might have gone wrong. Also: Twilio’s cofounder CEO stepped down – could we see more cofounders follow suit?
The Pulse is a series covering insights, patterns, and trends within Big Tech and startups. Notice an interesting event or trend? Send me a message.
Today, we cover:
Industry pulse. Apple to kill PWAs in the EU; Reddit prepares for IPO; big AI releases by Google and OpenAI; CodeSee’s developer platform shutting down; OpenAI allows employees to sell shares, and more.
Why did ChatGPT start to produce gibberish? The AI chatbot recited words that made little sense. We now have a postmortem that explains things at high-level – but we can speculate to get closer to what exactly went wrong when ChatGPT did sampling predictions.
After Twilio CEO quits, will other cofounders, too? During 0% interest rates, being a manager was easier: but so was being a CEO. Twilio’s cofounder and CEO threw in the towel, and other longtime cofounders where shareholders are pressuring unpopular decisions to be made might decide to do the same.