OpenAI’s subsequent flagship mannequin won’t symbolize as large a leap ahead as its predecessors, in accordance with a brand new report in The Data.
Staff who examined the brand new mannequin, code-named Orion, reportedly discovered that though its efficiency exceeds OpenAI’s present fashions, there was much less enchancment than they’d seen within the soar from GPT-3 to GPT-4.
In different phrases, the speed of enchancment appears to be slowing down. The truth is, Orion may not be reliably higher than earlier fashions in any respect in some areas, similar to coding.
In response, OpenAI has created a foundations group to determine how the corporate can proceed to enhance its fashions within the face of a dwindling provide of recent coaching knowledge. These new methods reportedly embrace coaching Orion on artificial knowledge produced by AI fashions, in addition to doing extra enhance fashions through the post-training course of.
OpenAI didn’t instantly reply to a request for remark. In response to earlier stories about plans for its flagship mannequin, the corporate stated, “We don’t have plans to launch a mannequin code-named Orion this 12 months.”
