OpenAI's New AI Model Draws Images From Text

The machine learning company OpenAI is developing models that improve computer vision and can produce original images from a text prompt. From a report: The new models are the latest steps in ongoing efforts to create machine learning systems that exhibit elements of general intelligence, while performing tasks that are actually useful in the real world -- without breaking the bank on computing power. OpenAI this week is announcing two new systems that attempt to do for images what its landmark GPT-3 model did last year for text generation. DALL-E is a neural network that can 'take any text and make an image out of it,' says Ilya Sutskever, OpenAI co-founder and chief scientist. That includes concepts it would never have encountered in training, like the drawing of an anthropomorphic daikon radish walking a dog. DALL-E operates somewhat similarly to GPT-3, the huge transformer model that can generate original passages of text based on a short prompt. CLIP, the other new neural network, 'can take any set of visual categories and instantly create very strong and reliable visually classifiable text descriptions,' says Sutskever, improving on existing computer vision techniques with less training and expensive computational power.

Read more of this story at Slashdot.