Stability AI introduces Stable Doodle, a sketch-to-image service powered by the Stable Diffusion model. It allows users to transform sketches into visually appealing images quickly. Stable Doodle offers precise control over image generation, utilizing a conditional control solution developed by Tencent’s Applied Research Center. To maximize efficiency for professionals and novices alike, Stable Doodle enables the creation of high-quality, original images. Stability AI seeks to expand revenue sources after recent financial challenges and aims to raise its $1 billion valuation.
Stability AI, the innovative startup known for its groundbreaking image-generation model called Stable Diffusion, is unveiling a new service designed to convert sketches into fully realized images.
Called Stable Doodle, this sketch-to-image service harnesses the cutting-edge capabilities of the latest Stable Diffusion model. By analyzing the contours and lines of a sketch, Stable Doodle generates visually captivating artistic renderings. The service is now accessible through ClipDrop, a platform that Stability AI acquired in March as part of its purchase of Init ML, an AI startup founded by former Google employees.
Stability AI emphasizes that Stable Doodle caters to both professionals and beginners, irrespective of their familiarity with AI tools. In a blog post shared with TechCrunch via email, Stability AI states, “Stable Doodle allows anyone with basic drawing skills and internet access to effortlessly create high-quality, original images within seconds.”
While there are various AI tools available for sketch-to-image conversion, including open-source projects and ad-supported apps, Stable Doodle stands out by offering more precise control over the image generation process, according to Stability AI.
Underlying Stable Doodle is the powerful Stable Diffusion XL model, complemented by a “conditional control solution” developed by Tencent’s Applied Research Center (ARC). Known as T2I-Adapter, this control solution enables Stable Diffusion XL to accept sketches as input and guides the model to achieve superior fine-tuning of the resulting artwork.
“Incorporating T2I-Adapter empowers Stable Doodle to comprehend sketch outlines and generate images based on prompts combined with the model’s defined contours,” explains Stability AI in the blog post.
As an author, I didn’t have the opportunity to test Stable Doodle before its release. However, the hand-picked images shared by Stability AI looked remarkably impressive, especially when compared to the original doodles that inspired them.
In addition to providing a sketch, Stable Doodle accepts a prompt that helps guide the image generation process. For instance, prompts like “A cozy chair, in an ‘isometric’ style” or “A cat wearing a jeans jacket, with a ‘digital art’ feel” can be utilized. However, it’s worth noting that, initially, Stable Doodle only supports 14 styles of art, limiting customization options.
Stability AI envisions Stable Doodle as a valuable tool for designers, illustrators, and other professionals to optimize their efficiency and save precious time. Nevertheless, the company cautions that the quality of the output images relies on the level of detail in the initial sketch, the descriptive nature of the prompt, and the complexity of the scene being depicted.
“Concepts expressed through sketches can be immediately transformed into tangible designs for clients, materials for presentations and websites, or even logos,” suggests the company. “Moving forward, Stable Doodle will enable users to import a sketch and explore specific use cases tailored to various industries, including real estate applications.”
By introducing tools like Stable Doodle, Stability AI is actively pursuing new revenue streams following a period of reduced commercial activity. (Although Stable Doodle is free, there are certain limitations.) According to Semafor’s report in April, Stability AI was experiencing a financial strain, leading to a search for executives to bolster sales efforts.
In recent months, Stability AI secured $25 million through a convertible note, adding to the total funding of over $125 million. However, the company has not yet closed new funding at a higher valuation. Its most recent valuation stood at $1 billion, and reportedly, Stability AI aimed to quadruple that figure within the next few months.
