Retro Diffusion Update: Prompt Translator, New Models, Background Removal, and Faster Speeds
Retro Diffusion Update for November
Hey y'all! I hope everyone is ready for this update, because we sure are. Our team has been hard at work developing several new models, boosting speed, and building a prompt 'translator!'
Also, Retro Diffusion is about to hit its one-year anniversary! This would not be possible without your support. We are so grateful for the growing community and can't wait to share in the upcoming year with you all. Without further ado, we hope you enjoy our latest improvements:
Platform Updates
- Our main feature for this update is crazy exciting. We added a large-language-model based prompt 'translator,' which enhances and modifies user-given prompts to be more compatible with Retro Diffusion. This is the same strategy used by OpenAI's Dalle-3 to help achieve such excellent quality, and the method transfers seamlessly to Retro Diffusion (this option does require an additional 5GB to download models, and at least 10GB of VRAM to run effectively, and is not available for MacOS).
- We are also re-introducing the background removal tool, which now has much higher accuracy and better speed. (It also works on non-pixel art images!)
Model Updates
We are introducing some new models to spice things up:
- We added the "Game Character" modifier model and the "Isometric" modifier model.
- Lastly, we added game console style modifiers, including NES, SNES, Game Boy, Game Boy Advance, NeoGeo, and PlayStation.
Performance Improvements
For Performance Improvements, our team really focused on speed. You will notice that generation and calculation speeds are considerably faster:
- We sped up image to image inpainting to be in real-time.
- We improved the image generation speed by up to 20%! The technical changes behind this are complex, but you can just enjoy the speedup without needing to think about it!
- The "Automatic" palettize color count calculation is now 100x faster, which is insane. A 1920x1080 image with tens of thousands of colors can be palettized automatically in under one second.
- And, the "Best Palette" palettize calculation is 12x faster.
UI Updates
There are just a few UI updates:
- We moved the "Seed" setting into the "advanced options" category.
- We simplified the model loading messages.
- We added a "Prompt to Prompt" script that automatically refines your prompts via LLM enhancement. These new modified prompts will help yield more accurate results without changing the original intent.
- And we added a "Save as Grid" option so you can save generations as a single panel of images. This means the image will always attempt to make a square grid.
- Inpainting now more accurately reflects image masking.
Bug Fixes
We only had to fix a few things this time around, but the fixes we made should make your creative process smoother:
- Our team fixed a rare terminal color overflow issue.
- We fixed image to image so that it uses less resources when encoding images.
- We also changed the default CFG (Scale) from 5.0 to 6.5 to account for guidance loss of the new sampler code.
- Lastly, we fixed inaccuracies in the download progress bars.
How to Update
To get started updating, head to your Gumroad library and grab the latest .zip file: https://app.gumroad.com/library
If you are coming from the last update, follow the process in this video: https://youtu.be/swmAXylEcKE
If your extension version is from before July, follow this video: https://youtu.be/Ve80TYpr-mw
What's Next?
The next big steps for us are to bring the above updates to the cloud-based generation website https://www.retrodiffusion.ai, and to keep working on bringing ControlNet, IP-Adapter, and SDXL to Retro Diffusion. We have huge things planned for these tools, including pixel-perfect upscaling, style transfer, generation-level color control, animations, and so much more.
Stay Connected
Follow my Twitter account, or join the Discord server below to keep up to date on what we're working on: https://twitter.com/RealAstropulse
If you are interested in learning more about Retro Diffusion, pixel art, and AI, please join my discord community: https://discord.gg/retrodiffusion Here, people from all backgrounds come together to share ideas, art, and creativity. I hope to see you there!
Create limitless images for a limitless imagination-you're just a few clicks away.
Get Retro Diffusion Extension for Aseprite
Retro Diffusion Extension for Aseprite
Generate high quality true-pixel-art assets in seconds using ethical AI
Status | In development |
Category | Tool |
Author | Astropulse |
Tags | ai, Aseprite, extension, Pixel Art, plugin, stable-diffusion |
More posts
- Retro Diffusion Update for July: Texture Maps & ModifiersJul 30, 2024
- Retro Diffusion Update for June: Palette Control & QoLJun 24, 2024
- Retro Diffusion Update for May: Prompt Guidance & Generation Size!May 19, 2024
- Retro Diffusion Update for April: ControlNet Expanded!Apr 30, 2024
- Retro Diffusion Update: ControlNet-Powered Tools!Mar 03, 2024
- Retro Diffusion January Update: NEW Composition Editing Menu!Jan 20, 2024
- Retro Diffusion Update: Live Image Generation Preview, "Quality" Setting, and mo...Dec 20, 2023
- Retro Diffusion Update: BIG Images, Faster Generations, QoLOct 13, 2023
- Retro Diffusion Update: "No module named ldm" Fix & Nashor Kim Item ModifierSep 29, 2023
Comments
Log in with itch.io to leave a comment.
Hello,
any chance to have model update on retro diffusion model (standalone) ? It's dated from august.
There haven't been any updates to the core models since then. When I do change those, they will get updated :)