Retro Diffusion Update: Prompt Translator, New Models, Background Removal, and Faster Speeds


Retro Diffusion Update for November

Hey y'all! I hope everyone is ready for this update, because we sure are. Our team has been hard at work developing several new models, boosting speed, and building a prompt 'translator!'

Also, Retro Diffusion is about to hit its one-year anniversary! This would not be possible without your support. We are so grateful for the growing community and can't wait to share in the upcoming year with you all. Without further ado, we hope you enjoy our latest improvements:

Platform Updates

  • Our main feature for this update is crazy exciting. We added a large-language-model based prompt 'translator,' which enhances and modifies user-given prompts to be more compatible with Retro Diffusion. This is the same strategy used by OpenAI's Dalle-3 to help achieve such excellent quality, and the method transfers seamlessly to Retro Diffusion (this option does require an additional 5GB to download models, and at least 10GB of VRAM to run effectively, and is not available for MacOS).
  • We are also re-introducing the background removal tool, which now has much higher accuracy and better speed. (It also works on non-pixel art images!)

Model Updates

We are introducing some new models to spice things up:

  • We added the "Game Character" modifier model and the "Isometric" modifier model.
  • Lastly, we added game console style modifiers, including NES, SNES, Game Boy, Game Boy Advance, NeoGeo, and PlayStation.

Performance Improvements

For Performance Improvements, our team really focused on speed. You will notice that generation and calculation speeds are considerably faster:

  • We sped up image to image inpainting to be in real-time.
  • We improved the image generation speed by up to 20%! The technical changes behind this are complex, but you can just enjoy the speedup without needing to think about it!
  • The "Automatic" palettize color count calculation is now 100x faster, which is insane. A 1920x1080 image with tens of thousands of colors can be palettized automatically in under one second.
  • And, the "Best Palette" palettize calculation is 12x faster.

UI Updates

There are just a few UI updates:

  • We moved the "Seed" setting into the "advanced options" category.
  • We simplified the model loading messages.
  • We added a "Prompt to Prompt" script that automatically refines your prompts via LLM enhancement. These new modified prompts will help yield more accurate results without changing the original intent.
  • And we added a "Save as Grid" option so you can save generations as a single panel of images. This means the image will always attempt to make a square grid.
    A grid of 9 "blood pickaxes" automatically displayed with "save as grid"
  • Inpainting now more accurately reflects image masking.
    Inpainting mask displayed as noise pattern

Bug Fixes

We only had to fix a few things this time around, but the fixes we made should make your creative process smoother:

  • Our team fixed a rare terminal color overflow issue.
  • We fixed image to image so that it uses less resources when encoding images.
  • We also changed the default CFG (Scale) from 5.0 to 6.5 to account for guidance loss of the new sampler code.
  • Lastly, we fixed inaccuracies in the download progress bars.

How to Update

To get started updating, head to your Gumroad library and grab the latest .zip file: https://app.gumroad.com/library

If you are coming from the last update, follow the process in this video: https://youtu.be/swmAXylEcKE

If your extension version is from before July, follow this video: https://youtu.be/Ve80TYpr-mw

What's Next?

The next big steps for us are to bring the above updates to the cloud-based generation website https://www.retrodiffusion.ai, and to keep working on bringing ControlNet, IP-Adapter, and SDXL to Retro Diffusion. We have huge things planned for these tools, including pixel-perfect upscaling, style transfer, generation-level color control, animations, and so much more.

Stay Connected

Follow my Twitter account, or join the Discord server below to keep up to date on what we're working on: https://twitter.com/RealAstropulse

If you are interested in learning more about Retro Diffusion, pixel art, and AI, please join my discord community: https://discord.gg/retrodiffusion Here, people from all backgrounds come together to share ideas, art, and creativity. I hope to see you there!

Create limitless images for a limitless imagination-you're just a few clicks away.

Get Retro Diffusion Extension for Aseprite

Buy Now$65.00 USD or more

Comments

Log in with itch.io to leave a comment.

Hello,

any chance to have model update on retro diffusion model (standalone) ? It's dated from august.

There haven't been any updates to the core models since then. When I do change those, they will get updated :)