Much of the discussion about AI in the 3D community has so far focused on fears about computers eventually replacing artist. But the tone at an event I attended in Berlin last week struck a completely different note by asking how artists could harness AI to make their work faster and better.
I found myself agreeing with SOOII‘s Marc Gruber-Laux when he posited that most of us care much more about the images we produce than about how we produce them. If the output is exactly how we intended, then it doesn’t matter if it was made in 3D, in Photoshop or with watercolors.
In that respect, generative AI isn’t quite there yet. Not because its output is qualitatively inadequate–on the contrary, Midjourney and Stable Diffusion are often much more skilled than we could ever hope to become–but because it is so hard to control.
This limited control is a problem that will eventually be solved. In the meantime, generative AI can do a lot to help 3D artists speed up their workflow and improve the quality of their final images.
That’s where tools like Magnific AI come in. If you are familiar with Topaz Labs’ Gigapixel, this does something similar in a web editor. The main difference is in the amount of additional detail Magnific creates when enlarging an image. While not designed specifically for 3D artists, the tool can be harnessed to add a final layer of details to a finished 3D render, ideally before the last post-production step. As Commonpoint‘s Artur and Bartosz put it in their presentation in Berlin, it does in one click that last 10% of the image which normally takes 50% of the work.
Below are a few before-after examples using some of my older renders. As you can see, the effect ranges from subtle to quite dramatic. Magnific can also screw up quite badly, so if you are going to use it in production, it will likely be only for specific parts of your image, typically those that show organic details or distressed materials. Some of the difference may only be visible on a large screen at 100% resolution.
The example below (ignore the difference in white balance, which is my mistake) shows how Magnific excels at vegetation and rugged buildings. While the two images aren’t radically different, the very fine details of leaves and branches is much better on the after image. It would takes days to get this extra level of polish in 3D or with overpainting in Photoshop.
In this image of the Goldstein House in LA, Magnific does a great job of adding extra vivid details in the plants and trees but it can’t quite figure out the interior. In general, it doesn’t seem to process reflections very well and there is a good chance it will screw up anything that is behind glass. You’ll want to mask out those areas in your project.
One area where Magnific can excel (and sometimes screw up spectacularly) is with people. Note how it makes this 3d character more convincing while preserving the lighting. The vegetation in the sand, the trees, and the ground around the pillar are also much improved.
This example shows the best and the worst of Magnific. On the one hand, the vegetation, rocks and water are much more natural, on the other, the tool mangles the fine geometry of the music kiosk and even completely transforms some of its features. All this would have to be masked out in a final composite.
Magnific can do wonders in interiors, especially in grungier ones, potentially saving days of modeling and texturing work. Check out the details of the leather sofa, where extra wrinkles appear, giving it a much more realistic look. The fabrics are generally much better, as are some of the pots and vases. There are some obvious glitches too: one of the candles on the table becomes a weird pint glass, and the wood frame of the pendant light turns into some kind of brass construction.
Generally speaking, Magnific won’t do much good on very clean scenes. In this example, it gives the towel on the Eames chair a much more naturalistic look, but the rest of the image doesn’t see much of an improvement.
Food is another area where Magnific can come up with interesting results. In this case, the madeleines and the bread appear more realistic while the glass and cup are largely left unchanged. Note that the tool sometimes struggles to decide what is in focus and what isn’t adding fine details in areas that should be blurry.
Another still life. The roses are much improved, but everything else is arguable worse.
Magnific does a good job in urban scenes. This one is quite detailed to start with, but it adds another layer of grime and realism that works quite well in this case, though I have some issues with the road. The bridge construction on the left is much more realistic, except for one area of the pillar in the foreground that comes out strangely soft. In general, I’ve noticed that the tool can sometimes remove or soften details in areas that are slightly out of focus, rendering them as flat surfaces.
The tool’s landscape mode does wonders with Gaea scenes, especially if you give it quite a low-res image, which gives the algorithm more space to improvise. The improvements here are quite striking even though Magnific takes a lot of questionable liberties with the background. The clouds too are much improved, which much sharper definition.
I’m quite impressed how Magnific’s ability to invent details where there aren’t works wonders with old scenes, papering over the sloppy modeling and texturing to deliver something much more high-end.
This means it can breath new life in old images that show their age by elevating the vegetation, textures, surface details and even the skies.
Magnific is at best when dealing with realistic renders and struggles a bit more with Sci-fi and generally anything that lacks a counterpart in the real world, which I assume is an artefact of its training data. Some of its decisions are sometimes baffling. In a few different instances, it insisted of turning hard hats into cowboy hats. Why?
In summary, anyone whose job is to produce still images is likely to find Magnific very good value in terms of time saved, which is just as well because it is eye-wateringly expensive. Those on a tighter budget will want to check cheaper alternatives, such as Krea and Leonardo, which do similar things, though not as convincingly.
The R36 handhelds look like a fun choice for retro gaming enthusiasts. I like that the focus remains on portability while still providing physical controls.
I appreciate the candid assessment of Magnific AI’s ability to inject fine leaf detail into vegetation, which can indeed shave days off a 3‑D artist’s workflow. However, the article’s warning about its tendency to distort glass reflections and misinterpret focus depth is a crucial reminder to mask those areas before compositing. Overall, using Magnific selectively on grungy interiors or low‑res Gaea landscapes seems the most reliable way to boost realism without compromising the original geometry.
It’s interesting how Magnific AI can
This is a very insightful look at Magn
This is a great breakdown of
Bertrand, your works have no value. Your works is art.
AI is only the price of a monthly subscription.
Comfort will make people slaves.
Amazing examples Bertrand! Its amazing to see what I already considered pretty perfect images and then the AI showing you what maybe was missing? This is the ghost many arviz artist are always chasing. Its an educational tool as well in my opinion. I am going to use this in some tutorials for humanalloy.com as well.. you just need some basic 3D people to for placement and lighting.. and you have much more control then just having AI spawn people from thin air.. Exiting times!
Great post what kind of AI are you using topaz giga pixel or stable diffusion open source or mid journey
Sir, thank you
help me understand – the test you made was on final renders of your works, or the machine built everything from scratch?
In the future, you believe AI will create entire interior scenes?
Hi, This is a very Impressive and also very informative post.
I have read your post, it’s very informative and helpful too for readers.
Martin, absolutely no offense taken. I value every comment here and I’m grateful for anyone who takes the time to read my stuff and comment on it.
I’m sorry if I offend you with this, but in my opinion…even if it’s essentially a generated perfect image of your vision…the images you created yourself will always be of more value to me
The thesis statement in my opinion is wrong. Why should we speed up our work? To make more renders? Instead of crafting one and trying to give it a meaning, a value you are advocating for becoming producing machines? Slaves instead of creators? Imagine Leonardo stamping a Mona Lisa every day of his life! There weee millions of Mona Lisa creators working in factories and still working long hours as slaves producing clothes in Asia just to have a can of soup. Is this the future you are advocating for artists? No thank you. I will better die in poverty trying to improve my abilities to think, to concept, to craft, etc etc etc
“Before” comes from Vray or Vantage? 4th picture for instance..
Maybe i don’t know how to use it but i am pretty dissappointed with this after paying 45 eurosFor me its ruining all my interiors. Its true that my interiors are more modern, not classy interiors but still, its struggles with all fabrics, completly ignores the prompt, the photography & cinematic looks adds grunge to almost to everything, and i’ve played a lot with the strenght of it and with all the other triggers. Yes, for vegetation, wood and reflections is doing a good job, but this is where it stops…
Just as a heads up, if you want to sign up for that AI service they will first ask you for your email which goes on to some tracking service and then ask you to pay. There is no free trial or anything.
had to hop over from Instagram – Great Post – Thank you for this and for sharing!!!
really damn expensive, but if i can render an image in a quarter of the time with half the resolution it should sum up again – in theory 😉
Optimized for Film & Photography(!) and Automatic engine?
Thanks again for this!
Great job on these! I have been looking at Magnific AI, but with out a trial, I haven’t taken the plunge.
Hey Sidney. Yes, it doesn’t always work well and it can mess up with geometry. Also, on some renders it doesn’t look like it’s changing much of anything.
Filip, that’s my experience so far too. I haven’t used that many prompts except when the subject is very obvious.
It really depends on the render. Here are a few things that help:
1. Try using a lower resolution render. Ideally half the resolution of your actual image. It sometimes helps Magnific work more creatively, especially if you don’t already have a lot of tiny details in your render. though it doesn’t always work.
2. Instead of Standard, use the film and photography preset. Don’t use the 3D rendering preset.
3. Play with the creativity slider, but don’t crank it too high.
Just gave it a try. It didn’t return any better results than the original renders, apart for some dirt and grind added to the image. The sharpness was excessive. Which resolution did you start with, and did you use any prompts to start with? What about the various sliders? I guess one has to play with it a little bit.
Awesome job with adding that details. With interiors it’s a little bit harder but I still you can mask in few details here and there.
Would you share some info regarding the setup and prompting? I’ve made a lot of trials and from my experience best setup is with Illusio Engine and optimized for Photography.
very interesting and detailed article.
Having tested it for a few days without prompting.
I agree with the idea of using it as a final mask for certain textures such as fabrics and vegetation, but I’m rather disappointed with wood and marble, where the AI adds HDR detail or reflection, or even knots when it’s not the nature of the wood species.
And I agree with Hesham that we no longer have any depth of field…except for very zoomed-in views.
But we do care how we produce images. Why would people have such strong feelings about even things that bare very little significance on the quality of an image like what render engine was used ? On top of that, it is easy to say – “as long as we get the images exactly how we want them to be” but truth is we know how we want them to be because of experience. Pretty much anyone that got into AI art without artistic background really has no idea why the image they produced looks good, why it doesn’t or spot any mistakes. I’m not even touching on the moral/legal problems around the current state of AI. Having all that said AI generated images are here, we can’t undo that and have to evolve along with the technology. But we also have to be mindful of all the downfalls that it can bring.
It is eye-wateringly expensive, just read your article and subscribed to try it out. Its very good!! Even low res tests it produced a much more polished image, could save a lot of time waiting for those tests to get good enough, and as they say, time is money so could be a nice saver in the end. Looking forward to testing on finished works next.
Great results, specially the leather sofa scene. But I find it strange as it deletes DOF effect in the image!