Generative AI Image-to-3D solutions — a Benchmark

Generative AI technologies have made remarkable strides in converting 2D images into 3D models, with innovative tools and features emerging at an impressive pace. To better understand the current capabilities of these services and APIs, I tested four of them using the same image to see how their outputs compare.

Currently my favorite pick is TRELLIS, followed by meshy — but see for yourself, I've provided also the resulting 3d models on sketchfab.

• meshy.ai (https://www.meshy.ai/?utm_source=E7PZL9)

• Shutterstock generative-ai-3d (https://www.shutterstock.com/de/discover/generative-ai-3d)

• Microsoft TRELLIS-3D (https://github.com/microsoft/TRELLIS)

• Stability stable-fast-3D (https://stability.ai/news/introducing-stable-fast-3d)

The test image is a picture of a milling machine — the ABENE VHF-680, which I found in this PDF product brochure: VHF680CNC ENG 2011.

This machine presents a challenging test case due to its intricate geometry, including transparent components and protruding elements like the HMI. As a reference, I downloaded a traditional 3D model from Sketchfab to serve as ground truth:

Cutter Machine — Download Free 3D model by Francesco Coldesina (@topfrank2013) [ea44a8b]

meshy.ai

(https://www.meshy.ai/?utm_source=E7PZL9)

Meshy is an easy to use web-service which offers a broad range of generative AI solutions.

It’s a paid service, everything costs coins, e.g. create the model, create the texture etc. expect to pay around 1$ per model until it’s finished.

Results are quite good, you can also add animation by text.

Result Model:

skfb.ly

Shutterstock Gen3D API + Blender

(https://www.shutterstock.com/de/discover/generative-ai-3d)

Shutterstock gen3d API is currently only a beta - there is a standalone client and plugins for Blender and Maya. I’ve tested with the Blender Plugin :

https://generative-static.shutterstock.com/apps/shutterstock_gen3d_blender_1_1_3.zip

Documentation | Shutterstock

The result is not really usable, took quite long to generate, doesnt have a preview — given the 25$ minimum subscription it’s rather disappointing.

Result:

https://skfb.ly/psONr

Microsoft TRELLIS 3D

Microsoft TRELLIS is so far the best solution if you own a RTX A6000 graphics card because you can run it locally without additional costs and the resulting models are quite nice.

Result:

https://skfb.ly/psOLC

stability.ai stable-fast-3d

I just came across the stable-fast-3d solution — it’s fast but the results are better than shutterstock but not as good as meshy and TRELLIS.

Result:

https://skfb.ly/psOLA