<blockquote>
  <p>Is there any 3D software that supports rendering an artificial scene to a light field image?</p>
</blockquote>

<p>I took a look at Myst and <a href="https://youtu.be/m2kKsFjZwx8?t=5m16s" rel="nofollow noreferrer">realMyst</a>, and found this YouTube video: "<a href="https://youtu.be/e18brgSS_F0" rel="nofollow noreferrer">LightField synthesis &amp; realtime render in Unity - sneak preview (raw footage)</a>" with accompanying background <a href="https://www.reddit.com/r/oculus/comments/2qjqr3/i_got_lightfield_synthesis_and_rendering_working/" rel="nofollow noreferrer">introductory information from Frooxius on Reddit</a>. You can see the pipeline he used to convert lightfields, though copying it may be a challenge. He has obtained pretty good results.</p>

<p>So the answer is yes.</p>

<blockquote>
  <p>I guess animations would be out almost of the question. It should at least in theory be easier to incorporate animations in cgi-light fields than in real photos.</p>
</blockquote>

<p>It's an interesting experiment but the scene is baked, adding characters or new objects will kind of look like cutting out one photograph and pasting onto another - thus what you hoped to gain in speed is lost trying to smooth the two scenes together.</p>

<p>To walk into a scene and see a moving object you essentially need to create a dynamic 'lightfield movie' so the moving object can move normally and then you simply walk/look around the dynamic lightfield. That will be somewhat computationally intensive but most of all it will take a lot of memory.</p>

<p>Check out Frooxius' video and let me know if that's the <em>look</em> you were hoping for.</p>

<p>This webpage: "<a href="https://www.fxguide.com/featured/light-fields-the-future-of-vr-ar-mr/" rel="nofollow noreferrer">Light fields – the future of VR-AR-MR</a>" by Mike Seymour (May 26, 2015) says:</p>

<blockquote>
  <p>"The Octane renderer has plugins for a range of products from 3DsMax to Maya and even Nuke.".</p>
</blockquote>

<p>There's mention of OTOY and on their website the latest announced is: "<a href="https://home.otoy.com/unreal-engine-announcement-siggraph/" rel="nofollow noreferrer">OTOY and Epic announce OctaneRender® 2019 for UnrealEngine 4</a>", their <a href="https://home.otoy.com/render/octane-render/demo/" rel="nofollow noreferrer">DEMO version</a> is free, the least expensive paid version is U$400.</p>

CC BY-SA 4.0
2018-09-05T10:53:38.043Z
Cool. Yeah that's exactly what I was thinking of. Three years ago, that's impressive. I wonder how it's going...
Andreas Zita
CC BY-SA 4.0
2018-09-05T13:12:43.520Z
@AndreasZita - I'll do some more research and see if I can improve this answer.
Rob
CC BY-SA 4.0
2018-09-06T09:08:42.053Z
@AndreasZita - Answer improved.
Rob
CC BY-SA 4.0
2018-09-04T23:46:36.673Z
2018-09-06T09:08:10.780Z
2018-09-06T09:08:10.780Z
Rob
<p>Is there any 3d software that supports rendering an artificial scene to a light field image?</p>

<p>With that I mean an image capturing light from more than one point in a scene, more lika a spherical volume of evenly distributed points.</p>

<p>There is <a href="https://www.blog.google/products/google-ar-vr/experimenting-light-fields/" rel="nofollow noreferrer">research</a> being done by for instance P Debevec for Google VR that does this for physical scenes with an expensive camera rig. I would like to be able to render the same output but from an artificial scene, in for instance 3dsmax. And then preferably use this in for instance Unity 3D.</p>

<p>Would be awesome for a Myst-like game with high fidelity ray traced graphics instead of low-poly rasterized real time graphics. But I guess animations would be almost out of the question. It should at least in theory be easier to incorporate animations in cgi-light fields than in real photos.</p>

<raytracing><3d>
Light field rendering for 3d software?
Andreas Zita
# Light field rendering for 3d software?

(Asked by: username_0 on 2018-09-02)

Is there any 3d software that supports rendering an artificial scene to a light field image?

With that I mean an image capturing light from more than one point in a scene, more lika a spherical volume of evenly distributed points.

There is [research](https://www.blog.google/products/google-ar-vr/experimenting-light-fields/) being done by for instance P Debevec for Google VR that does this for physical scenes with an expensive camera rig. I would like to be able to render the same output but from an artificial scene, in for instance 3dsmax. And then preferably use this in for instance Unity 3D.

Would be awesome for a Myst-like game with high fidelity ray traced graphics instead of low-poly rasterized real time graphics. But I guess animations would be almost out of the question. It should at least in theory be easier to incorporate animations in cgi-light fields than in real photos.

**Tags:** raytracing, 3d


---

## 1 answers

### Answer by username_1 on 2018-09-04. Score: 2 | Accepted answer

> Is there any 3D software that supports rendering an artificial scene to a light field image?

I took a look at Myst and [realMyst](https://youtu.be/m2kKsFjZwx8?t=5m16s), and found this YouTube video: "[LightField synthesis & realtime render in Unity - sneak preview (raw footage)](https://youtu.be/e18brgSS_F0)" with accompanying background [introductory information from Frooxius on Reddit](https://www.reddit.com/r/oculus/comments/2qjqr3/i_got_lightfield_synthesis_and_rendering_working/). You can see the pipeline he used to convert lightfields, though copying it may be a challenge. He has obtained pretty good results.

So the answer is yes.

> I guess animations would be out almost of the question. It should at least in theory be easier to incorporate animations in cgi-light fields than in real photos.

It's an interesting experiment but the scene is baked, adding characters or new objects will kind of look like cutting out one photograph and pasting onto another - thus what you hoped to gain in speed is lost trying to smooth the two scenes together.

To walk into a scene and see a moving object you essentially need to create a dynamic 'lightfield movie' so the moving object can move normally and then you simply walk/look around the dynamic lightfield. That will be somewhat computationally intensive but most of all it will take a lot of memory.

Check out Frooxius' video and let me know if that's the *look* you were hoping for.

This webpage: "[Light fields – the future of VR-AR-MR](https://www.fxguide.com/featured/light-fields-the-future-of-vr-ar-mr/)" by Mike Seymour (May 26, 2015) says:

> "The Octane renderer has plugins for a range of products from 3DsMax to Maya and even Nuke.".

There's mention of OTOY and on their website the latest announced is: "[OTOY and Epic announce OctaneRender® 2019 for UnrealEngine 4](https://home.otoy.com/unreal-engine-announcement-siggraph/)", their [DEMO version](https://home.otoy.com/render/octane-render/demo/) is free, the least expensive paid version is U$400.

> **Comments:**
> **username_0**: Cool. Yeah that's exactly what I was thinking of. Three years ago, that's impressive. I wonder how it's going...  
> **username_1**: @username_0 - I'll do some more research and see if I can improve this answer.  
> **username_1**: @username_0 - Answer improved.  

---

