<p>One method is to do <a href="https://en.wikipedia.org/wiki/Projection_mapping" rel="nofollow">projection mapping</a>. I understand that most 3D rendering applications can do that. I don't have much experience with them, but I have done it using AfterEffects using the Camera Mapper in <a href="http://aescripts.com/buena-depth-cue/" rel="nofollow">Buena Depth Cue</a>.</p>

<p>Algorithmically, it's achieved by projecting the geometry back onto the image to generate texture coordinates. So one way to do that is as follows:</p>

<ol>
<li>Line up the image of the scene in front of the corresponding geometry</li>
<li>For each triangle in your geometry, project the 3 corners onto the image</li>
<li>The coordinates where the projection hits your image are the texture coordinates you need for that triangle</li>
</ol>

CC BY-SA 3.0
2016-06-16T08:00:35.683Z
This is a solution for a single image or frame, not the while video. To use this, the texture maps for many frames will need to be stitched somehow... This is the main problem here.
Michael Litvin
CC BY-SA 3.0
2016-06-16T13:08:57.653Z
unknown @MichaelLitwin they dont need to be stitched, just masked. Its pretty easy all you do is you calculateuseful  how much the pixel area is facing the camera tha when the facing drops under a certain treshold mask it out. Then median filter the overlap to remove noise. Then either bake to 2D or just use the projection as is. Any projection works just as long as you can track the projector location in 3D
joojaa
CC BY-SA 3.0
2016-06-17T13:08:54.047Z
I don't understand - I'm using several images for texture. These images will meet somewhere, and edge lines won't necessarily meet at exactly the same place. How do I ensure they do?
Michael Litvin
CC BY-SA 3.0
2016-06-20T20:02:12.593Z
@MichaelLitvin you dont need to you can simply let them overlap.
joojaa
CC BY-SA 3.0
2016-06-16T04:04:10.187Z
2016-06-16T04:04:10.187Z
user1118321
<p>If I understand you correctly, you have a 3D model, and a video of the real world object? This sounds like a job for photogrammetry. Using a photogrammetry plugin, you can derive a model of what is seen in the video, and a texture map of it. The derived model probably won't be exactly like your 3D model, but you may be able to remap the texture map back onto your 3D model. Doing a search on photogrammetry and blender should give you some good links.</p>

CC BY-SA 3.0
2016-06-20T19:47:03.700Z
2016-06-20T19:47:03.700Z
Hanoixan
<p>I have a base 3D mesh of an object that I want to texturize. I also have a 360 degrees video of the real-world object.</p>

<p>What are good ways to use the video to texturize the mesh? Are there existing tools to do that? (paid or free)</p>

<p><strong>Edit</strong>: I have complete control over the camera and object positions, I can measure the distances and whatever needed. I can also put markers on the object.</p>

CC BY-SA 3.0
2016-06-15T09:26:46.287Z
Most 3d apps can do this.
joojaa
CC BY-SA 3.0
2016-06-15T13:28:24.457Z
Could you add some details?If you could explain the general process in Blender (or any other app) that would be great.
Michael Litvin
CC BY-SA 3.0
2016-06-16T08:01:23.600Z
I'm not asking about just Blender, though a suggestion for how to do this in Blender would be nice.
Michael Litvin
<algorithm><3d><3dtexture>
How to texturize a 3D model from video?
Michael Litvin
# How to texturize a 3D model from video?

(Asked by: username_0 on 2016-06-15)

I have a base 3D mesh of an object that I want to texturize. I also have a 360 degrees video of the real-world object.

What are good ways to use the video to texturize the mesh? Are there existing tools to do that? (paid or free)

**Edit**: I have complete control over the camera and object positions, I can measure the distances and whatever needed. I can also put markers on the object.

**Tags:** algorithm, 3d, 3dtexture

> **Comments:**
> **username_1**: Most 3d apps can do this.  
> **username_0**: Could you add some details?If you could explain the general process in Blender (or any other app) that would be great.  
> **username_0**: I'm not asking about just Blender, though a suggestion for how to do this in Blender would be nice.  

---

## 2 answers

### Answer by username_2 on 2016-06-16. Score: 1

One method is to do [projection mapping](https://en.wikipedia.org/wiki/Projection_mapping). I understand that most 3D rendering applications can do that. I don't have much experience with them, but I have done it using AfterEffects using the Camera Mapper in [Buena Depth Cue](http://aescripts.com/buena-depth-cue/).

Algorithmically, it's achieved by projecting the geometry back onto the image to generate texture coordinates. So one way to do that is as follows:

1. Line up the image of the scene in front of the corresponding geometry
2. For each triangle in your geometry, project the 3 corners onto the image
3. The coordinates where the projection hits your image are the texture coordinates you need for that triangle

> **Comments:**
> **username_0**: This is a solution for a single image or frame, not the while video. To use this, the texture maps for many frames will need to be stitched somehow... This is the main problem here.  
> **username_1**: unknown @MichaelLitwin they dont need to be stitched, just masked. Its pretty easy all you do is you calculateuseful  how much the pixel area is facing the camera tha when the facing drops under a certain treshold mask it out. Then median filter the overlap to remove noise. Then either bake to 2D or just use the projection as is. Any projection works just as long as you can track the projector location in 3D  
> **username_0**: I don't understand - I'm using several images for texture. These images will meet somewhere, and edge lines won't necessarily meet at exactly the same place. How do I ensure they do?  
> **username_1**: @username_0 you dont need to you can simply let them overlap.  

---

### Answer by username_3 on 2016-06-20. Score: 0

If I understand you correctly, you have a 3D model, and a video of the real world object? This sounds like a job for photogrammetry. Using a photogrammetry plugin, you can derive a model of what is seen in the video, and a texture map of it. The derived model probably won't be exactly like your 3D model, but you may be able to remap the texture map back onto your 3D model. Doing a search on photogrammetry and blender should give you some good links.


---

