Learning for 3D Homeworks

Homeworks in CMU 16-825: Learning for 3D Vision.

Assignment1: Rendering Basics with PyTorch3D

Practicing with Cameras

Rendering Your First Mesh

Practicing with Cameras

360-degree Renders

Re-creating the Dolly Zoom

Practicing with Meshes

Constructing a Tetrahedron

Constructing a Cube

Re-texturing a Mesh

Rendering Generic 3D Representations

Rendering Point Clouds from RGB-D Images

RGBD-1
RGBD-2
Union of Two Point Cloud

Parametric Functions

Sphere
Torus

Implicit Surfaces

Sphere
Torus

Sampling Points on Meshes

Assignment2: Single View to 3D

Exploring Loss Functions

Fitting A Voxel Grid

Ground Truth
Prediction

Fitting A Point Cloud

Ground Truth
Prediction

Fitting A Mesh

Ground Truth
Prediction

Reconstructing 3D from Single View

Image To Voxel Grid

Image
Voxel

Image To Point Cloud

Image
Voxel

Image To Mesh

Image
Voxel

Assignment3: Volume Rendering, Neural Radiance Fields, Neural Surfaces

Neural Volume Rendering

Volume Rendering

Color Rendering
Depth

Optimizing A Basic Implicit Volume

Optimizing A NeRF

Neural Surface Rendering

Sphere Tracing

Optimizing A Neural SDF

Input Point Cloud
Fitted SDF

VolSDF

SDF To Density
Color Prediction

Assignment4: 3D Gaussian Splatting and Diffusion Guided Optimization

3D Gaussian Splatting

3D Gaussian Rasterization

Training 3D Gaussian Representations

GS Rendering
Training Progress

Rendering Using Spherical Harmonics

Training A Harder Scene

GS Rendering
Training Progress

Diffusion-guided Optimization

SDS Loss + Image Optimization

A Hamburger
A Standing Corgi Dog
A Lego Toy
A Picasso Drawing
A Piet Mondrian Drawing
A Vincent van Gogh Drawing

Texture Map Optimization for Mesh

A Chocolate Cow
A Cow Sculpture
A Marble Cow

NeRF Optimization

I met some problem compiling gridencoder and failed to train the model. Maybe finish this part in the future…

Assignment5: Point Cloud Processing

PointNet for Segmentation

PointNet++ for Segmentation

Seems that PointNet++ does not improve the performance. Maybe need more effort fine tuning…