point-e icon indicating copy to clipboard operation
point-e copied to clipboard

Poor Output from PLY

Open AmanKishore opened this issue 3 years ago • 7 comments

I'm getting really poor output from the PLY: image

Am I using marching_cubes_mesh incorrectly?

mesh = marching_cubes_mesh(
    pc=pc,
    model=model,
    batch_size=4096,
    grid_size=256, # increase to 128 for resolution used in evals
    progress=True,
)
image

AmanKishore avatar Dec 21 '22 19:12 AmanKishore

I have the same problem.

giddyyupp avatar Dec 21 '22 19:12 giddyyupp

Now I have an error

AttributeError                            Traceback (most recent call last)
[<ipython-input-12-9f81ccec745d>](https://localhost:8080/#) in <module>
      1 # Produce a mesh (with vertex colors)
----> 2 mesh = marching_cubes_mesh(
      3     pc=pc,
      4     model=model,
      5     batch_size=4096,

[/content/point-e/point_e/util/pc_to_mesh.py](https://localhost:8080/#) in marching_cubes_mesh(pc, model, batch_size, grid_size, side_length, fill_vertex_channels, progress)
     68         volume_np -= np.mean(volume_np)
     69 
---> 70     verts, faces, normals, _ = skimage.measure.marching_cubes(
     71         volume=volume_np,
     72         level=0,

AttributeError: module 'skimage' has no attribute 'measure'

fractaltr33 avatar Dec 21 '22 19:12 fractaltr33

And I have a question, how can I save my .npz file?

fractaltr33 avatar Dec 21 '22 19:12 fractaltr33

@fractaltr33 Check out #8 for saving .npz file. You probably need to do pip install --upgrade scikit-image

AmanKishore avatar Dec 21 '22 19:12 AmanKishore

@AmanKishore I'm far from programming, how should I use save() in colab?

fractaltr33 avatar Dec 21 '22 20:12 fractaltr33

Add this line at the end of the file pc.save('pointcloud.npz')

AmanKishore avatar Dec 21 '22 20:12 AmanKishore

The quality issue in the initial post is likely not a bug, but an actual case where the point cloud -> mesh model doesn't do a great job. There are some tricks that might improve quality, like adding some bias to the SDF predictions to thicken the object, or applying smoothing to the points in the point cloud, but there will always be some cases like this.

In the future, the meshing quality could be improved by using other, more advanced existing techniques like SAP. The method we use based on SDF regression can suffer with thin parts or noisy point clouds, as shown in the paper. This is probably a bigger problem with the small text2pc model, since the model is less large and therefore less capable of producing clean pointclouds.

Screenshot_20221222-121431

unixpickle avatar Dec 22 '22 17:12 unixpickle