Point Cloud

Point Cloud ControlNet allows users to create or use an existing model converted into a point cloud to control the surface details, proportions, and overall shape of the new model. This method is beneficial for refining models, repairing low-quality 3D scans, and generating variants that maintain specific surface characteristics.

Use Case

• Example: Repairing a low-quality 3D scanned model by using its point cloud as a guide to generate a higher-quality version. Additionally, it can be combined with 2D image generation to create diverse variants of an existing model.

Example Representation

{
  "pcd_condition": [
    [0.5206083885457375, 0.7898993724346586, -0.01808462914092718],
    ...,
    []
  ],
  "pcd_condition_weight": 0.01
}

• pcd_condition: An array of arrays, each containing the X, Y, and Z coordinates of a point in the point cloud.

  • Each sub-array represents a point in 3D space that collectively defines the shape and surface characteristics of the model to be generated.

• pcd_condition_weight: A numerical value representing the weight or tolerance level for the point cloud condition.

  • This parameter allows flexibility in how strictly the model should adhere to the provided point cloud. A lower value means the model will more closely follow the point cloud, while a higher value allows for more variation.

---

For an example of a cURL request, please refer to the ControlNet Playground.

ControlNet Playground