Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sun RGB-D data generation for indoor 3D layouts #3

Open
jinzita142857 opened this issue Nov 26, 2023 · 4 comments
Open

Sun RGB-D data generation for indoor 3D layouts #3

jinzita142857 opened this issue Nov 26, 2023 · 4 comments

Comments

@jinzita142857
Copy link

Hello, your article is really wonderful, I am also very interested in your work, I have tried to generate a reasonable indoor 3D layout using Sun RGB-D data. But I don't know the specific implementation project, can you give some guidance?

@aluo-x
Copy link
Owner

aluo-x commented Nov 27, 2023

Hi @jinzita142857

Could you clarify what you are trying to achieve? Are you getting errors when trying to run my code?

I would be glad to help you out with your problems.

@jinzita142857
Copy link
Author

Hello, thank you very much for your reply. (Beginner) question: I plan to implement your "Example-based scene layout synthesis" section, but I don't know the specific steps. Can you give me some specific steps to do this? Thank you again and look forward to hearing from you.

@aluo-x
Copy link
Owner

aluo-x commented Nov 28, 2023

Our example-based scene layout synthesis was implemented approximately as follows:

  1. Given an image, we use "Cooperative Scene Parsing" to parse out 3D bounding boxes and object identities
  2. These bounding boxes are in world space coordinates, we can then take the centroid of each bounding box, and provide them to a rule based parser, which generates pair-wise object relations from the bounding box centroids. We do this using a modified "compute_rel" function, adapted to the coordinate space of "Cooperative Scene Parsing".
  3. Since we now have a scene graph, we can then generate new scenes based on 3D-SLN.

@jinzita142857
Copy link
Author

Thanks for the reply, I'm still trying.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants