Soybean leaf 3D semantic reconstruction for plant phenotype analysis
CSTR:
Author:
Affiliation:

1.College of Mathematics and Informatics,South China Agricultural University, Guangzhou 510642,China;2.School of Computer Science & Engineering,South China University of Technology, Guangzhou 510006,China;3.College of Agriculture,South China Agricultural University,Guangzhou 510642,China;4.Guangzhou Key Laboratory of Intelligent Agriculture,Guangzhou 510642,China

Clc Number:

S126

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related [20]
  • |
  • Cited by
  • | |
  • Comments
    Abstract:

    The 3D point clouds obtained from 3D scanner and multi-view data lack semantic information,leading to difficulties in discriminating the plant organ parts from the point clouds when the number of plant point clouds is large,or when different organs of the plant are similarly colored or obscured.To deal with the problem,this article proposes a three-dimensional semantic modeling method for soybean leaves embedded with a two-dimensional semantic prior.The semantic segmentation of soybean leaves based on Mask R-CNN was conducted.The three-dimensional reconstruction,fusion and learning of the segmentation results and multi-view data were performed to transfer the semantic information of leave from 2D semantics to 3D point clouds and obtain the point cloud semantic information of plant leaf.The 3D semantic model of plant leaves was established.The model was validated through multiple sets of potted soybean plant experiments.The length and width of leaf were extracted and compared with the manual measurement data.Results showed that the mean square error of the length and width of leaf was 2.53 and 1.52 mm,with the determination coefficients of 0.97 and 0.89,respectively.It is indicated that the proposed method can conveniently and accurately construct the 3D semantic model of plant leaves.

    Table 1 Reconstruction cost of soybean plant with/without leaf semantic information
    Fig.1 Data acquisition platform and structure diagram
    Fig.2 Samples of soybean plant with leaf label
    Fig.3 Pipeline of semantic model of soybean plant leaf
    Fig.4 Semantic segmentation of soybean plant leaf
    Fig.5 Sparse reconstruction process of soybean plant with leaf semantics
    Fig.6 Flow chart of dense reconstruction of soybean plant with leaf semantics
    Fig.7 3D reconstruction of soybean plant under different scenes
    Fig.8 Leaf semantics segmentation of different soybean plant seedlings
    Fig.9 Soybean plant point cloud based on with/without leaf semantic information
    Fig.10 Soybean leaf semantic point cloud extraction
    Fig.11 Accuracy comparison of soybean leaf measurement
    Fig.12 Semantic point cloud of soybean plants with different sizes
    Fig.13 Semantic reconstruction of soybean plant leaves from the same plant with different images
    Table 3 Reconstruction cost of soybean plant with leaf semantic information
    Table 2 Phenotypic measurement of length and width of leaves
    Reference
    Cited by
Get Citation

高月芳,肖冬冬,傅汝佳,冼楚华,李桂清,黄琼,杨存义. Soybean leaf 3D semantic reconstruction for plant phenotype analysis[J]. Jorunal of Huazhong Agricultural University,2023,42(3):177-186.

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:November 19,2022
  • Online: June 20,2023
Article QR Code