Real-time 3D Human Body Scanning, Measurement, and Analysis using Kinects + Thermal Sensors

Project Overview

  • We are developing a real-time 3D body scanning system to provide efficient and automatic 3D geometric + thermal body scan.
  • The measurements and analysis on the human body are important tasks in multiple biomedical research tasks. Rather than performing the physical measurements the subject, we aim to efficiently acquire the digital models through real-time body scans upon which various digital measurements and computer-aided analysis can be conducted.
  • We have conducted digital scanning, at Pennington Biomedical Research Center, on 150+ human subjects.
  • One or multiple Microsoft Kinect sensors are used to scan RGB and depth information; a Xenics Gobi 640 long-wave infrared camera is used to scan thermal information.
  • Key Technologies: 3D Range Image Processing; Occluded/incomplete Data Completion; Fusion and Integration of Multimodal Data.

    • 3D+Thermal Body Scanning (Spring 2018)

    Demo: Scanned 3D-Thermal Models

    3D Body Scanning (Summer 2013)

    Scanned Digital Models

    Selected Publications

    1. Depth and Thermal Sensor Fusion to Enhance 3D Thermographic Reconstruction,
      Y. Cao, B. Xu, Z. Ye, J. Yang, Y. Cao, C. Tisse, and X. Li
      Optics Express, 26(7), pp. 8179-8193, 2018.
    2. Digital Anthropometry: A Critical Review,
      S. Heymsfield, B. Bourgeois, B. Ng, M. Sommer, X. Li, and J. Shepherd
      European Journal of Clinical Nutrition, to appear, 2018.
    3. Clinically-Applicable Optical Imaging Technology for Body Size and Shape Analysis: Comparison of Systems Differing in Design,
      B. Bourgeois, B. Ng, D. Latimer, C. Stannard, L. Romeo, X. Li, J. Shepherd, S. Heymsfield
      European Journal of Clinical Nutrition, 71(11):1329-1335, 2017.
    4. Automated Anthropometric Phenotyping with Novel Kinect-based Three-Dimensional Imaging Method: Comparison to a Reference Laser Imaging System,
      L. Soileau, D. Bautista, C. Johnson, C. Gao, K. Zhang+, X. Li, S. Heymsfield, D. Thomas, and J. Zheng,
      European Journal of Clinical Nutrition, 70(4):475-481, 2016.

    Sponsors

    Part of this research was supported by Pennington Biomedical Research Center.