Gyeongmin "Chris" Choe

Gyeongmin "Chris" Choe, Ph.D 

Research Scientist, Meta (Facebook) Reality Labs Email: cgchoe [at] fb.com 

I'm a research scientist at Meta Reality Labs. Prior to joining Meta, I have spent 3 years in Samsung Research America researching and developing AI, computer vision and image processing algorithms for Samsung's flagship Galaxy smartphones. I received my Ph.D in Computer Vision from KAIST in 2018. I was a visiting researcher at Robotics Institute, CMU in 2015.

Work Experiences

Meta Reality labs

2021 - Current, Sunnyvale, CA

Senior Research Scientist, Research on Computer Vision and Machine learning for AR/VR 

FSID: Fully Synthetic Image Denoising via Procedural Scene Generation,

Gyeongmin Choe, Beibei Du, Seonghyeon Nam, Xiaoyu Xiang, Bo Zhu, Rakesh Ranjan, arXiv preprint arXiv:2212.03961, 2022 


Consistent Direct Time-of-Flight Video Depth Super-Resolution,

Zhanghao Sun, Wei Ye, Jinhui Xiong, Gyeongmin Choe, Jialiang Wang, Shuochen Su, Rakesh Ranjan,  arXiv preprint arXiv:2211.08658, 2022  


Samsung Research America

2018 - 2021, Plano, TX

Senior Research Engineer, AI Computer Vision, Image/Video Processing for Flagship Galaxy Smartphone Cameras 

Synthetic AI HDR

Sensor-realistic Synthetic Data Engine for Multi-frame High Dynamic Range Photography,

J Hu, G Choe, Z Nadir, O Nabil, SJ Lee, H Sheikh, Y Yoo, M Polley, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) - Ntire Workhop, 2020 


*intelligent Zoom

CLICK-AND-LOCK ZOOM CAMERA USER INTERFACE, G Choe, HR Sheikh, JS Lee, Y Yoo - US Patent App. 16/947,274, 2021

* Click-and-lock zoom patent has been technology transferred to Galaxy S21. This video is from Galaxy S21 Ultra: Untold Stories – Camera | Samsung "https://www.youtube.com/watch?v=FzshLMEVbrU"

VIDEO INTEROLATION AND OPTICAL FLOW

Research at kaist & CMU

3D depth estimation and enhancement. 

RAL 2017 - RANUS

RANUS: RGB and NIR Urban Scene Dataset for Deep Scene Parsing,

Gyeongmin Choe, Seong-heum Kim, Sunghoon Im, Joon-Young Lee, Srinivasa Narasimhan, and In So Kweon,  

IEEE Robotics and Automation Letters (RAL), Feb. 2018

[Project page] [Dataset]


CVPR 2016 - NISAR

Simultaneous Estimation of Near IR BRDF and Fine-Scale Surface Geometry,


Gyeongmin Choe, Srinivasa G. Narasimhan, and In So Kweon, 

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2016. Spotlight 

IJCV 2017 - KINIR

Refining Geometry from Depth Sensors using IR Shading Images,

Gyeongmin Choe, Jaesik Park, Yu-Wing Tai and, In So Kweon,  

International Journal of Computer Vision (IJCV), Mar. 2017

ECCV 2016 - Deep NIR

Fine-scale Surface Normal Estimation using a Single NIR Image,

Youngjin Yoon*, Gyeongmin Choe*, Namil Kim, Joon-Young Lee, and In So Kweon, 

European Conference on Computer Vision (ECCV), Oct. 2016. 

TPAMI 2018 - Lf Depth

Depth from a Light Field Image with Learning-based Matching Costs,

Hae-Gon Jeon, Jaesik Park, Gyeongmin Choe, Jinsun Park, Yunsu Bok, Yu-Wing Tai, and In So Kweon,  

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2018

TPAMI 2018- RS Depth

Accurate 3D  Reconstruction for Small Motion Clip for Rolling Shutter Cameras ,

Sunghoon Im, Hyowon Ha, Gyeongmin Choe, Hae-Gon Jeon, Kyungdon Joo and In So Kweon,

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2018

Salient View Selection for Visual Recognition of Industrial Components, S Kim, G Choe, M Park, IS Kweon,  IEEE RA-L, ICRA 2020

High Quality Structure from Small Motion for Rolling Shutter Cameras, S Im, H Ha, G Choe, H Jeon, K Joo, and IS Kweon, ICCV 2015.


Reflection Removal using Disparity and Gradient-Sparsity via Smoothing Algorithm ,

Tharatch Sirinukulwattana, Gyeongmin Choe, and In So Kweon, 

IEEE International Conference on Image Processing (ICIP), Sep. 2015 

A Taxonomy and Evaluation of Dense Light Field Depth Estimation Algorithms ,

O Johannsen etal.

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) Workshop - Light Field for Computer Vision, Jul. 2017. 

Depth from Accidental Motion using Geometry Prior ,

Sunghoon Im, Gyeongmin Choe, Hae-Gon Jeon, and In So Kweon, 

IEEE International Conference on Image Processing (ICIP) [Top 10% paper], Sep. 2015. 

Exploiting Shading Cues in Kinect IR Images for Geometry Refinement,

Gyeongmin Choe, Jaesik Park, Yu-Wing Tai, and In So Kweon, 

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2014.

Accurate Depth Map Estimation from a Lenslet Light Field Camera,

Hae-Gon Jeon, Jaesik Park, Gyeongmin Choe, Jinsun Park, Yunsu Bok, Yu-Wing Tai, and In So Kweon,

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2015.



Educations

Ph.D, KAIST (Integrated master's and doctor's course)  Feb. 2012 - Aug.2018

Computer Vision 

Advisor: Prof. In So Kweon 

Visiting Ph.D student, CMU  Jul. 2015 - Dec.2015

Advisor: Prof. Srinivasa Narasimhan

B.S, KAIST Feb. 2008 - Feb.2012

Mechanical Engineering

Patents

Gyeongmin Choe, Hamid R Sheikh, John Seokjun Lee, Youngjun Yoo, “Click-and-lock zoom camera user interface”, US Patent 11297244

Gyeongmin Choe, Yingmao Li, John Seokjun Lee, Hamid R Sheikh, Michael O Polley, “Accurate optical flow interpolation optimizing bi-directional consistency and temporal smoothness”, US Patent App. 17/591,350

Gyeongmin Choe, Yingmao Li, John Seokjun Lee, Hamid R Sheikh, Michael O Polley, “Pixel blending for synthesizing video frames with occlusion and watermark handling”, US Patent App. 17/591,040

Chenchi Luo, Gyeongmin Choe, Yingmao Li, Zeeshan Nadir, Hamid R Sheikh, John Seokjun Lee, Youngjun Yoo, “Multi-sensor, multi-view, multi-frame, multi-task synthetic image fusion engine for mobile imaging system”, US Patent App. 17/135,573

Chenchi Luo, Yingmao Li, Youngjun Yoo, George Q Chen, Kaimo Lin, David D Liu, Gyeongmin Choe “Asymmetric normalized correlation layer for deep neural network feature matching”, US Patent 11,132,772

METHOD AND APPARATUS OF FINE-SCALE SURFACE NORMAL ESTIMATION USING SINGLE NIR IMAGE, AND NEURAL NETWORK LEARNING METHOD

kr 10-2017-0112107 / Application date: Sep. 2017 

APPARATUS AND METHOD FOR DEPTH MAP GENERATION

kr 10-1745493-0000 / Registration date: Jun. 2017

DEVICE AND METHOD FOR OBTAINING ACCURATE 3D INFORMATION USING DEPTH SENSOR AND INFRARED SHADING CUES

kr 10-1707939-0000 / Registration date: Feb. 2017

METHOD AND APPARATUS FOR ACQUIRING DEPTH MAP FROM ALL-AROUND CAMERA

kr 10-2016-0167525 / Application date: Dec. 2016 

METHOD AND SYSTEM FOR ESTIMATING SURFACE GEOMETRY AND REFLECTANCE

kr 10-2016-0167526 / Application date: Dec. 2016  


Reviewer

IEEE Transactions on Image Processing (TIP)

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR)

IEEE International Conference on Robotics and Automation (ICRA)

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR)

Asian Conference on Computer Vision (ACCV)

Computer Vision and Image Understanding (CVIU)

Computational Visual Media Conference (CVM)

Computer Science and Application Engineering (CSAE)

Awards

- Grant, ICCV Doctoral Consortium, Venice, Italy, Oct. 2017

- Depth estimation challenge: robustness champion, CVPR workshop on Light Fields for Computer Vision, Jul. 2017 [Prize]

- Best Poster Presentation Award, IPIU 2017, Korea, Feb. 2017 [Prize]

- Best Poster Award, The 11th IWRCV, Korea, Dec. 2016 [Prize] 

- Grand prize (1st place), BK 21 plus overseas study report competition, KAIST, Jul. 2016 [Prize] 

- Best Poster Award, The 10th IWRCV, China, Nov. 2015 [Prize] 

- Official Best 10% Paper Selection, ICIP 2015 Organizing Committee, Sep. 2015 

- Oral presentation, The 9th IWRCV, Japan, Dec. 2014 

- Certificate, International Computer Vision Summer School (ICVSS 2014), Sicily, Italy, Jul. 2014 [Certificate] 

- Silver prize (2nd place), 20th HumanTech Paper Award, Samsung Electronics Corp., Feb. 2014 [Prize] 

- Student volunteer, Asian Conference on Computer Vision (ACCV 2012), Daejeon, Korea, Nov. 2012 

- Full scholarship, KAIST, Feb. 2008 ~ Feb. 2012 

- Scholarship, Samsung Electronics Corp., Feb. 2008 

- Silver Prize(2nd place), 13th HumanTech Paper Award, Samsung Electronics Corp., Feb. 2007