Gyeongmin "Chris" Choe
Gyeongmin "Chris" Choe, Ph.D
Research Scientist, Meta (Facebook) Reality Labs Email: cgchoe [at] fb.com
I'm a research scientist at Meta Reality Labs. Prior to joining Meta, I have spent 3 years in Samsung Research America researching and developing AI, computer vision and image processing algorithms for Samsung's flagship Galaxy smartphones. I received my Ph.D in Computer Vision from KAIST in 2018. I was a visiting researcher at Robotics Institute, CMU in 2015.
Work Experiences
Meta Reality labs
2021 - Current, Sunnyvale, CA
Senior Research Scientist, Research on Computer Vision and Machine learning for AR/VR
FSID: Fully Synthetic Image Denoising via Procedural Scene Generation,
Gyeongmin Choe, Beibei Du, Seonghyeon Nam, Xiaoyu Xiang, Bo Zhu, Rakesh Ranjan, arXiv preprint arXiv:2212.03961, 2022
Consistent Direct Time-of-Flight Video Depth Super-Resolution,
Zhanghao Sun, Wei Ye, Jinhui Xiong, Gyeongmin Choe, Jialiang Wang, Shuochen Su, Rakesh Ranjan, arXiv preprint arXiv:2211.08658, 2022
Samsung Research America
2018 - 2021, Plano, TX
Senior Research Engineer, AI Computer Vision, Image/Video Processing for Flagship Galaxy Smartphone Cameras
Synthetic AI HDR
Sensor-realistic Synthetic Data Engine for Multi-frame High Dynamic Range Photography,
J Hu, G Choe, Z Nadir, O Nabil, SJ Lee, H Sheikh, Y Yoo, M Polley, IEEE Conference on Computer Vision and Pattern Recognition (CVPR) - Ntire Workhop, 2020
*intelligent Zoom
CLICK-AND-LOCK ZOOM CAMERA USER INTERFACE, G Choe, HR Sheikh, JS Lee, Y Yoo - US Patent App. 16/947,274, 2021
* Click-and-lock zoom patent has been technology transferred to Galaxy S21. This video is from Galaxy S21 Ultra: Untold Stories – Camera | Samsung "https://www.youtube.com/watch?v=FzshLMEVbrU"
VIDEO INTEROLATION AND OPTICAL FLOW
Pixel blending for synthesizing video frames with occlusion and watermark handling, G.Choe etal, US Patent App. 17/591,040
Accurate optical flow interpolation optimizing bi-directional consistency and temporal smoothness, G.Choe etal, US Patent App. 17/591,350
Research at kaist & CMU
3D depth estimation and enhancement.
RAL 2017 - RANUS
RANUS: RGB and NIR Urban Scene Dataset for Deep Scene Parsing,
Gyeongmin Choe, Seong-heum Kim, Sunghoon Im, Joon-Young Lee, Srinivasa Narasimhan, and In So Kweon,
IEEE Robotics and Automation Letters (RAL), Feb. 2018
CVPR 2016 - NISAR
Simultaneous Estimation of Near IR BRDF and Fine-Scale Surface Geometry,
Gyeongmin Choe, Srinivasa G. Narasimhan, and In So Kweon,
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2016. Spotlight
IJCV 2017 - KINIR
Refining Geometry from Depth Sensors using IR Shading Images,
Gyeongmin Choe, Jaesik Park, Yu-Wing Tai and, In So Kweon,
International Journal of Computer Vision (IJCV), Mar. 2017
ECCV 2016 - Deep NIR
Fine-scale Surface Normal Estimation using a Single NIR Image,
Youngjin Yoon*, Gyeongmin Choe*, Namil Kim, Joon-Young Lee, and In So Kweon,
European Conference on Computer Vision (ECCV), Oct. 2016.
TPAMI 2018 - Lf Depth
Depth from a Light Field Image with Learning-based Matching Costs,
Hae-Gon Jeon, Jaesik Park, Gyeongmin Choe, Jinsun Park, Yunsu Bok, Yu-Wing Tai, and In So Kweon,
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2018
TPAMI 2018- RS Depth
Accurate 3D Reconstruction for Small Motion Clip for Rolling Shutter Cameras ,
Sunghoon Im, Hyowon Ha, Gyeongmin Choe, Hae-Gon Jeon, Kyungdon Joo and In So Kweon,
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2018
Salient View Selection for Visual Recognition of Industrial Components, S Kim, G Choe, M Park, IS Kweon, IEEE RA-L, ICRA 2020
High Quality Structure from Small Motion for Rolling Shutter Cameras, S Im, H Ha, G Choe, H Jeon, K Joo, and IS Kweon, ICCV 2015.
Reflection Removal using Disparity and Gradient-Sparsity via Smoothing Algorithm ,
Tharatch Sirinukulwattana, Gyeongmin Choe, and In So Kweon,
IEEE International Conference on Image Processing (ICIP), Sep. 2015
A Taxonomy and Evaluation of Dense Light Field Depth Estimation Algorithms ,
O Johannsen etal.
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) Workshop - Light Field for Computer Vision, Jul. 2017.
Depth from Accidental Motion using Geometry Prior ,
Sunghoon Im, Gyeongmin Choe, Hae-Gon Jeon, and In So Kweon,
IEEE International Conference on Image Processing (ICIP) [Top 10% paper], Sep. 2015.
Exploiting Shading Cues in Kinect IR Images for Geometry Refinement,
Gyeongmin Choe, Jaesik Park, Yu-Wing Tai, and In So Kweon,
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2014.
Accurate Depth Map Estimation from a Lenslet Light Field Camera,
Hae-Gon Jeon, Jaesik Park, Gyeongmin Choe, Jinsun Park, Yunsu Bok, Yu-Wing Tai, and In So Kweon,
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2015.
Educations
Ph.D, KAIST (Integrated master's and doctor's course) Feb. 2012 - Aug.2018
Computer Vision
Advisor: Prof. In So Kweon
B.S, KAIST Feb. 2008 - Feb.2012
Mechanical Engineering
Patents
Gyeongmin Choe, Hamid R Sheikh, John Seokjun Lee, Youngjun Yoo, “Click-and-lock zoom camera user interface”, US Patent 11297244
Gyeongmin Choe, Yingmao Li, John Seokjun Lee, Hamid R Sheikh, Michael O Polley, “Accurate optical flow interpolation optimizing bi-directional consistency and temporal smoothness”, US Patent App. 17/591,350
Gyeongmin Choe, Yingmao Li, John Seokjun Lee, Hamid R Sheikh, Michael O Polley, “Pixel blending for synthesizing video frames with occlusion and watermark handling”, US Patent App. 17/591,040
Chenchi Luo, Gyeongmin Choe, Yingmao Li, Zeeshan Nadir, Hamid R Sheikh, John Seokjun Lee, Youngjun Yoo, “Multi-sensor, multi-view, multi-frame, multi-task synthetic image fusion engine for mobile imaging system”, US Patent App. 17/135,573
Chenchi Luo, Yingmao Li, Youngjun Yoo, George Q Chen, Kaimo Lin, David D Liu, Gyeongmin Choe “Asymmetric normalized correlation layer for deep neural network feature matching”, US Patent 11,132,772
METHOD AND APPARATUS OF FINE-SCALE SURFACE NORMAL ESTIMATION USING SINGLE NIR IMAGE, AND NEURAL NETWORK LEARNING METHOD
kr 10-2017-0112107 / Application date: Sep. 2017
APPARATUS AND METHOD FOR DEPTH MAP GENERATION
kr 10-1745493-0000 / Registration date: Jun. 2017
DEVICE AND METHOD FOR OBTAINING ACCURATE 3D INFORMATION USING DEPTH SENSOR AND INFRARED SHADING CUES
kr 10-1707939-0000 / Registration date: Feb. 2017
METHOD AND APPARATUS FOR ACQUIRING DEPTH MAP FROM ALL-AROUND CAMERA
kr 10-2016-0167525 / Application date: Dec. 2016
METHOD AND SYSTEM FOR ESTIMATING SURFACE GEOMETRY AND REFLECTANCE
kr 10-2016-0167526 / Application date: Dec. 2016
Reviewer
IEEE Transactions on Image Processing (TIP)
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR)
IEEE International Conference on Robotics and Automation (ICRA)
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR)
Asian Conference on Computer Vision (ACCV)
Computer Vision and Image Understanding (CVIU)
Computational Visual Media Conference (CVM)
Computer Science and Application Engineering (CSAE)
Awards
- Grant, ICCV Doctoral Consortium, Venice, Italy, Oct. 2017
- Depth estimation challenge: robustness champion, CVPR workshop on Light Fields for Computer Vision, Jul. 2017 [Prize]
- Best Poster Presentation Award, IPIU 2017, Korea, Feb. 2017 [Prize]
- Best Poster Award, The 11th IWRCV, Korea, Dec. 2016 [Prize]
- Grand prize (1st place), BK 21 plus overseas study report competition, KAIST, Jul. 2016 [Prize]
- Best Poster Award, The 10th IWRCV, China, Nov. 2015 [Prize]
- Official Best 10% Paper Selection, ICIP 2015 Organizing Committee, Sep. 2015
- Oral presentation, The 9th IWRCV, Japan, Dec. 2014
- Certificate, International Computer Vision Summer School (ICVSS 2014), Sicily, Italy, Jul. 2014 [Certificate]
- Silver prize (2nd place), 20th HumanTech Paper Award, Samsung Electronics Corp., Feb. 2014 [Prize]
- Student volunteer, Asian Conference on Computer Vision (ACCV 2012), Daejeon, Korea, Nov. 2012
- Full scholarship, KAIST, Feb. 2008 ~ Feb. 2012
- Scholarship, Samsung Electronics Corp., Feb. 2008
- Silver Prize(2nd place), 13th HumanTech Paper Award, Samsung Electronics Corp., Feb. 2007