[go: up one dir, main page]

JayBusch et al. - Google Patents

Head-mounted Photometric Stereo for Performance Capture

JayBusch et al.

View PDF
Document ID
7459419790683744824
Author
JayBusch A
PaulDebevec R

External Links

Snippet

Head-mounted cameras are an increasingly important tool for capturing facial performances to drive virtual characters. They provide a fixed, unoccluded view of the face, useful for observing motion capture dots or as input to video analysis. However, the 2D imagery …
Continue reading at scholar.archive.org (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • G06T15/60—Shadow generation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00221—Acquiring or recognising human faces, facial parts, facial sketches, facial expressions
    • G06K9/00268—Feature extraction; Face representation
    • G06K9/00281—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general

Similar Documents

Publication Publication Date Title
Bermano et al. Makeup lamps: Live augmentation of human faces via projection
Thies et al. Facevr: Real-time facial reenactment and eye gaze control in virtual reality
WO2022197024A1 (en) Point-based modeling of human clothing
JP6824279B2 (en) Head-mounted display for virtual reality and mixed reality with inside-out position, user body, and environmental tracking
US5870136A (en) Dynamic generation of imperceptible structured light for tracking and acquisition of three dimensional scene geometry and surface characteristics in interactive three dimensional computer graphics applications
US9940753B1 (en) Real time surface augmentation using projected light
Alexander et al. Creating a photoreal digital actor: The digital emily project
US20140176591A1 (en) Low-latency fusing of color image data
KR20200087757A (en) Full convolutional point of interest detection and description through homographic adaptation
US20090324017A1 (en) Capturing and processing facial motion data
AU2018292610A1 (en) Method and system for performing simultaneous localization and mapping using convolutional image transformation
Zhao et al. Mask-off: Synthesizing face images in the presence of head-mounted displays
US20240257419A1 (en) Virtual try-on via warping and parser-based rendering
Malleson et al. Rapid one-shot acquisition of dynamic VR avatars
Fukamizu et al. Elamorph projection: Deformation of 3d shape by dynamic projection mapping
WO2023280082A1 (en) Handle inside-out visual six-degree-of-freedom positioning method and system
Zheng Spatio-temporal registration in augmented reality
Casas et al. Rapid photorealistic blendshape modeling from RGB-D sensors
Farbiz et al. Live three-dimensional content for augmented reality
Schindler Photometric stereo via computer screen lighting for real-time surface reconstruction
Wang et al. A context-aware light source
Teufel et al. Humanolat: A large-scale dataset for full-body human relighting and novel-view synthesis
Peng et al. Perceptually-aligned dynamic facial projection mapping by high-speed face-tracking method and lens-shift co-axial setup
JayBusch et al. Head-mounted Photometric Stereo for Performance Capture
KR20250108619A (en) Appearance capture