[go: up one dir, main page]

Wei et al., 2020 - Google Patents

Object-based illumination estimation with rendering-aware neural networks

Wei et al., 2020

View PDF
Document ID
8392363304497353941
Author
Wei X
Chen G
Dong Y
Lin S
Tong X
Publication year
Publication venue
European Conference on Computer Vision

External Links

Snippet

We present a scheme for fast environment light estimation from the RGBD appearance of individual objects and their local image areas. Conventional inverse rendering is too computationally demanding for real-time applications, and the performance of purely …
Continue reading at arxiv.org (PDF) (other versions)

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • G06T15/60—Shadow generation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/06—Ray-tracing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20112—Image segmentation details
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30—Information retrieval; Database structures therefor; File system structures therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration, e.g. from bit-mapped to bit-mapped creating a similar image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformation in the plane of the image, e.g. from bit-mapped to bit-mapped creating a different image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06K—RECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00—Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints

Similar Documents

Publication Publication Date Title
Bi et al. Deep reflectance volumes: Relightable reconstructions from multi-view photometric images
Georgoulis et al. Reflectance and natural illumination from single-material specular objects using deep learning
Li et al. Physically-based editing of indoor scene lighting from a single image
Gao et al. Relightable 3d gaussians: Realistic point cloud relighting with brdf decomposition and ray tracing
Yao et al. Neilf: Neural incident light field for physically-based material estimation
Li et al. Monocular real-time volumetric performance capture
Tremblay et al. Rain rendering for evaluating and improving robustness to bad weather
Wang et al. Learning indoor inverse rendering with 3d spatially-varying lighting
Wei et al. Object-based illumination estimation with rendering-aware neural networks
Griffiths et al. OutCast: Outdoor Single‐image Relighting with Cast Shadows
Kronander et al. Photorealistic rendering of mixed reality scenes
Kán et al. Deeplight: light source estimation for augmented reality using deep learning
Ranjan et al. Learning multi-human optical flow
Zhu et al. Learning-based inverse rendering of complex indoor scenes with differentiable monte carlo raytracing
Li et al. Capturing relightable human performances under general uncontrolled illumination
CN107408315A (en) The flow and method of glasses try-in accurate and true to nature for real-time, physics
Chen et al. S-nerf++: Autonomous driving simulation via neural reconstruction and generation
Rohmer et al. Natural environment illumination: Coherent interactive augmented reality for mobile and non-mobile devices
Liu et al. Static scene illumination estimation from videos with applications
CN117557714A (en) Three-dimensional reconstruction method, electronic device and readable storage medium
Tous Pictonaut: movie cartoonization using 3D human pose estimation and GANs
He et al. Unirelight: Learning joint decomposition and synthesis for video relighting
Xie et al. Flash-splat: 3d reflection removal with flash cues and gaussian splats
Mirbauer et al. SkyGAN: Towards Realistic Cloud Imagery for Image Based Lighting.
Xu et al. Object-based illumination transferring and rendering for applications of mixed reality