EP3599982A4 - A 3d reconstruction system - Google Patents

A 3d reconstruction system Download PDF

Info

Publication number: EP3599982A4
Authority: EP; European Patent Office
Prior art keywords: reconstruction system; reconstruction
Prior art date: 2017-03-20
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.): Pending

Application number

EP18771352.4A

Other languages

German (de)

French (fr)

Other versions

EP3599982A1 (en

Inventor

Michael Saas HANSEN

Morten Rufus Blas

Mads Ockert FOGTMANN

Steen Møller Hansen

André Hansen

Henriette Schultz KIRKEGAARD

Sebastian Hoppe NESGAARD JENSEN

Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)

Cilag GmbH International

Original Assignee

3DIntegrated ApS

Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)

2017-03-20

Filing date

2018-03-20

Publication date

2020-12-23

2018-03-20 Application filed by 3DIntegrated ApS filed Critical 3DIntegrated ApS

2020-02-05 Publication of EP3599982A1 publication Critical patent/EP3599982A1/en

2020-12-23 Publication of EP3599982A4 publication Critical patent/EP3599982A4/en

Status Pending legal-status Critical Current

Classifications

- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
- A61B1/000094—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope extracting biological structures
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/55—Depth or shape recovery from multiple images
- G06T7/593—Depth or shape recovery from multiple images from stereo images
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
- G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10068—Endoscopic image
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20076—Probabilistic image processing
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30028—Colon; Small intestine

Landscapes

Engineering & Computer Science (AREA)
Health & Medical Sciences (AREA)
Physics & Mathematics (AREA)
Life Sciences & Earth Sciences (AREA)
Surgery (AREA)
Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
Medical Informatics (AREA)
Optics & Photonics (AREA)
Computer Vision & Pattern Recognition (AREA)
Radiology & Medical Imaging (AREA)
General Physics & Mathematics (AREA)
General Health & Medical Sciences (AREA)
Theoretical Computer Science (AREA)
Heart & Thoracic Surgery (AREA)
Molecular Biology (AREA)
Animal Behavior & Ethology (AREA)
Biomedical Technology (AREA)
Public Health (AREA)
Veterinary Medicine (AREA)
Pathology (AREA)
Biophysics (AREA)
Signal Processing (AREA)
Quality & Reliability (AREA)
Length Measuring Devices By Optical Means (AREA)

EP18771352.4A 2017-03-20 2018-03-20 A 3d reconstruction system Pending EP3599982A4 (en)

Applications Claiming Priority (3)

Application Number	Priority Date	Filing Date	Title
DKPA201770193		2017-03-20
DKPA201770430		2017-06-01
PCT/DK2018/050048 WO2018171851A1 (en)	2017-03-20	2018-03-20	A 3d reconstruction system

Publications (2)

Publication Number	Publication Date
EP3599982A1 EP3599982A1 (en)	2020-02-05
EP3599982A4 true EP3599982A4 (en)	2020-12-23

Family

ID=63585007

Family Applications (1)

Application Number	Title	Priority Date	Filing Date
EP18771352.4A Pending EP3599982A4 (en)	2017-03-20	2018-03-20	A 3d reconstruction system

Country Status (2)

Country	Link
EP (1)	EP3599982A4 (en)
WO (1)	WO2018171851A1 (en)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
US10792034B2 (en)	2018-07-16	2020-10-06	Ethicon Llc	Visualization of surgical devices
US12257013B2 (en)	2019-03-15	2025-03-25	Cilag Gmbh International	Robotic surgical systems with mechanisms for scaling camera magnification according to proximity of surgical tool to tissue
CN109870386B (en) *	2019-04-03	2024-06-07	浙江省工程物探勘察设计院有限公司	Sample density testing system for rock-soil investigation test
CN110349237B (en) *	2019-07-18	2021-06-18	华中科技大学	Fast volume imaging method based on convolutional neural network
CN110495900B (en) *	2019-08-19	2023-05-26	武汉联影医疗科技有限公司	Image display method, device, equipment and storage medium
US12207881B2 (en)	2019-12-30	2025-01-28	Cilag Gmbh International	Surgical systems correlating visualization data and powered surgical instrument data
US12002571B2 (en)	2019-12-30	2024-06-04	Cilag Gmbh International	Dynamic surgical visualization systems
US12053223B2 (en)	2019-12-30	2024-08-06	Cilag Gmbh International	Adaptive surgical system control according to surgical smoke particulate characteristics
US11832996B2 (en)	2019-12-30	2023-12-05	Cilag Gmbh International	Analyzing surgical trends by a surgical system
US11776144B2 (en)	2019-12-30	2023-10-03	Cilag Gmbh International	System and method for determining, adjusting, and managing resection margin about a subject tissue
US11759283B2 (en)	2019-12-30	2023-09-19	Cilag Gmbh International	Surgical systems for generating three dimensional constructs of anatomical organs and coupling identified anatomical structures thereto
US11896442B2 (en)	2019-12-30	2024-02-13	Cilag Gmbh International	Surgical systems for proposing and corroborating organ portion removals
US11284963B2 (en)	2019-12-30	2022-03-29	Cilag Gmbh International	Method of using imaging devices in surgery
US11744667B2 (en)	2019-12-30	2023-09-05	Cilag Gmbh International	Adaptive visualization by a surgical system
US12453592B2 (en)	2019-12-30	2025-10-28	Cilag Gmbh International	Adaptive surgical system control according to surgical smoke cloud characteristics
US11659998B2 (en) *	2020-03-05	2023-05-30	International Business Machines Corporation	Automatic measurement using structured lights
US11484245B2 (en)	2020-03-05	2022-11-01	International Business Machines Corporation	Automatic association between physical and visual skin properties
CN111637850B (en) *	2020-05-29	2021-10-26	南京航空航天大学	Self-splicing surface point cloud measuring method without active visual marker
WO2022209156A1 (en) *	2021-03-30	2022-10-06	ソニーグループ株式会社	Medical observation device, information processing device, medical observation method, and endoscopic surgery system
US20230062782A1 (en) *	2021-09-02	2023-03-02	Cilag Gmbh International	Ultrasound and stereo imaging system for deep tissue visualization
CN114627163B (en) *	2022-03-23	2025-05-02	青岛根尖智能科技有限公司	A global image target tracking method and system based on fast scene stitching
CN116740325B (en) *	2023-08-16	2023-11-28	广州和音科技文化发展有限公司	Image stitching method and system based on exhibition hall scene three-dimensional effect design

Citations (1)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
JP2005201868A (en) *	2004-01-19	2005-07-28	Toshiba Corp	Image information acquisition apparatus, image information acquisition method, and image information acquisition program

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
GB9216743D0 (en) *	1992-08-07	1992-09-23	Epstein Ruth	A device to calibrate adsolute size in endoscopy
US6503195B1 (en)	1999-05-24	2003-01-07	University Of North Carolina At Chapel Hill	Methods and systems for real-time structured light depth extraction and endoscope using real-time structured light depth extraction
US7824328B2 (en)	2006-09-18	2010-11-02	Stryker Corporation	Method and apparatus for tracking a surgical instrument during surgery
JP5118867B2 (en) *	2007-03-16	2013-01-16	オリンパス株式会社	Endoscope observation apparatus and operation method of endoscope
JP2009240621A (en)	2008-03-31	2009-10-22	Hoya Corp	Endoscope apparatus
IT1401669B1 (en)	2010-04-07	2013-08-02	Sofar Spa	ROBOTIC SURGERY SYSTEM WITH PERFECT CONTROL.
DE102010050227A1 (en)	2010-11-04	2012-05-10	Siemens Aktiengesellschaft	Endoscope with 3D functionality
WO2012147679A1 (en)	2011-04-27	2012-11-01	オリンパス株式会社	Endoscopic device and measurement method
US11510600B2 (en) *	2012-01-04	2022-11-29	The Trustees Of Dartmouth College	Method and apparatus for quantitative and depth resolved hyperspectral fluorescence and reflectance imaging for surgical guidance
WO2013116869A1 (en)	2012-02-02	2013-08-08	Transenterix, Inc.	Mechanized multi-instrument surgical system
WO2013163391A1 (en)	2012-04-25	2013-10-31	The Trustees Of Columbia University In The City Of New York	Surgical structured light system
US20130296712A1 (en)	2012-05-03	2013-11-07	Covidien Lp	Integrated non-contact dimensional metrology tool
TWI533675B (en)	2013-12-16	2016-05-11	國立交通大學	Optimal dynamic seam adjustment system and method for images stitching
WO2015151098A2 (en)	2014-04-02	2015-10-08	M.S.T. Medical Surgery Technologies Ltd.	An articulated structured light based-laparoscope
US20150371420A1 (en)	2014-06-19	2015-12-24	Samsung Electronics Co., Ltd.	Systems and methods for extending a field of view of medical images
BR112017005251A2 (en) *	2014-09-17	2017-12-12	Taris Biomedical Llc	Methods and Systems for Bladder Diagnostic Mapping
GB2553022B (en)	2014-09-22	2018-12-05	Shanghai United Imaging Healthcare Co Ltd	System and method for image composition
US11053314B2 (en)	2014-10-10	2021-07-06	The United States Of America, As Represented By The Secretary, Department Of Health And Human Services	Methods to eliminate cancer stem cells by targeting CD47
US10368720B2 (en)	2014-11-20	2019-08-06	The Johns Hopkins University	System for stereo reconstruction from monoscopic endoscope images
JP6450589B2 (en)	2014-12-26	2019-01-09	株式会社モルフォ	Image generating apparatus, electronic device, image generating method, and program
US9866815B2 (en) *	2015-01-05	2018-01-09	Qualcomm Incorporated	3D object segmentation
JP6618704B2 (en) *	2015-04-10	2019-12-11	オリンパス株式会社	Endoscope system
US10512508B2 (en)	2015-06-15	2019-12-24	The University Of British Columbia	Imagery system

2018
- 2018-03-20 EP EP18771352.4A patent/EP3599982A4/en active Pending
- 2018-03-20 WO PCT/DK2018/050048 patent/WO2018171851A1/en not_active Ceased

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
JP2005201868A (en) *	2004-01-19	2005-07-28	Toshiba Corp	Image information acquisition apparatus, image information acquisition method, and image information acquisition program

Also Published As

Publication number	Publication date
WO2018171851A1 (en)	2018-09-27
EP3599982A1 (en)	2020-02-05

Publication	Publication Date	Title
EP3599982A4 (en)	2020-12-23	A 3d reconstruction system
GB202017534D0 (en)	2020-12-23	Imprinate 3d
EP3681696A4 (en)	2021-03-03	Three-dimensional printing
EP3525963A4 (en)	2020-07-08	Three-dimensional printing
EP3108457A4 (en)	2017-09-06	Three-dimensional mapping system
EP3058785A4 (en)	2017-06-21	Synchronization in a beamforming system
EP3200977A4 (en)	2017-09-27	Three-dimensional (3d) printing system
EP3707858A4 (en)	2021-07-21	Blockchain system
EP3716235A4 (en)	2021-08-11	Unstaffed store system
EP3707684A4 (en)	2021-08-04	Limited scope blockchain system
GB201706499D0 (en)	2017-06-07	Three-dimensional scene reconstruction
EP3668666A4 (en)	2021-05-05	A 3d printer
EP3177805A4 (en)	2018-03-21	A well system
GB201711438D0 (en)	2017-08-30	A brake system
EP3233434A4 (en)	2018-07-11	Three-dimensional object representation
EP3586135A4 (en)	2020-12-09	A diagnostic system
EP3236421A4 (en)	2018-06-20	Texture generation system
EP3374733A4 (en)	2019-07-17	Stereoscopic mapping
EP3621757A4 (en)	2021-01-13	Three-dimensional printing
EP3742207A4 (en)	2021-03-10	Three-dimensional object
EP3234924A4 (en)	2018-12-26	Three-dimensional object representation
EP3368793A4 (en)	2019-10-30	A transmission system
EP3300884B8 (en)	2023-03-22	System for making a micro-truss structure
GB201706159D0 (en)	2017-05-31	Interactive 3D mapping system
AU2017904342A0 (en)	2017-11-09	A vapour-compression system

Legal Events

Date	Code	Title	Description
2018-09-29	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE
2020-01-03	PUAI	Public reference made under article 153(3) epc to a published international application that has entered the european phase	Free format text: ORIGINAL CODE: 0009012
2020-01-03	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE
2020-02-05	17P	Request for examination filed	Effective date: 20191002
2020-02-05	AK	Designated contracting states	Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
2020-02-05	AX	Request for extension of the european patent	Extension state: BA ME
2020-06-24	DAV	Request for validation of the european patent (deleted)
2020-06-24	DAX	Request for extension of the european patent (deleted)
2020-12-23	A4	Supplementary search report drawn up and despatched	Effective date: 20201119
2020-12-23	RIC1	Information provided on ipc code assigned before grant	Ipc: A61B 1/05 20060101ALI20201113BHEP Ipc: G06T 7/00 20170101ALI20201113BHEP Ipc: A61B 1/04 20060101AFI20201113BHEP Ipc: A61B 1/00 20060101ALI20201113BHEP
2023-03-13	GRAP	Despatch of communication of intention to grant a patent	Free format text: ORIGINAL CODE: EPIDOSNIGR1
2023-03-13	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: GRANT OF PATENT IS INTENDED
2023-03-15	RAP1	Party data changed (applicant data changed or rights of an application transferred)	Owner name: CILAG GMBH INTERNATIONAL
2023-03-29	RIC1	Information provided on ipc code assigned before grant	Ipc: G06T 7/00 20060101ALI20230220BHEP Ipc: A61B 1/00 20060101ALI20230220BHEP Ipc: A61B 1/05 20060101ALI20230220BHEP Ipc: A61B 1/04 20060101AFI20230220BHEP
2023-04-05	INTG	Intention to grant announced	Effective date: 20230313
2023-07-03	GRAJ	Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted	Free format text: ORIGINAL CODE: EPIDOSDIGR1
2023-07-03	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE
2023-07-14	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: EXAMINATION IS IN PROGRESS
2023-08-09	INTC	Intention to grant announced (deleted)
2023-08-16	17Q	First examination report despatched	Effective date: 20230718