[go: up one dir, main page]

EP3806101A4 - Training data collecting device, training data collecting method and program, training system, trained model, and endoscope image processing device - Google Patents

Training data collecting device, training data collecting method and program, training system, trained model, and endoscope image processing device Download PDF

Info

Publication number
EP3806101A4
EP3806101A4 EP19811403.5A EP19811403A EP3806101A4 EP 3806101 A4 EP3806101 A4 EP 3806101A4 EP 19811403 A EP19811403 A EP 19811403A EP 3806101 A4 EP3806101 A4 EP 3806101A4
Authority
EP
European Patent Office
Prior art keywords
data collecting
training data
training
program
image processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19811403.5A
Other languages
German (de)
French (fr)
Other versions
EP3806101A1 (en
Inventor
Goro Miura
Masaaki Oosake
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Publication of EP3806101A1 publication Critical patent/EP3806101A1/en
Publication of EP3806101A4 publication Critical patent/EP3806101A4/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A61B1/000094—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope extracting biological structures
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A61B1/000096—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope using artificial intelligence
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/045—Control thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00043—Operational features of endoscopes provided with output arrangements
    • A61B1/00045—Display arrangement
    • A61B1/0005—Display arrangement combining images e.g. side-by-side, superimposed or tiled
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
    • G02B23/2476—Non-optical details, e.g. housings, mountings, supports
    • G02B23/2484—Arrangements in relation to a camera or imaging device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/03—Recognition of patterns in medical or anatomical images
    • G06V2201/031—Recognition of patterns in medical or anatomical images of internal organs
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/70—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for mining of medical data, e.g. analysing previous cases of other patients

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Veterinary Medicine (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Optics & Photonics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Endoscopes (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
EP19811403.5A 2018-05-28 2019-05-07 Training data collecting device, training data collecting method and program, training system, trained model, and endoscope image processing device Pending EP3806101A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018101498 2018-05-28
PCT/JP2019/018231 WO2019230302A1 (en) 2018-05-28 2019-05-07 Training data collecting device, training data collecting method and program, training system, trained model, and endoscope image processing device

Publications (2)

Publication Number Publication Date
EP3806101A1 EP3806101A1 (en) 2021-04-14
EP3806101A4 true EP3806101A4 (en) 2021-07-21

Family

ID=68696941

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19811403.5A Pending EP3806101A4 (en) 2018-05-28 2019-05-07 Training data collecting device, training data collecting method and program, training system, trained model, and endoscope image processing device

Country Status (5)

Country Link
US (1) US11776692B2 (en)
EP (1) EP3806101A4 (en)
JP (1) JP7042907B2 (en)
CN (1) CN112189236B (en)
WO (1) WO2019230302A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6872581B2 (en) * 2018-12-04 2021-05-19 Hoya株式会社 Information processing equipment, endoscope processors, information processing methods and programs
JP7462424B2 (en) * 2020-01-15 2024-04-05 キヤノンメディカルシステムズ株式会社 Medical information processing device, learning data generation program, and learning data generation method
US12213643B2 (en) 2020-02-18 2025-02-04 Sony Olympus Medical Solutions Inc. Learning device and medical image processing device
EP4116992A4 (en) * 2020-03-06 2024-04-10 Lunit Inc. Method and system for predicting expression of biomarker from medical image
JP7600247B2 (en) * 2020-08-28 2024-12-16 富士フイルム株式会社 LEARNING DEVICE, LEARNING METHOD, PROGRAM, TRAINED MODEL, AND ENDOSCOPE SYSTEM
JP2024112325A (en) * 2021-04-26 2024-08-21 富士フイルム株式会社 Medical imaging device, endoscopy system, and method of operating a medical imaging device
JP7190534B1 (en) * 2021-06-14 2022-12-15 アサヒ飲料株式会社 Microorganism detection method
JP7642498B2 (en) 2021-09-08 2025-03-10 富士フイルム株式会社 Image processing device, image processing method, and program
KR102672710B1 (en) * 2023-07-06 2024-06-05 주식회사 서르 Apparatus and method for synthesizing endoscopic image
CN117115241B (en) * 2023-09-06 2024-03-29 北京透彻未来科技有限公司 Method for searching central focus of digital pathological image in zooming process

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002336193A (en) * 2001-05-17 2002-11-26 Olympus Optical Co Ltd Diagnosis support apparatus
JP4451460B2 (en) * 2007-03-16 2010-04-14 オリンパス株式会社 Endoscopic diagnosis support device
KR101993716B1 (en) * 2012-09-28 2019-06-27 삼성전자주식회사 Apparatus and method for diagnosing lesion using categorized diagnosis model
JP6235921B2 (en) 2014-02-07 2017-11-22 国立大学法人広島大学 Endoscopic image diagnosis support system
JP6697743B2 (en) * 2015-09-29 2020-05-27 パナソニックＩｐマネジメント株式会社 Information terminal control method and program
JP6746360B2 (en) 2016-04-13 2020-08-26 キヤノン株式会社 Information processing system, information processing method, and program
CN107730489A (en) * 2017-10-09 2018-02-23 杭州电子科技大学 Wireless capsule endoscope small intestine disease variant computer assisted detection system and detection method
JP7138771B2 (en) * 2019-03-18 2022-09-16 オリンパス株式会社 Diagnosis support device, diagnosis support method and program

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
GEORGAKOPOULOS SPIROS V ET AL: "Weakly-supervised Convolutional learning for detection of inflammatory gastrointestinal lesions", 2016 IEEE INTERNATIONAL CONFERENCE ON IMAGING SYSTEMS AND TECHNIQUES (IST), IEEE, 4 October 2016 (2016-10-04), pages 510 - 514, XP032996210, DOI: 10.1109/IST.2016.7738279 *
MÜNZER BERND ET AL: "Content-based processing and analysis of endoscopic images and videos: A survey", MULTIMEDIA TOOLS AND APPLICATIONS, KLUWER ACADEMIC PUBLISHERS, BOSTON, US, vol. 77, no. 1, 11 January 2017 (2017-01-11), pages 1323 - 1362, XP036403706, ISSN: 1380-7501, [retrieved on 20170111], DOI: 10.1007/S11042-016-4219-Z *
SHIN YOUNGHAK ET AL: "Comparison of hand-craft feature based SVM and CNN based deep learning framework for automatic polyp classification", 2017 39TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), IEEE, 11 July 2017 (2017-07-11), pages 3277 - 3280, XP033152733, DOI: 10.1109/EMBC.2017.8037556 *

Also Published As

Publication number Publication date
US11776692B2 (en) 2023-10-03
EP3806101A1 (en) 2021-04-14
CN112189236B (en) 2024-07-23
WO2019230302A1 (en) 2019-12-05
JPWO2019230302A1 (en) 2021-06-24
JP7042907B2 (en) 2022-03-28
CN112189236A (en) 2021-01-05
US20210052137A1 (en) 2021-02-25

Similar Documents

Publication Publication Date Title
EP3806101A4 (en) Training data collecting device, training data collecting method and program, training system, trained model, and endoscope image processing device
EP3951654A4 (en) Image classification model training method, and image processing method and device
EP3879485A4 (en) Tissue nodule detection and model training method and apparatus thereof, device and system
GB2591890B (en) Medical image processing apparatus, medical image processing method, program, and learned model
GB2614130B (en) Medical image processing apparatus, medical image processing system, learned model, learning apparatus, medical image processing method, and program
SG11202003973VA (en) Image diagnosis assistance apparatus, data collection method, image diagnosis assistance method, and image diagnosis assistance program
EP3777644A4 (en) Image processing device, endoscope system, and image processing method
EP3819835A4 (en) Risk identification model training method and apparatus, and server
EP3678059A4 (en) Image processing method, image processing apparatus, and a neural network training method
EP3776451A4 (en) Image processing apparatus, image processing method thereof, image processing system, and training method thereof
EP3633553A4 (en) Method, device and apparatus for training object detection model
EP3804605A4 (en) Image processing device, endoscope system, and image processing method
EP3819861A4 (en) Mark data obtaining method and apparatus, training method and apparatus, and medical device
EP3606054A4 (en) Image processing device, image analysis system, method, and program
EP3883211A4 (en) Exercise data processing method and device
SG11202105631YA (en) Image processing method and device, and network training method and device
EP3805744A4 (en) Biological tissue image processing system, and machine learning method
EP3859657A4 (en) Image processing device, image processing method, and program
EP3764096A4 (en) Image processing method, image processing device, and program
EP4006914A4 (en) Information processing system, information processing device, image acquisition device, information processing method, image acquisition method, and program
EP3733047A4 (en) Surgical system, image processing device, and image processing method
EP4075786A4 (en) Image processing device, system, image processing method and image processing program
EP3851049A4 (en) Medical image processing device, method, and program
EP3904865A4 (en) Image processing device, image processing method, and image processing program
EP3875021A4 (en) Medical image processing apparatus, medical image processing method and program, and diagnosis assisting apparatus

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20201117

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20210621

RIC1 Information provided on ipc code assigned before grant

Ipc: G16H 30/40 20180101AFI20210615BHEP

Ipc: A61B 1/045 20060101ALI20210615BHEP

Ipc: G02B 23/24 20060101ALI20210615BHEP

Ipc: G16H 50/20 20180101ALI20210615BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20240507