[go: up one dir, main page]

EP1588328A1 - A method of image registration and medical image data processing apparatus - Google Patents

A method of image registration and medical image data processing apparatus

Info

Publication number
EP1588328A1
EP1588328A1 EP03777072A EP03777072A EP1588328A1 EP 1588328 A1 EP1588328 A1 EP 1588328A1 EP 03777072 A EP03777072 A EP 03777072A EP 03777072 A EP03777072 A EP 03777072A EP 1588328 A1 EP1588328 A1 EP 1588328A1
Authority
EP
European Patent Office
Prior art keywords
transformation parameter
registration
sub
image data
parameter set
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP03777072A
Other languages
German (de)
French (fr)
Other versions
EP1588328B1 (en
Inventor
Marcel J. Quist
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Priority to EP03777072.4A priority Critical patent/EP1588328B1/en
Priority to EP17171917.2A priority patent/EP3239930B1/en
Publication of EP1588328A1 publication Critical patent/EP1588328A1/en
Application granted granted Critical
Publication of EP1588328B1 publication Critical patent/EP1588328B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/38—Registration of image sequences

Definitions

  • a method of image registration and medical image data processing apparatus A method of image registration and medical image data processing apparatus
  • the present invention relates to image registration, and more particularly without limitation, to image registration in medical diagnostic systems.
  • a second example is that of images of an individual taken over a period of time. This can be used, among other things, to study the development of anatomical structures. Besides the comparison of images of a single individual, comparisons of images of different individuals is also performed, e.g. to study the differences and similarities between groups.
  • the contents of the images must be in alignment. This is often not the case for numerous reasons, such as movement of the individual or differences in the field of view (the part of the anatomy that is captured in the images).
  • image registration This is achieved by optimizing a measure of similarity between images, such as the position of corresponding landmarks or the similarity in intensity of corresponding anatomical structures. In most cases, global translations and rotations suffice to align images.
  • non-rigid or elastic registration This is necessary for registration of images of different individuals (who have different anatomies) or images of a single individual when an anatomical change has taken place.
  • the present invention provides for an improved method of image registration where registrations are performed for a number of sub-volumes of the image to be registered in addition to a global registration. For example, a number of sub-volumes contained in the image data is selected manually by an operator by marking the sub-volumes of interest. For this purpose a graphical user interface (GUI) can be utilized. Alternatively or in addition an automatic image segmentation can be performed for identification of such sub-volumes. For example, each of the sub-volumes contains a certain medical region of interest, such as an organ or a tumour.
  • GUI graphical user interface
  • a registration is performed for each one of the sub-volumes in addition to a global registration of the image data.
  • This enables to identify an outlier sub-volume which substantially deviates from the transformation of the other sub-volumes and the global registration.
  • Such an outlier sub-volume can be cut off in order to improve the overall registration result or it can trigger a subsequent elastic registration for improved registration.
  • the transformation parameter set obtained in the first registration step can be used as an input parameter set for the subsequent elastic registration.
  • the present invention is particularly advantageous as it registers sub-volumes of the images and translates the registration results to global transformations, hi particular this enables a comparison of the resulting transformations which indicates: the accuracy of the global transformation, e.g.
  • the reason for the inaccuracy e.g. too much constraint transformation
  • the location of the problem in the images e.g. local image artefacts.
  • outliers in the registration of the sub-volumes are likely to originate from image artefacts or unequal anatomies in the images such as pathology, especially if the structures can be assumed as rigid, such as the scull.
  • An example is neural- MR where a sub-volume is selected on a tumour that does not exist on the other image.
  • neural-CT where a sub-volume is selected on image artefacts caused by metal fillings.
  • a possible reaction to this detected origin of inaccuracy can be to signal for user-interaction or to cut-off this section for a more accurate global registration.
  • an additional processing step is performed for improved registration rather than cutting-off the corresponding sub-volume.
  • An inaccurately registered sub-volume can be caused by deformation of the organ, e.g. due to breathing motion, which cannot be appropriately dealt with by a rigid, global transformation, hi this case a refinement and / or localization of the transformation is performed in order to improve the registration of this sub-volume.
  • the transformation can be locally extended with more degrees of freedom; in particular non-rigid or elastic image registration can be used for this purpose.
  • Another advantageous application of the present invention is the detection of artefacts in MR inter-leaved scans, i.e.
  • the present invention enables to detect such artefacts in order to warn a user that artefacts are present in the MR inter-leaved scans.
  • the invention provides for a sub-regional registration to be performed alongside the global registration of the full images.
  • Sub-regions or sub-volumes, of the images to be registered are selected and are registered throughout the sequence of images.
  • a table of registration information is compiled for all sub-regions and the global registration containing translation and rotation information. Quantification of the registration process is therefore possible over sub-regions and allows identification of inaccuracies within the overall registration process. hi particular, this enables to draw the users attention to the sub-volume or sub- volumes of the global image where the registration process has failed and manual orientation is required.
  • the result of the registration method of the invention can be incorporated into a fully automated image handling sequence which enables spurious sections of the sequence of images to be removed.
  • Fig. 1 is illustrative of a flow diagram of an embodiment of a method of the invention
  • Fig. 2 is a schematic example for the registration of sub-volumes
  • Fig. 3 is a block diagram of a medical image data acquisition and processing system.
  • Fig. 1 shows a flow diagram of an embodiment of the registration method of the invention.
  • image data is provided by an imaging modality.
  • all of the image data are provided by the same image modality.
  • image data of different image modalities are to be combined.
  • X-ray imaging, magnetic resonance imaging (MRI), computer tomography (CT) imaging, functional MRI (fMRI), single photon emission computer tomography (SPECT) or positron emission tomography (PET) are used as image modalities.
  • step 102 a selection of sub-volumes S; in the image data is performed. This can be done manually by marking the sub-volumes Sj on a display or by performing an image segmentation step or another suitable image processing step for identification of sub-regions or sub-volumes in the image data.
  • step 104 image registrations are performed locally for the selected sub- volumes Sj. For example, these registrations are performed by means of a rigid image registration method.
  • step 106 a parameter set T, is outputted for each one of the sub- volumes Sj for which a registration has been performed.
  • Each one of the transformation parameter sets Tj is descriptive of the displacement of the corresponding sub-volume Si in the two images to be registered.
  • a global registration is performed for the images to be registered. Again a rigid image registration method can be employed for this purpose.
  • a global transformation parameter set TQ is outputted.
  • the global transformation parameter set T G is descriptive of the displacement of the images to be registered with respect to each other.
  • the index i is initialized to be equal to one.
  • a mean distance measure is calculated for the transformation parameter set Tj. This can be done by calculating a distance measure between the transformation parameter set T; and each one of the other transformation parameter sets T j and to the global transformation parameter set TQ and calculating a mean value on the basis of these individual distance measures.
  • any distance measure for the determination of the distance between two parameter sets or vectors can be used, such as Euclid's distance.
  • Euclid's distance is calculated for all pairs of parameter sets Tj , T j, where i ⁇ j. and the resulting Euclid's distances are added. This provides the mean distance measure.
  • step 116 it is determined whether the mean distance measure of step 114 is above a threshold level. If this is not the case the registration of the corresponding sub- volume Sj is deemed to be sufficiently accurate and the control goes to step 120 to increment the index i.
  • step 118 an output signal is generated for identification of the sub- volume Sj.
  • This output signal can be outputted as a warning signal by means of a graphical user interface in order to warn an operator that the registration of the sub-volume Sj is inaccurate.
  • the output signal generated in step 118 triggers the execution of an additional non-rigid, elastic image registration procedure for improved registration of the sub-volume Sj and / or for improved global registration.
  • FIG. 2 shows a schematic example.
  • the example is illustrative of an application in two dimensions for convenience of explanation. It is to be noted that the example can be extended to more dimensions.
  • Image 100 is a slice or "slab" of image data which has been acquired by medical image data acquisition. Image 100 is located in the XY-plane 104. Image 102 is also within plane 104 and needs to be registered with image 100.
  • Image 100 contains the sub-volumes A, B, C and D. These sub-volumes are selected by marking the corresponding regions in image 100 by means of a graphical user interface by an operator and / or by a segmentation step or another suitable data processing step for identification of such regions of interest.
  • Image 102 has corresponding sub-volumes A ⁇ B', C' and D'.
  • An image registration is performed both globally for images 100 and 102 and for the individual sub-volumes. This means that the sub-volumes A and A' are registered as well as the sub-volumes B-B', C-C and D-D'.
  • Table 106 of Fig. 2 shows the resulting transformation parameter sets.
  • the transformation parameter set for each individual image registration contains the amount of displacement in the X and Y directions within plane 104 as well as the amount of angular transformation in degrees of rotation.
  • Fig. 3 shows a block diagram of a computer 200 which is coupled to a medical image data acquisition apparatus 202.
  • Computer 200 has memory 204 for the storage of image data and has a graphical user interface 206.
  • Further computer 200 has segmentation program module 208, image registration program module 210, elastic image registration program module 212 and memory 214 for the storage of transformation parameters (cf. table 106 of Fig. 2).
  • In addition computer 200 has program 216 for controlling the operation of these various components.
  • Computer 200 is coupled to display 218 for rendering of image data. Alternatively or in addition computer 200 is connected to a printer. hi operation the image data is loaded into memory 204 from image data acquisition apparatus 202. The image data is rendered on display 218.
  • graphical user interface 206 an operator can select a number of sub-volumes in the image data. Alternatively or in addition sub-volumes are selected automatically by means of segmentation program module 208.
  • Image registrations are performed by means of program module 210 for registering of the sub- volumes and for performing a global image registration.
  • the corresponding transformation parameters are stored in memory 214 for analysis by program 216.
  • program 216 identifies an outlier sub-volume a warning message is generated and outputted on display 218.
  • program 216 triggers program module 212 for performing an elastic image registration for the outlier sub-volume.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
  • Image Processing (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Image Analysis (AREA)

Abstract

The present invention relates to a method of image registration comprising the steps of, a) providing at least first image data and second image data, b) selecting of sub-volumes of the first and the second image data, c) performing a registration for each one of the sub-volumes, each registration providing a transformation parameter set, d) performing a global registration for the first and second image data, the global registration providing a global transformation parameter set, e) comparing one of the transformation parameter sets to other transformation parameter sets and/or to the global transformation parameter set for identification of an outlier transformation parameter set of the transformation parameter sets, f) outputting of a signal being indicative of the sub-volume of the outlier transformation parameter set.

Description

A method of image registration and medical image data processing apparatus
The present invention relates to image registration, and more particularly without limitation, to image registration in medical diagnostic systems.
In current clinical practice, it is not uncommon that several medical images are to be compared or combined. For example, this occurs when images of a single individual are acquired by different techniques, each producing different information about the individual. One technique may depict brain function very well and another a brain tumour.
The combination of the two is crucial in determining whether the tumour can be resected without damaging vital brain areas. A second example is that of images of an individual taken over a period of time. This can be used, among other things, to study the development of anatomical structures. Besides the comparison of images of a single individual, comparisons of images of different individuals is also performed, e.g. to study the differences and similarities between groups.
To be able to compare images, the contents of the images must be in alignment. This is often not the case for numerous reasons, such as movement of the individual or differences in the field of view (the part of the anatomy that is captured in the images). The process of finding the correspondence between the contents of images is called image registration. This is achieved by optimizing a measure of similarity between images, such as the position of corresponding landmarks or the similarity in intensity of corresponding anatomical structures. In most cases, global translations and rotations suffice to align images. When one image has to be deformed, however, to fit the contents of the other this is referred to as non-rigid or elastic registration. This is necessary for registration of images of different individuals (who have different anatomies) or images of a single individual when an anatomical change has taken place.
Various image registration techniques are known from the prior art, such as from WO 01/ 01346 Al, EP 1 184 802 A2, US 2002 / 0 141 626 Al , US 6,266,453 Bl . The book "Medical Image Registration" by Josef Hajnal provides an overview of the various prior art image registration techniques. As far as elastic image registration is concerned the article "Elastic Image Registration and Pathology Detection" by Paul Thompson and Arthur W. Toga (http://www.loni.ucla.edu/~thompson/PDF/no_pics_ElasChpt.pdf) provides an overview of the known approaches for elastic image registration. This article is also published as a book chapter in "Handbook of Medical Image Processing", Academic Press, 2000.
A common disadvantage of prior art image registration methods is the lack of an objective quality criterion. So far, the only reliable way to check the results of the image registration is visual assessment by a human observer. This is a practical problem that substantially limits the application of registration methods. For example, in case of time series where many sequential images have to be registered it is impractical to interrupt an otherwise automatic pre-processing method. This is also true if registration is part of a preprocessing chain.
It is therefore an object of the present invention to provide for an improved method of image registration which addresses the problems of the prior art. It is a further object of the present invention to provide for an improved computer program product and improved medical image data processing apparatus for image registration.
The present invention provides for an improved method of image registration where registrations are performed for a number of sub-volumes of the image to be registered in addition to a global registration. For example, a number of sub-volumes contained in the image data is selected manually by an operator by marking the sub-volumes of interest. For this purpose a graphical user interface (GUI) can be utilized. Alternatively or in addition an automatic image segmentation can be performed for identification of such sub-volumes. For example, each of the sub-volumes contains a certain medical region of interest, such as an organ or a tumour.
In accordance with the present invention a registration is performed for each one of the sub-volumes in addition to a global registration of the image data. This enables to identify an outlier sub-volume which substantially deviates from the transformation of the other sub-volumes and the global registration. Such an outlier sub-volume can be cut off in order to improve the overall registration result or it can trigger a subsequent elastic registration for improved registration. The transformation parameter set obtained in the first registration step can be used as an input parameter set for the subsequent elastic registration. The present invention is particularly advantageous as it registers sub-volumes of the images and translates the registration results to global transformations, hi particular this enables a comparison of the resulting transformations which indicates: the accuracy of the global transformation, e.g. by measuring variations, the reason for the inaccuracy, e.g. too much constraint transformation, the location of the problem in the images, e.g. local image artefacts. In some applications outliers in the registration of the sub-volumes are likely to originate from image artefacts or unequal anatomies in the images such as pathology, especially if the structures can be assumed as rigid, such as the scull. An example is neural- MR where a sub-volume is selected on a tumour that does not exist on the other image. Another example is neural-CT where a sub-volume is selected on image artefacts caused by metal fillings. A possible reaction to this detected origin of inaccuracy can be to signal for user-interaction or to cut-off this section for a more accurate global registration.
If the image is to be registered e.g. in the abdomen with the deforming organs such as the liver an additional processing step is performed for improved registration rather than cutting-off the corresponding sub-volume. An inaccurately registered sub-volume can be caused by deformation of the organ, e.g. due to breathing motion, which cannot be appropriately dealt with by a rigid, global transformation, hi this case a refinement and / or localization of the transformation is performed in order to improve the registration of this sub-volume. For this improved registration the transformation can be locally extended with more degrees of freedom; in particular non-rigid or elastic image registration can be used for this purpose. Another advantageous application of the present invention is the detection of artefacts in MR inter-leaved scans, i.e. the even and odd slices being not aligned. Image interpolation between the slices results in double edges and other artefacts which make registration inaccurate and can result in a low quality after the reformatting which is subsequent to the registration. The present invention enables to detect such artefacts in order to warn a user that artefacts are present in the MR inter-leaved scans.
In essence, the invention provides for a sub-regional registration to be performed alongside the global registration of the full images. Sub-regions or sub-volumes, of the images to be registered are selected and are registered throughout the sequence of images. In accordance with a preferred embodiment a table of registration information is compiled for all sub-regions and the global registration containing translation and rotation information. Quantification of the registration process is therefore possible over sub-regions and allows identification of inaccuracies within the overall registration process. hi particular, this enables to draw the users attention to the sub-volume or sub- volumes of the global image where the registration process has failed and manual orientation is required. Alternatively the result of the registration method of the invention can be incorporated into a fully automated image handling sequence which enables spurious sections of the sequence of images to be removed.
In the following preferred embodiments of the invention are explained in greater detail by making reference to the drawings in which:
Fig. 1 is illustrative of a flow diagram of an embodiment of a method of the invention, Fig. 2 is a schematic example for the registration of sub-volumes,
Fig. 3 is a block diagram of a medical image data acquisition and processing system.
Fig. 1 shows a flow diagram of an embodiment of the registration method of the invention. In step 100 image data is provided by an imaging modality. Depending on the application all of the image data are provided by the same image modality. Alternatively the image data of different image modalities are to be combined. For example, X-ray imaging, magnetic resonance imaging (MRI), computer tomography (CT) imaging, functional MRI (fMRI), single photon emission computer tomography (SPECT) or positron emission tomography (PET) are used as image modalities.
In step 102 a selection of sub-volumes S; in the image data is performed. This can be done manually by marking the sub-volumes Sj on a display or by performing an image segmentation step or another suitable image processing step for identification of sub-regions or sub-volumes in the image data.
In step 104 image registrations are performed locally for the selected sub- volumes Sj. For example, these registrations are performed by means of a rigid image registration method. In step 106 a parameter set T, is outputted for each one of the sub- volumes Sj for which a registration has been performed. Each one of the transformation parameter sets Tj is descriptive of the displacement of the corresponding sub-volume Si in the two images to be registered.
In step 108 a global registration is performed for the images to be registered. Again a rigid image registration method can be employed for this purpose. In step 110 a global transformation parameter set TQ is outputted. The global transformation parameter set TG is descriptive of the displacement of the images to be registered with respect to each other. In step 112 the index i is initialized to be equal to one. In step 114 a mean distance measure is calculated for the transformation parameter set Tj. This can be done by calculating a distance measure between the transformation parameter set T; and each one of the other transformation parameter sets Tj and to the global transformation parameter set TQ and calculating a mean value on the basis of these individual distance measures. For this purpose any distance measure for the determination of the distance between two parameter sets or vectors can be used, such as Euclid's distance. For example Euclid's distance is calculated for all pairs of parameter sets Tj , Tj, where i ≠ j. and the resulting Euclid's distances are added. This provides the mean distance measure.
In step 116 it is determined whether the mean distance measure of step 114 is above a threshold level. If this is not the case the registration of the corresponding sub- volume Sj is deemed to be sufficiently accurate and the control goes to step 120 to increment the index i.
If the mean distance measure is above the threshold the control goes from step 116 to step 118. In step 118 an output signal is generated for identification of the sub- volume Sj. This output signal can be outputted as a warning signal by means of a graphical user interface in order to warn an operator that the registration of the sub-volume Sj is inaccurate. Alternatively or in addition the output signal generated in step 118 triggers the execution of an additional non-rigid, elastic image registration procedure for improved registration of the sub-volume Sj and / or for improved global registration.
As an alternative to steps 114 and 116 another statistical method can be used to identify an outlier parameter set and corresponding sub-volume. Fig. 2 shows a schematic example. The example is illustrative of an application in two dimensions for convenience of explanation. It is to be noted that the example can be extended to more dimensions. Image 100 is a slice or "slab" of image data which has been acquired by medical image data acquisition. Image 100 is located in the XY-plane 104. Image 102 is also within plane 104 and needs to be registered with image 100.
Image 100 contains the sub-volumes A, B, C and D. These sub-volumes are selected by marking the corresponding regions in image 100 by means of a graphical user interface by an operator and / or by a segmentation step or another suitable data processing step for identification of such regions of interest. Image 102 has corresponding sub-volumes A\ B', C' and D'.
An image registration is performed both globally for images 100 and 102 and for the individual sub-volumes. This means that the sub-volumes A and A' are registered as well as the sub-volumes B-B', C-C and D-D'.
Table 106 of Fig. 2 shows the resulting transformation parameter sets. In the example considered here the transformation parameter set for each individual image registration contains the amount of displacement in the X and Y directions within plane 104 as well as the amount of angular transformation in degrees of rotation.
From table 106 it is apparent that the transformation parameter set for the registration of the sub-volume B-B' substantially deviates from the other transformation parameter sets. The sub-volume B-B' is therefore identified as an outlier. In response a corresponding warning signal is outputted and / or an elastic registration procedure is triggered for improved registration of the sub-volume B-B'. The fact that the transformation parameter set of the sub-volume B-B' is an outlier can be determined by processing table 106 by means of suitable statistical methods and / or by calculating of distance measures.
Fig. 3 shows a block diagram of a computer 200 which is coupled to a medical image data acquisition apparatus 202. Computer 200 has memory 204 for the storage of image data and has a graphical user interface 206. Further computer 200 has segmentation program module 208, image registration program module 210, elastic image registration program module 212 and memory 214 for the storage of transformation parameters (cf. table 106 of Fig. 2). In addition computer 200 has program 216 for controlling the operation of these various components. Computer 200 is coupled to display 218 for rendering of image data. Alternatively or in addition computer 200 is connected to a printer. hi operation the image data is loaded into memory 204 from image data acquisition apparatus 202. The image data is rendered on display 218. By means of graphical user interface 206 an operator can select a number of sub-volumes in the image data. Alternatively or in addition sub-volumes are selected automatically by means of segmentation program module 208.
Image registrations are performed by means of program module 210 for registering of the sub- volumes and for performing a global image registration. The corresponding transformation parameters are stored in memory 214 for analysis by program 216. When program 216 identifies an outlier sub-volume a warning message is generated and outputted on display 218. Alternatively or in addition program 216 triggers program module 212 for performing an elastic image registration for the outlier sub-volume.
LIST OF REFERENCE NUMBERS:
100 image
102 image
104 plane
106 table
200 computer
202 image data acquisition apparatus
204 memory
206 GUI
208 segmentation program module
210 program module
212 program module
214 memory
216 program
218 display

Claims

CLAIMS:
1. A method of image registration comprising the steps of: providing at least first image data and second image data, selecting of sub-volumes of the first and the second image data, performing a registration for each one of the sub-volumes, each registration providing a transformation parameter set, performing a global registration for the first and second image data, the global registration providing a global transformation parameter set, comparing one of the transformation parameter sets to other transformation parameter sets and/or to the global transformation parameter set for identification of an outlier transformation parameter set of the transformation parameter sets, outputting of a signal being indicative of the sub-volume of the outlier transformation parameter set.
2. The method of claim 1, whereby the first image data and / or the second image data is provided by X-ray imaging, magnetic resonance imaging, computer tomography imaging, functional MRI, single photon emission computer tomography or positron emission tomography.
3. The method of claim 1 or 2, whereby the selection of the sub-volumes is performed manually by means of a graphical user interface.
4. The method of claim 1, 2 or 3, whereby the selection of the sub-volumes is performed by means of an image segmentation step.
5. The method of anyone of the preceding claims 1 to 4, further comprising calculating a mean distance measure of the one of the transformation parameter sets to the other transformation parameter sets and to the global transformation parameter set, whereby the comparison of the one of the transformation parameter sets with the other transformation parameter sets and the global transformation parameter set is performed on the basis of the mean distance measure for determining whether the one of the transformation parameter sets is an outlier transformation parameter set.
6. The method of claim 5, whereby the one of the transformation parameter sets is identified as an outlier transformation parameter set, if the mean distance measure of the one of the transformation parameter sets is greater than a threshold distance value.
7. The method of anyone of the preceding claims 1 to 5, further comprising cutting off of the sub-volume of the outlier transformation parameter set.
8. The method of anyone of the preceding claims 1 to 7, further comprising performing an elastic image registration in response to the signal.
9. Computer program product, in particular digital storage medium, comprising program means for registration of at least first image data and second data, the program means being adapted to perform the steps of: storing of a selection of sub-volumes of the first and second image data, performing a registration for each one of the sub-volumes, each registration providing a transformation parameter set, - performing a global registration for the first and second image data, the global registration providing a global transformation parameter set, comparing one of the transformation parameter sets to other transformation parameter sets and/or to the global transformation parameter set for identification of an outlier transformation parameter set of the transformation parameter sets, - outputting of a signal being indicative of the sub-volume of the outlier transformation parameter set.
10. A medical image data processing apparatus comprising: a memory for a storage of at least first and second image data, - means for selecting of sub-volumes of the first and second image data, means for performing a registration for each one of the sub-volumes and for a global registration of the first and second image data, each registration providing a transformation parameter set, means for identification of an outlier transformation parameter set of the transformation parameter sets on the basis of the transformation parameter sets, means for outputting of a signal being indicative of the sub-volume of an identified outlier transformation parameter set.
11. The medical image data processing apparatus of claim 10, further comprising a graphical user interface for selection of the sub- volumes.
12. The medical image data processing apparatus of claims 10 or 11, further comprising means for image segmentation for the selection of the sub-volumes.
13. The medical image data processing apparatus of claims 10, 11 or 12, further comprising means for elastic image registration for performing of an elastic image registration when an outlier transformation parameter set has been identified.
EP03777072.4A 2003-01-13 2003-12-04 A method of image registration and medical image data processing apparatus Expired - Lifetime EP1588328B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP03777072.4A EP1588328B1 (en) 2003-01-13 2003-12-04 A method of image registration and medical image data processing apparatus
EP17171917.2A EP3239930B1 (en) 2003-01-13 2003-12-04 A method of image registration and medical image data processing apparatus

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP03075076 2003-01-13
EP03075076 2003-01-13
EP03777072.4A EP1588328B1 (en) 2003-01-13 2003-12-04 A method of image registration and medical image data processing apparatus
PCT/IB2003/005898 WO2004063990A1 (en) 2003-01-13 2003-12-04 A method of image registration and medical image data processing apparatus

Related Child Applications (2)

Application Number Title Priority Date Filing Date
EP17171917.2A Division-Into EP3239930B1 (en) 2003-01-13 2003-12-04 A method of image registration and medical image data processing apparatus
EP17171917.2A Division EP3239930B1 (en) 2003-01-13 2003-12-04 A method of image registration and medical image data processing apparatus

Publications (2)

Publication Number Publication Date
EP1588328A1 true EP1588328A1 (en) 2005-10-26
EP1588328B1 EP1588328B1 (en) 2017-08-16

Family

ID=32695599

Family Applications (2)

Application Number Title Priority Date Filing Date
EP17171917.2A Expired - Lifetime EP3239930B1 (en) 2003-01-13 2003-12-04 A method of image registration and medical image data processing apparatus
EP03777072.4A Expired - Lifetime EP1588328B1 (en) 2003-01-13 2003-12-04 A method of image registration and medical image data processing apparatus

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP17171917.2A Expired - Lifetime EP3239930B1 (en) 2003-01-13 2003-12-04 A method of image registration and medical image data processing apparatus

Country Status (5)

Country Link
US (1) US7778490B2 (en)
EP (2) EP3239930B1 (en)
JP (1) JP4744883B2 (en)
AU (1) AU2003286329A1 (en)
WO (1) WO2004063990A1 (en)

Families Citing this family (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7885440B2 (en) 2004-11-04 2011-02-08 Dr Systems, Inc. Systems and methods for interleaving series of medical images
US7660488B2 (en) 2004-11-04 2010-02-09 Dr Systems, Inc. Systems and methods for viewing medical images
US7970625B2 (en) 2004-11-04 2011-06-28 Dr Systems, Inc. Systems and methods for retrieval of medical data
US7920152B2 (en) 2004-11-04 2011-04-05 Dr Systems, Inc. Systems and methods for viewing medical 3D imaging volumes
US7787672B2 (en) 2004-11-04 2010-08-31 Dr Systems, Inc. Systems and methods for matching, naming, and displaying medical images
WO2006067685A2 (en) * 2004-12-21 2006-06-29 Koninklijke Philips Electronics N.V. Handling of datasets
US7653264B2 (en) 2005-03-04 2010-01-26 The Regents Of The University Of Michigan Method of determining alignment of images in high dimensional feature space
GB0514553D0 (en) 2005-07-15 2005-08-24 Nonlinear Dynamics Ltd A method of analysing a representation of a separation pattern
DE102005058095A1 (en) * 2005-12-05 2007-06-06 Forschungszentrum Jülich GmbH Method for the topographic representation of changes in a studied brain
JP4690204B2 (en) * 2006-01-16 2011-06-01 富士フイルム株式会社 Image reproduction apparatus and program thereof
DE102006029718A1 (en) * 2006-06-28 2008-01-10 Siemens Ag Organ system`s e.g. brain, images evaluating method for detecting pathological change in medical clinical picture, involves extending registration for area to extended registration, such that another area is detected
US7953614B1 (en) 2006-11-22 2011-05-31 Dr Systems, Inc. Smart placement rules
US8385687B1 (en) * 2006-12-06 2013-02-26 Matrox Electronic Systems, Ltd. Methods for determining a transformation between images
JP2008161266A (en) * 2006-12-27 2008-07-17 Ritsumeikan Image processing apparatus, computer program, and image processing method
WO2008103435A1 (en) * 2007-02-22 2008-08-28 Indiana University Research & Technology Corporation Imaging resolution recovery techniques
EP1982652A1 (en) 2007-04-20 2008-10-22 Medicim NV Method for deriving shape information
WO2008141293A2 (en) * 2007-05-11 2008-11-20 The Board Of Regents Of The University Of Oklahoma One Partner's Place Image segmentation system and method
US8229168B2 (en) * 2008-02-20 2012-07-24 International Business Machines Corporation Fast license plate verifier
WO2009117700A2 (en) * 2008-03-21 2009-09-24 Foba Technology + Services Gmbh Multi model registration (mmr) for a galvanometer and laser system
US8068652B2 (en) * 2008-08-29 2011-11-29 General Electric Company Semi-automated registration of data based on a hierarchical mesh
DE102008049467B4 (en) * 2008-09-29 2016-12-29 Siemens Healthcare Gmbh Method and device for registration of tomographic volume data sets of the intestine
JP5523791B2 (en) * 2008-10-27 2014-06-18 株式会社東芝 X-ray diagnostic apparatus and image processing apparatus
US8380533B2 (en) 2008-11-19 2013-02-19 DR Systems Inc. System and method of providing dynamic and customizable medical examination forms
US8712120B1 (en) 2009-09-28 2014-04-29 Dr Systems, Inc. Rules-based approach to transferring and/or viewing medical images
EP2591459B1 (en) * 2010-07-09 2016-09-07 Koninklijke Philips N.V. Automatic point-wise validation of respiratory motion estimation
US9092551B1 (en) 2011-08-11 2015-07-28 D.R. Systems, Inc. Dynamic montage reconstruction
US8675944B2 (en) * 2012-01-12 2014-03-18 Kabushiki Kaisha Toshiba Method of registering image data
CN102663361B (en) * 2012-04-01 2014-01-01 北京工业大学 A Face Image Reversible Geometric Normalization Method Oriented to Overall Feature Analysis
US9495604B1 (en) 2013-01-09 2016-11-15 D.R. Systems, Inc. Intelligent management of computerized advanced processing
US9552533B2 (en) * 2013-03-05 2017-01-24 Toshiba Medical Systems Corporation Image registration apparatus and method
CN103325111A (en) * 2013-06-05 2013-09-25 哈尔滨工程大学 Non-rigid sonar image registration method based on mutual information
JP6145178B2 (en) 2013-10-18 2017-06-07 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． Medical image alignment
US9727965B2 (en) 2014-11-25 2017-08-08 Toshiba Medical Systems Corporation Medical image processing apparatus and medical image processing method
US20170039321A1 (en) 2015-04-30 2017-02-09 D.R. Systems, Inc. Database systems and interactive user interfaces for dynamic interaction with, and sorting of, digital medical image data
JP6768389B2 (en) * 2015-08-07 2020-10-14 キヤノン株式会社 Image processing equipment, image processing methods and programs
US20180211423A1 (en) * 2015-10-28 2018-07-26 Koninklijke Philips N.V. Computed tomography image generation apparatus
US10424045B2 (en) * 2017-06-21 2019-09-24 International Business Machines Corporation Machine learning model for automatic image registration quality assessment and correction
EP3684463A4 (en) 2017-09-19 2021-06-23 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement
US11717686B2 (en) 2017-12-04 2023-08-08 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to facilitate learning and performance
WO2019133997A1 (en) 2017-12-31 2019-07-04 Neuroenhancement Lab, LLC System and method for neuroenhancement to enhance emotional response
EP3547262A1 (en) * 2018-03-28 2019-10-02 Koninklijke Philips N.V. Tomographic x-ray image reconstruction
US11364361B2 (en) 2018-04-20 2022-06-21 Neuroenhancement Lab, LLC System and method for inducing sleep by transplanting mental states
CA3112564A1 (en) 2018-09-14 2020-03-19 Neuroenhancement Lab, LLC System and method of improving sleep
CN111435969B (en) * 2019-01-11 2021-11-09 佳能株式会社 Image processing apparatus, control method thereof, recording medium, and information processing system
US11151703B2 (en) 2019-09-12 2021-10-19 International Business Machines Corporation Artifact removal in medical imaging

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS59137942A (en) 1983-01-28 1984-08-08 Hitachi Ltd Picture positioning system
US5575286A (en) * 1995-03-31 1996-11-19 Siemens Medical Systems, Inc. Method and apparatus for generating large compound ultrasound image
JP4237256B2 (en) * 1996-02-29 2009-03-11 シーメンス メディカル ソリューションズ ユーエスエイ インコーポレイテッド Ultrasonic transducer
US5876342A (en) * 1997-06-30 1999-03-02 Siemens Medical Systems, Inc. System and method for 3-D ultrasound imaging and motion estimation
US6078701A (en) 1997-08-01 2000-06-20 Sarnoff Corporation Method and apparatus for performing local to global multiframe alignment to construct mosaic images
US6393971B1 (en) 1998-10-09 2002-05-28 Star Manufacturing International, Inc. Roller grill assembly for cooking human food
US6611615B1 (en) 1999-06-25 2003-08-26 University Of Iowa Research Foundation Method and apparatus for generating consistent image registration
US6266453B1 (en) 1999-07-26 2001-07-24 Computerized Medical Systems, Inc. Automated image fusion/alignment system and method
IL133562A0 (en) * 1999-12-16 2001-04-30 Compugen Ltd Method for registering separation patterns
JP2002149821A (en) 2000-09-04 2002-05-24 Ge Medical Systems Global Technology Co Llc Medical image providing method, medical software providing method, medical image centralized control server device, medical software centralized control server device, medical image providing system and medical software providing system
US6909794B2 (en) 2000-11-22 2005-06-21 R2 Technology, Inc. Automated registration of 3-D medical scans of similar anatomical structures

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2004063990A1 *

Also Published As

Publication number Publication date
EP1588328B1 (en) 2017-08-16
JP2006512960A (en) 2006-04-20
WO2004063990A1 (en) 2004-07-29
EP3239930B1 (en) 2019-04-17
JP4744883B2 (en) 2011-08-10
US7778490B2 (en) 2010-08-17
US20060188134A1 (en) 2006-08-24
EP3239930A1 (en) 2017-11-01
AU2003286329A1 (en) 2004-08-10

Similar Documents

Publication Publication Date Title
US7778490B2 (en) Method of image registration and medical image data processing apparatus
US7995864B2 (en) Method and system for performing image registration
Chen et al. Localization and segmentation of 3D intervertebral discs in MR images by data driven estimation
EP2422318B1 (en) Quantification of medical image data
US8045771B2 (en) System and method for automated patient anatomy localization
US9280815B2 (en) Comparison workflow automation by registration
US10878564B2 (en) Systems and methods for processing 3D anatomical volumes based on localization of 2D slices thereof
US20100123715A1 (en) Method and system for navigating volumetric images
EP2747658B1 (en) Method to compute and present brain amyloid in gray matter
US20160196642A1 (en) Medical image processing
EP4156089A1 (en) Method, device and system for automated processing of medical images to output alerts for detected dissimilarities
US8306354B2 (en) Image processing apparatus, method, and program
EP3624058A1 (en) Method and system of analyzing symmetry from image data
US10249050B2 (en) Image processing apparatus and image processing method
JP6660741B2 (en) Image extraction device and image extraction method
US10929990B2 (en) Registration apparatus, method, and program
CN115082373A (en) Method, device and equipment for testing medical image positioning line and storage medium
Lu et al. Prior active shape model for detecting pelvic landmarks
JP6869086B2 (en) Alignment device, alignment method and alignment program
Li et al. Knee orientation detection in MR scout scans using 3D U-net
Gholipour et al. Biomedical image registration
Zhan et al. From point to surface: Hierarchical parsing of human anatomy in medical images using machine learning technologies
Nar et al. SIMULTANEOUS REGISTRATION OF ICTAL SPECT, INTERICTAL SPECT AND MR IMAGES FOR EPILEPSY STUDIES: METHOD AND SIMULATIONS

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20050816

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20061229

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: KONINKLIJKE PHILIPS N.V.

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20170315

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 919759

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170915

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 60350524

Country of ref document: DE

REG Reference to a national code

Ref country code: DE

Ref legal event code: R084

Ref document number: 60350524

Country of ref document: DE

REG Reference to a national code

Ref country code: GB

Ref legal event code: 746

Effective date: 20171120

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20170816

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 919759

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170816

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171116

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20171117

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20171228

Year of fee payment: 15

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 15

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 60350524

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20180517

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171204

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20171231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171204

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171231

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171231

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20171231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20031204

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20181204

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170816

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20181204

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170816

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20221222

Year of fee payment: 20

Ref country code: DE

Payment date: 20220628

Year of fee payment: 20

REG Reference to a national code

Ref country code: DE

Ref legal event code: R071

Ref document number: 60350524

Country of ref document: DE