CN101606158B - Graphical user interfaces (gui), methods and apparatus for data presentation - Google Patents

Abstract

A graphical user interface (GUI) includes: (a) a group definition module adapted to accept user input defining a group; (b) a data receiver operable to receive a plurality of individual measurement input data indicating matrix state; (c) a grouping module configured to assign each of the individual measurement input data to one of the groups to produce grouped data; and (d) an output module adapted to output the grouped data.

Description

Graphical user interface (GUI), method and device for data presentation

technical field

Embodiments of the invention generally relate to graphical user interfaces (GUIs), methods and apparatus useful in data presentation.

Background technique

Previously, a great deal of research and development has been conducted in the fields of tissue characterization, medical imaging, and computerized surgical planning and/or guidance. The following list of references is given to generally indicate the types of techniques known to those of ordinary skill in the art. This list is not meant to be exhaustive.

In the patent literature, changes in electrical impedance in human tissue are described to provide indications of tumors, lesions and other abnormalities. For example, U.S. Patent Nos. 4,291,708; 4,458,694; 4,537,203; 4,617,939 and 4,539,640 illustrate systems for tissue characterization by using multiple element probes that are pressed against a patient's skin and measure the impedance of the tissue to produce 2D impedance map.

Other techniques of this type are described in WO 01/43630 and US Patents 4,291,708 and 5,143,079.

US Patents 5,807,257; 5,704,355 and 6,061,589 describe the use of millimeter and microwave devices to measure bioimpedance and detect abnormal tissue. These methods direct free propagating radiation or guided radiation by means of waveguides onto the organ. This radiation is concentrated on a relatively small volume within the organ, and the reflected radiation is then measured.

US Patent 6,109,270 describes a measurement concept utilizing a multimodal instrument for tissue identification in real-time neurosurgical practice.

美国专利6,813,515；7,082,325和7,184,824，公布为20070260156；20070255169；20070179397；20070032747；20070032739；20060264738；20060253107；20050021019；20030187366和20030138378的美国专利申请描述了用于评定组织类型和/或识别肿瘤边界的工具系统和method.

US Patent 5,615,132 describes a method and apparatus for determining the position and orientation of a movable object using an accelerometer.

US Patent 6,833,814 describes an in vivo navigation system for medical applications in which three planar antennas at least partially overlapping are used to transmit electromagnetic radiation simultaneously.

Ascension Technology (Burlington VT, USA) sells a guide device called "3DGuidance ^™ Medsafe" that uses 3D magnetic tracking to locate medical instruments.

Contents of the invention

A major aspect of the invention involves combining images and/or data (which may be biological, chemical and/or physical data) with the planning and/or execution of steps. In those medically directed embodiments of the invention, for example, the image data may be X-ray-based (e.g., fluorography, computerized tomography [CT]), ultrasound-based, or MRI-based ( MRI). It should be understood that the term "image" as used herein is a representation of data indicative of properties of a subject (or substrate) under examination or under examination within a region of interest, such as a tissue region. Properties of the subject under examination or measured may include optical, electrical, geometrical properties of the subject within the region of interest. The acquired images do not necessarily provide a continuous distribution of the required properties throughout the region of interest, but are in most cases in the form of several data segments corresponding to discrete measurement sites within the region of interest.

According to an aspect of some embodiments of the present invention, a Graphical User Interface (GUI) provides data to a user by purpose groups. More specifically, the present invention deals with medical data, such as data about resected tissue, and thus is described below for this particular application. It should be understood, however, that the present invention is not limited to this application, and that the innovative aspects are equally applicable to various other applications. In some exemplary embodiments of the invention, grouped data about the resected tissue is provided to a user in the operating room, optionally during the resection step.

According to various embodiments of the invention, a data representation of a set includes individual data and/or a collection of one or more statistics summarizing the set.

Another aspect of some embodiments of the invention relates to an apparatus configured and operable to divide data belonging to individual points on a substrate into groups during data acquisition. In some exemplary embodiments of the invention, a user provides input regarding group definitions. Optionally, the group definition is selected from a list and/or defined by the user (ie "from scratch"). In some exemplary embodiments of the invention, the grouped data is presented graphically on a display screen. Optionally, grouped data is provided superimposed on the representation of the matrix. For example, a representation of a matrix may be a theoretical representation of the matrix (eg, a cube), a simplified three-dimensional shape, or an image. In medical applications, common imaging modalities include, but are not limited to, ultrasound-based imaging, fluoroscopy, computerized tomography (CT), magnetic resonance induction (MRI), impedance, and other electrical signal-based measurements . In some embodiments of the invention, image preparation is synchronized with data acquisition. In other embodiments of the invention, previously acquired images are used. In some exemplary embodiments of the invention, reducing the time elapsed between acquiring an image and acquiring other data that will be registered to the image helps to increase the accuracy of the registration. Optionally, group and/or position and/or point characterization data are stored in available memory.

Aspects of some embodiments of the invention pertain to user selection of locations on a substrate for data collection and user grouping of these locations. In some exemplary embodiments of the invention, a user may use an input device on a handheld data collection probe to group locations. Optionally, the stroma includes a resected mass of tissue and/or a lumen from which the tissue was resected. In some exemplary embodiments of the invention, the user grouping of the locations indicates the approximate location of the locations on the substrate.

An aspect of some embodiments of the invention relates to determining the relative position between a site on a substrate and a previously placed marker. Optionally, markers are placed during image-guided localization. In some exemplary embodiments of the invention, the relative position between the data collection probe and the marker is measured when data is collected at the location. Alternatively, measurement of relative position may be performed by evaluation of signal strength, and/or signal direction/polarity, and/or using external sensors, and/or image analysis, and/or using overlapping planar antennas.

Aspects of some embodiments of the invention relate to handheld devices adapted to acquire data from multiple substrate regions, and to group this data into user-defined groups. Optionally, a user input mechanism on the device allows this data to be grouped. Alternatively, the handheld device can be connected to external data analysis components and/or to an external vacuum pump. In some exemplary embodiments of the invention, the handheld device is sterilized and/or provided in sterile packaging.

An aspect of some embodiments of the invention relates to providing data indicative of a state of a substrate on a substrate model. In some exemplary embodiments of the invention, a single detector simultaneously collects data on location coordinates and substrate state. In some exemplary embodiments of the invention, the user indicates the location of each data point. Optionally, the model is a predefined geometric model (eg cube, tube, cylinder or sphere) or a realistic model (eg based on medical images).

Aspects of some embodiments of the invention relate to combining location data with data indicative of substrate status for procedure planning and/or execution on and/or around the substrate. Optionally, the position data indicates the position of the probe, which provides data indicative of the state of the substrate, and/or the position of the tool when certain data was acquired. In a medical embodiment of the invention, the tool may be a cutting tool and/or a sampling tool. Optionally, combining positional data with data indicative of the state of the substrate is used for planning and/or execution of steps on and/or around the substrate.

In some exemplary embodiments of the invention, a graphical user interface (GUI) is provided. The GUI includes: (a) a group definition module (software and/or hardware tool) adapted to accept user input defining the group; (b) a data receiver operable to receive a plurality of individual measurement input data indicative of the state of the substrate; (c) a grouping module (tool) configured to assign each individual measurement input data to one of the groups to produce grouped data; and (d) an output module (tool) adapted to output the grouped data.

In some exemplary embodiments of the invention, an apparatus is provided. The apparatus includes: (a) a detector operable to generate a plurality of individual signal data indicative of a substrate state; (b) a group definition module adapted to accept user input defining a group; (c) a grouping module configured to receive a signal comprising individual data and assigning each individual data to one of the groups to produce packet data; and (d) an output module adapted to output the packet data.

In some exemplary embodiments of the invention, a method of analyzing a matrix is provided. This method involves: (a) selecting multiple locations on the substrate; (b) collecting data indicative of the state of the substrate at each location; and (c) grouping the data into user-defined groups.

In some exemplary embodiments of the present invention, a matrix analysis system is provided. The system includes: (a) a substrate position indicator located at the substrate; (b) a detector operable to evaluate the state of the substrate and output data indicative of the state at an individual point; (c) a measurement module configured to determine the position the relative position of the indicator and detector; and (d) a controller adapted to coordinate the operation of the detector and measurement module to determine the relative position of each individual point.

In some exemplary embodiments of the invention, a surgical monitoring system is provided. This system includes: (a) an input module adapted to receive a path from the step planning module described herein; and (b) a guidance system adapted to output guidance instructions to guide a surgical tool according to the path.

In some exemplary embodiments of the invention, there is provided a substrate detector comprising: (a) a data acquisition module adapted to engage a substrate at a user-selected point, analyze the substrate and generate (b) a user input device adapted to accept a defined set of user inputs; (c) a signal conduit adapted to transmit electrical signals; and (d) a lumen adapted to transfer negative pressure from an external The vacuum source is delivered to the data acquisition module.

In some exemplary embodiments of the invention, there is provided a substrate detector comprising: (a) a data acquisition module adapted to engage a substrate at a user-selected point, analyze the substrate and generate (b) a location determination module adapted to provide the location of the point; (c) a user input device; (d) a signal conduit adapted to transmit an electrical signal; and (e) a lumen adapted to place the negative Pressure is delivered from an external vacuum source to the data acquisition module.

In some exemplary embodiments of the invention, an apparatus for matrix analysis is provided. This apparatus includes: (a) a detector operable to generate a plurality of individual signal data indicative of the state of the substrate at a specified location; (b) a modeling module adapted to generate a three-dimensional model of the substrate; (c) a registration a registration module adapted to indicate designated locations on the model; and (d) an output module adapted to provide an indication of a substrate state at each designated location on the model.

Various exemplary embodiments according to the invention include one or more of the following optional features.

Optionally, a registration module is included.

Optionally, the registration module registers the grouped data to one selected from the group consisting of: a volumetric representation of the substrate, a space-filling model of the substrate, and an image of the substrate (eg, a three-dimensional image of the substrate).

Optionally, the user input includes a start command and an end command.

Optionally, the user input includes a name.

Optionally, the name indicates a location on the substrate.

Optionally, names are provided as nested menus.

Optionally, separate data indicative of the state of the substrate is associated with the location coordinates.

Optionally, positional coordinates are defined relative to the matrix.

Optionally, output of grouped data includes individual data arranged in groups.

Optionally, the output of grouped data includes at least one statistic summarizing the individual data in each group.

Optionally, a storage module is included adapted to store the packet data output by the output module.

Optionally, the data receiver is adapted to simultaneously receive individual measurement input data from the detector array.

Optionally, the user input is provided at times selected from: before, during and after the data receiver receives the plurality of individual measurement input data.

Optionally, at least one user input mechanism on the detector is included.

Optionally, at least one indicator on the detector is included.

Optionally, the output module includes a display.

Optionally, the output module includes memory.

Optionally, the detector is adapted to measure dielectric properties of the substrate.

Optionally, the detector is adapted to measure electromagnetic properties of the matrix.

Alternatively, the detector is manually operable.

Optionally, a plurality of individual data indicative of the state of the substrate are associated with manually selected locations on the substrate.

Optionally, the user input indicates a location on the substrate.

Optionally, the detector comprises a plurality of sub-detectors arranged in a spatial array, the sub-detectors being jointly operable by a single detector activation signal.

Optionally, the detector is operable in at least two sensing/characterization modes.

Optionally, the selecting step includes visual inspection.

Optionally, the data indicative of the state of the matrix includes evaluations of dielectric properties.

Optionally, the data indicative of the state of the matrix includes evaluations of electromagnetic properties.

Optionally, embodiments of the invention include output groups.

Optionally, embodiments of the invention include computing at least one statistic summarizing the individual data in each group, and outputting the at least one statistic.

Optionally, embodiments of the invention include mapping groups onto representations of matrices.

Optionally, the mapping is onto a representation of the substrate selected from the group consisting of: a volumetric representation of the substrate, a space-filling model of the substrate, and an image of the substrate.

Optionally, user-defined groups each indicate a location on the matrix.

Optionally, embodiments of the invention include defining positional coordinates for each location on the substrate.

Alternatively, the signal originates from the detector and is received at the position indicator.

Optionally, the signal originates from a position indicator and is received at the detector.

Optionally, embodiments of the invention include a position sensor adapted to determine the first detector position and the second substrate position indicator position; wherein the measurement module determines the relative position by comparing the first position and the second position.

Optionally, the matrix analysis system according to an exemplary embodiment of the present invention comprises an imaging module adapted to generate an image depicting the detector and the position indicator; wherein the measurement module determines the relative position from the image.

Optionally, the matrix analysis system according to an exemplary embodiment of the present invention comprises a registration module adapted to register the status indicating data from the individual points with the medical image data.

Optionally, the matrix analysis system according to an exemplary embodiment of the present invention comprises a registration module adapted to register the local summary of the status indication data with the medical image data.

Optionally, exemplary embodiments of the present invention include a cutting tool mounted on the probe.

Optionally, exemplary embodiments of the present invention include an output module adapted to output the relative position and status indication data of each individual point together.

Optionally, a step planning module is included.

Optionally, the step planning module is adapted to analyze the output from the output module and calculate the path.

Optionally, the step planning module is adapted to accept user input regarding the planned path.

Optionally, in some embodiments of the invention the probe includes a connector to an external data analysis component.

Optionally, the probes in some embodiments of the invention are provided as sterile medical devices.

Optionally, the user input device is configured to group the data into data groups.

Optionally, a user-sensible indicator of the state of the substrate is provided on the detector.

Optionally, the user senses the indicator to produce an audible indication.

Optionally, the user perceives the indicator to produce a visible indication.

Optionally, some embodiments of the invention are adapted to accept user input specifying the location of the zone.

Alternatively, some embodiments of the invention are adapted to determine the location of a region.

Optionally, some embodiments of the invention include a position sensor adapted to determine the position of the zone.

Optionally, the model used in the embodiment of the present invention includes a predefined geometric model.

Alternatively, the models used by embodiments of the present invention include actual models indicative of the true matrix shape.

Alternatively, embodiments of the invention are adapted to accept as input medical image data, and to generate the actual model from the medical image data.

Optionally, direct the output to one selected from the group consisting of: a graphics display, a printer, and memory.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Although suitable methods and materials are described below, methods and materials similar or equivalent to those described herein can be used in the practice of the present invention. In case of conflict, the patent specification, including definitions, will control. All materials, methods, and examples are illustrative only and not intended to be limiting.

As used herein, the terms "comprises" and "comprises" or their grammatical variations should be understood as specifying that stated features, integers, acts or components include, without excluding the addition of one or more additional features, integers , action, component, or group of them. This term includes and is broader than the terms "consisting of" and "consisting essentially of" as defined in the USPTO's Manual of Patent Examining Procedure.

The phrase "consisting essentially of" or its grammatical variations when used herein should be understood as specifying a stated feature, integer, step or component without excluding the addition of one or more additional features , integer, step, component or group thereof, as long as the additional feature, integer, step, component or group thereof does not substantially change the basic and novel features of the claimed composition, device or method.

The term "method" refers to ways, means, techniques and steps for accomplishing a given task, including but not limited to those ways, means, techniques and steps known to professionals in architecture and/or computer science, or derived from those ways Ways, means, techniques and steps that are easy to develop in , means, techniques and steps.

Embodiments of the methods and systems of the present invention include performing or completing selected tasks or steps manually, automatically, or a combination of both. Moreover, according to the actual instrumentation and equipment of the preferred embodiments of the method, apparatus and system of the present invention, several selected steps may be performed by hardware or software on an operating system of arbitrary firmware or a combination of both. For example, in hardware, selected steps of the invention may be implemented as a chip or a circuit. In software, selected steps of the invention could be implemented as a plurality of software instructions being executed by a computer using any suitable operating system. Regardless, selected steps of the methods and systems of the present invention may be described as being performed by a data processor, such as a computing platform that executes a plurality of instructions.

Description of drawings

In order to understand the invention and to understand its practical manner of carrying out, some embodiments have been described, by way of non-limiting examples only, with reference to the accompanying drawings. For simplicity and clarity of illustration, elements shown in the figures have not necessarily been drawn to scale. For example, the dimensions of some of the elements may be exaggerated relative to other elements for clarity. Further, where considered appropriate, reference numerals have been repeated among the figures to indicate corresponding or analogous elements.

In these figures:

Figure 1 is a schematic diagram of a system according to an exemplary embodiment of the present invention;

Figure 2A is a schematic diagram of an exemplary information screen in accordance with an embodiment of the present invention;

Figure 2B is an exemplary schematic representation of a matrix according to one embodiment of the invention;

Figure 2C is a schematic diagram of an exemplary information screen according to one embodiment of the present invention;

Figure 2D is an illustration of an exemplary detector array according to some embodiments of the invention;

2E to 2H are schematic diagrams of additional exemplary information screens according to embodiments of the invention;

3A is a schematic diagram of registering output data to a predetermined geometric model according to an exemplary embodiment of the present invention;

Figure 3B is a schematic diagram of a three-dimensional matrix according to an embodiment of the invention;

4A and 4B are substrate side views depicting exemplary detectors and exemplary substrate position indicators according to exemplary embodiments of the present invention;

Figure 5 is a simplified flowchart of a method according to an exemplary embodiment of the present invention; and

Figure 6 is a schematic diagram of an exemplary user input interface according to one embodiment of the present invention;

7 to 10, 12 and 13 are schematic diagrams of exemplary information screens according to embodiments of the present invention;

Figure 11 is a set of exemplary user input devices according to one embodiment of the present invention;

Figure 14 is a schematic representation of an exemplary graphical user interface according to an embodiment of the invention;

Figure 15 is a simplified flowchart of a method according to an exemplary embodiment of the invention;

Figure 16 is a schematic representation of an exemplary monitoring system according to some embodiments of the invention; and

FIG. 17 is a more detailed schematic representation of a possible exemplary guidance system of FIG. 16 .

Detailed ways

review

Various embodiments of the invention relate to computerized analysis systems, data acquisition tools for use with the systems, and user interfaces suitable for data entry and/or data presentation. In particular, some embodiments of the invention may be used to define and provide sets of individual data points and/or map the data onto a model of the matrix (region of interest) in which the data points reside.

The principles and operation of the system method and apparatus according to the exemplary embodiments of the present invention may be better understood with reference to the drawings and accompanying descriptions.

Before describing in detail at least one embodiment of the invention, it is to be understood that the invention is not limited in application to the details set forth in the ensuing description. The invention is capable of other embodiments or of being practiced or carried out in different ways. Also, it is to be understood that the phraseology or terminology used herein is for the purpose of description and should not be regarded as limiting.

Figure 1 is a schematic diagram of an exemplary system 100 according to one embodiment of the invention. The depicted system 100 includes a data acquisition device or measurement unit (depicted as probe 40). The probe 40 includes an operative portion 42 for scanning (contact or non-contact scanning) the substrate to be measured, and is configured to be operable to measure and/or characterize one or more substrate conditions indicative of the scanned site of the substrate or properties of one or more parameters.

In some exemplary embodiments of the invention, the matrix is biological tissue, such as a piece of tissue excised from a subject during a surgical procedure. In other embodiments of the invention, the substrate is a mineral substrate, such as a piece of material taken from a quarry or mine.

According to various exemplary embodiments of the invention, detector 40 is configured to measure electromagnetic properties (e.g., using non-radioactive sensors), dielectric properties, impedance, biological properties, chemical properties, optical properties (e.g., fluorescence emission and/or or absorption and/or reflectivity of light of selected wavelengths), MRI, energy transfer and/or reflectivity (e.g. radio frequency [RF] or microwave [MW]) and temperature (e.g. by means of infrared thermography) one or more. Optionally, the probe 40 is configured as a dielectric sensor, essentially formed as a coaxial cable.

In some exemplary embodiments of the invention, detector 40 includes a single sensor at operating portion 42 . In other exemplary embodiments of the invention, the detector 40 includes a sensor array at the operating portion 42 .

In some exemplary embodiments of the invention, the manipulation portion 42 includes a cutting tool and/or a sampling tool. Optionally, the cutting and/or sampling tools may be independently controlled. In some exemplary embodiments of the invention, a controller operates the cutting and/or sampling tool in response to data provided by the sensor.

Optionally, the detector 40 includes or is associated with a control utility including one or more operational memory devices 47, a master database storage facility 48, one or more control buttons 43 (e.g., for activating the detector 40 and/or for initiation and/or measurement/characterization processing), and data processing tools (not shown here). Likewise, detector 40 may include one or more such light sources (depicted as LEDs 45 and 46), indicators or displays 1 (such as LCD or CRT). In some exemplary embodiments of the invention, the display 1 is used to display results and/or information related to diagnosis and/or surgical planning. Optionally, one, two, three or more categories of results and/or information are provided.

There is a tradeoff between the amount of information provided on the detector 40 and the user's ability to organize and understand the information. In some exemplary embodiments of the invention, a small amount of information is provided instantaneously on the detector 40 for immediate user evaluation and/or reaction, and a larger amount of information is provided for a longer period of time on the display 24, which is connected to the detector. The device 40 is physically separated.

Figure 1 depicts the data conduit 5 between the probe 40 and an external control station. Conduit 5 is drawn as a physical connection (such as a wire or fiber optic cable), but could be replaced by a wireless link (such as Bluetooth, infrared (IR) or radio frequency (RF)).

The depicted control station or console 20 includes a control component 22 . The latter is typically a computer system comprising one or more control buttons 23 which can be used, for example, to activate the detector 40 and/or initiate and/or control measurements and/or characterizations. Optionally, the control station 20 comprises additional input interfaces, such as a keyboard 26 or a joystick 29 and/or read/write means 27 (eg CDROM or DVD drive) and/or storage means 50 . The storage component 50 may include a data processor or processing component. Optionally, control component 22 may be configured to communicate with signal analyzer 25 and/or audio speaker 31 and/or display screen 24 .

Control station 20 is depicted as being on chassis 28 , although control station 20 could be incorporated into a handheld device, such as a personal digital assistant or smart phone, or a laptop computer.

Optionally, the processing component 50 includes a detector localization module 58 and/or a physical marking module 58a.

Exemplary detectors and analysis systems for use in various embodiments of the invention (e.g., for sensing, receiving, processing, storing and/or displaying) are described in a paper entitled "Method And System For Examining Tissue According To The DielectricProperties Thereof", U.S. Patent No. 6,813,515, filed on November 18, 2002, entitled "Method And Apparatus For Examining Tissue For Predefined TargetCells, Particularly Cancerous Cells, And Such A Probe Useful AndApparatus," U.S. Application No. 10/298,196, filed March 23, 2005, entitled "Clean Margin Assessment Tool," and February 12, 2007, entitled "Method, Systems, And Sensors For Examining Tissue According To The Electromagnetic Properties Thereof", each of which is assigned to the common assignee of the present invention and is hereby incorporated by reference.

Positioning module 58 and physical marking module 58a may optionally be used, such as the techniques described in US 7,082,325, filed July 15, 2004, entitled "Method and Apparatus For Examining A Substance, Particularly Tissue, To Characterize Its Type".

In some exemplary embodiments of the invention, localization module 58 relies on medical imaging data. Medical imaging data includes, but is not limited to, X-ray (such as fluoroscopy or computerized tomography [CT]), magnetic resonance induction (MRI), ultrasound (US) and infrared (IR) imaging data .

In some exemplary embodiments of the invention, the command causes a detectable material to be deployed from the operative portion 42 of the probe 40 to physically mark the measurement site. Users can detect physical markers instantly or with a delay. Physical marking is performed, for example, by use of a visually detectable substance such as one or more colored biomarker inks emitted from nozzles mounted at the operative portion 42 of the probe 40 .

Briefly, in response to instructions from the processing component 50, the marking module 58a issues commands to physically mark the measurement sites on the substrate.

The processing unit analyzes the measurements from the detectors 40 . Following substrate (eg tissue) identification, marking module 58a issues coloring specific commands to nozzles (not depicted) and prints the appropriate coloring markings on the substrate. According to some exemplary embodiments of the present invention, one or more measurements within a region or area may be marked using, for example, the marking module 58a, eg, related to the measured output of the measured area or area. Such indicia may correspond to matrix characterization results/outputs and/or to region-related data and/or to other data available from processing component 50 .

According to various embodiments of the invention, probe 40 may be configured as an extracorporeal device, an intracorporeal device, a device adapted on a portion of subcutaneous tissue, or a device adapted on a portion of internal tissue during open surgery.

Exemplary in vivo devices may be specifically configured for minimally invasive procedures and/or for insertion via a trocar valve and/or for insertion into a body lumen via a body orifice (e.g., using a on a portion of the lumen for further penetration into the lumen for use on a portion of body tissue outside the lumen) and/or for percutaneous insertion into a body lumen (for example, for use on a portion of the lumen wall for further penetration into the lumen for use on a portion of body tissue outside the lumen).

或Mac

)上。可选择地，可使用多个监视器来显示数据。For example, the external display screen 24 and the indicator 1 on the detector 40 may be a CRT screen, LCD screen, plasma screen or projection display or any other device capable of providing images or other data such as audible output. In an exemplary embodiment of the present invention, various types of information are displayed on a compartmentalized user interface (eg

or Mac

)superior. Alternatively, multiple monitors may be used to display data.

Exemplary GUI

FIG. 14 is a schematic block diagram illustrating the interaction of components of an exemplary graphical user interface (GUIs) 1400 according to some embodiments of the invention. Figures 2A, 2C, 2E, 2F, 2g, 2H, 3A and 3B depict exemplary graphical output for this type of GUI.

In some exemplary embodiments of the invention, GUI 1400 includes a group definition module 1410 adapted to accept user input defining a group, and a data receiver 1424 operable to receive a plurality of individual measurement input data indicative of a state of a substrate (eg from detector 40).

In some exemplary embodiments of the invention, the user input includes a start command and an end command. Optionally, the group definition module includes a single button, the first press of which indicates "Start assigning measurement input data to groups" and the second click of which indicates "The most recent measurement input data received is group the end of". In some embodiments of the invention, each click of the button after the first click indicates the end of the previous group and the start of the subsequent group. In some exemplary embodiments of the invention, a button is placed on the detector 40 .

In some exemplary embodiments of the invention, the user input includes a name. Alternatively, this name may be selected from a menu (eg using a physical interface such as a scroll wheel, mouse or joystick) or entered manually by the user (eg using a keyboard or via voice commands).

Optionally, the name indicates a general location on the substrate. In some exemplary embodiments of the invention, group designations are according to conventions commonly used by medical professionals: medial (M), lateral (L), posterior/deep (D), anterior/surface (SF ), below (I) and above (S). Alternatively, multiple groups may be assigned to the same general location (eg S1 , S2 or M1 , M2 and M3).

In some exemplary embodiments of the invention, the inner surface of a body cavity is used as the matrix. Alternatively, data acquired from the lumen was used by adding "C" or "CAV" to the above commonly used convention group names. Optionally, data is collected from resected tissue and lumens resulting from single-step resections.

Optionally, use group numbers instead of names. In some exemplary embodiments of the present invention, groups are numbered consecutively according to their collection order.

In some exemplary embodiments of the invention, titles are presented to the user in a nested menu.

Optionally, the user selects a group name from a list of names, optional names describing the field.

Alternatively, instead of using a list, the user enters a name, eg using the keypad 26 or the buttons 43 on the detector 40, the user may name the zone 210 'XL'. Alternatively or additionally, the user may store the name 'XL' in a 'language' database, for example at the database storage means 48.

In some exemplary embodiments of the invention, by pressing the control buttons 43 and 44, or the keyboard 26 and/or voice operating system or machine and/or by using a touch screen and/or a virtual touch screen (for example by contacting the surgeon's hand) movements and gestures to manipulate the screen), to name the group.

User input and individual measurement input data defining groups are processed by a grouping module 1430 configured to assign each of said individual measurement input data to one of said groups to generate grouping data 1450 for outputting by means of Module 1440 outputs.

Optionally, GUI 1400 includes a registration module 1460. In some exemplary embodiments of the invention, registration module 1460 registers grouped data 1450 onto matrix model 1452 . The registration can be based on general location information (eg indicated by the group name) and/or based on the location coordinates of one or more points in the group. For example, the matrix model 1452 can be a geometric solid representation of the matrix (e.g., a cube, sphere, cylinder, tube, or polyhedron), a space-filling model of the matrix (e.g., a model based on general characteristics of the anatomical part or organ being examined), or An image of the stroma produced using any known imaging technique. Alternatively, the registration of the images may be a registration of previously acquired images.

In some exemplary embodiments of the invention, separate data indicative of the state of said matrix are associated with positional coordinates. Optionally, position coordinates are defined relative to the matrix. One exemplary way of doing this is to use position sensor 1420 to generate position coordinates 1422 , which are then sent to data receiver 1424 along with individual measurement input data from detector 40 . Optionally, a position sensor 1420 is mounted on the probe 40 .

2A is a schematic representation of an exemplary output 200 of grouped data 1450 from GUI 1400. For example, output 200 may be displayed on display screen 24 and/or indicator 1 (eg, LCD) and/or stored in memory of processor 50 and/or written to a machine-readable medium in read/write drive 27 . In some exemplary embodiments of the invention, output 200 displays information in a manner designed to assist a user in making a diagnosis and/or planning a surgical response.

The depicted exemplary output 200 includes sets of measurements or results 210 , 220 , 230 , 240 and 250 . Optionally, each group corresponds to an area on the substrate. These groups may include one or more measurements or results, and different groups may include different numbers of measurements/results.

For example, area 210 includes five measurement outputs, such as measurement results 211 , 212 , 213 , 214 , and 215 , while area 250 includes two measurement outputs 251 and 252 .

According to some embodiments of the invention, a single measurement relates to a single point on a substrate (e.g. a piece of resected tissue) and a group of measurements relates to a range or general location on the substrate, wherein all individual measurements in the group are performed .

For example, as shown in FIG. 2B, a user may examine a range 210' on a substrate 260. Range 210' can be displayed in output 200 as group 210. The measurement output of each inspection point in the range 210', such as the measurement output of points 211', 212', 213', 214' and 215', respectively, can be displayed in the area 210 as, for example, a bar graph 211 like FIG. 2A , 212, 213, 214 and 215. The association between group 210 and range 210' is optionally provided by a descriptive title 216 or group name (e.g. L for side).

Optionally, each group is automatically named or numbered. For example, the first area inspected, such as area 210, is numbered "1," and subsequent inspected areas are automatically numbered "2." In some embodiments, a user may insert a title (eg, name or number) to each field, eg, according to the region's location in the substance being examined, or according to the number of the examination.

According to some embodiments of the invention, a single measurement may relate to a single point on a substrate, such as tissue, which is measured or characterized by a single sensor. Optionally, the sensor is one of a set of sensors provided in an array on the operative portion 42 of the probe 40 .

According to other embodiments of the invention, a single measurement may relate to multiple points on the substrate measured by individual sensors belonging to a set of sensors provided in an array on the operative part 42 of the probe 40 . Alternatively, a single measurement is the arithmetic mean or median of a series of measurements. Optionally, an indication of variability is also provided.

In those embodiments of the invention that use groups or arrays of sensors, such groups or arrays may optionally be operated in unison. Consistent operation refers to simultaneous or sequential measurements by individual sensors in such a group/array as a result of a single operational input or command. In some exemplary embodiments of the invention, the use of groups or arrays of sensors helps to increase the accuracy and/or reliability of collected data without prolonging the time of data collection.

For example, as shown in FIG. 2B , the surgeon may attach probe 40 to region 210 ′ on substance 260 . If the operative portion 42 of the detector 40 comprises an array of sensors, each point in the range 210' can be provided as a single data point indicating all measurements from all sensors in the array, or as a series of data outputs ( Each sensor has an output). Additionally, one or more measurement outputs of range 210' may be displayed on information screen 200 using, for example, display screen 24 or indicator 1 such as an LCD.

FIG. 2C depicts an exemplary matrix A of the outputs of sensor array 42' (FIG. 2D). In some exemplary embodiments of the invention, a matrix A is provided for each checked point 211', 212', 213', 214' and 215' in the range 210'. According to these exemplary embodiments of the invention, individual measurements are displayed simultaneously, with each index Aij in the matrix A respectively representing the output of a single measurement from a corresponding sensor Bij of the sensor array 42'.

In other exemplary embodiments, measurements from sensor array 42' are compressed into a single data set for each inspected point 211', 212', 213', 214', and 215' in range 210' (e.g., via average).

Alternatively or additionally, the data set (eg, 210) includes a plurality of measured outputs of the matrix A resulting from a plurality of operations of the array 42' at a plurality of locations. For example, a user may use probe 40 with sensor array 42' to characterize a first substrate region (e.g., 211'), and characterize a second substrate region (e.g., 214' or adjacent to the first region) by moving the sensor array. . For example, the measurement output 211 of the first substrate range and the measurement output 214 of the second substrate range both take the form of matrix A, and the group representation 210 is a sequence of matrix A. Alternatively, the measurement output for the first matrix range and the second matrix range may be displayed as a single group (eg "M") or as separate groups (eg M1 and M2). Optionally, several detectors comprising matrices operate in parallel. In some exemplary embodiments of the invention, the use of matrices reduces data collection time and/or helps increase the usefulness of grouped data.

According to various embodiments of the invention, a single measurement output may be binary (e.g., yes/no, or malignant/harmless), discrete (e.g., on a scale with numbered units, optionally with increasing in size increments) or continuous (e.g. temperature, conductivity, color picked from a spectrum).

According to various embodiments of the present invention, for example, the measured output level or percentage of carcinogens or non-carcinogens (such as stromal tissue) can be displayed in numerical form (for example, no/yes, or red/green), or in bar form Graphically (e.g. carcinogen or non-carcinogen levels or percentages may be indicated by bar length or color and/or position relative to baseline), proportionally filled circles, a combination of numerical results and bars, and Level results only, eg contain only carcinogen levels without a yes or no indication.

Optionally, faulty measurements such as faulty sensor signals, mechanical faults of the probes are indicated on the GUI, eg with empty boxes and/or dedicated colors and/or error messages.

Figure 2E depicts an additional exemplary display screen 201 having bars 280 and 290, the length of which indicates the percentage of carcinogens measured during a single measurement (50% and 90%, respectively).

Optionally, the individual measurement data and/or group names are stored in the system 100 (eg, in the control station 20 or in the database storage component 48 of the probe 40).

According to some embodiments of the invention, each measurement data acquired by the probe 40 is summarized by a momentary audio indication. For example, a beep may be used to indicate "normal" and a hum may be used to indicate an "abnormal" substrate status. A series of beeps can be used to indicate a faulty measurement.

Alternatively or additionally, the status of the grouping module 1430 may be indicated by an audio signal. For example, the "start" signal delivered from the group definition module 1410 can produce a single-click sound, which indicates that the individual data acquired successively will be grouped together, and the "end" signal delivered from the group definition module 1410 can produce a double-click sound, which indicates Indicates the end of the group.

According to some embodiments of the invention, each measurement data acquired by the probe 40 is summarized by a momentary visual indication. For example, light sources 45 and 46 are used (eg red LEDs to indicate abnormal measurements, green LEDs to indicate normal measurements, yellow LEDs to indicate faulty measurements).

FIG. 2F depicts an additional exemplary display screen 203 showing exemplary output of summary statistics 292 (eg, mean values) for grouped data 1450 . Summary statistics 292 may be provided instead of, or in addition to, individual bars representing the status of data from a single location.

Types of summary statistics 292 include, but are not limited to, mean, mode, median, standard error of the mean (SEM), and standard deviation (SD). Optionally, two or more summary statistics (eg mean and SD or median, mean and SEM) are displayed simultaneously. Alternatively, the full measurement output 292 for each zone may be displayed separately. Overall measurement output 292 represents the totality of all measurements performed in the area.

In some exemplary embodiments of the invention, the summary statistic 292 indicates the number of data in the group whose values exceed a predetermined threshold, the peak or the accumulation of all measurements in the group.

In some exemplary embodiments of the invention, summary statistics 292 are provided during data acquisition and are updated as new data is added to the group.

In some exemplary embodiments of the invention, summary statistics 292 are provided when data acquisition is complete and the group is complete.

FIG. 2G depicts an additional exemplary display screen 205 showing measurement outputs 298 and 299 including alphanumeric measurement indications.

Figure 2H depicts a simultaneous display 291 of data from two different sensor types, as described in detail below.

As described above, the output of grouped data 1450 includes the individual data arranged in groups and/or at least one statistic summarizing the individual data in each group. Optionally, packet data 1450 is stored in memory module 1470 .

In some exemplary embodiments of the invention, the data receiver 1424 is adapted to simultaneously receive individual measurement input data from the detector array. Alternatively or additionally, the data receiver 1424 is adapted to simultaneously receive separate measurement input data from different types of sensors.

According to various exemplary embodiments of the invention, user input is provided before and/or during and/or after data receiver 1424 receives said plurality of individual measurement input data.

Demonstration equipment for matrix analysis

In some exemplary embodiments of the invention, system 100 (FIG. 1) includes an apparatus for matrix analysis. According to some embodiments of the invention, the device comprises a detector 40 operable to generate a plurality of individual signal data indicative of the state of the substrate. Optionally, the detector 40 is activated by contacting the operating portion 42 with a portion of the substrate and/or by manipulating one or more control inputs 43 . The device comprises a group definition module 1410 (FIG. 14) adapted to accept user input defining groups, and configured to receive said signal data indicative of substrate status and assign each of said individual data to one of said groups to generate A grouping module 1430 for grouping the data 1450 , and an output module 1440 adapted to output the grouped data 1450 . According to various embodiments of the present invention, the output module 1440 includes a display (eg 1 and/or 24 ) and/or a memory (eg 27 or 50 ) and/or a printer (not shown). In some embodiments of the invention, components such as group definition module 1410 and/or grouping module 1430 and/or output module 1440 are provided on detector 40 .

In some exemplary embodiments of the invention, device 100 includes one or more user input mechanisms on probe 40 . In the embodiment depicted in FIG. 1, the button 43 on the detector 40 serves as the user input mechanism.

Optionally, device 100 includes at least one indicator on detector 40 (eg, LEDs 45 and 46 ). These indicators are used as components of the output module 1440 .

In some exemplary embodiments of the invention, the probe 40 measures dielectric and/or electromagnetic or other properties of the substrate, as described above. Probes capable of measuring dielectric and/or electromagnetic properties or other properties have been described, and one of ordinary skill in the art will be able to modify these probes for use in the context of the present invention.

In some exemplary embodiments of the invention, the probe is manually operable (eg, by button press and/or by contact with the substrate).

In some exemplary embodiments of the invention, a plurality of individual data indicating the state of the substrate (eg 211, 212, 213, 214 and 215) are associated with manually selected locations on the substrate (211', 212', 213' , 214' and 215'; see Figures 2A and 2B) are associated.

In some exemplary embodiments of the invention, a device includes a registration module 1460 . Optionally, the registration module 1460 registers the grouped data onto a model of the matrix. According to various embodiments of the invention, the model may be a solid representation of the substrate (eg a cube, sphere, dodecahedron or cylinder) and/or a space-filling model of the substrate and/or an image of the substrate.

In some exemplary embodiments of the invention, user input indicates a location on said substrate. For example, a group name entered through the group definition module may be used to indicate which face of the cube the grouped data 1450 should be displayed on.

FIG. 3A shows an exemplary output 300 of grouped data registered on a three-dimensional model. In this figure, the matrix is represented by a cube. Faces 310, 320 and 330 of the cube are visible. During examination of a substrate (eg, a resected tissue block), the user can optionally select an automatic region selection mode display. For example, a user may measure substrate properties at points in different regions of the substrate (e.g., [311, 312] and [321] and [331, 332 and 333]), where the square brackets indicate the values provided by the user by means of the group definition module 1410. group label.

In some exemplary embodiments of the invention, registration module 1460 applies grouped data 1450 to matrix model 1452 to produce an output of the type depicted in FIG. 3A . In the depicted exemplary output, the matrix model 1452 is in the shape of a cube, where each face of the cube corresponds to a region of the cube according to the nomenclature system of M/L/D/SF/I/S described above.

In other exemplary embodiments of the present invention, a three-dimensional shape other than a cube is used as the matrix model 1452 (eg, a sphere, a dodecahedron, a tube, or a cylinder).

When using shapes other than cubes, an appropriate naming system may be used. For example a sphere model may use names based on longitude and/or latitude. Tube or cylinder models may use names based on z (eg, top, top-central, central, central-bottom, and bottom) and angles in the plane perpendicular to z. A name for a polyhedron shape (such as a dodecahedron) may correspond to an enumeration of surfaces in a predetermined order (such as 12 in the case of a dodecahedron), which can be further refined if the polyhedron has a particular symmetry (such as in In the case of hexahedrons: cube, box, pyramid; each capable of more specialized enumerations).

FIG. 3B shows an irregularly shaped substrate having a surface 330' corresponding to the cube model surface 330 of FIG. 3A. Locations 331', 332' and 333' indicate measurement sites 331, 332 and 333, respectively.

Although a simple matrix model 1452 is depicted in FIG. 3A, display 300 can include model 1452 in the form of medical image data. Medical image data may include any imaging data, including the types of image data mentioned above. Alternatively, image data may be acquired in advance or concurrently with acquiring separate data indicative of the state of the substrate.

In some exemplary embodiments of the invention, separate data indicating the status of substrates belonging to the same group are displayed and registered on the substrate model 1452 in labels (e.g., group indicators) or modalities (e.g., colors) to assist the user Determine which points belong to the group indicating which stromal region. Alternatively, the individual data indicating the matrix state of all points in the first area may have a first mark or symbol such as a star and/or a color such as orange, while indicating the state of all points related to the second area. The individual data of the matrix state may comprise a second symbol such as a circle and/or a second color such as black. In some exemplary embodiments of the present invention, the nomenclature of M/L/D/SF/I/S is associated with specific symbols and/or colors. Alternatively, the letters M/L/D/SF/I/S are used as symbols for the corresponding faces of the cube. Alternatively or additionally, assign colors to the six faces of the M/L/D/SF/I/S system (e.g. M-red, L-orange, D-yellow, SF-green, I-blue, S- Purple).

Alternatively or additionally, each displayed individual data indicative of the state of the substrate comprises data related to the state of the substrate in the different formats detailed above. Alternatively or additionally, summary statistics 292 as described above are displayed on each facet. Optionally, summary statistics 292 summarize a single group or all groups belonging to a particular facet. Optionally, summary statistics color code or label individual data using the symbols described above.

According to some embodiments of the invention, separate data indicating the state of substrates belonging to the same group and/or residing on the same plane are connected by a connector. Optionally, the connector is like a surface area connector that encloses all the individual data belonging to the group. Optionally, the connectors are added automatically, eg, by the registration module 1460 and/or the grouping module 1430 . For example, a connector may be a graphical indication of the relationship between points. The graphical indication may include one or more line segments connecting the individual data regions, a counter surrounding all the individual data regions, or a geometric shape touching the individual data regions. In some exemplary embodiments of the invention, the connectors are dynamic and are updated as additional points belonging to the group are added. Updating can be fully automatic or in response to an update command.

In some exemplary embodiments of the invention, separate data indicative of the state of the substrate are associated with positional coordinates. Exemplary ways of obtaining location coordinates are described below.

Optionally, the operative portion 42 of the detector 40 comprises a plurality of sub-detectors arranged in a spatial array as described above with reference to Figures 2C and 2D. In some exemplary embodiments of the invention, the sub-detectors may be collectively operated by a single detector activation signal. Alternatively, contact with a substrate can be used as a detector activation signal. In some exemplary embodiments of the invention, the outputs of the arrayed array of sensors are used to provide a local summary of the state of the substrate.

In some exemplary embodiments of the invention, detector 40 is operable in at least two modes. For example, the operative portion 42 of the probe 40 may perform simultaneous sensing and detection of electrical resistance (EI) and magnetic resonance (MR) properties. Optionally, sensors for two or more modes are integrated into one sensored head.

In some exemplary embodiments of the invention, different sensing modes are combined to produce a third "hybrid" mode. For example, simultaneously measuring the EI properties of a specific region of the substrate and measuring the MR properties of the same substrate region produces a hybrid model indicative of changes in the EI properties due to MR absorption of incident electromagnetic radiation pulses.

Exemplary Matrix Analysis Method

15 is a simplified flowchart of an exemplary method 1500 of analyzing a substrate. The depicted exemplary method 1500 includes selecting 1510 a plurality of locations on a substrate, collecting 1520 data indicative of a state of the substrate at each location, and grouping 1530 the data into user-defined groups. Optionally, the selecting step 1510 is based at least in part on a user's visual inspection 1512 of the substrate. According to some exemplary embodiments of the invention, the data indicative of the state of the substrate reflects an evaluation 1522 of the dielectric and/or electromagnetic properties of the substrate at each selected location.

According to the method 1500, an output 1540 of the group is provided to the user. In some exemplary embodiments of the invention, the output of grouped data facilitates the user's ability to make decisions. Optionally, this decision is related to diagnosis and/or surgery. According to various implementations of the method 1500, the output 1540 may be to a digital display (eg, LCD or CRT screen) and/or a printer and/or memory. The output can optionally include one or more additional features described below. Additional features can help users make a decision.

In some exemplary embodiments of the invention, the grouping step 1530 may be followed by the calculation 1550 of one or more summary statistics as described above. Optionally, summary statistics are output 1540 in addition to or as an indication of the group data.

In some exemplary embodiments of the invention, method 1500 includes mapping 1560 a group onto a representation of a matrix. Optionally, the mapping step 1560 is based on a definition 1570 of location coordinates for each location (as explained below) and/or on a user-defined set of indicated locations 1532 (as explained above).

As explained above, the mapping step 1560 can be on any representation of the substrate including, but not limited to, faceted volumetric representations of the substrate, space-filling models of the substrate, and images of the substrate.

Demonstration System with Mapping Capabilities

In some exemplary embodiments of the invention, a substrate analysis system of the general type described in FIG. 1 , such as system 100 , is modified with a positional coordinate measurement module to determine the positional coordinates of a site on a substrate.

An exemplary measurement subsystem 400 is depicted in FIGS. 4A and 4B . The depicted exemplary measurement subsystem 400 utilizes markers 410 in a matrix. Optionally, marker 410 may be implanted during a previous procedure, such as an image-guided biopsy. Marker 410 may be passive or active.

For example, passive marker 410 may include a magnet or an ultrasound reflector. Alternatively, embodiments of the invention incorporating passive markers 410 may include an active location detector 435 (eg, a transducer) on detector 40 .

For example, active marker 410 may include a radio frequency (RF) or ultrasound (US) transducer. Alternatively, embodiments of the invention that include active markers 410 may include passive markers 435 on detector 40 .

In some exemplary embodiments of the invention, a marker 410 is placed at or near the geometric center of a stroma 420 (eg, a tumor or resected tissue mass), indicated at 410'. It is generally convenient to define 410' as the origin (0, 0, 0) of the three-dimensional coordinate system that defines a location on substrate 420 .

In some exemplary embodiments of the invention (FIG. 4B), detector 40 includes an active sensor 435 adapted to measure distance 460 and direction, such as the relative vector between location 445 from which matrix-indicating data was obtained and marker 410. (X, Y, Z) 440 .

FIG. 4A depicts another embodiment of the invention in which the position of the marker 410 in the matrix and the position of the marker 435 on the probe 40 are each determined by a measurement module which determines the measurement location 445 and the center 410' Between distance and direction 460.

According to one embodiment of the present invention, probe 40 may include a structure configured to receive and support a tissue sample, wherein the tissue sample includes tissue location fiducials and location fiducials associated with the structure used to fix the orientation of the tissue sample, When fixed by the detector, in order to reflect the location reference point of the tissue specimen. For example, such a structure may be similar to various embodiments described in International Publication No. WO2006/092797 entitled "Device And Method For Transporting And Handling Tissue", assigned to the common assignee of the present application and Incorporated herein by reference.

In some exemplary embodiments of the invention, the system 100 includes a substrate position indicator 410 positioned at the substrate 420, a detector operable to evaluate the status of the substrate and output status indicative data at a separate point (e.g., 445) 420, and a measurement module 470 configured to determine the relative position of the position indicator 410 and the detector 40. In some exemplary embodiments of the invention, a controller (eg, controller 22) coordinates the operation of detector 40 and measurement module 470 to determine said relative position of each of said individual points. Optionally, a reduction in the time difference between the substrate state measurement and the detector position measurement helps to improve the accuracy of the determined position for each substrate state measurement.

Optionally, the signal comes from detector 40 (eg, from sensor 435 ) and is received at position indicator 410 .

Optionally, the signal originates from position indicator 410 and is received at detector 40 (eg, at sensor 435).

In some exemplary embodiments of the invention, the measurement module 470 includes a position sensor adapted to determine a first position 445 of the probe 40 (using markers 435), and a second position 410' indicative of a substrate location (using Mark 410 to indicate (0, 0, 0)). According to these embodiments of the present invention, the measurement module 470 determines the relative position of the marker 410 and the marker 435 by comparing the first position and the second position.

Other exemplary embodiments rely on any other technique known to one of ordinary skill in the art for determining relative position.

Optionally, the measurement module is placed externally relative to the patient's body and/or relative to the substrate 420 .

In some exemplary embodiments of the invention, the system 100 includes an imaging module adapted to generate an image depicting the probe and the position indicator, and a measurement module 470 to determine the probe 40 and the matrix center 410' in the image The relative position of the data. Optionally, image data references 410 and/or 435 .

In some exemplary embodiments of the invention, data indicative of the state of the substrate is provided and registered on a three-dimensional representation of the substrate generated from the image data.

Optionally, probe 40 includes a cutting tool. In some exemplary embodiments of the invention, a cutting tool is mounted at or near operating portion 42 and/or sensor 435 such that location 445 location and/or substrate status information is associated with the cutting tool.

In some exemplary embodiments of the present invention, the output module 1440 outputs the relative position of the detector 40 and status indication data for each individual point 445 . Optionally, this facilitates the ability of registration module 1460 to register individual points 445 and/or grouped data 1450 on matrix model 1452 .

Optionally, system 100 includes a step planning module 1480 . Optionally, step planning module 1480 is adapted to analyze said output from said output module and/or registration module 1460 and calculate a path. The calculated path is optionally used as a cutting path and/or as a guide for delivering the implantable device and/or drug. Exemplary implantable devices include, but are not limited to, brachytherapy cores and stents. Optionally, the pathway includes one or more site markers for procedure execution (eg, cutting and/or implanting, drug injection and/or ablation).

During step planning (and/or steering), actions other than cutting can optionally be considered (eg, navigation taking into account anatomical features and/or drug administration and/or device implantation).

In some exemplary embodiments of the invention, the planning module 1480 takes into account the registration of the status indicating data at the plurality of points 445 on the substrate 420, the status indicating data being registered to any type of medical image when computing the path data. Alternatively or additionally, the planning module 1480 is adapted to accept additional user input 1482 relating to a planned path (eg cutting path) based on the output of said registration module. In some exemplary embodiments of the invention, step planning module 1480 takes into account grouped data 1450 , outputs of output module 1440 , and/or inputs and outputs of registration module 1460 .

In some exemplary embodiments of the invention, the planning module 1480 receives input from the user by means of an additional GUI. Optionally, the additional GUI includes a three-dimensional graphical interface.

In some exemplary embodiments of the invention, the planning module 1480 outputs suggested routes or other planning-related information graphically (optionally as a three-dimensional model). Optionally, a graphical output of suggested paths or other planning-related information is presented superimposed on and/or registered on the medical image.

Exemplary Modification for Surgical Monitoring

FIG. 16 depicts a surgical monitoring system 1600 . Optionally, system 1600 facilitates the performance of surgery.

The depicted exemplary system 1600 includes an input module 1612 adapted to receive a suggested path (eg, cut) 1610 from a step planning module. Optionally, the step planning module is the planning module 1480 as described above. The depicted exemplary system 1600 also includes a guidance system 1620 adapted to output guidance instructions to guide a surgical tool along the path. Optionally, the instructions are provided in a data format 1630 suitable for use by a robotic interface and/or as prompts 1640 suitable for use by a human user.

For example, display 300 (FIG. 3A) may include an image overlay such as detector readouts (eg, binary readouts per point) using windows representing images such as stromal 3D images and/or characterized anatomical features. Optionally, this readout enables guidance of the surgical tool to a specific area displayed on display 300 and/or instructions for guiding the surgical tool to a specific area displayed on display 300 . Optionally, detector readings are registered on the image.

FIG. 17 is a more detailed schematic representation of one possible configuration of the guide system 1620 shown in FIG. 16 . In the depicted exemplary configuration, position detection system 1720 determines the position of substrate 420 and detector 40 using any technique known in the art. As noted above, the position detection system 1720 may rely on markers implanted in the matrix 420 and/or mounted on the detector 40 based on the actual implementation.

In some exemplary embodiments of the invention, the cutting tool 1730 is provided as a separate component from the detector 40 . According to these embodiments of the invention, the position detection system alone determines the position of the cutting tool 1730 .

In other exemplary embodiments of the invention, cutting tool 1730 is provided as part of probe 40 . According to these embodiments of the invention, the position detection system determines the position of the cutting tool and the detector 40 simultaneously.

In the depicted exemplary configuration, position detection system 1720 is associated with controller 1710 , optionally integrated in control station 20 .

In some exemplary embodiments of the invention, position detection system 1720 determines the relative position of probe 40 and/or cutting tool 1730 relative to substrate 420 .

In other exemplary embodiments of the present invention, controller 1710 determines the relative position of detector 40 and/or cutting tool 1730 relative to substrate 420 based on position data received from position detection system 1720 .

In the exemplary configuration described, the controller also receives from the detector 40 data indicative of the state of the substrate as described above. In some exemplary embodiments of the invention, the controller 1710 combines and/or correlates these data with corresponding position data of the probe 40 to generate position-related substrate state data . Optionally, the controller 1710 constructs a state map from the location-related substrate state data.

In some exemplary embodiments of the invention, the controller 1710 compares the state diagram with suggested paths provided by the input module 1612 (FIG. 16). As the detector 40 and/or cutting tool 1730 are moved, the controller 1710 may update the state map and/or suggested path to generate a current state map and/or a current path.

In some exemplary embodiments of the present invention, based on the current state diagram and/or the current path, the controller 1710 represents the data 1630 for the robot interface and/or the prompts 1640 for the human user in a prescribed format.

Exemplary Detector Parts

Referring again to FIG. 1 , an exemplary embodiment of the present invention resides in a substrate probe 40 . Optionally, detector 40 is adapted to interact with system 100 .

The depicted exemplary substrate detector 40 includes a data acquisition module adapted to engage a substrate at a user-selected point, analyze the substrate and generate data indicative of the state of the substrate at that point. This data acquisition module is schematically depicted as an operation section 42 .

In some exemplary embodiments of the invention, the manipulation portion 42 includes a pair of electrodes in communication with the chamber and a vacuum source configured to extract a portion of the substrate into the chamber so that the substrate contacts the electrodes.

The depicted exemplary matrix detector 40 includes user input means in the form of buttons 43 (three are depicted). In some exemplary embodiments of the invention, the user input device is configured to group individual data into data groups.

Optionally, fewer or more buttons than 3 are provided. In some exemplary embodiments of the invention, a single button is used as a user input device. Alternatively, the buttons 43 are replaced by other mechanical, electronic or electromechanical input hardware (eg sliders, rheostats, scroll wheels, micro switches).

The depicted exemplary matrix probe 40 includes a signal conduit 5 adapted to convey electrical and/or optical signals, and a lumen adapted to convey negative pressure from an external vacuum source to a data acquisition module (eg, operating portion 42). In some exemplary embodiments of the invention, a lumen adapted to deliver negative pressure is located within the conduit 5 . In other exemplary embodiments of the invention, a lumen adapted to deliver negative pressure is provided separately.

The depicted exemplary matrix probe 40 includes a connector to external data analysis components. Optionally, this connector is located within the conduit 5 and/or relies on a wireless link.

In some exemplary embodiments of the invention, probe 40 is provided as a sterile medical device. Optionally, the probe 40 is provided in a package configured to ensure sterility until opened in the operating room. Considerations for the configuration of sterile packaging are well known to those of ordinary skill in the art of medical diagnostics and will readily apply to embodiments of the present invention.

In some exemplary embodiments of the invention, detector 40 includes a user-perceivable indicator. Optionally, the indicator provides a visual and/or audible indication as described above.

In order to make some of the advantages of the detector 40 apparent, an exemplary usage scenario is described in detail.

FIG. 5 is an exemplary simplified schematic flow diagram of a method 500 for measuring and displaying a measurement output of a substrate. A determination is made at 510 whether a group measurement mode is required.

If not, then at 515 a single measurement is performed, for example by the probe 40 .

If so, enter group mode at 520 and enter or select a group/zone name at 530 from a predetermined list. Alternatively, as described below in connection with FIG. 6, it may be entered by a user (eg, a physician) or automatically.

At 540 , one or more measurements belonging to the selected group are performed, such as performed by the probe 40 .

At 550, the measured output is stored. For example, it may be stored in the control station 20 or in the database storage unit 48 of the probe 40 .

At 560, the measurement output is displayed. Optionally, displayed on display screen 24 or indicator 1 .

At 570, a determination is made whether more measurements are needed.

If yes, return to 510 to move the detector 40 to a new point and/or substrate area.

If not, at 580 the measurement session is ended.

Exemplary data input interface

FIG. 6 is a schematic diagram of an exemplary implementation of a front panel button 600 of the console 20 .

According to some embodiments of the invention, operations performed using the console front panel buttons 600 are optionally performed using the buttons 43 of the detector 40 .

For example, double-clicking button 43 may initiate group mode processing. Optionally, consecutive numbers, eg starting with "1", are provided automatically in response to a double click. Alternatively, the letters may be used in a predetermined order, such as according to the M/L/D/SF/I/S convention.

FIG. 12 depicts an exemplary display screen 1110 in which a second double tap optionally ends a group mode, such as the first group 1200(M) depicted. Optionally, the end of the group also ends the frame surrounding the shown group.

FIG. 13 depicts an exemplary display screen 1112 in which an additional double tap opens the second group 1210(1) shown. Optionally, the opening of a group causes a new frame to appear. Optionally, the new frame opens to its left as shown.

Alternatively, buttons 610 on panel 600 (eg, of console 20) may operate in a similar manner to perform the same function.

FIG. 9 depicts an exemplary display screen 900 illustrating a "finished" group 910 comprising one or more measurement outputs 920 (optionally representing a region [eg M] on a substrate). According to some embodiments of the invention, measurements can also be started immediately without entering group mode. A long single press on button 43 of detector 40 or button 620 of console 600 enters the group name mode. Optionally, access the name menu (e.g. Medial-M, Lateral-L, Posterior (Deep)-D, Front (Surface)-SF, Below-I, Above-S, # - automatically selected for the group number, CAV-into the corresponding side of the cavity).

In some embodiments, each short press on button 43 of detector 40, or by pressing on button 630 or button 635 on console front panel 600, provides a different group name, for example in a cycle sequential order.

FIG. 11 depicts an exemplary set of user inputs (eg, buttons) 1102 . According to some embodiments of the invention, button 1102 may be provided within control station 20 or detector 40 . Optionally, the button is labeled with a group name corresponding to the indicated zone name. Alternatively or additionally, a group of similar names may be presented as a menu on the display screen.

According to some embodiments of the invention, the group presented after the first press will be the next group following the previously selected group. The symbol "#" can represent the group number automatically selected by the system. Once the name of the zone or group is approved (eg, by a long press on button 43 or 620), the user can scroll through the list of zones (eg, using button 650). A long press on button 43 or 620 authorizes a specific area as indicated by the group name. If one of the locale options is selected, immediately launches group name mode into the next group, with a series of locale options. A certain group name can be authorized by a long press on the button 43 of the detector or by pressing the button 620 on the front panel 600 of the console.

FIG. 10 depicts an exemplary display screen 1000 . According to some embodiments of the invention, the name of the group may be colored, for example in red, until the group is approved by a long button press on button 43 or 620 . Once approved, the color of the group name may switch to, for example, yellow. In some embodiments, measurements are not taken until the group is approved. Alternatively, even if the group has been approved, the name of the group can be changed as long as the group has not been ended. In some implementations, after a group is ended, the name of the group cannot be changed. In some implementations, no action can be performed until a certain set of names is approved. For example, in situations such as: the group name is not approved, and/or after 2 seconds of selecting the name, a message such as an audio or digital message will pop up on the screen.

To leave the group mode, the user can press the button 43 or the button 610 of the console twice. Alternatively, the user can open the second group by double-clicking button 43 . According to some embodiments, measurements can be performed immediately without selecting a group name. If no group name is selected, it can be selected at any time, for example as long as group mode is active. In some implementations, a group name may be selected multiple times.

FIG. 8 illustrates an exemplary implementation of a display screen 800 in which the output of the next measurement "pushes" the previous measurement to the next line not visible on the screen and activates a scrolling indicator 810, as shown in FIG. 8 . The user can use the button 43 or the button 640 or the joystick to scroll up and down the measurements.

According to some embodiments of the invention, when a screen line or row is full of measurement outputs or area outputs, the "next" measurement output or the next single measurement output for the same area output may be presented in the "next" row. For example, as shown in FIG. 10 , the next measurement output 1100 of the area output 1200 is displayed in the next row 1300 .

Error messages can be displayed on the detector 40 or on the display 24 . In some embodiments, an indication of an error message is activated, for example using an audio indicator machine.

A group can be selected before starting measurements related to that group. Alternatively, select a group after taking some measurements on the group, or select the group after taking all measurements on the group.

FIG. 7 depicts an exemplary output screen 700 with the current measurement highlighted. For example, highlighting may be by means of changing properties of the background and/or frame indicating the current group, and/or changing properties of the current measurement (eg, the width or color of the bars).

According to some embodiments of the invention, the data obtained from the session is stored in the storage component 48 for further analysis. Alternatively, the session data can also be exported and sent to an external device/computer, or to an external storage device such as a removable memory, eg DiskonKey or other small portable storage device. For example, the registered or saved session data can be used, for example, in additional procedures related to the examined tissue, such as pathology procedures. The registered or saved session data can also be used in additional procedures, such as additional surgical or diagnostic procedures on the same subject.

Exemplary analysis with registration

Referring again to FIG. 14, an additional exemplary embodiment of the present invention is described that is not related to data packets.

Some exemplary embodiments of the present invention are an apparatus 1400 for matrix analysis comprising a detector 40 as described above, a modeling module 1454 adapted to generate a three-dimensional model of the matrix, and adapted to indicate the Registration module 1460 of the location. Optionally, the modeling module relies on defined positional coordinates 1422 and/or a substrate model 1452 (eg, a predefined geometric model or a realistic model indicative of the actual substrate shape or a model based on medical image data).

Optionally, the device comprises an output module adapted to provide an indication of the state of the matrix at each designated location of the model. In some exemplary embodiments of the invention, the representation is like an overlay. In some exemplary embodiments of the invention, the model is a 3D model that can be manipulated (eg turned or inverted) during viewing.

In some exemplary embodiments of the invention, the device 1400 is adapted to accept user input specifying a location of said location (eg user provided coordinates 1422).

In other exemplary embodiments, the device 1400 is adapted to determine the location of said location. Optionally, the device 1400 employs a position sensor 1420 adapted to determine the location of said location.

Optionally, the registered data from registration module 1460 is output to one or more graphical displays, printers and memory.

It is expected that many substrate measurement techniques and medical imaging methods will be developed during the life of this patent, and the scope of the present invention is intended to include all such new substrate measurement techniques and medical imaging methods a priori.

Although the invention has been described in conjunction with specific embodiments of the invention, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art. It is therefore intended to embrace all such alterations, modifications and variations that fall within the spirit and broad scope of the appended claims.

In particular, components and/or actions described as a single component belonging to the exemplary embodiments of the present invention may be divided into sub-components. Conversely, components and/or actions described as sub-components/separate acts belonging to exemplary embodiments of the invention may be combined into a single component/act having the described/depicted function.

Alternatively or additionally, features used to describe a method may be used to characterize a device or system, and features used to describe a device or system may be used to characterize a method.

It should further be understood that the individual features described above can be combined in all possible combinations and sub-combinations, resulting in additional embodiments of the invention. The examples provided above are for illustration only and are not intended to limit the scope of the invention, which is defined only by the following claims. In particular, the invention is described in the context of testing on resected tissue masses and/or cavities derived from the resection, but the invention may be used in non-medical applications including, but not limited to, quarrying and/or mining. For example, a sequence of events described and/or required in the context of a method may be performed in any order.

All publications, patents, and patent applications mentioned herein in this specification are hereby incorporated by reference in their entirety to the extent that each individual publication, patent, or patent application is specifically and individually indicated to be incorporated by reference in its entirety. the degree to which it is incorporated. In addition, citation or identification of any reference in this application shall not be construed as an admission that such reference is available as prior art to the present invention.

As used herein, the terms "including" and "having" and their conjugates mean "including but not necessarily limited to".

Claims (44)

1. A graphical user interface (GUI) system, the graphical user interface comprising: (a) a data receiver operable to receive a plurality of individual measurement input data indicative of a state of the measured substrate when the substrate is scanned; (b) a group definition module adapted to accept user input defining groups associated with measurements of said matrix; (c) a grouping module configured to receive and process the plurality of individual measurement input data and user input of the defined group by associating the measured data with the user-defined group related to the measurement of the substrate , and assigning each of said individual measurement input data to one of said groups to produce grouped data; and (d) an output module adapted to output said packet data. 2. The graphical user interface system according to claim 1, the graphical user interface further comprising: (e) a registration module configured and operable to register the grouped data to a predetermined geometric model. 3. The graphical user interface system of claim 2, wherein the registration module is configured and operable to register the grouped data to the image of the substrate. 4. The graphical user interface system of claim 3, wherein the registration module is configured and operable to register the grouped data to the three-dimensional image of the substrate. 5. The graphical user interface system of claim 2, wherein the registration module is configured and operable to register the grouped data to a volumetric representation of the substrate. 6. The graphical user interface system of claim 2, wherein the registration module is configured and operable to register the grouped data to a space-filling model of the matrix. 7. A graphical user interface system according to any one of claims 1 to 6, wherein the individual measurement input data indicative of the state of the substrate are associated with positional coordinates. 8. The graphical user interface system of claim 7, wherein the location coordinates are defined relative to the substrate. 9. A graphical user interface system according to any one of claims 1 to 6, wherein said output of said grouped data comprises said individual measurement input data arranged in groups. 10. A graphical user interface system according to any one of claims 1 to 6, wherein said output of said grouped data comprises at least one summary statistic summarizing each of said Group the individual measurements in the input data. 11. A graphical user interface system according to any one of claims 1 to 6, said graphical user interface further comprising a memory module adapted to store packet data output by said output module. 12. A graphical user interface system according to any one of claims 1 to 6, wherein the data receiver is adapted to receive individual measurement input data simultaneously from the detector array. 13. An apparatus for matrix analysis, said apparatus comprising: (a) a detector operable to generate a signal comprising a plurality of individual data indicative of the state of the measured substrate when said substrate is scanned; (b) a group definition module adapted to accept user input defining groups associated with measurements of said measurand; (c) a grouping module configured to receive user input comprising said signal comprising said plurality of individual data and said defined group, associating the measured data with the user-defined group related to the measurement of said matrix , and assigning each of said individual data to one of said groups to produce grouped data; and (d) an output module adapted to output said packet data. 14. The apparatus of claim 13, further comprising at least one user input mechanism on the detector. 15. Apparatus according to claim 13 or 14, further comprising at least one indicator on the detector. 16. Apparatus according to claim 13 or 14, wherein the output module comprises a memory. 17. Apparatus according to claim 13 or 14, wherein the probe is adapted to measure dielectric properties of the substrate. 18. Apparatus according to claim 13 or 14, wherein the detector is adapted to measure electromagnetic properties of the matrix. 19. Apparatus according to claim 13 or 14, wherein said separate data indicative of a state of a substrate is associated with a manually selected location on said substrate. 20. The device of claim 13 or 14, further comprising: (e) a registration module configured and operable to provide registration of the output data to a predetermined geometric model. 21. The apparatus of claim 20, wherein the registration module registers the grouped data to an image of the stroma. 22. The apparatus of claim 21, wherein the registration module is configured and operable to register the grouped data to a three-dimensional image of the stroma. 23. The apparatus of claim 20, wherein the registration module is configured and operable to register the grouped data to a volumetric representation of the substrate. 24. The apparatus of claim 20, wherein the registration module is configured and operable to register the grouped data to a space-filling model of the stroma. 25. Apparatus according to claim 13 or 14, wherein the individual data indicative of the state of the substrate are associated with positional coordinates. 26. The apparatus of claim 25, wherein the location coordinates are defined relative to the substrate. 27. The apparatus of claim 13 or 14, wherein the detector comprises a plurality of sub-detectors arranged in a spatial array, the sub-detectors being co-operable by a single detection activation signal. 28. The apparatus of claim 13 or 14, wherein the detector is operable in at least two modes, the modes being sensing and/or characterizing. 29. The apparatus according to claim 13 or 14, wherein the detector is operable to evaluate the state of the matrix and output data indicative of the state at individual points, the apparatus further comprising: a substrate position indicator placed at the substrate; a measurement module configured to determine the relative position of the substrate position indicator and the detector; and a controller adapted to coordinate the operation of said detector and said measurement module to determine said relative position for each of said individual points. 30. The device of claim 29, further comprising: a position sensor adapted to determine a first position of the detector and a second position of the substrate position indicator; Wherein, the measurement module determines the relative position by comparing the first position of the detector with the second position of the matrix position indicator. 31. The device of claim 29, further comprising: an imaging module adapted to generate images depicting said detector and said position indicator; Wherein, the measurement module determines the relative position according to the image. 32. The device of claim 29, wherein: The registration module is adapted to register the status indication data from the individual points with medical image data. 33. The device of claim 29, wherein: The registration module is adapted to register the local summary of the status-indicating data with the medical image data. 34. The device of claim 29, further comprising: A cutting tool mounted on the detector. 35. The device of claim 29, wherein: Said output module is adapted to output said relative position and said status indicating data of each said individual point together. 36. Apparatus according to claim 29 adapted to accept as input medical image data and to generate a realistic model from said medical image data. 37. The device of claim 29, further comprising: A step planning module, wherein said step planning module is adapted to analyze output from said output module and calculate a path, or to accept user input regarding a planned path. 38. A matrix detector comprising: (a) a data acquisition module adapted to engage a scanned measured substrate at a user-selected point, analyze said measured substrate and generate measurement data indicative of a state of the substrate at said point; (b) user input means adapted to accept user input of a defined set, said set relating to the measurement of said measurand; (c) a grouping module configured to receive user input of said defined group and said measurement data indicative of a state of a substrate, determine an association between the measured data and a user-defined group related to measurements of said substrate , and assign each individual measurement to one or more predefined groups to produce grouped data; and (d) an output module adapted to generate an output signal indicative of said packet data. 39. The detector of claim 38, further comprising: A position determination module adapted to provide the position of said point. 40. The detector of claim 39, wherein the location determination module provides location coordinates defined relative to the substrate. 41. The detector of claim 38, further comprising: Connectors to external data analysis components. 42. The probe of claim 38 provided as a sterile medical device. 43. The detector of claim 38, wherein the user input device is configured to group the data into data groups. 44. The detector of claim 38, further comprising: a user-perceptible indicator of the state of the substrate.

Images