Disclosure of Invention
In view of this, the present application provides a neural signal visualization system, comprising:
The stimulation device is used for providing stimulation action for the tested object;
The acquisition device is used for acquiring bioelectric signals transmitted by nerve tissues of the tested object in response to the stimulation action through a plurality of acquisition points;
The processing device is used for generating an liveness image of nerve tissue according to the nerve electric signal, determining position information of at least part of points in the liveness image relative to the reference point in the acquisition device and generating visual data according to the liveness image and the position information;
And the output device is used for outputting a visual result according to the visual data.
Optionally, the stimulation device comprises an external stimulation device that stimulates the corresponding sensory organ of the subject by at least one stimulation source selected from the group consisting of acoustic source, light source, heat source, scent source, taste source, tactile source.
Optionally, the stimulation device comprises an implantable neural stimulation device that delivers the electrical pulse signal to the implantation site through electrode contacts implanted in the body.
Optionally, the at least part of points are all points in the liveness image, and the visualized data includes position information of all points relative to the reference point, and an liveness value corresponding to all points.
Optionally, the processing device is configured to perform continuous processing on the bioelectric signals of the plurality of acquisition points, so as to obtain an activity value for the activity level image, where each point corresponds to the activity value obtained by the continuous processing, and the continuous processing includes interpolation operation and normalization processing, and indicates a transmission path of the bioelectric signal in the nerve tissue by giving the position information to all points.
Optionally, the output device includes at least one of an image modeling device and a solid modeling device, wherein the visual result output by the image modeling device is a transmission path tracing graph, and the visual result output by the solid modeling device is a solid three-dimensional model of the transmission path tracing graph.
Optionally, the stimulation device comprises an in vitro electrical stimulation device for applying an electrical stimulation signal around the nerve tissue.
Optionally, the at least partial points are all points within an abnormal region in the liveness image or boundary points of the abnormal region, and the visualized data is data for indicating the abnormal region in the liveness image.
Optionally, the processing device is configured to perform continuous processing on the bioelectric signals of the plurality of acquisition points, so as to obtain the liveness image, where each point corresponds to an liveness value obtained by the continuous processing, and the continuous processing includes interpolation operation and normalization processing; and comparing the active value of each point with a threshold value to determine an abnormal point, and further determining the position information of the boundary point of the abnormal point or the abnormal point composition area relative to the reference point, thereby obtaining data for indicating the abnormal area in the liveness image.
Optionally, the output device comprises a projection device for projecting an image to the neural tissue according to the visual data and the position of the reference point to indicate the abnormal region or the boundary thereof.
Optionally, part of the plurality of acquisition points of the acquisition device is used as the reference point.
Optionally, the collection device comprises at least one of an electrode array adapted to be disposed on a surface of the nerve tissue, a microneedle array adapted to penetrate a body surface, a microneedle array or electrode array adapted to penetrate a surface of the nerve tissue to an interior of the nerve tissue, and a flexible electrode adapted to be implanted in the body.
The system provided by the embodiment of the invention analyzes the acquired nerve electric signals and positions to obtain the liveness image of nerve tissues, endows the calibrated nerve signal transmission path with space coordinate information relative to a preset reference point, and outputs a visual result for tracing the nerve electric signal transmission path through the output device, so that the nerve electric signal transmission path is presented to researchers with a more visual effect, and the mode that the nerve tissues transmit the nerve electric signals under the action of various external stimuli of a tested object can be shown, thereby providing valuable reference information in the research of brain science and medical fields.
According to the system provided by the embodiment of the invention, the nerve tissue is induced to generate related potentials by the stimulation signals sent by the stimulation device, the induced nerve impulse signals are transmitted in the nerve tissue and are collected by the signal collecting device, the response intensity of the nerve tissue to the stimulation signals is obtained, the collected nerve electrical signal information and the collecting sites are analyzed, the activity image of the nerve tissue of the collecting site is obtained, the response degree of the normal area and the lesion area is obviously different, the abnormal area can be identified based on the difference, the spatial coordinate position of the abnormal area is calibrated through the preset reference sites, and then the accurate abnormal difference boundary calibration is carried out through the output device, so that doctors are guided to carry out operations such as excision or ablation, and the operation cost is reduced.
Detailed Description
The following description of the embodiments of the present invention will be made apparent and fully in view of the accompanying drawings, in which some, but not all embodiments of the invention are shown. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In addition, the technical features of the different embodiments of the present invention described below may be combined with each other as long as they do not collide with each other.
Example 1
The embodiment of the invention provides a nerve signal visualization system which is used for presenting a path of a nerve tissue for transmitting bioelectric signals under external stimulation of a tested object. As shown in fig. 1, the present system may be specifically referred to as a nerve electrical signal transmission path visualization system, and includes an acquisition device 100, an output device 200, a stimulation device 300, and a processing device 400.
The acquisition device 100 is used for acquiring bioelectric signals transmitted by nerve tissue of a measured object in response to the stimulating action through a plurality of acquisition points. The acquisition device 100 may be disposed in peripheral nerve tissue or central nerve tissue of the subject or in a body part corresponding to the nerve tissue according to the observation requirement. The acquisition device 100 comprises at least one of an electrode array suitable for being arranged on the surface of nerve tissue, a microneedle array suitable for penetrating the surface of the nerve tissue, a microneedle array or an electrode array suitable for penetrating the surface of the nerve tissue to the inside of the nerve tissue, and a flexible electrode suitable for being implanted in a body, and specifically can be a non-implanted, semi-implanted or fully implanted nerve electric signal device such as a flexible electrode array, a light brain probe, a deep brain probe and the like, wherein the arrangement mode of the acquisition points can be one-dimensional, two-dimensional or three-dimensional.
The stimulation device 300 is used for providing a stimulation action to a subject. The stimulation device 300 may be an extracorporeal stimulation device or an implantable neural stimulation device. The external stimulation device is a device for stimulating the corresponding sense organs of the tested object through at least one stimulation source of sound source, light source, heat source, smell source, taste source and touch source; implantable neurostimulation devices refer to devices that release an electrical pulse signal to an implantation site through an electrode contact implanted in the body.
It should be noted that, in the embodiment using the implantable neural stimulation device, the system does not limit the stimulation location, for example, the acquisition device 100 is disposed at the cranial nerve, the implantable neural stimulation device may apply a stimulation signal to the spinal nerve, and the spinal nerve of the tested subject transmits the bioelectric signal under the influence of the stimulation signal. The present system may also be applied to nerve tissue other than the brain and spinal cord, and the user may arrange the locations of the acquisition device 100 and stimulation device 300 as desired.
The processing device 400 is configured to generate an activity image of the nerve tissue according to the nerve electrical signal, determine position information of all points in the activity image relative to a reference point in the acquisition device 100, and generate visual data according to the activity image and the position information, including position information of all points relative to the reference point, and activity values corresponding to all points.
Specifically, the plurality of electrode contacts 110 of the acquisition device 100 may acquire discrete nerve electrical signals at a plurality of points, and the processing device 400 may convert the discrete nerve electrical signals (analog signals) into digital signals, and then perform interpolation operation to obtain more interpolation points, thereby obtaining denser digital signals to form graph data, i.e. liveness images. The magnitude of the digital signals corresponding to the points can reflect the nerve activity, and the values of the digital signals of the points are the activity values.
The acquisition device 100 is provided with a plurality of reference points, the positional relationship between the reference points and each electrode contact 110 is known (determined by a hardware structure), and if the signals of 4 adjacent electrode contacts 110 are used to obtain 1 interpolation point located at the center of the 4 electrode contacts 110, the position of the interpolation point corresponding to the reference point can be calculated according to the positions of the 4 electrode contacts 110 relative to the reference point. The position information of each point in the liveness image can be obtained in this way.
And obtaining the position information of each point and the active value of each point, and then obtaining the visualized data.
In a preferred embodiment, a part of the plurality of acquisition points in the acquisition device 100 is used as a reference point. Such as the flexible electrode array shown in fig. 2, electrode contacts located at three corners may be used as reference points 101.
The output device 200 is used for outputting a visualization result according to the visualization data. The output device 200 may be specifically an image modeling device and a solid modeling device. The image modeling device is, for example, a projection device, and adopts plane projection, holographic projection, equal proportion projection, unequal proportion projection, static projection, dynamic projection and the like; the solid modeling means may in particular be a 3D printer.
The output device 200 may represent the activity value of each point in the activity image by using patterns such as color, fluctuation, and the like, and arrange the points according to the position information of each point, so as to generate a visual image, projection, or model. By means of the visual result, the path of the nerve tissue for transmitting the nerve electric signal under the influence of the stimulation action of the tested object can be clearly observed.
According to the embodiment, the acquired nerve electric signals and positions are analyzed, nerve electric signal data of each discrete acquisition point are continuous, an activity image of nerve tissues is obtained, a calibrated nerve signal transmission path is endowed with space coordinate information relative to a preset reference point, a visual result for tracing the nerve electric signal transmission path is output through an output device, the nerve electric signal transmission path is presented to researchers in a more visual effect, the mode that a tested object transmits the nerve electric signals under the action of various external stimuli can be shown, and valuable reference information is provided in the research of brain science and medical fields.
Further, in order to make the active value of the interpolation point more accurate, the active value of each interpolation point is calculated by combining interpolation operation and normalization processing in the preferred embodiment. Wherein the normalization process comprises the following steps:
Determining bioelectric signals at a plurality of acquisition points Maximum amplitude;
Using maximum valuesFor bioelectric signalsProcessing to obtain bioelectric signals:
。
For bioelectric signalsIntegrating over time to obtain a time integral of the bioelectric signalWhereinIs a time constant;
Determining time integral of bioelectric signals Maximum amplitude;
From time integral of bioelectric signalsAmplitudeAnd maximum amplitudeCalculating the time integral/>, of bioelectric signals:
。
Time integration of bioelectric signals using cancellation processingAnd bioelectric signalsObtaining normalized bioelectric signals:
,
According to the normalization processing manner, the normalization processing result corresponding to each electrode contact 110 can be obtained. Multiplying the time integral with the original signal is equivalent to enhancing the energy information in the signal, so that the dynamic range of the bioelectric signal is more prominent, and the characteristics and dynamic change of the obtained signal are more obvious, thereby accurately reflecting the transmission path of the bioelectric signal in the nerve tissue.
After the normalization processing result is obtained, interpolation operation is carried out, and the method comprises the following steps:
calculating the mean value of the digital signals of each acquisition point :
,
Where n and m represent the total number of electrode contacts 110 in the transverse and longitudinal directions in the electrode array,Nerve electric signal (/ >) representing acquisition points with positions i, j) Analog-to-digital conversion results of (a) are provided.
Calculating standard deviation of digital signals of each acquisition point:
,
Calculating the active value of each acquisition point:
,
Active values based on individual acquisition points using interpolation functionsCalculating the active value/>, of each interpolation point Representing the coordinate position of the interpolation point.
According to the interpolation processing process, the liveness values of interpolation points with arbitrary density and number can be obtained, and the liveness accuracy of the interpolation points is high.
Example two
The embodiment of the invention provides a nerve signal visualization system which is used for presenting an abnormal region or a boundary of nerve tissue of a tested object, and can be applied to precisely positioning a lesion region in an operation so as to perform operations such as excision, ablation and the like on the lesion region. As shown in fig. 3, the present system may be specifically referred to as a precision positioning system for neurological surgery, including an acquisition device 100, an output device 200, a stimulation device 300, and a processing device 400.
The acquisition device 100 is used for acquiring bioelectric signals transmitted by nerve tissue in response to external electrical stimulation through a plurality of acquisition points. Depending on the surgical requirements, the harvesting device 100 may be disposed in peripheral or central nervous tissue at the surgical site, or at a body part corresponding to the nervous tissue. The acquisition device 100 comprises at least one of an electrode array suitable for being arranged on the surface of nerve tissue, a microneedle array suitable for penetrating the surface of the nerve tissue, a microneedle array or an electrode array suitable for penetrating the surface of the nerve tissue to the inside of the nerve tissue, and a flexible electrode suitable for being implanted in a body, and specifically can be a non-implanted, semi-implanted or fully implanted nerve electric signal device such as a flexible electrode array, a light brain probe, a deep brain probe and the like, wherein the arrangement mode of the acquisition points can be one-dimensional, two-dimensional or three-dimensional.
In practice, a non-implantable two-dimensional flexible electrode array is preferred. As shown in fig. 2, an array of electrode contacts 110 is distributed on a flexible substrate 130 of the flexible electrode array. The flexible substrate 130 may be contoured or irregular in profile. The corresponding array of electrode contacts 110 within flexible substrate 130 also appears as a regular square matrix, irregular arbitrary array. Flexible substrate 130 may be attached to the surface of the nerve tissue and wrapped around the peripheral nerve bundles. The electrode contacts 110 are connected to the chip 140 through the wires 120, and the chip 140 may perform preprocessing such as filtering on the original signal.
The stimulation device 300 is used for providing a stimulation action to a subject. In this embodiment, the stimulation device 300 is preferably an in vitro electrical stimulation device for applying electrical stimulation signals around nerve tissue. By way of example, such as where the acquisition device 100 is disposed at a cranial nerve for the purpose of determining abnormal areas in the cranial nerve tissue, a user may hold the stimulation device 300 to apply electrical stimulation signals near the area covered by the flexible electrode array.
It should be noted that, the user may apply the stimulus at other positions according to the actual needs, and the stimulus mode is not limited to the electrical stimulus, for example, for some specific diseases, there may be a specific stimulus mode and a stimulus position that are more suitable for the corresponding neural tissue to respond, and specifically, the appropriate stimulus mode and stimulus position are selected according to the biological or surgical needs.
The processing device 400 is configured to generate an activity image of nerve tissue according to the nerve electrical signal, determine location information of all points within an abnormal region or boundary points of the abnormal region in the activity image relative to a reference point in the acquisition device 100, and generate visual data according to the activity image and the location information. The visualized data in this embodiment is data for indicating an abnormal region in the liveness image. Specifically, taking the boundary point of the abnormal region as an example, the present embodiment focuses only on the position of the boundary point, and does not focus on the specific activity value of each boundary point, so that only the position information may be in the visualized data.
The plurality of electrode contacts 110 of the acquisition device 100 may acquire discrete nerve electrical signals at a plurality of points, and the processing device 400 may convert the discrete nerve electrical signals (analog signals) into digital signals, and then perform interpolation operation to obtain more interpolation points, thereby obtaining denser digital signals to form graph data, i.e. liveness images. The magnitude of the digital signals corresponding to the points can reflect the nerve liveness, the value of the digital signals of the points can be used for calculating the activity value, and according to the magnitude of the activity value, the points can be judged to be abnormal points, so that all points in the abnormal area or boundary points of the abnormal area are determined.
The acquisition device 100 is provided with a plurality of reference points, the positional relationship between the reference points and each electrode contact 110 is known (determined by a hardware structure), and if the signals of 4 adjacent electrode contacts 110 are used to obtain 1 interpolation point located at the center of the 4 electrode contacts 110, the position of the interpolation point corresponding to the reference point can be calculated according to the positions of the 4 electrode contacts 110 relative to the reference point. The position information of each point in the liveness image can be obtained in this way.
And obtaining position information of all points in the abnormal region or boundary points of the abnormal region, and obtaining the visual data.
The output device 200 is used for outputting a visualization result according to the visualization data. As shown in fig. 4, the output device 200 of the present embodiment preferably includes a projection device for projecting an image to the nerve tissue according to the visualized data and the position of the reference point to indicate the abnormal region 201 or the boundary thereof. Specifically, the output device 200 includes a positioning device and a projection device, the positioning device is configured to capture a spatial position of a reference point in the acquisition device 100, a projection surface of the projection device, that is, a surface where the acquisition device 100 is located, and the positioning device establishes an optical relationship between the projection surface and the projection device based on the spatial position of the reference point, so that a point in the abnormal region 201 or a boundary point thereof can be projected on the projection surface, and a size 1 of the projected image and the liveness image is as follows: 1 corresponds to.
The projection device may be a laser projection or an LED light source projection, and the projected image may be regarded as a binary image, and one color may be used to represent a point in an abnormal area or a boundary point thereof, and another color may be used to represent other areas.
The positioning device may be an optical positioning device or an electromagnetic positioning device, and correspondingly, the reference points in the acquisition device 100 may be points that can be captured by the optical positioning device, for example, the reference points may be made of special reflective materials; the reference points in the acquisition device 100 may also be points that can be sensed by the electromagnetic positioning device, for example, the reference points may be made of magnetic materials, etc.
In a preferred embodiment, a part of the plurality of acquisition points in the acquisition device 100 is used as a reference point. Such as the flexible electrode array shown in fig. 2, electrode contacts located at three corners may be used as reference points 101.
According to the system provided by the embodiment of the invention, the nerve tissue is induced to generate related potentials by the stimulation signals sent by the stimulation device, the induced nerve impulse signals are transmitted in the nerve tissue and are collected by the signal collecting device, the response intensity of the nerve tissue to the stimulation signals is obtained, the collected nerve electrical signal information and the collecting sites are analyzed, the activity image of the nerve tissue of the collecting site is obtained, the response degree of the normal area and the lesion area is obviously different, the abnormal area can be identified based on the difference, the space coordinate position of the abnormal area is calibrated through the preset reference sites, the accurate abnormal difference boundary calibration is further carried out through the output device, doctors are guided to carry out operations such as excision or ablation, and the operation cost is reduced.
Further, in order to make the active value of the interpolation point more accurate, the active value of each interpolation point is calculated by combining interpolation operation and normalization processing in the preferred embodiment. Wherein the normalization process comprises the following steps:
Determining bioelectric signals at a plurality of acquisition points Maximum amplitude;
Using maximum valuesFor bioelectric signalsProcessing to obtain bioelectric signals:
。
For bioelectric signalsIntegrating over time to obtain a time integral of the bioelectric signalWhereinIs a time constant;
Determining time integral of bioelectric signals Maximum amplitude;
From time integral of bioelectric signalsAmplitudeAnd maximum amplitudeCalculating the time integral/>, of bioelectric signals:
。
Time integration of bioelectric signals using cancellation processingAnd bioelectric signalsObtaining normalized bioelectric signals:
,
Wherein the method comprises the steps ofAs an attenuation coefficient,The threshold value may be n times the noise amplitude. The present scheme introduces a threshold to distinguish between electrode acquired signals and other disturbances if the maximum amplitude/>, in all acquisition pointsIf the amplitude is larger than the set threshold, the result is calculated by adopting the first mode, if the maximum amplitudeWhen the attenuation coefficient is smaller than the set threshold value, the attenuation coefficient is introduced to calculate a result, and the calculation method provided by the embodiment is suitable for the situation that an abnormal region exists in nerve tissues, and aiming at the situation that the lack of nerves or the obvious loss of nerve functions is caused by diseases (tumors and the like), the bioelectric signal value calculated according to the mode can accurately express the activity of the corresponding position.
According to the normalization processing manner, the normalization processing result corresponding to each electrode contact 110 can be obtained. Multiplying the time integral with the original signal is equivalent to enhancing the energy information in the signal, so that the dynamic range of the bioelectric signal is more prominent, and the characteristics and dynamic changes of the obtained signal are more obvious, thereby accurately reflecting the liveness at each acquisition point.
After the normalization processing result is obtained, interpolation operation is carried out, and the method comprises the following steps:
calculating the mean value of the digital signals of each acquisition point :
,
Where n and m represent the total number of electrode contacts 110 in the transverse and longitudinal directions in the electrode array,Nerve electric signal (/ >) representing acquisition points with positions i, j) Analog-to-digital conversion results of (a) are provided.
Calculating standard deviation of digital signals of each acquisition point:
,
Calculating the active value of each acquisition point:
,
Active values based on individual acquisition points using interpolation functionsCalculating the active value/>, of each interpolation point,Representing the coordinate position of the interpolation point.
According to the interpolation processing process, the liveness values of interpolation points with arbitrary density and number can be obtained, and the liveness accuracy of the interpolation points is high.
And comparing the active values of the acquired points and the interpolation points with a threshold value to determine abnormal points (points with the active values lower than the threshold value are judged to be abnormal points), and further determining the position information of boundary points of abnormal points or abnormal point component areas relative to the reference points, so as to obtain data for indicating abnormal areas in the liveness image.
It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It is apparent that the above examples are given by way of illustration only and are not limiting of the embodiments. Other variations or modifications of the above teachings will be apparent to those of ordinary skill in the art. It is not necessary here nor is it exhaustive of all embodiments. While still being apparent from variations or modifications that may be made by those skilled in the art are within the scope of the invention.