JP4490225B2 - Cell image display method, cell image display system, cell image display device, and computer program - Google Patents

Description

  The present invention relates to a cell image display method for displaying a cell image in which cells are imaged, a cell image display system used to implement the cell image display method, a cell image display device provided in the cell image display system, and a computer The present invention relates to a computer program for causing a computer to function as a cell image display device.

  Conventionally, in the examination of blood cells, a method called “microscopic examination” is employed in which a smear prepared by placing blood to be examined on a preparation is viewed with a microscope and visually inspected. In this microscopic examination, for example, while classifying a smear sample with a microscope, a dedicated classification counter having a keyboard in which blood cell classification items are assigned to each key is used to classify white blood cells present in a predetermined area, for example. If a cell (white blood cell) that is difficult to determine the morphological abnormality of red blood cells or platelets or the classification item is found during the classification counting operation, the cell is imaged by a video camera or the like provided in a microscope. Then, the captured image of the blood cell is filed (saved) in the database of the image filing system together with the attribute information (the medical record number and the like) of the examination target. After the test, the result of the classification count is printed, and an image of the filed blood cell is printed as the test result as necessary.

  However, in the above method, the inspector needs to inspect at the place where the microscope is installed because the smear is inspected by visual observation through the microscope. For this reason, the inspector is disadvantageous in that it is subject to place restrictions.

  In addition, in the examination of cells, particularly blood cells, there is a high demand for raising the level of examination techniques by inspectors such as examination technicians or examination physicians. Conventionally, the instructor's guidance has been performed by the instructor classifying the cells by the above-mentioned microscopic examination, and the instructor confirming the classification result through a microscope. However, in such a guidance method, it is necessary to perform guidance at a place where a microscope is installed. In addition, since it is virtually impossible to set the smear sample once removed from the microscope stage at the same position on the stage again, the instructor later confirms the classification result that the instructor classifies in advance. There was also a time constraint that the instructor and the instructor must be at the same time where the microscope is installed.

  On the other hand, conventionally, a blood diagnosis support system has been proposed in which a blood smear is photographed with a microscope to create a blood image, and this blood image is reproduced on a screen (see Patent Document 1). In the blood diagnosis support system described in Patent Document 1, the examiner can perform a cell count by visually observing the blood image reproduced on the screen.

JP 2004-170368 A

  However, in the conventional technology as described above, when the cells are classified and counted, the examiner selects the cells to be classified from the cells included in the specimen and classifies the cells selected as the objects to be classified. It was necessary and a lot of work was required for the classification counting work. In addition, it is difficult for an inspector who is not skilled in cell classification counting to appropriately select cells to be classified, and the selection of the cells to be classified varies depending on the inspector. In particular, it is difficult for a trainee who is immature in the classification count of cells to appropriately select a cell to be classified, and thus it has not been possible to efficiently perform appropriate guidance.

  In addition, when performing guidance on cell classification count using the blood diagnosis support system disclosed in Patent Document 1, a plurality of instructors simultaneously confirm the same sample, and each instructor individually However, since the selection of cells to be classified differs depending on the instructor, it takes a lot of time for the instructor to examine each classification result. For this reason, it is practically difficult for one instructor to instruct a large number of instructors, and there has been a difference in instruction contents depending on the inspection technique level of each instructor. This obscures the cell classification criteria and causes differences in cell classification results for each examiner.

  The present invention has been made in view of such circumstances, and it is not necessary for an examiner to select a cell to be classified, and a cell image display method capable of improving the efficiency of counting and counting cells compared to the prior art, An object is to provide a cell image display system, a cell image display device, and a computer program.

  Another object of the present invention is that a single instructor can instruct cell classification to a large number of instructors, and can contribute to the unification of cell classification standards. An object is to provide an image display method, a cell image display system, a cell image display device, and a computer program.

  The cell image display method according to the present invention includes a step of obtaining a cell image from a first database in which cell images obtained by imaging a plurality of cells are stored, and positional information indicating the position of the cell image in the cell image A position information corresponding to the acquired cell image, a step of displaying the acquired cell image, and one of images of cells included in the displayed cell image. Selecting one of the images of the cells, and selecting a cell image selected from the displayed cell images based on the acquired position information. In the step, when an input of a predetermined key of the keyboard is received, an image of a cell different from the image of the selected cell is selected.

  The cell image display system according to the present invention includes a first database in which cell images obtained by imaging a plurality of cells are stored, a second database in which position information indicating the position of the cell image in the cell image is stored, and A cell image acquisition means for acquiring a cell image from the first database, a position information acquisition means for acquiring position information corresponding to the cell image acquired by the cell image acquisition means from the second database, and the cell Display means for displaying the cell image acquired by the image acquisition means, selection means for selecting one of the cell images included in the cell image displayed by the display means, and acquisition by the position information acquisition means A specifying means for specifying an image of the selected cell among the displayed cell images based on the positional information, and an input unit, -Option means, upon receiving a predetermined input of the input unit, characterized in that it is configured to select an image of a different cell and an image of the cells which have been selected.

  The cell image display device according to the present invention includes an image display unit, an input unit, a first receiving unit that receives a cell image in which cells are captured from the outside, and a cell in the cell image received by the first receiving unit. Second receiving means for receiving position information indicating the position of the image from the outside, display means for displaying a cell image received by the first receiving means, and an image of a cell included in the cell image displayed by the display means Selecting means for selecting one of the above, and specifying means for specifying an image of the selected cell among the displayed cell images based on the positional information received by the second receiving means, The selection unit is configured to select a cell image different from the selected cell image when a predetermined input from the input unit is received.

  A computer program according to the present invention is a computer program including an image display unit, an input unit having a keyboard provided with a plurality of keys, and a communication unit capable of communicating with the outside. First receiving means for receiving from outside, second receiving means for receiving position information indicating the position of the cell image in the cell image received by the first receiving means from outside, and cells received by the first receiving means Display based on position information received by the display means for displaying an image, selection means for selecting one of the cell images included in the cell image displayed by the display means, and the second receiving means A computer program for functioning as a specifying means for specifying an image of a selected cell in a selected cell image, wherein the selecting means includes the key When accepting an input of a predetermined key of the over-de, characterized in that it is configured to cause the computer to function so as to select the image of different cells and image cells that had been selected.

  By doing in this way, just by the inspector making a predetermined input to the input unit, an image of the cell is automatically selected and displayed so that the selected cell is specified. Therefore, it is not necessary to select an image of the cell, it is only necessary to classify the selected cell, and the cell classification / counting operation can be made more efficient than before. Further, there is no difference in selection of cells to be classified for each examiner, and a stable classification count result can be obtained.

  In addition, it is not necessary for the instructor who is inexperienced in the cell classification count to select the cells to be classified, and it is only necessary to classify the cells that are selected sequentially. Can be done automatically. In addition, even if multiple trainees perform classification work on the same cell image, the cells to be classified are unified among the trainees. It is possible to instruct cell classification, and as a result, it is possible to contribute to unification of cell classification standards.

  In the above invention, it is preferable that the specifying means is configured to display a mark indicating that the cell is selected at the position of the selected cell image in the cell image. The specifying unit may be configured to display a cell image so that an image of the cell selected by the selecting unit is located at the center.

  In this way, it is possible to clarify that the cell image is selected, and an inspector, a leader, a trainee, etc. (hereinafter referred to as an inspector, etc.) can easily select the selected cell image. Can be confirmed.

  In the above invention, the input unit has a keyboard provided with a plurality of keys, and the selection means is an image of the selected cell when receiving an input of a predetermined key of the keyboard. It is preferably configured to select images of different cells.

  Further, in this case, a plurality of classification items according to cell types are respectively assigned to the plurality of keys of the keyboard, and the selection means receives the input of the keyboard keys, It is preferable to have a configuration having classification means for classifying the selected cell image according to the classification item assigned to the key.

  By doing this, the examiner or the like only inputs the key on the keyboard, and the cell image is classified according to the classification item assigned to the key, and the next cell image is selected. The efficiency of the classification counting work can be improved.

  In the above invention, the display means is preferably configured to display classification items of the cell image in the vicinity of the cell image classified by the classification means.

  By doing in this way, it becomes possible to easily confirm the classification result of the already classified cell images. In addition, since the instructor can easily confirm the result of classifying in advance by the instructor, it is possible to more efficiently instruct cell classification.

  In the above invention, the selection means has the same line of sight as the image of the selected cell when the area displayed by the display means in the cell image is divided into a plurality of line-of-sight movement areas divided in the vertical direction. If at least one of the cell images included in the moving region is not yet selected, one of the cell images included in the line-of-sight moving region and not yet selected is selected and selected. When all of the cell images included in the same line-of-sight movement area as the image of the selected cell are selected, one of the image of the cells included in the line-of-sight movement area adjacent to the line-of-sight movement area and not yet selected. Preferably, it is configured to select one.

  The inventor of the present application, from the left to the right, for each region in which the line of sight of the examiner or the like when performing cell classification counting, in particular, the line of sight of an inspector skilled in cell classification work is divided into a plurality of screens in the vertical direction. It has been found that the screen is often moved in a Z-shape from the top to the bottom or from the bottom to the top by moving from the right to the left or by repeating this. Thus, by doing this, cell images are sequentially selected along the line-of-sight movement region corresponding to the region, and when selection of all cell images included in the line-of-sight movement region is completed, the adjacent line of sight Since the cell image of the moving region is selected, it is possible to select a cell image that matches the eye movement of the examiner, and it is possible to prevent the examiner from feeling uncomfortable in selecting the cell image in the cell classification operation. .

  In the above invention, it is preferable that the selection means is configured to sequentially select the images of cells included in one line-of-sight movement region from one side to the other side in the horizontal direction. Moreover, in the said invention, it is preferable that the said selection means is comprised so that the image of a cell may be selected so that a visual line movement area | region may be moved from upper direction to the downward direction, or from the downward direction toward the upper direction.

  As a result, for each line-of-sight movement region, the cell image selection moves in a Z-shape from the top to the bottom or from the bottom to the top. This makes it possible to prevent the examiner from feeling uncomfortable in selecting the cell image in the cell classification operation.

  In the above invention, it is preferable that the selection means is configured to select an image of a cell closest to the selected cell image.

  As a result, the examiner can usually select a cell image that matches the cell image selection order of the examiner, and then selects the cell image closest to the cell image selected as the classification target. It is possible to prevent the examiner from feeling uncomfortable in selecting the cell image.

  In the above invention, it is preferable that the display means is configured to display a dividing line for dividing the line-of-sight movement region so as to be superimposed on the cell image.

  Accordingly, since the examiner can grasp the line-of-sight movement region and advance the classification count, the selection order of the cell images can be easily predicted, and the cell classification counting operation can be further facilitated.

  In the above invention, the first database is provided in a cell image server device that provides a cell image, and the cell image acquisition unit, the display unit, the selection unit, the specifying unit, and the input unit include: It is preferable that the cell image display device receives a cell image from the cell image server device.

  By doing in this way, the first database, the cell image acquisition means, the display means, the selection means, the specifying means, and the input unit are provided in one apparatus, and storage, provision, and display of cell images are performed. Compared to the configuration to be performed, the processing load can be distributed in the cell image server device and the cell image display device. In addition, by centrally managing cell images with a large amount of data by the cell image server device, a plurality of cell image display devices can be connected to the cell image server device, and each cell image display device can receive cell images. It is possible to manage cell images because it is not necessary to store and manage cell images for each device. In addition, each cell image display device does not need to be equipped with a storage device having a large capacity, and an inexpensive system configuration can be achieved.

  In the above invention, preferably, the second database is provided in a location information server device that provides location information, and the location information acquisition means is provided in the cell image display device.

  By doing so, it is not necessary for the cell image server apparatus having a high processing load to manage and provide position information in order to provide a large-capacity cell image, and the processing load can be distributed.

  In the above invention, the cell image display device further includes an authentication information input receiving unit that receives an input of authentication information required for user authentication, and the authentication information input receiving unit receives the input based on the authentication information received. An authentication means for authenticating the user, and when the authentication of the user by the authentication means is successful, the cell image and the position information are provided from the first database and the second database to the cell image display device. It is preferable to be configured.

  In this way, when access to the first database and the second database occurs, it is not necessary to individually perform user authentication, and single sign-on can be realized.

  In the said invention, it is preferable that the cell imaged by the said cell image is a blood cell.

  According to the cell image display method, the cell image display system, the cell image display device, and the computer program according to the present invention, an image of a cell is automatically selected simply by the examiner making a predetermined input to the input unit, Since this selected cell is displayed, the examiner does not need to select an image of the cell, it is only necessary to classify the selected cell, and the efficiency of the cell classification / counting work compared to the conventional method is improved. The present invention has excellent effects, such as being able to be realized.

  Hereinafter, a cell image display method, a cell image display system, a cell image display device, and a computer program according to embodiments of the present invention will be specifically described with reference to the drawings.

  FIG. 1 is a schematic diagram showing a configuration of a cell image display system according to an embodiment of the present invention. As shown in FIG. 1, a cell image display system 1 according to the present embodiment includes a computer 2 that functions as a cell image display device according to the present invention, an image creation device 3, a virtual slide server device 4, and a communication server. The apparatus 5 and the authentication server apparatus 6 are mainly configured. The image creation device 3, the virtual slide server device 4, the communication server device 5, and the authentication server device 6 are provided in a medical institution such as a hospital or a pathological examination facility, for example. The virtual slide server device 4, the communication server device 5, and the authentication server device 6 are connected by a communication network NW such as a LAN or the Internet so that data communication is possible.

  FIG. 2 is a block diagram showing a configuration of the computer 2 according to the embodiment of the present invention. The computer 2 mainly includes a main body 21, an image display unit 22, and an input unit 23. The main body 21 mainly includes a CPU 21a, a ROM 21b, a RAM 21c, a hard disk 21d, a reading device 21e, an input / output interface 21f, a communication interface 21g, and an image output interface 21h.

  The CPU 21a can execute computer programs stored in the ROM 21b and computer programs loaded in the RAM 21c. Then, when the CPU 21a executes a computer program according to the present invention as described later, the computer 2 functions as the cell image display device according to the present invention.

  The ROM 21b is configured by a mask ROM, PROM, EPROM, EEPROM, or the like, and stores a computer program executed by the CPU 21a, data used for the same, and the like.

  The RAM 21c is configured by SRAM, DRAM, or the like. The RAM 21c is used for reading computer programs recorded in the ROM 21b and the hard disk 21d. Further, when these computer programs are executed, they are used as a work area of the CPU 21a.

  The hard disk 21d is installed with various computer programs to be executed by the CPU 21a, such as an operating system and application programs, and data used for executing the computer programs.

  The reading device 21e is configured by a flexible disk drive, a CD-ROM drive, a DVD-ROM drive, or the like, and can read a computer program or data recorded on the portable recording medium 24. The portable recording medium 24 stores the computer program according to the present invention, and the computer 2 reads the computer program according to the present invention from the portable recording medium 24 and installs the computer program in the hard disk 21d. It is possible.

  The computer program according to the present invention is provided not only by the portable recording medium 24 but also from an external device that is communicably connected to the computer 2 via an electric communication line (whether wired or wireless). It can also be provided through a communication line. For example, a computer program according to the present invention may be stored in a hard disk of a server computer on the Internet, and the computer 2 may access the server computer to download the computer program and install it on the hard disk 21d. Is possible.

  The input / output interface 21f includes, for example, a serial interface such as USB, IEEE1394, and RS-232C, a parallel interface such as SCSI, IDE, and IEEE1284, and an analog interface including a D / A converter and an A / D converter. ing. An input unit 23 composed of a keyboard and a mouse is connected to the input / output interface 21f, and a user (for example, a laboratory technician, an inspecting doctor, a leader, or a trainee) uses the input unit 23 so that a computer can be used. It is possible to input data into 2.

  The communication interface 21g is, for example, an Ethernet (registered trademark) interface, and the computer 2 uses the communication interface 21g to connect the virtual slide server device 4 and the communication server device 5 connected to the communication network NW using a predetermined communication protocol. , And the authentication server device 6 can transmit and receive data.

  The image output interface 21h is connected to an image display unit 22 composed of an LCD, a CRT, or the like, and outputs a video signal corresponding to the image data given from the CPU 21a to the image display unit 22. The image display unit 22 displays an image (screen) according to the input video signal.

  Next, the configuration of the image creation device 3 will be described. The image creation device 3 is a device for creating an image (hereinafter referred to as a virtual slide) obtained by taking a high-magnification image of blood cells contained in a blood smear, and is 10 times, 20 times, 40 times, and 60 times dry. An optical microscope 30 having an objective lens and a 100 × oil immersion objective lens, a 3CCD camera 31 for capturing an image, an automatic stage 32 for a microscope capable of automatically adjusting the position in the XYZ directions, and an automatic stage 32 It is mainly configured by a control device 33 and a joystick 34 for performing position control, and a computer 35 for performing position control of the automatic stage 32 and performing focus synthesis and image tiling. In the present embodiment, the optical microscope 30 is, for example, Olympus BX-50 series, the automatic stage 32 is, for example, PRIOR H101BX, and the 3CCD camera 31 is, for example, Victor Corporation, KY- F70B can be used respectively. The computer 35 is connected to the 3CCD camera 31 via an image signal transmission cable 36, and is connected to the control device 33 and the joystick 34 via a control signal transmission cable 37.

  The computer 35 includes a CPU, a ROM, a RAM, a hard disk, and the like (not shown). A computer program for performing position control of the automatic stage 32, focus synthesis, and image tiling is stored in the hard disk. Stored. The computer 35 can operate as described later by executing such a computer program. The computer 35 has a built-in communication interface (not shown) connected to the communication network NW, and can perform data communication with other devices such as the virtual slide server device 4 and the communication server device 5 through the communication network NW. It is possible.

  FIG. 3 is a block diagram showing a configuration of the virtual slide server device 4 according to the embodiment of the present invention. The virtual slide server device 4 is a device for managing the virtual slide created by the image creation device 3, providing it to an external device, and dividing the image. The CPU 41a, the ROM 41b, the RAM 41c, the hard disk 41d, The computer 41 includes a reading device 41e and a communication interface 41f.

  The CPU 41a can execute computer programs stored in the ROM 41b and computer programs loaded in the RAM 41c. The computer 41 functions as the virtual slide server device 4 when the CPU 41a executes a computer program according to the present invention as will be described later.

  The ROM 41b is configured by a mask ROM, PROM, EPROM, EEPROM, or the like, in which computer programs executed by the CPU 41a, data used for the same, and the like are recorded.

  The RAM 41c is configured by SRAM, DRAM, or the like. The RAM 41c is used to read out computer programs recorded in the ROM 41b and the hard disk 41d. Further, when these computer programs are executed, they are used as a work area of the CPU 41a.

  The hard disk 41d is installed with various computer programs to be executed by the CPU 41a, such as an operating system and application programs, and data used for executing the computer programs.

  The hard disk 41d is provided with a virtual slide database 42. The virtual slide database 42 includes identification information such as a specimen number, virtual slide data, a partial image cut out from the virtual slide, and access restriction information. Can be stored in association with each other.

  The reading device 41 e is configured by a flexible disk drive, a CD-ROM drive, a DVD-ROM drive, or the like, and can read a computer program or data recorded on the portable recording medium 43. The portable recording medium 43 stores a computer program for causing the computer to function as a virtual slide server device according to the present invention. The computer 41 reads the computer program from the portable recording medium 43, and the computer The program can be installed on the hard disk 41d.

  The computer program is not only provided by the portable recording medium 43 but also from an external device that is communicably connected to the computer 41 via an electric communication line (whether wired or wireless). It is also possible to provide. For example, the computer program according to the present invention may be stored in the hard disk of a server computer on the Internet, and the computer 41 may access the server computer to download the computer program and install it on the hard disk 41d. Is possible.

  The communication interface 41f is, for example, an Ethernet (registered trademark) interface, and the computer 41 is connected to the communication network NW using a predetermined communication protocol, the image creating apparatus 3, the communication server, and the like. Data can be transmitted and received between the device 5 and the authentication server device 6.

  FIG. 4 is a block diagram showing a configuration of the communication server device 5 according to the embodiment of the present invention. The communication server device 5 is a device for managing the position information of the cell image on the virtual slide, providing it to an external device, and managing the classification result data. The CPU 51a, the ROM 51b, the RAM 51c, the hard disk 51d, The computer 51 includes a reading device 51e and a communication interface 51f.

  The CPU 51a can execute computer programs stored in the ROM 51b and computer programs loaded in the RAM 51c. The computer 51 functions as the communication server device 5 when the CPU 51a executes a computer program according to the present invention as will be described later.

  The ROM 51b is configured by a mask ROM, PROM, EPROM, EEPROM, or the like, in which computer programs executed by the CPU 51a, data used for the same, and the like are recorded.

  The RAM 51c is configured by SRAM, DRAM, or the like. The RAM 51c is used for reading out computer programs recorded in the ROM 51b and the hard disk 51d. Further, when these computer programs are executed, it is used as a work area of the CPU 51a.

  The hard disk 51d is installed with various computer programs to be executed by the CPU 51a, such as an operating system and application programs, and data used for executing the computer programs.

  The hard disk 51d is provided with a position information database 52. The position information database 52 includes identification information such as a specimen number, classification count result data (or communication data described later), and data for specifying a virtual slide. (In this embodiment, the file name of the virtual slide data), the change history data of the classification count result, and the access restriction information can be stored in association with each other. FIG. 5 is a diagram illustrating the configuration of the classification count result data. As shown in FIG. 5, the classification count result data 52a includes, for each of a plurality of cell images to be classified and counted, a file name of a partial image of a cell, position information on a virtual slide of the cell image, a classification name, a comment, a number, The data includes the scale of the partial image, the size of the partial image, the classification date and time, and the classifier name. The position information database 52 stores user groups (described later) that are permitted to access the classification count result data as access restriction information.

  The reading device 51 e is configured by a flexible disk drive, a CD-ROM drive, a DVD-ROM drive, or the like, and can read a computer program or data recorded on the portable recording medium 53. The portable recording medium 53 stores a computer program for causing the computer to function as the communication server device according to the present invention. The computer 51 reads the computer program from the portable recording medium 53, and the computer program Can be installed on the hard disk 51d.

  The computer program is provided not only by the portable recording medium 53 but also from an external device that is communicably connected to the computer 51 via an electric communication line (whether wired or wireless) through the electric communication line. It is also possible to provide. For example, the computer program according to the present invention may be stored in a hard disk of a server computer on the Internet, and the computer 51 may access the server computer to download the computer program and install it on the hard disk 51d. Is possible.

  The communication interface 51f is, for example, an Ethernet (registered trademark) interface, and the computer 51 is connected to the communication network NW using a predetermined communication protocol, the image creation apparatus 3, the virtual slide, and the like. Data can be transmitted and received between the server device 4 and the authentication server device 6.

  FIG. 6 is a block diagram showing a configuration of the authentication server device 6 according to the embodiment of the present invention. The authentication server device 6 is a device for managing user authentication information and performing user authentication processing. The authentication server device 6 includes a CPU 61a, a ROM 61b, a RAM 61c, a hard disk 61d, a reading device 61e, and a communication interface 61f. 61.

  The CPU 61a can execute the computer program stored in the ROM 61b and the computer program loaded in the RAM 61c. The computer 61 functions as the authentication server device 6 when the CPU 61a executes a computer program as will be described later.

The ROM 61b is configured by a mask ROM, PROM, EPROM, EEPROM, or the like, in which computer programs executed by the CPU 61a, data used for the same, and the like are recorded.

  The RAM 61c is configured by SRAM, DRAM, or the like. The RAM 61c is used to read out computer programs recorded in the ROM 61b and the hard disk 61d. Further, when these computer programs are executed, they are used as a work area of the CPU 61a.

  The hard disk 61d is installed with various computer programs to be executed by the CPU 61a, such as an operating system and application programs, and data used for executing the computer programs.

  The hard disk 61d is provided with an authentication information database 62. The authentication information database 62 can store authentication data such as a user ID, a user group name, and a password. The user group is a group for classifying users. For example, a laboratory group to which a laboratory technician who performs a normal cell classification count examination belongs, a laboratory group to which a laboratory doctor who checks the classification count result by the laboratory technician belongs, and a virtual slide Management and maintenance of the clinician group to which the clinicians who perform cytodiagnosis using, the instructor group to which the instructor who instructs the examination technique belongs, the instructor group to which the instructor who receives instruction from the instructor belongs, and the system There is an administrator group to which the administrator who performs

  The reading device 61e is configured by a flexible disk drive, a CD-ROM drive, a DVD-ROM drive, or the like, and can read a computer program or data recorded on the portable recording medium 63. The portable recording medium 63 stores a computer program for causing the computer to function as the authentication server device according to the present invention. The computer 61 reads the computer program from the portable recording medium 63, and the computer program Can be installed on the hard disk 61d.

  The computer program is provided not only by the portable recording medium 63 but also from an external device that is communicably connected to the computer 61 via an electric communication line (whether wired or wireless) through the electric communication line. It is also possible to provide. For example, a computer program related to user authentication may be stored in a hard disk of a server computer on the Internet, and the computer 61 may access the server computer to download the computer program and install it on the hard disk 61d. Is possible.

  The communication interface 61f is, for example, an Ethernet (registered trademark) interface, and the computer 61 uses the communication interface 61f to connect the computer 2, the image creation apparatus 3, the virtual slide connected to the communication network NW using a predetermined communication protocol. Data can be transmitted and received between the server device 4 and the communication server device 5.

  Next, the operation of the cell image display system 1 according to the embodiment of the present invention will be described. The computers 2, 41, 51, and 61 operate as follows by executing computer programs stored in the hard disks 21d, 41d, 51d, and 61d, respectively. In the following description, computer programs for causing a computer to function as a cell image display device, a virtual slide server device, a communication server device, and an authentication server device according to the present invention are manufactured and sold by, for example, Microsoft Corporation. It operates on an operating system such as Windows (registered trademark).

  The operation of the cell image display system 1 includes a virtual slide registration operation for creating a virtual slide and registering it in the virtual slide database 42, and a user using the virtual slide registered in the virtual slide database 42 to calculate a blood cell classification count. It is divided into the classification count operation to be performed. First, the virtual slide registration operation will be described. FIG. 7 is a flowchart showing the procedure of the virtual slide registration operation of the cell image display system 1 according to the embodiment of the present invention. As shown in FIG. 7, first, the image creating apparatus 3 accepts input of identification information (step S1). Here, the operator who creates the virtual slide confirms the identification information attached to the blood smear specimen to be created, and operates an input device such as a keyboard provided in the computer 35 of the image creating apparatus 3. The identification information is input to the image creating apparatus 3. It should be noted that in the process of accepting data input as in step S1 in the computer program according to the embodiment of the present invention, the process of transmitting / receiving data, which will be described later, and the process of displaying an image, Device driver functions that control the input device (input unit), communication interface, and image output interface are not included. By inputting / outputting data to / from the device driver, input reception, transmission / reception of data, And processing for displaying an image.

  Next, the image creating apparatus 3 executes a virtual slide creating process for creating a virtual slide from the blood smear (step S2). FIG. 8 is a conceptual diagram for explaining a method for creating a virtual slide (blood cell image) according to the embodiment of the present invention, and FIG. 9 is a flowchart for explaining the procedure of the virtual slide creation process S2 in detail. As shown in FIG. 9, the virtual slide creation process includes a setting phase and a processing phase. In the setting phase, an operator first sets a specimen on the optical microscope 30 to which the automatic stage 32 is attached. As this specimen, as shown in FIG. 8, a specimen in which a smear 72 is spread over a predetermined region on the surface of the specimen slide glass 71 is used. Next, the computer 35 determines whether or not an input of a range for virtual slide has been received (step S101). Here, the operator uses the input device of the computer 35 to input a range to be virtual-slided (sample specimen area: distance in the X direction and the Y direction) to the image creating device 3. When the computer 35 receives the input of the range to be virtual-slided (Yes in step S101 in FIG. 9), the computer 35 sets the range to be virtual-slided as an input value (step S102). In addition, when the computer 35 does not accept the input of the range to be virtual slide in Step S101 (No in Step S101 of FIG. 9), the computer 35 repeats the process of Step S101 until the input is accepted. Next, the computer 35 determines whether or not an input of an overlapping rate between continuous visual fields for image tiling has been received (step S103). Here, the operator inputs the overlap rate into the computer 35 using the input device of the computer 35. This overlap ratio is preferably set to about 10% or more and about 40% or less. When the computer 35 thus receives the input of the overlapping rate between the continuous visual fields (Yes in step S103 in FIG. 9), the computer 35 sets the overlapping rate between the continuous visual fields to the input value (step S104). Further, when the computer 35 does not accept the input of the overlapping rate between the continuous visual fields in step S103 (No in step S103 of FIG. 9), the computer 35 repeats the process of step S103 until the input is accepted. Further, the computer 35 determines whether or not the input of the focal width (distance in the Z direction) and the step size for focus composition has been received (step S105). Here, the operator uses the input device of the computer 35 to input the focal width and the step size into the computer 35. The number of images to be captured in the same field of view is determined by setting the focal width and the step size. In the present embodiment, the case where the focal width is set to about 1 mm or less and the step width is set to about 0.1 μm will be described. When the computer 35 accepts the input of the focal width and the step width (Yes in step S105 in FIG. 9), the computer 35 sets the focal width and the step width as input values (step S106). If the computer 35 does not accept the input of the focal width and the step size in step S105 (No in step S105 of FIG. 9), the computer 35 repeats the process of step S105 until the input is accepted. The setting phase of the virtual slide (blood cell image) creation process is completed by the processes in steps S101 to S106 described above.

  Next, the processing phase will be described. In the processing phase, first, for the same field of view, the number of images determined in step S106 are captured by the 3CCD camera 12 and taken into the computer 35, and a focus composite image is created by the computer 35 (step S107). . Here, the focus synthesis is to extract a focused pixel from each image for a plurality of images having different focal positions in the same visual field, and synthesize these to obtain a single focused image as a whole. The process to create. In the present embodiment, by performing such focus synthesis on all images captured in the same field of view, a focus synthesized image having a resolution of 1360 dots × 1024 dots is created as shown in FIG. For example, the TIFF format is used as the image format of the focus composite image.

  Next, the computer 35 determines whether or not a focus composite image has been created for the entire range set in step S102 (step S108), and if a portion for which no focus composite image has been created remains ( In step S108 in FIG. 9, the automatic stage 32 is moved, the field of view taken by the 3CCD camera 12 is moved (step S109), the process returns to step S107, and a focus composite image in a new field of view is created. .

  If it is determined in step S108 that a focus composite image has been created for the entire setting range (Yes in step S108 in FIG. 9), the computer 35 performs the overlap set in step S104 as shown in FIG. According to the ratio, image tiling between the focus composite images is performed (step S110). At this time, the computer 35 recognizes an overlapping portion of adjacent focus composite images by a known pattern matching process, and synthesizes both images so that the joints are not conspicuous by matching the overlapping portions of the images. Next, the computer 35 determines whether or not the image tiling of all the focus composite images has been performed (step S111). If there is a focus composite image that has not been subjected to image tiling (see FIG. 9). No in step S111), one of the remaining focus composite images is selected as a processing target (step S112), the process returns to step S110, and image tiling is performed on the focus composite image to be processed. If it is determined in step S111 that image tiling of all focus composite images has been completed (Yes in step S111 in FIG. 9), the virtual slide 50 is completed. For example, the BMP format is used as the image format of the virtual slide 50. In addition, the size of the virtual slide 50 in the present embodiment created by the above processing is about 220,000 dots × 134,000 dots.

  Next, as shown in FIG. 7, the image creating apparatus 3 accepts an input of white blood cell selection conditions (step S3). The operator can input selection conditions such as a selection target magnification, a selected number, a selection target area, and the like using the input device of the computer 35. The CPU of the computer 35 first sets 0 to a variable i indicating the number of selected cells (step S4), and uses a known pattern recognition technique to select a classification count from the selection target area of the virtual slide 50. A white blood cell image which is a cell image is automatically recognized (step S5). Such automatic recognition processing is performed by extracting digital images of three colors of red, green, and blue from the virtual slide 50, performing a predetermined calculation between these images, and creating a density histogram. Further, when the selection target area is not set, white blood cells are recognized from the entire virtual slide 50. Then, the CPU of the computer 35 cuts out the partial image including the recognized white blood cell image from the virtual slide 50 (step S6). Such a partial image is an image that generally includes only one cell image. Then, the CPU of the computer 35 stores the position (X coordinate, Y coordinate) of the extracted white blood cell image in the virtual slide 50 in the memory (step S7), and increments the variable i by 1 (step S8). Next, the CPU of the computer 35 determines whether or not the variable i has reached the selected number N (step S9). If the variable i has not reached (No in step S9), the process returns to step S5. Here, when the selection number is not set, the processes of steps S5 to S8 are repeated until the whole white blood cell image is cut out. In step S9, when the variable i reaches the selected number N (or when the total white blood cell image is cut out) (Yes in step S9), the CPU of the computer 35 stores the white blood cell image stored in the memory. The communication data of the virtual slide 50 is created based on the position information and the file name, scale, size, etc. of the cut out partial image (step S10). This communication data is data having the same data structure as the classification count result data 52a, and “UNC” indicating that the classification is unclassified is stored in the classification name. Next, the CPU of the computer 35 transmits the identification information, the virtual slide 50, and the partial image to the virtual slide server device 4 (step S11). When receiving the identification information, the virtual slide 50, and the partial image (Yes in step S12), the CPU 41a of the virtual slide server device 4 stores the received identification information, the virtual slide 50, and the partial image in the virtual slide database 42. Register (step S13). In the process of step S13, an access right is set. In the present embodiment, description will be made on the assumption that all user groups can be accessed. When the registration of data in the virtual slide database 42 is completed, the CPU 41a ends the process.

  Further, the CPU of the computer 35 transmits the identification information, communication data, and the file name of the virtual slide to the communication server device 5 (step S14), and ends the process. When the CPU 51a of the communication server device 5 receives the identification information, the communication data, and the file name of the virtual slide (Yes in step S15), the CPU 51a receives the received identification information, the communication data, and the file name of the virtual slide as positional information. Register in the database 52 (step S16). In the process of step S16, an access right is set. In the present embodiment, description will be made on the assumption that all user groups can be accessed. When the registration of the data in the position information database 52 is completed, the CPU 51a ends the process.

  Next, the classification count operation will be described. FIGS. 10-12 is a flowchart which shows the procedure of the classification count operation | movement of the cell image display system 1 which concerns on embodiment of this invention. FIGS. 13 to 15 are diagrams showing screen display examples of the computer 2 during the white blood cell classification count operation in the cell image display system according to the embodiment of the present invention. First, the computer 2 displays the login screen shown in FIG. 13, determines whether or not an input of a user ID and a password necessary for accessing the virtual slide database 42 has been accepted (step S41), and this process until the input is accepted. Is repeated (No in step S41), and input standby is performed. This user ID and password are issued to the user of the cell image display system 1 in advance by the system administrator who manages the cell image display system 1 according to the present embodiment, and are used for user personal authentication. . As shown in FIG. 13, the computer 2 displays a login screen having user ID and password input boxes. Then, the user operates the input unit 23 of the computer 2 to input the user ID and password to the computer 2 and clicks the “OK” button displayed on the image display unit 22. Thus, the user ID and password are accepted in step S41 (Yes in step S41). Next, the computer 2 transmits the input user ID and password data to the authentication server device 6 (step S42). The authentication server device 6 determines whether or not user ID and password data has been received (step 43), and repeats this process until data is received (No in step S43). When the authentication server device 6 receives the user ID and password data in step S43 (Yes in step S43), the authentication server device 6 determines whether or not the user ID and password are registered in the authentication information database 62. Personal authentication is performed (step S44). If the authentication fails, the process ends. If the authentication is successful in step S44 (Yes in step S44), the virtual slide server device 4 transmits data indicating the authentication success to the virtual slide server device 4 and the communication server device 5 (step S45). The CPU 41a of the virtual slide server device 4 determines whether or not the authentication success data has been received (step S46), and the CPU 51a of the communication server device 5 also determines whether or not the authentication success data has been received (step S47). ).

  When the CPU 41a of the virtual slide server device 4 receives the authentication success data (Yes in step S46), it creates a list of virtual slides and sends this list to the computer 2 (step S48). When the CPU 21a of the computer 2 receives the list of virtual slides (Yes in step S49), the CPU 21a displays a list of file names of the virtual slides (step S50) and accepts selection of the virtual slides from the user (step S50). Step S51). At this time, the user can select this virtual slide by operating the input unit 22 and clicking one of the virtual slide file names displayed in a list. As described above, when the selection of the virtual slide is received (Yes in Step S51), the CPU 21a transmits the file name of the virtual slide for which the selection has been received to the virtual slide server device 4 and the communication server device 5 (Step S52). ).

  When the CPU 41a of the virtual slide server device 4 and the CPU 51a of the communication server device 5 each receive the file name of the virtual slide (Yes in steps S53 and S54), the access restriction information associated with the file name is confirmed. Then, it is determined whether or not access permission is given (steps S55 and S56). When the access permission is not given (No in steps S55 and S56), access denial data indicating access denial is transmitted to the computer 2 (steps S57 and S58), and the process is returned to steps S53 and S54, respectively. When the CPU 21a of the computer 2 receives the access refusal data (Yes in step S59), the process returns to step S50. As a result, access to the virtual slide 50 having this file name and the classification count result data or communication data associated therewith is denied to the user group to which access permission is not given.

  On the other hand, when access permission is given in steps S55 and S56 (Yes in steps S55 and S56), the CPU 41a reads out the virtual slide and the partial image corresponding to the file name from the virtual slide database 42 (step S60). These data are transmitted to the computer 2 (step S61), and the CPU 51a reads out the classification count result data or communication data corresponding to the file name from the position information database 52 (step S62) and transmits it to the computer 2. (Step S63). The CPU 21a of the computer 2 receives the virtual slide and the partial image (Yes in Step S64), and when receiving the classification count result data or the communication data (Yes in Step S65), executes the classification counting process (Step S66). ).

  The classification count process S66 will be described in detail. 16 and 17 are flowcharts showing the procedure of the classification count process according to the embodiment of the present invention. First, the CPU 21a displays the virtual slide 50 on the image display unit 22 (step S201). Since the virtual slide 50 is very large and cannot be displayed entirely on the image display unit 22, in the process of step S <b> 201, for example, the upper left corner region of the virtual slide 50 is displayed on the image display unit 22. Further, the CPU 21a receives an input of the display area of the virtual slide 50 (step S202). Here, the user can instruct to display a desired area in the virtual slide 50 by performing a drag operation with a mouse, for example. When an instruction for a display area is input in step S202 (Yes in step S202), the CPU 21a displays this area on the image display unit 22 (step S203). As a result, an area in the virtual slide 50 that should be classified and counted is displayed on the image display unit 22. Note that the processing in steps S202 and S203 has been described to be performed sequentially for the sake of simplicity, but in actuality, it is an event-driven processing and has received input from the user. In some cases, the display area is changed at any time.

  Next, the CPU 21a causes the image display unit 22 to display the line-of-sight movement area defining line 102 that defines the line-of-sight movement areas 101a, 101b, and 101c, superimposed on the virtual slide 50 (step S204). As shown in FIGS. 14 and 15, the line-of-sight movement area defining line 102 includes a rectangular outline line 102c indicating the outline of the free movement recognition area 101, and a dividing line extending in the horizontal direction over the entire width of the outline line 102c. 102a, 102b. In the image display unit 22, such a line-of-sight movement region defining line 102 is displayed so as to be superimposed on the virtual slide 50. 14 and 15, the line-of-sight movement area defining line 102 includes an outline line 102c slightly smaller than the size of the window and two division lines 102a and 102b. The free movement recognition area 101 is an area where a cell image to be classified at that time (hereinafter referred to as a focused cell image) is selected from all classification count target cell images displayed in the window. That is, even in the classification count target cell image displayed in the window, the cell image deviated from the free movement recognition area 101 is not selected as the target cell image. A part of the cell image existing at the edge of the window may not be displayed outside the window, and in this case, it is difficult to accurately classify the cell image. Thus, by doing this, it is possible to prevent the cell image existing at the edge portion of the window, which is difficult to classify correctly, from being selected as the target cell image. The division lines 102a and 102b are arranged vertically so as to divide the free movement recognition area 101 at equal intervals. Of the free movement recognition area 101, areas (line-of-sight movement areas) 101a, 101b, and 101c divided by the dividing lines 102a and 102b, that is, the horizontal lines on the upper side, the vertical lines on the left and right sides, and the upper dividing lines. The region 101a surrounded by 102a, the upper parting line 102a, the left and right vertical lines of the outer line 102c, and the area 101b surrounded by the lower parting line 102b, and the left and right vertical lines of the lower parting line 102b and the outer line 102c A region 101c surrounded by the line and the lower horizontal line is a region that defines the movement of the user's line of sight. As will be described in detail below, one of these line-of-sight movement regions 101a, 101b, and 101c is selected, and all cell images of interest are sequentially selected within the selected region, and then next to it. By selecting the line-of-sight movement region and repeating the same processing, natural line-of-sight movement is realized if the user is paying attention only to the target cell image.

  Next, the CPU 21a determines whether or not all of the classification count target cell images of the virtual slide 50 are cell images included in the free movement recognition area 101 (step S205). In this process, the position information of the area of the virtual slide 50 displayed on the image display unit 22 is compared with the position information of each classification count target cell included in the downloaded classification count result data or communication data. Thus, it is determined whether or not the class count target cell of interest is included in the free movement recognition region 101. Then, the CPU 21a displays the partial image of the classification count target cell image determined to be included in the free movement recognition area 101 in step S205 on the image display unit 22 (step S206). 14 and 15 show an example in which the partial images 103a, 103b,... Are displayed side by side in a matrix form on the right side of the virtual slide 50. FIG.

  Next, the CPU 21a reads out the classification name of the classification count target cell image included in the free movement recognition area 101 from the downloaded classification count result data or communication data, and superimposes this classification name 105 on the virtual slide 50 to cope with it. It displays in the vicinity of the cell image to be performed (step S207). Thereby, when the classification count is performed in the past, the classification name 105 at this time is displayed on the virtual slide as shown in FIG. Therefore, for example, the leader can easily confirm the past classification result of the instructor. That is, since the past classification result of the instructor can be stored in the position information database 52 as classification count result data for a long period of time, the instructor confirms the past classification result of the instructor and the instructor. It is possible to instruct the cell classification count even if the instructor and the instructor are not simultaneously at the place where the computer 2 is installed. In addition, here, when it is not classified (when the classification name is “UNC”), this is not displayed by default. This setting can be changed, and “UNC” can be displayed. Further, the CPU 21a counts the number of classified cell images for each classification name from the classification count result data or the communication data, and displays the count result (step S208). Thereby, when the classification count is performed in the past, the result of this classification count can be displayed (not shown).

  Next, the CPU 21a accepts the setting of the line-of-sight movement direction (step S209). The direction of the line-of-sight movement is a direction defined according to the line-of-sight movement areas 101a, 101b, and 101c, and the classification count target cell images are sequentially selected along this direction as described below. For example, as shown by the dashed arrows in FIG. 15, the line-of-sight movement direction is from the left to the right in the uppermost line-of-sight movement area 101a, and from the right to the left in the middle line-of-sight movement area 101b. In the area 101c, the direction is determined from left to right. Such a line-of-sight movement direction is substantially the same as the direction in which the line of sight is moved, particularly when an expert performs a cell classification and counting operation. As a result of investigation by the inventors of the present application, doctors, laboratory technicians, etc. engaged in classification counting work divide the screen into a plurality of areas in the vertical direction, and line of sight from left to right or from right to left for each area. It was found that by moving and repeating this from one end side (for example, the upper end side) to the other end side (for example, the lower end side), the line of sight is moved in a Z-shape. The line-of-sight movement direction described in the classification counting process S66 is determined in accordance with the line-of-sight movement direction of a person skilled in cell classification and counting work based on such knowledge.

  In addition to the line-of-sight movement direction shown in FIG. 15, the line-of-sight movement areas 101a, 101b, and 101c are sequentially selected from the top to the bottom, and in the selected line-of-sight movement area, the direction is from left to right. Alternatively, the line-of-sight movement areas 101a, 101b, and 101c are sequentially selected from the bottom to the top. From the line-of-sight movement area 101c selected first, from right to left, and in the line-of-sight movement area 101b selected next. In the line-of-sight movement area 101a that is selected last from left to right, the direction may be from right to left. In the present embodiment, the line-of-sight movement areas 101a, 101b, and 101c are sequentially selected from top to bottom, and the line-of-sight movement area 101b that is selected next from the left to the right in the line-of-sight movement area 101a that is selected first. In the following description, it is assumed that the direction from the left to the right is the default line-of-sight movement direction in the line-of-sight movement area 101c selected from right to left. The user can input the setting of the line-of-sight movement direction by operating the input unit 23. When the setting of the line-of-sight movement direction is accepted in step S209 (Yes in step S209), the CPU 21a sets the line-of-sight movement direction (step S210). Further, when the setting is not accepted in step S209 (No in step S209), the CPU 21a adopts the default line-of-sight movement direction. Note that the processing in step S209 has been described as being performed sequentially for the sake of simplicity, but in actuality, it is an event-driven process, and when input from the user is accepted Change the direction of eye movement at any time.

  Next, the CPU 21a selects the first line-of-sight movement region (step S211). Below, the flow of processing when the default line-of-sight movement direction is adopted as an example will be described. By default, the line-of-sight movement area 101a is first selected as the line-of-sight movement area. Next, the CPU 21a selects the first target cell image from among the classification count target cell images included in the selected line-of-sight movement region (step S212). Since the default line-of-sight movement direction is the direction from left to right in the line-of-sight movement area 101a, the leftmost cell image among the classification count target cell images included in the line-of-sight movement area 101a is the target cell image. Will be selected.

  Next, the CPU 21a superimposes and displays the circular mark 104 on the target cell image on the virtual slide 50 (step S213). Thereby, the user can confirm an attention cell image visually. Then, the CPU 21a accepts an input of the classification name of this attention cell image (step S214). Classification names are assigned to a plurality of keys of the keyboard of the input unit 23. To illustrate the classification of white blood cells, Blast (blast) is assigned to the “B” key, and Promyelo (promyelocyte) is assigned to the “P” key. This key assignment can be freely set by the user. For example, when classifying a target cell image as Blast (blast), the user presses the “B” key. When the CPU 21a accepts such a key input (Yes in step S214), the CPU 21a stores the classification name assigned to this key in the RAM 21c in association with the target cell image (step S215). Is displayed in the vicinity of the target cell image (step S216), and the count of the classification name is incremented by 1 (step S217). Further, here, if there is a comment from the user for the cell image of interest, this input is accepted (step S218). For example, when the instructor gives a comment on the classification result of the instructor, or when the clinician adds the diagnosis result as a comment by observing the form of the cell, the user makes a comment here. Can be entered. When the CPU 21a receives an input of a comment (Yes in step S218), the CPU 21a stores the comment in the RAM 21c in association with the target cell image (step S219).

  Subsequently, the CPU 21a determines from the classification count result data or the communication data whether or not the classification count target cell image exists on the visual line movement direction side of the target cell image (step S220). (Yes in step S220), among them, the cell image to be classified and counted that is closest to the target cell image is selected as a new target cell image (step S221), and within the line-of-sight movement region in which this target cell image is selected (Step S222). Here, whether or not the target cell image is present in the selected line-of-sight movement region is determined by determining the position information of the target cell image (classification count target cell image) included in the classification count result data or the communication data. Is performed by comparing the position of the cell image of interest with the position of the line-of-sight movement area (that is, the position on the virtual slide 50 of the area surrounded by the upper, lower, left, and right edges of the screen and the dividing line). In the process of step S222, when the selected classification count target cell image exists in the selected line-of-sight movement region (Yes in step S222), the CPU 21a moves the process to step S213. In the process of step S222, if the selected classification count target cell image does not exist in the selected line-of-sight movement region (No in step S222), the CPU 21a returns the process to step S220, and at that time It is determined whether or not there is a classification count target cell image present on the side of the line-of-sight movement direction with respect to the target cell image of FIG.

  In step S220, when there is no classification count target cell image on the visual line movement direction side of the target cell image (No in step S220), the CPU 21a determines whether there is an unselected visual line movement region. (Step S223), and if there is a line-of-sight movement region not selected here (Yes in step S223), the process proceeds to step S212. On the other hand, if there is no unselected line-of-sight movement region in step S223 (No in step S223), the CPU 21a determines whether or not an unclassified classification count target cell image exists in the virtual slide 50. However, if there is an unclassified classification count target cell image (Yes in step S224), a region adjacent to the region where the virtual slide 50 is displayed is displayed on the image display unit 22. (Step S225), the process proceeds to step S204. In step S224, when an unclassified classification count target cell image does not exist in the virtual slide 50 (No in step S224), the CPU 21a performs classification count result data based on the classification count result and the comment stored in the RAM 21c. Is created (step S226), and the process returns. Although not described here, the CPU 21a also generates classification count result data and returns the process when an end instruction is received from the user.

  In such a classification count process S66, not only a laboratory technician, an examiner, etc. can perform the cell classification count using the virtual slide, but also the instructor can practice and practice the cell classification count using the virtual slide. It is also possible for the instructor to check the result of the classification count performed by the instructor without actually performing the classification count. When the leader confirms the classification result of the trainee, the classification name of the classification result is displayed in the vicinity of the cell image to be classified and counted, so it is possible to determine whether the classification result is correct at a glance. Can do. Further, instead of the cell classification count, the clinician can visually check the cell morphology to diagnose the disease.

  After returning from the classification count process S66, the CPU 21a transmits the created classification count result data to the communication server device 5 (step S67), and ends the process. When the CPU 51a of the communication server device 5 receives the classification count result data (Yes in step S68), the CPU 51a uses the classification count result data together with the identification number, the file name of the virtual slide 50, and the access restriction information as position information. Registration in the database 52 (step S69), and the process ends.

  With the configuration described above, since the classification count target cell image is determined in advance, it is not necessary for the user to select the classification count target cell image in the middle of the classification count operation, and the selected target cell image is classified. Therefore, it is possible to improve the efficiency of the cell counting and counting work as compared with the conventional method. Further, there is no difference in selection of cells to be classified for each user, and a stable classification count result can be obtained.

  In addition, since an appropriate classification count target cell image can be shown to the user, the user can confirm what type of cell image is appropriate as the classification count target cell image simply by confirming the target cell image. Can learn.

  In addition, if the computer 2 in which the computer program for causing the computer to function as the cell image display device of the present invention is installed is installed, the examiner can use the virtual slide regardless of the location to count the cell classification. It can be performed.

  In addition, since the cell images of interest are sequentially selected along the line-of-sight movement direction adapted to the line-of-sight movement of the expert in cell classification and counting, the expert uses the cell image display system 1 according to the present embodiment. Thus, even when the cell classification counting operation is performed, natural line-of-sight movement is possible, and the user can be prevented from feeling uncomfortable in the selection order of the classification count target cell images.

  In the present embodiment, the cell image display system 1 includes a computer 2, an image creation device 3, a virtual slide server device 4, a communication server device 5, and an authentication server device 6, and the authentication server device. 6, when the user authentication is successful, so-called single sign-on that permits the user to access the virtual slide database 42 provided in the virtual slide server device 4 and the location information database 52 provided in the communication server device 5. Although the case where the environment is configured has been described, the present invention is not limited to this. For example, instead of the authentication server device 6, a user authentication server program is installed in each of the virtual slide server device 4 and the communication server device 5, bar When the user authentication by the user authentication server of the digital slide server device 4 is successful, the user access to the virtual slide database 42 is permitted, and when the user authentication by the user authentication server of the communication server device 5 is successful. A configuration may be adopted in which the user's access to the location information database 52 is permitted.

  In addition, the image creation device 3 and the virtual slide server device 4 may be configured as an integrated device, and the process from image capturing to virtual slide creation and virtual slide storage / management may be performed by a single device. The server device 4 and the communication server device 5 are configured as an integrated device, the virtual slide database 42 and the position information database 52 are provided in one device, and data necessary for classification counting work using the virtual slide is collectively stored. -It is good also as a structure to manage. Further, the computer 2, the image creating device 3, the virtual slide server device 4, the communication server device 5, and the authentication server device 6 are configured as an integrated device, and all of the classification counting work by the virtual slide can be performed only by this device. You may be able to do it.

  In the present embodiment, a configuration has been described in which a circular mark 104 can be superimposed on the target cell image displayed on the image display unit 22 and the target cell image can be confirmed. However, the present invention is not limited to this. For example, the mark may be a rectangular frame surrounding the target cell image, and the shape of the mark is not limited as long as the user can visually confirm the target cell image. However, if the portion of the target cell image hidden by the mark increases, it may interfere with the user's work of confirming the form of the target cell image. Therefore, the mark can be recognized by the user with normal attention. Therefore, it is preferable to set the area to a minimum. Further, by configuring the mark to be superimposed on the target cell image in this way, the target cell image can be obtained by changing the position of the mark each time the target cell image is switched while the display area of the virtual slide 50 is fixed. It can be shown which image is. As a result, since the display area of the virtual slide 50 does not frequently switch, it is easy for the user to grasp which part of the virtual slide is the cell image of interest, and to suppress user fatigue. it can.

  Further, instead of displaying the mark 104 superimposed on the target cell image, the target cell image may be displayed at the center of the display surface of the image display unit 22. According to this configuration, a part of the virtual slide 50 is not hidden by the mark, and the user can more reliably recognize the form of the attention cell image.

  In the present embodiment, cell classification names are assigned to a plurality of keys of the keyboard of the input unit 23, and this classification is performed by pressing a key corresponding to the classification name for the target cell image during the classification counting operation. Although the configuration for classifying the target cell image by name has been described, the present invention is not limited to this. For example, when the mouse is clicked near the target cell image, a list of classification names is displayed as a pull-down menu. A configuration may be adopted in which the cell image of interest is classified by this classification name by clicking on the corresponding classification name from the menu.

  In the present embodiment, the configuration for automatically recognizing the classification count target cell image by pattern recognition has been described. However, the present invention is not limited to this, and the operator who operates the image creating apparatus 3 visually recognizes the virtual image. The configuration may be such that a cell image to be classified and counted is selected from the cell images in the slide. In this case, the operator can click the classification count target cell image on the virtual slide to cut out a partial image including the cell image and acquire position information.

  Further, in the present embodiment, the configuration in which the automatic movement recognition area slightly smaller than the size of the window is set as the selection target area of the target cell image is not limited to this. For example, the whole window May be used as a selection target region of the target cell image.

  The cell image display method, the cell image display system, the cell image display device, and the computer program according to the present invention automatically select an image of a cell when the examiner simply inputs a predetermined input to the input unit. Since the displayed cells are displayed, the examiner does not need to select an image of the cells, it is only necessary to classify the selected cells. Cell image display method for displaying a cell image in which cells are imaged, cell image display system used for carrying out the cell image display method, and cell image provided in the cell image display system It is useful as a display device and a computer program for causing a computer to function as a cell image display device.

It is a schematic diagram which shows the structure of the cell image display system which concerns on embodiment of this invention. It is a block diagram which shows the structure of the computer which concerns on embodiment of this invention. It is a block diagram which shows the structure of the virtual slide server apparatus which concerns on embodiment of this invention. It is a block diagram which shows the structure of the communication server apparatus which concerns on embodiment of this invention. It is a figure which shows the structure of classification count result data. It is a block diagram which shows the structure of the authentication server apparatus which concerns on embodiment of this invention. It is a flowchart which shows the procedure of the virtual slide registration operation | movement of the cell image display system which concerns on embodiment of this invention. It is a conceptual diagram explaining the creation method of the virtual slide which concerns on embodiment of this invention. It is a flowchart explaining the procedure of virtual slide creation processing S2 in detail. It is a flowchart which shows the procedure of the classification count operation | movement of the cell image display system which concerns on embodiment of this invention. It is a flowchart which shows the procedure of the classification count operation | movement of the cell image display system which concerns on embodiment of this invention. It is a flowchart which shows the procedure of the classification count operation | movement of the cell image display system which concerns on embodiment of this invention. It is a figure which shows the example of a screen display of the computer in the case of the white blood cell classification count operation in the cell image display system which concerns on embodiment of this invention. It is a figure which shows the example of a screen display of the computer in the case of the white blood cell classification count operation in the cell image display system which concerns on embodiment of this invention. It is a figure which shows the example of a screen display of the computer in the case of the white blood cell classification count operation in the cell image display system which concerns on embodiment of this invention. It is a flowchart which shows the procedure of the classification count process which concerns on embodiment of this invention. It is a flowchart which shows the procedure of the classification count process which concerns on embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Cell image display system 2 Computer 3 Image preparation apparatus 4 Virtual slide server apparatus 5 Communication server apparatus 6 Authentication server apparatus 21 Main body 21a CPU
21b ROM
21c RAM
21d Hard disk 21e Reading device 22 Image display unit 23 Input unit 24 Portable recording medium 30 Optical microscope 31 3CCD camera 32 Automatic stage 33 Controller 35 Computer 41 Computer 41a CPU
41b ROM
41c RAM
41d hard disk 42 virtual slide database 51 computer 51a CPU
51b ROM
51c RAM
51d Hard disk 52 Location information database 52a Classification count result data 61 Computer 61a CPU
61b ROM
61c RAM
61d Hard disk 62 Authentication information database 101a, 101b, 101c Line-of-sight movement area 102a, 102b Partition line 103a, 103b, 103c Partial image 104 Mark NW Communication network

Claims (21)

Obtaining a cell image from a first database in which cell images obtained by imaging a plurality of cells are stored;
Obtaining position information corresponding to the obtained cell image from a second database in which position information indicating the position of the cell image in the cell image is stored;
Displaying the acquired cell image;
Selecting one of the cell images included in the displayed cell image;
Identifying an image of a selected cell in the displayed cell image based on the acquired position information,
In the step of selecting one of the cell images, a cell image display method of selecting a cell image different from the selected cell image when receiving an input of a predetermined key of the keyboard. The cell image display method according to claim 1, wherein in the step of specifying the cell image, a mark indicating that the cell is selected is displayed at a position of the selected cell image in the displayed cell image. The cell image display method according to claim 1, wherein in the step of displaying the cell image, the cell image is displayed so that the image of the selected cell is located at the center. A plurality of classification items according to cell types are assigned to a plurality of keys of the keyboard, respectively, and in the step of selecting one of the cell images, when an input of the keyboard key is accepted The cell image display method according to claim 1, wherein the image of the selected cell is classified according to the classification item assigned to the key. A first database storing cell images obtained by imaging a plurality of cells;
A second database in which position information indicating the position of the cell image in the cell image is stored;
Cell image acquisition means for acquiring a cell image from the first database;
Position information acquisition means for acquiring position information corresponding to the cell image acquired by the cell image acquisition means from the second database;
Display means for displaying the cell image acquired by the cell image acquisition means;
A selection means for selecting one of the cell images included in the cell image displayed by the display means;
Based on the position information acquired by the position information acquisition means, a specifying means for specifying an image of a selected cell in the displayed cell image;
With an input unit,
The cell image display system configured to select a cell image different from the selected cell image when the selection unit receives a predetermined input from the input unit. The cell image display system according to claim 5, wherein the specifying unit is configured to display a mark indicating that the cell is selected at a position of an image of the selected cell in the cell image. The cell image display system according to claim 5, wherein the specifying unit is configured to display a cell image so that an image of the cell selected by the selection unit is located in the center. The input unit has a keyboard provided with a plurality of keys,
The said selection means is comprised so that the image of the cell different from the image of the selected cell may be selected, when the input of the predetermined key of the said keyboard is received. The cell image display system described. A plurality of classification items according to cell types are respectively assigned to a plurality of keys of the keyboard,
The cell image according to claim 8, wherein the selection unit includes a classification unit that classifies an image of a selected cell according to a classification item assigned to the key when an input of the key of the keyboard is received. Display system. The cell image display system according to claim 9, wherein the display unit is configured to display a classification item of the cell image in the vicinity of the cell image classified by the classification unit. The selection means is included in the same line-of-sight movement area as the image of the selected cell when the area displayed by the display means in the cell image is divided into a plurality of line-of-sight movement areas divided in the vertical direction. If at least one of the cell images is not yet selected, select one of the cell images included in the line-of-sight movement area and not yet selected, and the selected cell image and When all of the cell images included in the same line-of-sight movement area are selected, one of the cell images included in the line-of-sight movement area adjacent to the line-of-sight movement area and not yet selected is selected. The cell image display system according to any one of claims 5 to 10, which is configured as described above. The cell image display system according to claim 11, wherein the selection unit is configured to sequentially select images of cells included in one line-of-sight movement region from one side to the other side in the horizontal direction. The cell image display system according to claim 11 or 12, wherein the selection unit is configured to select an image of a cell so as to move the line-of-sight movement region from above to below or from below to above. The cell image display system according to any one of claims 11 to 13, wherein the selection unit is configured to select an image of a cell that is closest to the image of the selected cell. The cell image display system according to any one of claims 11 to 14, wherein the display means is configured to display a dividing line for dividing the line-of-sight movement region so as to be superimposed on the cell image. The first database is provided in a cell image server device that provides a cell image;
The cell image acquisition unit, the display unit, the selection unit, the specifying unit, and the input unit are provided in a cell image display device that receives a cell image from the cell image server device. The cell image display system according to any one of the above. The second database is provided in a location information server device that provides location information,
The cell image display system according to claim 16, wherein the position information acquisition means is provided in the cell image display device. The cell image display device further includes authentication information input receiving means for receiving input of authentication information necessary for user authentication,
The authentication information input receiving means further comprises an authentication means for authenticating the user based on the authentication information received by the input,
18. The cell image and the position information are configured to be provided from the first database and the second database to the cell image display device when the authentication of the user by the authentication unit is successful. Cell image display system. The cell image display system according to claim 5, wherein the cell imaged in the cell image is a blood cell. An image display unit;
An input section;
First receiving means for receiving a cell image obtained by imaging a cell from the outside;
Second receiving means for receiving position information indicating the position of the cell image in the cell image received by the first receiving means from the outside;
Display means for displaying a cell image received by the first receiving means;
A selection means for selecting one of the cell images included in the cell image displayed by the display means;
A specifying unit for specifying an image of a selected cell among the displayed cell images based on the position information received by the second receiving unit;
The cell image display device configured to select a cell image different from the selected cell image when the selection unit receives a predetermined input from the input unit. A computer comprising an image display unit, an input unit having a keyboard provided with a plurality of keys, and a communication unit capable of communicating with the outside,
First receiving means for receiving a cell image obtained by imaging a cell from the outside;
Second receiving means for receiving position information indicating the position of the cell image in the cell image received by the first receiving means from the outside;
Display means for displaying a cell image received by the first receiving means;
A selection means for selecting one of the cell images included in the cell image displayed by the display means;
A computer program for functioning as a specifying means for specifying an image of a selected cell among displayed cell images based on position information received by the second receiving means,
The computer program configured to cause the computer to function so as to select an image of a cell different from an image of a selected cell when an input of a predetermined key of the keyboard is received.

Images