JP2009301485A - Information display system and portable information terminal therewith - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information display system for displaying information on the specific object designated from objects displayed on a display means on an information display means in a different display form, corresponding to the state of the object on a display screen, and a portable information terminal using the information display system. <P>SOLUTION: When an observer displays images shot by an imaging means 1 on a display means 2 and designates a specific object from the images, an extraction means 3 executes the image recognition of the object and gives the information to an object state detection means 4 and retrieval means 5. The object state detection means 4 detects the location, distance and the like of the object. The retrieval means 5 retrieves a database 6 for the name or the like of the object. An information display control means 7 collates information from the object state detection means 4 and the retrieval means 5 with each other. The name is displayed in the vicinity of the object in a size corresponding to the distance of the object, for example. Descriptive text about the object is displayed on information display means 8. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention provides an information display system in which information about a specific object displayed on an information display means is displayed differently according to the size and position of the object, and the information display system. It relates to the adopted portable information terminal.

  Recently, many portable information terminals such as mobile phones and PDAs have built-in photographing devices using an image sensor such as a CCD or can be attached as necessary. On the other hand, although a single digital camera equipped with an information communication system has been realized, it can be said that such a camera is also a kind of portable information terminal. In addition, the photographing devices of these portable information terminals must be connected to a storage means for recording the imaging information photographed by the photographing device, and a separate storage means for recording the imaging information. In any case, an image captured by the image sensor can be observed in real time by a display means (for example, a display device such as a liquid crystal).

  By the way, when using such a portable information terminal and observing an image displayed on the display means, the observer can learn about a specific object (for example, a building or a plant or animal) in the image. You may want to know information (for example, name). Therefore, as a response to such a request, the following Patent Document 1 discloses a position information acquisition unit that detects a current position, a direction information acquisition unit that detects a direction in which an object exists, and a plurality of pieces of position information. Control means for searching for the object database and identifying the object based on the object database storing the information, the current position detected by the position information acquisition means, and the direction detected by the orientation information acquisition means There is disclosed an object specifying apparatus that displays information specified by the control means on a display means. Patent Document 1 also describes that an object database is connected to a portable information terminal through a communication line as an external database.

JP 2001-216309 A

  However, the needs of users (hereinafter referred to as observers) have been diversifying recently, and no matter what state the identified object is placed on the image being observed by the observer, Information about the specific object cannot be satisfied if it is always displayed in the same display format on the information display means.

  Therefore, for example, regarding a specific object, it is required to be able to display not only the name but also an explanation about the object. Also, the display format may be changed depending on the distance to the specific object, the display format may be changed depending on the size of the specific object, or the specific object may be moving or When the viewing angle of the camera is changed, the display format is changed depending on whether the specific object is near the corner or the center of the screen. Is required to be displayed in different display formats corresponding to the size and position of the object.

  The present invention has been made to solve such problems, and the object of the present invention is to specify information about a specific object selected from those displayed on the display means. Information display system that makes it easier for an observer to recognize the information by displaying it on the information display means in a different display format corresponding to the state of the object on the display screen, and the information display It is to provide a portable information terminal adopting the system.

  In order to achieve the above object, an information display system according to the present invention includes a photographing unit, a display unit that displays an image captured by the photographing unit, and at least one specified from images displayed on the display unit. An extraction means for extracting one object, an object state detection means for detecting the state of the object extracted by the extraction means, and a search for searching information relating to the object extracted by the extraction means from a database And information display control means for displaying information on the object searched by the search means on the information display means in correspondence with the state of the object detected by the object state detection means. It is characterized by that.

  In the information display system of the present invention, the search means may be able to search the database for simple information of the object and at least one detailed information more detailed than the simple information. preferable.

  In the information display system of the present invention, the object state detection means can detect at least where the object is on the screen of the display means, and the information display control It is preferable that the means can change the information display format of the object to be displayed on the information display means in correspondence with the position.

  Further, in the information display system of the present invention, the object state detection means can detect at least how large the object is on the screen of the display means, and the information It is preferable that the display control means can change the information display format of the object displayed on the information display means in accordance with the size.

  Further, in the information display system of the present invention, the object state detection means can detect at least a distance from the imaging means, and the information display control means corresponds to the distance, It is preferable that the information display format of the object displayed on the information display means can be changed.

  In the information display system of the present invention, the object state detection means can detect at least a movement amount of the display means on the screen, and the information display control means can detect the movement amount. It is preferable that the information display format of the object displayed on the information display means can be changed.

  In the information display system of the present invention, the object state detection means can detect at least the amount of change of the object on the screen of the display means, and the information display control means It is preferable that the information display format of the object displayed on the information display means can be changed corresponding to the amount of change.

  In the information display system of the present invention, it is preferable that the display means also serves as the information display means.

  Furthermore, the information display system according to any one of claims 1 to 8 is preferably employed in a portable information terminal. In that case, it is more preferable that the portable information terminal is provided with a communication unit, and information related to the object extracted by the extraction unit can be searched from an external database via the communication unit. A portable information terminal is obtained.

  In the information display system of the present invention and the portable information terminal using the information system, information on at least one specific object on the image displayed on the display means corresponds to a state such as the position and size of the object. Since the information is displayed on the information display means in a different display format, the observer can easily recognize information about the object. In addition, when there are a plurality of types of specific objects, it is very easy to identify them by changing the display format depending on the distance or the like. Furthermore, it is possible to obtain timely information corresponding to the amount of change for an object that is moving or whose size has changed.

  The configuration of the embodiment of the present invention will be described with reference to the block diagram shown in FIG. 1, and then the examples will be described with reference to FIGS.

  In FIG. 1, a photographing means 1 has an image pickup device such as a CCD, and displays picked-up image pickup information as an image on a display means 2 composed of a liquid crystal panel or the like in real time. When an observer observes all objects displayed on the screen of the display means 2 and wants to know the name and explanation information (explanation) about the object for a specific object, the extraction means 3 to extract various features of the object.

  There are various methods for extracting a specific object by the extraction means 3. For example, in the case of a building, information on a tower, a building, etc., and in the case of a landscape, information on a mountain, a river, etc. In addition, in the case of animals, in addition to rough information on beasts, birds, etc., specific specific characteristic information such as shape and color of the object is input using a keyboard. When the screen of the display unit 2 is used as a touch panel and a specific object is touched or specified with a cursor, image recognition is performed. Further, the feature of the object may be inputted by voice. However, the extraction means 3 of the present invention does not need to be able to extract objects in all fields, and may be one that can extract only animals, for example.

  The object state detection unit 4 detects in what state the object extracted by the extraction unit 3 is placed on the screen of the display unit 2. And as this object state detection means 4, specifically, in addition to having a position detection means capable of detecting where the extracted object is on the screen, A size detecting means capable of detecting the size of the extracted object on the screen; a distance detecting means capable of detecting a distance from the photographing means to the extracted object; and It has a movement amount detection means capable of detecting the movement amount of the extracted object, a change amount detection means capable of detecting the change amount of the extracted object on the screen, and the like. However, the object state detection means 4 of the present invention does not need to be able to detect all of them, and may have only a position detection means, for example.

  The search means 5 searches the database 6 for information relating to the object extracted by the extraction means 3 and gives the information obtained by the search to the information display control means 7. When the information display system of the present invention is applied to a portable information terminal, the search means 5 and the database 6 are not necessarily provided in the portable information terminal, and the portable information terminal is provided with a communication means. The means 5 and the database 6 are provided outside, and the search means 5 searches the information in the database 6 through the communication means, and the obtained information is given to the information display control means 7 through the communication means. Alternatively, even when the portable information terminal includes the search means 5 and the database 6, information that cannot be obtained from the database 6 may be obtained from an external database via the communication means.

  The information obtained from the database 6 includes simple information and detailed information. In the description of the present invention, the simple information means the object with a relatively small amount of information such as the name of the object. The detailed information is information having a relatively large amount of information such as a commentary on the object. As for detailed information, a plurality of detailed information may be prepared for the same object depending on the difference in the amount of information. However, the present invention is not limited to the one in which simple information and detailed information about one object can be obtained from the database 6 as described above, and only one of them can be obtained. There is no problem. Further, only simple information may be obtained for a certain object, and only detailed information may be obtained for another object.

  The information display control means 7 displays the information searched by the search means 5 on the information display means 8 so as to correspond to the state of the object detected by the object state detection means 4 so as to be easily recognized by the observer. . However, in the present invention, the display unit 2 may be used without providing the information display unit 8. Therefore, in such a case, both simple information and detailed information are displayed on the display means 2. In addition, when the display unit 2 and the information display unit 8 are provided separately, the same display may be performed on both, but in the following, simple information is displayed on the display unit 2. The case where detailed information is displayed on the information display means 8 will be described.

  The information display control means 7 may display both simple information and detailed information from the beginning. However, when the observer does not request display of detailed information from the beginning, only simple information such as a name is displayed. The simple information is displayed on the screen of the display means 2 selected as a specific object while the observer actually observes, and the object detected by the position detection means of the object state detection means 4 Is displayed in the vicinity of. In that case, when the position detection means detects that the object is in a predetermined area of the screen, for example, the center area of the screen, it is determined that the object is the object most watched by the observer, It is possible to display larger than when it is in another area.

  Further, based on the detection result of the size detection means of the object state detection means 4, when there are a plurality of objects having different sizes so as to be displayed in a size corresponding to the size of the object, It is possible to make it easy for the observer to recognize the correspondence between the object and the display. Further, depending on the detection result of the distance detection means of the object state detection means 4, it is possible to make the display smaller for the object far away and to enlarge the display for the object near. Accordingly, when a plurality of objects with different distances are extracted, a stereoscopic effect is given to the observer.

  In addition, when the object is gradually moving from the corner to the center on the screen of the display unit 2, the initial value is small corresponding to the detection result of the movement amount detection unit of the object state detection unit 4. It is possible to display and gradually increase the display according to the amount of movement to the center. Further, when the size of the object is changed, for example, when a balloon is inflated, the object state detection means 4 corresponds to the detection result of the change amount detection means, and is adjusted to the change amount. The display can be changed by gradually increasing the display.

  On the other hand, when it is instructed to display detailed information about a specific object, it is displayed on the information display means 8. In that case, when the object is in a predetermined area on the screen of the display means 2, for example, the center area of the screen, according to the detection result of the position detection means of the object state detection means 4, detailed detailed information (explanation) is provided. When it is displayed and in another area, it is possible to display short detailed information. Therefore, the observer can obtain more detailed detailed information by changing the direction of the photographing means 1 so that the object is located in the central area of the display means 2. Further, depending on the detection result of the distance detection means of the object state detection means 4, for example, when the object is 100 m or more away from the photographing means 1, short detailed information is displayed, and when it is less than 100 m, more detailed detailed information is displayed. Can be displayed.

  In addition, when the object is moving from the corner to the center on the screen of the display means 2, first, short detailed information is displayed corresponding to the detection result of the movement amount detection means of the object state detection means 4. Although it is displayed, it is possible to display long detailed information or add information as it moves to the center. Further, in the case of an object whose shape or pattern changes, the detailed information corresponding to a plurality of change stages is displayed according to the detection result of the change amount detection means of the object state detection means 4. It is also possible.

  Further, as described above, it is also possible for the information display control means 7 to automatically determine and display either simple information or detailed information, instead of the observer selecting and displaying it. It is. For example, corresponding to the detection result of the distance detection means of the object state detection means 4, simple information is displayed when the object is far away, and detailed information is displayed when the object is near, or object state detection Corresponding to the detection result of the position detection means of the means 4, detailed information is displayed when the object is in a predetermined area such as the center of the screen, and simple information is displayed when the object is in another area. If an object is moving across the screen at high speed like an airplane or a car, even if detailed information is displayed, the timing of the object image may not match, so in such cases In this case, it is possible to display only simple information corresponding to the detection result of the movement amount detection means of the object state detection means 4.

  Next, two examples in the case where such an information display system is applied to a portable information terminal will be described with reference to the drawings. The above FIG. 1 is also cited in these descriptions. Moreover, FIG. 2 is a figure for demonstrating the outline | summary of a portable information terminal, but this FIG. 2 is used for description of both the Examples. 3 and 4 are for explaining the first embodiment, and FIGS. 5 and 6 are for explaining the second embodiment.

  The portable information terminal 11 shown in FIG. 2 has a first main body portion and a second main body portion that can be folded with hinges, and of course has a function of communicating with the outside. The first body portion that is substantially upright in FIG. 2 is provided with the camera 11a as the photographing means 1 on the outer surface side, and the first display portion as the display means 2 on the inner surface side. 11b. In addition, the other second main body portion is provided not only for operating the second display portion 11c as the information display means 8 and the information display system of the present invention on the inner surface side, but also as the portable information terminal 11. An operation unit 11d having a plurality of keys necessary for performing various operations is provided, and the above-described extraction means 3, object state detection means 4, search means 5, database 6, information display Various electronic components constituting the control means 7 and the like are attached.

  Among them, the camera 11a is provided with an image pickup device such as a CCD, and can capture a desired field of view by operating the operation unit 11d and display the image on the first display unit 11b in real time. In addition, it can be stored in a built-in storage device as a still image or a moving image.

  In addition, the first display unit 11b is a touch panel, and the observer touches a desired object from the image displayed on the first display unit 11b to touch the desired object. Information can be known. Therefore, the touch panel in this case can be said to be a starting operation means of the extraction means 3 described above. However, in the present invention, after inputting that the object to be specified is, for example, an animal by the operation unit 11d, a specific animal is touched among the plurality of animals displayed on the first display unit 11b. It is also possible to input characteristic information on the screen only with the operation unit 11d regardless of whether the first display unit 11b is a touch panel.

  Further, in the case of the portable information terminal 11, information about the designated object is displayed on the first display unit 11b when the information is simple information, and is displayed on the second display unit 11c when the information is detailed information. To be. However, as described above, in the present invention, the second display unit 11c may be used as the first display unit 11b, and it is necessary to display the information separately on the simple information and the detailed information about the object. Since there is no such thing, the display division in this way is merely an example.

  Then, the usage aspect of the portable information terminal 11 of a present Example is demonstrated. As shown in FIG. 2, in the field of view captured by the camera 11a, there are several tall trees, several shrubs, two elephants on a distant hill, and a pond. There is one river horse, one snake crawling out from the base of the tree on the right side, and two butterflies playing near the shrub on the near side. The first display section 11b of the portable information terminal 11 has It is displayed in real time. At this time, nothing is displayed on the second display portion 11c. The snake is actually smaller and has a posture in which most of the body is in contact with the ground as is well known, but is depicted in a convenient manner on the drawing.

  In this display state, the elephant is far away, so even if it is actually moving, the observer feels that it is moving only slightly, and the river is not moving in the pond. In addition, the butterfly moves but plays only within a certain range, and is not particularly interested as an observer. At this time, the observer was most interested in the snake that crawled from the root of the tree on the right side of the screen. Therefore, the moment when the observer touches the finger 12 with a snake on the screen of the first display unit 11b is the state shown in FIG.

  In this way, when the finger 12 is touched to the snake, the image information of the snake is extracted by the extraction means 3 and the information is given to the object state detection means 4 and the search means 5. Therefore, on the other hand, the position detection means of the above-described object state detection means 4 is located in a predetermined central area A (see FIG. 3) whose snake is preset on the screen of the first display unit 11b. First, it is detected that the current position is in the vicinity of the root of the right tree, and the information is given to the information display control means 7, but such position detection information is continuously given.

  On the other hand, the above-described search means 5 not only extracts the general name that the specific object is “snake” from the database 6 as simple information, but also a more specific unique name, photograph, commentary, etc. Detailed information on the information is extracted and given to the information display control means 7. In this embodiment, the general name is used as simple information and the unique name is described in detail. However, the general name may not be displayed and the unique name may be displayed as simple information from the beginning.

  The information display control means 7 first displays the screen of the first display section 11b in order to indicate that the observer has designated a snake as a specific object by the information obtained from the position detection means of the object state detection means 4. In the above, an “x” mark is displayed in the immediate vicinity of the snake. Then, from the information obtained from the object state detection means 4 and the information obtained from the database 6 via the search means 5, only the simple information is selected because the snake is not in the central area A of the screen, The character “snake”, which is the general name of a snake, is displayed in a standard size near the “x” mark. FIG. 3 shows the display state of the first display unit 11b as described above.

  In this embodiment, nothing is displayed on the second display portion 11c at this time. However, as with the first display unit 11b, the characters “snake” may be displayed. In the present invention, it is not essential to display the “x” mark as described above near the snake as the designation mark, but “x” is displayed on the first display portion 11b as in the present embodiment. "Is displayed, and if only one target is designated, the characters" snake "are displayed only at the corner of the first display unit 11b, or displayed only on the second display unit 11c. You may let them.

  In addition, when an elephant is designated after the snake is designated, the snake designation mark is set to “1”, the elephant designation mark is set to “2”, and the designation mark is displayed on the first display portion 11b. May be displayed, and the characters “snake” and “elephant” may be displayed on the second display portion 11c together with the designation marks.

  By the way, as described above, the elephant, the river horse, and the butterfly are not moved greatly on the screen even if they actually move. However, in the case of a snake, trying to reach the pond, the position on the screen is moved more greatly than other animals. The object state detecting means 4 detects the position of the snake in real time even during the movement. For this reason, the display of “×” and “snake” moves together with the movement of the snake. FIG. 4 shows a state in which the snake has reached the center area A of the screen.

  As shown in FIG. 4 (a), when the object state detection means 4 detects that the snake has reached the center area A of the screen, the information display control means 7 uses the position information to display the information shown in FIG. As shown in b), a snake photograph drawn from the database 6, a unique name, and a specific description are displayed on the second display unit 11c as detailed information. However, the detailed information displayed on the second display unit 11c may be only an explanatory text.

  In the present invention, since the second display unit 11c may be used as the first display unit 11b, in such a case, for example, the second display unit 11c is displayed in a partial area of the first display unit 11b. Only the explanatory text displayed in the part 11c may be displayed. Furthermore, since the present invention does not necessarily display the detailed information in the present embodiment, when the snake enters the central area A, the characters “snake” shown in FIG. The display size may be changed by increasing the size, making it thicker, or changing the color, instead of the same size as the characters “snake” shown in FIG. In short, it is only necessary that the observer's recognition becomes stronger.

  In this way, after the observer sufficiently obtains information about the snake that is the specific object, if the user wants to erase the display of the information from the screen, he / she touches the snake again with the first display unit 11b. Alternatively, the operation of the operation unit 11d cancels the designation of a specific object. When the snake moves and disappears from the screen, the designation is automatically canceled when the snake does not return to the screen after a predetermined time.

  The above description has been made on the assumption that a plurality of objects can be specified on the screen of the first display unit 11b and the information can be displayed simultaneously. The next object may not be designated unless the designation is canceled once.

  Next, the second embodiment will be described with reference to FIGS. 5 and 6. As described above, in the description of the present embodiment, the above-described FIGS. 1 and 2 are used as they are. Therefore, the description about description of those drawings is abbreviate | omitted.

  Also in the case of this embodiment, the observer is most interested in the snake crawling from the right side of the screen, and the moment when the finger 12 first touches the snake on the screen of the first display unit 11b is shown in FIG. It is in the state shown. However, at this time, the river is not moving in the pond, but the elephant and the butterfly are clearly visible, so the observer is also interested in them, and the elephant and butterfly follow the snake. The display state immediately after touching in this order is shown in FIG.

  In this way, when the finger 12 is touched in the order of snake, elephant and butterfly, their image information is extracted in order by the extracting means 3 and the information is given to the object state detecting means 4 and the searching means 5 in order. It is done. Thereby, the snake is detected to be on the right side of the screen by the position detection means of the object state detection means 4, and the standard distance (for example, for example) set in advance by the distance detection means of the object state detection means 4 10 to 50 m). Similarly, the elephant is detected to be above the screen and is detected to be at a preset long distance (for example, 50 m or more), and the butterfly is detected to be to the right of the screen. And a short distance set in advance (for example, 10 m or less) is detected. These pieces of information are given to the information display control means 7.

  Furthermore, since the observer is particularly interested in the snake, not only touching on the screen but also operating the operation unit 11d allows the first display unit 11b to display other elephants and butterflies. Similarly, the simple information is displayed, but the detailed information of the snake is displayed on the second display portion 11c. The information is also given to the object state detection means 4 and the search means 5.

  Therefore, the search means 5 extracts simple information, which is a general name for those objects, from the database 6, and for the snake, extracts information related to a unique image and a specific description, and information display control means 7. To give. In this embodiment, when the operation unit 11d is operated, the search means 5 pulls out detailed information from the database 6. However, the first display unit 11b simply touches a snake, elephant, or butterfly. The detailed information may be extracted, and the information display control means 7 to be described later may select only the detailed information of the snake that operated the operation unit 11d from the detailed information.

  The information display control means 7 first displays the first display in order to indicate that the observer has designated a snake, an image, and a butterfly as a specific object based on information obtained from the position detection means of the object state detection means 4. On the screen of the section 11b, an “x” mark is displayed in the immediate vicinity of those objects. Next, from the information obtained from the position detection means and the distance detection means of the object state detection means 4 and the information obtained from the database 6 via the search means 5, the snake is referred to as a general name “snake”. The character is displayed in a standard size, the elephant is displayed as “Elephant” with a character smaller than “snake”, and the butterfly is displayed as “Cho” with a character larger than “snake”. FIG. 5A shows the screen of the first display unit 11b displayed as described above.

  In the case of the present embodiment, since it is requested to display the detailed information of the snake by the operation of the operation unit 11d, the information display control means 7 displays the detailed information of the snake on the second display unit 11c. Display. The display state is shown in FIG. At this time, the second display unit 11c displays a photograph of the snake drawn from the database 6 and an explanatory text including the unique name. The snake is displayed in the central area on the screen of the first display unit 11b. Since it is not in A (refer FIG.6 (b)) and it exists in the right side position, the explanatory note is comparatively simple.

  The position detection means and distance detection means of the object state detection means 4 still detect the positions and distances of snakes, elephants and butterflies. Therefore, for example, if the elephant is closer than a predetermined distance, the character “Elephant” will also be larger. The size of such characters may change continuously according to the distance, but if an elephant is walking slowly, it will recognize that the size of the characters has changed. Difficult to do. Therefore, if the size is changed step by step as in the present embodiment, the degree of visual impact is greater.

  By the way, in the case of a present Example, the snake which crawls out from the root of the right-side Takagi on the screen of the 1st display part 11b is moving toward the pond where a river horse exists. And the distance with the camera 11a during the movement does not change so much. Therefore, the display of “x” and “snake” described above moves in accordance with the movement of the snake while maintaining the same size as in FIG. FIG. 6 shows a state where the snake has reached the center area A of the screen.

  As shown in FIG. 6A, when the position detecting means of the object state detecting means 4 detects that the snake has reached the central area A on the screen of the first display section 11b, an information display is performed. Based on the position information, the control means 7 changes the explanatory text displayed on the second display unit 11c to a more detailed one as shown in FIG. 6B. In addition, about the change of this display, you may make it change a snake to three steps or more as it approaches the center area | region A of the 1st display part 11b.

  In this way, when the observer wants to delete the display of the information from the screen of the second display section 11c after obtaining the detailed information about the snake sufficiently, the operation section 11d is operated once again. Become. Further, the method of deleting the simple information from the screen of the first display unit 11b and the processing when the specific object is off the screen are the same as in the case of the first embodiment. Furthermore, if it is desired to obtain elephant detailed information instead of the snake, the elephant may be designated in the same manner as the snake after deleting the detailed information of the snake. However, it is also possible to display detailed information on a plurality of objects at the same time by dividing the screen of the second display unit 11c shown in FIG.

  As described above, in this embodiment, the detailed information information is changed depending on whether the size of the simple display is changed according to the distance of the specific object and whether the specific object is in the central area A. Although both cases of changing the amount are described in the case where they can be performed at the same time, in the present invention, only one of them may be performed, and the specific area A may not include the center. . As already described, in addition to the position detection unit and the distance detection unit, the size detection unit, the movement amount detection unit, the change amount detection unit, and the like may be selectively employed as the object state detection unit 4. Absent.

  In each of the above embodiments, the camera 11a is fixed and the snake is moving. However, the snake is caught in the center area A of the screen by changing the shooting direction of the camera 11a. In this case, it goes without saying that the display format is changed in the same manner. Further, in each of the above embodiments, the case where the position detecting unit and the distance detecting unit are used as the object state detecting unit 4 has been described. However, as described with reference to FIG. Is provided with one or more position detecting means, distance detecting means, size detecting means, movement amount detecting means, change amount detecting means, etc. Anything that can change the display format for the object is an embodiment of the present invention.

It is a block diagram for demonstrating the structure of an embodiment. It is a figure for demonstrating the outline | summary of the portable information terminal of an Example. It is a figure for demonstrating the usage example of the portable information terminal of Example 1, Comprising: It is the figure which showed the display state in the 1st display part immediately after designating a specific target object. 4A and 4B are diagrams for explaining a display state after a predetermined time has elapsed in the same field of view as FIG. 3, in which FIG. 4A is a diagram illustrating a display state of the first display unit, and FIG. 2 shows the display state of the display unit. It is a figure for demonstrating the usage example of the portable information terminal of Example 2, Comprising: Fig.5 (a) shows the display state of the 1st display part immediately after designating a specific target object, FIG. 5B shows the display state of the second display unit at that time. FIG. 6A is a diagram showing a display state after a predetermined time has elapsed in the same field of view as FIG. 5, FIG. 6A shows a display state of the first display unit, and FIG. The display state of a display part is shown.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image | photographing means 2 Display means 3 Extraction means 4 Object state detection means 5 Search means 6 Database 7 Information display control means 8 Information display means 11 Portable information terminal 11a Camera 11b 1st display part 11c 2nd display part 11d Operation part 12 Finger A Central area

Claims (10)

Photographing means;
Display means for displaying an image captured by the photographing means;
Extraction means for extracting at least one specific object from the image displayed on the display means;
Object state detection means for detecting the state of the object extracted by the extraction means;
Search means for searching information on the object extracted by the extraction means from a database;
Information display control means for displaying on the information display means information relating to the object searched by the search means in correspondence with the state of the object detected by the object state detection means;
An information display system comprising:   The information display according to claim 1, wherein the search unit is capable of searching the database for simple information of the object and at least one detailed information more detailed than the simple information. system.   The object state detection means can detect at least where the object is on the screen of the display means, and the information display control means corresponds to the position, and The information display system according to claim 1 or 2, wherein an information display format of the object displayed on the information display means can be changed.   The object state detection means can detect at least how large the object is on the image of the display means, and the information display control means corresponds to the size. 4. The information display system according to claim 1, wherein an information display format of the object to be displayed on the information display means can be changed.   The object state detection means can detect at least a distance from the imaging means, and the information display control means corresponds to the distance of the object to be displayed on the information display means. The information display system according to claim 1, wherein the information display format can be changed.   The object state detection means can detect at least the amount of movement of the display means on the screen, and the information display control means displays on the information display means corresponding to the amount of movement. The information display system according to claim 1, wherein the information display format of the object to be changed can be changed.   The object state detection means can detect at least a change amount of the object on the screen of the display means, and the information display control means corresponds to the change amount, and the information display control means The information display system according to any one of claims 1 to 6, wherein an information display format of the object to be displayed on the display means can be changed.   The information display system according to claim 1, wherein the display unit also serves as the information display unit.   A portable information terminal, wherein the information display system according to claim 1 is adopted.   The portable information terminal includes a communication unit, and information related to the object extracted by the extraction unit can be searched from an external database via the communication unit. Item 10. A portable information terminal according to Item 9.

Images