JP6712861B2 - Information processing device, information processing method, and program - Google Patents

Description

The present invention relates to an information processing device or the like that associates a captured image with a code identifier and a character string.

As a conventional technology, a storage location information database is constructed based on the read data of the barcode label attached to the storage location of each product that was read by the barcode reader at the time of storage and is attached to each product. It is known that a product information database is constructed based on the read data of the barcode label. (For example, refer to Patent Document 1).

Japanese Unexamined Patent Publication No. 2000-90180 (page 1, FIG. 1, etc.)

However, in the conventional technique, in order to associate a captured image with a character string and a code such as a barcode and manage the captured image using the character string or the code, There is a problem that it is necessary to associate the code identifier with the code identifier manually, and the association takes time and effort.

The present invention is made to solve the above problems, and provides an information processing device and the like that can easily associate a captured image, a character string, and a code identifier. To aim.

The information processing apparatus of the present invention includes a captured image reception unit that receives a captured image, an acquisition unit that acquires a character string and a code identifier that is a code identifier for the captured image received by the captured image reception unit, and a captured image. And an output unit that outputs the code identifier and the character string acquired by the acquisition unit in association with each other.

With this configuration, the captured image, the character string, and the code identifier can be easily associated with each other.

Further, the information processing apparatus of the present invention further includes, in the information processing apparatus, a shooting unit that shoots a subject and obtains a shot image, and a character string reception unit that receives a character string when shooting using the shooting unit. An information processing device, wherein the captured image reception unit receives the captured image acquired by the imaging unit, and the acquisition unit acquires the character string received by the character string reception unit and a code identifier of a code corresponding to the character string. Is.

With this configuration, the photographed image, the received character string, and the code identifier can be easily associated with each other.

Further, in the information processing device of the present invention, in the information processing device, the acquisition unit further acquires a code corresponding to the character string accepted by the character string acceptance unit, and the output unit is at least one of the character string and the code. It is an information processing apparatus that acquires a captured image in which is arranged.

With this configuration, it is possible to acquire an image in which a character string acquired for this image and a code corresponding to the code identifier acquired for this image are arranged in the captured image.

Further, the information processing apparatus of the present invention includes, in the information processing apparatus, a position specification receiving unit that receives position specification information that is information specifying a position in a captured image of at least one of a character string and a code acquired by the acquisition unit. Further, the output unit is an information processing device that outputs a captured image in which at least one of a character string and a code is arranged at the position indicated by the position designation information.

With such a configuration, it is possible to specify the position where the character string or code is arranged as a desired position or change the arrangement by the position specifying information.

Further, the information processing apparatus of the present invention is the information processing apparatus, further comprising a character string storage unit that stores a plurality of character strings, and the character string reception unit is a plurality of character strings stored in the character string storage unit. The information processing apparatus receives one or more character strings selected by the user.

With this configuration, it is possible to select a character string to be associated with a captured image from character strings prepared in advance.

Further, in the information processing apparatus of the present invention, in the information processing apparatus, the captured image reception unit receives a captured image having one or more character string images, and the acquisition unit includes the captured image received by the captured image reception unit. Is an information processing device that performs character recognition on an image of a character string and acquires the character string.

With this configuration, a character string associated with this image can be obtained from the captured image.

Further, in the information processing apparatus of the present invention, in the information processing apparatus, the captured image reception unit receives a captured image having one or more code images, and the acquisition unit includes one of the captured images received by the captured image reception unit. It is an information processing device that recognizes a code image and acquires a code identifier corresponding to the code.

With such a configuration, it is possible to acquire the code identifier associated with this image from the captured image.

Further, the information processing device of the present invention is the information processing device according to the above information processing device, wherein the acquisition unit generates and acquires a code identifier using the character string acquired for the captured image received by the captured image reception unit. ..

With this configuration, it is possible to automatically acquire the code identifier associated with the captured image from the character string acquired for the captured image.

Further, in the information processing apparatus of the present invention, in the information processing apparatus, the output unit associates the captured image, time information that is time information regarding the captured image, and the code identifier and the character string acquired by the acquisition unit. This is an information processing device that is attached and output.

With this configuration, the captured image can be managed in association with the time information.

Further, in the information processing device of the present invention, in the information processing device, the captured image is an image of a building site, and at least one of a code identifier and a character string acquired by the acquisition unit is an identifier of the building site. It is a site identifier, and the output unit is an information processing device that outputs the captured images by arranging them in time series for each site identifier associated with the captured image using the time information associated with the captured image. ..

With such a configuration, the shot images can be arranged in time series for each site identifier and output.

Further, the information processing device of the present invention is the information processing device according to the above information processing device, wherein the site identifier is an identifier for individually specifying a plurality of places of one construction site.

With this configuration, it is possible to output an image taken at a construction site for each place.

Further, in the information processing device of the present invention, in the information processing device, the site identifier is an identifier having a floor identifier for identifying a plurality of floors of one building site and a group identifier for identifying one building site. Is further provided with an identifier receiving unit that receives one group identifier, or one or more groups of one group identifier and one floor identifier, the output unit, when the identifier receiving unit receives the one group identifier, When the captured images associated with the received site identifier having the one group identifier are arranged in a time series and output, and the identifier receiving unit receives the set of the one group identifier and the one floor identifier, the reception is performed. It is an information processing apparatus that outputs, in a time series, captured images associated with a site identifier having a group identifier and a floor identifier of another set.

With this configuration, it is possible to appropriately output the captured image for each building site or each floor of the building site.

Further, in the information processing device of the present invention, in the information processing device, the site identifier is a group identifier that identifies one building site, a floor identifier that identifies each of a plurality of floors of the one building site, and a floor Area identifiers for specifying a plurality of areas, respectively, and the identifier accepting unit includes one or more group identifiers, one or more groups of one group identifier and one floor identifier, or one group. An identifier, one floor identifier, and one or more pairs of area identifiers are received, and the output unit, when the identifier reception unit receives one or more group identifiers, a site identifier having one or more received group identifiers. When the captured images associated with each other are arranged in time series and output, and the identifier receiving unit receives one or more groups of one group identifier and one floor identifier, one group identifier of each received group And a photographed image associated with a site identifier having one or more floor identifiers, respectively, are arranged in time series for each floor identifier and output, and the identifier accepting unit generates one group identifier and one floor identifier. In the case of accepting a group with the area identifier, the captured image associated with the site identifier having the group identifier, floor identifier, and area identifier of the accepted group is arranged in time series and output. ..

With such a configuration, the captured image can be appropriately output for each building site, each floor of the building site, or each area of the floor of the building site.

According to the information processing apparatus and the like according to the present invention, it is possible to easily associate a photographed image, a character string, and a code identifier.

Block diagram of an information processing apparatus according to Embodiment 1 of the present invention Flowchart explaining the operation of the information processing apparatus The figure which shows the character string management table of the same information processing equipment The figure which shows the example of a display of the same information processing apparatus The figure which shows the example of a display of the same information processing apparatus The figure which shows the display example of the picked-up image of the information processing apparatus (FIG. 6A), and the figure which shows an example of a color code (FIG. 6B). FIG. 7A is a diagram for explaining an operation of changing the code position of the information processing apparatus (FIG. 7A), and a diagram showing a state immediately after the operation is finished (FIG. 7B). The figure which shows the picked-up image which the same information processing apparatus acquired. The figure which shows the image management table of the same information processing apparatus The figure which shows the example of a display of the same information processing apparatus The figure which shows the example of a display of the same information processing apparatus The figure which shows the example of a display of the same information processing apparatus Block diagram of an information processing apparatus according to Embodiment 2 of the present invention Flowchart explaining the operation of the information processing apparatus FIG. 15A is a diagram showing a photographed image photographed by the information processing apparatus and FIG. 15B is a diagram showing images of character strings and codes recognized in the photographed image. The figure which shows an example of a structure of the computer system in the same embodiment.

Hereinafter, embodiments of an information processing apparatus and the like will be described with reference to the drawings. It should be noted that, in the embodiments, the components denoted by the same reference numerals perform the same operation, and thus the repeated description may be omitted.

(Embodiment 1)
FIG. 1 is a block diagram of the information processing device 1 according to the present embodiment.

The information processing device 1 includes a photographing unit 101, a display unit 102, a character string storage unit 103, a character string reception unit 104, an acquisition unit 105, a position designation information reception unit 106, a photographed image reception unit 107, an image storage unit 108, and an identifier reception. The unit 109 and the output unit 110 are provided.

The information processing device 1 is realized by, for example, a dedicated device, a portable computer, a tablet terminal, a multifunctional mobile phone terminal such as a so-called smartphone, or a mobile information terminal.

The photographing unit 101 photographs a subject and acquires a photographed image. The captured image is a captured image. The subject is an object to be photographed. The subject may be one or more objects to be photographed, a part thereof, or the like, and may be considered as a region to be photographed, a photographing range, or the like. The subject photographed by the photographing unit 101 does not matter. The subject may be, for example, the scene. A site is a place where one or more things, work, etc. are performed. The site is, for example, a construction site or a construction site. The subject may be part of a construction site. For example, the subject may be a single-storey floor having one floor or one floor of a construction site of a building such as a high-rise building having two or more floors. Further, the subject may be, for example, a partial area of one floor. The area in this case may be considered as a section. The partial area of one floor may be, for example, one room or a corridor.

The photographing unit 101 may acquire a photographing candidate image, which is a photographing candidate image, by photographing at the time of photographing, for example. The time of photographing is, for example, a time during which a photographed image can be photographed. The time of shooting is, for example, a period including a time of shooting (for example, a time of releasing a shutter) and a time before or after the time of shooting. The time before or after the time of shooting may be considered as the time before or after the time of shooting, for example, after the shooting unit 101 is ready to shoot. At the time of shooting, it may be considered as a shooting period in which shooting is performed. For example, the photographing unit 101 starts photographing a candidate image for photographing when it becomes possible to photograph a photographed image in response to an instruction from a user or the like. In addition, for example, the photographing unit 101 ends the photographing of the photographing candidate image when the photographed image cannot be photographed in response to an instruction from the user or the like. The shooting candidate image is an image used as a candidate for determining a subject and a shooting range of the subject. The shooting candidate image is, for example, a monitor image that is an image shot to monitor the shooting range. Further, the shooting candidate image may be considered as an image displayed for confirming or determining the shooting range, the shooting angle, and the like, for example. The shooting candidate image is usually a moving image, but may be a still image. For example, it may be a plurality of still images that are continuously captured at a predetermined fixed or indefinite timing.

The image capturing unit 101, for example, when an instruction to perform image capturing is received from an operation receiving unit (not shown) or the like, performs image capturing and acquires a captured image. The process in which the image capturing unit 101 acquires one captured image may be considered as, for example, a process in which data of captured images to be accumulated is acquired. The image capturing unit 101 may acquire one of the image capturing candidate images as a captured image, or may perform image capturing separately from the image capturing candidate images to acquire a captured image. The photographed image is usually an image having more pixels than the photographed candidate image. Usually, when one shooting candidate image is displayed, the shot image acquired by shooting and this one shooting candidate image are images shot in the same shooting range. However, there may be cases where the images are not taken in the same shooting range due to shooting time lag or the like. Note that the configuration in which the image capturing unit 101 acquires a captured image and a candidate image for capturing by capturing is a technique known as a technique such as a so-called live view of a normal digital still camera or an electronic viewfinder, for example. Detailed description is omitted here.

The image capturing unit 101 can be realized by, for example, a digital still camera including an image sensor such as CCD or CMOS, a camera such as a video camera, or a camera module.

The file format of the captured image does not matter. The captured image is usually a still image, but it may be a moving image. The captured image may be a monochrome image or a color image. The number of pixels and the resolution of the captured image do not matter.

The image capturing unit 101 may acquire information on the time of capturing the captured image from a clock (not shown), an NTP (Network Time Protocol) server (not shown), or the like.

The display unit 102 displays the image capturing candidate images captured by the image capturing unit 101. The display unit 102 displays the shooting candidate image on, for example, a monitor (not shown). The display unit 102 displays a shooting candidate image when the shooting unit 101 shoots a shot image, for example. For example, the display unit 102 displays the shooting candidate image before or after shooting the shot image. The display unit 102 displays shooting candidate images for monitoring shooting, for example.

Further, instead of displaying the shooting candidate image, or in addition to displaying the shooting candidate image, the display unit 102 displays a shot image shot by the shooting unit 101 (for example, immediately after) on a monitor (not shown) or the like. You may make it display on. The captured image displayed on the display unit 102 after capturing may be considered a so-called preview image.

The display unit 102 may display, for example, a plurality of character strings stored in the character string storage unit 103 as candidates for a character string associated with a captured image. For example, the display unit 102 may display a list menu or the like for selecting a plurality of character strings stored in the character string storage unit 103. For example, the display unit 102 may display a list menu or the like having a plurality of list items in which a plurality of character strings stored in the character string storage unit 103 are arranged. Further, the display unit 102 may display such a character string candidate while displaying a shooting candidate image or while displaying a shooting image. The display unit 102 may display, for example, a plurality of character strings, for example, a list menu or the like, on the shooting candidate image (or on the shooting image) in an overlapping manner. When overlapping, the images may be combined so that the transparency is not 0%. The display unit 102 may display, for example, a candidate for such a character string, for example, a list menu for selecting a character string, according to a user's instruction received by an operation reception unit or the like (not shown).

The code is, for example, a one-dimensional code such as a bar code, a two-dimensional code such as a QR code (registered trademark), or a color code. The color code is, for example, a code in which an array of a plurality of colors is associated with arbitrary information. The color code may be called, for example, a color barcode or a chameleon code. The code according to the present embodiment may be considered to mean, for example, an image of the code. The code may be thought of as, for example, a pattern image that represents information. The information associated with the code can be read from the code. The information associated with the code is, for example, a code identifier. The code identifier may be considered as information embedded in the code. The code identifier is read from the code by performing a predetermined process or the like, for example. The code identifier is composed of, for example, one or more characters. The code identifier is, for example, an abbreviation or symbol represented by one or more characters. The letters here may be considered to include numbers and the like. Since the color code is a known technique, detailed description thereof is omitted here. For the color code, refer to Patent Document 2 below, for example. Patent Document 2: Japanese Patent Application Laid-Open No. 2010-033034 (page 1, FIG. 1, etc.).

The display unit 102 may display, for example, a captured image in which a character string or code acquired by the acquisition unit 105, which will be described later, is arranged when the captured image is captured. For example, the display unit 102 displays a shooting candidate image in which a character string or code acquired by the acquisition unit 105 described later is arranged at a position designated by default. For example, the display unit 102 displays a character string or code acquired by the acquisition unit 105, which will be described later, specifically, an image of the character string or code at the position indicated by the position specification information received by the position specification information reception unit 106 described below. Display the placed shooting candidate images. In addition, the display unit 102 displays a plurality of character strings stored in the character string storage unit 103 on a captured image, or a captured image in which the character strings and codes acquired by the acquisition unit 105 are arranged, as in the above. May be displayed at the position indicated by the position designation information, the position designated by default, or the like.

In addition, when the character string or the code is already arranged in the photographing candidate image or the photographed image, the position designation information receiving unit 106, which will be described later, outputs the position designation information to at least one of the character string and the code. When receiving, the display unit 102 may display a shooting candidate image in which at least one of the character string or the code for which the position designation information is received is arranged at the position indicated by the position designation information. In this way, the display unit 102 may change the arrangement of character strings and codes.

The display unit 102 may display the captured image captured by the capturing unit 101 immediately after capturing the captured image instead of displaying the captured candidate image or in addition to displaying the captured candidate image. For example, the display unit 102 displays the captured image on a monitor (not shown) or the like.

The display 102 may or may not include a display device. The display unit 102 can be realized by driver software of a display device or driver software of a display device and a display device.

The character string storage unit 103 stores a plurality of character strings. For example, the character string storage unit 103 stores a plurality of character strings that are candidates for the character string associated with the captured image. For example, the character string storage unit 103 stores a plurality of character strings that are candidates for character strings related to the subject of the captured image. For example, the character string storage unit 103 stores a plurality of character strings that are candidates for the character string indicating the subject of the captured image.

The character string storage unit 103 stores a plurality of character strings that are candidates for the character string associated with the subject photographed by the photographing unit 101. For example, when the subject imaged by the imaging unit 101 is a building site, the plurality of character strings stored in the character string storage unit 103 are, for example, a plurality of character strings that specify the location of the building site imaged by the imaging unit 101. May be a candidate. The character string that identifies the location of the building site may be considered as information that identifies a region within the building site, for example. It is preferable that the character string that identifies the place of the construction site is, for example, information of the character string that is described in a natural language or the like that allows the user to understand the place instead of a symbol or the like. The character string stored in the character string storage unit 103 is, for example, a character string accumulated in advance by the user or the like.

The character string stored in the character string storage unit 103 may be, for example, a character string downloaded and accumulated by a receiver (not shown) or the like from a server or the like (not shown) via a network or the like. Further, it may be a character string input by the user from the character string receiving unit 104 or the like described later.

The character string storage unit 103 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. The same applies to other storage units.

The character string acceptance unit 104 accepts a character string at the time of shooting using the shooting unit 101. Accepting at the time of shooting may be considered as receiving a character string while the display unit 102 displays a shooting candidate image, or immediately after shooting and while displaying a shooting image, for example.

The character string accepted by the character string acceptance unit 104 is, for example, a character string accepted for a captured image captured by the imaging unit 101. For example, the character string accepted by the character string accepting unit 104 may be a character string accepted for a captured image taken by the imaging unit 101 after accepting the character string, or an image captured by the imaging unit 101 immediately before accepting the character string. It may be a character string received for the image. The character string received for the captured image may be considered as a character string associated with the captured image or a character string associated with the captured image. The character string received for the captured image may be, for example, the title of the captured image or a comment or the like for the captured image. The character string received for the captured image may be, for example, a character string corresponding to the subject captured in the captured image (for example, a character string related to the subject). The character string corresponding to the subject captured in the captured image is, for example, a character string indicating the name of the subject or a comment for the subject. When the captured image is, for example, a captured image of one place, the character string accepted by the character string reception unit 104 is, for example, a captured place of the captured image or a character string indicating a place to be a subject, such as a place. It may be a character string indicating "" or a symbol such as an abbreviation indicating a place.

It does not matter how the character string receiving unit 104 receives the character string. For example, the character string receiving unit 104 may receive a character string input via an input device such as a keyboard or a microphone (not shown). The character string input via the microphone is, for example, a character string acquired by voice recognition from the voice input with respect to the microphone.

The character string receiving unit 104 may receive, for example, one or more character strings selected by the user from the plurality of character strings stored in the character string storage unit 103. For example, the character string receiving unit 104 selects one or more character strings selected by the user from among a plurality of character strings that are candidates for the character string stored in the character string storage unit 103 and are associated with the captured image. You may accept it. For example, when the operation of selecting one or more character strings of the plurality of character strings stored in the character string storage unit 103 displayed as a character string candidate by the display unit 102 as described above is accepted. Alternatively, the selected character string may be accepted. For example, when the display unit 102 displays a list menu or the like for selecting a plurality of character strings stored in the character string storage unit 103 as described above, an operation reception unit or the like (not shown) When the user receives an operation of selecting one or more list items of the displayed list menu (for example, an operation of clicking or tapping the list item), the character string receiving unit 104 makes this selection. A character string corresponding to the selected list item may be accepted. Note that a configuration for displaying a list menu in which a plurality of character strings are arranged, a configuration for receiving an operation for selecting one or more list items of the list menu, and the like are known techniques, and thus detailed description thereof will be omitted.

The acceptance of the character string here is acceptance of information input from an input device such as a keyboard, a mouse, or a touch panel. Any means such as a ten-key pad, a keyboard, a mouse, or a menu screen may be used as a character string input means. The character string acceptance unit 104 can be realized by a device driver of input means such as a ten-key pad or a keyboard, control software for a menu screen, or the like.

The acquisition unit 105 acquires a character string for the captured image received by the captured image reception unit 107. The character string that the acquisition unit 105 acquires for the captured image is, for example, a character string that identifies the captured image, a character string that indicates the captured image, or a character string that corresponds to the captured image. The acquisition unit 105 acquires, for example, a character string received by the character string reception unit 104 during shooting using the shooting unit 101, for a shot image taken by the shooting unit 101 and received by the shot image reception unit 107 during this shooting. ..

Further, the acquisition unit 105 acquires a code identifier that is a code identifier for the captured image received by the captured image reception unit 107. The code identifier acquired by the acquisition unit 105 is, for example, the code identifier acquired by the acquisition unit 105 for the character string acquired above. The character string acquired by the acquisition unit 105 above is, for example, the character string received by the captured image reception unit 107. The code identifier acquired by the acquisition unit 105 for the character string is, for example, a code identifier acquired using the character string or a code identifier corresponding to the character string. The acquisition unit 105 acquires, for example, a code identifier corresponding to the character string acquired above from a plurality of sets of a character string stored in advance in the character string storage unit 103 or a storage unit (not shown) and a code identifier. May be. The character string stored in advance here is, for example, the character string stored in the character string storage unit 103. For example, the character string storage unit 103 may further store code identifiers associated with each of the plurality of character strings described above, and among the plurality of character strings according to the user's selection as described above. When the character string reception unit 104 receives one or more character strings, the acquisition unit 105 may acquire the code identifier corresponding to the one or more character strings from the character string storage unit 103. Further, for example, the acquisition unit 105 may acquire the code identifier corresponding to the character string from the character string acquired above by using a predetermined algorithm or the like. The predetermined algorithm is, for example, a hash function. Further, the acquisition may be performed by converting the character string using a conversion table or the like prepared in advance for converting the character string into the symbol that constitutes the identifier.

For example, when the captured image received by the captured image receiving unit 107 is an image of a site such as a building site, or when the character string acquired from the captured image is a character string indicating the location of the building site, The code identifier acquired by the acquisition unit 105 may be an identifier of a construction site (hereinafter referred to as a site identifier).

The site identifier is, for example, an identifier that can identify one or more construction sites. For example, the site identifier is a name of the building site, information including the address of the building site, or a character string assigned to the building site. This character string may include numbers and symbols.

The site identifier is, for example, an identifier that can individually specify a plurality of places on one building site. For example, the site identifier is a name of a plurality of places on one building site or a character string assigned to each of the plurality of places.

The site identifier may be, for example, an identifier that includes a group identifier that identifies one construction site and a floor identifier that identifies a plurality of floors of the one construction site. The group identifier is, for example, an identifier that can identify the building as described above. For example, the group identifier is a name of a construction site or a character string such as a symbol assigned to the construction site. The name of the construction site is, for example, the name of a building such as an apartment name or a building name. Further, the name of the building site may be the address of the building site or the like. The floor identifier is a character string such as a floor name (for example, first floor, second floor, etc.) or a symbol assigned to the floor. This character string may include numbers and symbols. For example, in the site identifier, the first p characters (p is an integer of 1 or more) is a character string (for example, a symbol) representing each site, and the next q characters (q is an integer of 1 or more) are The total number of characters that is a character string (for example, a symbol) representing the floor is an identifier of p+q characters or more.

In addition, the site identifier is, for example, a group identifier that identifies one building site, a floor identifier that identifies each of a plurality of floors that the one building site has, and a plurality of areas within the plurality of floors that the one building site has. And area identifiers that respectively specify the area identifiers. The area identifier is, for example, a name of the area (for example, room 103, living room, first conference room, etc.) or a character string such as a symbol assigned to the area. This character string may include numbers and symbols. For example, in the site identifier, the first p characters (p is an integer of 1 or more) is a character string (for example, a symbol) representing each site, and the next q characters (q is an integer of 1 or more) are It is a character string that represents a floor (for example, a symbol), and the next r characters (r is an integer equal to or greater than 1) is a character string that indicates an individual area (for example, a symbol). The total number of characters is p+q+r or more identifiers. ..

The code identifier acquired by the acquisition unit 105 may be a code identifier associated with a site identifier by information having a plurality of sets of code identifiers and site identifiers (not shown). In such a case, It may be considered that the code identifier substantially acquired by the acquisition unit 105 is the site identifier.

Although the case where the code identifier is the site identifier has been described here, when the captured image is, for example, a captured image of a construction site, the character string received by the character string reception unit 104 is the site identifier. May be. That is, the site identifier may be acquired as a character string corresponding to the captured image.

The code identifier acquired by the acquisition unit 105 may be a code identifier that is randomly generated or randomly acquired from two or more code identifiers stored in a storage unit (not shown).

The code identifier acquired by the acquisition unit 105 may be a code identifier input by a user or the like via an operation reception unit or the like (not shown).

The acquisition unit 105 may further acquire the code corresponding to the code identifier acquired above. The code acquired here may be considered as an image of the code. For example, the acquisition unit 105 may acquire the code corresponding to the code identifier acquired above from one or more pairs of code identifiers and codes stored in advance in a storage unit (not shown). Further, the acquisition unit 105 stores in advance the information having one or more groups of a character string, a code identifier, and a code corresponding to the code identifier in the character string storage unit 103, When acquiring the code identifier corresponding to the character string acquired above from this information, the code corresponding to the acquired character string may be further acquired. The acquisition unit 105 may acquire the code by generating a code corresponding to the code identifier acquired above. The acquisition unit 105 also stores, for example, a code identifier stored in advance in a storage unit (not shown) and a parameter for generating the code (for example, when the code is a color code, information indicating the color arrangement of the code). The code may be acquired by acquiring a parameter for generating a code corresponding to the code identifier acquired above from one or more sets and generating a code using this parameter. Note that the configuration for obtaining a code such as a one-dimensional code, a two-dimensional code, or a color code from the code identifier is a known technique, and therefore will be omitted here.

Note that the acquisition unit 105 uses one code corresponding to the character string acquired by the acquisition unit 105 from one or more codes (for example, code images) stored in advance in the storage unit (not shown) in association with the character string. After acquiring, the code identifier acquired by reading this code may be acquired as the code identifier for the captured image.

When the acquisition unit 105 acquires the character string or the code, the display unit 102 sets the shooting candidate image (or the captured image) in which the character string or the code is arranged at the position designated by default or as described later. You may make it display on the position etc. which the position designation information shows.

Further, when the output unit 110, which will be described later, arranges the code in the captured image and does not output the code, the acquisition unit 105 does not have to acquire the code.

The position designation information receiving unit 106 receives the position designation information. The position designation information receiving unit 106 receives position designation information from, for example, a user via an input device (not shown) or the like. The position designation information is information that designates the position in the captured image of at least one of the character string and the code acquired by the acquisition unit 105. The position designation information is, for example, information that designates or specifies coordinates in the captured image. In addition, the position designation information may be information that designates an area in the captured image of at least one of the character string and the code acquired by the acquisition unit 105. For example, the information designating the area is, for example, information designating any one of the four sides (for example, the lower side, the right side, etc.) of the photographed image, or any one of the four corners (the upper right corner, the lower left corner, etc.). May be. For example, the position designation information receiving unit 106 may individually receive the position designation information for each of the character string and the code, or may receive the position designation information for the set of the character string and the code.

The position designation information reception unit 106 receives position designation information for a character string or a code. Receiving position specification information for one character string or code means, for example, receiving position specification information specifying the position where one character string or code is placed, or moving one character string or code. It may be considered that the position designation information designating the destination is accepted. The character string or code that has received the position specification information is, for example, a character string or code to be placed at the position indicated by the position specification information, or a character string or code that is moved to the position indicated by the position specification information. .. The position designation information accepting unit 106 may accept position designation information for a character string or code whose position is already determined, and for a character string or code whose position is not designated, position You may accept designated information. For example, the position designation information receiving unit 106 may receive the position designation information for a character string or a code already arranged on the shooting candidate image (or the shot image) displayed by the display unit 102. The position designation information may be received for the character string or code to be arranged on the shooting candidate image (or the shooting image) displayed by. The character string or code to be arranged is, for example, a character string received by the character string reception unit 104 or a character string or code acquired by the acquisition unit 105.

For example, when the position designation information receiving unit 106 receives an operation for designating a position on the shooting candidate image displayed by the display unit 102, the position designation information receiving unit 106 receives position designation information indicating a position on the shot image corresponding to this position. The operation of designating the position includes, for example, an operation of selecting a character string or a code for which the position is designated, and an operation of clicking one location on the shooting candidate image displayed by the display unit 102 (the display unit 102: In the case of having a touch panel, for example, a combination with a drag operation), or an operation of dragging a character string or a candidate already arranged on a shooting candidate image to a designated position. The same applies to the case where the captured image is displayed on the display unit 102 instead of the captured candidate image.

For example, when the position designation information accepting unit 106 accepts an operation of designating a position on the shooting candidate image displayed by the display unit 102, the shooting images taken before and after the shooting candidate image is displayed The position designation information is received such that the image and the position indicated by the position designation information have the same positional relation between the shooting candidate image and the position designated by the position designation operation. For example, the position designation information reception unit 106 receives coordinate designation information that designates coordinates on a captured image corresponding to coordinates on the captured candidate image designated by the user. The corresponding coordinates are, for example, the coordinates in which the size ratio between images is corrected. It should be noted that the position designation information receiving unit 106 receives information indicating the position designated by the user on the shooting candidate image as position designation information, and the output unit 110, which will be described later, and the like on the shooting image corresponding to the shooting candidate image, Information indicating the position corresponding to this position designation information may be acquired using this position designation information. It should be noted that this also applies to the case where the shooting candidate image is replaced with the shooting image.

Further, for example, when the position designation information receiving unit 106 receives an operation for designating the position on the captured image displayed by the display unit 102, the position designation information indicating the designated position on the captured image (for example, (Coordinates, etc.) is accepted.

Further, the position designation information receiving unit 106 may receive the position designation information from a menu or the like. Further, the position designation information reception unit 106 may receive a numerical value or the like indicating coordinates, which is the position designation information, via an input device or the like.

Any means such as a keyboard, a mouse, a touch panel, or a menu screen may be used as the input means of the position designation information. The position designation information accepting unit 106 can be realized by a device driver of input means such as a keyboard or a touch panel, control software for a menu screen, or the like.

When the position designation information receiving unit 106 receives the position designation information for at least one of the character string and the code, the display unit 102 displays at least one of the character string and the code for which the position designation information is received. You may make it display the imaging|photography candidate image (or imaging|photography image) arrange|positioned at the position which this position designation|designated information shows. For example, when the shooting candidate image (or the shooting image) in which at least one of the character string and the code is already displayed is displayed on the monitor (not shown) by the display unit 102, the position with respect to at least one of the character string and the code is displayed. When the designation information receiving unit 106 receives the position designation information, the display unit 102 moves the at least one of the character string and the code to the position indicated by the received position designation information and places the shooting candidate image (or the shot image). May be displayed.

The captured image receiving unit 107 receives a captured image. The captured image receiving unit 107 receives, for example, a captured image acquired by the capturing unit 101. The captured image receiving unit 107 may be, for example, an interface that receives a captured image, a connector, or the like. Further, for example, when the image capturing unit 101 is a so-called image capturing module or the like, the captured image receiving unit 107 may be considered as a processing unit or the like that receives a captured image output from the image capturing module.

The captured image receiving unit 107 may store the received captured images in a storage unit (not shown) or the like. Further, the captured image receiving unit 107 may further acquire time information regarding the captured image received from the capturing unit 101. Here, the time information regarding the captured image is referred to as time information. The time here may have information such as year and date. The time information is, for example, the time when the image was captured or the time when the captured image was accepted. The time information may be considered as information on the shooting time. For example, when the captured image receiving unit 107 receives a captured image, the captured image receiving unit 107 may obtain time information received from the image capturing unit 101 as time information from a clock, an NTP server, or the like (not shown). Further, the captured image receiving unit 107 may receive, as the time information, the time information acquired from a clock or the like (not shown) when the capturing unit 101 acquires the captured image, together with the captured image.

In addition, although the case where the information processing apparatus 1 has the imaging unit 101 has been described in the present embodiment, in the present invention, the information processing apparatus 1 does not have the imaging unit 101 and an external The captured image accepting unit 107 may accept the captured image acquired by the capturing unit corresponding to the capturing unit 101. Reception in this case is a concept including reception. Further, in this case, a shooting candidate image acquired by a shooting unit (not shown) corresponding to the external shooting unit 101 may be received by an operation reception unit or the like (not shown).

The image storage unit 108 stores one or more captured images. For example, the image storage unit 108 stores the captured image received by the captured image reception unit 107. For example, the image storage unit 108 stores a captured image output by the output unit 110 described later. The captured image output by the output unit 110 is, for example, a captured image in which at least one of the code and the character string acquired by the acquisition unit 105 described above for the captured image is arranged with respect to the captured image received by the captured image reception unit 107. It is an image. The captured image output by the output unit 110 will be described later.

The image storage unit 108 stores one or more captured images in association with the code identifier and the character string acquired by the acquisition unit 105 for the captured images. For example, the image storage unit 108 stores one or more pieces of information having a set of a captured image, a code identifier acquired by the acquisition unit 105 for this captured image, and a character string acquired by the acquisition unit 105 for this captured image. To be done. The code identifier and the character string acquired for the captured image are, for example, the character string received by the character string reception unit 104 and acquired by the acquisition unit 105 when the captured image is captured, and the code identifier acquired by the acquisition unit 105.

Further, the image storage unit 108 may further store one or more captured images in association with time information. The time information is, for example, information indicating the time when the captured image was captured. The time information is, for example, information on the time acquired by the image capturing unit 101 from a clock or the like (not shown) when capturing a captured image. The time information may be, for example, information on the time when the captured image receiving unit 107 receives the captured image. The time information may be time information acquired by the output unit 110 or the like using a clock or the like (not shown) when the captured images are stored in the image storage unit 108.

When the output unit 110 does not store captured images and the like in the image storage unit 108, the image storage unit 108 may be omitted.

The identifier receiving unit 109 receives information for designating one or more code identifiers or character strings. The code identifier or character string is, for example, the code identifier or character string acquired for the captured image. When the code identifier or the character string is the site identifier, the information for designating the code identifier or the character string may be, for example, the information for designating the site identifier. The information for designating the code identifier or the character string is, for example, one or more code identifiers themselves or the character string itself. The information for specifying the code identifier or the character string is, for example, at least one set of a group identifier, a floor identifier, and an area identifier. For example, the identifier receiving unit 109 may receive one group identifier as the information for specifying the code identifier or the character string. Further, the identifier receiving unit 109 is configured to receive one or more sets of one group identifier and one floor identifier as the information for designating the code identifier or the character string, for example. Is also good. Further, the identifier receiving unit 109 is configured to receive, as the information for specifying the code identifier or the character string, for example, one or more groups of one group identifier, one floor identifier, and one area identifier. Is also good.

The identifier accepting unit 109 may accept the site identifier associated with this code, for example, by reading one code associated with the site identifier.

Information for designating one or more code identifiers or character strings, for example, an input means such as a group identifier, a floor identifier, an area identifier, or the like may be anything such as a keyboard, a mouse, a touch panel, or a menu screen. The identifier receiving unit 109 can be realized by a device driver of input means such as a keyboard or a touch panel, control software for a menu screen, or the like.

The output unit 110 outputs a captured image. For example, the output unit 110 outputs the captured image received by the captured image reception unit 107. For example, the output unit 110 may output the captured image received by the captured image reception unit 107 and the code identifier and the character string acquired by the acquisition unit 105 for this captured image in association with each other.

The output unit 110 outputs, for example, the captured image received by the captured image reception unit 107, the time information regarding the captured image, the code identifier and the character string acquired by the acquisition unit 105 for the captured image in association with each other. You may. For example, the output unit 110 may store the time information, the captured image, the code identifier, and the character string in the image storage unit 108 in association with each other. The output unit 110 acquires, for example, time information that is time information regarding the captured image, and associates the time information, the captured image, and the code identifier and the character string acquired by the acquisition unit 105 for the captured image with each other. May be output. The output unit 110 captures, for example, the time information received by the captured image receiving unit 107 from the image capturing unit 101 together with the captured image and the time information acquired by the captured image receiving unit 107 when the captured image is received, as described above. It is acquired from the image reception unit 107 or the like and output. In addition, the output unit 110 provides time information indicating the time when the captured image is acquired from the captured image receiving unit 107, the time when the captured image in which codes and character strings are arranged as described later is acquired, and the like from a clock (not shown) or the like. You may acquire and output this time information.

The output unit 110, for example, instead of outputting the captured image received by the captured image reception unit 107 described above, with respect to the captured image received by the captured image reception unit 107, the code acquired by the acquisition unit 105 for this captured image. A captured image in which at least one of the character string and the character string is arranged may be output. For example, the output unit 110 may acquire (for example, create) and output a captured image in which at least one of a code and a character string is arranged. The photographed image in which at least one of the code and the character string is arranged is, for example, a photographed image in which at least one of the code image and the character string image is arranged. The photographed image in which at least one of the code image and the character string image is arranged is a photographed image in which at least one of the code image and the character string image is combined with the photographed image. The composition mode (multiplication mode, overlay mode) or the like applied at the time of this composition, the degree of transparency, etc. do not matter.

For example, the output unit 110 outputs a captured image in which at least one of a character string and a code is arranged at the position indicated by the position designation information. Further, for example, the output unit 110 may output a captured image in which at least one of a character string and a code is arranged at a position determined by default or the like. For example, the output unit 110, for the captured image received by the captured image receiving unit 107, the position at which the position designation information receiving unit 106 receives at least one of the code and the character string acquired by the acquisition unit 105 for this captured image. You may produce and output the picked-up image arrange|positioned at the position which designation|designated information shows, or the position determined by the default.

It does not matter whether the output unit 110 arranges the code or the character string acquired by the acquisition unit 105. For example, which one is to be arranged may be predetermined, for example. For example, which one is to be arranged may be designated in advance by the user.

It should be noted that such a captured image created by arranging a code or a character string in the captured image received by the captured image receiving unit 107 is considered to be one aspect of the captured image received by the captured image receiving unit 107. Therefore, the captured image in which such a code or character string is arranged may be considered as the captured image received by the captured image receiving unit 107.

Note that the above output is normally stored in the image storage unit 108, but may be transmitted to an external device, an external storage medium, or the like. For example, the information including the photographed image, the code identifier, the character string, and the like as described above is transmitted to an external server device (not shown) having a storage unit similar to the image storage unit 108, and this information is stored. The received server device may accumulate the received information in the storage unit or the like.

For example, the output unit 110 arranges the captured images in time series using the time information associated with the captured image for each site identifier associated with the captured image, and outputs (displays, for example). May be. Arranging and outputting in time series means, for example, that the captured images are arranged in ascending order or descending order of the associated time information (for example, arranged along a predetermined direction or route) and output. It is to be. This also applies to the following. Such output can be performed, for example, when the captured image is stored in the image storage unit 108 or the like in association with the site identifier.

For example, when the identifier receiving unit 109 receives information for designating one or more code identifiers, the output unit 110 arranges the captured images associated with the code identifiers designated by this information in time series. And output (eg, display). The information for specifying the code identifier is, for example, one or more code identifiers themselves, as described above. When the code identifier associated with the captured image is the site identifier, the information for designating the code identifier may be, for example, information for designating the site identifier.

For example, when the code identifier is the site identifier, the output unit 110, when the identifier receiving unit 109 receives the group identifier, the output unit 110 associates the captured image with the site identifier having the group identifier received by the identifier receiving unit 109. May be arranged in time series and output (for example, displayed).

Further, for example, when the identifier receiving unit 109 receives a set of a group identifier and a floor identifier, the output unit 110 associates a captured image with a site identifier having the group identifier and the floor identifier of the received set. May be arranged in time series and output (for example, displayed).

Further, for example, when the identifier receiving unit 109 receives a set of a group identifier, a floor identifier, and a region identifier, the output unit 110 determines that the site identifier including the group identifier, floor identifier identifier, and region identifier of the received set is The associated captured images may be arranged in time series and output (for example, displayed).

Note that, for example, when the identifier receiving unit 109 receives information for designating one or more character strings associated with a captured image, or when the character string associated with a captured image is a site identifier. The same applies to the case such as

The captured image output by the output unit 110 may be a captured image accepted by the captured image accepting unit 107. As described above, the output unit 110 outputs the captured image accepted by the captured image accepting unit 107. On the other hand, it may be a captured image in which at least one of a code and a character string is arranged. The captured image output by the output unit 110 may be a captured image stored in the image storage unit 108, for example. For example, the captured image output by the output unit 110 is stored in the image storage unit 108 by arranging at least one of a code and a character string with respect to the captured image received by the captured image reception unit 107 by the output unit 110, for example. The captured images may be accumulated.

Although the above output is normally a display using a monitor (not shown) or printing, it can be sent to another device, stored in a storage unit (not shown), or stored in an external storage unit. It may be.

It may be considered that the output unit 110 includes or does not include an accumulating unit (not shown) and an output device such as a monitor and a printer. The output unit 110 can be realized by driver software of an output device or driver software of an output device and an output device.

Next, an example of the operation of the information processing device 1 will be described with reference to the flowchart of FIG.

(Step S101) The image capturing unit 101 determines whether or not to start capturing a candidate image for capturing. For example, when an operation receiving unit (not shown) or the like receives an instruction or the like to set the image capturing unit 101 in a state in which image capturing is possible, or when the information processing apparatus 1 is started, it may be determined to start image capturing. When shooting is started, the process proceeds to step S102, and when shooting is not started, the process proceeds to step S115.

(Step S102) The display unit 102 sequentially displays the shooting candidate images taken by the shooting unit 101 on a monitor or the like (not shown).

(Step S103) It is determined whether an operation receiving unit (not shown) or the like has received an operation for displaying a character string. If it has been accepted, the process proceeds to step S104, and if it has not been accepted, the process proceeds to step S114. When accepted, one or more character strings stored in the character string storage unit 103, for example, a list menu of one or more character strings (for example, a drop-down menu or the like) is displayed on the shooting candidate image.

(Step S104) The character string acceptance unit 104 determines whether or not an operation of selecting one character string from the one or more character strings displayed in step S103 has been accepted. For example, when an operation of selecting a list item in which one character string is arranged is received from a list menu of one or more character strings, the character string reception unit 104 selects the character string arranged in this list item. Judge that the operation is accepted. The selection of one character string may be considered that the character string reception unit 104 has received this character string. If the operation of selecting the character string is accepted, the process proceeds to step S105, and if not, the process returns to step S104.

(Step S105) The acquisition unit 105 acquires the character string selected in step S104, that is, the character string received by the character string reception unit 104.

(Step S106) The acquisition unit 105 acquires the code identifier and the code stored in the character string storage unit 103 in association with the character string selected in step S105. For example, the acquisition unit 105 reads the code identifier and the code.

(Step S107) The display unit 102 is a shooting candidate image that the shooting unit 101 sequentially shoots, and places the character string acquired in step S105 and the code acquired in step S106 in predetermined locations by default. The photographed candidate image arranged on the monitor is displayed on a monitor or the like not shown.

(Step S108) The position designation information reception unit 106 determines whether or not the position designation information has been received. If accepted, the process proceeds to step S109, and if not accepted, the process proceeds to step S110.

(Step S109) The display unit 102 changes the display position and displays at least one of the character string and the code displayed in step S107 according to the position designation information received in step S108.

(Step S110) The imaging unit 101 determines whether or not to perform imaging. For example, the image capturing unit 101 determines whether or not an operation receiving unit (not shown) or the like has received an instruction to capture a captured image. If accepted, the process proceeds to step S111, and if not accepted, the process returns to step S108.

(Step S111) The photographing unit 101 performs photographing and acquires a photographed image. Further, here, the photographing unit 101 acquires time information at the time of photographing from a clock or the like (not shown).

(Step S112) The captured image receiving unit 107 receives the captured image captured by the capturing unit 101 in Step S111 and the time information regarding this captured image, and the output unit 110 converts the captured image received by the captured image receiving unit 107 into the captured image. The captured image in which the character string and the code acquired in step S107 are arranged is acquired, for example, generated. For example, the image of the character string and the code is combined with the captured image. When arranging the character string and the code, for example, the character string and the code are placed at the position determined by default, or in the position indicated by the position designation information when the position designation information is received in step S108. Deploy. When the character string and the code are not arranged in the captured image, the process of arranging the character string and the code may be omitted. Further, only one of the character string and the code may be arranged. The output unit 110 also acquires the time information received by the captured image reception unit 107 in step S112.

(Step S113) The output unit 110 outputs the captured image acquired in step S112 (or the captured image acquired in step S111 if step S112 is omitted), time information regarding this captured image, and the character string acquired in step S105. And the code identifier obtained in step S106. For example, the output unit 110 associates these pieces of information with each other and stores them in the image storage unit 108.

(Step S114) The imaging unit 101 determines whether or not to end the shooting of the shooting candidate image. For example, when an operation receiving unit (not shown) or the like receives an operation to end shooting, it is determined to end shooting of the shooting candidate image. If it ends, the process proceeds to step S115. If not, the process returns to step S102.

(Step S115) The identifier receiving unit 109 determines whether or not information specifying one or more code identifiers has been received. For example, it is determined whether one group identifier has been accepted. If accepted, the process proceeds to step S116, and if not accepted, the process returns to step S101. In addition,

(Step S116) The output unit 110 detects a captured image associated with the code identifier corresponding to the information designating the code identifier received in step S115 from the image storage unit 108 and the like, and detects the detected captured image. It is arranged along the series and output (for example, displayed). Then, the process returns to step S101. In addition, in step S115 and step S116, a case has been described in which it is determined whether or not information specifying one or more code identifiers is received and a captured image is output, but a character string is specified instead of the code identifier. It is also possible to determine whether or not the information to be received has been received and output the captured image corresponding to the designated character string.

In the flowchart of FIG. 2, the processing is ended by powering off or interruption for aborting the processing.

Hereinafter, a specific operation of the information processing device 1 according to the present embodiment will be described. Note that, here, a case where the information processing apparatus 1 is a so-called tablet terminal including a camera module that is the image capturing unit 101 will be described.

FIG. 3 is a character string management table that manages character strings and the like stored in the character string storage unit 103. The character string management table has attributes "character string", "code ID", and "code". The “character string” is a character string, and here, it is assumed to be a character string indicating one region of the construction site. “Code ID” is a code identifier. Here, the code identifier is a field identifier. Here, it is assumed that the first three characters of the code identifier are the group identifier indicating the construction site, the next two characters are the floor identifiers indicating the floor, and the next three characters are the area identifiers. The “code” is a code, and here it is assumed to indicate the file name of the image file of the code stored in the character string storage unit 103. Here, the code indicated by the attribute value of "code" in the character string management table in FIG. 3 is assumed to be a color code. The character string stored in the character string storage unit 103 is assumed to be, for example, a character string indicating the location of the building site where the user plans to shoot.

When the user activates the information processing device 1 at one construction site, for example, the photographing unit 101, which is a camera module, starts photographing a photographing candidate image, and the display unit 102 monitors the photographed image (not shown). To display. Here, as an example, the image capturing unit 101 captures a moving image as a capturing candidate image, and the display unit 102 sequentially updates the frame images forming the captured moving image and displays the frame images on a monitor (not shown) or the like.

FIG. 4 is a diagram illustrating an example of a state in which the display unit 102 is displaying a shooting candidate image on the monitor 40 included in the information processing device 1. Note that, here, the monitor 40 is provided with a touch panel (not shown) on its surface. Further, it is assumed that the lens (not shown) of the camera module which is the imaging unit 101 is installed on the surface opposite to the surface on which the monitor 40 is provided.

Here, the user operates a touch panel or the like to perform a predetermined operation for displaying a list menu for inputting a character string (for example, an operation for selecting a menu for displaying the list menu). Suppose you did.

In response to this operation, the display unit 102 configures a list menu having menu items in which two or more attribute values of “character string” in the character string management table as illustrated in FIG. 3 are configured, and the configured list menu The image of is displayed overlaid on the shooting candidate image.

FIG. 5 is a diagram showing a display example of a list menu 50 having menu items in which character strings are arranged. Here, it is assumed that the list menu 50 can display the attribute values of all "character strings" in the character string management table of FIG. 3 by performing so-called scrolling. Note that the data such as the attribute value of “character string” in the character string management table may have a hierarchical structure, and the list menu 50 displayed by the display unit 102 may be a hierarchical menu adapted to this hierarchical structure.

It is assumed that the user selects a list item having a character string indicating a place to be a subject in the list menu 50 shown in FIG. For example, it is assumed that the menu item 51 in which the character string “ABC building first floor entrance” is arranged is selected in the list menu 50. For example, it is assumed that the user touches (for example, taps) the menu item 51 with a finger.

The character string receiving unit 104 receives the character string “ABC building first floor entrance” arranged in the menu item touched by the user. The acceptance here may be considered as acceptance of the input of the character string.

The acquisition unit 105 acquires the character string “ABC building first floor entrance” received by the character string reception unit 104. In addition, from the character string management table shown in FIG. 3, the code identifier “ABC1F001”, which is the attribute value of the “code ID” associated with the character string “ABC building first floor entrance”, and “ABC building first floor entrance”. “P0001.png”, which is the code (here, the image of the code) of the file name that matches the attribute value of “code” associated with “” is acquired.

The display unit 102 respectively displays the character string “ABC1F001” acquired by the acquisition unit 105 and the image of the code having the file name “P0001.png” at predetermined positions on the shooting candidate images sequentially displayed. indicate.

FIG. 6 is a diagram showing a display example of a shooting candidate image in which the character string 61 and the code 62 acquired by the acquisition unit 105 are arranged (FIG. 6A), and a color code which is a code arranged in the shooting candidate image. It is a figure (FIG.6(b)) which shows an example of 62. The information indicating the location of the character string 61 and the code 62 is, for example, the coordinates of one point of the character string 61 or the code 62, such as the coordinates of the upper left corner or the like, the coordinates of the center of the character string 61 or the code 62, and the like. Is.

In this specific example, for example, a color code 62 as shown in FIG. 6B is used. The color code 62 is a code in which a plurality of colors are arranged on a matrix. For example, the color code 62 is also called a chameleon code. Here, it is assumed that the information read from the color code 62 is an identifier of the color code 62 (hereinafter, referred to as a code identifier). Here, as an example, the color codes 301 attached to the different character strings stored in the character string storage unit 103 are color codes having different color arrangements and the like, and different code identifiers are associated with each other. I shall.

FIG. 7 is a diagram showing a state in which an operation for changing the position of the color code 62 is being performed (FIG. 7A) and a state immediately after the operation is finished (FIG. 7(b)). is there.

Here, for example, the user thinks that the display position of the color code 62 displayed in the default position is not preferable, and as shown in FIG. 7A, for example, the color code 62 displayed on the monitor 40 is touched with a fingertip. It is assumed that the color code 62 is moved by holding it down and dragging it to an arbitrary position on the shooting candidate image. A touch panel (not shown) arranged on the monitor 40 acquires information on the position pressed by a finger, for example, coordinates, and the position designation information receiving unit 106 determines that the coordinates are within the area where the color code 62 is displayed. Since the coordinates are used, it is determined that the color code 62 is to be changed. When the finger is released from the color code 62, a touch panel (not shown) arranged on the monitor 40 acquires information on the position where the finger is released, for example, the coordinates, and the position designation information receiving unit 106 receives the information. The position designation information having position information (for example, coordinates), which indicates that the moving target is the target whose color code 62 is to change the position, is acquired.

Then, as shown in FIG. 7B, the display unit 102 arranges and displays the color code 62 at the position indicated by the position designation information.

Further, if the operation of dragging the character string 61 displayed on the monitor 40 is performed, the position designation information accepting unit 106 accepts the position designation information for the character string 61 as in the case of the color code 62. The display unit 102 arranges and displays the character string at the position indicated by the position designation information. However, it is assumed here that the character string 61 is not moved.

When the user performs a predetermined operation on an operation reception unit (not shown) or the like to perform shooting using the shooting unit 101, the shooting unit 101 performs shooting and acquires a shot image. The acquired captured image is assumed to be a still image here. The image capturing unit 101 also acquires time information indicating the time when the captured image was captured from a clock or the like (not shown). It is assumed that the acquired time information is “2015/12/08 14:05”.

The captured image receiving unit 107 receives the captured image acquired by the capturing unit 101. Further, the captured image reception unit 107 receives time information, here, time information indicating the time when the image was captured, from the imaging unit 101 together with the captured image.

The output unit 110 acquires a captured image obtained by arranging the character string 61 and the code 62 acquired by the acquisition unit 105 in the captured image acquired by the captured image reception unit 107 and combining them. For example, the coordinates indicating the positions where the character string 61 and the code 62 are arranged in the shooting candidate image displayed by the display unit 102 are acquired, and the acquired coordinates are converted into coordinates on the shot image, A captured image in which the character string 61 and the code 62 acquired above are arranged at the coordinates obtained by conversion is acquired. The conversion of the coordinates is performed, for example, according to the ratio of the number of pixels of the shooting candidate image and the number of pixels of the shooting image, the difference in the aspect ratio between the shooting candidate image and the shooting image, and the like. Accordingly, the acquisition unit 105 acquires the captured image in which the character string 61 is arranged at the position designated by default on the captured image and the code 62 is arranged at the position indicated by the position designation information. If the image displayed on the display unit 102 is a photographed image, the above-mentioned conversion of coordinates and the like need not be performed.

FIG. 8 is a diagram showing a captured image acquired by the output unit 110. Note that, here, the case where the output unit 110 acquires a captured image in which the character string 61 and the code 62 are arranged in the captured image has been described, but the output unit 110 selects one of the character string 61 and the code 62 in the captured image. You may make it acquire the picked-up image which arrange|positioned only one. Further, the output unit 110 may not arrange the character string 61 and the code 62 in the captured image.

The output unit 110 also acquires the time information received by the captured image reception unit 107 together with the captured image.

The output unit 110 arranges the captured image in which the character string 61 and the code 62 acquired above are arranged, the time information acquired from the captured image reception unit 107 for this captured image, and the character string “ABC Building One” acquired by the acquisition unit 105. It outputs the "floor entrance" and the code identifier "ABC1F001". Here, these pieces of information are associated and accumulated in the image storage unit 108.

FIG. 9 is an image management table that manages captured images, character strings, and code identifiers stored in the image storage unit 108. The image management table has attributes of "image", "character string", "code ID", and "time". The "image" is a captured image in which a character string and a code are arranged. Here, the file name of the captured image is shown. It is assumed that the file name is given according to a predetermined rule (for example, a rule for giving a serial number) or the like. The “character string” is a character string acquired by the acquisition unit 105 for the captured image. The “code ID” is a code identifier acquired by the acquisition unit 105 for the captured image. “Time” is time information regarding the captured image. Here, it is assumed that the rows (records) are sorted in descending order of the "time" attribute value. Here, it is assumed that the first row record (row) is a newly accumulated record having the captured image shown in FIG.

Here, the user finishes shooting the shooting candidate image and operates the operation receiving unit (not shown) or the like to display the shot image that has been shot, and, for example, the input screen 70 as shown in FIG. Is displayed, and "ABC" is input to the input field 71 of "group identifier" and "1F" is input to the input field 72 of "floor identifier" from this input screen 70. When the display button 74 is pressed, the identifier receiving unit 109 receives the group identifier “ABC” and the floor identifier “1F” input in the input fields 71 and 72.

The output unit 110 creates a search key “ABC1F”, which is a combination of the group identifier “ABC” accepted by the identifier accepting unit 109 and the floor identifier “1F”, and in the image management table shown in FIG. A record (line) in which the first five characters of the attribute value of “” match the search key “ABC1F” is detected, and the captured image of the file name indicated by the attribute value of “image” of the detected record is stored in the image storage unit 108. The read captured images are arranged in time series and output using the attribute value of "time" of the corresponding record. Here, for example, the read shot images are arranged in descending order of the attribute value of “time” of the corresponding record and displayed on the monitor 40. Here, the attribute value of “time” and the attribute value of “character string” of the corresponding record are also displayed below the captured image.

FIG. 11 shows a display example of captured images 80 arranged in time series by the output unit 110.

Here, the captured images of the detected records are arranged in the same column, but the captured images of the detected record are displayed in a time series so as to be arranged in different columns for each attribute value of the “code ID”. You may.

Further, the user temporarily displays the input screen 70 shown in FIG. 10, and from this input screen 70, “ABC” is input in the “group identifier” input field 71 and “1F” is input in the “floor identifier” input field 72. , "001" is input in the "area identifier" input field 73. When the display button 74 is pressed, the identifier reception unit 109 displays the group identifier “ABC”, the floor identifier “1F”, and the area identifier “001” input in the input field 71, the input field 72, and the input field 73. Accept.

The output unit 110 creates a search key “ABC1F001” that combines the group identifier “ABC” received by the identifier receiving unit 109, the floor identifier “1F”, and the area identifier “001”, and the image management illustrated in FIG. 9 is performed. In the table, a record (line) in which the first eight characters of the attribute value of "code ID" matches this search key "ABC1F001" is detected, and the image of the file name indicated by the attribute value of "image" of the detected record is captured. The images are read from the image storage unit 108, and the read shot images are arranged in time series and output using the attribute value of “time” of the corresponding record. Here, for example, the read shot images are arranged in descending order of the attribute value of “time” of the corresponding record and displayed on the monitor 40. Here, the attribute value of “time” and the attribute value of “character string” of the corresponding record are also displayed below the captured image.

FIG. 12 shows a display example of captured images 80 arranged in time series by the output unit 110.

As described above, according to the present embodiment, it is possible to easily associate the captured image, the character string, and the code identifier with each other by receiving the character string of the subject or the like at the time of shooting.

Further, according to the present embodiment, for example, a captured image in which a character string associated with a captured image and the code indicated by the code identifier are arranged can be acquired.

(Embodiment 2)
In the present embodiment, a character string for a captured image and a code identifier are acquired from the captured image, and these are associated with the captured image.

FIG. 13 is a block diagram of the information processing device 2 according to the present embodiment.

The information processing device 2 includes a photographing unit 201, a photographed image reception unit 202, an acquisition unit 203, an image storage unit 204, an identifier reception unit 205, and an output unit 206.

The information processing device 2 is realized by, for example, a dedicated device, a server device, a portable computer, a tablet terminal, a multifunctional mobile phone terminal such as a so-called smartphone, or a mobile information terminal.

The photographing unit 201 photographs a subject and acquires a photographed image. As the image capturing unit 201, for example, the same unit as the image capturing unit 101 of the above-described embodiment is used. The subject and the captured image here are the same as those in the above-described embodiment.

The image capturing unit 201 captures, for example, an object in which at least one of one or more character strings and one or more codes is arranged. The subject here is, for example, an object, a region to be photographed, a photographing range, or the like similar to the subject in the first embodiment. The character string arranged on the subject is, for example, a character string for the subject. The code placed on the subject is, for example, a code for the subject or a code associated with a code identifier for the subject. As the code here, for example, the same code as the code of the first embodiment is used.

The placement of the code on the subject means, for example, that the code is attached to, printed on, or drawn on the subject, an object placed in the area serving as the subject, or the like. For example, that the code is attached to the subject or the object may mean that a sticker or sheet on which the code is printed is attached to the subject or the object. The object on which the code is arranged is, for example, an area to be photographed on which a display object such as a signboard, a sheet or a plate on which the code is arranged, or a building on which the code is arranged. Arranging the code on a subject or an object may mean that a display object on which the code is printed, affixed, or described is hung on a region of the subject, which is an object to be photographed. In addition, the arrangement of the code means that, for example, the display object on which the code held by one user is attached or printed is present on the construction site or the like which is the subject. May be. The same applies to the character string placed on the subject.

For example, the photographing unit 101 may photograph a construction site where at least one of one or more character strings and one or more codes is arranged as a subject. For example, the image capturing unit 101 may capture an image of a building site where a signboard, a panel, or the like in which one or more character strings and one or more codes are arranged is arranged. The code identifier corresponding to the character string or code in this case may be a site identifier.

When the captured image receiving unit 202 described later receives a captured image captured by a device other than the capturing unit 201, the capturing unit 201 may be omitted. For example, when the information processing device 2 is a server device, the captured image reception unit 202 may receive a captured image captured and transmitted by an external image capturing device or the like via a network, a dedicated communication line, or the like. ..

Further, the image capturing unit 201 may further acquire time information indicating the time when the captured image was captured, similar to the above-described image capturing unit 101.

The captured image receiving unit 202 receives a captured image. The captured image receiving unit 202 receives, for example, a captured image having one or two or more character string images. The captured image having a character string image is, for example, a captured image in which a character string is captured. Further, the captured image receiving unit 202 may receive a captured image having one or more code images, for example. The captured image including the image of the code is a captured image in which the code is captured. It is preferable that the captured image receiving unit 202 receives, for example, a captured image having one or more character string images and one or more code images.

The captured image receiving unit 202 receives, for example, a captured image captured by the capturing unit 201. The captured image receiving unit 202 may receive a captured image acquired by an external image capturing apparatus (not shown) having the same function and configuration as the image capturing unit 201.

The captured image receiving unit 202 may receive the captured image from the capturing unit 201 and acquire time information indicating the capturing time of the captured image. Further, the captured image reception unit 202 may acquire time information indicating the time when the captured image is received from the imaging unit 201 from a clock or the like (not shown). This time information may be considered as information indicating the time when the captured image was captured.

The acquisition unit 203 acquires a character string and a code identifier that is a code identifier for the captured image received by the captured image reception unit 202. For example, the acquisition unit 203 does not accept the input of the character string or the code identifier from the user or the like, and automatically acquires the character string about the captured image from the captured image captured image received by the captured image reception unit 202. Get the code identifier.

For example, the acquisition unit 203 acquires a character string corresponding to the image of the character string included in the captured image received by the captured image reception unit 202. For example, when the captured image received by the captured image reception unit 202 is an image having one or more character string images, the acquisition unit 203 determines that the captured image received by the captured image reception unit 202 is the character string image in the captured image. A character string is obtained by performing character recognition processing by using. Acquiring a character string is, for example, acquiring text data or acquiring a character code of a character forming the character string. The acquisition unit 203 detects an image of a character string in the captured image received by the captured image reception unit 202 by using character recognition processing such as OCR, and detects a character string corresponding to the detected image of the character string. To get Note that character recognition processing for obtaining a character string corresponding to an image of a character string included in a captured image by performing character recognition processing from the captured image is known as a technique such as OCR, and therefore will not be described here in detail. The description is omitted. When the image of the character string included in the captured image is the image of the character string indicating the site identifier, the acquisition unit 203 acquires the site identifier from the image of the character string.

The acquisition unit 203 may acquire the character string by performing the character recognition process only on the image of the character string existing at a position satisfying a predetermined condition in the captured image. For example, the acquisition unit 203 uses a character string arranged in the same divided area as the area in which the code image in the captured image is arranged, or in the same object as the object in which the code in the captured image is arranged. The character string may be acquired only from the image. Further, the acquisition unit 203 may acquire the character string from the area of the background color designated in advance in the captured image. The object can be detected by, for example, detecting a region, pattern matching, detection of a feature amount, or the like. In addition, for example, the acquisition unit 203 may use an image of a character string whose distance to the area where the code image in the captured image is arranged is a predetermined distance or less, or a character string located in a predetermined direction. The character string may be acquired only from the image.

Further, the acquisition unit 105 recognizes the image of the code in the captured image received by the captured image reception unit 107, and acquires the code identifier corresponding to the recognized code. For example, when the captured image received by the captured image reception unit 202 is a captured image having one or more code images, the acquisition unit 203 recognizes the code image in the captured image received by the captured image reception unit 202. Then, the code identifier corresponding to the code is obtained. The process of recognizing the image of the code in the captured image and acquiring the code identifier associated with the detected code detects and detects the one-dimensional code, the two-dimensional code, the color code, or the like from the still image or the moving image. Since it is publicly known as a process of acquiring information such as an identifier associated with a code, detailed description thereof will be omitted here. Further, when a plurality of code images are included in the captured image, each code image may be detected and the code identifier corresponding to each detected code may be acquired. For example, the process of detecting a plurality of color codes from one image and acquiring the corresponding information is a known technique. Therefore, it is possible to obtain the code identifiers corresponding to the plurality of color codes using this technique. It is possible. When the image of the code included in the captured image is the image of the code associated with the code identifier indicating the site identifier, the acquisition unit 203 acquires the site identifier from the image of this character string.

The acquisition unit 203 acquires the code identifier associated with the character string acquired from the image of the character string included in the captured image, by the acquisition unit 105 of the first embodiment described above by the character string reception unit 104. May be obtained by performing the same process as that of obtaining the code identifier corresponding to this character string.

When acquiring the code identifier and the character string from the captured image, the acquisition unit 203 does not care which one is acquired first.

The image storage unit 204 stores one or more captured images. For example, the image storage unit 204 stores the captured image received by the captured image receiving unit 202. For example, the image storage unit 204 stores a captured image output by the output unit 206 described later.

The image storage unit 204 stores one or more captured images in association with the code identifier and the character string acquired by the acquisition unit 203 for the captured images. For example, the image storage unit 204 stores one or more pieces of information including a captured image, a code identifier acquired by the acquisition unit 203 for this captured image, and a character string acquired by the acquisition unit 203 for this captured image. To be done.

Further, the image storage unit 204 may store one or more captured images in association with time information. The time information is, for example, information indicating the time when the captured image was captured. The time information is, for example, information on the time acquired by the image capturing unit 201 from a clock or the like (not shown) when capturing the captured image. The time information may be, for example, information on the time when the captured image receiving unit 202 receives the captured image. The time information may be time information acquired by the output unit 206 or the like using a clock or the like (not shown) when the captured images are stored in the image storage unit 204.

When the output unit 206 does not store captured images and the like in the image storage unit 204, the image storage unit 204 may be omitted.

The identifier receiving unit 205 receives information for designating one or more code identifiers or character strings. The configuration of the identifier receiving unit 205, the processing executed by the identifier receiving unit 205, and the like are the same as those of the identifier receiving unit 109, and therefore detailed description thereof is omitted here.

The output unit 206 outputs a captured image. For example, the output unit 206 outputs the captured image received by the captured image reception unit 202. The output unit 206 may output the captured image received by the captured image receiving unit 202 and the code identifier and the character string acquired by the acquisition unit 203 in association with each other.

The output unit 206 acquires, for example, time information that is time information regarding the captured image, the time information, the captured image received by the captured image reception unit 202, and time information that is time information regarding the captured image. The code identifier and the character string acquired by the acquisition unit 203 for this captured image may be output in association with each other. For example, the output unit 206 acquires time information that is time information regarding the captured image, and outputs the time information, the captured image, the code identifier, and the character string in association with each other. Since the time information regarding the captured image is the same as the time information regarding the captured image of the output unit 110 described above, detailed description thereof will be omitted here.

In addition, for example, when the captured image is output in association with a code or a character string that is a site identifier, the output unit 206 converts the captured image into the captured image as in the output unit 110 of the first embodiment. For each associated site identifier, the time information associated with the captured image may be used and arranged in time series for output. Such output can be performed, for example, when the captured image is stored in the image storage unit 108 or the like in association with the site identifier.

Like the output unit 110, the output unit 206 receives information (for example, a site identifier, a group identifier, a floor identifier, a region identifier, etc.) for the identifier receiving unit 205 to specify one or more code identifiers. In this case, the shot images associated with the code identifier designated by this information may be arranged in time series and output (for example, displayed). This also applies to character strings. Since this processing is the same as the processing performed by the output unit 110, detailed description will be omitted here.

Since the configuration of the output unit 206 is the same as that of the output unit 110, detailed description will be omitted here.

Next, an example of the operation of the information processing device 2 will be described with reference to the flowchart of FIG.

(Step S201) The photographing unit 201 determines whether to photograph a photographed image. For example, when an operation receiving unit (not shown) or the like receives an instruction to take an image (for example, an instruction to release a shutter), it may be determined to take an image. If shooting is to be performed, the process proceeds to step S102. If shooting is not to be performed, the process proceeds to step S207.

(Step S202) The photographing unit 201 performs photographing and acquires a photographed image. Further, here, for example, time information indicating the time at which the image was taken is acquired from a clock or the like (not shown).

(Step S203) The captured image receiving unit 202 receives the captured image and time information acquired by the capturing unit 201 in step S202.

(Step S204) The acquisition unit 203 performs character recognition processing on the captured image received by the captured image reception unit 202 in step S203, and acquires one or more character strings.

(Step S205) The acquisition unit 203 performs a process of recognizing a code on the captured image received by the captured image reception unit 202 in step S203, and acquires one or more code identifiers.

(Step S206) The output unit 206 outputs the captured image and time information received by the captured image receiving unit 202 in step S203, the character string acquired in step S204, and the code identifier acquired in step S205 in association with each other. .. For example, the output unit 206 stores these in the image storage unit 204 in association with each other.

(Step S207) The identifier reception unit 205 determines whether or not information that specifies one or more code identifiers has been received. For example, it is determined whether one group identifier has been accepted. If accepted, the process proceeds to step S208, and if not accepted, the process returns to step S201.

(Step S208) The output unit 206 detects, from the image storage unit 108 or the like, a captured image associated with the code identifier corresponding to the information designating the code identifier received in step S115, and detects the detected captured image. It is arranged along the series and output (for example, displayed). Then, the process returns to step S201.

Note that in the flowchart of FIG. 14, the processing is ended by powering off or interruption for aborting the processing.

Hereinafter, a specific operation of the information processing device 2 according to the present embodiment will be described. Note that, here, a case where the information processing apparatus 1 is a so-called tablet terminal including a camera module that is the imaging unit 101 will be described.

It is assumed that the user photographs one area of one building site by using the photographing unit 101 of the information processing apparatus 2 and acquires one photographed image. In addition, in each area in this building site, a signboard having a plate on which a character string indicating each area of the building site and a code in which a code identifier that is a site identifier corresponding to each area is associated is placed. It has been done. The code here is assumed to be a color code. Then, it is assumed that the user photographs the one area using the photographing unit 101 of the information processing device 2 so that such a signboard installed in the one area of the construction site is reflected. Further, it is assumed that the image capturing unit 101 acquires time information indicating the image capturing time from a clock or the like (not shown). It is assumed that the acquired time information is “2015/12/08 14:05”.

FIG. 15 is a diagram showing a photographed image 150 photographed by the photographing unit 101 (FIG. 15A) and an image 151a of a character string recognized in the photographed image and an image 152a of the recognized code. It is a figure (FIG.15(b)). As shown in FIG. 15, it is assumed that the photographed image 150 shows a stand 154 having a plate 153 on which a character string 151 and a code 152 are arranged.

The captured image receiving unit 202 receives the captured image shown in FIG. 15A acquired by the capturing unit 201 and the time information.

The acquisition unit 203 performs character recognition processing such as OCR on the captured image received by the captured image reception unit 202 illustrated in FIG. 15A to generate a character string image 151a as illustrated in FIG. 15B. It is detected and the "ABC building 1F entrance" which is a character string corresponding to the image 151a of this character string is acquired.

In addition, the acquisition unit 203 performs a process of recognizing a color code in the captured image received by the captured image reception unit 202 illustrated in FIG. 15A, and the color code image is displayed as illustrated in FIG. 15B. 152a is detected, and "ABC1F001" which is the code identifier corresponding to the image 152a of this code is acquired. This code identifier is, for example, a site identifier here.

The output unit 206 outputs the captured image and time information “2015/12/08 14:05” received by the captured image reception unit 202, the character string “ABC building 1F entrance” and the code acquired by the acquisition unit 203 for this captured image. The identifier "ABC1F001" is output. For example, these pieces of information are associated and stored in the image storage unit 204. The accumulated information is, for example, the same as that shown in FIG. 9 described in the specific example of the first embodiment.

It should be noted that when the identifier accepting unit 205 accepts the information designating one or more code identifiers, for example, the information designating the site identifier, the processing for displaying the captured image corresponding to the designated code identifier is described above. Since it is the same as the specific example of the first embodiment, the description thereof is omitted here.

As described above, according to the present embodiment, the character string and the code identifier for this captured image can be acquired from the captured image. According to this embodiment, the character string for the subject etc. is accepted at the time of capturing. Thus, the captured image, the character string, and the code identifier can be easily associated with each other.

In each of the above embodiments, each process (each function) may be realized by centralized processing by a single device (system), or by distributed processing by a plurality of devices. May be done.

Further, in each of the above-mentioned embodiments, it goes without saying that two or more communication means (such as an information transmitting unit) existing in one device may be physically realized by one medium.

In addition, in the above-described embodiment, information related to processing executed by each component, for example, information that each component receives, acquires, selects, generates, transmits, receives. Information such as thresholds, mathematical expressions, addresses, etc. used by each component in processing is retained temporarily or for a long period of time in a recording medium (not shown), even if not explicitly stated in the above description. May be Further, the storage of information in the recording medium (not shown) may be performed by each component or the storage unit (not shown). Further, the reading of information from the recording medium (not shown) may be performed by each component or the reading unit (not shown).

Further, although cases have been described with the above embodiments where the information processing device is a stand-alone device, the information processing device may be a stand-alone device or a server device in a server/client system. In the latter case, the output unit and the reception unit receive an input or output a screen via the communication line.

Further, in each of the above-described embodiments, each component may be configured by dedicated hardware, or a component that can be implemented by software may be implemented by executing a program. For example, each component can be realized by a program executing unit such as a CPU reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory. At the time of execution, the program execution unit may execute the program while accessing a storage unit (for example, a recording medium such as a hard disk or a memory).

The software that realizes the information processing device in each of the above-described embodiments is the following program. That is, this program causes the computer to acquire a captured image reception unit that receives a captured image, an acquisition unit that acquires a character string and a code identifier that is a code identifier for the captured image received by the captured image reception unit, and an image capturing operation. It is a program for functioning as an output unit that outputs the image and the code identifier and the character string acquired by the acquisition unit in association with each other.

In the above program, the function realized by the program does not include the function realized only by hardware. For example, a function that can be realized only by hardware such as a modem or an interface card in an acquisition unit that acquires information and an output unit that outputs information is not included in the functions realized by the program.

Moreover, the computer that executes this program may be singular or plural. That is, centralized processing may be performed or distributed processing may be performed.

FIG. 16 is a diagram showing an example of a computer system 900 that realizes the information processing apparatus according to the above-described embodiments by executing the above-described program. The above embodiment can be realized by computer hardware and a computer program executed on the computer hardware. The information processing device according to the above-described embodiment may have the external appearance shown in FIG. 5 or the like, for example.

16, the computer system 900 is connected to an MPU (Micro Processing Unit) 911, a ROM 912 such as a flash memory in which programs such as a boot-up program, application programs, system programs, and data are stored, and the MPU 911. A RAM 913 that temporarily stores the instructions of the application program and that provides a temporary storage space, a touch panel 914, a wireless communication module 915, a bus 916 that mutually connects the MPU 911, the ROM 912, and the like are provided. A wired communication module may be provided instead of the wireless communication module 915. Further, instead of the touch panel 914, a display and an input device such as a mouse or a keyboard may be provided. Further, in the present embodiment, the information processing device may have a camera or a camera module not shown.

A program that causes the computer system 900 to execute the functions of the information processing apparatus according to the above-described embodiments may be stored in the ROM 912 via the wireless communication module 915. The program is loaded into the RAM 913 when it is executed. Note that the program may be loaded directly from the network.

The program does not necessarily have to include an operating system (OS) that causes the computer system 900 to execute the functions of the information processing apparatus according to the above-described embodiment, a third-party program, or the like. The program may include only a part of an instruction that calls an appropriate function or module in a controlled manner to obtain a desired result. How the computer system 900 operates is well known and will not be described in detail.

It is needless to say that the present invention is not limited to the above-mentioned embodiment, and various modifications can be made, and these are also included in the scope of the present invention.

As described above, the information processing apparatus or the like according to the present invention is suitable as an apparatus or the like for outputting a captured image, and particularly, the captured image, a character string for this image, and a code for this image. It is useful as a device for outputting an identifier and the like.

1, 2 Information processing device 101, 201 Imaging unit 102 Display unit 103 Character string storage unit 104 Character string acceptance unit 105, 203 Acquisition unit 106 Position designation information acceptance unit 107, 202 Photographed image acceptance unit 108, 204 Image storage unit 109, 205 identifier reception unit 110, 206 output unit

Claims (21)

A shooting unit that shoots a subject and acquires a shot image,
A captured image reception unit that receives captured images,
A character string acceptance unit that accepts a character string when photographing using the photographing unit,
An acquisition unit that acquires a character string and a code identifier that is a code identifier for the captured image received by the captured image reception unit;
An output unit that outputs the captured image and the code identifier and the character string acquired by the acquisition unit in association with each other ,
The photographed image receiving unit receives the photographed image acquired by the photographing unit,
The information processing apparatus , wherein the acquisition unit acquires the character string received by the character string reception unit and a code identifier of a code corresponding to the character string . The acquisition unit further acquires a code corresponding to the character string received by the character string reception unit,
The output unit, the information processing apparatus according to claim 1, wherein acquiring the captured image obtained by arranging at least one of said strings and codes. At least one of the character string and the code acquired by the acquisition unit further includes a position designation receiving unit that receives position designation information that is information designating a position in a captured image,
The information processing apparatus according to claim 2 , wherein the output unit outputs a captured image in which at least one of the character string and the code is arranged at a position indicated by the position designation information. Further comprising a character string storage unit for storing a plurality of character strings,
The character string receiving unit, the characters of the plurality of character strings stored in the sequence storage unit, information of claim 3 any one claim from claim 1 for receiving one or more character strings selected by the user Processing equipment. The captured image receiving unit receives a captured image having one or more character string images,
The acquisition unit, the captured image receiving unit in the information processing apparatus according to claim 4, wherein any one of claims 1 to obtain the character string by performing character recognition on the image of the string in the captured image received .. The captured image receiving unit receives a captured image having one or more code images,
The information processing according to any one of claims 1 to 5 , wherein the acquisition unit recognizes an image of the code in the captured image received by the captured image reception unit and acquires a code identifier corresponding to the code. apparatus. A captured image reception unit that receives captured images,
An acquisition unit that acquires a character string and a code identifier that is a code identifier for the captured image received by the captured image reception unit;
An output unit that outputs the captured image and the code identifier and the character string acquired by the acquisition unit in association with each other,
The captured image receiving unit receives a captured image having one or more character string images,
The information processing apparatus, wherein the acquisition unit acquires a character string by performing character recognition on an image of the character string in the captured image received by the captured image reception unit. A captured image reception unit that receives captured images,
An acquisition unit that acquires a character string and a code identifier that is a code identifier for the captured image received by the captured image reception unit;
An output unit that outputs the captured image and the code identifier and the character string acquired by the acquisition unit in association with each other,
The captured image receiving unit receives a captured image having one or more code images,
The information processing apparatus, wherein the acquisition unit recognizes an image of a code in the captured image received by the captured image reception unit and acquires a code identifier corresponding to the code. The photographed image is an image of a construction site,
At least one of the code identifier and the character string acquired by the acquisition unit is a site identifier that is an identifier of a construction site,
The output unit associates the captured image with the captured image by associating the captured image, time information that is time information about the captured image, the code identifier and the character string acquired by the acquisition unit. The information processing apparatus according to any one of claims 1 to 8, wherein the information is arranged in time series and output using time information associated with the captured image for each site identifier . A captured image reception unit that receives captured images,
An acquisition unit that acquires a character string and a code identifier that is a code identifier for the captured image received by the captured image reception unit;
An output unit that outputs the captured image and the code identifier and the character string acquired by the acquisition unit in association with each other,
The photographed image is an image of a construction site,
At least one of the code identifier and the character string acquired by the acquisition unit is a site identifier that is an identifier of a construction site,
The output unit associates the captured image with the captured image by associating the captured image, time information that is time information about the captured image, the code identifier and the character string acquired by the acquisition unit. and for each scene identifier, information processing apparatus it output is arranged in time series with the time information associated with the captured image. The information processing apparatus according to claim 9 or 10, wherein the site identifier is an identifier for individually identifying a plurality of places of one construction site. The site identifier is an identifier having a floor identifier that identifies each of a plurality of floors that one building site has, and a group identifier that identifies one building site,
Further comprising an identifier receiving unit that receives one group identifier, or one or more pairs of one group identifier and one floor identifier,
The output unit is
When the identifier receiving unit receives one group identifier, the captured image associated with the site identifier having the received one group identifier is arranged in time series and output,
When the identifier receiving unit receives a set of one group identifier and one floor identifier, the captured images associated with the site identifier having the received group identifier and floor identifier are arranged in time series. The information processing apparatus according to claim 11, wherein the information processing apparatus outputs the information. The site identifier is an identifier that includes a group identifier that identifies one construction site, a floor identifier that identifies each of a plurality of floors of the one construction site, and an area identifier that identifies each of a plurality of regions within the floor. And
One or more group identifier, one or more pairs of the first group identifier and one floor identifier, or one of the group identifier and one floor identifier and the identifier receiving unit for accepting an one or more sets of the first area identifier Further equipped with,
The output unit is
When the identifier receiving unit receives one or more group identifiers, the captured image associated with the site identifier having the received one or more group identifiers, arranged in time series and output,
When the identifier receiving unit receives one or more pairs of one group identifier and one floor identifier, it is associated with a site identifier having one group identifier and one or more floor identifiers of each received pair. The captured images are arranged in time series for each floor identifier and output,
When the identifier receiving unit receives a set of one group identifier, one floor identifier, and one area identifier, imaging associated with a site identifier having the received group identifier, floor identifier, and area identifier The information processing apparatus according to claim 11, wherein the images are arranged in time series and output. An information processing method performed using a photographing unit, a photographed image reception unit, a character string reception unit, an acquisition unit, and an output unit,
A photographing step in which the photographing unit photographs a subject and obtains a photographed image;
The captured image receiving unit, a captured image receiving step of receiving a captured image,
A character string receiving step in which the character string receiving unit receives a character string during shooting by the shooting step;
An acquisition step in which the acquisition unit acquires a character string and a code identifier that is a code identifier for the captured image received in the captured image reception step;
The output unit comprises an output step of outputting the captured image and the code identifier and the character string acquired in the acquisition step in association with each other,
The photographed image receiving step receives the photographed image acquired in the photographing step,
The acquisition step is an information processing method for acquiring the character string received in the character string reception step and a code identifier of a code corresponding to the character string . An information processing method performed using a captured image reception unit, an acquisition unit, and an output unit,
The captured image receiving unit, a captured image receiving step of receiving a captured image,
An acquisition step in which the acquisition unit acquires a character string and a code identifier that is a code identifier for the captured image received in the captured image reception step;
The output unit comprises an output step of outputting the captured image and the code identifier and the character string acquired in the acquisition step in association with each other,
The photographed image receiving step receives a photographed image having one or more character string images,
The acquisition step is an information processing method for performing character recognition on an image of a character string in the captured image received in the captured image receiving step to acquire the character string. An information processing method performed using a captured image reception unit, an acquisition unit, and an output unit,
The captured image receiving unit, a captured image receiving step of receiving a captured image,
An acquisition step in which the acquisition unit acquires a character string and a code identifier that is a code identifier for the captured image received in the captured image reception step;
The output unit comprises an output step of outputting the captured image and the code identifier and the character string acquired in the acquisition step in association with each other,
The captured image receiving step receives a captured image having one or more code images,
The acquisition step is an information processing method of recognizing an image of a code in the captured image received in the captured image receiving step and acquiring a code identifier corresponding to the code. An information processing method performed using a captured image reception unit, an acquisition unit, and an output unit,
The captured image receiving unit, a captured image receiving step of receiving a captured image,
An acquisition step in which the acquisition unit acquires a character string and a code identifier that is a code identifier for the captured image received in the captured image reception step;
The output unit comprises an output step of outputting the captured image and the code identifier and the character string acquired in the acquisition step in association with each other,
The photographed image is an image of a construction site,
At least one of the code identifier and the character string acquired in the acquisition step is a site identifier that is an identifier of a construction site,
The output step associates the captured image with the captured image by associating the captured image, time information that is time information about the captured image with the code identifier and the character string acquired in the acquisition step. An information processing method in which the time information associated with the photographed image is arranged in time series and output for each site identifier. Computer,
A shooting unit that shoots a subject and acquires a shot image,
A captured image reception unit that receives captured images,
A character string acceptance unit that accepts a character string when photographing using the photographing unit,
An acquisition unit that acquires a character string and a code identifier that is a code identifier for the captured image received by the captured image reception unit;
The captured image and the code identifier and the character string acquired by the acquisition unit are associated with each other and output, and are caused to function .
The photographed image receiving unit receives the photographed image acquired by the photographing unit,
The acquisition unit is a program for acquiring a character string received by the character string reception unit and a code identifier of a code corresponding to the character string . Computer,
A captured image reception unit that receives captured images,
An acquisition unit that acquires a character string and a code identifier that is a code identifier for the captured image received by the captured image reception unit;
The captured image and the code identifier and the character string acquired by the acquisition unit are associated with each other and output,
The captured image receiving unit receives a captured image having one or more character string images,
The acquisition unit is a program for performing character recognition on an image of a character string in a captured image received by the captured image reception unit to acquire the character string. Computer,
A captured image reception unit that receives captured images,
An acquisition unit that acquires a character string and a code identifier that is a code identifier for the captured image received by the captured image reception unit;
The captured image and the code identifier and the character string acquired by the acquisition unit are associated with each other and output, and are caused to function.
The captured image receiving unit receives a captured image having one or more code images,
The acquisition unit is a program for recognizing a code image in a captured image received by the captured image reception unit and acquiring a code identifier corresponding to the code. Computer,
A captured image reception unit that receives captured images,
An acquisition unit that acquires a character string and a code identifier that is a code identifier for the captured image received by the captured image reception unit;
The captured image and the code identifier and the character string acquired by the acquisition unit are associated with each other and output,
The photographed image is an image of a construction site,
At least one of the code identifier and the character string that the acquisition unit acquires is a site identifier that is an identifier of a construction site,
The output unit associates the captured image with the captured image by associating the captured image, time information that is time information about the captured image, the code identifier and the character string acquired by the acquisition unit. A program for arranging and outputting in time series using the time information associated with the captured image for each site identifier.

Images