JP2014106490A - Code image processing system, code image display apparatus, image display apparatus, and program - Google Patents

Abstract

A code image processing system capable of realizing AR display with a wide range of use by relatively simple processing.
A code image display device displays and outputs a code image associated with a document and accepts a user operation. The code image display device updates a document related to the displayed code image in accordance with the accepted operation, and generates and displays a code image related to the updated document. The image display device captures a code image displayed by the code image display device, acquires a document associated with the captured code image, and synthesizes and displays the document in a captured range of the code image associated with the document. To do.
[Selection] Figure 1

Description

  The present invention relates to a code image processing system, a code image display device, an image display device, and a program for processing a code image associated with a document.

  Some conference materials are displayed using augmented reality (AR) technology. For example, Patent Document 1 discloses the following technique. That is, the user selects a display medium (note cover, PC lid, etc.) for displaying the conference material. When a display medium is imaged with a camera and transmitted to the server together with the user name when participating in the conference, the server performs authentication with the user name and the display medium. The server acquires the logical object and transmits it to the user, and the user displays the AR on the logical object. Here, a technique is disclosed in which when a user performs writing, the writing is further recorded as a logical object, used for later reference, and used for AR display.

JP 2011-217098 A

However, in the above conventional technique, each user displays a logical object on each display medium, so that the area where the logical object can be displayed differs for each user. In order to ensure that the arrangement of the logical objects viewed by each user is always the same in such an environment, the alignment of the logical objects must be performed in the AR display device, which complicates the processing. .
Further, in the conventional example, since the AR display is fixed, it is not possible to cope with the case where the object changes, and the use range is limited.

  The present invention has been made in view of the above circumstances, and provides a code image processing system, a code image display device, an image display device, and a program capable of realizing AR display with a wide range of use by relatively simple processing. Is one of its purposes.

  The present invention for solving the problems of the above conventional example is a code image processing system, which includes a code image display device and an image display device, and the code image display device displays a code image associated with a document. Display means for displaying and outputting; receiving means for accepting a user operation; updating means for updating a document related to a displayed code image in accordance with the accepted operation; and a code image related to the updated document Control means for generating and displaying on the display means, wherein the image display device is associated with the picked-up code image and means for picking up the code image displayed by the code image display device. A means for acquiring a document and the acquired document are displayed in a range where the code image associated with the document is captured. A synthesis display unit that is obtained by the to have.

  The code image display device according to an aspect of the present invention includes a display unit that displays and outputs a code image associated with a document, a receiving unit that accepts a user operation, and displays the code image according to the accepted operation. Update means for updating a document related to the code image, and control means for generating a code image related to the updated document and displaying the code image on the display means.

  Furthermore, an image display device according to another aspect of the present invention includes a means for imaging a code image display device that displays and outputs a code image associated with a document, and the captured code image displayed by the code image display device. Means for obtaining an associated document and composition display means for synthesizing and displaying the obtained document in a captured range of a code image associated with the document are provided.

  A program according to another aspect of the present invention displays a computer in accordance with a display unit that displays and outputs a code image associated with a document, a reception unit that receives a user operation, and the received operation. An update unit that updates a document related to the code image being generated, and a control unit that generates a code image related to the updated document and displays the code image on the display unit.

  According to still another aspect of the present invention, there is provided a program for displaying a computer on a code image display device that displays and outputs a code image associated with a document, and the captured code image display device displays the image. Means for obtaining a document associated with a code image, and a composite display means for synthesizing and displaying the obtained document in a captured range of the code image associated with the document. It is.

  According to the present invention, AR display with a wide range of use can be realized with relatively simple processing.

It is a block diagram showing the example of a structure of the code | cord | chord image processing system which concerns on embodiment of this invention. It is explanatory drawing showing the example of the content of the document database utilized with the code | symbol image processing system which concerns on embodiment of this invention. It is explanatory drawing showing the example of an outline | summary of the image display apparatus which concerns on embodiment of this invention. It is a block diagram showing the structural example of the image display apparatus which concerns on embodiment of this invention. It is a functional block diagram showing the example of the code | symbol image display apparatus which concerns on embodiment of this invention. It is a functional block diagram showing the example of the image display apparatus which concerns on embodiment of this invention. It is a flowchart figure showing the example of operation of the code picture processing system concerning an embodiment of the invention. It is a flowchart figure showing another operation example of the code | symbol image processing system which concerns on embodiment of this invention.

  Embodiments of the present invention will be described with reference to the drawings. The code image processing system according to the embodiment of the present invention includes a code image display device 1 and an image display device 2 as illustrated in FIG. Here, the code image display device 1 includes a control unit 11, a storage unit 12, an input unit 13, a display unit 14, and a communication unit 15.

  The control unit 11 of the code image display device 1 is a program control device such as a CPU, and operates according to a program stored in the storage unit 12. In the present embodiment, the control unit 11 of the code image display device 1 causes the display unit 14 to display and output a code image associated with a document to be presented to the user. When the control unit 11 accepts a user operation, the control unit 11 updates and stores a document related to the displayed code image in accordance with the accepted operation. Then, a code image related to the updated and stored document is generated and displayed on the display unit 14. In the present embodiment, when the control unit 11 receives a document content request from the image display device 2 together with document specifying information for specifying a document, the control unit 11 stores the document specified by the document specifying information, for example, the storage unit 12. Are sent out to the requesting image display apparatus 2. Details of the processing of the control unit 11 will be described later.

  The storage unit 12 includes a disk device such as a hard disk drive and a memory device such as a DRAM. The storage unit 12 holds a program executed by the control unit 11. The program may be provided by being stored in a computer-readable recording medium such as a DVD-ROM (Digital Versatile Disc Read Only Memory), and may be stored in the storage unit 12 or a communication line such as a network. It may be provided through and stored in the storage unit 12. In the present embodiment, the storage unit 12 also operates as a work memory of the control unit 11. Further, as illustrated in FIG. 2, the control unit 12 holds a document database in which information (C) representing the contents of a document to be presented to the user is associated with document specifying information (D) for specifying each document. You may do it.

  The input unit 13 is, for example, a touch panel or the like arranged on the display unit 14. The input unit 13 detects a position designated by the user with a pen or a finger, and outputs information on the detected position to the control unit 11. The input unit 13 may include other input devices such as a keyboard and devices such as cameras that can be operated by detecting a user's gesture and the like, and details of operations performed on these input devices. Is output to the control unit 11. The display unit 14 is a liquid crystal display or the like, and displays and outputs information according to instructions input from the control unit 11.

  The communication unit 15 is a wireless local area network (LAN) interface or the like, and transmits information via a network in accordance with an instruction input from the control unit 11. The communication unit 15 receives information that arrives via the network and outputs the received information to the control unit 11.

  Further, as illustrated in FIG. 3, the image display device 2 is a glasses-type device, and includes a frame unit 20 and a circuit unit 30. The frame portion 20 includes a left rim 21L, a right rim 21R, a bridge 22, a nose pad 23, a left hinge 24L, a right hinge 24R, a left temple 25L, a right temple 25R, a left screen 26L, and a right screen 26R. .

  The left and right screens 26L and 26R are supported by the left and right rims 21L and 21R, respectively. The left and right rims 21L and R are connected to each other by a bridge 22. A nose pad 23 is provided on the side surface of each rim 21L, R on the bridge 22 side. Temples 25L, R are connected to the side surfaces of the rims 21L, R opposite to the bridge 22 side via corresponding hinges 24L, R, respectively. The user adjusts the angle formed by the temple 25 and the rim 21 with the hinge 24, puts the temples 25L and R on the left and right ears, and puts the nose pad 23 on the head of the nose and wears the image display device 2. At this time, the left and right eyes of the user visually recognize the outside through the screens 26L and 26R. That is, the screen 26 is formed of a light transmissive material such as glass. In the present embodiment, the screen 26 also functions as display means such as a liquid crystal display.

  The circuit unit 30 of the image display device 2 is attached to the temple 25, the rim 21, or the bridge 22, for example. As illustrated in FIG. 4, the circuit unit 30 includes a control unit 31, a storage unit 32, a display unit 33, an imaging unit 34, and a communication unit 35.

  The control unit 31 is a program control device such as a CPU, and operates according to a program stored in the storage unit 32. In the present embodiment, the control unit 31 accepts a code image displayed by the code image display device 1 obtained by imaging by an imaging unit 34 described later. Then, the control unit 31 decodes the captured code image, and acquires a document associated with the code image specified by the information obtained by decoding. The control unit 31 synthesizes and displays the acquired document in the range where the code image associated with the document is captured. Detailed operation of the control unit 31 will be described later.

  The storage unit 32 holds a program executed by the control unit 31. The program may be provided by being stored in a computer-readable recording medium such as a DVD-ROM and stored in the storage unit 32. The program may be distributed via a network or the like and stored in the storage unit 32. In the present embodiment, the storage unit 32 also operates as a work memory of the control unit 31.

  The display unit 33 is a display that is attached to at least one of the screens 26 </ b> L and 26 </ b> R and has a light transmission property using a liquid crystal method, an organic EL method, or the like disposed at a position visually recognized by the user's eyes. The display unit 33 displays information in accordance with an instruction input from the control unit 31.

  The imaging unit 34 includes a camera platform 34 a and a camera 34 b, and outputs an image captured by the camera 34 b to the control unit 31. In the present embodiment, the camera 34b captures one image as a moving image, for example, in 1/30 second and outputs the image to the control unit 31. In addition, the direction of imaging of the camera 34b is set by the camera platform 34a. It is assumed that the user adjusts in advance the imaging direction of the camera 34b so that the center of the imaging direction of the camera 34b coincides with the center of his field of view.

  The communication unit 35 is a wireless local area network (LAN) interface, for example, and transmits information to the designated destination via the network in accordance with an instruction input from the control unit 31. The communication unit 35 receives information that has arrived via the network and outputs the information to the control unit 31.

  Here, the operation of the control unit 11 of the code image display device 1 will be described. Functionally, the control unit 11 includes a document selection unit 41, a code image generation unit 42, a code image display unit 43, an operation reception unit 44, a document update unit 45, and an update control unit 46 as illustrated in FIG. , And a document distribution unit 47.

  The document selection unit 41 selects a document to be presented to the user from among documents held in the document database, for example, according to an instruction input from the input unit 13. The document selection unit 41 reads information representing the content of the selected document and document specifying information associated with the document from the document database, and stores the information in the work memory as information to be transmitted.

  The code image generation unit 42 encodes the document specifying information read by the document selection unit 41 and generates a code image such as a QR code (registered trademark) (JIS-X0510) or a barcode.

  The code image display unit 43 displays and outputs the code image generated by the code image generation unit 42 on the display unit 14. When the code image display unit 43 receives an instruction from the operation receiving unit 44 to adjust the size of the displayed code image, the code image display unit 43 displays the code image whose size is adjusted according to the instruction. For example, when an instruction to reduce or enlarge the size of the code image to R% is received from the operation receiving unit 44, a code image reduced or enlarged by R% is generated, and this code image is displayed on the display unit 14. .

  When the code image display unit 43 receives an instruction to rotate the displayed code image from the operation receiving unit 44, the code image display unit 43 displays a code image whose inclination is adjusted according to the instruction. As an example, when an instruction indicating that the code image should be displayed with an inclination of θ degrees is received from the operation receiving unit 44, the code image is rotated by θ degrees and displayed on the display unit 14.

  The operation receiving unit 44 receives a user operation. This operation includes an operation to adjust the size of the code image, an operation to rotate the code image, a writing operation to the document, and the like. Specifically, when an operation to adjust the size of the code image or an operation to rotate the code image is performed, the operation receiving unit 44 displays a result reflecting the content of the operation as a code image display unit. Output to 43.

  In addition, when a user performs a writing operation on the document specified by the document specifying information represented by the code image, the operation receiving unit 44 outputs the content of the operation and the document specifying information to the document updating unit 45. Specifically, information (operation content information) indicating the content of the operation output by the operation receiving unit 44 in response to a document writing operation represents a position traced with a pen or a finger obtained at a predetermined timing. It is a character string, a color, etc. showing the coordinate information and the content of writing. When this writing operation is completed, the user performs an operation to confirm the written content. The operation receiving unit 44 outputs operation content information such as coordinate information obtained at every predetermined timing and information indicating that an operation to confirm the written content has been performed to the document update unit 45.

  The document updating unit 45 holds the user's written content represented by the operation content information input from the operation receiving unit 44 in the storage unit 12 in association with the document specifying information for specifying the corresponding document. In addition, when information indicating that an operation to confirm the written content has been performed, the document update unit 45 associates the written content of the user stored in the storage unit 12 with the written content. The new document is generated by synthesizing it with the content of the document held in the work memory in association with the same document identification information as the document identification information. Then, the document updating unit 45 generates document specifying information unique to each document for specifying the new document, and stores the newly generated document in association with the generated document specifying information in the document database. .

  When the document update unit 45 generates a new document, the update control unit 46 instructs the document selection unit 41 to select the newly generated document. In response to this instruction, the document selection unit 41 reads the instructed document from the document database, and stores it in the work memory in association with the document specifying information for specifying the new document as information to be transmitted.

  Upon receiving the document specifying information from the image display device 2, the document distribution unit 47 associates the received document specifying information with information indicating the content of the document held in the work memory as information to be transmitted. read out. Then, the document distribution unit 47 distributes information representing the contents of the read document to the image display device 2. Further, if there is coordinate information held in association with the received document specifying information, the document distribution unit 47 reads the coordinate information. Then, the document distribution unit 47 combines the written content represented by the read coordinate information with information representing the content of the document held in the work memory, and distributes the combined information to the image display device 2. To do.

  The control unit 31 of the circuit unit 30 of the image display device 2 functionally includes a code image acquisition unit 51, a decoding unit 52, a document acquisition unit 53, and a composite display unit 54 as illustrated in FIG. . Here, the code image acquisition unit 51 can repeatedly obtain an image captured by the camera 34b of the imaging unit 34 at every predetermined timing. Each time an image is obtained, the code image displayed on the display unit 14 of the code image display device 1 captured in the image is detected and output to the decoding unit 52. The code image acquisition unit 51 also detects the size of the detected code image and the coordinate system of the image pickup unit 34 (the viewing direction of the camera 34b is the z axis, the vertical direction with respect to the camera 34b is the y axis, and the horizontal direction is the x axis. The inclination of the code image in the xy plane is detected in the coordinate system using the axes. In one example of the present embodiment, the code image is a code image such as a QR code that can detect the inclination and size. The code image acquisition unit 51 generates a normalized code image in which the detected code image is set to a predetermined standard state (predetermined size and inclination) and outputs the normalized code image to the decoding unit 52.

  The decoding unit 52 receives an input of the normalized code image, decodes the input normalized code image, and reads document specifying information represented as the code image. The document acquisition unit 53 transmits the document specifying information read by the decoding unit 52 to the code image display device 1 and requests information representing the content of the document specified by the document specifying information. The document acquisition unit 53 receives information indicating the content of the document requested from the code image display device 1 and operation content information indicating the content of writing performed on the document.

  The composition display unit 54 synthesizes the content of writing represented by the coordinate information with the information representing the content of the document acquired by the document acquisition unit 53 (in the example of the present embodiment, an image representing the content of the document). Generate a composite image. The composite display unit 54 obtains information about the inclination and size of the code image detected by the code image acquisition unit 51, and changes the size and inclination of the composite image according to the detected inclination and size of the code image. Generate an image. The composite display unit 54 displays the generated image at a position on the display unit 33 where the user wearing the image display device 2 views the code image displayed on the code image display device 1 through the screen 26. . As a result, the image of the document, which is the content of the acquired document, is synthesized and displayed in the range where the code image associated with the document is captured. Specifically, the area for displaying information representing the content of the document may be made to match the display area by identifying the display area (display portion) of the display unit 14 of the code image display device 1. In addition, the displayed information is not necessarily displayed only in the range where the code image is captured, and may be displayed beyond the range (out of the range). Further, when the displayed information is a character string, it may be displayed by folding back (with a line break) within the range where the code image is captured.

  The code image processing system of the present embodiment has the above-described configuration and operates as follows. In the following description, it is assumed that the information indicating the content of the document is information expressed in, for example, PDF (Portable Document Format) of Adobe Corporation in the United States. In addition, it is assumed that the user performs alignment in advance between the coordinate system of the image captured by the camera 34b of the image display device 2 and the coordinate system of the information displayed on the screen 26. As such an alignment method, a method widely known as a technique related to a head-mounted display can be adopted, and a detailed description thereof is omitted here.

  As illustrated in FIG. 7, when a user holding a conference operates the code image display device 1 and designates a desired document, the code image display device 1 accepts the designation of the document (S1). The code image display device 1 selects a document designated by the user from the documents held in the document database (S2). The code image display device 1 reads and encodes the document specifying information stored in the document database in association with the selected document, and generates a code image (S3). In this embodiment, this code image functions as a so-called AR marker, and as an example, a QR code can be used. The code image display device 1 displays and outputs this code image (S4).

  The image display device 2 captures the displayed code image (S5), decodes the captured code image, and reads document specifying information represented as the code image (S6). The image display device 2 transmits the document identification information read here to the code image display device 1, and requests information representing the contents of the document identified by the document identification information (S7).

  When the code image display device 1 receives the document specifying information from the image display device 2, the code image display device 1 reads information representing the content of the document selected in the process S2. Information representing the contents of the read document is distributed to the image display device 2 (S8).

  In the image display device 2, information representing the contents of the distributed document is aligned with a position where the user wearing the image display device 2 views the code image displayed on the code image display device 1 through the screen 26. Is displayed on the display unit 33 (S9). As a result, the image of the document, which is the content of the acquired document, is synthesized and displayed in the range where the code image associated with the document is captured.

  In the present embodiment, a user using the image display device 2 captures the code image displayed on the code image display device 1 in an imaging unit included in the image display device 2, and represents the content of the document represented by the code image. Information is acquired and presented to the user. That is, if each user has captured the same code image displayed on the same code image display device 1, the contents of the document viewed by each user will be the same.

  Further, as illustrated in FIG. 8, when the user performs an operation on the input unit 13 superimposed on the display unit 14 on which the code image is displayed in the code image display device 1, the code image display device 1 The operation is accepted (S11). Then, the code image display device 1 determines whether the user's operation is an input of writing content or an operation of confirming the writing content, such as tracing with a pen or a finger or photographing a gesture with a camera. (S12).

  Here, when it is determined that the user's operation is an input of writing contents, the input writing contents are the document specifying information for specifying the displayed document and the writing in the code image display device 1. Is stored in association with information for identifying the user who has input the content (S13).

  In the present embodiment, the image display apparatus 2 repeatedly transmits the document specifying information read from the captured code image to the code image display apparatus 1. When the image display device 2 requests information indicating the content of the document specified by the document specifying information (S14), the code image display device 1 reads out the information indicating the content of the document selected in the process S2, and Document specifying information transmitted by the image display device 2 and information specifying the user of the image display device 2 (the code image display device 1 uses information specifying this user, for example, a device unique to the image display device 2. The information to be identified is stored in advance in association with, for example, the MAC address set in the communication unit 35, and is associated with information for identifying a device unique to the image display device 2 that is the transmission source of the document identification information The content of the writing associated with the user may be obtained by acquiring information identifying the user who is present. Then, the code image display device 1 distributes the information indicating the content of the read document and the read content of the writing to the image display device 2 (S15).

  The image display device 2 synthesizes the written contents distributed together with the information representing the contents of the distributed document to generate a combined image (S16). The synthesized image is displayed in alignment with the position where the user wearing the image display device 2 views the code image displayed on the code image display device 1 through the screen 26 (S17).

  On the other hand, when the code image display apparatus 1 determines in step S12 that the user's operation is an operation for confirming the write content, the code image display apparatus 1 uses the write content stored in the storage unit 12 as the write content. A new document is generated by synthesizing it with the content of the document specified by the document specifying information associated with (S18). Then, the code image display device 1 generates the document specifying information unique to each document for specifying the new document, and stores the newly generated document in association with the generated document specifying information in the document database. (S19). The code image display device 1 returns to the process S4 and displays a code image obtained by encoding the generated document specifying information (R).

  In addition, there may be a plurality of pieces of information indicating the contents of writing each time an operation for confirming the contents of writing is performed. In this case, the code image display apparatus 1 receives a selection of which writing content to be combined from the user. The code image display device 1 reads information indicating the content of the document specified by the document specification information transmitted by the image display device 2, and also specifies the document specification information and information for specifying the user of the image display device 2. Of the contents of writing associated with, the contents of writing selected by the user are read. The code image display device 1 distributes information representing the content of the read document and the read content of the writing to the image display device 2.

  Furthermore, in the description so far, the code image display device 1 reads out information representing the content of the document specified by the document specification information transmitted by the image display device 2, and the document specification information and the image display device 2 Of the writing contents associated with the information specifying the user, the writing contents selected by the user are read and distributed to the image display device 2. However, the present embodiment is not limited to this. For example, when an operation for sharing the written content is accepted from a user who has performed the input operation of the written content, the code image display device 1 stores the written content. Information indicating that the information is shared may be stored in association with the information. In addition, in the operation for sharing, information for specifying a user (a user to be shared) as a sharing partner may be accepted. In this case, the code image display device 1 stores information for specifying the sharing target user and information indicating that the user is shared in association with the information on the contents of writing.

  The code image display device 1 reads out information representing the content of the document specified by the document specification information transmitted by the image display device 2, and also converts the document specification information and information specifying the user of the image display device 2. Of the associated writing contents, the writing contents selected by the user and the writing contents associated with the information indicating sharing may be read and distributed. Further, when the information on the content of writing in which the information for specifying the sharing target user and the information indicating that the sharing is associated is read, the user of the image display device 2 is specified as the sharing target user. Read and distribute only when information is included.

  Since the image display device 2 requests information representing the content of the document based on the newly displayed code image, the content of the document that has been written and confirmed is displayed on the image display device 2. The Rukoto.

  In the description so far, the document database is held by the code image display device 1, but the present embodiment is not limited to this. For example, the document database may be held in a server separate from the code image display device 1 and accessed from the code image display device 1 via a network or the like. Furthermore, in an example of the present embodiment, the image display device 2 may be an information processing device provided with a camera such as a smartphone instead of the glasses type. In this case, it is not necessary to match the optical axes of the line of sight and the camera 34b, and the configuration can be simplified.

  In an example of the present embodiment, the conference identification information, the conference start time and end time identified by the identification information, and access information for enabling access to the document used in the conference are provided. A conference database recorded in association with each other may be used. That is, in this example, if access information is not used, access to information representing the contents of the document stored in the document database is not permitted. Specifically, the access information is used as a decryption key, and information representing the contents of the document is encrypted with an encryption key corresponding to the access information that is the decryption key. The code image display device 1 uses, for example, a user who participates in a meeting or a user who operates the code image display device 1 using a user name or password, or a user's biometric information (fingerprint, voice print, face and other information). ) To authenticate.

  When the user is authenticated, the code image display device 1 accepts conference identification information from the user. The code image display apparatus 1 is identified by the received identification information with reference to the current time (which can be obtained using a calendar IC provided in a normal computer or can be obtained from an NTP (Network Time Protocol) server via a network). It is determined whether the current time is included between the start time and the end time of the meeting to be performed, and if included, the associated access information is obtained and access to the information representing the content of the document is performed. The information representing the content of the document obtained by the access is distributed to the image display device 2 on the user side in response to the request.

  The access information is not limited to the decryption key, and may be profile information for accessing the document database via the wireless LAN, for example. Furthermore, in the present embodiment, when a time at which the use of the document is to be ended, such as a meeting end time, is set, the code image display device 1 displays the display unit 14 when the end time has elapsed. The display output of the code image may be stopped.

  Further, when encoding the document specifying information read by the document selection unit 41, the code image generation unit 42 further includes information unique to the code image display device 1 (an encryption key set in advance in the code image display device 1). A code image such as a QR code (JIS-X0510) or a bar code representing information encrypted using (information) may be generated.

  In this example, it is assumed that the image display device 2 stores a decryption key for decrypting information encrypted with information unique to the corresponding code image display device 1. In the process S5 of FIG. 7, the image display device 2 captures the code image representing the encrypted information, decrypts the information represented by the captured code image with the stored decryption key, and in the process S6. , Get document identification information.

  In this example, the image display device 2 holds encryption key information for performing encryption that can be decrypted by the corresponding code image display device 1. When the document request is transmitted in the process S14 of FIG. 8, the request is encrypted using the held encryption key information.

  In this case, when the code image display device 1 receives the encrypted request, the code image display device 1 tries to decode the request. If the decoding is successful here, it is determined that the request is from the corresponding image display device 2, and processing S15 for transmitting the contents of the document and the contents of writing is executed. If the decoding is not successful, the code image display device 1 ignores the request.

  According to this example, each user brings both his / her code image display device 1 and the corresponding image display device 2 to the conference, so that each user can work without seeing the contents of his / her own writing. become able to. This is because the image display device 2 of another person does not hold a decryption key for decrypting information encrypted in the code image display device 1 owned by the other person.

  In this example, the image display device 2 needs to hold a key for decryption and an encryption key. Information on these keys is generated in advance on the code image display device 1 side, and the image display device 2 may be transmitted. Specifically, the code image display device 1 uses the encryption key E1 and the corresponding decryption key D1 when it is encrypted by the user's instruction, and the encryption key E2 used for encryption by the image display device 2 and the corresponding key. The decryption key D2 to be issued is issued. A code image representing the decryption key D1 and the encryption key E2 is generated and displayed. The user causes the image display device 2 to capture the displayed code image. As a result, the image display device 2 can accept the decryption key D1 and the encryption key E2, and the code image display device 1 side holds the encryption key E1 and the decryption key D2 corresponding to each. It becomes a state.

  Further, in the description so far, the code image generated by the code image generation unit 42 of the code image display device 1 is assumed to be a code image even when viewed by humans, such as a QR code or a bar code. The code image is not limited to this, and may be any image as long as the computer can read the code. For example, an image embedded in an image that is meaningful to humans or an image that is meaningful may be used as a code image. Since such code images are widely known, such as data glyphs of Xerox Corporation, for example, detailed description thereof is omitted here.

  According to the present embodiment, it is possible to cope with time-varying documents and writing, and thus AR display with a wide usage range can be realized with relatively simple processing.

  DESCRIPTION OF SYMBOLS 1 Code image display apparatus, 2 Image display apparatus, 11,31 Control part, 12,32 Storage part, 13 Operation part, 14,33 Display part, 15,35 Communication part, 20 Frame part, 21 Rim, 22 Bridge, 23 Nose pad, 24 hinge, 25 temple, 26 screen, 30 circuit unit, 34 imaging unit, 34a pan head, 34b camera, 41 document selection unit, 42 code image generation unit, 43 code image display unit, 44 operation receiving unit, 45 Document update unit, 46 Update control unit, 47 Document transmission unit, 51 Code image acquisition unit, 52 Decode unit, 53 Document acquisition unit, 54 Composite display unit

Claims (5)

A code image display device and an image display device,
The code image display device includes:
Display means for displaying and outputting a code image associated with the document;
An acceptance means for accepting the user's operation;
Updating means for updating a document related to the displayed code image in accordance with the accepted operation;
Control means for generating a code image related to the updated document and displaying the code image on the display means;
The image display device includes:
Means for capturing a code image displayed by the code image display device;
Means for obtaining a document associated with the captured code image;
A synthesized display unit that synthesizes and displays the acquired document in a captured range of a code image associated with the document;
A code image processing system. Display means for displaying and outputting a code image associated with the document;
An acceptance means for accepting the user's operation;
Updating means for updating a document related to the displayed code image in accordance with the accepted operation;
Control means for generating a code image related to the updated document and displaying the code image on the display means;
A code image display device comprising: Means for imaging a code image display device that displays and outputs a code image associated with a document;
Means for obtaining a document associated with the imaged code image displayed by the code image display device;
A synthesized display unit that synthesizes and displays the acquired document in a captured range of a code image associated with the document;
An image display apparatus. Computer
Display means for displaying and outputting a code image associated with the document;
An acceptance means for accepting the user's operation;
Updating means for updating a document related to the displayed code image in accordance with the accepted operation;
Control means for generating a code image related to the updated document and displaying the code image on the display means;
Program to function as. Computer
Means for imaging a code image display device that displays and outputs a code image associated with a document;
Means for obtaining a document associated with the imaged code image displayed by the code image display device;
A synthesized display unit that synthesizes and displays the acquired document in a captured range of a code image associated with the document;
Program to function as.

Images