CN103577071A - Product usage instruction display system and method - Google Patents

Abstract

A product instruction manual display system and method, the method comprising: obtaining the product model and accessory item selected by the user to be viewed, and obtaining the contents of the instruction manual of the accessory item; acquiring the image of the accessory item captured by the camera device of the handheld device , and make the captured image be located in the preset detection area of the display screen of the handheld device; compare the image in the detection area with all accessory images in the product image sample database, and determine an accessory that matches the captured image Image; when a matching accessory image is found, the content of the instruction manual of the accessory item is displayed on the display screen in the form of augmented reality. Utilizing the invention, the product instruction manual that the user needs to browse can be displayed in an electronic form.

Description

Product instruction manual display system and method

technical field

The invention relates to a system and method for displaying product instruction manuals, in particular to a system and method for displaying product instruction manuals on the screen of a handheld device.

Background technique

When users need to understand the functions of a certain product, they need to read the product instruction manual in paper. Since the product may be sold to many different countries or regions, the manufacturer will print multiple languages in the product instruction manual to increase the convenience of sales operations. .

However, when users read product instruction manuals, they often only read the language version that they are familiar with, which not only causes inconvenience for users to browse, but also causes waste of printing costs and resources. At the same time, paper-based product instruction manuals are also prone to loss due to improper preservation, making traditional product instruction manuals easy to cause trouble and inconvenience for users to browse.

Contents of the invention

In view of the above, it is necessary to provide a product instruction manual display system, which can electronically display the product instruction manual that users need to browse.

In view of the above, it is also necessary to provide a method for displaying product instruction manuals, which can electronically display the product instruction manuals that users need to browse.

A product instruction manual display system, applied to handheld devices, the system includes: a first acquisition module, used to acquire the product model and accessory item selected by the user to be viewed, and acquire the content of the instruction manual of the accessory item; the second acquisition module The module is used to obtain the image of the accessory item captured by the camera device of the handheld device, and make the captured image be located in the preset detection area of the display screen of the handheld device; the image comparison module is used to compare the images within the detection area The image and all the accessory images in the product image sample database are used to determine an accessory image that matches the captured image; the display module is used to expand the content of the instruction manual of the accessory item when a matching accessory image is found. The augmented reality mode is displayed on the display screen.

A method for displaying an instruction manual for a product, which is applied to a handheld device. The method includes: a first obtaining step, obtaining a product model and an accessory item selected by a user to be viewed, and obtaining the contents of the instruction manual for the accessory item; a second obtaining step, Obtain the image of the accessory item captured by the camera device of the handheld device, and make the captured image located in the preset detection area of the display screen of the handheld device; the image comparison step is to compare the image in the detection area with the product image sample For all accessory images in the database, determine an accessory image that matches the captured image; display step, when a matching accessory image is found, display the content of the instruction manual of the accessory item on the display in the form of augmented reality on the screen.

Compared with the prior art, the described product instruction manual display system and method can display the product instruction manual that the user needs to browse in an electronic form (such as the form of augmented reality), effectively avoiding the traditional paper-based product instruction manual. In the event of loss, it also provides users with a more intuitive way to browse and obtain instruction information for related products.

Description of drawings

Fig. 1 is a schematic diagram of the application environment of the product instruction manual display system of the present invention.

Fig. 2 is a functional block diagram of the product instruction manual display system of the present invention.

Fig. 3 is a flow chart of the method for displaying product instruction manuals of the present invention.

FIG. 4 is a schematic diagram of the product image sample database in the present invention.

Fig. 5 is a schematic diagram of automatically obtaining product items by scanning a product barcode.

6A and 6B are schematic diagrams of preset detection areas.

FIG. 7 is a schematic diagram of calculating the similarity between the image in the preset detection area and each accessory image in the product image sample database.

8A and 8B are diagrams showing examples of augmented reality display.

Description of main component symbols

Handheld devices 2 display screen 20 camera device twenty two memory twenty three Product instruction manual display system twenty four Processor 25 Product Image Sample Database 30 detection area 40 The first acquisition module 240 The second acquisition module 241 Image comparison module 242 display module 243

Detailed ways

As shown in FIG. 1 , it is a schematic diagram of the application environment of the product instruction manual display system of the present invention. In this embodiment, the product instruction manual display system 24 runs in a handheld device 2 . The handheld device 2 also includes a display screen 20 , a camera 22 , a memory 23 and a processor 25 connected through signal lines and data lines. In this embodiment, the handheld device 2 is a smart phone. The display screen 20 may be a resistive touch screen or a capacitive touch screen.

The camera device 22 is used to capture images of product accessories that the user needs to check, and store the captured images in the memory 23 .

The memory 23 is used to store the program code of the product manual display system 24 and the product image sample database 30 downloaded from the back-end host. The product image sample database 30 is used to store accessory images of different products and the instruction manual for each accessory, as shown in FIG. 4 , the product image sample database 30 includes, but is not limited to, product models (such as DVDR800) , accessory items (such as the host), accessory images, and instruction manuals for each accessory (such as button functions, circuit installation, etc.).

In this embodiment, the product image sample database 30 is stored in a back-end host, and the handheld device 2 can be connected to the back-end host through a network. It should be noted that the product image sample database 30 does not record the accessory image itself, but records the storage address of the accessory image, such as E:\Template\DVDR800\Image\HostObverse.jpg. Similarly, the product image sample database 30 does not record the specific content of each accessory instruction manual, but records the storage address of each instruction manual, such as E:\Template\DVDR800\Manual\HostObverse.txt.

In this embodiment, the product instruction manual display system 24 is downloaded from the backend host through the built-in network module of the handheld device 2 and installed into the handheld device 2 . In other embodiments, the product image sample database 30 may not be downloaded to the handheld device 2, and the handheld device 2 may access the product image sample database 30 stored in the backend host through a network module. The product instruction manual display system 24 is used to display the product accessory instruction manual that the user needs to browse in an electronic form (such as an augmented reality format), and the specific process is described below.

In this embodiment, the product instruction manual display system 24 can be divided into one or more modules, and the one or more modules are stored in the memory 23 and configured to be processed by one or more processors (this embodiment is a processor 25) to complete the present invention. For example, referring to FIG. 2 , the product instruction manual display system 24 is divided into a first acquisition module 240 , a second acquisition module 241 , an image comparison module 242 and a display module 243 . The module referred to in the present invention is a program segment that completes a specific function, and is more suitable for describing the execution process of software in the handheld device 2 than a program. The functions of each module will be described in detail in the flow chart of FIG. 3 .

As shown in FIG. 3 , it is a flow chart of the method for displaying the product instruction manual of the present invention.

In step S10, the first obtaining module 240 obtains the product model and accessory items to be checked. In this embodiment, two methods are provided to obtain the product model to be viewed.

Method 1, manual selection, the handheld device 2 displays a drop-down list on the display screen 20, the drop-down list includes a variety of models of products, when the user selects a certain model of product, the first acquisition module 240 determines the product selected by the user Model is the product model to be checked.

Method two, automatic selection, as shown in Figure 5, the user takes a barcode image of the product, the first acquisition module 240 recognizes the model of the product from the barcode image, and lists the product model on the display screen 20, including All accessory items. For example, the user can select "A" in the list to select the image of the front of the host.

In this embodiment, when the user selects an accessory item, the first acquisition module 240 will acquire the content of the instruction manual for the accessory item according to the storage address of the instruction manual corresponding to the accessory item. In other embodiments, instead of manually selecting an accessory item, the user may obtain the instruction manual corresponding to the accessory item through the accessory image determined in the subsequent step S12. The advantage of using manual selection of accessory items is that the accurate content of the instruction manual can be obtained.

In step S11 , the second acquisition module 241 acquires the image of the accessory item captured by the camera 22 , and makes the captured image located within the preset detection area 40 of the display screen 20 . Specifically, as shown in FIG. 6 , after the accessory items are determined, the second acquisition module 241 will prompt the user to take pictures of the product accessories to be checked, and the user can properly adjust the lens of the camera 22 so that the captured accessory images are displayed on the display screen. 20 within the preset detection area 40 .

In this embodiment, the second acquisition module 241 will adjust the shape and position of the detection area 40 on the display screen 20 (such as a square or rectangular area) according to the product model and the shape of the accessory item selected by the user, or prompt The user adjusts the orientation of the handheld device 2 (such as portrait orientation or landscape orientation), so that the user can operate and display the content of the instruction manual of related product accessories in an optimal browsing manner. For example, if the user selects accessory A in FIG. 5 (that is, the front image of the DVDR800), the detection area 40 is as shown in FIG. 6A. If the user selects accessory B in FIG. 5 (that is, the remote control image of the DVDR800), The detection area 40 is shown in FIG. 6B.

In step S12 , the image comparison module 242 compares the image in the detection area 40 with all accessory images in the product image sample database 30 to determine an accessory image that matches the captured image.

Specifically, the image comparison module 242 calculates the similarity between the image in the detection area 40 and each accessory image in the product image sample database 30, and determines an accessory image with a similarity greater than a preset value as a matching accessory. image. In this embodiment, the preset value is 95%. For example, assuming that the captured image is as shown in FIG. 6A , the calculated similarity value is as shown in FIG. 7 . It can be seen from FIG. 7 that the most similar accessory to the image in the detection area 40 in FIG. 6A is the front image of the DVDR800, with a similarity of 98%. Among them, many methods in the prior art can be used to calculate the similarity between two images, such as the US patent application published on July 15, 2010, the publication number is US20100177967A1.

In step S13, the image comparison module 242 determines whether a matching accessory image is found. If no matching accessory image is found, the process returns to step S11, prompting the user to re-shoot the product accessory to be viewed. If a matching accessory image is found, go to step S14.

In step S14, the display module 243 displays the content of the instruction manual of the accessory item on the display screen 20 in the form of Augmented Reality (AR for short).

Specifically, if the user manually selects an accessory item in step S10 , the display module 243 displays the manual content of the accessory item manually selected by the user on the display screen 20 in an augmented reality manner. If the user does not manually select an accessory item in step S10 , the display module 243 displays the content of the instruction manual of the accessory item corresponding to the matched accessory image on the display screen 20 in an augmented reality manner.

Among them, augmented reality is a technology that can calculate the position or angle of the image captured by the camera device 22, and additionally add the corresponding image, so as to achieve the effect of interacting with the virtual world on the display screen 20 in the real world. .

For example, as shown in FIG. 8A , the display screen 20 displays the real-time images of the accessory items captured by the camera 22. At the same time, the content of the instruction manual of the accessory items is displayed on the display screen 20 through augmented reality. Refer to the annotation box content inside. When the user selects a comment box, the detailed function of the button corresponding to the comment box will be further displayed on the display screen 20 . Referring to FIG. 8B , when the user selects the annotation box corresponding to the "Volume Adjustment" button, the detailed function of the "Volume Adjustment" button will be displayed.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention without limitation. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be Modifications or equivalent replacements can be made without departing from the spirit and scope of the technical solutions of the present invention.

Claims (10)

1. A product instruction manual display system applied to handheld devices, characterized in that the system includes: The first obtaining module is used to obtain the product model and accessory item selected by the user to be viewed, and obtain the content of the instruction manual of the accessory item; The second acquisition module is used to acquire the image of the accessory item captured by the camera device of the handheld device, and make the captured image be located in the preset detection area of the display screen of the handheld device; The image comparison module is used to compare the image in the detection area with all the accessory images in the product image sample database, and determine an accessory image that matches the captured image; and The display module is configured to display the content of the instruction manual of the accessory item on the display screen in the form of augmented reality when a matching accessory image is found. 2. The product instruction manual display system according to claim 1, wherein the first acquisition module is further configured to: automatically identify the product model to be checked from the product barcode image captured by the camera device. 3. The product instruction manual display system according to claim 1, wherein the second acquisition module is further configured to: adjust the detection area on the display screen according to the product model and the shape of the accessory item selected by the user. shape and position. 4. The product instruction manual display system according to claim 1, wherein the image comparison module determines the matched accessory image includes: Calculate the similarity between the image in the detection area and each accessory image in the product image sample database, and determine an accessory image with a similarity greater than a preset value as a matching accessory image. 5. The product instruction manual display system according to claim 1, wherein the display module is further configured to: display the contents of the instruction manual of the accessory item corresponding to the matched accessory image in an augmented reality manner on the display screen. 6. A method for displaying product instruction manuals, applied to handheld devices, characterized in that the method comprises: The first obtaining step is to obtain the product model and accessory item selected by the user to be viewed, and obtain the content of the instruction manual of the accessory item; The second acquisition step is to acquire the image of the accessory item captured by the camera device of the handheld device, and make the captured image located in the preset detection area of the display screen of the handheld device; an image comparison step, comparing the image in the detection area with all the accessory images in the product image sample database, and determining an accessory image that matches the captured image; and In the displaying step, when a matching accessory image is found, the content of the instruction manual of the accessory item is displayed on the display screen in the form of augmented reality. 7. The method for displaying product instruction manuals according to claim 6, further comprising: automatically identifying the product model to be viewed from the product barcode image captured by the camera device. 8. The method for displaying product instruction manuals according to claim 6, further comprising: adjusting the shape and position of the detection area on the display screen according to the product model and the shape of the accessories selected by the user . 9. The method for displaying product instruction manuals according to claim 6, wherein the image comparison step comprises: Calculate the similarity between the image in the detection area and each accessory image in the product image sample database, and determine an accessory image with a similarity greater than a preset value as a matching accessory image. 10. The method for displaying product instruction manuals according to claim 6, further comprising: displaying the contents of the instruction manuals of the accessory item corresponding to the matching accessory image on the display screen in the form of augmented reality superior.

Images