CN105413198A - AR children early education building block system - Google Patents

Abstract

An AR early education building block system for children, which belongs to the field of early education toys for children and comprises building blocks and physical equipment; the physical equipment comprises a camera, an identification module, an error correction module, a processing module, a display device and a memory; the error correction module comprises a judgment unit and a synthesis unit, wherein the synthesis unit is suitable for integrating the image of each building block and the position information of the image of each building block into a memory, the judgment unit is suitable for judging the position information of each building block, and when the position information of the building block is wrong, a virtual prompting diagram for prompting the position error is displayed on the display device; calling a processing module when the position information of the building block is correct; the processing module is adapted to obtain a virtual physical model. Every time the jigsaw is successful, the picture can be changed into a three-dimensional 3D animation through the AR technology. The function of intelligently identifying and judging whether the arrangement of the jigsaw puzzle is correct is accompanied with the assistance of an indirect prompt function, and a space for independent thinking is reserved for children. Each group of AR animations also has an interaction function, and instant interaction is realized.

Description

AR early childhood education building block system

technical field

The invention relates to an AR children's early education building block system, which belongs to the field of children's early education toys.

Background technique

At present, children's early education toys have building blocks. By putting the building blocks into a certain shape or pattern, it increases interest and arouses children's interest and exercises children's hands-on ability. However, children are very random when splicing, and encourage them after they are spliced correctly. At present, AR toys include Lego's AR toys, which recognize the appearance of each building original and display the final superimposed AR image. Although this kind of AR toy is directional, there is no prompt and guidance when it is assembled incorrectly, and it lacks interaction with children, and young children aged 3-6 cannot complete such complex toy splicing independently, which will make children lose interest.

Contents of the invention

In view of the defects in the existing technical solutions, the present invention provides an AR building block for early childhood education, which is composed of a virtual program module and a solid building block, and the entity is composed of nine building blocks. level of exquisite picture. AR (Augmented Reality) technology is implanted on the basis of the traditional Jiugongge puzzle building blocks. After installing the "AR Puzzle" application through the smart device, turn on the smart device and set the camera to scan the puzzle. Technology turns the drawn picture into a three-dimensional 3D animation. In addition, the application also has the functions of intelligent identification and judging whether the arrangement of the puzzle is correct, and it is accompanied by an indirect prompt function.

In order to achieve the above object, the technical solution adopted in the present invention is an AR children's early education building block system, including at least two building blocks and physical equipment; the physical equipment includes a camera, an identification module, an error correction module, a processing module, a display device and a memory The two building blocks form at least one complete picture, the camera is suitable for capturing images combined with the building blocks, and the recognition module is suitable for the image of each building block and the image of the corresponding building block Binding of marking information; the marking information includes basic marking points and virtual prompting maps; the error correction module includes a judgment unit and a synthesis unit, and the synthesis unit is suitable for integrating the image of each building block and the position information of each building block image To the memory, the judging unit is suitable for judging the position information of each building block, and when the position information of the building block is wrong, a virtual prompting picture indicating the wrong position is displayed on the display device; when the position information of the building block is correct, the processing module is called; the processing module is suitable for Obtain the virtual physical model, and after the simulation, superimpose the real image and the virtual information, and display the superposition result on the display device. The position information of each building block refers to the vertical spacing, left-right spacing, angle and position between the basic marker points of each building block image in the coordinates of the virtual space. The judging mode of the judging module is to identify the position information of a building block image, integrate its image and position information and add it to the memory, judge whether the building block is consistent with other building block images, and then identify the position information of a building block image , and cycle in turn until there are no unrecognized building blocks. If they are consistent, the position information is correct, and if they are inconsistent, the position information is wrong. The virtual cue map corresponds to each face of each building block. The synthesis unit is a VuforiaAR recognition unit; the processing module is a VuforiaAR recognition unit. There are nine building blocks, and each building block has six faces, and each building block takes one of the six faces to form a complete picture, and the six faces of the nine building blocks form a total of six pictures complete picture.

There are 54 basic marking points, and each face of each building block corresponds to one basic marking point.

When the virtual prompting diagram prompts that the pictures are arranged incorrectly, the position information is changed by turning over the building block until the prompt is correct; the virtual prompting diagram corresponds to each face of each building block.

The physical device also includes a gyroscope. When the camera is separated from the building block, the gyroscope is used to record the change of the basic marker point. If there is no change, the AR animation interaction function is maintained; if there is a change, the error correction module is called.

The physical device is a mobile phone or a PAD.

The position refers to the position from the basic mark point of any building block to the reference mark point. The reference mark point refers to the basic mark point of the first block image recognized. The position of each block image is in the complete picture where it is located. The position in is certain. For example: 54 basic markers correspond to 54 building blocks, forming 6 complete pictures, with serial numbers 1 to 9 as a group, 10 to 18 as a group, 19 to 27 as a group, and 28 to 36 as a group , 37 to 54 are a group, the same group of basic marker points corresponds to the same complete picture, in the same group of basic marker points, each point has its own position, and each complete picture has its own 9 positions.

Correct position information refers to judging four aspects in turn, and it is correct when all four aspects are satisfied: 1) Whether the captured building block image is the same complete picture, including whether the number of building blocks is 9, that is, whether it is complete ; It also includes whether the basic markers corresponding to all the captured building block images fall in the same group of basic markers, that is, whether they are the same picture; when the number of building blocks is 9 and they fall in the same group of basic markers, it means It's the same complete picture. After it is correct, proceed to the next step of judgment.

2) Whether the position of each building block image in the same picture is correct. The basic marker points of all building block images are correct when the position of the same group of basic marker points is the specified position. After it is correct, proceed to the next step of judgment.

3) In the same picture, whether the angle of the basic marker points of each building block image in the virtual coordinate system is within the preset range. After it is correct, proceed to the next step of judgment.

4) In the same picture, whether the distance between the basic marking points of each building block is within the range. The range is that the distance between the basic marker points of two adjacent building block images is greater than or equal to the width of the building block, and less than the preset width.

After adopting the above method, it has the following beneficial effects compared with the prior art method: every time the puzzle is successful, the drawn picture can be turned into a three-dimensional 3D animation through AR technology. In addition, the application also has the function of intelligent recognition and judging whether the arrangement of the puzzle is correct, and it is accompanied by indirect prompt function assistance, which reserves the space for children to think independently. In addition, each group of AR animations is also equipped with interesting interactive functions, allowing children to interact in real time. While building puzzle blocks, AR puzzle not only allows children to enjoy the fun of building puzzle blocks, but also can improve children's logical thinking ability, exercise image memory and imagination, and cultivate hand-eye coordination. This product is mainly suitable for children aged 3-6.

Description of drawings

Figure 1. Principle flow chart;

Figure 2, a schematic diagram of a building block;

Figure 3. Nine blocks form a complete picture.

detailed description

After entering the program, turn on the camera and align the recognition frame with the pattern. It must be used in a moderate and stable environment, and the optimal distance between the pattern and the camera is 15-20cm. When scanning building blocks, the animation effect will only appear when nine building blocks form a complete pattern and the pattern position information of each building block is correct. Correct position information refers to judging four aspects in turn, and it is correct when all four aspects are satisfied: 1) Whether the captured building block image is the same complete picture, including whether the number of building blocks is 9, that is, whether it is complete ; It also includes whether the basic markers corresponding to all the captured building block images fall in the same group of basic markers, that is, whether they are the same picture; when the number of building blocks is 9 and they fall in the same group of basic markers, it means It's the same complete picture. After it is correct, proceed to the next step of judgment.

4) Whether the position of each building block image in the same picture is correct. The basic marker points of all building block images are correct when the position of the same group of basic marker points is the specified position. After it is correct, proceed to the next step of judgment.

5) In the same picture, whether the angle of the basic marker points of each building block image in the virtual coordinate system is within the preset range. After it is correct, proceed to the next step of judgment.

4) In the same picture, whether the distance between the basic marking points of each building block is within the range. The range is that the distance between the basic marker points of two adjacent building block images is greater than or equal to the width of the building block, and less than the preset width.

For example, if a building block is a first-level object, when the mobile phone recognizes 9 of the 54 basic marker points, it will display a second-level sub-object, which is a virtual prompt map, and at the same time judge the placement position of the building block. The correctness of the release direction, etc., that is, to judge whether the position information is correct or not. If the position and direction of the 9 pieces are all correct, then the 3D model animation will appear.

After the animation effect appears, you can move the observation device and enjoy the animation away from the marking points on the building blocks. If you want to return the animation to the initial position, just align the AR animation with the marking points on the building block pattern.

If the location information is wrong, a virtual prompting image indicating the wrong location will be displayed on the display

1. For example, when calculating the positional relationship of each piece, if the position and placement direction of the 8 pieces are the same, then the other piece must be wrong, and the direction of the hint picture displayed by this virtual hint map (secondary sub-object) will be the same as The other 8 blocks are different. The real-world and virtual world information of the VuforiaAR recognition unit integrates these information, and calculates the position of each piece in real time, the direction of each piece and the other eight pieces, and whether each piece belongs to the same group of puzzles as the other eight pieces. This will serve as a reminder. Correcting Mistakes Flipping according to the intuitive visual prompts of the virtual prompt map (secondary sub-object) can correct mistakes and complete the correct placement of the jigsaw puzzle, thereby realizing the function of real-time prompting. Then add the positioning virtual object model in the three-dimensional coordinate space, and then superimpose after simulation, and apply the virtual information to the real world, so that the real environment and virtual objects can be superimposed on the same screen or space in real time and exist simultaneously on the display screen. After the AR animation appears, the outline of the 3D animation model is obtained through the rendering of the VuforiaAR recognition unit, and the rendering result is viewed on the screen of the physical device. If the camera is separated from the first-level object (building block), the gyroscope function of the physical device will be called, and the AR animation will not be lost, and the interactive function of the AR animation will be maintained.

If you want to switch between different building block screens, you need to click the "Reset" button to exit the current AR animation, and then scan the building block pattern on the other side.

After the animation is displayed, in order to increase the experience effect, if the physical device with the camera is not irradiated on the building block, that is, when it is out of the marker map (building block), start the mobile phone gyroscope function, which will not affect the experience effect. If During the process of detachment, the marker map (building block) is recognized again, and the 3D model animation returns to the starting position. In this way, the user can interact even without a marker map.

The VuforiaAR recognition unit refers to Qualcomm Vuforia, which can be downloaded from the following website platform: https://developer.vuforia.com/.

Claims (10)

1.AR children early education modular system, is characterized in that: comprise at least two building blocks and physical equipment; Described physical equipment comprises camera, identification module, correction module, processing module, display device and memory; Described two building blocks are at least combined into a secondary complete picture, and described camera is applicable to catch the image combined with described building block, and the image that described identification module is applicable to each building block is bound with the label information of the image of corresponding building block respectively; Described label information comprises basic gauge point and virtual cue figure; Described correction module comprises judging unit, synthesis unit, the positional information of image and each building block image that synthesis unit is applicable to integrated each building block is to memory, judging unit is applicable to judge each building block positional information, when building block positional information mistake on display device the virtual cue figure of display reminding positional fault; Processing module is called when building block positional information is correct; Processing module is applicable to obtain physical vlan model, is superposed by true picture, and show stack result after analog simulation with virtual information on display device.

2. AR children early education modular system according to claim 1, it is characterized in that: the positional information of described each building block refers in the coordinate of Virtual Space, distance between the upper and lower, between left and right distance, angle and position between the basic gauge point of each building block image.

3. AR children early education modular system according to claim 1, it is characterized in that: the judgment mode of described judge module is the positional information of identification one block of building block image, by its image and positional information integrated after add memory to, judge that whether this building block is consistent with other building block images, identify the positional information of one block of building block image again, circulate successively, until the building block do not identified, represent time consistent that positional information is correct, time inconsistent, represent positional information mistake.

4. AR children early education modular system according to claim 1, is characterized in that: described virtual cue figure is corresponding with each of each building block.

5. AR children early education modular system according to claim 1, is characterized in that: described synthesis unit is VuforiaAR recognition unit; Described processing module is VuforiaAR recognition unit.

6. AR children early education modular system according to claim 1, it is characterized in that: described building block has nine, each building block has six faces, and nine building block faces of respectively getting in six faces are combined into a complete picture, and nine building blocks, six faces are combined into altogether six secondary complete pictures.

7. AR children early education modular system according to claim 1, is characterized in that: described basic gauge point has 54, each correspondence basic gauge point of each building block.

8. AR children early education modular system according to claim 1, is characterized in that: when described virtual cue figure points out picture arrangement mistake, changes positional information by upset building block, until prompting is correct; Described virtual cue figure is corresponding with each of each building block.

9. AR children early education modular system according to claim 1, it is characterized in that: described physical equipment also comprises gyroscope, when camera departs from building block, gyroscope is for recording the change of basic gauge point, if not change, keeps AR animation interaction function; If changed, call correction module.

10. AR children early education modular system according to claim 1, is characterized in that: described physical equipment is mobile phone or PAD.