WO2020105222A1 - Training teaching material presenting system and training teaching material presenting method - Google Patents
Training teaching material presenting system and training teaching material presenting methodInfo
- Publication number
- WO2020105222A1 WO2020105222A1 PCT/JP2019/029595 JP2019029595W WO2020105222A1 WO 2020105222 A1 WO2020105222 A1 WO 2020105222A1 JP 2019029595 W JP2019029595 W JP 2019029595W WO 2020105222 A1 WO2020105222 A1 WO 2020105222A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- work
- training
- information
- display screen
- display
- Prior art date
Links
- 238000012549 training Methods 0.000 title claims abstract description 366
- 238000000034 method Methods 0.000 title claims abstract description 89
- 238000012423 maintenance Methods 0.000 claims abstract description 92
- 230000008569 process Effects 0.000 claims abstract description 27
- 238000004088 simulation Methods 0.000 claims abstract description 17
- 230000033001 locomotion Effects 0.000 claims description 69
- 230000004931 aggregating effect Effects 0.000 claims 2
- 238000012545 processing Methods 0.000 description 63
- 230000006870 function Effects 0.000 description 43
- 238000004891 communication Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 9
- 230000036541 health Effects 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 6
- 230000007704 transition Effects 0.000 description 6
- 238000002360 preparation method Methods 0.000 description 4
- 230000002776 aggregation Effects 0.000 description 3
- 238000004220 aggregation Methods 0.000 description 3
- 238000011960 computer-aided design Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000012905 input function Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000008685 targeting Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
- G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
Definitions
- the present invention relates to a training material presentation system and a training material presentation method for generating and presenting training materials including 3DCG used for education and exercises concerning maintenance work of various devices without an actual machine.
- the teaching material basic data corresponding to the target work is edited by moving, adding, deleting, or processing the teaching material object data extracted from the previously stored teaching material basic data.
- a system including a teaching material editing device is known (for example, see Patent Document 1).
- the work content may involve disassembling or assembling the device (target device) that is the target of the maintenance work.
- target device the device that is the target of the maintenance work.
- Patent Documents 1 and 2 the target of the maintenance work is specialized at the plant site, and it is considered that the training of the maintenance work is performed for those who have no knowledge of the plant. I didn't.
- the present invention has been made to solve such a conventional problem, and a training material presentation system and training capable of easily and accurately generating a training material reflecting a maintenance work procedure of a target device without an actual machine.
- the purpose is to provide a teaching material presentation method.
- the training material presentation system provides a training material including a three-dimensional image related to maintenance work of a target device (401) with a work space display and a trainee (4). ) And a training teaching material presentation system (1) for changing the presentation content according to the operation input of the simulated work corresponding to each stage of the maintenance work, and acquiring the information of the operation input of the simulated work.
- a first display screen (70A) that displays a specific tool required for any process
- a second display screen (70B) that displays a work target part of a specific process among the plurality of operation target images, and the specific
- each screen of the first to third display screens requires a selection operation of a tool or a work target site or an operation input to a selected work target site. Since it includes an instruction display and an operation target image display area capable of performing a selection operation or a simulated work operation input of a specific operation target image corresponding to the display content, it is possible to respond to a user operation input on each screen. The contents displayed on the screen will be changed sequentially, and the system will be able to grasp the work procedure easily and accurately without using an actual machine.
- each of the first display screen, the second display screen, and the third display screen has an instruction display area for requesting the selection operation or the operation input ( 701), a specific operation target image corresponding to the display content of the instruction display area among the plurality of operation target images, and an operation input of the selection operation or the simulated work on each display screen by the instructor or the trainee And an operation image display area (702) for displaying the contents of the above.
- the training material presentation system according to claim 2 of the present invention can easily and quickly generate the training material and the exercise material according to the required maintenance work procedure based on the model operation input of the instructor.
- the information input device is configured to display the operation target image including the three-dimensional image and display the operation target image, and the instructor to perform the operation.
- Designation for designating a work as a reference of the maintenance work for the target image, a work target site in the operation target image, the tool, and a movement of the tool, and a motion of the target site according to the movement of the tool Means (106), and the output information generation device includes the work target portion, the tool, the movement of the tool, and the movement of the target portion in the reference work designated by the designating means. It is characterized by having a training material generating means (212) for generating a training material (222) having a work procedure reflecting the above.
- the training material presentation system facilitates the training material including the three-dimensional image of the target device based on the information of the operation input in the simulation work by the simulator work. Can be generated quickly.
- the display output device is a mode for selecting an education mode or an exercise mode as a training mode performed by displaying each screen of the first to third display screens.
- the information input device includes a selection unit (306), the information input device inputs instruction information for guiding the trainee during the training, and the training in the education mode. Only when the explicit part specifying means (106) for specifying the part to be clearly specified to the trainee and the part specified in the reference work during the training in the exercise mode are selected, the next work step is performed. And a work stage designating means (106) for designating to proceed to (1).
- the training material presentation system in the training performed by displaying each screen of the first to third display screens on the display output device, the training without knowledge of maintenance work in the education mode.
- the person can easily receive the training, and in the exercise mode, the trainee can perform the correct simulated work to generate the optimum educational material for each mode in which the trainee can proceed to the next stage.
- the training material presentation system according to claim 5 of the present invention, the work procedure specified for each work item of the maintenance work by the simulated work of the instructor, the work target site, and each information of the tool, First management means (121) for managing as correct operation input information, the work procedure specified for each work item of the maintenance work by the simulated work of the trainee, the work target part, and the Depending on the result of comparison between the second management means (321) for managing each piece of information of the tool as the operation input information of the exercise mode, the information of the correct operation input, and the information of the operation input of the exercise mode.
- Determination means (300) for determining the proficiency level of the trainee, and recording means (321) for recording the comparison result in the training in the exercise mode in the training material unit in association with the trainee.
- a totaling means (312) for totaling the comparison result for each work item in units of the training material, and a display control means (300) for displaying the comparison result on the display screen.
- the training material presentation system in the training material execution terminal 30, according to the training using the first to the third display screen based on the training material, the trainee in the training. Skill management can be realized.
- the method for presenting training material according to claim 6 of the present invention provides a training material including a three-dimensional image related to maintenance work of a target device (401) together with a work space display and a trainee (4). ), And a method for presenting training material in which the content of presentation is changed according to the operation input of the simulated work corresponding to each stage of the maintenance work, the information input step of acquiring information of the operation input of the simulated work.
- a plurality of operation target images (400) capable of displaying and selectively operating the work target part (405) of the maintenance work and the tools (404a, 404b, 404c, 404d) used for the maintenance work.
- each screen of the first to third display screens requires a selection operation of a tool or a work target site or an operation input to a selected work target site. Since it includes an instruction display and an operation target image display area capable of performing a selection operation or a simulated work operation input of a specific operation target image corresponding to the display content, it is possible to respond to a user operation input on each screen. The contents displayed on the screen are changed sequentially, and it becomes possible to easily and accurately grasp the work procedure without using an actual machine.
- the present invention can provide a training material presentation system and a training material presentation method that can easily and accurately generate a training material that reflects the maintenance work procedure of the target device without an actual machine.
- FIG. 2 It is a block diagram of the training material presentation system which concerns on embodiment of this invention. It is a block diagram of the operation acquisition terminal shown in FIG. It is a block diagram of the work information recording database shown in FIG. 2 is a configuration diagram of a training material generation server shown in FIG. 1.
- FIG. It is a block diagram of the template database shown in FIG. It is a block diagram of the training material execution terminal shown in FIG. It is a block diagram of the execution information recording database shown in FIG.
- FIG. 1 It is a figure which shows the structure (education mode) of the screen display of a training material execution terminal. It is a figure which shows the structure (exercise mode) of the screen display of a training material execution terminal. It is a figure which shows the structure (exercise mode) of the screen display of a training material execution terminal. It is a figure which shows the structure (exercise mode) of the screen display of a training material execution terminal. It is a figure which shows the structure (exercise mode) of the screen display of a training material execution terminal. It is a figure which shows the example of a display (education mode) of the screen of a training material execution terminal. It is a figure which shows the example of a display of the training material execution terminal (exercise mode). It is a figure which shows the example of a display of the training material execution terminal (exercise mode).
- training material presentation system 1 An embodiment of the training material presentation system 1 according to the present invention will be described below with reference to the drawings.
- a case will be mainly described in which a training material for performing maintenance work training of a target device is generated and presented, but the present invention is intended for maintenance work training for a system or equipment. It can also be applied when generating and presenting training materials.
- the training material presentation system 1 includes a motion acquisition terminal 10, a training material generation server 20, and a training material execution terminal 30, which are connected to a communication network 40.
- the operation acquisition terminal 10 has a function of acquiring information on simulated work related to maintenance of the target device 401 (see FIG. 9) performed by the instructor 3 and outputting the acquired information to the training material generation server 20.
- the simulation work performed by the instructor 3 for example, a three-dimensional image of the target device 401 is displayed, and then an input operation is performed, so that the three-dimensional image can be appropriately moved and maintained in light of the maintenance work of the target device 401. Examples include inputting characters for instructing work at each stage of work, inputting voice information using a microphone, and the like.
- the motion acquisition terminal 10 acquires an operation input (text information, voice information, etc.) in the simulated work of the instructor 3.
- the operation acquisition terminal 10 may have a function of photographing the maintenance work performed by the instructor 3 on the maintenance target device 401 (actual machine) and capturing the photographed image as a simulated work.
- the training material generation server 20 receives and stores, from the operation acquisition terminal 10, the operation input information acquired by the operation acquisition terminal 10, for example, the simulated work performed by the instructor 3.
- the training material generation server 20 uses the authoring function for generating multimedia contents as training material including the three-dimensional image of the target device 401 based on the stored information, and the generated training material as the training material. It has a function of delivering to the execution terminal 30 and presenting it to the trainee 4 together with the work space display.
- the training material execution terminal 30 is an information terminal operated by the trainee 4, and displays the training material distributed from the training material generation server 20 together with the work space and while accepting the input operation by the trainee 4.
- the training for the maintenance work of the target device 401 using the training material is executed.
- the motion acquisition terminal 10, the training material generation server 20, and the training material execution terminal 30 are configured by an information processing device such as a PC (personal computer).
- the motion acquisition terminal 10 and the training material execution terminal 30 may be configured with mobile terminals such as smartphones and tablets.
- the operation acquisition terminal 10, the training material generation server 20, and the training material execution terminal 30 all have a three-dimensional graphic data drawing function. That is, the training material presentation system 1 positively adopts 3DCG as an educational material related to the maintenance work of the target device 401.
- the action acquisition terminal 10 includes, for example, as illustrated in FIG. 2, a control unit 100, a communication unit 101, a sensing unit 102, a recording unit 103, a recording unit 104, a display unit 105, an operation unit 106, It has a power supply unit 107, a memory 110, and a storage 120, and these units are connected by a bus 130.
- the control unit 100 is composed of a CPU (central processing unit) that controls the entire operation acquisition terminal 10.
- the communication unit 101 communicates information with the training material generation server 20 via the communication network 40.
- the sensing unit 102, the recording unit 103, and the recording unit 104 are functional units that perform processing for acquiring information on simulated work performed by the instructor to generate training materials, and operation inputs on the operation unit 106 described later, respectively. Capture, voice recording, and motion recording.
- the display unit 105 displays various kinds of information, and is composed of, for example, an LCD or the like.
- the operation unit 106 performs an operation related to input of various commands related to simulation work and the like, and includes a keyboard, a mouse, and the like.
- the power supply unit 107 supplies power necessary for the operation of the operation acquisition terminal 10.
- the memory 110 includes, for example, a ROM and a RAM, and stores various information such as a program for realizing the functional operation of the operation acquisition terminal 10.
- the memory 110 stores each program for implementing each processing unit of the motion totaling processing unit 111, the teaching material generation processing unit 112, and the information transmission / reception processing unit 113.
- Each processing unit is realized by the control unit (CPU) 100 reading each program from the memory 110 and executing the program.
- the motion totaling processing unit 111 takes in the information of the operation input in the simulated work performed by the instructor and totalizes it as the information of the motion of the simulated work.
- the teaching material generation processing unit 112 generates a teaching material to be used for generating the training teaching material based on the motions of the simulated work totaled by the motion totalization processing unit 111.
- the information transmission / reception processing unit 113 transmits / receives various kinds of information, such as information on the operation of the simulated work and teaching materials.
- the storage 120 holds a work information recording database 121 that stores, as work information, the information on the motions of the simulated work totaled by the motion totalization processing unit 111.
- the work information recording database 121 is associated with an instructor number (No.), a work procedure number (No.), a procedure number (No.), a tool number (No.) used, Information about each item such as a work handling part, an operation, a recorded moving image, and a recorded sound is stored.
- tool numbers 12 and 14 are used, and hexagon bolts 1 to 6 and screws 1 to 3 are stored as work objects using these tools.
- the motion acquisition terminal 10 having the above configuration corresponds to the information input device in the present invention.
- the display unit 105 corresponds to the display means in the present invention.
- the operation unit 106 corresponds to the designating means, the instruction information inputting means, the explicit part designating means, and the work stage designating means in the present invention.
- the work information recording database 121 corresponds to the first managing means in the present invention.
- the training material generation server 20 has, for example, as shown in FIG. 3, a control unit 200, a communication unit 201, a display unit 205, an operation unit 206, a power supply unit 207, a memory 210, and a storage 220, and each of these units is a bus. They are connected by 230.
- the control unit 200 is composed of a CPU that controls the entire training material generation server 20.
- the communication unit 201 communicates information with the motion acquisition terminal 10 and the training material execution terminal 30 via the communication network 40.
- the display unit 205 displays various kinds of information, and is composed of, for example, an LCD or the like.
- the operation unit 206 includes a keyboard, a mouse, and the like, and performs an operation related to inputting various commands.
- the power supply unit 207 supplies power required for the operation of the training material generation server 20.
- the memory 210 includes, for example, a ROM and a RAM, and stores various information such as a program for realizing the functional operation of the training material generation server 20.
- the memory 210 stores each program for realizing each processing unit of the motion totaling processing unit 211, the teaching material generation processing unit 212, and the information transmission / reception processing unit 213.
- Each processing unit is realized by the control unit (CPU) 200 reading out each program from the memory 210 and executing the program.
- the motion totaling processing unit 211 receives motion information (operation input information) in the simulated work performed by the instructor 3 received from the motion acquisition terminal 10, and training (maintenance performed by the trainee 4 received from the training material execution terminal 30 described later).
- the operation information (operation input information) of (work) is totaled and managed.
- the motion information (operation input information) in the simulated work performed by the instructor 3 is acquired from the motion totalization processing unit 111 of the motion acquisition terminal 10, and the motion of the training (maintenance work) performed by the trainee 4 is performed.
- the information (operation input information) is acquired from the later-described teaching material execution processing unit 311 of the training teaching material execution terminal 30.
- the teaching material generation processing unit 212 generates the training material based on the motions of the simulated work (information of operation input) collected by the motion collection processing unit 111 of the motion acquisition terminal 10.
- the information transmission / reception processing unit 113 transmits / receives various kinds of information such as operation information in simulated work performed by the instructor 3, operation information in training (maintenance work) performed by the trainee 4, and training materials.
- the storage 220 holds a template database 221 that stores information about templates for generating training materials and a training material database 222 that stores training materials.
- the template database 221 stores information on each item such as a progress pattern number (No.) and a screen configuration number (No.) in association with a template number (No.), as shown in FIG. There is.
- the sequence of screen configuration numbers is “1, 2, 4, ...”, “5, 7, 8 ,. . ”,“ 5, 7, 9, ... ”,“ 10, 12, ... ”Are stored.
- the training material database 222 stores training material generated using the template recorded in the template database 221.
- the training material generation server 20 having the above configuration corresponds to the output information generation device in the present invention. Further, as will be apparent from the description below, in the training material generation server 20, the learning material generation processing unit 212 corresponds to the training material generation means in the present invention.
- the storage 220 corresponds to the storage device in the present invention.
- the training material execution terminal 30 has, for example, as shown in FIG. 4, a control unit 300, a communication unit 301, a display unit 305, an operation unit 306, a power supply unit 307, a memory 310, and a storage 320, each of which is a bus. They are connected by 330.
- the control unit 300 is composed of a CPU that controls the entire training material execution terminal 30.
- the communication unit 301 communicates information with the training material generation server 20 via the communication network 40.
- the display unit 305 displays various types of information, and is composed of, for example, an LCD.
- the operation unit 306 includes a keyboard, a mouse, and the like, and performs an operation related to inputting various commands.
- the power supply unit 307 supplies power necessary for the operation of the training material execution terminal 30.
- the memory 310 includes, for example, a ROM and a RAM, and stores various kinds of information such as a program for realizing the functional operation of the training material execution terminal 30.
- the memory 310 stores each program for realizing each processing unit of the teaching material execution processing unit 311, the execution data totaling processing unit 312, and the information transmission / reception processing unit 313.
- Each processing unit is realized by the control unit (CPU) 300 reading each program from the memory 310 and executing the program.
- the teaching material execution processing unit 311 receives the training request operation of the trainee 4 on the operation unit 306, fetches the requested training teaching material for maintenance work of the target device 401 from the training teaching material generation server 20, and displays the display unit 305. Is displayed as a training screen, and the training for each stage of maintenance work is executed using the training screen. In this training, the teaching material execution processing unit 311 controls to switch the display screen of each stage of the maintenance work according to the training work (operation input) performed by the trainee 4 on the training screen.
- the execution data tabulation processing unit 312 tabulates information on the operation input of the training work performed by the trainee 4 on the training screen, that is, the maintenance work (simulation work) for the target device image.
- the information transmission / reception processing unit 313 transmits / receives various types of information such as the information aggregated by the execution data aggregation processing unit 312 (information of operation input in the simulated work of the trainee 4).
- the storage 320 holds an execution information recording database 321 that stores, as work information, information on operation input information of the simulated work (maintenance work) of the trainee 4 collected by the execution data collection processing unit 312.
- the execution information recording database 321 is associated with a trainee number (No.), a work number (No.), a procedure number (No.), a tool number (No.) used, Information about each item such as a work handling part, correctness and proficiency is stored.
- the training material execution terminal 30 having the above configuration corresponds to the display output device of the present invention.
- the control unit 300 corresponds to the determination means and the display control means in the present invention.
- the operation unit 306 corresponds to the mode selection unit in the present invention.
- the execution data tallying processing unit 312 corresponds to the tallying means in the present invention.
- the execution information recording database 321 corresponds to the second management means and recording means in the present invention.
- the training material creation server 20 cooperates with the motion acquisition terminal 10 to create the training material.
- the training material it is necessary to generate a 3DCG image of the target device 401 as a preparation.
- the target device 401 is disassembled into parts, each part is photographed, and images of the parts are collected to generate a 3DCG model of the target device 401.
- the health appliance as shown in FIG. 19 is used as the target device 401, the health appliance having the shape shown in FIG. 19A is disassembled into the state as shown in FIG. 19B and each part is photographed.
- the images of the respective parts are arranged in the vicinity of the positions in the actual machine, and then the respective parts are brought closer to each other in accordance with the actual machine as shown in FIG. 19A to first generate the 3DCG model of the target device 401.
- CAD Computer Aided Design
- FIG. 19A A method of generating a 3D CAD model of the target device 401 by bringing them closer to each other according to an actual machine may be used.
- the image of the target device 401 and the image of each component correspond to the operation target image in the present invention.
- a 3DCG image is generated by photographing or CG processing.
- the training material generation server 20 can generate the training material using the 3DCG image.
- the generated training material is, for example, the display screens 50A, 50B, 50C shown in FIGS. 9 to 11, the display screens 60A, 60B, 60C shown in FIGS. 12 to 14, and the first display screens shown in FIGS. This is information that enables display screens such as the display screen 70A, the second display screen 70B, and the third display screen 70C to be displayed in association with each stage of maintenance work (simulation work).
- the instructor 3 first captures the 3DCG image of the target device 401 including a plurality of operation target images and the tool image in the motion acquisition terminal 10 and displays the 3DCG image on the display unit 105.
- the instructor 3 executes a simulation work operation on a plurality of operation target images in the 3DCG image of the target device 401 displayed on the display unit 105 by an input operation from the operation unit 106, and performs maintenance on each operation target image.
- the instructor 3 designates the work target site in the operation target image, the tool 404 used for the work, and the movement of the tool 404 by the same simulated work operation.
- the instructor 3 also designates the movement of the target portion according to the movement of the tool 404 described above by the operation of the simulation work.
- the instructor 3 specifies, as a result of the above-described work procedure, how the target part (object: a part such as a cover) is detached or moves by an input operation from the operation unit 106.
- the teaching material generation processing unit 212 first creates the reference work according to the designation of the work as the reference work for the maintenance work in the operation of the instructor 3 described above. In addition, the teaching material generation processing unit 212 determines the movement of the work target portion, the tool 404, and the tool 404 in accordance with the designation of the work target portion, the tool 404, and the movement of the tool 404 in the subsequent simulated operation of the instructor 3. Generate training materials that reflect the work procedure shown. Further, the teaching material generation processing unit 212 creates the training material that also reflects the movement of the object designated as the result of the work procedure.
- the instructor 3 When creating the training material, the instructor 3 further inputs the instruction information for guiding the trainee 4 for each work item during the maintenance work of the target device 401 by a simulated operation. This instruction information is input according to the training mode.
- the training material execution terminal 30 can select an education mode or an exercise mode as a training mode.
- the instructor 3 specifies, for example, regarding the education mode, that the target portion of the maintenance work is clearly indicated in a manner different from other portions on the display screen for training displayed in the education mode.
- it is specified to display a yellow part for the part "Caution: Only loosen the screw but do not remove it.”
- the instructor 3 can proceed to the next work stage only when the work target portion is correctly selected on the display screen for training displayed in the practice mode. Specify that there is.
- the instructor 3 can proceed to the next work stage only when the work target portion is correctly selected on the display screen for training displayed in the practice mode. Specify that there is.
- the next work step can be performed. Specify that there is.
- the motion acquisition terminal 10 displays the operation target image 400 including a three-dimensional image, and the simulation work of the instructor 3.
- the operation target image 400 including a three-dimensional image
- the simulation work of the instructor 3 By the operation of the maintenance target for the operation target image 400, movement of the work target portion 405, tool 404, and tool 404 in the operation target image 400, and movement of the target portion according to the movement of the tool 404.
- an operation unit 106 having a function of designating.
- the training material generation server 20 generates a training material having a work procedure in which a work target part 405, a tool 404, a movement of the tool 404, and a motion of the target part are reflected in the designated standard work.
- the processing unit 212 is included.
- the training material execution terminal 30 displays the first to third display screens 70A, 70B, and 70C as the training mode to be performed, and the training mode or the exercise.
- the motion acquisition terminal 10 has an instruction information input function for inputting instruction information for guiding the trainee 4 during the execution of the training, and an instruction mode in the education mode.
- Explicit part designation function to specify the part to be clearly shown to the trainee 4 at the time of training, and to specify to proceed to the next work stage only when the part specified in the reference work at the time of training in the exercise mode is selected
- the operation unit 106 is provided with a work stage designation function.
- the operation acquisition terminal 10 creates a work procedure (training teaching material) for the maintenance work of the target device 401 described above based on the information of the input operation of the simulated work by the instructor 3 based on the information of the input work.
- the work procedure for each work item, the work target part, and each information (reference operation input information) of the tool 404 are acquired, and the reference operation input information is stored in the work information recording database 121 (see FIGS. 2 and 3). , Manage.
- the training material execution terminal 30 determines each work item based on the input operation information of the simulated work.
- Each piece of information (operation input information) on the work procedure, the work target part, and the tool 404 is acquired, and the operation input information is stored and managed in the execution information recording database 321 (see FIGS. 6 and 7).
- the control unit 300 uses the work procedure for each work item stored in the work information recording database 121 of the motion acquisition terminal 10, the work target site, and each information of the tool 404 as standard operation input information. That is, the management function for managing the correct operation input information, the work procedure for each work item stored in the execution information recording database 321 of the training material execution terminal 30, the work target part, and each information of the tool 404. It has a judgment function of judging the skill level of the trainee 4 by comparing the operation input information with the correct operation input information.
- the control unit 300 records a circle (o) mark in the correct / incorrect column of the execution information recording database 321 (see FIG. 7).
- the trainee 4 is made to repeat the same training a plurality of times, and the trainee 4 maintains the target device 401 based on the ratio of the number of crosses to the number of times the training is performed a plurality of times (three times in this example).
- the work proficiency level (for example, A, B, C, ... From the highest) is calculated and recorded in the proficiency level field of the execution information recording database 321 (see FIG. 7).
- control unit 300 has a recording function of recording the training result using the training material associated with the trainee 4 for each training material, in addition to the management function and the determination function described above. You may have. Further, the control unit 300 may be configured to have a display control function of performing display control of totaling the above-described exercise results and comparison results and displaying the totalized results on the display unit 305.
- the training material execution terminal 30 has the above-described management function and determination function, but the present invention is not limited to this, and even if these training functions and determination functions are provided in the training material generation server 20, Alternatively, the training material generation server 20 and the training material execution terminal 30 may be configured to execute in cooperation with each other.
- the training teaching material presentation system 1 displays each information of the work procedure, the work target part 405, and the tool 404 designated for each work item of the maintenance work by the simulated work of the instructor 3.
- a work information recording database 121 as a first management function for managing as correct operation input information, a work procedure designated for each work item of maintenance work by a simulated work of the trainee 4, a work target portion 405,
- the execution information recording database 321 that is the second management function that manages each information of the tool 404 and the tool 404 as the information of the operation input of the exercise mode, the information of the operation input of the correct answer, and the information of the operation input of the exercise mode.
- a control unit 300 having a determination function of determining the proficiency level of the trainee 4 according to the result, and a recording function of associating with the trainee 4 and recording the above comparison result in the training in the practice mode in units of training material, And an execution data tabulation processing unit 312 having a tabulation function for tabulating the comparison results for each work item in units of training materials, and the control unit 300 has a display control function for displaying the comparison results on the display unit 305. It is the structure which has.
- the training material presentation method of the training material presentation system 1 includes a training material generation step in steps S1 to S4 and a training material execution step in steps S5 to S12.
- the operation acquisition terminal 10 acquires information on an operation input from the operation unit 106 in a simulation work related to the preparation of the training material by the instructor 3 (step S1).
- the motion totaling processing unit 111 performs a process of totaling the acquired information (information of operation input in the simulated work) and storing the totalized result in the work information recording database 121.
- the totaling and recording process is continuously performed while the series of educational teaching material generating processes of steps S1 to S4 is performed.
- the training material generation server 20 stores the work target part of the maintenance work and the tool 404 used for the maintenance work generated in the above-described preparation process as the operation target image (including the 3DCG image of the target device 401). Yes (step S2). Subsequently, the training material generation server 20 stores the procedure of the operation input of the simulated work (step S3).
- the learning material generation processing unit 212 generates a display screen (training material) based on the information stored in steps S2 and S3 (step S4).
- the instructor 3 operates the operation unit 106 to input characters for instructing the work at each stage of the maintenance work while appropriately moving the operation target image, and to use the microphone to input the voice information. Enter.
- the teaching material generation processing unit 112 acquires the information (character information, voice information, etc.) of the operation input in the simulated work of the instructor 3, and transfers the information to the teaching material generation processing unit 212 of the training teaching material generation server 20. Perform processing.
- the training teaching material presentation system 1 is ready to proceed to the execution stage of the training teaching material.
- the trainee 4 displays the target device 401 on the predetermined display screen (see FIGS. 9, 12, and 16) for executing the training displayed on the display unit 305 of the training material execution terminal 30.
- Device name and training menu are selected (input) (step S5).
- the training material execution terminal 30 transmits the device name and the training menu information input by the trainee 4 using the operation unit 306 to the training material generation server 20 (step S6).
- the training material generating server 20 receives the device name and the training menu from the training material executing terminal 30, the training material (content) corresponding to the device name and the training menu is read from the training material database 222, and is transmitted to the training material executing terminal 30. It is distributed (step S7).
- the training material execution terminal 30 receives the training material distributed from the training material generation server 20, and the learning material execution processing unit 311 executes the training material.
- the teaching material execution processing unit 311 outputs the display screen (for example, see FIGS. 16 to 17) to the display unit 305 based on the received training teaching material according to a predetermined output condition (step S8).
- the training material execution terminal 30 acquires information on the operation input in the simulated work performed by the trainee 4 using the operation unit 306 on the display screen (step S9).
- the execution data totalization processing unit 312 totals the acquired information (operation input information in the simulated work) and stores the totalized result in the execution information recording database 321. The totaling and recording process is continued until it is determined in step S10 that the training is completed.
- the training material execution terminal 30 performs a process of determining whether or not the training by the trainee 4 is completed (step S10). If it is determined that the training has not ended (NO in step S10), the teaching material execution processing unit 311 continues to execute the processes of steps S8 and S9.
- the training material execution terminal 30 causes the trainee 4 to input the operation input information in the simulated work and the training material creation.
- a process of comparing and judging the information of the operation input in the simulated work of the instructor 3 at that time and judging the skill level of the trainee 4 is performed (step S11).
- step S11 is executed by the above-described management function of the control unit 300, for example.
- This management function is provided for each work item, work target part, and tool information (correct answer) for each work item of the training material stored in the work information recording database 121 of the motion acquisition terminal 10 during execution of S1 to S4.
- control unit 300 (the above management function) carries out a process of recording the proficiency level determined in step S11 in the execution information recording database 321 (see FIG. 7) corresponding to the trainee 4 (step S12), After that, a series of processes related to the training material presentation method is ended.
- the training material execution terminal 30 starts a processing operation for training the maintenance work of the target device 401 by receiving a predetermined training start operation on the operation unit 306 by the trainee 4.
- a training start operation the trainee 4 needs to specify the target device 401 and the training menu mode.
- the training menu mode includes an exercise mode and an education mode.
- the training material execution terminal 30 displays the display screen 50A shown in FIG. 9 on the display unit 305.
- the teaching material execution processing section 311 reads out the training teaching material corresponding to the designated device A from the training teaching material database 222 of the training teaching material generation server 20, and displays the display screen 50A based on the training teaching material.
- the display screen 50A has an instruction display area 501, an operation target image display area 502, and a guide display area 503.
- a message requesting operation input is displayed in the instruction display area 501.
- the operation target image 400 is displayed in the operation target image display area 502.
- the operation target image 400 includes an image of the target device 401 (device A in this example) and an image of its component 402.
- the designated device name, training menu mode, and work items to be trained are displayed.
- the display screen 50A is set, for example, so that the "valve replacement” is first performed on the target device 401.
- a message “Please select“ Valve replacement ”” is displayed.
- work items such as “valve replacement”, “console replacement”, “board replacement”, and “screw replacement” that can be used for education are displayed.
- the detailed work procedure “(1) Remove the cover”, "(2) Remove the fixture”, and "(3) Remove the valve” are also displayed.
- a target device 401 and a work target component 402 in the target device 401 for example, a valve are displayed.
- the display screen 50A when the trainee 4 selects "Valve replacement” in accordance with the message displayed in the instruction display area 501, the display screen 50B shown in FIG. 10 is displayed.
- the instruction display area 501 is changed to display a message "Please click (1) Remove cover”.
- the "bulb replacement” is underlined and the "bulb replacement” is changed to the selected display content.
- the operation target image 400 changes to a display content in which a screwdriver, which is a tool 404 necessary for removing the cover of the target device 401, is brought close to the valve (part 402).
- the screen transitions to the display screen 50C shown in FIG.
- the instruction display area 501 changes to display a message "Click” (3) Remove valve ".”
- underline is added to “valve replacement”, “(1) remove cover” and “(2) remove fixture”, and the display content is changed.
- the operation target image 400 has a display content in which the caution display area 504 is displayed such that the screwdriver for removing the valve of the target device 401 is close to the valve (part 402) and overlaps the images. change.
- the alert display area 504 a message “Be careful about the rotation direction before removal” is displayed.
- the trainee 4 can learn the work procedure related to “valve replacement” of the target device 401 by using the training materials of the display screens 50A to 50C.
- the display screens 50A to 50C are configured such that the input operation is performed in accordance with the message displayed in the instruction display area 501, and even the trainee 4 who has little knowledge in the field can display the target device 401. You can easily learn maintenance work.
- cautions at the time of valve replacement are clearly displayed on the display screen 50C, it is possible to receive high-quality training capable of avoiding danger.
- the trainee 4 can receive training in the operations of "console replacement", "board replacement", and "screw replacement” in the same manner as "valve replacement".
- the training material execution terminal 30 receives the designated training from the training material generation server 20.
- the teaching material is acquired and the display screen 60A shown in FIG. 12 is displayed on the display unit 305.
- the display screen 60A has an instruction display area 601, an operation target image display area 602, and a guide display area 603. Functions of the instruction display area 601, the operation target image display area 602, and the guide display area 603 are the same as those of the guide display area 503 in the instruction display area 501 and the operation target image display area 502 in the display screen 50A, respectively. Have.
- the training material execution terminal 30 changes to the display screen 60A when the operation input on the operation unit 306 by the trainee 4 satisfies a predetermined output condition during the display of the display screen 60A, for example, the display shown in FIG. It is possible to make a transition to the display of the screen 60B.
- the display screen 60B may be changed to, for example, the display screen 60C shown in FIG. It is possible.
- the predetermined output condition is set according to the order and selection contents of the selection operation of the plurality of operation target images 400 acquired by the motion acquisition terminal 10 according to the simulated work of the instructor 3.
- each of the display screens 60A, 60B, and 60C in response to a question-type message (exercise question) displayed in the instruction display area 601, the question is answered to the target device 401 displayed in the operation target image display area 602. It is a configuration of the form to execute the simulated operation (solve the exercise problem).
- the case where the above output condition is satisfied is, for example, a case where the information input by the trainee 4 is correct for the question displayed in the instruction display area 601 of the display screens 60A and 60B as described later. You can
- the same items as the display screens 50A, 50B, and 50C used for the above-mentioned “education” are displayed, but in the instruction display area 601, The message "Please select the tool required to remove the cover” is displayed.
- the operation target image 400 the target device 401 is displayed, and the tool display area 604 is secured so as to overlap the target device 401.
- a plurality of tool (tool) images 403a, 403b, 403c, 403d are displayed in a selectable manner.
- the trainee 4 can select one of the tools 404 displayed as the tool images 403a, 403b, 403c, and 403d on the display screen 60A by operating the operation unit 306.
- the tool 404 selected by the trainee 4 on the display screen 60A is the “tool required to remove the cover” in the question displayed in the instruction display area 601, for example, to the display screen 60B shown in FIG. And transition.
- the instruction display area 601 displays a message "Please click the positions of screws required to remove the cover for the number of screws".
- a target device 401 and a plurality of screws that are parts 402 are displayed.
- the trainee 4 can select a required number of screws from the plurality of screws in the operation target image 400 on the display screen 60B by operating the operation unit 306.
- the display screen 60B when the number of screws selected by the trainee 4 matches “the number of screws required to remove the cover for the number of screws” in the question displayed in the instruction display area 601, for example, FIG.
- a message "Please select the purpose for removing the cover” is displayed in the instruction display area 601.
- the target device 401 is displayed, and the answer display area 605 is secured so as to overlap the target device 401.
- the answer display area 605 a plurality of answer documents 606a, 606b, 606c, 606d are displayed in a selectable manner.
- the trainee 4 can select any one of the reply documents 606a, 606b, 606c, and 606d on the display screen 60C by operating the operation unit 306.
- the answer document selected by the trainee 4 for example, 606a matches the “purpose of removing the cover” in the question displayed in the instruction display area 601, for example, the following display screen (not shown) is displayed. No)).
- the training material execution terminal 30 it is possible to determine the proficiency level related to the training of the trainee based on the information in the correctness column recorded in the execution information recording database 321.
- This proficiency level determination process can be performed at various timings, such as once for each training, for each multiple training, and for each training item.
- the determined skill level is stored in the skill level column of the execution information recording database 321.
- the training material presentation system for example, in the training material execution terminal 30, by the exercise using the display screens 60A, 60B, and 60C based on the training material, the exercise for the trainee 4 and the trainee 4 in the exercise are performed. Skill management can be realized.
- 15 to 18 show examples of display screens corresponding to the respective stages in the training for the health appliance executed by the training material executing terminal 30 based on the training material.
- FIG. 15 is a diagram showing a display example of a screen in the practice in the education mode targeting the health appliance on the training material execution terminal 30.
- the display screen 80 shown in FIG. 15 corresponds to a certain stage of the simulation work related to the replacement of the drive belt of the health appliance which is the target device 401, and includes an instruction display area 801, an operation target image display area 802, and a guide display area. In addition to 803, it has a procedure display area 805.
- the guide display area 603 displays a plurality of work items including “replacement of drive belt”.
- the trainee 4 selects “replacement of drive belt” and the guide display area 603 corresponds to “replacement of drive belt” and the detailed work procedure “(1) Loosen the fixing screw”. ",” (2) Loosen the belt tension pulley “and” (3) Remove the belt "are also displayed.
- “Procedure: Replace drive belt” is displayed in the procedure display area 805, and “User operation: Click after confirming” is displayed in the instruction display area 801.
- the operation target image display area 802 and the operation target image 400 including the target device 401 are displayed.
- a caution display area 604 is secured so as to overlap the target device 401.
- the attention display area 604 is displayed in a specific color different from the other areas, for example, yellow.
- In the warning display area 604 only loosen the screws but do not remove them.
- Information (text characters) is displayed.
- the display screen 80 used in the education mode is configured to have the alert display area 604 of a specific color different from other areas.
- the attention display area 604 on the display screen 80 is generated by the teaching material generation processing unit 212 of the training teaching material generation server 20 based on the designation of the instructor 3 during the simulation work by the instructor 3 in the motion acquisition terminal 10 (see step S1). It is a thing. That is, the motion acquisition terminal 10 has a function of designating instruction information for clearly indicating (for example, displaying in yellow) the target part of the target device 401 so that the trainee 4 can understand. Since the screen (display screen 80) used in the education mode has the above-mentioned caution display area 604, the trainee 4 will be required to be careful during the maintenance work while performing the training in the education mode. It is possible to grasp the procedure without fail.
- FIG. 16, FIG. 17, and FIG. 18 are diagrams each showing a display example of a screen in the exercise mode for the health training device on the training material execution terminal 30.
- the training material execution terminal 30 causes the training material generation server 20 to execute the above-described training start operation.
- the designated training material is acquired and the first display screen 70A shown in FIG. 16 is displayed on the display unit 305.
- the first display screen 70A has an instruction display area 701, an operation target image display area 702, and a guide display area 703.
- the training material execution terminal 30 changes to the first display screen 70A when the operation input by the trainee 4 satisfies a predetermined output condition while the first display screen 70A is being displayed, and for example, the second display shown in FIG. It is possible to make a transition to the display of the display screen 70B.
- the second display screen 70B is replaced with, for example, the display of the third display screen 70C shown in FIG. It is possible to transition to.
- the case where the output condition is satisfied may be, for example, the case where the information input by the trainee 4 is correct for the question displayed in the instruction display area 701 of the first display screen 70A and the second display screen 70B. it can.
- the instruction display area 701 displays a message (text character) "User operation: Please select a tool when removing the console.”
- a target device 401 which is a health appliance is displayed, and a tool display area 704 is secured adjacent to the target device 401.
- a plurality of tool images 403a, 403b, 403c, 403d corresponding to the tools 404a, 404b, 404c, 404d are displayed in a selectable manner.
- the trainee 4 can select any one of the tools 404a, 404b, 404c, and 404d in the tool display area 704 on the first display screen 70A by operating the operation unit 306.
- the tool 404 selected by the trainee 4 on the first display screen 70A is the “tool at the time of removing the console” in the question displayed in the instruction display area 601, for example, the second display screen shown in FIG. Transition to 70B.
- the operation target image 700 the target device 401 and a plurality of screws that are the work target parts 405 are displayed.
- the trainee 4 can select a required number of screws from the work target portion 405 in the operation target image 400 on the second display screen 70B by operating the operation unit 306.
- the number of screws selected by the trainee 4 matches the "number of screws” in the "position of hexagon bolts for removing the console" in the question displayed in the instruction display area 701.
- it changes to the 3rd display screen 70C shown in FIG. 18, for example.
- the target device 401 As the operation target image 400, the target device 401 is displayed, and a plurality of moving directions 405a, 405b, 405c of the console are displayed by arrows and selectably.
- the trainee 4 can select any one of the moving directions 405a, 405b, 405c corresponding to it by clicking the above-mentioned arrow on the third display screen 70C by operating the operation unit 306.
- the third display screen 70C when the moving direction of the console selected by the trainee 4 matches the “direction of moving the console” in the question displayed in the instruction display area 701, for example, the following display screen (Not shown) or the training (exercise) ends.
- the trainee 4 also inputs (in the exercise by the first display screen 70A, the second display screen 70B, and the third display screen 70C (see FIGS. 16 to 18). If the selected (or clicked) tool 404, the number of screws, and the moving direction are correct for the question displayed in the instruction display area 701, the training material in the execution information recording database 321 (see FIG. 7) is used. A circle is recorded in the corresponding correctness column, and a cross is recorded if the answer is incorrect. As a result, the training material execution terminal 30 can determine the proficiency level related to the training of the trainee based on the information in the correct / wrong column recorded in the execution information recording database 321.
- an exercise for the trainee 4 is performed by an exercise using the first display screen 70A, the second display screen 70B, and the third display screen 70C based on the training material in the training material execution terminal 30. , The skill management of the trainee 4 in the exercise can be performed.
- the training material presentation system 1 presents the training material including the 3DCG image related to the maintenance work of the target device 401 to the trainee 4 together with the work space display, and performs the maintenance work.
- the presentation content is changed according to the operation input of the simulated work corresponding to each stage.
- the training material presentation system 1 includes a plurality of operation acquisition terminals 10 for acquiring information on operation input of simulated work, a plurality of operation target parts 405 for maintenance work, and a tool 404 used for maintenance work, which are selectable.
- the storage 220 that stores the operation input image 400 and stores the information of the operation input acquired by the operation acquisition terminal 10, and one of the plurality of operation target images 400 for maintenance work based on the storage information of the storage 220.
- a first display screen 70A displaying a specific tool 404 necessary for a process
- a second display screen 70B displaying a work target site 405 of a specific process among a plurality of operation target images 400, and a work target site 405 of a specific process.
- a training teaching material execution terminal 30 that displays each of the screen 70A, the second display screen 70B, and the third display screen 70C according to a predetermined output condition, and the predetermined output condition is acquired by the motion acquisition terminal 10.
- the operation target image 400 is set according to the order of selection operation and the selection content.
- each screen of the first to third display screens 70A, 70B, and 70C has a selection operation of the tool 404 or the work target site 405 or a selected work target site 405. Since it includes an instruction display requesting an operation input to the screen and an operation target image display area capable of executing a selection operation of a specific operation target image 400 corresponding to the display content or a simulated work operation input, The screen display contents are sequentially changed according to the user's operation input, and the system becomes a system in which the work procedure can be grasped easily and accurately without an actual machine.
- each of the first display screen 70A, the second display screen 70B, and the third display screen 70C has an instruction display area 701 for requesting a selection operation or an operation input,
- the specific operation target image 400 corresponding to the display content of the instruction display area 701 among the plurality of operation target images 400 and the content of the selection operation or the operation input of the simulated work on each display screen by the instructor 3 or the trainee 4 are displayed.
- the training material presentation system 1 can easily and quickly generate the training material and the exercise material according to the required maintenance work procedure based on the model operation input of the instructor 3.
- the motion acquisition terminal 10 maintains the operation target image 400 by the display unit 105 that displays the operation target image 400 including the three-dimensional image and the instructor 3 for the simulation work.
- An operation unit 106 having a function of designating a work as a work reference, a work target part 405, a tool 404, a movement of the tool 404 in the operation target image 400, and a motion of the target part according to the movement of the tool 404.
- the training material generation server 20 has a training including a work procedure in which the work to be the work target portion 405, the tool 404, the movement of the tool 404, and the movement of the target portion are reflected in the work as the designated reference. It has a teaching material generation processing unit 212 for generating a teaching material.
- the training material presentation system 1 facilitates the training material including the three-dimensional image of the target device 401 by the simulated work of the instructor 3 based on the information of the operation input in the simulated work. Can be generated quickly.
- the training material execution terminal 30 displays the first to third display screens 70A, 70B, and 70C as the training mode to be performed, and the training mode or the exercise.
- the motion acquisition terminal 10 has an instruction information input function for inputting instruction information for guiding the trainee 4 during the execution of the training, and an instruction mode in the education mode.
- Explicit part designation function to specify the part to be clearly shown to the trainee 4 at the time of training, and to specify to proceed to the next work stage only when the part specified in the reference work at the time of training in the exercise mode is selected
- the training teaching material presentation system 1 performs the maintenance work in the education mode during the training performed by displaying each screen of the first to third display screens 70A, 70B, and 70C on the training teaching material execution terminal 30.
- Trainers 4 who do not have knowledge of can easily receive the training, and in the exercise mode, the trainers 4 can perform the correct simulated work to advance to the next stage. can do.
- the training material presentation system 1 uses the correct operation of the work procedure specified for each work item of the maintenance work by the simulated work of the instructor 3, the work target part 405, and each information of the tool 404.
- a work information recording database 121 as a first management function that manages as input information, a work procedure specified for each work item of maintenance work by a simulated work of the trainee 4, a work target portion 405, and a tool 404.
- the execution information recording database 321 which is the second management function of managing each information as the operation input information of the exercise mode, the information of the correct operation input, and the information of the operation input of the exercise mode.
- a control unit 300 having a determination function for determining the proficiency level of the trainee 4, and a recording function for associating with the trainee 4 and recording the above comparison result in the training in the exercise mode in units of training materials, and for each work item.
- the execution data tabulation processing unit 312 having a tabulation function for tabulating the above comparison results in units of training teaching materials, and the control unit 300 has a display control function for displaying the above comparison results on the display unit 305. is there.
- the training material presentation system 1 for example, in the training material execution terminal 30, according to the exercise using the first to third display screens 70A, 70B, 70C based on the training material, The skill management of the trainee 4 in the exercise can be realized.
- the training material presentation method includes an operation acquisition step S1 for acquiring information on operation input of simulated work, a work target part 405 for maintenance work, and tools 404a, 404b, 404c, 404d used for maintenance work.
- tool 404 is stored as a plurality of operation target images 400 that can be displayed and selected and operated, a storage 220 that stores information on an operation input acquired by the motion acquisition terminal 10, and a storage 220 of the storage 220.
- a first display screen 70A that displays a specific tool 404 required for any step of maintenance work among a plurality of operation target images 400 based on the stored information, a work target site of a specific step among the plurality of operation target images 400 Information that can be output as a second display screen 70B that displays 405, and a third display screen 70C that displays the work target site 405 of the specific process such that the operation input of the simulated work for the work target site 405 can be executed.
- Predetermined output conditions including, are set according to the order and selection contents of the selection operations of the plurality of operation target images 400 acquired by the motion acquisition terminal 10.
- each of the first to third display screens 70A, 70B, and 70C is displayed on the tool 404 or the operation target site 405 or the selected operation target site 405. Since it includes the instruction display requesting the operation input and the operation target image display area capable of executing the selection operation of the specific operation target image 400 corresponding to the display content or the simulated work operation input, the user for each screen The screen display contents are sequentially changed according to the operation input of, and the work procedure can be grasped easily and accurately without an actual machine.
- the training material presentation system and the training material presentation method according to the present invention have the effect that the training material reflecting the maintenance work procedure of the target device 401 can be easily and accurately generated without the actual device, and the disassembly is performed.
- the present invention can be applied to all education systems that require the generation of training materials for education and exercises using 3DCG of a maintenance target device that involves assembly work.
- Training Material Presentation System 3 Instructor 4 Trainer 10 Action Acquisition Terminal (Information Input Device) 20 Training material generation server (output information generation device) 30 Training material execution terminal (information input device, display output device) 40 Communication Network 70A First Display Screen (Training Material) 70B Second display screen (training material) 70C 3rd display screen (training material) 105 display unit (display means) 106 operation unit (designating means, instruction information inputting means, explicit part designating means, work stage designating means) 121 work information record database (first management means) 212 Teaching Material Generation Processing Unit (Training Material Generating Means) 220 Storage 222 Training Material Database (Training Material) 300 control unit (determination means, display control means) 305 Display (display screen) 306 Operation unit (mode selection means) 312 Execution data aggregation processing unit (aggregation means) 321 execution information recording database (second management means, recording means) 400 Operation Target Image 401 Target Device 404a, 404b, 404c, 404d Tool 405 Work Target Part 501, 60
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Entrepreneurship & Innovation (AREA)
- Economics (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Electrically Operated Instructional Devices (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
This training teaching material presenting system is provided with: an operation acquisition terminal 10 for acquiring information about operation input for simulation work; a training teaching material generation server 20 which, on the basis of prestored information, generates a first display screen displaying specific tools necessary for any of the steps of maintenance work among a plurality of operation target images, a second display screen displaying a work target part of a specific process among a plurality of operation target images, and a third display screen displaying the work target part of the specific step in such a way that operation input for simulation work with respect to the work target part is executable, each screen as information that can be displayed and output; and a training teaching material execution terminal for displaying each screen of the first to the third display screens in accordance with predetermined output conditions. The predetermined output conditions are set in accordance with the order of selection operations for the plurality of operation target images acquired by the operation acquisition terminal 10 and the selected content.
Description
本発明は、各種装置の保守作業に関する教育、演習に用いる3DCGを含む訓練教材を実機無しで生成し、提示する訓練教材提示システムおよび訓練教材提示方法に関する。
The present invention relates to a training material presentation system and a training material presentation method for generating and presenting training materials including 3DCG used for education and exercises concerning maintenance work of various devices without an actual machine.
例えば、工業製品等の各種装置では、その保守作業において特別な技術を必要とするものが少なくない。そのため、上述した保守作業を行う作業員に対しては上述した各種作業のための訓練を行うことが重要になる。
For example, in the case of various devices such as industrial products, there are many devices that require special technology for their maintenance work. Therefore, it is important to train the workers who perform the above-mentioned maintenance work for the above-mentioned various works.
今日、マルチメディアの発展を背景に、熟練者の前で実機を用いて行う訓練に代えて、訓練用コンテンツを電子的に生成し、これを表示装置に表示して作業要員等に提示可能なシステムも実現されつつある。
With the development of multimedia, it is possible to generate training contents electronically and display it on a display device instead of performing the training using an actual machine in front of a skilled worker, and present it to workers etc. The system is being realized.
実機を用いずに保守手順を教示するシステムとして、従来、予め記憶された教材基本データから抽出した教材オブジェクトデータを移動、追加、削除、加工することで対象作業に対応した教材基本データを編集する教材編集装置を備えたシステムが知られている(例えば、特許文献1参照)。
As a system for teaching maintenance procedures without using an actual machine, conventionally, the teaching material basic data corresponding to the target work is edited by moving, adding, deleting, or processing the teaching material object data extracted from the previously stored teaching material basic data. A system including a teaching material editing device is known (for example, see Patent Document 1).
また、従来、例えば、プラントの設計業務で作成した該プラントの3Dモデルを保守作業手順に対応付けて記憶し、保守作業を支援可能にしたシステムも知られている(例えば、特許文献2参照)。
Further, conventionally, for example, there is also known a system in which a 3D model of the plant created in the design work of the plant is stored in association with the maintenance work procedure so that the maintenance work can be supported (for example, see Patent Document 2). ..
各種装置を対象とする保守作業の分野にあっては、例えば、作業内容として、保守作業の対象となる装置(対象機器)の分解や組み立てを伴うものがある。加えて、対象機器の技術分野に関する知識がない者でも保守要員として教育できることも望まれている。
In the field of maintenance work that targets various devices, for example, the work content may involve disassembling or assembling the device (target device) that is the target of the maintenance work. In addition, it is desired that even those who do not have knowledge of the technical field of the target device can be trained as maintenance personnel.
しかしながら、特許文献1、および2に記載のものは、保守作業の対象がプラント現場の特化したものであり、該プラントに関する知識がないものを対象に保守作業の訓練を行うことについても考慮されていなかった。
However, in Patent Documents 1 and 2, the target of the maintenance work is specialized at the plant site, and it is considered that the training of the maintenance work is performed for those who have no knowledge of the plant. I didn't.
このため、従来は、実機を用いず、しかも、特別な知識を有しない者に対しても、分解や組み立てを伴う保守作業についての十分な教育、演習を行い得る教育教材を生成し、提示する装置は存在しなかった。
For this reason, conventionally, even if a person who does not use an actual machine and has no special knowledge, sufficient education and exercises about maintenance work involving disassembly and assembly are generated and presented. No device was present.
本発明は、このような従来の課題を解決するためになされたものであって、対象機器の保守作業手順を実機無しで反映した訓練教材を容易かつ的確に生成可能な訓練教材提示システムおよび訓練教材提示方法を提供することを目的とする。
The present invention has been made to solve such a conventional problem, and a training material presentation system and training capable of easily and accurately generating a training material reflecting a maintenance work procedure of a target device without an actual machine. The purpose is to provide a teaching material presentation method.
上記課題を解決するために、本発明の請求項1に係る訓練教材提示システムは、対象機器(401)の保守作業に関連する3次元画像を含む訓練教材を、作業空間表示と共に訓練者(4)に提示するとともに、前記保守作業の各段階に対応する模擬作業の操作入力に応じて提示内容を変化させる訓練教材提示システム(1)であって、前記模擬作業の操作入力の情報を取得する情報入力装置(10)と、前記保守作業の作業対象部位(405)と前記保守作業に使用するツール(404a、404b、404c、404d)とを表示可能かつ選択操作可能な複数の操作対象画像(400)として記憶するとともに、前記情報入力装置で取得される操作入力の情報を記憶する記憶装置(220)と、前記記憶装置の記憶情報に基づき、前記複数の操作対象画像のうち前記保守作業のいずれかの工程に必要な特定のツールを表示する第1表示画面(70A)、前記複数の操作対象画像のうち特定工程の作業対象部位を表示する第2表示画面(70B)、および、前記特定工程の作業対象部位を該作業対象部位に対する前記模擬作業の操作入力を実行可能に表示する第3表示画面(70C)を、それぞれ表示出力可能な情報として生成する出力情報生成装置(20)と、表示画面(305)上に、前記第1表示画面、前記第2表示画面および前記第3表示画面の各画面を所定の出力条件に従って表示する表示出力装置(30)と、を備え、前記所定の出力条件が、前記情報入力装置で取得される前記複数の操作対象画像の前記選択操作の順序および選択内容に応じて設定されることを特徴とする。
In order to solve the above problems, the training material presentation system according to claim 1 of the present invention provides a training material including a three-dimensional image related to maintenance work of a target device (401) with a work space display and a trainee (4). ) And a training teaching material presentation system (1) for changing the presentation content according to the operation input of the simulated work corresponding to each stage of the maintenance work, and acquiring the information of the operation input of the simulated work. The information input device (10), a plurality of operation target images (displayable and selectable) of the maintenance target work portion (405) and the tools (404a, 404b, 404c, 404d) used for the maintenance work ( 400) and a storage device (220) that stores the information of the operation input acquired by the information input device, and based on the storage information of the storage device, the maintenance work of the plurality of operation target images A first display screen (70A) that displays a specific tool required for any process, a second display screen (70B) that displays a work target part of a specific process among the plurality of operation target images, and the specific An output information generation device (20) for generating, as displayable information, a third display screen (70C) for displaying the work input part of the process so that the operation input of the simulated work for the work target part can be executed, A display output device (30) for displaying each of the first display screen, the second display screen, and the third display screen on a display screen (305) in accordance with a predetermined output condition; It is characterized in that the output condition is set according to the order and selection contents of the selection operation of the plurality of operation target images acquired by the information input device.
この構成により、本発明の請求項1に係る訓練教材提示システムは、第1ないし第3表示画面の各画面が、ツールや作業対象部位の選択操作または選択済み作業対象部位への操作入力を要求するインストラクション表示と、その表示内容に対応する特定の操作対象画像の選択操作または模擬作業操作入力を実行可能な操作対象画像表示領域とを含んでいるので、各画面に対するユーザの操作入力に応じて画面表示内容が順次変更されていき、作業手順を実機無しで容易・的確に把握可能なシステムとなる。
With this configuration, in the training material presentation system according to claim 1 of the present invention, each screen of the first to third display screens requires a selection operation of a tool or a work target site or an operation input to a selected work target site. Since it includes an instruction display and an operation target image display area capable of performing a selection operation or a simulated work operation input of a specific operation target image corresponding to the display content, it is possible to respond to a user operation input on each screen. The contents displayed on the screen will be changed sequentially, and the system will be able to grasp the work procedure easily and accurately without using an actual machine.
本発明の請求項2に係る訓練教材提示システムは、前記第1表示画面、前記第2表示画面および前記第3表示画面の各画面が、前記選択操作または前記操作入力を要求するインストラクション表示領域(701)と、前記複数の操作対象画像のうち前記インストラクション表示領域の表示内容に対応する特定の操作対象画像と、インストラクタまたは前記訓練者による各表示画面での前記選択操作または前記模擬作業の操作入力の内容を表示する操作画像表示領域(702)とを、含んでいることを特徴とする。
In the training material presentation system according to claim 2 of the present invention, each of the first display screen, the second display screen, and the third display screen has an instruction display area for requesting the selection operation or the operation input ( 701), a specific operation target image corresponding to the display content of the instruction display area among the plurality of operation target images, and an operation input of the selection operation or the simulated work on each display screen by the instructor or the trainee And an operation image display area (702) for displaying the contents of the above.
この構成により、本発明の請求項2に係る訓練教材提示システムは、インストラクタの模範操作入力を基に、所要の保守作業手順に則した訓練教材や演習教材を容易・迅速に生成可能となる。
With this configuration, the training material presentation system according to claim 2 of the present invention can easily and quickly generate the training material and the exercise material according to the required maintenance work procedure based on the model operation input of the instructor.
本発明の請求項3に係る訓練教材提示システムは、前記情報入力装置は、前記3次元画像を含む前記操作対象画像を表示する表示手段(105)と、前記インストラクタの前記模擬作業によって、前記操作対象画像に対する前記保守作業の基準となる作業と、前記操作対象画像における作業対象部位、前記ツール、および前記ツールの動きと、前記ツールの動きに応じた前記対象部位の動きと、を指定する指定手段(106)と、を有し、前記出力情報生成装置は、前記指定手段により指定された前記基準となる作業に、前記作業対象部位、前記ツール、前記ツールの動き、および前記対象部位の動きが反映された作業手順を有する訓練教材(222)を生成する訓練教材生成手段(212)を有することを特徴とする。
In the training teaching material presentation system according to claim 3 of the present invention, the information input device is configured to display the operation target image including the three-dimensional image and display the operation target image, and the instructor to perform the operation. Designation for designating a work as a reference of the maintenance work for the target image, a work target site in the operation target image, the tool, and a movement of the tool, and a motion of the target site according to the movement of the tool Means (106), and the output information generation device includes the work target portion, the tool, the movement of the tool, and the movement of the target portion in the reference work designated by the designating means. It is characterized by having a training material generating means (212) for generating a training material (222) having a work procedure reflecting the above.
この構成により、本発明の請求項3に係る訓練教材提示システムは、インストラクタの模擬作業により、その模擬作業での操作入力の情報に基づいて、対象機器の3次元画像を含む訓練教材を容易・迅速に生成することができる。
With this configuration, the training material presentation system according to claim 3 of the present invention facilitates the training material including the three-dimensional image of the target device based on the information of the operation input in the simulation work by the simulator work. Can be generated quickly.
本発明の請求項4に係る訓練教材提示システムは、前記表示出力装置は、前記第1ないし第3表示画面の各画面を表示して行う訓練のモードとして、教育モードまたは演習モードを選択するモード選択手段(306)を有し、前記情報入力装置は、前記訓練の実施中に前記訓練者を誘導するための指示情報を入力する指示情報入力手段(106)と、前記教育モードでの前記訓練時に前記訓練者に対して明示する部位を指定する明示部位指定手段(106)と、前記演習モードでの前記訓練時に前記基準となる作業で指定した部位が選択された場合にのみ次の作業段階に進むように指定する作業段階指定手段(106)と、をさらに有することを特徴とする。
In the training material presentation system according to claim 4 of the present invention, the display output device is a mode for selecting an education mode or an exercise mode as a training mode performed by displaying each screen of the first to third display screens. The information input device includes a selection unit (306), the information input device inputs instruction information for guiding the trainee during the training, and the training in the education mode. Only when the explicit part specifying means (106) for specifying the part to be clearly specified to the trainee and the part specified in the reference work during the training in the exercise mode are selected, the next work step is performed. And a work stage designating means (106) for designating to proceed to (1).
この構成により、本発明の請求項4に係る訓練教材提示システムは、表示出力装置で第1ないし第3表示画面の各画面を表示して行う訓練に際し、教育モードでは保守作業の知識がない訓練者でも簡単に訓練を受けることができ、かつ、演習モードでは訓練者が正しい模擬作業を行うことで次の段階に進むことができる各モードに最適な教育教材を生成することができる。
With this configuration, in the training material presentation system according to claim 4 of the present invention, in the training performed by displaying each screen of the first to third display screens on the display output device, the training without knowledge of maintenance work in the education mode. The person can easily receive the training, and in the exercise mode, the trainee can perform the correct simulated work to generate the optimum educational material for each mode in which the trainee can proceed to the next stage.
本発明の請求項5に係る訓練教材提示システムは、前記インストラクタの前記模擬作業により前記保守作業の各作業項目ごとに指定された前記作業手順、前記作業対象部位、および前記ツールの各情報を、正解の操作入力の情報として管理する第1の管理手段(121)と、前記訓練者の前記模擬作業により前記保守作業の各作業項目ごとに指定された前記作業手順、前記作業対象部位、および前記ツールの各情報を、前記演習モードの操作入力の情報として管理する第2の管理手段(321)と、前記正解の操作入力の情報と、前記演習モードの操作入力の情報との比較結果に応じて前記訓練者の習熟度を判定する判定手段(300)と、前記訓練者に対応付けて、前記演習モードでの前記訓練における前記比較結果を、前記訓練教材単位に記録する記録手段(321)と、前記作業項目ごとの前記比較結果を、前記訓練教材単位に集計する集計手段(312)と、前記比較結果を前記表示画面に表示させる表示制御手段(300)と、をさらに有することを特徴とする。
The training material presentation system according to claim 5 of the present invention, the work procedure specified for each work item of the maintenance work by the simulated work of the instructor, the work target site, and each information of the tool, First management means (121) for managing as correct operation input information, the work procedure specified for each work item of the maintenance work by the simulated work of the trainee, the work target part, and the Depending on the result of comparison between the second management means (321) for managing each piece of information of the tool as the operation input information of the exercise mode, the information of the correct operation input, and the information of the operation input of the exercise mode. Determination means (300) for determining the proficiency level of the trainee, and recording means (321) for recording the comparison result in the training in the exercise mode in the training material unit in association with the trainee. And a totaling means (312) for totaling the comparison result for each work item in units of the training material, and a display control means (300) for displaying the comparison result on the display screen. And
この構成により、本発明の請求項5に係る訓練教材提示システムは、訓練教材実行端末30において、訓練教材に基づく第1ないし第3の表示画面を用いた演習に合わせて、その演習における訓練者のスキル管理を実現することができる。
With this configuration, the training material presentation system according to claim 5 of the present invention, in the training material execution terminal 30, according to the training using the first to the third display screen based on the training material, the trainee in the training. Skill management can be realized.
上記課題を解決するために、本発明の請求項6に係る訓練教材提示方法は、対象機器(401)の保守作業に関連する3次元画像を含む訓練教材を、作業空間表示と共に訓練者(4)に提示するとともに、前記保守作業の各段階に対応する模擬作業の操作入力に応じて提示内容を変化させる訓練教材提示方法であって、前記模擬作業の操作入力の情報を取得する情報入力ステップ(S1)と、前記保守作業の作業対象部位(405)と前記保守作業に使用するツール(404a、404b、404c、404d)とを表示可能かつ選択操作可能な複数の操作対象画像(400)として記憶するとともに、前記情報入力装置で取得される操作入力の情報を記憶する記憶ステップ(S2)と、前記記憶装置の記憶情報に基づき、前記複数の操作対象画像のうち前記保守作業のいずれかの工程に必要な特定のツールを表示する第1表示画面(70A)、前記複数の操作対象画像のうち特定工程の作業対象部位を表示する第2表示画面(70B)、および、前記特定工程の作業対象部位を該作業対象部位に対する前記模擬作業の操作入力を実行可能に表示する第3表示画面(70C)を、それぞれ表示出力可能な情報として生成する出力情報生成ステップ(S4)と、表示画面(305)上に、前記第1表示画面、前記第2表示画面および前記第3表示画面の各画面を所定の出力条件に従って表示する表示出力ステップ(S8)と、を含み、前記所定の出力条件が、前記情報入力装置で取得される前記複数の操作対象画像の前記選択操作の順序および選択内容に応じて設定されることを特徴とする。
In order to solve the above-mentioned problems, the method for presenting training material according to claim 6 of the present invention provides a training material including a three-dimensional image related to maintenance work of a target device (401) together with a work space display and a trainee (4). ), And a method for presenting training material in which the content of presentation is changed according to the operation input of the simulated work corresponding to each stage of the maintenance work, the information input step of acquiring information of the operation input of the simulated work. As (S1), a plurality of operation target images (400) capable of displaying and selectively operating the work target part (405) of the maintenance work and the tools (404a, 404b, 404c, 404d) used for the maintenance work. A storage step (S2) of storing the operation input information acquired by the information input device and storing one of the plurality of operation target images in the maintenance work based on the storage information of the storage device. A first display screen (70A) displaying a specific tool necessary for the process, a second display screen (70B) displaying a work target part of the specific process among the plurality of operation target images, and a work of the specific process An output information generation step (S4) of generating a third display screen (70C) for displaying the operation input of the simulated work for the work target site as executable information, and a display screen (S4). 305), a display output step (S8) of displaying each of the first display screen, the second display screen, and the third display screen according to a predetermined output condition, and the predetermined output condition is Is set in accordance with the order and selection contents of the selection operations of the plurality of operation target images acquired by the information input device.
この構成により、本発明の請求項6に係る訓練教材提示方法は、第1ないし第3表示画面の各画面が、ツールや作業対象部位の選択操作または選択済み作業対象部位への操作入力を要求するインストラクション表示と、その表示内容に対応する特定の操作対象画像の選択操作または模擬作業操作入力を実行可能な操作対象画像表示領域とを含んでいるので、各画面に対するユーザの操作入力に応じて画面表示内容が順次変更されていき、作業手順を実機無しで容易・的確に把握可能となる。
With this configuration, in the training material presenting method according to claim 6 of the present invention, each screen of the first to third display screens requires a selection operation of a tool or a work target site or an operation input to a selected work target site. Since it includes an instruction display and an operation target image display area capable of performing a selection operation or a simulated work operation input of a specific operation target image corresponding to the display content, it is possible to respond to a user operation input on each screen. The contents displayed on the screen are changed sequentially, and it becomes possible to easily and accurately grasp the work procedure without using an actual machine.
本発明は、対象機器の保守作業手順を実機無しで反映した訓練教材を容易かつ的確に生成可能な訓練教材提示システムおよび訓練教材提示方法を提供することができる。
The present invention can provide a training material presentation system and a training material presentation method that can easily and accurately generate a training material that reflects the maintenance work procedure of the target device without an actual machine.
以下、本発明に係る訓練教材提示システム1の一実施形態について図面を用いて説明する。なお、本実施形態では、主として、対象機器の保守作業の訓練を行うための訓練教材を生成、提示する場合について述べるが、本発明は、システムや設備を対象とする保守作業の訓練のための訓練教材を生成、提示する場合にも適用できるものである。
An embodiment of the training material presentation system 1 according to the present invention will be described below with reference to the drawings. In the present embodiment, a case will be mainly described in which a training material for performing maintenance work training of a target device is generated and presented, but the present invention is intended for maintenance work training for a system or equipment. It can also be applied when generating and presenting training materials.
本発明に係る訓練教材提示システム1は、図1に示すように、通信ネットワーク40に対してそれぞれ接続された動作取得端末10、訓練教材生成サーバ20、訓練教材実行端末30を有している。
As shown in FIG. 1, the training material presentation system 1 according to the present invention includes a motion acquisition terminal 10, a training material generation server 20, and a training material execution terminal 30, which are connected to a communication network 40.
訓練教材提示システム1において、動作取得端末10は、インストラクタ3が行う対象機器401(図9参照)の保守に関する模擬作業の情報を取得し、取得した情報を訓練教材生成サーバ20に出力する機能を有する。インストラクタ3が行う模擬作業としては、例えば、対象機器401の3次元画像を表示したうえで、入力操作を行うことにより、対象機器401の保守作業に照らして上記3次元画像を適宜に動かしつつ保守作業の各段階の作業を指示するための文字を入力したり、マイクを使って音声情報を入力すること等が挙げられる。動作取得端末10は、インストラクタ3の模擬作業での操作入力(文字情報、音声情報等)を取得する。この他、動作取得端末10は、保守作業の対象機器401(実機)に対するインストラクタ3による保守作業を撮影し、その撮影画像を模擬作業として取り込む機能を有していてもよい。
In the training material presentation system 1, the operation acquisition terminal 10 has a function of acquiring information on simulated work related to maintenance of the target device 401 (see FIG. 9) performed by the instructor 3 and outputting the acquired information to the training material generation server 20. Have. As the simulation work performed by the instructor 3, for example, a three-dimensional image of the target device 401 is displayed, and then an input operation is performed, so that the three-dimensional image can be appropriately moved and maintained in light of the maintenance work of the target device 401. Examples include inputting characters for instructing work at each stage of work, inputting voice information using a microphone, and the like. The motion acquisition terminal 10 acquires an operation input (text information, voice information, etc.) in the simulated work of the instructor 3. In addition, the operation acquisition terminal 10 may have a function of photographing the maintenance work performed by the instructor 3 on the maintenance target device 401 (actual machine) and capturing the photographed image as a simulated work.
訓練教材生成サーバ20は、動作取得端末10から該動作取得端末10が取得した、例えば、インストラクタ3が行う模擬作業での操作入力の情報を受信して記憶する。訓練教材生成サーバ20は、記憶された情報に基づいて、対象機器401の3次元画像を含む訓練教材としてのマルチメディア・コンテンツを生成するオーサリング(Authoring)機能と、生成した訓練教材を、訓練教材実行端末30に配信し、作業空間表示と共に訓練者4に提示する機能を有している。
The training material generation server 20 receives and stores, from the operation acquisition terminal 10, the operation input information acquired by the operation acquisition terminal 10, for example, the simulated work performed by the instructor 3. The training material generation server 20 uses the authoring function for generating multimedia contents as training material including the three-dimensional image of the target device 401 based on the stored information, and the generated training material as the training material. It has a function of delivering to the execution terminal 30 and presenting it to the trainee 4 together with the work space display.
訓練教材実行端末30は、訓練者4が操作する情報端末であり、訓練教材生成サーバ20から配信される訓練教材を作業空間とともに表示するとともに、訓練者4による入力操作を受け付けつつ、表示された訓練教材を用いた対象機器401の保守作業の訓練を実行するものである。
The training material execution terminal 30 is an information terminal operated by the trainee 4, and displays the training material distributed from the training material generation server 20 together with the work space and while accepting the input operation by the trainee 4. The training for the maintenance work of the target device 401 using the training material is executed.
動作取得端末10、訓練教材生成サーバ20、訓練教材実行端末30は、例えば、PC(パーソナル・コンピュータ)等の情報処理装置により構成される。特に、動作取得端末10、訓練教材実行端末30については、例えば、スマートフォン、タブレット等の携帯型端末で構成されていてもよい。
The motion acquisition terminal 10, the training material generation server 20, and the training material execution terminal 30 are configured by an information processing device such as a PC (personal computer). In particular, the motion acquisition terminal 10 and the training material execution terminal 30 may be configured with mobile terminals such as smartphones and tablets.
動作取得端末10、訓練教材生成サーバ20、訓練教材実行端末30は、いずれも、3次元グラフィックデータ描画機能を有している。すなわち、訓練教材提示システム1は、対象機器401の保守作業に関連する教育教材として3DCGを積極的に採用している。
The operation acquisition terminal 10, the training material generation server 20, and the training material execution terminal 30 all have a three-dimensional graphic data drawing function. That is, the training material presentation system 1 positively adopts 3DCG as an educational material related to the maintenance work of the target device 401.
次に、訓練教材提示システム1における各装置のより詳しい構成について説明する。
Next, a more detailed configuration of each device in the training material presentation system 1 will be described.
訓練教材提示システム1において、動作取得端末10は、例えば、図2に示すように、制御部100、通信部101、センシング部102、録音部103、録画部104、表示部105、操作部106、電源供給部107、メモリ110、ストレージ120を有し、これら各部がバス130により接続されている。
In the training material presentation system 1, the action acquisition terminal 10 includes, for example, as illustrated in FIG. 2, a control unit 100, a communication unit 101, a sensing unit 102, a recording unit 103, a recording unit 104, a display unit 105, an operation unit 106, It has a power supply unit 107, a memory 110, and a storage 120, and these units are connected by a bus 130.
制御部100は、動作取得端末10全体の制御を行うCPU(中央処理装置)により構成される。通信部101は、通信ネットワーク40を介して訓練教材生成サーバ20との間で情報の通信を行うものである。センシング部102、録音部103、録画部104は、訓練教材を生成するためにインストラクタが行う模擬作業の情報を取得するための処理を行う機能部であり、それぞれ、後述する操作部106における操作入力の取込み、音声の録音、動作の録画を行うものである。表示部105は、各種情報を表示するものであり、例えば、LCD等により構成される。操作部106は、模擬作業等に関する各種指令の入力等に関する操作を行うものであり、キーボード、マウス等を備えている。電源供給部107は、動作取得端末10の動作に必要な電源を供給する。
The control unit 100 is composed of a CPU (central processing unit) that controls the entire operation acquisition terminal 10. The communication unit 101 communicates information with the training material generation server 20 via the communication network 40. The sensing unit 102, the recording unit 103, and the recording unit 104 are functional units that perform processing for acquiring information on simulated work performed by the instructor to generate training materials, and operation inputs on the operation unit 106 described later, respectively. Capture, voice recording, and motion recording. The display unit 105 displays various kinds of information, and is composed of, for example, an LCD or the like. The operation unit 106 performs an operation related to input of various commands related to simulation work and the like, and includes a keyboard, a mouse, and the like. The power supply unit 107 supplies power necessary for the operation of the operation acquisition terminal 10.
メモリ110は、例えば、ROM、RAM等を含み、動作取得端末10としての機能動作を実現するためのプログラム等、各種の情報を記憶している。図2の例では、メモリ110は、動作集計処理部111、教材生成処理部112、情報送受信処理部113の各処理部を実現するための各プログラムを記憶している。これら各処理部は、制御部(CPU)100が各プログラムをメモリ110から読み出して実行することにより実現される。
The memory 110 includes, for example, a ROM and a RAM, and stores various information such as a program for realizing the functional operation of the operation acquisition terminal 10. In the example of FIG. 2, the memory 110 stores each program for implementing each processing unit of the motion totaling processing unit 111, the teaching material generation processing unit 112, and the information transmission / reception processing unit 113. Each processing unit is realized by the control unit (CPU) 100 reading each program from the memory 110 and executing the program.
動作集計処理部111は、インストラクタが行う模擬作業での操作入力の情報を取り込んで、該模擬作業の動作の情報として集計するものである。教材生成処理部112は、動作集計処理部111により集計された模擬作業の動作に基づいて訓練教材の生成に用いる教材の生成をするものである。情報送受信処理部113は、模擬作業の動作の情報や教材等の各種情報の送受信を行うものである。
The motion totaling processing unit 111 takes in the information of the operation input in the simulated work performed by the instructor and totalizes it as the information of the motion of the simulated work. The teaching material generation processing unit 112 generates a teaching material to be used for generating the training teaching material based on the motions of the simulated work totaled by the motion totalization processing unit 111. The information transmission / reception processing unit 113 transmits / receives various kinds of information, such as information on the operation of the simulated work and teaching materials.
ストレージ120は、動作集計処理部111で集計された模擬作業の動作の情報を作業情報として記憶する作業情報記録データベース121を保持している。作業情報記録データベース121は、例えば、図3に示すように、インストラクタ番号(No.)に対応付けて、作業手順番号(No.)、手順番号(No.)、使用工具番号(No.)、作業対処部位、操作、記録動画、記録音声などの各項目の情報を記憶している。使用工具として、使用工具番号12、14のものが使用され、これらを用いた作業対象としては、六角ボルト1~6、ネジ1~3が記憶されている。
The storage 120 holds a work information recording database 121 that stores, as work information, the information on the motions of the simulated work totaled by the motion totalization processing unit 111. For example, as shown in FIG. 3, the work information recording database 121 is associated with an instructor number (No.), a work procedure number (No.), a procedure number (No.), a tool number (No.) used, Information about each item such as a work handling part, an operation, a recorded moving image, and a recorded sound is stored. As tools to be used, tool numbers 12 and 14 are used, and hexagon bolts 1 to 6 and screws 1 to 3 are stored as work objects using these tools.
上記構成を有する動作取得端末10は、本発明における情報入力装置に相当する。また、後述する説明から明らかであるように、動作取得端末10において、表示部105は、本発明における表示手段に相当する。操作部106は、本発明における指定手段、指示情報入力手段、明示部位指定手段、作業段階指定手段に相当する。作業情報記録データベース121は、本発明における第1の管理手段に相当する。
The motion acquisition terminal 10 having the above configuration corresponds to the information input device in the present invention. Further, as will be apparent from the description below, in the motion acquisition terminal 10, the display unit 105 corresponds to the display means in the present invention. The operation unit 106 corresponds to the designating means, the instruction information inputting means, the explicit part designating means, and the work stage designating means in the present invention. The work information recording database 121 corresponds to the first managing means in the present invention.
訓練教材生成サーバ20は、例えば、図3に示すように、制御部200、通信部201、表示部205、操作部206、電源供給部207、メモリ210、ストレージ220を有し、これら各部がバス230により接続されている。
The training material generation server 20 has, for example, as shown in FIG. 3, a control unit 200, a communication unit 201, a display unit 205, an operation unit 206, a power supply unit 207, a memory 210, and a storage 220, and each of these units is a bus. They are connected by 230.
制御部200は、訓練教材生成サーバ20全体の制御を行うCPUにより構成される。通信部201は、通信ネットワーク40を介して動作取得端末10および訓練教材実行端末30との間で情報の通信を行うものである。表示部205は、各種情報を表示するものであり、例えば、LCD等により構成される。操作部206は、キーボード、マウス等を備え、各種指令の入力等に関する操作を行うものである。電源供給部207は、訓練教材生成サーバ20の動作に必要な電源を供給する。
The control unit 200 is composed of a CPU that controls the entire training material generation server 20. The communication unit 201 communicates information with the motion acquisition terminal 10 and the training material execution terminal 30 via the communication network 40. The display unit 205 displays various kinds of information, and is composed of, for example, an LCD or the like. The operation unit 206 includes a keyboard, a mouse, and the like, and performs an operation related to inputting various commands. The power supply unit 207 supplies power required for the operation of the training material generation server 20.
メモリ210は、例えば、ROM、RAM等を含み、訓練教材生成サーバ20としての機能動作を実現するためのプログラム等、各種の情報を記憶している。図3の例では、メモリ210は、動作集計処理部211、教材生成処理部212、情報送受信処理部213の各処理部を実現するための各プログラムを記憶している。これら各処理部は、制御部(CPU)200が各プログラムをメモリ210から読み出して実行することにより実現される。
The memory 210 includes, for example, a ROM and a RAM, and stores various information such as a program for realizing the functional operation of the training material generation server 20. In the example of FIG. 3, the memory 210 stores each program for realizing each processing unit of the motion totaling processing unit 211, the teaching material generation processing unit 212, and the information transmission / reception processing unit 213. Each processing unit is realized by the control unit (CPU) 200 reading out each program from the memory 210 and executing the program.
動作集計処理部211は、動作取得端末10から受信したインストラクタ3が行う模擬作業での動作情報(操作入力の情報)と、後述する訓練教材実行端末30から受信した訓練者4が行う訓練(保守作業)の動作情報(操作入力の情報)とを集計し、管理するものである。訓練教材生成サーバ20では、インストラクタ3が行う模擬作業での動作情報(操作入力の情報)は動作取得端末10の動作集計処理部111から取得し、訓練者4が行う訓練(保守作業)の動作情報(操作入力の情報)は、訓練教材実行端末30の後述する教材実行処理部311から取得する。
The motion totaling processing unit 211 receives motion information (operation input information) in the simulated work performed by the instructor 3 received from the motion acquisition terminal 10, and training (maintenance performed by the trainee 4 received from the training material execution terminal 30 described later). The operation information (operation input information) of (work) is totaled and managed. In the training material generation server 20, the motion information (operation input information) in the simulated work performed by the instructor 3 is acquired from the motion totalization processing unit 111 of the motion acquisition terminal 10, and the motion of the training (maintenance work) performed by the trainee 4 is performed. The information (operation input information) is acquired from the later-described teaching material execution processing unit 311 of the training teaching material execution terminal 30.
教材生成処理部212は、動作取得端末10の動作集計処理部111により集計された模擬作業の動作(操作入力の情報)に基づいて訓練教材を生成するものである。情報送受信処理部113は、インストラクタ3が行う模擬作業での動作情報、訓練者4が行う訓練(保守作業)の動作情報、訓練教材等の各種情報の送受信を行うものである。
The teaching material generation processing unit 212 generates the training material based on the motions of the simulated work (information of operation input) collected by the motion collection processing unit 111 of the motion acquisition terminal 10. The information transmission / reception processing unit 113 transmits / receives various kinds of information such as operation information in simulated work performed by the instructor 3, operation information in training (maintenance work) performed by the trainee 4, and training materials.
ストレージ220は、訓練教材を生成するためのテンプレートの情報を記憶するテンプレートデータベース221と、訓練教材を記憶する訓練教材データベース222とを保持している。
The storage 220 holds a template database 221 that stores information about templates for generating training materials and a training material database 222 that stores training materials.
テンプレートデータベース221は、例えば、図5に示すように、テンプレート番号(No.)に対応付けて、進行パターン番号(No.)、画面構成番号(No.)などの各項目の情報を記憶している。この例のテンプレートデータベース221は、進行パターン番号1、2、3、9に対応して、それぞれ、画面構成番号の並びが「1、2、4、・・」、「5、7、8、・・」、「5、7、9、・・」、「10、12、・・」という内容の情報が記憶されている。
The template database 221 stores information on each item such as a progress pattern number (No.) and a screen configuration number (No.) in association with a template number (No.), as shown in FIG. There is. In the template database 221 of this example, the sequence of screen configuration numbers is “1, 2, 4, ...”, “5, 7, 8 ,. . ”,“ 5, 7, 9, ... ”,“ 10, 12, ... ”Are stored.
訓練教材データベース222は、テンプレートデータベース221に記録されたテンプレートを用いて生成された訓練教材が記憶されている。
The training material database 222 stores training material generated using the template recorded in the template database 221.
上記構成を有する訓練教材生成サーバ20は、本発明における出力情報生成装置に相当する。また、後述する説明から明らかであるように、訓練教材生成サーバ20において、教材生成処理部212は、本発明における訓練教材生成手段に相当する。ストレージ220は、本発明における記憶装置に相当する。
The training material generation server 20 having the above configuration corresponds to the output information generation device in the present invention. Further, as will be apparent from the description below, in the training material generation server 20, the learning material generation processing unit 212 corresponds to the training material generation means in the present invention. The storage 220 corresponds to the storage device in the present invention.
訓練教材実行端末30は、例えば、図4に示すように、制御部300、通信部301、表示部305、操作部306、電源供給部307、メモリ310、ストレージ320を有し、これら各部がバス330により接続されている。
The training material execution terminal 30 has, for example, as shown in FIG. 4, a control unit 300, a communication unit 301, a display unit 305, an operation unit 306, a power supply unit 307, a memory 310, and a storage 320, each of which is a bus. They are connected by 330.
制御部300は、訓練教材実行端末30全体の制御を行うCPUにより構成される。通信部301は、通信ネットワーク40を介して訓練教材生成サーバ20との間で情報の通信を行うものである。表示部305は、各種情報を表示するものであり、例えば、LCD等により構成される。操作部306は、キーボード、マウス等を備え、各種指令の入力等に関する操作を行うものである。電源供給部307は、訓練教材実行端末30の動作に必要な電源を供給する。
The control unit 300 is composed of a CPU that controls the entire training material execution terminal 30. The communication unit 301 communicates information with the training material generation server 20 via the communication network 40. The display unit 305 displays various types of information, and is composed of, for example, an LCD. The operation unit 306 includes a keyboard, a mouse, and the like, and performs an operation related to inputting various commands. The power supply unit 307 supplies power necessary for the operation of the training material execution terminal 30.
メモリ310は、例えば、ROM、RAM等を含み、訓練教材実行端末30としての機能動作を実現するためのプログラム等、各種の情報を記憶している。図4の例では、メモリ310は、教材実行処理部311、実行データ集計処理部312、情報送受信処理部313の各処理部を実現するための各プログラムを記憶している。これら各処理部は、制御部(CPU)300が各プログラムをメモリ310から読み出して実行することにより実現される。
The memory 310 includes, for example, a ROM and a RAM, and stores various kinds of information such as a program for realizing the functional operation of the training material execution terminal 30. In the example of FIG. 4, the memory 310 stores each program for realizing each processing unit of the teaching material execution processing unit 311, the execution data totaling processing unit 312, and the information transmission / reception processing unit 313. Each processing unit is realized by the control unit (CPU) 300 reading each program from the memory 310 and executing the program.
教材実行処理部311は、操作部306での訓練者4の訓練要求操作を受け付けて、該要求された対象機器401の保守作業のための訓練教材を訓練教材生成サーバ20から取り込んで表示部305に訓練用画面として表示し、該訓練用画面を用いて保守作業の各段階の作業に対しての訓練を実行する。この訓練において、教材実行処理部311は、訓練者4が訓練用画面上で行う訓練作業(操作入力)に応じて当該保守作業の各段階の表示画面を切り換える制御を行う。
The teaching material execution processing unit 311 receives the training request operation of the trainee 4 on the operation unit 306, fetches the requested training teaching material for maintenance work of the target device 401 from the training teaching material generation server 20, and displays the display unit 305. Is displayed as a training screen, and the training for each stage of maintenance work is executed using the training screen. In this training, the teaching material execution processing unit 311 controls to switch the display screen of each stage of the maintenance work according to the training work (operation input) performed by the trainee 4 on the training screen.
実行データ集計処理部312は、訓練画面上で訓練者4が行う訓練の作業、すなわち、対象機器画像に対する保守作業(模擬作業)での操作入力の情報を集計するものである。情報送受信処理部313は、実行データ集計処理部312が集計した情報(訓練者4の模擬作業での操作入力の情報)等の各種情報の送受信を行うものである。
The execution data tabulation processing unit 312 tabulates information on the operation input of the training work performed by the trainee 4 on the training screen, that is, the maintenance work (simulation work) for the target device image. The information transmission / reception processing unit 313 transmits / receives various types of information such as the information aggregated by the execution data aggregation processing unit 312 (information of operation input in the simulated work of the trainee 4).
ストレージ320は、実行データ集計処理部312で集計された訓練者4の模擬作業(保守作業)での操作入力の情報の情報を作業情報として記憶する実行情報記録データベース321を保持している。実行情報記録データベース321は、例えば、図7に示すように、訓練者番号(No.)に対応付けて、作業番号(No.)、手順番号(No.)、使用工具番号(No.)、作業対処部位、正誤、習熟度などの各項目の情報を記憶している。
The storage 320 holds an execution information recording database 321 that stores, as work information, information on operation input information of the simulated work (maintenance work) of the trainee 4 collected by the execution data collection processing unit 312. For example, as shown in FIG. 7, the execution information recording database 321 is associated with a trainee number (No.), a work number (No.), a procedure number (No.), a tool number (No.) used, Information about each item such as a work handling part, correctness and proficiency is stored.
上記構成を有する訓練教材実行端末30は、本発明における表示出力装置に相当する。また、後述する説明から明らかであるように、訓練教材実行端末30において、制御部300は、本発明における判定手段、表示制御手段に相当する。操作部306は、本発明におけるモード選択手段に相当する。実行データ集計処理部312は、本発明における集計手段に相当する。実行情報記録データベース321は、本発明における第2の管理手段、記録手段に相当する。
The training material execution terminal 30 having the above configuration corresponds to the display output device of the present invention. Further, as will be apparent from the description below, in the training material execution terminal 30, the control unit 300 corresponds to the determination means and the display control means in the present invention. The operation unit 306 corresponds to the mode selection unit in the present invention. The execution data tallying processing unit 312 corresponds to the tallying means in the present invention. The execution information recording database 321 corresponds to the second management means and recording means in the present invention.
次に、本実施形態に係る訓練教材提示システム1におけるオーサリング機能について説明する。
Next, the authoring function in the training material presentation system 1 according to this embodiment will be described.
訓練教材提示システム1において、訓練教材生成サーバ20は、動作取得端末10と協働して訓練教材を生成する。訓練教材を生成するためには、前準備として、対象機器401の3DCG画像を生成する必要がある。その際、対象機器401を部品単位に分解して各部品を撮影し、該各部品の画像をまとめて対象機器401の3DCGモデルを生成する。例えば、図19に示すような健康器具を対象機器401とする場合は、図19Aに示す形状の健康器具を、図19Bに示すような状態に分解して各部品を撮影する。そのうえで、各部品の画像を実機における位置近傍に配置したうえで、図19Aに示すように当該各部分を実機に則して互いに近づけていくことで当該対象機器401の3DCGモデルをまず生成する。それ以外にも、例えば、CAD(Computer Aided Design)モデリングソフトウェアなどで、各部品をモデリングし、各部品の3D画像を実機における近傍位置に配置したうえで、図19Aに示すように当該各部分を実機に則して互いに近づけていくことで当該対象機器401の3DCADモデルを生成する方法であってもよい。対象機器401の画像、および各部品の画像は、本発明における操作対象画像に相当する。同様に、対象機器401の保守作業に用いる複数のツール404a、404b、404c、404d(図16参照)についても、各ツール404a、404b、404c、404d(以下、単に404と称することもある)を撮影すること、あるいはCG処理によって3DCG画像を生成する。
In the training material presentation system 1, the training material creation server 20 cooperates with the motion acquisition terminal 10 to create the training material. In order to generate the training material, it is necessary to generate a 3DCG image of the target device 401 as a preparation. At this time, the target device 401 is disassembled into parts, each part is photographed, and images of the parts are collected to generate a 3DCG model of the target device 401. For example, when the health appliance as shown in FIG. 19 is used as the target device 401, the health appliance having the shape shown in FIG. 19A is disassembled into the state as shown in FIG. 19B and each part is photographed. Then, the images of the respective parts are arranged in the vicinity of the positions in the actual machine, and then the respective parts are brought closer to each other in accordance with the actual machine as shown in FIG. 19A to first generate the 3DCG model of the target device 401. Other than that, for example, after modeling each part by CAD (Computer Aided Design) modeling software and the like, and arranging the 3D image of each part in the vicinity of the actual machine, as shown in FIG. A method of generating a 3D CAD model of the target device 401 by bringing them closer to each other according to an actual machine may be used. The image of the target device 401 and the image of each component correspond to the operation target image in the present invention. Similarly, regarding the plurality of tools 404a, 404b, 404c, and 404d (see FIG. 16) used for the maintenance work of the target device 401, the respective tools 404a, 404b, 404c, and 404d (hereinafter, also simply referred to as 404) may be used. A 3DCG image is generated by photographing or CG processing.
この訓練教材提示システム1では、前準備で生成した操作対象画像、およびツール404の画像を動作取得端末10に取込み、インストラクタ3の模擬作業によって各画像に移動、回転などの操作を加えることで、訓練教材生成サーバ20が3DCG画像を使った訓練教材を生成することができる。生成される訓練教材は、例えば、図9~図11に示す各表示画面50A、50B、50C、図12~図14に示す各表示画面60A、60B、60C、図16~図18に示す第1表示画面70A、第2表示画面70B、第3表示画面70C等の表示画面を、保守作業(模擬作業)の各段階に関連付けて表示可能とする情報である。
In the training teaching material presentation system 1, by capturing the operation target image generated in the preparation and the image of the tool 404 in the motion acquisition terminal 10 and performing an operation such as moving or rotating on each image by the simulated work of the instructor 3, The training material generation server 20 can generate the training material using the 3DCG image. The generated training material is, for example, the display screens 50A, 50B, 50C shown in FIGS. 9 to 11, the display screens 60A, 60B, 60C shown in FIGS. 12 to 14, and the first display screens shown in FIGS. This is information that enables display screens such as the display screen 70A, the second display screen 70B, and the third display screen 70C to be displayed in association with each stage of maintenance work (simulation work).
この訓練教材の生成手順について以下に説明する。訓練教材を生成するには、まず、インストラクタ3は、動作取得端末10において、複数の操作対象画像を含む対象機器401の3DCG画像、およびツール画像を取り込んで表示部105に表示させる。
The procedure for creating this training material is explained below. To generate the training material, the instructor 3 first captures the 3DCG image of the target device 401 including a plurality of operation target images and the tool image in the motion acquisition terminal 10 and displays the 3DCG image on the display unit 105.
次に、インストラクタ3は、表示部105に表示された対象機器401の3DCG画像における複数の操作対象画像に対する模擬作業の操作を、操作部106からの入力操作によって実行し、各操作対象画像に対する保守作業の基準となる作業(作業手順)を指定する。また、インストラクタ3は、操作対象画像における作業対象部位、作業に使用するツール404、および該ツール404の動きを、同じく模擬作業の操作により指定する。ツール404の動きとしては、例えば、回す、外れる等を指定する。さらに、インストラクタ3は、同じく模擬作業の操作によって、上述したツール404の動きに応じた対象部位の動きを指定する。その際、インストラクタ3は、上述した作業手順の結果として、対象部位(オブジェクト:カバーなどのパーツ)が外れたり、どう動くかを、操作部106からの入力操作によって指定する。
Next, the instructor 3 executes a simulation work operation on a plurality of operation target images in the 3DCG image of the target device 401 displayed on the display unit 105 by an input operation from the operation unit 106, and performs maintenance on each operation target image. Designate the work (work procedure) that is the basis of the work. Further, the instructor 3 designates the work target site in the operation target image, the tool 404 used for the work, and the movement of the tool 404 by the same simulated work operation. As the movement of the tool 404, for example, turning, disengaging, or the like is designated. Further, the instructor 3 also designates the movement of the target portion according to the movement of the tool 404 described above by the operation of the simulation work. At that time, the instructor 3 specifies, as a result of the above-described work procedure, how the target part (object: a part such as a cover) is detached or moves by an input operation from the operation unit 106.
訓練教材生成サーバ20において、教材生成処理部212は、上述したインストラクタ3の模擬作業の操作での保守作業の基準となる作業の指定に応じて、まず、当該基準となる作業を作成する。また、教材生成処理部212は、その後のインストラクタ3の模擬作業の操作での作業対象部位、ツール404、ツール404の動きの指定に応じて、当該作業対象部位、ツール404、ツール404の動きを示す作業手順が反映された訓練教材を生成する。また、教材生成処理部212は、作業手順の結果として指定されたオブジェクトの動きも反映した訓練教材を作成する。
In the training teaching material generation server 20, the teaching material generation processing unit 212 first creates the reference work according to the designation of the work as the reference work for the maintenance work in the operation of the instructor 3 described above. In addition, the teaching material generation processing unit 212 determines the movement of the work target portion, the tool 404, and the tool 404 in accordance with the designation of the work target portion, the tool 404, and the movement of the tool 404 in the subsequent simulated operation of the instructor 3. Generate training materials that reflect the work procedure shown. Further, the teaching material generation processing unit 212 creates the training material that also reflects the movement of the object designated as the result of the work procedure.
訓練教材の作成に際し、インストラクタ3はさらに、対象機器401の保守作業中に各作業項目ごとに、訓練者4を誘導するための指示情報を模擬操作によって入力する。この指示情報は、訓練のモードに応じて入力する。
When creating the training material, the instructor 3 further inputs the instruction information for guiding the trainee 4 for each work item during the maintenance work of the target device 401 by a simulated operation. This instruction information is input according to the training mode.
訓練教材提示システム1では、訓練のモードについて、訓練教材実行端末30において、教育モードまたは演習モードを選択できるようになっている。これにより、インストラクタ3は、例えば、教育モードに関しては、該教育モードで表示される訓練のための表示画面上で保守作業の対象部位を他の部位と異なる態様で明示することを指定する。一例として、例えば、表示画面80を表示可能な教材の作成に際しては、「注意:ネジは少し緩めるだけ、外さないこと。」という部位については黄色で表示することを指定する。
In the training material presentation system 1, the training material execution terminal 30 can select an education mode or an exercise mode as a training mode. As a result, the instructor 3 specifies, for example, regarding the education mode, that the target portion of the maintenance work is clearly indicated in a manner different from other portions on the display screen for training displayed in the education mode. As an example, when creating a teaching material that can display the display screen 80, it is specified to display a yellow part for the part "Caution: Only loosen the screw but do not remove it."
一方、例えば、演習モードに関しては、インストラクタ3は、該演習モードで表示される訓練のための表示画面上で、作業対象部位が正しく選択された場合にのみ次の作業段階に進むことが可能である旨を指定する。具体例としては、例えば、第1表示画面70A(図16参照)、第2表示画面70B(図17参照)、第3表示画面70C(図18参照)を表示可能な各教材の作成に際しては、それぞれ、コンソール取り外し時のツール404が正しく選択された場合、六角ボルトの正しい本数がクリックされた場合、コンソールを移動する方向が正しく選択された場合にのみ、次の作業段階に進むことが可能である旨を指定する。
On the other hand, for example, in the practice mode, the instructor 3 can proceed to the next work stage only when the work target portion is correctly selected on the display screen for training displayed in the practice mode. Specify that there is. As a specific example, for example, when creating each teaching material capable of displaying the first display screen 70A (see FIG. 16), the second display screen 70B (see FIG. 17), and the third display screen 70C (see FIG. 18), Only when the tool 404 for removing the console is correctly selected, the correct number of hexagon bolts is clicked, and the direction in which the console is moved are correctly selected, the next work step can be performed. Specify that there is.
上述したオーサリング機能を実現するために、本実施形態に係る訓練教材提示システム1において、動作取得端末10は、3次元画像を含む操作対象画像400を表示する表示部105と、インストラクタ3の模擬作業によって、操作対象画像400に対する保守作業の基準となる作業と、操作対象画像400における作業対象部位405、ツール404、およびツール404の動きと、ツール404の動きに応じた対象部位の動きと、を指定する機能を有する操作部106と、を有する。
In order to realize the above-mentioned authoring function, in the training material presentation system 1 according to the present embodiment, the motion acquisition terminal 10 displays the operation target image 400 including a three-dimensional image, and the simulation work of the instructor 3. By the operation of the maintenance target for the operation target image 400, movement of the work target portion 405, tool 404, and tool 404 in the operation target image 400, and movement of the target portion according to the movement of the tool 404. And an operation unit 106 having a function of designating.
訓練教材生成サーバ20は、上記指定された基準となる作業に、作業対象部位405、ツール404、ツール404の動き、および対象部位の動きが反映された作業手順を有する訓練教材を生成する教材生成処理部212を有する。
The training material generation server 20 generates a training material having a work procedure in which a work target part 405, a tool 404, a movement of the tool 404, and a motion of the target part are reflected in the designated standard work. The processing unit 212 is included.
また、本実施形態に係る訓練教材提示システム1において、訓練教材実行端末30は、第1ないし第3表示画面70A、70B、70Cの各画面を表示して行う訓練のモードとして、教育モードまたは演習モードを選択するモード選択機能を有する操作部306を有し、動作取得端末10は、記訓練の実施中に訓練者4を誘導するための指示情報を入力する指示情報入力機能、教育モードでの訓練時に訓練者4に対して明示する部位を指定する明示部位指定機能、および演習モードでの訓練時に基準となる作業で指定した部位が選択された場合にのみ次の作業段階に進むように指定する作業段階指定機能とを備えた操作部106を有する。
Further, in the training material presentation system 1 according to the present embodiment, the training material execution terminal 30 displays the first to third display screens 70A, 70B, and 70C as the training mode to be performed, and the training mode or the exercise. Having the operation unit 306 having a mode selection function for selecting a mode, the motion acquisition terminal 10 has an instruction information input function for inputting instruction information for guiding the trainee 4 during the execution of the training, and an instruction mode in the education mode. Explicit part designation function to specify the part to be clearly shown to the trainee 4 at the time of training, and to specify to proceed to the next work stage only when the part specified in the reference work at the time of training in the exercise mode is selected The operation unit 106 is provided with a work stage designation function.
次に、本実施形態に係る訓練教材提示システム1における訓練者4のスキル管理機能について説明する。
Next, the skill management function of the trainee 4 in the training material presentation system 1 according to this embodiment will be described.
訓練教材提示システム1において、動作取得端末10は、上述した対象機器401の保守作業の作業手順(訓練教材)の作成時、インストラクタ3による模擬作業での入力操作の情報に基づき、当該模擬作業の各作業項目ごとの作業手順、作業対象部位、およびツール404の各情報(基準操作入力情報)を取得し、該基準操作入力情報を作業情報記録データベース121(図2、図3参照)に記憶し、管理している。
In the training teaching material presentation system 1, the operation acquisition terminal 10 creates a work procedure (training teaching material) for the maintenance work of the target device 401 described above based on the information of the input operation of the simulated work by the instructor 3 based on the information of the input work. The work procedure for each work item, the work target part, and each information (reference operation input information) of the tool 404 are acquired, and the reference operation input information is stored in the work information recording database 121 (see FIGS. 2 and 3). , Manage.
一方で、訓練教材実行端末30は、上述した演習モードでの訓練者4による対象機器401の保守作業(模擬作業)の実行時、該模擬作業の入力操作の情報に基づき、各作業項目ごとの作業手順、作業対象部位、およびツール404の各情報(操作入力情報)を取得し、該操作入力情報を、実行情報記録データベース321(図6、図7参照)に記憶し、管理している。
On the other hand, when the trainee 4 executes the maintenance work (simulated work) of the target device 401 in the above-described exercise mode in the above-described practice mode, the training material execution terminal 30 determines each work item based on the input operation information of the simulated work. Each piece of information (operation input information) on the work procedure, the work target part, and the tool 404 is acquired, and the operation input information is stored and managed in the execution information recording database 321 (see FIGS. 6 and 7).
訓練教材実行端末30において、制御部300は、動作取得端末10の作業情報記録データベース121に記憶されている各作業項目ごとの作業手順、作業対象部位、およびツール404の各情報を基準操作入力情報、つまり、正解の操作入力情報として管理する管理機能と、訓練教材実行端末30の実行情報記録データベース321に記憶されている各作業項目ごとの作業手順、作業対象部位、およびツール404の各情報を操作入力情報と、正解の操作入力情報と比較して訓練者4の習熟度を判定する判定機能を有している。
In the training material execution terminal 30, the control unit 300 uses the work procedure for each work item stored in the work information recording database 121 of the motion acquisition terminal 10, the work target site, and each information of the tool 404 as standard operation input information. That is, the management function for managing the correct operation input information, the work procedure for each work item stored in the execution information recording database 321 of the training material execution terminal 30, the work target part, and each information of the tool 404. It has a judgment function of judging the skill level of the trainee 4 by comparing the operation input information with the correct operation input information.
具体的に、制御部300では、例えば、訓練者4の模擬操作が正しい場合には丸(○)印を、実行情報記録データベース321の正誤欄に記録する(図7参照)。また、例えば、同じ訓練を訓練者4に複数回繰り返し行わせ、該複数回(この例では3回)の演習回数に対するバツ印の数の比に基づいて訓練者4の当該対象機器401の保守作業の習熟度(例えば、高い方からA、B、C、・・・等)を算出し、実行情報記録データベース321の習熟度欄に記録する(図7参照)。
Specifically, for example, when the simulated operation of the trainee 4 is correct, the control unit 300 records a circle (o) mark in the correct / incorrect column of the execution information recording database 321 (see FIG. 7). In addition, for example, the trainee 4 is made to repeat the same training a plurality of times, and the trainee 4 maintains the target device 401 based on the ratio of the number of crosses to the number of times the training is performed a plurality of times (three times in this example). The work proficiency level (for example, A, B, C, ... From the highest) is calculated and recorded in the proficiency level field of the execution information recording database 321 (see FIG. 7).
また、訓練教材実行端末30においては、制御部300は、上述した管理機能、判定機能の他、訓練者4に対応付けて訓練教材を用いた演習結果を、訓練教材ごとに記録する記録機能を有していてもよい。さらに、制御部300は、上述した演習結果、および比較結果を集計し、その集計結果を表示部305に表示させる表示制御を行う表示制御機能を有する構成であってもよい。
Further, in the training material execution terminal 30, the control unit 300 has a recording function of recording the training result using the training material associated with the trainee 4 for each training material, in addition to the management function and the determination function described above. You may have. Further, the control unit 300 may be configured to have a display control function of performing display control of totaling the above-described exercise results and comparison results and displaying the totalized results on the display unit 305.
ここでは、訓練教材実行端末30が上述した管理機能、判定機能を有する例を挙げているが、本発明はこれに限らず、これら管理機能、判定機能を訓練教材生成サーバ20に設けても、あるいは訓練教材生成サーバ20と訓練教材実行端末30とが協働して実行する構成としてもよい。
Here, an example is given in which the training material execution terminal 30 has the above-described management function and determination function, but the present invention is not limited to this, and even if these training functions and determination functions are provided in the training material generation server 20, Alternatively, the training material generation server 20 and the training material execution terminal 30 may be configured to execute in cooperation with each other.
上述したスキル管理のための機能構成として、訓練教材提示システム1は、インストラクタ3の模擬作業により保守作業の各作業項目ごとに指定された作業手順、作業対象部位405、およびツール404の各情報を、正解の操作入力の情報として管理する第1の管理機能としての作業情報記録データベース121と、訓練者4の模擬作業により保守作業の各作業項目ごとに指定された作業手順、作業対象部位405、およびツール404の各情報を、演習モードの操作入力の情報として管理する第2の管理機能である実行情報記録データベース321と、正解の操作入力の情報と、演習モードの操作入力の情報との比較結果に応じて訓練者4の習熟度を判定する判定機能を有する制御部300と、訓練者4に対応付けて、演習モードでの訓練における上記比較結果を、訓練教材単位に記録する記録機能、および作業項目ごとの上記比較結果を、訓練教材単位に集計する集計機能とを有する実行データ集計処理部312とを有し、制御部300は、上記比較結果を表示部305に表示させる表示制御機能を有する構成である。
As a functional configuration for skill management described above, the training teaching material presentation system 1 displays each information of the work procedure, the work target part 405, and the tool 404 designated for each work item of the maintenance work by the simulated work of the instructor 3. , A work information recording database 121 as a first management function for managing as correct operation input information, a work procedure designated for each work item of maintenance work by a simulated work of the trainee 4, a work target portion 405, The execution information recording database 321 that is the second management function that manages each information of the tool 404 and the tool 404 as the information of the operation input of the exercise mode, the information of the operation input of the correct answer, and the information of the operation input of the exercise mode. A control unit 300 having a determination function of determining the proficiency level of the trainee 4 according to the result, and a recording function of associating with the trainee 4 and recording the above comparison result in the training in the practice mode in units of training material, And an execution data tabulation processing unit 312 having a tabulation function for tabulating the comparison results for each work item in units of training materials, and the control unit 300 has a display control function for displaying the comparison results on the display unit 305. It is the structure which has.
次に、本実施形態に係る訓練教材提示システム1における訓練教材提示方法について、図8に示すフローチャートを参照して説明する。図8に示すように、訓練教材提示システム1の訓練教材提示方法は、ステップS1~S4での訓練教材の生成段階と、ステップS5~S12での訓練教材の実行段階を含んでいる。
Next, a training material presentation method in the training material presentation system 1 according to the present embodiment will be described with reference to the flowchart shown in FIG. As shown in FIG. 8, the training material presentation method of the training material presentation system 1 includes a training material generation step in steps S1 to S4 and a training material execution step in steps S5 to S12.
訓練教材の生成段階ではまず、動作取得端末10が、インストラクタ3による訓練教材の作成に係る模擬作業での操作部106からの操作入力の情報を取得する(ステップS1)。その際、動作集計処理部111が、取得した情報(模擬作業での操作入力の情報)を集計し、その集計結果を作業情報記録データベース121に記憶させる処理を行う。この集計、記録処理は、ステップS1~S4の一連の教育教材生成処理が行われる間、継続的に実施される。
In the training material generation stage, first, the operation acquisition terminal 10 acquires information on an operation input from the operation unit 106 in a simulation work related to the preparation of the training material by the instructor 3 (step S1). At that time, the motion totaling processing unit 111 performs a process of totaling the acquired information (information of operation input in the simulated work) and storing the totalized result in the work information recording database 121. The totaling and recording process is continuously performed while the series of educational teaching material generating processes of steps S1 to S4 is performed.
次いで、訓練教材生成サーバ20が、上述した前準備の処理で生成された保守作業の作業対象部位と保守作業に使用するツール404とを操作対象画像(対象機器401の3DCG画像を含む)として記憶する(ステップS2)。引き続き、訓練教材生成サーバ20が、模擬作業の操作入力の手順を記憶する(ステップS3)。
Next, the training material generation server 20 stores the work target part of the maintenance work and the tool 404 used for the maintenance work generated in the above-described preparation process as the operation target image (including the 3DCG image of the target device 401). Yes (step S2). Subsequently, the training material generation server 20 stores the procedure of the operation input of the simulated work (step S3).
さらに、訓練教材生成サーバ20では、教材生成処理部212が、上記ステップS2、S3で記憶された情報に基づいて表示画面(訓練教材)を生成する(ステップS4)。その際、インストラクタ3は、例えば、操作部106を操作することにより、操作対象画像を適宜に動かしつつ保守作業の各段階の作業を指示するための文字を入力したり、マイクを使って音声情報を入力する。これに対し、教材生成処理部112が、インストラクタ3の模擬作業での操作入力の情報(文字情報、音声情報等)を取得し、該情報を訓練教材生成サーバ20の教材生成処理部212に引き渡す処理を行う。このステップS4での訓練教材の生成処理が完了すると、その後、訓練教材提示システム1は該訓練教材の実行段階に進むことが可能な状態となる。
Further, in the training material generation server 20, the learning material generation processing unit 212 generates a display screen (training material) based on the information stored in steps S2 and S3 (step S4). At that time, the instructor 3 operates the operation unit 106 to input characters for instructing the work at each stage of the maintenance work while appropriately moving the operation target image, and to use the microphone to input the voice information. Enter. On the other hand, the teaching material generation processing unit 112 acquires the information (character information, voice information, etc.) of the operation input in the simulated work of the instructor 3, and transfers the information to the teaching material generation processing unit 212 of the training teaching material generation server 20. Perform processing. When the generation process of the training teaching material in step S4 is completed, the training teaching material presentation system 1 is ready to proceed to the execution stage of the training teaching material.
訓練教材の実行段階ではまず、訓練者4が、訓練教材実行端末30の表示部305に表示した訓練実行のための所定の表示画面(図9、図12、図16参照)上で対象機器401の機器名、訓練メニューを選択(入力)する(ステップS5)。
In the execution stage of the training material, first, the trainee 4 displays the target device 401 on the predetermined display screen (see FIGS. 9, 12, and 16) for executing the training displayed on the display unit 305 of the training material execution terminal 30. Device name and training menu are selected (input) (step S5).
次いで、訓練教材実行端末30が、訓練者4により操作部306を用いて入力された機器名、訓練メニューの情報を訓練教材生成サーバ20に送信する(ステップS6)。
Next, the training material execution terminal 30 transmits the device name and the training menu information input by the trainee 4 using the operation unit 306 to the training material generation server 20 (step S6).
訓練教材生成サーバ20は、訓練教材実行端末30から機器名、訓練メニューを受信すると、該機器名、訓練メニューに対応した訓練教材(コンテンツ)を訓練教材データベース222より読み出し、訓練教材実行端末30に配信する(ステップS7)。
When the training material generating server 20 receives the device name and the training menu from the training material executing terminal 30, the training material (content) corresponding to the device name and the training menu is read from the training material database 222, and is transmitted to the training material executing terminal 30. It is distributed (step S7).
一方、訓練教材実行端末30では、訓練教材生成サーバ20から配信された訓練教材を受信し、教材実行処理部311が該訓練教材を実行する。その際、教材実行処理部311は、受信した訓練教材に基づいて表示画面(例えば、図16~図17参照)を所定の出力条件に従って表示部305に表示出力する(ステップS8)。
On the other hand, the training material execution terminal 30 receives the training material distributed from the training material generation server 20, and the learning material execution processing unit 311 executes the training material. At that time, the teaching material execution processing unit 311 outputs the display screen (for example, see FIGS. 16 to 17) to the display unit 305 based on the received training teaching material according to a predetermined output condition (step S8).
次いで、訓練教材実行端末30が、上記表示画面上で訓練者4が操作部306を用いて行う模擬作業での操作入力の情報を取得する(ステップS9)。その際、実行データ集計処理部312が、取得した情報(模擬作業での操作入力の情報)を集計し、その集計結果を実行情報記録データベース321に記憶させる処理を行う。この集計、記録処理は、ステップS10で訓練が終了したと判定されるまで継続される。
Next, the training material execution terminal 30 acquires information on the operation input in the simulated work performed by the trainee 4 using the operation unit 306 on the display screen (step S9). At that time, the execution data totalization processing unit 312 totals the acquired information (operation input information in the simulated work) and stores the totalized result in the execution information recording database 321. The totaling and recording process is continued until it is determined in step S10 that the training is completed.
引き続き、訓練教材実行端末30では、訓練者4による訓練が終了したか否かを判定する処理を行う(ステップS10)。ここで訓練が終了していないと判定された場合(ステップS10でNO)、教材実行処理部311がステップS8およびS9の処理を継続して実行する。
Subsequently, the training material execution terminal 30 performs a process of determining whether or not the training by the trainee 4 is completed (step S10). If it is determined that the training has not ended (NO in step S10), the teaching material execution processing unit 311 continues to execute the processes of steps S8 and S9.
これに対し、訓練者4による訓練が終了したと判定された場合(ステップS10でYES)、訓練教材実行端末30が、訓練者4の当該模擬作業での操作入力の情報と、当該訓練教材作成時のインストラクタ3の模擬作業での操作入力の情報とを比較判定し、訓練者4の習熟度を判定する処理を行う(ステップS11)。
On the other hand, when it is determined that the training by the trainee 4 is finished (YES in step S10), the training material execution terminal 30 causes the trainee 4 to input the operation input information in the simulated work and the training material creation. A process of comparing and judging the information of the operation input in the simulated work of the instructor 3 at that time and judging the skill level of the trainee 4 is performed (step S11).
ステップS11の処理は、例えば、制御部300の上述した管理機能が実行する。この管理機能は、上記S1~S4の実行中に動作取得端末10の作業情報記録データベース121に記憶された当該訓練教材の各作業項目ごとの作業手順、作業対象部位、およびツールの各情報(正解の操作入力情報)と、上記ステップS8、S9で訓練教材実行端末30の実行情報記録データベース321に記憶された当該訓練教材の各作業項目ごとの作業手順、作業対象部位、およびツール404の各情報を操作入力情報とを比較して訓練者4の習熟度を判定する。
The process of step S11 is executed by the above-described management function of the control unit 300, for example. This management function is provided for each work item, work target part, and tool information (correct answer) for each work item of the training material stored in the work information recording database 121 of the motion acquisition terminal 10 during execution of S1 to S4. Operation input information), and the work procedure, work target part, and tool 404 information for each work item of the training material stored in the execution information recording database 321 of the training material execution terminal 30 in steps S8 and S9. Is compared with the operation input information to determine the skill level of the trainee 4.
さらに制御部300(上記管理機能)は、ステップS11で判定された習熟度を訓練者4に対応して、実行情報記録データベース321(図7参照)に記録する処理を実施し(ステップS12)、その後、当該訓練教材提示方法に係る一連の処理を終了する。
Further, the control unit 300 (the above management function) carries out a process of recording the proficiency level determined in step S11 in the execution information recording database 321 (see FIG. 7) corresponding to the trainee 4 (step S12), After that, a series of processes related to the training material presentation method is ended.
次に、訓練教材を用いた訓練教材実行端末30による訓練(図8のステップS8、S9参照)の処理動作について図9~図18を参照して説明する。
Next, the processing operation of the training (see steps S8 and S9 in FIG. 8) by the training material execution terminal 30 using the training material will be described with reference to FIGS. 9 to 18.
訓練教材実行端末30は、訓練者4による操作部306での所定の訓練開始操作を受け付けることにより、対象機器401の保守作業の訓練のための処理動作を開始する。訓練開始操作として、訓練者4は、対象機器401と、訓練メニューモードを指定する必要がある。訓練メニューモードには、演習モードと教育モードとがある。
The training material execution terminal 30 starts a processing operation for training the maintenance work of the target device 401 by receiving a predetermined training start operation on the operation unit 306 by the trainee 4. As a training start operation, the trainee 4 needs to specify the target device 401 and the training menu mode. The training menu mode includes an exercise mode and an education mode.
ここでまず、訓練教材実行端末30における訓練者4による対象機器401の保守作業に関する教育の処理動作について図9~図11を参照して説明する。訓練教材実行端末30は、上記訓練開始操作として、例えば、対象機器401として機器Aが指定され、かつ、訓練メニューモードとして教育モードが指定されると、図9に示す表示画面50Aを表示部305に表示する。その際、教材実行処理部311は、訓練教材生成サーバ20の訓練教材データベース222から指定された機器Aに対応する訓練教材を読み出し、該訓練教材に基づいて表示画面50Aを表示する。表示画面50Aは、インストラクション表示領域501、操作対象画像表示領域502、ガイド表示領域503を有する。
First, the processing operation of the training regarding the maintenance work of the target device 401 by the trainee 4 in the training material execution terminal 30 will be described with reference to FIGS. 9 to 11. When the device A is designated as the target device 401 and the education mode is designated as the training menu mode as the training start operation, the training material execution terminal 30 displays the display screen 50A shown in FIG. 9 on the display unit 305. To display. At that time, the teaching material execution processing section 311 reads out the training teaching material corresponding to the designated device A from the training teaching material database 222 of the training teaching material generation server 20, and displays the display screen 50A based on the training teaching material. The display screen 50A has an instruction display area 501, an operation target image display area 502, and a guide display area 503.
インストラクション表示領域501には、操作入力を要求するメッセージが表示される。操作対象画像表示領域502には、操作対象画像400が表示される。操作対象画像400は、対象機器401(この例では、機器A)の画像とその部品402の画像を含んでいる。ガイド表示領域503には、指定された機器名、訓練メニューモード、訓練対象の作業項目が表示されている。
A message requesting operation input is displayed in the instruction display area 501. The operation target image 400 is displayed in the operation target image display area 502. The operation target image 400 includes an image of the target device 401 (device A in this example) and an image of its component 402. In the guide display area 503, the designated device name, training menu mode, and work items to be trained are displayed.
表示画面50Aは、例えば、対象機器401に対して最初に「バルブ交換」を実施する設定となっている。これにより、インストラクション表示領域501には、「「バルブ交換」を選択してください」というメッセージが表示されている。ガイド表示領域503には、教育の実施が可能な「バルブ交換」、「コンソール交換」、「ボード交換」、「スクリュー交換」の作業項目が表示され、そのうちの最初に実施する「バルブ交換」については、その詳細作業手順「(1)カバーを外す」、「(2)固定具を外す」、「(3)バルブを外す」も併せて表示されている。操作対象画像400としては、対象機器401と、該対象機器401における作業対象の部品402である、例えば、バルブとが表示されている。
The display screen 50A is set, for example, so that the "valve replacement" is first performed on the target device 401. As a result, in the instruction display area 501, a message “Please select“ Valve replacement ”” is displayed. In the guide display area 503, work items such as “valve replacement”, “console replacement”, “board replacement”, and “screw replacement” that can be used for education are displayed. The detailed work procedure "(1) Remove the cover", "(2) Remove the fixture", and "(3) Remove the valve" are also displayed. As the operation target image 400, a target device 401 and a work target component 402 in the target device 401, for example, a valve are displayed.
表示画面50A上で、訓練者4が、インストラクション表示領域501に表示されたメッセージにしたがって、「バルブ交換」を選択すると、図10に示す表示画面50Bへと遷移する。表示画面50Bにおいて、インストラクション表示領域501は、「「(1)カバーを外す」をクリックしてください」というメッセージの表示に変わる。ガイド表示領域503は、「バルブ交換」に下線が付加され、当該「バルブ交換」が選択された表示内容に変わる。操作対象画像400は、対象機器401のカバーを外すため必要なツール404であるねじまわしがバルブ(部品402)に近接された表示内容に変わる。
On the display screen 50A, when the trainee 4 selects "Valve replacement" in accordance with the message displayed in the instruction display area 501, the display screen 50B shown in FIG. 10 is displayed. On the display screen 50B, the instruction display area 501 is changed to display a message "Please click (1) Remove cover". In the guide display area 503, the "bulb replacement" is underlined and the "bulb replacement" is changed to the selected display content. The operation target image 400 changes to a display content in which a screwdriver, which is a tool 404 necessary for removing the cover of the target device 401, is brought close to the valve (part 402).
表示画面50B上で、訓練者4が、インストラクション表示領域501に表示されたメッセージにしたがって、「(1)カバーを外す」をクリックすると、インストラクション表示領域501に「「(2)固定具を外す」をクリックしてください」というメッセージが表示され、ガイド表示領域503では「バルブ交換」および「(1)カバーを外す」に下線が付加され、操作対象画像400として、対象機器401のカバーを取り外すための固定具(部品402)が表示された表示画面(図示せず)へと遷移する。
On the display screen 50B, when the trainee 4 clicks "(1) Remove cover" according to the message displayed in the instruction display area 501, "(2) Remove the fixing tool" is displayed in the instruction display area 501. Please click. ”Is displayed, and in the guide display area 503,“ valve replacement ”and“ (1) remove cover ”are underlined to remove the cover of the target device 401 as the operation target image 400. The display screen (not shown) in which the fixture (part 402) is displayed is displayed.
そして、この表示画面上で、「(2)固定具を外す」を選択すると、図11に示す表示画面50Cへと遷移する。表示画面50Cにおいて、インストラクション表示領域501は、「「(3)バルブを外す」をクリックしてください」というメッセージの表示に変わる。ガイド表示領域503は、「バルブ交換」、「(1)カバーを外す」および「(2)固定具を外す」に下線が付加され表示内容に変わる。操作対象画像400は、対象機器401のバルブを外すためのねじまわしがバルブ(部品402)に近接するとともに、それらの画像の上に重なるようにして注意喚起表示領域504が表示された表示内容に変わる。注意喚起表示領域504には、「取り外す前の回転方向に注意」というメッセージが表示される。
Then, when "(2) Remove the fixing tool" is selected on this display screen, the screen transitions to the display screen 50C shown in FIG. In the display screen 50C, the instruction display area 501 changes to display a message "Click" (3) Remove valve "." In the guide display area 503, underline is added to “valve replacement”, “(1) remove cover” and “(2) remove fixture”, and the display content is changed. The operation target image 400 has a display content in which the caution display area 504 is displayed such that the screwdriver for removing the valve of the target device 401 is close to the valve (part 402) and overlaps the images. change. In the alert display area 504, a message “Be careful about the rotation direction before removal” is displayed.
このように、訓練者4は、表示画面50A~50Cという訓練教材を用いて対象機器401の「バルブ交換」に係る作業手順を学ぶことができる。ここで、表示画面50A~50Cは、インストラクション表示領域501に表示されたメッセージにしたがって入力を操作を行うような構成であり、当該分野の知識に乏しい訓練者4であっても、対象機器401の保守作業を容易に学ぶことができる。しかも、表示画面50Cには、バルブ交換時の注意点が明示されるため、危険を回避可能な質の高い訓練を受けることができる。この他、訓練者4は、「コンソール交換」、「ボード交換」、「スクリュー交換」の作業についても、「バルブ交換」と同様にして訓練を受けることができる。
In this way, the trainee 4 can learn the work procedure related to “valve replacement” of the target device 401 by using the training materials of the display screens 50A to 50C. Here, the display screens 50A to 50C are configured such that the input operation is performed in accordance with the message displayed in the instruction display area 501, and even the trainee 4 who has little knowledge in the field can display the target device 401. You can easily learn maintenance work. In addition, since cautions at the time of valve replacement are clearly displayed on the display screen 50C, it is possible to receive high-quality training capable of avoiding danger. In addition to this, the trainee 4 can receive training in the operations of "console replacement", "board replacement", and "screw replacement" in the same manner as "valve replacement".
次に、訓練教材実行端末30における訓練者4による対象機器401の保守作業に関する演習の処理動作について図12~図14を参照して説明する。訓練教材実行端末30は、上記訓練開始操作として、例えば、対象機器401として機器Aが指定され、かつ、訓練メニューモードとして演習モードが指定されると、訓練教材生成サーバ20から該指定された訓練教材を取得して、図12に示す表示画面60Aを表示部305に表示する。
Next, the processing operation of the exercise regarding the maintenance work of the target device 401 by the trainee 4 in the training material execution terminal 30 will be described with reference to FIGS. 12 to 14. When the device A is designated as the target device 401 and the practice mode is designated as the training menu mode as the training start operation, the training material execution terminal 30 receives the designated training from the training material generation server 20. The teaching material is acquired and the display screen 60A shown in FIG. 12 is displayed on the display unit 305.
表示画面60Aは、インストラクション表示領域601、操作対象画像表示領域602、ガイド表示領域603を有する。インストラクション表示領域601、操作対象画像表示領域602、ガイド表示領域603の機能は、それぞれ、表示画面50Aにおけるインストラクション表示領域501、操作対象画像表示領域502、には、ガイド表示領域503と同等の機能を有する。
The display screen 60A has an instruction display area 601, an operation target image display area 602, and a guide display area 603. Functions of the instruction display area 601, the operation target image display area 602, and the guide display area 603 are the same as those of the guide display area 503 in the instruction display area 501 and the operation target image display area 502 in the display screen 50A, respectively. Have.
訓練教材実行端末30は、表示画面60Aの表示中に、訓練者4による操作部306での操作入力が所定の出力条件を満たす場合に、表示画面60Aに変えて、例えば、図13に示す表示画面60Bの表示へと遷移させることが可能となっている。同じく、表示画面60Bの表示中に、訓練者4による操作入力が所定の出力条件を満たす場合に、表示画面60Bに変えて、例えば、図14に示す表示画面60Cの表示へと遷移させることが可能となっている。ここで、所定の出力条件は、動作取得端末10でインストラクタ3の模擬作業に応じて取得される複数の操作対象画像400の選択操作の順序および選択内容に応じて設定されるものである。
The training material execution terminal 30 changes to the display screen 60A when the operation input on the operation unit 306 by the trainee 4 satisfies a predetermined output condition during the display of the display screen 60A, for example, the display shown in FIG. It is possible to make a transition to the display of the screen 60B. Similarly, when the operation input by the trainee 4 satisfies a predetermined output condition while the display screen 60B is being displayed, the display screen 60B may be changed to, for example, the display screen 60C shown in FIG. It is possible. Here, the predetermined output condition is set according to the order and selection contents of the selection operation of the plurality of operation target images 400 acquired by the motion acquisition terminal 10 according to the simulated work of the instructor 3.
表示画面60A、60B、60Cのいずれも、インストラクション表示領域601に表示される設問形式のメッセージ(演習問題)にしたがって、操作対象画像表示領域602に表示される対象機器401に対してその設問の答えとなる模擬操作を実行する(演習問題を解く)形式の構成である。上述した出力条件を満たす場合とは、例えば、後述するように、表示画面60A、60Bのインストラクション表示領域601に表示される設問に対し、訓練者4が入力した情報が正解である場合とすることができる。
In each of the display screens 60A, 60B, and 60C, in response to a question-type message (exercise question) displayed in the instruction display area 601, the question is answered to the target device 401 displayed in the operation target image display area 602. It is a configuration of the form to execute the simulated operation (solve the exercise problem). The case where the above output condition is satisfied is, for example, a case where the information input by the trainee 4 is correct for the question displayed in the instruction display area 601 of the display screens 60A and 60B as described later. You can
例えば、図12に示す表示画面60Aにおいて、ガイド表示領域603には、上述した「教育」に用いる表示画面50A、50B、50Cと同様の項目が表示されているところ、インストラクション表示領域601には、「カバーの取り外しに必要な工具を選択してください」というメッセージが表示されている。操作対象画像400としては、対象機器401が表示されるとともに、その上に重なるようにツール表示領域604が確保されている。ツール表示領域604には、複数のツール(工具)画像403a、403b、403c、403dが選択可能に表示されている。
For example, in the display screen 60A shown in FIG. 12, in the guide display area 603, the same items as the display screens 50A, 50B, and 50C used for the above-mentioned “education” are displayed, but in the instruction display area 601, The message "Please select the tool required to remove the cover" is displayed. As the operation target image 400, the target device 401 is displayed, and the tool display area 604 is secured so as to overlap the target device 401. In the tool display area 604, a plurality of tool (tool) images 403a, 403b, 403c, 403d are displayed in a selectable manner.
訓練者4は、操作部306を操作することにより、表示画面60Aにおいて、ツール画像403a、403b、403c、403dとしてそれぞれ表示される各ツール404の中からいずれか1つを選択することができる。表示画面60Aにおいて、訓練者4が選択したツール404が、インストラクション表示領域601に表示される設問における「カバーの取り外しに必要な工具」である場合には、例えば、図13に示す表示画面60Bへと遷移する。
The trainee 4 can select one of the tools 404 displayed as the tool images 403a, 403b, 403c, and 403d on the display screen 60A by operating the operation unit 306. In the case where the tool 404 selected by the trainee 4 on the display screen 60A is the “tool required to remove the cover” in the question displayed in the instruction display area 601, for example, to the display screen 60B shown in FIG. And transition.
表示画面60Bにおいて、インストラクション表示領域601には、「カバー取り外しに必要なネジの位置を本数分クリックしてください」というメッセージが表示されている。操作対象画像400としては、対象機器401と、部品402たる複数のネジが表示されている。
On the display screen 60B, the instruction display area 601 displays a message "Please click the positions of screws required to remove the cover for the number of screws". As the operation target image 400, a target device 401 and a plurality of screws that are parts 402 are displayed.
訓練者4は、操作部306を操作することにより、表示画面60Bにおいて、操作対象画像400における複数のネジの中から所要数のネジを選択することができる。表示画面60Bにおいて、訓練者4が選択したネジの数が、インストラクション表示領域601に表示される設問における「カバー取り外しに必要なネジの位置を本数分」と一致した場合には、例えば、図14に示す表示画面60Cへと遷移する。
The trainee 4 can select a required number of screws from the plurality of screws in the operation target image 400 on the display screen 60B by operating the operation unit 306. In the display screen 60B, when the number of screws selected by the trainee 4 matches “the number of screws required to remove the cover for the number of screws” in the question displayed in the instruction display area 601, for example, FIG. The display screen 60C shown in FIG.
表示画面60Cにおいて、インストラクション表示領域601には、「カバーを取り外す目的を選択してください」というメッセージが表示されている。操作対象画像400としては、対象機器401が表示されるとともに、その上に重なるように回答表示領域605が確保されている。回答表示領域605には、複数の回答文書606a、606b、606c、606dが選択可能に表示されている。
On the display screen 60C, a message "Please select the purpose for removing the cover" is displayed in the instruction display area 601. As the operation target image 400, the target device 401 is displayed, and the answer display area 605 is secured so as to overlap the target device 401. In the answer display area 605, a plurality of answer documents 606a, 606b, 606c, 606d are displayed in a selectable manner.
訓練者4は、操作部306を操作することにより、表示画面60Cにおいて、回答文書606a、606b、606c、606dの中からいずれか1つを選択することができる。表示画面60Cにおいて、訓練者4が選択した回答文書、例えば606aが、インストラクション表示領域601に表示される設問における「カバーを取り外す目的」に一致する場合には、例えば、次の表示画面(図示せず)へと遷移する。
The trainee 4 can select any one of the reply documents 606a, 606b, 606c, and 606d on the display screen 60C by operating the operation unit 306. In the display screen 60C, when the answer document selected by the trainee 4, for example, 606a matches the “purpose of removing the cover” in the question displayed in the instruction display area 601, for example, the following display screen (not shown) is displayed. No)).
上述した表示画面60A、60B、60Cによる演習において、訓練者4が入力(選択、あるいはクリック)したツール404、ネジの本数、目的が、インストラクション表示領域601に表示される設問に対して正解か否かについては、当該訓練教材の生成時におけるインストラクタ3の模擬操作の操作入力を正解とし、これを当該入力とを比較して決定される。この比較の結果、正解であれば、実行情報記録データベース321(図7参照)の当該訓練教材に対応する正誤の欄に丸印が記録され、不正解であればバツ印が記録される。したがって、訓練教材実行端末30では、実行情報記録データベース321に記録された正誤欄の情報に基づいて訓練者の訓練に関する習熟度を判定することが可能となる。この習熟度の判定処理は、1回の訓練ごと、複数回の訓練ごと、訓練の各項目ごと等、様々なタイミングで実施することができる。判定された習熟度は、実行情報記録データベース321の習熟度の欄に記憶される。
In the exercise using the display screens 60A, 60B, and 60C described above, whether the tool 404 input (selected or clicked) by the trainee 4, the number of screws, and the purpose are correct answers to the questions displayed in the instruction display area 601. Whether or not is determined by comparing the operation input of the simulated operation of the instructor 3 at the time of generating the training teaching material with the correct answer and the input. As a result of this comparison, if the answer is correct, a circle is recorded in the correct / incorrect column corresponding to the training material in the execution information recording database 321 (see FIG. 7), and if the answer is incorrect, a cross is recorded. Therefore, in the training material execution terminal 30, it is possible to determine the proficiency level related to the training of the trainee based on the information in the correctness column recorded in the execution information recording database 321. This proficiency level determination process can be performed at various timings, such as once for each training, for each multiple training, and for each training item. The determined skill level is stored in the skill level column of the execution information recording database 321.
このように、訓練教材提示システム1では、例えば、訓練教材実行端末30において、訓練教材に基づく表示画面60A、60B、60Cを用いた演習によって、訓練者4に対する演習と、その演習における訓練者4のスキル管理を実現することができる。
As described above, in the training material presentation system 1, for example, in the training material execution terminal 30, by the exercise using the display screens 60A, 60B, and 60C based on the training material, the exercise for the trainee 4 and the trainee 4 in the exercise are performed. Skill management can be realized.
次に、より具体的な機器を対象機器401とする訓練教材に基づく訓練の処理動作について図15~図18を参照して説明する。図15~図18は、訓練教材実行端末30が訓練教材に基づいて実行する健康器具を対象とする訓練における各段階に対応する表示画面の例を示している。
Next, the processing operation of the training based on the training material in which the more specific device is the target device 401 will be described with reference to FIGS. 15 to 18. 15 to 18 show examples of display screens corresponding to the respective stages in the training for the health appliance executed by the training material executing terminal 30 based on the training material.
図15は、訓練教材実行端末30での訓健康器具を対象とする教育モードでの練習における画面の表示例を示す図である。図15に示す表示画面80は、対象機器401である健康器具のドライブベルトの交換に係る模擬作業のある段階に対応するものであり、インストラクション表示領域801、操作対象画像表示領域802、ガイド表示領域803の他、手順表示領域805を有している。
FIG. 15 is a diagram showing a display example of a screen in the practice in the education mode targeting the health appliance on the training material execution terminal 30. The display screen 80 shown in FIG. 15 corresponds to a certain stage of the simulation work related to the replacement of the drive belt of the health appliance which is the target device 401, and includes an instruction display area 801, an operation target image display area 802, and a guide display area. In addition to 803, it has a procedure display area 805.
表示画面80において、ガイド表示領域603には、「ドライブベルトの交換」を含む複数の作業項目が表示されている。この例では、特に、訓練者4によって「ドライブベルトの交換」が選択され、ガイド表示領域603には、「ドライブベルトの交換」に対応してその詳細な作業手順「(1)固定ネジを緩める」、「(2)ベルトテンションプーリを緩める」、「(3)ベルトを取り外す」が併せて表示されている。
On the display screen 80, the guide display area 603 displays a plurality of work items including “replacement of drive belt”. In this example, in particular, the trainee 4 selects “replacement of drive belt” and the guide display area 603 corresponds to “replacement of drive belt” and the detailed work procedure “(1) Loosen the fixing screw”. "," (2) Loosen the belt tension pulley "and" (3) Remove the belt "are also displayed.
また、表示画面80において、手順表示領域805には、「手順:ドライブベルトの交換」が表示され、インストラクション表示領域801には、「ユーザ操作:確認したらクリックしてください」が表示されている。操作対象画像表示領域802、対象機器401を含む操作対象画像400が表示されている。また、操作対象画像表示領域802には、対象機器401の上に重なるように注意喚起表示領域604が確保されている。注意喚起表示領域604は、その領域全体が他の領域とは異なる特定の色、例えば黄色で表示されている。この注意喚起表示領域604には、ネジは少し緩めるだけ、外さないこと。」という情報(テキスト文字)が表示されている。
Further, on the display screen 80, “Procedure: Replace drive belt” is displayed in the procedure display area 805, and “User operation: Click after confirming” is displayed in the instruction display area 801. The operation target image display area 802 and the operation target image 400 including the target device 401 are displayed. In the operation target image display area 802, a caution display area 604 is secured so as to overlap the target device 401. The attention display area 604 is displayed in a specific color different from the other areas, for example, yellow. In the warning display area 604, only loosen the screws but do not remove them. Information (text characters) is displayed.
このように、教育モードで用いる表示画面80では、他の領域とは異なる特定の色の注意喚起表示領域604を有する構成である。表示画面80における注意喚起表示領域604は、動作取得端末10におけるインストラクタ3による模擬作業時(ステップS1参照)、該インストラクタ3の指定に基づいて訓練教材生成サーバ20の教材生成処理部212により生成されたものである。すなわち、動作取得端末10は、訓練者4に分かるように対象機器401の対象部位を明示する(例えば、黄色で表示する)ための指示情報を指定する機能を有している。教育モードで用いる画面(表示画面80)が、上述した注意喚起表示領域604を有することで、訓練者4は、教育モードでの練習を繰り返すうちに、当該保守作業中に注意すべき箇所あるいは作業手順を確実に把握することが可能となる。
As described above, the display screen 80 used in the education mode is configured to have the alert display area 604 of a specific color different from other areas. The attention display area 604 on the display screen 80 is generated by the teaching material generation processing unit 212 of the training teaching material generation server 20 based on the designation of the instructor 3 during the simulation work by the instructor 3 in the motion acquisition terminal 10 (see step S1). It is a thing. That is, the motion acquisition terminal 10 has a function of designating instruction information for clearly indicating (for example, displaying in yellow) the target part of the target device 401 so that the trainee 4 can understand. Since the screen (display screen 80) used in the education mode has the above-mentioned caution display area 604, the trainee 4 will be required to be careful during the maintenance work while performing the training in the education mode. It is possible to grasp the procedure without fail.
図16、図17、図18は、それぞれ、訓練教材実行端末30での訓健康器具を対象とする演習モードでの画面の表示例を示す図である。訓練教材実行端末30は、上述した訓練開始操作として、例えば、対象機器401として機器A(健康器具)が指定され、かつ、訓練メニューモードとして演習モードが指定されると、訓練教材生成サーバ20から該指定された訓練教材を取得して、図16に示す第1表示画面70Aを表示部305に表示する。第1表示画面70Aは、インストラクション表示領域701、操作対象画像表示領域702、ガイド表示領域703を有する。
FIG. 16, FIG. 17, and FIG. 18 are diagrams each showing a display example of a screen in the exercise mode for the health training device on the training material execution terminal 30. When the device A (health equipment) is specified as the target device 401 and the exercise mode is specified as the training menu mode, the training material execution terminal 30 causes the training material generation server 20 to execute the above-described training start operation. The designated training material is acquired and the first display screen 70A shown in FIG. 16 is displayed on the display unit 305. The first display screen 70A has an instruction display area 701, an operation target image display area 702, and a guide display area 703.
訓練教材実行端末30は、第1表示画面70Aの表示中に、訓練者4による操作入力が所定の出力条件を満たす場合に、第1表示画面70Aに変えて、例えば、図17に示す第2表示画面70Bの表示へと遷移させることが可能となっている。同じく、第2表示画面70Bの表示中に、訓練者4による操作入力が所定の出力条件を満たす場合に、第2表示画面70Bに変えて、例えば、図18に示す第3表示画面70Cの表示へと遷移させることが可能となっている。出力条件を満たす場合とは、例えば、第1表示画面70A、第2表示画面70Bのインストラクション表示領域701に表示される設問に対し、訓練者4が入力した情報が正解である場合とすることができる。
The training material execution terminal 30 changes to the first display screen 70A when the operation input by the trainee 4 satisfies a predetermined output condition while the first display screen 70A is being displayed, and for example, the second display shown in FIG. It is possible to make a transition to the display of the display screen 70B. Similarly, when the operation input by the trainee 4 satisfies a predetermined output condition during the display of the second display screen 70B, the second display screen 70B is replaced with, for example, the display of the third display screen 70C shown in FIG. It is possible to transition to. The case where the output condition is satisfied may be, for example, the case where the information input by the trainee 4 is correct for the question displayed in the instruction display area 701 of the first display screen 70A and the second display screen 70B. it can.
例えば、図16に示す第1表示画面70Aにおいて、インストラクション表示領域701には、「ユーザ操作:コンソール取り外し時の工具を選択してください。」というメッセージ(テキスト文字)が表示されている。操作対象画像400としては、健康器具である対象機器401が表示されるとともに、該対象機器401に隣接してツール表示領域704が確保されている。ツール表示領域704には、それぞれ、ツール404a、404b、404c、404dに対応する複数のツール画像403a、403b、403c、403dが選択可能に表示されている。
For example, in the first display screen 70A shown in FIG. 16, the instruction display area 701 displays a message (text character) "User operation: Please select a tool when removing the console." As the operation target image 400, a target device 401 which is a health appliance is displayed, and a tool display area 704 is secured adjacent to the target device 401. In the tool display area 704, a plurality of tool images 403a, 403b, 403c, 403d corresponding to the tools 404a, 404b, 404c, 404d are displayed in a selectable manner.
訓練者4は、操作部306を操作することにより、第1表示画面70Aにおいて、ツール表示領域704内のツール404a、404b、404c、404dの中からいずれか1つを選択することができる。第1表示画面70Aにおいて、訓練者4が選択したツール404が、インストラクション表示領域601に表示される設問における「コンソール取り外し時の工具」である場合には、例えば、図17に示す第2表示画面70Bへと遷移する。
The trainee 4 can select any one of the tools 404a, 404b, 404c, and 404d in the tool display area 704 on the first display screen 70A by operating the operation unit 306. When the tool 404 selected by the trainee 4 on the first display screen 70A is the “tool at the time of removing the console” in the question displayed in the instruction display area 601, for example, the second display screen shown in FIG. Transition to 70B.
第2表示画面70Bにおいて、インストラクション表示領域701には、「ユーザ操作:コンソールを外すための六角ボルトの位置を本数分クリックしてください。」というメッセージが表示されている。操作対象画像700としては、対象機器401と、作業対象部位405である複数のネジが表示されている。
On the second display screen 70B, in the instruction display area 701, a message "User operation: Click the positions of the hexagon bolts for removing the console for the number of the bolts." Is displayed. As the operation target image 700, the target device 401 and a plurality of screws that are the work target parts 405 are displayed.
訓練者4は、操作部306を操作することにより、第2表示画面70Bにおいて、操作対象画像400における作業対象部位405の中から所要数のネジを選択することができる。第2表示画面70Bにおいて、訓練者4が選択したネジの数が、インストラクション表示領域701に表示される設問における「コンソールを外すための六角ボルトの位置を本数分」中の「本数分」と一致した場合には、例えば、図18に示す第3表示画面70Cへと遷移する。
The trainee 4 can select a required number of screws from the work target portion 405 in the operation target image 400 on the second display screen 70B by operating the operation unit 306. On the second display screen 70B, the number of screws selected by the trainee 4 matches the "number of screws" in the "position of hexagon bolts for removing the console" in the question displayed in the instruction display area 701. When it does, it changes to the 3rd display screen 70C shown in FIG. 18, for example.
第3表示画面70Cにおいて、インストラクション表示領域701には、「ユーザ操作:コンソールをポストから外すとき、最初にコンソールを移動する方向を選択してください。」というメッセージが表示されている。操作対象画像400としては、対象機器401が表示されるとともに、コンソールの複数の移動方向405a、405b、405cが矢印によってかつ選択可能に表示されている。
On the third display screen 70C, a message "User operation: When removing the console from the post, first select the direction in which to move the console." Is displayed in the instruction display area 701. As the operation target image 400, the target device 401 is displayed, and a plurality of moving directions 405a, 405b, 405c of the console are displayed by arrows and selectably.
訓練者4は、操作部306を操作することにより、第3表示画面70Cにおいて、例えば、上記矢印をクリックすることでそれに対応するいずれかの移動方向405a、405b、405cを選択することができる。第3表示画面70Cにおいて、訓練者4が選択したコンソールの移動方向が、インストラクション表示領域701に表示される設問における「~コンソールを移動する方向」に一致する場合には、例えば、次の表示画面(図示せず)へと遷移するか、当該訓練(演習)が終了する。
The trainee 4 can select any one of the moving directions 405a, 405b, 405c corresponding to it by clicking the above-mentioned arrow on the third display screen 70C by operating the operation unit 306. In the third display screen 70C, when the moving direction of the console selected by the trainee 4 matches the “direction of moving the console” in the question displayed in the instruction display area 701, for example, the following display screen (Not shown) or the training (exercise) ends.
図12ないし図14に基づく説明でも述べたように、第1表示画面70A、第2表示画面70B、第3表示画面70C(図16~図18参照)による演習においても、訓練者4が入力(選択、あるいはクリック)したツール404、ネジの本数、移動する方向が、インストラクション表示領域701に表示される設問に対して正解であれば、実行情報記録データベース321(図7参照)の当該訓練教材に対応する正誤の欄に丸印が記録され、不正解であればバツ印が記録される。これにより、訓練教材実行端末30では、実行情報記録データベース321に記録された正誤欄の情報に基づいて訓練者の訓練に関する習熟度を判定することが可能となる。よって、訓練教材提示システム1では、訓練教材実行端末30での訓練教材に基づく第1表示表示画面70A、第2表示画面70B、第3表示画面70Cを用いた演習によって、訓練者4に対する演習と、その演習における訓練者4のスキル管理を行うことができる。
As described in the description based on FIGS. 12 to 14, the trainee 4 also inputs (in the exercise by the first display screen 70A, the second display screen 70B, and the third display screen 70C (see FIGS. 16 to 18). If the selected (or clicked) tool 404, the number of screws, and the moving direction are correct for the question displayed in the instruction display area 701, the training material in the execution information recording database 321 (see FIG. 7) is used. A circle is recorded in the corresponding correctness column, and a cross is recorded if the answer is incorrect. As a result, the training material execution terminal 30 can determine the proficiency level related to the training of the trainee based on the information in the correct / wrong column recorded in the execution information recording database 321. Therefore, in the training material presentation system 1, an exercise for the trainee 4 is performed by an exercise using the first display screen 70A, the second display screen 70B, and the third display screen 70C based on the training material in the training material execution terminal 30. , The skill management of the trainee 4 in the exercise can be performed.
以上説明したように、本実施形態に係る訓練教材提示システム1は、対象機器401の保守作業に関連する3DCG画像を含む訓練教材を、作業空間表示と共に訓練者4に提示するとともに、保守作業の各段階に対応する模擬作業の操作入力に応じて提示内容を変化させるものである。
As described above, the training material presentation system 1 according to the present embodiment presents the training material including the 3DCG image related to the maintenance work of the target device 401 to the trainee 4 together with the work space display, and performs the maintenance work. The presentation content is changed according to the operation input of the simulated work corresponding to each stage.
この訓練教材提示システム1は、模擬作業の操作入力の情報を取得する動作取得端末10と、保守作業の作業対象部位405と保守作業に使用するツール404とを表示可能かつ選択操作可能な複数の操作対象画像400として記憶するとともに、動作取得端末10で取得される操作入力の情報を記憶するストレージ220と、ストレージ220の記憶情報に基づき、複数の操作対象画像400のうち保守作業のいずれかの工程に必要な特定のツール404を表示する第1表示画面70A、複数の操作対象画像400のうち特定工程の作業対象部位405を表示する第2表示画面70B、および、特定工程の作業対象部位405を該作業対象部位405に対する模擬作業の操作入力を実行可能に表示する第3表示画面70Cを、それぞれ表示出力可能な情報として生成する訓練教材生成サーバ20と、表示部305上に、第1表示画面70A、第2表示画面70Bおよび第3表示画面70Cの各画面を所定の出力条件に従って表示する訓練教材実行端末30と、を備え、所定の出力条件が、動作取得端末10で取得される複数の操作対象画像400の選択操作の順序および選択内容に応じて設定されるようになっている。
The training material presentation system 1 includes a plurality of operation acquisition terminals 10 for acquiring information on operation input of simulated work, a plurality of operation target parts 405 for maintenance work, and a tool 404 used for maintenance work, which are selectable. The storage 220 that stores the operation input image 400 and stores the information of the operation input acquired by the operation acquisition terminal 10, and one of the plurality of operation target images 400 for maintenance work based on the storage information of the storage 220. A first display screen 70A displaying a specific tool 404 necessary for a process, a second display screen 70B displaying a work target site 405 of a specific process among a plurality of operation target images 400, and a work target site 405 of a specific process. On the display unit 305 and the training material generation server 20 that generates the third display screen 70C that displays the operation input of the simulated work for the work target portion 405 as executable information. A training teaching material execution terminal 30 that displays each of the screen 70A, the second display screen 70B, and the third display screen 70C according to a predetermined output condition, and the predetermined output condition is acquired by the motion acquisition terminal 10. The operation target image 400 is set according to the order of selection operation and the selection content.
この構成により、本実施形態に係る訓練教材提示システム1は、第1ないし第3表示画面70A、70B、70Cの各画面が、ツール404や作業対象部位405の選択操作または選択済み作業対象部位405への操作入力を要求するインストラクション表示と、その表示内容に対応する特定の操作対象画像400の選択操作または模擬作業操作入力を実行可能な操作対象画像表示領域とを含んでいるので、各画面に対するユーザの操作入力に応じて画面表示内容が順次変更されていき、作業手順を実機無しで容易・的確に把握可能なシステムとなる。
With this configuration, in the training material presentation system 1 according to the present embodiment, each screen of the first to third display screens 70A, 70B, and 70C has a selection operation of the tool 404 or the work target site 405 or a selected work target site 405. Since it includes an instruction display requesting an operation input to the screen and an operation target image display area capable of executing a selection operation of a specific operation target image 400 corresponding to the display content or a simulated work operation input, The screen display contents are sequentially changed according to the user's operation input, and the system becomes a system in which the work procedure can be grasped easily and accurately without an actual machine.
また、本実施形態に係る訓練教材提示システム1は、第1表示画面70A、第2表示画面70Bおよび第3表示画面70Cの各画面が、選択操作または操作入力を要求するインストラクション表示領域701と、複数の操作対象画像400のうちインストラクション表示領域701の表示内容に対応する特定の操作対象画像400と、インストラクタ3または訓練者4による各表示画面での選択操作または模擬作業の操作入力の内容を表示する操作画像表示領域702とを、含んでいる。
In the training material presentation system 1 according to the present embodiment, each of the first display screen 70A, the second display screen 70B, and the third display screen 70C has an instruction display area 701 for requesting a selection operation or an operation input, The specific operation target image 400 corresponding to the display content of the instruction display area 701 among the plurality of operation target images 400 and the content of the selection operation or the operation input of the simulated work on each display screen by the instructor 3 or the trainee 4 are displayed. An operation image display area 702 to be operated.
この構成により、本実施形態に係る訓練教材提示システム1は、インストラクタ3の模範操作入力を基に、所要の保守作業手順に則した訓練教材や演習教材を容易・迅速に生成可能となる。
With this configuration, the training material presentation system 1 according to the present embodiment can easily and quickly generate the training material and the exercise material according to the required maintenance work procedure based on the model operation input of the instructor 3.
また、本実施形態に係る訓練教材提示システム1において、動作取得端末10は、3次元画像を含む操作対象画像400を表示する表示部105と、インストラクタ3の模擬作業によって、操作対象画像400に対する保守作業の基準となる作業と、操作対象画像400における作業対象部位405、ツール404、およびツール404の動きと、ツール404の動きに応じた対象部位の動きと、を指定する機能を有する操作部106と、を有し、訓練教材生成サーバ20は、上記指定された基準となる作業に、作業対象部位405、ツール404、ツール404の動き、および対象部位の動きが反映された作業手順を有する訓練教材を生成する教材生成処理部212を有する。
Further, in the training teaching material presentation system 1 according to the present embodiment, the motion acquisition terminal 10 maintains the operation target image 400 by the display unit 105 that displays the operation target image 400 including the three-dimensional image and the instructor 3 for the simulation work. An operation unit 106 having a function of designating a work as a work reference, a work target part 405, a tool 404, a movement of the tool 404 in the operation target image 400, and a motion of the target part according to the movement of the tool 404. And the training material generation server 20 has a training including a work procedure in which the work to be the work target portion 405, the tool 404, the movement of the tool 404, and the movement of the target portion are reflected in the work as the designated reference. It has a teaching material generation processing unit 212 for generating a teaching material.
この構成により、本実施形態に係る訓練教材提示システム1は、インストラクタ3の模擬作業により、その模擬作業での操作入力の情報に基づいて、対象機器401の3次元画像を含む訓練教材を容易・迅速に生成することができる。
With this configuration, the training material presentation system 1 according to the present embodiment facilitates the training material including the three-dimensional image of the target device 401 by the simulated work of the instructor 3 based on the information of the operation input in the simulated work. Can be generated quickly.
また、本実施形態に係る訓練教材提示システム1において、訓練教材実行端末30は、第1ないし第3表示画面70A、70B、70Cの各画面を表示して行う訓練のモードとして、教育モードまたは演習モードを選択するモード選択機能を有する操作部306を有し、動作取得端末10は、記訓練の実施中に訓練者4を誘導するための指示情報を入力する指示情報入力機能、教育モードでの訓練時に訓練者4に対して明示する部位を指定する明示部位指定機能、および演習モードでの訓練時に基準となる作業で指定した部位が選択された場合にのみ次の作業段階に進むように指定する作業段階指定機能とを備えた操作部106をさらに有する構成である。
Further, in the training material presentation system 1 according to the present embodiment, the training material execution terminal 30 displays the first to third display screens 70A, 70B, and 70C as the training mode to be performed, and the training mode or the exercise. Having the operation unit 306 having a mode selection function for selecting a mode, the motion acquisition terminal 10 has an instruction information input function for inputting instruction information for guiding the trainee 4 during the execution of the training, and an instruction mode in the education mode. Explicit part designation function to specify the part to be clearly shown to the trainee 4 at the time of training, and to specify to proceed to the next work stage only when the part specified in the reference work at the time of training in the exercise mode is selected This is a configuration further including an operation unit 106 having a work stage designating function.
この構成により、本実施形態に係る訓練教材提示システム1は、訓練教材実行端末30で第1ないし第3表示画面70A、70B、70Cの各画面を表示して行う訓練に際し、教育モードでは保守作業の知識がない訓練者4でも簡単に訓練を受けることができ、かつ、演習モードでは訓練者4が正しい模擬作業を行うことで次の段階に進むことができる各モードに最適な教育教材を生成することができる。
With this configuration, the training teaching material presentation system 1 according to the present embodiment performs the maintenance work in the education mode during the training performed by displaying each screen of the first to third display screens 70A, 70B, and 70C on the training teaching material execution terminal 30. Trainers 4 who do not have knowledge of can easily receive the training, and in the exercise mode, the trainers 4 can perform the correct simulated work to advance to the next stage. can do.
また、本実施形態に係る訓練教材提示システム1は、インストラクタ3の模擬作業により保守作業の各作業項目ごとに指定された作業手順、作業対象部位405、およびツール404の各情報を、正解の操作入力の情報として管理する第1の管理機能としての作業情報記録データベース121と、訓練者4の模擬作業により保守作業の各作業項目ごとに指定された作業手順、作業対象部位405、およびツール404の各情報を、演習モードの操作入力の情報として管理する第2の管理機能である実行情報記録データベース321と、正解の操作入力の情報と、演習モードの操作入力の情報との比較結果に応じて訓練者4の習熟度を判定する判定機能を有する制御部300と、訓練者4に対応付けて、演習モードでの訓練における上記比較結果を、訓練教材単位に記録する記録機能、および作業項目ごとの上記比較結果を、訓練教材単位に集計する集計機能とを有する実行データ集計処理部312とを有し、制御部300は、上記比較結果を表示部305に表示させる表示制御機能を有する構成である。
Further, the training material presentation system 1 according to the present embodiment uses the correct operation of the work procedure specified for each work item of the maintenance work by the simulated work of the instructor 3, the work target part 405, and each information of the tool 404. A work information recording database 121 as a first management function that manages as input information, a work procedure specified for each work item of maintenance work by a simulated work of the trainee 4, a work target portion 405, and a tool 404. Depending on the result of comparison between the execution information recording database 321 which is the second management function of managing each information as the operation input information of the exercise mode, the information of the correct operation input, and the information of the operation input of the exercise mode. A control unit 300 having a determination function for determining the proficiency level of the trainee 4, and a recording function for associating with the trainee 4 and recording the above comparison result in the training in the exercise mode in units of training materials, and for each work item. And the execution data tabulation processing unit 312 having a tabulation function for tabulating the above comparison results in units of training teaching materials, and the control unit 300 has a display control function for displaying the above comparison results on the display unit 305. is there.
この構成により、本実施形態に係る訓練教材提示システム1は、例えば、訓練教材実行端末30において、訓練教材に基づく第1ないし第3の表示画面70A、70B、70Cを用いた演習に合わせて、その演習における訓練者4のスキル管理を実現することができる。
With this configuration, the training material presentation system 1 according to the present embodiment, for example, in the training material execution terminal 30, according to the exercise using the first to third display screens 70A, 70B, 70C based on the training material, The skill management of the trainee 4 in the exercise can be realized.
また、本実施形態に係る訓練教材提示方法は、模擬作業の操作入力の情報を取得する動作取得ステップS1と、保守作業の作業対象部位405と保守作業に使用するツール404a、404b、404c、404d(以下、ツール404)とを表示可能かつ選択操作可能な複数の操作対象画像400として記憶する記憶ステップS2、動作取得端末10で取得される操作入力の情報を記憶するストレージ220と、ストレージ220の記憶情報に基づき、複数の操作対象画像400のうち保守作業のいずれかの工程に必要な特定のツール404を表示する第1表示画面70A、複数の操作対象画像400のうち特定工程の作業対象部位405を表示する第2表示画面70B、および、特定工程の作業対象部位405を該作業対象部位405に対する模擬作業の操作入力を実行可能に表示する第3表示画面70Cを、それぞれ表示出力可能な情報として生成する訓練教材生成ステップS4と、表示部305上に、第1表示画面70A、第2表示画面70Bおよび第3表示画面70Cの各画面を所定の出力条件に従って表示する訓練教材実行ステップS8と、を含む、所定の出力条件が、動作取得端末10で取得される複数の操作対象画像400の選択操作の順序および選択内容に応じて設定されるようになっている。
Further, the training material presentation method according to the present embodiment includes an operation acquisition step S1 for acquiring information on operation input of simulated work, a work target part 405 for maintenance work, and tools 404a, 404b, 404c, 404d used for maintenance work. (Hereinafter, tool 404) is stored as a plurality of operation target images 400 that can be displayed and selected and operated, a storage 220 that stores information on an operation input acquired by the motion acquisition terminal 10, and a storage 220 of the storage 220. A first display screen 70A that displays a specific tool 404 required for any step of maintenance work among a plurality of operation target images 400 based on the stored information, a work target site of a specific step among the plurality of operation target images 400 Information that can be output as a second display screen 70B that displays 405, and a third display screen 70C that displays the work target site 405 of the specific process such that the operation input of the simulated work for the work target site 405 can be executed. And a training material execution step S8 of displaying each screen of the first display screen 70A, the second display screen 70B, and the third display screen 70C on the display unit 305 according to a predetermined output condition. Predetermined output conditions including, are set according to the order and selection contents of the selection operations of the plurality of operation target images 400 acquired by the motion acquisition terminal 10.
この構成により、本実施形態に係る訓練教材提示方法は、第1ないし第3表示画面70A、70B、70Cの各画面が、ツール404や作業対象部位405の選択操作または選択済み作業対象部位405への操作入力を要求するインストラクション表示と、その表示内容に対応する特定の操作対象画像400の選択操作または模擬作業操作入力を実行可能な操作対象画像表示領域とを含んでいるので、各画面に対するユーザの操作入力に応じて画面表示内容が順次変更されていき、作業手順を実機無しで容易・的確に把握可能となる。
With this configuration, in the training material presentation method according to the present embodiment, each of the first to third display screens 70A, 70B, and 70C is displayed on the tool 404 or the operation target site 405 or the selected operation target site 405. Since it includes the instruction display requesting the operation input and the operation target image display area capable of executing the selection operation of the specific operation target image 400 corresponding to the display content or the simulated work operation input, the user for each screen The screen display contents are sequentially changed according to the operation input of, and the work procedure can be grasped easily and accurately without an actual machine.
以上のように、本発明に係る訓練教材提示システムおよび訓練教材提示方法は、対象機器401の保守作業手順を実機無しで反映した訓練教材を容易かつ的確に生成可能であるという効果を奏し、分解、組立作業を伴う保守対象装置の3DCGを用いた教育、演習用の訓練教材を生成することが必要な教育システム全般に適用可能である。
As described above, the training material presentation system and the training material presentation method according to the present invention have the effect that the training material reflecting the maintenance work procedure of the target device 401 can be easily and accurately generated without the actual device, and the disassembly is performed. The present invention can be applied to all education systems that require the generation of training materials for education and exercises using 3DCG of a maintenance target device that involves assembly work.
1 訓練教材提示システム
3 インストラクタ
4 訓練者
10 動作取得端末(情報入力装置)
20 訓練教材生成サーバ(出力情報生成装置)
30 訓練教材実行端末(情報入力装置、表示出力装置)
40 通信ネットワーク
70A 第1表示画面(訓練教材)
70B 第2表示画面(訓練教材)
70C 第3表示画面(訓練教材)
105 表示部(表示手段)
106 操作部(指定手段、指示情報入力手段、明示部位指定手段、作業段階指定手段)
121 作業情報記録データベース(第1の管理手段)
212 教材生成処理部(訓練教材生成手段)
220 ストレージ(記憶装置)
222 訓練教材データベース(訓練教材)
300 制御部(判定手段、表示制御手段)
305 表示部(表示画面)
306 操作部(モード選択手段)
312 実行データ集計処理部(集計手段)
321 実行情報記録データベース(第2の管理手段、記録手段)
400 操作対象画像
401 対象機器
404a、404b、404c、404d ツール
405 作業対象部位
501、601、701 インストラクション表示領域
502、602、702 操作対象画像表示領域
1 TrainingMaterial Presentation System 3 Instructor 4 Trainer 10 Action Acquisition Terminal (Information Input Device)
20 Training material generation server (output information generation device)
30 Training material execution terminal (information input device, display output device)
40Communication Network 70A First Display Screen (Training Material)
70B Second display screen (training material)
70C 3rd display screen (training material)
105 display unit (display means)
106 operation unit (designating means, instruction information inputting means, explicit part designating means, work stage designating means)
121 work information record database (first management means)
212 Teaching Material Generation Processing Unit (Training Material Generating Means)
220 Storage
222 Training Material Database (Training Material)
300 control unit (determination means, display control means)
305 Display (display screen)
306 Operation unit (mode selection means)
312 Execution data aggregation processing unit (aggregation means)
321 execution information recording database (second management means, recording means)
400Operation Target Image 401 Target Device 404a, 404b, 404c, 404d Tool 405 Work Target Part 501, 601, 701 Instruction Display Area 502, 602, 702 Operation Target Image Display Area
3 インストラクタ
4 訓練者
10 動作取得端末(情報入力装置)
20 訓練教材生成サーバ(出力情報生成装置)
30 訓練教材実行端末(情報入力装置、表示出力装置)
40 通信ネットワーク
70A 第1表示画面(訓練教材)
70B 第2表示画面(訓練教材)
70C 第3表示画面(訓練教材)
105 表示部(表示手段)
106 操作部(指定手段、指示情報入力手段、明示部位指定手段、作業段階指定手段)
121 作業情報記録データベース(第1の管理手段)
212 教材生成処理部(訓練教材生成手段)
220 ストレージ(記憶装置)
222 訓練教材データベース(訓練教材)
300 制御部(判定手段、表示制御手段)
305 表示部(表示画面)
306 操作部(モード選択手段)
312 実行データ集計処理部(集計手段)
321 実行情報記録データベース(第2の管理手段、記録手段)
400 操作対象画像
401 対象機器
404a、404b、404c、404d ツール
405 作業対象部位
501、601、701 インストラクション表示領域
502、602、702 操作対象画像表示領域
1 Training
20 Training material generation server (output information generation device)
30 Training material execution terminal (information input device, display output device)
40
70B Second display screen (training material)
70C 3rd display screen (training material)
105 display unit (display means)
106 operation unit (designating means, instruction information inputting means, explicit part designating means, work stage designating means)
121 work information record database (first management means)
212 Teaching Material Generation Processing Unit (Training Material Generating Means)
220 Storage
222 Training Material Database (Training Material)
300 control unit (determination means, display control means)
305 Display (display screen)
306 Operation unit (mode selection means)
312 Execution data aggregation processing unit (aggregation means)
321 execution information recording database (second management means, recording means)
400
Claims (6)
- 対象機器(401)の保守作業に関連する3次元画像を含む訓練教材を、作業空間表示と共に訓練者(4)に提示するとともに、前記保守作業の各段階に対応する模擬作業の操作入力に応じて提示内容を変化させる訓練教材提示システム(1)であって、
前記模擬作業の操作入力の情報を取得する情報入力装置(10)と、
前記保守作業の作業対象部位(405)と前記保守作業に使用するツール(404a、404b、404c、404d)とを表示可能かつ選択操作可能な複数の操作対象画像(400)として記憶するとともに、前記情報入力装置で取得される操作入力の情報を記憶する記憶装置(220)と、
前記記憶装置の記憶情報に基づき、前記複数の操作対象画像のうち前記保守作業のいずれかの工程に必要な特定のツールを表示する第1表示画面(70A)、前記複数の操作対象画像のうち特定工程の作業対象部位を表示する第2表示画面(70B)、および、前記特定工程の作業対象部位を該作業対象部位に対する前記模擬作業の操作入力を実行可能に表示する第3表示画面(70C)を、それぞれ表示出力可能な情報として生成する出力情報生成装置(20)と、
表示画面(305)上に、前記第1表示画面、前記第2表示画面および前記第3表示画面の各画面を所定の出力条件に従って表示する表示出力装置(30)と、
を備え、
前記所定の出力条件が、前記情報入力装置で取得される前記複数の操作対象画像の前記選択操作の順序および選択内容に応じて設定されることを特徴とする訓練教材提示システム。 A training material including a three-dimensional image related to the maintenance work of the target device (401) is presented to the trainee (4) together with the work space display, and according to the operation input of the simulated work corresponding to each stage of the maintenance work. A training material presentation system (1) for changing presentation contents by
An information input device (10) for acquiring information on operation input of the simulation work;
The work target part (405) of the maintenance work and the tools (404a, 404b, 404c, 404d) used for the maintenance work are stored as a plurality of displayable and selectable operation target images (400), and A storage device (220) for storing information of operation input acquired by the information input device;
A first display screen (70A) that displays a specific tool required for any step of the maintenance work among the plurality of operation target images based on the storage information of the storage device, among the plurality of operation target images A second display screen (70B) displaying the work target part of the specific process, and a third display screen (70C) displaying the work target part of the specific process so that the operation input of the simulated work to the work target part can be executed. ) As output information that can be displayed and output, respectively, and
A display output device (30) for displaying each of the first display screen, the second display screen, and the third display screen on a display screen (305) according to a predetermined output condition;
Equipped with
The training material presentation system, wherein the predetermined output condition is set according to an order and selection contents of the selection operations of the plurality of operation target images acquired by the information input device. - 前記第1表示画面、前記第2表示画面および前記第3表示画面の各画面が、前記選択操作または前記操作入力を要求するインストラクション表示領域(701)と、前記複数の操作対象画像のうち前記インストラクション表示領域の表示内容に対応する特定の操作対象画像と、インストラクタまたは前記訓練者による各表示画面での前記選択操作または前記模擬作業の操作入力の内容を表示する操作画像表示領域(702)とを、含んでいることを特徴とする請求項1に記載の訓練教材提示システム。 Each of the first display screen, the second display screen, and the third display screen has an instruction display area (701) for requesting the selection operation or the operation input, and the instruction among the plurality of operation target images. A specific operation target image corresponding to the display content of the display area and an operation image display area (702) for displaying the content of the operation input of the selection operation or the simulated work on each display screen by the instructor or the trainee. The training teaching material presentation system according to claim 1, wherein the training teaching material presentation system comprises:
- 前記情報入力装置は、
前記3次元画像を含む前記操作対象画像を表示する表示手段(105)と、
前記インストラクタの前記模擬作業によって、前記操作対象画像に対する前記保守作業の基準となる作業と、前記操作対象画像における作業対象部位、前記ツール、および前記ツールの動きと、前記ツールの動きに応じた前記対象部位の動きと、を指定する指定手段(106)と、を有し、
前記出力情報生成装置は、前記指定手段により指定された前記基準となる作業に、前記作業対象部位、前記ツール、前記ツールの動き、および前記対象部位の動きが反映された作業手順を有する訓練教材(222)を生成する訓練教材生成手段(212)を有することを特徴とする請求項1または2に記載の訓練教材提示システム。 The information input device,
Display means (105) for displaying the operation target image including the three-dimensional image;
By the simulation work of the instructor, a work as a reference of the maintenance work for the operation target image, a work target portion in the operation target image, the tool, and the movement of the tool, and the operation according to the movement of the tool And a designating means (106) for designating the movement of the target part,
The output information generation device has a training material having a work procedure in which the work to be a work, the tool, the movement of the tool, and the movement of the target portion are reflected in the reference work designated by the designating unit. The training material presentation system according to claim 1 or 2, further comprising training material creation means (212) for creating (222). - 前記表示出力装置は、前記第1ないし第3表示画面の各画面を表示して行う訓練のモードとして、教育モードまたは演習モードを選択するモード選択手段(306)を有し、
前記情報入力装置は、
前記訓練の実施中に前記訓練者を誘導するための指示情報を入力する指示情報入力手段(106)と、
前記教育モードでの前記訓練時に前記訓練者に対して明示する部位を指定する明示部位指定手段(106)と、
前記演習モードでの前記訓練時に前記基準となる作業で指定した部位が選択された場合にのみ次の作業段階に進むように指定する作業段階指定手段(106)と、
をさらに有することを特徴とする請求項3に記載の訓練教材提示システム。 The display output device has a mode selection unit (306) for selecting an education mode or an exercise mode as a training mode performed by displaying each screen of the first to third display screens,
The information input device,
Instruction information input means (106) for inputting instruction information for guiding the trainee during the training,
An explicit part specifying means (106) for specifying a part to be clearly shown to the trainee at the time of the training in the education mode;
Work stage designating means (106) for designating to proceed to the next work stage only when a part designated in the reference work is selected during the training in the practice mode;
The training material presentation system according to claim 3, further comprising: - 前記インストラクタの前記模擬作業により前記保守作業の各作業項目ごとに指定された前記作業手順、前記作業対象部位、および前記ツールの各情報を、正解の操作入力の情報として管理する第1の管理手段(121)と、
前記訓練者の前記模擬作業により前記保守作業の各作業項目ごとに指定された前記作業手順、前記作業対象部位、および前記ツールの各情報を、前記演習モードの操作入力の情報として管理する第2の管理手段(321)と、
前記正解の操作入力の情報と、前記演習モードの操作入力の情報との比較結果に応じて前記訓練者の習熟度を判定する判定手段(300)と、
前記訓練者に対応付けて、前記演習モードでの前記訓練における前記比較結果を、前記訓練教材単位に記録する記録手段(321)と、
前記作業項目ごとの前記比較結果を、前記訓練教材単位に集計する集計手段(312)と、
前記比較結果を前記表示画面に表示させる表示制御手段(300)と、
をさらに有することを特徴とする請求項3または4に記載の訓練教材提示システム。 A first management unit that manages the work procedure, the work target part, and the tool information designated for each work item of the maintenance work by the simulated work of the instructor as information of correct operation input. (121),
Secondly, managing each information of the work procedure, the work target portion, and the tool designated for each work item of the maintenance work by the simulated work of the trainee as information of operation input in the exercise mode. Management means (321) of
Determination means (300) for determining the degree of proficiency of the trainee according to the result of comparison between the information on the correct operation input and the information on the operation input in the exercise mode;
A recording means (321) for recording the comparison result in the training in the exercise mode in association with the training material unit in association with the trainee;
An aggregating means (312) for aggregating the comparison result for each work item in units of the training material;
Display control means (300) for displaying the comparison result on the display screen;
The training material presentation system according to claim 3, further comprising: - 対象機器(401)の保守作業に関連する3次元画像を含む訓練教材を、作業空間表示と共に訓練者(4)に提示するとともに、前記保守作業の各段階に対応する模擬作業の操作入力に応じて提示内容を変化させる訓練教材提示方法であって、
前記模擬作業の操作入力の情報を取得する情報入力ステップ(S1)と、
前記保守作業の作業対象部位(405)と前記保守作業に使用するツール(404a、404b、404c、404d)とを表示可能かつ選択操作可能な複数の操作対象画像(400)として記憶するとともに、前記情報入力装置で取得される操作入力の情報を記憶する記憶ステップ(S2)と、
前記記憶装置の記憶情報に基づき、前記複数の操作対象画像のうち前記保守作業のいずれかの工程に必要な特定のツールを表示する第1表示画面(70A)、前記複数の操作対象画像のうち特定工程の作業対象部位を表示する第2表示画面(70B)、および、前記特定工程の作業対象部位を該作業対象部位に対する前記模擬作業の操作入力を実行可能に表示する第3表示画面(70C)を、それぞれ表示出力可能な情報として生成する出力情報生成ステップ(S4)と、
表示画面(305)上に、前記第1表示画面、前記第2表示画面および前記第3表示画面の各画面を所定の出力条件に従って表示する表示出力ステップ(S8)と、を含み、
前記所定の出力条件が、前記情報入力装置で取得される前記複数の操作対象画像の前記選択操作の順序および選択内容に応じて設定されることを特徴とする訓練教材提示方法。
A training material including a three-dimensional image related to the maintenance work of the target device (401) is presented to the trainee (4) together with the work space display, and according to the operation input of the simulated work corresponding to each stage of the maintenance work. A method for presenting training materials that changes the presentation content by
An information input step (S1) for obtaining information on the operation input of the simulation work,
The work target part (405) of the maintenance work and the tools (404a, 404b, 404c, 404d) used for the maintenance work are stored as a plurality of displayable and selectable operation target images (400), and A storage step (S2) of storing the information of the operation input acquired by the information input device,
A first display screen (70A) that displays a specific tool required for any step of the maintenance work among the plurality of operation target images based on the storage information of the storage device, among the plurality of operation target images A second display screen (70B) displaying the work target part of the specific process, and a third display screen (70C) displaying the work target part of the specific process so that the operation input of the simulated work to the work target part can be executed. ) As output information that can be displayed and output, respectively (S4),
A display output step (S8) of displaying each of the first display screen, the second display screen, and the third display screen on the display screen (305) according to a predetermined output condition;
The training material presentation method, wherein the predetermined output condition is set according to the order and selection content of the selection operation of the plurality of operation target images acquired by the information input device.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018217703A JP7012632B2 (en) | 2018-11-20 | 2018-11-20 | Training material presentation system and training material presentation method |
JP2018-217703 | 2018-11-20 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020105222A1 true WO2020105222A1 (en) | 2020-05-28 |
Family
ID=70774227
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2019/029595 WO2020105222A1 (en) | 2018-11-20 | 2019-07-29 | Training teaching material presenting system and training teaching material presenting method |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP7012632B2 (en) |
WO (1) | WO2020105222A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7440352B2 (en) * | 2020-06-17 | 2024-02-28 | 株式会社日立製作所 | Educational content creation system and method |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120270196A1 (en) * | 2011-04-21 | 2012-10-25 | Applied Computer Education Services, Inc. | Systems and methods for virtual wound modules |
US20150243013A1 (en) * | 2014-02-27 | 2015-08-27 | Microsoft Corporation | Tracking objects during processes |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH10293525A (en) * | 1996-12-24 | 1998-11-04 | Toko Seiki Kk | Intellectual educational training method and system therefor |
JP2002304112A (en) * | 2001-04-06 | 2002-10-18 | Mitsubishi Heavy Ind Ltd | Method and device for plant design, and program |
US20030001903A1 (en) * | 2001-06-08 | 2003-01-02 | Michael Duffy | Software-based system for educational tools |
JP2006139163A (en) * | 2004-11-15 | 2006-06-01 | Osaka Gas Co Ltd | Security work training system |
JP6159217B2 (en) * | 2013-10-11 | 2017-07-05 | 三菱重工業株式会社 | Plant operation training apparatus, control method, program, and plant operation training system |
-
2018
- 2018-11-20 JP JP2018217703A patent/JP7012632B2/en active Active
-
2019
- 2019-07-29 WO PCT/JP2019/029595 patent/WO2020105222A1/en active Application Filing
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120270196A1 (en) * | 2011-04-21 | 2012-10-25 | Applied Computer Education Services, Inc. | Systems and methods for virtual wound modules |
US20150243013A1 (en) * | 2014-02-27 | 2015-08-27 | Microsoft Corporation | Tracking objects during processes |
Also Published As
Publication number | Publication date |
---|---|
JP7012632B2 (en) | 2022-01-28 |
JP2020086042A (en) | 2020-06-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11227439B2 (en) | Systems and methods for multi-user virtual reality remote training | |
Carruth | Virtual reality for education and workforce training | |
US20140308647A1 (en) | Computer-based virtual trainer | |
CN107657666A (en) | A kind of virtual experimental system of Machine Control | |
JP7393445B2 (en) | Training material presentation system and training material presentation method | |
Lavric et al. | An ar work instructions authoring tool for human-operated industrial assembly lines | |
WO2020105222A1 (en) | Training teaching material presenting system and training teaching material presenting method | |
CN110580830A (en) | Teaching system applying digital visual virtual reality technology to interdisciplinary learning | |
CN117711217A (en) | VR technology-based standardized training system for operation flow in coal chemical industry | |
Fernández-Mireles et al. | Design and implementation of an augmented reality-based app for assembly lines in industry 4.0 | |
CN113887158B (en) | Virtual simulation teaching method, system and computer equipment | |
Häfner et al. | An Adaptive Learning Environment for Industry 4.0 Competencies Based on a Learning Factory and Its Immersive Digital Twin. | |
JP2013068794A (en) | Training study support device | |
CN113674569A (en) | Remote relay protection test training system and training method based on VR | |
CN115809945B (en) | Teaching training platform based on cloud computing | |
Siyapong et al. | The Virtual Reality Technology for Maintenance of Complex Machine in Manufacturing Training | |
Hanifati et al. | Interactive Learning Through Virtual Reality Operating Training Simulations for Industry Operators | |
Pathan et al. | Teaching and learning of divergent & convergent thinking skills using DCT | |
Mahadzir et al. | The Effectiveness of PLC Programming and Simulator Using Factory I/O | |
Shimazu et al. | Systems engineering education for inexperienced students by providing hand-on practices | |
Roelofs | Using AR Enhanced Instructional Materials to Help Novice UX Designers Get Started with XR Development | |
Rubani et al. | Development Augmented Reality of CNC Lathe G-Code Programming | |
CN120218415A (en) | Digital twin visual practical training assessment platform for commodity display technology | |
CN117313186A (en) | Configuration method and device of industrial equipment virtual training system | |
CN101458619A (en) | Simulation learning software and manufacturing method thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19887142 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19887142 Country of ref document: EP Kind code of ref document: A1 |