JP2017102939A - Authoring device, authoring method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an authoring device capable of performing authoring processing to an object by using a voice.SOLUTION: The authoring device includes: an authoring data storage part 101 for storing authoring data in which one or more objects are arranged; a voice reception part 102 for receiving a voice; a voice recognition part 103 for performing voice recognition processing to the voice received by the voice reception part 102; an authoring processing part 104 for performing authoring processing to the object arranged in the authoring data stored in the authoring data storage part 101 in accordance with the result of the voice recognition processing of the voice recognition part 103; and an output part 105 for outputting the processing result of the authoring processing part.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an authoring apparatus that performs an authoring process.

  2. Description of the Related Art As a conventional technique, an automatic electronic publishing support system using a computer, content acquisition means for receiving content information from a content provider via a telecommunication line and storing it in a storage device, and advertisement via a telecommunication line An advertisement acquisition means for receiving advertisement information from the main and storing it in a storage device; and an automatic layout means for automatically arranging content information and advertisement information based on a predetermined layout determination rule to generate an electronic publication. An automatic electronic publishing support system has been known (for example, see Patent Document 1).

JP 2012-242865 A (first page, FIG. 1 etc.)

  However, the conventional authoring apparatus has a problem that it cannot perform an authoring process on an object using sound. For example, an authoring process such as a size change or a position change cannot be performed by voice on an object arranged on a page. For this reason, the authoring process cannot be easily performed, for example, when the hand is full and the operation by the hand is difficult. In addition, it is difficult for a user who is not proficient in manual operation to perform the authoring process. In addition, for example, there is a problem that it is not possible to combine voice and hand input.

  The present invention has been made to solve the above-described problems, and an object thereof is to provide an authoring apparatus and the like that can perform an authoring process on an object using sound.

  The authoring apparatus according to the present invention includes an authoring data storage unit that stores authoring data in which one or more objects are arranged, a voice reception unit that receives voice, and a voice recognition that performs voice recognition processing on the voice received by the voice reception unit. And the processing results of the authoring processing unit and the authoring processing unit that perform the authoring processing on the object arranged in the authoring data stored in the authoring data storage unit according to the result of the voice recognition processing of the voice recognition unit An authoring device including an output unit.

  With this configuration, it is possible to perform an authoring process for an object using sound.

  The authoring apparatus according to the present invention further includes a display unit that displays one or more authoring data stored in the authoring data storage unit in the authoring device, and the authoring processing unit includes the authoring displayed by the display unit. An authoring apparatus that performs authoring processing on one or more objects arranged in data.

  With this configuration, the displayed object can be authored by voice.

  In the authoring apparatus according to the present invention, in the authoring apparatus, the authoring processing unit performs an authoring process on only an object whose display unit displays the entire display screen.

  With this configuration, it is possible to perform authoring by voice with the object that is entirely displayed in the display screen as a processing target.

  The authoring device of the present invention further includes a display unit that displays one or more authoring data stored in the authoring data storage unit in the authoring device, and the authoring processing unit is an object that is not displayed by the display unit. Is an authoring apparatus that performs an authoring process.

  With this configuration, an object other than the displayed object can be processed and processed using sound.

  In the authoring apparatus of the present invention, in the authoring apparatus, the authoring data acquired by the authoring processing unit has one or more layers on which an object can be arranged, and the authoring processing unit recognizes speech of the authoring data. An authoring apparatus that performs an authoring process for a layer designated by the process.

  With this configuration, the object to be processed can be specified in units of layers.

  In the authoring device of the present invention, in the authoring device, the authoring processing unit identifies an object to be processed from at least a part of the speech recognition result, and identifies a process for the object from at least a part of the speech recognition result. Authoring device.

  With such a configuration, the specified process can be performed on the specified processing target by specifying the processing target object and the process from the voice recognition result.

  In the authoring device according to the present invention, in the authoring device, the authoring processing unit specifies a processing target from at least a part of the speech recognition result, and uses one or more objects for the processing target. Is an authoring device for performing

  With this configuration, it is possible to perform processing using a processing target object for a processing target such as a page or a layer.

  The authoring device of the present invention further includes a display unit for displaying the authoring data stored in the authoring data storage unit in the authoring device, and the authoring processing unit is a processing target from at least a part of the speech recognition result. When the object is specified, the authoring process is performed on the object. When the object to be processed cannot be specified, the authoring apparatus performs the authoring process using the object displayed on the display unit as the process target.

  With such a configuration, when a processing target cannot be specified, it is possible to perform processing on an appropriate processing target by setting the displayed object as the processing target.

  Further, the authoring device of the present invention is the authoring device, wherein the authoring processing unit performs the authoring processing on the object when the object to be processed can be identified from at least a part of the speech recognition result, and the processing target When the object cannot be specified, the authoring apparatus performs the authoring process on all the objects included in the authoring data as the processing target.

  With this configuration, when the processing target cannot be specified, it is possible to perform processing on an appropriate display target by setting all objects that are not displayed as processing targets.

  The authoring apparatus according to the present invention is an authoring apparatus in which the authoring process performed by the authoring processing unit is a process of changing an attribute of an object in the authoring apparatus.

  With this configuration, the attribute of the object can be changed by sound.

  The authoring apparatus according to the present invention is an authoring apparatus in which the authoring process performed by the authoring processing unit is a process of changing the position of an object in the authoring apparatus.

  With this configuration, the position of the object can be changed by sound.

  The authoring apparatus of the present invention is an authoring apparatus in which the authoring process performed by the authoring processing unit is a process of changing the color of an object in the authoring apparatus.

  With this configuration, the color of the object can be changed by sound.

  Further, the authoring device of the present invention is the authoring device in the authoring device, wherein the object is an object integrally including display data that is display data and audio data that is audio data.

  With this configuration, it is possible to specify an object to be processed by voice using voice data that the object has.

  According to the authoring apparatus and the like according to the present invention, it is possible to perform an authoring process for an object using sound.

Block diagram of an authoring apparatus in an embodiment of the present invention Flow chart for explaining the operation of the authoring apparatus Diagram showing an example of the authoring device Figure showing the authoring data management table of the authoring device Schematic diagram showing the authoring data page structure of the authoring device Figure showing a display example by the authoring device The figure which shows the recognition processing object management table of the same authoring device The figure which shows the recognition processing management table of the same authoring device Figure showing the process target management table of the authoring device Figure showing a display example of the authoring device Schematic diagram showing the authoring data page structure of the authoring device Figure showing a display example of the authoring device Schematic diagram showing the authoring data page layer of the authoring device Schematic diagram showing the authoring data page structure of the authoring device The figure which shows an example of the external appearance of the computer system in embodiment of this invention The figure which shows an example of a structure of the computer system

  Hereinafter, embodiments of an authoring apparatus and the like will be described with reference to the drawings. In addition, since the component which attached | subjected the same code | symbol in embodiment performs the same operation | movement, description may be abbreviate | omitted again.

(Embodiment)
FIG. 1 is a block diagram of an authoring device 1 according to the present embodiment.

  The authoring apparatus 1 includes an authoring data storage unit 101, a voice reception unit 102, a voice recognition unit 103, an authoring processing unit 104, an output unit 105, and a display unit 106.

  The authoring device 1 can be realized by, for example, a computer, a portable information terminal, a mobile phone, a multifunctional mobile phone such as a so-called smartphone, a tablet terminal, or the like.

  The authoring data storage unit 101 stores one or more authoring data. Authoring data is data in which one or more objects are arranged. The authoring data is, for example, data acquired by the authoring process. The authoring process will be described later. The authoring data may be, for example, a final product such as digital content or multimedia data, or may be an intermediate product used to generate these final products. When the authoring data is an intermediate product, for example, the final product can be acquired by rendering the authoring data or writing out the data as a data in a format specified in advance.

  One piece of authoring data may have one or more pages, for example. The page here is a concept including, for example, a sheet, a mount for arranging contents, and the like. A page may be considered as a surface on which one or more objects are arranged, for example. For example, a page identifier such as a page number is associated with each page. One page may have one or more layers. Each layer is associated with a layer identifier such as a layer name or a layer number, for example. Since pages and layers are well-known techniques in the technical field of authoring, detailed description thereof is omitted here. Note that one authoring data may not have a page. One authoring data is, for example, authoring data constituting one file.

  One or more objects arranged in the authoring data are, for example, data to be authored. The object is, for example, data that is a unit to be authored. For example, one object is data handled as one authoring target. The object is, for example, content data. The object is, for example, a character string, data obtained by digitizing a video, a map, software for displaying an image or a character string, or a combination of these. The object is data having display data, for example. The display data is, for example, data that can be visualized. The object is, for example, text data or image data. The text data is, for example, data having one or more character codes indicating characters. The image data may be a still image or a moving image. The still image may be bitmap data or vector data. The object may be two-dimensional or three-dimensional modeling data. It should be noted that character strings and images such as page numbers that are fixed in advance to pages, etc., and character strings and images that are fixed as templates, etc. are considered to be not authored freely by the user. You may make it exclude from the object which is object.

  The object may be, for example, data having display data and audio data integrated. Here, the data having the display data and the audio data integrated is referred to as data with audio. For example, the data with sound may be a file having display data and sound data integrated. Data audio data is audio data. The voice data is data indicating a voice waveform, for example. For example, the voice data is data indicating a change in voltage indicating a voice waveform. The voice data may be data obtained by sampling a voice waveform. The audio data may be uncompressed data or compressed data. The data with sound may further have a feature amount of the sound data stored in the data with sound. The feature amount of the audio data will be described later. In addition, the voice-attached data is information obtained by breaking down the voice data stored in the voice-added data into phonemes, information further broken down into elements (hereinafter referred to as phonemes) than the phonemes, and encoded these. You may have information etc.

  The object arranged in the authoring data may be an object arranged by a link to the authoring data, or may be data (for example, embedded) stored in the authoring data. The object arranged by the link is, for example, data stored in an object storage unit (not shown).

  In the authoring data storage unit 101, for example, authoring data acquired by the authoring processing unit 104 by performing the authoring process is stored. The authoring data storage unit 101 stores, for example, authoring data output from the output unit 105 described later. Further, authoring data received from the outside or authoring data read from a storage unit (not shown) may be stored.

  The storage here is a concept including temporary storage when creating authoring data. For example, a temporary file of authoring data acquired by an authoring processing unit 104 (to be described later) when authoring data is created is stored in the authoring data storage unit 101, and this temporary file may be updated as appropriate by the authoring processing unit 104. good. The acquisition by the authoring processing unit 104 here may be generation by the authoring processing unit 104, or reading of authoring data stored in a storage unit (not shown) by the authoring processing unit 104.

  The authoring data storage unit 101 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. The same applies to other storage units.

  The voice reception unit 102 receives voice. The voice receiving unit 102 receives voice input via a microphone (not shown) or the like, for example. The voice received by the voice receiving unit 102 is, for example, a voice signal. For example, the voice receiving unit 102 acquires voice data indicating the received voice. For example, the voice reception unit 102 obtains voice data by sampling the received voice. The voice received by the voice receiving unit 102 may be considered as voice data. For example, the voice reception unit 102 may receive voice data transmitted or output from another device, another configuration in the authoring processing device, or the like as a voice.

  The voice receiving unit 102 may or may not include an input unit such as a microphone for receiving voice. The voice reception unit 102 can be realized by a device driver of input means, control software for a menu screen, or the like.

  The voice recognition unit 103 performs voice recognition processing on the voice received by the voice reception unit 102. For example, the voice recognition unit 103 performs voice recognition processing, and acquires information including information indicating a processing target of authoring processing, information indicating authoring processing to be executed (hereinafter referred to as processing to be executed), and the like. For example, the voice recognition unit 103 may acquire information indicating a processing target, information indicating a process to be executed, and may acquire data such as text data including these.

  The processing target is, for example, a subject of authoring processing, for example, an object or the like arranged in the authoring data. The information indicating the processing target is, for example, information indicating a processing target identifier or a processing target attribute. The processing target identifier includes, for example, a file name of an object to be processed, a name set for the processing target (for example, an object name or a layer name), a character string assigned to the processing target, and the like. Code (for example, an ID code of an object to be processed). When the processing target is a text object, it may be at least part of the text of this object. The information indicating the processing target attribute is, for example, information indicating the color and size of the object to be processed, the data type of the object (for example, image or text), and the like. For example, information indicating the range of these attributes may be used. Further, the information indicating the processing target attribute may be, for example, information (for example, coordinates) indicating the position in the processing target page. Further, information indicating one page or layer may be considered as information indicating one or more objects arranged on these as processing targets. Similarly, information indicating an arrangement area of an object called a frame or container arranged on a page or the like may be considered as information indicating an object arranged in the arrangement area. Further, when the arranged object includes an object with sound, at least a part of the sound data included in the object with sound, a feature amount corresponding to at least a part of the sound data, a phoneme or a phoneme piece, It may be considered as information indicating the processing target.

  The process to be executed is, for example, one or more authoring processes to be executed on the processing target. The information indicating the process to be executed is, for example, information that can identify the process to be executed, and is an instruction indicating the process to be executed and the name of the process to be executed. For example, the information indicating the process to be executed may be an instruction to move an object, an instruction to delete the object, an instruction to change the color of the image object, and the like. It may be a character string such as “move”, “delete”, or “brighten color”. The information indicating the process to be executed may be information further including parameters of the process to be executed. For example, the parameter is information indicating a movement distance or a movement direction. For example, the parameter is information indicating the moving direction and moving amount, such as 5 pixels on the left and 10 pixels on the right. The parameter may be information indicating the degree to which the brightness of the image indicated by the image object is changed.

  It does not matter what kind of voice recognition processing the voice recognition unit 103 performs on the voice received by the voice reception unit 102. For example, the voice recognition unit 103 performs voice recognition on the voice received by the voice reception unit 102 and acquires text data corresponding to the voice as a voice recognition result. The text data is, for example, text data of voice data corresponding to the voice received by the voice receiving unit 102. The text data acquired by the speech recognition is text data including information indicating a processing target and information indicating a process to be executed. In a specific example to be described later, a case where the speech recognition result is text data corresponding to speech will be described as an example. In addition, since the process which acquires the text data corresponding to an audio | voice by audio | voice recognition is a well-known technique, detailed description is abbreviate | omitted here.

  Further, the voice recognition unit 103 further matches the recognition character string that is the character string indicating the processing target, the character string indicating the processing to be executed, etc. in the text data acquired by the voice recognition processing as described above. If one or more character strings that match the recognition character string are included, a processing target corresponding to each of the one or more recognition character strings is determined. You may make it acquire the information which shows or the information which shows the process to perform. In this case, if a character string having a number or ratio equal to or greater than a predetermined threshold value is included, it is determined that one character string in the text data matches one recognition character string. You may do it.

  The recognition character string includes, for example, a recognition character string representing a processing target and a recognition character string representing a process to be executed. The recognition character string that represents the processing target is, for example, a character string that represents the processing target, for example, a character string that represents the processing target in a natural language or the like. Further, the recognition character string representing the process to be executed is a character string representing the process to be executed, for example, a character string representing the process to be executed in a natural language or the like. The recognition character string representing the processing target is associated with information indicating the processing target, for example. Further, the recognition character string representing the process to be executed is associated with information indicating the process to be executed, for example. The information indicating the process to be executed is, for example, an instruction or an instruction name for executing this process. The instruction here may be considered to include a command. The recognition character string may be stored in advance in a storage unit (not shown), for example.

  For example, when the information indicating the processing target is the same as the recognition character string representing the processing target, the voice recognition unit 103 determines that the character string that matches the recognition character string representing one processing target is the voice recognition When it is detected in the text data obtained by processing, the recognition character string itself representing this processing target is used as information indicating the processing target corresponding to the recognition character string representing the processing target determined to match. Just get it. For example, when the information indicating the processing target is not the same as the recognition character string representing the processing target, the speech recognition unit 103 determines that the character string that matches the recognition character string representing the one processing target is a voice When detected in the text data acquired by the recognition processing, information indicating the processing target stored in a storage unit (not shown) in association with the recognition character string representing the processing target determined to match And can be acquired as information indicating the processing target.

  Similarly, for example, when the information indicating the process to be executed is the same as the recognition character string representing the process to be executed, the speech recognition unit 103 matches the recognition character string representing the one process to be executed. When a character string is detected in the text data acquired by the speech recognition process, the process to be executed is used as information indicating the process corresponding to the recognition character string representing the process to be executed that is determined to match. What is necessary is just to acquire the recognition character string itself represented. For example, when the information indicating the process to be executed is not the same as the recognition character string representing the process to be executed, the voice recognition unit 103 matches the character string that matches the recognition character string representing the one process to be executed. Is detected in the text data acquired by the speech recognition process, the execution is stored in a storage unit (not shown) in association with the recognition character string representing the process to be executed that is determined to match. What is necessary is just to acquire the information which shows a process as information which shows the said process to perform.

  In addition, the voice recognition unit 103 acquires the feature amount of the voice received by the voice reception unit 102 without acquiring the text data from the voice received by the voice reception unit 102 as described above. The feature amount is matched with the feature amount of the recognition speech that is the speech indicating the processing target or the speech indicating the processing to be executed, and the matching amount of the feature amount with the one or more recognition speech feature amounts is equal to or greater than the threshold. Is detected in the feature amount of the voice received by the voice reception unit 102, information indicating a processing target corresponding to each of the one or more recognition voices and information indicating a process to be executed are acquired. It may be.

  The recognition voice includes, for example, a recognition voice that represents a processing target and a recognition voice that represents a process to be executed. The recognition voice that represents the processing target is, for example, a voice that represents the processing target, for example, a voice that represents the processing target in a natural language or the like. Further, the recognition voice representing the process to be executed is a voice representing the process to be executed, for example, a voice representing the process to be executed in a natural language or the like. The recognition voice representing the processing target is associated with the processing target, for example. Also, the recognition voice representing the process to be executed is associated with the process to be executed, for example.

  For example, the recognition voice indicating the processing target is a voice obtained when the processing target identifier or the like is read out in a natural language. For example, the recognition sound is a sound obtained by reading a name assigned to an object to be processed in a natural language. In such a case, the processing target indicated by the processing target identifier read out in order to acquire the recognition voice representing the processing target is set as the processing target corresponding to the recognition voice, and the processing target identifier is It is good also as information which shows the processing target acquired above.

  Further, the recognition voice indicating the process to be executed is a voice obtained by reading a text representing the process to be executed in a natural language. For example, the recognition voice is a voice that reads out the text “move” or a voice that reads the text “large”, and the recognition voice that reads “move” is associated with the process of executing the movement. The recognition voice that reads out “Large” is associated with a process of executing enlargement. The fact that the recognition voice indicating the process to be executed is associated with the process to be executed means that the recognition voice indicating the process to be executed is an identifier indicating the process to be executed. It may be considered that it is associated with an instruction or instruction name for execution. In such a case, the process indicated by the identifier of the process to be executed read out to acquire the recognition voice representing the process to be executed is the process to be executed corresponding to the recognition voice, and the identifier of this process is Information indicating the processing to be executed acquired as described above may be used. The recognition voice and the feature amount corresponding to the recognition voice may be stored in advance in a storage unit (not shown).

  The feature amount acquired with respect to speech is, for example, a sequence of feature vectors extracted from speech signals cut out every short time. The feature quantity acquired here is, for example, MFCC obtained by discrete cosine transform of a filter bank output of 24 channels using a triangular filter, and has 12 dimensions each of its static parameter, delta parameter, and delta delta parameter, It may also have normalized power and delta power and delta delta power (39 dimensions total). Alternatively, the feature quantity may be 25 dimensions including 12 dimensions of MFCC, 12 dimensions of ΔMFCC, and 1 dimension of Δlogarithmic power. As described above, various feature amounts can be used. The feature amount is also called a feature parameter or feature vector.

  Since the process of acquiring feature quantities for voice and voice data is a known technique, detailed description thereof is omitted here. Moreover, since the process which collates the feature-value acquired about audio | voice and audio | voice data, and acquires the value etc. which show a fitness is a well-known technique, detailed description is abbreviate | omitted here.

  Note that the speech recognition unit 103 performs collation using information obtained by decomposing speech or speech data into phonemes or phoneme pieces instead of the speech feature values described above, information indicating the processing target, and processing to be executed You may acquire the information which shows. Since processing for acquiring phonemes and phonemes and processing for searching using data obtained by encoding phonemes and phonemes is a known technique, detailed description thereof is omitted here. The recognition speech and the phonemes and phonemes corresponding to the recognition speech may be stored in advance in a storage unit (not shown).

  Note that the voice recognition unit 103 may perform voice recognition processing in the same manner as described above to acquire information further including information indicating the processing target. The processing target means, for example, a page or a layer on which an object that is an authoring processing target is arranged. The processing target may be considered as, for example, an object movement destination, a movement source, a copy destination, a copy source, or the like. Information indicating the processing target, for example, a page identifier (for example, a page number), a layer identifier, and the like. For example, the voice recognition unit 103 acquires information indicating the processing target using the recognition character string indicating the processing target associated with the information indicating the processing target or the recognition voice, as described above. You may do it. Note that the process of acquiring information including information indicating the processing target by the voice recognition process is the same as the process of acquiring information including information indicating the processing target as described above, and thus description thereof is omitted here. .

  Similarly, the voice recognition unit 103 may perform voice recognition processing and acquire information further including information indicating a layer. However, the information indicating the layer acquired here is information indicating a layer for specifying a processing target arranged in the layer. For example, the speech recognition unit 103 may acquire information indicating a layer in the same manner as described above using a recognition character string indicating a layer associated with information indicating a layer or a recognition speech. Note that the process of acquiring information including information indicating a layer by the voice recognition process is the same as the process of acquiring information including information indicating the processing target as described above, and thus description thereof is omitted here.

  In addition, when the speech recognition unit 103 acquires text data corresponding to speech data as a result of speech recognition, information indicating a processing target using a recognition character string or the like from the text data as described above, or execution Instead of the voice recognition unit 103 performing processing for acquiring information indicating the processing to be performed, the authoring processing unit 104 may perform the processing.

  The authoring processing unit 104 performs the authoring process according to the result of the voice recognition process of the voice recognition unit 103. The authoring processing unit 104 performs an authoring process on one or more objects arranged in one or more authoring data stored in the authoring data storage unit 101. For example, the authoring processing unit 104 performs authoring processing and creates authoring data. For example, the authoring processing unit 104 performs authoring processing to update one or more authoring data stored in the authoring data storage unit 101. Further, for example, the authoring processing unit 104 may perform an authoring process and acquire new authoring data from one or more authoring data stored in the authoring data storage unit 101.

  The authoring process is a process for producing and editing digital contents such as an electronic book and a WEB page, and multimedia data. Authoring processing includes, for example, processing that is performed on objects placed in authoring data, processing that creates or deletes pages that make up authoring data, changes the order of pages, etc. For example, a process of setting one or more contents stored in a storage unit (not shown) or the like, or a process of deleting the contents from the page. The authoring process may be a process for creating new authoring data or an operation for creating or deleting a layer on a page.

  The authoring process performed on the object by the authoring processing unit 104 is a process performed on an object as a processing target in the authoring process. The authoring process performed on the object is, for example, a process of changing the attribute of the object. The attribute of the object is an attribute for displaying the object, for example. Attributes for displaying the object include, for example, the position, size, color, orientation, transparency, resolution, and the like of the object. For example, the authoring processing unit 104 performs a process of changing the position of the object. The authoring processing unit 104 performs processing for changing the color of the object. The process of changing the color of the object is, for example, a process of changing at least one of brightness, hue, and saturation of an image object or text object. Alternatively, it may be processing for changing the RGB value or CMYK value of the object.

  Further, the authoring process performed on the object may be a process of arranging the object on the page or deleting it from the page. Moreover, the process arrange | positioned the object arrange | positioned on one page on another page, the process to duplicate, etc. may be sufficient. The page here is, for example, a page of authoring data obtained as a result of the authoring process.

  For example, the authoring processing unit 104 identifies one or more objects to be processed from at least a part of a result of the speech recognition processing (hereinafter referred to as a speech recognition result) by the speech recognition unit 103. Further, one or more processes to be executed from at least a part of the speech recognition result are specified. Then, authoring data is obtained by performing the above-described processing on the processing target object specified above.

  For example, the authoring processing unit 104 acquires the information indicating the processing target from at least a part of the information including the information indicating the processing target and the information indicating the processing to be executed, acquired by the voice recognition unit 103 as the voice recognition result. , Specify one or more objects indicated by this information. For example, when the information indicating the processing target is an identifier of the object to be processed (for example, an object name or an object file name), the authoring processing unit 104 sets the object associated with this identifier as the processing target. Identify. In addition, when the information indicated by the processing target is information on a condition for specifying the processing target, an object that satisfies this condition may be specified. For example, when the information indicating the processing target is an attribute value (for example, data type, color, size, etc.) for specifying the processing target, the authoring processing unit 104 selects an object having this attribute value as the processing target. To be specific. Further, when the information indicating the processing target is information indicating the page or layer, the authoring processing unit 104 may identify the object arranged on the page or layer indicated by the information indicating the processing target as the processing target. good. Further, when information indicating a plurality of processing targets is acquired as a speech recognition result, the authoring processing unit 104 processes an object specified by combining them (for example, an object indicated by a logical sum or logical product thereof). It may be specified as a target.

  For example, the authoring processing unit 104 acquires information indicating processing to be executed from at least a part of information including information indicating a processing target and information indicating processing to be executed, acquired by the voice recognition unit 103 as a voice recognition result. Thus, one or more processes indicated by this information are specified. Then, the authoring data may be acquired by performing the processing specified above on the object or the like. For example, the authoring processing unit 104 may acquire the authoring data by performing the processing specified above on the processing target object specified above.

  It should be noted that information indicating the processing target and information indicating the processing to be executed are acquired from text data corresponding to the voice acquired by the voice recognition unit 103 as described above using voice recognition. Instead of the voice recognition unit 103 performing the processing to be performed, the authoring processing unit 104 performs the processing, and the authoring processing unit 104 uses the information indicating the acquired processing target and the information indicating the processing to be executed. You may make it identify the process to perform. In a specific example to be described later, such a case will be described as an example.

  For example, the authoring processing unit 104 acquires a character string indicating the processing target from the head side of the text data indicated by the voice received by the voice receiving unit 102 acquired as the voice recognition result by the voice recognition unit 103, and executes it from the tail side. Acquires the character string indicating the processing to be performed. In addition, for example, the authoring processing unit 104 acquires a character string indicating a processing target from the head side of text data acquired as a speech recognition result, and immediately after that or sandwiches one or more pre-designated clue phrases. You may acquire the character string which shows the process to perform from the position arrange | positioned. The authoring processing unit 104 may acquire a character string indicating a processing target or a character string indicating a process to be executed based on, for example, a combination of a morphological analysis and a clue phrase, a positional relationship between character strings, and the like. . For example, the authoring processing unit 104 acquires the noun phrase “image” as a character string indicating the processing target from the head of the text data “enlarge image”, and then uses the clue phrase “ The noun phrase “enlarged” that is positioned may be acquired as a character string indicating the process to be executed. In addition, an object arranged in one authoring data stored in the authoring data storage unit 101, an object already arranged on a page or the like, or an authoring that is currently displayed at least partially by the display unit 106 Of the identifiers of the objects corresponding to one or more objects arranged in the data, the one included in the text data acquired from the speech recognition result may be specified by searching or the like. Similarly, an attribute value corresponding to an object already arranged on a page or the like of authoring data, an object currently displayed on the display unit 106, or an attribute value prepared in advance in a storage unit (not shown) or the like. The attribute value corresponding to the attribute value included in the text data acquired from the speech recognition result may be specified by searching or the like. Similarly, information included in text data acquired from the speech recognition result may be specified by searching or the like from information indicating authoring processing that can be executed by the authoring processing unit 104.

  Note that the authoring processing unit 104 may appropriately convert the information indicating the processing target into information that can specify the processing target, and specify the processing target using the converted information. In such a case, it may be considered that the processing target is specified using information indicating the processing target. For example, when the information indicating the processing target is a natural language character string “image”, this information is converted into a “data type” using a conversion table prepared in advance in a storage unit (not shown), a conversion rule, or the like. May be converted into information specifying the processing target. Since such conversion is well-known, detailed description is omitted here.

  Further, the authoring processing unit 104 may appropriately convert information indicating the process to be executed into information that can specify the process to be executed, and specify the process to be executed using the converted information. In such a case as well, it may be considered that information to be executed is used to specify the process to be executed. For example, when the information indicating the processing to be executed is a natural language character string “large”, this information is expanded using a conversion table or conversion rules prepared in advance in a storage unit (not shown). It may be converted into an instruction or a command for specifying.

  Note that the authoring processing unit 104 may specify only the object to be processed from the result of speech recognition, or may specify only the process to be executed. For example, the authoring processing unit 104 may specify an object to be processed from the result of speech recognition, and the process to be executed may specify a default process specified in advance. In addition, the authoring processing unit 104 identifies an object currently displayed on the display unit 106 (or an object that is not currently displayed arranged in the currently displayed authoring data) as an object to be processed, You may make it identify the process performed from the result of speech recognition.

  For example, the authoring processing unit 104 performs an authoring process on the object displayed on the display unit 106 as a processing target. For example, the authoring processing unit 104 performs the authoring process using the object currently displayed by the display unit 106 among the processing target objects specified by the voice recognition result. Further, when the speech recognition result does not include information indicating the processing target, the authoring processing unit 104 may perform the authoring process using the object currently displayed on the display unit 106 as the processing target.

  Note that the authoring processing unit 104 may perform the authoring process only on the object that the display unit 106 displays in its entirety on the display screen. For example, the authoring processing unit 104 determines whether or not the object displayed on the display unit 106 is entirely displayed on the display screen, specifies only the object that is displayed as a display target, You may make it exclude from the display object what has not been displayed entirely. Even in this case, as described above, among the objects to be processed specified by the speech recognition result, only the object whose display unit 106 displays the whole on the display screen is specified as the processing target. Also good.

  Further, the authoring processing unit 104 may perform an authoring process on an object that is not displayed on the display unit 106 as a processing target. For example, the authoring processing unit 104 may perform an authoring process by specifying an object arranged on a page that is not currently displayed or an object that is not currently displayed in the display screen as a processing target. In this case, an object that is not displayed as a whole may or may not be included in an object that is not displayed. Also in this case, as described above, only the objects that are not displayed by the display unit 106 among the processing target objects specified by the voice recognition result may be specified as the processing target.

  Further, when the authoring data acquired by the authoring processing unit 104 has one or more layers, the authoring processing unit 104 performs the authoring process on the layer specified by the speech recognition process of the authoring data. May be. The authoring process for a layer is, for example, the above-described authoring process such as enlargement or movement performed on an object placed on this layer when the designated layer is one or more layers on which the object can be placed. is there. When authoring processing is performed on an object placed on a layer, all objects placed on a specified layer may be specified as processing targets. As described above, the processing target specified by the speech recognition result may be specified. Of the objects, only the objects arranged in the designated layer may be specified as the processing target. Also, the authoring process for a layer is a process for changing, for example, the attribute value of the layer itself. For example, when one layer is a layer that changes the attribute value of an object arranged in another layer arranged below this layer, the authoring process may be a process of setting this attribute value A process for generating such a layer may be used. For example, when one layer is a layer that changes the saturation of an image object placed thereunder, even if the processing is to change the amount of saturation that this one layer changes rather than authoring s. good. For example, as a layer for changing the attribute value of the image object arranged below, there is a so-called adjustment layer. Further, the process of changing the attribute value of the layer itself may be a process of changing the attribute value such as the transparency of the layer and the composition mode.

  The authoring processing unit 104 may identify the processing target from at least a part of the speech recognition result, and perform the authoring process using one or more objects for the processing target. For example, the authoring processing unit 104 acquires information indicating the processing target from the voice recognition result, and specifies the processing target indicated by the information indicating the processing target. Then, an authoring process is performed on the processing target using an object. For example, the authoring processing unit 104 may move one object arranged on the currently displayed page to a page specified by information indicating the processing target.

  For example, when the object to be processed can be specified from at least a part of the speech recognition result, the authoring processing unit 104 performs the authoring process on the object, and when the object to be processed cannot be specified, the display unit 106 The authoring process may be performed with the object displayed as the object to be processed.

  For example, the authoring processing unit 104 performs the authoring process on the object when the object to be processed can be identified from at least a part of the speech recognition result, and is authored when the object to be processed cannot be identified. The authoring process may be performed with all objects being processed. The all authored objects are, for example, all the objects arranged on any page by the authoring process or all objects that are included in the authoring data by the authoring process. However, a character string such as a page number or an image fixed in advance to a page or the like, or a character string or an image fixed as a template or the like may be excluded from the authored object.

  Note that the authoring processing unit 104 generates authoring data, generates pages, deletes, generates layers, places and deletes objects, and changes attributes of objects. Since it is a well-known technique, detailed description is omitted here.

  When the object is data with sound, the speech recognition unit 103 uses the speech data received by the speech reception unit 102 as the information indicating the processing target, the voice data indicating the processing target, the feature amount of the voice data, The information about the speech indicating the processing target such as phonemes and phoneme pieces is acquired, and the authoring processing unit 104 uses the information indicating these processing targets, A voice search may be performed using information related to voice indicating the processing target, and an object that is data with voice determined to have matching voice may be specified as the processing target.

  The output unit 105 outputs the processing result of the authoring processing unit 104. For example, the output unit 105 outputs the authoring data acquired by the authoring processing unit 104.

  Output here refers to printing on a printer, transmission to an external device, storage in a recording medium, delivery of processing results to another processing device or another program, display on a monitor (not shown), etc. It is a concept that includes. For example, the output unit 105 accumulates the authoring data acquired by the authoring processing unit 104 in the authoring data storage unit 101. The authoring data acquired by the authoring processing unit 104 here may be considered to include the authoring data temporarily acquired during the authoring process. Further, for example, the output unit 105 may accumulate the authoring data acquired by the authoring processing unit 104 in an external storage medium or transmit the data to an external device or the like. The display here may be a display similar to the display performed by the display unit 106 described later, for example, a display using an external device or the like.

  The output unit 105 may or may not include an output device such as a communication unit. The output unit 105 can be implemented by output device driver software, or output device driver software and an output device.

  The display unit 106 displays one or more authoring data stored in the authoring data storage unit 101. The display unit 106 displays, for example, authoring data in which one or more objects are arranged. The authoring data displayed by the display unit 106 may be authoring data for one or more pages or authoring data for some areas in one or more pages. Further, the display unit 106 may display one or more layers of one or more pages of one authoring data. The display unit 106 may display the changed authoring data each time the authoring data is changed, for example, during the authoring process. For example, every time the authoring data stored in the authoring data storage unit 101 is updated according to the authoring process by the authoring processing unit 104, the display of the authoring data may be updated in accordance with this update. Note that the display here may be that data for displaying the authoring data screen is transmitted to an external device (not shown), and the authoring data is displayed on the external device by the data for displaying this image. It is also possible to display the screen. For example, when the authoring device 1 is a server device, the external device is a terminal device connected to the server device via a network or the like. This external device is, for example, a device provided with display means (not shown) for displaying this screen using data for displaying the authoring data screen, a display device (not shown), and the like. .

  The display unit 106 may be considered as including a display device or not. The display unit 106 can be realized by display device driver software, or display device driver software and a display device.

  Next, an example of the operation of the authoring apparatus 1 will be described using the flowchart of FIG. Here, a case where one or more authoring data is already stored in the authoring data storage unit 101 of the authoring apparatus 1 will be described as an example.

  (Step S <b> 101) The display unit 106 determines whether to display one authoring data stored in the authoring data storage unit 101. For example, a receiving unit (not shown) may determine to display authoring data when receiving an instruction to display one authoring data. If the authoring data is to be displayed, the process proceeds to step S102. If not, the process returns to step S101.

  (Step S102) The display unit 106 reads out one piece of authoring data in which one or more objects are arranged from the authoring data storage unit 101 to a storage medium such as a memory (not shown) and displays it on a monitor or the like (not shown). For example, when the authoring data has a plurality of pages, the display unit 106 displays one or more pages specified in advance of the authoring data and one or more pages specified by the user.

  (Step S103) The voice receiving unit 102 determines whether or not a voice is received. If accepted, the process proceeds to step S104. If not accepted, the process proceeds to step S117.

  (Step S104) The voice recognition unit 103 performs voice recognition processing on the voice received in step S103, and acquires text data as a voice recognition result.

  (Step S105) The authoring processing unit 104 determines whether or not the text data acquired in step S104 includes information indicating a processing target. If there is, this information is acquired, and the process proceeds to step S106. If not, the process proceeds to step S112. The authoring processing unit 104 reads one or more character strings indicating object attribute values (for example, data type) stored in advance in a storage unit (not shown) or the like as a recognition character string representing a processing target, and reads the read characters It is determined whether or not a character string that matches the column is included. If it is included, this attribute value is acquired as information indicating the processing target. In addition, for example, the authoring processing unit 104 acquires an identifier of one or more objects arranged on the page currently displayed on the display unit 106 as a recognition character string, and the character string that matches the identifier is a step. It is determined whether or not it is included in the text data acquired in S104. If included, the identifier of this object may be acquired as information indicating the processing target.

  (Step S106) The authoring processing unit 104 specifies an object to be processed. For example, when the information indicating the processing target acquired in step S105 is an object identifier, the processing target object is specified by detecting the object indicated by the object identifier in the displayed page. In addition, when the information indicating the processing target acquired in step S105 is information indicating the attribute value of the object, the object having this attribute value is detected in the displayed page and specified as the processing target object. To do. The authoring processing unit 104 detects an object in which the entire object is not displayed in the display screen among the detected objects, and specifies an object excluding the detected object as a processing target. Good. The user may set in advance whether or not to exclude an object that is not entirely displayed from the processing target.

  (Step S107) The authoring processing unit 104 determines whether or not the text data acquired in step S104 includes information indicating a process to be executed. If there is, this information is read out, and the process proceeds to step S108. If not, the process proceeds to step S111. For example, whether or not a character string that matches a recognition character string that represents a process to be executed that is read out from a storage unit (not shown) that represents one or more processes that are prepared in advance is included. If it is determined and included, information indicating this process is acquired.

  (Step S108) The authoring processing unit 104 determines whether or not the text data acquired in step S104 includes information indicating the processing target. If not included, the process proceeds to step S109. If included, the process proceeds to step S111. For example, information indicating the processing target included in the currently displayed authoring data is acquired as a recognition character string representing the processing target, and whether information indicating the processing target that matches any of these is included. If it is included, information indicating the processing target is acquired. Or you may acquire the information which shows a to-be-processed object using a morphological analysis and a clue phrase. For example, information indicating a page or a layer to be processed may be detected by detecting a clue phrase such as “page” or “layer” and a number or the like detected immediately before these clue phrases.

  (Step S109) The authoring processing unit 104 executes the process indicated by the information indicating the process acquired in Step S107 on the object specified in Step S106. Then, the process returns to step S103. The display unit 106 appropriately updates the display screen according to the execution result of the process.

  (Step S110) The authoring processing unit 104 performs default processing on the object identified in Step S106. Then, the process returns to step S103. The display unit 106 appropriately updates the display screen according to the execution result of the process.

  (Step S111) The authoring processing unit 104 executes the process indicated by the information indicating the process acquired in Step S107 on the object specified in Step S106 for the processing target acquired in Step S108. If the process indicated by the information indicating the process acquired in step S107 is not a process that can be executed for the processing target acquired in step S108, the process may not be executed. Then, the process returns to step S103. The display unit 106 appropriately updates the display screen according to the execution result of the process.

  (Step S112) The authoring processing unit 104 determines whether or not the text data acquired in step S104 includes information indicating a process to be executed. If there is, this information is read out, and the process proceeds to step S113. If not, the process returns to step S103.

  (Step S113) The authoring processing unit 104 determines whether or not the text data acquired in step S104 includes information specifying a layer. If it is not included, the process proceeds to step S114. If it is included, the process proceeds to step S116.

  (Step S114) The authoring processing unit 104 detects and specifies the object currently displayed on the display unit 106. For example, the authoring processing unit 104 acquires an identifier of the detected object.

  (Step S115) The authoring processing unit 104 executes the authoring process indicated by the information indicating the process acquired in Step S112 for the object that is not excluded in Step S115. Then, the process returns to step S116. The display unit 106 appropriately updates the display screen according to the execution result of the process.

(Step S116) The authoring processing unit 104 identifies an object arranged in the layer indicated by the information indicating the layer detected in Step S113 as a processing target, and information indicating the processing acquired in Step S112 indicates this object. Execute the authoring process. Then, the process returns to step S116. The display unit 106 appropriately updates the display screen according to the execution result of the process.
(Step S117) The output unit 105 determines whether or not to output the authoring data displayed on the display unit 106. For example, when a reception unit (not shown) receives an instruction to output, it determines to output authoring data. When outputting, it progresses to step S118, and when not outputting, it returns to step S103.
(Step S103) The output unit 105 outputs the authoring data displayed on the display unit 106. For example, the output unit 105 may transmit the authoring data to the outside, and updates (eg, overwrites) the authoring data before the change stored in the authoring data storage unit 101 with the changed authoring data. Also good.

  In the flowchart of FIG. 2, the default process may not be performed in step S110.

  In addition, instead of setting the processing target specified in step S106 in the flowchart of FIG. 2 as at least a part of the currently displayed object, the same authoring data as the object displayed on the display unit 106 (for example, the same file or the like) ) May be part of the non-display objects included, or may be all the non-display objects. Whether the processing target is the currently displayed object or the non-displayed object may be preset by the user, for example, or may be instructed when the user performs processing. May be.

Further, in step S114 of the flowchart of FIG. 2, all objects included in the same authoring data (for example, the same file, etc.) as the object displayed on the display unit 106 are specified as processing targets regardless of whether or not they are displayed. May be.
Further, step S115 in the flowchart of FIG. 2 may be omitted.

  In the flowchart of FIG. 2, the process is terminated by powering off or a process termination interrupt.

  Hereinafter, a specific operation of the authoring apparatus 1 in the present embodiment will be described.

(Specific example 1)
FIG. 3 is a diagram illustrating an example of the authoring device 1 according to the present embodiment, and it is assumed that the authoring device 1 is a tablet terminal. The authoring device 1 is assumed to include a microphone 102a and a monitor 106a. It is assumed that a touch panel (not shown) is provided on the surface of the monitor 106a.

  FIG. 4 is an authoring data management table for managing authoring data stored in the authoring data storage unit 101. The authoring data management table has attributes of “authoring ID” and “authoring data”. “Authoring ID” is an identifier of authoring data, and here it is assumed to be a file name of authoring data. “Authoring data” is authoring data, and here, it is assumed that it is a file of authoring data. Here, as an example, a case where the authoring data is an electronic book will be described.

  First, the user operates a touch panel or the like to give an instruction to display the authoring data with the “authoring ID” “001” stored in the authoring data storage unit 101 to a reception unit (not shown) of the authoring device 1. For example, the display unit 106 reads out the authoring data associated with the authoring ID “001” from the authoring data storage unit 101 to a memory or the like, and displays the authoring data on the monitor 106a. Here, the display unit 106 displays a part of the upper left part of the first page of the authoring data according to a setting such as default. Hereinafter, authoring data whose “authoring ID” is “001” is referred to as authoring data 001.

  FIG. 5 is a schematic diagram showing a page structure of the authoring data 001. It is assumed that the authoring data 001 includes a total of four pages from the first page 51 to the fourth page 54. An image object and a text object are arranged on each page. On page 51, which is the first page, text objects 501 and 504 and image objects 502 and 503 are arranged.

  FIG. 6 is a diagram illustrating a display example of the authoring data 001 by the display unit 106. It is assumed that the area 51a of the page 51 is displayed on the monitor 106a. Specifically, the entire text object 501 arranged on the page 51, a part of the image object 502, and the entire image object 503 are displayed on the monitor 106a.

  FIG. 7 shows the correspondence between the recognition character string used for recognizing the processing target from the text data obtained by the authoring processing unit 104 as the speech recognition result by the speech recognition unit 103 and the processing target specified as the recognition result. It is a recognition process target management table for managing the relationship. The recognition processing target management table has attributes of “target character string” and “processing target”. The “target character string” is a recognition character string for recognizing a processing target. “Processing target” is information indicating the processing target, and indicates, for example, a combination of an attribute for searching for the processing target and its attribute value (attribute: attribute value). For example, “data type: image” means that an object whose data type is an image is designated. “Object name: ABC” indicates that an object whose object name is “ABC” is designated. [**] of “target character string” is a regular expression indicating a continuous character string of one or more characters. For example, “file [**]” indicates “file ABC”, “file CDE”, and the like. The recognition process target management table is stored in advance in a storage unit (not shown), for example.

  Here, the attribute value of “processing target” is expressed in natural language, but “processing target” is, for example, one or more attributes used to identify processing targets corresponding to these natural languages. It may be composed of a name, an attribute value, and the like. Further, the “processing target” may be data such as a search key used for search processing or determination processing corresponding to these natural languages.

  FIG. 8 shows correspondence between a recognition character string used for recognizing processing executed by the authoring processing unit 104 from text data acquired by the speech recognition unit 103 as a speech recognition result, and processing specified as a recognition result. It is a recognition process management table for managing relationships. The recognition process management table has attributes of “process character string” and “process”. The “process character string” is a recognition character string for recognizing the process to be executed. “Processing” is information indicating processing to be executed. [Processing target] of “Processing” is a character string of the processing target acquired using a processing target management table described later. The recognition process management table is stored in advance in a storage unit (not shown), for example.

  Here, the attribute value of “processing” is expressed in a natural language, but “processing” is, for example, one or more functions corresponding to these natural languages, method names, “if”, “ It may be configured with a control syntax indicated by “then” or the like. Further, the “processing target” may be an algorithm for performing a determination process or the like corresponding to these natural languages.

  FIG. 9 is a processing target management table for managing a recognition character string used by the authoring processing unit 104 to recognize a processing target from text data acquired by the voice recognition unit 103 as a voice recognition result. In the process target management table, “process target” is a recognition character string for recognizing the process target. In “processing target”, it is assumed that [***] is a regular expression indicating a continuous character string of one or more characters. For example, “layer [***]” indicates “layer ABC”, “layer DEF”, or the like.

  Next, it is assumed that the user utters a voice “enlarge image” to the microphone 102a in order to enlarge the size of the image displayed in FIG. This sound is assumed to be a sound having a sound indicating a processing target “image” and a sound indicating a process “large”. The voice reception unit 102 receives voice uttered by the user as a voice signal via the microphone 102a, performs sampling, and converts the voice into voice data.

  Then, it is assumed that the voice recognition unit 103 acquires text data “Large image” as a result of performing voice recognition on the voice data acquired by the voice receiving unit 102.

  The authoring processing unit 104 sequentially reads out the attribute value of “target character string”, which is a recognition character string representing the processing target, from each record (row) of the recognition processing target management table shown in FIG. It is sequentially determined whether or not the character string that matches is included in the text data acquired by the speech recognition unit 103. Then, the “processing target” attribute value of the record corresponding to the attribute value determined to be included, that is, the “processing target” attribute value of the same record as the attribute value determined to be included is acquired.

  Here, since the text data acquired by the speech recognition unit 103 includes a character string that matches the “image” that is the “target character string” of the record in the first line from the top of FIG. The value of “data type: image” is acquired as information indicating the processing target.

  Next, the authoring processing unit 104 sequentially reads and reads the attribute value of “processing character string”, which is a recognition character string indicating processing to be executed, from each record (row) of the recognition processing management table shown in FIG. It is sequentially determined whether or not a character string that matches the attribute value is included in the text data acquired by the speech recognition unit 103. Then, the “processing” attribute value of the record corresponding to the attribute value determined to be included, that is, the “processing” attribute value of the same record as the attribute value determined to be included is acquired.

  Here, since the text data acquired by the speech recognition unit 103 includes a character string that matches “large” as the “processing character string” of the record in the first line from the top of FIG. The value “120% expansion” is acquired. This “120% enlargement” is information instructing execution of a process for enlarging an object by 120%.

  Further, the authoring processing unit 104 sequentially reads the attribute value of “processing target” in the processing target management table shown in FIG. 9, and the character string that matches the read attribute value is the text acquired by the speech recognition unit 103. It is sequentially determined whether or not it is included in the data. Then, the attribute value determined to be included is acquired. For example, since the text data does not include the character strings “layer” and “page”, the attribute value of “target” in any record of the target management table shown in FIG. Suppose there was nothing to do. In determining whether there is a match, the start position, end position, etc. of the regular expression included in the attribute value of “target” are the morpheme obtained from the text data using morphological analysis etc. You may judge from a break.

  As described above, since the information indicating the processing target is acquired from the text data acquired by the voice recognition unit 103, the information indicating the processing is acquired, and the information indicating the processing target cannot be acquired, the authoring processing unit 104 Among the currently displayed objects, the information “120%” indicating the processing is the object indicated by the information “data type: image” indicating the processing target and the object displayed as a whole on the monitor 106a. The authoring process indicated by “Enlarge” is performed.

  Specifically, among the currently displayed objects, an object 502 and an object 503 that are objects whose data type is an image are detected. Furthermore, an object whose entire object is not displayed on the monitor 106a is detected from the detected objects 502 and 503. For example, an object in which some of the coordinates in the object are not located in the display area is detected. Here, the object 502 is detected, and the object 502 is excluded from the processing target. Then, the authoring processing unit 104 performs a process of enlarging the size (size) by 120% for the object 502 remaining as a processing target. Then, the display unit 106 updates the display on the monitor 106a with the authoring data acquired in this way.

  FIG. 10 is a diagram showing authoring data displayed on the display unit 106 after the authoring process.

  When the target of the enlargement process is a text object, the area where the text is arranged may be enlarged, or the character size of the text may be changed.

  In addition, here, an object whose entire object is not displayed on the monitor 106a is excluded from the processing target, but may be excluded. For example, whether or not to exclude may be switched according to a user instruction or the like.

  Here, a case has been described in which the text data acquired by the speech recognition unit 103 includes the character string “large”. For example, instead of “large”, the text data is “brighter”. ”Is included, the authoring processing unit 104 performs a process similar to the above on the text data, and performs a process of“ increase brightness by 10% ”from the recognition process management table shown in FIG. Get information indicating Thereby, the process executed by the authoring processing unit 104 is specified to increase the brightness of the image object by 10%. Then, the authoring processing unit 104 performs this process on the currently displayed image object specified above, thereby increasing the brightness value of the currently displayed image object by 10% and displaying the image object. The brightness of the displayed image becomes brighter.

  Further, in the state shown in FIG. 6, it is assumed that the voice received from the user by the voice receiving unit 102 is a voice “copy image to page 4”, and the voice recognition unit 103 sets “image” It is assumed that the text data “copy to page 4” is acquired.

  The authoring processing unit 104 performs the same processing as described above from the text data obtained as the speech recognition result, and “data type: image” which is information indicating the processing target and “[ “Copy to Process Target” and “Fourth Page” indicating the target to be processed are acquired. For example, the above text data includes the text “fourth page”, and this text is the “[***] page of the second line record from the top of the processing target management table shown in FIG. Therefore, the authoring processing unit 104 acquires, from the text data, “fourth page”, which is the text that matches the character string, as information indicating the processing target.

  The authoring processing unit 104 then copies the object 502 and the object 503, which are objects whose data type is an image, among the currently displayed objects to the fourth page, specifically, the object 502 and the object 503. Is copied and placed on the fourth page. Here, the object 502a and 503a that are duplicates of the object 502 and the object 503 of the page 51 that are the first page are arranged at the same position (for example, the same coordinates) of the page 54 that is the fourth page. Note that the pages 51 to 54 are associated with identifiers “first page” to “fourth page” in advance, for example, so that the page to be copied and the page to which the copied object is placed are placed. Can be detected.

  As a result, the authoring data 001 whose “authoring ID” is “001” is changed as shown in FIG.

  Also, suppose that the user utters “more right” to the microphone 102a in the state shown in FIG. It is assumed that this voice is a voice that instructs to move to the right. The voice reception unit 102 receives voice uttered by the user as a voice signal via the microphone 102a, performs sampling, and converts the voice into voice data. Then, it is assumed that the voice recognition unit 103 performs voice recognition and acquires text data “more right”.

  Similarly to the above, the authoring processing unit 104 sequentially reads the attribute values of the “target character string” in the recognition processing target management table shown in FIG. 7 and the matching character string becomes the text data acquired by the speech recognition unit 103. Whether it is included or not is sequentially determined, but here it is determined that none is included. That is, it is assumed that the authoring processing unit 104 cannot identify the processing target from the voice recognition result.

  For this reason, the authoring processing unit 104 sequentially reads the attribute value of “processed character string” from each record (row) of the recognition process management table shown in FIG. When it is determined that the recognition unit 103 includes the acquired text data, the “processing” attribute value of the record corresponding to the attribute value determined to be included is acquired.

  Here, since the acquired text data includes a character string that matches “more right”, which is the “processing character string” of the record on the sixth line from the top in FIG. 7, this is the value of “processing” of this record. Acquire “move 10 pixels to the right”. This process is a process for moving the object to the right by 10 pixels, and this process is specified as a process to be performed on the processing target.

  Further, the authoring processing unit 104 determines whether or not the text data acquired by the speech recognition unit 103 includes information specifying a layer. Here, specifically, the authoring processing unit 104 refers to the acquired text data as “layer [***]”, which is the same as the attribute value in the first row from the processing target management table shown in FIG. It is determined whether or not a character string that matches the character string including the regular expression is included. Here, it is determined that no matching character string is included.

  For this reason, the authoring processing unit 104 detects the objects 501 to 503 that are all objects currently displayed on the monitor 106a by the display unit 106 and identifies them as processing targets.

  In this case, as described above, an object that is not partially displayed may be excluded from the processing target. Further, instead of all the objects currently displayed, the authoring processing unit 104 may specify an object arranged on the page 51 that is a page on which at least a part is currently displayed as a processing target. good.

  Then, the authoring processing unit 104 performs a process of moving the position of the object, which is the process specified above, here, the coordinates, to the right by 10 pixels with respect to the objects 501 to 503 specified above. Then, the display unit 106 updates the display on the monitor 106a with the authoring data acquired in this way.

  FIG. 12 is a diagram showing the authoring data displayed on the display unit 106 after the authoring process.

  FIG. 13 is a schematic diagram for explaining a case where the page 51 has a plurality of layers. Here, for example, it is assumed that the page 51, which is the first page of the authoring data 001 shown in FIG. 5, is composed of a layer 51a and a layer 51b as shown in FIG. Assume that an object 501 and an object 502 are arranged on the layer 51a, and an object 503 and an object 504 are arranged on the layer 51b. In addition, it is assumed that the layer name “layer LF” is associated with the layer 51a, and the layer name “layer LB” is associated with the layer 51b.

  In such a case, it is assumed that the user utters a voice “Large layer LF” to the microphone 102a with the page 51 displayed as shown in FIG. This sound is assumed to be a sound having a sound indicating the processing target “layer LF” and a sound indicating the process “large”. The voice reception unit 102 receives voice uttered by the user as a voice signal via the microphone 102a, performs sampling, and converts the voice into voice data. Then, it is assumed that the voice recognition unit 103 performs voice recognition and acquires text data “increase layer LF”.

  Similarly to the above, the authoring processing unit 104 sequentially reads the attribute value of “target character string” in the recognition processing target management table shown in FIG. 7 and sequentially determines whether or not a matching character string is included in this text data. Assume that it is determined that none of them is included here.

  Therefore, the authoring processing unit 104 sequentially reads the attribute value of “processed character string” from each record (row) of the recognition processing management table shown in FIG. It is determined whether or not the data is included in the data, and “120% enlargement” is acquired as information for specifying the processing to be performed on the processing target in the same manner as described above.

  Further, the authoring processing unit 104 determines whether or not the text data acquired by the speech recognition unit 103 includes a character string that matches “layer [***]”. Here, since “layer LF” matches this character string, it is determined that a matching character string is included.

  Therefore, the authoring processing unit 104 is all the objects arranged in the layer 51a whose layer name is “Layer LF” in the page 51 that is partly displayed on the monitor 106a by the display unit 106 at present. The objects 501 and 502 are detected and specified as processing targets.

  In this case, as described above, an object that is not partially displayed may be excluded from the processing target.

  Then, the authoring processing unit 104 performs a process of enlarging the size of the object, which is the process specified above, by 120% on the object 501 and the object 502 arranged on the layer 51a specified above. Then, the display unit 106 updates the display on the monitor 106a with the authoring data acquired in this way. Accordingly, authoring data obtained by enlarging the objects 501 and 502 of the authoring data 001 shown in FIG. 5 by 120% can be acquired and displayed.

(Specific example 2)
In the above specific example, when the object to be processed cannot be specified from the voice recognition result by the voice recognition unit 103, the object displayed on the monitor 106a by the display unit 106 or the page displayed by the display unit 106 is displayed. Although an example in which processing is performed on a placed object has been described, in the following, the authoring processing unit 104 is placed on an object other than the currently displayed object among the objects placed on the authoring data. An example in which processing is performed on all objects will be described.

  For example, it is assumed that the user utters “loud” to the microphone 102a in a state where the authoring data 001 is displayed on the monitor 106a as in the above specific example. This sound is assumed to be a sound having a sound indicating a process of “large”. The voice reception unit 102 receives voice uttered by the user as a voice signal via the microphone 102a, performs sampling, and converts the voice into voice data. Then, it is assumed that the voice recognition unit 103 performs voice recognition and acquires text data “large”.

  Similarly to the above, the authoring processing unit 104 sequentially reads the attribute values of the “target character string” in the recognition processing target management table shown in FIG. 7 and the matching character string becomes the text data acquired by the speech recognition unit 103. Whether it is included or not is sequentially determined, but here it is determined that none is included. That is, it is assumed that the authoring processing unit 104 cannot identify the processing target from the voice recognition result.

  For this reason, the authoring processing unit 104 sequentially reads the attribute value of “processed character string” from each record (row) of the recognition process management table shown in FIG. The recognizing unit 103 determines whether it is included in the acquired text data. When it is determined that the attribute value is included, the attribute value of “processing” of the record corresponding to the attribute value determined to be included is acquired.

  Here, since the acquired text data includes a character string that matches “large” that is the “processing character string” of the record in the first line from the top of FIG. 7, the “processing” value of this record is “120”. % Expansion ”. This process is a process specified as a process to be performed on the processing target.

  Further, the authoring processing unit 104 determines whether or not the text data acquired by the speech recognition unit 103 includes information specifying a layer. Here, specifically, the authoring processing unit 104 refers to the acquired text data as “layer [***]”, which is the same as the attribute value in the first row from the processing target management table shown in FIG. It is determined whether or not a character string that matches the character string including the regular expression is included. Here, it is assumed that a matching character string is not included.

  As described above, since the object to be processed cannot be specified from the speech recognition result, and the layer is not detected, the authoring processing unit 104 has the display unit 106 that currently displays the monitor 106a among the objects arranged in the authoring data 001. Objects other than the objects 501 to 503 that are displayed on the screen, that is, all objects not currently displayed are detected and specified as processing targets.

  Note that an object that is only partially displayed, such as the object 502, may be considered as an object that is not currently displayed and added to the processing target. Further, instead of all the objects currently displayed, the authoring processing unit 104 displays all the objects (here, for example, the object 501) arranged on the page 51 that is a page on which at least a part is currently displayed. ˜504) may be excluded from the processing target.

  Then, the authoring processing unit 104 performs a process of enlarging the size of the object, which is the process specified above, by 120% for all the objects other than the objects 501 to 503 specified above in the authoring data 001. Then, the display unit 106 updates the display on the monitor 106a with the authoring data acquired in this way.

  FIG. 14 is a schematic diagram showing the page structure of the authoring data 001 changed after the authoring process. As shown in FIG. 14, the sizes of the non-displayed objects, that is, the objects arranged on the pages 52 to 54 and the object 504 are both enlarged by 120% compared to FIG. 5.

  Needless to say, the process for processing a non-display object may be applied as appropriate to processes other than those described above.

  As described above, according to the present embodiment, it is possible to perform authoring processing on an object using sound. Thereby, for example, even when both hands are occupied, the authoring process can be easily performed.

  In each of the above embodiments, each process (each function) may be realized by centralized processing by a single device (system), or by distributed processing by a plurality of devices. May be.

  Further, although cases have been described with the above embodiments where the authoring device is a stand-alone device, the authoring device may be a stand-alone device or a server device in a server / client system. In the latter case, the accepting unit, the output unit, the display unit, etc. accept input via the communication line or output data for displaying the screen.

  In each of the above embodiments, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. At the time of execution, the program execution unit may execute the program while accessing a storage unit (for example, a recording medium such as a hard disk or a memory).

  The software that realizes the authoring device in each of the above embodiments is the following program. In other words, this program uses a computer that can access an authoring data storage unit that stores authoring data, which is data in which one or more objects are arranged, for a voice reception unit that receives voice and a voice that is received by the voice reception unit. A speech recognition unit that performs speech recognition processing, and an authoring processing unit that performs authoring processing on an object placed in authoring data stored in the authoring data storage unit according to a result of speech recognition processing by the speech recognition unit and authoring processing It is a program for functioning as an output part which outputs the processing result of a part.

  In the program, the functions realized by the program do not include functions that can be realized only by hardware. For example, a function that can be realized only by hardware such as a modem or an interface card in an acquisition unit that acquires information or an output unit that outputs information is not included in the function realized by the program.

  Further, the computer that executes this program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

  FIG. 15 is a schematic diagram illustrating an example of an external appearance of a computer that executes the program and realizes the authoring apparatus according to the embodiment. The above-described embodiment can be realized by computer hardware and a computer program executed on the computer hardware.

  In FIG. 15, the computer system 900 includes a computer 901 including a CD-ROM (Compact Disk Read Only Memory) drive 905, a keyboard 902, a mouse 903, and a monitor 904.

  FIG. 16 is a diagram showing an internal configuration of the computer system 900. In FIG. 16, in addition to the CD-ROM drive 905, a computer 901 is connected to an MPU (Micro Processing Unit) 911, a ROM 912 for storing a program such as a boot-up program, and an MPU 911. A RAM (Random Access Memory) 913 that temporarily stores and provides a temporary storage space, a hard disk 914 that stores application programs, system programs, and data, and a bus 915 that interconnects the MPU 911, ROM 912, and the like Prepare. The computer 901 may include a network card (not shown) that provides connection to the LAN.

  A program that causes the computer system 900 to execute the functions of the authoring apparatus according to the above-described embodiment may be stored in the CD-ROM 921, inserted into the CD-ROM drive 905, and transferred to the hard disk 914. Instead, the program may be transmitted to the computer 901 via a network (not shown) and stored in the hard disk 914. The program is loaded into the RAM 913 when executed. The program may be loaded directly from the CD-ROM 921 or the network.

  The program does not necessarily include an operating system (OS) or a third-party program that causes the computer 901 to execute the functions of the authoring apparatus according to the above-described embodiment. The program may include only a part of an instruction that calls an appropriate function (module) in a controlled manner and obtains a desired result. How the computer system 900 operates is well known and will not be described in detail.

  The present invention is not limited to the above-described embodiments, and various modifications are possible, and it goes without saying that these are also included in the scope of the present invention.

  As described above, the authoring device according to the present invention is suitable as a device for performing authoring and the like, and is particularly useful as a device for performing an authoring process on objects arranged in authoring data.

DESCRIPTION OF SYMBOLS 1 Authoring apparatus 101 Authoring data storage part 102 Voice reception part 102a Microphone 103 Speech recognition part 104 Authoring process part 105 Output part 106 Display part 106a Monitor

Claims (7)

An authoring data storage unit for storing authoring data in which one or more objects are arranged;
A voice reception unit for receiving voice;
A voice recognition unit that performs voice recognition processing on the voice received by the voice reception unit;
According to the result of the speech recognition processing of the speech recognition unit, the authoring processing unit that performs the authoring processing on the object arranged in the authoring data stored in the authoring data storage unit and the processing result of the authoring processing unit are output. An output section;
A display unit for displaying authoring data stored in the authoring data storage unit,
The authoring processing unit performs an authoring process on the object when the object to be processed can be identified from at least a part of the speech recognition result, and when the object to be processed cannot be identified, the display unit An authoring device that performs authoring processing for an object displayed by. The authoring apparatus according to claim 1, wherein the authoring process performed by the authoring processing unit is a process of changing an attribute of an object. The authoring apparatus according to claim 2, wherein the authoring process performed by the authoring processing unit is a process of changing a position of an object. The authoring apparatus according to claim 2, wherein the authoring process performed by the authoring processing unit is a process of changing a color of an object. The authoring apparatus according to any one of claims 1 to 4, wherein the object is an object that integrally includes display data that is display data and audio data that is audio data. An authoring method that is performed using an authoring data storage unit that stores authoring data in which one or more objects are arranged, a voice reception unit, a voice recognition unit, an authoring processing unit, an output unit, and a display unit. There,
A voice receiving step in which the voice receiving unit receives voice;
A voice recognition step in which the voice recognition unit performs a voice recognition process on the voice received in the voice reception step;
An authoring processing step in which the authoring processing unit performs an authoring process on an object arranged in the authoring data stored in the authoring data storage unit according to a result of the voice recognition processing in the voice recognition step; and the output unit An output step for outputting a processing result by the authoring processing step; and a display step for displaying the authoring data stored in the authoring data storage unit by the display unit,
In the authoring processing step, when an object to be processed can be specified from at least a part of the speech recognition result, an authoring process is performed on the object, and when the object to be processed cannot be specified, the display step An authoring method that performs authoring for the object displayed in. A computer capable of accessing an authoring data storage unit in which authoring data in which one or more objects are arranged is stored;
A voice reception unit for receiving voice;
A voice recognition unit that performs voice recognition processing on the voice received by the voice reception unit;
According to the result of the speech recognition processing of the speech recognition unit, the authoring processing unit that performs the authoring processing on the object arranged in the authoring data stored in the authoring data storage unit and the processing result of the authoring processing unit are output. Function as an output unit and a display unit for displaying the authoring data stored in the authoring data storage unit;
The authoring processing unit performs an authoring process on the object when the object to be processed can be identified from at least a part of the speech recognition result, and when the object to be processed cannot be identified, the display unit A program that performs authoring for the object displayed by.

Images