CN101604212B - Writing action and trajectory recognition method, writing device and recognition system thereof - Google Patents
Writing action and trajectory recognition method, writing device and recognition system thereof Download PDFInfo
- Publication number
- CN101604212B CN101604212B CN 200810100443 CN200810100443A CN101604212B CN 101604212 B CN101604212 B CN 101604212B CN 200810100443 CN200810100443 CN 200810100443 CN 200810100443 A CN200810100443 A CN 200810100443A CN 101604212 B CN101604212 B CN 101604212B
- Authority
- CN
- China
- Prior art keywords
- writing
- signal
- sound
- track
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Character Discrimination (AREA)
Abstract
Description
技术领域 technical field
本发明是有关一种书写辨识技术,尤其是指一种利用声音信号来判断书写动作的一种书写动作与轨迹辨识方法及其书写装置与辨识系统。The present invention relates to a writing recognition technology, in particular to a writing motion and track recognition method, a writing device, and a recognition system that uses sound signals to judge writing motions.
背景技术 Background technique
随着科技的进步,现代人的生活已经与信息科技产品密不可分。在信息科技的产品中,尤其是计算机与手机等科技产品,更是与多数人生活息息相关。而使用者可以利用这些计算机科技产品,将要执行的作业命令传递到计算机中,经过处理与转换后,计算机会将其处理后的结果呈现于屏幕上。在这样的操作过程中,使用者与计算机之间沟通的方式需要藉由一输入接口来作为人机对话的接口。With the advancement of science and technology, the life of modern people has become inseparable from information technology products. Among information technology products, especially technology products such as computers and mobile phones, they are closely related to the lives of most people. And users can use these computer technology products to transmit the operation commands to be executed to the computer, and after processing and conversion, the computer will present the processed results on the screen. In such an operation process, the way of communication between the user and the computer needs to use an input interface as an interface for man-machine dialogue.
过去计算机产品的人机接口最常见的是键盘与鼠标。一般而言,鼠标主要仅能改变移动与选择的输入模式,因此功能有限,难以下达复杂多元的指令。而键盘输入,因为按键繁多,因此需经一定时间的学习与熟悉,因此有较高的学习门坎。此外,使用键盘或鼠标,通常较难进行细腻的图形绘制与处理,或是需要较多时间进行处理。基于这些限制,其它输入方式,例如:手写或者是语音的人机输入模式也就因应而生。In the past, the most common human-machine interfaces of computer products were keyboards and mice. Generally speaking, the mouse can only change the input mode of movement and selection, so its functions are limited and it is difficult to issue complex and diverse commands. As for keyboard input, because there are many keys, it needs to be studied and familiarized with for a certain period of time, so there is a higher learning threshold. In addition, it is usually difficult to draw and process delicate graphics using a keyboard or mouse, or it takes more time to process. Based on these limitations, other input methods, such as: handwriting or voice man-machine input mode will emerge accordingly.
在常用的手写输入模式中,如美国公开专利申请号US2004/0184659所揭露的一种手写输入轨迹辨识系统与方法就揭露出一个手写轨迹辨识系统,包含:一个运动检测单元用于输出基于系统本体在空间中的加速度变化的电子信号以及一控制单元用于检测当系统本体暂时停止时的非手写区段间隔,其藉由加速度值的标准差跟一门坎值的比较来定义出书写的时间范围以得到手写的电子信号。在该技术中,字符间书写需刻意暂停才能做断点检测。In the commonly used handwriting input mode, such as a handwriting input trajectory recognition system and method disclosed in United States Published Patent Application No. US2004/0184659 discloses a handwriting trajectory recognition system, including: a motion detection unit for outputting based on the system ontology The electronic signal of the acceleration change in space and a control unit are used to detect the non-handwriting segment interval when the system body is temporarily stopped, which defines the writing time range by comparing the standard deviation of the acceleration value with a threshold value to obtain handwritten electronic signals. In this technology, writing between characters requires a deliberate pause to detect breakpoints.
此外,又如美国公开专利申请号US 2006/0088215所揭露的一种书写辨识系统,其以一个压力传感器在书写工具的前端,判别是否有接触书写面并且分离字的轨迹和提笔信号,然后再利用加速度运算书写轨迹并加上压力计作为手写信号断点检测。又如美国专利公告第US.Pat.No.6,628,847所揭露的亦为一种利用一个压力传感器在笔头,判别是否有接触书写面,分离字的轨迹和提笔信号。In addition, another example is a writing recognition system disclosed in U.S. Published Patent Application No. US 2006/0088215, which uses a pressure sensor at the front end of the writing tool to determine whether there is contact with the writing surface and separate the trajectory of the word and the pen-lifting signal, and then Then use the acceleration calculation to write the trajectory and add a pressure gauge as a handwriting signal breakpoint detection. Another example is US Pat. No. 6,628,847, which discloses a pressure sensor at the tip of the pen to determine whether there is contact with the writing surface, separate the track of the word and the signal for lifting the pen.
发明内容 Contents of the invention
本发明提供一种书写动作辨识方法,其可检测书写工具于平面书写时所产生的音信,并藉由判断音信的有无得知此时书写工具的状态为处于平面上书写或离开此书写面。The present invention provides a writing action recognition method, which can detect the sound generated by the writing tool when writing on a plane, and determine whether the writing tool is writing on the plane or away from the writing surface by judging whether the sound is present or not. .
本发明提供一种书写轨迹辨识方法及其书写装置与辨识系统,其可利用音信与书写工具的书写轨迹进行对应,以辨识出属于书写状态的轨迹信号,进而针对该轨迹信号进行辨识以产生对应该书写状态时的文字。The present invention provides a writing track identification method and its writing device and identification system, which can use the audio information to correspond to the writing track of the writing tool to identify the track signal belonging to the writing state, and then identify the track signal to generate a pair The text when the state should be written.
本发明提供一种书写装置与辨识系统,其于该书写装置中设置可以收集音信的装置,该系统结合该书写装置以及利用具有书写动作与轨迹辨识方法的处理单元辨以识出对应的文字。The invention provides a writing device and a recognition system. A device capable of collecting audio information is provided in the writing device. The system combines the writing device and a processing unit with a writing action and trajectory recognition method to recognize corresponding characters.
在一实施例中,本发明提供一种书写动作辨识方法,其包括有下列步骤:撷取一书写工具于书写时所产生的一声音信号;以及根据该声音信号,判断该书写工具的状态。In one embodiment, the present invention provides a writing action recognition method, which includes the following steps: capturing a sound signal generated by a writing tool when writing; and judging the state of the writing tool according to the sound signal.
在另一实施例中,本发明更提供一种书写动作辨识方法,其包括有下列步骤:撷取一书写工具于书写时所产生的一声音信号;以及根据该声音信号,判断该书写工具的状态。In another embodiment, the present invention further provides a writing action recognition method, which includes the following steps: extracting a sound signal generated by a writing tool when writing; and judging the sound signal of the writing tool according to the sound signal. state.
在另一实施例中,本发明更提供一种书写轨迹辨识方法,其包括有下列步骤:撷取一书写工具于书写时所产生的一声音信号;撷取该书写工具因动作变化而产生的一连续电子信号;将该声音信号转换成一辨识声音信号,其包括有至少一书写音信;比对该辨识声音信号与该连续电子信号;以及对该连续电子信号中对应该至少一书写音信的位置所具有的信号进行一辨识与组合程序。In another embodiment, the present invention further provides a method for recognizing writing traces, which includes the following steps: extracting a sound signal generated by a writing tool when writing; a continuous electronic signal; converting the sound signal into an identification sound signal including at least one written message; comparing the identification sound signal with the continuous electronic signal; and corresponding to the position of the at least one written message in the continuous electronic signal The possessed signals undergo an identification and combination process.
在另一实施例中,本发明更提供一种书写装置,包括:一书写本体,其可产生一书写动作;一收音装置,其设置于该书写本体上,该收音装置可撷取该书写本体产生书写动作时所产生的声音信号;以及一音信判断单元,其与该收音装置电信连接,该音信判断单元可接收该声音信号并进行处理以产生对应该书写本体状态的一辨识声音信号。In another embodiment, the present invention further provides a writing device, including: a writing body, which can generate a writing action; a sound collecting device, which is arranged on the writing body, and the sound collecting device can pick up the writing body A sound signal generated when writing is generated; and an audio judging unit, which is connected to the sound receiving device by telecommunication, the audio judging unit can receive the audio signal and process it to generate an identification audio signal corresponding to the state of the writing body.
在另一实施例中,本发明更提供一种书写辨识系统,包括:一书写本体,其可产生一书写动作;一收音装置,其设置于该书写本体上,该收音装置可撷取该书写本体产生书写动作时所产生的声音信号;一音信判断单元,其与该收音装置电信连接,该音信判断单元可接收该声音信号并进行处理以产生对应该书写本体状态的一辨识声音信号;一动作检测单元,其可检测该书写本体的动作以产生一连续电子信号;一轨迹处理单元,其可比对该辨识声音信号与该连续电子信号,以对该连续电子信号中对应至少一书写音信的位置所具有的信号进行辨识与组合;以及一文字辨识单元,其可根据该辨识与组合的结果,而产生对应的书写内容。In another embodiment, the present invention further provides a writing recognition system, including: a writing body, which can generate a writing action; a sound receiving device, which is arranged on the writing body, and the sound receiving device can capture the writing A sound signal generated when the main body produces a writing action; an audio judging unit, which is connected to the sound receiving device by telecommunication, and the audio judging unit can receive the audio signal and process it to generate an identification audio signal corresponding to the state of the writing body; A motion detection unit, which can detect the motion of the writing body to generate a continuous electronic signal; a trajectory processing unit, which can compare the recognition sound signal with the continuous electronic signal, and in order to correspond to at least one writing audio in the continuous electronic signal Identifying and combining the signals of the position; and a character recognition unit, which can generate corresponding written content according to the result of the identification and combination.
附图说明 Description of drawings
图1A为本发明的书写动作辨识方法实施例流程示意图;FIG. 1A is a schematic flow chart of an embodiment of the writing action recognition method of the present invention;
图1B为本发明的判断该书写工具的状态实施例流程示意图;Fig. 1B is a schematic flow chart of an embodiment of judging the state of the writing instrument of the present invention;
图2A为初始量测到的声音信号示意图;2A is a schematic diagram of an initially measured sound signal;
图2B为经过处理后的声音信号示意图;Fig. 2B is a schematic diagram of the processed sound signal;
图3为本发明的书写动作辨识方法另一实施例流程示意图;FIG. 3 is a schematic flow chart of another embodiment of the writing action recognition method of the present invention;
图4为本发明的书写轨迹辨识方法实施例流程示意图;FIG. 4 is a schematic flow chart of an embodiment of the method for recognizing writing traces in the present invention;
图5为本发明的辨识组合程序流程示意图;Fig. 5 is a schematic flow chart of the identification combination program of the present invention;
图6A与图6B为本发明声音信号与连续电子信号比对示意图;Figure 6A and Figure 6B are schematic diagrams of the comparison between the sound signal and the continuous electronic signal of the present invention;
图7A至图7C为辨识文字示意图;7A to 7C are schematic diagrams of character recognition;
图8为具有转折点的文字示意图;Fig. 8 is a text schematic diagram with a turning point;
图9为本发明的书写装置实施例示意图;Fig. 9 is a schematic diagram of an embodiment of the writing device of the present invention;
图10A为本发明的书写辨识系统示意图;10A is a schematic diagram of the writing recognition system of the present invention;
图10B为本发明的轨迹处理单元实施例示意图;FIG. 10B is a schematic diagram of an embodiment of a trajectory processing unit of the present invention;
图11为本发明的书写本体另一实施例示意图。Fig. 11 is a schematic diagram of another embodiment of the writing body of the present invention.
其中附图标记为:Wherein reference sign is:
1-书写动作辨识方法1-Writing Action Recognition Method
10~11-步骤10~11-steps
120~121-步骤120~121-steps
2-书写动作辨识方法2-Writing Action Recognition Method
20~23-步骤20~23-steps
3-书写轨迹辨识方法3-Writing track identification method
30~34-步骤30~34-steps
340~342-步骤340~342-steps
4-书写装置4- Writing device
40-书写本体40-Writing Ontology
41-收音装置41-radio device
410、411-麦克风410, 411-Microphone
42-噪声处理单元42 - noise processing unit
421-音波指向控制单元421-Sonic Directional Control Unit
43-音信判断单元43-Message judging unit
5-书写辨识系统5- Writing recognition system
50-书写本体50-writing ontology
51-收音装置51 - radio device
510、511-麦克风510, 511-Microphone
52-噪声处理单元52 - noise processing unit
53-音信判断单元53-Message judging unit
54-动作检测单元54-Motion detection unit
55-轨迹处理单元55- Trajectory processing unit
550-信号分割运算单元550-signal division operation unit
551-轨迹运算单元551-Track computing unit
56-文字辨识单元56-Text Recognition Unit
90-门坎值90-threshold value
91、910、911、912-声音信号91, 910, 911, 912 - sound signal
913-转折点913 - turning point
92-连续电子信号92 - Continuous electronic signal
920、921、922-加速度感测信号920, 921, 922-acceleration sensing signal
924-区域924-area
925-轨迹信号925-track signal
926-动作信号926-action signal
927、928-区域927, 928-area
9270~9273-轨迹9270~9273-track
9280~9282-相对位置9280~9282-relative position
93-区域93-area
94-轨迹94-track
95-轨迹方向95-track direction
具体实施方式 Detailed ways
为进一步的认知与了解本发明的特征、目的及功能,下文特将本发明的装置的相关细部结构以及设计的理念原由进行说明,详细陈述如下:In order to further recognize and understand the features, purposes and functions of the present invention, the relevant detailed structure and design concept of the device of the present invention will be described below in detail as follows:
请参阅图1A所示,该图为本发明的书写动作辨识方法实施例流程示意图。在本实施例中,该方法1包括有步骤10,撷取一书写工具于书写时所产生的一声音信号。在本步骤中,该书写工具可以是笔或者是可供使用者手持的工具,甚至为使用者的手指等,但不以此为限。当该书写工具在书写的时候,因为摩擦之故,会产生该声音,因此可利用收音的装置或组件来收取书写时所产生的声音信号。至于在步骤10中撷取声音的方法有很多种方式,可将收音器设置在书写装置上或者是书写板上,甚至利用外部的收音器来收取音信都可以,并无特定的限制。接着进行步骤12,根据该声音信号,判断该书写工具的状态。请参阅图2A所示,该图为声音信号示意图。由于收集到的声音信号基本上会涵盖到书写工具正在书写时因为摩擦所产生的音信,以及也会包括书写工具移动时所产生的声音,因此在本步骤中可以透过信号处理的方式以区隔出书写时所产生的音信以及非书写时(书写工具移动)所产生的音信。Please refer to FIG. 1A , which is a schematic flowchart of an embodiment of the writing action recognition method of the present invention. In this embodiment, the
如图1B所示,该图为本发明的判断该书写工具的状态实施例流程示意图。首先进行步骤120,先设定一门坎值。该门坎值的大小,可根据实际的状况而定,并无一定的限制。请配合参阅图2A所示,可以了解门坎值90所代表的意义,亦即在该门坎值90范围内所涵盖的信号将会被视为非书写时的音信。再回到图1B所示,接着进行步骤121,当该声音信号超过该门坎值时,则判断该书写工具处于书写状态,如果该声音信号小于该门坎值的话,则判断该书写工具处于移动状态。进行完步骤121之后,图2A的信号,便可形成如图2B所示,仅剩下被判断出书写工具于书写时的声音信号。As shown in FIG. 1B , this figure is a schematic flow chart of an embodiment of judging the state of the writing instrument according to the present invention. First,
请参阅图3所示,该图为本发明的书写动作辨识方法另一实施例流程示意图。在本实施例中,该方法2包括有步骤20,撷取一书写工具于书写时所产生的一声音信号。然后进行步骤21,利用波束成型(beamforming)的方法,将收音方向导向至书写时声音的产生方向以形成一强化声音信号。由于在书写的时候,虽然会有因书写工具与平面摩擦所产生的声音,但是因为外在环境中仍然会有其它声音的干扰。因此在本实施例中,可利用波束成型的方式,将声音接收的方向导向至书写时声音产生的方向,以减少后续判断所产生的误差,增加判断的精准度。至于波束成型的方法,其主要是将数组收音装置所收到的声音信号经过数字转换以及加权运算的方式声音信号进行运算处理以得到一可调整收音波束方向的输出结果。波束成型的方式属于现有技术,其是可用于声波、雷达波等信号处理,在此不作赘述。接着进行步骤22,对该强化声音信号进行一滤除噪声的步骤。在本步骤中,为了降低噪声的干扰,该强化声音信号更可以藉由带通滤波器的处理,以将不必要的噪声滤除。随后,进行步骤23,根据该声音信号,判断该书写工具的状态。该状态包括有书写状态或者是非书写的移动。步骤23的程序如同前述的步骤12所述,在此不作赘述。Please refer to FIG. 3 , which is a schematic flowchart of another embodiment of the writing action recognition method of the present invention. In this embodiment, the
请参阅图4所示,该图为本发明的书写轨迹辨识方法实施例流程示意图。在本实施例中,主要是结合前述的书写动作辨识方法与书写装置的书写轨迹辨识以判断出书写的文字。该方法3包括有下列步骤,首先进行步骤30,撷取一书写工具于书写时所产生的一声音信号。本步骤如前述的步骤10所述,在此不作赘述。接着进行步骤31,撷取该书写装置因动作变化而产生的一连续电子信号。由于步骤30中的声音信号仅能作为有无书写时的依据,因此需要藉由步骤31来感测书写装置在书写时的移动状态以利后续进行文字辨识的程序。Please refer to FIG. 4 , which is a schematic flowchart of an embodiment of the method for identifying writing traces of the present invention. In this embodiment, the written characters are mainly determined by combining the above-mentioned writing action recognition method with the writing track recognition of the writing device. The method 3 includes the following steps. First, step 30 is performed to capture a sound signal generated by a writing instrument when writing. This step is as described in
步骤31中,感测书写装置的动作变化可以藉由很多方式,例如:在书写装置内设置陀螺仪或加速度传感器的惯性感测组件或者是设置影像感测装置(CCD),甚至是利用红外线或超音波等现有技术皆可感测该书写装置的动作变化。接下来进行步骤32,将该声音信号转换成一辨识声音信号,其包括有至少一书写音信。由于在步骤30中所取得的声音信号,含有书写装置在书写时的音信以及书写装置在移动中的音信,甚至含有外部环境的干扰音信或者是噪声等。因此,在步骤32中,与前述的步骤21至23相同,可以利用前述图2中的步骤21以及22所提到的方式利用波束整型以滤除噪声的程序先对声音信号进行处理,然后再进行步骤23,根据该声音信号,判断该书写工具的状态。该状态包括有书写状态或者是非书写的移动状态。经过步骤32的结果可以参阅图2B所示的信号状态。In step 31, there are many ways to sense the movement change of the writing device, for example: setting a gyroscope or an inertial sensing component of an acceleration sensor in the writing device or setting an image sensing device (CCD), or even using infrared rays or Existing technologies such as ultrasound can sense the movement changes of the writing device. Then proceed to step 32, converting the audio signal into an identification audio signal, which includes at least one written audio message. Because the sound signal obtained in step 30 includes the audio information of the writing device when it is writing, the audio signal of the writing device while it is moving, and even the interference information or noise of the external environment. Therefore, in step 32, the same as the aforementioned steps 21 to 23, the sound signal can be processed first by using the beamforming procedure mentioned in
步骤32后,接着进行步骤33比对该辨识声音信号与该连续电子信号。由于该声音信号与该连续电子信号的时间是一致的,因此当在步骤32中确定了书写状态发生的声音信号的后,便可与该连续电子信号进行比对,以确定出在该连续电子信号中哪一段的电子信号是属于书写时所感测到的电子信号。请参阅图6A与图6B所示,该图为本发明声音信号与连续电子信号比对示意图。在图6A中,该声音信号91可以区别具有书写时的声音信号910以及非书写时的声音信号911。而该连续电子信号92主要是由3轴的加速度感测信号920、921与922所组成,但不以此为限。当该声音信号91与该连续电子信号92进行比对时,非书写时的声音信号911所对应到的区域93内的连续电子信号即被判断成无意义的电子信号。反的,书写时的声音信号910所对应到的连续电子信号92则属于有意义的电子信号。当步骤33比对完毕的后,则形成如图6B的状态。After step 32, proceed to step 33 to compare the identified sound signal with the continuous electronic signal. Because the sound signal is consistent with the time of the continuous electronic signal, after determining the sound signal of the writing state in step 32, it can be compared with the continuous electronic signal to determine the time of the continuous electronic signal. Which segment of the electronic signal in the signal belongs to the electronic signal sensed during writing. Please refer to FIG. 6A and FIG. 6B , which are schematic diagrams of the comparison between the sound signal and the continuous electronic signal according to the present invention. In FIG. 6A , the
再回到图4所示,接着进行步骤34,对该连续电子信号中对应该至少一书写音信的位置所具有的信号进行一辨识与组合程序。步骤34中所谓的对该连续电子信号中对应该至少一书写音信的位置所具有的信号即为图6B中的区域924所涵盖的连续电子信号。如图5所示,该图为本发明的辨识组合程序流程示意图。首先进行步骤340,将该连续电子信号分成一轨迹信号以及一动作信号,其中该轨迹信号对应该至少一书写音信的位置所具有的信号,该动作信号为对应非书写音信的位置。如图6A所示,连续电子信号92为利用加速度传感器所感测到的电子信号,经过分割之后,其结果如图7A与7B所示。其中图7A中,显示该连续电子信号对应到书写声音信号910的轨迹信号925,而图7B则显示该连续电子信号对应到非书写声音信号911的动作信号926。Returning to FIG. 4 , proceed to step 34 , performing an identification and combination procedure on the signal corresponding to the position of at least one written audio message in the continuous electronic signal. The so-called signal in the continuous electronic signal corresponding to the position of the at least one written audio message in
再回到图5所示,进行步骤341,根据该轨迹信号决定出至少一书写轨迹。在步骤341中,如图7A所示,对于轨迹信号925进行轨迹还原的步骤,以了解每一个对应书写声音信号的电子信号所代表的轨迹与方向为何,还原结果如区域927内所示的轨迹9270至9273。接着可以进行图5所示的步骤342,根据该动作信号决定该至少一书写轨迹间的相对位置。如图7B所示,对于动作信号926进行轨迹还原的步骤,以了解相邻的书写轨迹间的动作轨迹,进而判断出相邻书写轨迹间的相对位置。例如在图7B中,动作信号9260代表其前后的书写轨迹间手移动产生的惯性信号,因此根据该信号可以定出移动的方向与距离,进而了解出相邻书写轨迹间的相对位置与距离。在图7B中的区域928中所代表根据步骤342所决定出的相对位置9280至9282。Referring back to FIG. 5 , proceed to step 341 , and determine at least one writing track according to the track signal. In
再回到图5所示,接着进行步骤343,将该至少一书写轨迹以及其所对应的相对位置进行组合。本步骤主要是利用图7A与图7B中决定的轨迹9270至9273与相对位置9280至9282,根据时间的先后进行组合而得到如图7C的图案。由于该图案在尚未辨识前并无任何文字意义,因此需要藉由图5的步骤344,根据步骤343组合的结果进行文字辨识,并将辨识的结果显示于屏幕上。Referring back to FIG. 5 ,
例如图7A与图7B所示,该图为辨识文字示意图。当利用步骤341可以得到如图7A所示的对应每一段书写声音信号的轨迹94以及轨迹方向95。然后利用步骤342图7A中所辨识的轨迹94组合成如图7C的图案。并经由步骤344辨识出该图案为中文的”王”字。此外,由于在书写的过程中可能具有书写转折的现象,例如图8所示,在书写文字”2”的时候在位置913的地方会具有一转折点,因此利用本发明的声音信号亦可以辅助判断该转折点发生的位置,以利后续进行文字判断之用。如图6B中,声音信号中标号912的位置,即是代表书写时有转折点产生。For example, as shown in FIG. 7A and FIG. 7B , the figure is a schematic diagram of character recognition. When
请参阅图9所示,该图为本发明的书写装置实施例示意图。在本实施例中,该书写装置4具有一书写本体40、一收音装置41、一噪声处理单元42以及一音信判断单元43。该书写本体40,其可产生一书写动作。在本实施例中,该书写本体40成笔的型态,以利使用者握持。在另一实施例中,如图11所示,该书写本体40成一套筒状,以提供容置使用者的手指。在图11的实施例中,使用者可直接利用该套筒状的书写本体40直接于书写板上书写。该收音装置41,其设置于该书写本体40上,该收音装置41可撷取该书写本体40于书写动作时所产生的声音信号。该收音装置41可由至少一收音组件(如:麦克风或指向性麦克风)所构成。在本实施例中,该收音装置由多个收音麦克风410与411所构成。该多个收音麦克风可成数组式排列设置于该书写本体40上。Please refer to FIG. 9 , which is a schematic diagram of an embodiment of the writing device of the present invention. In this embodiment, the writing device 4 has a writing
该收音装置41更与一噪声处理单元42相连接,该噪声处理单元42可以接收该收音装置41所产生的声音信号,并滤除该声音信号的噪声。此外,在该噪声处理单元42中更具有一音波指向控制单元421,其具有波束成型(beamforming)的演算机制,可将收音装置41的收音方向导向至书写声音发生的方向。至于波束整型的演算机制属于现有技术,在此不作赘述。该音信判断单元43,其与该噪声处理单元42作电信连接,该音信判断单元43可接收经过噪声处理的声音信号并进行处理以产生对应该书写工具状态的一辨识声音信号。该音信判断单元43主要是藉由图1A中的步骤12或图3中的步骤23的程序以将该声音信号处理成如图2B所示的辨识声音信号。本实施例中的噪声处理单元42,可根据需要而设置,虽然在图9中教导了噪声处理单元42连接于该收音装置41与该音信处理单元43之间,但亦可将该收音装置41直接与该音信处理单元43连接。The
请参阅图10A所示,该图为本发明的书写辨识系统示意图。该书写辨识系统5具有一书写本体50、一收音装置51、一噪声处理单元52、一音信判断单元53、一动作检测单元54、一轨迹处理单元55以及一文字辨识单元56。该书写本体50,在本实施例中为一笔状元件以提供使用者握持在书写板上书写。当然,该书写本体50亦可如图11所示的结构。该收音装置51,其具有多个设置于该书写本体上的收音组件510与511,其可成数组排列或者是环状排列于该书写本体50上。该收音组件510与511可选择为指向性麦克风或者是麦克风等组件。该收音装置51可撷取该书写本体50于书写动作时所产生的声音信号。Please refer to FIG. 10A , which is a schematic diagram of the writing recognition system of the present invention. The writing
该噪声处理单元52与该收音装置51电性连接,以对该收音装置51所撷取到的声音信号进行滤除噪声以及声音导向的处理。本实施例中的噪声处理单元52与图9的实施例中的噪声处理单元42功能相同,因此在此不作赘述。该音信判断单元53,与该噪声处理单元52电性连接,该音信判断单元53可接收该声音信号并进行处理以产生对应该书写本体状态的一辨识声音信号(如图2B所示的声音信号)。该动作检测单元54,其可检测该书写本体的动作以产生一连续电子信号。在本实施例中,该动作检测单元54可由惯性感测组件(例如:陀螺仪以及加速度传感器),亦或者是影像感测组件(CCD或CMOS)或者是超音波或红外线传感器等。该动作检测单元54所检测到的连续电子信号可用来还原书写轨迹之用。The
该轨迹处理单元55,其可比对该辨识声音信号与该连续电子信号,以对该连续电子信号中对应至少一书写音信的位置所具有的信号进行辨识与组合。如图10B所示,该图为本发明的轨迹处理单元实施例示意图。在本实施例中,该轨迹处理单元55更具有一信号分割运算单元550以及一轨迹运算单元551。该信号分割运算单元550,其将该辨识声音信号与该连续电子信号比对并将对应该至少一书写音信的该连续电子信号分割成至少一子电子信号(如图6B所示的结果)。该轨迹运算单元551,其将该至少一子电子信号进行组合。该轨迹运算单元551所处理的结果可参考图7A与图7B所示。该轨迹运算单元551将轨迹组合之后,可将组合的结果传输给该文字辨识单元56。一般而言,该文字辨识单元56可设置于一计算机系统6内。该文字辨识单元56,其可根据该辨识与组合的结果,而产生对应的书写内容。例如该轨迹运算单元551将图7A的轨迹组合成图7B的状态后,便将该组合结果传输至该文字辨识单元56,文字辨识单元56在从其所具有的文字数据库中,找出符合的文字,并在该计算机系统6中的显示器显示出来。The
再回到图9所示,该轨迹处理单元55将处理完的信号传输给该文字辨识单元56的方式可利用无线或有线的方式传递。另一方面,虽然本发明的轨迹处理单元55设置在该书写本体50上,但是对于熟悉此项技术的人而言,是可以轻易将其改变而设置于计算机系统6内,并且直接由一音信判断单元53以及动作检测单元54将感测到的信号利用无线或有线的方式传出至该轨迹处理单元55。Referring back to FIG. 9 , the
以上所述,仅为本发明的实施例,当不能以之限制本发明范围。即大凡依本发明权利要求所做的均等变化及修饰,仍将不失本发明的要义所在,亦不脱离本发明的精神和范围,故都应视为本发明的进一步实施状况。The above descriptions are merely examples of the present invention, and should not be used to limit the scope of the present invention. That is, all equivalent changes and modifications made according to the claims of the present invention will still not lose the gist of the present invention, nor depart from the spirit and scope of the present invention, so all should be regarded as further implementation status of the present invention.
综合上述,本发明提供的书写动作与轨迹辨识方法及其书写装置与辨识系统,辨识出书写工具是否处于书写状态,并更进一步辨识出在书写时的书写轨迹,以形成出对应该书写轨迹的文字。因此已经可以提高该产业的竞争力以及带动周遭产业的发展,诚已符合发明专利法所规定申请发明所需具备的要件,故爰依法呈提发明专利的申请。To sum up the above, the writing action and track identification method and its writing device and identification system provided by the present invention can identify whether the writing tool is in the writing state, and further identify the writing track when writing, so as to form a corresponding writing track. Word. Therefore, it has been able to improve the competitiveness of this industry and promote the development of surrounding industries. Sincerely, it has met the requirements required for an invention application as stipulated in the Invention Patent Law, so the application for an invention patent is submitted according to law.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200810100443 CN101604212B (en) | 2008-06-11 | 2008-06-11 | Writing action and trajectory recognition method, writing device and recognition system thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200810100443 CN101604212B (en) | 2008-06-11 | 2008-06-11 | Writing action and trajectory recognition method, writing device and recognition system thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101604212A CN101604212A (en) | 2009-12-16 |
| CN101604212B true CN101604212B (en) | 2013-01-09 |
Family
ID=41469959
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200810100443 Expired - Fee Related CN101604212B (en) | 2008-06-11 | 2008-06-11 | Writing action and trajectory recognition method, writing device and recognition system thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101604212B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9232331B2 (en) * | 2014-05-08 | 2016-01-05 | Microsoft Technology Licensing, Llc | Hand-worn device for surface gesture input |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5517579A (en) * | 1994-02-04 | 1996-05-14 | Baron R & D Ltd. | Handwritting input apparatus for handwritting recognition using more than one sensing technique |
| US6628847B1 (en) * | 1998-02-27 | 2003-09-30 | Carnegie Mellon University | Method and apparatus for recognition of writing, for remote communication, and for user defined input templates |
| CN1627320A (en) * | 2003-12-10 | 2005-06-15 | 明基电通股份有限公司 | Handheld electronic device with track-sensing input |
| CN1936795A (en) * | 2005-09-23 | 2007-03-28 | 英华达(上海)电子有限公司 | Acceleration sensing measurment type handwriting input device and input method |
-
2008
- 2008-06-11 CN CN 200810100443 patent/CN101604212B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5517579A (en) * | 1994-02-04 | 1996-05-14 | Baron R & D Ltd. | Handwritting input apparatus for handwritting recognition using more than one sensing technique |
| US6628847B1 (en) * | 1998-02-27 | 2003-09-30 | Carnegie Mellon University | Method and apparatus for recognition of writing, for remote communication, and for user defined input templates |
| CN1627320A (en) * | 2003-12-10 | 2005-06-15 | 明基电通股份有限公司 | Handheld electronic device with track-sensing input |
| CN1936795A (en) * | 2005-09-23 | 2007-03-28 | 英华达(上海)电子有限公司 | Acceleration sensing measurment type handwriting input device and input method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101604212A (en) | 2009-12-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI374391B (en) | Method for recognizing writing motion and trajectory and apparatus for writing and recognizing system | |
| EP3201743B1 (en) | Method and apparatus for addressing touch discontinuities | |
| US8793621B2 (en) | Method and device to control touchless recognition | |
| EP3198497B1 (en) | Method and apparatus for classifying contacts with a touch sensitive device | |
| TWI457793B (en) | Real-time motion recognition method and inertia sensing and trajectory | |
| CN103257727B (en) | A kind of hand-written inputting method and device | |
| CN102945362B (en) | The sensor synergism gesture identification method merged based on isomeric data and system | |
| KR100630806B1 (en) | Command input method using gesture recognition device | |
| US20070130547A1 (en) | Method and system for touchless user interface control | |
| US20090153499A1 (en) | Touch action recognition system and method | |
| CN101893988B (en) | A mobile communication terminal for handwriting input and its input method | |
| CN104898879A (en) | Method and apparatus for data input | |
| WO2018018624A1 (en) | Gesture input method for wearable device, and wearable device | |
| CN103294226B (en) | A virtual input device and method | |
| CN105975091A (en) | Virtual keyboard human-computer interaction technology based on inertial sensor | |
| Muhammad et al. | Hand gesture user interface for smart devices based on mems sensors | |
| CN101604212B (en) | Writing action and trajectory recognition method, writing device and recognition system thereof | |
| JP2009099041A (en) | Pen-type input device | |
| KR20070060580A (en) | Character recognition device and method using acceleration sensor | |
| Mankar et al. | Review on hand gesture based mobile control application | |
| JP4927009B2 (en) | Handwritten character recognition device | |
| JP3712835B2 (en) | Pen-type input device | |
| CN106886283A (en) | Characters input method, device and system | |
| Wang et al. | Acoustic-based Alphanumeric Input Interface for Earables | |
| KR20040048396A (en) | Information processing apparatus and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130109 Termination date: 20200611 |