CN115963968A - Display method, display system, display device and readable storage medium - Google Patents
Display method, display system, display device and readable storage medium Download PDFInfo
- Publication number
- CN115963968A CN115963968A CN202211714916.4A CN202211714916A CN115963968A CN 115963968 A CN115963968 A CN 115963968A CN 202211714916 A CN202211714916 A CN 202211714916A CN 115963968 A CN115963968 A CN 115963968A
- Authority
- CN
- China
- Prior art keywords
- recognition result
- display
- reading
- read
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
本发明公开了一种显示方法、显示系统、显示设备及可读存储介质。包括如下步骤:采集待阅读图像;对所述待阅读图像进行图像识别,得到识别结果;根据预设排布方式调整所述识别结果,得到目标识别结果,并将调整后的所述目标识别结果在显示设备上显示。本发明能够将带阅读图像通过图像识别后在显示设备中进行显示,利用了显示设备的优势,避免了待阅读图像的不清晰问题,方便老年人或者视力较差的用户能够方便的阅读。
The invention discloses a display method, a display system, a display device and a readable storage medium. The method includes the following steps: collecting an image to be read; performing image recognition on the image to be read to obtain a recognition result; adjusting the recognition result according to a preset arrangement method to obtain a target recognition result, and storing the adjusted target recognition result displayed on the display device. The invention can display the reading image on the display device after image recognition, utilizes the advantages of the display device, avoids the unclear problem of the image to be read, and is convenient for the elderly or users with poor eyesight to read conveniently.
Description
技术领域technical field
本发明涉及智能设备技术领域,尤其涉及一种显示方法、显示系统、显示设备及可读存储介质。The present invention relates to the technical field of smart devices, in particular to a display method, a display system, a display device and a readable storage medium.
背景技术Background technique
目前Android平台智能电视基本普及,随着技术人工智能技术的不断发展,在电视机上也得到的广泛的应用,让电视具有语言识别、图像识别、自然语言处理和专家系统等功能。同时,电视屏幕在显示尺寸也越来越大,在显示效果和显示质量上也越好。而目前,老年人是使用智能电视的一大群体,根据调查显示,52岁以上人群老花眼的发病率接近100%,只有极少数人在50岁以后仍然视力正常。在这当中的一部分老年人有读书看报的习惯,但传统纸质书籍存在字体较小的情况,不利于老年的阅读需求。At present, smart TVs on the Android platform are basically popular. With the continuous development of artificial intelligence technology, it has also been widely used on TVs, allowing TVs to have functions such as language recognition, image recognition, natural language processing and expert systems. At the same time, the display size of TV screens is getting larger and larger, and the display effect and display quality are better. At present, the elderly are a large group of people who use smart TVs. According to the survey, the incidence of presbyopia in people over 52 years old is close to 100%, and only a very small number of people still have normal vision after 50 years old. Some of the elderly have the habit of reading books and newspapers, but traditional paper books have small fonts, which is not conducive to the reading needs of the elderly.
发明内容Contents of the invention
本发明的主要目的在于提供一种显示方法、显示系统、显示设备及可读存储介质。旨在解决传统纸质书籍存在字体较小的情况,不利于老年的阅读需求的问题。The main purpose of the present invention is to provide a display method, a display system, a display device and a readable storage medium. It aims to solve the problem that traditional paper books have small fonts, which is not conducive to the reading needs of the elderly.
为实现上述目的,本发明提供一种显示方法,所述显示方法包括步骤:In order to achieve the above object, the present invention provides a display method, which includes the steps of:
采集待阅读图像;Collect images to be read;
对所述待阅读图像进行图像识别,得到识别结果;performing image recognition on the image to be read to obtain a recognition result;
根据预设排布方式调整所述识别结果,得到目标识别结果,并将调整后的所述目标识别结果在显示设备上显示。The recognition results are adjusted according to a preset arrangement to obtain target recognition results, and the adjusted target recognition results are displayed on a display device.
可选地,所述根据预设排布方式调整所述识别结果,得到目标识别结果的步骤之前,还包括:Optionally, before the step of adjusting the recognition result according to the preset arrangement method and obtaining the target recognition result, it also includes:
根据所述识别结果查找与所述待阅读图像相对应的电子文件版本;Finding an electronic file version corresponding to the image to be read according to the recognition result;
根据所述电子文件版本对所述识别结果进行校正。The recognition result is corrected according to the electronic file version.
可选地,所述显示方法还包括:Optionally, the display method further includes:
监测用户在阅读过程中的眼球运动信息,并得到与所述眼球运动信息相对应的调节命令;Monitor the user's eye movement information during reading, and obtain adjustment commands corresponding to the eye movement information;
根据所述调节命令,调节所述显示设备上的目标识别结果。According to the adjustment command, the target recognition result on the display device is adjusted.
可选地,所述监测用户在阅读过程中的眼球运动信息,并得到与所述眼球运动信息相对应的调节命令的步骤包括:Optionally, the step of monitoring eye movement information of the user during reading and obtaining an adjustment command corresponding to the eye movement information includes:
监测用户在阅读过程中的眼球运动信息;Monitor the user's eye movement information during the reading process;
根据所述眼球运动信息,确定用户在所述目标识别结果上的阅读位置;determining the user's reading position on the target recognition result according to the eye movement information;
根据所述阅读位置,确定用户在所述目标识别结果的排版方向上的阅读方向,并统计所述阅读方向由排版方向变化为目标方向的变化次数;According to the reading position, determine the reading direction of the user in the typesetting direction of the target recognition result, and count the number of changes in the reading direction from the typesetting direction to the target direction;
在所述变化次数达到当前显示页面的次数阈值时,生成与所述眼球运动信息相对应的调节命令,所述调节命令包括翻页命令。When the number of times of change reaches the number threshold of the currently displayed page, an adjustment command corresponding to the eye movement information is generated, where the adjustment command includes a page turning command.
可选地,所述统计所述阅读方向由排版方向变化为目标方向的变化次数的步骤之后,还包括:Optionally, after the step of counting the number of changes in the reading direction from the typesetting direction to the target direction, it may further include:
根据所述阅读位置和所述阅读方向,对已阅读过的文字进行标记。Mark the text that has been read according to the reading position and the reading direction.
可选地,所述根据所述眼球运动信息,确定用户在所述目标识别结果上的阅读位置的步骤之后,还包括:Optionally, after the step of determining the user's reading position on the target recognition result according to the eye movement information, the method further includes:
检测所述用户在所述阅读位置上的停留时长;Detecting the length of stay of the user at the reading position;
在所述停留时长超过预设时长时,对与所述阅读位置相对应的文字进行搜索,并显示所述搜索结果。When the staying time exceeds the preset time, the text corresponding to the reading position is searched, and the search result is displayed.
此外,为实现上述目的,本发明还提供一种显示系统,所述显示系统包括:In addition, in order to achieve the above object, the present invention also provides a display system, which includes:
终端设备,用于采集待阅读图像;A terminal device for collecting images to be read;
云端服务器,用于对所述待阅读图像进行图像识别,得到识别结果;The cloud server is used to perform image recognition on the image to be read to obtain a recognition result;
显示设备,用于根据预设排布方式调整所述识别结果,得到目标识别结果,并将调整后的所述目标识别结果在显示设备上显示。A display device, configured to adjust the recognition results according to a preset arrangement, obtain target recognition results, and display the adjusted target recognition results on the display device.
可选地,所述显示设备中包括:Optionally, the display device includes:
重排模块,用于根据预设排布方式,调整所述识别结果,得到目标识别结果;a rearrangement module, configured to adjust the recognition result according to a preset arrangement mode, and obtain a target recognition result;
显示模块,用于接收所述重排模块发送的所述目标识别结果,并将调整后的所述目标识别结果在显示设备上显示。The display module is configured to receive the target recognition result sent by the rearrangement module, and display the adjusted target recognition result on a display device.
此外,为实现上述目的,本发明还提供一种显示设备,所述显示设备包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的显示程序,所述显示程序被所述处理器执行时实现如上所述的显示方法的步骤。In addition, in order to achieve the above object, the present invention also provides a display device, which includes: a memory, a processor, and a display program stored in the memory and operable on the processor, the display program When executed by the processor, the steps of the above-mentioned display method are realized.
此外,为实现上述目的,本发明还提供一种计算机可读存储介质,所述计算机可读存储介质上存储有显示程序,所述显示程序被处理器执行时实现如上所述的显示方法的步骤。In addition, in order to achieve the above object, the present invention also provides a computer-readable storage medium, on which a display program is stored, and when the display program is executed by a processor, the steps of the above-mentioned display method are realized. .
本发明提出一种显示方法、显示系统、显示设备及可读存储介质,所述显示方法包括步骤:采集待阅读图像;对所述待阅读图像进行图像识别,得到识别结果;根据预设排布方式调整所述识别结果,得到目标识别结果,并将调整后的所述目标识别结果在显示设备上显示。通过上述方法,能够将待阅读图像中的文字在显示设备上重新排布,进行显示,能够利用显示设备的大屏幕优势,以及对识别结果的调整优势,使得用户能够使用更加符合自己阅读习惯的排布方式来进行阅读,同时避免了待阅读图像的文字过小而导致的无法看清文字的问题,方便老年人或者视力较差的用户能够方便的阅读纸质书籍。The present invention proposes a display method, a display system, a display device, and a readable storage medium. The display method includes the steps of: collecting an image to be read; performing image recognition on the image to be read to obtain a recognition result; arranging according to a preset The recognition result is adjusted in a manner to obtain a target recognition result, and the adjusted target recognition result is displayed on a display device. Through the above method, the text in the image to be read can be rearranged and displayed on the display device, and the advantage of the large screen of the display device and the adjustment of the recognition result can be used to enable users to use text that is more in line with their own reading habits. Arrangement for reading, while avoiding the problem that the text of the image to be read is too small and cannot read the text, so that the elderly or users with poor vision can conveniently read paper books.
附图说明Description of drawings
图1是本发明实施例方案涉及的硬件运行环境的装置结构示意图;Fig. 1 is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present invention;
图2是本发明显示方法中一实施例的流程示意图;Fig. 2 is a schematic flow chart of an embodiment of the display method of the present invention;
图3是本发明显示方法中一实施例中步骤S20之后的细化流程示意图;Fig. 3 is a schematic diagram of a refined flow after step S20 in an embodiment of the display method of the present invention;
图4是本发明显示方法中二实施例的流程示意图;Fig. 4 is a schematic flow chart of the second embodiment of the display method of the present invention;
图5是本发明显示系统的框架结构示意图;Fig. 5 is a schematic diagram of the frame structure of the display system of the present invention;
本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization of the purpose of the present invention, functional characteristics and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings.
具体实施方式Detailed ways
为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.
如图1所示,图1是本发明实施例方案涉及的硬件运行环境的终端结构示意图。As shown in FIG. 1 , FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment involved in the solution of the embodiment of the present invention.
本发明实施例终端为显示设备。The terminal in this embodiment of the present invention is a display device.
如图1所示,该终端可以包括:处理器1001,例如CPU,通信总线1002,用户接口1003,DVI接口1004,USB接口1005,存储器1006。其中,通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard),可选的用户接口1003还可以包括标准的有线接口、无线接口。DVI接口1004可选的可以包括标准的有线接口,通过DVI线与其他外部设备连接。USB接口1005可选的可以包括标准的有线接口,通过USB连接线与其他外部设备连接。存储器1006可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器。存储器1006可选的还可以是独立于前述处理器1001的存储装置。As shown in FIG. 1 , the terminal may include: a
可选地,终端还可以包括音频电路等等,在此不再赘述。Optionally, the terminal may further include an audio circuit, etc., which will not be described in detail here.
本领域技术人员可以理解,图1中示出的终端结构并不构成对终端的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Those skilled in the art can understand that the terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or less components than those shown in the figure, or combine some components, or arrange different components.
如图1所示,作为一种计算机存储介质的存储器1006中可以包括操作系统、DVI接口模块、USB接口模块、用户接口模块以及显示程序。As shown in FIG. 1 , the
在图1所示的终端中,DVI接口1004主要用于连接外部设备,与外部设备进行数据通信;USB接口1005主要用于连接外部设备,与外部设备进行数据通信;用户接口1003主要用于连接客户端,与客户端进行数据通信;而处理器1001可以用于调用存储器1006中存储的显示程序,并执行以下操作:In the terminal shown in Figure 1, the
采集待阅读图像;Collect images to be read;
对所述待阅读图像进行图像识别,得到识别结果;performing image recognition on the image to be read to obtain a recognition result;
根据预设排布方式调整所述识别结果,得到目标识别结果,并将调整后的所述目标识别结果在显示设备上显示。The recognition results are adjusted according to a preset arrangement to obtain target recognition results, and the adjusted target recognition results are displayed on a display device.
进一步地,处理器1001可以调用存储器1006中存储的显示程序,还执行以下操作:Further, the
根据所述识别结果查找与所述待阅读图像相对应的电子文件版本;Finding an electronic file version corresponding to the image to be read according to the recognition result;
根据所述电子文件版本对所述识别结果进行校正。The recognition result is corrected according to the electronic file version.
进一步地,处理器1001可以调用存储器1006中存储的显示程序,还执行以下操作:Further, the
监测用户在阅读过程中的眼球运动信息,并得到与所述眼球运动信息相对应的调节命令;Monitor the user's eye movement information during reading, and obtain adjustment commands corresponding to the eye movement information;
根据所述调节命令,调节所述显示设备上的目标识别结果。According to the adjustment command, the target recognition result on the display device is adjusted.
进一步地,处理器1001可以调用存储器1006中存储的显示程序,还执行以下操作:Further, the
监测用户在阅读过程中的眼球运动信息;Monitor the user's eye movement information during the reading process;
根据所述眼球运动信息,确定用户在所述目标识别结果上的阅读位置;determining the user's reading position on the target recognition result according to the eye movement information;
根据所述阅读位置,确定用户在所述目标识别结果的排版方向上的阅读方向,并统计所述阅读方向由排版方向变化为目标方向的变化次数;According to the reading position, determine the reading direction of the user in the typesetting direction of the target recognition result, and count the number of changes in the reading direction from the typesetting direction to the target direction;
在所述变化次数达到当前显示页面的次数阈值时,生成与所述眼球运动信息相对应的调节命令,所述调节命令包括翻页命令。When the number of times of change reaches the number threshold of the currently displayed page, an adjustment command corresponding to the eye movement information is generated, where the adjustment command includes a page turning command.
进一步地,处理器1001可以调用存储器1006中存储的显示程序,还执行以下操作:Further, the
根据所述阅读位置和所述阅读方向,对已阅读过的文字进行标记。Mark the text that has been read according to the reading position and the reading direction.
进一步地,处理器1001可以调用存储器1006中存储的显示程序,还执行以下操作:Further, the
检测所述用户在所述阅读位置上的停留时长;Detecting the length of stay of the user at the reading position;
在所述停留时长超过预设时长时,对与所述阅读位置相对应的文字进行搜索,并显示所述搜索结果。When the staying time exceeds the preset time, the text corresponding to the reading position is searched, and the search result is displayed.
本发明显示设备的具体实施例与下述显示程序各实施例基本相同,在此不作赘述。The specific embodiments of the display device of the present invention are basically the same as the following embodiments of the display program, and will not be repeated here.
目前Android平台智能电视基本普及,随着技术人工智能技术的不断发展,在电视机上也得到的广泛的应用,让电视具有语言识别、图像识别、自然语言处理和专家系统等功能。同时,电视屏幕在显示尺寸也越来越大,在显示效果和显示质量上也越好。而目前,老年人是使用智能电视的一大群体,根据调查显示,52岁以上人群老花眼的发病率接近100%,只有极少数人在50岁以后仍然视力正常。在这当中的一部分老年人有读书看报的习惯,但传统纸质书籍存在字体较小的情况,不利于老年的阅读需求。At present, smart TVs on the Android platform are basically popular. With the continuous development of artificial intelligence technology, it has also been widely used on TVs, allowing TVs to have functions such as language recognition, image recognition, natural language processing and expert systems. At the same time, the display size of TV screens is getting larger and larger, and the display effect and display quality are better. At present, the elderly are a large group of people who use smart TVs. According to the survey, the incidence of presbyopia in people over 52 years old is close to 100%, and only a very small number of people still have normal vision after 50 years old. Some of the elderly have the habit of reading books and newspapers, but traditional paper books have small fonts, which is not conducive to the reading needs of the elderly.
为解决上述问题,本发明提出一种显示方法,具体的,请参阅下述实施例。In order to solve the above problems, the present invention proposes a display method. For details, please refer to the following embodiments.
请参阅图2,图2为本发明显示方法第一实施例的流程示意图,本实施例提供的显示方法包括如下步骤:Please refer to FIG. 2. FIG. 2 is a schematic flow chart of the first embodiment of the display method of the present invention. The display method provided in this embodiment includes the following steps:
步骤S10,采集待阅读图像;Step S10, collecting images to be read;
待阅读图像为通过摄像设备采集的包含文字或者图片信息的图像,例如报纸图像、杂志图像、书籍图像等。其中,摄像设备可以是手机、平板电脑等智能电子设备,也可以是相机等可以进行拍摄的电子设备,本发明在此不作限制。为方便理解,在后续实施例中均采用手机进行叙述。The image to be read is an image including text or picture information captured by a camera device, such as a newspaper image, a magazine image, a book image, and the like. Wherein, the imaging device may be a smart electronic device such as a mobile phone or a tablet computer, or may be an electronic device capable of taking pictures such as a camera, and the present invention is not limited here. For the convenience of understanding, mobile phones are used for description in the subsequent embodiments.
步骤S20,对所述待阅读图像进行图像识别,得到识别结果;Step S20, performing image recognition on the image to be read to obtain a recognition result;
识别结果包括待阅读图像中的文字、图片和超链接等。图像识别可以为OCR识别,OCR(Optical Character Recognition,光学字符识别)是指手机检查纸上打印的字符,通过检测暗、亮的模式确定其形状,然后用字符识别方法将形状翻译成计算机文字的过程。The recognition results include text, pictures and hyperlinks in the image to be read. Image recognition can be OCR recognition. OCR (Optical Character Recognition, Optical Character Recognition) refers to the mobile phone checking the characters printed on the paper, determining its shape by detecting dark and bright patterns, and then using the character recognition method to translate the shape into computer text. process.
图像识别的过程可以在云端服务器中进行,具体的,在手机采集到待阅读图像之后,手机将待阅读图像发送至云端服务器,云端服务器通过OCR将待阅读图像中的文字和图像等信息识别出来,生成识别结果。另外,在对所述阅读图像进行图像识别之前,还可以对待阅读图像进行灰度处理,以增强待阅读图像的对比度,使得待阅读图像中的文字部分和背景部分的显示差异更加明显,从而使得OCR得到的识别结果更加准确。The process of image recognition can be carried out in the cloud server. Specifically, after the mobile phone collects the image to be read, the mobile phone sends the image to be read to the cloud server, and the cloud server recognizes the text and image information in the image to be read through OCR , to generate recognition results. In addition, before image recognition is performed on the image to be read, the image to be read can also be grayscale processed to enhance the contrast of the image to be read, so that the display difference between the text part and the background part in the image to be read is more obvious, so that The recognition result obtained by OCR is more accurate.
在一实施例中,所述步骤S20之后,还包括:In one embodiment, after the step S20, it also includes:
步骤S201,根据所述识别结果查找与所述待阅读图像相对应的电子文件版本;Step S201, searching for the version of the electronic file corresponding to the image to be read according to the recognition result;
步骤S202,根据所述电子文件版本对所述识别结果进行校正。Step S202, correcting the recognition result according to the electronic file version.
在本实施中,由于通过OCR识别得到的识别结果可能与待阅读图像上的文字信息存在误差,为了避免影响阅读,需要对识别结果进行校正。In this implementation, since the recognition result obtained through OCR recognition may have errors with the text information on the image to be read, in order to avoid affecting reading, the recognition result needs to be corrected.
具体的,当待阅读图像是报纸图像、杂志图像或者书籍图像时,可能会存在与待阅读图像相对应的电子文件版本,例如,当待阅读图像时报纸图像时,报社则会发出与该报纸的内容一致的电子文件版本,当待阅读图像是杂志和书籍时,出版社则会发布对应的电子版本。而在云端服务器识别到识别结果后,根据识别结果进行联网搜索,得到与识别结果相对应的电子文件版本,再在电子文件版本中定位到与识别结果相对应的区域,然后将识别结果与该区域的文字进行比对,判断是否一致,若两者一致,则说明OCR识别到的识别结果是正确的,无需进行校正;若两者部分不一致,则说明OCR识别到的识别结果是有误的,则通过电子文件版本对识别结果进行校正,或者直Specifically, when the image to be read is a newspaper image, a magazine image or a book image, there may be an electronic file version corresponding to the image to be read, for example, when the image to be read is a newspaper image, the newspaper office will issue a The electronic file version with the same content, when the images to be read are magazines and books, the publisher will release the corresponding electronic version. After the cloud server recognizes the recognition result, it searches online according to the recognition result to obtain the electronic file version corresponding to the recognition result, and then locates the area corresponding to the recognition result in the electronic file version, and then compares the recognition result with the Compare the text in the area to determine whether they are consistent. If the two are consistent, it means that the recognition result recognized by OCR is correct and no correction is required; if the two parts are inconsistent, it means that the recognition result recognized by OCR is wrong. , correct the recognition results through the electronic file version, or directly
接将识别结果替换为电子文件版本,以保证识别结果的正确性,不影响用户5进行阅读。Then replace the recognition result with the electronic file version to ensure the correctness of the recognition result and not affect the reading by the user 5 .
步骤S30,根据预设排布方式调整所述识别结果,得到目标识别结果,并将调整后的所述目标识别结果在显示设备上显示。Step S30 , adjusting the recognition results according to a preset arrangement to obtain a target recognition result, and displaying the adjusted target recognition result on a display device.
在本实施例中,目标识别结果即为对识别结果进行调整之后的文字和图In this embodiment, the target recognition result is the text and picture after the recognition result is adjusted.
片信息;所述显示设备优选为电视机,当然本领域技术人员还可以选择则其0他显示设备进行显示,例如,电脑、手机、平板等,本发明在此不作限制。The display device is preferably a TV, and of course those skilled in the art can also select other display devices for display, such as computers, mobile phones, tablets, etc., and the present invention is not limited here.
在得到识别结果后,由于需要将识别结果在电视上进行显示,而电视的尺寸与报纸的排版方式可能不相同,因此,可以对识别结果按照预设排布方式进行重新调整之后,再在电视上进行显示。其中,预设排布方式包括排版After the recognition results are obtained, the recognition results need to be displayed on the TV, and the size of the TV may be different from the layout of the newspaper. displayed on the Among them, the preset layout method includes typesetting
方式、字体颜色、背景颜色和字体大小,用户可以根据自己的阅读方式对预5设排布方式进行调节,例如,用户喜爱的排版方式是从左到右、字体颜色是method, font color, background color and font size, users can adjust the preset layout method according to their own reading style, for example, the user's favorite typesetting method is from left to right, and the font color is
黑色、背景颜色是白色、字体大小是5号字体,则可直接在电视上进行设置,以使电视以该预设排布方式进行显示。Black, the background color is white, and the font size is font size 5, you can directly set it on the TV so that the TV will display it in this preset arrangement.
在另一实施例中,所述步骤S30之前,还包括:In another embodiment, before the step S30, it also includes:
步骤A301,采集用户信息,并获取与所述用户信息相对应的预设排布方0式。Step A301, collecting user information, and obtaining a preset arrangement mode corresponding to the user information.
在本实施例中,为了避免用户在每一次阅读之前都需要进行排布方式的调整,因此在对识别结果进行调整之前,可以采集用户信息,根据用户信息调用预设排布方式。In this embodiment, in order to prevent the user from needing to adjust the layout before each reading, user information can be collected before adjusting the recognition result, and the preset layout can be invoked according to the user information.
具体的,可以通过设置在电视上的摄像头获取用户的面部信息,在用户5第一次进行排布方式的调节时,将面部信息与排布方式进行存储,以使在后Specifically, the facial information of the user can be obtained through a camera installed on the TV, and when the user 5 adjusts the layout for the first time, the facial information and the layout are stored, so that later
续调整过程中可以直接通过用户的面部信息调用对应的预设排布方式,避免用户进行反复调节,提高阅读过程中的体验感。During the continuous adjustment process, the corresponding preset arrangement method can be called directly through the user's facial information, avoiding repeated adjustments by the user, and improving the experience in the reading process.
本发明提出一种显示方法,所述显示方法包括步骤:采集待阅读图像;The present invention proposes a display method, which includes the steps of: collecting images to be read;
对所述待阅读图像进行图像识别,得到识别结果;根据预设排布方式调整所0述识别结果,得到目标识别结果,并将调整后的所述目标识别结果在显示设备上显示。通过上述方法,能够将待阅读图像中的文字在显示设备上重新排布,进行显示,能够利用显示设备的大屏幕优势,以及对识别结果的调整优势,使得用户能够使用更加符合自己阅读习惯的排布方式来进行阅读,同时避免了待阅读图像的文字过小而导致的无法看清文字的问题,方便老年人或者视力较差的用户能够方便的阅读纸质书籍。Perform image recognition on the image to be read to obtain a recognition result; adjust the recognition result according to a preset arrangement to obtain a target recognition result, and display the adjusted target recognition result on a display device. Through the above method, the text in the image to be read can be rearranged and displayed on the display device, and the advantage of the large screen of the display device and the adjustment of the recognition result can be used to enable users to use text that is more in line with their own reading habits. Arrangement for reading, while avoiding the problem that the text of the image to be read is too small and cannot read the text, so that the elderly or users with poor vision can conveniently read paper books.
进一步地,请参阅图3,基于本发明显示方法的第一实施例提出本发明的第二实施例,所述显示方法还包括:Further, referring to FIG. 3 , a second embodiment of the present invention is proposed based on the first embodiment of the display method of the present invention, and the display method further includes:
步骤S40,监测用户在阅读过程中的眼球运动信息,并得到与所述眼球运动信息相对应的调节命令;Step S40, monitoring the user's eye movement information during the reading process, and obtaining an adjustment command corresponding to the eye movement information;
在本实施例中,由于用户在阅读过程中眼球会随着阅读位置而发生改变,因此可以通过用户的眼球运动信息来获取对目标识别结果的调节命令,且所述调节命令包括翻页命令。具体的,显示设备上设置有摄像头,在用户进行阅读的过程中,可以实时监测用户的眼球运动轨迹,进而将眼球运动轨迹转换为调节命令,方便用户进行阅读,不需要手动进行翻页,提高阅读过程中的智能化。In this embodiment, since the user's eyeballs will change along with the reading position during the reading process, the adjustment command for the target recognition result can be obtained through the user's eyeball movement information, and the adjustment command includes a page turning command. Specifically, the display device is equipped with a camera, which can monitor the user's eye movement trajectory in real time during the user's reading process, and then convert the eye movement trajectory into an adjustment command, which is convenient for the user to read and does not need to manually turn pages. Intelligence in the reading process.
具体的,在一实施例中,所述步骤S40还包括:Specifically, in an embodiment, the step S40 also includes:
步骤A41,监测用户在阅读过程中的眼球运动信息;Step A41, monitoring the user's eye movement information during the reading process;
步骤A42,根据所述眼球运动信息,确定用户在所述目标识别结果上的阅读位置;Step A42, according to the eye movement information, determine the user's reading position on the target recognition result;
阅读位置是指用户在目标识别结果上所处的文本行数。例如,目标识别结果为20行,检测到用户的眼球运动信息处于第10行的时候,阅读位置即为第10行。在监测用户的眼球运动信息时,可以通过眼球中瞳孔位置的变化来获取眼球运动信息。The reading position refers to the number of lines of text the user is on on the target recognition result. For example, the target recognition result is line 20, and when it is detected that the user's eye movement information is on
步骤A43,根据所述阅读位置,确定用户在所述目标识别结果的排版方向上的阅读方向,并统计所述阅读方向由排版方向变化为目标方向的变化次数;Step A43, according to the reading position, determine the reading direction of the user in the typesetting direction of the target recognition result, and count the number of changes in the reading direction from the typesetting direction to the target direction;
步骤A44,在所述变化次数达到当前显示页面的次数阈值时,生成与所述眼球运动信息相对应的调节命令,所述调节命令包括翻页命令。Step A44, when the number of changes reaches a threshold value of the number of times of the currently displayed page, generate an adjustment command corresponding to the eye movement information, where the adjustment command includes a page turning command.
排版方向指的是单行文本的阅读顺序,例如,单行文本的阅读顺序是从左至右的,则排版方向则是从左至右的;单行文本的阅读顺序是从上至下的,则排版方向则是从上至下的。阅读方向包括与排版方向相同的方向和与排版方向相反的方向。当阅读方向为与排版方向相同的方向时,说明用户在按照正常顺序阅读,当阅读方向为与排版方向相反的方向时,说明用户在往回读。Typesetting direction refers to the reading order of a single line of text, for example, if the reading order of a single line of text is from left to right, then the typesetting direction is from left to right; if the reading order of a single line of text is from top to bottom, then the typesetting direction is The direction is from top to bottom. The reading direction includes the same direction as the typesetting direction and the direction opposite to the typesetting direction. When the reading direction is the same as the typesetting direction, it means that the user is reading in the normal order; when the reading direction is opposite to the typesetting direction, it means that the user is reading back.
由于阅读位置是随着用户的阅读进程而变化的,因此,可以根据阅读位置的变化来确定阅读方向,例如,阅读位置从单行文本的左边移动到右边时,则阅读方向即为从左至右,当阅读位置从单行文本的右边移动到左边时,则阅读方向即为从右至左。目标方向为与排版方向相垂直的方向,例如,无论排版方向为从左至右或者从右至左时,均为水平方向,而与水平方向垂直的目标方向即为从上往下或者从下往上;而无论排版方向为从上往下或者从下往上时,均为垂直方向,而与垂直方向垂直的目标方向即为从左至右或者从右至左。Since the reading position changes with the user's reading progress, the reading direction can be determined according to the change of the reading position. For example, when the reading position moves from the left to the right of a single line of text, the reading direction is from left to right , when the reading position moves from the right to the left of a single line of text, the reading direction is from right to left. The target direction is the direction perpendicular to the typesetting direction, for example, no matter whether the typesetting direction is from left to right or from right to left, it is horizontal, and the target direction perpendicular to the horizontal direction is from top to bottom or from bottom to bottom Up; regardless of whether the typesetting direction is from top to bottom or from bottom to top, it is a vertical direction, and the target direction perpendicular to the vertical direction is from left to right or from right to left.
当阅读方向有排版方向变化为目标方向时,则说明用户在阅读的过程中进行了换行,在换行次数达到当前显示页面中的换行次数阈值时,说明用户已经达到当前显示页面的最下行数,即已阅读完当前页面,此时则可生成翻页指令。需要说明的是,在执行步骤A43之前,还需要统计当前显示页面的单行文本数量,将单行文本的数量作为次数阈值。例如,当前显示页面有20行文本,当变化次数超过20次时,说明当前页面已经阅读完,则可生成翻页指令,以使显示设备进行翻页。When the reading direction changes from the typesetting direction to the target direction, it means that the user has changed the line during the reading process. When the number of line breaks reaches the threshold of the number of line breaks in the currently displayed page, it means that the user has reached the bottom line of the currently displayed page. That is, the current page has been read, and a page turning instruction can be generated at this time. It should be noted that before step A43 is performed, the number of single-line texts on the currently displayed page needs to be counted, and the number of single-line texts is used as the number of times threshold. For example, if the currently displayed page has 20 lines of text, when the number of changes exceeds 20, it means that the current page has been read, and a page turning instruction can be generated to make the display device turn the page.
在一实施例中,所述步骤A43之后,还包括:In one embodiment, after the step A43, it also includes:
步骤A431,根据所述阅读位置和所述阅读方向,对已阅读过的文字进行标记。Step A431, mark the text that has been read according to the reading position and the reading direction.
在本实施例中,在得到阅读位置和阅读方向后,对已阅读过的文字进行颜色标记,或者进行下划线处理等,能够避免换行混乱甚至忘记刚刚已经阅读过的位置等情况发生,辅助老年人或者儿童进行阅读。In this embodiment, after obtaining the reading position and reading direction, color-mark the text that has been read, or perform underline processing, etc., which can avoid the confusion of line breaks or even forget the position that has just been read, and assist the elderly Or children read.
在一实施例中,所述步骤A42之后,还包括:In one embodiment, after the step A42, it also includes:
步骤A421,检测所述用户在所述阅读位置上的停留时长;Step A421, detecting the length of stay of the user at the reading position;
步骤A422,在所述停留时长超过预设时长时,对与所述阅读位置相对应的文字进行搜索,并显示所述搜索结果。Step A422, when the staying time exceeds a preset time, search for the text corresponding to the reading position, and display the search result.
在本实施例中,停留时长即为阅读时长,当用户在一阅读位置停留时长达到预设时长时,获取位于该阅读位置的文字,并通过联网搜索该文字,将该文字的注释或者读音在显示设备上进行显示。当用户长时间在一个阅读位置停留时,说明用户对该位置的文字可能存在疑问,例如老年人对当前的网络用语可能存在疑问,则可以通过搜索的方式查找该文字的释义等,在显示设备上进行说明,方便用户进行理解阅读。In this embodiment, the staying time is the reading time. When the user stays at a reading position for a preset time, the text at the reading position is obtained, and the text is searched online, and the annotation or pronunciation of the text is in the displayed on the display device. When the user stays at a reading position for a long time, it means that the user may have doubts about the text at the position. For example, the elderly may have doubts about the current Internet terms, and they can search for the definition of the text, etc., on the display device The description above is convenient for users to understand and read.
步骤S50,根据所述调节命令,调节所述显示设备上的目标识别结果。Step S50, adjusting the target recognition result on the display device according to the adjustment command.
在检测到调节命令后,可以直接对目标识别结果进行翻页操作,避免用户手动进行翻页操作。另外,也可以通过接收用户的语音指令来进行翻页操作。After the adjustment command is detected, the page-turning operation can be directly performed on the target recognition result, avoiding the manual page-turning operation by the user. In addition, the page turning operation may also be performed by receiving a user's voice command.
在本发明中,通过监测用户在阅读过程中的眼球运动信息,并得到与所述眼球运动信息相对应的调节命令,以及根据所述调节命令,调节所述显示设备上的目标识别结果,能够使得显示设备中的目标识别结果随着用户的阅读而可以自动进行翻页操作,提高了用户的体验感以及显示设备的智能化程度,方便用户进行操作,特别是方便了老年人进行阅读。In the present invention, by monitoring the user's eye movement information during the reading process, obtaining an adjustment command corresponding to the eye movement information, and adjusting the target recognition result on the display device according to the adjustment command, it is possible to The target recognition result in the display device can be automatically turned over with the user's reading, which improves the user's experience and the intelligence of the display device, and is convenient for the user to operate, especially for the elderly to read.
进一步地,请参阅图5,在另一实施例中,本发明还提出一种显示系统10,所述显示系统10包括:Further, please refer to FIG. 5. In another embodiment, the present invention also proposes a
终端设备11,用于采集待阅读图像;The
云端服务器12,用于对所述待阅读图像进行图像识别,得到识别结果;The
显示设备13,用于根据预设排布方式,调整所述识别结果,并将调整后的目标识别结果在显示设备上显示。The
其中,所述显示设备包括重排模块131,用于根据预设排布方式,调整所述识别结果,得到目标识别结果;Wherein, the display device includes a
显示模块132,用于接收所述重排模块发送的所述目标识别结果,并将调整后的所述目标识别结果在显示设备上显示。The
本实施例的具体实施方式,请参阅上述实施例,本发明在此不作赘述。For the specific implementation manner of this embodiment, please refer to the foregoing embodiments, and the present invention will not be described in detail here.
此外,本发明实施例还提出一种计算机可读存储介质,所述计算机可读存储介质上存储有显示程序,所述显示程序被处理器执行时实现如下操作:In addition, an embodiment of the present invention also proposes a computer-readable storage medium, where a display program is stored on the computer-readable storage medium, and when the display program is executed by a processor, the following operations are implemented:
采集待阅读图像;Collect images to be read;
对所述待阅读图像进行图像识别,得到识别结果;performing image recognition on the image to be read to obtain a recognition result;
根据预设排布方式调整所述识别结果,得到目标识别结果,并将调整后的所述目标识别结果在显示设备上显示。The recognition results are adjusted according to a preset arrangement to obtain target recognition results, and the adjusted target recognition results are displayed on a display device.
进一步地,所述显示程序被处理器执行时还实现如下操作:Further, when the display program is executed by the processor, the following operations are also realized:
根据所述识别结果查找与所述待阅读图像相对应的电子文件版本;Finding an electronic file version corresponding to the image to be read according to the recognition result;
根据所述电子文件版本对所述识别结果进行校正。The recognition result is corrected according to the electronic file version.
进一步地,所述显示程序被处理器执行时还实现如下操作:Further, when the display program is executed by the processor, the following operations are also realized:
采集用户信息,并获取与所述用户信息相对应的预设排布方式,其中,所述预设排布方式包括排版方式、字体颜色、背景颜色和字体大小。Collecting user information, and obtaining a preset layout corresponding to the user information, wherein the preset layout includes a layout, font color, background color, and font size.
进一步地,所述显示程序被处理器执行时还实现如下操作:Further, when the display program is executed by the processor, the following operations are also realized:
监测用户在阅读过程中的眼球运动信息,并得到与所述眼球运动信息相对应的调节命令;Monitor the user's eye movement information during reading, and obtain adjustment commands corresponding to the eye movement information;
根据所述调节命令,调节所述显示设备上的目标识别结果。According to the adjustment command, the target recognition result on the display device is adjusted.
进一步地,所述显示程序被处理器执行时还实现如下操作:Further, when the display program is executed by the processor, the following operations are also realized:
监测用户在阅读过程中的眼球运动信息;Monitor the user's eye movement information during the reading process;
根据所述眼球运动信息,确定用户在所述目标识别结果上的阅读位置;determining the user's reading position on the target recognition result according to the eye movement information;
根据所述阅读位置,确定用户在所述目标识别结果的排版方向上的阅读方向,并统计所述阅读方向由排版方向变化为目标方向的变化次数;According to the reading position, determine the reading direction of the user in the typesetting direction of the target recognition result, and count the number of changes in the reading direction from the typesetting direction to the target direction;
在所述变化次数达到当前显示页面的次数阈值时,生成与所述眼球运动信息相对应的调节命令,所述调节命令包括翻页命令。When the number of times of change reaches the number threshold of the currently displayed page, an adjustment command corresponding to the eye movement information is generated, where the adjustment command includes a page turning command.
进一步地,所述显示程序被处理器执行时还实现如下操作:Further, when the display program is executed by the processor, the following operations are also realized:
根据所述阅读位置和所述阅读方向,对已阅读过的文字进行标记。Mark the text that has been read according to the reading position and the reading direction.
进一步地,所述显示程序被处理器执行时还实现如下操作:Further, when the display program is executed by the processor, the following operations are also realized:
检测所述用户在所述阅读位置上的停留时长;Detecting the length of stay of the user at the reading position;
在所述停留时长超过预设时长时,对与所述阅读位置相对应的文字进行搜索,并显示所述搜索结果。When the staying time exceeds the preset time, the text corresponding to the reading position is searched, and the search result is displayed.
本发明计算机可读存储介质的具体实施例与上述显示程序各实施例基本相同,在此不作赘述。The specific embodiments of the computer-readable storage medium of the present invention are basically the same as the above-mentioned embodiments of the display program, and will not be repeated here.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。It should be noted that, as used herein, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or system comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or system. Without further limitations, an element defined by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article or system comprising that element.
上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the above embodiments of the present invention are for description only, and do not represent the advantages and disadvantages of the embodiments.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本发明各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on such an understanding, the technical solution of the present invention can be embodied in the form of a software product in essence or in other words, the part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above. , magnetic disk, optical disk), including several instructions to make a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) execute the method described in each embodiment of the present invention.
以上仅为本发明的优选实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process conversion made by using the description of the present invention and the contents of the accompanying drawings, or directly or indirectly used in other related technical fields , are all included in the scope of patent protection of the present invention in the same way.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211714916.4A CN115963968A (en) | 2022-12-26 | 2022-12-26 | Display method, display system, display device and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211714916.4A CN115963968A (en) | 2022-12-26 | 2022-12-26 | Display method, display system, display device and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115963968A true CN115963968A (en) | 2023-04-14 |
Family
ID=87363139
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211714916.4A Pending CN115963968A (en) | 2022-12-26 | 2022-12-26 | Display method, display system, display device and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115963968A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117908669A (en) * | 2023-12-26 | 2024-04-19 | 奇点新源国际技术开发(北京)有限公司 | Auxiliary reading method and system |
-
2022
- 2022-12-26 CN CN202211714916.4A patent/CN115963968A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117908669A (en) * | 2023-12-26 | 2024-04-19 | 奇点新源国际技术开发(北京)有限公司 | Auxiliary reading method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11195315B2 (en) | Language element vision augmentation methods and devices | |
| US11048865B2 (en) | Processing and displaying handwritten note based on format change of content in electronic book | |
| US9165185B2 (en) | Optical character recognition of text in an image according to a prioritized processing sequence | |
| US9460089B1 (en) | Flow rendering of annotation characters | |
| JP5877272B2 (en) | Document processing apparatus, document processing method, program, and information storage medium | |
| US20210073458A1 (en) | Comic data display system, method, and program | |
| CN108256523A (en) | Recognition methods, device and computer readable storage medium based on mobile terminal | |
| CN112163513A (en) | Information selection method, system, device, electronic device and storage medium | |
| CN115963968A (en) | Display method, display system, display device and readable storage medium | |
| CN111753715A (en) | Method, device, electronic device and storage medium for shooting test questions in a reading scene | |
| JP2016045723A (en) | Electronics | |
| CN111753168A (en) | A method, device, electronic device and storage medium for searching questions | |
| JP2016045724A (en) | Electronics | |
| KR102293361B1 (en) | Apparatus and method for providing handwriting calibration function | |
| US20110294522A1 (en) | Character recognizing system and method for the same | |
| CN113010718A (en) | Photographing question searching method, device, equipment and storage medium | |
| CN113762223B (en) | Question splitting model training method, question splitting method and related device | |
| CN117908669A (en) | Auxiliary reading method and system | |
| CN111582281B (en) | Picture display optimization method and device, electronic equipment and storage medium | |
| JP2016062307A (en) | Information display device, information display program, and information display method | |
| CN114241175A (en) | Text translation method, device, scanning pen and storage medium | |
| CN111432131A (en) | Photographing frame selection method and device, electronic equipment and storage medium | |
| CN111079491A (en) | Writing content identification method, electronic equipment and storage medium | |
| JP6364051B2 (en) | Document information acquisition method with guidance, program, and portable terminal device | |
| CN111563497A (en) | Frame question method and device based on movement track, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |
