WO2024051757A1 - Information processing method and apparatus, electronic device and computer readable medium - Google Patents
Information processing method and apparatus, electronic device and computer readable medium Download PDFInfo
- Publication number
- WO2024051757A1 WO2024051757A1 PCT/CN2023/117331 CN2023117331W WO2024051757A1 WO 2024051757 A1 WO2024051757 A1 WO 2024051757A1 CN 2023117331 W CN2023117331 W CN 2023117331W WO 2024051757 A1 WO2024051757 A1 WO 2024051757A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- tactile
- preset
- next frame
- receiving end
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/0001—Systems modifying transmission characteristics according to link quality, e.g. power backoff
- H04L1/0036—Systems modifying transmission characteristics according to link quality, e.g. power backoff arrangements specific to the receiver
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/004—Arrangements for detecting or preventing errors in the information received by using forward error control
- H04L1/0056—Systems characterized by the type of code used
- H04L1/0061—Error detection codes
Definitions
- the present disclosure relates to the field of information processing technology, and specifically, to an information processing method, an information processing device, an electronic device, and a computer-readable medium.
- Tactile communication is one of the main application scenarios in the 6G era, and it is also the basic technology for future XR (Extended Reality, extended reality)/metaverse related scenarios and applications. Tactile communication is bidirectional and bursty, and the temporal and spatial resolution requirements of tactile information are relatively high. Therefore, tactile communication perception is highly dependent on parameters such as the reliability and delay of the tactile information transmission network.
- the transmission network if the transmission network is interfered with, it may cause the tactile signal to be missing, wrong or delayed at the information receiving end, causing the problem of perception interruption at the information receiving end.
- the purpose of this disclosure is to provide an information processing method, an information processing device, an electronic device, and a computer-readable medium, which can alleviate the problem of perception interruption at the information receiving end, at least to a certain extent.
- an information processing method applied to an information receiving end, including:
- next frame of tactile information is received within the preset interval period, determine whether the next frame of tactile information is error information
- next frame of tactile information is not received within the preset interval period, or the next frame of tactile information is the error information, obtain preset information
- the preset information is decoded, and the decoded preset information is used to replace the tactile sensation information of the next frame for tactile sensation reproduction.
- the method further includes:
- next frame of tactile information is received within the preset interval period and the next frame of tactile information is correct information, the next frame of tactile information is directly decoded and used for tactile reproduction.
- the method further includes:
- the preset information is generated based on the current tactile information.
- generating the preset information according to the current touch information includes:
- the current touch information is used as the preset information corresponding to the touch information of the next frame.
- generating the preset information according to the current touch information includes:
- the preset information is generated according to the historical tactile information and the weight corresponding to each historical tactile information.
- generating the preset information according to the current touch information includes:
- the preset information is generated based on a preset prediction algorithm and the historical touch information.
- the method further includes:
- the method for generating the preset information is determined according to the terminal resource status of the information receiving end.
- an information processing device which is applied to an information receiving end and includes:
- a reception time judgment module configured to judge whether the information receiving end receives the next frame of tactile information within a preset interval time period
- An error information judgment module configured to determine whether the next frame of tactile information is error information if the next frame of tactile information is received within the preset interval period;
- a preset information acquisition module configured to obtain preset information if the next frame of tactile information is not received within the preset interval period, or the next frame of tactile information is the error information.
- the preset information decoding module is configured to decode the preset information, and use the decoded preset information to replace the next frame of tactile sensation information for tactile sensation reproduction.
- an electronic device including: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the operation via executing the executable instructions. Perform any of the information processing methods described above.
- a computer-readable medium on which a computer program is stored, and when the computer program is executed by a processor, the information processing method described in any one of the above is implemented.
- the information processing method of the exemplary embodiment of the present disclosure it is determined whether the information receiving end receives the next frame of tactile information within a preset interval time period, and when the information receiving end receives the next frame of tactile information, it is determined whether the information receiving end has received the next frame of tactile information. Whether the tactile information is error information; if the information receiving end does not receive the next frame of tactile information within the preset interval time period, or the received tactile information is error information, obtain the preset information and decode it, and then Will The decoded preset information replaces the tactile information of the next frame for tactile reproduction.
- the information processing method in the exemplary embodiment of the present disclosure can improve tactile communication perception based on information preset, by generating preset information based on the normal tactile information received in the early stage, and using the generated preset information as the next frame tactile information. Alternate input of information. When the next frame of tactile information cannot be obtained on time due to network problems, or the acquired tactile information is incorrect, using preset information as an alternative input can alleviate the loss or delay of tactile information in tactile communication. The resulting problems of perception interruption and poor perception at the information receiving end can be used to restore the tactile sensation at the information receiving end and reduce the impact of signal loss on perception restoration.
- Figure 1 shows a schematic flowchart of an information processing method according to an example embodiment of the present disclosure
- Figure 2 schematically shows a flow chart of tactile information transmission in a related embodiment of the present disclosure
- Figure 3 schematically shows a flow chart of tactile information transmission according to a specific embodiment of the present disclosure
- Figure 4 shows a schematic flowchart of a method for processing tactile information according to a specific embodiment of the present disclosure
- FIG. 5 shows a block diagram of an information processing device according to an example embodiment of the present disclosure
- FIG. 6 shows a schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present disclosure.
- Example embodiments will now be described more fully with reference to the accompanying drawings.
- Example embodiments may, however, be embodied in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concepts of the example embodiments.
- the described features, structures or characteristics may be combined in any suitable manner in one or more embodiments.
- numerous specific details are provided to provide a thorough understanding of embodiments of the disclosure.
- those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details described, or other methods, components, devices, steps, etc. may be adopted.
- well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the disclosure.
- This example implementation first provides an information processing method, which is applied to the information receiving end.
- the above information processing method may include the following steps:
- Step S110 Determine whether the information receiving end receives the next frame of tactile information within the preset interval period.
- Step S120 If the next frame of tactile information is received within the preset interval period, determine whether the next frame of tactile information is error information.
- Step S130 If the next frame of tactile information is not received within the preset interval period, or the next frame of tactile information is error information, obtain the preset information.
- Step S140 Decode the preset information, and use the decoded preset information to replace the tactile information of the next frame for tactile reproduction.
- the information processing method of the exemplary embodiment of the present disclosure it is determined whether the information receiving end receives the next frame of tactile information within a preset interval time period, and when the information receiving end receives the next frame of tactile information, it is determined whether the information receiving end has received the next frame of tactile information. Whether the tactile information is error information; if the information receiving end does not receive the next frame of tactile information within the preset interval time period, or the received tactile information is error information, obtain the preset information and decode it, and then The decoded preset information is used to replace the tactile information of the next frame for tactile reproduction.
- the information processing method in the exemplary embodiment of the present disclosure can improve tactile communication perception based on information preset, by generating preset information based on the normal tactile information received in the early stage, and using the generated preset information as the next frame tactile information. Alternate input of information. When the next frame of tactile information cannot be obtained on time due to network problems, or the acquired tactile information is incorrect, using preset information as an alternative input can alleviate the loss or delay of tactile information in tactile communication. The resulting problems of perception interruption and poor perception at the information receiving end can be used to restore the tactile sensation at the information receiving end and reduce the impact of signal loss on perception restoration.
- step S110 it is determined whether the information receiving end receives the next frame of tactile information within a preset interval period.
- the information sending end includes a sensor, a coding module and a sending module
- the information receiving end includes a receiving module, a decoding module and a perception restoration module.
- the information sending end obtains the tactile information through the sensor, encodes it through the encoding module, and then uses the sending module to send the encoded tactile information to the information receiving end through the transmission network.
- the information receiving end receives the tactile information through the receiving module, decodes it through the decoding module, and then performs perceptual restoration through the perceptual restoration module.
- a time counter can be built into the receiving module to periodically determine whether the information receiving end receives the next frame of tactile information within a preset interval time period.
- step S120 if the next frame of touch information is received within the preset interval period, it is determined that the next frame of touch information is received. Whether the sensed information is wrong information.
- the receiving module will analyze the tactile information transmitted through the network to determine whether there are errors or missing codes in the received tactile information. question. If it exists, it is judged as wrong information; if the information is correct, it is judged as correct information.
- step S130 if the next frame of tactile information is not received within the preset interval period, or the next frame of tactile information is error information, preset information is obtained.
- the preset information generated in advance is directly obtained from the information presetting module as an alternative.
- step S140 the preset information is decoded, and the decoded preset information is used to replace the next frame of tactile sensation information for tactile sensation reproduction.
- the preset information can be passed to the decoding module to decode the tactile information, and the decoded preset information can be used to replace the next frame of tactile information for tactile reproduction.
- next frame of tactile information is received within the preset interval period and the next frame of tactile information is correct information
- the next frame of tactile information is directly decoded and used for tactile reproduction.
- next frame of tactile information received by the information receiving end within the preset interval time period is correct information, it will be directly submitted to the decoding module for decoding of the tactile information, and then used for tactile reproduction.
- the information preset module can also periodically calculate and output the next frame of preset information based on the correct touch information received from the receiving module.
- the preset information is generated based on the current tactile information.
- next frame of tactile information received by the information receiving end within the preset interval time period is correct information, it will be submitted to the decoding module and passed to the information presetting module for calculation of preset information as subsequent information. of spare.
- the calculation cycle of the preset information is calculated every time a frame of new and correct tactile information is received.
- the information preset module can also generate preset information in a variety of ways based on the correct touch information received.
- the current touch information can be directly used as the preset information corresponding to the next frame of touch information.
- the correct data of the previous frame can be directly reused to generate preset information.
- This method is relatively simple and requires the lowest computing power of the terminal.
- the calculation formula of the preset information S is as follows:
- multiple historical tactile information including current tactile information can also be obtained, and preset information can be generated based on the historical tactile information and the weight corresponding to each historical tactile information.
- the preset information S t at time t is obtained by summing the previous L normally received historical touch information Sn multiplied by the corresponding weight W n .
- L is the sliding window size
- W n is the corresponding previous L history.
- the weight value of tactile information, sliding window size and weight value can be configured according to needs.
- multiple historical tactile information including current tactile information can also be obtained, and preset information is generated based on a preset prediction algorithm and historical tactile information.
- the model can also be modified based on the correct information received. Continuous iterative updates. This method is more accurate in recovering the signal and has higher computational complexity. Therefore, it requires higher computing power on the terminal and may introduce additional computational delay at the signal receiving end.
- which method of generating preset information is specifically used may be determined based on the terminal resource status of the information receiving end.
- Factors that may be considered when selecting a method to generate preset information include: terminal computing power, accuracy requirements of preset information, etc.
- the specific solution for preset information calculation at the information receiving end can be strategically configured. According to the terminal resource status of the information receiving end, such as the terminal computing power, combined with the accuracy requirements of the preset information, the system automatically selects the appropriate solution, or through parameters Configured to adapt to different application environments, it has strong flexibility, good operability and good practicality.
- FIG. 4 shows a complete flowchart of a method for processing tactile information applied to the information receiving end in a specific embodiment of the present disclosure. It is an example of the above steps in this exemplary embodiment.
- the specific steps of the flowchart are as follows:
- Step S410 Receive touch information.
- Step S420 Determine whether the touch information is correct.
- step S430 If the received tactile information is incorrect information, proceed to step S430; if the received tactile information is correct information, proceed to step S440, and submit the information to the information preset module for preset information calculation.
- Step S430 Obtain preset information.
- step S440 is also entered for decoding.
- Step S440 Submit to the decoding module.
- the decoded tactile information can be used for tactile reproduction.
- Step S450 Preset information calculation.
- the information preset module periodically calculates new preset information and outputs the predicted next frame data.
- steps S410 to S440 are executed by the receiving module, and step S450 is executed by the information presetting module.
- the present disclosure also provides an information processing device, which is applied to the information receiving end.
- the information processing device may include a reception time judgment module 510 , an error information judgment module 520 , a preset information acquisition module 530 and a preset information decoding module 540 . in:
- the reception time determination module 510 may be configured to determine whether the information receiving end receives the next frame of tactile information within a preset interval period
- the error information determination module 520 may be configured to determine whether the next frame of tactile information is error information if the next frame of tactile information is received within the preset interval period;
- the preset information acquisition module 530 may be configured to obtain the preset information if the next frame of tactile information is not received within the preset interval period, or the next frame of tactile information is error information;
- the preset information decoding module 540 may be configured to decode the preset information and replace the next frame of tactile sensation information with the decoded preset information for tactile sensation reproduction.
- the information processing device provided by the present disclosure may further include a tactile information decoding module, which may be configured to execute if the next frame of tactile information is received within a preset interval period, If the tactile information of the next frame is correct, the tactile information of the next frame is directly decoded and used for tactile reproduction.
- a tactile information decoding module which may be configured to execute if the next frame of tactile information is received within a preset interval period, If the tactile information of the next frame is correct, the tactile information of the next frame is directly decoded and used for tactile reproduction.
- an information processing device may also include a preset information generation module, which may be configured to execute the current information received by the information receiving end within a preset interval period. If the tactile information is correct, preset information is generated based on the current tactile information.
- a preset information generation module which may be configured to execute the current information received by the information receiving end within a preset interval period. If the tactile information is correct, preset information is generated based on the current tactile information.
- the preset information generation module may include a first preset information generation unit, which may be configured to perform using the current touch information as preset information corresponding to the next frame of touch information.
- the preset information generation module may include a historical touch information acquisition unit and a second preset information generation unit. in:
- the historical tactile information acquisition unit may be configured to acquire a plurality of historical tactile information including current tactile information
- the second preset information generation unit may be configured to generate preset information based on historical tactile information and weights corresponding to each historical tactile information.
- the preset information generation module may include a historical touch information acquisition unit and a third preset information generation unit. in:
- the historical tactile information acquisition unit may be configured to acquire a plurality of historical tactile information including current tactile information
- the third preset information generating unit may be configured to generate preset information based on a preset prediction algorithm and historical tactile information.
- the preset information generation module may also include a preset information generation method
- the determining unit may be configured to execute a method for determining the generation of preset information based on the terminal resource status of the information receiving end.
- FIG. 6 shows a schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present disclosure.
- computer system 600 includes a central processing unit (CPU) 601 that can operate according to a program stored in a read-only memory (ROM) 602 or loaded from a storage portion 608 into a random access memory (RAM) 603 And perform various appropriate actions and processing.
- CPU 601, ROM 602 and RAM 603 are connected to each other through bus 604.
- An input/output (I/O) interface 605 is also connected to bus 604.
- the following components are connected to the I/O interface 605: an input section 606 including a keyboard, a mouse, etc.; an output section 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., speakers, etc.; and a storage section 608 including a hard disk, etc. ; and a communication section 609 including a network interface card such as a LAN card, a modem, etc.
- the communication section 609 performs communication processing via a network such as the Internet.
- Driver 610 is also connected to I/O interface 605 as needed.
- Removable media 611 such as magnetic disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on the drive 610 as needed, so that a computer program read therefrom is installed into the storage portion 608 as needed.
- embodiments of the present disclosure include a computer program product including a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart.
- the computer program may be downloaded and installed from the network via communication portion 609, and/or installed from removable media 611.
- CPU central processing unit
- the computer-readable medium shown in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two.
- the computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard drive, random access memory (RAM), read only memory (ROM), removable Programmd read-only memory (EPROM or flash memory), fiber optics, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
- a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device.
- a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above.
- a computer-readable signal medium may also be any computer-readable storage medium other than a computer-readable storage medium.
- Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the foregoing.
- each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more logic functions that implement the specified executable instructions.
- the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved.
- each block in the block diagram or flowchart illustration, and combinations of blocks in the block diagram or flowchart illustration can be implemented by special purpose hardware-based systems that perform the specified functions or operations, or may be implemented by special purpose hardware-based systems that perform the specified functions or operations. Achieved by a combination of specialized hardware and computer instructions.
- the present disclosure also provides a computer-readable medium.
- the computer-readable medium may be included in the electronic device described in the above embodiments; it may also exist independently without being assembled into the electronic device. middle.
- the computer-readable medium carries one or more programs. When the one or more programs are executed by an electronic device, the electronic device implements the method described in the above embodiments.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Quality & Reliability (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
相关申请的交叉引用Cross-references to related applications
本申请要求于2022年09月09日提交的申请号为202211105283.7、名称为“信息的处理方法、装置、电子设备及计算机可读介质”的中国专利申请的优先权,该中国专利申请的全部内容通过引用全部并入本文。This application claims priority to the Chinese patent application with application number 202211105283.7 and titled "Information processing method, device, electronic equipment and computer-readable medium" submitted on September 9, 2022. The entire content of the Chinese patent application All incorporated herein by reference.
本公开涉及信息处理技术领域,具体而言,涉及一种信息的处理方法、信息的处理装置、电子设备及计算机可读介质。The present disclosure relates to the field of information processing technology, and specifically, to an information processing method, an information processing device, an electronic device, and a computer-readable medium.
触觉通信是6G时代主要应用场景之一,也是未来XR(Extended Reality,扩展现实)/元宇宙相关场景、应用的基础技术。触觉通信具有双向性,且突发性强,触感信息的时间分辨率和空间分辨率要求都比较高,因此,触觉通信感知高度依赖于触感信息传送网络的可靠性和时延等参数。Tactile communication is one of the main application scenarios in the 6G era, and it is also the basic technology for future XR (Extended Reality, extended reality)/metaverse related scenarios and applications. Tactile communication is bidirectional and bursty, and the temporal and spatial resolution requirements of tactile information are relatively high. Therefore, tactile communication perception is highly dependent on parameters such as the reliability and delay of the tactile information transmission network.
在触感信息的传输过程中,如果传输网络遭到干扰,可能会导致触觉信号在信息接收端出现缺失、错误或者时延,造成信息接收端感知中断的问题。During the transmission process of tactile information, if the transmission network is interfered with, it may cause the tactile signal to be missing, wrong or delayed at the information receiving end, causing the problem of perception interruption at the information receiving end.
需要说明的是,在上述背景技术部分公开的信息仅用于加强对本公开的背景的理解,因此可以包括不构成对本领域普通技术人员已知的现有技术的信息。It should be noted that the information disclosed in the above background section is only used to enhance understanding of the background of the present disclosure, and therefore may include information that does not constitute prior art known to those of ordinary skill in the art.
发明内容Contents of the invention
本公开的目的在于提供一种信息的处理方法、信息的处理装置、电子设备及计算机可读介质,进而至少在一定程度上能够缓解信息接收端感知中断的问题。The purpose of this disclosure is to provide an information processing method, an information processing device, an electronic device, and a computer-readable medium, which can alleviate the problem of perception interruption at the information receiving end, at least to a certain extent.
根据本公开的第一个方面,提供一种信息的处理方法,应用于信息接收端,包括:According to a first aspect of the present disclosure, an information processing method is provided, applied to an information receiving end, including:
判断所述信息接收端是否在预设间隔时间段内接收到下一帧触感信息;Determine whether the information receiving end receives the next frame of tactile information within a preset interval;
若在所述预设间隔时间段内接收到所述下一帧触感信息,则判断所述下一帧触感信息是否为错误信息;If the next frame of tactile information is received within the preset interval period, determine whether the next frame of tactile information is error information;
若在所述预设间隔时间段内未接收到所述下一帧触感信息,或者所述下一帧触感信息为所述错误信息,则获取预置信息;If the next frame of tactile information is not received within the preset interval period, or the next frame of tactile information is the error information, obtain preset information;
对所述预置信息进行解码,并将解码后的所述预置信息代替所述下一帧触感信息用于触感复现。The preset information is decoded, and the decoded preset information is used to replace the tactile sensation information of the next frame for tactile sensation reproduction.
在本公开的一种示例性实施例中,所述方法还包括:In an exemplary embodiment of the present disclosure, the method further includes:
若在所述预设间隔时间段内接收到所述下一帧触感信息,且所述下一帧触感信息为正确信息,则直接对所述下一帧触感信息进行解码并用于触感复现。 If the next frame of tactile information is received within the preset interval period and the next frame of tactile information is correct information, the next frame of tactile information is directly decoded and used for tactile reproduction.
在本公开的一种示例性实施例中,所述方法还包括:In an exemplary embodiment of the present disclosure, the method further includes:
若所述信息接收端在所述预设间隔时间段内接收到的当前触感信息为正确信息,则根据所述当前触感信息生成所述预置信息。If the current tactile information received by the information receiving end within the preset interval period is correct information, the preset information is generated based on the current tactile information.
在本公开的一种示例性实施例中,所述根据所述当前触感信息生成所述预置信息,包括:In an exemplary embodiment of the present disclosure, generating the preset information according to the current touch information includes:
将所述当前触感信息作为所述下一帧触感信息对应的所述预置信息。The current touch information is used as the preset information corresponding to the touch information of the next frame.
在本公开的一种示例性实施例中,所述根据所述当前触感信息生成所述预置信息,包括:In an exemplary embodiment of the present disclosure, generating the preset information according to the current touch information includes:
获取包含所述当前触感信息在内的多个历史触感信息;Obtain multiple historical tactile information including the current tactile information;
根据所述历史触感信息以及各个所述历史触感信息对应的权重生成所述预置信息。The preset information is generated according to the historical tactile information and the weight corresponding to each historical tactile information.
在本公开的一种示例性实施例中,所述根据所述当前触感信息生成所述预置信息,包括:In an exemplary embodiment of the present disclosure, generating the preset information according to the current touch information includes:
获取包含所述当前触感信息在内的多个历史触感信息;Obtain multiple historical tactile information including the current tactile information;
基于预设的预测算法以及所述历史触感信息生成所述预置信息。The preset information is generated based on a preset prediction algorithm and the historical touch information.
在本公开的一种示例性实施例中,所述方法还包括:In an exemplary embodiment of the present disclosure, the method further includes:
根据所述信息接收端的终端资源状态确定所述预置信息的生成方法。The method for generating the preset information is determined according to the terminal resource status of the information receiving end.
根据本公开的第二方面,提供一种信息的处理装置,应用于信息接收端,包括:According to a second aspect of the present disclosure, an information processing device is provided, which is applied to an information receiving end and includes:
接收时间判断模块,被配置为执行判断所述信息接收端是否在预设间隔时间段内接收到下一帧触感信息;A reception time judgment module configured to judge whether the information receiving end receives the next frame of tactile information within a preset interval time period;
错误信息判断模块,被配置为执行若在所述预设间隔时间段内接收到所述下一帧触感信息,则判断所述下一帧触感信息是否为错误信息;An error information judgment module configured to determine whether the next frame of tactile information is error information if the next frame of tactile information is received within the preset interval period;
预置信息获取模块,被配置为执行若在所述预设间隔时间段内未接收到所述下一帧触感信息,或者所述下一帧触感信息为所述错误信息,则获取预置信息;A preset information acquisition module configured to obtain preset information if the next frame of tactile information is not received within the preset interval period, or the next frame of tactile information is the error information. ;
预置信息解码模块,被配置为执行对所述预置信息进行解码,并将解码后的所述预置信息代替所述下一帧触感信息用于触感复现。The preset information decoding module is configured to decode the preset information, and use the decoded preset information to replace the next frame of tactile sensation information for tactile sensation reproduction.
根据本公开的第三方面,提供一种电子设备,包括:处理器;以及存储器,用于存储所述处理器的可执行指令;其中,所述处理器配置为经由执行所述可执行指令来执行上述任意一项所述的信息的处理方法。According to a third aspect of the present disclosure, an electronic device is provided, including: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the operation via executing the executable instructions. Perform any of the information processing methods described above.
根据本公开的第四方面,提供一种计算机可读介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现上述任意一项所述的信息的处理方法。According to a fourth aspect of the present disclosure, there is provided a computer-readable medium on which a computer program is stored, and when the computer program is executed by a processor, the information processing method described in any one of the above is implemented.
本公开示例性实施例可以具有以下有益效果:Exemplary embodiments of the present disclosure may have the following beneficial effects:
本公开示例实施方式的信息的处理方法中,通过判断信息接收端是否在预设间隔时间段内接收到下一帧触感信息,并且在信息接收端接收到下一帧触感信息时,判断接收到的触感信息是否为错误信息;如果信息接收端在预设间隔时间段内未接收到下一帧触感信息,或者接收到的触感信息为错误信息,则获取预置信息并对其进行解码,然后将 解码后的预置信息代替下一帧触感信息用于触感复现。本公开示例实施方式中的信息的处理方法,能够基于信息预置提升触觉通信感知,通过基于前期收到的、正常的触感信息生成预置信息,并将生成的预置信息作为下一帧触感信息的备用输入,当因网络问题造成下一帧触感信息无法按时获取,或者获取到的触感信息出现错误时,使用预置信息作为替代输入,能够缓解在触觉通信中触感信息丢失或时延而导致的信息接收端感知中断、感知差的问题,可以用于信息接收端的触感恢复,降低信号丢失对感知复原的影响。In the information processing method of the exemplary embodiment of the present disclosure, it is determined whether the information receiving end receives the next frame of tactile information within a preset interval time period, and when the information receiving end receives the next frame of tactile information, it is determined whether the information receiving end has received the next frame of tactile information. Whether the tactile information is error information; if the information receiving end does not receive the next frame of tactile information within the preset interval time period, or the received tactile information is error information, obtain the preset information and decode it, and then Will The decoded preset information replaces the tactile information of the next frame for tactile reproduction. The information processing method in the exemplary embodiment of the present disclosure can improve tactile communication perception based on information preset, by generating preset information based on the normal tactile information received in the early stage, and using the generated preset information as the next frame tactile information. Alternate input of information. When the next frame of tactile information cannot be obtained on time due to network problems, or the acquired tactile information is incorrect, using preset information as an alternative input can alleviate the loss or delay of tactile information in tactile communication. The resulting problems of perception interruption and poor perception at the information receiving end can be used to restore the tactile sensation at the information receiving end and reduce the impact of signal loss on perception restoration.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本公开。It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only, and do not limit the present disclosure.
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本公开的实施例,并与说明书一起用于解释本公开的原理。显而易见地,下面描述中的附图仅仅是本公开的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without exerting creative efforts.
图1示出了本公开示例实施方式的信息的处理方法的流程示意图;Figure 1 shows a schematic flowchart of an information processing method according to an example embodiment of the present disclosure;
图2示意性示出了根据本公开的一个相关实施方式中的触感信息传输的流程框图;Figure 2 schematically shows a flow chart of tactile information transmission in a related embodiment of the present disclosure;
图3示意性示出了根据本公开的一个具体实施方式中的触感信息传输的流程框图;Figure 3 schematically shows a flow chart of tactile information transmission according to a specific embodiment of the present disclosure;
图4示出了根据本公开的一个具体实施方式中触感信息的处理方法的流程示意图;Figure 4 shows a schematic flowchart of a method for processing tactile information according to a specific embodiment of the present disclosure;
图5示出了本公开示例实施方式的信息的处理装置的框图;FIG. 5 shows a block diagram of an information processing device according to an example embodiment of the present disclosure;
图6示出了适于用来实现本公开实施方式的电子设备的计算机系统的结构示意图。FIG. 6 shows a schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present disclosure.
现在将参考附图更全面地描述示例实施方式。然而,示例实施方式能够以多种形式实施,且不应被理解为限于在此阐述的范例;相反,提供这些实施方式使得本公开将更加全面和完整,并将示例实施方式的构思全面地传达给本领域的技术人员。所描述的特征、结构或特性可以以任何合适的方式结合在一个或更多实施方式中。在下面的描述中,提供许多具体细节从而给出对本公开的实施方式的充分理解。然而,本领域技术人员将意识到,可以实践本公开的技术方案而省略所述特定细节中的一个或更多,或者可以采用其它的方法、组元、装置、步骤等。在其它情况下,不详细示出或描述公知技术方案以避免喧宾夺主而使得本公开的各方面变得模糊。Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concepts of the example embodiments. To those skilled in the art. The described features, structures or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to provide a thorough understanding of embodiments of the disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details described, or other methods, components, devices, steps, etc. may be adopted. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the disclosure.
此外,附图仅为本公开的示意性图解,并非一定是按比例绘制。图中相同的附图标记表示相同或类似的部分,因而将省略对它们的重复描述。附图中所示的一些方框图是功能实体,不一定必须与物理或逻辑上独立的实体相对应。可以采用软件形式来实现这些功能实体,或在一个或多个硬件模块或集成电路中实现这些功能实体,或在不同网络和/或处理器装置和/或微控制器装置中实现这些功能实体。 Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings represent the same or similar parts, and thus their repeated description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and/or processor devices and/or microcontroller devices.
本示例实施方式首先提供了一种信息的处理方法,应用于信息接收端。参考图1所示,上述信息的处理方法可以包括以下步骤:This example implementation first provides an information processing method, which is applied to the information receiving end. Referring to Figure 1, the above information processing method may include the following steps:
步骤S110.判断信息接收端是否在预设间隔时间段内接收到下一帧触感信息。Step S110. Determine whether the information receiving end receives the next frame of tactile information within the preset interval period.
步骤S120.若在预设间隔时间段内接收到下一帧触感信息,则判断下一帧触感信息是否为错误信息。Step S120. If the next frame of tactile information is received within the preset interval period, determine whether the next frame of tactile information is error information.
步骤S130.若在预设间隔时间段内未接收到下一帧触感信息,或者下一帧触感信息为错误信息,则获取预置信息。Step S130. If the next frame of tactile information is not received within the preset interval period, or the next frame of tactile information is error information, obtain the preset information.
步骤S140.对预置信息进行解码,并将解码后的预置信息代替下一帧触感信息用于触感复现。Step S140. Decode the preset information, and use the decoded preset information to replace the tactile information of the next frame for tactile reproduction.
本公开示例实施方式的信息的处理方法中,通过判断信息接收端是否在预设间隔时间段内接收到下一帧触感信息,并且在信息接收端接收到下一帧触感信息时,判断接收到的触感信息是否为错误信息;如果信息接收端在预设间隔时间段内未接收到下一帧触感信息,或者接收到的触感信息为错误信息,则获取预置信息并对其进行解码,然后将解码后的预置信息代替下一帧触感信息用于触感复现。本公开示例实施方式中的信息的处理方法,能够基于信息预置提升触觉通信感知,通过基于前期收到的、正常的触感信息生成预置信息,并将生成的预置信息作为下一帧触感信息的备用输入,当因网络问题造成下一帧触感信息无法按时获取,或者获取到的触感信息出现错误时,使用预置信息作为替代输入,能够缓解在触觉通信中触感信息丢失或时延而导致的信息接收端感知中断、感知差的问题,可以用于信息接收端的触感恢复,降低信号丢失对感知复原的影响。In the information processing method of the exemplary embodiment of the present disclosure, it is determined whether the information receiving end receives the next frame of tactile information within a preset interval time period, and when the information receiving end receives the next frame of tactile information, it is determined whether the information receiving end has received the next frame of tactile information. Whether the tactile information is error information; if the information receiving end does not receive the next frame of tactile information within the preset interval time period, or the received tactile information is error information, obtain the preset information and decode it, and then The decoded preset information is used to replace the tactile information of the next frame for tactile reproduction. The information processing method in the exemplary embodiment of the present disclosure can improve tactile communication perception based on information preset, by generating preset information based on the normal tactile information received in the early stage, and using the generated preset information as the next frame tactile information. Alternate input of information. When the next frame of tactile information cannot be obtained on time due to network problems, or the acquired tactile information is incorrect, using preset information as an alternative input can alleviate the loss or delay of tactile information in tactile communication. The resulting problems of perception interruption and poor perception at the information receiving end can be used to restore the tactile sensation at the information receiving end and reduce the impact of signal loss on perception restoration.
下面,结合图2至图4对本示例实施方式的上述步骤进行更加详细的说明。Below, the above steps of this exemplary embodiment will be described in more detail with reference to FIGS. 2 to 4 .
在步骤S110中,判断信息接收端是否在预设间隔时间段内接收到下一帧触感信息。In step S110, it is determined whether the information receiving end receives the next frame of tactile information within a preset interval period.
如图2所示是本公开的一个相关实施方式中的触感信息传输的流程框图,其中,信息发送端包含感知器、编码模块和发送模块,信息接收端包含接收模块,解码模块和感知复原模块。信息发送端通过感知器获取触感信息,并通过编码模块对其进行编码,然后使用发送模块将编码后的触感信息通过传输网络发送给信息接收端。信息接收端通过接收模块接收触感信息,并通过解码模块对其进行解码,然后通过感知复原模块进行感知复原。As shown in Figure 2 is a flow chart of tactile information transmission in a related embodiment of the present disclosure, in which the information sending end includes a sensor, a coding module and a sending module, and the information receiving end includes a receiving module, a decoding module and a perception restoration module. . The information sending end obtains the tactile information through the sensor, encodes it through the encoding module, and then uses the sending module to send the encoded tactile information to the information receiving end through the transmission network. The information receiving end receives the tactile information through the receiving module, decodes it through the decoding module, and then performs perceptual restoration through the perceptual restoration module.
对于上述相关实施方式中的触感信息传输过程,一旦传输网络出现错误,将会导致触感信息的传输出现延时,或者传输的触感信息有误,从而影响解码模块的正常解码和感知复原。Regarding the tactile information transmission process in the above related embodiments, once an error occurs in the transmission network, it will cause a delay in the transmission of tactile information, or the transmitted tactile information will be incorrect, thus affecting the normal decoding and perception recovery of the decoding module.
本示例实施方式中,如图3所示,通过在信号接收端对接收模块进行改造,新增用以实时计算预置信号的信息预置模块,能够缓解触感信息传输损耗而影响信息接收端感知的问题。其中,接收模块中可以内置时间计数器,周期性地判断信息接收端是否在预设间隔时间段内接收到下一帧触感信息。In this example implementation, as shown in Figure 3, by modifying the receiving module at the signal receiving end and adding an information preset module for real-time calculation of the preset signal, the loss of tactile information transmission that affects the perception of the information receiving end can be alleviated. The problem. Among them, a time counter can be built into the receiving module to periodically determine whether the information receiving end receives the next frame of tactile information within a preset interval time period.
在步骤S120中,若在预设间隔时间段内接收到下一帧触感信息,则判断下一帧触 感信息是否为错误信息。In step S120, if the next frame of touch information is received within the preset interval period, it is determined that the next frame of touch information is received. Whether the sensed information is wrong information.
本示例实施方式中,如果信息接收端在超时前接收到了下一帧触感信息,则通过接收模块对通过网络传输过来的触感信息进行分析,判断接收到的触感信息是否存在错码或漏码等问题。如果存在,则将其判定为错误信息;如果信息无误,则将其判定为正确信息。In this example implementation, if the information receiving end receives the next frame of tactile information before timeout, the receiving module will analyze the tactile information transmitted through the network to determine whether there are errors or missing codes in the received tactile information. question. If it exists, it is judged as wrong information; if the information is correct, it is judged as correct information.
在步骤S130中,若在预设间隔时间段内未接收到下一帧触感信息,或者下一帧触感信息为错误信息,则获取预置信息。In step S130, if the next frame of tactile information is not received within the preset interval period, or the next frame of tactile information is error information, preset information is obtained.
本示例实施方式中,如果下一帧触感信息的接收出现超时,或者接收模块判断下一帧触感信息为错误信息,则直接从信息预置模块获取预先生成的预置信息作为替代。In this example implementation, if the reception of the next frame of tactile information times out, or the receiving module determines that the next frame of tactile information is error information, the preset information generated in advance is directly obtained from the information presetting module as an alternative.
在步骤S140中,对预置信息进行解码,并将解码后的预置信息代替下一帧触感信息用于触感复现。In step S140, the preset information is decoded, and the decoded preset information is used to replace the next frame of tactile sensation information for tactile sensation reproduction.
获取预置信息之后,可以将预置信息传递给解码模块进行触感信息的解码,并将解码后的预置信息代替下一帧触感信息用于触感复现。After obtaining the preset information, the preset information can be passed to the decoding module to decode the tactile information, and the decoded preset information can be used to replace the next frame of tactile information for tactile reproduction.
本示例实施方式中,若在预设间隔时间段内接收到下一帧触感信息,且下一帧触感信息为正确信息,则直接对下一帧触感信息进行解码并用于触感复现。In this example implementation, if the next frame of tactile information is received within the preset interval period and the next frame of tactile information is correct information, the next frame of tactile information is directly decoded and used for tactile reproduction.
如果信息接收端在预设间隔时间段内接收到的下一帧触感信息为正确信息,则直接提交给解码模块进行触感信息的解码,进而将其用于触感复现。If the next frame of tactile information received by the information receiving end within the preset interval time period is correct information, it will be directly submitted to the decoding module for decoding of the tactile information, and then used for tactile reproduction.
除此之外,信息预置模块还可以基于从接受模块收到的、正确的触感信息,周期性计算并输出下一帧预置信息备用。In addition, the information preset module can also periodically calculate and output the next frame of preset information based on the correct touch information received from the receiving module.
本示例实施方式中,若信息接收端在预设间隔时间段内接收到的当前触感信息为正确信息,则根据当前触感信息生成预置信息。In this example implementation, if the current tactile information received by the information receiving end within the preset interval period is correct information, the preset information is generated based on the current tactile information.
如果信息接收端在预设间隔时间段内接收到的下一帧触感信息为正确信息,则在提交给解码模块的同时,将其传递给信息预置模块进行预置信息的计算,作为后续信息的备用。预置信息的计算周期为每收到一帧新的、正确的触感信息就计算一次。If the next frame of tactile information received by the information receiving end within the preset interval time period is correct information, it will be submitted to the decoding module and passed to the information presetting module for calculation of preset information as subsequent information. of spare. The calculation cycle of the preset information is calculated every time a frame of new and correct tactile information is received.
与此同时,信息预置模块还可以根据收到的正确触感信息,通过多种方式生成预置信息备用。At the same time, the information preset module can also generate preset information in a variety of ways based on the correct touch information received.
本示例实施方式中,可以直接将当前触感信息作为下一帧触感信息对应的预置信息。In this example implementation, the current touch information can be directly used as the preset information corresponding to the next frame of touch information.
首先,可以直接复用上一帧正确数据生成预置信息,这种方法较为简单,对终端的算力要求最低。预置信息S的计算公式如下:First of all, the correct data of the previous frame can be directly reused to generate preset information. This method is relatively simple and requires the lowest computing power of the terminal. The calculation formula of the preset information S is as follows:
st=st-1 s t =s t-1
本示例实施方式中,还可以获取包含当前触感信息在内的多个历史触感信息,并根据历史触感信息以及各个历史触感信息对应的权重生成预置信息。In this example implementation, multiple historical tactile information including current tactile information can also be obtained, and preset information can be generated based on the historical tactile information and the weight corresponding to each historical tactile information.
其次,可以获取包含当前触感信息在内的多个历史触感信息,然后基于滑动窗口生成预置信息,这种方法也比较简单,对终端的算力要求不高。预置信息S的计算公式如下:
Secondly, multiple historical tactile information including current tactile information can be obtained, and then preset information is generated based on the sliding window. This method is also relatively simple and does not require high computing power of the terminal. The calculation formula of the preset information S is as follows:
其中,t时刻的预置信息St是通过之前L个正常接收的历史触感信息Sn乘以相应的权重Wn之后进行求和得到的,L为滑动窗口大小,Wn为对应之前L个历史触感信息的权重值,滑动窗口大小和权重值可根据需求进行配置。Among them, the preset information S t at time t is obtained by summing the previous L normally received historical touch information Sn multiplied by the corresponding weight W n . L is the sliding window size, and W n is the corresponding previous L history. The weight value of tactile information, sliding window size and weight value can be configured according to needs.
本示例实施方式中,还可以获取包含当前触感信息在内的多个历史触感信息,并基于预设的预测算法以及历史触感信息生成预置信息。In this example implementation, multiple historical tactile information including current tactile information can also be obtained, and preset information is generated based on a preset prediction algorithm and historical tactile information.
另外,还可以基于多元线性回归、时间序列分析等预测算法,以时间为维度,基于多个正确的历史触感信息预测得到相应的预置信息,同时,还可以基于接收到的正确信息对模型进行持续的迭代更新。这种方法恢复信号的准确性更高,同时计算复杂度也更高,因此对终端算力要求较高,可能会在信号接收端引入额外的计算时延。In addition, it can also be based on multiple linear regression, time series analysis and other prediction algorithms, using time as the dimension, and predicting based on multiple correct historical tactile information to obtain corresponding preset information. At the same time, the model can also be modified based on the correct information received. Continuous iterative updates. This method is more accurate in recovering the signal and has higher computational complexity. Therefore, it requires higher computing power on the terminal and may introduce additional computational delay at the signal receiving end.
本示例实施方式中,具体使用哪一种预置信息的生成方法,可以根据信息接收端的终端资源状态确定。In this example implementation, which method of generating preset information is specifically used may be determined based on the terminal resource status of the information receiving end.
选择预置信息的生成方法可能考虑的因素包括:终端算力情况、预置信息准确性要求等。信息接收端进行预置信息计算的具体方案可策略化配置,根据信息接收端的终端资源状态,例如终端算力情况,结合预置信息准确性要求,由系统自动选择合适的方案,也可以通过参数配置以适应不同的应用环境,灵活性强,可操作性好,具有良好的实用性。Factors that may be considered when selecting a method to generate preset information include: terminal computing power, accuracy requirements of preset information, etc. The specific solution for preset information calculation at the information receiving end can be strategically configured. According to the terminal resource status of the information receiving end, such as the terminal computing power, combined with the accuracy requirements of the preset information, the system automatically selects the appropriate solution, or through parameters Configured to adapt to different application environments, it has strong flexibility, good operability and good practicality.
如图4所示是本公开的一个具体实施方式中应用于信息接收端的触感信息的处理方法的完整流程图,是对本示例实施方式中的上述步骤的举例说明,该流程图的具体步骤如下:Figure 4 shows a complete flowchart of a method for processing tactile information applied to the information receiving end in a specific embodiment of the present disclosure. It is an example of the above steps in this exemplary embodiment. The specific steps of the flowchart are as follows:
步骤S410.接收触感信息。Step S410. Receive touch information.
步骤S420.判断触感信息是否正确。Step S420. Determine whether the touch information is correct.
若接收到的触感信息为错误信息,则进入步骤S430;若接收到的触感信息为正确信息,则进入步骤S440,并将信息提交给信息预置模块进行预置信息计算。If the received tactile information is incorrect information, proceed to step S430; if the received tactile information is correct information, proceed to step S440, and submit the information to the information preset module for preset information calculation.
步骤S430.获取预置信息。Step S430. Obtain preset information.
若接收到的触感信息为错误信息,或者由于网络延时等原因造成计时器超时,则从信息预置模块获取预置信息,获取后同样进入步骤S440进行解码。If the received tactile information is error information, or the timer times out due to network delay or other reasons, the preset information is obtained from the information preset module, and after being obtained, step S440 is also entered for decoding.
步骤S440.提交至解码模块。Step S440. Submit to the decoding module.
解码后的触感信息可以用于触感复现。The decoded tactile information can be used for tactile reproduction.
步骤S450.预置信息计算。Step S450. Preset information calculation.
信息预置模块周期性计算新的预置信息,并输出预测的下一帧数据。The information preset module periodically calculates new preset information and outputs the predicted next frame data.
其中,步骤S410至步骤S440由接收模块执行,步骤S450由信息预置模块执行。Among them, steps S410 to S440 are executed by the receiving module, and step S450 is executed by the information presetting module.
应当注意,尽管在附图中以特定顺序描述了本公开中方法的各个步骤,但是,这并 非要求或者暗示必须按照该特定顺序来执行这些步骤,或是必须执行全部所示的步骤才能实现期望的结果。附加的或备选的,可以省略某些步骤,将多个步骤合并为一个步骤执行,以及/或者将一个步骤分解为多个步骤执行等。It should be noted that although the various steps of the methods of the present disclosure are depicted in the drawings in a specific order, this does not necessarily It is not required or implied that the steps must be performed in that particular order, or that all steps shown must be performed to achieve desired results. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step for execution, and/or one step may be decomposed into multiple steps for execution, etc.
进一步的,本公开还提供了一种信息的处理装置,应用于信息接收端。参考图5所示,该信息的处理装置可以包括接收时间判断模块510、错误信息判断模块520、预置信息获取模块530以及预置信息解码模块540。其中:Furthermore, the present disclosure also provides an information processing device, which is applied to the information receiving end. Referring to FIG. 5 , the information processing device may include a reception time judgment module 510 , an error information judgment module 520 , a preset information acquisition module 530 and a preset information decoding module 540 . in:
接收时间判断模块510可以被配置为执行判断信息接收端是否在预设间隔时间段内接收到下一帧触感信息;The reception time determination module 510 may be configured to determine whether the information receiving end receives the next frame of tactile information within a preset interval period;
错误信息判断模块520可以被配置为执行若在预设间隔时间段内接收到下一帧触感信息,则判断下一帧触感信息是否为错误信息;The error information determination module 520 may be configured to determine whether the next frame of tactile information is error information if the next frame of tactile information is received within the preset interval period;
预置信息获取模块530可以被配置为执行若在预设间隔时间段内未接收到下一帧触感信息,或者下一帧触感信息为错误信息,则获取预置信息;The preset information acquisition module 530 may be configured to obtain the preset information if the next frame of tactile information is not received within the preset interval period, or the next frame of tactile information is error information;
预置信息解码模块540可以被配置为执行对预置信息进行解码,并将解码后的预置信息代替下一帧触感信息用于触感复现。The preset information decoding module 540 may be configured to decode the preset information and replace the next frame of tactile sensation information with the decoded preset information for tactile sensation reproduction.
在本公开的一些示例性实施例中,本公开提供的一种信息的处理装置还可以包括触感信息解码模块,可以被配置为执行若在预设间隔时间段内接收到下一帧触感信息,且下一帧触感信息为正确信息,则直接对下一帧触感信息进行解码并用于触感复现。In some exemplary embodiments of the present disclosure, the information processing device provided by the present disclosure may further include a tactile information decoding module, which may be configured to execute if the next frame of tactile information is received within a preset interval period, If the tactile information of the next frame is correct, the tactile information of the next frame is directly decoded and used for tactile reproduction.
在本公开的一些示例性实施例中,本公开提供的一种信息的处理装置还可以包括预置信息生成模块,可以被配置为执行若信息接收端在预设间隔时间段内接收到的当前触感信息为正确信息,则根据当前触感信息生成预置信息。In some exemplary embodiments of the present disclosure, an information processing device provided by the present disclosure may also include a preset information generation module, which may be configured to execute the current information received by the information receiving end within a preset interval period. If the tactile information is correct, preset information is generated based on the current tactile information.
在本公开的一些示例性实施例中,预置信息生成模块可以包括第一预置信息生成单元,可以被配置为执行将当前触感信息作为下一帧触感信息对应的预置信息。In some exemplary embodiments of the present disclosure, the preset information generation module may include a first preset information generation unit, which may be configured to perform using the current touch information as preset information corresponding to the next frame of touch information.
在本公开的一些示例性实施例中,预置信息生成模块可以包括历史触感信息获取单元以及第二预置信息生成单元。其中:In some exemplary embodiments of the present disclosure, the preset information generation module may include a historical touch information acquisition unit and a second preset information generation unit. in:
历史触感信息获取单元可以被配置为执行获取包含当前触感信息在内的多个历史触感信息;The historical tactile information acquisition unit may be configured to acquire a plurality of historical tactile information including current tactile information;
第二预置信息生成单元可以被配置为执行根据历史触感信息以及各个历史触感信息对应的权重生成预置信息。The second preset information generation unit may be configured to generate preset information based on historical tactile information and weights corresponding to each historical tactile information.
在本公开的一些示例性实施例中,预置信息生成模块可以包括历史触感信息获取单元以及第三预置信息生成单元。其中:In some exemplary embodiments of the present disclosure, the preset information generation module may include a historical touch information acquisition unit and a third preset information generation unit. in:
历史触感信息获取单元可以被配置为执行获取包含当前触感信息在内的多个历史触感信息;The historical tactile information acquisition unit may be configured to acquire a plurality of historical tactile information including current tactile information;
第三预置信息生成单元可以被配置为执行基于预设的预测算法以及历史触感信息生成预置信息。The third preset information generating unit may be configured to generate preset information based on a preset prediction algorithm and historical tactile information.
在本公开的一些示例性实施例中,预置信息生成模块还可以包括预置信息生成方法 确定单元,可以被配置为执行根据信息接收端的终端资源状态确定预置信息的生成方法。In some exemplary embodiments of the present disclosure, the preset information generation module may also include a preset information generation method The determining unit may be configured to execute a method for determining the generation of preset information based on the terminal resource status of the information receiving end.
上述信息的处理装置中各模块/单元的具体细节在相应的方法实施例部分已有详细的说明,此处不再赘述。The specific details of each module/unit in the above information processing device have been described in detail in the corresponding method embodiment section, and will not be described again here.
图6示出了适于用来实现本公开实施例的电子设备的计算机系统的结构示意图。FIG. 6 shows a schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present disclosure.
需要说明的是,图6示出的电子设备的计算机系统600仅是一个示例,不应对本公开实施例的功能和使用范围带来任何限制。It should be noted that the computer system 600 of the electronic device shown in FIG. 6 is only an example, and should not impose any restrictions on the functions and scope of use of the embodiments of the present disclosure.
如图6所示,计算机系统600包括中央处理单元(CPU)601,其可以根据存储在只读存储器(ROM)602中的程序或者从存储部分608加载到随机访问存储器(RAM)603中的程序而执行各种适当的动作和处理。在RAM 603中,还存储有系统操作所需的各种程序和数据。CPU 601、ROM 602以及RAM 603通过总线604彼此相连。输入/输出(I/O)接口605也连接至总线604。As shown in FIG. 6 , computer system 600 includes a central processing unit (CPU) 601 that can operate according to a program stored in a read-only memory (ROM) 602 or loaded from a storage portion 608 into a random access memory (RAM) 603 And perform various appropriate actions and processing. In RAM 603, various programs and data required for system operation are also stored. CPU 601, ROM 602 and RAM 603 are connected to each other through bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
以下部件连接至I/O接口605:包括键盘、鼠标等的输入部分606;包括诸如阴极射线管(CRT)、液晶显示器(LCD)等以及扬声器等的输出部分607;包括硬盘等的存储部分608;以及包括诸如LAN卡、调制解调器等的网络接口卡的通信部分609。通信部分609经由诸如因特网的网络执行通信处理。驱动器610也根据需要连接至I/O接口605。可拆卸介质611,诸如磁盘、光盘、磁光盘、半导体存储器等等,根据需要安装在驱动器610上,以便于从其上读出的计算机程序根据需要被安装入存储部分608。The following components are connected to the I/O interface 605: an input section 606 including a keyboard, a mouse, etc.; an output section 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., speakers, etc.; and a storage section 608 including a hard disk, etc. ; and a communication section 609 including a network interface card such as a LAN card, a modem, etc. The communication section 609 performs communication processing via a network such as the Internet. Driver 610 is also connected to I/O interface 605 as needed. Removable media 611, such as magnetic disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on the drive 610 as needed, so that a computer program read therefrom is installed into the storage portion 608 as needed.
特别地,根据本公开的实施例,上文参考流程图描述的过程可以被实现为计算机软件程序。例如,本公开的实施例包括一种计算机程序产品,其包括承载在计算机可读介质上的计算机程序,该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中,该计算机程序可以通过通信部分609从网络上被下载和安装,和/或从可拆卸介质611被安装。在该计算机程序被中央处理单元(CPU)601执行时,执行本公开的系统中限定的各种功能。In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such embodiments, the computer program may be downloaded and installed from the network via communication portion 609, and/or installed from removable media 611. When this computer program is executed by the central processing unit (CPU) 601, various functions defined in the system of the present disclosure are performed.
需要说明的是,本公开所示的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中,计算机可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中,计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可 读介质,该计算机可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输,包括但不限于:无线、电线、光缆、RF等等,或者上述的任意合适的组合。It should be noted that the computer-readable medium shown in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard drive, random access memory (RAM), read only memory (ROM), removable Programmed read-only memory (EPROM or flash memory), fiber optics, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable storage medium other than a computer-readable storage medium. A computer-readable medium that can send, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the foregoing.
附图中的流程图和框图,图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分,上述模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个接连地表示的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图或流程图中的每个方框、以及框图或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more logic functions that implement the specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved. It will also be noted that each block in the block diagram or flowchart illustration, and combinations of blocks in the block diagram or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or operations, or may be implemented by special purpose hardware-based systems that perform the specified functions or operations. Achieved by a combination of specialized hardware and computer instructions.
作为另一方面,本公开还提供了一种计算机可读介质,该计算机可读介质可以是上述实施例中描述的电子设备中所包含的;也可以是单独存在,而未装配入该电子设备中。上述计算机可读介质承载有一个或者多个程序,当上述一个或者多个程序被一个该电子设备执行时,使得该电子设备实现如上述实施例中所述的方法。As another aspect, the present disclosure also provides a computer-readable medium. The computer-readable medium may be included in the electronic device described in the above embodiments; it may also exist independently without being assembled into the electronic device. middle. The computer-readable medium carries one or more programs. When the one or more programs are executed by an electronic device, the electronic device implements the method described in the above embodiments.
应当注意,尽管在上文详细描述中提及了用于动作执行的设备的若干模块,但是这种划分并非强制性的。实际上,根据本公开的实施方式,上文描述的两个或更多模块的特征和功能可以在一个模块中具体化。反之,上文描述的一个模块的特征和功能可以进一步划分为由多个模块来具体化。It should be noted that although several modules of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to embodiments of the present disclosure, the features and functions of two or more modules described above may be embodied in one module. Conversely, the features and functions of a module described above can be further divided into being embodied by multiple modules.
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本公开的其它实施方案。本公开旨在涵盖本公开的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。Other embodiments of the disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the disclosure that follow the general principles of the disclosure and include common common sense or customary technical means in the technical field that are not disclosed in the disclosure. .
应当理解的是,本公开并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限制。 It is to be understood that the present disclosure is not limited to the precise structures described above and illustrated in the accompanying drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the disclosure is limited only by the appended claims.
Claims (10)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211105283.7A CN115484002B (en) | 2022-09-09 | 2022-09-09 | Information processing method, device, electronic device and computer readable medium |
CN202211105283.7 | 2022-09-09 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2024051757A1 true WO2024051757A1 (en) | 2024-03-14 |
Family
ID=84392405
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2023/117331 WO2024051757A1 (en) | 2022-09-09 | 2023-09-06 | Information processing method and apparatus, electronic device and computer readable medium |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN115484002B (en) |
WO (1) | WO2024051757A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115484002B (en) * | 2022-09-09 | 2025-02-28 | 中国电信股份有限公司 | Information processing method, device, electronic device and computer readable medium |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090201247A1 (en) * | 2008-02-12 | 2009-08-13 | Aviles Walter A | Communications with a Haptic Interface Device from a Host Computer |
CN101999235A (en) * | 2008-04-11 | 2011-03-30 | 汤姆逊许可公司 | Staggercasting with temporal scalability |
CN111681408A (en) * | 2020-06-08 | 2020-09-18 | 广东电网有限责任公司电力科学研究院 | Data restoration processing method and device |
CN111949135A (en) * | 2020-08-31 | 2020-11-17 | 福州大学 | Touch communication fault-tolerant method and system based on hybrid prediction |
CN111966226A (en) * | 2020-09-03 | 2020-11-20 | 福州大学 | A fault-tolerant method and system for tactile communication based on compensatory long short-term memory network |
CN112187406A (en) * | 2020-09-25 | 2021-01-05 | 歌尔科技有限公司 | Error correction method, device and medium for true wireless earphone |
CN115484002A (en) * | 2022-09-09 | 2022-12-16 | 中国电信股份有限公司 | Information processing method and device, electronic equipment and computer readable medium |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101504541B (en) * | 2008-02-05 | 2013-07-10 | 夏燕江 | Tactility representation system and method |
US8966520B2 (en) * | 2011-10-03 | 2015-02-24 | Hulu, LLC | Video ad swapping in a video streaming system |
KR101332508B1 (en) * | 2011-11-24 | 2013-11-26 | 김상호 | Apparatus and method of providng advertisement on smartphone |
CN114023020B (en) * | 2021-10-29 | 2023-06-30 | 福州大学 | Touch data hybrid compression system based on data characteristics and improved regression |
-
2022
- 2022-09-09 CN CN202211105283.7A patent/CN115484002B/en active Active
-
2023
- 2023-09-06 WO PCT/CN2023/117331 patent/WO2024051757A1/en unknown
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090201247A1 (en) * | 2008-02-12 | 2009-08-13 | Aviles Walter A | Communications with a Haptic Interface Device from a Host Computer |
CN101999235A (en) * | 2008-04-11 | 2011-03-30 | 汤姆逊许可公司 | Staggercasting with temporal scalability |
CN111681408A (en) * | 2020-06-08 | 2020-09-18 | 广东电网有限责任公司电力科学研究院 | Data restoration processing method and device |
CN111949135A (en) * | 2020-08-31 | 2020-11-17 | 福州大学 | Touch communication fault-tolerant method and system based on hybrid prediction |
CN111966226A (en) * | 2020-09-03 | 2020-11-20 | 福州大学 | A fault-tolerant method and system for tactile communication based on compensatory long short-term memory network |
CN112187406A (en) * | 2020-09-25 | 2021-01-05 | 歌尔科技有限公司 | Error correction method, device and medium for true wireless earphone |
CN115484002A (en) * | 2022-09-09 | 2022-12-16 | 中国电信股份有限公司 | Information processing method and device, electronic equipment and computer readable medium |
Also Published As
Publication number | Publication date |
---|---|
CN115484002B (en) | 2025-02-28 |
CN115484002A (en) | 2022-12-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112771541A (en) | Data compression using integer neural networks | |
CN109697724B (en) | Video image segmentation method and device, storage medium and electronic equipment | |
CN114374440B (en) | Quantum channel classical capacity estimation method and device, electronic equipment and medium | |
WO2016131229A1 (en) | Encoding and decoding method for video image, encoding device, and decoding device | |
US11463697B2 (en) | Method and apparatus for coding video, electronic device and computer-readable storage medium | |
CN113436620A (en) | Model training method, speech recognition method, device, medium and equipment | |
CN111428883A (en) | Backward-based federated modeling method, device, and readable storage medium | |
WO2024051757A1 (en) | Information processing method and apparatus, electronic device and computer readable medium | |
CN111882039A (en) | Physical machine sales data prediction method and device, computer equipment and storage medium | |
CN111382557B (en) | Batch processing method, device, terminal and storage medium for non-fixed-length input data | |
EP3985983A1 (en) | Interpolation filtering method and apparatus for intra-frame prediction, medium, and electronic device | |
US20240251083A1 (en) | Context-based image coding | |
CN109474826B (en) | Picture compression method and device, electronic equipment and storage medium | |
CN119382826A (en) | Data transmission method, electronic device, storage medium and program product | |
CN114071137A (en) | Video coding method and apparatus | |
CN114237962B (en) | Alarm root cause judging method, model training method, device, equipment and medium | |
US11632552B2 (en) | Method and apparatus for coding video, device and medium | |
CN110548285B (en) | Game communication control method and device, medium and electronic equipment | |
CN110209878B (en) | Video processing method and device, computer readable medium and electronic equipment | |
CN114339216A (en) | Video processing method, device, electronic device and storage medium | |
CN112738522A (en) | Video coding method and device | |
CN119299702A (en) | Intra-frame encoding and decoding method, device, equipment and storage medium based on neighborhood features | |
CN113923453B (en) | Time domain filtering method and device for video, electronic equipment and storage medium | |
US12073027B2 (en) | Behavior-based standard operating procedure detection | |
CN114245141B (en) | Video code stream compression method and device based on deep learning |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23862451 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |