CN118522126A - Intelligent reminding interaction system for sitting postures of children - Google Patents
Intelligent reminding interaction system for sitting postures of children Download PDFInfo
- Publication number
- CN118522126A CN118522126A CN202410582722.6A CN202410582722A CN118522126A CN 118522126 A CN118522126 A CN 118522126A CN 202410582722 A CN202410582722 A CN 202410582722A CN 118522126 A CN118522126 A CN 118522126A
- Authority
- CN
- China
- Prior art keywords
- sitting posture
- sitting
- monitoring
- data
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000036544 posture Effects 0.000 title claims abstract description 192
- 230000003993 interaction Effects 0.000 title 1
- 238000012544 monitoring process Methods 0.000 claims abstract description 72
- 230000007613 environmental effect Effects 0.000 claims abstract description 49
- 238000004458 analytical method Methods 0.000 claims abstract description 25
- 238000000034 method Methods 0.000 claims abstract description 20
- 230000008569 process Effects 0.000 claims abstract description 17
- 238000001914 filtration Methods 0.000 claims abstract description 16
- 230000002452 interceptive effect Effects 0.000 claims abstract description 16
- 238000012545 processing Methods 0.000 claims abstract description 16
- 230000009471 action Effects 0.000 claims abstract description 11
- 210000002414 leg Anatomy 0.000 claims abstract description 10
- 210000001217 buttock Anatomy 0.000 claims abstract description 6
- 230000005540 biological transmission Effects 0.000 claims description 13
- 238000004891 communication Methods 0.000 claims description 13
- 230000006870 function Effects 0.000 claims description 10
- 230000008859 change Effects 0.000 claims description 7
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 239000011159 matrix material Substances 0.000 claims description 6
- 238000012806 monitoring device Methods 0.000 claims description 6
- 208000001491 myopia Diseases 0.000 claims description 4
- 230000004379 myopia Effects 0.000 claims description 4
- 238000005070 sampling Methods 0.000 claims description 4
- 230000003321 amplification Effects 0.000 claims description 3
- 238000000691 measurement method Methods 0.000 claims description 3
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 3
- 239000012535 impurity Substances 0.000 claims 5
- 238000005516 engineering process Methods 0.000 abstract description 3
- 238000001514 detection method Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 210000002435 tendon Anatomy 0.000 description 4
- 210000005036 nerve Anatomy 0.000 description 2
- 229920001296 polysiloxane Polymers 0.000 description 2
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 1
- 208000000875 Spinal Curvatures Diseases 0.000 description 1
- 208000020307 Spinal disease Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 231100000862 numbness Toxicity 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 230000010399 physical interaction Effects 0.000 description 1
- 230000029058 respiratory gaseous exchange Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 210000000278 spinal cord Anatomy 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 210000001519 tissue Anatomy 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/24—Reminder alarms, e.g. anti-loss alarms
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
- G01D21/00—Measuring or testing not otherwise provided for
- G01D21/02—Measuring two or more variables by means not covered by a single other subclass
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/10—Pre-processing; Data cleansing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B31/00—Predictive alarm systems characterised by extrapolation or other computation using updated historic data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
- H04M1/72412—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Biology (AREA)
- Emergency Management (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Computing Systems (AREA)
- Human Computer Interaction (AREA)
- Telephonic Communication Services (AREA)
Abstract
本发明公开了一种儿童坐姿智能提醒互动系统,涉及智能提醒技术领域,包括坐姿监测单元和结果展示单元,数据采集单元,所述数据采集单元通过压力坐垫实时采集坐姿信息,采集坐立时臀部和腿部压力分布数据,首先将原始数据通过滤波算法进行预处理,再对坐姿动作类型识别,分析当前坐姿状态,同时实时采集环境参数,对采集到的温度、湿度、光强参数进行阈值判断分析,分析坐立过程中的环境情况。本发明将坐姿状态数据和环境参数上传至云端服务器进行分析处理,并将分析结果通过网络传至手机APP客户端,以图表的形式显示在客户端,实时显示当前坐姿和环境情况,及时提醒儿童纠正不良坐姿和调整环境。
The present invention discloses an interactive system for intelligent reminder of children's sitting posture, which relates to the field of intelligent reminder technology, including a sitting posture monitoring unit and a result display unit, and a data acquisition unit. The data acquisition unit collects sitting posture information in real time through a pressure cushion, collects the pressure distribution data of the buttocks and legs when sitting, first pre-processes the original data through a filtering algorithm, then identifies the sitting posture action type, analyzes the current sitting posture state, and collects environmental parameters in real time, performs threshold judgment analysis on the collected temperature, humidity, and light intensity parameters, and analyzes the environmental conditions during the sitting process. The present invention uploads the sitting posture state data and environmental parameters to a cloud server for analysis and processing, and transmits the analysis results to a mobile phone APP client through the network, and displays them on the client in the form of a chart, displays the current sitting posture and environmental conditions in real time, and promptly reminds children to correct bad sitting postures and adjust the environment.
Description
技术领域Technical Field
本发明涉及智能提醒技术领域,具体为一种儿童坐姿智能提醒互动系统。The present invention relates to the technical field of intelligent reminders, and in particular to an interactive system for intelligent reminders of children's sitting postures.
背景技术Background Art
坐姿长时间不规范将对人体健康造成一定的危害,长期处于不良坐姿如果不加以调整,将会导致人体局部组织、器官、神经和劲椎等受力不均衡,更将会产生很多危害,如毛细血管堵塞、神经麻木、各种劲椎类疾病,儿童的成长过程中,绝大多数事件处于坐着写或者阅读的状态,正确的坐姿不仅可以预防近视和劲椎弯曲,也会产生最佳的呼吸结果,更能有效保持活力和专注力,提高学习的效率,在申请号为201810181547.4的专利中公开了“一种儿童坐姿检测智能交互装置系统及方法,属于人体坐姿检测及交互技术领域,包括底座、深度摄像头、中央处理芯片、电机控制板、左电机、右电机、中电机、左弹簧、右弹簧、中弹簧、左腱绳、右腱绳、中腱绳、硅胶外壳、底板、顶板、LED灯环、扬声器、终端APP,本发明装置采用深度摄像头、多个电机、弹簧、腱绳、硅胶外壳和终端APP等综合实现了儿童坐姿检测和交互功能。”Long-term improper sitting posture will cause certain harm to human health. If you do not adjust the bad sitting posture for a long time, it will lead to uneven force on local tissues, organs, nerves and spinal cord, and will cause many harms, such as capillary blockage, nerve numbness, and various spinal diseases. During the growth of children, most of the time they are sitting to write or read. The correct sitting posture can not only prevent myopia and spinal curvature, but also produce the best breathing results, and can more effectively maintain vitality and concentration, and improve learning efficiency. Patent No. 547.4 discloses "a child sitting posture detection intelligent interactive device system and method, belonging to the field of human sitting posture detection and interactive technology, including a base, a depth camera, a central processing chip, a motor control board, a left motor, a right motor, a middle motor, a left spring, a right spring, a middle spring, a left tendon rope, a right tendon rope, a middle tendon rope, a silicone shell, a bottom plate, a top plate, an LED light ring, a speaker, and a terminal APP. The device of the present invention uses a depth camera, multiple motors, springs, tendons, silicone shells, and terminal APPs to comprehensively realize the child sitting posture detection and interactive functions."
上述文件能够实时检测儿童坐姿的角度,还能通过装置实时模拟出儿童的姿态进行声光提醒,形成有趣的实时实体交互和短期激励,然而,儿童坐姿会受到多种因素的影响,天阴状态光线昏暗的情况下,儿童阅读可能根据光线改变坐姿,另外,外界温度降低或者湿度增大,孩童倾向于蜷缩,容易形成不良坐姿,所以孩童处于相对舒适的坐姿环境中很重要,坐姿种类具有多种情形,如果不针对性的对各种不良坐姿进行统计再以可视化的形式出现在用户眼前,难以针对性矫正,适用性不高。The above-mentioned document can detect the angle of the child's sitting posture in real time, and can also simulate the child's posture in real time through the device for sound and light reminders, forming interesting real-time physical interaction and short-term incentives. However, the child's sitting posture will be affected by many factors. When it is cloudy and the light is dim, the child may change his sitting posture according to the light when reading. In addition, when the outside temperature drops or the humidity increases, children tend to curl up and easily form a bad sitting posture. Therefore, it is important for children to be in a relatively comfortable sitting environment. There are many types of sitting postures. If various bad sitting postures are not specifically counted and then presented to the user in a visual form, it is difficult to correct them in a targeted manner and the applicability is not high.
发明内容Summary of the invention
本发明的目的在于提供一种儿童坐姿智能提醒互动系统,以解决上述背景技术中提出的问题。The purpose of the present invention is to provide a children's sitting posture intelligent reminder interactive system to solve the problems raised in the above background technology.
为实现上述目的,本发明提供如下技术方案:一种儿童坐姿智能提醒互动系统,包括坐姿监测单元和结果展示单元;To achieve the above-mentioned purpose, the present invention provides the following technical solutions: a child sitting posture intelligent reminder interactive system, comprising a sitting posture monitoring unit and a result display unit;
数据采集单元,所述数据采集单元通过压力坐垫实时采集坐姿信息,采集坐立时臀部和腿部压力分布数据,首先将原始数据通过滤波算法进行预处理,再对坐姿动作类型识别,分析当前坐姿状态,同时实时采集环境参数,对采集到的温度、湿度、光强参数进行阈值判断分析,分析坐立过程中的环境情况,并采用坐姿动作识别与分析算法把坐姿状态划分为标准坐姿和不良坐姿。A data acquisition unit, wherein the data acquisition unit collects sitting posture information in real time through a pressure cushion, collects pressure distribution data of the buttocks and legs when sitting, first pre-processes the original data through a filtering algorithm, then identifies the sitting posture action type, analyzes the current sitting posture state, and simultaneously collects environmental parameters in real time, performs threshold judgment analysis on the collected temperature, humidity, and light intensity parameters, analyzes the environmental conditions during the sitting process, and uses a sitting posture action recognition and analysis algorithm to divide the sitting posture state into a standard sitting posture and a bad sitting posture.
数据传输单元,所述数据传输单元通过通讯传输模块将实时采集到的坐姿压力分布数据和环境参数传输到云端服务器进行分析处理。The data transmission unit transmits the sitting pressure distribution data and environmental parameters collected in real time to the cloud server for analysis and processing through the communication transmission module.
坐姿提醒单元,所述坐姿提醒单元监测儿童坐姿并获取全程监测数据,将结果展示给用户后,与使用的儿童进行交互,通过语音和文字的方式提醒用户调整坐姿和环境参数。A sitting posture reminder unit monitors the sitting posture of the child and obtains full monitoring data. After displaying the results to the user, the unit interacts with the child using the device and reminds the user to adjust the sitting posture and environmental parameters through voice and text.
坐姿记录单元,所述坐姿记录单元监测完成后,在手机APP上显示儿童监测过程中的历史记录,期间通过摄像头拍摄了整体坐姿的详细情况,包括每种坐姿的次数、监测时长、微动作详情和环境参数的记录信息,方便对儿童的坐姿进行观察和对比以矫正坐姿。The sitting posture recording unit displays the historical records of the child during the monitoring process on the mobile phone APP after the monitoring is completed. During the period, the detailed situation of the overall sitting posture is captured by the camera, including the number of times each sitting posture is used, the monitoring time, the details of micro-movements and the recording information of environmental parameters, so as to facilitate the observation and comparison of the child's sitting posture to correct the sitting posture.
优选的,所述数据采集单元包括坐姿压力采集模块和环境参数采集模块,所述坐姿压力采集模块采用柔性阵列压力传感器采集压力分布信息,坐姿压力分布信号由一个60行*60列的压力矩阵表示,压力大小对应着矩阵上点的数值0~255区间内的变化,根据滤波算法对非杂点进行均值滤波处理,对孤立杂点直接滤除,按照顺序扫描当前压力垫采集一帧的所有压力点数据,构建滤波模板,统计模板中具有压力值的压力点总个数,若此类压力点的总个数为4个以上,则该压力点判断为非杂点,否则判定为杂点,根据当前坐姿情况判别正常坐姿和不良坐姿,不良坐姿分为前倾、后倾、左倾、右倾、抖腿、翘腿和离座,所述环境参数采集模块通过光强传感器、温度传感器和湿度传感器采集环境参数,其中光强传感器用来检测坐姿过程中光线的变化,提醒儿童及时调整光强,指导正确用光,调整坐姿以降低近视发生率,通过温度传感器和湿度传感器检测坐姿过程中的温度、湿度的变化情况,提醒儿童调整环境参数,使儿童处于相对舒适的坐姿环境,提高学习效率,分析这些参数准确判别儿童坐立过程中的环境情况。Preferably, the data acquisition unit includes a sitting pressure acquisition module and an environmental parameter acquisition module. The sitting pressure acquisition module uses a flexible array pressure sensor to collect pressure distribution information. The sitting pressure distribution signal is represented by a 60-row*60-column pressure matrix. The pressure size corresponds to the change in the numerical value of the point on the matrix within the range of 0 to 255. The non-noise points are processed by mean filtering according to the filtering algorithm, and the isolated noise points are directly filtered out. The current pressure pad is scanned in sequence to collect all pressure point data of one frame, and a filtering template is constructed. The total number of pressure points with pressure values in the template is counted. If the total number of such pressure points is more than 4, the pressure point is judged as a non-noise point, otherwise it is judged as a noise point. point, and distinguish normal sitting posture and bad sitting posture according to the current sitting posture. Bad sitting posture is divided into forward leaning, backward leaning, left leaning, right leaning, shaking legs, crossing legs and leaving the seat. The environmental parameter acquisition module collects environmental parameters through light intensity sensors, temperature sensors and humidity sensors. The light intensity sensor is used to detect changes in light during sitting, remind children to adjust the light intensity in time, guide correct use of light, and adjust sitting posture to reduce the incidence of myopia. The temperature and humidity changes during sitting are detected by temperature sensors and humidity sensors, and children are reminded to adjust environmental parameters, so that children are in a relatively comfortable sitting environment and improve learning efficiency. These parameters are analyzed to accurately determine the environmental conditions of children during sitting.
优选的,所述数据采集单元还包括信号处理模块,所述信号处理模块包括信号放大和A/D转换,所述柔性阵列传感器是压阻式,通过信号采集将柔性阵列传感器输出转化成电压信号,最终转换成压力值,将频率低且微弱的坐姿信号进行放大处理,再通过ADC做A/D转换,并采用二次测量法对柔性阵列传感器进行扫描,利用放大器输入端在同一时间下将一行和一列分别被选中与ADC连接,通过地址的循环依次得到每个节点的实时受力情况。Preferably, the data acquisition unit also includes a signal processing module, which includes signal amplification and A/D conversion. The flexible array sensor is a piezoresistive type. The output of the flexible array sensor is converted into a voltage signal through signal acquisition, and finally converted into a pressure value. The low-frequency and weak sitting posture signal is amplified and processed, and then A/D conversion is performed through ADC. The flexible array sensor is scanned by a secondary measurement method, and a row and a column are selected and connected to the ADC at the same time using the amplifier input end, and the real-time force condition of each node is obtained in turn through the address cycle.
优选的,所述数据传输单元包括蓝牙通信模块和调试串口模块,所述蓝牙通信模块将采集到的环境光与温湿度数据传送至MCU进行数据处理,再和坐姿压力分布数据一起上传至云端服务器进行分析,所述调试串口模块作为调试助手,将蓝牙通信模块未传输的数据进行完善处理。Preferably, the data transmission unit includes a Bluetooth communication module and a debugging serial port module. The Bluetooth communication module transmits the collected ambient light and temperature and humidity data to the MCU for data processing, and then uploads them together with the sitting pressure distribution data to the cloud server for analysis. The debugging serial port module serves as a debugging assistant to complete the processing of the data not transmitted by the Bluetooth communication module.
优选的,所述坐姿监测单元包括参数调节模块和设备连接模块,所述参数调节模块对坐姿监测过程中温度、湿度、光强的报警阈值进行设置,服务器根据用户设置的阈值对环境检测模块所采集到的数据进行判断,若采集到的环境参数不在设置的阈值内,给出预警提醒用户调整环境,若用户没有进行设置,服务器根据默认阈值进行判别,并且设置坐姿监测过程中采集设备的采样频率,让用户自主设置提醒时间,所述设备连接模块通过设置坐姿监测设备的IP号和端口号,当用户通过手机APP连接设备时,会根据输入的IP号和端口号与设备进行连接,控制设备运行。Preferably, the sitting posture monitoring unit includes a parameter adjustment module and a device connection module. The parameter adjustment module sets the alarm thresholds of temperature, humidity and light intensity during the sitting posture monitoring process. The server judges the data collected by the environment detection module according to the thresholds set by the user. If the collected environmental parameters are not within the set thresholds, an early warning is given to remind the user to adjust the environment. If the user does not set it, the server judges according to the default threshold and sets the sampling frequency of the collection device during the sitting posture monitoring process, allowing the user to set the reminder time independently. The device connection module sets the IP number and port number of the sitting posture monitoring device. When the user connects to the device through a mobile phone APP, it will connect to the device according to the input IP number and port number to control the operation of the device.
优选的,所述坐姿监测单元还包括运行控制模块,所述运行控制模块使用户通过设备连接功能与坐姿监测采集设备进行连接,手机APP根据输入的IP号和端口号与监测设备进行连接,之后对设备进行相关的控制,包括开始监测和停止监测,开始监测用于控制设备开启采集功能,实时监测坐姿情况,停止监测用于控制设备关闭采集功能,关闭监测坐姿情况。Preferably, the sitting posture monitoring unit also includes an operation control module, which enables the user to connect to the sitting posture monitoring and collection device through the device connection function. The mobile phone APP connects to the monitoring device according to the input IP number and port number, and then performs relevant controls on the device, including starting monitoring and stopping monitoring. Starting monitoring is used to control the device to turn on the collection function and monitor the sitting posture in real time. Stopping monitoring is used to control the device to turn off the collection function and turn off monitoring of the sitting posture.
优选的,所述结果展示单元将与儿童相关的坐姿特征数据通过手机APP进行绑定,所有实时测得的数据将通过网络传至手机APP客户端,且分析结果以图表的形式显示在客户端。Preferably, the result display unit will bind the sitting posture characteristic data related to the child through a mobile phone APP, all real-time measured data will be transmitted to the mobile phone APP client through the network, and the analysis results will be displayed on the client in the form of charts.
优选的,所述坐姿提醒单元中如果打开语音提醒,在坐姿监测的过程中如果儿童坐姿不正确,则通过语音播报当前坐姿不良,提醒用户及时纠正坐姿,如果关闭语音提醒,在坐姿监测过程中,所述坐姿记录单元对坐姿期间的相关信息以图表的形式进行显示,其中以饼状图的形式对监测时长和不良坐姿进行统计,以折线图的形式对环境参数进行连续统计,以文字形式对监测过程中出现频率高的微动作的详情进行叙述说明。Preferably, if the voice reminder is turned on in the sitting posture reminder unit, if the child's sitting posture is incorrect during the sitting posture monitoring process, the current bad sitting posture will be announced through voice to remind the user to correct the sitting posture in time. If the voice reminder is turned off, during the sitting posture monitoring process, the sitting posture recording unit will display the relevant information during the sitting posture in the form of a chart, wherein the monitoring time and bad sitting posture are counted in the form of a pie chart, the environmental parameters are continuously counted in the form of a line graph, and the details of the micro-movements that appear frequently during the monitoring process are described in text.
滤波算法具体为:The specific filtering algorithm is:
其中,fij为原始采集数据,gij为滤波后的数据,M为该模板中包含当前像素在内的像素总个数。Among them, fij is the original collected data, gij is the filtered data, and M is the total number of pixels in the template including the current pixel.
与现有技术相比,本发明的有益效果是:Compared with the prior art, the present invention has the following beneficial effects:
1、本发明通过数据采集单元采集坐立时臀部和腿部压力分布数据,再对坐姿动作类型识别,分析当前坐姿状态,并实时采集环境参数,对采集得到的温度、湿度、光强参数进行阈值判断分析,分析坐立过程中的环境情况,通过数据传输单元将坐姿状态数据和环境参数上传至云端服务器进行分析处理,并将分析结果通过网络传至手机APP客户端,以图表的形式显示在客户端,实时显示当前坐姿和环境情况,及时提醒儿童纠正不良坐姿和调整环境。1. The present invention collects the pressure distribution data of the buttocks and legs when sitting through the data acquisition unit, then identifies the sitting action type, analyzes the current sitting state, and collects environmental parameters in real time, performs threshold judgment analysis on the collected temperature, humidity, and light intensity parameters, analyzes the environmental conditions during the sitting process, uploads the sitting state data and environmental parameters to the cloud server through the data transmission unit for analysis and processing, and transmits the analysis results to the mobile phone APP client through the network, and displays them in the client in the form of a chart, showing the current sitting posture and environmental conditions in real time, and promptly reminding children to correct bad sitting postures and adjust the environment.
2、本发明通过坐姿监测单元监测儿童整个坐姿过程中的状态,根据设置的阈值判断预警提醒,从而及时告知用户实时环境状态以及坐姿状态,或者根据实际情况用户自主设置提醒时间从而不影响儿童当前的做事状态,另外通过坐姿提醒单元选择提醒类别,选择实时语音播报还是存储记录在手机APP中之后进行自主查看,通过坐姿记录单元记录每种坐姿的次数、监测时长、微动作详情和环境参数,方便对儿童的坐姿进行观察和对比以矫正坐姿。2. The present invention monitors the state of the child in the entire sitting process through a sitting posture monitoring unit, and determines the early warning reminder according to the set threshold value, so as to timely inform the user of the real-time environmental status and sitting posture status, or the user can independently set the reminder time according to the actual situation so as not to affect the child's current work status. In addition, the sitting posture reminder unit selects the reminder category, and selects real-time voice broadcast or storage and recording in the mobile phone APP for independent review. The sitting posture recording unit records the number of times of each sitting posture, monitoring time, micro-movement details and environmental parameters, which is convenient for observing and comparing the child's sitting posture to correct the sitting posture.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本发明实施例提供整体系统流程示意图FIG. 1 is a schematic diagram of the overall system flow diagram of an embodiment of the present invention.
图2为本发明实施例提供的数据采集单元的内部模块框图;FIG2 is a block diagram of internal modules of a data acquisition unit provided by an embodiment of the present invention;
图3为本发明实施例提供的数据传输单元的内部模块框图;3 is a block diagram of internal modules of a data transmission unit provided in an embodiment of the present invention;
图4为本发明实施例提供的坐姿监测单元的内部模块框图。FIG. 4 is a block diagram of internal modules of a sitting posture monitoring unit provided in an embodiment of the present invention.
图中:1、数据采集单元;101、坐姿压力采集模块;102、环境参数采集模块;103、信号处理模块;2、数据传输单元;201、蓝牙通信模块;202、调试串口模块;3、坐姿监测单元;301、参数调节模块;302、设备连接模块;303、运行控制模块;4、结果展示单元;5、坐姿提醒单元;6、坐姿记录单元。In the figure: 1. Data acquisition unit; 101. Sitting pressure acquisition module; 102. Environmental parameter acquisition module; 103. Signal processing module; 2. Data transmission unit; 201. Bluetooth communication module; 202. Debug serial port module; 3. Sitting monitoring unit; 301. Parameter adjustment module; 302. Equipment connection module; 303. Operation control module; 4. Result display unit; 5. Sitting reminder unit; 6. Sitting recording unit.
具体实施方式DETAILED DESCRIPTION
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
请参阅图1-4,本发明提供一种技术方案:一种儿童坐姿智能提醒互动系统,包括坐姿监测单元3和结果展示单元4;Please refer to Figures 1-4, the present invention provides a technical solution: a child sitting posture intelligent reminder interactive system, including a sitting posture monitoring unit 3 and a result display unit 4;
数据采集单元1,数据采集单元1通过压力坐垫实时采集坐姿信息,采集坐立时臀部和腿部压力分布数据,首先将原始数据通过滤波算法进行预处理,再对坐姿动作类型识别,分析当前坐姿状态,同时实时采集环境参数,对采集到的温度、湿度、光强参数进行阈值判断分析,分析坐立过程中的环境情况,并采用坐姿动作识别与分析算法把坐姿状态划分为标准坐姿和不良坐姿。Data acquisition unit 1, data acquisition unit 1 collects sitting posture information in real time through a pressure cushion, collects the pressure distribution data of the buttocks and legs when sitting, first pre-processes the original data through a filtering algorithm, then identifies the sitting posture action type, analyzes the current sitting posture state, and collects environmental parameters in real time, performs threshold judgment analysis on the collected temperature, humidity, and light intensity parameters, analyzes the environmental conditions during the sitting process, and uses a sitting posture action recognition and analysis algorithm to divide the sitting posture state into standard sitting posture and poor sitting posture.
数据传输单元2,数据传输单元2通过通讯传输模块将实时采集到的坐姿压力分布数据和环境参数传输到云端服务器进行分析处理。The data transmission unit 2 transmits the real-time collected sitting pressure distribution data and environmental parameters to the cloud server for analysis and processing through the communication transmission module.
坐姿提醒单元5,坐姿提醒单元4监测儿童坐姿并获取全程监测数据,将结果展示给用户后,与使用的儿童进行交互,通过语音和文字的方式提醒用户调整坐姿和环境参数。The sitting posture reminder unit 5 and the sitting posture reminder unit 4 monitor the sitting posture of the child and obtain the whole monitoring data, and after displaying the result to the user, interact with the child using the device, and remind the user to adjust the sitting posture and environmental parameters by voice and text.
坐姿记录单元6,坐姿记录单元5监测完成后,在手机APP上显示儿童监测过程中的历史记录,期间通过摄像头拍摄了整体坐姿的详细情况,包括每种坐姿的次数、监测时长、微动作详情和环境参数的记录信息,方便对儿童的坐姿进行观察和对比以矫正坐姿。After the sitting posture recording unit 6 and the sitting posture recording unit 5 complete the monitoring, the historical records of the child during the monitoring process are displayed on the mobile phone APP. During the period, the detailed situation of the overall sitting posture is captured by the camera, including the number of times of each sitting posture, monitoring time, micro-movement details and recording information of environmental parameters, so as to facilitate the observation and comparison of the child's sitting posture in order to correct the sitting posture.
数据采集单元1包括坐姿压力采集模块101和环境参数采集模块102,坐姿压力采集模块101采用柔性阵列压力传感器采集压力分布信息,坐姿压力分布信号由一个60行*60列的压力矩阵表示,压力大小对应着矩阵上点的数值0~255区间内的变化,根据滤波算法对非杂点进行均值滤波处理,对孤立杂点直接滤除,按照顺序扫描当前压力垫采集一帧的所有压力点数据,构建滤波模板,统计模板中具有压力值的压力点总个数,若此类压力点的总个数为4个以上,则该压力点判断为非杂点,否则判定为杂点,根据当前坐姿情况判别正常坐姿和不良坐姿,不良坐姿分为前倾、后倾、左倾、右倾、抖腿、翘腿和离座,环境参数采集模块102通过光强传感器、温度传感器和湿度传感器采集环境参数,其中光强传感器用来检测坐姿过程中光线的变化,提醒儿童及时调整光强,指导正确用光,调整坐姿以降低近视发生率,通过温度传感器和湿度传感器检测坐姿过程中的温度、湿度的变化情况,提醒儿童调整环境参数,使儿童处于相对舒适的坐姿环境,提高学习效率,分析这些参数准确判别儿童坐立过程中的环境情况;The data acquisition unit 1 includes a sitting pressure acquisition module 101 and an environmental parameter acquisition module 102. The sitting pressure acquisition module 101 uses a flexible array pressure sensor to collect pressure distribution information. The sitting pressure distribution signal is represented by a 60-row*60-column pressure matrix. The pressure size corresponds to the change in the value of the point on the matrix within the range of 0 to 255. The non-noise points are processed by mean filtering according to the filtering algorithm, and the isolated noise points are directly filtered out. The current pressure pad is scanned in sequence to collect all pressure point data of one frame, and a filtering template is constructed. The total number of pressure points with pressure values in the template is counted. If the total number of such pressure points is more than 4, the pressure point is judged as a non-noise point, otherwise it is judged as Miscellaneous points, according to the current sitting posture, normal sitting posture and bad sitting posture are judged. Bad sitting posture is divided into forward leaning, backward leaning, left leaning, right leaning, shaking legs, crossing legs and leaving the seat. The environmental parameter acquisition module 102 collects environmental parameters through light intensity sensors, temperature sensors and humidity sensors. The light intensity sensor is used to detect the change of light during the sitting process, remind children to adjust the light intensity in time, guide the correct use of light, and adjust the sitting posture to reduce the incidence of myopia. The temperature and humidity changes during the sitting process are detected by the temperature sensor and the humidity sensor, and the children are reminded to adjust the environmental parameters, so that the children are in a relatively comfortable sitting environment, improve learning efficiency, and analyze these parameters to accurately judge the environmental conditions of children during sitting;
数据采集单元1还包括信号处理模块103,信号处理模块103包括信号放大和A/D转换,柔性阵列传感器是压阻式,通过信号采集将柔性阵列传感器输出转化成电压信号,最终转换成压力值,将频率低且微弱的坐姿信号进行放大处理,再通过ADC做A/D转换,并采用二次测量法对柔性阵列传感器进行扫描,利用放大器输入端在同一时间下将一行和一列分别被选中与ADC连接,通过地址的循环依次得到每个节点的实时受力情况;The data acquisition unit 1 also includes a signal processing module 103, which includes signal amplification and A/D conversion. The flexible array sensor is a piezoresistive type. The output of the flexible array sensor is converted into a voltage signal through signal acquisition, and finally converted into a pressure value. The low-frequency and weak sitting posture signal is amplified and processed, and then A/D conversion is performed through ADC. The flexible array sensor is scanned by a secondary measurement method. A row and a column are selected and connected to the ADC at the same time using the amplifier input end, and the real-time force condition of each node is obtained in turn through the address cycle;
数据传输单元2包括蓝牙通信模块201和调试串口模块202,蓝牙通信模块201将采集到的环境光与温湿度数据传送至MCU进行数据处理,再和坐姿压力分布数据一起上传至云端服务器进行分析,调试串口模块202作为调试助手,将蓝牙通信模块201未传输的数据进行完善处理;The data transmission unit 2 includes a Bluetooth communication module 201 and a debugging serial port module 202. The Bluetooth communication module 201 transmits the collected ambient light and temperature and humidity data to the MCU for data processing, and then uploads it together with the sitting pressure distribution data to the cloud server for analysis. The debugging serial port module 202 serves as a debugging assistant to improve the data not transmitted by the Bluetooth communication module 201.
坐姿监测单元3包括参数调节模块301和设备连接模块302,参数调节模块301对坐姿监测过程中温度、湿度、光强的报警阈值进行设置,服务器根据用户设置的阈值对环境检测模块所采集到的数据进行判断,若采集到的环境参数不在设置的阈值内,给出预警提醒用户调整环境,若用户没有进行设置,服务器根据默认阈值进行判别,并且设置坐姿监测过程中采集设备的采样频率,让用户自主设置提醒时间,设备连接模块302通过设置坐姿监测设备的IP号和端口号,当用户通过手机APP连接设备时,会根据输入的IP号和端口号与设备进行连接,控制设备运行;The sitting posture monitoring unit 3 includes a parameter adjustment module 301 and a device connection module 302. The parameter adjustment module 301 sets the alarm thresholds of temperature, humidity and light intensity during the sitting posture monitoring process. The server judges the data collected by the environment detection module according to the thresholds set by the user. If the collected environmental parameters are not within the set thresholds, an early warning is given to remind the user to adjust the environment. If the user does not set it, the server judges according to the default threshold and sets the sampling frequency of the collection device during the sitting posture monitoring process, allowing the user to set the reminder time independently. The device connection module 302 sets the IP number and port number of the sitting posture monitoring device. When the user connects to the device through the mobile phone APP, it will connect to the device according to the input IP number and port number to control the operation of the device;
坐姿监测单元3还包括运行控制模块303,运行控制模块303使用户通过设备连接功能与坐姿监测采集设备进行连接,手机APP根据输入的IP号和端口号与监测设备进行连接,之后对设备进行相关的控制,包括开始监测和停止监测,开始监测用于控制设备开启采集功能,实时监测坐姿情况,停止监测用于控制设备关闭采集功能,关闭监测坐姿情况;The sitting posture monitoring unit 3 also includes an operation control module 303. The operation control module 303 enables the user to connect to the sitting posture monitoring and collecting device through the device connection function. The mobile phone APP connects to the monitoring device according to the input IP number and port number, and then performs relevant control on the device, including starting monitoring and stopping monitoring. Starting monitoring is used to control the device to start the collection function and monitor the sitting posture in real time. Stopping monitoring is used to control the device to turn off the collection function and turn off the monitoring of the sitting posture.
结果展示单元4将与儿童相关的坐姿特征数据通过手机APP进行绑定,所有实时测得的数据将通过网络传至手机APP客户端,且分析结果以图表的形式显示在客户端;The result display unit 4 binds the sitting posture characteristic data related to the child through the mobile phone APP, and all the real-time measured data will be transmitted to the mobile phone APP client through the network, and the analysis results will be displayed on the client in the form of charts;
坐姿提醒单元5中如果打开语音提醒,在坐姿监测的过程中如果儿童坐姿不正确,则通过语音播报当前坐姿不良,提醒用户及时纠正坐姿,如果关闭语音提醒,在坐姿监测过程中,坐姿记录单元6对坐姿期间的相关信息以图表的形式进行显示,其中以饼状图的形式对监测时长和不良坐姿进行统计,以折线图的形式对环境参数进行连续统计,以文字形式对监测过程中出现频率高的微动作的详情进行叙述说明;If the voice reminder is turned on in the sitting posture reminder unit 5, if the child's sitting posture is incorrect during the sitting posture monitoring process, the current bad sitting posture will be announced by voice to remind the user to correct the sitting posture in time. If the voice reminder is turned off, during the sitting posture monitoring process, the sitting posture recording unit 6 displays the relevant information during the sitting posture in the form of a chart, in which the monitoring time and bad sitting posture are counted in the form of a pie chart, the environmental parameters are continuously counted in the form of a line chart, and the details of the micro-movements that appear frequently during the monitoring process are described in text form;
滤波算法具体为:The specific filtering algorithm is:
其中,fij为原始采集数据,gij为滤波后的数据,M为该模板中包含当前像素在内的像素总个数;Among them, fij is the original collected data, gij is the filtered data, and M is the total number of pixels in the template including the current pixel;
坐姿动作识别算法具体为:The specific sitting posture action recognition algorithm is as follows:
其中,N为采集的样本总数,M为分类类别的数量,c为M种类别中的其中一种,yic的取值为当样本i与真实类别c相同时取1否则取0,pic为观测样本i属于类别c的概率。Where N is the total number of samples collected, M is the number of classification categories, c is one of the M categories, the value of y ic is 1 when sample i is the same as the true category c, otherwise it is 0, and pic is the probability that the observed sample i belongs to category c.
工作原理:本发明通过数据采集单元1通过压力坐垫实时采集坐姿信息,采集坐立时臀部和腿部压力分布数据,将原始数据通过滤波算法进行预处理,再对坐姿动作类型识别,分析当前坐姿状态,同时实时采集环境参数,对采集到的温度、湿度、光强参数进行阈值判断分析,分析坐立过程中的环境情况,并采用坐姿动作识别与分析算法把坐姿状态划分为标准坐姿和不良坐姿,通过数据传输单元2将实时采集到的坐姿压力分布数据和环境参数传输到云端服务器进行分析处理,通过坐姿监测单元3对坐姿监测过程中温度、湿度、光强的报警阈值进行设置,服务器根据用户设置的阈值对环境检测模块所采集到的数据进行判断,若采集到的环境参数不在设置的阈值内,给出预警提醒用户调整环境,若用户没有进行设置,服务器根据默认阈值进行判别,并且设置坐姿监测过程中采集设备的采样频率,通过IP号和端口号与监测设备进行连接,之后对设备进行相关的控制,让用户自主设置提醒时间;Working principle: The present invention collects sitting posture information in real time through a pressure cushion through a data acquisition unit 1, collects the pressure distribution data of the buttocks and legs when sitting, pre-processes the original data through a filtering algorithm, and then identifies the sitting posture action type, analyzes the current sitting posture state, and collects environmental parameters in real time, performs threshold judgment analysis on the collected temperature, humidity, and light intensity parameters, analyzes the environmental conditions during the sitting process, and uses a sitting posture action recognition and analysis algorithm to divide the sitting posture state into a standard sitting posture and a bad sitting posture, and transmits the real-time collected sitting posture pressure distribution data and environmental parameters to a cloud server for analysis and processing through a data transmission unit 2, sets the alarm thresholds of temperature, humidity, and light intensity during the sitting posture monitoring process through a sitting posture monitoring unit 3, and the server judges the data collected by the environmental detection module according to the threshold set by the user. If the collected environmental parameters are not within the set threshold, an early warning is given to remind the user to adjust the environment. If the user does not set it, the server judges according to the default threshold, and sets the sampling frequency of the acquisition device during the sitting posture monitoring process, connects to the monitoring device through the IP number and port number, and then performs relevant control on the device, allowing the user to set the reminder time independently;
通过结果展示单元4将与儿童相关的坐姿特征数据通过手机APP进行绑定,所有实时测得的数据将通过网络传至手机APP客户端,且分析结果以图表的形式显示在客户端,通过坐姿提醒单元5将结果展示给用户后,与使用的儿童进行交互,通过语音和文字的方式提醒用户调整坐姿和环境参数,如果打开语音提醒,在坐姿监测的过程中如果儿童坐姿不正确,则通过语音播报当前坐姿不良,提醒用户及时纠正坐姿,如果关闭语音提醒,在坐姿监测过程中,通过坐姿记录单元6对坐姿期间的相关信息以图表的形式进行显示,其中以饼状图的形式对监测时长和不良坐姿进行统计,以折线图的形式对环境参数进行连续统计,以文字形式对监测过程中出现频率高的微动作的详情进行叙述。The result display unit 4 will bind the sitting posture feature data related to the child through the mobile phone APP, all real-time measured data will be transmitted to the mobile phone APP client through the network, and the analysis results will be displayed on the client in the form of charts. After the results are displayed to the user through the sitting posture reminder unit 5, it will interact with the child using it, and remind the user to adjust the sitting posture and environmental parameters through voice and text. If the voice reminder is turned on, if the child's sitting posture is incorrect during the sitting posture monitoring process, the current sitting posture will be announced through voice to remind the user to correct the sitting posture in time. If the voice reminder is turned off, during the sitting posture monitoring process, the relevant information during the sitting posture will be displayed in the form of charts through the sitting posture recording unit 6, where the monitoring time and bad sitting posture are counted in the form of pie charts, the environmental parameters are continuously counted in the form of line graphs, and the details of micro-movements that appear frequently during the monitoring process are described in text.
需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.
尽管已经示出和描述了本发明的实施例,对于本领域的普通技术人员而言,可以理解在不脱离本发明的原理和精神的情况下可以对这些实施例进行多种变化、修改、替换和变型,本发明的范围由所附权利要求及其等同物限定。Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410582722.6A CN118522126A (en) | 2024-05-11 | 2024-05-11 | Intelligent reminding interaction system for sitting postures of children |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410582722.6A CN118522126A (en) | 2024-05-11 | 2024-05-11 | Intelligent reminding interaction system for sitting postures of children |
Publications (1)
Publication Number | Publication Date |
---|---|
CN118522126A true CN118522126A (en) | 2024-08-20 |
Family
ID=92273217
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410582722.6A Pending CN118522126A (en) | 2024-05-11 | 2024-05-11 | Intelligent reminding interaction system for sitting postures of children |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN118522126A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN118975794A (en) * | 2024-10-22 | 2024-11-19 | 深圳西昊智能家居股份有限公司 | A method and system for detecting office chair sitting posture health based on pressure distribution |
CN119622496A (en) * | 2024-11-25 | 2025-03-14 | 哈尔滨理工大学 | A sitting posture classification method based on seat cushion |
-
2024
- 2024-05-11 CN CN202410582722.6A patent/CN118522126A/en active Pending
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN118975794A (en) * | 2024-10-22 | 2024-11-19 | 深圳西昊智能家居股份有限公司 | A method and system for detecting office chair sitting posture health based on pressure distribution |
CN119622496A (en) * | 2024-11-25 | 2025-03-14 | 哈尔滨理工大学 | A sitting posture classification method based on seat cushion |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105962896B (en) | Heart rate sleep monitor system and monitoring method | |
CN110897425A (en) | Child sitting posture detection cushion, device interacting with cushion and sitting posture monitoring method | |
CN100462046C (en) | Online early warning system and method of weariness working | |
CN108492890B (en) | Human health state monitoring system and method | |
CN109145032A (en) | A kind of bee raising intelligent monitoring method and system | |
CN106980746A (en) | A kind of general Woundless blood sugar Forecasting Methodology based on Time-Series analysis | |
CN110151203B (en) | Fatigue driving identification method based on multistage avalanche convolution recursive network EEG analysis | |
CN110265135A (en) | A kind of stamping quality testing assessment system and method based on inertial sensor | |
CN118522126A (en) | Intelligent reminding interaction system for sitting postures of children | |
US20180132744A1 (en) | Systems and methods for physiological sign analysis | |
CN108806765A (en) | A kind of intelligence baby monitoring system | |
CN111402997A (en) | A human-computer interaction system and method | |
CN112163518A (en) | Emotion modeling method for emotion monitoring and emotion monitoring regulation system | |
CN108652587A (en) | A kind of cognition dysfunction provisional monitor device | |
CN109124655A (en) | State of mind analysis method, device, equipment, computer media and multifunctional chair | |
CN108922626A (en) | A kind of physical sign parameters model building method and physical sign parameters evaluation method | |
CN110693510A (en) | Auxiliary diagnostic device for attention deficit hyperactivity disorder and using method thereof | |
CN111503811A (en) | Human health detection management method and system and air conditioner | |
CN201070353Y (en) | On-line early warning system for exhausted working | |
CN110811548A (en) | A memory state evaluation method, system, device and storage medium | |
CN118383782A (en) | A flexible multi-channel facial electromyography signal detection method, system and device | |
CN118512173A (en) | Deep learning-based children hearing detection method and system | |
CN106326672A (en) | Falling into sleep detecting method and system | |
CN116484290A (en) | A method for building a depression recognition model based on Stacking integration | |
CN107961008A (en) | A kind of auxiliary device and method of resting metabolic rate quick obtaining |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |