[go: up one dir, main page]

CN103472799B - Based on the intelligent curtain rolling machine system of image processing techniques - Google Patents

Based on the intelligent curtain rolling machine system of image processing techniques Download PDF

Info

Publication number
CN103472799B
CN103472799B CN201310416299.4A CN201310416299A CN103472799B CN 103472799 B CN103472799 B CN 103472799B CN 201310416299 A CN201310416299 A CN 201310416299A CN 103472799 B CN103472799 B CN 103472799B
Authority
CN
China
Prior art keywords
main control
control module
weather
image
roller shutter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201310416299.4A
Other languages
Chinese (zh)
Other versions
CN103472799A (en
Inventor
姚分喜
张百海
崔灵果
柴森春
邹伟东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute of Technology BIT
Original Assignee
Beijing Institute of Technology BIT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Institute of Technology BIT filed Critical Beijing Institute of Technology BIT
Priority to CN201310416299.4A priority Critical patent/CN103472799B/en
Publication of CN103472799A publication Critical patent/CN103472799A/en
Application granted granted Critical
Publication of CN103472799B publication Critical patent/CN103472799B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A40/00Adaptation technologies in agriculture, forestry, livestock or agroalimentary production
    • Y02A40/10Adaptation technologies in agriculture, forestry, livestock or agroalimentary production in agriculture
    • Y02A40/25Greenhouse technology, e.g. cooling systems therefor
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Operating, Guiding And Securing Of Roll- Type Closing Members (AREA)

Abstract

本发明公开一种基于图像处理技术的智能卷帘机系统,包括:主控模块、气象站、摄像头、GPRS模块、摆杆和卷帘机电机。该系统以主控模块为数据处理和控制平台,建立了基于天气图像的智能天气识别系统,通过采集大棚外气象站中温度、湿度、光照、风速风向等气象信息,结合天气图像,能够有效判断出雨雪等恶劣天气,从而及时控制保温被的卷起与铺设。通过保温被定位技术,实现操作人员在进行远程操作或在控制室内操作时,均能够将保温被精确控制在其初始位置到终止位置之间的任意位置。同时能够实现故障智能诊断,对卷帘机电机的工作状况实时监控,当卷帘机电机发生故障时,主控模块自动切断卷帘机的电源,使整个系统安全可靠。

The invention discloses an intelligent roller blind machine system based on image processing technology, comprising: a main control module, a weather station, a camera, a GPRS module, a swing rod and a roller blind machine motor. The system uses the main control module as the data processing and control platform, and establishes an intelligent weather recognition system based on weather images. By collecting meteorological information such as temperature, humidity, light, wind speed and direction from the weather station outside the greenhouse, combined with weather images, it can effectively judge Inclement weather such as rain and snow, so as to control the rolling and laying of the insulation quilt in time. Through the heat preservation positioning technology, the operator can precisely control the heat preservation to any position between its initial position and the end position when performing remote operation or operating in the control room. At the same time, intelligent fault diagnosis can be realized, and the working status of the roller shutter motor can be monitored in real time. When the roller shutter motor fails, the main control module will automatically cut off the power supply of the roller shutter machine, making the whole system safe and reliable.

Description

基于图像处理技术的智能卷帘机系统Intelligent shutter machine system based on image processing technology

技术领域technical field

本发明涉及一种智能卷帘机系统,具体涉及一种基于图像处理技术的智能卷帘机系统,属于电子控制技术领域。The invention relates to an intelligent roller blind machine system, in particular to an intelligent roller blind machine system based on image processing technology, and belongs to the technical field of electronic control.

背景技术Background technique

目前,温室大棚已经在多种农产品、蔬菜产品及花卉、观赏植物等种植中得到了广泛的应用,而卷帘机的出现极大地推动了温室大棚操作的机械化程度。通常情况下白天天气晴朗时通过卷帘机卷起保温被,调节光照时间使棚内温度升高,同时使大棚内的植物吸收太阳光的照射;晚上温度较低或遇到雨雪等不好天气时,通过卷帘机铺设保温被对大棚进行保温;从而达到节能保温,提高经济效益的目的。At present, greenhouses have been widely used in the cultivation of various agricultural products, vegetable products, flowers, ornamental plants, etc., and the emergence of roller shutters has greatly promoted the mechanization of greenhouse operations. Usually, when the weather is fine during the day, roll up the thermal insulation quilt by the roller shutter machine, adjust the light time to increase the temperature in the shed, and at the same time make the plants in the shed absorb the sunlight; at night, the temperature is low or rain and snow are not good. When the weather is bad, the heat preservation quilt is laid by the roller shutter machine to insulate the greenhouse; so as to achieve the purpose of energy saving and heat preservation, and improve economic benefits.

为了进一步提高温室大棚的经济效益,根据大棚内植物的生长模型智能调节大棚内温度、湿度、二氧化碳、光照时间、土壤水分等参数,适当调节作物上市时间,使其效益最大化,是当前大棚种植发展的最新方向。而其中调节光照强度与时间是作物生长最重要的环节,这就要求卷帘机必须具备精确控制保温被位置的功能,只有这样才能达到与生长模型相结合的目的。In order to further improve the economic benefits of greenhouses, intelligently adjust the temperature, humidity, carbon dioxide, light time, soil moisture and other parameters in the greenhouses according to the growth model of the plants in the greenhouses, and properly adjust the time for crops to go to market to maximize their benefits. The latest direction of development. Among them, adjusting the light intensity and time is the most important part of crop growth, which requires that the roller shutter machine must have the function of accurately controlling the position of the insulation quilt. Only in this way can it achieve the purpose of combining with the growth model.

目前常见的普通卷帘机通常采用以下两种方式进行操作:一是人工接通卷帘机电源,控制保温被的卷起或铺设。二是为了操作简单方便,采用遥控器对卷帘机进行控制,但一般遥控距离只有十几米。两种方式的共同特点是操作人员必须在温室大棚现场,通过目测观察将保温被控制到要求的位置,然后断开卷帘机电源;因此需要工作人员每天到大棚现场,特别是遇到突遭下雨、下雪等恶劣天气时,更需要操作人员迅速赶到现场放下保温被,可以说大棚卷帘机离不开人。当需要对多个大棚进行操作时,则耗费时间很长。上述操作方式既增加了人工劳动强度,又加大了人工成本。At present, the common common roller blind machine usually adopts the following two methods to operate: one is to manually turn on the power supply of the roller blind machine to control the rolling or laying of the insulation quilt. Second, for the sake of simple and convenient operation, the remote control is used to control the shutter machine, but the general remote control distance is only a dozen meters. The common feature of the two methods is that the operator must be on the greenhouse site, control the insulation to the required position through visual observation, and then disconnect the power supply of the roller shutter machine; therefore, the staff needs to go to the greenhouse site every day, especially in case of sudden In bad weather such as rain and snow, it is even more necessary for operators to rush to the scene to put down the insulation quilt. It can be said that the greenhouse roller blind machine cannot be separated from people. When it is necessary to operate multiple greenhouses, it takes a long time. Above-mentioned mode of operation has not only increased artificial labor intensity, has increased labor cost again.

虽然当前少数技术先进的智能卷帘机采用可编程逻辑控制器(PLC)或嵌入式等控制器,通过对温室大棚外温度、湿度和光照强度等环境参数采集,控制保温被的卷起或铺设,在一定程度上实现了智能控制。但还存在以下缺陷:(1)仅以温室大棚外温度、湿度和光照强度等环境参数为依据,只能实现简单的天气状况的判别;(2)智能控制器的控制策略仅与大棚内外的环境参数相结合,不能实现结合棚内种植作物的生长模型的功能;(3)只有当工作人员现场操作时,才可以将保温被控制到需要位置,通过智能卷帘机进行远程操作或在控制室内操作时,只能实现将保温被完全卷起或完全铺设,不能将保温被控制在指定的任意位置;(4)当进行远程操作或在控制室内操作时,对卷帘机的故障不能进行及时有效的判断和保护。Although the current few technologically advanced intelligent roller blind machines use programmable logic controllers (PLC) or embedded controllers, they control the rolling or laying of insulation quilts by collecting environmental parameters such as temperature, humidity, and light intensity outside the greenhouse. , to a certain extent to achieve intelligent control. However, there are still the following defects: (1) Only based on environmental parameters such as temperature, humidity and light intensity outside the greenhouse, only simple weather conditions can be discriminated; The combination of environmental parameters cannot realize the function of combining the growth model of the crops planted in the shed; (3) Only when the staff operates on site can the heat preservation be controlled to the required position, and the intelligent roller shutter machine can be used for remote operation or in-control When operating indoors, the insulation can only be fully rolled up or fully laid, and the insulation cannot be controlled at any designated position; (4) When performing remote operations or operating in the control room, the failure of the roller shutter machine cannot be checked. Timely and effective judgment and protection.

发明内容Contents of the invention

有鉴于此,本发明提供一种基于图像处理技术的智能卷帘机系统,该系统能够结合天气图像及气象参数对温室大棚外的天气状况进行准确快速的识别;能够对保温被的位置进行精确定位,同时还具备智能故障诊断功能。In view of this, the present invention provides an intelligent roller shutter system based on image processing technology, which can accurately and quickly identify the weather conditions outside the greenhouse in combination with weather images and meteorological parameters; Positioning, but also has intelligent fault diagnosis function.

该智能卷帘机系统,包括:主控模块、气象站、GPRS模块、摆杆和卷帘机电机;外围设备为温室大棚;所述主控模块位于控制室内;气象站安装在温室大棚的顶部,所述气象站实时采集温室大棚外的气象信息,然后将所采集的气象信息发送给主控模块;所述气象信息包括环境温度、湿度、光照、风速和风向;所述摆杆可伸缩,其底部与固定安装的支座铰接,摆杆能够绕该铰接点摆动;所述卷帘机电机安装在摆杆的顶部,卷帘机电机的输出轴与铺设在温室大棚外保温被的卷轴相连,带动保温被的卷起或铺设;所述GPRS模块用于将温室大棚外的气象信息及保温被位置信息以彩信形式发送给操作人员,并接受操作人员的控制指令,对卷帘机进行远程监控。The intelligent rolling machine system includes: a main control module, a weather station, a GPRS module, a swing rod and a rolling machine motor; the peripheral equipment is a greenhouse; the main control module is located in the control room; the weather station is installed on the top of the greenhouse , the weather station collects weather information outside the greenhouse in real time, and then sends the collected weather information to the main control module; the weather information includes ambient temperature, humidity, light, wind speed and wind direction; the swing rod is scalable, Its bottom is hinged with a fixedly installed support, and the swing rod can swing around the hinge point; the roller shutter motor is installed on the top of the swing rod, and the output shaft of the roller shutter motor is connected to the reel laid on the outer insulation quilt of the greenhouse , to drive the roll-up or laying of the thermal insulation quilt; the GPRS module is used to send the meteorological information outside the greenhouse and the location information of the thermal insulation quilt to the operator in the form of MMS, and accept the control instructions of the operator to remotely control the roller shutter machine. monitor.

此外还包括摄像头;所述摄像头通过固定云台安装在控制室顶部,固定云台在主控模块的控制下对摄像头的角度进行调整;主控模块通过视频采集卡与摄像头相连,获取摄像头采集的图像或视频信息。Also comprise camera in addition; Described camera is installed on the top of control room by the fixed platform, and fixed platform adjusts the angle of camera under the control of main control module; image or video information.

所述摄像头具有三种工作模式,在工作模式一下,摄像头对准整个温室大棚,监控大棚安全;在工作模式二下,摄像头对准天空,采集天空图像;在工作模式三下,摄像头对准保温被安装有卷帘机电机的一侧,采集温室大棚的侧面图像。The camera has three working modes. In the first working mode, the camera is aimed at the entire greenhouse to monitor the safety of the greenhouse; in the second working mode, the camera is aimed at the sky to collect sky images; in the third working mode, the camera is aimed at the heat preservation On the side where the roller shutter motor is installed, the side image of the greenhouse is collected.

所述主控模块中预存有雨雪天气图像知识库,所述雨雪天气图像知识库指通过提取常见雨雪天气的图像特征,并依据提取的图像特征对雨雪天气进行分类后形成的图像知识库;同时所述主控模块中预存有每个分类结果对应的环境温度和湿度的范围。In the main control module, there is a rain and snow weather image knowledge base pre-stored, and the rain and snow weather image knowledge base refers to images formed by extracting image features of common rain and snow weather and classifying rain and snow weather according to the extracted image features knowledge base; at the same time, the range of ambient temperature and humidity corresponding to each classification result is pre-stored in the main control module.

当主控模块依据气象站发送的环境温度、湿度和光照初步判断会出现雨雪天气时;启动智能天气判断模式:主控模块控制摄像头进入工作模式二;摄像头以设定频率采集天空图像,并将采集到的天空图像发送给主控模块;主控模块提取接收到的天空图像的图像特征,并将提取的图像特征与雨雪天气图像知识库中不同类别雨雪天气的图像特征进行比对。When the main control module preliminarily judges that there will be rainy and snowy weather according to the ambient temperature, humidity and light sent by the weather station; start the intelligent weather judgment mode: the main control module controls the camera to enter working mode two; the camera collects sky images at a set frequency, and Send the collected sky image to the main control module; the main control module extracts the image features of the received sky image, and compares the extracted image features with the image features of different types of rain and snow weather in the rain and snow weather image knowledge base .

若该图像特征与其中一类图像特征相同,主控模块确定会出现该类别的雨雪天气,将判断结果通过GPRS模块发送给操作人员;若该图像特征与雨雪天气图像知识库中所有类别的图像特征均不同,则主控模块重新获取天空图像,直至所接收到的环境温度、湿度不在所有分类对应的环境温度和湿度的范围。If the image feature is identical with one of the image features, the main control module determines that the rain and snow weather of this category will occur, and the judgment result is sent to the operator through the GPRS module; if the image feature is consistent with all categories in the rain and snow weather image knowledge base If the image features of different images are different, the main control module reacquires the sky image until the received ambient temperature and humidity are not within the range of ambient temperature and humidity corresponding to all classifications.

所述主控模块中预存有温室大棚安装有卷帘机电机一侧的侧面轮廓中四条边的长度;主控模块控制保温被卷起或铺设前,操作人员将设定的保温被的位置预存在主控模块中;主控模块先控制摄像头进入工作模式三,然后启动卷帘机,带动保温被铺设或卷收;在此过程中,摄像头实时采集温室大棚的侧面图像,并对采集到的图像进行边缘提取处理,然后将处理得到的温室大棚的侧面轮廓发送给主控模块;所述主控模块依据该图像确定保温被的当前位置;当保温被的当前位置与预设位置一致时,关闭卷帘机电机;若从图像中得到保温被的位置在设定时间内没有发生变化,主控模块进入故障诊断模式:主控模块在故障诊断模式下首先判断当前位置是否是系统预设的位置,如果是,则主控模块关闭卷帘机电机;如果不是,则认为卷帘机电机发生了故障,主控模块主动断开卷帘机电机的电源,并通过GPRS模块向操作人员发短信报警。The main control module pre-stores the lengths of the four sides of the side profile of the side of the greenhouse where the roller shutter motor is installed; It exists in the main control module; the main control module first controls the camera to enter working mode 3, and then starts the roller blind machine to drive the insulation to be laid or rolled; during this process, the camera collects the side image of the greenhouse in real time, and performs The image is subjected to edge extraction processing, and then the processed side profile of the greenhouse is sent to the main control module; the main control module determines the current position of the thermal insulation quilt according to the image; when the current position of the thermal insulation quilt is consistent with the preset position, Turn off the roller shutter motor; if the position of the heat preservation quilt does not change within the set time from the image, the main control module enters the fault diagnosis mode: in the fault diagnosis mode, the main control module first judges whether the current position is preset by the system position, if it is, then the main control module closes the roller shutter motor; if not, it thinks that the roller shutter motor has failed, and the main control module actively disconnects the power supply of the roller shutter motor, and sends a text message to the operator through the GPRS module Call the police.

在所述保温被安装有卷帘机电机一侧的边缘上涂抹黑色颜料。Smear black paint on the edge of the thermal insulation side where the roller shutter motor is installed.

所述主控模块中预存有摄像头在三种工作模式下固定云台所需旋转的角度。The main control module pre-stores the rotation angles required by the camera to fix the pan-tilt in three working modes.

还包括角度传感器,所述角度传感器安装在摆杆的底部,随摆杆一起运动。所述主控模块中预设有摆杆在初始位置及终止位置时角度传感器的读数,主控模块控制保温被卷起或铺设前,在主控模块中预存保温被在设定位置时角度传感器的读数;保温被卷起或铺设过程中,所述角度传感器实时采集摆杆与地面的角度信息,并将采集到的角度信息发送给主控模块,主控模块将接收到的角度信息与其内部预设的保温被在设定位置时角度传感器的读数进行比对,当两者一致时,主控模块关闭卷帘机电机。所述主控模块每次接收到角度传感器发送来的角度信息后,将当前收到的角度信息与前一次所接收到的角度信息进行比较,判断相邻两次角度信息是否发生改变;若两次角度信息有所改变,认为卷帘机电机工作正常;若所述角度信息在设定时间内没有发生变化,则进入故障诊断模式。An angle sensor is also included, and the angle sensor is installed at the bottom of the swing rod and moves together with the swing rod. The main control module is preset with the readings of the angle sensor when the pendulum is at the initial position and the end position. The main control module controls the angle sensor when the heat preservation is rolled up or laid in the main control module. readings; during the insulation is rolled up or laid, the angle sensor collects the angle information between the pendulum and the ground in real time, and sends the collected angle information to the main control module, and the main control module combines the received angle information with its internal The preset heat preservation is compared with the readings of the angle sensor at the set position, and when the two are consistent, the main control module closes the roller shutter motor. After the main control module receives the angle information sent by the angle sensor each time, it compares the angle information received at present with the angle information received at the previous time, and judges whether two adjacent angle information changes; If the secondary angle information changes, it is considered that the motor of the roller blind machine is working normally; if the angle information does not change within the set time, enter the fault diagnosis mode.

通过定位机构将所述角度传感器安装在摆杆上;所述定位机构包括:连杆A、连杆B、中心轴、联轴器和两个轴承;所述连杆A的一端与摆杆垂直连接,另一端加工有轴向滑槽;所述连杆B的顶部位于该滑槽内,且可在该滑槽内轴向移动;所述连杆B的底部固接中心轴;所述中心轴与摆杆的铰接轴同轴,角度传感器通过联轴器固接在中心轴靠近摆杆一端的端部。Install the angle sensor on the swing rod through a positioning mechanism; the positioning mechanism includes: connecting rod A, connecting rod B, central shaft, coupling and two bearings; one end of the connecting rod A is perpendicular to the swing rod connected, the other end is processed with an axial chute; the top of the connecting rod B is located in the chute, and can move axially in the chute; the bottom of the connecting rod B is fixed to the central shaft; the center The shaft is coaxial with the hinged shaft of the swing rod, and the angle sensor is fixedly connected to the end of the central axis close to one end of the swing rod through a shaft coupling.

还包括拉绳位移传感器;所述拉绳位移传感器固定在保温被完全铺设或完全收起时的位置;拉绳位移传感器的拉绳端与卷帘机电机固接。所述主控模块控制保温被卷起或铺设的过程中,卷帘机电机与保温被一起移动,则带动拉绳位移传感器的拉伸移动;拉绳位移传感器实时向主控模块发送拉绳的位移信号,主控模块依据该位移信号判断保温被的位置。所述主控模块每次接收到拉绳位移传感器发送来的位移信号后,将当前收到的位移信号与前一次所接收到的位移信号进行比较,判断相邻两次位移信号是否发生改变;若两次位移信号有所改变,认为卷帘机电机工作正常;若所述位移信号在设定时间内没有发生变化,则进入故障诊断模式。It also includes a pull rope displacement sensor; the pull rope displacement sensor is fixed at the position when the heat preservation is completely laid or fully stowed; the pull rope end of the pull rope displacement sensor is fixedly connected to the motor of the roller blind machine. During the process that the main control module controls the heat preservation being rolled up or laid, the motor of the roller shutter machine and the heat preservation quilt move together, which drives the stretching movement of the pull rope displacement sensor; The displacement signal, and the main control module judges the position of the insulation quilt according to the displacement signal. After the main control module receives the displacement signal sent by the stay rope displacement sensor each time, it compares the displacement signal received at present with the displacement signal received at the previous time, and judges whether two adjacent displacement signals have changed; If the two displacement signals have changed, it is considered that the motor of the shutter machine is working normally; if the displacement signal does not change within the set time, it will enter the fault diagnosis mode.

在所述温室大棚上,保温被完全铺设和完全收起的位置各设置一个限位开关,当所述保温被接触到限位开关后,向主控模块发送保温被到位信号,主控模块接收到保温被到位信号后,关闭卷帘机电机。On the greenhouse, a limit switch is set at the position where the heat preservation is completely laid and completely stowed. When the heat preservation is touched by the limit switch, it sends a signal that the heat preservation is in place to the main control module, and the main control module receives After the heat preservation signal is in place, turn off the roller shutter motor.

有益效果:Beneficial effect:

(1)建立了基于天气图像的智能天气识别系统,通过采集大棚外气象站中温度、湿度、光照、风速风向等气象信息,结合天气图像,能够有效判断出雨雪等恶劣天气,从而及时控制保温被的卷起与铺设,实现天气的智能判断及对卷帘机的智能控制。(1) An intelligent weather recognition system based on weather images has been established. By collecting meteorological information such as temperature, humidity, light, wind speed and wind direction from the weather station outside the greenhouse, combined with weather images, it can effectively judge severe weather such as rain and snow, so as to control it in time The rolling and laying of the thermal insulation quilt realizes the intelligent judgment of the weather and the intelligent control of the roller shutter machine.

(2)该系统中的主控模块作为数据处理和控制平台,采用可视化操作方式,操作简单;主控模块的屏幕上实时显示所有检测数据以及保温被位置的实时图像。所有操作都在控制室中完成,有效降低了人工劳动强度。(2) The main control module in the system is used as a data processing and control platform, and it adopts a visual operation mode, which is easy to operate; the screen of the main control module displays all the detection data and real-time images of the position of the heat preservation quilt in real time. All operations are completed in the control room, which effectively reduces the labor intensity.

(3)通过保温被定位技术,实现操作人员在进行远程操作或在控制室内操作时,均能够将保温被精确控制在其初始位置到终止位置之间的任意位置,使用户可以结合棚内种植作物生长模型参数控制保温被的铺设和卷收,不需操作人员到现场控制。(3) Through the thermal insulation positioning technology, the operator can precisely control the thermal insulation at any position between its initial position and the end position when performing remote operation or operating in the control room, so that users can combine planting in the shed The parameters of the crop growth model control the laying and rolling of the insulation quilt, without the need for operators to go to the site for control.

(4)能够实现故障智能诊断,对卷帘机的工作状况实时监控,实现对卷帘机的智能保护。发生故障时,主控模块自动切断卷帘机的电源,使整个系统安全可靠。(4) It can realize intelligent fault diagnosis, real-time monitoring of the working status of the shutter machine, and realize the intelligent protection of the shutter machine. When a failure occurs, the main control module automatically cuts off the power supply of the shutter machine, making the entire system safe and reliable.

(5)具备远程监控功能。操作人员可以通过手机发短信的方式对大棚卷帘机进行控制。短信内容按照预先设定的格式发送。主控模块接收到规定格式要求的短信后,按照短信中的要求对卷帘机进行控制。同时主控模块能够依据操作人员的需要,通过GPRS模块定时将大棚外气象信息以及卷帘机保温被的位置图像等传送至相应手机,供操作人员参考。(5) With remote monitoring function. The operator can control the greenhouse roller shutter machine by sending text messages through the mobile phone. The SMS content is sent according to the pre-set format. After the main control module receives the short message required by the specified format, it controls the shutter machine according to the requirements in the short message. At the same time, the main control module can regularly transmit the meteorological information outside the greenhouse and the position image of the thermal insulation quilt of the roller shutter machine to the corresponding mobile phone through the GPRS module according to the needs of the operator, for the operator's reference.

附图说明Description of drawings

图1为所述智能卷帘机系统的电气连接图;Fig. 1 is the electrical connection diagram of described intelligent roller blind machine system;

图2为本实施例中所述智能卷帘机的整体结构示意图;Fig. 2 is a schematic diagram of the overall structure of the intelligent roller blind machine described in this embodiment;

图3为智能天气识别流程示意图;Fig. 3 is a schematic diagram of an intelligent weather identification process;

图4为角度传感器的安装示意图;Fig. 4 is the installation diagram of angle sensor;

图5为采用图像处理技术对保温被进行定位的计算示意图;Fig. 5 is the calculation schematic diagram of adopting image processing technology to locate the thermal insulation quilt;

图6为故障诊断流程示意图。Figure 6 is a schematic diagram of the fault diagnosis process.

其中:1-温室大棚、2-保温被、3-气象站、4-卷帘机电机、5-摆杆、6-摄像头、7-角度传感器、8-连杆A、9-连杆B、10-中心轴Among them: 1-Greenhouse, 2-Insulation quilt, 3-Weather station, 4-Roller motor, 5-Swing rod, 6-Camera, 7-Angle sensor, 8-Connecting rod A, 9-Connecting rod B, 10-central axis

具体实施方式Detailed ways

本实施例提供一种基于图像处理及传感器技术的智能卷帘机系统,通过该系统能够对卷帘机实施精确定位与智能保护,且具备远程监控及智能故障诊断的功能,节省人力物力。下面依据保温被精确定位方案的不同,提供该系统的三个实施例。This embodiment provides an intelligent roller blind machine system based on image processing and sensor technology, through which the precise positioning and intelligent protection of the roller blind machine can be implemented, and it has the functions of remote monitoring and intelligent fault diagnosis, saving manpower and material resources. In the following, three embodiments of the system are provided according to the different schemes for the precise positioning of the heat preservation.

实施例1:Example 1:

该系统的电气部分包括主控模块、气象站、摄像头、GPRS模块、扩展控制板、限位开关和卷帘机电机;外围设备为温室大棚。本实施例中所述主控模块采用PC104计算机,主控模块为数据处理平台和控制平台,本实施例中的PC104计算机采用触摸屏可视化操作方式。气象站和摄像头均接入主控模块,向主控模块实时发送所采集到的信息;GPRS模块通过串行接口与主控模块相连(或直接集成在主控模块中),主控模块通过GPRS模块能够将温室大棚外的气象信息及保温被位置信息以彩信形式(文字与图像)发送给操作人员,以便操作人员实时了解现场情况,实现对卷帘机电机的远程监控。主控模块通过扩展控制板与卷帘机电机相连,控制卷帘机电机的启动和关闭;限位开关通过扩展控制板与主控模块相连,用于向主控模块发送到位信号。The electrical part of the system includes a main control module, a weather station, a camera, a GPRS module, an extended control board, a limit switch and a shutter motor; the peripheral equipment is a greenhouse. The main control module in this embodiment adopts a PC104 computer, and the main control module is a data processing platform and a control platform. The PC104 computer in this embodiment adopts a touch screen visual operation mode. Both the weather station and the camera are connected to the main control module, and send the collected information to the main control module in real time; the GPRS module is connected to the main control module through a serial interface (or directly integrated in the main control module), and the main control module is The module can send the meteorological information outside the greenhouse and the location information of the heat preservation quilt to the operator in the form of MMS (text and image), so that the operator can understand the site situation in real time and realize the remote monitoring of the roller shutter motor. The main control module is connected with the motor of the roller shutter machine through the extended control board, and controls the startup and shutdown of the motor of the roller shutter machine; the limit switch is connected with the main control module through the extended control board, and is used to send an in-position signal to the main control module.

该系统中各部件的具体安装如图2所示,其中主控模块位于控制室内,控制室设置在温室大棚1附近。气象站3安装在温室大棚1的顶部,保证气象站3无遮挡、安装牢固。主控模块通过RS485接口与气象站3相连;气象站3实时采集温室大棚外的环境温度、湿度、风速和风向等气象信息;然后通过RS485串行通讯方式将所采集的气象信息发送给主控模块。The specific installation of each component in the system is shown in FIG. 2 , wherein the main control module is located in the control room, and the control room is set near the greenhouse 1 . The weather station 3 is installed on the top of the greenhouse 1 to ensure that the weather station 3 has no shelter and is installed firmly. The main control module is connected with the weather station 3 through the RS485 interface; the weather station 3 collects weather information such as ambient temperature, humidity, wind speed and wind direction outside the greenhouse in real time; and then sends the collected weather information to the main controller through RS485 serial communication module.

摄像头6通过固定云台安装在控制室顶部,所述固定云台受控于主控模块,能够实现摄像头6角度的调整,使摄像头6对准相应目标采集图像或视频。主控模块通过视频采集卡与摄像头6相连,获取摄像头6采集到的图像或视频信息。本实施例中所述摄像头6具有以下功能:(1)监控大棚安全,此时摄像头6监视整个温室大棚,将采集的图像或视频实时传送至主控模块,以供控制室内的操作人员观察,防止非法人员进入或盗窃等。(2)采集天空图像传送至主控模块,用于雨雪天气的智能判断。(3)拍摄温室大棚的侧面图像,用于确定保温被位置。为保证摄像头6所采集信息的可靠准确,所述摄像头6的安装高度要合适,无遮挡;并且要标定出实现上述三种功能时固定云台的最佳角度和控制参数,并将所标定的最佳角度和控制参数保存至主控模块,以实现快速准确的控制。The camera 6 is installed on the top of the control room through a fixed pan-tilt, which is controlled by the main control module and can realize the adjustment of the angle of the camera 6 so that the camera 6 is aimed at the corresponding target to collect images or videos. The main control module is connected with the camera 6 through the video capture card, and obtains the image or video information collected by the camera 6 . The camera 6 described in this embodiment has the following functions: (1) Monitoring the safety of the greenhouse. At this time, the camera 6 monitors the entire greenhouse, and transmits the collected images or videos to the main control module in real time for observation by the operators in the control room. Prevent illegal personnel from entering or stealing, etc. (2) Collect sky images and send them to the main control module for intelligent judgment of rainy and snowy weather. (3) Take a side image of the greenhouse to determine the position of the insulation quilt. In order to ensure that the information collected by the camera 6 is reliable and accurate, the installation height of the camera 6 should be suitable without occlusion; The optimal angle and control parameters are saved to the main control module for fast and accurate control.

所述卷帘机电机4通过摆杆5固定安装,具体为:摆杆5可伸缩,其位于温室大棚1的侧面,摆杆5的底部与固定在地面上的支座铰接,使摆杆5能够沿温室大棚1的前后方向摆动。卷帘机电机4通过支撑架固接在摆杆5的顶部,卷帘机电机4的输出轴与铺设在温室大棚1外保温被2的卷轴相连,用于带动保温被2的卷起或铺设。The motor 4 of the roller shutter machine is fixedly installed through the swing rod 5, specifically: the swing rod 5 is telescopic, and it is located on the side of the greenhouse 1, and the bottom of the swing rod 5 is hinged with the support fixed on the ground, so that the swing rod 5 Can swing along the front and back directions of the greenhouse 1 . The roller blind machine motor 4 is fixedly connected to the top of the swing rod 5 through the support frame, and the output shaft of the roller blind machine motor 4 is connected with the reel laid on the outer heat preservation quilt 2 of the greenhouse 1 to drive the heat preservation quilt 2 to be rolled up or laid. .

在温室大棚1上,保温被2完全铺设的位置(图2中的A处)和完全收起的位置(图2中的B处)各设置有一个限位开关。当保温被2卷起或铺设时接触到限位开关后,限位开关向主控模块发送到位信号,主控模块接收到到位信号后关闭卷帘机电机4。On the greenhouse 1, a limit switch is respectively set at the fully laid position (at A in FIG. 2 ) and the fully retracted position (at B in FIG. 2 ) of the insulation quilt 2 . When the insulation is rolled up or laid by 2 and touches the limit switch, the limit switch sends a signal in place to the main control module, and the main control module closes the roller shutter motor 4 after receiving the signal in place.

该智能卷帘机系统的工作原理为:The working principle of the intelligent roller shutter system is:

正常情况下,摄像头6监视整个温室大棚1,监控大棚安全,并将采集的视频和图像信息实时传送给主控模块。气象站6实时采集温室大棚1外的环境温度、湿度、光照、风速和风向等气象信息,并将采集到的气象信息发送给主控模块。控制室内的操作人员依据主控模块接收到的气象信息,结合大棚内植物的生长模型(指植物在现阶段生长状态下所需的光照时长等)决策保温被2停留的位置及时长,操作人员做出决策后,将设定的保温被的位置及在该位置的时长预存在主控模块中。然后主控模块控制固定云台将摄像头6对准保温被安装有卷帘机电机4的一侧,并启动卷帘机电机,带动保温被2铺设或卷收。Under normal circumstances, the camera 6 monitors the entire greenhouse 1, monitors the safety of the greenhouse, and transmits the collected video and image information to the main control module in real time. The weather station 6 collects weather information such as ambient temperature, humidity, light, wind speed and wind direction outside the greenhouse 1 in real time, and sends the collected weather information to the main control module. Based on the weather information received by the main control module, the operator in the control room decides where and how long the heat preservation 2 stays by combining the growth model of the plants in the greenhouse (referring to the light duration required by the plants in the current growth state, etc.). After the decision is made, the set position of the thermal insulation quilt and the duration at the position are pre-stored in the main control module. Then the main control module controls the fixed pan-tilt to aim the camera 6 at the side where the roller blind machine motor 4 is installed on the heat preservation quilt, and starts the roller blind machine motor to drive the heat preservation quilt 2 to lay or roll up.

在保温被2铺设或卷收过程中,摄像头6实时采集温室大棚的侧面图像,并将采集到的图像发送给主控模块。主控模块对接收到的图像进行边缘提取处理后得到温室大棚的侧面轮廓ABCD及保温被的位置E,如图5所示。AB、BC、CD、DA的长度参数已经事先测量并预存在主控模块中,主控模块通过图像分割得出保温被位置E的投影点E’在线段CD上的位置;进而得到线段DE的长度,则可求出E点在弧线AB上的位置,即保温被此时的精确位置。当主控模块判断保温被的当前位置与预设位置一致时,关闭卷帘机电机。为了提高图像处理精度,在保温被的边缘涂抹黑色颜料。During the laying or retracting process of the thermal insulation quilt 2, the camera 6 collects side images of the greenhouse in real time, and sends the collected images to the main control module. The main control module performs edge extraction processing on the received image to obtain the side profile ABCD of the greenhouse and the position E of the insulation quilt, as shown in Figure 5. The length parameters of AB, BC, CD, and DA have been measured in advance and pre-stored in the main control module. The main control module obtains the position of the projection point E' of the position E of the thermal insulation layer on the line segment CD through image segmentation; and then obtains the position of the line segment DE length, then the position of point E on the arc AB can be obtained, that is, the precise position of the heat preservation quilt at this time. When the main control module judges that the current position of the heat preservation quilt is consistent with the preset position, the motor of the roller shutter machine is turned off. In order to improve the precision of image processing, black paint is applied to the edge of the insulation quilt.

当保温被在卷起或铺设过程中,由于负载过重(常见的情况是冬天下雪后未及时清除保温被上的积雪或夏天保温被被雨水浸湿而使其超重)或机械故障等原因,保温被停滞不前,而卷帘机电机一直堵转,会导致卷帘机过热而烧坏。采用该方案时由于摄像头能够对保温被的动作过程进行实时拍摄,控制室的操作人员能够及时对故障做出判断及处理。When the insulation quilt is being rolled up or laid, due to overloading (the common situation is that the snow on the insulation quilt is not cleared in time after snowing in winter or the insulation is soaked by rain in summer to make it overweight) or mechanical failure, etc. The reason is that the heat preservation is stagnant, and the motor of the roller blind machine has been blocked, which will cause the roller blind machine to overheat and burn out. When this solution is adopted, since the camera can capture the action process of the thermal insulation quilt in real time, the operators in the control room can make judgments and deal with the fault in time.

所述主控模块中预存有雨雪天气图像知识库,所述雨雪天气图像知识库指通过提取常见雨雪天气图像特征进行训练与分类后形成的图像知识库。本实施例中,将常见雨雪天气分为小雨、中雨、大雨和雪四类,主控模块中预存有上述每类天气的图像特征,同时所述主控模块中预存有每个分类对应的环境温度和湿度的范围、The main control module pre-stores a rain and snow weather image knowledge base, and the rain and snow weather image knowledge base refers to an image knowledge base formed after training and classification by extracting common rain and snow weather image features. In this embodiment, the common rain and snow weather is divided into light rain, moderate rain, heavy rain and snow. range of ambient temperature and humidity,

当主控模块依据气象站发送的环境温度、湿度和光照初步判断会出现雨雪天气时,如气象站发送的环境温度、湿度在雨雪天气对应的环境温度和湿度的范围内,启动智能天气判断模式:When the main control module preliminarily judges that there will be rainy and snowy weather based on the ambient temperature, humidity and light sent by the weather station, if the ambient temperature and humidity sent by the weather station are within the range of ambient temperature and humidity corresponding to the rainy and snowy weather, start the smart weather Judgment mode:

(11)主控模块通过固定云台调整摄像头的角度,使其对准棚外天空;(11) The main control module adjusts the angle of the camera by fixing the gimbal so that it is aligned with the sky outside the studio;

(12)摄像头以设定频率采集天空图像,并将采集到的天空图像发送给主控模块;(12) The camera collects sky images at a set frequency, and sends the collected sky images to the main control module;

(13)主控模块提取接收到的天空图像的图像特征,并将提取的图像特征与雨雪天气图像知识库中不同类别雨雪天气的图像特征进行比对:(13) The main control module extracts the image features of the received sky image, and compares the extracted image features with the image features of different categories of rain and snow weather in the rain and snow weather image knowledge base:

若该图像特征与主控模块内部预存的一类雨雪天气的图像特征相同,例如该图像特征与主控模块中预存的“中雨”的图像特征相同,则主控模块确认会出现“中雨”天气,然后进入步骤(14);若该图像特征与所有类别雨雪天气的图像特征均不同,则判断不会出现雨雪天气,返回至步骤(12),直至主控模块接收到的气象站发送的环境温度、湿度不在所有分类对应的环境温度和湿度的范围。If the image feature is the same as the image feature of a type of rain and snow weather pre-stored in the main control module, for example, the image feature is the same as the image feature of "moderate rain" pre-stored in the main control module, then the main control module will confirm that "moderate rain" will appear. "rain" weather, and then enter step (14); if the image features are different from those of all types of rain and snow weather, it is judged that there will be no rain and snow weather, and return to step (12), until the main control module receives the The ambient temperature and humidity sent by the weather station are not within the range of ambient temperature and humidity corresponding to all classifications.

(14)主控模块通过GPRS模块将判断结果发送给操作人员。(14) The main control module sends the judgment result to the operator through the GPRS module.

实施例2:Example 2:

为使故障诊断过程智能,保证操作人员不在控制室时,系统仍能够完成故障诊断;且保证在对保温被进行操作的过程中,摄像头可继续监控大棚安全或采集天空图像。本实施例在实施例1所述的系统中增加了角度传感器7,通过角度传感器7对保温被进行精确定位及卷帘机进行智能故障诊断。角度传感器通过RS485串行方式与主控模块通讯,电气连接如图1所示。In order to make the fault diagnosis process intelligent, the system can still complete the fault diagnosis when the operator is not in the control room; and ensure that the camera can continue to monitor the safety of the greenhouse or collect sky images during the operation of the insulation quilt. In this embodiment, an angle sensor 7 is added to the system described in Embodiment 1, and the angle sensor 7 is used for precise positioning of the heat preservation quilt and intelligent fault diagnosis for the shutter machine. The angle sensor communicates with the main control module through RS485 serial mode, and the electrical connection is shown in Figure 1.

所述角度传感7安装在摆杆的底部,为保证角度传感器7测量结果准确,不受摆杆5摆动的影响,本实施例中对角度传感器采用图4所示的安装方式。角度传感器7的安装结构包括连杆A8、连杆B9、中心轴10、联轴器和两个轴承。连杆A8的一端与连接,另一端加工有轴向滑槽;连杆B9的顶部位于该滑槽内,且可在该滑槽内沿轴向移动;连杆B9的底部固接中心轴10。所述中心轴10与摆杆的铰接轴同轴,角度传感器7通过联轴器固接在中心轴10靠近摆杆5一端的端部。在所述中心轴10位于连杆B9左右两侧的位置分别安装有轴承。角度传感器7安装完成后,标定出摆杆5在初始位置、终止位置时角度传感器7的读数,预存至主控模块;其中初始位置指保温被2完全铺设时摆杆5的位置,终止位置指保温被2完全卷起时摆杆5的位置。图2中OA表示摆杆5的初始位置,OB表示摆杆5的终止位置。The angle sensor 7 is installed at the bottom of the swing rod. In order to ensure that the measurement result of the angle sensor 7 is accurate and not affected by the swing of the swing rod 5, the installation method shown in FIG. 4 is adopted for the angle sensor in this embodiment. The installation structure of the angle sensor 7 includes a connecting rod A8, a connecting rod B9, a central shaft 10, a coupling and two bearings. One end of the connecting rod A8 is connected with the chute, and the other end is processed with an axial chute; the top of the connecting rod B9 is located in the chute, and can move axially in the chute; the bottom of the connecting rod B9 is fixed to the central shaft 10 . The central shaft 10 is coaxial with the hinge shaft of the swing rod, and the angle sensor 7 is fixedly connected to the end of the central shaft 10 close to the swing rod 5 through a coupling. Bearings are respectively installed at the positions where the central shaft 10 is located on the left and right sides of the connecting rod B9. After the installation of the angle sensor 7 is completed, the readings of the angle sensor 7 when the pendulum 5 is at the initial position and the end position are calibrated, and stored in the main control module; wherein the initial position refers to the position of the pendulum 5 when the insulation quilt 2 is fully laid, and the end position refers to The position of the fork 5 when the heat preservation was rolled up completely by 2. OA in FIG. 2 represents the initial position of the swing rod 5 , and OB represents the end position of the swing rod 5 .

角度传感器7实时采集摆杆与地面的角度信息,并将采集到的角度信息发送至主控模块,通过主控模块实现保温被的精确定位及卷帘机的智能保护。角度传感器7对保温被2进行精确定位的原理为:主控模块中预设有摆杆5在初始位置及终止位置时角度传感器7的读数。保温被2在铺设或卷收的过程前,操作人员将保温被在设定位置时角度传感器的读数预存在主控模块中。保温被卷起或铺设过程中,角度传感器7实时采集摆杆5与地面的角度信息,并将采集到的角度信息发送至主控模块,主控模块将接收到的角度信息与其内部预设保温被在设定位置时角度传感器的读数进行比对,当两者一致时,主控模块关闭卷帘机电机,从而精确控制保温被的位置。The angle sensor 7 collects the angle information between the pendulum and the ground in real time, and sends the collected angle information to the main control module, through which the precise positioning of the heat preservation quilt and the intelligent protection of the roller blind machine are realized. The principle that the angle sensor 7 accurately positions the heat preservation quilt 2 is: the readings of the angle sensor 7 when the pendulum 5 is at the initial position and the end position are preset in the main control module. Before the heat preservation quilt 2 is laid or retracted, the operator pre-stores the readings of the angle sensor when the heat preservation quilt is at the set position in the main control module. When the insulation is rolled up or laid, the angle sensor 7 collects the angle information between the pendulum 5 and the ground in real time, and sends the collected angle information to the main control module, and the main control module combines the received angle information with its internal preset insulation The readings of the angle sensor are compared when the quilt is at the set position, and when the two are consistent, the main control module turns off the motor of the roller blind machine, thereby precisely controlling the position of the heat preservation quilt.

通过角度传感器7进行智能故障诊断的流程如图6所示。保温被在卷起或铺设的过程中,角度传感器实时测量摆杆与地面的角度信息,并将所测量的角度信息发送给主控模块,主控模块将本次所接收到的角度信息与上次所接收到的角度信息进行比较,判断相邻的两次角度信息是否发生改变。若两次角度信息有所改变,表明保温被正在被卷起或铺设,卷帘机工作正常;若所述角度信息在设定时间(本实施例中设定时间为3min)内一直没有发生变化,表明在该段时间内保温被的位置没有改变,主控模块首先判断当前位置是否是系统预设的位置,如果是,表明保温被铺设到位,主控模块关闭卷帘机电机;如果不是,则认为卷帘机电机发生了故障,主控模块主动断开卷帘机电机的电源,并通过GPRS模块向操作人员发短信报警,从而有效避免卷帘机电机由于长时间堵转而烧坏。The flow of intelligent fault diagnosis through the angle sensor 7 is shown in FIG. 6 . During the rolling or laying process of the insulation quilt, the angle sensor measures the angle information between the swing rod and the ground in real time, and sends the measured angle information to the main control module, which compares the angle information received this time with the previous one. Compared with the angle information received next time, it is judged whether the angle information of two adjacent times has changed. If the angle information changes twice, it means that the insulation quilt is being rolled up or laid, and the shutter machine is working normally; if the angle information has not changed within the set time (in this embodiment, the set time is 3 minutes) , indicating that the position of the insulation quilt has not changed during this period of time. The main control module first judges whether the current position is the preset position of the system. It is considered that the motor of the roller blind machine has failed, and the main control module actively disconnects the power supply of the motor of the roller blind machine, and sends a text message to the operator through the GPRS module to alarm, thereby effectively preventing the motor of the roller blind machine from burning out due to long-term blocking.

实施例3:Example 3:

通过拉绳位移传感器对保温被进行精确定位及卷帘机进行智能故障诊断。在实施例1所述的系统中增加拉绳位移传感器。所述拉绳位移传感器固定在图2中的A点位置,拉绳位移传感器的拉绳端固定在卷帘机电机上,信息输出端通过RS485串行方式与主控模块通讯。Precise positioning of the heat preservation quilt and intelligent fault diagnosis of the shutter machine through the rope displacement sensor. In the system described in Embodiment 1, a stay rope displacement sensor is added. The rope displacement sensor is fixed at point A in Fig. 2, the rope end of the rope displacement sensor is fixed on the motor of the shutter machine, and the information output terminal communicates with the main control module through RS485 serial mode.

拉绳位移传感器对保温被进行精确定位的原理为:操作人员在做出卷起或铺设保温被的决策后,将保温被所需铺设的位置预设在主控模块中。在保温被卷起或铺设的过程,卷帘机与保温被一起移动,则带动拉绳位移传感器的拉伸移动;拉绳位移传感器实时向主控模块发送保温被与A点之间直线距离的信号,通过该测量信号,主控模块便可得到保温被的精确位置;当保温被到达预设位置后,主控模块关闭卷帘机。The principle of precise positioning of the thermal insulation quilt by the drawstring displacement sensor is: after the operator makes a decision to roll up or lay the thermal insulation quilt, he presets the position where the thermal insulation quilt needs to be laid in the main control module. In the process of rolling up or laying the heat preservation quilt, the roller shutter machine and the heat preservation quilt move together, which will drive the stretching movement of the pull rope displacement sensor; the pull rope displacement sensor sends the linear distance between the heat preservation quilt and point A to the main control module Signal, through the measurement signal, the main control module can obtain the precise position of the heat preservation quilt; when the heat preservation quilt reaches the preset position, the main control module closes the roller shutter machine.

通过拉绳位移传感器进行智能故障诊断的过程为:卷帘机在卷起或铺设保温被的过程中,拉绳位移传感器实时测量保温被与A点之间直线距离,并将所测量的位移信号发送给主控模块,主控模块将本次所接收到的位移信号与上次所接收到的位移信号进行比较,判断相邻的两次位移信号是否发生改变。若两次位移信号有所改变,表明保温被正在被卷起或铺设,卷帘机工作正常;若所述位移信号在设定时间(本实施例中设定时间为3min)内一直没有发生变化,表明在该段时间内保温被的位置没有改变,主控模块首先判断当前位置是否是系统预设的位置,如果是,表明保温被铺设到位,主控模块关闭卷帘机电机;如果不是,则认为卷帘机电机发生了故障,主控模块主动断开卷帘机电机的电源,并通过GPRS模块向值班人员发短信报警,从而有效避免卷帘机由于长时间堵转而烧坏。The process of intelligent fault diagnosis through the rope displacement sensor is as follows: in the process of rolling up or laying the heat preservation quilt of the roller blind machine, the rope displacement sensor measures the linear distance between the heat preservation quilt and point A in real time, and sends the measured displacement signal Send to the main control module, the main control module compares the displacement signal received this time with the displacement signal received last time, and judges whether two adjacent displacement signals have changed. If the two displacement signals change, it indicates that the insulation quilt is being rolled up or laid, and the shutter machine is working normally; if the displacement signal has not changed within the set time (in this embodiment, the set time is 3 minutes) , indicating that the position of the insulation quilt has not changed during this period of time. The main control module first judges whether the current position is the preset position of the system. Then it is considered that the motor of the shutter machine has failed, and the main control module actively disconnects the power supply of the motor of the shutter machine, and sends a text message to the on-duty staff through the GPRS module to alarm, thereby effectively preventing the shutter machine from burning out due to long-term blocking.

上述实施例2和实施例3中,当所述角度传感器7(或拉绳位移传感器)采用串行通讯方式输出时,可直接与主控模块相连。当所述角度传感器7(或拉绳位移传感器)以电阻、电流形式输出信号时,需通过扩展控制板上的采样电路对其输出的信号进行采样。即此时,所述角度传感器7(或拉绳位移传感器)通过扩展控制板与主控模块相连。角度传感器7(或拉绳位移传感器)的安装位置距离控制室较远,在电阻方式下,为了保证采集精度,采用精密电流源的方案,即电流源通过精密标准电阻后与角度传感器(或拉绳位移传感器)相连,采用该种方案可保证角度传感器7(或拉绳位移传感器)的测量精度。In the above-mentioned Embodiment 2 and Embodiment 3, when the angle sensor 7 (or the rope displacement sensor) is output by serial communication, it can be directly connected to the main control module. When the angle sensor 7 (or the rope displacement sensor) outputs signals in the form of resistance and current, the output signal needs to be sampled through the sampling circuit on the expansion control board. That is, at this time, the angle sensor 7 (or the rope displacement sensor) is connected to the main control module through the expansion control board. The angle sensor 7 (or pull rope displacement sensor) is installed far away from the control room. In the resistance mode, in order to ensure the acquisition accuracy, a precise current source scheme is adopted, that is, the current source is connected to the angle sensor (or pull The rope displacement sensor) is connected, and the measurement accuracy of the angle sensor 7 (or the rope displacement sensor) can be guaranteed by adopting this scheme.

综上所述,以上仅为本发明的较佳实施例而已,并非用于限定本发明的保护范围。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。To sum up, the above are only preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (7)

1.基于图像处理技术的智能卷帘机系统,包括:主控模块、气象站、GPRS模块、摆杆和卷帘机电机;外围设备为温室大棚;所述主控模块位于控制室内;气象站安装在温室大棚的顶部,所述气象站实时采集温室大棚外的气象信息,然后将所采集的气象信息发送给主控模块;所述气象信息包括环境温度、湿度、光照、风速和风向;所述摆杆可伸缩,其底部与固定安装的支座铰接,摆杆能够绕该铰接点摆动;所述卷帘机电机安装在摆杆的顶部,卷帘机电机的输出轴与铺设在温室大棚外保温被的卷轴相连,带动保温被的卷起或铺设;所述GPRS模块用于将温室大棚外的气象信息及保温被位置信息以彩信形式发送给操作人员,并接受操作人员的控制指令,对卷帘机进行远程监控;1. An intelligent roller shutter system based on image processing technology, including: a main control module, a weather station, a GPRS module, a swing rod and a roller shutter motor; the peripheral equipment is a greenhouse; the main control module is located in the control room; the weather station Installed on the top of the greenhouse, the weather station collects weather information outside the greenhouse in real time, and then sends the collected weather information to the main control module; the weather information includes ambient temperature, humidity, light, wind speed and wind direction; The swing rod is telescopic, and its bottom is hinged with a fixedly installed support, and the swing rod can swing around the hinge point; the motor of the roller blind machine is installed on the top of the swing rod, and the output shaft of the motor of the roller blind machine is connected with the The reels of the external thermal insulation quilt are connected to drive the rolling or laying of the thermal insulation quilt; the GPRS module is used to send the weather information outside the greenhouse and the location information of the thermal insulation quilt to the operator in the form of MMS, and accept the control instructions of the operator. Remote monitoring of roller blinds; 其特征在于,还包括摄像头;所述摄像头通过固定云台安装在控制室顶部,固定云台在主控模块的控制下对摄像头的角度进行调整;主控模块通过视频采集卡与摄像头相连,获取摄像头采集的图像信息;It is characterized in that it also includes a camera; the camera is installed on the top of the control room through a fixed platform, and the fixed platform adjusts the angle of the camera under the control of the main control module; the main control module is connected with the camera through a video capture card to obtain Image information collected by the camera; 所述摄像头具有三种工作模式,在工作模式一下,摄像头对准整个温室大棚,监控温室大棚安全;在工作模式二下,摄像头对准天空,采集天空图像;在工作模式三下,摄像头对准保温被安装有卷帘机电机的一侧,采集温室大棚的侧面图像;The camera has three working modes. In the first working mode, the camera is aimed at the entire greenhouse to monitor the safety of the greenhouse; in the second working mode, the camera is aimed at the sky to collect sky images; in the third working mode, the camera is aimed at The thermal insulation is installed on the side of the shutter machine motor, and the side image of the greenhouse is collected; 所述主控模块中预存有雨雪天气图像知识库,所述雨雪天气图像知识库指通过提取常见雨雪天气的图像特征,并依据提取的图像特征对雨雪天气进行分类后形成的图像知识库;同时所述主控模块中预存有每个分类结果对应的环境温度和湿度的范围;In the main control module, there is a rain and snow weather image knowledge base pre-stored, and the rain and snow weather image knowledge base refers to images formed by extracting image features of common rain and snow weather and classifying rain and snow weather according to the extracted image features knowledge base; at the same time, the range of ambient temperature and humidity corresponding to each classification result is pre-stored in the main control module; 当主控模块依据气象站发送的环境温度、湿度和光照初步判断会出现雨雪天气时;启动智能天气判断模式:主控模块控制摄像头进入工作模式二;摄像头以设定频率采集天空图像,并将采集到的天空图像发送给主控模块;主控模块提取接收到的天空图像的图像特征,并将提取的图像特征与雨雪天气图像知识库中不同类别雨雪天气的图像特征进行比对;When the main control module preliminarily judges that there will be rainy and snowy weather according to the ambient temperature, humidity and light sent by the weather station; start the intelligent weather judgment mode: the main control module controls the camera to enter working mode two; the camera collects sky images at a set frequency, and Send the collected sky image to the main control module; the main control module extracts the image features of the received sky image, and compares the extracted image features with the image features of different types of rain and snow weather in the rain and snow weather image knowledge base ; 若该图像特征与其中一类图像特征相同,主控模块确定会出现该类别的雨雪天气,将判断结果通过GPRS模块发送给操作人员;若该图像特征与雨雪天气图像知识库中所有类别的图像特征均不同,则主控模块重新获取天空图像,直至所接收到的环境温度、湿度不在所有分类对应的环境温度和湿度的范围;If the image feature is identical with one of the image features, the main control module determines that the rain and snow weather of this category will occur, and the judgment result is sent to the operator through the GPRS module; if the image feature is consistent with all categories in the rain and snow weather image knowledge base If the image features of different images are different, the main control module reacquires the sky image until the received ambient temperature and humidity are not within the range of ambient temperature and humidity corresponding to all classifications; 所述主控模块中预存有温室大棚安装有卷帘机电机一侧的侧面轮廓中四条边的长度;主控模块控制保温被卷起或铺设前,操作人员将设定的保温被的位置预存在主控模块中;主控模块先控制摄像头进入工作模式三,然后启动卷帘机,带动保温被铺设或卷起;在此过程中,摄像头实时采集温室大棚的侧面图像,并对采集到的侧面图像进行边缘提取处理,然后将处理得到的温室大棚的侧面轮廓发送给主控模块;所述主控模块依据该侧面图像确定保温被的当前位置;当保温被的当前位置与预设位置一致时,关闭卷帘机电机;若从侧面图像中得到保温被的位置在设定时间内没有发生变化,主控模块进入故障诊断模式:主控模块在故障诊断模式下首先判断当前位置是否是系统预设的位置,如果是,则主控模块关闭卷帘机电机;如果不是,则认为卷帘机电机发生了故障,主控模块主动断开卷帘机电机的电源,并通过GPRS模块向操作人员发短信报警。The main control module pre-stores the lengths of the four sides of the side profile of the side of the greenhouse where the roller shutter motor is installed; It exists in the main control module; the main control module first controls the camera to enter working mode three, and then starts the roller shutter machine to drive the insulation to be laid or rolled up; The side image is subjected to edge extraction processing, and then the side profile of the processed greenhouse is sent to the main control module; the main control module determines the current position of the heat preservation quilt according to the side image; when the current position of the heat preservation quilt is consistent with the preset position , turn off the roller shutter motor; if the position of the heat preservation quilt does not change within the set time from the side image, the main control module enters the fault diagnosis mode: in the fault diagnosis mode, the main control module first judges whether the current position is the system preset position, if yes, then the main control module closes the roller shutter motor; if not, then it is considered that the roller shutter motor has broken down, and the main control module actively disconnects the power supply of the roller shutter motor, and reports to the operator through the GPRS module The staff sent a text message to the police. 2.如权利要求1所述的基于图像处理技术的智能卷帘机系统,其特征在于,在所述保温被安装有卷帘机电机一侧的边缘上涂抹黑色颜料。2. The intelligent roller shutter system based on image processing technology as claimed in claim 1, characterized in that black paint is applied to the edge of the heat preservation side where the motor of the roller shutter is installed. 3.如权利要求1所述的基于图像处理技术的智能卷帘机系统,其特征在于,所述主控模块中预存有摄像头在三种工作模式下固定云台所需旋转的角度。3. The intelligent roller shutter system based on image processing technology according to claim 1, wherein the main control module pre-stores the rotation angles required by the camera to fix the pan-tilt in three working modes. 4.如权利要求1所述的基于图像处理技术的智能卷帘机系统,其特征在于,还包括角度传感器,所述角度传感器安装在摆杆的底部,随摆杆一起运动;4. The intelligent roller shutter system based on image processing technology according to claim 1, further comprising an angle sensor, the angle sensor is installed at the bottom of the swing rod and moves together with the swing rod; 所述主控模块中预设有摆杆在初始位置及终止位置时角度传感器的读数,主控模块控制保温被卷起或铺设前,在主控模块中预存保温被在设定位置时角度传感器的读数;保温被卷起或铺设过程中,所述角度传感器实时采集摆杆与地面的角度信息,并将采集到的角度信息发送给主控模块,主控模块将接收到的角度信息与其内部预设的保温被在设定位置时角度传感器的读数进行比对,当两者一致时,主控模块关闭卷帘机电机;The main control module is preset with the readings of the angle sensor when the pendulum is at the initial position and the end position. The main control module controls the angle sensor when the heat preservation is rolled up or laid in the main control module. readings; during the insulation is rolled up or laid, the angle sensor collects the angle information between the pendulum and the ground in real time, and sends the collected angle information to the main control module, and the main control module combines the received angle information with its internal The preset heat preservation is compared with the readings of the angle sensor at the set position, and when the two are consistent, the main control module turns off the roller shutter motor; 所述主控模块每次接收到角度传感器发送来的角度信息后,将当前收到的角度信息与前一次所接收到的角度信息进行比较,判断相邻两次角度信息是否发生改变;若两次角度信息有所改变,认为卷帘机电机工作正常;若所述角度信息在设定时间内没有发生变化,则进入故障诊断模式。After the main control module receives the angle information sent by the angle sensor each time, it compares the angle information received at present with the angle information received at the previous time, and judges whether two adjacent angle information changes; If the secondary angle information changes, it is considered that the motor of the roller blind machine is working normally; if the angle information does not change within the set time, enter the fault diagnosis mode. 5.如权利要求4所述的基于图像处理技术的智能卷帘机系统,其特征在于,通过定位机构将所述角度传感器安装在摆杆上;所述定位机构包括:连杆A、连杆B、中心轴、联轴器和两个轴承;所述连杆A的一端与摆杆垂直连接,另一端加工有轴向滑槽;所述连杆B的顶部位于该滑槽内,且可在该滑槽内轴向移动;所述连杆B的底部固接中心轴;所述中心轴与摆杆的铰接轴同轴,角度传感器通过联轴器固接在中心轴靠近摆杆一端的端部。5. The intelligent roller shutter system based on image processing technology as claimed in claim 4, wherein the angle sensor is mounted on the swing rod by a positioning mechanism; the positioning mechanism comprises: connecting rod A, connecting rod B, central shaft, coupling and two bearings; one end of the connecting rod A is vertically connected with the swing rod, and the other end is processed with an axial chute; the top of the connecting rod B is located in the chute, and can Move axially in the chute; the bottom of the connecting rod B is fixed to the central shaft; the central shaft is coaxial with the hinge shaft of the swing rod, and the angle sensor is fixed on the end of the central shaft close to the swing rod through a coupling Ends. 6.如权利要求1所述的基于图像处理技术的智能卷帘机系统,其特征在于,还包括拉绳位移传感器;所述拉绳位移传感器固定在保温被完全铺设或完全收起时的位置;拉绳位移传感器的拉绳端与卷帘机电机固接;6. The intelligent roller blind machine system based on image processing technology as claimed in claim 1, further comprising a stay rope displacement sensor; the stay rope displacement sensor is fixed at the position when the heat preservation is fully laid or fully retracted ; The rope end of the rope displacement sensor is fixedly connected to the motor of the shutter machine; 所述主控模块控制保温被卷起或铺设的过程中,卷帘机电机与保温被一起移动,则带动拉绳位移传感器的拉伸移动;拉绳位移传感器实时向主控模块发送拉绳的位移信号,主控模块依据该位移信号判断保温被的位置;During the process that the main control module controls the heat preservation being rolled up or laid, the motor of the roller shutter machine and the heat preservation quilt move together, which drives the stretching movement of the pull rope displacement sensor; Displacement signal, the main control module judges the position of the insulation quilt according to the displacement signal; 所述主控模块每次接收到拉绳位移传感器发送来的位移信号后,将当前收到的位移信号与前一次所接收到的位移信号进行比较,判断相邻两次位移信号是否发生改变;若两次位移信号有所改变,认为卷帘机电机工作正常;若所述位移信号在设定时间内没有发生变化,则进入故障诊断模式。After the main control module receives the displacement signal sent by the stay rope displacement sensor each time, it compares the displacement signal received at present with the displacement signal received at the previous time, and judges whether two adjacent displacement signals have changed; If the two displacement signals have changed, it is considered that the motor of the shutter machine is working normally; if the displacement signal does not change within the set time, it will enter the fault diagnosis mode. 7.如权利要求1或4或6所述的基于图像处理技术的智能卷帘机系统,其特征在于,在所述温室大棚上,保温被完全铺设和完全收起的位置各设置一个限位开关,当所述保温被接触到限位开关后,向主控模块发送保温被到位信号,主控模块接收到保温被到位信号后,关闭卷帘机电机。7. The intelligent rolling machine system based on image processing technology as claimed in claim 1, 4 or 6, characterized in that, on the greenhouse, a limit position is set at the position where the insulation is fully laid and fully retracted. switch, when the heat preservation is in contact with the limit switch, it sends a signal that the heat preservation is in place to the main control module, and after receiving the signal that the heat preservation is in place, the main control module closes the roller shutter motor.
CN201310416299.4A 2013-09-13 2013-09-13 Based on the intelligent curtain rolling machine system of image processing techniques Expired - Fee Related CN103472799B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310416299.4A CN103472799B (en) 2013-09-13 2013-09-13 Based on the intelligent curtain rolling machine system of image processing techniques

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310416299.4A CN103472799B (en) 2013-09-13 2013-09-13 Based on the intelligent curtain rolling machine system of image processing techniques

Publications (2)

Publication Number Publication Date
CN103472799A CN103472799A (en) 2013-12-25
CN103472799B true CN103472799B (en) 2015-09-23

Family

ID=49797690

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310416299.4A Expired - Fee Related CN103472799B (en) 2013-09-13 2013-09-13 Based on the intelligent curtain rolling machine system of image processing techniques

Country Status (1)

Country Link
CN (1) CN103472799B (en)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104472276B (en) * 2014-12-01 2017-02-08 安徽科技学院 Mounting and use method of solar greenhouse sidewall-mounted curtain reeling mechanism
CN104978418A (en) * 2015-06-29 2015-10-14 杨昕吉 A method and system for intelligent weather image acquisition and weather image recognition
CN105493913A (en) * 2015-12-31 2016-04-20 北京农业信息技术研究中心 Irradiation device for plant growth and irradiation method for plant growth
CN105961076A (en) * 2016-05-05 2016-09-28 安徽农业大学 Double-layer plastic greenhouse
CN106483999A (en) * 2016-11-04 2017-03-08 谷彤 Anti- personal injury curtain-rolling machine for greenhouse intelligent controller
CN106768073A (en) * 2017-02-07 2017-05-31 钱峥 A kind of dual camera automatic weather station that can gather panorama and day condition
CN106912325B (en) * 2017-03-13 2022-11-08 山东农业大学 Sunlight greenhouse rolling curtain ventilation system based on intelligent prediction and control method
CN106912326A (en) * 2017-04-07 2017-07-04 大连英力斯特机电设备有限公司 Greenhouse roller remote control and protection system
CN107677230B (en) * 2017-10-17 2019-06-04 中国农业大学 A method for detecting the opening degree of greenhouse shed
CN107765732A (en) * 2017-10-24 2018-03-06 中国农业大学 A kind of greenhouse wound membrane machine remote monitoring system and method
CN108649448A (en) * 2018-05-14 2018-10-12 朱雨辰 Outdoor high-power water-tight socket box
CN109799824A (en) * 2019-01-23 2019-05-24 华中农业大学 Field crops image collecting device based on wheeled carriage
CN110362133B (en) * 2019-04-01 2020-07-07 中国农业大学 Sunlight greenhouse illumination intensity control method and system
CN110471337A (en) * 2019-08-06 2019-11-19 西北农林科技大学 A kind of roller shutter machine of solar greenhouse intelligent monitor system and method based on low-power consumption narrowband net
CN110622742B (en) * 2019-10-11 2024-11-26 北京市农林科学院 A fully automatic greenhouse rolling curtain machine and control method
CN111108980B (en) * 2020-01-03 2022-05-27 天津市农业科学院信息研究所 Greenhouse roller shutter operation control system and control method thereof
CN113348909B (en) * 2021-07-15 2022-08-09 宁夏大学 Double-layer heat-preservation sunlight greenhouse with dynamic temperature regulation and control function and intelligent regulation method
CN114284899B (en) * 2022-01-05 2022-11-29 南京赤勇星智能科技有限公司 5G integrated intelligent power cabinet and energy-saving method and system thereof
CN115237175A (en) * 2022-05-18 2022-10-25 农业农村部规划设计研究院 Greenhouse heat-insulating part control method and device, electronic equipment and medium
CN118192312A (en) * 2024-03-13 2024-06-14 山东链云科技有限公司 Greenhouse roller shutter machine control method, device and greenhouse roller shutter machine

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0279916A (en) * 1988-09-16 1990-03-20 Iseki & Co Ltd House
WO2007091586A1 (en) * 2006-02-07 2007-08-16 Fairy Angel Inc. Plant growing system using portable telephone
CN101576753A (en) * 2009-05-27 2009-11-11 江苏农林职业技术学院 Greenhouse environmental control device
KR20120120689A (en) * 2011-04-25 2012-11-02 전북대학교산학협력단 Remote control system for vinyl-house
CN202929440U (en) * 2012-09-29 2013-05-08 民勤县大漠瓜菜实业有限公司 Automatic greenhouse control system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0279916A (en) * 1988-09-16 1990-03-20 Iseki & Co Ltd House
WO2007091586A1 (en) * 2006-02-07 2007-08-16 Fairy Angel Inc. Plant growing system using portable telephone
CN101576753A (en) * 2009-05-27 2009-11-11 江苏农林职业技术学院 Greenhouse environmental control device
KR20120120689A (en) * 2011-04-25 2012-11-02 전북대학교산학협력단 Remote control system for vinyl-house
CN202929440U (en) * 2012-09-29 2013-05-08 民勤县大漠瓜菜实业有限公司 Automatic greenhouse control system

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"数据采集系统中光栅尺信号处理方法的研究";张百海 等;《机床与液压》;20031231(第2期);118-119 *
"日光温室温湿环境数据库的建立及其在专家系统中的应用";张培新 等;《农业网络信息》;20061231(第6期);18-20 *

Also Published As

Publication number Publication date
CN103472799A (en) 2013-12-25

Similar Documents

Publication Publication Date Title
CN103472799B (en) Based on the intelligent curtain rolling machine system of image processing techniques
CN206805329U (en) Sun glasshouse's green house of vegetables video intelligent central management equipment
CN206031396U (en) High -speed railway pulls institute's pavilion intelligence and patrols survey system
CN207301379U (en) Agricultural weather station intelligent monitoring and controlling device based on multi-sensor information fusion
CN105204546B (en) A kind of roller shutter machine of solar greenhouse control method based on the coupling of light temperature and system
CN110763270A (en) Power transmission line tower pole working condition monitoring system based on multiple information acquisition
CN107064735A (en) A kind of transmission line malfunction Visualized Monitoring System and method
CN111224465B (en) Intelligent monitoring system for micro-power distribution lines
CN103472327B (en) A kind of anti-strong magnetic round-the-clock dry reactor on-Line Monitor Device and method
CN206388088U (en) A kind of warmhouse booth intelligence control system
CN106034803A (en) Intelligent flower growing system based on Internet of Things
CN106105902B (en) Control system and control method of greenhouse roller shutter device
CN107278490A (en) A kind of intelligent grass-removing and its control method
CN205265146U (en) Novel patrol and examine device
CN110673155A (en) Detection device, detection system and detection method for power transmission line structure
CN211454003U (en) A kind of substation cable trench water level monitoring device
CN204883311U (en) Warmhouse booth management system
CN210608693U (en) Micro-power consumption distribution line intelligent monitoring system
CN221299260U (en) Mine early warning device based on 5G communication and infrared imaging technology
CN207833651U (en) A kind of fire prevention early warning electric power tower
CN202948349U (en) Intelligent control circuit and outdoor intelligent electronic equipment box
CN203274791U (en) Remote on-line state detection system of high-tension transmission line
CN117958059A (en) Rolling curtain device and rolling curtain control method for solar greenhouse
CN213813829U (en) Transmission line on-line monitoring device
CN104106430A (en) Sunlight greenhouse covering control system and method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150923

Termination date: 20180913