SE2051353A1 - A computer-implemented method for monitoring a horse to predict foaling - Google Patents

Abstract

A computer-implemented method and system for monitoring a horse to predict foaling and create an alarm, wherein a horse is monitored in a confined area by recording image data from an image recording device, identifying when the horse enters the confined area and starting to monitor horse movement levels for subsequent, equal length, time periods when the horse enters the confined area. The movement levels are compared with previously recorder movement levels and an alarm generated if a threshold is exceeded.

Description

A COMPUTER-IMPLEMENTED METHOD FOR MONITORING A HORSE TOPREDICT FOALING Technical Field 1. 1. id="p-1" id="p-1"

[0001] The present disclosure relates generally to a method and a system for monitoring a horse to predict foaling.

Background 2. 2. id="p-2" id="p-2"

[0002] Horse breeding techniques have been developed by humans sinceancient times. One of the most vital steps is when a mare gives birth to her foal.Even though the foaling process occurs independently of human interventions,sometimes this intervention is essential in order to avoid serious injuries and/or death of the horse or the foal. 3. 3. id="p-3" id="p-3"

[0003] Horse monitoring is typically done by owners or staff of a breedingfacility, zoos, farms or any place that has horses. This monitoring is usually laborintensive and therefore expensive, since it is not possible to predict with precisionwhen a foaling process will happen. Furthermore, the animals cannot bemonitored 24 hours a day by staff or owners. 4. 4. id="p-4" id="p-4"

[0004] ln cases when a person detects a foaling process taking place and someissue is identified, it is usually too late for contacting and obtaining a professional help that would arrive on time for a veterinary intervention or assistance. . . id="p-5" id="p-5"

[0005] Some solutions in the art include one or more sensors connected to thehorse body for continuously monitoring horse parameters, such as heart rate, laiddown/up positions etc. However, those solutions may detect a foaling process thatis taking place at the moment and thus are not able to predict and alert astaff/owner in advance about the foaling process. 6. 6. id="p-6" id="p-6"

[0006] Therefore, there is a need of a monitoring process of a horse that is able to avoid or at least reduce the above-mentioned problems.

Summary 7. 7. id="p-7" id="p-7"

[0007] lt is a first aspect of this disclosure to present a computer-implementedmethod for monitoring a horse to predict foaling and create an alarm thatmitigates, alleviates or eliminates one or more of the above-identified deficienciesin the art singly or in combination. Another aspect of this disclosure is to present a system for monitoring a horse, predict foaling and create an alarm. 8. 8. id="p-8" id="p-8"

[0008] The first aspect is solved by providing a computer-implemented methodfor monitoring a horse to predict foaling and create an alarm, comprising the stepsof monitoring a horse in a confined area by recording image data from an imagerecording device, identifying when the horse enters the confined area, starting tomonitor horse movement levels for subsequent, equal length, time periods whenthe horse enters the confined area, comparing the movement levels withpreviously recorder movement levels. Further, an alarm is generated if a thresholdis exceeded, the threshold being any one of: the movement level of a first timeperiod after the horse entered the confined area exceeds a first threshold for anaverage first time period movement level, the movement level of a number ofsubsequent time periods exceed a second threshold for an average movementlevel of the same subsequent time periods from the horse entered the confined area. 9. 9. id="p-9" id="p-9"

[0009] One exemplary effect of this computer-implemented method is that it ispossible to predict foaling and create an alarm by using an image recording deviceonly. Thus, there is no need of using extra devices, such as devices attached tothe horse in order to know its location or position. Furthermore, the methodaccording to the disclosure advantageously predict a foaling event in an accuratemanner by comparing actual movement level with previously recorded movementlevel, using an image recording device. The predicted foaling event may thentrigger an alarm so one or more subjects may be notified and act according to thealarm received. ln other words, one or more subjects may be notified before the foaling process starts to happen. . . id="p-10" id="p-10"

[00010] A previous movement may be recorded by an image recording devicesuch as a camera. Previous movement records of a horse that enters a confinedarea may provide a standard behavior pattern for that specific horse. Hence, thestandard behavior pattern may then be compared to current behavior patterndetermined by the current movement record of the horse. ln case the currentmovement record exceeds a first threshold, an alarm may be triggered. 11. 11. id="p-11" id="p-11"

[00011] Alternatively, an average movement level for a number of subsequenttime periods may be compared to the current movement level of the samesubsequent time periods from the time since the horse entered the confined area.ln case the current movement level of the same subsequent time periods exceedsa second threshold, an alarm may be triggered. Both first and second thresho|dsindependently provide an accurate horse foa| prediction. 12. 12. id="p-12" id="p-12"

[00012] According to one exemplary embodiment the equal length time periodsare time periods of for example any one of 1, 5, 10, 15, 20, 30, 60 or 120 minutes.ln another example the equal length time periods are for each horse determinedby the horse movement level. Such determination could for example be conducted via an artificial intelligence engine or average calculations. 13. 13. id="p-13" id="p-13"

[00013] According to one exemplary embodiment, the first time period is delayedat least 30 minutes after the horse enters the confined area. The first time periodmay be delayed at least 45 minutes, 60 minutes or 90 minutes after the horseenters the confined area. One exemplary effect of this embodiment is that it wasnoted that an even higher foaling prediction accuracy and/or a reduced number offalse alarms may be obtained when the first period is delayed by at least 30minutes. This effect may happen since the horse may naturally move substantiallymore when it has just entered the confined area, for instance for recognizing thearea or searching the limits of the confined area. Furthermore, the horsemovement level during the first 30 minutes in the confined area is more affected towhat happened before the horse entered that confined area, e.g., if the horse ate, ran or trained 14. 14. id="p-14" id="p-14"

[00014] According to another exemplary embodiment, the average movementlevels are any one, or a combination, of movement levels recorder from multipledays for a specific horse, movement levels recorder from multiple days for a groupof horses, and movement levels recorder for a general population of horses. Oneexemplary effect of this embodiment is that the horse movement may not only becompared to its own average movement, but also to average movements of agroup of horses and/or a general population of horses. The comparison ofmovement levels recorder from multiple days for the specific horse and/or a groupof horses and/or the general population of horses may be used to predict a foalingevent for the specific horse. Further, movement data from a group of horse and/ormovement data from the general population of horses may be used in case thereare missing data from the specific horse. ln this case, a reliable foaling predictionmay also be obtained. . . id="p-15" id="p-15"

[00015] According to one exemplary embodiment, the horse movement levelcomprises information about for example if the horse is laying down, standing up,standing still, or moving together with the information how much the horse ismoving. lt is thus one advantage with the horse movement level as describedherein and as monitored by the image recording device that the horse movementlevel provides relevant data for analysis independently if the horse is for examplestanding or lying down. 16. 16. id="p-16" id="p-16"

[00016] According to one exemplary embodiment, the average movement levelscomprise only the last time period of a defined time period. The last time periodmay be substantially shorter than the defined time period. A defined time periodmay be selected from 12 hours, 1 day, 2 days, 4 days and 7 days. lf for instance adefined time period is one day, the average movement level considers only the last time period of the day. 17. 17. id="p-17" id="p-17"

[00017] According to one exemplary embodiment, the average movement level ofmultiple time periods are averages of aggregated values of measurements withinthe time periods and averages of the aggregated time periods. Aggregated valuesmay be measurements obtained approximately every second. The aggregated values may than be averaged per minute in order to obtain an average minute value. Further, the average minute levels may be averaged in for instance every 5minutes, 10 minutes, 15 minutes, 20 minutes, 30 minutes and combinationsthereof. 18. 18. id="p-18" id="p-18"

[00018] One advantageous effect is that substantial computational processing isavoided by the averaging the aggregated values. The computational processingsavings generated by compressing data promote a more effective calculation.Further, less storage space is demanded. 19. 19. id="p-19" id="p-19"

[00019] According to another exemplary embodiment, the at least one of the firstand second thresholds is dependent of the time of day. The time of the day maybe in the morning, in the afternoon or in the evening. One exemplary effect is thatdepending on the time of the day, horse movement and/or behavior may change,so defining a first and second threshold accordingly may increase the predictabilityof the method. . . id="p-20" id="p-20"

[00020] According to another exemplary embodiment, the time periods has alength between 5 and 60 minutes. The time period may have a length of 5, 10, 20,30, 40, 50 or 60 minutes. One exemplary effect of this embodiment is that datafrom 5 to 60 minutes may provide an ideal range for data collection, thereby improving the foaling prediction and reducing or avoiding false alarms. 21. 21. id="p-21" id="p-21"

[00021] According to another exemplary embodiment, missing data in theaverage movement levels is replaced with average movement data from thecurrent time period. One exemplary effect of this embodiment is that the computerimplemented method may still provide a horse monitoring that predicts foaling andcreate an alarm. The method still works even if data is missing by replacing the missing data with average movement data from the current time period. 22. 22. id="p-22" id="p-22"

[00022] According to another exemplary embodiment, the horse is identified inthe image data from the image recording device by image recognition. The imagerecording device may be any device suitable for image recognition, such as acamera, video camera, radar, a lidar, an infrared camera and combinations thereof. 23. 23. id="p-23" id="p-23"

[00023] According to another exemplary embodiment, the horse movement levelsare calculated from the image data by at least the steps: masking an area aroundthe horse to define pixels creating a mask relating to said horse, and calculating pixel movement of the mask. 24. 24. id="p-24" id="p-24"

[00024] According to another exemplary embodiment, the horse movement levelsare calculated from the image data by at least the steps: masking an area aroundthe horse to define an area in the image relating to said horse, and calculating the difference in the mask values between two or several images with masks. . . id="p-25" id="p-25"

[00025] According to another exemplary embodiment, generating the alarmcomprise the steps: determine if another alarm has been generated within athreshold time, generate an alarm to a user if no alarm been generated within thethreshold time and cancel subsequent alarms generated until expiry of thethreshold time. One exemplary effect of this embodiment is to avoid generatingmultiple alarms to a user due to the same event. After the alarm is first triggereddue to a threshold being exceeded, subsequent alarms will be canceled until thethreshold time is expired. 26. 26. id="p-26" id="p-26"

[00026] According to another exemplary embodiment, generating the alarmcomprise the step: transmit an alert to a personal telecommunication device. Apersonal telecommunication device may be any device suitable fortelecommunication. A non-exhaustive list of personal telecommunication devicecomprises a phone, a mobile phone, a personal computer, a notebook, a tablet, a wearable device, a smartwatch, a smart band and combinations thereof. 27. 27. id="p-27" id="p-27"

[00027] A second aspect of the disclosure concerns a system for monitoring ahorse, predict foaling and create an alarm, wherein the system comprises animage recording device, a memory, a central processing unit, and alarm means.Further, the image recording device is adapted to be arranged to monitor a horsein a confined area, the system is adapted to by means of image data from theimage recording device identify when the horse enters the confined area, startmonitoring horse movement levels for subsequent, equal length, time periods when the horse enter the confined area. Further, the system compares the movement levels with previously recorder movement levels and activate the alarmmeans if a threshold is exceed, wherein the threshold is any one of: the movementlevel of a first time period after the horse entered the confined area exceeds a firstthreshold for an average first time period movement level, the movement level of anumber of subsequent time periods exceed a second threshold for an averagemovement level of the same subsequent time periods from the horse entered the confined area. 28. 28. id="p-28" id="p-28"

[00028] One exemplary effect of the system is that a horse foaling can bepredicted, and an alarm can be triggered before the foaling process begins.Therefore, the system can predict a foaling process and trigger an alarm without the need of human monitoring, e.g. staff members or the owner. 29. 29. id="p-29" id="p-29"

[00029] According to one exemplary embodiment, the image recording device isany one of a camera, a video camera, and an infrared camera. The imagerecording device of the system may be any one of a camera, video camera, radar, lidar, infrared camera or combinations thereof. . . id="p-30" id="p-30"

[00030] According to one exemplary embodiment the system may furthercomprise an artificial intelligence (Al) engine for any one of the steps, for examplesetting the length of equal length time periods, identifying the horse, thresholds, oridentifying a horse movement level depending on the horse is standing, laying down, standing still, or moving around. 31. 31. id="p-31" id="p-31"

[00031] ln one embodiment, the artificial intelligence engine uses machinelearning and neural networks to improve at least one of setting the length of equallength time periods, identifying the horse, thresholds, or identifying a horsemovement level depending on the horse is standing, laying down, standing still, or moving around. 32. 32. id="p-32" id="p-32"

[00032] According to another exemplary embodiment, the system performs themethod according to any one of the previous embodiments. 33. 33. id="p-33" id="p-33"

[00033] According to another aspect the system may monitor abnormalities andabnormal motion patters to detect and alarm if the horse behaves out of the normal. This is for example advantageous for detecting other triggers than foaling,such as colic, diseases, or any problem occurring that affects the horse. Theimage recording device can further be used to provide live or accumulated feedsof image and/or video to a user via for example the same device as the user receives an alarm via. 34. 34. id="p-34" id="p-34"

[00034] Other parameters such as the length of rest, amount of movement,numbers of times the horse gets up standing and/or down in a time period couldfurther be used to understand and analyze both foaling and other triggers.

Brief description of the drawinqs . . id="p-35" id="p-35"

[00035] Fig. 1 illustrates a flow chart describing a computer implemented method for monitoring a horse, according to one embodiment. 36. 36. id="p-36" id="p-36"

[00036] Fig. 2 illustrates a flow chart describing a computer implemented method for monitoring a horse having two triggers, according to one embodiment. 37. 37. id="p-37" id="p-37"

[00037] Fig. 3 illustrates a blocking diagram of a system for monitoring ahorse, according to one embodiment.

Detailed description 38. 38. id="p-38" id="p-38"

[00038] Figure 1 shows a computer-implemented method 10 for monitoring ahorse to predict foaling and create an alarm. The method comprises a step 100 ofmonitoring a horse in a confined area, and the monitoring step 100 may use animage recording device. The image recording device is positioned in a placewhere it can record the whole confined area where the horse may move. Someconfined areas may be recorded by more than one image recording device so allarea can be accurately monitored. Furthermore, the image recording device maybe stationary or may comprise means for moving in case the image recordingdevice needs to be repositioned. 39. 39. id="p-39" id="p-39"

[00039] ln step 110, it is identified when the horse entered a confined area.The step 110 is a relevant step since on this step it is detected when the horse enters the confined area and a time period can be counted from this moment. The horse may be identified by the image recording device using any technique knownin the art, for instance by masking an area around the horse to define pixels andcreating a mask related to the horse or masking an area in the image relating tosaid horse. This step 110 may usually be used to identify one horse per confinedarea, but it may be applied to monitor two or more horses in the same confined area. 40. 40. id="p-40" id="p-40"

[00040] ln step 120, horse movement levels are constantly monitored andstored. Horse movement levels may be monitored by any technique known in theart, for instance by by masking an area around the horse to define pixels, creatinga mask related to the horse, and calculating pixel movement of the mask. Thehorse movement levels are monitored in a subsequent, equal length, time periodsmanner, so that this data may be compared to future movement level data usingthe same parameters (e.g. equal length, time period etc.). The time period may be15 minutes since the horse entered the confined area. The time period may be 60minutes since the horse entered the confined area. The time period may be 180minutes since the horse entered the confined area. Alternatively, the time periodmay be the morning, the afternoon or the evening. 41. 41. id="p-41" id="p-41"

[00041] Movement levels in step 120 may be calculated in batches of 15minutes, therefore one hour is measured as 4 batches of 15 minutes each. 42. 42. id="p-42" id="p-42"

[00042] ln step 130, the current movement level of a horse is compared toprevious movement level recorded by the image recording device. The movementlevel of a horse is compared to a previous movement level on an equivalent timeperiod. For instance, movement level 15 minutes after entering the confined areacan be compared to previous 15 minutes after entering the confined area. Themovement level 15 minutes after entering the confined area can be compared toan average of previous 15 minutes after entering the confined area. The averagemay be the average of the last 7, 8, 9, 10, 11 or more days. 43. 43. id="p-43" id="p-43"

[00043] The average calculation may include only the last event of a timeperiod such as a day. For instance, in case a horse enters a confined area at 2pm, leaves at 4.30pm, returns to the confined area at 8pm and leaves the next day at 8am, the average calculation considers only the last event, i.e., the average movement levels from 8pm to 8am. 44. 44. id="p-44" id="p-44"

[00044] ln step 140, it is measured whether a threshold was exceeded. Thethreshold may be 130, 150, 180, 200 or 300% higher current movement levelcompared to the averaged movement levels. ln case the threshold is not reached,step 140 ends and the method return to step 120, i.e. monitoring the horse movement levels. 45. 45. id="p-45" id="p-45"

[00045] ln step 150, an alarm is triggered when the current movement levelreaches a threshold when compared to previous averaged movement levels. Thealarm may be triggered every 15 minutes if any of the threshold values areexceeded. The alarm may be any means for inducing a subject to perceive thatthe alarm was triggered. The alarm may be a sound, a beep, a light, a vibrationand combinations thereof. The alarm may be sent to one or more personaltelecommunication devices, such as smartphones, computers, or other personal communication devices. 46. 46. id="p-46" id="p-46"

[00046] When the alarm is triggered by any threshold, all other alarms may bepaused for the next 240, 260, 285, 300, 325 minutes. 47. 47. id="p-47" id="p-47"

[00047] The alarm may not be sent during the first 15, 30, 45, 60, 90, 120minutes since the horse has entered the confined area. Alternatively, the alarmmay not be sent after 90, 120, 180 minutes have passed. 48. 48. id="p-48" id="p-48"

[00048] Fig.2 shows a computer-implemented method 20 where two differentthresholds may be used as an alarm trigger. The steps of monitoring a horse 200,identifying when the horse enters a confined area 210, monitoring horsemovement levels 220 and comparing movement levels with previous movement levels 230 are as previously described. 49. 49. id="p-49" id="p-49"

[00049] ln step 240, it is measured whether a first threshold was exceeded.The first threshold may be exceeded when the movement level of a first timeperiod after the horse entered the confined area is higher than the averagemovement level of previous first time periods. Alternatively, the first threshold may 11 be exceeded when the movement level of a number of subsequent time periodsafter the horse entered the confined area is higher than the average movementlevel of the same subsequent time periods. 50. 50. id="p-50" id="p-50"

[00050] ln case the first threshold 240 is exceeded, a step 250 of triggering the alarm is followed. 51. 51. id="p-51" id="p-51"

[00051] ln case any of the thresholds are not exceeded, it is checked in thenext step 260 whether the second threshold was exceeded. The second thresholdmay be exceeded when the movement level of a first time period after the horseentered the confined area is higher than the average movement level of previousfirst time periods. Alternatively, the second threshold may be exceeded when themovement level of a number of subsequent time periods after the horse enteredthe confined area is higher than the average movement level of the samesubsequent time periods. 52. 52. id="p-52" id="p-52"

[00052] ln case the first threshold is related to the movement level of a firsttime period, the second threshold will be the movement level of a number ofsubsequent time periods. 53. 53. id="p-53" id="p-53"

[00053] ln case the first threshold is related to the movement level of anumber of subsequent time periods, the second threshold will be the movementlevel of a first time period. 54. 54. id="p-54" id="p-54"

[00054] ln case the second threshold 260 is exceeded, a step 270 of triggeringthe alarm is followed. 55. 55. id="p-55" id="p-55"

[00055] When both threshold steps 240 and 260 do not lead to triggering thealarm, the method return to the step 220 of monitoring the horse movement levels. 56. 56. id="p-56" id="p-56"

[00056] Fig. 3 depicts an illustrative block diagram of a system 30 formonitoring a horse in which a set of instructions for causing the system to performany one of the methods discussed herein may be executed. The system 30 maycomprise 1, 2, 3, 4, 5, 6, 10, 20 or more devices. 12 57. 57. id="p-57" id="p-57"

[00057] The system 30 for monitoring a horse may include at least one centralprocessing unit 320, a memory 310, a network adapter 330, an image recordingdevice 340, and alarm means 350, and storage means 360 that are in connectionto a bus 300. The bus 300 represents one or more separate buses connected bysuitable controllers, adapters and/or bridges, and may be any form of network and/or internal bus, alone or in combination. 58. 58. id="p-58" id="p-58"

[00058] The central processing unit 320 may be one or more processordevices known in the art, such as microprocessors, and the central processing unit320 is configured to execute instructions related to the steps of the method as descnbed. 59. 59. id="p-59" id="p-59"

[00059] The image recording device 340 may be any device suitable forrecording an image, such as camera, video camera, radar, a lidar, an infrared camera and combinations thereof. 60. 60. id="p-60" id="p-60"

[00060] The alarm means 350 may be any means for inducing a subject toperceive that the alarm was triggered. The alarm means 350 may be a sound, abeep, a light, a vibration and combinations thereof. The alarm means 350 may besent and triggered in one or more personal telecommunication devices, such as smartphones. 61. 61. id="p-61" id="p-61"

[00061] The storage means 360 is a computer-readable medium on whichdata related to horse movement levels are stored. 62. 62. id="p-62" id="p-62"

[00062] The system 30 may be several independent system devices30;30a,30b;30a...30n. The system devices 30;30a,30b;30a...30n are in oneembodiment connected via a network and each comprise one or multiple of thedevices 310, 320, 330, 340, 350, 360 as illustrated in Fig. 3. The system 30 canmonitor a horse, predict foaling and create an alarm, wherein the alarm is triggered by at least one threshold as previously described.

Claims (15)

1. A computer-implemented method for monitoring a horse to predict foalingand create an alarm, comprising the steps: - monitor a horse in a confined area by recording image data from an imagerecording device, - identify when the horse enters the confined area, - start monitor horse movement levels for subsequent, equal length, time periodswhen the horse enters the confined area, - compare movement levels with previously recorder movement levels andgenerate an alarm if a threshold is exceed, wherein the threshold is any one of: - the movement level of a first time period after the horse entered the confinedarea exceeds a first threshold for an average first time period movement level, - the movement level of a number of subsequent time periods exceed a secondthreshold for an average movement level of the same subsequent time periods from the horse entered the confined area.

2. The computer-implemented method according to claim 1, wherein thefirst time period is delayed at least 30 minutes after the horse enters the confined area.

3. The computer-implemented method according to any one of claims 1 or2, wherein the average movement levels are any one, or a combination, of: - movement levels recorder from multiple days for a specific horse, - movement levels recorder from multiple days for a group of horses, and - movement levels recorder for a general population of horses.

4. The computer-implemented method according to any one of claims 1-3,wherein the average movement levels comprise only the last time period of adefined time period.

5. The computer-implemented method according to any one of claims 1-4, wherein the average movement level of multiple time periods are averages of 14 aggregated values of measurements within the time periods and averages of the aggregated time periods.

6. The computer-implemented method according to any one of claims 1-5,wherein at least one of the first and second thresholds is dependent of the time of day.

7. The computer-implemented method according to any one of claims 1-6,wherein the time periods has a length between 5 and 60 minutes.

8. The computer-implemented method according to any one of claims 1-7,wherein missing data in the average movement levels is replaced with average movement data from the current time period.

9. The computer-implemented method according to any one of claims 1-8,wherein the horse is identified in the image data from the image recording deviceby image recognition.

10. The computer-implemented method according to any one of claims 1-9,wherein the horse movement levels are calculated from the image data by at leastthe steps: - masking an area around the horse to define an area in the image relating to saidhorse, and - calculating the difference in the mask values between two or several images with masks.

11. The computer-implemented method according to any one of claims 1-10, wherein generating the alarm comprise the steps: - determine if another alarm been generated within a threshold time, - generate an alarm to a user if no alarm been generated within the threshold timeand cancel subsequent alarms generated until expiry of the threshold time.

12. The computer-implemented method according to any one of claims 1-11, wherein generating the alarm comprise the step: - transmit an alert to a personal telecommunication device.

13. A system for monitoring a horse, predict foaling and create an alarm,wherein the system comprises an image recording device, a memory, a centralprocessing unit, and alarm means, the image recording device is adapted to bearranged to monitor a horse in a confined area, the system is adapted to by meansof image data from the image recording device identify when the horse enters theconfined area, start monitoring horse movement levels for subsequent, equallength, time periods when the horse enter the confined area, compare themovement levels with previously recorder movement levels and activate the alarmmeans if a threshold is exceed, wherein the threshold is any one of: - the movement level of a first time period after the horse entered the confinedarea exceeds a first threshold for an average first time period movement level, - the movement level of a number of subsequent time periods exceed a secondthreshold for an average movement level of the same subsequent time periods from the horse entered the confined area.

14. The system for monitoring a horse, predict foaling, and create an alarmaccording to claim 13, wherein the image recording device is any one of a camera,video camera, radar, lidar, infrared camera, or combinations thereof.

15. The system for monitoring a horse, predict foaling, and create an alarmaccording to any one of claims 13 or 14, wherein the system performs the method according to any one of claims 1-12.