WO2021133356A2

WO2021133356A2 - A product system for automating marking, mapping and reporting processes carried out in demining activities

Info

Publication number: WO2021133356A2
Application number: PCT/TR2020/051385
Authority: WO
Inventors: Furkan Efe DIKMEN; Efe KART; Eniscan BUBIK; Kerem Asaf TECIRLIOGLU
Original assignee: Dimus Proje Teknoloji Tasarim Ve Danismanlik Ltd Sirketi
Current assignee: Dimus Proje Teknoloji Tasarim Ve Danismanlik Ltd Sirketi
Priority date: 2019-12-26
Filing date: 2020-12-25
Publication date: 2021-07-01
Anticipated expiration: 2022-06-26
Also published as: WO2021133356A3

Abstract

The invention is related to the product system that automatizes marking, mapping, and reporting processes carried out in demining activities.

Description

A PRODUCT SYSTEM FOR AUTOMATING MARKING, MAPPING AND REPORTING PROCESSES CARRIED OUT IN DEMINING ACTIVITIES

TECHNICAL FIELD

The present invention relates to a product system that enables automation of marking, mapping, and reporting processes carried out in demining activities. PRIOR ART

In the prior art, demining activities are mainly focused on digitalizing the applications that are currently used for improving the process of clearing land mines from an area and for reducing the labor force through the use of the latest technology. Demining activities consist of 4 process steps, these are the following:

A) detecting a contaminated area through a variety of methods,

B) detecting and clearing land mines from the area,

C) marking the area according to standards,

D) reporting and mapping.

The steps of C and D are carried out in a manner that is so much behind up-to-date technological methods and is immensely dependent on the labor force. This leads to human- related faults and also a quite inefficient process regarding resource and time management. Additionally, devices and methods that are used in these two steps do not operate in an integrated manner with one another. When considering other drawbacks of the prior art, analysis processes in demining activities are performed manually. Field data is collected manually and the coordination of the piles that are required to be used for encoding a site are calculated and documented by hand as well. The data collected is subsequently submitted to the headquarters and then the data is either transferred to digital media or is rewritten on digital media manually. In these steps, it has been found out that the entire process has been slowed down and iterative applications have been required to be performed due to several problems including wearing down of documents, mistakes in writing, loss of papers, etc. Since it is such a quite sensitive process and it is mandatory to achieve a high accuracy rate (99%) throughout the entire process, iterative aspects of the processes carried out manually cause the entire process to be inefficient, high-cost, and time-consuming.

BRIEF DESCRIPTION OF THE INVENTION AND ITS AIMS

The present invention is related to the product system that enables marking, mapping, and reporting processes to be carried out automatically in demining activities, in an effort to eliminate the aforementioned disadvantages and to provide novel advantages to the related art.

The present invention allows the analysis and documentation steps of the aforementioned process to be fully integrated into technology. In other words; the present invention has a system that automatizes marking, mapping, and reporting processes carried out after removing land mines from an area in demining activities and a handheld terminal that is capable of applying these processes.

The needs of the institutions that desire to enhance the efficiency of analysis and documentation processes, to minimize the manpower/time required for the entire process, and to achieve an accuracy rate of 99% as rapidly as possible throughout the entire process can be met with the handheld terminal of the present invention.

The present invention can not only be used in demining activities but it can also apply to sectors including construction, archeology, mining, energy, etc.

Definitions of Drawings of the Invention

Below are the drawings that are used to better describe the product system subject to the present invention that enables marking, mapping, and reporting processes carried out in demining activities to be automated.

Figure 1 shows a view of the components of the system. Figure 2 shows the operational view of the system. Definitions of the Components and Parts of the Invention

Parts and components of the product system subject to the invention that automatizes marking, mapping, and reporting processes carried out in demining activities when the components of said system communicate with an Android application are individually enumerated below.

1 GNSS Receiver

2 GSM Modem

3 LoRa Modem

4 RFID Reader

5 Android Computer

6 Touchscreen

7 Wi-Fi Modem

8 Soil Measurement Unit

9 Air Measurement Unit

10 Handheld Terminal

11 Reference Station

12 L-Band Correction Data Receiver

13 Camera

14 Microcontroller

DETAILED DESCRIPTION OF THE INVENTION

In this detailed description, the novelty subject to the invention, which is the product system that enables marking, mapping, and reporting processes carried out in demining activities to be automated, is only described by way of non-limiting examples to help the subject matter to be better understood.

In our web service, we use JavaScript language from many popular web programming languages such as Java, HTML, CSS, PHP, and JavaScript for all of the codes including user interfaces and algorithms for data management. A Google Maps API is used as a mapping platform. Additionally, different map bases can be easily used by using the website related to the system. Digital maps having different resolutions that are provided by the General Directorate of Mapping, map bases of private companies such as ESRI and Trimble, and similar bases can be integrated. The mapping interface of the ESRI has been also offered to developers, ArcGIS API can also be used for similar operations. Users can display digital data and textual data that they gathered on site on the web service by projects. Additionally, practical diagrams can be offered to the user by listing digital data by day/month/year in a table through our algorithm on the web service. In addition to these, the data gathered is documented according to the determined reporting format and is offered to the user in PDF format. The web service use the data transferred to the server by the user from the handheld terminal. For such a function, MongoDB is utilized as an online server. Any databases can be used.

The android mobile application mentioned above creates an offline data pool within the device by gathering the textual data required to form the reports such as daily/monthly and handover reports, registration of coordinates for mines that are prepared within the framework of NATO standards for demining activities, and digital and geographical data from the user and field. Similarly, mobile or desktop applications intended to execute the process of data gathering may also be developed for many different platforms.

The handheld terminal comprises a Differential GNSS Receiver, an L-Band Correction Data Receiver, LoRa, Wi-Fi, and GSM technologies therein in addition to an android computer. The GNSS receiver can communicate with Beidou, Galileo, GLONASS, and GPS satellites on GPS L1C/A L2C, GLO LIOF L20F, GAL E1B/C E5b, BDS B1I B2I, QZSS L1C/A L2C bands in 184 channels. Thus, precise positioning can be performed even under formidable land conditions.The LoRa technology that is a long-range communication protocol is assessed to be able to communicate with our reference stations. The LoRa operates on the 868MHz band in our country. It connects with the Turkish National Permanent GNSS Network Active (TUSAGA-AKTIF) that provides service in our country through GSM and 2G internet connection. In the standard called 'NTRIP', said GNSS (Global Navigation Satellite System) systems that broadcast correction data on the internet operate in the same standards across the world. These broadcasts can be accessed through the satellite signals present on the L-Band in addition to the GSM internet connection. By utilizing these services, positioning data can be achieved at centimeter-level accuracy (<10cm). The data gathered within the device is stored on an offline database. The data gathered can be transferred to a determined local or cloud database via the internet or intranet with Wi-Fi. All of the points on the device are registered with individual serial numbers with passive tags to be placed on marker bars thereon through the use of the 13.86MHz RFID reader provided on the device; such a process provides important input for retrospective control. Furthermore, the device has antennas that are capable of broadcasting on the related bands. The reference station comprises the same GNSS receiver and RF communication technologies used in the handheld terminal. These reference stations to be positioned in the field intended to be worked broadcast to the handheld terminal over continuous LoRa and thus precise positioning can be also achieved without the need for the services that produce 'Real-Time Kinematic' (RTK) correction data such as TUSAGA- AKTIF (CORS-TR). The reference station can optionally gather the data on climate and land related to the field by equipping the device with additional units (Soil Measurement Unit, Air Measurement Unit). In this device, antennas with the range of ‘Low-Noise Amplifier’ (LNA) gain >40±2dB are used. With the use of high-gain antennas, high-accuracy position detection (<10cm) can be continuously carried out.

Descriptions of the components of the present invention are the following. GNSS Receiver (1): they are the most prominent device(s) subject to the invention that enable position detection at centimeter-level accuracy. The receiver can communicate with Beidou, Galileo, GLONASS, and GPS satellites on GPS L1C/A L2C, GLO LIOF L20F, GAL E1B/C E5b, BDS B1I B2I, QZSS L1C/A L2C bands in 184 channels.

GSM Modem (2): it enables the correction data broadcasted to the GNSS receiver on active GNSS networks in a given country and/or thereabouts to be downloaded on and transferred to the device on the internet. Through the use of said correction data, measurements at centimeter-level accuracy can be carried out. The correction data can be broadcasted by any GNSS receivers that know their locations.

LoRa Modem: (3):The correction data can be broadcasted by a GNSS receiver that knows its location and has the required functions. By positioning the reference station that we have developed on suitable places in the areas where the internet is hard to access, we can broadcast this correction data to our handheld terminal on site via LoRa protocol. It enables the hardware present within the system to communicate with one another wirelessly.

Various Definitions:

• RTCM (Radio Technical Commission for Maritime) (Standard for Data Format)): Real-Time GNSS data transfer protocol/standardcorrection data. It is used in several processes for making location data obtained precisely. It allows data communication between RTCM and GNSS receivers.

• NTRIP (Networked Transport of RTCM via Interet Protocol): Data transfer protocol/standard for online broadcasting of RTCM data.

• Correction Data Server: Any hardware, software, and/or service that produces and/or transfers meaningful RTCM data.

TUSAGA-AKTIF is an NTRIP server. It broadcasts data in RTCM format. The reference station broadcasts RTCM data not on the internet but via LoRa. Here, the reference station and NTRIP server (TUSAGA-AKTIF) function as correction data providers. Radio Frequency Identification System (RFID) Reader (4): We use passive tags to uniquely detect a marked point on digital media. Each of these passive tags has a unique number thereon. These tags placed on the point to be marked with RFID reader are read, combined with the data such as location, etc. through the handheld terminal, and then interpreted.

Android Computer(5): The android application operates on this device; at the same time, the data gathered from other peripheral units, components are interpreted together with the data input through the application and stored offline within the handheld terminal. Subsequently, this data can be transferred to any desired platforms by the user via Wi-Fi and USB cable.

Touchscreen(6): It enables user interaction of the mobile application. Furthermore, it allows interaction with the user kinesthetically and visually through its main interface. Wi-Fi Modem (7): The data gathered from the android application and other components are combined on the Android computer. This data can be exported by the user via Wi-Fi as well.

Soil Measurement Unit (Optional) (8):

• It is a function that can be optionally positioned on the base (GNSS) station that has been developed. With this additional unit, an important data pool can be created for the soil of the site in the area and throughout the time in which the entire process is carried out.

Air Measurement Unit (Optional) (9):

• It is a function that can be optionally positioned on the base (GNSS) station that has been developed. With this additional unit, an important data pool can be created by recording the air and climate conditions of the site in the area and throughout the time in which the entire process is carried out.

Handheld Terminal (10): It is our main product that comprises the aforementioned components. The components it comprises are Wi-Fi modem, Touchscreen, Android computer, RFID Reader, LoRa Modem, mobile application, L-band correction data receiver, GSM Modem, GNSS Receiver, and Camera.

Reference Station (Optional) (11): It is a secondary main product that comprises the aforementioned components. The components it comprises are Microcontroller, L-Band Correction Data Receiver, LoRa Modem, GSM Modem, and GNSS receiver. Optional components are the Soil measurement unit and Air measurement unit. It is entitled to perform a geographical measurement just as the handheld terminal does. This equipment can operate in a coordinated manner with the handheld terminal.

L-BandCorrectionDataReceiver (12): It allows the GNSS receiver to download and transfer the correction data broadcasted through the L-Band signals present in a country and/or thereabouts. With this data, measurement at centimeter-level accuracy can be carried out in points where cellular internet and GSM network is impossible to access.

Camera(13): It is used for recording the related photos and/or videos from the site.

Microcontroller (14): Due to the software it comprises, it enables communication and compatibility between integrated hardware; the function of the Reference Station within the product system.

The invention is the system that automatizes marking, mapping, and reporting processes carried out in demining activities, characterized in that it comprises; a handheld terminal (10) that operates in coordination with a reference station (11) when desired, comprising a GNSS receiver (1) that enables global location to be detected, an L- Band Correction data receiver (12) that enables the GNSS receiver to download the correction data broadcasted on GNSS networks via active L-Band signals in a country and/or thereabouts and to transfer the data to the device, a GSM modem (2) that enables mobile internet connection and precise positioning, a LoRa modem that enables communication between hardwares (handheld terminal, optional reference frequency station), that is used for broadcasting said correction data at precise positioning (< 10) to the handheld terminal on site via LoRa protocol with the use of the reference station at the points where the internet is difficult to access, a RFID Reader (4) that is used for retrospective accreditation (each marking point has a specific number) and allows RFID tags (labels) placed on the points intended to be marked to be read, to be combined with the location and data via the handheld terminal and thus to be interpreted, an Android Computer (5) that enables all of other data related to the location and the work carried out to be gathered, to be packed and to be transferred to database from the field, a mobile application that allows creating an offline data pool within the device by gathering the textual data required to form the reports such as daily/monthly and handover reports, registration of coordinates for mines that are prepared within the framework of NATO standards for demining activities, and digital and geographical data from the user and field, a Touchscreen (6) that enables interaction with the user kinesthetically and visually through its usage interface, a camera (13) that allows the related photos and/or videos from the site (field) to be recorded, a Wi-Fi modem (7) that enables the data to be transferred from the device via intemet/intranet,

• a correction data provider that is any one of the hardware, software, and/or service that produces and/or transfers meaningful correction (RTCM) data,

• web service means that enable the digital data and textual data users gathered on site to be displayed by projects, that offers practical diagrams to the user by listing digital data by day/month/year in a table, and that enables the data gathered to be offered to the user in report format, wherein map bases and digital maps are integrated into the web service means.

In an embodiment of the invention, said hardware is a handheld terminal (10) and a reference station (11). In another embodiment of the invention, said correction data provider is the meaningful correction (NTRIP) server (such as TUSAGA-AKTIF) or the reference station (11).

In yet another embodiment of the invention, the invention comprises a L-Band Correction Data Receiver (12) that allows the GNSS receiver (1) to download the correction data broadcasted on GNSS networks via the active L-Band signals present in a country and/or thereabouts and to transfer the data to the device, a LoRa Modem (3) that is used for broadcasting the correction data to the handheld terminal on site viaa LoRa protocol with the reference station present in the points where the internet is difficult to access and that enables wireless communication of the hardware within the system, a GSM modem (2) that allows mobile internet connection and is used in precise positioning, and a GNSS receiver (1) that enables positioning at centimeter-level accuracy, and a reference station (11) comprising microcontroller (14) means that enable communication and compatibility between integrated hardware and the function of the reference station within the product system, that is positioned on the field to be operated, that continuously broadcasts to the handheld terminal (10) via LoRa and therefore enables the detection of precise location without the need for services such as TUSAGA-AKTIF (Correction Data Provider) as well.

In a further embodiment of the invention, the invention is a device that uses the aforementioned systems that automatize marking, mapping, and reporting processes carried out in demining activities, and that enable marking, mapping, and reporting processes carried out in demining activities to be automatized.

In a further embodiment of the invention, said reference station (11) comprises a soil measurement unit (8) that enables the moisture, pH, electrical conductivity, and temperature values of the soil on the site to be measured, and an air measurement unit (9) that is comprised of sensors used for measuring air temperature and moisture. The components of the numbers 8 and 9 are optional, said positioning technology can still function appropriately without using these components.

In another preferred embodiment of the invention, said GNSS receiver (1) can determine the location at centimeter-level accuracy. All of the hardware mentioned above operate with geographical information system(s).

Claims

1. A system that automatizes marking, mapping, and reporting processes carried out in demining activities, characterized by comprising;

• a handheld terminal (10) that operates in coordination with a reference station (11) when desired, comprising a GNSS receiver (1) that enables global location to be detected, a L-Band Correction data receiver (12) that enables the GNSS receiver (1) to download the correction data broadcasted on GNSS networks via active L-Band signals in a country and/or thereabouts and to transfer the data to the device, a GSM modem (2) that enables mobile internet connection and is used in precise positioning, a LoRa modem that enables communication between hardware, that is used for broadcasting said correction data at precise positioning with positioning less that 10 cm, to the handheld terminal on site via LoRa protocol with the use of the reference station at the points where the internet is difficult to access, a RFID Reader (4) that is used for retrospective accreditation and allows RFID tags placed on the points intended to be marked to be read, to be combined with the location and data via the handheld terminal and thus to be interpreted, an Android Computer (5) that enables all of other data related to the location and the work carried out to be gathered, to be packed and to be transferred to database from the field, a mobile application that allows creating an offline data pool within the device by gathering the textual data required to form the reports such as daily/monthly and handover reports, registration of coordinates for mines that are prepared within the framework of NATO standards for demining activities, and digital and geographical data from the user and field, a Touchscreen (6) that enables interaction with the user kinesthetically and visually through its usage interface, a camera (13) that allows the related photos and/or videos from the site (field) to be recorded, a Wi-Fi modem (7) that enables the data to be transferred from the device via intemet/intranet,

• web service means that enable the digital data and textual data that users have gathered on site to be displayed by projects, that offer practical diagrams to the user by listing digital data by day/month/year in a table, and that enable the data gathered to be offered to the user in report format, wherein map bases and digital maps are integrated into the web service means.

2. A system according to claim 1, characterized by comprising; an L-Band Correction Data Receiver (12) that allows the GNSS receiver (1) to download the correction data broadcasted on GNSS networks via the active L-Band signals present in a country and/or thereabouts and to transfer the data to the device, a LoRa Modem (3) that is used for broadcasting the correction data to the handheld terminal (10) on site via LoRa protocol with the reference station present in the points where the internet is difficult to access and that enables wireless communication of the hardware within the system, a GSM modem (2) that allows mobile internet connection and is used in precise positioning, and a GNSS receiver (1) that enables positioning at centimeter-level accuracy, and a reference station (11) comprising microcontroller (14) means that enable communication and compatibility between integrated hardware and the function of the reference station within the product system, that is positioned on the field to be operated on, that continuously broadcasts to the handheld terminal (10) via LoRa and thus that enables the detection of precise location without the need for correction data providers as well.

3. A system according to claim 1 , characterized in that; said correction data provider is the meaningful correction (NTRIP) server or the reference station (11).

4. A system according to claim 1 or claim 2, characterized in that; said GNSS receiver (1) can determine the location at centimeter-level accuracy.

5. A system according to claim 1, characterized in that; said hardware is the handheld terminal (10) and the reference station (11).

6. A device that automatizes marking, mapping, and reporting processes carried out in demining activities, characterized by using the system according to claim 1 or claim 2.

7. A system according to claim 1 or claim 2, characterized in that; said reference station (11) comprises a soil measurement unit (8) that enables the moisture, pH, electrical conductivity, and temperature values of the soil on the site to be measured and/or an air measurement unit (9) comprised of sensors that enable the temperature and moisture of the air to be measured.