KR20250131162A - Method for processing data using 3d location data and a blockchain system - Google Patents

Abstract

In a method for processing data using a data processing system, the data processing system includes a first user terminal including a camera and a first GPS receiver, an image data storage device, a web server, a database, and a blockchain system including blockchain nodes, and the method for processing data includes a step in which the first user terminal generates location data including latitude, longitude, and altitude using the first GPS receiver, a step in which the first user terminal transmits image data generated by the camera to the image data storage device, a step in which the image data storage device stores the image data in an image data storage area corresponding to a file path and transmits the file path to the first user terminal, a step in which the first user terminal transmits the location data and the file path to the web server, and a step in which the web server transmits the location data and the file path to the database and transmits a transaction including the location data and the file path to the blockchain system.

Description

Method for Processing Data Using 3D Location Data and a Blockchain System

The present invention relates to a data processing system, and more particularly, to a data processing system including three-dimensional position data and a blockchain system, and a data processing method using the same.

Smartphone location information is primarily measured using the Global Positioning System (GPS). Other location technologies include Wi-Fi signals or cell tower signals. These technologies determine the smartphone's current location and relay this information to applications and the operating system.

Location information is used in a variety of services and applications, including map apps, weather apps, social media, location-based advertising, and health apps.

Location-based image provision refers to services that provide images of the area based on the user's current location.

Among examples of such services, travel-related applications can provide information to smartphone users while they are traveling by providing images of tourist attractions, restaurants, or landmarks that match their current location.

Examples of such services include map apps that can display images of specific points or buildings on a map around a smartphone user's location, helping the user more easily understand their surroundings.

Among these services, photo sharing services allow smartphone users to upload photos taken at specific locations along with their location information, which are then displayed on a map so that other users can explore photos from that area.

Examples of these services include geographically relevant information services that can be used to provide educational services or cultural content based on the location information of smartphone users.

Patent Registration: Registration No. 10-2599640 (Published on November 6, 2023) Publication No. 10-2023-0082087 (published on June 8, 2023) Patent Registration: Registration No. 10-1759726 (Published July 20, 2017)

The technical problem to be achieved by the present invention is to provide a data processing system and an operating method thereof, which directly stores image data captured at a location specified by latitude, longitude, and altitude in an image data storage device without going through a web server, stores a file path for an image data storage area of the image data storage device where the image data is stored and location data for the location in a database and an immutable blockchain, verifies the location data and the file path stored in the database using the location data and the file path stored in the blockchain, reads the image data from the image data storage device using the verified file path, and can display the read image data in augmented reality (AR).

In a method for processing data using a data processing system according to an embodiment of the present invention, the data processing system includes a first user terminal including a camera and a first GPS receiver, an image data storage device, a web server, a database, and a blockchain system including blockchain nodes, and the method for processing data includes a step in which the first user terminal generates first location data including latitude, longitude, and altitude using the first GPS receiver, a step in which the first user terminal transmits image data generated by the camera to the image data storage device, a step in which the image data storage device stores the image data in an image data storage area corresponding to a file path and transmits the file path to the first user terminal, a step in which the first user terminal transmits the first location data and the file path to the web server, and a step in which the web server transmits the first location data and the file path to the database and transmits a transaction including the first location data and the file path to the blockchain system.

The method for processing the above data includes a step in which the blockchain system generates a block including the first location data and the file path according to the transaction, and transmits a transaction ID for identifying the transaction and a block number for identifying the block to the web server, and a step in which the web server stores the transaction ID and the block number in the database.

In a method for processing data using a data processing system according to an embodiment of the present invention, the data processing system includes a first user terminal including a camera and a first GPS receiver, an image data storage device, a web server, a database, and a blockchain system including blockchain nodes, and the method for processing the data includes a step of the first user terminal generating first location data including latitude, longitude, and altitude using the first GPS receiver, a step of the first user terminal transmitting image data generated by the camera to the image data storage device, a step of the image data storage device storing the image data in an image data storage area corresponding to a file path and transmitting the file path to the first user terminal, a step of the first user terminal transmitting the first location data and the file path to the web server, a step of the web server transmitting a transaction including the first location data and the file path to the blockchain system, a step of the blockchain system generating a block including the first location data and the file path according to the transaction and transmitting a transaction ID for identifying the transaction and a block number for identifying the block to the web server, and a step of the web server transmitting the transaction ID and the block number for identifying the block to the web server. The server includes a step of storing the first location data, the file path, the transaction ID, and the block number in the database.

A data processing system and an operating method thereof according to an embodiment of the present invention have the effect of storing image data captured at a location specified by latitude, longitude, and altitude directly in an image data storage device without going through a web server, storing a file path for an image data storage area of the image data storage device where the image data is stored and location data for the location in a database and a blockchain, verifying the location data and the file path stored in the database using the location data and the file path stored in the blockchain having immutability, reading the image data from the data storage device using the verified file path, and displaying the read image data in augmented reality.

The data processing system and its operating method according to an embodiment of the present invention have the effect of being able to process image data by segmenting it by three-dimensional location including latitude, longitude, and altitude.

In order to more fully understand the drawings cited in the detailed description of the present invention, a detailed description of each drawing is provided.
FIG. 1 is a block diagram of a data processing system that processes data using location data and blockchain according to an embodiment of the present invention.
FIG. 2 is a data flow diagram illustrating one embodiment of a data storage method of the data processing system illustrated in FIG. 1.
FIG. 3 is an example of data stored in a database of the data processing system illustrated in FIG. 1.
FIG. 4 is an example of blocks generated by a block generation node of a blockchain of the data processing system illustrated in FIG. 1.
FIG. 5 is a data flow diagram illustrating another embodiment of a data storage method of the data processing system illustrated in FIG. 1.
FIG. 6 is a data flow diagram illustrating one embodiment of a data search method of the data processing system illustrated in FIG. 1 and a method of displaying searched data in augmented reality.
FIG. 7 is a data flow diagram illustrating another embodiment of a data search method of the data processing system illustrated in FIG. 1 and a method of displaying searched data in augmented reality.
Figure 8 is an example of a coordinate system that displays latitude, longitude, and altitude for each location in three dimensions.
FIG. 9 is a data flow diagram illustrating another embodiment of a data search method of the data processing system illustrated in FIG. 1 and a method of displaying searched data in augmented reality.
FIG. 10 is an embodiment of a graphical user interface for explaining a method of setting a search range in a second user terminal included in the data processing system illustrated in FIG. 1.

FIG. 1 is a block diagram of a data processing system that processes data using location data and blockchain according to an embodiment of the present invention.

The data processing system (100) includes a first user terminal (101) used by a first user, a second user terminal (102) used by a second user, a web server (200), storage (300), a database (400) for storing data (DATA), and a blockchain system (also called 'blockchain', 500).

The first user terminal (101) includes a processor (110) for executing an augmented reality (AR) app (112), a camera (114), a global positioning system (GPS) receiver (116), an input device (118), a communication device (120), and an output device (122).

The output devices (122 and 122_2) may refer to display devices or monitors. Although, in FIG. 1, each input device (118 and 118_2) and each output device (122 and 122_2) are depicted as physically separate, each touch screen may include a corresponding input device among the input devices (118 and 118_2) and a corresponding output device among the output devices (122 and 122_2).

A GPS receiver (116) is an embodiment of a location data (or location information) generating device capable of generating three-dimensional location data including latitude, longitude, and altitude (also referred to as 'three-dimensional location information').

A computer program according to an embodiment of the present invention, i.e., an augmented reality app (112 and 112_2), may perform steps to be described with reference to FIGS. 2, 5, 6, 7, and 9, and may perform Mobile Augmented Reality (MAR). The computer program is stored in a computer-readable recording medium (e.g., a memory device included in each user terminal (101 and 102)) included within each user terminal (101 and 102) and executed by a processor (110 or 110_2).

It is assumed that the structure of the second user terminal (102) is identical to the structure of the first user terminal (101). Each user terminal (101 and 102) may be a mobile device capable of executing mobile augmented reality, such as a smartphone, PDA, or mobile Internet device (MID), but is not limited thereto.

The web server (200) may be a web server capable of using Web3. Web3 (also called Web 3.0, the decentralized web, or the semantic web) is a term encompassing technologies that decentralize ownership and control of data on the Internet, including blockchain.

Storage (300), which refers to a memory device or an image data storage device, stores each image data (IM1 to IM6) captured at each location (P1 to P4) shown in Fig. 8 in each image data storage area (DS1_FP1 to DS6_FP6) corresponding to each file path (FP1 to FP6). Each image data (IM1 to IM6) collectively refers to a still image or a moving image.

A database (400) refers to a data storage device that stores various data (DATA) to be described with reference to FIG. 3.

A blockchain system (500) includes a plurality of blockchain nodes (510, 520_1, 520_2, and 520_3). The blockchain nodes (510, 520_1, 520_2, and 520_3) include a read-only node (510) that is connected to a web server (200) and communicates with the web server (200) (here, communication means wired communication or wireless communication), and a plurality of block generation nodes (520_1, 520_2, and 520_3) that participate in the generation of blocks.

For example, each block generation node (520_1, 520_2, and 520_3) can exchange data (also called signals or information) with the web server (200) only through the read-only node (510).

Blockchain is a form of distributed database managed through a P2P (Peer to Peer) network. It is a technology that stores and preserves the ledger that stores transaction information on nodes (i.e. computers) connected to the blockchain network, rather than storing it on a single central server.

Blockchain is a technology that securely stores and manages data in decentralized distributed networks. One of the most notable characteristics of blockchain is its immutability. Immutability means that once recorded, data remains unchanged.

Each block generation node (520_1, 520_2, and 520_3) capable of generating a block can communicate with a read-only node (510), and each block generation node (520_1, 520_2, and 520_3) can communicate with other block generation node(s) to generate the block.

It is assumed that each blockchain node (510, 520_1, 520_2, and 520_3) has the same structure. As illustrated in FIG. 1, each blockchain node (510, 520_1, 520_2, and 520_3) includes a processor (512, 522_1, 522_2, and 522_3), a communication device (514, 524_1, 524_2, and 524_3), and a memory device (516, 526_1, 526_2, and 526_3).

FIG. 2 is a data flow diagram illustrating one embodiment of a data storage method of the data processing system illustrated in FIG. 1.

According to an embodiment of the present invention, each image data (IM1 to IM6) stored in each image data storage area (DS1_FP1 to DS6_FP6) corresponding to each file path (FP1 to FP6) in the image data storage device (300) is mapped to each position data (PI1 to PI6) for coordinates (or positions) of a three-dimensional space specified (or defined) according to latitude, longitude, and altitude.

For example, even if the latitude and longitude of two locations are the same, if the altitudes are different, the location data for the two locations are different, and therefore, different file paths are mapped one-to-one for each location in the database (400).

Referring to FIGS. 1 and 2, when a first user of a first user terminal (101) takes a picture of a subject using a camera (114) at a sixth position (P6), the camera (114) generates sixth image data (IM6) corresponding to the subject and transmits this (IM6) to the processor (110) (S110).

The GPS receiver (116) of the first user terminal (101) generates sixth location data (PI6) including latitude, longitude, and altitude for the first user's current location (P6) and transmits this (PI6) to the processor (110) (S115).

When the first user inputs the sixth content data (CD6) using the input device (118), the input device (118) transmits the sixth content data (CD6) to the processor (110).

Each content data (CD1 to CD6) described in this specification may include at least one of a hashtag, a description for each location (P1 to P4) (e.g., date, address, building name, and/or place name, etc.), or an additional description for each image data (IM1 to IM6) (e.g., emotion for the subject, and/or emotion for each location (P1 to P4), etc.).

Since the uniform resource locator (URL) of the storage (300) is programmed in each of the augmented reality (AR) apps (112 and 112_2), the AR app (112) generates a packet including the sixth image data (IM6) and transmits the packet to the communication device (320) of the storage (300) corresponding to the URL through the communication device (120) (S120).

The processor (310) of the storage (300) stores the sixth image data (IM6) in the sixth image data storage area (DS6_FP6) of the memory device (330) corresponding to the sixth file path (FP6) according to the storage command included in the received packet (S125), generates a packet including the sixth file path (FP6), and transmits the packet to the communication device (120) of the first user terminal (101) via the communication device (320) (S130).

The first user terminal (101) and storage (300) communicate directly without going through the web server (200) to transmit or receive the sixth image data (IM6) and the sixth file path (FP6).

When the processor (110) of the first user terminal (101) receives a packet including a sixth file path (FP6) through the communication device (120), the AR app (112) generates a packet including sixth location data (PI6), a sixth file path (FP6), sixth content data (CD6), and user information (USI6) in response to the packet and transmits the packet to the communication device (120) (S135). The user information (USI6) may be unique identification information that can uniquely identify the first user, for example, a user ID (wherein ID is an abbreviation for identity or identification) or a phone number (for example, a mobile phone number) of the first user terminal (101).

A packet containing information (PI6, FP6, CD6, and USI6) is transmitted to the processor (210) of the web server (200) via communication devices (120 and 220) (S135).

When the processor (210) generates a packet including information (PI6, FP6, CD6, and USI6) and transmits the packet to the database (400) via the communication device (220), the database (400), for example, the processor of the database (400), stores the information (PI6, FP6, CD6, and USI6) according to the command included in the packet (S140).

A database (400) storing information (PI6, FP6, CD6, and USI6), for example, a processor of the database (400), generates a response packet and transmits it to a communication device (220) of a web server (200).

The processor (210) of the web server (200) receives a response packet from the communication device (220), and in response to the response packet, creates a transaction including information (PI6, FP6, CD6, and USI6), encrypts (or electronically signs) the transaction with a private key of the web server (200), and transmits the transaction, the encrypted (or electronically signed) transaction, and the public key of the web server (200) to the communication device (514) of the read-only node (510) via the communication device (220) (S145). Steps (S140 and S145) may be performed simultaneously or in parallel.

The processor (512) of the read-only node (510) receives a transaction, an encrypted transaction, and a public key of the web server (200) from the communication device (514), decrypts the encrypted transaction with the public key to generate a decrypted transaction, and performs verification or validity check by comparing the decrypted transaction with the transaction.

If the verification or validation check is successful, the processor (512) A transaction including information (PI6, FP6, CD6, and USI6) is stored in a memory device (516), and the transaction, the encrypted transaction, and the public key of the web server (200) are transmitted (also called 'publishing' or 'broadcasting') to block generation nodes (520_1, 520_2, and 520_3, collectively referred to as 520) through a blockchain network (500) (S150).

Since there is no central server in the blockchain (500), the read-only node (510) uses a broadcasting method to transmit the entire data (e.g., a transaction containing information (PI6, FP6, CD6, and USI6)) to all nodes (520_1, 520_2, and 520_3).

Each processor (522_1, 522_2, and 522_3) of each block generation node (520_1, 520_2, and 520_3) receives a transaction, an encrypted transaction, and a public key of a web server (200) from each communication device (524_1, 524_2, and 524_3), decrypts the encrypted transaction with the public key to generate a decrypted transaction, and performs a verification or validity check by comparing the decrypted transaction with the transaction.

When one of the block generating nodes (520_1, 520_2, and 520_3) (e.g., 520_1) generates a sixth block (BL6) including information (PI6, FP6, CD6, and USI6) and transmits the sixth block (BL6) to other nodes (510, 520_2, and 520_3), each node (510, 520_2, and 520_3) accepts the sixth block (BL6) and connects the sixth block (BL6) to the fifth block (BL5) to generate a blockchain (S155).

The process of creating each block (BL1-BL5) is nearly identical to the process of creating the sixth block (BL6), so a detailed description will be omitted. Furthermore, the process of creating the sixth block (BL6) has been conceptually outlined.

In each memory device (516, 526_1, 526_2, and 526_3) of each node (510, 520_1, 520_2, and 520_3), blocks (BL1 to BL6) in the form of a chain as shown in FIG. 4 are stored.

FIG. 3 is an example of data stored in a database of the data processing system illustrated in FIG. 1, and FIG. 4 is an example of blocks generated by a block generation node of a blockchain of the data processing system illustrated in FIG. 1.

Referring to FIGS. 1 to 4, it is assumed that a blockchain including five blocks (BL to BL5) is first created and stored in each memory device (516, 526_1, 526_2, and 526_3) before the sixth block (BL6) is created.

The transaction ID of the genesis block (i.e., the first block, BL1) is TX_ID1, the block number is BL_NO1, the block hash is BH1, the previous hash of the header block is 0 (zero), the time at which the genesis block (BL1) was created (also called a time stamp) is TIME1, and the transaction ID (TX_ID1) included in the first block (BL1) includes first location data (PI1) including latitude (LAT2), longitude (LNG1), and altitude (ALT1) for the first location (P1) as illustrated in FIG. 8, first content data (CD1), a first file path (FP1) indicating that the first image data (IM1) taken at the first location (P1) is stored in the first image data storage area (DS1_FP1) of the storage (300), and a user identifier (UI) for uniquely identifying the user who took the first image data (IM1). Assume that it contains information (USI1).

It is assumed that the transaction ID of the second block (BL2) is TX_ID2, the block number is BL_NO2, the block hash is BH2, the previous hash of the block header is BH1, the time at which the second block (BL2) was created is TIME2, and the transaction ID (TX_ID2) included in the second block (BL2) includes second location data (PI2) including latitude (LAT2), longitude (LNG1), and altitude (ALT1) for the first location (P1), second content data (CD2), a second file path (FP2) indicating that second image data (IM2) taken at the first location (P1) is stored in the second image data storage area (DS2_FP2) of the storage (300), and user information (USI2) for uniquely identifying the user who took the second image data (IM2).

Since the information contained in the third block (BL3) to the fifth block (BL5) can be easily understood by understanding the information contained in the first block (BL1) and the second block (BL2) described above, the description of each block (BL3, BL4, and BL5) is omitted.

It is assumed that the transaction ID of the 6th block (BL6) is TX_ID6, the block number is BL_NO6, the block hash is BH6, the previous hash of the block header is BH5, the time when the 6th block (BL6) was created is TIME6, and the transaction ID (TX_ID6) included in the 6th block (BL6) includes 6th location data (PI6) including latitude (LAT1), longitude (LNG1), and altitude (ALT1) for the 2nd location (P2), 6th content data (CD6), 6th file path (FP6) indicating that the 6th image data (IM6) taken at the 2nd location (P2) is stored in the 6th image data storage area (DS6_FP6) of the storage (300), and user information (USI6) for uniquely identifying the user who took the 6th image data (IM6).

Each transaction ID (TX_ID1~TX_ID6) is a unique identifier used to uniquely identify each transaction, and each block number (BL_NO1~BL_NO6) is a unique identifier used to uniquely identify each block.

As illustrated in FIG. 4, each block (BL1 to BL6) generated by block generation nodes (520_1, 520_2, and 520_3) is stored in the memory devices (516, 526_1, 526_2, and 526_3) of each node (510, 520_1, 520_2, and 520_3) (S155).

The processor (512) of the read-only node (510) receives identification data including at least one of a transaction ID (TX_ID6) or a block number (BL_NO6) for the sixth block (BL6) from one of the block generation nodes (520_1, 520_2, and 520_3) (e.g., 520_1) via a communication device (514) (S160).

The processor (512) of the read-only node (510) receives identification data including at least one of a transaction ID (TX_ID6) or a block number (BL_NO6) for the sixth block (BL6) from the communication device (514), stores the identification data in the memory device (516), generates a packet including the identification data, and transmits the packet to the communication devices (514 and 220) and the processor (210) of the web server (200) (S165).

The processor (210) of the web server (200) maps the identification data included in the packet to the sixth location data (PI6) corresponding to the second location (P2) according to the command included in the received packet and stores it in the database (400) via the communication device (220) (S170).

As illustrated in Fig. 3, each record containing location data (PI1 to PI6) corresponding to each location (P1 to P4) includes each transaction ID (TX_ID1 to TX_ID6) and each block number (BL_NO1 to BL_NO6). DATA in Fig. 3 may also mean a table.

FIG. 5 is a data flow diagram illustrating another embodiment of a data storage method of the data processing system illustrated in FIG. 1.

Referring to FIGS. 2 and 5, in FIG. 2, step (S140) was performed before step (S165) was performed, but in FIG. 5, step (S165) must be performed, that is, after the processor (210) of the web server (200) receives identification data including at least one of a transaction ID (TX_ID6) or a block number (BL_NO6) of the sixth block (BL6) from the read-only node (510), the sixth location data (PI6), the sixth file path (FP6), the sixth content data (CD6), the user information (USI6) for identifying the first user of the first user terminal (101), and the identification data (TX_ID6 and/or BL_NO6) are written or stored together in the database (400) via the communication device (220) (S175).

FIG. 6 is a data flow diagram illustrating one embodiment of a data search method of the data processing system illustrated in FIG. 1 and a method of displaying searched data as an augmented representation.

Referring to FIGS. 1, 3, and 6, when a second user currently at a second location (P2) runs an AR app (112_2) to view image data related to the second location (P2) in augmented reality on an output device (122_2) of a second user terminal (102), the AR app (112_2) operates a GPS receiver (116_2).

The GPS receiver (116_2) of the second user terminal (102) generates sixth location data (PI6) including latitude (LAT1), longitude (LNG1), and altitude (ATL1) for the second user's current location, i.e., the second location (P2), and transmits this (PI6) to the processor (110_2) (S210).

The processor (110_2) of the second user terminal (102) generates a packet including the sixth location data (PI6) and the second user's user information (USI7), and transmits the packet to the communication device (220) of the web server (200) via the communication device (120_2) (S215).

The processor (210) of the web server (200) extracts the sixth position data (PI6) from a packet received from the communication device (220), generates a search request including the sixth position data (PI6), and transmits it to the database (400) via the communication device (220) (S220).

The processor of the database (400), in response to a search request, searches for first data (CD6, FP6, USI6, TX_ID6, and BL_NO6) related to the sixth position data (PI6) from the data (DATA) stored therein (S225), and generates a packet including the searched first data (CD6, FP6, USI6, TX_ID6, and BL_NO6) and transmits it to the communication device (220) of the web server (200) (S230).

The processor (210) of the web server (200) receives a packet through the communication device (220), extracts identification data (for example, at least one of a transaction ID (TX_ID6) or a block number (BL_NO6)) from the packet (S235), generates a data transmission request including the identification data, and transmits it to the communication device (514) of the read-only node (510) through the communication device (220) (S240).

Since the memory device (516) of the read-only node (510) already stores the blocks (BL1 to BL6) in the form of a chain as shown in FIG. 4, the processor (512) of the read-only node (510) receives a data transmission request from the communication device (514), extracts identification data from the data transmission request, searches for the sixth block (BL6) corresponding to the identification data from the memory device (516) (S245), extracts data (PI6, CD6, FP6, and USI6) corresponding to the identification data from the sixth block (BL6), and transmits the data (PI6, CD6, FP6, USI6, TX_ID6, and BL_NO6) to the communication device (220) of the web server (200) via the communication device (514) (S250).

The processor (210) of the web server (200) receives data (PI6, CD6, FP6, USI6, TX_ID6, and BL_NO6) through the communication device (220), and can check the validity of the first data received in step (S230) (S255).

For example, the processor (210) can check the validity of the first data received in step (S230) by using at least one of the consistency of the sixth position data (PI6) received in each step (S230 and S250), the consistency of the transaction ID (TX_ID6), or the consistency of the block number (BL_NO6) (S255).

If the validity check is successful, the processor (210) generates second data including all or part of the first data (CD6, FP6, USI6, TX_ID6, and BL_NO6) received in step (S230) and transmits the second data to the communication device (120_2) of the second user terminal (102) via the communication device (220) (S260). At this time, the second data must include the sixth file path (FP6).

When the processor (110_2) of the second user terminal (102) receives second data from the communication device (120_2), the AR app (112_2) generates an image data transmission request including the sixth file path (FP6) and transmits the image data transmission request to the communication device (320) of the storage (300) through the communication device (120_2) (S265).

The processor (310) of the storage (300) receives an image data transmission request from a communication device (320), extracts a sixth file path (FP6) from the image data transmission request, searches for sixth image data (IM6) from a sixth image data storage area (DS6_FP6) of a memory device (330) in response to the image data transmission request (S270), and transmits the sixth image data (IM6) to a communication device (120_2) of a second user terminal (102) via the communication device (320) (S275).

The AR app (112_2) running on the processor (110_2) of the second user terminal (102) can receive the sixth image data (IM6) from the communication device (120_2) and display the sixth image data (IM6) in augmented reality on the output device (122_2) (S280).

According to embodiments, when the second data includes at least one of the sixth content data (CD6) or the user information (USI6), the AR app (112_2) can display the sixth image data (IM6) together with at least one of the sixth content data (CD6) or the user information (USI6) in augmented reality on the output device (122_2) (S280).

In FIG. 6, for convenience of explanation, an example is described in which the sixth image data (IM6) corresponding to the sixth location data (PI6) is displayed in augmented reality on the output device (122_2). However, when the location data including the latitude (LAT1), longitude (LNG1), and altitude (ATL1) for the second location (P2) is the third location data (PI3), the third image data (IM3) corresponding to the third location data (PI3) can be displayed in augmented reality on the output device (122_2).

In addition, when each of the location data including latitude (LAT1), longitude (LNG1), and altitude (ATL1) for the second location (P2) is the third location data (PI3) and the sixth location data (PI6), each of the image data (IM3 and IM6) mapped to each location data (PI3 and PI6) can be displayed (or sequentially displayed) in augmented reality on the output device (122_2).

FIG. 7 is a data flow illustrating another embodiment of a data search method of the data processing system illustrated in FIG. 1 and a method of displaying searched data in AR, and FIG. 8 is an embodiment of a coordinate system that displays latitude, longitude, and altitude for each location in three dimensions.

1. If the latitude search range is programmed1 (CASE1)

As in Case 1 (CASE1) of FIG. 8, it is assumed that a latitude search range (SR) is programmed in a computer program running on a processor (210) of a web server (200) (S201).

The processor (210) of the web server (200) receives a packet including the sixth location data (PI6) and the user information (USI7) of the second user (S215), extracts the sixth location data (PI6) from the packet, generates a search request including the sixth location data (PI6) and a latitude search range (SR), and transmits the search request to the database (400) via the communication device (220) (S220_1). At this time, it is assumed that each location data (PI1, PI2, PI3, and PI6) for each location (P1 and P2) having the same longitude (LNG1) and altitude (ALT1) is included in the latitude search range (SR).

The processor of the database (400), in response to a search request, searches for first data related to each location data (PI1, PI2, PI3, and PI6) from the data (DATA) stored therein (S225), and generates a packet including the searched first data and transmits it to the communication device (220) of the web server (200) (S230).

At this time, the first data includes data related to the first position data (PI1) (CD1, FP1, USI1, TX_ID1, and BL_NO1), data related to the second position data (PI2) (CD2, FP2, USI2, TX_ID2, and BL_NO2), data related to the third position data (PI3) (CD3, FP3, USI3, TX_ID3, and BL_NO3), and data related to the sixth position data (PI6) (CD6, FP6, USI6, TX_ID6, and BL_NO6).

When the processor (210) of the web server (200) extracts identification data including at least one of each transaction ID (TX_ID1, TX_ID2, TX_ID3, and TX_ID6) or each block number (BL_NO1, BL_NO2, BL_NO3, and BL_NO6) from the first data received in step (S230) (S235_1), and generates a data transmission request including the extracted identification data and transmits it to the read-only node (510) (S240), the processor (512) of the read-only node (510) can perform step (S245) using the identification data.

The read-only node (510) transmits the search data (SDATA) searched in step (S245) to the web server (200) (S250_1).

Search data (SDATA) includes (i) transaction ID (TX_ID1) and data related thereto (PI1, CD1, FP1, USI1, and BL_NO1), (ii) transaction ID (TX_ID2) and data related thereto (PI2, CD2, FP2, USI2, and BL_NO2), (iii) transaction ID (TX_ID3) and data related thereto (PI3, CD3, FP3, USI3, and BL_NO3), and (iv) transaction ID (TX_ID6) and data related thereto (PI6, CD6, FP6, USI6, and BL_NO6).

If the validity check on the first data received in step (S230) is successful (S255), the processor (210) generates second data including all or part of the first data received in step (S230) and transmits the second data to the communication device (120_2) of the second user terminal (102) via the communication device (220) (S260). At this time, as described above, the second data must include each file path (FP1, FP2, FP3, and FP6).

When the processor (110_2) of the second user terminal (102) receives second data from the communication device (120_2), the AR app (112_2) generates an image data transmission request including each file path (FP1, FP2, FP3, and FP6) and transmits the image data transmission request to the communication device (320) of the storage (300) through the communication device (120_2) (S265).

The processor (310) of the storage (300) receives an image data transmission request including each file path (FP1, FP2, FP3, and FP6) from the communication device (320), extracts each file path (FP1, FP2, FP3, and FP6) from the image data transmission request, searches for each image data (IM1, IM2, IM3, and IM6) from the memory device (330) in response to the image data transmission request (S270), and transmits each image data (IM1, IM2, IM3, and IM6) to the communication device (120_2) of the second user terminal (102) via the communication device (320) (S275).

The AR app (112_2) running on the processor (110_2) of the second user terminal (102) receives each image data (IM1, IM2, IM3, and IM6) from the communication device (120_2) and can display each image data (IM1, IM2, IM3, and IM6) in augmented reality on the output device (122_2) (S280).

According to embodiments, when the second data received in step (S260) includes at least one of each content data (CD1, CD2, CD3, and CD6) or each user information (USI1, USI2, USI3, and USI6), the AR app (112_2) may display at least one of each content data (CD1, CD2, CD3, and CD6) or each user information (USI1, USI2, USI3, and USI6) in augmented reality on the output device (122_2) together with each image data (IM1, IM2, IM3, and IM6) according to the selection of the second user (S280).

2. If the hardness search range is programmed 2 (CASE2)

As in Case 2 (CASE2) of Fig. 8, it is assumed that a longitude search range (SR) is programmed in a computer program running on a processor (210) of a web server (200) (S201).

The processor (210) of the web server (200) receives a packet including the sixth location data (PI6) and the second user's user information (USI7) (S215), extracts the sixth location data (PI6) from the packet, generates a search request including the sixth location data (PI6) and a longitude search range (SR), and transmits the search request to the database (400) via the communication device (220) (S220_1). At this time, it is assumed that each location data (PI3, PI5, PI6) for each location (P2 and P4) having the same latitude (ALT1) and altitude (ALT1) is included in the longitude search range (SR).

The processor of the database (400), in response to a search request, searches for first data related to each location data (PI3, PI5, and PI6) from the data (DATA) stored therein (S225), and generates a packet including the searched first data and transmits it to the communication device (220) of the web server (200) (S230).

At this time, the first data includes data related to the third position data (PI3) (CD3, FP3, USI3, TX_ID3, and BL_NO3), data related to the fifth position data (PI5) (CD5, FP5, USI5, TX_ID5, and BL_NO5), and data related to the sixth position data (PI6) (CD6, FP6, USI6, TX_ID6, and BL_NO6).

When the processor (210) of the web server (200) extracts identification data including at least one of each transaction ID (TX_ID3, TX_ID5, and TX_ID6) or each block number (BL_NO3, BL_NO5, and BL_NO6) from the first data received in step (S230) (S235_1), and generates a data transmission request including the identification data and transmits it to the read-only node (510) (S240), the processor (512) of the read-only node (510) can perform step (S245) using the identification data.

The read-only node (510) transmits the search data (SDATA) searched in step (S245) to the web server (200) (S250_1).

Search data (SDATA) includes (1) transaction ID (TX_ID3) and related data (PI3, CD3, FP3, USI3, and BL_NO3), (ii) transaction ID (TX_ID5) and related data (PI5, CD5, FP5, USI5, and BL_NO5), and (iii) transaction ID (TX_ID6) and related data (PI6, CD6, FP6, USI6, and BL_NO6).

If the validity check on the first data received in step (S230) is successful (S255), the processor (210) generates second data including all or part of the first data received in step (S230) and transmits the second data to the communication device (120_2) of the second user terminal (102) via the communication device (220) (S260). At this time, as described above, the second data must include each file path (FP3, FP5, and FP6).

When the processor (110_2) of the second user terminal (102) receives second data from the communication device (120_2), the AR app (112_2) generates an image data transmission request including each file path (FP3, FP5, and FP6) and transmits the image data transmission request to the communication device (320) of the storage (300) via the communication device (120_2) (S265).

The processor (310) of the storage (300) receives an image data transmission request including each file path (FP3, FP5, and FP6) from the communication device (320), extracts each file path (FP3, FP5, and FP6) from the image data transmission request, searches for each image data (IM3, IM5, and IM6) from the memory device (330) in response to the image data transmission request (S270), and transmits each searched image data (IM3, IM5, and IM6) to the communication device (120_2) of the second user terminal (102) via the communication device (320) (S275).

The AR app (112_2) running on the processor (110_2) of the second user terminal (102) can receive each image data (IM3, IM5, and IM6) from the communication device (120_2) and display each image data (IM3, IM5, and IM6) in augmented reality on the output device (122_2) (S280).

According to embodiments, when the second data received in step (S260) includes at least one of the content data (CD3, CD5, and CD6) or the user information (USI3, USI5, and USI6), the AR app (112_2) may display at least one of the content data (CD3, CD5, and CD6) or the user information (USI3, USI5, and USI6) in augmented reality on the output device (122_2) together with the image data (IM3, IM5, and IM6) according to the selection of the second user (S280).

3. If the altitude search range is programmed 3 (CASE3)

As in Case 3 (CASE3) of FIG. 8, it is assumed that a high-level search range (SR) is programmed in a computer program running on a processor (210) of a web server (200) (S201).

The processor (210) of the web server (200) receives a packet including the sixth location data (PI6) and the user information (USI7) of the second user (S215), extracts the sixth location data (PI6) from the packet, generates a search request including the sixth location data (PI6) and an altitude search range (SR), and transmits the search request to the database (400) via the communication device (220) (S220_1). At this time, it is assumed that the location data (PI3, PI4, and PI6) for each location (P2 and P3) having the same latitude (ALT1) and longitude (LNG1) are included in the altitude search range (SR).

The processor of the database (400), in response to a search request, searches for first data related to each location data (PI3, PI4, and PI6) from the data (DATA) stored therein (S225), and generates a packet including the searched first data and transmits it to the communication device (220) of the web server (200) (S230).

At this time, the first data includes data related to the third position data (PI3) (CD3, FP3, USI3, TX_ID3, and BL_NO3), data related to the fourth position data (PI4) (CD4, FP4, USI4, TX_ID4, and BL_NO), and data related to the sixth position data (PI6) (CD6, FP6, USI6, TX_ID6, and BL_NO6).

When the processor (210) of the web server (200) extracts identification data including at least one of each transaction ID (TX_ID3, TX_ID4, and TX_ID6) or each block number (BL_NO3, BL_NO4, and BL_NO6) from the first data received in step (S230) (S235_1), and generates a data transmission request including the identification data and transmits it to the read-only node (510) (S240), the processor (512) of the read-only node (510) can perform step (S245) using the identification data.

The read-only node (510) transmits the search data (SDATA) searched in step (S245) to the web server (200) (S250_1).

Search data (SDATA) includes (i) transaction ID (TX_ID3) and data related thereto (PI3, CD3, FP3, USI3, and BL_NO3), (ii) transaction ID (TX_ID4) and data related thereto (PI4, CD4, FP4, USI4, and BL_NO4), and (iii) transaction ID (TX_ID6) and data related thereto (PI6, CD6, FP6, USI6, and BL_NO6).

If the validity check on the first data received in step (S230) is successful (S255), the processor (210) generates second data including all or part of the first data received in step (S230) and transmits the second data to the communication device (120_2) of the second user terminal (102) via the communication device (220) (S260). At this time, as described above, the second data must include each file path (FP3, FP4, and FP6).

When the processor (110_2) of the second user terminal (102) receives second data from the communication device (120_2), the AR app (112_2) generates an image data transmission request including each file path (FP3, FP4, and FP6) and transmits the image data transmission request to the communication device (320) of the storage (300) via the communication device (120_2) (S265).

The processor (310) of the storage (300) receives an image data transmission request including each file path (FP3, FP4, and FP6) from the communication device (320), extracts each file path (FP3, FP4, and FP6) from the image data transmission request, searches for each image data (IM3, IM4, and IM6) from the memory device (330) in response to the image data transmission request (S270), and transmits each searched image data (IM3, IM4, and IM6) to the communication device (120_2) of the second user terminal (102) via the communication device (320) (S275).

The AR app (112_2) running on the processor (110_2) of the second user terminal (102) can receive each image data (IM3, IM4, and IM6) from the communication device (120_2) and display each image data (IM3, IM4, and IM6) in augmented reality on the output device (122_2) (S280).

According to embodiments, when the second data received in step (S260) includes at least one of the content data (CD3, CD4, and CD6) or the user information (USI3, USI4, and USI6), the AR app (112_2) may display at least one of the content data (CD3, CD4, and CD6) or the user information (USI3, USI4, and USI6) in augmented reality on the output device (122_2) together with the image data (IM3, IM4, and IM6) according to the selection of the second user (S280).

In FIG. 8, for the sake of explanation, only one of latitude, longitude, or altitude is set as the search range (SR). However, depending on the embodiments, search ranges for two (e.g., CASE1 and CASE2, CASE1 and CASE3, or CASE2 and CASE3) or three (e.g., CASE1, CASE2, and CASE3) of latitude, longitude, or altitude may be set.

FIG. 9 is a data flow diagram illustrating another embodiment of a data search method of the data processing system illustrated in FIG. 1 and a method of displaying searched data in augmented reality, and FIG. 10 is an embodiment of a graphical user interface for illustrating a method of setting a search range in a second user terminal included in the data processing system illustrated in FIG. 1.

As illustrated in FIG. 10, when the AR app (112_2) displays a graphical user interface (102_1) including a first window (WD1) for inputting a latitude search range (SR_LAT), a second window (WD2) for inputting a longitude search range (SR_LNG), and a third window (WD3) for inputting an altitude search range (SR_ALT) on an output device (122_2), a second user inputs a search range in at least one of the windows (WD1, WD2, or WD3) and selects (or clicks) a search button (BT) (S203).

Upon selection of the search button (BT) (S203), the AR app (112_2) running on the processor (110_2) of the second user terminal (102) generates a packet including the sixth location data (PI6), the second user's user information (USI7), and the search range, and transmits the packet to the communication device (220) of the web server (200) via the communication device (120_2) (S215).

When the search range (SR) is the latitude search range (SR_LAT), as described with reference to Case 1 (CASE1) of FIGS. 7 and 8, the processor (210) of the web server (200) extracts the sixth location data (PI6) and the latitude search range (SR_LAT) from the received packet, generates a search request including the sixth location data (PI6) and the latitude search range (SR_LAT=SR), and transmits the search request to the database (400) via the communication device (220) (S220_1).

When the search range (SR) is the longitude search range (SR_LNG), as described with reference to Case 2 (CASE2) of FIGS. 7 and 8, the processor (210) of the web server (200) extracts the sixth position data (PI6) and the longitude search range (SR_LNG) from the received packet, generates a search request including the sixth position data (PI6) and the longitude search range (SR_LNG=SR), and transmits the search request to the database (400) via the communication device (220) (S220_1).

When the search range (SR) is the altitude search range (SR_ALT), as described with reference to Case 3 (CASE3) of FIGS. 7 and 8, the processor (210) of the web server (200) extracts the sixth location data (PI6) and the altitude search range (SR_ALT) from the received packet, generates a search request including the sixth location data (PI6) and the altitude search range (SR_ALT=SR), and transmits the search request to the database (400) via the communication device (220) (S220_1).

In addition, when the search range (SR) includes at least two search ranges among the latitude search range (SR_LAT), the longitude search range (SR_LNG), or the altitude search range (SR_ALT), the processor (210) of the web server (200) extracts the sixth location data (PI5) and the at least two search ranges from the received packet, generates a search request including the sixth location data (PI6) and the at least two search ranges, and transmits the search request to the database (400) via the communication device (220) (220).

As described with reference to FIGS. 1 to 10, each image data (e.g., image data for AR, IM1 to IM6) corresponding to a three-dimensional position (P1, P2, P3, and P4) specified according to latitude, longitude, and altitude is stored in each AR storage space (DS1_FP1 to DS6_FP6) of the image data storage device (or storage area, 300) corresponding to each file path (FP1 to FP6), and data (PIi, CDi, FPi, USIi, TD_IDi, and BL_NOi) related to each image data (IMi, i is 1 to 6) is stored in each of a database (400) and an immutable blockchain system (500), and some or all of the data (PIi, CDi, FPi, USIi, TD_IDi, and BL_NOi) read from the database (400) is read from the blockchain system (500). The image data (IMi) can be read from the image data storage device (300) using the verified file path (FPi) verified (or validated) by some or all of the data (PIi, CDi, FPi, USIi, TD_IDi, and BL_NOi), and the image data (IMi) can be displayed in augmented reality.

For example, when each altitude (ALT1 or ALT2) is not reflected at each location (P2 and P3), the first group of image data (IM3) taken at the first coffee shop on the first floor of building A and the second group of image data (IM4) taken at the second coffee shop on the third floor of building A are not distinguished by altitude, so the user cannot view only the first group of image data (IM3) or only the second group of image data (IM4) separately.

However, when each altitude (ALT1 or ALT2) is reflected at each location (P2 and P3) according to an embodiment of the present invention, the first group of image data (IM3) taken at the first coffee shop on the first floor of building A and the second group of image data (IM4) taken at the second coffee shop on the third floor of building A are distinguished by altitude, so that the user can view only the first group of image data (IM3) or only the second group of image data (IM4) separately.

As described above, image data for a three-dimensional location defined by latitude, longitude, and altitude is effectively recorded in storage (300) as three-dimensional coordinates.

While the present invention has been described with reference to the embodiments illustrated in the drawings, these are merely exemplary, and those skilled in the art will understand that various modifications and equivalent embodiments are possible. Therefore, the true scope of technical protection of the present invention should be determined by the technical spirit of the appended claims.

100: Data Processing System
101: First user terminal
102: Second user terminal
200: Web server
300: Storage
400: Database
500: Blockchain System
510: Read-only node
520_1, 520_2, and 520_3: Block Generation Nodes

Claims (7)

In a method for processing data using a data processing system,
The above data processing system,
A first user terminal including a camera and a first GPS receiver;
Image data storage device;
web server;
database; and
A blockchain system comprising blockchain nodes,
The method of processing the above data is as follows:
A step in which the first user terminal generates first location data including latitude, longitude, and altitude using the first GPS receiver;
A step in which the first user terminal transmits image data generated by the camera to the image data storage device;
A step in which the image data storage device stores the image data in an image data storage area corresponding to a file path and transmits the file path to the first user terminal;
A step in which the first user terminal transmits the first location data and the file path to the web server; and
A method for processing data, comprising the step of the web server transmitting the first location data and the file path to the database and transmitting a transaction including the first location data and the file path to the blockchain system. In the first paragraph,
The step of the blockchain system generating a block including the first location data and the file path according to the transaction, and transmitting a transaction ID for identifying the transaction and a block number for identifying the block to the web server; and
A method for processing data, comprising the step of the web server storing the transaction ID and the block number in the database. In the second paragraph,
The above data processing system further includes a second user terminal including a second GPS receiver,
The method of processing the above data is as follows:
A step in which the second user terminal generates second location data including the latitude, the longitude, and the altitude using the second GPS receiver, and transmits the second location data to the web server;
A step in which the web server retrieves first data including the first location data, the file path, the transaction ID, and the block number from the database using the second location data;
A step in which the web server extracts the transaction ID and the block number from the first data and transmits them to the blockchain system; and
A method for processing data, comprising the step of the web server receiving the first location data and the file path from the blockchain system and transmitting second data including the first location data and the file path to the second user terminal. In the third paragraph, the method for processing the data is as follows:
A step in which the second user terminal transmits the file path included in the second data to the image data storage device;
A step in which the image data storage device reads the image data from the image data storage area corresponding to the file path and transmits the image data to the second user terminal; and
The second user terminal further includes a step of displaying the image data in augmented reality,
A method for processing data in which at least one of the latitude, the longitude, or the altitude is the same as the first location data and the second location data. In a method for processing data using a data processing system,
The above data processing system,
A first user terminal including a camera and a first GPS receiver;
Image data storage device;
web server;
database; and
A blockchain system comprising blockchain nodes,
The method of processing the above data is as follows:
A step in which the first user terminal generates first location data including latitude, longitude, and altitude using the first GPS receiver;
A step in which the first user terminal transmits image data generated by the camera to the image data storage device;
A step in which the image data storage device stores the image data in an image data storage area corresponding to a file path and transmits the file path to the first user terminal;
A step in which the first user terminal transmits the first location data and the file path to the web server;
A step in which the web server transmits a transaction including the first location data and the file path to the blockchain system;
The step of the blockchain system generating a block including the first location data and the file path according to the transaction, and transmitting a transaction ID for identifying the transaction and a block number for identifying the block to the web server; and
A method for processing data, comprising the step of the web server storing the first location data, the file path, the transaction ID, and the block number in the database. In paragraph 5,
The above data processing system further includes a second user terminal including a second GPS receiver,
The method of processing the above data is as follows:
A step in which the second user terminal generates second location data including the latitude, the longitude, and the altitude using the second GPS receiver, and transmits the second location data to the web server;
A step in which the web server retrieves first data including the first location data, the file path, the transaction ID, and the block number from the database using the second location data;
A step in which the web server extracts the transaction ID and the block number from the first data and transmits them to the blockchain system; and
A method for processing data, comprising the step of the web server receiving the first location data and the file path from the blockchain system and transmitting second data including the first location data and the file path to the second user terminal. In the sixth paragraph, the method for processing the data is as follows:
A step in which the second user terminal transmits the file path included in the second data to the image data storage device;
A step in which the image data storage device reads the image data from the image data storage area corresponding to the file path and transmits the image data to the second user terminal; and
The second user terminal further includes a step of displaying the image data in augmented reality,
A method for processing data in which at least one of the latitude, the longitude, or the altitude is the same as the first location data and the second location data.