KR20240131208A - Electronic device for providing information related to exercise, method for controlling thereof and storage medium - Google Patents

Abstract

According to one embodiment, an electronic device comprises a first sensor, a second sensor, a communication module, a GPS module, and at least one processor, wherein the at least one processor obtains first location information of the first electronic device through the GPS module, obtains a first sensing value related to a user's bio-signal through the first sensor, determines whether a user wearing the first electronic device is in a location where he can start exercising based on the first location information, and if it is determined that the user is in a location where he can start exercising, transmits the first location information and the first sensing value to a server through the communication module, and obtains information on at least one mission specified for the exercise from the server based on the transmission of the first location information and the first sensing value, wherein the at least one mission is determined based on the first sensing value and the first location information, and after the exercise starts, based on at least one of a second sensing value related to the user's movement obtained through the second sensor or a third sensing value related to the user's bio-signal obtained through the first sensor, among the at least one mission, If it is confirmed that the first mission has been performed and the first electronic device is located at a designated location through the GPS module, a first command can be transmitted to the second electronic device through the communication module so that the second electronic device performs the second mission among the at least one mission. Various other embodiments are possible.

Description

ELECTRONIC DEVICE FOR PROVIDING INFORMATION RELATED TO EXERCISE, METHOD FOR CONTROLLING THEREOF AND STORAGE MEDIUM

Embodiments of the present disclosure relate to an electronic device providing information related to exercise, a method of operating the same, and a storage medium.

Metaverse-related content is being actively provided. For example, metaverse-related content based on augmented reality that allows additional information to be superimposed on the actual environment can be provided. As metaverse-related content becomes more sophisticated, a large number of users can access metaverse services.

The variety of services and additional functions provided through wearable electronic devices such as augmented reality glasses (AR glasses), video see-through (VST) devices, and head mounted display (HMD) devices are gradually increasing. In order to increase the utility value of these electronic devices and satisfy the needs of various users, communication service providers or electronic device manufacturers are competitively developing electronic devices to provide various functions and differentiate themselves from other companies. Accordingly, the various functions provided through wearable electronic devices are also becoming increasingly advanced.

AR glasses or VR glasses can provide a realistic experience to users by displaying virtual images while worn on the user's body. AR glasses or VST (video see through) devices can replace the usability of smartphones in various fields such as game entertainment, education, and SNS (social networking service). Users can receive content similar to reality through AR glasses or VST (video see through) devices, and can feel as if they are staying in a virtual world through interaction.

The above information may be provided as related art for the purpose of assisting in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

In one embodiment, a first electronic device may include a first sensor, a second sensor, a communication module, a GPS module, and at least one processor.

According to one embodiment, the at least one processor can obtain first location information of the first electronic device through the GPS module.

According to one embodiment, the at least one processor can obtain a first sensing value related to a user's biosignal through the first sensor.

According to one embodiment, the at least one processor may determine, based on the first location information, whether a user wearing the first electronic device is in a position where he or she can start exercising.

According to one embodiment, the at least one processor may transmit the first location information and the first sensing value to a server through the communication module when it is determined that the user is at a location where the exercise can begin.

According to one embodiment, the at least one processor may obtain information about at least one mission specified for the movement from the server based on the transmission of the first location information and the first sensing value.

According to one embodiment, at least one mission may be determined based on the first sensing value and the first location information.

According to one embodiment, the at least one processor may determine whether the first mission among the at least one mission has been performed based on at least one of a second sensing value related to the movement of the user acquired through the second sensor or a third sensing value related to the biosignal of the user acquired through the first sensor after the exercise has started.

According to one embodiment, the at least one processor may, when the first electronic device is determined to be located at a designated location through the GPS module, transmit a first command to the second electronic device through the communication module so that the second electronic device performs a second mission among the at least one mission.

In a method of operating a first electronic device according to one embodiment, the method may include an operation of obtaining first location information of the first electronic device through a GPS module included in the first electronic device.

In a method of operating a first electronic device according to one embodiment, the method may include an operation of obtaining a first sensing value related to a user's biosignal through a first sensor included in the first electronic device.

In a method of operating a first electronic device according to one embodiment, the method may include an operation of determining whether a user wearing the first electronic device is in a position where he or she can start exercising based on the first location information.

In a method of operating a first electronic device according to one embodiment, when it is determined that the user is in a position where the exercise can be started, the method may include transmitting the first location information and the first sensing value to a server through a communication module included in the first electronic device.

In a method of operating a first electronic device according to one embodiment, the method may include an operation of obtaining information on at least one mission specified for the movement from the server based on transmission of the first location information and the first sensing value.

In a method of operating a first electronic device according to one embodiment, after the movement starts, an operation of determining whether a first mission among the at least one mission has been performed based on at least one of a second sensing value related to the movement of the user acquired through a second sensor included in the first electronic device or a third sensing value related to the biosignal of the user acquired through the first sensor may be included.

In a method of operating a first electronic device according to one embodiment, when it is determined through the GPS module that the first electronic device is located at a designated location, the method may include transmitting a first command to a second electronic device through the communication module so that the second electronic device performs a second mission among the at least one mission.

In one embodiment, a non-transitory recording medium may store at least one instruction capable of executing an operation of obtaining first location information of a first electronic device through a GPS module included in the first electronic device.

In one embodiment, a non-transitory recording medium may store at least one instruction capable of executing an operation of obtaining a first sensing value related to a user's biosignal through a first sensor included in the first electronic device.

In one embodiment, a non-transitory recording medium may store at least one instruction capable of executing an operation of determining whether a user wearing the first electronic device is in a position where he or she can start exercising, based on the first location information.

In a non-transitory recording medium according to one embodiment, at least one instruction can be stored that can execute an operation of transmitting the first location information and the first sensing value to a server through a communication module included in the first electronic device when it is determined that the user is at a position where the exercise can be started.

In a non-transitory recording medium according to one embodiment, at least one instruction capable of executing an operation of obtaining information on at least one mission specified for the movement from the server based on transmission of the first location information and the first sensing value may be stored.

In one embodiment, a non-transitory recording medium may store at least one instruction capable of executing an operation of determining whether a first mission among the at least one mission has been performed based on at least one of a second sensing value related to the movement of the user acquired through a second sensor included in the first electronic device after the movement has started or a third sensing value related to the bio-signal of the user acquired through the first sensor.

In a non-transitory recording medium according to one embodiment, when the first electronic device is confirmed to be located at a designated location through the GPS module, at least one instruction can be stored that can execute an operation of transmitting a first command to a second electronic device so that the second electronic device performs a second mission among the at least one mission.

FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.
FIG. 2 is a perspective view illustrating the internal configuration of a wearable electronic device according to one embodiment of the present disclosure.
FIGS. 3A and 3B are diagrams showing the front and back of a wearable electronic device according to one embodiment.
FIG. 4A is a diagram for explaining a method for obtaining mission information related to exercise while a user wears a first electronic device and a second electronic device according to one embodiment.
FIG. 4b is a diagram illustrating a system that provides mission information related to exercise according to one embodiment.
FIG. 5 is a flowchart illustrating an operation of a system providing exercise-related mission information according to one embodiment of the present invention providing exercise-related mission information to a first electronic device and a second electronic device.
FIG. 6A is a flowchart illustrating an operation of a server according to one embodiment of the present invention to generate an artificial intelligence model by learning based on learning data acquired from a plurality of external electronic devices.
FIG. 6b is a flowchart illustrating an operation in which a server, according to one embodiment, determines information for at least one mission by further considering profile information and health information of a user of a first electronic device.
FIG. 7 is a flowchart illustrating an operation in which a server according to one embodiment determines at least one mission related to image capturing based on peripheral status information of a first electronic device.
FIG. 8A is a flowchart illustrating an operation of a server according to one embodiment of the present invention to determine whether a second electronic device has performed a mission.
FIG. 8b is a flowchart illustrating an operation of a server according to one embodiment of the present invention to determine whether a second electronic device has performed a mission.
FIG. 9 is a drawing showing a screen on which a second electronic device according to one embodiment displays at least one movement path information and at least one movement-related mission information through a display.
FIG. 10A is a diagram illustrating a screen viewed by a user wearing a second electronic device when it is confirmed that a first electronic device is located at a designated location according to one embodiment.
FIG. 10b is a diagram illustrating a screen viewed by a user wearing a second electronic device when a preview image acquired by the second electronic device using a camera according to one embodiment of the present invention substantially does not match a designated image.
FIG. 10c is a diagram illustrating a screen viewed by a user wearing a second electronic device when a preview image acquired by the second electronic device using a camera according to one embodiment substantially matches a designated image.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components. In addition, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

The processor (120) may control at least one other component (e.g., a hardware or software component) of an electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store result data in a nonvolatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

The auxiliary processor (123) may control at least a portion of functions or states associated with at least one of the components of the electronic device (101) (e.g., the display module (160), the sensor module (176), or the communication module (190)), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing device) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. Such learning may be performed, for example, in the electronic device (101) on which artificial intelligence is performed, or may be performed through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers. The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may additionally or alternatively include a software structure.

The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or nonvolatile memory (134).

The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

The audio output module (155) can output an audio signal to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive an incoming call. According to one embodiment, the receiver can be implemented separately from the speaker or as a part thereof.

The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) can include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) can include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can obtain sound through an input module (150), or output sound through an audio output module (155), or an external electronic device (e.g., an electronic device (102)) (e.g., a speaker or a headphone) directly or wirelessly connected to the electronic device (101).

The sensor module (176) can detect an operating state (e.g., power or temperature) of the electronic device (101) or an external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., the electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that a user can perceive through a tactile or kinesthetic sense. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module (180) can capture still images and moving images. According to one embodiment, the camera module (180) can include one or more lenses, image sensors, image signal processors, or flashes.

The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery (189) can power at least one component of the electronic device (101). In one embodiment, the battery (189) can include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

The communication module (190) may support establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., the electronic device (102), the electronic device (104), or the server (108)), and performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., the application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module or a power line communication module). Among these communication modules, a corresponding communication module may communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196) to identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199).

The wireless communication module (192) can support a 5G network and next-generation communication technology after a 4G network, for example, NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), terminal power minimization and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) may support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) may support various requirements specified in an electronic device (101), an external electronic device (e.g., an electronic device (104)), or a network system (e.g., a second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL) each, or 1 ms or less for round trip) for URLLC realization.

The antenna module (197) may transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the at least one selected antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

In one embodiment, the antenna module (197) can generate a mmWave antenna module. In one embodiment, the mmWave antenna module can include a printed circuit board, an RFIC positioned on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) positioned on or adjacent a second side (e.g., a top side or a side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

At least some of the above components may be connected to each other and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, a general purpose input and output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)).

In one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). In one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform at least a part of the function or service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result, as is or additionally processed, as at least a part of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an IoT (Internet of Things) device. The server (108) may be an intelligent server using machine learning and/or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199). The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

FIG. 2 is a perspective view illustrating the internal configuration of a wearable electronic device according to one embodiment of the present disclosure.

Referring to FIG. 2, a wearable electronic device (200) according to one embodiment of the present disclosure may include at least one of a light output module (211), a display member (201), and a camera module (250).

According to one embodiment of the present disclosure, the light output module (211) may include a light source capable of outputting an image, and a lens that guides the image to the display member (201). According to one embodiment of the present disclosure, the light output module (211) may include at least one of a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED).

According to one embodiment of the present disclosure, the display member (201) may include an optical waveguide (e.g., a waveguide). According to one embodiment of the present disclosure, an output image of an optical output module (211) incident on one end of the optical waveguide may be propagated inside the optical waveguide and provided to a user. According to one embodiment of the present disclosure, the optical waveguide may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) or at least one reflective element (e.g., a reflective mirror). For example, the optical waveguide may guide an output image of the optical output module (211) to a user's eyes by using at least one diffractive element or reflective element.

According to one embodiment of the present disclosure, the camera module (250) can capture still images and/or moving images. According to one embodiment, the camera module (250) is disposed within a lens frame and can be disposed around the display member (201).

According to one embodiment of the present disclosure, the first camera module (251) can capture and/or recognize a trajectory of a user's eye (e.g., pupil, iris) or gaze. According to one embodiment of the present disclosure, the first camera module (251) can periodically or aperiodically transmit information related to a trajectory of the user's eye or gaze (e.g., trajectory information) to a processor (e.g., processor (120) of FIG. 1).

According to one embodiment of the present disclosure, the second camera module (253) can capture an external image.

According to one embodiment of the present disclosure, the third camera module (255) can be used for hand detection and tracking, and user gesture (e.g., hand movement) recognition. According to one embodiment of the present disclosure, the third camera module (255) can be used for 3DoF (3 degrees of freedom), 6DoF head tracking, location (space, environment) recognition, and/or movement recognition. According to one embodiment of the present disclosure, the second camera module (253) can also be used for hand detection and tracking, and user gesture recognition. According to one embodiment of the present disclosure, at least one of the first camera module (251) to the third camera module (255) can be replaced with a sensor module (e.g., a LiDAR sensor). For example, the sensor module can include at least one of a VCSEL (vertical cavity surface emitting laser), an infrared sensor, and/or a photodiode.

FIGS. 3A and 3B are drawings showing the front and back of a wearable electronic device according to one embodiment.

Referring to FIGS. 3A and 3B, in one embodiment, camera modules (311, 312, 313, 314, 315, 316) and/or depth sensors (317) for obtaining information related to the surrounding environment of the wearable electronic device (300) may be arranged on a first surface (310) of the housing.

In one embodiment, the camera modules (311, 312) can acquire images related to the environment surrounding the wearable electronic device.

In one embodiment, the camera modules (313, 314, 315, 316) can acquire images while the wearable electronic device is worn by a user. The camera modules (313, 314, 315, 316) can be used for hand detection and tracking, and recognition of user's gestures (e.g., hand movements). The camera modules (313, 314, 315, 316) can be used for 3DoF, 6DoF head tracking, position (spatial, environmental) recognition, and/or movement recognition. In one embodiment, the camera modules (311, 312) can also be used for hand detection and tracking, and user's gestures.

In one embodiment, the depth sensor (317) may be configured to transmit a signal and receive a signal reflected from a subject, and may be used for purposes such as time of flight (TOF) to determine the distance to an object. Instead of or in addition to the depth sensor (217), the camera modules (313, 314, 315, 316) may determine the distance to an object.

According to one embodiment, a camera module (325, 326) for facial recognition and/or a display (321) (and/or a lens) may be arranged on the second side (320) of the housing.

In one embodiment, a facial recognition camera module (325, 326) adjacent to the display may be used to recognize a user's face, or may recognize and/or track both eyes of the user.

In one embodiment, the display (321) (and/or lens) may be disposed on the second side (320) of the wearable electronic device (300). In one embodiment, the wearable electronic device (300) may not include camera modules (315, 316) among the plurality of camera modules (313, 314, 315, 316). Although not shown in FIGS. 3A and 3B, the wearable electronic device (300) may further include at least one of the configurations illustrated in FIG. 2.

As described above, according to one embodiment, the wearable electronic device (300) may have a form factor for being worn on a user's head. The wearable electronic device (300) may further include a strap for being fixed on a body part of the user, and/or a wearing member. The wearable electronic device (300) may provide a user experience based on augmented reality, virtual reality, and/or mixed reality while being worn on the user's head.

FIG. 4A is a diagram for explaining a method for obtaining mission information related to exercise while a user wears a first electronic device and a second electronic device according to one embodiment.

According to one embodiment, the first electronic device (401) and the second electronic device (402) can provide information about the user's exercise. For example, the first electronic device (401) and the second electronic device (402) can recommend to the user at least one exercise that can be performed at the current location. In addition, the first electronic device (401) and the second electronic device (402) can provide the user with information about a path related to the exercise and information about a mission that can be performed on the path. The first electronic device (401) and the second electronic device (402) can recommend a more active exercise method to the user.

According to one embodiment, the first electronic device (401) may be implemented as a wearable electronic device that can be worn on a user's wrist. According to one embodiment, the second electronic device (402) may be implemented as either an augmented reality glass (AR glass) or a video see through (VST) device. However, this is only an example, and the first electronic device (401) and the second electronic device (402) may be implemented as various types of electronic devices.

According to one embodiment, the first electronic device (401) can confirm that the user is wearing the first electronic device (401). For example, the first electronic device (401) can confirm that the first electronic device (401) is worn by the user (e.g., worn on the wrist) through a sensor included in the first electronic device (401). According to one embodiment, the second electronic device (402) can confirm that the user is wearing the second electronic device (402). For example, the second electronic device (402) can confirm that the second electronic device (402) is worn by the user (e.g., worn on the face) through a sensor included in the second electronic device (402).

According to one embodiment, the first electronic device (401) can determine whether the user is in a position where he or she can start exercising based on location information of the first electronic device (401).

According to one embodiment, when the first electronic device (401) is determined to be in a position where it can start exercising, it can acquire and confirm information related to a bio-signal (e.g., a photoplethysmogram (PPG) signal) acquired through a sensor included in the first electronic device (401). At this time, the information related to the bio-signal may be information acquired at the current time or information acquired at a previous time.

According to one embodiment, the first electronic device (401) may transmit sensing values related to bio-signals acquired through a sensor and location information of the first electronic device (401) to a server (e.g., server (408) of FIG. 4B). According to one embodiment, the first electronic device (401) may acquire at least one exercise path information and information on at least one mission related to exercise from the server (408). For example, at least one mission may mean an exercise method (e.g., fast walking, running), an exercise state (e.g., a specified heart rate, a speed higher than a specified value, a specified number of steps), an exercise motion (e.g., maintaining a specific motion for a certain period of time), and other actions (e.g., taking a picture at a specific location) that the user can perform when performing a specific exercise. In this case, at least one mission may be related to the user's characteristics (e.g., gender, age), the user's state (e.g., health state), the type of exercise, the exercise path, and/or the surrounding state (e.g., weather).

According to one embodiment, the first electronic device (401) can check whether the user performs an exercise and the exercise satisfies the conditions for at least one mission. For example, the first electronic device (401) can provide a notification indicating the completion of a mission if the user's movement or state satisfies the conditions for the mission.

According to one embodiment, the first electronic device (401) can transmit at least one movement path information and at least one mission information related to the movement to the second electronic device (402).

According to one embodiment, the second electronic device (402) can display at least one piece of exercise path information and at least one piece of mission information related to the exercise through a display included in the second electronic device (402).

According to one embodiment, the second electronic device (402) can check whether the user performs an exercise and the exercise satisfies the conditions for at least one mission. For example, if the user's movement or state satisfies the conditions for the mission, the second electronic device (402) can provide a notification indicating the completion of the mission through a display included in the second electronic device (402). Alternatively, if the user's movement or state does not satisfy the conditions for the mission, the second electronic device (402) can provide a guide for completing the mission through a display included in the second electronic device (402).

Through this, the first electronic device (401) and the second electronic device (402) can recommend an exercise suitable for the user and provide information on at least one mission related to the exercise. Through this, the first electronic device (401) and the second electronic device (402) can provide information that enables the user to exercise more actively.

FIG. 4b is a diagram illustrating a system that provides mission information related to exercise according to one embodiment.

According to one embodiment, a system (400) for providing mission information related to exercise may include a plurality of external electronic devices (410), a server (408), a first electronic device (401), and a second electronic device (402).

According to one embodiment, the first electronic device (401) may include a processor (420), a first sensor (430), a second sensor (440), a GPS module (450), a display (460), and a communication module (490). According to one embodiment, the second electronic device (402) may include a processor (444), a camera (455) (250 of FIG. 2; 311, 312, 313, 314, 315, 316 of FIGS. 3A and 3B; 455 of FIG. 4B), a display (461) (201 of FIG. 2; 361 of FIGS. 3A and 3B; 460 of FIG. 4B), and a communication module (491).

According to one embodiment, the processor (420) can control the overall operation of the first electronic device (401). For example, the processor (420) can be implemented in a manner identical to or similar to the processor (120) of FIG. 1. According to one embodiment, the processor (444) can control the overall operation of the second electronic device (402). For example, the processor (444) can be implemented in a manner identical to or similar to the processor (120) of FIG. 1.

According to one embodiment, the first electronic device (401) may be implemented as a wearable electronic device that can be worn on a user's wrist. However, this is only an example, and the first electronic device (401) may be implemented as various types of electronic devices.

According to one embodiment, the second electronic device (402) may be implemented as either an augmented reality glass (AR glass) or a video see through (VST) device. For example, if the second electronic device (402) is implemented as an AR glass, the display (461) may be implemented as an optical output device for displaying content or objects through the glass. Alternatively, if the second electronic device (402) is implemented as a VST device, the display (461) may be implemented as a device for displaying a screen on a display. However, this is only an example, and the second electronic device (402) may be implemented as various types of electronic devices.

According to one embodiment, the plurality of external electronic devices (410) may be implemented as wearable electronic devices worn on the wrist. However, this is only an example, and the plurality of external electronic devices (410) may be implemented as various types of electronic devices.

According to one embodiment, the processor (420) can connect to the server (408) to transmit and receive information. According to one embodiment, the server (408) can generate data for representing artificial reality (e.g., an augmented reality environment or a virtual reality environment). According to one embodiment, the second electronic device (402) can transmit and receive information to the server (408) through the first electronic device (401). Additionally, the second electronic device (402) can directly connect to the server (408) to transmit and receive information. According to one embodiment, a plurality of external electronic devices (410) can connect to the server (408) to transmit and receive information.

According to one embodiment, the server (408) can obtain bio-signal data, location data, exercise path data, and exercise-related mission data of each user of the plurality of external electronic devices (410) from the plurality of external electronic devices (410). According to one embodiment, the server (408) can generate an artificial intelligence model based on the data.

According to one embodiment, the processor (420) can obtain first location information of the first electronic device (420) through the GPS module (450).

According to one embodiment, the processor (420) may obtain a first sensing value related to a user's bio-signal (e.g., a PPG signal) through the first sensor (430). For example, the bio-signal may include a PPG (photoplethysmography) signal. According to one embodiment, the first sensor (430) may include a PPG sensor for measuring a PPG signal. According to one embodiment, the first sensor (430) may further include a sensor (e.g., an ECG sensor) for measuring GSR, BIA, and ECG signals. The processor (420) may obtain a GSR (galvanic skin reflex), a BIA (bioelectrical impedance analysis) signal, and/or an ECG (electrocardiogram) signal through the first sensor (430). However, the present invention is not limited thereto, and the first sensor (430) may include various types of sensors capable of measuring the user's bio-signal. According to one embodiment, the first sensing value may mean a sensing value obtained through the first sensor (430) when the user wearing the first electronic device (401) is before starting exercise.

According to one embodiment, the processor (420) may obtain a sensing value related to a user's biosignal (e.g., a PPG signal) through the first sensor (430) when the user is in a sleeping state. In addition, the processor (420) may obtain a sensing value related to a user's biosignal (e.g., a PPG signal) through the first sensor (430) when the user is in a resting state. According to one embodiment, the processor (420) may store the sensing values obtained when the user is in a sleeping state or a resting state in a memory (not shown) (e.g., the memory (130) of FIG. 1).

According to one embodiment, the processor (420) may determine whether a user wearing the first electronic device (401) is in a location where he or she can start exercising based on the first location information. According to one embodiment, the processor (420) may pre-designate at least one location information where the first electronic device (401) can start exercising. According to one embodiment, if the pre-designated location information and the first location information substantially match, the processor (420) may determine that the user is in a location where he or she can start exercising. According to one embodiment, if the processor (420) determines that the user is in a location where he or she can start exercising, the processor (420) may transmit the first location information and the first sensing value to the server (408) through the communication module (490).

According to one embodiment, the server (408) may acquire learning data from a plurality of external electronic devices (410), learn from them, and generate an artificial intelligence model. According to one embodiment, the learning data may include bio-signal data, location data, exercise path data, and exercise-related mission data of users wearing the plurality of external electronic devices (410) acquired by each of the plurality of external electronic devices (410). In addition, the learning data may further include profile data including at least one of gender, age, height, weight, occupation, or exercise-related hobbies of the users of the plurality of external electronic devices (410), and health status data including at least one of obesity or health disease. In addition, the learning data may further include data on sensing values related to bio-signals acquired when the users of the plurality of external electronic devices (410) are in a sleeping or resting state. In addition, the learning data may include peripheral status data of the plurality of external electronic devices (410). In one embodiment, the ambient conditions may include at least one of the weather, time, or season at the time the plurality of external electronic devices (410) performed the plurality of missions.

In addition, according to one embodiment, the learning data may include information about a plurality of images in which at least one location was captured. In one embodiment, the information about the plurality of images may include at least one of the plurality of images, the surrounding conditions at the time when the plurality of images were captured, the location where the plurality of images were captured, or the number of times the images were captured at the location where the images were captured. In one embodiment, the surrounding conditions may include at least one of the weather, time, or season at the time when the plurality of images were captured. In addition, according to one embodiment, the information about the plurality of images may include the number of times that the plurality of external electronic devices (410) connected to the server (408) checked the information about the plurality of images and the scores assigned to the plurality of images.

According to one embodiment, the server (408) inputs the first location information and the first sensing value into an artificial intelligence model, thereby obtaining at least one piece of exercise path information and at least one mission specified for the exercise. According to one embodiment, the server (408) inputs at least one of the first location information, the first sensing value, the profile information, the health status information, the surrounding status information, or the sensing value obtained through the first sensor (430) when the user is in a sleeping or resting state into the artificial intelligence model, thereby obtaining at least one piece of exercise path information and at least one mission specified for the exercise.

According to one embodiment, the server (408) may transmit at least one piece of exercise path information and at least one mission information to the first electronic device (401). According to one embodiment, the first electronic device (401) may transmit at least one piece of exercise path information and at least one mission information to the second electronic device (402). According to one embodiment, the server (408) may also transmit at least one piece of exercise path information and at least one mission information to the second electronic device (401). According to one embodiment, the second electronic device (402) may display the at least one piece of exercise path information and the at least one mission as virtual objects through the display (461). According to one embodiment, the first electronic device (401) may display the at least one piece of exercise path information and the at least one mission through the display (460).

In addition, according to one embodiment, the processor (444) may display only exercise route information with a high preference among at least one exercise route information through the display (461). Alternatively, the processor (444) may display exercise route information with a high preference through the display (461) so as to be distinguished from other exercise route information. According to one embodiment, the preference may be determined by the processor (420), the processor (444), the server (408), the first electronic device (401), or the second electronic device (402). For example, the preference may be designated based on at least one of altitude, scenery, temperature, presence or absence of a resting area, or required time. According to one embodiment, exercise route information with a high preference may mean information on the number of exercise route information received by the server (408) from a plurality of external electronic devices (410).

In one embodiment, at least one motion path may include a first path and a second path. In one embodiment, the first path and the second path may have substantially the same starting location and an arrival location, but the paths between the starting location and the arrival location may be different from each other. Alternatively, the first path and the second path may have substantially the same starting location but different arrival locations.

According to one embodiment, at least one mission may be a mission designated in correspondence with at least one exercise path. Additionally, according to one embodiment, at least one mission may be a mission designated separately from at least one exercise path.

For example, at least one mission may include a mission to perform an exercise related to stretching, knee exercise, or jumping jacks at a starting location or an ending location. According to one embodiment, the processor (444) may display guide information for the exercise through the display (461). The guide information may include image information representing the motion of the exercise. At least one mission may include a mission related to at least one of the number of steps of the user, the average speed of the user's movement, the number of calories consumed, or the value of biometric information (e.g., heart rate, oxygen saturation, blood pressure) measured based on a biometric signal, and the time required to perform the exercise. At least one mission may include a mission to photograph a designated location. At least one mission may include a mission to acquire an item displayed as a virtual object through the display (461) of the second electronic device (402) at the location based on location information acquired through the GPS module (450) of the first electronic device (401). At least one mission may include a mission in which the first electronic device (401) obtains a sensing value exceeding a sensing value related to a step count or speed corresponding to a top 10% among sensing values related to a step count or speed of a first plurality of users who are substantially the same age as the user wearing the first electronic device (401) among users wearing a plurality of external electronic devices (410) and who used substantially the same exercise route. At least one mission may include a mission in which a designated location is photographed.

According to one embodiment, the processor (444) may verify a user's input for a first path among at least one exercise path. According to one embodiment, when the user's input for the first path is verified, the processor (444) may display a first mission among the first path and at least one mission corresponding to the first path through the display (461). Alternatively, according to one embodiment, when the user's input for the first path and the user's input for the first mission are verified, the processor (444) may display a first mission among the first path and at least one mission through the display (461).

According to one embodiment, the processor (420) may obtain a second sensing value related to the user's movement through the second sensor (440) after the exercise starts. According to one embodiment, the second sensor (440) may include an acceleration sensor. According to one embodiment, the processor (420) may obtain a third sensing value related to the user's biosignal (e.g., PPG signal) through the first sensor (430) after the exercise starts.

According to one embodiment, the processor (420) can determine whether at least one of the first missions among the at least one missions has been performed based on at least one of the second sensing value or the third sensing value.

For example, if the processor (420) determines that the second sensing value (e.g., number of steps, speed) related to the user's movement is greater than a preset value, the processor (420) may determine that the first mission is performed (or completed). According to one embodiment, if the processor (420) determines that the third sensing value related to the user's bio-signal (e.g., PPG signal) acquired after the start of exercise is greater than a preset value, the processor (420) may determine that the first mission is performed (or completed). For example, the processor (420) may compare a first value indicated by the third sensing value (e.g., heart rate, blood pressure, oxygen saturation) with a second value indicated by the existing user's bio-information (e.g., bio-information acquired based on the first sensing value) (e.g., heart rate, blood pressure, oxygen saturation). If the first electronic device (401) determines that the difference between the second value and the first value is greater than a preset value, the first electronic device (401) may determine that the first mission is performed (or completed). For example, the processor (420) may determine that the first mission has been performed if it is determined that the user has rested for a preset period of time at a specific location.

According to one embodiment, the processor (420) may further consider the user's health status information to determine whether the first mission has been performed. For example, the processor (420) may determine an input for information indicating that the user is injured. According to one embodiment, when the input is confirmed, the processor (420) may determine that the first mission has been performed (or completed) if the second sensing value (e.g., number of steps, speed) is confirmed to be a value greater than the first value and less than the second value. The second value may mean a value greater than the first value. For example, a value greater than the first value and less than the second value may mean a sensing value that does not cause strain to the injured user's body.

However, this is an example, and the processor (420) can determine whether the first mission has been performed in various ways.

According to one embodiment, the processor (420) can confirm that the first electronic device (401) is located at a designated location through the GPS module (450). At this time, the processor (420) can transmit a first command to the second electronic device (402) through the communication module (490) so that the second electronic device (402) performs a second mission among the at least one mission. According to one embodiment, the second mission can be a mission to photograph a designated location through a camera (455) included in the second electronic device (402). According to one embodiment, the server (408) can store information about a plurality of images in which the designated location is photographed. According to one embodiment, the server (408) can determine the second mission by considering the number of times that a plurality of external electronic devices (410) connected to the server (408) have confirmed information about the plurality of images, the number of times that the plurality of images have been photographed, and/or the scores assigned to the plurality of images. According to one embodiment, if the number of times the server (408) has checked information about the first image included in the plurality of images is greater than the number of times the server (408) has checked information about the plurality of images included in the remaining plurality of images excluding information about the first image included in the plurality of images, the server (408) may determine the mission to capture the first image as the second mission. According to one embodiment, if the number of times the server (408) has captured the first image among the plurality of images is the greatest, the server (408) may determine the mission to capture the first image as the second mission. According to one embodiment, if the first image among the plurality of images has the highest score, the server (408) may determine the mission to capture the first image as the second mission.

According to one embodiment, the first electronic device (401), the second electronic device (402), and the plurality of external electronic devices (410) can access the server (408) to check information about a plurality of images including a plurality of images captured by other devices. According to one embodiment, the server (408) can check and update in real time the number of times information about the plurality of images has been checked (e.g., the number of views). According to one embodiment, the first electronic device (401) and the plurality of external electronic devices (410) can assign scores to the plurality of images. For example, the first electronic device (401) and the plurality of external electronic devices (410) can assign scores to the plurality of images as natural numbers between 1 and 5.

According to one embodiment, the server (408) may transmit information about an image of a designated location to the first electronic device (401). According to one embodiment, the first electronic device (401) may transmit information about an image of a designated location to the second electronic device (402) while transmitting a first command. According to one embodiment, the processor (444) may display an image of the designated location as information about the second mission through the display (461).

According to one embodiment, the processor (444) can display a preview image captured in real time using the camera (455) through the display (461). According to one embodiment, the processor (444) can transmit the preview image captured in real time to the first electronic device (401) through the communication module (491). According to one embodiment, the first electronic device (401) can transmit the preview image to the server (408).

According to one embodiment, the server (408) can verify whether the preview image and the first image taken of the designated location substantially match. According to one embodiment, the server (408) can verify whether the preview image and the first image for the designated location substantially match using object recognition technology. According to one embodiment, the server (408) can compare the image for the designated location with the preview image based on objects (e.g., plants, structures) included in the first image and the preview image, and the composition and direction in which the objects are located. According to one embodiment, the server (408) can verify that the preview image and the first image substantially match each other when the preview image and the first image match or are similar.

Alternatively, according to one embodiment, the first electronic device (401) may determine whether the preview image and the first image photographed at the specified location substantially match each other. According to one embodiment, the first electronic device (401) may determine that the preview image and the first image substantially match each other if the preview image and the first image match or are similar to each other.

According to one embodiment, if the server (408) determines that the preview image and the first image match or are similar, the server (408) may transmit information indicating that the preview image and the first image substantially match to the first electronic device (401). According to one embodiment, the processor (420) may transmit information indicating that the preview image and the first image substantially match to the second electronic device (402). According to one embodiment, the processor (444) may display information indicating that the preview image and the first image substantially match through the display (461). According to one embodiment, the second electronic device (402) may photograph a designated location using the camera (455). According to one embodiment, the processor (444) may transmit second image information including a second image in which the designated location is photographed to the server (408) through the first electronic device (401) using the communication module (491).

According to one embodiment, the server (408) can store the second image information. According to one embodiment, a plurality of external electronic devices (410) can access the server (408) to check the second image information (e.g., the second image, information on the surrounding conditions in which the second image was captured). According to one embodiment, the plurality of external electronic devices (410) can assign a score to the second image. According to one embodiment, the server (408) can store the number of times the plurality of external electronic devices (410) have checked the second image information and the score assigned to the second image in the second image information.

According to one embodiment, the second electronic device (402) may display information indicating that the second mission has been performed through the display (461). According to one embodiment, the processor (420) may display information indicating that the second mission has been performed through the display (460).

According to one embodiment, if the server (401) determines that the preview image and the first image do not match or are not similar, the server (401) may transmit to the first electronic device (401) information indicating that the preview image and the first image do not substantially match and guide information guiding the user to capture an image for the designated location. According to one embodiment, the processor (420) may transmit to the second electronic device (402) information indicating that the preview image and the first image do not substantially match and guide information. According to one embodiment, the server (401) may also transmit to the second electronic device (402) information indicating that the preview image and the first image do not substantially match and guide information guiding the user to capture an image for the designated location. According to one embodiment, the second electronic device (402) may display the information indicating that the preview image and the first image do not substantially match and the guide information through the display (461). According to one embodiment, the guiding information may include information related to an object (e.g., a plant, a structure) included in the image, a composition in which the object is located, and a direction. For example, the second electronic device (402) may display guide information to move the camera (455) to the right, left, or backward.

According to one embodiment, the processor (420) may determine a score related to the performance of the first mission based on the difficulty of the first mission performed by the first electronic device (401) and/or the time taken to perform the first mission. According to one embodiment, the processor (444) may determine a score related to the performance of the second mission based on the difficulty of the second mission performed by the second electronic device (402) and/or the time taken to perform the second mission. According to one embodiment, the processor (444) may transmit the score related to the performance of the second mission to the first electronic device (401) through the communication module (491). At this time, the processor (444) may also transmit the difficulty of the second mission and/or the time taken to perform the second mission. According to one embodiment, the processor (420) may transmit the score related to the performance of the first mission and the score related to the performance of the second mission to the server (408).

According to one embodiment, the server (408) may determine a score related to the performance of the first mission based on the difficulty of the first mission performed by the first electronic device (401) and/or the time taken to perform the first mission. According to one embodiment, the server (408) may determine a score related to the performance of the second mission based on the difficulty of the second mission performed by the second electronic device (402) and/or the time taken to perform the second mission.

In one embodiment, the server (408) may determine a reward for the first mission based on a score associated with performing the first mission. In one embodiment, the server (408) may determine a reward for the second mission based on a score associated with performing the second mission.

According to one embodiment, the server (408) can compare a reward for a first mission performed by at least one first external electronic device among a plurality of external electronic devices (410) that performed a first mission with a reward for the first mission performed by the first electronic device (401). The server (408) can determine a ranking related to the first mission performed by the first electronic device (401) based on a result of the comparison. According to one embodiment, the server (408) can compare a reward for a second mission performed by at least one second external electronic device among a plurality of external electronic devices (410) that performed a second mission with a reward for the second mission performed by the second electronic device (401). The server (408) can determine a ranking related to the second mission performed by the second electronic device (401).

According to one embodiment, the server (408) can store a ranking associated with a first mission of the first electronic device (401) and a ranking associated with a second mission of the second electronic device (401). The first electronic device (401) or the second electronic device (402) can access the server (408) to check the ranking associated with the first mission and the ranking associated with the second mission.

According to one embodiment, the server (408) may transmit to the first electronic device (401) a ranking associated with a first mission of the first electronic device (401) and a ranking associated with a second mission of the second electronic device (401).

According to one embodiment, the first electronic device (401) may display a ranking related to the first mission of the first electronic device (401) and a ranking related to the second mission of the second electronic device (401) through the display (460). According to one embodiment, the first electronic device (401) may transmit a control command to the second electronic device (402) to display the ranking related to the first mission of the first electronic device (401) and the ranking related to the second mission of the second electronic device (401) on the display (461) of the second electronic device (402). According to one embodiment, the server (408) may also transmit a control command to the second electronic device (402) to display the ranking related to the first mission of the first electronic device (401) and the ranking related to the second mission of the second electronic device (402) on the display (461) of the second electronic device (402). The second electronic device (402) can display, based on the control command, a priority related to the first mission of the first electronic device (401) and a priority related to the second mission of the second electronic device (401) through the display (461).

According to one embodiment, the server (408) is described as transmitting and receiving information or control commands for at least one mission to and from the second electronic device (402) via the first electronic device (401), but the server (408) may directly transmit and receive information or control commands for at least one mission to and from the second electronic device (402).

The operations of the first electronic device (401) described in the drawings below may be performed by the processor (420). However, for convenience of explanation, the operations performed by the processor (420) will be described as being performed by the first electronic device (401).

The operations of the second electronic device (402) described in the drawings below may be performed by the processor (444). However, for convenience of explanation, the operations performed by the processor (444) will be described as being performed by the second electronic device (402).

FIG. 5 is a flowchart illustrating an operation of a system providing exercise-related mission information according to one embodiment of the present invention providing exercise-related mission information to a first electronic device and a second electronic device.

In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

According to one embodiment, in operation 511, a first electronic device (401) (e.g., the first electronic device (401) of FIG. 4b) may obtain first location information through a GPS module (450) (e.g., the GPS module (450) of FIG. 4b).

According to one embodiment, in operation 513, the first electronic device (401) may obtain a first sensing value related to a user's biosignal (e.g., a PPG signal) through a first sensor (430) (e.g., the first sensor (430) of FIG. 4B ). According to one embodiment, the first sensing value may mean information indicating a health status of the user (e.g., heart rate, oxygen saturation, blood pressure, stress index).

According to one embodiment, in operation 515, the first electronic device (401) can determine whether the user is at a location where the user can start exercising. According to one embodiment, the first electronic device (401) can determine whether the user wearing the first electronic device (401) is at a location where the user can start exercising, based on the first location information. According to one embodiment, the first electronic device (401) can also designate at least one location information where the first electronic device (401) can start exercising. According to one embodiment, if the designated location information and the first location information substantially match, the first electronic device (401) can determine that the user is at a location where the user can start exercising.

According to one embodiment, in operation 517, the first electronic device (401) may transmit first location information and first sensing value to a server (e.g., server (408) of FIG. 4b).

According to one embodiment, in operation 518, the server (408) can determine at least one exercise path and at least one mission based on the first location information and the first sensing value. According to one embodiment, the server (408) can input the first location information and the first sensing value into an artificial intelligence model, and obtain at least one exercise path and at least one mission. According to one embodiment, the at least one mission can be a mission designated in correspondence with the at least one exercise path. Alternatively, according to one embodiment, the at least one mission can be a mission designated separately from the at least one exercise path. According to one embodiment, the operation of the server (408) generating the artificial intelligence model is specifically described in FIG. 6A.

According to one embodiment, in operation 519, the first electronic device (401) may receive information about at least one motion path and at least one mission from the server (408).

In one embodiment, at operation 521, the first electronic device (401) may transmit information about at least one exercise path and at least one mission to the second electronic device (402) (e.g., the second electronic device (402) of FIG. 4B ). In one embodiment, the server (408) may also transmit information about at least one exercise path and at least one mission to the second electronic device (402).

According to one embodiment, in operation 523, the second electronic device (402) may display at least one exercise path and at least one mission through the display (461) (e.g., the display (461) of FIG. 4B ), and confirm a user input for a first path among the at least one exercise path. According to one embodiment, the second electronic device (402) may display the first path and at least one mission corresponding to the first path in association with each other through the display (461), and may display the second path among the at least one exercise path and at least one mission corresponding to the second path in association with each other. According to one embodiment, when a user input for the first path is confirmed, the second electronic device (402) may display the first path and at least one mission corresponding to the first path through the display (461). Alternatively, according to one embodiment, the at least one mission and the at least one exercise path may be separately input by the user. In one embodiment, the first path and the second path may have substantially the same starting location and arrival location, but the paths between the starting location and the arrival location may be different from each other. Alternatively, the first path and the second path may have substantially the same starting location but different arrival locations.

According to one embodiment, in operation 525, the second electronic device (402) may display a first mission included in the first path and at least one mission corresponding to the first path through the display (461). Or, according to one embodiment, the second electronic device (402) may display a first mission among the first path for which a user input has been confirmed and at least one mission for which a user input has been confirmed through the display (461).

According to one embodiment, in operation 527, the first electronic device (401) may determine whether the first mission included in at least one mission corresponding to the first path has been performed. According to one embodiment, the first electronic device (401) may determine whether the first mission has been performed based on at least one of a second sensing value related to the user's movement acquired through a second sensor (e.g., the second sensor (440) of FIG. 4B ) or a third sensing value related to the user's biosignal acquired through the first sensor (430) after the exercise starts. For example, if the first electronic device (401) determines that the second sensing value (e.g., acceleration, number of steps) is greater than a preset value, the first electronic device (401) may determine that the first mission has been performed. For example, the first electronic device (401) may compare the first value indicated by the third sensing value (e.g., heart rate, blood pressure, oxygen saturation) with the second value indicated by the existing user's biometric information (e.g., biometric information acquired based on the first sensing value) (e.g., heart rate, blood pressure, oxygen saturation). If the first electronic device (401) determines that the difference between the second value and the first value is greater than a preset value, the first electronic device (401) may determine that the first mission has been performed (or completed). For example, if the first electronic device (401) determines that the user has rested for a preset time at a specific location, the first electronic device (401) may determine that the first mission has been performed. According to one embodiment, the first electronic device (401) may determine whether the first mission has been performed by further considering the user's health status information. For example, the first electronic device (401) may determine an input for information indicating that the user is injured. According to one embodiment, when the input is confirmed, the first electronic device (401) can confirm that the first mission has been performed (or completed) if the second sensing value (e.g., number of steps, speed) is confirmed to be a value greater than the first value and less than the second value. The second value may mean a value greater than the first value. For example, a value greater than the first value and less than the second value may mean a sensing value that does not cause strain to the injured user's body. However, this is only an example, and embodiments of the present invention can confirm whether the first electronic device (401) has performed the first mission in various ways.

According to one embodiment, in operation 529, the first electronic device (401) can determine that the first electronic device (401) is located at a designated location through the GPS module (450). For example, the designated location can be designated by the first electronic device (401).

According to one embodiment, in operation 531, the first electronic device (401) may transmit a first command to the second electronic device (402) so that the second electronic device (402) performs a second mission based on the determination that the first electronic device (401) is located at a designated location. According to one embodiment, the second electronic device (402) may display a second mission included in the at least one mission through the display (461) based on the first command. According to one embodiment, the second mission may be a mission to photograph a designated location through a camera (455) included in the second electronic device (402) (e.g., the camera (455) of FIG. 4B ).

According to one embodiment, in operation 533, the second electronic device (402) can perform a second mission based on the first command. According to one embodiment, the operation of the second electronic device (402) performing the second mission is specifically described in FIGS. 8A and 8B.

Meanwhile, operation 527 and operation 529 to operation 533 can be performed independently of each other. That is, the operation of checking whether the first mission is performed and the operation of checking whether the second mission is performed can be performed independently of each other. For example, the order of operation 527 can be performed later than any one of operations 529 to 533.

FIG. 6A is a flowchart illustrating an operation of a server according to one embodiment of the present invention to generate an artificial intelligence model by learning based on learning data acquired from a plurality of external electronic devices.

In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

In one embodiment, at operation 611, a server (408) (e.g., server (408) of FIG. 4B ) may obtain learning data from a plurality of external electronic devices (410) (e.g., a plurality of external electronic devices (410) of FIG. 4B ). In one embodiment, the learning data may include biosignal data, location data, movement path data, and mission data specified for movement.

In one embodiment, at operation 613, the server (408) can learn using the learning data to determine information about at least one mission and information about at least one movement path. In one embodiment, the server (408) can generate an artificial intelligence model based on the learning data.

According to one embodiment, in operation 615, the first electronic device (401) (e.g., the first electronic device (401) of FIG. 4B ) may transmit a first sensing value and first location information related to a biosignal (e.g., a PPG signal) to the server (408).

According to one embodiment, in operation 617, the server (408) can determine information about at least one exercise path and at least one mission based on the first sensing value and the first location information. According to one embodiment, when the server (408) inputs the first sensing value and the first location information into the artificial intelligence model, the server can obtain information about at least one exercise path and at least one mission. According to one embodiment, the information about at least one mission can mean information about an activity of the user that can be performed on the at least one exercise path.

According to one embodiment, in operation 619, the first electronic device (401) may receive information about at least one motion path and at least one mission based on the first sensing value and the first location information from the server (408).

In one embodiment, at operation 621, the first electronic device (401) may transmit information about at least one exercise path and at least one mission to the second electronic device (402) (e.g., the second electronic device (402) of FIG. 4B ). In one embodiment, the server (408) may also transmit information about at least one exercise path and at least one mission directly to the second electronic device (402).

In one embodiment, at operation 623, the second electronic device (402) may display at least one motion path and at least one mission via a display (461) (e.g., display (461) of FIG. 4B ).

According to one embodiment, a system (400) that provides mission information related to exercise can provide an exercise route and a mission specified for exercise to a user according to the physical health condition of a user wearing a first electronic device (401).

FIG. 6b is a flowchart illustrating an operation in which a server, according to one embodiment, determines information about at least one mission by further considering profile information and health status information of a user of a first electronic device.

In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

According to one embodiment, the server (408) (e.g., the server (408) of FIG. 4B) may learn using learning data and generate an artificial intelligence model. According to one embodiment, the learning data may include bio-signal data, location data, exercise route data, and mission data specified for exercise. According to one embodiment, the learning data may further include profile data including at least one of gender, age, height, or weight of users wearing the plurality of external electronic devices (410) (e.g., the plurality of external electronic devices (410)) and health status data including at least one of obesity or health disease. In addition, according to one embodiment, the learning data may further include ambient condition data at the time when the exercise was performed. According to one embodiment, the ambient condition may include at least one of weather, time, or season at the time when the specified mission for the exercise was performed. In addition, the learning data may further include data on sensing values related to bio-signals acquired when users of the plurality of external electronic devices (410) are in a sleeping or resting state. In addition, according to one embodiment, the learning data may include image data of a designated location photographed. The image data may include ambient condition data at the time the image was photographed. The ambient condition data at the time the image was photographed may include at least one of the weather, time, or season at the time the image was photographed. The image data may include at least one of a score assigned to the image by a plurality of external electronic devices (410) by accessing the server (408) or a number of times the server (408) accesses and checks information about the image. According to one embodiment, the first electronic device (401), the second electronic device (402), and the plurality of external electronic devices (410) may access the server (408) and check information about a plurality of images including a plurality of images photographed by other devices. According to one embodiment, the server (408) may check and update the number of times the information about the plurality of images (e.g., the number of views) is checked in real time.

According to one embodiment, in operation 631, the first electronic device (401) (e.g., the first electronic device (401) of FIG. 4B ) may transmit a first sensing value and first location information related to a biosignal (e.g., a PPG signal) of a user wearing the first electronic device (401) to the server (408). For example, the first sensing value may mean information indicating a health status of the user (e.g., heart rate, oxygen saturation, blood pressure, stress index).

According to one embodiment, in operation 633, the first electronic device (401) may transmit the user's profile information and health status information to the server (408). According to one embodiment, the profile information may include the user's height, weight, age, gender, or hobbies related to exercise. According to one embodiment, the health status information may include whether the user is obese or has a health condition.

According to one embodiment, in operation 635, the first electronic device (401) may transmit a fourth sensing value related to a biosignal (e.g., a PPG signal) acquired through a first sensor (e.g., the first sensor (430) of FIG. 4B) when a user wearing the first electronic device (401) is in a sleeping state to the server (408). For example, the fourth sensing value may mean information indicating a health state (e.g., heart rate, oxygen saturation, blood pressure, stress index) of the user when in a sleeping state.

According to one embodiment, the first electronic device (401) may further include a sensor capable of obtaining surrounding environment information. According to one embodiment, the first electronic device (401) may obtain current surrounding environment information using the sensor. According to one embodiment, the surrounding condition may include at least one of weather, time, or season. According to one embodiment, the first electronic device (401) may transmit the surrounding environment information to the server (408).

According to one embodiment, in operation 637, the server (408) can determine at least one exercise path information and at least one information about a mission. According to one embodiment, the server (408) can input at least one of the first sensing value, the first location information, and the profile information, the health status information, or the fourth sensing value into the artificial intelligence model, and obtain at least one exercise path information and information about at least one mission. In addition, according to one embodiment, the server (408) can further consider surrounding environment information to obtain at least one exercise path information and information about at least one mission. For example, in case of rainy weather, the server (408) can determine a low-slope exercise path.

According to one embodiment, in operation 641, the first electronic device (401) may receive at least one movement path information and at least one mission information based on at least one of the first sensing value, the first location information, and the profile information, the health status information, the fourth sensing value, or the surrounding environment information from the server (408).

In one embodiment, at operation 643, the first electronic device (401) may transmit at least one piece of exercise path information and at least one piece of mission information to the second electronic device (402) (e.g., the second electronic device (402) of FIG. 4B ). In one embodiment, the server (408) may directly transmit the at least one piece of exercise path information and the at least one mission information to the second electronic device (402).

In one embodiment, at operation 645, the second electronic device (402) may display at least one motion path and at least one mission via a display (461) (e.g., display (461) of FIG. 4B ).

FIG. 7 is a flowchart illustrating an operation in which a server according to one embodiment determines at least one mission related to image capturing based on peripheral status information of a first electronic device.

In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

According to one embodiment, in operation 711, a first electronic device (401) (e.g., the first electronic device (401) of FIG. 4B ) may transmit a first sensing value and first location information related to a biosignal (e.g., a PPG signal) of a user wearing the first electronic device (401) to a server (408) (e.g., the server (408) of FIG. 4B ).

According to one embodiment, in operation 713, the first electronic device (401) may transmit current surrounding condition information of the first electronic device (401) to the server (408). According to one embodiment, the first electronic device (401) may further include a sensor capable of obtaining surrounding environment information. According to one embodiment, the first electronic device (401) may obtain current surrounding environment information using the sensor. According to one embodiment, the surrounding condition may include at least one of weather, time, or season.

According to one embodiment, in operation 715, the server (408) may determine at least one piece of exercise path information and at least one piece of mission information related to image capturing. According to one embodiment, the server (408) may input a first sensing value, first location information, and current surrounding condition information of the first electronic device (401) into an artificial intelligence model, and may obtain at least one piece of exercise path information and at least one piece of mission information related to image capturing. According to one embodiment, the server (408) may generate an artificial intelligence model as a result of learning based on learning data. According to one embodiment, the learning data may include image data in which a specified location is captured. The image data may include surrounding condition data at the time the image was captured. The surrounding condition data at the time the image was captured may include at least one of weather, time, or season at the time the image was captured. The image data may include at least one of a score assigned to the image by a plurality of external electronic devices (410) (e.g., the plurality of external electronic devices (410) of FIG. 4B) by accessing the server (408) or the number of times the server (408) accessed and checked information about the image.

According to one embodiment, the first electronic device (401) and the plurality of external electronic devices (410) can access the server (408) to check information about the plurality of images including the plurality of images captured by other devices. According to one embodiment, the server (408) can check and update in real time the number of times the information about the plurality of images has been checked (e.g., the number of views). According to one embodiment, the first electronic device (401) and the plurality of external electronic devices (410) can assign scores to the plurality of images. For example, the first electronic device (401) and the plurality of external electronic devices (410) can assign scores to the plurality of images as natural numbers between 1 and 5.

For example, if the number of times the server (408) checks information about a first image included in the plurality of images is greater than the number of times the server (408) checks information about a plurality of images included in the remaining plurality of images excluding information about the first image included in the plurality of images, the server (408) may determine the mission information for shooting the first image as at least one piece of mission information related to image shooting. If the number of times the server (408) has shot the first image among the plurality of images is the greatest, the server (408) may determine the mission information for shooting the first image as at least one piece of mission information related to image shooting. If the score of the first image among the plurality of images is the highest, the server (408) may determine the mission information for shooting the first image as at least one piece of mission information related to image shooting.

According to one embodiment, at least one mission information related to image capturing may include capturing a designated location. For example, at least one mission information related to image capturing may include a mission to capture a specific structure at the top of Mt. Halla, a mission to capture canola flowers on the Olle Trail in Jeju Island. According to one embodiment, at least one mission information related to image capturing may include a mission to capture an image that is substantially the same as an image captured at a designated location.

According to one embodiment, in operation 717, the first electronic device (401) may receive at least one movement path information and at least one mission information from the server (408). According to one embodiment, the at least one mission information may include an image taken of a designated location.

In one embodiment, at operation 719, the first electronic device (401) may transmit at least one piece of exercise path information and at least one piece of information about a mission to the second electronic device (402) (e.g., the second electronic device (402) of FIG. 4B ) while transmitting a first command. For example, the first command may be a command to cause the second electronic device (402) to perform at least one mission. In one embodiment, the server (408) may also directly transmit the at least one piece of exercise path information and the at least one piece of information about a mission to the second electronic device (402).

According to one embodiment, in operation 721, the second electronic device (402) may display at least one piece of exercise path information and at least one piece of mission information through the display (461) (e.g., the display (461) of FIG. 4B ). According to one embodiment, the second electronic device (402) may display information about a mission to photograph a designated location on the display (461). According to one embodiment, the second electronic device (402) may also display an image of a designated location photographed, received from the server (408), on the display (461).

According to one embodiment, a system (400) that provides mission information related to exercise can provide a safe exercise route and a mission designated for exercise by considering the current weather, season, and time.

FIG. 8A is a flowchart illustrating an operation of a server according to one embodiment of the present invention to determine whether a second electronic device has performed a mission.

In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

According to one embodiment, in operation 811, the second electronic device (402) (e.g., the second electronic device (402) of FIG. 4B ) may display a second mission among the at least one mission through the display (461) (e.g., the display (461) of FIG. 4B ). According to one embodiment, when it is determined that the first electronic device (401) is located at a designated location, the first electronic device (401) may transmit a command to the second electronic device (402) through the communication module (490) (e.g., the communication module (490) of FIG. 4B ) so that the second electronic device (402) performs the second mission among the at least one mission. According to one embodiment, the second mission may include a mission of photographing the designated location through a camera (455) included in the second electronic device (402) (e.g., the camera (455) of FIG. 4B ). According to one embodiment, the server (408) may transmit an image of the designated location to the second electronic device (402) via the first electronic device (401) (e.g., the first electronic device (401) of FIG. 4B ). According to one embodiment, the second mission may include a mission of capturing an image substantially matching the image of the designated location. According to one embodiment, the second electronic device (402) may display the image of the designated location as a virtual object via the display (461).

According to one embodiment, in operation 813, the second electronic device (402) may display a preview image captured in real time using a camera (455) through the display (461).

According to one embodiment, in operation 815, the first electronic device (401) may receive information about a preview image from the second electronic device (402). According to one embodiment, the second electronic device (402) may transmit the preview image to the first electronic device (401) in real time through a communication module (491) (e.g., the communication module (491) of FIG. 4B ).

In one embodiment, at operation 817, the first electronic device (401) may transmit information about the preview image to the server (408). In one embodiment, the second electronic device (402) may also transmit information about the preview image directly to the server (408).

According to one embodiment, in operation 819, the server (408) may verify whether the preview image and the image for the designated location included in the second mission substantially match. For example, if the preview image and the image for the designated location included in the second mission are identical or similar, the server (408) may verify that the preview image and the image for the designated location included in the second mission substantially match. According to one embodiment, the server (408) may verify whether the preview image and the image for the designated location included in the second mission are identical or similar using object recognition technology. The server (408) may compare the image for the designated location with the preview image based on objects (e.g., plants, structures) included in the image for the designated location and the composition and direction in which the objects are located. According to one embodiment, the first electronic device (401) may also verify whether the preview image and the image for the designated location included in the second mission are identical or similar.

According to one embodiment, at operation 821, the first electronic device (401) may receive information from the server (408) indicating that the preview image and the image for the specified location substantially match.

In one embodiment, at operation 823, the first electronic device (401) may transmit information indicating that the preview image and the image for the designated location substantially match to the second electronic device (402). In one embodiment, the server (408) may directly transmit information indicating that the preview image and the image for the designated location substantially match to the second electronic device (402).

According to one embodiment, in operation 825, the second electronic device (402) may display information indicating that the preview image and the image for the designated location substantially match through the display (461). For example, the second electronic device (402) may display information indicating that the preview image and the image for the designated location substantially match through a pop-up window.

In one embodiment, at operation 827, the second electronic device (402) can capture an image via a camera (455).

According to one embodiment, at operation 829, the first electronic device (401) may receive image information including an image from the second electronic device (402).

In one embodiment, at operation 831, the first electronic device (401) may transmit image information to the server (408). In one embodiment, the second electronic device (402) may also transmit image information directly to the server (408).

According to one embodiment, in operation 833, the server (408) may receive image information based on the fact that the image captured by the second electronic device (402) substantially matches the image for the designated location. According to one embodiment, the server (408) may also store the received image information. According to one embodiment, a plurality of external electronic devices (410) may access the server (408) to check the image information (e.g., the image, information on the surrounding conditions where the image was captured). According to one embodiment, the plurality of external electronic devices (410) may assign a score to the image. According to one embodiment, the server (408) may store the image information by including the number of times the plurality of external electronic devices (410) have checked the image information and the score assigned to the image.

According to one embodiment, in operation 835, the second electronic device (402) may display information indicating that the second mission has been performed through the display (461). According to one embodiment, the first electronic device (401) may display information indicating that the second mission has been performed through the display (460) (e.g., the display (460) of FIG. 4B ).

FIG. 8b is a flowchart illustrating an operation of a server according to one embodiment of the present invention to determine whether a second electronic device has performed a mission.

In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

According to one embodiment, in operation 851, the server (408) (e.g., the server (408) of FIG. 4B ) may determine whether the preview image and the image for the designated location included in the second mission substantially match. According to one embodiment, if the server (408) determines that the preview image and the image for the designated location included in the second mission are identical or similar, the server (408) may determine that the preview image and the image for the designated location included in the second mission substantially match. According to one embodiment, if the preview image and the image for the designated location are inconsistent or dissimilar, the server (408) may transmit to the first electronic device (401) (e.g., the first electronic device (401) of FIG. 4B ) information indicating that the preview image and the image for the designated location substantially match and information guiding the device to capture the image for the designated location. For example, the server (408) may compare the image for the designated location with the preview image based on an object (e.g., a plant, a structure) included in the image for the designated location and the composition and direction in which the object is located.

According to one embodiment, in operation 853, the first electronic device (401) may receive from the server (408) information indicating that the preview image and the image for the designated location substantially do not match, and information guiding to capture the image for the designated location.

According to one embodiment, in operation 855, the first electronic device (401) may transmit information indicating that the preview image and the image for the designated location substantially do not match and information guiding to capture an image for the designated location to the second electronic device (402) (e.g., the second electronic device (402) of FIG. 4B ). According to one embodiment, the second electronic device (402) may also directly receive information indicating that the preview image and the image for the designated location substantially do not match and information guiding to capture an image for the designated location from the server (408).

According to one embodiment, in operation 857, the second electronic device (402) may display information indicating that the preview image and the image for the designated location substantially do not match through the display (461) (e.g., the display (461) of FIG. 4b ) and information guiding to capture the image for the designated location. According to one embodiment, the guiding information may include information related to an object (e.g., a plant, a structure) included in the image, a composition and a direction in which the object is located. For example, the second electronic device (402) may display guide information guiding to move the camera (455) (e.g., the camera (455) of FIG. 4b ) to the right, left, or backward.

FIG. 9 is a drawing showing a screen on which a second electronic device according to one embodiment displays at least one movement path information and at least one movement-related mission information through a display.

According to one embodiment, the second electronic device (402) (e.g., the second electronic device (402) of FIG. 4B ) may display at least one exercise path and at least one mission through the display (461) (e.g., the display (461) of FIG. 4B ). According to one embodiment, at least one mission may be designated to correspond to at least one exercise path.

According to one embodiment, the second electronic device (402) may display a first path (920) and at least one mission (910) specified in the first path (920) through the display (461). The at least one mission (910) specified in the first path (920) may include a case where a sensing value (e.g., the number of steps) related to a movement of the user obtained through the second sensor (440) (e.g., the second sensor (440) of FIG. 4B) is greater than or equal to a pre-specified sensing value (e.g., 10000). The at least one mission (910) specified in the first path (920) may include a case where a sensing value (e.g., a heart rate) related to a biosignal obtained through the first sensor (430) (e.g., the first sensor (430) of FIG. 4B) after exercise starts is greater than a sensing value (e.g., a heart rate) related to a biosignal obtained when the user is in a sleeping state. At least one mission (910) specified in the first path (920) may include a case where a sensing value (e.g., heart rate) related to a bio-signal acquired after exercise starts is greater than a sensing value (e.g., heart rate) related to a bio-signal acquired when the user is in a sleeping state by a pre-specified value or more.

According to one embodiment, the second electronic device (402) may display a second path (940) and at least one mission (930) specified in the second path (940) through the display (461). According to one embodiment, the at least one mission (930) specified in the second path (940) may include a case where the total calories consumed by the user is equal to or greater than a pre-specified value (e.g., 1000). According to one embodiment, the at least one mission (930) specified in the second path (940) may include taking a designated image at a pre-specified location.

FIG. 10A is a diagram illustrating a screen viewed by a user wearing a second electronic device when it is confirmed that a first electronic device is located at a designated location according to one embodiment.

According to one embodiment, when the first electronic device (401) (e.g., the first electronic device (401) of FIG. 4B) determines that the first electronic device (401) is located at a designated location through the GPS module (450) (e.g., the GPS module (450) of FIG. 4B), the first electronic device (401) may transmit a command to the second electronic device (402) (e.g., the second electronic device (402) of FIG. 4B) through the communication module (490) (e.g., the communication module (490) of FIG. 4B) so that the second electronic device (402) performs a mission. According to one embodiment, the designated location may be a location designated in advance by the first electronic device (401).

According to one embodiment, the second electronic device (402) may display information about the mission (1020) indicating information about the mission through the display (461) (e.g., the display (461) of FIG. 4B) based on the command. For example, the information about the mission (1020) may mean information indicating a mission to photograph a designated location. Referring to FIG. 10A, a screen (1010) seen by a user wearing the second electronic device (402) may include information about an actual space and information about the mission (1020). The information about the mission (1020) may be displayed as a virtual object. According to one embodiment, the second electronic device (402) may receive an image (not shown) of a designated location being photographed from the first electronic device (401) and display it as a virtual object through the display (461).

FIG. 10b is a diagram illustrating a screen viewed by a user wearing a second electronic device when a preview image acquired by the second electronic device using a camera according to one embodiment of the present invention substantially does not match a designated image.

In one embodiment, the second electronic device (402) (e.g., the second electronic device (402) of FIG. 4b) may display a preview image captured in real time using a camera (455) (e.g., the camera (455) of FIG. 4b)) through a display (361) (e.g., the display (461) of FIG. 4b). In one embodiment, the second electronic device (402) may transmit the preview image in real time to a server (408) (e.g., the server (408) of FIG. 4b) through the first electronic device (401) (e.g., the first electronic device (401) of FIG. 4b).

According to one embodiment, the server (408) can determine whether the preview image and the designated image for the designated location match or are similar. According to one embodiment, the server (408) can determine whether the preview image and the designated image for the designated location match or are similar by considering the composition and orientation in which the object (e.g., a structure) included in the designated image is located.

According to one embodiment, if the preview image and the image for the designated location are inconsistent or dissimilar, the server (408) may transmit information indicating that the preview image and the designated image are substantially inconsistent and guide information to the second electronic device (402) through the first electronic device (401).

According to one embodiment, the second electronic device (402) may display information and guide information (1040) indicating that the preview image and the designated image substantially do not match through the display (461). Referring to FIG. 10b, a screen (1030) viewed by a user wearing the second electronic device (402) may include information and guide information (1040) indicating that the actual space and the preview image and the designated image substantially do not match. For example, the information and guide information (1040) indicating that the preview image and the designated image substantially do not match may be a virtual object. For example, the guide information may include information for moving in a specific direction (e.g., to the left) from a current location.

FIG. 10c is a diagram illustrating a screen viewed by a user wearing a second electronic device when a preview image acquired by the second electronic device using a camera and a designated image match according to one embodiment.

In one embodiment, the server (408) (e.g., the server (408) of FIG. 4B ) may transmit information indicating that the preview image and the designated image substantially match each other to the second electronic device (402) (e.g., the second electronic device (402) of FIG. 4B ) via the first electronic device (401) (e.g., the first electronic device (401) of FIG. 4B ) when the preview image and the image for the designated location match or are similar.

According to one embodiment, the second electronic device (402) may display information (1060) indicating that the preview image and the designated image substantially match through the display (461) (e.g., the display (461) of FIG. 4b ). Referring to FIG. 10c , a screen (1050) viewed by a user wearing the second electronic device (402) may include information (1060) indicating that the actual space and the preview image and the designated image substantially match. For example, the information (1060) indicating that the preview image and the designated image substantially match may be a virtual object.

In one embodiment, a first electronic device (401) may include a first sensor (430), a second sensor (440), a communication module (490), a GPS module (450), and at least one processor (420).

According to one embodiment, the at least one processor (420) can obtain first location information of the first electronic device through the GPS module (450).

According to one embodiment, at least one processor (420) can obtain a first sensing value related to a user's biosignal through the first sensor (430).

According to one embodiment, the at least one processor (420) may determine, based on the first location information, whether the user wearing the first electronic device (401) is in a position where he or she can start exercising.

According to one embodiment, the at least one processor (420) may transmit the first location information and the first sensing value to a server through the communication module (490) when it is determined that the user is at a location where the exercise can begin.

According to one embodiment, the at least one processor (420) may obtain information on at least one mission specified for the movement from the server (408) based on the transmission of the first location information and the first sensing value.

According to one embodiment, at least one mission may be determined based on the first sensing value and the first location information.

According to one embodiment, the at least one processor (420) can determine whether the first mission among the at least one mission has been performed based on at least one of a second sensing value related to the movement of the user acquired through the second sensor (440) or a third sensing value related to the biosignal of the user acquired through the first sensor (430) after the exercise has started.

According to one embodiment, when the at least one processor (420) determines that the first electronic device (401) is located at a designated location through the GPS module (450), the at least one processor (420) may transmit a first command to the second electronic device (402) through the communication module (490) so that the second electronic device (402) performs a second mission among the at least one mission.

According to one embodiment, the at least one processor (420) may receive information about at least one movement path from the server (408).

According to one embodiment, the at least one processor (420) may transmit information about the at least one exercise path to the second electronic device (402) so as to display the at least one exercise path through a display (461) of the second electronic device (402).

The second mission according to one embodiment may include a mission of photographing the designated location through a camera (455) included in the second electronic device (402).

According to one embodiment, the at least one processor (420) may receive information about an image taken at the designated location from the server (408).

According to one embodiment, the at least one processor (420) may transmit information about the image to the second electronic device (402) so as to display the image as information about the second mission through a display of the second electronic device.

In one embodiment, the information about the image may be obtained based on information about a plurality of images captured at the designated location by a plurality of external electronic devices (410) collected by the server (408).

Information about the plurality of images according to one embodiment may include at least one of the plurality of images, the surrounding conditions at the time the plurality of images were captured, the location where the plurality of images were captured, or the number of shots taken at the location where the images were captured.

According to one embodiment, the ambient conditions may include at least one of the weather, time, or season at the time the plurality of images were captured.

According to one embodiment, the at least one processor (420) may determine a score related to the performance of the first mission based on the difficulty of the first mission or the time taken to perform the first mission.

According to one embodiment, the at least one processor (420) may determine a reward for the first mission based on the score.

According to one embodiment, the at least one processor (420) may transmit at least one of the user's gender information, age information, weather information, current time information, or season information to the server.

According to one embodiment, the at least one mission may be determined based on at least one of the user's gender information, age information, weather information, current time information, or season information.

According to one embodiment, the at least one processor (420) may transmit a fourth sensing value representing a biosignal of the user obtained when the user is in a sleeping state to the server through the first sensor (430).

According to one embodiment, at least one of the missions may be determined by further considering the fourth sensing value.

According to one embodiment, the at least one processor (420) may determine that the first mission has been performed if the second sensing value related to the movement of the user is determined to be greater than a first threshold value.

According to one embodiment, the at least one processor (420) may determine that the first mission has been performed if it is determined that a difference between the third sensing value acquired after the exercise starts and the fourth sensing value acquired when the user is in a sleeping state before the exercise starts is greater than a second threshold value.

According to one embodiment, the first electronic device (401) may include a wearable electronic device that can be worn on the user's wrist.

According to one embodiment, the second electronic device (402) may include augmented reality glasses.

According to one embodiment, the second electronic device (402) may include a video see through (VST) device.

In a method of operating a first electronic device (401) according to one embodiment, an operation of obtaining first location information of the first electronic device (401) through a GPS module (450) included in the first electronic device (401) may be included.

In a method of operating a first electronic device (401) according to one embodiment, an operation of obtaining a first sensing value related to a user's biosignal through a first sensor (430) included in the first electronic device (401) may be included.

In a method of operating a first electronic device (401) according to one embodiment, an operation of checking whether a user wearing the first electronic device (401) is in a position where he or she can start exercising may be included based on the first location information.

In a method of operating a first electronic device (401) according to one embodiment, when it is confirmed that the user is in a position where the exercise can be started, an operation of transmitting the first location information and the first sensing value to a server (408) through a communication module (490) included in the first electronic device (401) may be included.

In a method of operating a first electronic device (401) according to one embodiment, the method may include an operation of obtaining information on at least one mission specified for the movement from the server (408) based on transmission of the first location information and the first sensing value.

In a method of operating a first electronic device (401) according to one embodiment, after the movement starts, an operation of determining whether a first mission among the at least one mission has been performed based on at least one of a second sensing value related to the movement of the user acquired through a second sensor (440) included in the first electronic device (401) or a third sensing value related to the bio-signal of the user acquired through the first sensor (430).

In a method of operating a first electronic device (401) according to one embodiment, when it is confirmed through the GPS module (450) that the first electronic device (401) is located at a designated location, an operation of transmitting a first command to a second electronic device (402) through the communication module (490) so that the second electronic device (402) performs a second mission among the at least one mission may be included.

In a method of operating a first electronic device (401) according to one embodiment, the method may include an operation of receiving movement path information from the server (408).

In a method of operating a first electronic device (401) according to one embodiment, the method may include an operation of transmitting movement path information to a second electronic device (402) so as to display the movement path through a display (461) of the second electronic device (402).

In a method of operating a first electronic device (401) according to one embodiment, the method may include an operation of receiving information about an image in which the specified location was photographed from the server (408).

In a method of operating a first electronic device (401) according to one embodiment, the method may include an operation of transmitting information about an image to a second electronic device (402) so as to display the image through a display (461) of the second electronic device (402).

In a method of operating a first electronic device (401) according to one embodiment, an operation of checking a score related to performance of the first mission may be included based on a difficulty of the first mission or a time taken to perform the first mission.

In a method of operating a first electronic device (401) according to one embodiment, an operation of determining a reward for the first mission based on the score may be included.

In a method of operating a first electronic device (401) according to one embodiment, an operation of transmitting a fourth sensing value representing a biosignal of the user obtained when the user is in a sleeping state through the first sensor (430) to a server (408) may be included.

In a method of operating a first electronic device (401) according to one embodiment, if it is determined that the second sensing value related to the movement of the user is greater than a first threshold value, an operation of determining that the first mission has been performed may be included.

In a method of operating a first electronic device (401) according to one embodiment, if it is determined that a difference between the third sensing value acquired after the exercise starts and the fourth sensing value acquired when the user is in a sleeping state before the exercise starts is greater than a second threshold value, an operation of determining that the first mission has been performed may be included.

In a non-transitory recording medium according to one embodiment, at least one instruction capable of executing an operation of obtaining first location information of the first electronic device (401) through a GPS module (450) included in the first electronic device (401) may be stored.

In a non-transitory recording medium according to one embodiment, at least one instruction capable of executing an operation of obtaining a first sensing value related to a user's biosignal through a first sensor (430) included in the first electronic device (401) may be stored.

In a non-transitory recording medium according to one embodiment, at least one instruction capable of executing an operation of checking whether a user wearing the first electronic device (401) is in a position where he or she can start exercising may be stored based on the first location information.

In a non-transitory recording medium according to one embodiment, when it is determined that the user is in a position where the exercise can be started, at least one instruction that can execute an operation of transmitting the first location information and the first sensing value to a server (408) through a communication module included in the first electronic device (401) can be stored.

In a non-transitory recording medium according to one embodiment, at least one instruction capable of executing an operation of obtaining information on at least one mission specified for the movement from the server (408) based on the transmission of the first location information and the first sensing value may be stored.

In a non-transitory recording medium according to one embodiment, at least one instruction can be stored that can execute an operation of determining whether a first mission among the at least one mission has been performed based on at least one of a second sensing value related to the movement of the user acquired through the second sensor (440) included in the first electronic device (401) after the movement has started, or a third sensing value related to the bio-signal of the user acquired through the first sensor (430).

In a non-transitory recording medium according to one embodiment, when it is confirmed through the GPS module (450) that the first electronic device (401) is located at a designated location, at least one instruction can be stored that can execute an operation of transmitting a first command to the second electronic device (402) so that the second electronic device (402) performs a second mission among the at least one mission.

The electronic device according to various embodiments disclosed in this document may be a device of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiments of this document is not limited to the above-described devices.

The various embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly dictates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first) is referred to as "coupled" or "connected" to another (e.g., a second) component, with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be an integrally configured component or a minimum unit of the component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101, 201, 301, 401, 402)). For example, a processor (e.g., a processor (120, 220, 420, 444)) of a machine (e.g., an electronic device (101, 201, 301, 401, 402)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may include: It may be provided in the form of a non-transitory storage medium. Here, ‘non-transitory’ means only that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently in the storage medium and cases where it is stored temporarily.

According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a commodity. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play StoreTM) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or an intermediary server.

According to various embodiments, each component (e.g., a module or a program) of the above-described components may include a single or multiple entities, and some of the multiple entities may be separated and arranged in other components. According to various embodiments, one or more of the components or operations of the above-described components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, the multiple components (e.g., a module or a program) may be integrated into one component. In such a case, the integrated component may perform one or more functions of each of the multiple components identically or similarly to those performed by the corresponding component of the multiple components before the integration. According to various embodiments, the operations performed by the module, program, or other component may be executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims (20)

In the first electronic device (101 in FIG. 1; 401 in FIG. 4b),
First sensor (176 in Fig. 1; 430 in Fig. 4b);
Second sensor (176 in Fig. 1; 440 in Fig. 4b);
Communication module (190 in Fig. 1; 490 in Fig. 4b);
GPS module (450 in Fig. 4b); and
comprising at least one processor (120 in FIG. 1; 420 in FIG. 4b),
At least one processor of the above,
Obtaining first location information of the first electronic device through the GPS module,
Obtaining a first sensing value related to the user's biosignal through the first sensor,
Based on the first location information, it is determined whether the user wearing the first electronic device is in a position where he or she can start exercising,
When it is confirmed that the user is in a position where the exercise can be started, the first location information and the first sensing value are transmitted to the server (108 in FIG. 1; 408 in FIG. 4b) through the communication module,
Based on the transmission of the first location information and the first sensing value, information on at least one mission specified for the movement is obtained from the server, wherein the at least one mission is determined based on the first sensing value and the first location information,
After the above exercise starts, based on at least one of the second sensing value related to the user's movement acquired through the second sensor or the third sensing value related to the user's bio-signal acquired through the first sensor, it is determined whether the first mission among the at least one mission has been performed,
A first electronic device configured to transmit a first command to a second electronic device (102; 104 of FIG. 1; 200 of FIG. 2; 300 of FIGS. 3a, 3b; 402 of FIG. 4b) through the communication module so that the second electronic device performs a second mission among the at least one mission when the first electronic device is confirmed to be located at a designated location through the GPS module.
In the first paragraph,
At least one processor of the above,
Receive information about at least one exercise path from the above server,
A first electronic device configured to transmit information about said at least one exercise path to said second electronic device so as to display said at least one exercise path via a display of said second electronic device (201 of FIG. 2; 361 of FIGS. 3a, 3b; 460 of FIG. 4b).
In any one of paragraphs 1 and 2,
The second mission above is,
A first electronic device including a mission to photograph the designated location through a camera (350 of FIG. 2; 311, 312, 313, 314, 315, 316 of FIGS. 3a and 3b; 455 of FIG. 4b) included in the second electronic device.
In any one of claims 1 to 3,
At least one processor of the above,
Receive information about the image taken at the designated location from the above server,
A first electronic device configured to transmit information about the image to the second electronic device so as to display the image as information about the second mission through a display of the second electronic device.
In any one of claims 1 to 4,
Information about the above image is obtained based on information about a plurality of images taken at the designated location by a plurality of external electronic devices collected by the server,
The information about the plurality of images includes at least one of the plurality of images, the surrounding conditions at the time the plurality of images were taken, the location where the plurality of images were taken, or the number of shots taken at the location where the plurality of images were taken.
The above-mentioned ambient conditions include at least one of the weather, time, or season at the time the plurality of images were captured, the first electronic device.
In any one of paragraphs 1 to 5,
At least one processor of the above,
Based on the difficulty of the first mission above or the time taken to perform the first mission above, check the score related to the performance of the first mission above,
A first electronic device set to determine a reward for the first mission based on the above score.
In any one of claims 1 to 6,
A first electronic device that transmits at least one of the user's gender information, age information, weather information, current time information, or season information to the server, wherein the at least one mission is determined based on at least one of the user's gender information, age information, weather information, current time information, or season information.
In any one of claims 1 to 7,
At least one processor of the above,
Transmitting a fourth sensing value representing the user's biosignal obtained when the user is in a sleeping state to the server through the first sensor;
wherein at least one of the above missions is determined by further considering the fourth sensing value, the first electronic device.
In any one of claims 1 to 8,
At least one processor of the above,
A first electronic device set to determine that the first mission has been performed when a difference between the third sensing value acquired after the exercise starts and the fourth sensing value acquired when the user is in a sleeping state before the exercise starts is determined to be greater than a threshold value.
In any one of claims 1 to 9,
A first electronic device including a wearable electronic device wearable on the user's wrist, and a second electronic device including an augmented reality glass (AR glass) or a video see through (VST) device.
In the operating method of the first electronic device (101 of FIG. 1; 401 of FIG. 4b),
An operation of acquiring first location information of the first electronic device through a GPS module (450 of FIG. 4b) included in the first electronic device;
An operation of obtaining a first sensing value related to a user's biosignal through a first sensor (176 of FIG. 1; 430 of FIG. 4b) included in the first electronic device;
An action of determining whether a user wearing the first electronic device is in a position where he or she can start exercising based on the first location information;
When it is confirmed that the user is in a position where the exercise can be started, an operation of transmitting the first location information and the first sensing value to a server (108 of FIG. 1; 408 of FIG. 4b) through a communication module (190 of FIG. 1; 490 of FIG. 4b) included in the first electronic device;
An operation of obtaining information about at least one mission specified for the movement from the server based on the transmission of the first location information and the first sensing value; wherein the at least one mission is determined based on the first sensing value and the first location information;
After the above movement starts, an operation of determining whether the first mission among the at least one mission has been performed based on at least one of a second sensing value related to the movement of the user acquired through the second sensor (176 of FIG. 1; 440 of FIG. 4b) included in the first electronic device or a third sensing value related to the user's bio-signal acquired through the first sensor; and
An operating method of a first electronic device, comprising: when the first electronic device is determined to be located at a designated location through the GPS module, transmitting a first command to the second electronic device through the communication module so that the second electronic device performs a second mission among the at least one mission.
In Article 11,
An action of receiving exercise path information from the above server; and
A method of operating a first electronic device, further comprising transmitting the exercise path information to the second electronic device so as to display the exercise path through a display of the second electronic device (201 of FIG. 2; 361 of FIGS. 3a, 3b; 460 of FIG. 4b).
In any one of Articles 11 to 12,
The second mission above is,
A method of operating a first electronic device, including a mission of photographing a designated location through a camera (250 of FIG. 2; 311, 312, 313, 314, 315, 316 of FIGS. 3a and 3b; 455 of FIG. 4b) included in the second electronic device.
In any one of Articles 11 to 13,
An action of receiving information about an image taken at the designated location from the server; and
A method of operating a first electronic device further comprising transmitting information about the image to a second electronic device so as to display the image through a display of the second electronic device.
In any one of Articles 11 to 14,
Information about the above image is obtained based on information about multiple images taken at the designated location by multiple external electronic devices collected by the server,
Information about the plurality of images includes at least one of the plurality of images, the surrounding conditions at the time the plurality of images were taken, the location where the plurality of images were taken, or the number of shots taken at the location where the plurality of images were taken.
A method of operating a first electronic device, wherein the above-mentioned ambient conditions include at least one of weather, time, or season at the time when the plurality of images were captured.
In any one of Articles 11 to 15,
An action of checking a score related to the performance of the first mission based on the difficulty of the first mission or the time taken to perform the first mission; and
A method of operating a first electronic device further comprising an action of determining a reward for the first mission based on the score.
In any one of Articles 11 to 16,
A method of operating a first electronic device, wherein at least one of the user's gender information, age information, weather information, current time information, or season information is transmitted to the server, and wherein the at least one mission is determined based on at least one of the user's gender information, age information, weather information, current time information, or season information.
In any one of Articles 11 to 17,
A method of operating a first electronic device further comprising an action of transmitting a fourth sensing value representing a biosignal of the user obtained when the user is in a sleeping state through the first sensor to a server, wherein the at least one mission is determined by further considering the fourth sensing value.
In any one of Articles 11 to 18,
The operation of checking whether the first mission among at least one of the above missions has been performed is as follows:
A method of operating a first electronic device, comprising an operation of determining that the first mission has been performed when a difference between the third sensing value acquired after the exercise starts and the fourth sensing value acquired when the user is in a sleeping state before the exercise starts is determined to be greater than a threshold value.
In non-transitory recording media,
An operation of acquiring first location information of a first electronic device through a GPS module (450 of FIG. 4b) included in the first electronic device (101 of FIG. 1; 401 of FIG. 4b);
An operation of obtaining a first sensing value related to a user's biosignal through a first sensor (176 of FIG. 1; 430 of FIG. 4b) included in the first electronic device;
An action of determining whether a user wearing the first electronic device is in a position where he or she can start exercising based on the first location information;
When it is confirmed that the user is in a position where the exercise can be started, an operation of transmitting the first location information and the first sensing value to a server (108 of FIG. 1; 408 of FIG. 4b) through a communication module (190 of FIG. 1; 490 of FIG. 4b) included in the first electronic device;
An operation of obtaining information about at least one mission specified for the movement from the server based on the transmission of the first location information and the first sensing value; wherein the at least one mission is determined based on the first sensing value and the first location information;
After the above movement starts, an operation of determining whether the first mission among the at least one mission has been performed based on at least one of a second sensing value related to the movement of the user acquired through the second sensor (176 of FIG. 1; 440 of FIG. 4b) included in the first electronic device or a third sensing value related to the user's bio-signal acquired through the first sensor; and
A recording medium storing at least one instruction capable of executing an operation of transmitting a first command to a second electronic device through the communication module so that the second electronic device performs a second mission among the at least one mission when the first electronic device is confirmed to be located at a designated location through the GPS module.

Images