KR20230023504A - Electronic device including flexible display and method of operating the same - Google Patents

Abstract

According to various embodiments, an electronic device comprises: a display and a processor. The processor controls the display to display an executing screen of a camera application through a first area of the display in response to execution of the camera application; and to display an image list connected to the camera application through a second area of the display which is different from the first area, wherein the image list includes a plurality of images which are composed of stopping images and videos; controls the display to obtain a first image photographed by using the camera application in response to an image photographing request and to display a first temporary image corresponding to the first image in the image list through the second area when post-processing for the first image is necessary; and controls the display to display a first post-processing image in which the post-processing for the first image is completed by replacing the first temporary image in the image list through the second area. Other embodiments can be possible.

Description

Electronic device including a flexible display and method for operating the same

Various embodiments relate to an electronic device including a flexible display and an operating method thereof.

As the demand for mobile communication increases, on the other hand, as the degree of integration of electronic devices increases, the portability of electronic devices such as mobile communication terminals increases, and convenience in using multimedia functions and the like can be improved. For example, displays with integrated touch screen functionality can replace traditional mechanical (button) keypads, allowing electronic devices to be miniaturized while retaining the functionality of input devices. For example, portability of the electronic device may be improved by removing the mechanical keypad from the electronic device. In another embodiment, an electronic device including a touch screen function may be larger than an electronic device including a mechanical keypad, even if it has the same size and weight as an electronic device including a mechanical keypad, if it extends the display by the area where the mechanical keypad is removed. A larger screen can be provided.

In web surfing or using multimedia functions, it may be more convenient to use an electronic device that outputs a larger screen. A larger display may be mounted on an electronic device to output a larger screen, but considering the portability of the electronic device, there may be restrictions on expanding the size of the display. In one embodiment, the flexible display can secure the portability of the electronic device while providing a larger screen. For example, a flexible display (or an electronic device equipped with the same) can implement a stable operation even if it is made very thin, and can be mounted on an electronic device in a foldable or bendable or rollable form. .

After taking an image using the camera application of an electronic device, another application (eg gallery or video viewer application) to perform additional functions (eg sharing, editing, deleting, zoom in/out) for the captured image There is the inconvenience of having to run .

According to various embodiments, an electronic device and an operating method thereof display an execution screen of a camera application through a first area of a display, display a plurality of captured images through a second area of a display, and display a user input according to a user input. An additional function may be performed on the plurality of captured images displayed in the second area.

According to various embodiments, an electronic device includes a display and a processor, and the processor displays an execution screen of the camera application through a first area of the display in response to execution of the camera application, and the Controlling the display to display an image list linked to the camera application through a second area of the display different from the first area, wherein the image list includes a plurality of images, and the plurality of images include still images and moving images. configurable-, in response to an image capture request, a first image captured using the camera application is obtained, and when it is determined that post-processing of the first image is necessary, the image is captured through the second region. The display is controlled to display a first temporary image corresponding to the first image in the list, and post-processing of the first image is performed by substituting the first temporary image in the image list through the second area. It may be set to control the display to display the completed first post-processing image.

According to various embodiments, a method of operating an electronic device may include displaying an execution screen of the camera application through a first area of a display of the electronic device in response to execution of a camera application, and displaying a screen different from the first area. Controlling the display to display an image list linked to the camera application through a second area of the display, wherein the image list includes a plurality of images, and the plurality of images can be composed of still images and moving images. Obtaining a first image captured using the camera application in response to a request for capturing an image, and when it is determined that post-processing of the first image is necessary, the first image is included in the image list through the second area. Controlling the display to display a first temporary image corresponding to the first image, and replacing the first temporary image in the image list through the second area to complete post-processing of the first image. 1 may include an operation of controlling the display to display a post-processed image.

According to various embodiments, by simultaneously performing an operation of displaying an execution screen of a camera application through a first area of the display and an operation of displaying a plurality of captured images in a shooting order through a second area of the display, the user's An electronic device and an operating method thereof for improving the convenience of image capturing and image editing may be provided.

1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure.
2 is a flowchart illustrating a method for an electronic device to display an execution screen of a camera application and an image list together through a display and perform an additional function for an image in the image list, according to various embodiments.
FIG. 3 illustrates an operation of displaying an execution screen of a camera application and an image list based on a specific direction by an electronic device, according to various embodiments.
4 illustrates an operation of displaying a first temporary image and a first post-processed image by an electronic device according to various embodiments.
5 is a flowchart illustrating a method of synchronizing an image list with an image database after an electronic device changes an image of an image database using an image editing application, according to various embodiments.
FIG. 6 is a flowchart illustrating a method in which an image list refers to an image from an image database and displays the referenced image in a second area of a display, according to various embodiments.
FIG. 7 is a diagram illustrating an embodiment in which an electronic device sets a sound path of a photographing button sound of a camera application as a system sound path while playing a video of an image list, according to various embodiments.
FIG. 8 is a diagram illustrating an embodiment in which an electronic device sets a sound path of a photographing button sound of a camera application as a media sound path while playing a video of a video application, according to various embodiments.

1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure.

Referring to FIG. 1 , in a network environment 100, an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It is possible to communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or the antenna module 197 may be included. In some embodiments, in the electronic device 101, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added. In some embodiments, some of these components (eg, sensor module 176, camera module 180, or antenna module 197) are integrated into a single component (eg, display module 160). It can be.

The processor 120, for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 . According to an embodiment, the processor 120 may include a main processor 121 (eg, a central processing unit or an application processor), or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) that may operate independently of or together with the main processor 121 . (NPU: neural processing unit), image signal processor, sensor hub processor, or communication processor). For example, when the electronic device 101 includes the main processor 121 and the auxiliary processor 123, the auxiliary processor 123 uses less power than the main processor 121 or is set to be specialized for a designated function. It can be. The secondary processor 123 may be implemented separately from or as part of the main processor 121 .

The secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, running an application). ) state, together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to one embodiment, the auxiliary processor 123 (eg, image signal processor or communication processor) may be implemented as part of other functionally related components (eg, camera module 180 or communication module 190). there is. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing device) may include a hardware structure specialized for processing an artificial intelligence model. AI models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself where artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited. The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples. The artificial intelligence model may include, in addition or alternatively, software structures in addition to hardware structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, program 140) and commands related thereto. The memory 130 may include volatile memory 132 or non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input module 150 may receive a command or data to be used by a component (eg, the processor 120) of the electronic device 101 from the outside of the electronic device 101 (eg, a user). The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. A receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 may visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to an embodiment, the display module 160 may include a touch sensor configured to detect a touch or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 may convert sound into an electrical signal or vice versa. According to an embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to one embodiment, the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 may be a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, a : a local area network (LAN) communication module or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, a legacy communication module). It may communicate with an external electronic device through a cellular network, a 5G network, a next-generation communication network, the Internet, or a telecommunications network such as a computer network (eg, LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199. The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology). NR access technologies include high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low latency (URLLC)). -latency communications)) can be supported. The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported. The wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199). According to one embodiment, the wireless communication module 192 is a peak data rate for eMBB realization (eg, 20 Gbps or more), a loss coverage for mMTC realization (eg, 164 dB or less), or a U-plane latency for URLLC realization (eg, Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) may be supported.

The antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module 197 in addition to the radiator.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first surface (eg, a lower surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to a second surface (eg, a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or part of operations executed in the electronic device 101 may be executed in one or more external devices among the external electronic devices 102 , 104 , and 108 . For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself. Alternatively or additionally, one or more external electronic devices may be requested to perform the function or at least part of the service. One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 . The electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed. To this end, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an internet of things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199 . The electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

FIG. 2 illustrates an electronic device (eg, the electronic device 101 of FIG. 1 ) displaying an execution screen of a camera application and an image list together through a display (eg, the display module 160 of FIG. 1 ) according to various embodiments. It is a flowchart for explaining a method of displaying and performing an additional function for an image in an image list.

FIG. 3 illustrates an operation of the electronic device 101 displaying an execution screen of a camera application and an image list based on a specific direction, according to various embodiments.

4 illustrates an operation of displaying a first temporary image and a first post-processed image by the electronic device 101 according to various embodiments.

In operation 201, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) executes the camera application through the first area of the display 160 in response to the execution of the camera application. A screen may be displayed and an image list may be displayed through the second area of the display 160 . For example, referring to <301> of FIG. 3 , when the electronic device 101 faces in a first direction (eg, a portrait direction), the electronic device 101 responds to the execution of the camera application and displays the display 160 The execution screen 311 of the camera application is displayed through the first area 310 of ), and at least one image included in the image list 321 is displayed through the second area 320 different from the first area 310. can be displayed. For another example, referring to <302> of FIG. 3 , when the electronic device 101 faces a second direction (eg, a landscape direction), the electronic device 101 responds to the execution of the camera application, and displays the display. The execution screen 311 of the camera application may be displayed through the first area 310 of (160), and at least one image included in the image list 321 may be displayed through the second area 320. According to an embodiment, the electronic device 101 may display a preview image acquired in real time using a camera (eg, the camera module 180 of FIG. 1 ) on the execution screen 311 of the camera application. According to an embodiment, the image list 321 may include a plurality of images, and the plurality of images may be composed of still images and moving images. According to an embodiment, at least one image included in the image list 321 may be arranged according to a time taken by a camera application and/or a time sequence added/deleted/edited by an image editing application. According to an embodiment, at least one image included in the image list 321 may be an image that the image list 321 refers to (eg, loads) a predetermined number (eg, 100) from an image database.

In operation 203, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) may obtain a first image captured using a camera application in response to the image capturing request. . For example, referring to <301> of FIG. 3 , the electronic device 101 takes a picture using the camera 180 in response to a user input for selecting a capture button displayed on the execution screen 311 of the camera application. In this case, the first image may correspond to raw data.

In operation 205, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1) may determine whether post-processing of the first image is required. According to an embodiment, the electronic device 101 may determine whether post-processing of the first image is necessary based on the capturing mode of the first image. For example, when the electronic device 101 captures a first image, the capturing mode of the first image corresponds to a previously designated capturing mode (eg, a night capturing mode, a portrait capturing mode, or a wide-angle capturing mode) based on , it may be determined that post-processing of the first image is necessary.

In operation 207, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ), if post-processing of the first image is required, displays the image list ( 321), a first temporary image corresponding to the first image may be displayed. According to an embodiment, when the electronic device 101 determines that post-processing is necessary for the first image, the second region 320 adds a first temporary image corresponding to the first image to the image list 321. ), the first temporary image may be displayed. For example, referring to <301> of FIG. 3 and <401> of FIG. 4 , when the electronic device 101 captures a first image (eg, A) in the night photographing mode, the first image is post-processed. A first temporary image (eg, A1 ) before image may be added to the image list 321 , and the first temporary image may be displayed through the second area 320 . According to an embodiment, the electronic device 101 may parse the first temporary image from a memory (eg, the memory 130 of FIG. 1 ), and convert the first temporary image to temporary identification information (eg, media ID), it can be added to the image list 321. According to an embodiment, the first temporary image may be the same image as the first image or an image temporarily stored in the memory 130 before post-processing the first image.

In operation 209, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) replaces the first temporary image in the image list 321 through the second area 320 to create the first temporary image. A first post-processed image obtained by completing post-processing of one image may be displayed. For example, referring to <401> and <402> of FIG. 4 , when the electronic device 101 completes post-processing of the first image (eg, A), the image is displayed through the second region 320. A first post-processed image (eg, A2) obtained by post-processing from the first image may be displayed by replacing the first temporary image (eg, A1) in the list 321 . According to an embodiment, after obtaining the first post-processed image, the electronic device 101 may generate image identification information (eg, media provider uri) for the first post-processed image, and After associating the image identification information with , the image list 320 may be updated so that the first post-processed image and image identification information replace the first temporary image and temporary identification information.

In operation 211, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1) transmits the image through the second area 320 when post-processing of the first image is not required. The first image may be displayed in the list 321 . According to an embodiment, after acquiring the first image, the electronic device 101 may generate image identification information (eg, media provider uri) for the first image, and may include the image identification information in the first image. After association, the first image may be added to the image list 321 .

In operation 213, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) displays the execution screen 311 of the camera application through the first region 310 while the second When a user input for the video list 321 in the area 320 is received, an additional function corresponding to the user input may be performed.

According to an embodiment, the electronic device 101 may perform a sharing function for a specific image in response to a first user input for a specific image in the image list 321 . For example, referring to <402> of FIG. 4, the electronic device 101 responds to a user input for selecting a share icon 411 included in a specific image (eg, B) in the image list 321, A sharing function for the specific image may be performed.

According to an embodiment, the electronic device 101 may perform a delete function for a specific video in response to a second user input for a specific video in the video list 321 . For example, referring to <402> of FIG. 4, the electronic device 101 responds to a user input for selecting a delete icon 412 included in a specific image (eg, B) in the image list 321, The specific video may be deleted from the video list 321 , and the specific video may be deleted from the video database in the process of synchronizing the media database with the video list 321 .

According to an embodiment, the electronic device 101 performs a zoom-in or zoom-out operation on a specific image in response to a third user input on a specific image in the image list 321. function can be performed. For example, referring to <402> of FIG. 4, the electronic device 101 performs pinch-in or pinch-out of a specific image (eg, B) in the image list 321. In response to the input, a zoom-in or zoom-out function may be performed on the specific image.

According to an embodiment, the electronic device 101 may display an execution screen of a gallery application including the specific image in response to a fourth user input for a specific image in the image list 321 . For example, referring to <402> of FIG. 4, the electronic device 101 responds to a user input (eg, tap) for selecting a specific video (eg, B) in the video list 321, A gallery application may be launched, an execution screen of the gallery application including the specific image may be displayed through at least one of the first region 310 and the second region 320, and the specific image may be displayed. It can be displayed as the main image of the execution screen of the gallery application.

According to an embodiment, the electronic device 101 may perform a scroll function on the video list 321 in response to a fifth user input on the video list 321 . For example, the electronic device 101 may scroll up or down the image list according to the dragging direction of the user within the image list 321 .

FIG. 5 illustrates an image list (eg, the image list of FIG. 3 ) after an electronic device (eg, the electronic device 101 of FIG. 1 ) changes an image of an image database using an image editing application, according to various embodiments. (321)) is a flowchart for explaining a method of synchronizing with an image database.

In operation 501, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) may detect an event causing the camera application to operate in the background. For example, while the camera application is being executed, the electronic device 101 may switch the camera application to the background and display the home screen in response to a user input requesting display of the home screen. For another example, while the camera application is running, the electronic device 101 switches the camera application to the background in response to a user input requesting execution of a video editing application (eg, a gallery application) different from the camera application. , you can run a video editing application. According to an embodiment, the electronic device 101 may store information about a first point in time when the camera application starts operating in the background.

In operation 503, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1) may change an image stored in a media database using an image editing application. According to an embodiment, the image database may store images having a predetermined format among images processed in the electronic device 101 and may be linked with each application for processing images. According to an embodiment, the electronic device 101 may add a new image to an image database using an image editing application. According to an embodiment, the electronic device 101 may modify or delete an image existing in an image database using an image editing application.

In operation 505, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1) may detect an event causing the camera application to operate in the foreground. For example, the electronic device 101 switches the camera application operating in the background state to the foreground state in response to a user input requesting execution of the camera application while the video editing application is running, and the first area ( Example: An execution screen (eg, execution screen 310 of FIG. 1 ) of the camera application is displayed through the first area 310 of FIG. 3 , and the second area (eg, second area 320 of FIG. 3 ) The image list 321 can be displayed through.

In operation 507, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) starts operating the camera application in the foreground from the first time point when the camera application starts operating in the background. Until the second point in time, at least one image changed by the image editing application may be identified from the image database. According to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) may identify additional images added to the image database by the image editing application from the first point of view to the second point of view. .

In operation 509, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1) may update the image list 321 based on at least one image.

According to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) selects the image list 321 and the image list 321 from among at least one image changed by an image editing application between the first and second views. One or more related images may be identified, and the image list 321 may be updated based on the one or more images. According to an embodiment, (1) the image list 321 refers to (eg, loads) a first specific image in the image database at the first time point, and (2) an image editing application is applied between the first and second time points. When a first specific video in the video database is edited into a first edited video using , the electronic device 101 may identify the first specific video referred to by the video list 321 from among at least one video, and The image list 321 may be updated to refer to the first edited video by replacing the specific video. According to an embodiment, (1) the image list 321 refers to a second specific image in the image database at the first point of view, and (2) uses an image editing application between the first point and the second point in time to view the image database. When deleting the second specific image in the image list, the electronic device 101 may identify the second specific image referred to by the image list 321 from among at least one image, and delete the second specific image from the image list 321. The image list 321 can be updated to do so.

According to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) renews the additional video added by the video editing application between the first view and the second view in the image list 321. The image list 321 can be updated for reference.

For example, [Table 1] below shows number codes for updating the video list 321 based on at least one video changed by the video editing application between the first and second views or an added video. indicate

void onTopResumedActivityChanged(boolean isTopResumedActivity) {
If (isTopResumedActivity)
MediaItemLoader.validateRespository(lastAppFocusedDateTime)
else
lastAppFocusedDateTime = System.currentTimeMillis
}

void validateRepository in MediaItemLoader {
List<CaptureViewItem> currentRepositoryList = ItemRepository.getList()
try Cursor cursor // about list items, dateTime >= lastAppFocusedDateTime in Camera Path
while {
item = loadItemFromCursor(cursor)
if item is null // removed item from background app context
ItemRepository. remove(item)
else
If currentRepositoryList.contains(item) // updated item from background app context
If item is updated
ItemRepository.update(item) // internally update item if contains
else // added item from background app context
ItemRepository.add(item) // add item into repository

FIG. 6 is an image list (eg, the image list 321 of FIG. 3 ) refers to an image from an image database and displays the referenced image (eg, the display module 160 of FIG. 1 ) according to various embodiments. It is a flowchart for explaining a method of displaying in the second area (for example, the second area 320 of FIG. 3 ).

In operation 601, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1) may detect a drag input to the image list 321. For example, referring to <401> of FIG. 4, the electronic device 101 performs a drag function to search for images (eg, A1, B, C, ??) of the image list 321. input can be detected.

In operation 603, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) is displaying on the second area 320 of the display 160 while detecting a drag input. It may be determined whether the display area of the first specific image of the image list 321 is reduced to a predetermined size (eg, 10%) or less.

In operation 605, according to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) displays the second area 320 when the display area of the first specific image decreases to a predetermined size or less. ), the second specific image of the image list 321 to be displayed is identified from the image database, the image list 321 is set to refer to the second specific image from the image database, and the second specific image is set in the second area 320. A specific image can be displayed.

According to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) identifies one or more images of the image list 321 to be displayed on the second area 320 from an image database, An image list 321 may be set to refer to one or more images from an image database, and one or more images may be displayed in the second area 320 . In this case, the electronic device 101 selects images not displayed on the second area 320, excluding one or more images displayed on the second area 320, among the images included in the image list 321. It may not be referenced from the database.

FIG. 7 illustrates a capture button of a camera application while an electronic device (eg, the electronic device 101 of FIG. 1 ) plays a video of an image list (eg, the image list 321 of FIG. 3 ) according to various embodiments. It is a diagram showing an embodiment in which a sound path of sound is set as a system sound path.

According to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) may include a first area (eg, the first area of FIG. 3 ) of a display (eg, the display module 160 of FIG. 1 ). 310) to display the execution screen of the camera application (eg, the execution screen 311 of FIG. 3), and through the second area of the display 160 (eg, the second area 320 of FIG. 3). An image list 321 may be displayed.

According to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) converts a sound path of a video included in the image list 321 to a sound path of a shutter sound of a camera application. can be set the same as According to an embodiment, the electronic device 101 may set the sound path of the video included in the image list 321 as the same system sound path as the sound path of the photographing button of the camera application. For example, referring to FIG. 7 , when a video in the video list 321 is set to be played in silence, the electronic device 101 mutes the video in the video list 321 using the system sound path. , and while the video in the video list 321 is being played, the sound of the shooting button by the camera application can be output using the system sound path.

FIG. 8 illustrates an example of setting a sound path of a recording button sound of a camera application as a media sound path while an electronic device (eg, the electronic device 101 of FIG. 1 ) plays a video of a video application, according to various embodiments. It is a drawing showing an example.

According to various embodiments, the electronic device 101 (eg, the processor 120 of FIG. 1 ) may include a first area (eg, the first area of FIG. 3 ) of a display (eg, the display module 160 of FIG. 1 ). 310) to display the execution screen of the camera application (eg, the execution screen 311 of FIG. 3), and through the second area of the display 160 (eg, the second area 320 of FIG. 3). An execution screen of a video playback application may be displayed.

According to various embodiments, while the electronic device 101 (eg, the processor 120 of FIG. 1 ) plays a video using the video application displayed in the first area 310, the sound of the shooting button of the camera application is heard. A sound path may be set identically to a sound path of a video played using a video application. According to an embodiment, while the electronic device 101 plays a video using the video application, the sound path of the camera application's shooting button sound is the same media sound path as the sound path of the video played using the video application ( media sound path). For example, referring to FIG. 8 , the electronic device 101 may output the sound of a video played in a video application using a media sound path, and while playing the video, the electronic device 101 may use the media sound path to output a sound of a camera application. The sound of the shooting button can be output. According to an embodiment, the media sound path is different from the system sound path for outputting the system sound (eg, a sound preset by the manufacturer of the electronic device 101) described in FIG. sound output by media reproduction) may mean a sound path for outputting.

Electronic devices according to various embodiments disclosed in this document may be devices of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. An electronic device according to an embodiment of the present document is not limited to the aforementioned devices.

Various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, like reference numbers may be used for like or related elements. The singular form of a noun corresponding to an item may include one item or a plurality of items, unless the relevant context clearly dictates otherwise. In this document, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A Each of the phrases such as "at least one of , B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof. Terms such as "first", "second", or "first" or "secondary" may simply be used to distinguish a given component from other corresponding components, and may be used to refer to a given component in another aspect (eg, importance or order) is not limited. A (e.g., first) component is said to be "coupled" or "connected" to another (e.g., second) component, with or without the terms "functionally" or "communicatively." When mentioned, it means that the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits. can be used as A module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of this document provide one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). It may be implemented as software (eg, the program 140) including them. For example, a processor (eg, the processor 120 ) of a device (eg, the electronic device 101 ) may call at least one command among one or more instructions stored from a storage medium and execute it. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.

According to one embodiment, the method according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) online, directly between smart phones. In the case of online distribution, at least part of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium such as a manufacturer's server, an application store server, or a relay server's memory.

According to various embodiments, each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is. According to various embodiments, one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. . According to various embodiments, the actions performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the actions are executed in a different order, or omitted. or one or more other actions may be added.

According to various embodiments, an electronic device (eg, the electronic device 101 of FIG. 1 ) includes a display (eg, the display module 160 of FIG. 1 ) and a processor (eg, the processor 120 of FIG. 1 ). and the processor, in response to the execution of the camera application, the execution screen (eg, execution screen of FIG. 3 ) of the camera application through the first area (eg, first area 310 of FIG. 3 ) of the display. 311) is displayed, and an image list (eg, the image of FIG. 3 ) interlocked with the camera application through a second area (eg, second area 320 of FIG. 3 ) of the display that is different from the first area. Controlling the display to display a list 321) -The image list includes a plurality of images, and the plurality of images can be composed of still images and moving images-, and in response to a video capture request, the camera application Obtaining a first image captured using the image, and displaying a first temporary image corresponding to the first image in the image list through the second area when it is determined that post-processing of the first image is required. Controlling the display, and controlling the display to display a first post-processed image obtained by completing post-processing of the first image by replacing the first temporary image in the image list through the second area. It can be.

According to various embodiments, the processor may be configured to determine that post-processing of the first image is necessary, based on whether the capturing mode of the first image corresponds to a previously designated capturing mode.

According to various embodiments, the processor launches a gallery application in response to a user input for selecting a specific image in the image list, and through at least one of the first area and the second area. It may be set to display an execution screen of the gallery application including the specific image.

According to various embodiments, the processor may, from a first time point when the camera application starts operating in the background to a second time point when the camera application starts operating in the foreground, to a video editing application different from the camera application. It may be set to identify at least one image changed by the image database from an image database, and to update the image list based on the at least one image.

According to various embodiments, the processor may: (1) the image list at the first point of view refer to a first specific image in the image database; (2) between the first point of view and the second point of view; When the first specific video in the video database is edited into a first edited video using a video editing application, the video list may be updated to refer to the first edited video by replacing the first specific video. there is.

According to various embodiments, the processor may: (1) the image list at the first point of view refer to a second specific image in the image database; (2) between the first point of view and the second point of view, the image list When the second specific video in the video database is deleted using the video editing application, the video list may be updated to delete the second specific video from the video list.

According to various embodiments, the processor may be configured to update the image list so that the image list newly refers to an additional video added by the video editing application between the first and second viewpoints. .

According to various embodiments, while sensing a drag input with respect to the image list, the processor determines whether a display area of a first specific image in the image list is reduced to a predetermined size or less, and When the display area of the image decreases to the predetermined size or less, a second specific image of the image list to be displayed on the second area is identified from the image database, and the second specific image is referred to from the image database. It can be set to set the image list to do.

According to various embodiments, the processor may be configured to set a sound path of a moving image included in the image list to the same system sound path as a sound path of a photographing button of the camera application.

According to various embodiments, the processor, while playing a video using the video application displayed in the first area, converts a sound path of a photographing button sound of the camera application to the video played using the video application. It can be set to set the same media sound path as the sound path.

According to various embodiments, a method of operating an electronic device may include displaying an execution screen of the camera application through a first area of a display of the electronic device in response to execution of a camera application, and displaying a screen different from the first area. Controlling the display to display an image list linked to the camera application through a second area of the display, wherein the image list includes a plurality of images, and the plurality of images can be composed of still images and moving images. Obtaining a first image captured using the camera application in response to a request for capturing an image, and when it is determined that post-processing of the first image is necessary, the first image is included in the image list through the second area. Controlling the display to display a first temporary image corresponding to the first image, and replacing the first temporary image in the image list through the second area to complete post-processing of the first image. 1 may include an operation of controlling the display to display a post-processed image.

According to various embodiments, the method may further include an operation of determining that post-processing of the first image is required, based on a photographing mode of the first image corresponding to a previously designated photographing mode. .

According to various embodiments, the method may include an operation of launching a gallery application in response to a user input for selecting a specific video in the video list, and at least one of the first area or the second area. An operation of displaying an execution screen of the gallery application including the specific image may be further included.

According to various embodiments, the method may include a video editing application different from the camera application from a first time point when the camera application starts operating in the background to a second time point when the camera application starts operating in the foreground. The method may further include identifying at least one image changed by the above from an image database, and updating the image list based on the at least one image.

According to various embodiments, the updating of the image list may include: (1) the image list at the first point in time refers to a first specific image in the image database; and (2) the first point to the first point in time. When the first specific video in the video database is edited into a first edited video using the video editing application between two viewpoints, the video list is created to refer to the first edited video by replacing the first specific video. An update operation may be included.

According to various embodiments, the updating of the image list may include: (1) the image list at the first point in time refers to a second specific image in the image database; and (2) the first point to the first point in time. When the second specific video in the video database is deleted using the video editing application between two viewpoints, an operation of updating the video list to delete the second specific video from the video list may be included.

According to various embodiments, the updating of the video list may include updating the video list so that the video list newly refers to an additional video added by the video editing application between the first and second viewpoints. action may be included.

According to various embodiments, the method may include an operation of determining whether a display area of a first specific video of the video list is reduced to a predetermined size or less while sensing a drag input with respect to the video list; When the display area of the specific image decreases below the predetermined size, a second specific image of the image list to be displayed on the second region is identified from the image database, and the second specific image is selected from the image database. An operation of setting the image list for reference may be further included.

According to various embodiments, the method may further include setting a sound path of a video included in the video list as a system sound path identical to a sound path of a recording button of the camera application. can

According to various embodiments, the method, while playing a video using the video application displayed in the first area, converts a sound path of a photographing button sound of the camera application to the video played using the video application. An operation of setting the same media sound path as the sound path may be further included.

Claims (20)

In electronic devices,
display, and
contains a processor;
the processor,
In response to the execution of the camera application, an execution screen of the camera application is displayed through a first area of the display, and an image list linked to the camera application is displayed through a second area of the display different from the first area. Control the display to do -The image list includes a plurality of images, and the plurality of images can be composed of still images and moving images-,
Obtaining a first image captured using the camera application in response to a video capture request;
If it is determined that post-processing of the first image is required, controlling the display to display a first temporary image corresponding to the first image in the image list through the second area; and
The electronic device is configured to control the display to display a first post-processed image obtained by completing post-processing of the first image by replacing the first temporary image in the image list through the second area.
According to claim 1,
the processor,
The electronic device is configured to determine that post-processing of the first image is required based on the photographing mode of the first image corresponding to the previously designated photographing mode.
According to claim 1,
the processor,
Launching a gallery application in response to a user input for selecting a specific video in the video list, and
The electronic device configured to display an execution screen of the gallery application including the specific image through at least one of the first area and the second area.
According to claim 1,
the processor,
Identification of at least one image changed by a video editing application different from the camera application from a first time point when the camera application starts operating in the background to a second time point when the camera application starts operating in the foreground from the image database doing, and
The electronic device configured to update the image list based on the at least one image.
According to claim 4,
the processor,
(1) the image list at the first point of view refers to a first specific image in the image database; (2) between the first point and the second point of view, the image editing application is used to The electronic device configured to update the video list to refer to the first edited video by replacing the first specific video when editing the first specific video with the first edited video.
According to claim 4,
the processor,
(1) the image list at the first point of view refers to a second specific image in the image database, (2) between the first point and the second point of view, the image editing application is used to The electronic device configured to update the video list to delete the second specific video from the video list when the second specific video is deleted.
According to claim 4,
the processor,
The electronic device is set to update the video list so that the video list newly refers to an additional video added by the video editing application between the first and second viewpoints.
According to claim 1,
the processor,
While detecting a drag input to the video list, determining whether a display area of a first specific video in the video list is reduced to a predetermined size or less, and
When the display area of the first specific image decreases below the predetermined size, a second specific image of the image list to be displayed on the second region is identified from the image database, and the second specific image is identified from the image database. The electronic device configured to set the image list to refer to a specific image.
According to claim 1,
the processor,
The electronic device configured to set a sound path of a moving image included in the image list to a system sound path identical to a sound path of a recording button sound of the camera application.
According to claim 1,
the processor,
While a video is played using the video application displayed in the first area, the sound path of the camera application's shooting button is the same media sound path as the sound path of the video played using the video application. ), the electronic device set to set.
In the operating method of the electronic device,
In response to the execution of the camera application, an execution screen of the camera application is displayed through a first area of the display of the electronic device, and an image interlocked with the camera application is displayed through a second area of the display different from the first area. Controlling the display to display a list -The image list includes a plurality of images, and the plurality of images can be composed of still images and moving images-;
Obtaining a first image captured using the camera application in response to a request for capturing an image;
If it is determined that post-processing of the first image is necessary, controlling the display to display a first temporary image corresponding to the first image in the image list through the second area; and
and controlling the display to display a first post-processed image obtained by completing post-processing of the first image by replacing the first temporary image in the image list through the second area. how it works.
According to claim 11,
The method of operating the electronic device further comprising an operation of determining that post-processing of the first image is required based on that the capturing mode of the first image corresponds to a previously designated capturing mode.
According to claim 11,
Launching a gallery application in response to a user input for selecting a specific video in the video list; and
The method of operating the electronic device further comprising an operation of displaying an execution screen of the gallery application including the specific image through at least one of the first area and the second area.
According to claim 11,
Identification of at least one image changed by a video editing application different from the camera application from a first time point when the camera application starts operating in the background to a second time point when the camera application starts operating in the foreground from the image database action, and
The method of operating an electronic device further comprising updating the image list based on the at least one image.
According to claim 14,
The operation of updating the image list,
(1) the image list at the first point of view refers to a first specific image in the image database; (2) between the first point and the second point of view, the image editing application is used to and updating the video list so that the first specific video is edited to refer to the first edited video by replacing the first specific video when the first specific video is edited.
According to claim 14,
The operation of updating the image list,
(1) the image list at the first point of view refers to a second specific image in the image database, (2) between the first point and the second point of view, the image editing application is used to and updating the image list to delete the second specific image from the image list when the second specific image is deleted.
According to claim 14,
The operation of updating the image list,
and updating the video list so that the video list newly refers to an additional video added by the video editing application between the first view and the second view.
According to claim 11,
An operation of determining whether a display area of a first specific image of the image list is reduced to a predetermined size or less while sensing a drag input to the image list; and
When the display area of the first specific image decreases below the predetermined size, a second specific image of the image list to be displayed on the second region is identified from the image database, and the second specific image is identified from the image database. The method of operating the electronic device further comprising setting the image list to refer to a specific image.
According to claim 11,
The method of operating the electronic device further comprising an operation of setting a sound path of the video included in the image list to a system sound path identical to a sound path of a photographing button of the camera application.
According to claim 11,
While a video is played using the video application displayed in the first area, the sound path of the camera application's shooting button is the same media sound path as the sound path of the video played using the video application. ), further comprising an operation of setting the electronic device operating method.

Images