[go: up one dir, main page]

WO2019090772A1 - Image processing method and apparatus for terminal - Google Patents

Image processing method and apparatus for terminal Download PDF

Info

Publication number
WO2019090772A1
WO2019090772A1 PCT/CN2017/110720 CN2017110720W WO2019090772A1 WO 2019090772 A1 WO2019090772 A1 WO 2019090772A1 CN 2017110720 W CN2017110720 W CN 2017110720W WO 2019090772 A1 WO2019090772 A1 WO 2019090772A1
Authority
WO
WIPO (PCT)
Prior art keywords
display screen
terminal
display device
target
screen
Prior art date
Application number
PCT/CN2017/110720
Other languages
French (fr)
Chinese (zh)
Inventor
朱登奎
张晓伟
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2017/110720 priority Critical patent/WO2019090772A1/en
Priority to CN201780082065.7A priority patent/CN110178111B/en
Publication of WO2019090772A1 publication Critical patent/WO2019090772A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering

Definitions

  • the embodiments of the present invention relate to the field of communications technologies, and in particular, to an image processing method and apparatus for a terminal.
  • PC Personal computer
  • the mobile terminal and the like can project the display content on the screen of the mobile phone to a large-screen display such as a PC through a wireless video display (Wi-Fi-Display) function or a Microsoft continuum function, so that the mobile phone is connected. It can also be used as a PC after a large screen display.
  • Wi-Fi-Display wireless video display
  • Microsoft continuum Microsoft continuum
  • TV As a large-screen display, when the TV receives the source picture data to be played, as shown in Figure 1, the TV intercepts 95% of the source picture data from the source picture data, and then intercepts the source. The screen data is displayed in full screen on the TV.
  • the large screen display receives the source picture data sent by the mobile terminal such as the mobile phone
  • the received source picture data is still overscan, and the partial image information sent by the mobile phone is lost.
  • the user does not display the screen when viewing the large screen display.
  • An embodiment of the present invention provides an image processing method and apparatus for a terminal.
  • the mobile terminal is PCized, the phenomenon that the display screen is incomplete due to over-scanning of the large-screen display can be improved, and the display quality of the large-screen display is improved.
  • an embodiment of the present application provides an image processing method of a terminal, where the terminal is connected to an external display device, the method includes: the terminal generates a target display screen to be displayed for the external display device, where the target display area in the target display area For displaying the display content in the target display screen, the target area is a part of the target display screen; the terminal sends the target display screen to an external display device for display.
  • the external display device can scan the target display image according to the display image processing flow, and overscan. The actual display content lost will be reduced, thereby improving the phenomenon that the display screen is incomplete due to over-scanning of the large-screen display, and improving the display quality of the large-screen display.
  • the method before the terminal generates the target display screen to be displayed for the external display device, the method further includes: the terminal determining a display screen size, where the display screen size is a size of a screen sent to the external display device;
  • the display screen has the display screen size. That is, the size of each display screen sent by the terminal to the external display device is the above-mentioned display screen size, but the area having the substantial display content in each display screen is reduced.
  • the terminal generates a target display screen to be displayed for the external display device, and specifically includes: the terminal generates an initial display image for the content to be displayed by the external display device, where the initial display screen has the display screen size; Converting the initial display screen to the target display screen, the target display screen The display content of the target area is obtained by reducing the initial display screen.
  • the terminal generates a target display screen to be displayed for the external display device, and specifically includes: the terminal filling the content displayed by the external display device in the target area to obtain the target display screen.
  • the information of the display screen received by the external display device is complete, and the display caused by overscan can be avoided.
  • the picture is incomplete.
  • the method before the terminal converts the initial display image into the target display screen, the method further includes: the terminal generating, by the external display device, a setting interface for adjusting a display screen size of the external display device, the setting interface Included in the at least one candidate screen size; the terminal sends the setting interface to an external display device for display; the terminal determines a scaling ratio between the initial display screen and the target area in the target display screen according to an input operation of the user on the setting interface .
  • the method before the terminal fills the content to be displayed by the external display device in the target area, the method further includes: the terminal generating, by the external display device, a setting interface for adjusting a display screen size of the external display device, the setting The interface includes at least one candidate screen size; the terminal sends the setting interface to an external display device for display; and the terminal determines the size of the target area in the target display screen according to an input operation of the user on the setting interface.
  • the user can manually select the proportion of the display screen on the screen in the external display device, and select the screen size that suits his own usage habits.
  • the setting interface further includes a screen preview effect of the external display device under the candidate screen size.
  • the terminal generates a setting interface for adjusting the size of the display screen for the external display device, including: in response to the setting operation of the external display device by the user, the terminal generates an external display device for adjusting the display screen size.
  • the setting interface or, when the terminal is successfully connected to the external display device, the terminal generates a setting interface for adjusting the size of the display screen for the external display device.
  • the target area is located at the center of the target display screen, and other areas of the target display screen except the target area are provided with a background color, for example, the background color may be set to black.
  • the target ratio of the target area to the target display screen is less than or equal to the extraction ratio of the display screen when the external display device overscans.
  • the area of the screen that is extracted when the external display device is overscan is greater than or equal to the area of the effective screen in the target display screen generated by the terminal. Therefore, the information of the display screen received by the external display device in the terminal PC-based scene is complete. Avoid the phenomenon that the display is incomplete due to overscan.
  • the terminal determines the display screen size, including: the terminal acquires the resolution supported by the external display device; and the terminal determines the display screen size according to the resolution supported by the external display device.
  • an embodiment of the present application provides an image processing method of a terminal, where the terminal is connected to an external display device, the method includes: the terminal sends the generated initial display image to an external display device for display; and the terminal is used to adjust the external
  • the setting interface of the display screen size of the display device is sent to an external display device for display, the setting interface includes at least one candidate screen size; and the target display screen generated by the terminal in response to the target screen size selected by the user in the candidate screen size Send to an external display device for display, the target display
  • the screen has the same size as the initial display screen, and the display content of the target area in the target display screen is obtained by reducing the initial display screen, and the size of the target area is the target screen size.
  • an embodiment of the present application provides a terminal, including: a generating unit, configured to generate, for an external display device, a target display screen to be displayed, where a target area in the target display screen is used to layout the target display screen The content is displayed, the target area is a part of the target display screen, and the transceiver unit is configured to send the target display screen to an external display device for display.
  • a generating unit configured to generate, for an external display device, a target display screen to be displayed, where a target area in the target display screen is used to layout the target display screen The content is displayed, the target area is a part of the target display screen
  • the transceiver unit is configured to send the target display screen to an external display device for display.
  • the terminal further includes: a determining unit, configured to determine a display screen size, the size of the screen sent to the external display device; the target display screen has the display screen size.
  • the generating unit is specifically configured to generate an initial display image for the content to be displayed by the external display device, where the initial display screen has the display screen size; and the terminal converts the initial display image into the target display In the screen, the display content of the target area in the target display screen is obtained by reducing the initial display screen.
  • the generating unit is specifically configured to fill the target area with the content to be displayed by the external display device to obtain the target display screen.
  • the generating unit is further configured to generate, by the external display device, a setting interface for adjusting a display screen size of the external display device, where the setting interface includes at least one candidate screen size; the transceiver unit, And the determining unit is further configured to: determine, according to an input operation of the user on the setting interface, a scaling ratio between the initial display screen and the target area in the target display screen. .
  • the generating unit is further configured to generate, by the external display device, a setting interface for adjusting a display screen size of the external display device, where the setting interface includes at least one candidate screen size; the transceiver unit, The determining unit is further configured to send the setting interface to the external display device for display; the determining unit is further configured to determine a size of the target area in the target display screen according to an input operation of the user on the setting interface.
  • the generating unit is specifically configured to generate a setting interface for adjusting the size of the display screen for the external display device in response to a setting operation of the external display device by the user; or, when the terminal and the external display device When the connection is successful, a setting interface for adjusting the size of the display screen is generated for the external display device.
  • the transceiver unit is further configured to obtain a resolution supported by the external display device.
  • the determining unit is specifically configured to determine the display screen size according to a resolution supported by the external display device.
  • an embodiment of the present application provides a terminal, where the terminal is connected to an external display device, where the terminal includes a processor, a memory, and a transceiver connected through a bus, where the processor is configured to generate a display to be displayed for the external display device.
  • a target display screen the target area in the target display screen is used to layout the display content in the target display screen, the target area is a part of the target display screen;
  • the transceiver is configured to send the target display screen to External display device for display
  • the processor before generating a target display screen to be displayed for an external display device, the processor is further configured to determine a display screen size, where the display screen size is a size of a screen sent to the external display device;
  • the target display screen has the display screen size.
  • the processor is specifically configured to generate an initial display image for the content to be displayed by the external display device, where the initial display screen has the display screen size; and the terminal converts the initial display image A screen is displayed for the target, and the display content of the target area in the target display screen is obtained by reducing the initial display screen.
  • the processor is specifically configured to fill the content to be displayed by the external display device in the target area to obtain the target display screen.
  • the processor is further configured to generate, by the external display device, a setting interface for adjusting a display screen size of the external display device, where the setting interface includes at least one candidate screen size; the transceiver, The method is further configured to send the setting interface to an external display device for display; receiving an input operation of the user on the setting interface; the processor is further configured to determine a scaling ratio between the initial display screen and the target area in the target display screen .
  • the processor is further configured to generate, by the external display device, a setting interface for adjusting a display screen size of the external display device, where the setting interface includes at least one candidate screen size; the transceiver, The method is further configured to send the setting interface to an external display device for display; receiving an input operation of the user in the setting interface; the processor is further configured to determine the target area in the target display screen according to an input operation of the user on the setting interface size of.
  • the setting interface further includes a screen preview effect of the external display device under the candidate screen size.
  • the processor is specifically configured to: generate a setting interface for adjusting the size of the display screen for the external display device in response to a setting operation of the external display device by the user; or, when the terminal and the external display When the device is successfully connected, a setting interface for adjusting the size of the display screen is generated for the external display device.
  • the target area is located at the center of the target display screen, and other areas of the target display screen except the target area are provided with a background color.
  • the target ratio of the target area to the target display screen is less than or equal to the extraction ratio of the display screen when the external display device overscans.
  • the transceiver is further configured to obtain a resolution supported by the external display device; and the processor is specifically configured to determine the display screen size according to a resolution supported by the external display device.
  • an embodiment of the present application provides a terminal, where the terminal is connected to an external display device, where the terminal includes a processor, a memory, and a transceiver connected by a bus, where the processor is configured to generate an initial display for the external display device.
  • a setting interface for adjusting a display screen size of the external display device generating a target display screen for the external display device, the target display screen having the same size as the initial display screen, and the display content of the target area in the target display screen Obtained by the initial display screen, the size of the target area is the target screen size;
  • the transceiver is configured to send the initial display screen to an external display device for display; and send the setting interface to the external display device Display; send the target display to an external display device for display.
  • an embodiment of the present application provides a computer readable storage medium, where the computer readable storage medium stores an instruction, when the instruction is run on any one of the foregoing terminals, causing the terminal to perform any of the foregoing image processing. method.
  • an embodiment of the present application provides a computer program product including instructions, when the terminal runs on any of the foregoing terminals, causing the terminal to execute any of the above image processing methods.
  • the names of the components in the terminal are not limited to the device itself, and the actual implementation is These parts can now appear under other names. As long as the functions of the various components are similar to the embodiments of the present application, they are within the scope of the claims and their equivalents.
  • FIG. 1 is a schematic diagram of an application scenario of overscan in the prior art
  • FIG. 2 is a schematic diagram 1 of an application scenario of an image processing method according to an embodiment of the present disclosure
  • FIG. 3 is a schematic diagram 2 of an application scenario of an image processing method according to an embodiment of the present disclosure
  • FIG. 4 is a schematic diagram 3 of an application scenario of an image processing method according to an embodiment of the present disclosure.
  • FIG. 5 is a schematic structural diagram of a terminal according to an embodiment of the present application.
  • FIG. 6 is a schematic diagram 4 of an application scenario of an image processing method according to an embodiment of the present disclosure.
  • FIG. 7 is a schematic diagram 5 of an application scenario of an image processing method according to an embodiment of the present disclosure.
  • FIG. 8 is a schematic diagram of interaction of an image processing method according to an embodiment of the present application.
  • FIG. 9 is a schematic diagram 6 of an application scenario of an image processing method according to an embodiment of the present disclosure.
  • FIG. 10 is a schematic diagram 7 of an application scenario of an image processing method according to an embodiment of the present disclosure.
  • FIG. 11 is a schematic diagram 8 of an application scenario of an image processing method according to an embodiment of the present disclosure.
  • FIG. 12 is a schematic diagram 9 of an application scenario of an image processing method according to an embodiment of the present disclosure.
  • FIG. 13 is a schematic diagram of an application scenario of an image processing method according to an embodiment of the present disclosure.
  • FIG. 14 is a schematic diagram of an application scenario of an image processing method according to an embodiment of the present disclosure.
  • FIG. 15 is a schematic diagram of an application scenario of an image processing method according to an embodiment of the present application.
  • FIG. 16 is a schematic diagram of an application scenario of an image processing method according to an embodiment of the present application.
  • 16B is a schematic diagram of an application scenario of an image processing method according to an embodiment of the present disclosure.
  • FIG. 17 is a schematic diagram of an application scenario of an image processing method according to an embodiment of the present application.
  • FIG. 18 is a schematic diagram of an application scenario of an image processing method according to an embodiment of the present application.
  • FIG. 19 is a schematic structural diagram 2 of a terminal according to an embodiment of the present disclosure.
  • FIG. 20 is a schematic structural diagram 3 of a terminal according to an embodiment of the present application.
  • first and second are used for descriptive purposes only, and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, features defining “first” and “second” may include one or more of the features either explicitly or implicitly. In the description of the embodiments of the present application, “multiple” means two or more unless otherwise stated.
  • the image processing method of the terminal provided by the embodiment of the present invention can be applied to the terminal, and can be specifically applied to the process of displaying the display screen of the terminal to the display on the external display device when the terminal is connected to the external display device.
  • the terminal may be connected to the external display device through the switching device, or the terminal may be connected to the external display device by way of wireless connection.
  • the external display device can be connected to an external device (such as a keyboard and/or a mouse), and the external display device can also be connected to the external device.
  • the terminal in the embodiment of the present invention may be a mobile phone, a tablet computer, a wearable device, and an enhanced present.
  • Augmented reality (AR) ⁇ virtual reality (VR) devices laptops, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), etc.
  • the embodiment of the invention does not impose any limitation on this.
  • the external display device in the embodiment of the present invention may be any display device such as a display of a PC, a television, a tablet, or a projector.
  • connection mode between the terminal and the external display device by using the above terminal as the mobile phone and the external display device as the display:
  • the handset 110 can be connected to the display 120 via the transit device 130.
  • the switching device 130 can be connected to a Universal Serial Bus (USB) interface of the mobile phone data line, and the Type-c interface of the terminal data line is plugged into the mobile phone 110.
  • the switching device 130 can also be connected to the display 120 through a patch cord, which can include a high definition multimedia interface (HDMI) cable, a video graphics array (AGI) cable, and a digital video interface. (digital visual interface, DVI) connection line or the like.
  • HDMI high definition multimedia interface
  • AGI video graphics array
  • DVI digital video interface
  • the switching device 130 in the embodiment of the present invention may be a mobile high-definition link (MHL) device, and the MHL device can simultaneously transmit audio or video signals in the mobile terminal (such as a mobile phone) to the external device. Displayed on the display device (ie, display 120 described above).
  • MHL mobile high-definition link
  • the handset 110 can be coupled to the display 120 via a wireless connection 201.
  • the wireless connection 201 may specifically be a Bluetooth connection or a wireless-fidelity (Wi-Fi) connection.
  • the switching device 130 can be connected to the external display device without using a keyboard and/or a mouse.
  • the switching device 130 may further include an interface for connecting a keyboard and a mouse for connecting a keyboard and a mouse.
  • the keyboard and keyboard and mouse can also be connected to the mobile phone 110 wirelessly.
  • the handset can also be connected to the display 120 via a Dock device 122 as shown in FIG.
  • the mobile phone 110 can also be connected to a keyboard and a mouse.
  • the keyboard and mouse can be connected to the Dock device 122 via a cable, or the keyboard and mouse can be connected to the handset 110 or Dock device 122 by way of a wireless connection.
  • the Dock device 122 can be one of the above MHL devices.
  • FIG. 5 it is a schematic structural diagram of the above-mentioned mobile phone 110. It should be understood that the illustrated mobile phone 110 is only one example of the above terminal, and the mobile phone 110 may have more or fewer components than those shown in the figure, two or more components may be combined, or Has a different component configuration.
  • the mobile phone 110 may specifically include: a processor 101, a radio frequency (RF) circuit 102, a memory 103, a touch screen 104, a Bluetooth device 105, one or more sensors 106, and wireless fidelity (WIreless-Fidelity).
  • RF radio frequency
  • Wi-Fi device 107 positioning device 108, audio circuit 109, peripheral interface 110, and power system 111 and the like.
  • These components can communicate over one or more communication buses or signal lines (not shown in Figure 5).
  • the hardware structure illustrated in FIG. 5 does not constitute a limitation to a handset, and that handset 110 may include more or fewer components than those illustrated, or some components may be combined, or different components may be arranged.
  • the processor 101 is a control center of the mobile phone 110, and connects various parts of the mobile phone 110 using various interfaces and lines, and executes the mobile phone 110 by running or executing an application stored in the memory 103 and calling data stored in the memory 103.
  • the processor 101 may include one or more processing units; for example, the processor 101 may be a Kirin 960 chip manufactured by Huawei Technologies Co., Ltd.
  • the processor 101 may further include a fingerprint verification chip for verifying the collected fingerprint.
  • the radio frequency circuit 102 can be used to receive and transmit wireless signals during transmission or reception of information or calls.
  • the radio frequency circuit 102 can process the downlink data of the base station and then process it to the processor 101; in addition, transmit the data related to the uplink to the base station.
  • radio frequency circuits include, but are not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
  • the radio frequency circuit 102 can also communicate with other devices through wireless communication.
  • the wireless communication can use any communication standard or protocol, including but not limited to global mobile communication systems, general packet radio services, code division multiple access, wideband code division multiple access, long term evolution, email, short message service, and the like.
  • the memory 103 is used to store applications and data, and the processor 101 executes various functions of the mobile phone 110 and data processing by running applications and data stored in the memory 103.
  • the memory 103 mainly includes a storage program area and a storage data area, wherein the storage program area can store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.); the storage data area can be stored according to the use of the mobile phone. Data created at 110 o'clock (such as audio data, phone book, etc.).
  • the memory 103 may include a high speed random access memory (RAM), and may also include a nonvolatile memory such as a magnetic disk storage device, a flash memory device, or other volatile solid state storage device.
  • the memory 103 can store various operating systems, for example, developed by Apple. Operating system, developed by Google Inc. Operating system, etc.
  • the above memory 103 may be independent and connected to the processor 101 via the above communication bus; the memory 103 may also be integrated with the processor 101.
  • the touch screen 104 may specifically include a touch panel 104-1 and a display 104-2.
  • the touch panel 104-1 can collect touch events on or near the user of the mobile phone 110 (such as the user using a finger, a stylus, or the like on the touch panel 104-1 or on the touchpad 104.
  • the operation near -1), and the collected touch information is sent to other devices (for example, processor 101).
  • the touch event of the user in the vicinity of the touch panel 104-1 may be referred to as a hovering touch; the hovering touch may mean that the user does not need to directly touch the touchpad in order to select, move or drag a target (eg, an icon, etc.) And only the user is located near the terminal in order to perform the desired function.
  • the touch panel 104-1 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
  • a display (also referred to as display) 104-2 can be used to display information entered by the user or information provided to the user as well as various menus of the handset 110.
  • the display 104-2 can be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.
  • the touchpad 104-1 can be overlaid on the display 104-2, and when the touchpad 104-1 detects a touch event on or near it, it is transmitted to the processor 101 to determine the type of touch event, and then the processor 101 may provide a corresponding visual output on display 104-2 depending on the type of touch event.
  • the touchpad 104-1 and the display 104-2 are implemented as two separate components to implement the input and output functions of the handset 110, in some embodiments, the touchpad 104- 1 and display 104-2 Integration and implementation of the input and output functions of the handset 110.
  • the touch screen 104 is formed by stacking a plurality of layers of materials. In the embodiment of the present application, only the touch panel (layer) and the display screen (layer) are shown, and other layers are not described in the embodiment of the present application. .
  • the touch panel 104-1 may be disposed on the front surface of the mobile phone 110 in the form of a full-board
  • the display screen 104-2 may also be disposed on the front surface of the mobile phone 110 in the form of a full-board, so that the front side of the mobile phone can be borderless. Structure.
  • the mobile phone 110 may also include a Bluetooth device 105 for enabling data exchange between the handset 110 and other short-range terminals (eg, mobile phones, smart watches, etc.).
  • the Bluetooth device in the embodiment of the present application may be an integrated circuit or a Bluetooth chip or the like.
  • the handset 110 may also include at least one sensor 106, such as a fingerprint acquisition device 112, a light sensor, a motion sensor, and other sensors.
  • the fingerprint capture device 112 can be configured on the back of the handset 110 (eg, below the rear camera) or on the front side of the handset 110 (eg, below the touch screen 104).
  • the fingerprint collection device 112 can be configured in the touch screen 104 to implement the fingerprint recognition function, that is, the fingerprint collection device 112 can be integrated with the touch screen 104 to implement the fingerprint recognition function of the mobile phone 110;
  • the light sensor can include an ambient light sensor and a proximity sensor.
  • the ambient light sensor can adjust the brightness of the display of the touch screen 104 according to the brightness of the ambient light, and the proximity sensor can turn off the power of the display when the mobile phone 110 moves to the ear.
  • the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.
  • the mobile phone 110 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here Let me repeat.
  • the Wi-Fi device 107 is configured to provide the mobile phone 110 with network access complying with the Wi-Fi related standard protocol, and the mobile phone 110 can access the Wi-Fi access point through the Wi-Fi device 107, thereby helping the user to send and receive emails. Browsing web pages and accessing streaming media, etc., it provides users with wireless broadband Internet access.
  • the Wi-Fi device 107 can also function as a Wi-Fi wireless access point, and can provide Wi-Fi network access to other terminals.
  • the positioning device 108 is configured to provide a geographic location for the mobile phone 110. It can be understood that the positioning device 108 can be specifically a receiver of a positioning system such as a global positioning system (GPS) or a Beidou satellite navigation system, and a Russian GLONASS. After receiving the geographical location transmitted by the positioning system, the positioning device 108 sends the information to the processor 101 for processing, or sends it to the memory 103 for storage. In still other embodiments, the positioning device 108 may also be an assisted global positioning system (AGPS) receiver, and the AGPS system assists the positioning device 108 in performing ranging and positioning services by acting as an auxiliary server.
  • AGPS assisted global positioning system
  • the secondary location server provides location assistance over a wireless communication network in communication with a location device 108 (i.e., a GPS receiver) of the terminal, such as handset 110.
  • a location device 108 i.e., a GPS receiver
  • the positioning device 108 can also be a Wi-Fi access point based positioning technology. Since each Wi-Fi access point has a globally unique media access control (MAC) address, the terminal can scan and collect the surrounding Wi-Fi access points when Wi-Fi is turned on.
  • MAC media access control
  • the terminal sends the data (such as the MAC address) capable of indicating the Wi-Fi access point to the location server through the wireless communication network, and the location server retrieves the geographic location of each Wi-Fi access point and combines The degree of strength of the Wi-Fi broadcast signal is calculated and the geographic location of the terminal is calculated and sent to the location device 108 of the terminal.
  • the data such as the MAC address
  • the audio circuit 109, the speaker 113, and the microphone 114 can provide an audio interface between the user and the handset 110.
  • the audio circuit 109 can transmit the converted electrical data of the received audio data to the speaker 113 for conversion to the sound signal output by the speaker 113; on the other hand, the microphone 114 converts the collected sound signal into an electrical signal by the audio circuit 109. After receiving, it is converted into audio data, and then the audio data is output to the RF circuit 102 for transmission to, for example, another mobile phone, or the audio data is output to the memory 103 for further processing.
  • the peripheral interface 110 is used to provide various interfaces for external input/output devices (such as a keyboard, a mouse, an external display, an external memory, a subscriber identity module card, etc.). For example, it is connected to the mouse through a universal serial bus (USB) interface, and is connected with a subscriber identification module (SIM) card provided by the telecommunication operator through a metal contact on the card slot of the subscriber identification module. . Peripheral interface 110 can be used to couple the external input/output peripherals described above to processor 101 and memory 103.
  • USB universal serial bus
  • SIM subscriber identification module
  • the mobile phone 110 may further include a power supply device 111 (such as a battery and a power management chip) that supplies power to the various components.
  • the battery may be logically connected to the processor 101 through the power management chip to manage charging, discharging, and power management through the power supply device 111. And other functions.
  • the mobile phone 110 may further include a camera (front camera and/or rear camera), a flash, a micro projection device, a near field communication (NFC) device, etc., and will not be described herein. .
  • a camera front camera and/or rear camera
  • a flash a flash
  • micro projection device a micro projection device
  • NFC near field communication
  • the mobile phone 110 when the mobile phone 110 is connected to the external display device 120, the mobile phone 110 is equivalent to having two displays, one is the display of the mobile phone 110 itself, and the other is the display of the external display device 120 connected thereto.
  • the mobile phone 110 can project an application installed on the mobile phone 110 to the display of the external display device 120 by a method of homologous display or heterogeneous display.
  • the homologous display refers to different monitors, for example, the display of the mobile phone 110 and the display source of the display device of the external display device 120 are the same; and the heterogeneous display refers to the signal of the display screen of the mobile phone 110.
  • the source is independent of the signal source of the display screen in the display of the external display device 120.
  • the mobile phone 110 When the mobile phone 110 homogenously projects its installed application onto the display of the external display device 120, as shown in FIG. 6, before the mobile phone 110 establishes a connection with the external display device 120, the mobile phone 110 will generate the displayed display content to be displayed. Stored in a specified location in the memory (the area in the application where the display content to be displayed on the screen is to be referred to as a screen container). In this way, the display of the mobile phone 110 can display the related picture by reading the display content in the screen container. After the mobile phone 110 establishes a connection with the external display device 120, as shown in FIG. 6, the mobile phone 110 can transmit the display content in the screen container to the external display device 120, so that the external display device 120 displays the same display content as the mobile phone 110. The mobile phone 110 is displayed in synchronization with the external display device 120.
  • the mobile phone 110 When the mobile phone 110 heterogeneously projects its installed application onto the display of the external display device 120, as shown in FIG. 7, before the mobile phone 110 establishes a connection with the external display device 120, the mobile phone 110 will generate the displayed display content to be displayed. 1 is stored in the screen container 1 of the memory, such that the display of the mobile phone 110 is read by the screen container The display content 1 in 1 can display the related screen.
  • the mobile phone 110 can identify relevant specification information of the display of the external display device 120 connected thereto, for example, the resolution of the display of the external display device 120 and the dots per inch (dots per inch, DPI) and so on.
  • the mobile phone 110 can establish a separate screen container for the external display device 120 in its own memory according to the specification information of the display of the external display device 120, that is, the screen container 2 in FIG. 7, wherein the screen container 2 and the screen container 1 can be distinguished by different display IDs.
  • such an application generally stores two display resources in the mobile phone 110, one display resource corresponding to the mobile phone 110, and another display resource corresponding to the mobile phone 110.
  • One display resource corresponds to the external display device 120, and the same display content (eg, an icon of an application) may have different layouts and display effects in different display resources.
  • the mobile phone 110 can read the display resource stored by the external display device 120, the application icon, the icon layout, the status bar, and the like in the display resource.
  • the desktop display content is stored in the screen container 2.
  • the mobile phone 110 transmits the display content in the screen container 2 to the external display device 120
  • the icons and/or interfaces of the respective applications installed on the mobile phone 110 can be independently projected onto the display of the external display device 120.
  • the mobile phone 110 and the external display device 120 can independently run two display screens under the same operating system according to the display contents in the respective screen containers.
  • the display content in the screen container 1 may also be the same as the display content in the screen container 2, for example, the display content in the screen container 1 and the display content in the screen container 2. It is the display interface of the 10th minute of video A. In this way, the display content in the display of the mobile phone 110 can be simultaneously displayed in the display of the external display device 120.
  • the above-mentioned screen container may specifically be a cache queue for storing the display content generated by each task in the task queue when the terminal (for example, the mobile phone 110) runs each task in the task queue.
  • the terminal for example, the mobile phone 110
  • the task at the head of the task queue is the task that the current terminal is running.
  • the display content generated by the terminal when running the task can be stored in the queue head of the cache queue.
  • the display of the terminal always reads the queue queue. The display content is displayed.
  • the image processing method of the terminal provided by the embodiment of the present application is described in detail in conjunction with the principle of the screen projection shown in FIG. 2 to FIG. 7. As shown in FIG. 8, the method includes:
  • the terminal is connected to an external display device.
  • the terminal can connect to the external display device by means of a wired connection or a wireless connection.
  • the terminal determines a display screen size when the display screen is subsequently sent to the external display device.
  • the terminal can detect display parameters such as the resolution of the external display device, and further determine the display screen size of the display screen that needs to be sent to the external display device. For example, if the external display device supports the image display in the 1080P format, the terminal may determine that the display screen size of the display screen sent to the external display device is a display screen of 1920 ⁇ 1080 resolution corresponding to the 1080P format.
  • the terminal may display a "large screen projection welcome interface” 117 as shown in FIG. 2 or FIG. 3 on its display screen.
  • the terminal can generate a "Welcome to use large screen projection” prompt 121 for the external display device, and the prompt The language 121 is sent to the external display device such that the external display device displays the "Welcome to Use Large Screen Projection" prompt 121 as shown in FIG. 2 or FIG.
  • the terminal may display an operation description for performing a large screen projection function in the “large screen projection welcome interface” 117.
  • the terminal can A terminal interface 801 as shown in FIG. 9 is displayed on the display screen of the terminal, and a large screen interface 802 as shown in FIG. 9 is displayed on the external display device according to the determined display screen size.
  • the external display device displays the large screen interface 802
  • the external display device intercepts the display at the center of the large screen interface 802 sent from the terminal by 95%.
  • the content is displayed.
  • the display screen of the external display device is a large screen interface 802'. Since the display content of the original large screen interface 802 is not extracted when the external display device performs overscan, the large screen after overscan Edge 803 on interface 802' may present an incomplete display.
  • the external display device displays a setting interface for adjusting a display screen size of the external display device.
  • step S702 in order to avoid the phenomenon that the display screen is incomplete due to overscan when the terminal projects the screen to the external display device, after the terminal establishes a connection with the external display device to complete the initialization process of the display of the external display device, as shown in FIG.
  • the external display device can display a setting interface 1001 for adjusting the size of its display screen.
  • the user can perform a right-click operation on the large-screen interface 802 (or the large-screen interface 802') of the external display device by using a mouse, and the external display device sends the right-click operation input by the user to the terminal, and the terminal responds to the right-click operation as
  • the external display device generates a right-click menu and sends the right-click menu to the external display device for display.
  • the right-click menu may include a screen setting option for adjusting the size of the display screen.
  • the display setting interface 1001 may be requested from the terminal. After receiving the request from the external display device, the terminal generates the setting interface 1001 shown in FIG. 11 for the external display device, and sends it to the external display device for display.
  • the terminal can also enter the analog keyboard and mouse function, and the touch panel interface 1101 shown in FIG. 12 is displayed on the display screen of the terminal.
  • the touch panel interface 1101 shown in FIG. 12 is displayed on the display screen of the terminal.
  • the user's finger 1104 contacts the touchpad interface 1101 shown in FIG. 12 and moves on the touchpad interface 1101
  • the corresponding movement of the cursor in the largescreen interface 1102 shown in FIG. 12 can be controlled.
  • the user can perform the above-mentioned right-click operation and the selection operation of the above-mentioned screen setting options on the external display device through the touch panel interface 1101, and trigger the terminal to generate the setting interface 1001 shown in FIG. 11 for the external display device, and send the setting interface 1001 to the external display device. Display.
  • the terminal can automatically trigger the terminal to generate the setting interface 1001 shown in FIG. 11 for the external display device, and send the display interface 1001 to the external display device for display. .
  • the size of the plurality of candidate screen sizes may be included in the setting interface 1001.
  • the setting interface 1001 includes three candidate screen sizes, one is a full screen screen size 1101 in which the display screen is full of the screen, and the other is a moderate screen size 1102 in which the display screen accounts for 95% of the screen, and the other is a display.
  • the screen occupies 85% of the screen with a smaller screen size of 1103.
  • the setting interface 1001 also shows the painting of each candidate screen size.
  • Preview the effect The preview effect of each screen may be a preview effect of any display screen when the external display device does not perform overscan processing, or may be an arbitrary display ratio according to the default extraction ratio (for example, 95% of the screen extraction ratio) of the display screen according to overscan.
  • the terminal transmits a subsequent display screen to be displayed to the external display device (for example, the large screen interface 802 shown in FIG. 9), as shown in FIG.
  • the image in the large screen interface 802 ie, the initial display screen
  • the image reduced by 95% is adjusted to the center of the large screen interface to obtain a target display screen equal in size to the initial display screen.
  • 95% of the target area in the center is a valid screen having substantially displayed content.
  • the external display device overscans the received target display screen, that is, intercepts 95% of the screen of the target display screen center.
  • the screen intercepted by the external display device is just the effective screen in the target display screen.
  • the full large screen interface 802 can be displayed in the external display device to overcome the problem that the display screen is incomplete due to overscan. Therefore, as shown in FIG. 11, the moderate screen size 1002 can be presented to the user as the recommended size.
  • the small screen size 1103 in which the display screen occupies 85% of the screen is taken as an example.
  • the terminal transmits the initial display screen to be displayed to the external display device (still taking the large screen interface 802 shown in FIG. 9 as an example) for example, As shown in FIG. 14, the image in the large screen interface 802 can be reduced by 85% from the original full screen screen size, and the image reduced by 85% can be adjusted to the center of the large screen interface to obtain a target display screen having the same size as the initial display screen. At this time, in the target display screen, 85% of the target area in the center is a valid screen having substantial display content.
  • the external display device overscans the received target display screen, that is, intercepts 95% of the screen of the target display screen center for display. Since the screen captured during overscan is larger than the above-mentioned effective screen, the external display device can still display the full large screen interface 802 when displayed.
  • the external display device may also display each candidate screen size in the form of the progress bar 1401 in the setting interface 1001, and the user drags the slider 1402 of the progress bar 1401.
  • the progress of the progress bar can be changed to select the corresponding candidate picture size as the target picture size when the subsequent external display device is displayed.
  • the external display device can display the screen preview effect 1403 of the candidate screen size at the slider position in the setting interface 1001, so that the user selects the screen preview effect according to the usage habit. Picture size.
  • the terminal obtains a target screen size selected by the user in response to an input operation of the user on the setting interface.
  • the target screen size described above may be used to indicate the size of the target area having the substantially displayed content in the target display screen generated by the terminal.
  • the target screen size may be a target ratio between the target area and the target display screen, for example, 95%, that is, 95% of the target display screens sent by the terminal to the external display device are substantially displayed.
  • the target screen size may directly be the size of the target area in the target display screen, for example, a target area of 1900 ⁇ 1000 resolution.
  • the external display device may send the candidate screen size selected by the user as the target screen size to the terminal, and the target drawing
  • the face size may include a target ratio of a display screen on a subsequent external display device to an external display device screen.
  • the target screen size may also include the ratio of the length of the subsequent display to the height, such as 16:9. Therefore, when the terminal subsequently transmits the real-time display screen to the external display device, the display screen may be scaled according to the target screen size, thereby providing the external display device with a signal source of the complete display screen.
  • the method for the terminal to display the signal source of the complete display screen for the external display device can be referred to the following steps S705-S707, wherein the step S705 and the step S705' are two alternative implementation manners.
  • the terminal converts an initial display screen to be displayed by the external display device into a target display screen that is adapted to the size of the target screen.
  • the initial display screen and the target display screen each have a display screen size determined in step 702.
  • the terminal After the terminal acquires the target screen size set by the user to the external display device, it can store it in the memory of the terminal. Subsequently, when the user triggers the external display device to display, for example, when the user opens an application displayed on the external display device, the external display device may send the user-triggered input event to the terminal, and the terminal generates a size for the external display device.
  • the screen to be displayed of the above display screen size for example, an initial display screen.
  • the initial display screen 1501 generated by the terminal for the external display device is a size of 10*10 matched with the external display device, according to 80.
  • the terminal may first reduce the generated initial display screen 1501 by 80% to obtain an 8*8 zoom screen 1502. Further, the 8*8 zoom screen 1502 is adjusted to the center of the target position based on the target position where the initial display screen 1501 is located. As shown in FIG.
  • the terminal can fill black or other colors around the zoom screen 1502 to obtain a target display screen 1503 having the same size as the initial display screen 1501. It can be seen that the target display screen 1503 is the same size as the initial display screen 1501, but the area of the effective screen in the target display screen 1503 occupies 80% of the entire target display screen 1503, that is, the target display screen 1503 is provided with 80% of the target area. Used to layout display content.
  • the initial display screen 1501 may be the entire display interface to be displayed on the external display device, or may be one or more windows in the entire display interface, or may be some in the window.
  • the specific embodiment of the present application does not impose any limitation on this.
  • the Android operating system can be divided into four layers, from the upper layer to the lower layer respectively, the application layer (ie, the APP layer), the application framework layer (ie, the Framework layer), and the system runtime layer ( That is, the Libraries layer) and the Linux kernel layer.
  • the application layer ie, the APP layer
  • the application framework layer ie, the Framework layer
  • the system runtime layer That is, the Libraries layer
  • the Linux kernel layer the Linux kernel layer.
  • the Linux kernel layer can be used as an abstraction layer between hardware (for example, CPU, network card, memory, etc.) and software stack, which can hide specific hardware details for the upper layer (system runtime layer, application framework layer and application layer) ) Provide a unified service.
  • the system runtime layer contains some C/C++ libraries, such as media library, system C library, and display management library (Surface Manager). These libraries can be used by different components in the Android system.
  • the system runtime layer can pass the Framework layer. Serve developers.
  • the Framework layer provides developers with an API framework for full access to applications. Specifically, the Framework layer provides a lot of APIs for developing applications. By calling the corresponding APIs, you can construct an APP that meets the relevant business needs.
  • the application layer mainly includes the APP written in java language, and the user operates on the APP. When the interface is used, it interacts with the system runtime layer or the Linux kernel layer by calling related APIs in the Framework layer to implement functions corresponding to the operation interface.
  • the system service maintained by the Framework layer includes a window manager service, and a PC manager dedicated to maintaining and implementing the terminal PC function.
  • Service PC management service
  • the window manager service is provided with a window state animator.
  • each application's Activity corresponds to a window, and the window state animator can be used to draw and manage the window surface and window animation of the window.
  • the window state animator draws each window for the external display device (for example, the initial display screen A)
  • the target screen size set by the user can be obtained from the PC manager service, and then the target display screen corresponding to the target screen size is drawn. A.
  • the display interface when the initial display screen is a complete display interface to be displayed on the external display device, usually the display interface includes one or more windows (or icons), then the terminal may When each window (or icon) is drawn, each window (or icon) is converted according to the method described in step S704, and finally the converted target display screen is obtained; after the entire display interface is completed, the The display interface is converted according to the method described in step S704, and the converted target display screen is also obtained.
  • This embodiment of the present application does not impose any limitation.
  • the terminal may also pre-store one or more target type windows, such windows do not need to adjust the size of the display screen, such as a wallpaper type window.
  • the edges of such preset windows usually do not contain important information that the user needs. Therefore, the images in such windows are scanned without causing the loss of information required by the user.
  • the terminal may perform the above-mentioned step S704, and the terminal may draw the window according to the existing window drawing method, and send the drawn window to the external display device for display.
  • the window may be converted according to the method described in the above step S704, and finally the converted target display screen is obtained.
  • the terminal draws a target display screen to be displayed for the external display device according to the target screen size.
  • the terminal may draw the display according to the target screen size set by the user.
  • the initial canvas used by the system is modified to the target canvas, and the target canvas can only draw the display in the same target area as the above target image size.
  • the subsequent terminal can draw the display screen in the target area in the target canvas.
  • the obtained target display screen is the same as the target display screen formed after the conversion in step S704.
  • the terminal can first reduce the initial canvas 1601 of 10*10 to 8* according to the target screen size. 8. Further, a bottom color is formed around the reduced initial canvas 1601 to form a target canvas 1602 of 10*10. It can be seen that the size of the target canvas 1602 is the same as the initial canvas 1601, but only the 8*8 target area located in the center of the target canvas 1602 can be used to draw the display. Therefore, as shown in FIG. 16B, the terminal can arrange the display contents in the display screen, such as text, images, icons, and the like, within the target area of the target canvas 1602, and finally obtain the same target display screen as in FIG. 16A.
  • the terminal when the terminal draws the display content in the target area of the target canvas 1602, the terminal may still draw according to the above target
  • the surface size is reduced by 80% of the preset size of the element to be displayed, and then the layout is in the target area.
  • the terminal can also directly arrange the preset size of the to-be-displayed element in the target area. limit.
  • the terminal sends the target display screen to the external display device.
  • the scanned target display screen is outputted on the display.
  • the terminal transmits the zoomed target display screen to the external display device.
  • the external display device may overscan the received target display screen, for example, , 95% of the display data in the center of the extraction target display screen is displayed. Then, since the area of the screen extracted by the external display device during the overscan is greater than or equal to the area of the effective screen in the target display screen generated by the terminal, the information of the display screen received by the external display device in the terminal PCized scene is complete. It can avoid the phenomenon that the display is incomplete due to overscan.
  • the external display device uses an extraction ratio of 95% for the display screen when the overscan is used. It can be understood that the specific extraction ratio of the overscan can be performed by a person skilled in the art according to the actual application scenario. It is set that when the zoom ratio of the initial display screen (ie, the target screen size set by the user) is less than or equal to the extraction ratio of the display screen when the external display device overscan, the external display device can obtain a complete display screen after overscan.
  • the external display device may The display screen extraction rate is sent to the terminal. Further, the terminal can automatically set the target screen size to a value corresponding to the display screen extraction rate. Then, when the subsequent terminal sends the initial display screen to be displayed to the external display device, the initial display screen may be scaled by using the target screen size according to the method shown in steps S704-S706 above, and the target display screen obtained by the scaling is sent. Displayed after overscan of the external display device.
  • the display screen obtained by the external display device after overscan is just the effective screen in the target display screen, and the target display can be maximized and displayed in the external display device.
  • the screen overcomes the problem of incomplete display due to overscan.
  • the above terminal and the like include hardware structures and/or software modules corresponding to each function.
  • the embodiments of the present application can be implemented in a combination of hardware or hardware and computer software in combination with the elements and algorithm steps of the various examples described in the embodiments disclosed herein. Whether a function is implemented in hardware or computer software to drive hardware depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods to implement the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the embodiments of the present application.
  • the embodiment of the present application may perform the division of the function modules on the terminal or the like according to the foregoing method example.
  • each function module may be divided according to each function, or two or more functions may be integrated into one processing module.
  • the above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of the module in the embodiment of the present application is schematic, and is only a logical function division, and the actual implementation may have another division manner.
  • FIG. 18 shows the above embodiment.
  • a possible schematic diagram of a terminal involved, the terminal includes: a transceiver unit 1901, a determining unit 1902, and a generating unit 1903.
  • the transceiver unit 1901 is configured to support the terminal to perform the processes S701, S704, and S706 in FIG. 7; the determining unit 1902 is configured to support the terminal to perform the process S702 in FIG. 7; the generating unit 1903 is configured to support the terminal to execute the processes S705 and S705 in FIG. 7. '. All the related content of the steps involved in the foregoing method embodiments may be referred to the functional descriptions of the corresponding functional modules, and details are not described herein again.
  • the above determining unit 1902 and generating unit 1903 may be integrated into a processing module, the transceiver unit 1901 is used as a communication module, and the terminal may further include a storage module, a display module, and the like.
  • the processing module 2002 is configured to control and manage the actions of the terminal.
  • the communication module 2003 is used to support communication between the terminal and other network entities.
  • the storage module 2001 is used to save program codes and data of the terminal.
  • the display module 2004 is for displaying information input by the user or information provided to the user and various menus of the terminal.
  • the processing module 2002 of the terminal may generate a target display screen to be displayed for the external display device, where the target displays the target in the screen
  • the area is used for arranging display content in the target display screen, and the target area is a part of the target display screen; further, the communication module 2003 may send the target display screen to the external display device for display.
  • the processing module 2002 may be a processor or a controller, for example, may be a central processing unit (CPU), a GPU, a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit. (Application-Specific Integrated Circuit, ASIC), Field Programmable Gate Array (FPGA) or other programmable logic device, transistor logic device, hardware component, or any combination thereof. It is possible to implement or carry out the various illustrative logical blocks, modules and circuits described in connection with the present disclosure.
  • the processor may also be a combination of computing functions, for example, including one or more microprocessor combinations, a combination of a DSP and a microprocessor, and the like.
  • the communication module 2003 can be a transceiver, a transceiver circuit, an input/output device, a communication interface, or the like.
  • the communication module 2003 may specifically be a Bluetooth device, a Wi-Fi device, a peripheral interface, or the like.
  • the memory module 2001 may be a memory, which may include a high speed random access memory (RAM), and may also include a nonvolatile memory such as a magnetic disk storage device, a flash memory device, or other volatile solid state storage device.
  • RAM high speed random access memory
  • nonvolatile memory such as a magnetic disk storage device, a flash memory device, or other volatile solid state storage device.
  • the display module 2004 can be a display, and specifically can be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.
  • a touch panel can be integrated on the display for collecting touch events on or near the display, and transmitting the collected touch information to other devices (such as a processor, etc.).
  • the processing module 2002 is a processor
  • the communication module 2003 is a radio frequency circuit
  • the storage module 2001 is a memory.
  • the terminal provided by the embodiment of the present application may be the mobile phone 110 shown in FIG. 5 when the display module 2004 is a display.
  • the computer program product includes one or more computer instructions.
  • the computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable device.
  • the computer instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions can be from a website site, computer, server or data center Transfer to another website site, computer, server, or data center by wire (eg, coaxial cable, fiber optic, digital subscriber line (DSL), or wireless (eg, infrared, wireless, microwave, etc.).
  • the computer readable storage medium can be any available media that can be accessed by a computer or a data storage device such as a server, data center, or the like that includes one or more available media.
  • the usable medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (such as a solid state disk (SSD)).

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

An image processing method and apparatus for a terminal, capable of mitigating the phenomenon of incomplete display image caused by overscan by a large-screen display during PC of a mobile terminal, thereby improving the display quality of the large-screen display. The method comprises: when a terminal is connected to an external display device, the terminal generates a target display image to be displayed for the external display device, a target region in the target display image being used for laying out display content in the target display image, the target region being a part of the target display image; the terminal sends the target display image to the external display device for displaying.

Description

一种终端的图像处理方法及装置Image processing method and device for terminal 技术领域Technical field
本申请实施例涉及通信技术领域,尤其涉及一种终端的图像处理方法及装置。The embodiments of the present invention relate to the field of communications technologies, and in particular, to an image processing method and apparatus for a terminal.
背景技术Background technique
移动终端个人计算机(personal computer,PC)化是实现移动办公的重要手段之一。具体的,手机等移动终端可以通过无线视频显示(Wi-Fi-Display)功能或者微软的连续统一体(continuum)功能,将手机屏幕上的显示内容投射至PC等大屏显示器上,使得手机连接上大屏显示器后也能当PC一样使用。Personal computer (PC) is one of the important means to achieve mobile office. Specifically, the mobile terminal and the like can project the display content on the screen of the mobile phone to a large-screen display such as a PC through a wireless video display (Wi-Fi-Display) function or a Microsoft continuum function, so that the mobile phone is connected. It can also be used as a PC after a large screen display.
目前,有一些大屏显示器在显示时会开启过扫描(overscan)功能,以解决大屏显示器中因其模拟电路参数差异导致的画面边缘发生畸变的现象。以电视为大屏显示器举例,当电视接收到待播放的源画面数据时,如图1所示,电视会从源画面数据中截取位于画面中心95%的源画面数据,然后将截取后的源画面数据全屏显示在电视中。At present, some large-screen displays will turn on the overscan function during display to solve the distortion of the edges of the screen caused by the difference of analog circuit parameters in the large-screen display. Taking TV as a large-screen display, when the TV receives the source picture data to be played, as shown in Figure 1, the TV intercepts 95% of the source picture data from the source picture data, and then intercepts the source. The screen data is displayed in full screen on the TV.
在移动终端PC化的应用场景下,大屏显示器接收到手机等移动终端发送的源画面数据时,仍会对接收到的源画面数据进行overscan,此时会导致手机发送的部分图像信息丢失,用户在观看大屏显示器时画面显示不完整。In the application scenario of the mobile terminal PC, when the large screen display receives the source picture data sent by the mobile terminal such as the mobile phone, the received source picture data is still overscan, and the partial image information sent by the mobile phone is lost. The user does not display the screen when viewing the large screen display.
发明内容Summary of the invention
本申请的实施例提供一种终端的图像处理方法及装置,在移动终端PC化时可改善因大屏显示器进行过扫描而导致显示画面不完整的现象,提高大屏显示器的显示质量。An embodiment of the present invention provides an image processing method and apparatus for a terminal. When the mobile terminal is PCized, the phenomenon that the display screen is incomplete due to over-scanning of the large-screen display can be improved, and the display quality of the large-screen display is improved.
为达到上述目的,本申请的实施例采用如下技术方案:To achieve the above objective, the embodiment of the present application adopts the following technical solutions:
第一方面,本申请的实施例提供一种终端的图像处理方法,终端与外部显示设备相连,该方法包括:终端为外部显示设备生成待显示的目标显示画面,该目标显示画面内的目标区域用于布局该目标显示画面中的显示内容,该目标区域为该目标显示画面中的一部分;终端将该目标显示画面发送至外部显示设备进行显示。In a first aspect, an embodiment of the present application provides an image processing method of a terminal, where the terminal is connected to an external display device, the method includes: the terminal generates a target display screen to be displayed for the external display device, where the target display area in the target display area For displaying the display content in the target display screen, the target area is a part of the target display screen; the terminal sends the target display screen to an external display device for display.
这样,终端发送给外部显示设备的目标显示画面中仅有部分区域内布局有实质的显示内容,外部显示设备接收到目标显示画面后可沿用显示图像处理流程对目标显示画面进行过扫描,过扫描时丢失的实质显示内容将减少,从而可改善因大屏显示器进行过扫描而导致显示画面不完整的现象,提高大屏显示器的显示质量。In this way, only a part of the target display screen sent by the terminal to the external display device has a substantial display content. After receiving the target display screen, the external display device can scan the target display image according to the display image processing flow, and overscan. The actual display content lost will be reduced, thereby improving the phenomenon that the display screen is incomplete due to over-scanning of the large-screen display, and improving the display quality of the large-screen display.
在一种可能的设计方法中,在终端为外部显示设备生成待显示的目标显示画面之前,还包括:终端确定显示画面尺寸,该显示画面尺寸为发送给外部显示设备的画面的尺寸;该目标显示画面具有该显示画面尺寸。即终端给外部显示设备发送的每一幅显示画面的尺寸均为上述显示画面尺寸,但每一幅显示画面中具有实质显示内容的区域减小。In a possible design method, before the terminal generates the target display screen to be displayed for the external display device, the method further includes: the terminal determining a display screen size, where the display screen size is a size of a screen sent to the external display device; The display screen has the display screen size. That is, the size of each display screen sent by the terminal to the external display device is the above-mentioned display screen size, but the area having the substantial display content in each display screen is reduced.
在一种可能的设计方法中,终端为外部显示设备生成待显示的目标显示画面,具体包括:终端为待外部显示设备显示的内容生成初始显示画面,该初始显示画面具有上述显示画面尺寸;终端将该初始显示画面转换为该目标显示画面,该目标显示画面 中该目标区域的显示内容是由该初始显示画面缩小后得到的。In a possible design method, the terminal generates a target display screen to be displayed for the external display device, and specifically includes: the terminal generates an initial display image for the content to be displayed by the external display device, where the initial display screen has the display screen size; Converting the initial display screen to the target display screen, the target display screen The display content of the target area is obtained by reducing the initial display screen.
在一种可能的设计方法中,终端为外部显示设备生成待显示的目标显示画面,具体包括:终端在上述目标区域填充待外部显示设备显示的内容,以得到该目标显示画面。In a possible design method, the terminal generates a target display screen to be displayed for the external display device, and specifically includes: the terminal filling the content displayed by the external display device in the target area to obtain the target display screen.
那么,当外部显示设备过扫描时提取的画面面积大于或等于终端生成的目标显示画面中目标区域的面积时,外部显示设备接收到的显示画面的信息是完整的,可避免因overscan而导致显示画面不完整的现象。Then, when the area of the screen extracted by the external display device is greater than or equal to the area of the target area in the target display screen generated by the terminal, the information of the display screen received by the external display device is complete, and the display caused by overscan can be avoided. The picture is incomplete.
在一种可能的设计方法中,在终端将该初始显示画面转换为该目标显示画面之前,还包括:终端为外部显示设备生成用于调整外部显示设备的显示画面尺寸的设置界面,该设置界面中包括至少一个候选画面尺寸;终端将该设置界面发送至外部显示设备进行显示;终端根据用户在该设置界面的输入操作,确定该初始显示画面与该目标显示画面中该目标区域间的缩放比例。In a possible design method, before the terminal converts the initial display image into the target display screen, the method further includes: the terminal generating, by the external display device, a setting interface for adjusting a display screen size of the external display device, the setting interface Included in the at least one candidate screen size; the terminal sends the setting interface to an external display device for display; the terminal determines a scaling ratio between the initial display screen and the target area in the target display screen according to an input operation of the user on the setting interface .
在一种可能的设计方法中,在终端在该目标区域填充待外部显示设备显示的内容之前,还包括:终端为外部显示设备生成用于调整外部显示设备的显示画面尺寸的设置界面,该设置界面中包括至少一个候选画面尺寸;终端将该设置界面发送至外部显示设备进行显示;终端根据用户在该设置界面的输入操作确定该目标显示画面中该目标区域的尺寸。In a possible design method, before the terminal fills the content to be displayed by the external display device in the target area, the method further includes: the terminal generating, by the external display device, a setting interface for adjusting a display screen size of the external display device, the setting The interface includes at least one candidate screen size; the terminal sends the setting interface to an external display device for display; and the terminal determines the size of the target area in the target display screen according to an input operation of the user on the setting interface.
这样,用户可以手动选择外部显示设备中显示画面在屏幕上所占的比例,选择符合自身使用习惯的画面尺寸。In this way, the user can manually select the proportion of the display screen on the screen in the external display device, and select the screen size that suits his own usage habits.
在一种可能的设计方法中,该设置界面中还包括在该候选画面尺寸下外部显示设备的画面预览效果。In a possible design method, the setting interface further includes a screen preview effect of the external display device under the candidate screen size.
在一种可能的设计方法中,终端为外部显示设备生成用于调整显示画面尺寸的设置界面,包括:响应于用户对外部显示设备的设置操作,终端为外部显示设备生成用于调整显示画面尺寸的设置界面;或者,当终端与外部显示设备连接成功时,终端为外部显示设备生成用于调整显示画面尺寸的设置界面。In a possible design method, the terminal generates a setting interface for adjusting the size of the display screen for the external display device, including: in response to the setting operation of the external display device by the user, the terminal generates an external display device for adjusting the display screen size. The setting interface; or, when the terminal is successfully connected to the external display device, the terminal generates a setting interface for adjusting the size of the display screen for the external display device.
在一种可能的设计方法中,该目标区域位于该目标显示画面的中心,该目标显示画面中除该目标区域的其他区域设置有底色,例如,该底色可以设置为黑色。In one possible design method, the target area is located at the center of the target display screen, and other areas of the target display screen except the target area are provided with a background color, for example, the background color may be set to black.
在一种可能的设计方法中,该目标区域与该目标显示画面的目标比例,小于或等于外部显示设备过扫描时对显示画面的提取比例。这样,外部显示设备过扫描时提取的画面面积大于或等于终端生成的目标显示画面中有效画面的面积,因此,在终端PC化场景下外部显示设备接收到的显示画面的信息是完整的,可避免因overscan而导致显示画面不完整的现象。In a possible design method, the target ratio of the target area to the target display screen is less than or equal to the extraction ratio of the display screen when the external display device overscans. In this way, the area of the screen that is extracted when the external display device is overscan is greater than or equal to the area of the effective screen in the target display screen generated by the terminal. Therefore, the information of the display screen received by the external display device in the terminal PC-based scene is complete. Avoid the phenomenon that the display is incomplete due to overscan.
在一种可能的设计方法中,终端确定显示画面尺寸,包括:终端获取外部显示设备支持的分辨率;终端根据外部显示设备支持的分辨率确定该显示画面尺寸。In a possible design method, the terminal determines the display screen size, including: the terminal acquires the resolution supported by the external display device; and the terminal determines the display screen size according to the resolution supported by the external display device.
第二方面,本申请的实施例提供一种终端的图像处理方法,终端与外部显示设备相连,该方法包括:终端将生成的初始显示画面发送至外部显示设备进行显示;终端将用于调整外部显示设备的显示画面尺寸的设置界面发送至外部显示设备进行显示,该设置界面中包括至少一个候选画面尺寸;响应于用户在该候选画面尺寸中选中的目标画面尺寸,终端将生成的目标显示画面发送至外部显示设备进行显示,该目标显示 画面和该初始显示画面的尺寸相同,且该目标显示画面中目标区域的显示内容是由该初始显示画面缩小后得到的,该目标区域的大小为该目标画面尺寸。In a second aspect, an embodiment of the present application provides an image processing method of a terminal, where the terminal is connected to an external display device, the method includes: the terminal sends the generated initial display image to an external display device for display; and the terminal is used to adjust the external The setting interface of the display screen size of the display device is sent to an external display device for display, the setting interface includes at least one candidate screen size; and the target display screen generated by the terminal in response to the target screen size selected by the user in the candidate screen size Send to an external display device for display, the target display The screen has the same size as the initial display screen, and the display content of the target area in the target display screen is obtained by reducing the initial display screen, and the size of the target area is the target screen size.
第三方面,本申请的实施例提供一种终端,包括:生成单元,用于为外部显示设备生成待显示的目标显示画面,该目标显示画面内的目标区域用于布局该目标显示画面中的显示内容,该目标区域为该目标显示画面中的一部分;收发单元,用于将该目标显示画面发送至外部显示设备进行显示。In a third aspect, an embodiment of the present application provides a terminal, including: a generating unit, configured to generate, for an external display device, a target display screen to be displayed, where a target area in the target display screen is used to layout the target display screen The content is displayed, the target area is a part of the target display screen, and the transceiver unit is configured to send the target display screen to an external display device for display.
在一种可能的设计方法中,终端还包括:确定单元,用于确定显示画面尺寸,该显示画面尺寸为发送给外部显示设备的画面的尺寸;该目标显示画面具有该显示画面尺寸。In a possible design method, the terminal further includes: a determining unit, configured to determine a display screen size, the size of the screen sent to the external display device; the target display screen has the display screen size.
在一种可能的设计方法中,该生成单元,具体用于为待外部显示设备显示的内容生成初始显示画面,该初始显示画面具有该显示画面尺寸;终端将该初始显示画面转换为该目标显示画面,该目标显示画面中该目标区域的显示内容是由该初始显示画面缩小后得到的。In a possible design method, the generating unit is specifically configured to generate an initial display image for the content to be displayed by the external display device, where the initial display screen has the display screen size; and the terminal converts the initial display image into the target display In the screen, the display content of the target area in the target display screen is obtained by reducing the initial display screen.
在一种可能的设计方法中,该生成单元,具体用于在该目标区域填充待外部显示设备显示的内容,以得到该目标显示画面。In a possible design method, the generating unit is specifically configured to fill the target area with the content to be displayed by the external display device to obtain the target display screen.
在一种可能的设计方法中,该生成单元,还用于为外部显示设备生成用于调整外部显示设备的显示画面尺寸的设置界面,该设置界面中包括至少一个候选画面尺寸;该收发单元,还用于将该设置界面发送至外部显示设备进行显示;该确定单元,还用于根据用户在该设置界面的输入操作,确定该初始显示画面与该目标显示画面中该目标区域间的缩放比例。In a possible design method, the generating unit is further configured to generate, by the external display device, a setting interface for adjusting a display screen size of the external display device, where the setting interface includes at least one candidate screen size; the transceiver unit, And the determining unit is further configured to: determine, according to an input operation of the user on the setting interface, a scaling ratio between the initial display screen and the target area in the target display screen. .
在一种可能的设计方法中,该生成单元,还用于为外部显示设备生成用于调整外部显示设备的显示画面尺寸的设置界面,该设置界面中包括至少一个候选画面尺寸;该收发单元,还用于将该设置界面发送至外部显示设备进行显示;该确定单元,还用于根据用户在该设置界面的输入操作确定该目标显示画面中该目标区域的尺寸。In a possible design method, the generating unit is further configured to generate, by the external display device, a setting interface for adjusting a display screen size of the external display device, where the setting interface includes at least one candidate screen size; the transceiver unit, The determining unit is further configured to send the setting interface to the external display device for display; the determining unit is further configured to determine a size of the target area in the target display screen according to an input operation of the user on the setting interface.
在一种可能的设计方法中,该生成单元,具体用于响应于用户对外部显示设备的设置操作,为外部显示设备生成用于调整显示画面尺寸的设置界面;或者,当终端与外部显示设备连接成功时,为外部显示设备生成用于调整显示画面尺寸的设置界面。In a possible design method, the generating unit is specifically configured to generate a setting interface for adjusting the size of the display screen for the external display device in response to a setting operation of the external display device by the user; or, when the terminal and the external display device When the connection is successful, a setting interface for adjusting the size of the display screen is generated for the external display device.
在一种可能的设计方法中,该收发单元,还用于获取外部显示设备支持的分辨率;该确定单元,具体用于根据外部显示设备支持的分辨率确定该显示画面尺寸。In a possible design method, the transceiver unit is further configured to obtain a resolution supported by the external display device. The determining unit is specifically configured to determine the display screen size according to a resolution supported by the external display device.
第四方面,本申请的实施例提供一种终端,终端与外部显示设备相连,终端包括通过总线相连的处理器、存储器以及收发器,其中,该处理器,用于为外部显示设备生成待显示的目标显示画面,该目标显示画面内的目标区域用于布局该目标显示画面中的显示内容,该目标区域为该目标显示画面中的一部分;该收发器,用于将该目标显示画面发送至外部显示设备进行显示In a fourth aspect, an embodiment of the present application provides a terminal, where the terminal is connected to an external display device, where the terminal includes a processor, a memory, and a transceiver connected through a bus, where the processor is configured to generate a display to be displayed for the external display device. a target display screen, the target area in the target display screen is used to layout the display content in the target display screen, the target area is a part of the target display screen; the transceiver is configured to send the target display screen to External display device for display
在一种可能的设计方法中,在为外部显示设备生成待显示的目标显示画面之前,该处理器,还用于确定显示画面尺寸,该显示画面尺寸为发送给外部显示设备的画面的尺寸;该目标显示画面具有该显示画面尺寸。In a possible design method, before generating a target display screen to be displayed for an external display device, the processor is further configured to determine a display screen size, where the display screen size is a size of a screen sent to the external display device; The target display screen has the display screen size.
在一种可能的设计方法中,该处理器,具体用于为待外部显示设备显示的内容生成初始显示画面,该初始显示画面具有该显示画面尺寸;终端将该初始显示画面转换 为该目标显示画面,该目标显示画面中该目标区域的显示内容是由该初始显示画面缩小后得到的。In a possible design method, the processor is specifically configured to generate an initial display image for the content to be displayed by the external display device, where the initial display screen has the display screen size; and the terminal converts the initial display image A screen is displayed for the target, and the display content of the target area in the target display screen is obtained by reducing the initial display screen.
在一种可能的设计方法中,该处理器,具体用于在该目标区域填充待外部显示设备显示的内容,以得到该目标显示画面。In a possible design method, the processor is specifically configured to fill the content to be displayed by the external display device in the target area to obtain the target display screen.
在一种可能的设计方法中,该处理器,还用于为外部显示设备生成用于调整外部显示设备的显示画面尺寸的设置界面,该设置界面中包括至少一个候选画面尺寸;该收发器,还用于将该设置界面发送至外部显示设备进行显示;接收用户在该设置界面的输入操作;该处理器,还用于确定该初始显示画面与该目标显示画面中该目标区域间的缩放比例。In a possible design method, the processor is further configured to generate, by the external display device, a setting interface for adjusting a display screen size of the external display device, where the setting interface includes at least one candidate screen size; the transceiver, The method is further configured to send the setting interface to an external display device for display; receiving an input operation of the user on the setting interface; the processor is further configured to determine a scaling ratio between the initial display screen and the target area in the target display screen .
在一种可能的设计方法中,该处理器,还用于为外部显示设备生成用于调整外部显示设备的显示画面尺寸的设置界面,该设置界面中包括至少一个候选画面尺寸;该收发器,还用于将该设置界面发送至外部显示设备进行显示;接收用户在该设置界面的输入操作;该处理器,还用于根据用户在该设置界面的输入操作确定该目标显示画面中该目标区域的尺寸。In a possible design method, the processor is further configured to generate, by the external display device, a setting interface for adjusting a display screen size of the external display device, where the setting interface includes at least one candidate screen size; the transceiver, The method is further configured to send the setting interface to an external display device for display; receiving an input operation of the user in the setting interface; the processor is further configured to determine the target area in the target display screen according to an input operation of the user on the setting interface size of.
在一种可能的设计方法中,该设置界面中还包括在该候选画面尺寸下外部显示设备的画面预览效果。In a possible design method, the setting interface further includes a screen preview effect of the external display device under the candidate screen size.
在一种可能的设计方法中,该处理器,具体用于:响应于用户对外部显示设备的设置操作,为外部显示设备生成用于调整显示画面尺寸的设置界面;或者,当终端与外部显示设备连接成功时,为外部显示设备生成用于调整显示画面尺寸的设置界面。In a possible design method, the processor is specifically configured to: generate a setting interface for adjusting the size of the display screen for the external display device in response to a setting operation of the external display device by the user; or, when the terminal and the external display When the device is successfully connected, a setting interface for adjusting the size of the display screen is generated for the external display device.
在一种可能的设计方法中,该目标区域位于该目标显示画面的中心,该目标显示画面中除该目标区域的其他区域设置有底色。In one possible design method, the target area is located at the center of the target display screen, and other areas of the target display screen except the target area are provided with a background color.
在一种可能的设计方法中,该目标区域与该目标显示画面的目标比例,小于或等于外部显示设备过扫描时对显示画面的提取比例。In a possible design method, the target ratio of the target area to the target display screen is less than or equal to the extraction ratio of the display screen when the external display device overscans.
在一种可能的设计方法中,该收发器,还用于获取外部显示设备支持的分辨率;该处理器,具体用于根据外部显示设备支持的分辨率确定该显示画面尺寸。In a possible design method, the transceiver is further configured to obtain a resolution supported by the external display device; and the processor is specifically configured to determine the display screen size according to a resolution supported by the external display device.
第五方面,本申请的实施例提供一种终端,终端与外部显示设备相连,终端包括通过总线相连的处理器、存储器以及收发器,其中,该处理器,用于为外部显示设备生成初始显示画面;生成用于调整外部显示设备的显示画面尺寸的设置界面;为外部显示设备生成目标显示画面,该目标显示画面和该初始显示画面的尺寸相同,且该目标显示画面中目标区域的显示内容是由该初始显示画面缩小后得到的,该目标区域的大小为该目标画面尺寸;该收发器,用于将该初始显示画面发送至外部显示设备进行显示;将该设置界面发送至外部显示设备进行显示;将该目标显示画面发送至外部显示设备进行显示。In a fifth aspect, an embodiment of the present application provides a terminal, where the terminal is connected to an external display device, where the terminal includes a processor, a memory, and a transceiver connected by a bus, where the processor is configured to generate an initial display for the external display device. a setting interface for adjusting a display screen size of the external display device; generating a target display screen for the external display device, the target display screen having the same size as the initial display screen, and the display content of the target area in the target display screen Obtained by the initial display screen, the size of the target area is the target screen size; the transceiver is configured to send the initial display screen to an external display device for display; and send the setting interface to the external display device Display; send the target display to an external display device for display.
第六方面,本申请实施例提供一种计算机可读存储介质,该计算机可读存储介质中存储有指令,当该指令在上述任一项终端上运行时,使得终端执行上述任一项图像处理方法。In a sixth aspect, an embodiment of the present application provides a computer readable storage medium, where the computer readable storage medium stores an instruction, when the instruction is run on any one of the foregoing terminals, causing the terminal to perform any of the foregoing image processing. method.
第七方面,本申请实施例提供一种包含指令的计算机程序产品,当其在上述任一项终端上运行时,使得终端执行上述任一项图像处理方法。In a seventh aspect, an embodiment of the present application provides a computer program product including instructions, when the terminal runs on any of the foregoing terminals, causing the terminal to execute any of the above image processing methods.
本申请的实施例中,上述终端中各部件的名字对设备本身不构成限定,在实际实 现中,这些部件可以以其他名称出现。只要各个部件的功能和本申请的实施例类似,即属于本申请权利要求及其等同技术的范围之内。In the embodiment of the present application, the names of the components in the terminal are not limited to the device itself, and the actual implementation is These parts can now appear under other names. As long as the functions of the various components are similar to the embodiments of the present application, they are within the scope of the claims and their equivalents.
另外,第二方面至第七方面中任一种设计方式所带来的技术效果可参见上述第一方面中不同设计方法所带来的技术效果,此处不再赘述。In addition, the technical effects brought by the design method of any one of the second aspect to the seventh aspect can be referred to the technical effects brought by different design methods in the above first aspect, and details are not described herein again.
附图说明DRAWINGS
图1为现有技术中过扫描的应用场景示意图;1 is a schematic diagram of an application scenario of overscan in the prior art;
图2为本申请实施例提供的一种图像处理方法的应用场景示意图一;FIG. 2 is a schematic diagram 1 of an application scenario of an image processing method according to an embodiment of the present disclosure;
图3为本申请实施例提供的一种图像处理方法的应用场景示意图二;FIG. 3 is a schematic diagram 2 of an application scenario of an image processing method according to an embodiment of the present disclosure;
图4为本申请实施例提供的一种图像处理方法的应用场景示意图三;FIG. 4 is a schematic diagram 3 of an application scenario of an image processing method according to an embodiment of the present disclosure;
图5为本申请实施例提供的一种终端的结构示意图;FIG. 5 is a schematic structural diagram of a terminal according to an embodiment of the present application;
图6为本申请实施例提供的一种图像处理方法的应用场景示意图四;FIG. 6 is a schematic diagram 4 of an application scenario of an image processing method according to an embodiment of the present disclosure;
图7为本申请实施例提供的一种图像处理方法的应用场景示意图五;FIG. 7 is a schematic diagram 5 of an application scenario of an image processing method according to an embodiment of the present disclosure;
图8为本申请实施例提供的一种图像处理方法的交互示意图;FIG. 8 is a schematic diagram of interaction of an image processing method according to an embodiment of the present application;
图9为本申请实施例提供的一种图像处理方法的应用场景示意图六;FIG. 9 is a schematic diagram 6 of an application scenario of an image processing method according to an embodiment of the present disclosure;
图10为本申请实施例提供的一种图像处理方法的应用场景示意图七;FIG. 10 is a schematic diagram 7 of an application scenario of an image processing method according to an embodiment of the present disclosure;
图11为本申请实施例提供的一种图像处理方法的应用场景示意图八;FIG. 11 is a schematic diagram 8 of an application scenario of an image processing method according to an embodiment of the present disclosure;
图12为本申请实施例提供的一种图像处理方法的应用场景示意图九;FIG. 12 is a schematic diagram 9 of an application scenario of an image processing method according to an embodiment of the present disclosure;
图13为本申请实施例提供的一种图像处理方法的应用场景示意图十;FIG. 13 is a schematic diagram of an application scenario of an image processing method according to an embodiment of the present disclosure;
图14为本申请实施例提供的一种图像处理方法的应用场景示意图十一;FIG. 14 is a schematic diagram of an application scenario of an image processing method according to an embodiment of the present disclosure;
图15为本申请实施例提供的一种图像处理方法的应用场景示意图十二;FIG. 15 is a schematic diagram of an application scenario of an image processing method according to an embodiment of the present application;
图16A为本申请实施例提供的一种图像处理方法的应用场景示意图十三;FIG. 16 is a schematic diagram of an application scenario of an image processing method according to an embodiment of the present application;
图16B为本申请实施例提供的一种图像处理方法的应用场景示意图十四;16B is a schematic diagram of an application scenario of an image processing method according to an embodiment of the present disclosure;
图17为本申请实施例提供的一种图像处理方法的应用场景示意图十五;FIG. 17 is a schematic diagram of an application scenario of an image processing method according to an embodiment of the present application;
图18为本申请实施例提供的一种图像处理方法的应用场景示意图十六;FIG. 18 is a schematic diagram of an application scenario of an image processing method according to an embodiment of the present application;
图19为本申请实施例提供的一种终端的结构示意图二;FIG. 19 is a schematic structural diagram 2 of a terminal according to an embodiment of the present disclosure;
图20为本申请实施例提供的一种终端的结构示意图三。FIG. 20 is a schematic structural diagram 3 of a terminal according to an embodiment of the present application.
具体实施方式Detailed ways
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本申请实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。In the following, the terms "first" and "second" are used for descriptive purposes only, and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, features defining "first" and "second" may include one or more of the features either explicitly or implicitly. In the description of the embodiments of the present application, "multiple" means two or more unless otherwise stated.
本申请实施例提供的一种终端的图像处理方法可以应用于终端,具体可以应用于终端连接外部显示设备时,将终端的显示画面投射到外部显示设备上显示的过程中。The image processing method of the terminal provided by the embodiment of the present invention can be applied to the terminal, and can be specifically applied to the process of displaying the display screen of the terminal to the display on the external display device when the terminal is connected to the external display device.
其中,在本申请实施例中,终端可以通过转接设备与外部显示设备连接,或者终端可以通过无线连接的方式与外部显示设备连接。并且,当终端连接外部显示设备时,该外部显示设备可以连接外部设备(如键盘和/或鼠标),该外部显示设备也可以不连接外部设备。In the embodiment of the present application, the terminal may be connected to the external display device through the switching device, or the terminal may be connected to the external display device by way of wireless connection. Moreover, when the terminal is connected to the external display device, the external display device can be connected to an external device (such as a keyboard and/or a mouse), and the external display device can also be connected to the external device.
例如,本发明实施例中的终端可以是手机、平板电脑、可穿戴设备、增强现 实(augmented reality,AR)\虚拟现实(virtual reality,VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本、个人数字助理(personal digital assistant,PDA)等,本发明实施例对此不作任何限制。本发明实施例中的外部显示设备可以为PC的显示器、电视机、平板电脑或者投影仪等任一显示装置。For example, the terminal in the embodiment of the present invention may be a mobile phone, a tablet computer, a wearable device, and an enhanced present. Augmented reality (AR)\virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), etc. The embodiment of the invention does not impose any limitation on this. The external display device in the embodiment of the present invention may be any display device such as a display of a PC, a television, a tablet, or a projector.
示例性的,以下以上述终端为手机,外部显示设备为显示器为例,对终端与外部显示设备的连接方式进行介绍:Exemplarily, the following describes the connection mode between the terminal and the external display device by using the above terminal as the mobile phone and the external display device as the display:
如图2所示,手机110可以通过转接设备130连接显示器120。其中,转接设备130可以插接手机数据线的通用串行总线(Universal Serial Bus,USB)接口,终端数据线的Type-c接口插接在手机110上。转接设备130还可以通过转接线连接显示器120,该转接线可以包括高清晰度多媒体接口(high definition multimedia interface,HDMI)连接线、视频图形阵列(video graphics array,AGI)连接线、数字视频接口(digital visual interface,DVI)连接线等中的任一个。As shown in FIG. 2, the handset 110 can be connected to the display 120 via the transit device 130. The switching device 130 can be connected to a Universal Serial Bus (USB) interface of the mobile phone data line, and the Type-c interface of the terminal data line is plugged into the mobile phone 110. The switching device 130 can also be connected to the display 120 through a patch cord, which can include a high definition multimedia interface (HDMI) cable, a video graphics array (AGI) cable, and a digital video interface. (digital visual interface, DVI) connection line or the like.
其中,本发明实施例中的转接设备130可以为移动终端高清连接(mobile high-definition link,MHL)设备,该MHL设备可以将移动终端(如手机)中的音频或者视频信号同时传输到外接显示设备(即上述显示器120)上显示。The switching device 130 in the embodiment of the present invention may be a mobile high-definition link (MHL) device, and the MHL device can simultaneously transmit audio or video signals in the mobile terminal (such as a mobile phone) to the external device. Displayed on the display device (ie, display 120 described above).
或者,如图3所示,手机110可以通过无线连接201与显示器120连接。其中,该无线连接201具体可以为蓝牙连接或者无线保真(wireless-fidelity,Wi-Fi)连接等。Alternatively, as shown in FIG. 3, the handset 110 can be coupled to the display 120 via a wireless connection 201. The wireless connection 201 may specifically be a Bluetooth connection or a wireless-fidelity (Wi-Fi) connection.
如图2或图3所示,手机110与显示器120建立连接后,转接设备130可以不连接键盘和/或鼠标,由手机110作为触控板控制外部显示设备。或者,转接设备130上还可以包括用于连接键盘和鼠标的接口,用于插接键盘和鼠标的连接线。当然,键盘和键盘和鼠标也可以通过无线方式连接手机110。As shown in FIG. 2 or FIG. 3, after the mobile phone 110 is connected to the display 120, the switching device 130 can be connected to the external display device without using a keyboard and/or a mouse. Alternatively, the switching device 130 may further include an interface for connecting a keyboard and a mouse for connecting a keyboard and a mouse. Of course, the keyboard and keyboard and mouse can also be connected to the mobile phone 110 wirelessly.
可选的,手机还可以通过如图4所示的Dock设备122与显示器120连接。其中,手机110还可以连接键盘和鼠标。例如,键盘和鼠标可以通过连接线与Dock设备122连接,或者,键盘和鼠标可以通过无线连接的方式与手机110或者Dock设备122连接。其中,该Dock设备122可以是上述MHL设备的一种。Alternatively, the handset can also be connected to the display 120 via a Dock device 122 as shown in FIG. The mobile phone 110 can also be connected to a keyboard and a mouse. For example, the keyboard and mouse can be connected to the Dock device 122 via a cable, or the keyboard and mouse can be connected to the handset 110 or Dock device 122 by way of a wireless connection. The Dock device 122 can be one of the above MHL devices.
如图5所示,为上述手机110的结构示意图。应该理解的是,图示手机110仅是上述终端的一个范例,并且手机110可以具有比图中所示出的更多的或者更少的部件,可以组合两个或更多的部件,或者可以具有不同的部件配置。As shown in FIG. 5, it is a schematic structural diagram of the above-mentioned mobile phone 110. It should be understood that the illustrated mobile phone 110 is only one example of the above terminal, and the mobile phone 110 may have more or fewer components than those shown in the figure, two or more components may be combined, or Has a different component configuration.
如图5所示,手机110具体可以包括:处理器101、射频(radio frequency,RF)电路102、存储器103、触摸屏104、蓝牙装置105、一个或多个传感器106、无线保真(WIreless-Fidelity,Wi-Fi)装置107、定位装置108、音频电路109、外设接口110以及电源系统111等部件。这些部件可通过一根或多根通信总线或信号线(图5中未示出)进行通信。本领域技术人员可以理解,图5中示出的硬件结构并不构成对手机的限定,手机110可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。As shown in FIG. 5, the mobile phone 110 may specifically include: a processor 101, a radio frequency (RF) circuit 102, a memory 103, a touch screen 104, a Bluetooth device 105, one or more sensors 106, and wireless fidelity (WIreless-Fidelity). Wi-Fi device 107, positioning device 108, audio circuit 109, peripheral interface 110, and power system 111 and the like. These components can communicate over one or more communication buses or signal lines (not shown in Figure 5). Those skilled in the art will appreciate that the hardware structure illustrated in FIG. 5 does not constitute a limitation to a handset, and that handset 110 may include more or fewer components than those illustrated, or some components may be combined, or different components may be arranged.
下面结合图5对手机110的各个部件进行具体的介绍: The various components of the mobile phone 110 will be specifically described below with reference to FIG. 5:
处理器101是手机110的控制中心,利用各种接口和线路连接手机110的各个部分,通过运行或执行存储在存储器103内的应用程序,以及调用存储在存储器103内的数据,执行手机110的各种功能和处理数据。在一些实施例中,处理器101可包括一个或多个处理单元;举例来说,处理器101可以是华为技术有限公司制造的麒麟960芯片。在本申请一些实施例中,上述处理器101还可以包括指纹验证芯片,用于对采集到的指纹进行验证。The processor 101 is a control center of the mobile phone 110, and connects various parts of the mobile phone 110 using various interfaces and lines, and executes the mobile phone 110 by running or executing an application stored in the memory 103 and calling data stored in the memory 103. Various functions and processing data. In some embodiments, the processor 101 may include one or more processing units; for example, the processor 101 may be a Kirin 960 chip manufactured by Huawei Technologies Co., Ltd. In some embodiments of the present application, the processor 101 may further include a fingerprint verification chip for verifying the collected fingerprint.
射频电路102可用于在收发信息或通话过程中,无线信号的接收和发送。特别地,射频电路102可以将基站的下行数据接收后,给处理器101处理;另外,将涉及上行的数据发送给基站。通常,射频电路包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等。此外,射频电路102还可以通过无线通信和其他设备通信。所述无线通信可以使用任一通信标准或协议,包括但不限于全球移动通讯系统、通用分组无线服务、码分多址、宽带码分多址、长期演进、电子邮件、短消息服务等。The radio frequency circuit 102 can be used to receive and transmit wireless signals during transmission or reception of information or calls. In particular, the radio frequency circuit 102 can process the downlink data of the base station and then process it to the processor 101; in addition, transmit the data related to the uplink to the base station. Generally, radio frequency circuits include, but are not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency circuit 102 can also communicate with other devices through wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to global mobile communication systems, general packet radio services, code division multiple access, wideband code division multiple access, long term evolution, email, short message service, and the like.
存储器103用于存储应用程序以及数据,处理器101通过运行存储在存储器103的应用程序以及数据,执行手机110的各种功能以及数据处理。存储器103主要包括存储程序区以及存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等);存储数据区可以存储根据使用手机110时所创建的数据(比如音频数据、电话本等)。此外,存储器103可以包括高速随机存取存储器(ramdom access memory,RAM),还可以包括非易失存储器,例如磁盘存储器件、闪存器件或其他易失性固态存储器件等。存储器103可以存储各种操作系统,例如,苹果公司所开发的
Figure PCTCN2017110720-appb-000001
操作系统,谷歌公司所开发的
Figure PCTCN2017110720-appb-000002
操作系统等。上述存储器103可以是独立的,通过上述通信总线与处理器101相连接;存储器103也可以和处理器101集成在一起。
The memory 103 is used to store applications and data, and the processor 101 executes various functions of the mobile phone 110 and data processing by running applications and data stored in the memory 103. The memory 103 mainly includes a storage program area and a storage data area, wherein the storage program area can store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.); the storage data area can be stored according to the use of the mobile phone. Data created at 110 o'clock (such as audio data, phone book, etc.). Further, the memory 103 may include a high speed random access memory (RAM), and may also include a nonvolatile memory such as a magnetic disk storage device, a flash memory device, or other volatile solid state storage device. The memory 103 can store various operating systems, for example, developed by Apple.
Figure PCTCN2017110720-appb-000001
Operating system, developed by Google Inc.
Figure PCTCN2017110720-appb-000002
Operating system, etc. The above memory 103 may be independent and connected to the processor 101 via the above communication bus; the memory 103 may also be integrated with the processor 101.
触摸屏104具体可以包括触控板104-1和显示器104-2。The touch screen 104 may specifically include a touch panel 104-1 and a display 104-2.
其中,触控板104-1可采集手机110的用户在其上或附近的触摸事件(比如用户使用手指、触控笔等任何适合的物体在触控板104-1上或在触控板104-1附近的操作),并将采集到的触摸信息发送给其他器件(例如处理器101)。其中,用户在触控板104-1附近的触摸事件可以称之为悬浮触控;悬浮触控可以是指,用户无需为了选择、移动或拖动目标(例如图标等)而直接接触触控板,而只需用户位于终端附近以便执行所想要的功能。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型来实现触控板104-1。The touch panel 104-1 can collect touch events on or near the user of the mobile phone 110 (such as the user using a finger, a stylus, or the like on the touch panel 104-1 or on the touchpad 104. The operation near -1), and the collected touch information is sent to other devices (for example, processor 101). The touch event of the user in the vicinity of the touch panel 104-1 may be referred to as a hovering touch; the hovering touch may mean that the user does not need to directly touch the touchpad in order to select, move or drag a target (eg, an icon, etc.) And only the user is located near the terminal in order to perform the desired function. In addition, the touch panel 104-1 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
显示器(也可称为显示屏)104-2可用于显示由用户输入的信息或提供给用户的信息以及手机110的各种菜单。可以采用液晶显示器、有机发光二极管等形式来配置显示器104-2。触控板104-1可以覆盖在显示器104-2之上,当触控板104-1检测到在其上或附近的触摸事件后,传送给处理器101以确定触摸事件的类型,随后处理器101可以根据触摸事件的类型在显示器104-2上提供相应的视觉输出。虽然在图5中,触控板104-1与显示屏104-2是作为两个独立的部件来实现手机110的输入和输出功能,但是在某些实施例中,可以将触控板104-1与显示屏104-2 集成而实现手机110的输入和输出功能。A display (also referred to as display) 104-2 can be used to display information entered by the user or information provided to the user as well as various menus of the handset 110. The display 104-2 can be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The touchpad 104-1 can be overlaid on the display 104-2, and when the touchpad 104-1 detects a touch event on or near it, it is transmitted to the processor 101 to determine the type of touch event, and then the processor 101 may provide a corresponding visual output on display 104-2 depending on the type of touch event. Although in FIG. 5, the touchpad 104-1 and the display 104-2 are implemented as two separate components to implement the input and output functions of the handset 110, in some embodiments, the touchpad 104- 1 and display 104-2 Integration and implementation of the input and output functions of the handset 110.
可以理解的是,触摸屏104是由多层的材料堆叠而成,本申请实施例中只展示出了触控板(层)和显示屏(层),其他层在本申请实施例中不予记载。另外,触控板104-1可以以全面板的形式配置在手机110的正面,显示屏104-2也可以以全面板的形式配置在手机110的正面,这样在手机的正面就能够实现无边框的结构。It is to be understood that the touch screen 104 is formed by stacking a plurality of layers of materials. In the embodiment of the present application, only the touch panel (layer) and the display screen (layer) are shown, and other layers are not described in the embodiment of the present application. . In addition, the touch panel 104-1 may be disposed on the front surface of the mobile phone 110 in the form of a full-board, and the display screen 104-2 may also be disposed on the front surface of the mobile phone 110 in the form of a full-board, so that the front side of the mobile phone can be borderless. Structure.
手机110还可以包括蓝牙装置105,用于实现手机110与其他短距离的终端(例如手机、智能手表等)之间的数据交换。本申请实施例中的蓝牙装置可以是集成电路或者蓝牙芯片等。The mobile phone 110 may also include a Bluetooth device 105 for enabling data exchange between the handset 110 and other short-range terminals (eg, mobile phones, smart watches, etc.). The Bluetooth device in the embodiment of the present application may be an integrated circuit or a Bluetooth chip or the like.
手机110还可以包括至少一种传感器106,比如指纹采集器件112、光传感器、运动传感器以及其他传感器。具体地,可以在手机110的背面(例如后置摄像头的下方)配置指纹采集器件112,或者在手机110的正面(例如触摸屏104的下方)配置指纹采集器件112。又例如,可以在触摸屏104中配置指纹采集器件112来实现指纹识别功能,即指纹采集器件112可以与触摸屏104集成在一起来实现手机110的指纹识别功能;光传感器可包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节触摸屏104的显示器的亮度,接近传感器可在手机110移动到耳边时,关闭显示器的电源。作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别手机姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;至于手机110还可配置的陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器,在此不再赘述。The handset 110 may also include at least one sensor 106, such as a fingerprint acquisition device 112, a light sensor, a motion sensor, and other sensors. Specifically, the fingerprint capture device 112 can be configured on the back of the handset 110 (eg, below the rear camera) or on the front side of the handset 110 (eg, below the touch screen 104). For another example, the fingerprint collection device 112 can be configured in the touch screen 104 to implement the fingerprint recognition function, that is, the fingerprint collection device 112 can be integrated with the touch screen 104 to implement the fingerprint recognition function of the mobile phone 110; the light sensor can include an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display of the touch screen 104 according to the brightness of the ambient light, and the proximity sensor can turn off the power of the display when the mobile phone 110 moves to the ear. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the gesture of the mobile phone (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc. As for the mobile phone 110 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here Let me repeat.
Wi-Fi装置107,用于为手机110提供遵循Wi-Fi相关标准协议的网络接入,手机110可以通过Wi-Fi装置107接入到Wi-Fi接入点,进而帮助用户收发电子邮件、浏览网页和访问流媒体等,它为用户提供了无线的宽带互联网访问。在其他一些实施例中,该Wi-Fi装置107也可以作为Wi-Fi无线接入点,可以为其他终端提供Wi-Fi网络接入。The Wi-Fi device 107 is configured to provide the mobile phone 110 with network access complying with the Wi-Fi related standard protocol, and the mobile phone 110 can access the Wi-Fi access point through the Wi-Fi device 107, thereby helping the user to send and receive emails. Browsing web pages and accessing streaming media, etc., it provides users with wireless broadband Internet access. In some other embodiments, the Wi-Fi device 107 can also function as a Wi-Fi wireless access point, and can provide Wi-Fi network access to other terminals.
定位装置108,用于为手机110提供地理位置。可以理解的是,该定位装置108具体可以是全球定位系统(global positioning system,GPS)或北斗卫星导航系统、俄罗斯GLONASS等定位系统的接收器。定位装置108在接收到上述定位系统发送的地理位置后,将该信息发送给处理器101进行处理,或者发送给存储器103进行保存。在另外的一些实施例中,该定位装置108还可以是辅助全球卫星定位系统(assisted global positioning system,AGPS)的接收器,AGPS系统通过作为辅助服务器来协助定位装置108完成测距和定位服务,在这种情况下,辅助定位服务器通过无线通信网络与终端例如手机110的定位装置108(即GPS接收器)通信而提供定位协助。在另外的一些实施例中,该定位装置108也可以是基于Wi-Fi接入点的定位技术。由于每一个Wi-Fi接入点都有一个全球唯一的媒体介入控制(media access control,MAC)地址,终端在开启Wi-Fi的情况下即可扫描并收集周围的Wi-Fi接入点的广播信号,因此可以获取到Wi-Fi接入点广播出来 的MAC地址;终端将这些能够标示Wi-Fi接入点的数据(例如MAC地址)通过无线通信网络发送给位置服务器,由位置服务器检索出每一个Wi-Fi接入点的地理位置,并结合Wi-Fi广播信号的强弱程度,计算出该终端的地理位置并发送到该终端的定位装置108中。The positioning device 108 is configured to provide a geographic location for the mobile phone 110. It can be understood that the positioning device 108 can be specifically a receiver of a positioning system such as a global positioning system (GPS) or a Beidou satellite navigation system, and a Russian GLONASS. After receiving the geographical location transmitted by the positioning system, the positioning device 108 sends the information to the processor 101 for processing, or sends it to the memory 103 for storage. In still other embodiments, the positioning device 108 may also be an assisted global positioning system (AGPS) receiver, and the AGPS system assists the positioning device 108 in performing ranging and positioning services by acting as an auxiliary server. In this case, the secondary location server provides location assistance over a wireless communication network in communication with a location device 108 (i.e., a GPS receiver) of the terminal, such as handset 110. In still other embodiments, the positioning device 108 can also be a Wi-Fi access point based positioning technology. Since each Wi-Fi access point has a globally unique media access control (MAC) address, the terminal can scan and collect the surrounding Wi-Fi access points when Wi-Fi is turned on. Broadcast signal, so you can get the Wi-Fi access point to broadcast MAC address; the terminal sends the data (such as the MAC address) capable of indicating the Wi-Fi access point to the location server through the wireless communication network, and the location server retrieves the geographic location of each Wi-Fi access point and combines The degree of strength of the Wi-Fi broadcast signal is calculated and the geographic location of the terminal is calculated and sent to the location device 108 of the terminal.
音频电路109、扬声器113、麦克风114可提供用户与手机110之间的音频接口。音频电路109可将接收到的音频数据转换后的电信号,传输到扬声器113,由扬声器113转换为声音信号输出;另一方面,麦克风114将收集的声音信号转换为电信号,由音频电路109接收后转换为音频数据,再将音频数据输出至RF电路102以发送给比如另一手机,或者将音频数据输出至存储器103以便进一步处理。The audio circuit 109, the speaker 113, and the microphone 114 can provide an audio interface between the user and the handset 110. The audio circuit 109 can transmit the converted electrical data of the received audio data to the speaker 113 for conversion to the sound signal output by the speaker 113; on the other hand, the microphone 114 converts the collected sound signal into an electrical signal by the audio circuit 109. After receiving, it is converted into audio data, and then the audio data is output to the RF circuit 102 for transmission to, for example, another mobile phone, or the audio data is output to the memory 103 for further processing.
外设接口110,用于为外部的输入/输出设备(例如键盘、鼠标、外接显示器、外部存储器、用户识别模块卡等)提供各种接口。例如通过通用串行总线(universal serial bus,USB)接口与鼠标连接,通过用户识别模块卡卡槽上的金属触点与电信运营商提供的用户识别模块卡(subscriber identification module,SIM)卡进行连接。外设接口110可以被用来将上述外部的输入/输出外围设备耦接到处理器101和存储器103。The peripheral interface 110 is used to provide various interfaces for external input/output devices (such as a keyboard, a mouse, an external display, an external memory, a subscriber identity module card, etc.). For example, it is connected to the mouse through a universal serial bus (USB) interface, and is connected with a subscriber identification module (SIM) card provided by the telecommunication operator through a metal contact on the card slot of the subscriber identification module. . Peripheral interface 110 can be used to couple the external input/output peripherals described above to processor 101 and memory 103.
手机110还可以包括给各个部件供电的电源装置111(比如电池和电源管理芯片),电池可以通过电源管理芯片与处理器101逻辑相连,从而通过电源装置111实现管理充电、放电、以及功耗管理等功能。The mobile phone 110 may further include a power supply device 111 (such as a battery and a power management chip) that supplies power to the various components. The battery may be logically connected to the processor 101 through the power management chip to manage charging, discharging, and power management through the power supply device 111. And other functions.
尽管图5未示出,手机110还可以包括摄像头(前置摄像头和/或后置摄像头)、闪光灯、微型投影装置、近场通信(NFC near field communication,NFC)装置等,在此不予赘述。Although not shown in FIG. 5, the mobile phone 110 may further include a camera (front camera and/or rear camera), a flash, a micro projection device, a near field communication (NFC) device, etc., and will not be described herein. .
在本申请实施例中,当手机110与外部显示设备120建立连接后,手机110相当于拥有了两个显示器,一个是手机110自身的显示器,另一个是与其连接的外部显示设备120的显示器。手机110可以通过同源显示或异源显示的方法,将手机110上安装的应用投射至外部显示设备120的显示器上。In the embodiment of the present application, when the mobile phone 110 is connected to the external display device 120, the mobile phone 110 is equivalent to having two displays, one is the display of the mobile phone 110 itself, and the other is the display of the external display device 120 connected thereto. The mobile phone 110 can project an application installed on the mobile phone 110 to the display of the external display device 120 by a method of homologous display or heterogeneous display.
其中,同源显示是指不同显示器,例如上述手机110的显示器以及外部显示设备120的显示器中显示画面的信号源是相同的;而异源显示,是指上述手机110的显示器中显示画面的信号源,与外部显示设备120的显示器中显示画面的信号源是独立的。The homologous display refers to different monitors, for example, the display of the mobile phone 110 and the display source of the display device of the external display device 120 are the same; and the heterogeneous display refers to the signal of the display screen of the mobile phone 110. The source is independent of the signal source of the display screen in the display of the external display device 120.
当手机110同源地将其安装的应用投射至外部显示设备120的显示器上时,如图6所示,在手机110与外部显示设备120建立连接之前,手机110将生成的待显示的显示内容存放在内存的指定位置(本申请中将存放屏幕上待显示的显示内容的区域称为屏幕容器)中。这样,手机110的显示器通过读取屏幕容器中的显示内容便可进行相关画面的显示。当手机110与外部显示设备120建立连接后,仍如图6所示,手机110可将屏幕容器中显示内容发送给外部显示设备120,使得外部显示设备120显示与手机110相同的显示内容,实现手机110与外部显示设备120的同步显示。When the mobile phone 110 homogenously projects its installed application onto the display of the external display device 120, as shown in FIG. 6, before the mobile phone 110 establishes a connection with the external display device 120, the mobile phone 110 will generate the displayed display content to be displayed. Stored in a specified location in the memory (the area in the application where the display content to be displayed on the screen is to be referred to as a screen container). In this way, the display of the mobile phone 110 can display the related picture by reading the display content in the screen container. After the mobile phone 110 establishes a connection with the external display device 120, as shown in FIG. 6, the mobile phone 110 can transmit the display content in the screen container to the external display device 120, so that the external display device 120 displays the same display content as the mobile phone 110. The mobile phone 110 is displayed in synchronization with the external display device 120.
当手机110异源地将其安装的应用投射至外部显示设备120的显示器上时,如图7所示,在手机110与外部显示设备120建立连接之前,手机110将生成的待显示的显示内容1存放在内存的屏幕容器1中,这样,手机110的显示器通过读取屏幕容器 1中的显示内容1便可进行相关画面的显示。When the mobile phone 110 heterogeneously projects its installed application onto the display of the external display device 120, as shown in FIG. 7, before the mobile phone 110 establishes a connection with the external display device 120, the mobile phone 110 will generate the displayed display content to be displayed. 1 is stored in the screen container 1 of the memory, such that the display of the mobile phone 110 is read by the screen container The display content 1 in 1 can display the related screen.
当手机110与外部显示设备120建立连接后,手机110可以识别出与其连接的外部显示设备120的显示器的相关规格信息,例如,外部显示设备120显示器的分辨率以及每英寸点数(dots per inch,DPI)等。此时,手机110可按照外部显示设备120显示器的规格信息,在自身的内存中为外部显示设备120建立一个独立的屏幕容器,即图7中的屏幕容器2,其中,屏幕容器2与屏幕容器1可以通过不同的显示标识(display ID)区分。When the mobile phone 110 establishes a connection with the external display device 120, the mobile phone 110 can identify relevant specification information of the display of the external display device 120 connected thereto, for example, the resolution of the display of the external display device 120 and the dots per inch (dots per inch, DPI) and so on. At this time, the mobile phone 110 can establish a separate screen container for the external display device 120 in its own memory according to the specification information of the display of the external display device 120, that is, the screen container 2 in FIG. 7, wherein the screen container 2 and the screen container 1 can be distinguished by different display IDs.
一般,对于及支持在手机110上显示,又支持在外部显示设备120上显示的应用而言,这类应用一般在手机110中存储有两份显示资源,一份显示资源对应于手机110,另一份显示资源对应于外部显示设备120,同样的显示内容(例如应用的图标)在不同显示资源中的布局和显示效果可能不同。那么,手机110与外部显示设备120连接建立后,仍如图7所示,手机110可读取为外部显示设备120存储的显示资源,将该显示资源中的应用图标、图标布局以及状态栏等桌面显示内容存放至屏幕容器2中。这样,手机110将屏幕容器2中的显示内容发送给外部显示设备120后,便可将手机110上安装的各个应用的图标和/或界面独立的投射至外部显示设备120的显示器上。后续,手机110和外部显示设备120根据各自的屏幕容器中的显示内容,便可以在同一操作系统下独立的运行两个显示画面。Generally, for an application that supports display on the mobile phone 110 and supports display on the external display device 120, such an application generally stores two display resources in the mobile phone 110, one display resource corresponding to the mobile phone 110, and another display resource corresponding to the mobile phone 110. One display resource corresponds to the external display device 120, and the same display content (eg, an icon of an application) may have different layouts and display effects in different display resources. Then, after the mobile phone 110 is connected to the external display device 120, as shown in FIG. 7, the mobile phone 110 can read the display resource stored by the external display device 120, the application icon, the icon layout, the status bar, and the like in the display resource. The desktop display content is stored in the screen container 2. In this way, after the mobile phone 110 transmits the display content in the screen container 2 to the external display device 120, the icons and/or interfaces of the respective applications installed on the mobile phone 110 can be independently projected onto the display of the external display device 120. Subsequently, the mobile phone 110 and the external display device 120 can independently run two display screens under the same operating system according to the display contents in the respective screen containers.
当然,在图7所示的异源投射系统中,屏幕容器1中的显示内容也可以与屏幕容器2中的显示内容相同,例如,屏幕容器1中的显示内容和屏幕容器2中的显示内容均为视频A第10分钟的显示界面。这样,可以将手机110的显示器中的显示内容同步显示在外部显示设备120的显示器中。Of course, in the heterogeneous projection system shown in FIG. 7, the display content in the screen container 1 may also be the same as the display content in the screen container 2, for example, the display content in the screen container 1 and the display content in the screen container 2. It is the display interface of the 10th minute of video A. In this way, the display content in the display of the mobile phone 110 can be simultaneously displayed in the display of the external display device 120.
需要说明的是,上述屏幕容器具体可以是终端(例如手机110)在运行任务队列内的各个任务时,用于存储任务队列中每个任务生成的显示内容的缓存队列。通常,位于任务队列队头的任务即为当前终端正在运行的任务,终端在运行该任务时生成的显示内容可存储至缓存队列的队头,终端的显示器总是读取缓存队列中位于队头的显示内容进行显示。It should be noted that the above-mentioned screen container may specifically be a cache queue for storing the display content generated by each task in the task queue when the terminal (for example, the mobile phone 110) runs each task in the task queue. Generally, the task at the head of the task queue is the task that the current terminal is running. The display content generated by the terminal when running the task can be stored in the queue head of the cache queue. The display of the terminal always reads the queue queue. The display content is displayed.
以下,将结合图2-图7所示的屏幕投射原理,详细阐述本申请实施例提供的一种终端的图像处理方法,如图8所示,该方法包括:In the following, the image processing method of the terminal provided by the embodiment of the present application is described in detail in conjunction with the principle of the screen projection shown in FIG. 2 to FIG. 7. As shown in FIG. 8, the method includes:
S701、终端连接外部显示设备。S701. The terminal is connected to an external display device.
示例性的,如图2-图4中任一附图所示,终端可以通过有线连接或者无线连接的方式连接外部显示设备。Exemplarily, as shown in any of Figures 2 to 4, the terminal can connect to the external display device by means of a wired connection or a wireless connection.
S702、所述终端确定后续向所述外部显示设备发送显示画面时的显示画面尺寸。S702. The terminal determines a display screen size when the display screen is subsequently sent to the external display device.
当终端与外部显示设备连接时,终端可检测到外部显示设备的分辨率等显示参数,进而确定后续需要向外部显示设备发送的显示画面的显示画面尺寸。例如,外部显示设备支持1080P格式的图像显示,那么,终端可确定后续向外部显示设备发送的显示画面的显示画面尺寸为与1080P格式对应的1920×1080分辨率大小的显示画面。When the terminal is connected to the external display device, the terminal can detect display parameters such as the resolution of the external display device, and further determine the display screen size of the display screen that needs to be sent to the external display device. For example, if the external display device supports the image display in the 1080P format, the terminal may determine that the display screen size of the display screen sent to the external display device is a display screen of 1920×1080 resolution corresponding to the 1080P format.
例如,终端可以在其显示屏显示如图2或图3所示的“大屏投射欢迎界面”117。同时,终端可以为外部显示设备生成“欢迎使用大屏投射”提示语121,并将该提示 语121发送给外部显示设备,使得外部显示设备显示如图2或图3所示的“欢迎使用大屏投射”提示语121。For example, the terminal may display a "large screen projection welcome interface" 117 as shown in FIG. 2 or FIG. 3 on its display screen. At the same time, the terminal can generate a "Welcome to use large screen projection" prompt 121 for the external display device, and the prompt The language 121 is sent to the external display device such that the external display device displays the "Welcome to Use Large Screen Projection" prompt 121 as shown in FIG. 2 or FIG.
示例性的,以图2为例,终端可在“大屏投射欢迎界面”117中显示进行大屏投射功能的操作说明。当用户点击图2中终端所示的“大屏投射欢迎界面”117中的“跳过”选项113,或者在终端显示图2所示的“大屏投射欢迎界面”117一定时间后,终端可以在终端的显示屏显示如图9所示的终端界面801,并按照确定好的显示画面尺寸在外部显示设备显示如图9所示的大屏界面802。Exemplarily, with FIG. 2 as an example, the terminal may display an operation description for performing a large screen projection function in the “large screen projection welcome interface” 117. When the user clicks the "Skip" option 113 in the "Large Screen Projection Welcome Screen" 117 shown in the terminal in FIG. 2, or after the terminal displays the "Large Screen Projection Welcome Screen" 117 shown in FIG. 2 for a certain period of time, the terminal can A terminal interface 801 as shown in FIG. 9 is displayed on the display screen of the terminal, and a large screen interface 802 as shown in FIG. 9 is displayed on the external display device according to the determined display screen size.
其中,外部显示设备在显示大屏界面802时,如果外部显示设备的系统设置中预先选中了overscan的选项,则外部显示设备会将从终端发送的大屏界面802中截取位于中心95%的显示内容进行显示。此时,如图10所示,外部显示设备的显示画面为大屏界面802’,由于外部显示设备进行overscan时位于原大屏界面802边缘的一些显示内容没有被提取到,因此overscan后大屏界面802’上的边缘803会呈现不完整的显示画面。When the external display device displays the large screen interface 802, if the option of the overscan is selected in the system setting of the external display device, the external display device intercepts the display at the center of the large screen interface 802 sent from the terminal by 95%. The content is displayed. At this time, as shown in FIG. 10, the display screen of the external display device is a large screen interface 802'. Since the display content of the original large screen interface 802 is not extracted when the external display device performs overscan, the large screen after overscan Edge 803 on interface 802' may present an incomplete display.
S703、外部显示设备显示用于调整外部显示设备的显示画面尺寸的设置界面。S703. The external display device displays a setting interface for adjusting a display screen size of the external display device.
在步骤S702中,为了避免终端向外部显示设备投射屏幕时出现因overscan导致的显示画面不完整的现象,在终端与外部显示设备建立连接,完成外部显示设备显示器的初始化过程之后,如图11所示,外部显示设备可显示用于调整其显示画面尺寸的设置界面1001。In step S702, in order to avoid the phenomenon that the display screen is incomplete due to overscan when the terminal projects the screen to the external display device, after the terminal establishes a connection with the external display device to complete the initialization process of the display of the external display device, as shown in FIG. The external display device can display a setting interface 1001 for adjusting the size of its display screen.
示例性的,用户可通过鼠标在外部显示设备的大屏界面802(或大屏界面802’)上执行右键操作,外部显示设备将用户输入的右键操作发送给终端,终端响应于该右键操作为外部显示设备生成右键菜单,并将该右键菜单发送给外部显示设备进行显示。其中,右键菜单中可以包括用于调整显示画面尺寸的屏幕设置选项,那么,当外部显示设备检测到用户在上述右键菜单中选中该屏幕设置选项时,可向终端请求显示设置界面1001。终端接收到外部显示设备的请求后,为外部显示设备生成图11所示的设置界面1001,并发送给外部显示设备进行显示。Exemplarily, the user can perform a right-click operation on the large-screen interface 802 (or the large-screen interface 802') of the external display device by using a mouse, and the external display device sends the right-click operation input by the user to the terminal, and the terminal responds to the right-click operation as The external display device generates a right-click menu and sends the right-click menu to the external display device for display. The right-click menu may include a screen setting option for adjusting the size of the display screen. Then, when the external display device detects that the user selects the screen setting option in the right-click menu, the display setting interface 1001 may be requested from the terminal. After receiving the request from the external display device, the terminal generates the setting interface 1001 shown in FIG. 11 for the external display device, and sends it to the external display device for display.
又或者,如图12所示,终端还可以进入模拟键鼠功能,在终端的显示屏显示如图12所示的触控板界面1101。这样,当用户手指1104接触图12所示的触控板界面1101,并在触控板界面1101移动时,可以控制图12所示的大屏界面1102中的光标相应移动。那么,用户可以通过触控板界面1101在外部显示设备上执行上述右键操作以及上述屏幕设置选项的选择操作,触发终端为外部显示设备生成图11所示的设置界面1001,并发送给外部显示设备进行显示。Alternatively, as shown in FIG. 12, the terminal can also enter the analog keyboard and mouse function, and the touch panel interface 1101 shown in FIG. 12 is displayed on the display screen of the terminal. Thus, when the user's finger 1104 contacts the touchpad interface 1101 shown in FIG. 12 and moves on the touchpad interface 1101, the corresponding movement of the cursor in the largescreen interface 1102 shown in FIG. 12 can be controlled. Then, the user can perform the above-mentioned right-click operation and the selection operation of the above-mentioned screen setting options on the external display device through the touch panel interface 1101, and trigger the terminal to generate the setting interface 1001 shown in FIG. 11 for the external display device, and send the setting interface 1001 to the external display device. Display.
又或者,当终端与外部显示设备连接成功后,可自动触发终端为外部显示设备生成图11所示的设置界面1001,并发送给外部显示设备进行显示,本申请实施例对此不做任何限制。Alternatively, after the terminal is successfully connected to the external display device, the terminal can automatically trigger the terminal to generate the setting interface 1001 shown in FIG. 11 for the external display device, and send the display interface 1001 to the external display device for display. .
具体的,该设置界面1001中可包括多个候选画面尺寸的大小。如图11所示,设置界面1001中包括三种候选画面尺寸,一种是显示画面充满屏幕的全屏画面尺寸1101,一种是显示画面占屏幕95%的适中画面尺寸1102,还有一种是显示画面占屏幕85%的较小画面尺寸1103。Specifically, the size of the plurality of candidate screen sizes may be included in the setting interface 1001. As shown in FIG. 11, the setting interface 1001 includes three candidate screen sizes, one is a full screen screen size 1101 in which the display screen is full of the screen, and the other is a moderate screen size 1102 in which the display screen accounts for 95% of the screen, and the other is a display. The screen occupies 85% of the screen with a smaller screen size of 1103.
并且,仍如图11所示,设置界面1001中还分别示出了每一种候选画面尺寸的画 面预览效果。其中,每一幅画面预览效果可以是外部显示设备未做overscan处理时任意显示画面的预览效果,也可以是按照overscan时对显示画面默认的提取比例(例如95%的画面提取比例)对任意显示画面进行overscan后的预览效果,本申请实施例对此不做任何限制。Moreover, as shown in FIG. 11, the setting interface 1001 also shows the painting of each candidate screen size. Preview the effect. The preview effect of each screen may be a preview effect of any display screen when the external display device does not perform overscan processing, or may be an arbitrary display ratio according to the default extraction ratio (for example, 95% of the screen extraction ratio) of the display screen according to overscan. The preview effect of the screen after the overscan is performed, and the embodiment of the present application does not impose any limitation on this.
以显示画面占屏幕95%的适中画面尺寸1102为例,终端在向外部显示设备传送后续待显示的显示画面(例如图9所示的大屏界面802)时,如图13所示,可将大屏界面802中的图像(即初始显示画面)由原始的全屏画面尺寸缩小95%,并将缩小95%后的图像调整至大屏界面的中心得到与初始显示画面大小相等的目标显示画面,此时,目标显示画面中位于中心95%的目标区域内为具有实质显示内容的有效画面。Taking the moderate screen size 1102 of the screen occupying 95% of the screen as an example, when the terminal transmits a subsequent display screen to be displayed to the external display device (for example, the large screen interface 802 shown in FIG. 9), as shown in FIG. The image in the large screen interface 802 (ie, the initial display screen) is reduced by 95% from the original full screen screen size, and the image reduced by 95% is adjusted to the center of the large screen interface to obtain a target display screen equal in size to the initial display screen. At this time, in the target display screen, 95% of the target area in the center is a valid screen having substantially displayed content.
那么,终端将目标显示画面发送给外部显示设备后,仍如图13所示,外部显示设备对接收到的目标显示画面进行overscan,即截取目标显示画面中心95%的画面。这样,外部显示设备截取到的画面刚好为目标显示画面中的有效画面,此时可在外部显示设备中显示完整的大屏界面802,克服因overscan导致的显示画面不完整的问题。因此,如图11所示,可将该适中画面尺寸1002作为推荐尺寸提示给用户。Then, after the terminal transmits the target display screen to the external display device, as shown in FIG. 13, the external display device overscans the received target display screen, that is, intercepts 95% of the screen of the target display screen center. In this way, the screen intercepted by the external display device is just the effective screen in the target display screen. At this time, the full large screen interface 802 can be displayed in the external display device to overcome the problem that the display screen is incomplete due to overscan. Therefore, as shown in FIG. 11, the moderate screen size 1002 can be presented to the user as the recommended size.
又例如,以显示画面占屏幕85%的较小画面尺寸1103为例,终端在向外部显示设备传送待显示的初始显示画面(仍以图9所示的大屏界面802为例)时,如图14所示,可将大屏界面802中的图像由原始的全屏画面尺寸缩小85%,并将缩小85%后的图像调整至大屏界面的中心得到与初始显示画面大小相等的目标显示画面,此时,目标显示画面中位于中心85%的目标区域内为具有实质显示内容的有效画面。For another example, the small screen size 1103 in which the display screen occupies 85% of the screen is taken as an example. When the terminal transmits the initial display screen to be displayed to the external display device (still taking the large screen interface 802 shown in FIG. 9 as an example), for example, As shown in FIG. 14, the image in the large screen interface 802 can be reduced by 85% from the original full screen screen size, and the image reduced by 85% can be adjusted to the center of the large screen interface to obtain a target display screen having the same size as the initial display screen. At this time, in the target display screen, 85% of the target area in the center is a valid screen having substantial display content.
那么,终端将目标显示画面发送给外部显示设备后,仍如图14所示,外部显示设备对接收到的目标显示画面进行overscan,即截取目标显示画面中心95%的画面进行显示。由于overscan时截取的画面大于上述有效画面,因此,外部显示设备在显示时仍可显示完整的大屏界面802。Then, after the terminal transmits the target display screen to the external display device, as shown in FIG. 14, the external display device overscans the received target display screen, that is, intercepts 95% of the screen of the target display screen center for display. Since the screen captured during overscan is larger than the above-mentioned effective screen, the external display device can still display the full large screen interface 802 when displayed.
在本申请的另一些实施例中,如图15所示,外部显示设备还可以将各个候选画面尺寸通过进度条1401的形式显示在设置界面1001中,用户通过拖动进度条1401的滑块1402可以改变进度条的进度,从而选择相应的候选画面尺寸作为后续外部显示设备显示时的目标画面尺寸。In other embodiments of the present application, as shown in FIG. 15, the external display device may also display each candidate screen size in the form of the progress bar 1401 in the setting interface 1001, and the user drags the slider 1402 of the progress bar 1401. The progress of the progress bar can be changed to select the corresponding candidate picture size as the target picture size when the subsequent external display device is displayed.
仍图15所示,用户在拖动滑块1402时,外部显示设备可在设置界面1001中显示滑块位置处候选画面尺寸的画面预览效果1403,以便用户根据画面预览效果选择符合自身使用习惯的画面尺寸。As shown in FIG. 15, when the user drags the slider 1402, the external display device can display the screen preview effect 1403 of the candidate screen size at the slider position in the setting interface 1001, so that the user selects the screen preview effect according to the usage habit. Picture size.
S704、响应于用户在上述设置界面的输入操作,终端得到用户选择的目标画面尺寸。S704. The terminal obtains a target screen size selected by the user in response to an input operation of the user on the setting interface.
上述目标画面尺寸可用于指示终端生成的目标显示画面中具有实质显示内容的目标区域的大小。例如,上述目标画面尺寸具体可以为目标区域与目标显示画面之间的目标比例,例如,95%,即终端向外部显示设备后续发送的目标显示画面中有95%的画面为具有实质显示内容的画面;又例如,上述目标画面尺寸直接可以为目标显示画面中目标区域的大小,例如,1900×1000分辨率大小的目标区域。The target screen size described above may be used to indicate the size of the target area having the substantially displayed content in the target display screen generated by the terminal. For example, the target screen size may be a target ratio between the target area and the target display screen, for example, 95%, that is, 95% of the target display screens sent by the terminal to the external display device are substantially displayed. For example, the target screen size may directly be the size of the target area in the target display screen, for example, a target area of 1900×1000 resolution.
用户在上述设置界面1001提供的多个候选画面尺寸中选中某一候选画面尺寸后,外部显示设备可将用户选中的候选画面尺寸作为目标画面尺寸发送给终端,该目标画 面尺寸可包括后续外部显示设备上的显示画面占外部显示设备屏幕的目标比例。当然,该目标画面尺寸还可以包括后续显示画面的长和高的比例,例如16:9等。以便终端后续在向外部显示设备传送实时的显示画面时,可按照该目标画面尺寸对显示画面进行缩放,从而为外部显示设备提供完整显示画面的信号源。After the user selects a certain candidate screen size among the plurality of candidate screen sizes provided by the setting interface 1001, the external display device may send the candidate screen size selected by the user as the target screen size to the terminal, and the target drawing The face size may include a target ratio of a display screen on a subsequent external display device to an external display device screen. Of course, the target screen size may also include the ratio of the length of the subsequent display to the height, such as 16:9. Therefore, when the terminal subsequently transmits the real-time display screen to the external display device, the display screen may be scaled according to the target screen size, thereby providing the external display device with a signal source of the complete display screen.
具体的,终端为外部显示设备提供完整显示画面的信号源进行显示的方法可参见下述步骤S705-S707,其中,步骤S705与步骤S705’为两种可选的实现方式。Specifically, the method for the terminal to display the signal source of the complete display screen for the external display device can be referred to the following steps S705-S707, wherein the step S705 and the step S705' are two alternative implementation manners.
S705、终端将外部显示设备待显示的初始显示画面转换为与上述目标画面尺寸大小相适应的目标显示画面,初始显示画面和目标显示画面均具有步骤702中确定的显示画面尺寸。S705. The terminal converts an initial display screen to be displayed by the external display device into a target display screen that is adapted to the size of the target screen. The initial display screen and the target display screen each have a display screen size determined in step 702.
终端获取到用户对外部显示设备设置的目标画面尺寸后,可将其存储至终端的存储器中。后续,当用户触发外部显示设备进行显示时,例如,用户打开外部显示设备上显示的某一应用时,外部显示设备可将用户触发的输入事件发送给终端,由终端为外部显示设备生成尺寸大小为上述显示画面尺寸的待显示画面,例如初始显示画面。After the terminal acquires the target screen size set by the user to the external display device, it can store it in the memory of the terminal. Subsequently, when the user triggers the external display device to display, for example, when the user opens an application displayed on the external display device, the external display device may send the user-triggered input event to the terminal, and the terminal generates a size for the external display device. The screen to be displayed of the above display screen size, for example, an initial display screen.
此时,以上述目标画面尺寸为占屏幕80%为例,如图16A所示,终端为外部显示设备生成的初始显示画面1501为与外部显示设备分别率匹配的10*10的尺寸,按照80%的目标画面尺寸,终端可先将生成的初始显示画面1501缩小80%,得到8*8的缩放画面1502。进而,以初始显示画面1501所在的目标位置为基准,将8*8的缩放画面1502调整至目标位置的中心。如图16所示,终端可将8*8的缩放画面1502沿X轴的正方向移动10*10%=1,沿Y轴移动的正方向移动10*10%=1,使得缩放画面1502移动至原初始显示画面所在目标位置的中心。此时,终端可将缩放画面1502的四周填充黑色或其他颜色,得到与初始显示画面1501尺寸相同的目标显示画面1503。可以看出,目标显示画面1503与初始显示画面1501的尺寸相同,但目标显示画面1503中有效画面的面积占整个目标显示画面1503的80%,即目标显示画面1503中设有80%的目标区域用于布局显示内容。In this case, taking the target screen size as an example of 80% of the screen, as shown in FIG. 16A, the initial display screen 1501 generated by the terminal for the external display device is a size of 10*10 matched with the external display device, according to 80. For the target screen size of %, the terminal may first reduce the generated initial display screen 1501 by 80% to obtain an 8*8 zoom screen 1502. Further, the 8*8 zoom screen 1502 is adjusted to the center of the target position based on the target position where the initial display screen 1501 is located. As shown in FIG. 16, the terminal can move the 8*8 zoom picture 1502 in the positive direction of the X-axis by 10*10%=1, and move in the positive direction of the Y-axis movement by 10*10%=1, so that the zoom screen 1502 moves. To the center of the target position where the original initial display screen is located. At this time, the terminal can fill black or other colors around the zoom screen 1502 to obtain a target display screen 1503 having the same size as the initial display screen 1501. It can be seen that the target display screen 1503 is the same size as the initial display screen 1501, but the area of the effective screen in the target display screen 1503 occupies 80% of the entire target display screen 1503, that is, the target display screen 1503 is provided with 80% of the target area. Used to layout display content.
其中,如图17所示,上述初始显示画面1501可以是外部显示设备上待显示的整个显示界面,也可以是整个显示界面中的一个或多个窗口(window),还可以是窗口内的某个具体图标,本申请实施例对此不做任何限制。As shown in FIG. 17 , the initial display screen 1501 may be the entire display interface to be displayed on the external display device, or may be one or more windows in the entire display interface, or may be some in the window. The specific embodiment of the present application does not impose any limitation on this.
示例性的,以Android操作系统为例,Android操作系统可以划分为四层,从高层到低层分别是应用程序层(即APP层)、应用程序框架层(即Framework层)、系统运行库层(即Libraries层)和Linux内核层。Exemplarily, taking the Android operating system as an example, the Android operating system can be divided into four layers, from the upper layer to the lower layer respectively, the application layer (ie, the APP layer), the application framework layer (ie, the Framework layer), and the system runtime layer ( That is, the Libraries layer) and the Linux kernel layer.
其中,Linux内核层可作为硬件(例如,CPU、网卡以及内存等)和软件栈之间的抽象层,它可隐藏具体硬件细节从而为上层(系统运行库层、应用程序框架层以及应用程序层)提供统一的服务。系统运行库层中包含一些C/C++库,例如,媒体库、系统C库以及显示管理库(Surface Manager)等,这些库能被Android系统中不同的组件使用,系统运行库层可通过Framework层为开发人员提供服务。Framework层为开发人员提供了一个可以完全访问应用程序所使用的API框架。具体的,Framework层为开发应用程序提供了非常多的API,通过调用相应的API可以构造满足相关业务需求的APP。而应用程序层主要包括用java语言编写的APP,用户在操作APP上的操 作界面时,通过调用Framework层中的相关API,与系统运行库层或Linux内核层进行交互,实现与该操作界面相对应的功能。Among them, the Linux kernel layer can be used as an abstraction layer between hardware (for example, CPU, network card, memory, etc.) and software stack, which can hide specific hardware details for the upper layer (system runtime layer, application framework layer and application layer) ) Provide a unified service. The system runtime layer contains some C/C++ libraries, such as media library, system C library, and display management library (Surface Manager). These libraries can be used by different components in the Android system. The system runtime layer can pass the Framework layer. Serve developers. The Framework layer provides developers with an API framework for full access to applications. Specifically, the Framework layer provides a lot of APIs for developing applications. By calling the corresponding APIs, you can construct an APP that meets the relevant business needs. The application layer mainly includes the APP written in java language, and the user operates on the APP. When the interface is used, it interacts with the system runtime layer or the Linux kernel layer by calling related APIs in the Framework layer to implement functions corresponding to the operation interface.
那么,在本申请实施例中,如图18所示,Framework层维护的系统服务(system service)中包括window manager service(窗口管理服务),以及专门用于维护和实现终端PC化功能的PC manager service(PC化管理服务),该PC manager service中维护有外部显示设备发送的目标画面尺寸。window manager service中设置有window state animator(窗口状态绘制器),一般,每个应用的Activity都对应一个窗口,而window state animator可用于绘制和管理该窗口的窗口surface和窗口动画。Then, in the embodiment of the present application, as shown in FIG. 18, the system service maintained by the Framework layer includes a window manager service, and a PC manager dedicated to maintaining and implementing the terminal PC function. Service (PC management service), which maintains the target screen size sent by the external display device. The window manager service is provided with a window state animator. Generally, each application's Activity corresponds to a window, and the window state animator can be used to draw and manage the window surface and window animation of the window.
这样,window state animator在为外部显示设备绘制每一个窗口(例如初始显示画面A)时,可从PC manager service中获取用户设置的目标画面尺寸,进而绘制与目标画面尺寸大小相适应的目标显示画面A。In this way, when the window state animator draws each window for the external display device (for example, the initial display screen A), the target screen size set by the user can be obtained from the PC manager service, and then the target display screen corresponding to the target screen size is drawn. A.
需要说明的是,在本申请实施例中,当上述初始显示画面为外部显示设备上待显示的完整显示界面时,通常该显示界面中包括一个或多个窗口(或图标),那么,终端可以在绘制每一个窗口(或者图标)时按照步骤S704所述的方法对每一个窗口(或者图标)进行转换,最终得到转换后的目标显示画面;也可以在绘制完成整个的显示界面后,对该显示界面按照步骤S704所述的方法进行转换,也可得到转换后的目标显示画面,本申请实施例对此不做任何限制。It should be noted that, in the embodiment of the present application, when the initial display screen is a complete display interface to be displayed on the external display device, usually the display interface includes one or more windows (or icons), then the terminal may When each window (or icon) is drawn, each window (or icon) is converted according to the method described in step S704, and finally the converted target display screen is obtained; after the entire display interface is completed, the The display interface is converted according to the method described in step S704, and the converted target display screen is also obtained. This embodiment of the present application does not impose any limitation.
另外,终端还可以预先存储一个或多个目标类型的窗口,这类窗口无需调整显示画面的尺寸,例如壁纸类型的窗口。这类预设窗口的边缘通常不会包含用户所需的重要信息,因此,这类窗口中的图像进行过扫描后也不会造成用户所需的信息丢失的现象。那么,当终端判断出当前绘制的窗口为上述目标类型的窗口时,无需执行上述步骤S704,终端可沿用现有的窗口绘制方法绘制该窗口,并将绘制出的窗口发送给外部显示设备进行显示;当终端判断出当前绘制的窗口并非上述预设窗口时,可按照上述步骤S704所述的方法对该窗口进行转换,最终得到转换后的目标显示画面。In addition, the terminal may also pre-store one or more target type windows, such windows do not need to adjust the size of the display screen, such as a wallpaper type window. The edges of such preset windows usually do not contain important information that the user needs. Therefore, the images in such windows are scanned without causing the loss of information required by the user. Then, when the terminal determines that the currently drawn window is the window of the target type, the terminal may perform the above-mentioned step S704, and the terminal may draw the window according to the existing window drawing method, and send the drawn window to the external display device for display. When the terminal determines that the currently drawn window is not the preset window, the window may be converted according to the method described in the above step S704, and finally the converted target display screen is obtained.
S705’、终端根据上述目标画面尺寸为外部显示设备绘制待显示的目标显示画面。S705', the terminal draws a target display screen to be displayed for the external display device according to the target screen size.
在本申请的另一种实现方式中,当外部显示设备需要显示一定显示画面尺寸的显示画面,例如,10*10的桌面图像时,终端可根据用户设置的上述目标画面尺寸,将绘制该显示画面时系统默认使用的初始画布(canvas)修改为目标画布,其中,目标画布中仅可在与上述目标画面尺寸相同的目标区域内绘制显示画面。那么,后续终端可在该目标画布中的目标区域绘制上述显示画面,此时,得到的目标显示画面与步骤S704中转换后形成的目标显示画面相同。In another implementation manner of the present application, when the external display device needs to display a display screen of a certain display screen size, for example, a desktop image of 10*10, the terminal may draw the display according to the target screen size set by the user. When the screen is used, the initial canvas used by the system is modified to the target canvas, and the target canvas can only draw the display in the same target area as the above target image size. Then, the subsequent terminal can draw the display screen in the target area in the target canvas. At this time, the obtained target display screen is the same as the target display screen formed after the conversion in step S704.
示例性的,以上述目标画面尺寸为占屏幕80%为例,如图16B所示,终端在绘制待显示画面之前,首先可根据该目标画面尺寸将10*10的初始画布1601缩小为8*8。进而,在缩小后的初始画布1601周围填充底色形成与10*10的目标画布1602。可以看出,目标画布1602的大小与初始画布1601相同,但目标画布1602中仅有位于中心的8*8的目标区域可用于绘制显示画面。因此,仍如图16B所示,终端可在目标画布1602的目标区域内布局显示画面中的显示内容,例如文本、图像以及图标等,最终得到与图16A中相同的目标显示画面。For example, as shown in FIG. 16B, the terminal can first reduce the initial canvas 1601 of 10*10 to 8* according to the target screen size. 8. Further, a bottom color is formed around the reduced initial canvas 1601 to form a target canvas 1602 of 10*10. It can be seen that the size of the target canvas 1602 is the same as the initial canvas 1601, but only the 8*8 target area located in the center of the target canvas 1602 can be used to draw the display. Therefore, as shown in FIG. 16B, the terminal can arrange the display contents in the display screen, such as text, images, icons, and the like, within the target area of the target canvas 1602, and finally obtain the same target display screen as in FIG. 16A.
其中,终端在目标画布1602的目标区域内绘制显示内容时,仍可按照上述目标画 面尺寸将预设大小的待显示元素缩小80%后布局在目标区域内,当然,终端也可直接将预设大小的待显示元素布局在上述目标区域内,本申请实施例对此不做任何限制。Wherein, when the terminal draws the display content in the target area of the target canvas 1602, the terminal may still draw according to the above target The surface size is reduced by 80% of the preset size of the element to be displayed, and then the layout is in the target area. Of course, the terminal can also directly arrange the preset size of the to-be-displayed element in the target area. limit.
S706、终端向外部显示设备发送上述目标显示画面。S706. The terminal sends the target display screen to the external display device.
S707、外部显示设备对目标显示画面进行过扫描后,在其显示器中输出过扫描后的目标显示画面。S707. After the external display device scans the target display screen, the scanned target display screen is outputted on the display.
在步骤S705-S706中,终端将缩放后得到的目标显示画面发送给外部显示设备,此时,如图13或图14所示,外部显示设备对接收到的目标显示画面可进行过扫描,例如,提取目标显示画面中位于中心95%的显示数据进行显示。那么,由于外部显示设备过扫描时提取的画面面积大于或等于终端生成的目标显示画面中有效画面的面积,因此,在终端PC化场景下外部显示设备接收到的显示画面的信息是完整的,可避免因overscan而导致显示画面不完整的现象。In steps S705-S706, the terminal transmits the zoomed target display screen to the external display device. At this time, as shown in FIG. 13 or FIG. 14, the external display device may overscan the received target display screen, for example, , 95% of the display data in the center of the extraction target display screen is displayed. Then, since the area of the screen extracted by the external display device during the overscan is greater than or equal to the area of the effective screen in the target display screen generated by the terminal, the information of the display screen received by the external display device in the terminal PCized scene is complete. It can avoid the phenomenon that the display is incomplete due to overscan.
需要说明的是,上述实施例中仅以overscan时外部显示设备对显示画面使用95%的提取比例进行举例说明,可以理解的是,本领域技术人员可以根据实际应用场景对overscan的具体提取比例进行设置,当终端对初始显示画面的缩放比例(即用户设置的目标画面尺寸)小于或等于外部显示设备overscan时对显示画面的提取比例时,外部显示设备在overscan后便可得到完整的显示画面。It should be noted that, in the above embodiment, the external display device uses an extraction ratio of 95% for the display screen when the overscan is used. It can be understood that the specific extraction ratio of the overscan can be performed by a person skilled in the art according to the actual application scenario. It is set that when the zoom ratio of the initial display screen (ie, the target screen size set by the user) is less than or equal to the extraction ratio of the display screen when the external display device overscan, the external display device can obtain a complete display screen after overscan.
另外,在本申请提供的终端的图像处理方法中,当终端与外部显示设备建立连接后,如果外部显示设备能够检测出当前系统在overscan选项中设置的显示画面提取率,则外部显示设备可将该显示画面提取率发送给终端。进而,终端可自动为将上述目标画面尺寸设置为与该显示画面提取率对应的取值。那么,后续终端向外部显示设备发送待显示的初始显示画面时,仍可按照上述步骤S704-S706所示的方法,使用该目标画面尺寸对初始显示画面进行缩放,将缩放得到的目标显示画面发送给外部显示设备进行overscan后显示。由于上述目标画面尺寸与该显示画面提取率对应,因此,外部显示设备进行overscan后得到的显示画面刚好为目标显示画面中的有效画面,此时可在外部显示设备中最大化完整显示该目标显示画面,克服因overscan导致的显示画面不完整的问题。In addition, in the image processing method of the terminal provided by the present application, after the terminal establishes a connection with the external display device, if the external display device can detect the display screen extraction rate set by the current system in the overscan option, the external display device may The display screen extraction rate is sent to the terminal. Further, the terminal can automatically set the target screen size to a value corresponding to the display screen extraction rate. Then, when the subsequent terminal sends the initial display screen to be displayed to the external display device, the initial display screen may be scaled by using the target screen size according to the method shown in steps S704-S706 above, and the target display screen obtained by the scaling is sent. Displayed after overscan of the external display device. Since the target screen size corresponds to the display screen extraction rate, the display screen obtained by the external display device after overscan is just the effective screen in the target display screen, and the target display can be maximized and displayed in the external display device. The screen overcomes the problem of incomplete display due to overscan.
可以理解的是,上述终端等为了实现上述功能,其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,本申请实施例能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请实施例的范围。It can be understood that, in order to implement the above functions, the above terminal and the like include hardware structures and/or software modules corresponding to each function. Those skilled in the art will readily appreciate that the embodiments of the present application can be implemented in a combination of hardware or hardware and computer software in combination with the elements and algorithm steps of the various examples described in the embodiments disclosed herein. Whether a function is implemented in hardware or computer software to drive hardware depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods to implement the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the embodiments of the present application.
本申请实施例可以根据上述方法示例对上述终端等进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。需要说明的是,本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。The embodiment of the present application may perform the division of the function modules on the terminal or the like according to the foregoing method example. For example, each function module may be divided according to each function, or two or more functions may be integrated into one processing module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of the module in the embodiment of the present application is schematic, and is only a logical function division, and the actual implementation may have another division manner.
在采用对应各个功能划分各个功能模块的情况下,图18示出了上述实施例中 所涉及的终端的一种可能的结构示意图,该终端包括:收发单元1901、确定单元1902以及生成单元1903。In the case where the respective functional modules are divided by corresponding functions, FIG. 18 shows the above embodiment. A possible schematic diagram of a terminal involved, the terminal includes: a transceiver unit 1901, a determining unit 1902, and a generating unit 1903.
收发单元1901用于支持终端执行图7中的过程S701、S704以及S706;确定单元1902用于支持终端执行图7中的过程S702;生成单元1903用于支持终端执行图7中的过程S705以及S705’。其中,上述方法实施例涉及的各步骤的所有相关内容均可以援引到对应功能模块的功能描述,在此不再赘述。The transceiver unit 1901 is configured to support the terminal to perform the processes S701, S704, and S706 in FIG. 7; the determining unit 1902 is configured to support the terminal to perform the process S702 in FIG. 7; the generating unit 1903 is configured to support the terminal to execute the processes S705 and S705 in FIG. 7. '. All the related content of the steps involved in the foregoing method embodiments may be referred to the functional descriptions of the corresponding functional modules, and details are not described herein again.
在采用集成的单元的情况下,可将上述确定单元1902和生成单元1903集成为处理模块,将收发单元1901作为通信模块,并且,终端还可进一步包括存储模块和显示模块等。In the case of employing an integrated unit, the above determining unit 1902 and generating unit 1903 may be integrated into a processing module, the transceiver unit 1901 is used as a communication module, and the terminal may further include a storage module, a display module, and the like.
此时,如图20所示,示出了上述实施例中所涉及的终端的一种可能的结构示意图。其中,处理模块2002用于对终端的动作进行控制管理。通信模块2003用于支持终端与其他网络实体的通信。存储模块2001用于保存终端的程序代码和数据。显示模块2004用于显示由用户输入的信息或提供给用户的信息以及终端的各种菜单。At this time, as shown in FIG. 20, a possible structural diagram of the terminal involved in the above embodiment is shown. The processing module 2002 is configured to control and manage the actions of the terminal. The communication module 2003 is used to support communication between the terminal and other network entities. The storage module 2001 is used to save program codes and data of the terminal. The display module 2004 is for displaying information input by the user or information provided to the user and various menus of the terminal.
在本申请实施例中,当终端通过通信模块2003与外部显示设备相连时,终端的处理模块2002可为所述外部显示设备生成待显示的目标显示画面,其中,所述目标显示画面内的目标区域用于布局所述目标显示画面中的显示内容,所述目标区域为所述目标显示画面中的一部分;进而,通信模块2003可将所述目标显示画面发送至所述外部显示设备进行显示,这样外部显示设备过扫描时丢失的图像信息减少,从而改善因overscan而导致显示画面不完整的现象。In the embodiment of the present application, when the terminal is connected to the external display device through the communication module 2003, the processing module 2002 of the terminal may generate a target display screen to be displayed for the external display device, where the target displays the target in the screen The area is used for arranging display content in the target display screen, and the target area is a part of the target display screen; further, the communication module 2003 may send the target display screen to the external display device for display. In this way, the image information lost when the external display device overscans is reduced, thereby improving the phenomenon that the display screen is incomplete due to overscan.
其中,上述图像处理方法涉及的各步骤的所有相关内容均可以援引到上述实施例步骤S701-S704中的相关描述,在此不再赘述。The related descriptions of the steps in the above-mentioned embodiments may be referred to the related descriptions in the steps S701-S704 of the foregoing embodiment, and are not described herein again.
示例性的,处理模块2002可以是处理器或控制器,例如可以是中央处理器(Central Processing Unit,CPU),GPU,通用处理器,数字信号处理器(Digital Signal Processor,DSP),专用集成电路(Application-Specific Integrated Circuit,ASIC),现场可编程门阵列(Field Programmable Gate Array,FPGA)或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框,模块和电路。所述处理器也可以是实现计算功能的组合,例如包含一个或多个微处理器组合,DSP和微处理器的组合等等。Exemplarily, the processing module 2002 may be a processor or a controller, for example, may be a central processing unit (CPU), a GPU, a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit. (Application-Specific Integrated Circuit, ASIC), Field Programmable Gate Array (FPGA) or other programmable logic device, transistor logic device, hardware component, or any combination thereof. It is possible to implement or carry out the various illustrative logical blocks, modules and circuits described in connection with the present disclosure. The processor may also be a combination of computing functions, for example, including one or more microprocessor combinations, a combination of a DSP and a microprocessor, and the like.
通信模块2003可以是收发器、收发电路、输入输出设备或通信接口等。例如,通信模块2003具体可以是蓝牙装置、Wi-Fi装置、外设接口等等。The communication module 2003 can be a transceiver, a transceiver circuit, an input/output device, a communication interface, or the like. For example, the communication module 2003 may specifically be a Bluetooth device, a Wi-Fi device, a peripheral interface, or the like.
存储模块2001可以是存储器,该存储器可以包括高速随机存取存储器(RAM),还可以包括非易失存储器,例如磁盘存储器件、闪存器件或其他易失性固态存储器件等。The memory module 2001 may be a memory, which may include a high speed random access memory (RAM), and may also include a nonvolatile memory such as a magnetic disk storage device, a flash memory device, or other volatile solid state storage device.
显示模块2004可以为显示器,具体可以采用液晶显示器、有机发光二极管等形式来配置显示器。另外,显示器上还可以集成触控板,用于采集在其上或附近的触摸事件,并将采集到的触摸信息发送给其他器件(例如处理器等)。The display module 2004 can be a display, and specifically can be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. In addition, a touch panel can be integrated on the display for collecting touch events on or near the display, and transmitting the collected touch information to other devices (such as a processor, etc.).
当处理模块2002为处理器,通信模块2003为射频电路,存储模块2001为存 储器,显示模块2004为显示器时,本申请实施例所提供的终端可以为图5所示的手机110。When the processing module 2002 is a processor, the communication module 2003 is a radio frequency circuit, and the storage module 2001 is a memory. The terminal provided by the embodiment of the present application may be the mobile phone 110 shown in FIG. 5 when the display module 2004 is a display.
在上述实施例中,可以全部或部分的通过软件,硬件,固件或者其任意组合来实现。当使用软件程序实现时,可以全部或部分地以计算机程序产品的形式出现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。该可用介质可以是磁性介质,(例如,软盘,硬盘、磁带)、光介质(例如,DVD)或者半导体介质(例如固态硬盘Solid State Disk(SSD))等。In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it may occur in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in accordance with embodiments of the present application are generated in whole or in part. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions can be from a website site, computer, server or data center Transfer to another website site, computer, server, or data center by wire (eg, coaxial cable, fiber optic, digital subscriber line (DSL), or wireless (eg, infrared, wireless, microwave, etc.). The computer readable storage medium can be any available media that can be accessed by a computer or a data storage device such as a server, data center, or the like that includes one or more available media. The usable medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (such as a solid state disk (SSD)).
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。 The foregoing is only a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present application should be covered by the scope of the present application. . Therefore, the scope of protection of the present application should be determined by the scope of the claims.

Claims (26)

  1. 一种终端的图像处理方法,所述终端与外部显示设备相连,其特征在于,所述方法包括:An image processing method of a terminal, wherein the terminal is connected to an external display device, and the method includes:
    所述终端为所述外部显示设备生成待显示的目标显示画面,所述目标显示画面内的目标区域用于布局所述目标显示画面中的显示内容,所述目标区域为所述目标显示画面中的一部分;The terminal generates a target display screen to be displayed for the external display device, and the target area in the target display screen is used for layout display content in the target display screen, where the target area is in the target display screen a part of;
    所述终端将所述目标显示画面发送至所述外部显示设备进行显示。The terminal sends the target display screen to the external display device for display.
  2. 根据权利要求1所述的方法,其特征在于,在所述终端为所述外部显示设备生成待显示的目标显示画面之前,还包括:The method according to claim 1, wherein before the terminal generates the target display screen to be displayed for the external display device, the method further includes:
    所述终端确定显示画面尺寸,所述显示画面尺寸为发送给所述外部显示设备的画面的尺寸;所述目标显示画面具有所述显示画面尺寸。The terminal determines a display screen size, the display screen size being a size of a screen transmitted to the external display device; and the target display screen having the display screen size.
  3. 根据权利要求2所述的方法,其特征在于,所述终端为所述外部显示设备生成待显示的目标显示画面,包括:The method according to claim 2, wherein the generating, by the terminal, the target display screen to be displayed for the external display device comprises:
    所述终端为待所述外部显示设备显示的内容生成初始显示画面,所述初始显示画面具有所述显示画面尺寸;The terminal generates an initial display screen for content to be displayed by the external display device, where the initial display screen has the display screen size;
    所述终端将所述初始显示画面转换为所述目标显示画面,所述目标显示画面中所述目标区域的显示内容是由所述初始显示画面缩小后得到的。The terminal converts the initial display screen into the target display screen, and the display content of the target area in the target display screen is obtained by being reduced by the initial display screen.
  4. 根据权利要求2所述的方法,其特征在于,所述终端为所述外部显示设备生成待显示的目标显示画面,包括:The method according to claim 2, wherein the generating, by the terminal, the target display screen to be displayed for the external display device comprises:
    所述终端在所述目标区域填充待所述外部显示设备显示的内容,以得到所述目标显示画面。The terminal fills the content to be displayed by the external display device in the target area to obtain the target display screen.
  5. 根据权利要求3所述的方法,其特征在于,在所述终端将所述初始显示画面转换为所述目标显示画面之前,还包括:The method according to claim 3, further comprising: before the terminal converting the initial display image to the target display screen, further comprising:
    所述终端为所述外部显示设备生成用于调整所述外部显示设备的显示画面尺寸的设置界面,所述设置界面中包括至少一个候选画面尺寸;The terminal generates, for the external display device, a setting interface for adjusting a display screen size of the external display device, where the setting interface includes at least one candidate screen size;
    所述终端将所述设置界面发送至所述外部显示设备进行显示;Sending, by the terminal, the setting interface to the external display device for display;
    所述终端根据用户在所述设置界面的输入操作,确定所述初始显示画面与所述目标显示画面中所述目标区域间的缩放比例。The terminal determines a scaling ratio between the initial display screen and the target area in the target display screen according to an input operation of the user on the setting interface.
  6. 根据权利要求4所述的方法,其特征在于,在所述终端在所述目标区域填充待所述外部显示设备显示的内容之前,还包括:The method according to claim 4, further comprising: before the terminal filling the content to be displayed by the external display device in the target area, further comprising:
    所述终端为所述外部显示设备生成用于调整所述外部显示设备的显示画面尺寸的设置界面,所述设置界面中包括至少一个候选画面尺寸;The terminal generates, for the external display device, a setting interface for adjusting a display screen size of the external display device, where the setting interface includes at least one candidate screen size;
    所述终端将所述设置界面发送至所述外部显示设备进行显示;Sending, by the terminal, the setting interface to the external display device for display;
    所述终端根据用户在所述设置界面的输入操作确定所述目标显示画面中所述目标区域的尺寸。The terminal determines a size of the target area in the target display screen according to an input operation of the user at the setting interface.
  7. 根据权利要求5或6所述的方法,其特征在于,所述设置界面中还包括在所述候选画面尺寸下所述外部显示设备的画面预览效果。The method according to claim 5 or 6, wherein the setting interface further comprises a screen preview effect of the external display device under the candidate screen size.
  8. 根据权利要求5-7中任一项所述的方法,其特征在于,所述终端为所述外部显示设备生成用于调整显示画面尺寸的设置界面,包括:The method according to any one of claims 5-7, wherein the terminal generates a setting interface for adjusting the size of the display screen for the external display device, including:
    响应于用户对所述外部显示设备的设置操作,所述终端为所述外部显示设备生成用于调整显示画面尺寸的设置界面;或者, And in response to a setting operation of the external display device by the user, the terminal generates a setting interface for adjusting the size of the display screen for the external display device; or
    当所述终端与所述外部显示设备连接成功时,所述终端为所述外部显示设备生成用于调整显示画面尺寸的设置界面。When the terminal successfully connects to the external display device, the terminal generates a setting interface for adjusting the size of the display screen for the external display device.
  9. 根据权利要求1-8中任一项所述的方法,其特征在于,所述目标区域位于所述目标显示画面的中心,所述目标显示画面中除所述目标区域的其他区域设置有底色。The method according to any one of claims 1 to 8, wherein the target area is located at a center of the target display screen, and other areas of the target display screen other than the target area are provided with a background color .
  10. 根据权利要求1-9中任一项所述的方法,其特征在于,所述目标区域与所述目标显示画面的目标比例,小于或等于所述外部显示设备过扫描时对显示画面的提取比例。The method according to any one of claims 1 to 9, wherein a target ratio of the target area to the target display screen is less than or equal to an extraction ratio of the display screen when the external display device overscans .
  11. 根据权利要求2-10中任一项所述的方法,其特征在于,所述终端确定显示画面尺寸,包括:The method according to any one of claims 2 to 10, wherein the terminal determines a display screen size, including:
    所述终端获取所述外部显示设备支持的分辨率;The terminal acquires a resolution supported by the external display device;
    所述终端根据所述外部显示设备支持的分辨率确定所述显示画面尺寸。The terminal determines the display screen size according to a resolution supported by the external display device.
  12. 一种终端的图像处理方法,所述终端与外部显示设备相连,其特征在于,所述方法包括:An image processing method of a terminal, wherein the terminal is connected to an external display device, and the method includes:
    所述终端将生成的初始显示画面发送至所述外部显示设备进行显示;Sending, by the terminal, the generated initial display screen to the external display device for display;
    所述终端将用于调整所述外部显示设备的显示画面尺寸的设置界面发送至所述外部显示设备进行显示,所述设置界面中包括至少一个候选画面尺寸;Sending, by the terminal, a setting interface for adjusting a display screen size of the external display device to the external display device for display, where the setting interface includes at least one candidate screen size;
    响应于用户在所述候选画面尺寸中选中的目标画面尺寸,所述终端将生成的目标显示画面发送至所述外部显示设备进行显示,所述目标显示画面和所述初始显示画面的尺寸相同,且所述目标显示画面中目标区域的显示内容是由所述初始显示画面缩小后得到的,所述目标区域的大小为所述目标画面尺寸。And responding to the target screen size selected by the user in the candidate screen size, the terminal transmitting the generated target display screen to the external display device for display, where the target display screen and the initial display screen have the same size, And the display content of the target area in the target display screen is obtained by being reduced by the initial display screen, and the size of the target area is the target screen size.
  13. 一种终端,所述终端与外部显示设备相连,其特征在于,所述终端包括通过总线相连的处理器、存储器以及收发器,其中,A terminal, the terminal being connected to an external display device, wherein the terminal comprises a processor, a memory and a transceiver connected by a bus, wherein
    所述处理器,用于为所述外部显示设备生成待显示的目标显示画面,所述目标显示画面内的目标区域用于布局所述目标显示画面中的显示内容,所述目标区域为所述目标显示画面中的一部分;The processor is configured to generate, for the external display device, a target display screen to be displayed, where a target area in the target display screen is used to lay out display content in the target display screen, where the target area is The target displays a portion of the screen;
    所述收发器,用于将所述目标显示画面发送至所述外部显示设备进行显示。The transceiver is configured to send the target display screen to the external display device for display.
  14. 根据权利要求13所述的终端,其特征在于,在为所述外部显示设备生成待显示的目标显示画面之前,The terminal according to claim 13, wherein before the target display screen to be displayed is generated for the external display device,
    所述处理器,还用于确定显示画面尺寸,所述显示画面尺寸为发送给所述外部显示设备的画面的尺寸;所述目标显示画面具有所述显示画面尺寸。The processor is further configured to determine a display screen size, where the display screen size is a size of a screen sent to the external display device; and the target display screen has the display screen size.
  15. 根据权利要求13所述的终端,其特征在于,The terminal of claim 13 wherein:
    所述处理器,具体用于为待所述外部显示设备显示的内容生成初始显示画面,所述初始显示画面具有所述显示画面尺寸;所述终端将所述初始显示画面转换为所述目标显示画面,所述目标显示画面中所述目标区域的显示内容是由所述初始显示画面缩小后得到的。The processor is specifically configured to generate an initial display screen for content to be displayed by the external display device, where the initial display screen has the display screen size; and the terminal converts the initial display screen into the target display a screen, wherein the display content of the target area in the target display screen is obtained by being reduced by the initial display screen.
  16. 根据权利要求13所述的终端,其特征在于,The terminal of claim 13 wherein:
    所述处理器,具体用于在所述目标区域填充待所述外部显示设备显示的内容,以得到所述目标显示画面。The processor is specifically configured to fill the content to be displayed by the external display device in the target area to obtain the target display screen.
  17. 根据权利要求15所述的终端,其特征在于,The terminal of claim 15 wherein:
    所述处理器,还用于为所述外部显示设备生成用于调整所述外部显示设备的 显示画面尺寸的设置界面,所述设置界面中包括至少一个候选画面尺寸;The processor is further configured to generate, for the external display device, an adjustment for the external display device a setting interface for displaying a screen size, wherein the setting interface includes at least one candidate screen size;
    所述收发器,还用于将所述设置界面发送至所述外部显示设备进行显示;接收用户在所述设置界面的输入操作;The transceiver is further configured to send the setting interface to the external display device for display; and receive an input operation of the user at the setting interface;
    所述处理器,还用于确定所述初始显示画面与所述目标显示画面中所述目标区域间的缩放比例。The processor is further configured to determine a scaling ratio between the initial display screen and the target area in the target display screen.
  18. 根据权利要求16所述的终端,其特征在于,The terminal of claim 16 wherein:
    所述处理器,还用于为所述外部显示设备生成用于调整所述外部显示设备的显示画面尺寸的设置界面,所述设置界面中包括至少一个候选画面尺寸;The processor is further configured to generate, by the external display device, a setting interface for adjusting a display screen size of the external display device, where the setting interface includes at least one candidate screen size;
    所述收发器,还用于将所述设置界面发送至所述外部显示设备进行显示;接收用户在所述设置界面的输入操作;The transceiver is further configured to send the setting interface to the external display device for display; and receive an input operation of the user at the setting interface;
    所述处理器,还用于根据用户在所述设置界面的输入操作确定所述目标显示画面中所述目标区域的尺寸。The processor is further configured to determine a size of the target area in the target display screen according to an input operation of a user at the setting interface.
  19. 根据权利要求17或18所述的终端,其特征在于,所述设置界面中还包括在所述候选画面尺寸下所述外部显示设备的画面预览效果。The terminal according to claim 17 or 18, wherein the setting interface further comprises a screen preview effect of the external display device under the candidate screen size.
  20. 根据权利要求17-19中任一项所述的终端,其特征在于,A terminal according to any one of claims 17 to 19, characterized in that
    所述处理器,具体用于:响应于用户对所述外部显示设备的设置操作,为所述外部显示设备生成用于调整显示画面尺寸的设置界面;或者,当所述终端与所述外部显示设备连接成功时,为所述外部显示设备生成用于调整显示画面尺寸的设置界面。The processor is specifically configured to: generate a setting interface for adjusting the size of the display screen for the external display device in response to a setting operation of the external display device by the user; or, when the terminal and the external display When the device is successfully connected, a setting interface for adjusting the size of the display screen is generated for the external display device.
  21. 根据权利要求13-20中任一项所述的终端,其特征在于,所述目标区域位于所述目标显示画面的中心,所述目标显示画面中除所述目标区域的其他区域设置有底色。The terminal according to any one of claims 13 to 20, wherein the target area is located at a center of the target display screen, and other areas of the target display screen other than the target area are provided with a background color .
  22. 根据权利要求13-21中任一项所述的终端,其特征在于,所述目标区域与所述目标显示画面的目标比例,小于或等于所述外部显示设备过扫描时对显示画面的提取比例。The terminal according to any one of claims 13 to 21, wherein a target ratio of the target area to the target display screen is less than or equal to an extraction ratio of the display screen when the external display device overscans .
  23. 根据权利要求14-22中任一项所述的终端,其特征在于,A terminal according to any one of claims 14 to 22, characterized in that
    所述收发器,还用于获取所述外部显示设备支持的分辨率;The transceiver is further configured to obtain a resolution supported by the external display device;
    所述处理器,具体用于根据所述外部显示设备支持的分辨率确定所述显示画面尺寸。The processor is specifically configured to determine the display screen size according to a resolution supported by the external display device.
  24. 一种终端,所述终端与外部显示设备相连,其特征在于,所述终端包括通过总线相连的处理器、存储器以及收发器,其中,A terminal, the terminal being connected to an external display device, wherein the terminal comprises a processor, a memory and a transceiver connected by a bus, wherein
    所述处理器,用于为所述外部显示设备生成初始显示画面;生成用于调整所述外部显示设备的显示画面尺寸的设置界面;为所述外部显示设备生成目标显示画面,所述目标显示画面和所述初始显示画面的尺寸相同,且所述目标显示画面中目标区域的显示内容是由所述初始显示画面缩小后得到的,所述目标区域的大小为所述目标画面尺寸;The processor is configured to generate an initial display screen for the external display device, generate a setting interface for adjusting a display screen size of the external display device, generate a target display screen for the external display device, and display the target display The screen and the initial display screen have the same size, and the display content of the target area in the target display screen is obtained by being reduced by the initial display screen, and the size of the target area is the target screen size;
    所述收发器,用于将所述初始显示画面发送至所述外部显示设备进行显示;将所述设置界面发送至所述外部显示设备进行显示;将所述目标显示画面发送至所述外部显示设备进行显示。The transceiver is configured to send the initial display screen to the external display device for display; send the setting interface to the external display device for display; and send the target display screen to the external display The device is displayed.
  25. 一种计算机可读存储介质,所述计算机可读存储介质中存储有指令,其特征在于,当所述指令在终端上运行时,使得所述终端执行如权利要求1-11或12中任一项所述的图像处理方法。A computer readable storage medium having stored therein instructions, wherein when the instructions are run on a terminal, causing the terminal to perform any of claims 1-11 or 12 The image processing method described in the item.
  26. 一种包含指令的计算机程序产品,其特征在于,当所述计算机程序产品在终端上运行时,使得所述终端执行如权利要求1-11或12中任一项所述的图像处理方法。 A computer program product comprising instructions, wherein when the computer program product is run on a terminal, the terminal is caused to perform the image processing method according to any one of claims 1-11 or 12.
PCT/CN2017/110720 2017-11-13 2017-11-13 Image processing method and apparatus for terminal WO2019090772A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2017/110720 WO2019090772A1 (en) 2017-11-13 2017-11-13 Image processing method and apparatus for terminal
CN201780082065.7A CN110178111B (en) 2017-11-13 2017-11-13 Image processing method and device for terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/110720 WO2019090772A1 (en) 2017-11-13 2017-11-13 Image processing method and apparatus for terminal

Publications (1)

Publication Number Publication Date
WO2019090772A1 true WO2019090772A1 (en) 2019-05-16

Family

ID=66437510

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/110720 WO2019090772A1 (en) 2017-11-13 2017-11-13 Image processing method and apparatus for terminal

Country Status (2)

Country Link
CN (1) CN110178111B (en)
WO (1) WO2019090772A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111953918A (en) * 2019-05-17 2020-11-17 成都鼎桥通信技术有限公司 Video acquisition processing method and system in video single call

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112558900A (en) * 2019-09-26 2021-03-26 华为技术有限公司 Screen projection method, content source device and content receiving device
CN113918070B (en) * 2020-08-31 2024-07-02 北京金山办公软件股份有限公司 Synchronous display method and device, readable storage medium and electronic equipment
CN112799620B (en) * 2021-01-15 2021-09-07 北京天华星航科技有限公司 Big data visualization system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002290930A (en) * 2001-03-26 2002-10-04 Sanyo Electric Co Ltd Broadcasting receiver
CN103995683A (en) * 2014-04-24 2014-08-20 深圳创维-Rgb电子有限公司 Multi-screen interaction method and system
CN104272245A (en) * 2012-02-08 2015-01-07 苹果公司 Overscan support

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH04157887A (en) * 1990-10-22 1992-05-29 Hitachi Ltd Television transmission equipment and receivers
JP5223284B2 (en) * 2006-11-10 2013-06-26 株式会社リコー Information retrieval apparatus, method and program
TWI353788B (en) * 2007-10-29 2011-12-01 Acer Inc System and method for converting digital image sig
CN104020968B (en) * 2013-02-28 2019-02-26 中兴通讯股份有限公司 Control the method and device that shared screen is shown
US20140071121A1 (en) * 2012-09-11 2014-03-13 Digital Signal Corporation System and Method for Off Angle Three-Dimensional Face Standardization for Robust Performance
CN104461232A (en) * 2014-09-30 2015-03-25 小米科技有限责任公司 Method and device for determining reduction scale in screen display process
CN106339192B (en) * 2016-08-24 2019-12-06 腾讯科技(深圳)有限公司 Region sharing method, device and system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002290930A (en) * 2001-03-26 2002-10-04 Sanyo Electric Co Ltd Broadcasting receiver
CN104272245A (en) * 2012-02-08 2015-01-07 苹果公司 Overscan support
CN103995683A (en) * 2014-04-24 2014-08-20 深圳创维-Rgb电子有限公司 Multi-screen interaction method and system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111953918A (en) * 2019-05-17 2020-11-17 成都鼎桥通信技术有限公司 Video acquisition processing method and system in video single call
CN111953918B (en) * 2019-05-17 2022-06-24 成都鼎桥通信技术有限公司 Video acquisition processing method and system in video single call

Also Published As

Publication number Publication date
CN110178111A (en) 2019-08-27
CN110178111B (en) 2021-05-18

Similar Documents

Publication Publication Date Title
US11989383B2 (en) Application window display method and terminal
CN114449091B (en) Display method and device
US11809705B2 (en) Touch control method and apparatus
US11115518B2 (en) Display method and terminal
WO2018227824A1 (en) Display method and device
WO2021197263A1 (en) Content sharing method and electronic device
WO2019084827A1 (en) Management of a plurality of free windows in pull-down menu of notification bar
WO2018223558A1 (en) Data processing method and electronic device
CN109857289B (en) Display control method and terminal equipment
WO2019090772A1 (en) Image processing method and apparatus for terminal
WO2019071600A1 (en) Image processing method and apparatus
CN110908554B (en) Long screenshot method and terminal device
US11526320B2 (en) Multi-screen interface control method and terminal device
CN109976611A (en) The control method and terminal device of terminal device
CN110225180B (en) Content input method and terminal equipment
CN114706549A (en) Display method, intelligent terminal and storage medium
CN111596836A (en) A split-screen display method and electronic device
CN110866409A (en) Content processing method and electronic equipment
WO2023202468A1 (en) Display method, smart terminal and storage medium
CN113703632A (en) Interface display method and device and electronic equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17931231

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17931231

Country of ref document: EP

Kind code of ref document: A1