CN107357540B - Display direction adjusting method and mobile terminal - Google Patents

Abstract

The present invention provides a method for adjusting a display direction and a mobile terminal, wherein the method includes: acquiring the display directions of a first display interface and a second display interface in the display interface of the mobile terminal; When the direction and the display direction of the second display interface are different, according to the display direction of one of the first display interface or the second display interface, adjust the display direction of the other display interface, so that the display direction of the first display interface and the display direction of the second display interface are different. The display directions of the second display interface are the same. Thus, the problem in the prior art that the display direction of the mobile terminal interface is different from the viewing direction of the user is solved.

Description

A kind of adjustment method of display direction and mobile terminal

technical field

The present invention relates to the technical field of mobile terminals, and in particular, to a method for adjusting a display direction and a mobile terminal.

Background technique

With the rapid development of electronic technology, portable mobile devices such as smartphones and tablet computers have greatly changed the way people live and work, and these mobile devices are usually equipped with one or more cameras to achieve more and more users. High shooting demand.

At present, with the increasing use of cameras, for example, the gradual rise of technologies such as AR/VR and 3D projection on mobile phones, the requirements for camera imaging effects and framing accuracy will become higher and higher. At present, in order to achieve an accurate viewing angle, the smartphone uses the gravity sensor (G-senior) to judge and identify the angle change direction in the vertical direction after turning on the camera for online video or taking pictures, so that every time the mobile phone rotates 90 degrees, the viewing direction of the camera corresponds to The adjustment is always consistent with the direction of gravity. Used to prevent upside-down portraits and scenes due to smartphone rotation.

However, in some scenarios where the gravity sensor is not applicable or the screen is split, the display of the interface is often displayed according to a preset angle due to the inability or the user's orientation, which may be different from the user's orientation, which affects the user's normal viewing.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a method for adjusting a display direction and a mobile terminal, so as to solve the problem in the prior art that the display direction of an interface in a mobile terminal is different from the viewing direction of a user.

In a first aspect, an embodiment of the present invention provides a method for adjusting a display direction, which is applied to a mobile terminal, and the method includes:

acquiring the display directions of the first display interface and the second display interface in the display interface of the mobile terminal;

When the display direction of the first display interface and the display direction of the second display interface are different, according to the display direction of one of the first display interface or the second display interface, adjust the display direction of the other display interface, so that the display direction of the other display interface is adjusted. The display direction of the first display interface is the same as the display direction of the second display interface.

In a second aspect, an embodiment of the present invention further provides a mobile terminal, including:

a viewfinder direction acquisition module, configured to acquire the display directions of the first display interface and the second display interface in the display interface of the mobile terminal;

A viewfinder direction adjustment module, used for adjusting the display direction of one display interface of the first display interface or the second display interface when the display direction of the first display interface and the display direction of the second display interface are different, to adjust the other display interface so that the display direction of the first display interface and the display direction of the second display interface are the same.

In this way, in this embodiment of the present invention, the display directions of the first display interface and the second display interface in the display interface of the mobile terminal are obtained; when the display direction of the first display interface and the display direction of the second display interface are different, according to The display direction of one of the first display interface or the second display interface is adjusted, and the display direction of the other display interface is adjusted so that the display direction of the first display interface and the display direction of the second display interface are the same, thereby solving the problem of existing In the technology, the display direction of the interface in the mobile terminal is different from the viewing direction of the user.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present invention more clearly, the following briefly introduces the drawings that are used in the description of the embodiments of the present invention. Obviously, the drawings in the following description are only some embodiments of the present invention. , for those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative labor.

1 shows a flowchart of a method for adjusting a display direction in Embodiment 1 of the present invention;

FIG. 2 shows a flowchart of a method for adjusting a display direction in Embodiment 2 of the present invention;

FIG. 2A shows a schematic diagram of adjusting the display direction of the T-shaped area of the face in Embodiment 2 of the present invention;

3 shows a structural block diagram of a mobile terminal according to Embodiment 3 of the present invention;

4 shows a structural block diagram of a mobile terminal according to Embodiment 3 of the present invention;

5 shows a structural block diagram of a mobile terminal according to Embodiment 4 of the present invention;

FIG. 6 shows a schematic structural diagram of a mobile terminal according to Embodiment 5 of the present invention.

Detailed ways

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present disclosure will be more thoroughly understood, and will fully convey the scope of the present disclosure to those skilled in the art.

Example 1

Referring to FIG. 1 , a flowchart of a method for adjusting a display direction according to Embodiment 1 of the present invention is shown, which may specifically include the following steps:

Step 110: Obtain the display directions of the first display interface and the second display interface in the display interfaces of the mobile terminal.

In the embodiment of the present invention, when the mobile terminal is used, when it is determined that the display screen on the mobile terminal is in an on state, it is detected that there are two display interfaces, namely a first display interface and a second display interface. Wherein, the first display interface and the second display interface may be two independent display interfaces with a split screen, or may be superimposed display interfaces. For example, the display area of the first display interface is smaller than that of the second display interface, and is suspended on the second display interface.

This embodiment is further described by taking the split screen as an example. First determine whether dual-screen display is enabled in the mobile terminal. Among them, the display-related components in the Android framework mainly include activity Activity, window Windows, window attribute WindowState, window management service Windows Manager Service, display management service Display ManagerService, and interface management Surface Manager /Surface Flinger, Display HAL (HardwareAbstraction Layer) and display drivers in the Linux Kernel, the core of the Linux system. The Android platform added support for multiple screens after version 4.2. There are three main screen types: Primary Display, External Display and Virtual Display. The built-in screen is generally recognized as the main screen, and HDMI will be set as the external screen. In order to facilitate the APP to access the above three types of screens, Android also provides a unified screen management service DisplayManagerService, through which the display device parameters can also be easily obtained and dual-screen display operations can be realized. The Android system maintains the current window stack through a list of WindowState, and the list represents the depth of field (front and rear) layout order of the window displayed by the current window from the beginning to the end. The list is bound to the current display default device, and WindowState itself contains the Surface information of the current form. The above implements the default display device, the WindowState list, and the connection relationship between the Surfaces of each Window. Then, it is judged according to the current display situation, if the current dual-screen simultaneous display state, there is an application request to display on the second screen. First, create a new form stack - the second form stack according to the default form stack, that is, the default WindowState list, obtain the second screen operation context object DisplayContent through the DisplayManager Service and combine the newly created second form stack with the obtained Context object bindings. At this time, the window state object WindowState of the current application is searched from the first window stack. Therefore, by obtaining the specific parameters of WindowState, you can know the opening state of the dual-screen display of the mobile terminal. When the split-screen state is turned on, further to obtain the display directions of the images displayed on the first display screen and the second display screen.

Step 120, when the display orientation of the first display interface and the display orientation of the second display interface are different, adjust the display orientation of the other display interface according to the display orientation of one of the first display interface or the second display interface, So that the display direction of the first display interface and the display direction of the second display interface are the same.

In the embodiment of the present invention, in practical applications, the preview direction of the camera is 360 degrees because the screen of the mobile phone can be rotated, in order to ensure that the user can see the "correct" preview screen no matter how the mobile phone rotates (this "correct" refers to the human eye The order of the pictures in front of you is matched with the pictures in the UI preview interface), so the viewing directions in the dual-screen display interface of the mobile terminal are not necessarily the same. The data is rotated and then sent to the display system. Therefore, after opening the Camera app, no matter how you rotate the phone, you can see the "correct" picture. The Android system provides an API to manually set the camera's preview orientation, called setDisplayOrientation , by default, this value is 0, which is consistent with the orientation of the image Sensor, so for landscape applications, you do not need to change the Camera preview orientation, but if the application is a portrait application, you must pass this API to the Camera Rotate the preview direction by 90, which is consistent with the direction of the mobile phone screen, so as to get the correct preview picture. The direction of the camera is that when the user clicks the photo button, the direction of the obtained picture is not necessarily the same as the direction of the preview in the screen. This is because the data collected by the image sensor is directly stored on the SDCard. Therefore, the Camera The photographing direction of the camera is consistent with the image sensor direction of the above-mentioned camera. Therefore, if the camera direction is not the correct direction, the viewfinder direction of one display screen in the dual screen is mainly used, and the viewfinder direction of the two display screens is adjusted to be consistent. Among them, the function setDisplayOrientation() can be called to ensure that the preview direction of the camera is consistent with the Activity. The direction is the same, that is, adjust to the correct direction.

In this embodiment of the present invention, the display directions of the first display interface and the second display interface in the display interface of the mobile terminal are acquired; when the display direction of the first display interface and the display direction of the second display interface are different, according to the The display orientation of one display interface or the second display interface is adjusted, and the display orientation of the other display interface is adjusted so that the display orientation of the first display interface and the display orientation of the second display interface are the same. It has the beneficial effect of always adjusting the camera preview direction, that is, the framing direction, to face the positive direction of the user, which enhances the user's use experience.

Embodiment 2

Referring to FIG. 2 , a flowchart of a method for adjusting a display direction according to Embodiment 2 of the present invention is shown, which may specifically include the following steps:

Step 210: Obtain the display directions of the first display interface and the second display interface after the split screen, wherein the first display interface is a reduced interface of the display interface before the split screen.

In the embodiment of the present invention, the display-related components in the Android framework mainly include activity Activity, window Windows, window attribute WindowState, window management service Windows Manager Service, display management service Display Manager Service, interface management Surface Manager/Surface Flinger, display layer DisplayHAL (Hardware Abstraction Layer) and the display driver in the Linux Kernel, the core of the Linux system. The Android platform added support for multiple screens after version 4.2. There are three main screen types: Primary Display, External Display and Virtual Display. The built-in screen is generally recognized as the main screen, and HDMI will be set as the external screen. In order to facilitate the APP to access the above three kinds of screens, Android also provides a unified screen management service DisplayManagerService. Although the screen is divided into 3 types, the window composition and rendering built on them are still managed by SurfaceFlinger. The introduction of these new features ensures the framework foundation for dual-screen display. In the specific implementation, for example, when the Surface Manger recognizes that the current device has multiple logical display devices, it can create the corresponding Surface as needed, and the Display ManagerService can also easily obtain and operate the display device list. The Android system maintains the current window stack through a list of WindowState, and the list represents the depth of field (front and rear) layout order of the window displayed by the current window from the beginning to the end. The list is bound to the current display default device, and WindowState itself contains the Surface information of the current form, so as to realize dual-screen display on the display screen of the mobile terminal, and the first display interface can be changed to the front-split screen according to the change of parameter settings. The reduced interface of the display interface, the size of the reduced interface and the ratio to the full screen can be set according to the firmware parameters of the current mobile terminal. Certainly, the manner of detecting the dual-screen state of the mobile terminal is not limited to the above description, which is not limited in this embodiment of the present invention.

Step 220: Adjust the display direction of the second display interface according to the display direction of the first display interface, so that the display direction of the second display interface is the same as the display direction of the first display interface.

In the embodiment of the present invention, the judgment is made according to the current display situation. If the current dual-screen simultaneous display state is in the state of simultaneous display, there is an application request to display on the second screen. First, create a new window stack - the second window stack according to the default window stack, that is, the default WindowState list, obtain the second screen operation context object DisplayContent through the Display Manager Service and add the newly created second window stack to the second window stack. Get the context object binding. At this time, the window state object WindowState of the current application is searched from the first window stack. Therefore, by obtaining specific parameters in WindowState, it can be known whether the dual-screen display state of the mobile terminal is in the open state. According to the above method, when it is determined that the mobile terminal enables dual-screen display, one of the applications is a camera application displayed in one of the display tasks, and the other application is displayed in the second display task. Parameters, for example, through the function ToSecondDisplay(), where mDisplayContents, obtain the display content and display direction in the first display task and the second display task, and usually the display direction in the first display interface is facing the user, so use This direction is the main one, and the display direction of the second display interface is adjusted to be the same as the display direction of the first interface. According to the display direction of the display interface before the split screen, the display interface of the first display interface after the split screen can be known. The first display interface is a reduced interface of the display interface before the split screen. Since the display direction of the first display interface is adapted to the user, the first display interface shall prevail after the screen is split, and adjusting the display direction of the second display interface can ensure that the user's viewing is not affected by the split screen.

Preferably, in another embodiment of the present invention, it also includes:

Step 210A, during the video call, acquire the first display interface captured by the front camera of the mobile terminal, and determine the display direction of the first display interface according to the face of the first display interface.

In the embodiment of the present invention, in the practical application, taking the Android system as an example, firstly, it is detected whether the device has a camera. When a video call is in progress, first, whether the device has a camera can be determined according to the return value of the function hasCamera(), and the function can be used to determine whether the device has a camera. hasBackFacingCamera() and the function hasFrontFacingCamera() determine whether the front and rear cameras of the device are available, and to further determine the status of the camera, you can use the main thread to call the function Camera.open to get the corresponding RuntimeException of the catch, if the return value canUse=true, then Indicates that the current camera is on. When it is determined that the status of the camera on the device is on, and according to the parameters returned by the video call start operation, it starts to further judge the framing content of the camera, and extracts the face features in the framing content in the framing screen, and according to the face features The display direction determines the display direction of the first display interface. Usually, in a video call, since the front camera captures the user's face, the first display interface is the image captured by the front camera, and the acquired user's face features The display direction is the standard of the current screen display direction of the mobile terminal.

Preferably, step 210A specifically includes: sub-steps 210A1-210A2;

Sub-step 210A1: Determine the display direction of the first display interface according to the T-shaped area angle offset parameter in the facial features in the first display interface.

In the embodiment of the present invention, the main application of face recognition when taking pictures with a mobile phone is: face detection and positioning in the shooting scene, and in the face detection method based on geometric features, it is first determined that the face consists of parts such as eyes, nose, mouth, chin, etc. It is precisely because of the various differences in shape, size and structure of these parts that each face in the world is very different, so the geometric description of the shape and structural relationship of these parts can be used as an important feature of face recognition. Roughly, several salient points are firstly determined according to the contour curve, and a set of characteristic metrics for identification such as distance, angle, etc. are derived from these salient points, and are projected by the integral near the line in the frontal grayscale image. When a contour curve that conforms to the identification features is found during the photographing process, it can be quickly positioned and marked. For face T-shaped contour feature recognition, the positions of the face feature points that need to be identified are roughly, the eyebrows, the left side of the nose, the tip of the nose, the right side of the nose, the lower side of the nostril, the position of the pupil, the lower side of the upper lip, etc. The distribution of the feature points Similar to the T shape. After the T-shaped area of the face feature is determined, the display angle of the area can be specifically determined, so as to determine the display direction of the shooting framing angle.

Preferably, sub-step 210A1 specifically includes: sub-step 210A11-sub-step 210A13;

Sub-step 210A11, according to the facial features in the first display interface, determine whether it is a single facial feature.

或者

时，可以根据T字的角度获取角度偏移参数。In the embodiment of the present invention, if it is found that multiple face features are detected by monitoring the T-shaped feature of the human face in the preview image displayed by shooting, then it is determined that there are multiple human faces in the current preview image. A T-shaped area is identified as a face. When it is determined to detect a single face feature, the angle offset parameter of the T-shaped area of the face feature is extracted, assuming the scene is that the mobile phone is placed horizontally (or the mobile phone's gravity sensor is abnormal), and the automatic face recognition function in the viewfinder is turned on. The eyes and the bridge of the nose are the "T"-shaped areas, which are used as the standard for judging whether the framing is correct. When the "T" gradually becomes

or

, the angle offset parameter can be obtained according to the angle of the T word.

Step 210A12, if it is a single face feature, determine the display direction of the first display interface according to the T-shaped area angle offset parameter in the single face feature.

或者

时，切换取景视角90度。其中，人脸T型区与取景角度偏移变化量实时读取，且判定当人脸T型区与摄像头取景角度一旦偏移超过了45度门限时，即可切换摄像头取景角度。In the embodiment of the present invention, as shown in FIG. 2A , it is assumed that the scene is that the mobile phone is placed horizontally (or the gravity sensor of the mobile phone is abnormal), the automatic face recognition function in the viewfinder is turned on, and the “T”-shaped area of the eyes and the bridge of the nose is recognized to identify the human face and the bridge of the nose. This is the standard for judging whether the framing is correct. When it gradually changes from "T" to

or

, switch the viewing angle to 90 degrees. Among them, the change of the face T-shaped area and the viewing angle offset is read in real time, and it is determined that once the deviation between the face T-shaped area and the camera viewing angle exceeds the 45-degree threshold, the camera viewing angle can be switched.

Step 210A13: If there are multiple face features, determine the display direction of the first display interface according to the T-shaped area angle offset parameter in the face feature with the largest area among the multiple face features.

In the embodiment of the present invention, if there are multiple faces on the screen and the offset angles of the T-shaped areas of multiple faces are inconsistent due to inconsistency in behavior (head tilt), it is necessary to enable the detection of the area size of the face recognition area, with the largest individual The area of the face recognition area is used as the main reference face, and the deviation between the T-shaped area of the face and the current camera framing angle is extracted as the criterion for judging the change of the framing angle of the camera. The highest, the extracted face features in the T-shaped area can indicate the framing direction of the framing screen, so if multiple T-shaped areas of faces are monitored, the T-shaped area in the face feature with the largest area is used as the judgment angle deviation. T-type feature for shifting parameters.

Sub-step 210A2, when the difference between the angle of the T-shaped area in the facial features in the second display interface and the angle of the T-shaped area in the facial features in the first display interface reaches a preset switching threshold, then The display direction of the second display interface is adjusted according to the display direction of the first display interface, so that the display direction of the second display interface is the same as the display direction of the first display interface.

In this embodiment of the present invention, after determining the viewing directions of the cameras of the first display interface and the second display interface through the above method, then the display directions of the two display interfaces are determined according to the offset angles of the display directions of the two display interfaces. Whether it is consistent, if not, adjust it. For example, in the above example, when it is determined that the angle deviation between the face T-shaped area in the second display interface and the face T-shaped area in the first display interface exceeds the 45-degree threshold, then Rotate the viewing direction of the second display interface to less than 20 degrees, where 20 degrees is the preset forward viewing value. Specifically, by calling the function getCameraInfo(), the function getWindowManager() and the function getDefaultDisplay(), you can know For the current display task direction, the camera viewing direction is adjusted to a preset value through Surface.ROTATION. Of course, the value can be adjusted and set at any time according to the user's needs, which is not limited in this embodiment of the present invention.

Preferably, in another embodiment of the present invention, it also includes:

Step 210B: Acquire the second display interface of the counterparty in the video call, and determine the display direction of the second display interface according to the face of the second display interface.

In the embodiment of the present invention, the second display interface is usually an image of the other party in the video call, and the facial features in the display interface are extracted, and the display direction of the facial features is further judged, and then the display direction of the second display interface is determined. Generally, In other words, a face recognition system includes image capture, face localization, image preprocessing, and face recognition (identity confirmation or identity search). Therefore, the display direction of the face can be determined after processing according to the main features of the face.

Step 210C: Adjust the display direction of the second display interface according to the display direction of the first display interface, so that the display direction of the second display interface is the same as the display direction of the first display interface.

This step is the same as step 220 and will not be described in detail here.

In this embodiment of the present invention, by acquiring the display orientations of the first display interface and the second display interface after the split screen, the display orientation of the second display interface is adjusted according to the display orientation of the first display interface, so that the display orientation of the second display interface is The direction is the same as the display direction of the first display interface, and the first display interface captured by the front camera of the mobile terminal is acquired during the video call, and the first display interface is determined according to the face of the first display interface. The display direction is adjusted, and the directions of the two display interfaces are adjusted to be consistent, realizing the beneficial effects of improving the user experience such as selfies and video calls in more complex scenes.

Embodiment 3

Referring to FIG. 3 , a structural block diagram of a mobile terminal according to Embodiment 3 of the present invention is shown.

The mobile terminal 300 includes: a viewfinder direction acquisition module 301 and a viewfinder direction adjustment module 302 .

The viewing direction acquisition module 301 is used to acquire the display directions of the first display interface and the second display interface in the display interface of the mobile terminal; the viewing direction adjustment module 302 is used for when the display direction of the first display interface and the second display interface are displayed. When the display directions are different, according to the display direction of one of the first display interface or the second display interface, adjust the display direction of the other display interface, so that the display direction of the first display interface and the display direction of the second display interface same direction.

Referring to FIG. 4 , the functions of each module of the mobile terminal 400 and the interaction relationship between the modules are described in detail below.

A viewing direction obtaining module 401, configured to obtain the display directions of the first display interface and the second display interface in the display interface of the mobile terminal;

Preferably, the framing direction acquiring module 401 specifically includes:

The sub-module 4011 for obtaining the display direction of the split screen is used to obtain the display directions of the first display interface and the second display interface after the split screen, wherein the first display interface is a reduced interface of the display interface before the split screen;

Preferably, in another embodiment of the present invention, the framing direction acquiring module 401 includes:

a first display orientation acquisition submodule, configured to acquire a first display interface captured by a front camera of a mobile terminal during a video call, and determine a display orientation of the first display interface according to a face of the first display interface;

The second display orientation obtaining submodule is used to obtain the second display interface of the opposite party in the video call, and determine the display orientation of the second display interface according to the face of the second display interface;

Preferably, the first display direction sub-module specifically includes:

a face feature direction determination unit, configured to determine the display direction of the first display interface according to the T-shaped area angle offset parameter in the face feature in the first display interface;

Preferably, the face feature direction determination unit specifically includes:

A single face feature judgment subunit, used for judging whether it is a single face feature according to the face feature in the first display interface;

The single-face display direction determination subunit is used for determining the display direction of the first display interface according to the T-shaped area angle offset parameter in the single face feature if it is a single face feature.

The multi-face display direction determination subunit is used to determine the first display interface according to the T-shaped area angle offset parameter in the face feature with the largest area in the plurality of face features if it is a plurality of face features display direction.

The viewfinder direction adjustment module 402 is used to adjust the display direction of one display interface in the first display interface or the second display interface when the display direction of the first display interface is different from the display direction of the second display interface. The display direction of the interface, so that the display direction of the first display interface and the display direction of the second display interface are the same.

Preferably, the viewing direction adjustment module 402 specifically includes:

The viewing direction adjustment sub-module 4021 adjusts the display direction of the second display interface according to the display direction of the first display interface, so that the display direction of the second display interface is the same as the display direction of the first display interface.

The viewing direction judgment and adjustment sub-module 4022 is used for when the difference between the T-shaped area angle in the facial features in the second display interface and the T-shaped area angle in the facial features in the first display interface reaches The preset switching threshold is to adjust the display direction of the second display interface according to the display direction of the first display interface, so that the display direction of the second display interface is the same as the display direction of the first display interface.

In this embodiment of the present invention, by acquiring the display orientations of the first display interface and the second display interface after the split screen, the display orientation of the second display interface is adjusted according to the display orientation of the first display interface, so that the display orientation of the second display interface is The direction is the same as the display direction of the first display interface, and the first display interface captured by the front camera of the mobile terminal is acquired during the video call, and the first display interface is determined according to the face of the first display interface. The display direction is adjusted, and the directions of the two display interfaces are adjusted to be consistent, realizing the beneficial effects of improving the user experience such as selfies and video calls in more complex scenes.

Embodiment 4

Referring to FIG. 5 , a structural block diagram of a mobile terminal in Embodiment 4 of the present invention is shown.

The mobile terminal 500 shown in FIG. 5 includes: at least one processor 501 , memory 502 , at least one network interface 504 and user interface 503 , and a photographing component 506 . The various components in the mobile terminal 500 are coupled together by a bus system 505 . It is understood that the bus system 505 is used to implement the connection communication between these components. In addition to the data bus, the bus system 505 also includes a power bus, a control bus and a status signal bus. However, for clarity of illustration, the various buses are labeled as bus system 505 in FIG. 5 .

Among them, the user interface 503 may include a display, a keyboard, or a pointing device (eg, a mouse, a trackball, a touch pad or a touch screen, etc.).

It can be understood that the memory 502 in the embodiment of the present invention may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be Read-Only Memory (ROM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (ErasablePROM, EPROM), Electrically Erasable Program read-only memory (Electrically EPROM, EEPROM) or flash memory. The volatile memory may be Random Access Memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double data rate synchronous dynamic random access memory (DoubleDataRateSDRAM, DDRSDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (SynchlinkDRAM, SLDRAM) and direct memory bus random access Memory (DirectRambusRAM, DRRAM). The memory 502 of the systems and methods described in the embodiments of the present invention is intended to include, but not be limited to, these and any other suitable types of memory.

In some embodiments, memory 502 stores the following elements, executable modules or data structures, or a subset thereof, or an extended set of them: an operating system 5021 and applications 5022 .

The operating system 5021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks. The application program 5022 includes various application programs, such as a media player (MediaPlayer), a browser (Browser), etc., for implementing various application services. The program for implementing the method of the embodiment of the present invention may be included in the application program 5022 .

In this embodiment of the present invention, by calling the program or instruction stored in the memory 502, specifically, the program or instruction stored in the application program 5022, the processor 501 is configured to acquire the first display interface and The display orientation of the second display interface; when the display orientation of the first display interface and the display orientation of the second display interface are different, adjust the display orientation of one of the first display interface or the second display interface according to the display orientation of the other display interface The display direction of the interface, so that the display direction of the first display interface and the display direction of the second display interface are the same. The methods disclosed in the above embodiments of the present invention may be applied to the processor 501 or implemented by the processor 501 . The processor 501 may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above-mentioned method can be completed by an integrated logic circuit of hardware in the processor 501 or an instruction in the form of software. The above-mentioned processor 501 may be a general-purpose processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), an off-the-shelf programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or Transistor logic devices, discrete hardware components. Various methods, steps, and logical block diagrams disclosed in the embodiments of the present invention can be implemented or executed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in conjunction with the embodiments of the present invention may be directly embodied as executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules may be located in random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers and other storage media mature in the art. The storage medium is located in the memory 502, and the processor 501 reads the information in the memory 502, and completes the steps of the above method in combination with its hardware.

It can be understood that the embodiments described in the embodiments of the present invention may be implemented by hardware, software, firmware, middleware, microcode or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application specific integrated circuits (Application Specific Integrated Circuits, ASIC), digital signal processors (Digital Signal Processing, DSP), digital signal processing devices (DSP Device, DSPD), Programmable Logic Device (Programmable Logic Device, PLD) ), a Field-Programmable Gate Array (FPGA), a general-purpose processor, a controller, a microcontroller, a microprocessor, other electronic units for performing the functions described herein, or a combination thereof.

For software implementation, the techniques described in the embodiments of the present invention may be implemented through modules (eg, procedures, functions, etc.) that perform the functions described in the embodiments of the present invention. Software codes may be stored in memory and executed by a processor. The memory can be implemented in the processor or external to the processor.

Optionally, when the processor 501 processes the acquisition of the display orientations of the first display interface and the second display interface in the display interface of the mobile terminal, it is further configured to: acquire the display orientation of the first display interface and the second display interface after the split screen. Display orientation, wherein the first display interface is a reduced interface of the display interface before the split screen; the display orientation of one display interface in the first display interface or the second display interface is adjusted according to the display orientation of the other display interface, When making the display direction of the first display interface and the display direction of the second display interface the same, it is also used to: adjust the display direction of the second display interface according to the display direction of the first display interface, so that the display direction of the second display interface It is the same as the display direction of the first display interface.

Optionally, when the processor 501 processes the acquisition of the display directions of the first display interface and the second display interface in the display interface of the mobile terminal, it is further configured to: acquire the data collected by the front camera of the mobile terminal during the video call. a first display interface, determining the display direction of the first display interface according to the face of the first display interface; acquiring the second display interface of the other party in the video call, and determining the display interface according to the face of the second display interface The display direction of the second display interface; the display direction of one of the first display interface or the second display interface is adjusted according to the display direction of the other display interface, so that the display direction of the first display interface and the second display interface are adjusted. When the display directions of the display interfaces are the same, it is also used for: adjusting the display direction of the second display interface according to the display direction of the first display interface, so that the display direction of the second display interface is the same as that of the first display interface.

Optionally, when the processor 501 processes the determining of the display direction of the first display interface according to the face of the first display interface, the processor 501 is further configured to: according to the facial features in the first display interface: The angle offset parameter of the T-shaped area determines the display direction of the first display interface; when the display direction of the first display interface and the display direction of the second display interface are different, the When adjusting the display direction of one display interface in the display interface, and adjusting the display direction of the other display interface so that the display direction of the first display interface and the display direction of the second display interface are the same, it is also used for: when the second display interface is in the same display direction The difference between the angle of the T-shaped area in the face feature and the angle of the T-shaped area in the face feature in the first display interface reaches the preset switching threshold, then the second display is adjusted according to the display direction of the first display interface. The display direction of the interface, so that the display direction of the second display interface is the same as the display direction of the first display interface.

Optionally, when the processor 501 processes the T-shaped area angle offset parameter in the face feature in the first display interface and determines the display direction of the first display interface, it is further configured to: Describe the facial feature in the first display interface, judge whether it is a single facial feature; if it is a single facial feature, then according to the T-shaped area angle offset parameter in the single facial feature, determine the first display The display direction of the interface; if there are multiple face features, the display direction of the first display interface is determined according to the T-shaped area angle offset parameter in the face feature with the largest area among the multiple face features.

It can be seen that, in this embodiment of the present invention, by acquiring the display directions of the first display interface and the second display interface after the split screen, the display direction of the second display interface is adjusted according to the display direction of the first display interface, so that the second display interface The display direction is the same as the display direction of the first display interface, and the first display interface captured by the front camera of the mobile terminal is acquired during the video call, and the first display interface is determined according to the face of the first display interface. The display direction of the interface is adjusted, and the directions of the two display interfaces are adjusted to be consistent, so as to realize the beneficial effect of improving the user experience, such as Selfie and video call in a more complex scene.

Embodiment 5

FIG. 6 shows a schematic structural diagram of a mobile terminal according to Embodiment 5 of the present invention.

The mobile terminal in the embodiment of the present invention may be a mobile phone, a tablet computer, a personal digital assistant (Personal Digital Assistant, PDA), or a vehicle-mounted computer.

The mobile terminal in FIG. 6 includes a radio frequency (RF) circuit 610 , a memory 620 , an input unit 630 , a display unit 640 , a processor 660 , an audio circuit 670 , a WiFi (Wireless Fidelity) module 680 , and a power supply 690 .

Wherein, the input unit 630 can be used for receiving numerical or character information input by the user, and generating signal input related to user setting and function control of the mobile terminal. Specifically, in this embodiment of the present invention, the input unit 630 may include a touch panel 631 . The touch panel 631, also known as a touch screen, can collect the user's touch operations on or near it (such as the user's operations on the touch panel 631 using any suitable objects or accessories such as a finger, a stylus, etc.) The specified program drives the corresponding connection device. Optionally, the touch panel 631 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To the processor 660, and can receive the commands sent by the processor 660 and execute them. In addition, the touch panel 631 can be realized by various types of resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 631, the input unit 630 may also include other input devices 632, and the other input devices 632 may include but are not limited to physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, joysticks, etc. one or more of.

The display unit 640 may be used to display information input by the user or information provided to the user and various menu interfaces of the mobile terminal. The display unit 640 may include a display panel 641, and optionally, the display panel 641 may be configured in the form of an LCD or an organic light-emitting diode (Organic Light-Emitting Diode, OLED).

It should be noted that the touch panel 631 can cover the display panel 641 to form a touch display screen. When the touch display screen detects a touch operation on or near it, it is transmitted to the processor 660 to determine the type of the touch event, and then the processor 660 provides corresponding visual output on the touch display screen according to the type of touch event.

The touch screen includes the application program interface display area and the commonly used controls display area. The arrangement of the application program interface display area and the common control display area is not limited, and may be an arrangement that can distinguish the two display areas, such as up-down arrangement, left-right arrangement, or the like. The application program interface display area can be used to display the interface of the application program. Each interface may contain at least one application icon and/or interface elements such as widget desktop controls. The application program interface display area can also be an empty interface that does not contain any content. The commonly used control display area is used to display controls with high usage rate, such as setting buttons, interface numbers, scroll bars, phonebook icons and other application icons.

The processor 660 is the control center of the mobile terminal, using various interfaces and lines to connect various parts of the entire mobile phone, by running or executing the software programs and/or modules stored in the first memory 621, and calling the software programs and/or modules stored in the second memory 622, perform various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole. Optionally, processor 660 may include one or more processing units.

In this embodiment of the present invention, by calling and storing software programs and/or modules in the first memory 621 and/or data in the second memory 622, the processor 660 is configured to acquire the first data in the display interface of the mobile terminal. The display orientation of the display interface and the second display interface; when the display orientation of the first display interface and the display orientation of the second display interface are different, adjust the display orientation according to the display orientation of one of the first display interface or the second display interface The display direction of the other display interface, so that the display direction of the first display interface and the display direction of the second display interface are the same.

Optionally, when the processor 660 processes the acquiring the display orientations of the first display interface and the second display interface in the display interface of the mobile terminal, it is further configured to: acquire the first display interface and the second display interface after the split screen. Display orientation, wherein the first display interface is a reduced interface of the display interface before the split screen; the display orientation of one display interface in the first display interface or the second display interface is adjusted according to the display orientation of the other display interface, When making the display direction of the first display interface and the display direction of the second display interface the same, it is also used to: adjust the display direction of the second display interface according to the display direction of the first display interface, so that the display direction of the second display interface It is the same as the display direction of the first display interface.

Optionally, when the processor 660 processes the acquisition of the display directions of the first display interface and the second display interface in the display interface of the mobile terminal, it is further configured to: acquire the data collected by the front camera of the mobile terminal during the video call. a first display interface, determining the display direction of the first display interface according to the face of the first display interface; acquiring the second display interface of the other party in the video call, and determining the display interface according to the face of the second display interface The display direction of the second display interface; the display direction of one of the first display interface or the second display interface is adjusted according to the display direction of the other display interface, so that the display direction of the first display interface and the second display interface are adjusted. When the display directions of the display interfaces are the same, it is also used for: adjusting the display direction of the second display interface according to the display direction of the first display interface, so that the display direction of the second display interface is the same as that of the first display interface.

Optionally, when the processor 660 processes the determining of the display direction of the first display interface according to the face of the first display interface, the processor 660 is further configured to: according to the facial features in the first display interface: The angle offset parameter of the T-shaped area determines the display direction of the first display interface; when the display direction of the first display interface and the display direction of the second display interface are different, the When adjusting the display direction of one display interface in the display interface, and adjusting the display direction of the other display interface so that the display direction of the first display interface and the display direction of the second display interface are the same, it is also used for: when the second display interface is in the same display direction The difference between the angle of the T-shaped area in the face feature and the angle of the T-shaped area in the face feature in the first display interface reaches the preset switching threshold, then the second display is adjusted according to the display direction of the first display interface. The display direction of the interface, so that the display direction of the second display interface is the same as the display direction of the first display interface.

Optionally, when the processor 660 processes the T-shaped area angle offset parameter in the facial features in the first display interface and determines the display direction of the first display interface, it is further configured to: Describe the facial feature in the first display interface, judge whether it is a single facial feature; if it is a single facial feature, then according to the T-shaped area angle offset parameter in the single facial feature, determine the first display The display direction of the interface; if there are multiple face features, the display direction of the first display interface is determined according to the T-shaped area angle offset parameter in the face feature with the largest area among the multiple face features.

It can be seen that, in this embodiment of the present invention, by acquiring the display directions of the first display interface and the second display interface after the split screen, the display direction of the second display interface is adjusted according to the display direction of the first display interface, so that the second display interface The display direction is the same as the display direction of the first display interface, and the first display interface captured by the front camera of the mobile terminal is acquired during the video call, and the first display interface is determined according to the face of the first display interface. The display direction of the interface is adjusted, and the directions of the two display interfaces are adjusted to be consistent, so as to realize the beneficial effect of improving the user experience, such as Selfie and video call in a more complex scene.

As for the apparatus embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and reference may be made to the partial description of the method embodiment for related parts.

The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the various embodiments may be referred to each other.

The algorithms and displays provided herein are not inherently related to any particular computer, virtual system, or other device. Various general-purpose systems can also be used with teaching based on this. The structure required to construct such a system is apparent from the above description. Furthermore, the present invention is not directed to any particular programming language. It is to be understood that various programming languages may be used to implement the inventions described herein, and that the descriptions of specific languages above are intended to disclose the best mode for carrying out the invention.

In the description provided herein, numerous specific details are set forth. It will be understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it is to be understood that in the above description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together into a single embodiment, figure, or its description. This disclosure, however, should not be construed as reflecting an intention that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. The modules or units or components in the embodiments may be combined into one module or unit or component, and further they may be divided into multiple sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method so disclosed may be employed in any combination, unless at least some of such features and/or procedures or elements are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that although some of the embodiments described herein include certain features, but not others, included in other embodiments, that combinations of features of different embodiments are intended to be within the scope of the invention within and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

Various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components in the photographing apparatus according to the embodiments of the present invention. The present invention can also be implemented as apparatus or apparatus programs (eg, computer programs and computer program products) for performing part or all of the methods described herein. Such a program implementing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such signals may be downloaded from Internet sites, or provided on carrier signals, or in any other form.

It should be noted that the above-described embodiments illustrate rather than limit the invention, and that alternative embodiments may be devised by those skilled in the art without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. do not denote any order. These words can be interpreted as names.

Those skilled in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in the embodiments of the present invention can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of the present invention.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described systems, devices and units may refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

In the embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as independent products, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product in essence, or the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including Several instructions are used to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk and other mediums that can store program codes.

The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention. should be included within the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims (8)

1. A method for adjusting a display direction, applied to a mobile terminal, characterized in that comprising: Obtaining the display directions of the first display interface and the second display interface in the display interface of the mobile terminal includes: obtaining the display directions of the first display interface and the second display interface after the split screen, wherein the first display interface is before the split screen The reduced interface of the display interface; When the display direction of the first display interface and the display direction of the second display interface are different, according to the display direction of one of the first display interface or the second display interface, adjust the display direction of the other display interface, so that the display direction of the other display interface is adjusted. The display direction of the first display interface is the same as the display direction of the second display interface, including: adjusting the display direction of the second display interface according to the display direction of the first display interface, so that the display direction of the second display interface is the same as that of the first display interface. The display direction is the same. 2. The method according to claim 1, wherein the step of acquiring the display directions of the first display interface and the second display interface in the display interface of the mobile terminal comprises: During the video call, acquiring the first display interface captured by the front camera of the mobile terminal, and determining the display direction of the first display interface according to the face of the first display interface; acquiring the second display interface of the opposite party in the video call, and determining the display direction of the second display interface according to the face of the second display interface; The step of adjusting the display direction of the other display interface according to the display direction of one of the first display interface or the second display interface, so that the display direction of the first display interface and the display direction of the second display interface are the same ,include: The display direction of the second display interface is adjusted according to the display direction of the first display interface, so that the display direction of the second display interface is the same as the display direction of the first display interface. 3. The method according to claim 2, wherein the step of determining the display direction of the first display interface according to the face of the first display interface comprises: Determine the display direction of the first display interface according to the T-shaped area angle offset parameter in the face feature in the first display interface; When the display direction of the first display interface and the display direction of the second display interface are different, adjusting the display direction of the other display interface according to the display direction of one of the first display interface or the second display interface, so as to The steps of making the display direction of the first display interface and the display direction of the second display interface the same include: When the difference between the angle of the T-shaped area in the face feature in the second display interface and the angle of the T-shaped area in the face feature in the first display interface reaches the preset switching threshold, then according to the first display interface The display direction of the interface adjusts the display direction of the second display interface, so that the display direction of the second display interface is the same as the display direction of the first display interface. 4. The method according to claim 3, wherein, according to the T-shaped area angle offset parameter in the facial features in the first display interface, determine the display direction of the first display interface. steps, including: According to the facial features in the first display interface, determine whether it is a single facial feature; If it is a single face feature, then according to the T-shaped area angle offset parameter in the single face feature, determine the display direction of the first display interface; If there are multiple face features, the display direction of the first display interface is determined according to the T-shaped area angle offset parameter in the face feature with the largest area among the multiple face features. 5. A mobile terminal, characterized in that, comprising: a viewfinder direction acquisition module, configured to acquire the display directions of the first display interface and the second display interface in the display interface of the mobile terminal; A viewfinder direction adjustment module, used for adjusting the display direction of one display interface of the first display interface or the second display interface when the display direction of the first display interface and the display direction of the second display interface are different, to adjust the other display interface the display direction of the first display interface, so that the display direction of the first display interface and the display direction of the second display interface are the same; The framing direction acquisition module includes: A submodule for obtaining a split-screen display direction is used to obtain the display directions of the first display interface and the second display interface after the split-screen, wherein the first display interface is a reduced interface of the display interface before the split-screen; The viewfinder direction adjustment module includes: a viewfinder direction adjustment sub-module for adjusting the display direction of the second display interface according to the display direction of the first display interface, so that the display direction of the second display interface is the same as the display direction of the first display interface. same direction. 6. The mobile terminal according to claim 5, wherein the viewing direction acquisition module comprises: a first display orientation acquisition sub-module, configured to acquire a first display interface captured by a front camera of a mobile terminal during a video call, and determine a display orientation of the first display interface according to the face of the first display interface; The second display orientation obtaining submodule is used to obtain the second display interface of the opposite party in the video call, and determine the display orientation of the second display interface according to the face of the second display interface; The viewfinder direction adjustment module includes: a viewfinder direction adjustment sub-module, which adjusts the display direction of the second display interface according to the display direction of the first display interface, so that the display direction of the second display interface is the same as the display direction of the first display interface . 7. The mobile terminal according to claim 6, wherein the first display direction sub-module comprises: a face feature direction determining unit, configured to determine the display direction of the first display interface according to the T-shaped area angle offset parameter in the face feature in the first display interface; The framing direction adjustment module includes: a framing direction judging and adjusting sub-module, which is used when the angle of the T-shaped area in the face features in the second display interface is different from the face features in the first display interface. If the difference between the angles of the T-shaped areas reaches the preset switching threshold, the display direction of the second display interface is adjusted according to the display direction of the first display interface, so that the display direction of the second display interface is the same as that of the first display interface. 8. The mobile terminal according to claim 7, wherein the face feature direction determination unit comprises: A single face feature judgment subunit, used for judging whether it is a single face feature according to the face feature in the first display interface; A single-face display direction determination subunit, used for determining the display direction of the first display interface if it is a single face feature, then according to the T-shaped area angle offset parameter in the single face feature; The multi-face display direction determination subunit is used to determine the first display interface according to the T-shaped area angle offset parameter in the face feature with the largest area in the plurality of face features if it is a plurality of face features display direction.

Images