CN114359528A - Adaptive method, apparatus, medium, and computer program product for operating an object - Google Patents

Abstract

The present invention relates to the field of three-dimensional modeling, and more particularly, to an adaptive method, apparatus, computer-readable storage medium, and computer program product for manipulating an object. The manipulator is configured to interact with scene elements in the virtual world within the viewport, and the method of the invention comprises: determining a distance between the operating element and a border of the viewport; and adjusting, when the distance is smaller than or equal to a preset value, the size of the operating element within a size constraint range of the operating element, and/or adjusting the relative position between the viewport and the virtual world, so that the adjusted operating element is always within the viewport range. The invention can utilize the distance between the operating element and the frame of the viewport to quantify the approach degree of the operating element and the frame of the viewport, and can realize the self-adaptive adjustment of the operating element before at least one part of the operating element exceeds the range of the viewport.

Description

Adaptive method, apparatus, medium and computer program product for operating element

technical field

The present invention relates to the technical field of three-dimensional model making, and in particular, to an adaptive method, device, computer-readable storage medium and computer program product of an operating element.

Background technique

The user can interact with the scene element in the virtual world within the viewport range through the operating element. However, when the scene element is close to the border of the viewport, at least a part of the operating element will exceed the viewport range. At this time, the user will Difficulty continuing to interact with scene elements. Therefore, there is an urgent need to improve the convenience of interaction between users and scene elements, and to optimize the user experience.

SUMMARY OF THE INVENTION

The object of the present invention is to provide an adaptive method, device, computer-readable storage medium and computer program product for an operating element, which can utilize the distance between the operating element and the border of the viewport to quantify the proximity of the operating element and the border of the viewport, And the adaptive adjustment of the operating element can be achieved before at least a part of the operating element exceeds the viewport range.

The present invention discloses an adaptive method for an operating member for electronic equipment, the operating member is configured to interact with scene elements in a virtual world within a viewport range, and the method includes:

determining step, determining the distance between the operating member and the frame of the viewport;

Adjusting step, when the distance is less than or equal to a preset value, adjusting the size of the operating element within the size constraint range of the operating element, and/or adjusting the relative relationship between the viewport and the virtual world position, so that the adjusted operating piece is always within the viewport range.

Optionally, the operating member includes an origin and one or more operating handles extending from the origin in one or more directions and having corresponding lengths, the origin of the operating member being configured to be fixed to the a reference point of the scene element with which the operator interacts, and the one or more handles of the operator are configured to perform zooming in the corresponding direction on the scene element with which the operator interacts , move, rotate any one or several interactive operations.

Optionally, the one or more handles of the operator have respective minimum lengths, and the dimensions of the operator are defined by the respective minimum lengths of the one or more handles of the operator constraint.

Optionally, the determining step includes:

determining viewport coordinates of corresponding vertices of the one or more handles of the operator;

A minimum distance between respective vertices of the one or more handles of the operator and a border of the viewport is calculated.

Optionally, in the determining step, determining the viewport coordinates of the corresponding vertices of the one or more operating handles of the operating member includes:

determining the world coordinates of the reference point of the scene element interacting with the operator;

determining the world coordinate of the origin of the operating member based on the world coordinate of the reference point of the scene element;

converting the world coordinates of the origin of the operating piece into viewport coordinates of the origin of the operating piece;

Based on the viewport coordinates of the origin of the operator, and based on the corresponding viewport lengths of the one or more handles of the operator, determining the length of the one or more handles of the operator The viewport coordinates of the corresponding vertex.

Optionally, in the determining step, determining the viewport coordinates of the corresponding vertices of the one or more operating handles of the operating member includes:

determining the world coordinates of the reference point of the scene element interacting with the operator;

determining the world coordinate of the origin of the operating member based on the world coordinate of the reference point of the scene element;

Based on the world coordinates of the origin of the operator, and based on the respective world lengths of the one or more handles of the operator, the corresponding vertices of the one or more handles of the operator are determined the world coordinates;

Converting the world coordinates of the corresponding vertices of the one or more handles of the operator to the viewport coordinates of the corresponding vertices of the one or more handles of the operator.

Optionally, in the adjusting step, when the distance is less than or equal to a preset value, adjusting the size of the operating member within the size constraint range of the operating member includes: for the corresponding vertex and the frame of the viewport. The minimum distance between the operating handles of the operating member is less than or equal to the preset value, and the corresponding length of the operating handle is adjusted so that the corresponding vertices of the one or more operating handles of the adjusted operating member are all within the viewport; or

In the adjusting step, when the distance is less than or equal to a preset value, adjusting the relative position between the viewport and the virtual world includes: for the minimum distance between the corresponding vertex and the frame of the viewport less than or equal to the preset value of the operating handle of the operating piece, adjust the relative position between the viewport and the virtual world, so that the adjusted corresponding vertices of the one or more operating handles of the operating piece are within said viewport; or

In the adjusting step, when the distance is less than or equal to a preset value, the size of the operating element is adjusted within the size constraint range of the operating element, and the relative relationship between the viewport and the virtual world is adjusted. The position includes: for the handle of the operating piece whose minimum distance between the corresponding vertex and the border of the viewport is less than or equal to a preset value, adjusting the corresponding length of the handle, if the handle is adjusted to When the corresponding minimum length of the operation handle and the adjusted minimum distance between the corresponding vertex of the operation handle and the border of the viewport is still less than or equal to the preset value, then the adjustment between the viewport and the virtual The relative positions between the worlds are such that the corresponding vertices of the one or more operating handles of the adjusted operating piece are all within the scope of the viewport.

The invention discloses an adaptive system for an operating piece, the operating piece is configured to interact with scene elements in a virtual world within a viewport range, and the system includes:

a determining unit configured to determine the distance between the operating member and the frame of the viewport;

The adjusting unit is configured to adjust the size of the operating element within the size constraint range of the operating element when the distance is less than or equal to a preset value, and/or adjust the relationship between the viewport and the virtual world The relative position between the two, so that the adjusted operating member is always within the range of the viewport.

The present invention discloses an electronic device comprising a processor and a memory storing computer-executable instructions, the processor being configured to execute the instructions to implement an adaptive method of an operator.

The present invention discloses a computer-readable storage medium having computer-executable instructions stored thereon, the instructions being executed by a processor to implement an adaptive method of an operating element.

The present invention discloses a computer program product comprising computer-executable instructions that are executed by a processor to implement an adaptive method for an operator.

Compared with the prior art, the main difference and effect of the embodiment of the present invention are:

By determining the distance between the operating element and the border of the viewport, the present invention can use the distance between the operating element and the border of the viewport to quantify the proximity of the operating element to the border of the viewport, and when the distance is less than or equal to the preset value, adjust the size of the operating piece within the size constraint range of the operating piece, and/or adjust the relative position between the viewport and the virtual world, so that the adjusted operating piece is always within the viewport range, the present invention can operate Adaptive adjustment of the manipulator is achieved before at least a portion of the widget goes beyond the viewport.

Description of drawings

FIG. 1 is a schematic diagram of the interaction between an operator and a scene element according to a comparative example;

2A-2C are schematic diagrams of self-adaptation of an operating member according to an embodiment of the present invention;

FIG. 3 is a flowchart of an adaptive method for an operating member according to an embodiment of the present invention;

4 is a structural diagram of an adaptive system for an operating element according to an embodiment of the present invention;

FIG. 5 is a block diagram of a hardware structure of an electronic device implementing an adaptive method for an operating element according to an embodiment of the present invention.

Detailed ways

In order to make the purpose and technical solutions of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be described clearly and completely below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are some, but not all, embodiments of the present invention. Based on the described embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present invention.

In order to facilitate the understanding of the technical solutions of the present application, the definition, structure and application scenarios of the operating element are first introduced.

When viewing and editing a virtual world, users (eg, developers, end users, etc.) may need to interact with scene elements in the virtual world, such as zooming, moving, or rotating specific scene elements. The virtual world and its scene elements are presented to the user via the display of the electronic device, and the user can see at least a portion of the virtual world and its scene elements within the viewport of the display. The electronic device may be a computer, tablet computer, mobile phone, or other device with data processing and storage functions. The viewport refers to the interactive interface provided by the application software to the user when the application software interacts with the scene elements in the virtual world, and the viewport range is the range corresponding to the interactive interface. Interact. The viewport range can be the entire display area of the display, or part of the display area of the display.

The virtual world has a world coordinate system (also known as a global coordinate system). The viewport has a viewport coordinate system, the viewport coordinates are the normalized monitor screen coordinates, the viewport coordinates are represented by numbers between 0 and 1, and the viewport range is, for example, a rectangle, and the viewport coordinates of the lower left corner are is (0,0), the viewport coordinates of the upper left corner are (0,1), the viewport coordinates of the lower right corner are (1,0), and the viewport coordinates of the upper right corner are (1,1). Coordinate conversion can be performed between the world coordinate system and the viewport coordinate system. In a general application scenario, the scope of the virtual world is larger than the scope of the viewport, so the viewport only displays a part of the virtual world, and the user can only interact with the displayed part of the virtual world through the viewport.

The user can interact with the scene elements in the virtual world within the viewport via the operator. The operating member includes an origin and one or more operating handles extending from the origin in one or more directions and having corresponding lengths. One or more directions may be configured to be parallel to respective coordinate axes of the world coordinate system, respectively. The corresponding length of each handle can be the same or different. The origin of the operator is configured to be fixed to the reference point of the scene element with which the operator interacts, the reference point of the scene element may be the center point of the scene element or any other point, and one or more handles of the operator are configured Perform any one or several interactive operations of zooming, moving, and rotating the scene element interacting with the operator in the corresponding direction.

FIG. 1 is a schematic diagram of the interaction of an operator with a scene element according to a comparative example.

As shown in FIG. 1 , the viewport 100 includes four borders 101A-101D, so as to form a viewport range. At least a part of the virtual world and its scene elements 200 are displayed in the viewport. to interact with scene elements 200 in . The operating member 300 includes an origin 301, which is fixed to a reference point (not shown) of the scene element 200, and two operating handles 302-303 extending in two directions from the origin 301, and the operating handles 302 have respective lengths L1 and corresponding vertex P1, and handle 303 has a corresponding length L2 and a corresponding vertex P2. The user needs to realize interactive operations such as zooming, moving, and rotating the scene element 200 by controlling the operation handles 302-303.

When the scene element 200 is close to one or more borders of the viewport 100, for example, when the distance between the scene element 200 and the border 101A is small, continuing to zoom, move or rotate the scene element 200 via the operating element 300 may cause the operating element 300 to appear. In the case where at least a part of the operating member 300 exceeds the viewport range, specifically, any of the above zooming, moving, and rotating operations may cause at least a part of the operating member 300 to exceed the viewport range, or any of the zooming, moving, and rotating operations. A combination of the two or a combination of the three causes at least a portion of the operating member 300 to extend beyond the viewport. For example, if the operation handle 302 of the operation member 300 is beyond the viewport, the user cannot see the vertex P1 of the operation handle 302, and it is difficult to continue to zoom, move or rotate the scene element 200 in the corresponding direction of the operation handle 302.

In the comparative example described above, the user needs to manually move the viewport, that is, to modify the relative positional relationship between the world coordinate system and the viewport coordinate system, so that the operating element 300 completely reappears within the viewport range. In this way, the user Only then can the interaction with the scene element 200 continue in the corresponding direction of the handle 302 .

2A-2C are schematic diagrams of adaptation of an operating member according to an embodiment of the present invention.

As shown in FIG. 2A , when the operating member 300 is close to one or more borders of the viewport 100 , for example, when the distance between the corresponding vertex P1 of the operating handle 302 of the operating member 300 and the border 101A is small, if the operating handle 302 is If you continue to move the scene element upward, the vertex P1 of the operation handle 302 will be moved out of the viewport. At this time, it can be shortened to L1' by adjusting the corresponding length of the operation handle 302, so that the two operations of the adjusted operation member 300 can be shortened to L1'. The corresponding vertices P1-P2 of handles 302-303 are all within the viewport.

As shown in FIG. 2B , when the operating member 300 is close to one or more borders of the viewport 100 , for example, when the distance between the corresponding vertex P1 of the operating handle 302 of the operating member 300 and the border 101A is small, if the operating handle 302 is If the scene element continues to move upward, the vertex P1 of the operating handle 302 will be moved out of the viewport. At this time, the relative position between the viewport 100 and the virtual world can be adjusted so that the two operating handles of the adjusted operating element 300 can be adjusted. The corresponding vertices P1-P2 of 302-303 are all within the viewport. In the present invention, adjusting the relative position between the viewport and the virtual world means that when the operating element approaches the border of the viewport, if the scene element is controlled to continue to move toward the border of the viewport via the operating element, the operating element and the affected The controlled scene element is still relative to the viewport, but the operating element, the controlled scene element and the viewport move together relative to the virtual world, or it can be said that the operating element, the controlled scene element and the viewport move together in the virtual world. From the user's point of view, the operator, the controlled scene element, and the viewport are relatively stationary, while other scene elements in the virtual world move in the other direction.

As shown in FIG. 2C , when the operating member 300 is close to one or more borders of the viewport 100 , for example, when the distance between the corresponding vertex P1 of the operating handle 302 of the operating member 300 and the border 101A is small, if the operating handle 302 If you continue to move the scene element upward, the vertex P1 of the handle 302 will be moved out of the viewport. At this time, you can first adjust the corresponding length of the handle 302 until it is adjusted to the corresponding minimum length L1min. If the adjusted handle If the distance between the corresponding vertex P1 of 302 and the frame 101A is still less than or equal to the preset value, then continue to adjust the relative position between the viewport 100 and the virtual world, so that the two operating handles 302-303 of the adjusted operating member 300 The corresponding vertices P1-P2 of are all within the viewport.

In the three embodiments described above, even when the scene element 200 is close to one or more borders of the viewport 100, at least a part of the operating member 300 does not exceed the viewport range, and the operating member 300 can always be in Within the viewport range, the convenience of interaction between users and scene elements is improved, and the user experience is optimized. Although the above embodiments only describe the situation where scene elements are moved via the operating element, those skilled in the art can easily know from the above embodiments that when zooming or rotating scene elements via the operating element, the operation can also be achieved through the technical solutions provided by the present invention. A technical effect where the piece is always within the viewport.

FIG. 3 is a flowchart of an adaptive method of an operating member according to an embodiment of the present invention. As shown in Figure 3, the first embodiment includes:

In step S301, the distance between the operating member and the frame of the viewport is determined.

Optionally, determining the distance between the operator and the frame of the viewport includes determining the viewport coordinates of the corresponding vertices of the one or more handles of the operator, and calculating the corresponding vertices of the one or more handles of the operator. The minimum distance from the border of the viewport.

It can be understood that, when the operating member has the structure described above, the corresponding vertices of each operating handle of the operating member will belong to the peripheral portion of the operating member. Once the corresponding vertex of a certain operating handle of the operating member is close to a certain border of the viewport When the operator is close to the border of the viewport, the minimum distance between the corresponding vertices of one or more handles of the operator and the border of the viewport can be taken as the distance between the operator and the border of the viewport . The distance here can be understood as the vertical distance from a point (ie, the vertex of the handle) to a line (ie, the border of the viewport) on a two-dimensional plane (ie, the plane where the viewport is located).

For example, determine the viewport coordinates of the corresponding vertices P1-P2 of the two operating handles 302-303 of the operating member 300, and calculate the corresponding vertices P1-P2 and the four borders of the viewport 100 based on the viewport coordinates in the viewport coordinate system For the distances between 101A-101D, the smallest distance among these distances is selected as the distance between the operation member 300 and the frame of the viewport 100 .

Optionally, determining the viewport coordinates of the corresponding vertices of the one or more operating handles of the operating element includes determining the world coordinates of the reference points of the scene elements that interact with the operating elements, and determining the world coordinates of the reference points of the scene elements based on the world coordinates of the scene elements. The world coordinates of the origin of the operator, the viewport coordinates that convert the world coordinates of the origin of the operator to the viewport coordinates of the origin of the operator, and the viewport coordinates based on the origin of the operator, and the Corresponding to the viewport length, the viewport coordinates of the corresponding vertices of one or more handles of the operator are determined.

It is understood that the origin of the operator is configured to be fixed to the reference point of the scene element with which the operator interacts, so the world coordinates of the origin can be determined by the world coordinates of the reference point, and the world coordinates of the origin are determined by the world coordinate system and the viewport coordinates. Coordinate transformation between systems to determine the viewport coordinates of the origin. Handles can be added to the viewport at a later step in the rendering process, and thus can be considered a post-processing effect, in which case the corresponding length of each handle of the operator in the viewport (i.e. The port length) is fixed, so the viewport coordinates of the corresponding vertices of each handle can be determined by the viewport coordinates of the origin and the corresponding viewport length of each handle.

Optionally, determining the viewport coordinates of the corresponding vertices of the one or more operating handles of the operating element includes determining the world coordinates of the reference points of the scene elements that interact with the operating elements, and determining the world coordinates of the reference points of the scene elements based on the world coordinates of the scene elements. the world coordinates of the origin of the operator, the world coordinates of the origin of the operator based on the world coordinates, and the world coordinates of the corresponding vertices of the handle or handles of the operator are determined based on the corresponding world lengths of the handle or handles of the operator, and converting the world coordinates of the corresponding vertices of the one or more handles of the operator to the viewport coordinates of the corresponding vertices of the one or more handles of the operator.

It can be understood that the origin of the operating piece is configured to be fixed to the reference point of the scene element interacting with the operating piece, so the world coordinate of the origin can be determined by the world coordinate of the reference point. The handle can be directly bound to the scene elements in the virtual world and displayed to the user together through the rendering process. Camera) scene elements in the virtual world change with the three-dimensional display effect of near, far and small, but for the convenience of user operation, the length of the handle from the viewport remains unchanged (when the handle is not close to the viewport. In the case of adaptive adjustment), the corresponding length of the handle in the virtual world (that is, the world length, which can also be understood as the distance between the origin of the handle and the world coordinates of the vertex of the handle) is proportional to the It changes with the distance between the scene element and the virtual camera, so that the world coordinates of the corresponding vertices of each handle can be determined by the world coordinate of the origin and the corresponding world length of each handle, and the world coordinate system and the viewport Coordinate transformations between coordinate systems to determine the viewport coordinates of the corresponding vertices of each handle.

Through step S301, the present invention can use the distance between the operating member and the frame of the viewport to quantify the degree of proximity of the operating member and the frame of the viewport.

In step S302, when the distance is less than or equal to a preset value, adjust the size of the operating element within the size constraint range of the operating element, and/or adjust the relative position between the viewport and the virtual world, so that the adjusted operating element is always within the viewport. The preset value may be set to 0, that is, when the vertex of the operating member reaches the border of the viewport, if the operating member continues to move, adaptive adjustment is performed.

Optionally, the one or more handles of the operator have respective minimum lengths, and the size constraints of the operator are defined by the respective minimum lengths of the one or more handles of the operator.

It can be understood that the corresponding minimum length of each operating handle can indicate the visible or operable range of the operating handle. When the corresponding length of a certain operating handle is less than the corresponding minimum length, the operating handle is too short and the user will be difficult to see clearly. The corresponding direction of the handle or it is difficult to select the handle, so it is difficult to scale, move and/or rotate the corresponding scene element in the corresponding direction of the handle, so the size adjustment of the handle should be within the size constraints of the handle conduct. The corresponding minimum length of each operating handle may be preset or set actively by the user, and the corresponding minimum length of each operating handle may be the same or different.

Optionally, for the operating handle of the operating member whose minimum distance between the corresponding vertex and the frame of the viewport is less than or equal to the preset value, adjust the corresponding length of the operating handle so that one or more operating handles of the adjusted operating member are adjusted. The corresponding vertices of are all within the viewport.

Returning to FIG. 2A , the smallest distance among the distances between the corresponding vertex P1 of the operating handle 302 and the four borders 101A-101D of the viewport 100 (ie, the distance between the corresponding vertex P1 and the border 101A) is less than or equal to the preset At this time, the corresponding length of the operating handle 302 is adjusted. From the user's point of view, the corresponding length of the operating handle 302 is shortened from L1 to L1', so that the corresponding vertex P1 of the operating handle 302 of the adjusted operating member 300 is in the viewport range, and the corresponding vertex P2 of the handle 303 is also within the viewport range.

Optionally, for the handle of the operator whose minimum distance between the corresponding vertex and the border of the viewport is less than or equal to the preset value, adjust the relative position between the viewport and the virtual world, so that one of the adjusted operators is adjusted. The corresponding vertices of one or more handles are all within the viewport.

Returning to FIG. 2B , the smallest distance among the distances between the corresponding vertex P1 of the operating handle 302 and the four borders 101A-101D of the viewport 100 (ie, the distance between the corresponding vertex P1 and the border 101A) is less than or equal to the preset value, at this time adjust the relative position between the viewport 100 and the virtual world, from the user's point of view, the viewport camera moves in the virtual world, so that the corresponding vertex P1 of the handle 302 of the adjusted operating piece 300 is in the viewport range, and the corresponding vertex P2 of the handle 303 is also within the viewport range.

Optionally, for the handle of the operator whose minimum distance between the corresponding vertex and the frame of the viewport is less than or equal to the preset value, adjust the corresponding length of the handle, if the handle is adjusted to the corresponding minimum length of the handle and When the minimum distance between the corresponding vertex of the adjusted handle and the border of the viewport is still less than or equal to the preset value, adjust the relative position between the viewport and the virtual world so that one or more of the adjusted The corresponding vertices of each handle are within the viewport.

Returning to FIG. 2C , the smallest distance among the distances between the corresponding vertex P1 of the operating handle 302 and the four borders 101A-101D of the viewport 100 (ie, the distance between the corresponding vertex P1 and the border 101A) is less than or equal to the preset At this time, the corresponding length of the operating handle 302 is adjusted first. From the user’s point of view, the corresponding length of the operating handle 302 is shortened from L1 to L1min, but the adjusted distance between the corresponding vertex P1 of the operating handle 302 and the frame 101A is still less than or equal to the preset value, so continue to adjust the relative position between the viewport 100 and the virtual world. From the user’s point of view, the viewport moves in the virtual world, so that the corresponding The vertex P1 is within the viewport, and the corresponding vertex P2 of the handle 303 is also within the viewport.

Through step S302, the present invention can realize self-adaptive adjustment of the operating element before at least a part of the operating element exceeds the viewport range.

FIG. 4 is a structural diagram of an adaptive system of an operating member according to an embodiment of the present invention. As shown in Figure 4, the second embodiment includes:

The determining unit 401 is configured to determine the distance between the operating member and the frame of the viewport.

Through the determining unit 401, the present invention can use the distance between the operating element and the border of the viewport to quantify the proximity of the operating element to the border of the viewport.

The adjusting unit 402 is configured to adjust the size of the operating element within the size constraint range of the operating element when the distance is less than or equal to the preset value, and/or adjust the relative position between the viewport and the virtual world, so that the adjusted The manipulator is always within the viewport.

Through the adjusting unit 402, the present invention can realize the adaptive adjustment of the operating element before at least a part of the operating element exceeds the viewport range.

The first embodiment is a method embodiment corresponding to this embodiment, and this embodiment can be implemented in cooperation with the first embodiment. The relevant technical details mentioned in the first embodiment are still valid in this embodiment, and are not repeated here in order to reduce repetition. Correspondingly, the related technical details mentioned in this embodiment can also be applied to the first embodiment.

FIG. 5 is a block diagram of a hardware structure of an electronic device implementing an adaptive method for an operating element according to an embodiment of the present invention.

As shown in FIG. 5 , the electronic device 500 may include one or more processors 502 , a system board 508 connected to at least one of the processors 502 , a system memory 504 connected to the system board 508 , and a non-volatile memory 504 connected to the system board 508 . Volatile memory (NVM) 506 , and network interface 510 to system motherboard 508 .

Processor 502 may include one or more single-core or multi-core processors. Processor 502 may include any combination of general-purpose processors and special-purpose processors (eg, graphics processors, application processors, baseband processors, etc.). In an embodiment of the invention, the processor 502 may be configured to perform one or more embodiments in accordance with the various embodiments shown in FIG. 3 .

In some embodiments, system board 508 may include any suitable interface controller to provide any suitable interface to at least one of processors 502 and/or any suitable device or component in communication with system board 508 .

In some embodiments, system motherboard 508 may include one or more memory controllers to provide an interface to system memory 504 . System memory 504 may be used to load and store data and/or instructions. In some embodiments, system memory 504 of electronic device 500 may include any suitable volatile memory, such as suitable dynamic random access memory (DRAM).

NVM 506 may include one or more tangible, non-transitory computer-readable media for storing data and/or instructions. In some embodiments, NVM 506 may include any suitable non-volatile memory such as flash memory and/or any suitable non-volatile storage device, such as HDD (Hard Disk Drive), CD (Compact Disc) At least one of a drive and a DVD (Digital Versatile Disc, Digital Versatile Disc) drive.

The NVM 506 may include a portion of the storage resources installed on the appliance of the electronic device 500, or it may be accessed by the device, but not necessarily a part of the device. For example, NVM 506 may be accessed over a network via network interface 510 .

In particular, system memory 504 and NVM 506 may include temporary and permanent copies of instructions 520, respectively. The instructions 520 may include instructions that when executed by at least one of the processors 502 cause the electronic device 500 to implement the method shown in FIG. 3 . In some embodiments, instructions 520 , hardware, firmware, and/or software components thereof may additionally/alternatively reside in system motherboard 508 , network interface 510 , and/or processor 502 .

Network interface 510 may include a transceiver for providing a radio interface for electronic device 500 to communicate with any other suitable device (eg, front-end modules, antennas, etc.) over one or more networks. In some embodiments, network interface 510 may be integrated with other components of electronic device 500 . For example, network interface 510 may be integrated into at least one of processor 502, system memory 504, NVM 506, and a firmware device (not shown) having instructions that, when executed by at least one of processors 502, Electronic device 500 implements one or more of the various embodiments shown in FIG. 3 .

Network interface 510 may further include any suitable hardware and/or firmware to provide a multiple-input multiple-output radio interface. For example, network interface 510 may be a network adapter, wireless network adapter, telephone modem, and/or wireless modem.

In one embodiment, at least one of the processors 502 may be packaged with one or more controllers for the system motherboard 508 to form a system-in-package (SiP). In one embodiment, at least one of the processors 502 may be integrated on the same die with one or more controllers for the system motherboard 508 to form a system on a chip (SoC).

Electronic device 500 may further include an input/output (I/O) device 512 connected to system motherboard 508 . I/O device 512 may include a user interface that enables a user to interact with electronic device 500 ; the peripheral component interface is designed to enable peripheral components to interact with electronic device 500 as well. In some embodiments, the electronic device 500 further includes a sensor for determining at least one of environmental conditions and location information related to the electronic device 500 .

In some embodiments, I/O devices 512 may include, but are not limited to, a display (eg, a liquid crystal display, a touch screen display, etc.), a speaker, a microphone, one or more cameras (eg, a still image camera and/or video camera), a flashlight (eg LED flash) and keyboard.

In some embodiments, peripheral component interfaces may include, but are not limited to, non-volatile memory ports, audio jacks, and power connectors.

In some embodiments, sensors may include, but are not limited to, gyroscope sensors, accelerometers, proximity sensors, ambient light sensors, and positioning units. The positioning unit may also be part of or interact with the network interface 510 to communicate with components of the positioning network (eg, global positioning system (GPS) satellites).

It can be understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 500 . In other embodiments of the present application, the electronic device 500 may include more or less components than shown, or some components may be combined, or some components may be separated, or different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Program code may be applied to input instructions to perform the functions described herein and to generate output information. The output information can be applied to one or more output devices in a known manner. For the purposes of this application, a system for processing instructions including processor 502 includes any system having a processor such as a digital signal processor (DSP), microcontroller, application specific integrated circuit (ASIC), or microprocessor .

The program code may be implemented in a high-level procedural language or an object-oriented programming language to communicate with the processing system. The program code may also be implemented in assembly or machine language, if desired. In fact, the mechanisms described in this invention are not limited to the scope of any particular programming language. In either case, the language may be a compiled language or an interpreted language.

One or more aspects of at least one embodiment may be implemented by instructions stored on a computer-readable storage medium that, when read and executed by a processor, enable an electronic device to implement the methods of the embodiments described herein .

The present invention also provides a computer-readable storage medium having computer-executable instructions stored thereon, the instructions being executed by a processor to implement the above-described adaptive method of an operator.

The present invention also provides a computer program product comprising computer-executable instructions executed by a processor to implement the above-described adaptive method of an operator.

Although the present invention has been illustrated and described with reference to certain preferred embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and detail may be made therein without departing from the invention The spirit and scope of the invention.

Claims (10)

1. An adaptive method of manipulating elements for an electronic device, wherein the manipulating elements are configured to interact with scene elements in a virtual world within a viewport, and the method comprises:

determining a distance between the operating element and a border of the viewport;

and adjusting, when the distance is smaller than or equal to a preset value, the size of the operating element within a size constraint range of the operating element, and/or adjusting the relative position between the viewport and the virtual world, so that the adjusted operating element is always within the viewport range.

2. The method of claim 1, wherein the manipulator comprises an origin and one or more handles extending in one or more directions from the origin and having respective lengths, the origin of the manipulator is configured to be fixed to a reference point of the scene element interacting with the manipulator, and the one or more handles of the manipulator are configured to perform any one or more of zooming, moving, and rotating interactive operations on the scene element interacting with the manipulator in the respective directions.

3. The method of claim 2, wherein the one or more levers of the operating member have respective minimum lengths, and the dimensional constraint of the operating member is defined by the respective minimum lengths of the one or more levers of the operating member.

4. The method of claim 3, wherein the determining step comprises:

determining viewport coordinates of respective vertices of the one or more handles of the manipulator;

calculating a minimum distance between respective vertices of the one or more handles of the manipulation member and a bezel of the viewport.

5. The method of claim 4 wherein the determining step of determining viewport coordinates of respective vertices of the one or more handles of the manipulator comprises:

determining world coordinates of the reference point of the scene element interacting with the manipulation element;

determining world coordinates of the origin of the operating element based on world coordinates of the reference point of the scene element;

converting world coordinates of the origin of the manipulator to viewport coordinates of the origin of the manipulator;

determining viewport coordinates of respective vertices of the one or more handles of the manipulation element based on the viewport coordinates of the origin of the manipulation element and based on respective viewport lengths of the one or more handles of the manipulation element.

6. The method of claim 4 wherein the determining step of determining viewport coordinates of respective vertices of the one or more handles of the manipulator comprises:

determining world coordinates of the reference point of the scene element interacting with the manipulation element;

determining world coordinates of the origin of the operating element based on world coordinates of the reference point of the scene element; determining world coordinates of respective vertices of the one or more levers of the manipulator based on the world coordinates of the origin of the manipulator and based on respective world lengths of the one or more levers of the manipulator;

converting world coordinates of respective vertices of the one or more handles of the manipulator to viewport coordinates of the respective vertices of the one or more handles of the manipulator.

7. The method according to any one of claims 4 to 6,

in the adjusting step, when the distance is smaller than or equal to a preset value, adjusting the size of the operating element within the size constraint range of the operating element comprises: for the operation handles of the operation pieces of which the minimum distances between the corresponding vertexes and the frame of the viewport are smaller than or equal to a preset value, adjusting the corresponding lengths of the operation handles so that the corresponding vertexes of the one or more operation handles of the operation pieces after adjustment are all within the viewport range; or

When the distance is less than or equal to a preset value in the adjusting step, adjusting the relative position between the viewport and the virtual world includes: for the operation handles of the operation pieces with the minimum distances between the corresponding vertexes and the frame of the viewport being smaller than or equal to a preset value, adjusting the relative positions between the viewport and the virtual world so that the corresponding vertexes of the one or more operation handles of the operation pieces after adjustment are all within the range of the viewport; or

When the distance is less than or equal to a preset value in the adjusting step, adjusting the size of the operating element within the size constraint range of the operating element, and adjusting the relative position between the viewport and the virtual world includes: and for the operation handles of the operation pieces with the minimum distances between the corresponding vertexes and the borders of the viewport being smaller than or equal to a preset value, adjusting the corresponding lengths of the operation handles, and if the operation handles are adjusted to the corresponding minimum lengths of the operation handles and the adjusted minimum distances between the corresponding vertexes of the operation handles and the borders of the viewport are still smaller than or equal to the preset value, adjusting the relative positions between the viewport and the virtual world so that the corresponding vertexes of the one or more operation handles of the operation pieces after adjustment are all within the viewport range.

8. An electronic device comprising a processor and a memory storing computer-executable instructions, the processor being configured to execute the instructions to implement the adaptive method of the actuator of any of claims 1-7.

9. A computer-readable storage medium having computer-executable instructions stored thereon for execution by a processor to perform the adaptive method of the actuator of any one of claims 1-7.

10. A computer program product comprising computer executable instructions, wherein the instructions are executed by a processor to implement the adaptive method of the actuator of any one of claims 1 to 7.

Images