TWI817186B - Object operation system and object operation method - Google Patents

Abstract

An object operation system and an object operation method are provided. Multiple graphical objects are displayed on the user interface (UI). The content of the graphical object is presented by a diagram and/or text. The graphical object includes two attributes which are corresponding to values of two dimensions, respectively. A user behavior applied on the graphical object in the UI is obtained, to generate a control instruction. The object location of the graphical object in the UI and two attributes are modified according to the control instruction. The objection location includes the value on the two dimensions. An operation application is provided according to the object location. Accordingly, it would help a user to use a coordinate-axes analysis system.

Description

Object operating system and object operation methods

The present invention relates to an object management technology, and in particular to an object operating system and an object operating method.

Due to the lack of complete system planning and design, the physical or digital interface for object classification in existing computer systems may have the following technical limitations: First, it is difficult to integrate multiple manual analysis results; second, the completed data cannot be quickly be converted again or cross-referenced; thirdly, the previous manual analysis results cannot be used to create novel and valuable data, and often can only produce graphic data; fourthly, the analysis results are not based on data Integrating it into the database in a standardized way makes it more difficult to optimize the accuracy of the software.

In view of this, embodiments of the present invention provide an object operating system and an object operating method, which can assist users in performing coordinate axis analysis.

The object operation method according to the embodiment of the present invention includes (but is not limited to) the following steps: Steps: Display multiple graphical objects in the user interface. A multi-dimensional coordinate system is formed on the user interface. The multi-dimensional coordinate system includes the first dimension and the second dimension. The content of each graphical object is presented in graphics and/or text. Each graphical object includes a first attribute and a second attribute. The content of the first attribute is related to the first value in the first dimension, and the second attribute The content of is related to the second value in the second dimension. Receive user behavior for at least one graphical object on the user interface to generate control instructions. Adjust the object position, first attribute and second attribute of the graphical object in the user interface according to the control command. The object position includes a first value and a second value. Provide operation applications based on the object position of graphical objects. This operation application is related to user behavior.

Object operations in embodiments of the present invention include (but are not limited to) storage, displays, motion detectors, and processors. The storage is used to store information of multiple graphical objects. The display is used to present the user interface. Motion detectors are used to detect user behavior. The processor is coupled to the storage, display and motion detector. The processor is configured to display a plurality of graphical objects in the user interface through the display, receive user behavior for at least one graphical object on the user interface to generate control instructions, and adjust the graphical objects in the user interface according to the control instructions. The object position, first attribute and second attribute in the interface are provided, and operation applications are provided based on the object position of the graphical object. A multi-dimensional coordinate system is formed on the user interface. The multi-dimensional coordinate system includes the first dimension and the second dimension. The content of each graphical object is presented in graphics and/or text. Each graphical object includes a first attribute and a second attribute. The content of the first attribute is related to the first value in the first dimension, and the second attribute The content of is related to the second value in the second dimension. The object position includes a first value and a second value. This operation applies to the user behavior.

Based on the above, according to the object operating system and the object operating method of the embodiment of the present invention, the graphical objects in the user interface are located on a multi-dimensional coordinate system. In addition, it detects user behavior on graphical objects and adjusts the object position and object attributes accordingly, thereby providing a variety of operational applications. Thus, embodiments of the present invention can help users integrate each other's ideas and reach a consensus, thereby improving the efficiency of multi-person collaboration. In addition, embodiments of the present invention can also provide a new visual presentation method to help users view the data of each graphical object (ie, graphical object) while comparing multiple attributes at the same time.

In order to make the above-mentioned features and advantages of the present invention more obvious and easy to understand, embodiments are given below and described in detail with reference to the accompanying drawings.

1, 1’, 1”, 1”-1, 2: Object operating system

10:Storage

30:Motion sensor

50:Display

70: Processor

31: Infrared frame

51:Projector

52:Projection wall

71:Computer

32:Laser sensor

33:Camera

53:Head mounted display

S310~S370, S610~S630, S710~S770, S910~S940, S251~S255: steps

FF1~FF4: Favorites folder

UI1~UI4: User interface

TC1~TC9: Graphical objects

SP: Voice search bar

MI: Enter search bar

401: Representative picture

402:Title

403:Summary

404:Responsible person

405:Introduction

406:Internet link

407:Basic information

408:User-defined value

409:Other information

SO1, SO2: sliding operation

C-A, C-B, C-C, C-D, C-E, C-F, C-G, C1, C2, C3, C4, C5, C6, C7, C8, C9: display area

X, Y, X’, Y’, Z: dimensions

55: Projection area

CS1~CS3: Multi-dimensional coordinate system

DO1~DO3: Drag operation

1401, 1402: Dimension

1404: code

1405:Grid

1406:Coordinates

USER A, USER B, USER C: User

1601:Title

1062:Attribute

1063:User name

1604:Select quantity

1605:Select status indication

1606:Rolling axis

1607: Creation time

1608: Integrated report generation options

1609:Select options

U-A, U-B: User

CS4: The first new coordinate system

2001: Axial attribute menu

2002: Axial property bar

CS5: The second new coordinate system

2302: Dimension adding option

2303: Axial attribute menu

2304:New attributes

TV: three-dimensional virtual world

KW: keyword

FIG. 1 is a component block diagram of an object operating system according to an embodiment of the present invention.

FIG. 2A is a schematic diagram of an object operating system according to an embodiment of the present invention.

FIG. 2B is a schematic diagram of an object operating system according to an embodiment of the present invention.

FIG. 2C is a schematic diagram of an object operating system according to an embodiment of the present invention.

FIG. 2D is a schematic diagram of an object operating system according to an embodiment of the present invention.

FIG. 3 is a flow chart of an object operation method according to an embodiment of the present invention.

FIG. 4A is a schematic diagram of a user interface according to an embodiment of the present invention.

FIG. 4B is a schematic diagram of a graphical object according to an embodiment of the present invention.

FIG. 4C is a schematic diagram of a display area according to an embodiment of the present invention.

FIG. 4D is a schematic diagram of a display area according to an embodiment of the present invention.

FIG. 5A is a schematic diagram of a multi-dimensional coordinate system according to an embodiment of the present invention.

FIG. 5B is a schematic diagram of a multi-dimensional coordinate system according to an embodiment of the present invention.

FIG. 6 is a flow chart for detecting user behavior according to an embodiment of the present invention.

FIG. 7 is a flow chart of browsing objects according to an embodiment of the present invention.

FIG. 8 is a schematic diagram of a browsing object according to an embodiment of the present invention.

FIG. 9 is a flow chart of browsing objects-favorite folders according to an embodiment of the present invention.

10A and 10B are schematic diagrams of a favorite folder according to an embodiment of the present invention.

11A and 11B are schematic diagrams of a favorite folder according to an embodiment of the present invention.

FIG. 12 is a schematic diagram of a drag operation in multi-dimensional coordinates according to an embodiment of the present invention.

13A and 13B are schematic diagrams of a favorite folder according to an embodiment of the present invention.

14A and 14B are schematic diagrams of position and attribute conversion according to an embodiment of the present invention.

FIG. 15 is a schematic diagram of multi-dimensional coordinates of multiple users according to an embodiment of the present invention.

Figure 16 is a schematic diagram of an object classification report according to an embodiment of the present invention.

Figure 17 is an information integration of the same graphical objects according to an embodiment of the present invention. schematic diagram.

FIG. 18 is a schematic diagram of information integration of different graphical objects according to an embodiment of the present invention.

Figure 19 is a schematic diagram of coordinate system transformation according to an embodiment of the present invention.

Figure 20 is a schematic diagram of dimension attribute modification according to an embodiment of the present invention.

Figure 21 is a schematic diagram of dimension attribute modification according to an embodiment of the present invention.

Figure 22 is a schematic diagram of coordinate system transformation according to an embodiment of the present invention.

23A to 23C are schematic diagrams of adding dimension attributes according to an embodiment of the present invention.

Figure 24 is a schematic diagram of a three-dimensional virtual world according to an embodiment of the present invention.

Figure 25 is a flow chart of data search according to an embodiment of the present invention.

Figure 26 is a schematic diagram of data search according to an embodiment of the present invention.

FIG. 1 is a component block diagram of an object operating system 1 according to an embodiment of the present invention. Referring to FIG. 1 , the object operating system 1 includes (but is not limited to) a storage 10 , a motion sensor 30 , a display 50 and a processor 70 .

The storage 10 can be any type of fixed or removable random access memory (Radom Access Memory, RAM), read only memory (Read Only Memory, ROM), flash memory (flash memory), traditional hard disk (Hard Disk Drive, HDD), solid-state drive (Solid-State Drive, SSD) or similar components. In one embodiment, the memory 10 is used to store program codes, software modules, configurations, data (for example, Graphical objects and their information, locations, attributes, control instructions, folders, reports, etc.) or files will be detailed in subsequent embodiments.

The motion sensor 30 may be an interception motion sensor (for example, an infrared (IR) sensor, a radar, an ultrasonic sensor, etc.), an image sensor, or other relative motion sensors that can respond to external objects/objects. A sensor that generates sensing values/data based on its position, its movement or its posture. In one embodiment, the motion sensor 30 is used to detect user behavior consisting of the user's gestures, other postures or actions.

The display 50 may be a liquid crystal display (LCD), an organic light emitting display (OLED), an electrophoretic display, a head-mounted display (HMD), or a projector. . In one embodiment, the display 50 is used as a user interface.

The processor 70 is coupled to the storage 10 , the motion sensor 30 and the display 50 . The processor 70 may be a central processing unit (CPU), a graphics processing unit (GPU), or other programmable general-purpose or special-purpose microprocessor (Microprocessor), digital signal processing Digital Signal Processor (DSP), programmable controller, Field Programmable Gate Array (FPGA), Application-Specific Integrated Circuit (ASIC) or other similar components or A combination of the above elements. In one embodiment, the processor 70 is configured to execute all or part of the operations of the object operating system 1 and can load and execute each software module, program code, file and data stored in the storage 10 .

It is worth noting that the above components may be provided in different devices, or may be integrated into a single device or circuit.

For example, FIG. 2A is a schematic diagram of an object operating system 1' according to an embodiment of the present invention. Referring to Figure 2A, the object operating system 1' includes an infrared frame 31 enclosed in a rectangular shape, a projector 51, a projection wall 52, and a computer 71 (with a processor 70).

Figure 2B is a schematic diagram of an object operating system 1" according to an embodiment of the present invention. Please refer to Figure 2B. The object operating system 1" includes a straight radar sensor 32, a projector 51, a projection wall 52, and a computer 71 (Processor 70 provided).

Figure 2C is a schematic diagram of an object operating system 1"-1 according to an embodiment of the present invention. Please refer to Figure 2C. Compared with Figure 2B, the object operating system 1"-1 includes two projectors 51 and expands the display accordingly. screen, thus making it easier for more users to use.

FIG. 2D is a schematic diagram of the object operating system 2 according to an embodiment of the present invention. Referring to FIG. 2D , the object operating system 2 includes a head-mounted display 53 (including a memory 10 , a display 50 and a processor 70 (shown in the figure)) and a camera 33 (including an image sensor).

In the following, the method described in the embodiment of the present invention will be described with reference to various devices, components and modules in the object operating system 1 . Each process of this method can be adjusted according to the implementation situation, and is not limited to this.

FIG. 3 is a flow chart of an object operation method according to an embodiment of the present invention. Referring to FIG. 3 , the processor 70 displays one or more graphical objects in the user interface through the display 50 (step S310 ). Specifically, the user interface is a medium for interaction and information exchange between the object operating system 1 and the user. For example, FIG. 4A is a schematic diagram of the user interface UI1 according to an embodiment of the present invention. Referring to FIG. 4A, the user interface UI1 includes a plurality of graphical objects TC1, a voice search bar SP and an input search bar MI. It should be noted that the style of the user interface UI and the arrangement of the graphical objects TC1 may also have other changes, and are not limited by the embodiment of the present invention.

The content of each graphical object (or graphical object) is presented in graphics and/or text. Graphics can be patterns, colors, photos, or a combination thereof. The text does not limit the country. For example, FIG. 4B is a schematic diagram of graphical objects TC1 and TC2 according to an embodiment of the present invention. Please refer to Figure 4B. The information of the graphical object TC1 includes a representative picture 401, a title 402, an abstract 403, a person in charge 404, a profile 405 and a network link 406. The information of graphical object TC2 includes basic information 407 (for example, object name, object code, designer, year, and category), user-defined value 408 (for example, attribute content and coordinate position) and other information 409 (for example, number of clicks, number of co-occurrences). It should be noted that the information of graphical objects TC1 and TC2 may also have other changes, and this is not limited by the embodiment of the present invention.

In one embodiment, the display 50 further displays multiple display areas. These display areas correspond to different categories. Graphical objects record multiple properties. One of the attributes of each graphical object records the category of its content (for example, weight, color, year, etc.) and corresponds to a display area. Therefore, the processor 70 can allocate the graphical object to the corresponding display area according to the category-related attributes of the graphical object.

For example, FIG. 4C is a schematic diagram of the display areas C-A, C-B, C-C, C-D, C-E, C-F, and C-G according to an embodiment of the present invention. Please refer to Figure 4C, display area C- A,C-B,C-C,C-D,C-E,C-F,C-G respectively correspond to different categories. For example, lamps, chairs, tables, beds, carpets, bathroom fixtures and cabinets. A multi-dimensional coordinate system is formed on the user interface UI1, and the multi-dimensional coordinate system includes two dimensions X and Y (for example, the first dimension and the second dimension). For example, a two-dimensional rectangular coordinate system. Among them, the arrangement direction of the display areas C-A, C-B, C-C, C-D, C-E, C-F, and C-G corresponds to the dimension X (for example, the first dimension). Along the axis of dimension X, processor 70 classifies graphical objects according to attributes associated with the class. Graphical objects can also include attributes related to the year. On the axis of dimension Y, the processor 70 assigns graphical objects of the same category according to attributes related to the year. For example, years above are farther away, and years below are closer.

FIG. 4D is a schematic diagram of display areas C1, C2, C3, C4, C5, C6, C7, C8, and C9 according to an embodiment of the present invention. Please refer to Figure 4D. For the object operating system 1"-1 of the two projectors 51, the two projectors 51 can respectively display different display areas C1, C2, C3, C4, C5, C6, C7 in one projection area 55. C8,C9.

In one embodiment, the processor 70 may classify the graphical objects using a multi-dimensional coordinate system including two dimensions, and directly display the two dimensions in the multi-dimensional coordinate system through the display 50 . The axes of the two dimensions are perpendicular, and the intersection of the two dimensions is in the first area or the second area (different from the first area) in the user interface. The intersection represents a coordinate value in two dimensions, for example zero.

For example, FIG. 5A is a schematic diagram of a multi-dimensional coordinate system CS1 according to an embodiment of the present invention. Referring to FIG. 5A , the user interface UI2 displays the dimension X (the reverse is X’) and the dimension Y (the reverse is Y’) in the multi-dimensional coordinate system CS1. In this embodiment, the intersection of the two dimensions X and Y is approximately located in the central area of the user interface UI2 (for example, the a region).

FIG. 5B is a schematic diagram of a multi-dimensional coordinate system according to an embodiment of the present invention. Please refer to FIG. 5B . The difference from FIG. 5A is that the intersection of the two dimensions X and Y displayed by the user interface UI3 is approximately located in the lower left area (eg, the second area) of the user interface UI3 .

It should be noted that the embodiment of the present invention does not limit whether the user interface displays the first dimension and/or the second dimension in the multi-dimensional coordinate system. That is, the processor 70 may disable/not display one or both of the first dimension and the second dimension through the display 50 . In addition, the positions of the first area and the second area in the user interface can still be changed according to the actual needs of the user.

Referring to FIG. 3 , the processor 70 receives user actions on one or more graphical objects on the user interface through the motion sensor 30 to generate control instructions (step S330 ). Specifically, users can interact with graphical objects through special gestures, touching specific positions on the user interface, actions, or combinations thereof (forming user actions). Different user behaviors correspond to different control instructions. This control command is used to adjust the user interface or graphical objects.

For example, FIG. 6 is a flow chart of detecting user behavior according to an embodiment of the present invention. Referring to FIG. 6 , the motion sensor 30 detects the user's gesture (step S610). The processor 70 recognizes the gesture based on the sensing data of the motion sensor 30 and determines the user's behavior based on the gesture. User actions are, for example, sliding operations, dragging operations, or clicking operations.

Referring to Figure 3, the processor 70 adjusts the graphical objects according to the control instructions. The object position, first attribute and second attribute in the user interface (step S350), and corresponding operation applications are provided according to the object position of the graphical object (step S370). Specifically, the values on the multi-dimensional coordinate system represent the coordinate values in the corresponding axis. The object position of a graphical object includes those values in different dimensions. If the user behavior intends to change the object position of the graphical object in the user interface, the value in the object position will also change accordingly.

Operation applications are related to user behavior, and there are many types of operation applications. FIG. 7 is a flow chart of browsing objects according to an embodiment of the present invention. Please refer to Figure 7. In one embodiment, the operation application is related to the browsing object, and the user behavior is a sliding behavior. This embodiment is, for example, directed to the scenario of several display areas shown in FIG. 4C and FIG. 4D . The processor 70 may determine that the direction of the sliding operation corresponds to one of the first dimension (eg, horizontal axis) and the second dimension (eg, vertical axis) in the multi-dimensional coordinate system (step S710 ). When the direction of the sliding operation corresponds to the first dimension, the processor 70 further determines that the direction of the sliding operation corresponds to the larger value or the smaller value of the first dimension (step S720). It is assumed that the one to the right corresponds to the larger value of the first dimension, and the one to the left corresponds to the smaller value of the first dimension. When the direction of the sliding operation corresponds to the larger value (for example, sliding to the right), the processor 70 increases the first values in the first dimension of all graphical objects (step S730). When the direction of the sliding operation corresponds to the smaller value (eg, sliding to the left), the processor 70 decreases the first values in the first dimension of all graphical objects (step S740). When the direction of the sliding operation corresponds to the second dimension, the processor 70 further determines that the direction of the sliding operation corresponds to the larger value or the smaller value of the second dimension (step S750). Assume that the higher the value, the higher the value of the second dimension, and the higher the The lower one corresponds to the smaller value of the second dimension. When the direction of the sliding operation corresponds to the larger value (for example, sliding upward), the processor 70 only increases the second dimension of all graphical objects in one of the display areas (corresponding to the area where the user intends to interact). the second value on (step S760). When the direction of the sliding operation corresponds to the smaller value (for example, sliding down), the processor 70 only reduces the second value in the second dimension of all graphical objects in this display area (step S770).

For example, FIG. 8 is a schematic diagram of a browsing object according to an embodiment of the present invention. Please refer to Figure 8. The sliding operation SO1 is a left-right sliding, so all graphical objects will move in the direction (left or right) of the sliding operation SO1. The sliding operation SO2 is an up and down sliding, so only all graphical objects in the display areas C-F will move in the direction (up or down) of the sliding operation SO2.

FIG. 9 is a flow chart of browsing objects-favorite folders according to an embodiment of the present invention. Referring to FIG. 9 , in one embodiment, it is assumed that the operation application is related to the browsing object, and the user behavior is a click operation. The processor 70 times the duration of the clicking operation through the motion sensor 30 (step S910). For example, how long the user's gesture remains motionless or how long the hand presses on the screen. The processor 70 determines whether the duration exceeds a long press threshold (eg, 0.8 seconds, 1 second, or 1.5 seconds) (step S920). If the duration does not exceed the long-press threshold, the processor 70 determines that the duration corresponds to the short-press operation in the clicking operation. The processor 70 determines the graphical object corresponding to the position of the short-press operation, and enlarges the selected graphical object or displays additional content of the graphical object through the display 50 (step S930). This additional content is related to the attribute content of the graphical object. For example, more detailed description text, more image details, relevant Internet information links, etc. If the duration exceeds the long press threshold, the processor 70 determines that the duration corresponds to the long press operation in the click operation. The processor 70 determines the graphical object corresponding to the position of the long press operation, and displays one or more favorite folders through the display 50 (step S940).

For example, FIG. 10A and FIG. 10B are schematic diagrams of a favorite folder FF1 according to an embodiment of the present invention. Please refer to FIG. 10A. The user behavior is a long press operation, and the display 50 displays the favorite folder FF1 next to the graphical object TC3.

Referring to FIG. 10B , in one embodiment, the user behavior is a drag operation. The processor 70 determines the movement trajectory of the drag operation and the graphical object TC3 corresponding to the initial position of the drag operation, and adjusts the object position of the graphical object TC3 according to the movement trajectory. That is, the user drags the graphical object TC3.

In addition, the processor 70 determines the favorite folder FF1 corresponding to the end position of the drag operation. The processor 70 associates the graphical object TC3 corresponding to the initial position of the drag operation with the favorite folder FF1. For example, the graphical object TC3 enters the display area of the favorite folder FF1. For another example, the folder-related attributes of the graphical object TC3 are set to the favorite folder FF1. Thereby, the graphical object TC3 can be stored in the favorite folder FF1.

11A and 11B are schematic diagrams of favorite folders FF1 to FF3 according to an embodiment of the present invention. Please refer to Figure 11A. Compared with Figure 10B, this embodiment includes three favorite folders FF1~FF3. Referring to FIG. 11B , assuming that the end position of the drag operation DO1 corresponds to the favorite folder FF3, the graphical object TC4 is stored in the favorite folder FF3.

FIG. 12 is a schematic diagram of the drag operation DO2 in the multi-dimensional coordinate CS1 according to an embodiment of the present invention. Referring to Figure 12, the drag operation DO2 can drag the graphical object TC5 on the multi-dimensional coordinate CS1.

13A and 13B are schematic diagrams of a favorite folder according to an embodiment of the present invention. Please refer to Figure 13A and Figure 13B. This user interface UI3 is for a two-dimensional coordinate system (taking the attribute content as soft, hard, light, and heavy as an example), and Drag operation DO3 can move the graphical object TC6 out of the favorite folder FF4.

In addition to changing the object position of the graphical object, user behavior can further adjust the properties of the graphical object. In one embodiment, multiple attributes included in the graphical object respectively correspond to values in multiple dimensions of the multi-dimensional coordinate system. The first attribute corresponds to the first value in the first dimension, the second attribute corresponds to the second value in the second dimension, or the third attribute corresponds to the third value in the third dimension.

14A and 14B are schematic diagrams of position and attribute conversion according to an embodiment of the present invention. Referring to FIG. 14A, the user interface UI4 includes the multi-dimensional coordinate system CS2. The two dimensions 1401 and 1402 of the multidimensional coordinate system CS2 correspond to two attributes. Referring to Figure 14B, from an attribute perspective, the attributes are converted into codes 1404 (eg, "HS", "LH,'), and the grid 1405 defines the coordinates. For example, the coordinates 1406 of the graphical object TC7 are (25,70) . That is, the value in the first dimension is 25, and the value in the second dimension is 70. The value in each dimension is related to the (quantized) value of the corresponding attribute. For example, the value in the dimension is related to the value of the corresponding attribute. Proportional. In addition, when the object position of the graphical object TC7 changes, the content of the corresponding attribute will also change accordingly.

After the object positions of different graphical objects are determined, the processor 70 can store updated attributes.

In addition, FIG. 15 is a schematic diagram of multi-dimensional coordinates of multiple users according to an embodiment of the present invention. Please refer to Figure 15. Different users USER A, USER B, and USER C may make different decisions regarding the location of the same or different graphical objects in the user interface.

In one embodiment, the operation application is related to the object classification, and the user behavior is related to the click/save operation of report production. The processor 70 can generate an object classification report (User Defined Object Classification Report, UDOCR) based on the information of the graphical object. This object classification report records the correspondence between one or more users and the information of those graphical objects. In this way, the adjustment results of multiple graphical objects by different users can be viewed at the same time through the object classification report.

For example, FIG. 16 is a schematic diagram of an object classification report according to an embodiment of the present invention. Please refer to Figure 16. The object classification report includes title 1601, attributes corresponding to each dimension 1602, user name 1603, selection quantity 1604 (corresponding to selection option 1609), selection status indication 1605, scroll axis 1606, creation time 1607 and integrated report Generate option 1608. If the user behavior is to click the multi-user report generation option 1608, the processor 70 generates a Merged User Defined Object Classification Report (MUDOCR) corresponding to the user according to the selection status indication 1605.

In one embodiment, the operation application is related to object classification, and the user behavior is a plurality of click operations. The processor 70 provides the object classification report through the display 50 Selection options for information between multiple users and graphical objects (such as those presented in Figure 16). The processor 70 detects those click operations that select the same graphical object and those user selection options. In other words, two or more users are using the same graphical object in the object classification report. Processor 70 may determine representative values for one or more attributes of the graphical object. Since different users may place the same graphical object in different locations, the processor 70 further integrates the attribute content of the graphical object. The representative values of these attributes may be statistical indicators (eg, arithmetic mean, median, or mode) of the values of the corresponding attributes of the graphical object determined by the user.

For example, FIG. 17 is a schematic diagram of information integration of the same graphical object TC8 according to an embodiment of the present invention. Referring to Figure 17, it is assumed that the user behavior intention of two users U-A and U-B is to drag the same graphical object TC8. Therefore, the final position of the graphical object TC8 becomes the average of the final positions of the drag operations of the two users U-A and U-B after integration. In addition, the corresponding attributes of the graphical object TC8 will also become the average value of the attributes finally determined by the two users U-A and U-B. The lower part of the figure shows the results of the integrated object classification report. In some embodiments, the processor 70 can also confirm through the motion sensor 30 whether the users U-A and U-B need to further adjust the object position of the graphical object. If the object position changes, after the object position is saved, its adjusted coordinates and attributes can be updated in the integrated object classification report.

In one embodiment, if the processor 70 detects that different click operations select different users and select options of different graphical objects (i.e., detects that one click operation selects a graphical object and a certain user selects option and detect another click Select another graphical object and another user's selection options). Although the selection is mostly users, these users have not adjusted the same graphical objects. Therefore, the processor 70 can maintain/not change the values of the attributes of these graphical objects.

For example, FIG. 18 is a schematic diagram of information integration of different graphical objects according to an embodiment of the present invention. Please refer to Figure 18. Assume that there is only one user U-B moving the graphical object TC9. This graphical object TC9 will only appear in a single object classification report, and the graphical object TC9 can be directly displayed in the user's object classification report. on the interface.

In one embodiment, the operation application is related to the object classification, and the user behavior corresponds to the axial attribute change. The information of graphical objects includes three attributes, and their attribute types are different. For example, year, weight and hardness. The processor 70 may convert the multi-dimensional coordinate system into a first new coordinate system. It is assumed that the multi-dimensional coordinate system includes a first dimension (corresponding to the first attribute) and a second dimension (corresponding to the third attribute). This first new coordinate system includes the first dimension and the third dimension. The third value of the third dimension corresponds to the value of the third attribute.

For example, FIG. 19 is a schematic diagram of coordinate system transformation according to an embodiment of the present invention. Please refer to Figure 19. The dimension X of the multi-dimensional coordinate system CS3 is replaced with the dimension Z, and accordingly becomes the first new coordinate system CS4. In addition, the two-dimensional interface of the multi-dimensional coordinate system CS3 is located in the central area of the user interface. After conversion, the two-dimensional boundary of the first new coordinate system CS4 is located in the lower left area of the user interface.

In one embodiment, the processor 70 may provide an axial attribute bar in the user interface through the display 50 . For example, FIG. 20 is a diagram according to an embodiment of the present invention. Schematic diagram of dimension attribute changes. Referring to Figure 20, each dimension provides axial attribute options 2001 and provides options for one or more attributes. The axial attribute column 2002 records attributes corresponding to multiple dimensions of the multi-dimensional coordinate system.

The processor 70 may further detect the attribute changes corresponding to any dimension in the axial attribute column 2002 by the user's behavior through the motion sensor 30 . For example, the user behavior selects other attributes in the axis attribute option 2001. The processor 70 may convert the multi-dimensional coordinate system into the first new coordinate system according to the attribute change. For example, the axial replacement shown in Figure 20. In this way, the user can replace an original axial attribute with another new attribute. At this time, the information of the graphical object will be rearranged based on the new attribute values to form the first new coordinate system. For example, the new third dimension attribute is year, which replaces the old hardness value.

Figure 21 is a schematic diagram of dimension attribute modification according to an embodiment of the present invention. Please refer to FIG. 21. When the user clicks other attributes in the axial attribute menu 2001, the user interface will rearrange the graphical objects accordingly. The processor 70 moves all the graphical objects to their corresponding coordinate positions based on the information of the graphical objects. This can help users quickly compare the various correlations of graphical objects. In this embodiment, the new dimension (horizontal axis) is year, and the vertical axis is weight (heavy (heavy) to light (light)).

In addition to attribute replacement, embodiments of the present invention can also add attribute axis directions. In one embodiment, the processor 70 may convert the multi-dimensional coordinate system into the second new coordinate system. This second new coordinate system also includes the third dimension. In addition, the first value of the first dimension of the second new coordinate system corresponds to the value of the first attribute, the second value of the second dimension of the second new coordinate system corresponds to the value of the second attribute, and the second value of the second new coordinate system corresponds to the value of the second attribute. The third number in the third dimension The value corresponds to the numerical value of the third attribute.

For example, FIG. 22 is a schematic diagram of coordinate system transformation according to an embodiment of the present invention. Please refer to Figure 22. The user's behavioral intention adds a third axis to the multi-dimensional coordinate system CS3 that is different from the original two axis attributes and is perpendicular to the original cross axis. Thereby, a three-dimensional second new coordinate system CS5 can be formed. At this time, the graphical objects will be rearranged according to the values corresponding to their attributes and the new axis, so that the graphical objects are distributed in the second new coordinate system CS5.

In one embodiment, the processor 70 may provide an axial attribute bar and a dimension adding option in the user interface through the display 50 . For example, FIGS. 23A to 23C are schematic diagrams of adding dimension attributes according to an embodiment of the present invention. Please refer to Figure 23A, the dimension increase option 2302 is represented by "+" in the figure. The processor 70 may detect through the motion sensor 30 that the user behavior increases the attribute of the third attribute corresponding to the newly added third dimension in the dimension increase option 203 . Add option 203 to the user behavior selection dimension.

Referring to Figure 23B, this third dimension provides an axial attribute menu 2303. If the user behavior further selects a specific attribute for the third dimension, the processor 70 may add the multi-dimensional coordinate system into a second new coordinate system according to the attribute. For example, the two-dimensional coordinate system of Figure 23B is converted into the three-dimensional coordinate system shown in Figure 23C (new attribute 2304 is added). In addition, the graphical objects will be arranged along the axis of the third dimension according to the value of the third attribute. For example, the graphical objects are arranged from 2005 to 2020.

In one embodiment, the processor 70 can display a three-dimensional virtual world (that is, applicable to virtual reality (VR) or mixed reality (MR)) through the display 50 . For example, FIG. 24 is a schematic diagram of a three-dimensional virtual world TV according to an embodiment of the present invention. Please refer to Figure 24 shows that any position in the three-dimensional virtual world TV corresponds to a coordinate in the second new coordinate system. Among them, the second attribute of the second dimension shown in Figure 24 is the sense of technology (tech) and the sense of nature (natural). In this way, in-depth axial information content can be provided, allowing users to obtain a larger amount of information at the same time.

In one embodiment, the operation application is related to object search, and the user action is an input operation. Embodiments of the present invention can further enhance the search engine by integrating the object positions of graphical objects. Figure 25 is a flow chart of data search according to an embodiment of the present invention. Referring to FIG. 25 , the processor 70 can receive the keyword input by the text/voice input operation through the motion sensor 30 or the microphone (step S251 ). For example, keywords can be derived through text recognition or speech recognition. This keyword may be a number or the content of a specific attribute. The processor 70 may determine that the search attribute corresponding to the keyword is the first attribute or the second attribute of the graphical object (step S253). For example, the processor 70 determines whether the search attribute corresponding to the keyword is the same or similar to the first attribute or the second attribute. For another example, the keyword is 2020 and the search attribute is year. Processor 70 may sort the graphical objects based on the search attributes. Among these graphical objects, the higher the numerical value of the search attribute is, the higher the ranking will be. The graphical objects with the lower numerical value of the search attribute will be sorted later. In other words, when the input keyword is one end of the coordinate attribute, the two-dimensional multi-dimensional coordinate system will use the center as the basis to filter out the graphical objects close to the keyword attribute side and indicate that they have the characteristics of this keyword. . Among them, the search results are displayed according to the rule of "high value, appear earlier; low value, appear later".

For example, FIG. 26 is a schematic diagram of data search according to an embodiment of the present invention. Please refer to Figure 26, assuming that the keyword KW is Lamp (desk lamp) and hard (hard), Then the graphical object including the category table lamp is selected. Among the graphical objects of these table lamps, those with higher soft-hard value of attributes are sorted first, and those with lower soft-hard values of attributes are sorted last. In addition, the processor 70 may further exclude items such as desk lamps whose soft and hard values are zero.

To sum up, the object operating system and object operating method according to the embodiments of the present invention include (but are not limited to) the following features:

Digitize the manually organized coordinate system analysis results: use the coordinate values on the coordinate axes to convert the position of the graphical object data in space into quantified values.

Automatically integrate multiple analysis results - the first method: when a graphical object has multiple analysis results, the embodiment of the present invention will automatically calculate the representative value of the coordinates of the graphical object.

Automatically integrate multiple analysis results - the second method: when the graphical objects in the two analysis results are not exactly the same, the embodiment of the present invention will maintain the relative position of each graphical object data in the coordinates, and intersect to produce one graph that contains all the graphical objects. The result of the object's information.

Swapping coordinate axis attributes automatically generates new analysis results: The embodiment of the present invention supports the user to swap the coordinate axes and provides the generated new visual information to the user. It can also further add dual axes (planar view) to Three-axis (three-dimensional view) to obtain comparison results in more dimensions.

Data assists in optimizing search engines: The database will be updated for various parameters and axes of graphical objects, and this parameter can be used to optimize the filtering function of search engines.

Although the present invention has been disclosed above through embodiments, they are not intended to limit the present invention. Anyone with ordinary knowledge in the technical field may make some modifications and modifications without departing from the spirit and scope of the present invention. Therefore, The protection scope of the present invention shall be determined by the appended patent application scope.

S310~S370: steps

Claims (36)

An object operation method includes: displaying a plurality of graphical objects in a user interface, wherein the content of each graphical object is related to a physical object and is presented in at least one of a diagram and text, and each graphical object The graphical object has multiple types of attributes corresponding to the physical object. The type attributes include a first attribute and a second attribute. The first attribute or the second attribute is used to classify the at least one graphical object. In the user interface A multi-dimensional coordinate system is formed on a first value on, and the content of the second attribute corresponds to a second value on the second dimension; receiving at least one user interacting with at least one of the graphical objects on the user interface A user behavior to generate a control instruction corresponding to the user behavior, wherein the user behavior includes a gesture of the at least one user, the user touching a specific position on the user interface, the use An action or a combination thereof; adjusting an object position of the graphical object in the user interface according to the control instruction, wherein the object position includes the first value and the second value; according to the adjusted object position Change at least one of the first attribute and the second attribute of the adjusted graphical object; provide an operation application based on the object position of the graphical objects, wherein the operation application is related to the user behavior; as well as An object classification report is generated based on the information of the graphical objects, wherein the object classification report records the corresponding relationship between the at least one user and the information of the graphical objects, and the operation application is related to the object classification. The object operation method of claim 1, wherein the step of receiving the user behavior of the at least one user interacting with at least one of the graphical objects on the user interface includes: detecting the at least one The user's gesture; and determining the user's behavior based on the gesture. The object operation method as described in claim 1, wherein the user behavior is a sliding operation, and the step of adjusting the object position of the graphical object in the user interface according to the control instruction includes: determining the position of the sliding operation. The direction corresponds to one of the first dimension and the second dimension; when the direction of the sliding operation corresponds to the first dimension, increase or decrease the first values of all the graphical objects; and when the sliding operation When the direction of the operation corresponds to the second dimension, only the second value of all the graphical objects in one of the multiple display areas in the user interface is increased or decreased, wherein the operation application is related to browsing objects, and the arrangement direction of the display areas corresponds to the first dimension. The object operation method as described in claim 1, wherein the user behavior is a drag operation, and the step of adjusting the object position of the graphical object in the user interface according to the user behavior includes: Determine a first object among the graphical objects corresponding to the movement trajectory of the drag operation and the initial position of the drag operation; and adjust the object position of the first object according to the movement trajectory. The object operation method as described in claim 1, wherein the user behavior is a click operation, and the step of providing the operation application based on the object position of the graphical objects includes: timing a duration of the click operation; Determine whether the duration corresponds to a short-press operation; determine a second object among the graphical objects corresponding to the position of the short-press operation; and enlarge the second object or display an additional content of the second object , where the additional content is related to the attribute content of the second object, and the operation application is related to the browsing object. The object operation method as described in claim 1, wherein the user behavior includes a click operation, and the step of providing the operation application based on the object position of the graphical objects includes: timing a duration of the click operation; Determine whether the duration corresponds to a long press operation; and when the duration corresponds to the long press operation, display at least one favorite folder, wherein the operation application is related to the browsing object. The object operation method as described in claim 6, wherein the user behavior further includes a drag operation, and the object operation method further includes: Determine a favorite folder corresponding to the end position of the drag operation; and associate a third object among the graphical objects corresponding to the initial position of the drag operation with the favorite folder. The object operation method as described in claim 1, wherein the at least one user includes multiple users, and the user behaviors of these users are multiple click operations, and the object positions are based on the graphical objects. The step of providing the operation application includes: providing a selection option for the information of the users and a fourth object among the graphical objects in the object classification report; detecting that the click operations select the same third object. The selection options of the four objects and the users; and determining the representative value of the first attribute and the representative value of the second attribute of the fourth object, wherein the representative value of the first attribute is the third attribute determined by the users. Statistical indicators of the value of the first attribute of the four objects, and the representative value of the second attribute is the statistical indicator of the value of the second attribute of the fourth object determined by the users. The object operating method as described in claim 8, wherein after the step of determining the representative value of the first attribute and the representative value of the second attribute of the fourth object, it further includes: based on the representative value of the first attribute and the representative value of the second attribute. The representative value of the second attribute displays the fourth object in the user interface, wherein the first value in the object position of the fourth object corresponds to the representative value of the first attribute, and the second value corresponds to The representative value of this second attribute. The object operation method as described in claim 9 further includes: detecting that one of the click operations selects the fourth object and the selection option of the user; detecting another one of the click operations. One selects a fifth object among the graphical objects and the selection option of the other user; and maintains the value of the first attribute and the value of the second attribute of the fourth object and the fifth object. . The object operation method as described in claim 1, wherein the type attribute further includes a third attribute, the first attribute, the second attribute and the third attribute have different attribute types, the operation application is related to the object classification, and The step of providing the operation application based on the object positions of the graphical objects includes: converting the multi-dimensional coordinate system into a first new coordinate system, wherein the first new coordinate system includes the first dimension and a third dimension , the first value of the first dimension of the first new coordinate system corresponds to the value of the first attribute, and a third value of the third dimension of the first new coordinate system corresponds to the value of the third attribute numerical value. The object operation method as described in claim 11, wherein the step of converting the multi-dimensional coordinate system into the first new coordinate system includes: providing a one-dimensional attribute bar in the user interface, wherein the dimension attribute bar records the first new coordinate system. An attribute corresponding to one dimension and the second dimension; detecting an attribute change of the user behavior to the attribute corresponding to the first dimension or the second dimension in the attribute column of the dimension; and changing the attribute according to the attribute change. The multi-dimensional coordinate system is converted into the first new coordinate system. The object operation method as described in claim 1, wherein the type attribute further includes a third attribute, the first attribute, the second attribute and the third attribute have different attribute types, the operation application is related to the object classification, and The step of providing the operation application based on the object positions of the graphical objects includes: converting the multi-dimensional coordinate system into a second new coordinate system, wherein the second new coordinate system includes the first dimension, the second dimension and a third dimension, the first value of the first dimension of the second new coordinate system corresponds to the value of the first attribute, and the second value of the second dimension of the second new coordinate system corresponds to the third The value of the second attribute, and a third value of the third dimension of the second new coordinate system corresponds to the value of the third attribute. The object operation method as described in claim 13, wherein the step of converting the multi-dimensional coordinate system into the second new coordinate system includes: providing a one-dimensional attribute bar and a one-dimensional adding option in the user interface, wherein the dimension The attribute column records the attributes corresponding to the first dimension and the second dimension; detects the user behavior to increase the attribute of the third attribute corresponding to the third dimension in the option of adding the dimension; and increases the attribute according to the attribute. Convert the multi-dimensional coordinate system into the second new coordinate system. The object operation method as described in claim 13, wherein after the step of converting the multi-dimensional coordinate system into the second new coordinate system, it further includes: displaying a three-dimensional virtual world, wherein any position in the three-dimensional virtual world corresponds to one of a plurality of coordinates in the second new coordinate system; and displaying the graphical objects in the three-dimensional virtual world. The object operation method as described in claim 1, wherein the user behavior is an input operation, the operation application is related to object search, and the step of providing the operation application based on the object positions of the graphical objects includes: receiving A keyword entered in the input operation; determining a search attribute corresponding to the keyword to be one of the first attribute and the second attribute; and sorting the graphical objects according to the search attribute, wherein the The graphical objects with higher values of the search attribute are sorted earlier, and the graphical objects with the lower values of the search attribute are sorted later. The object operating method as claimed in claim 1, further comprising: using the multi-dimensional coordinate system to classify the graphical objects, wherein the interface between the first dimension and the second dimension is at a first point in the user interface. area or a second area, and the first area is different from the second area. The object operation method as described in claim 1 further includes: displaying the first dimension and the second dimension in the user interface. An object operating system includes: a storage for storing information of a plurality of graphical objects; a display for presenting a user interface; a motion detector for detecting a user behavior; and a a processor coupled to the storage, the display, and the motion detector, and configured to: display a plurality of graphical objects in the user interface through the display, The content of each graphical object is related to the physical object and is presented in at least one of graphics and text. Each graphical object has multiple types of attributes corresponding to the physical object, and the type attributes include a first attribute. and a second attribute. The first attribute or the second attribute is used to classify the at least one graphical object, forming a multi-dimensional coordinate system on the user interface. The multi-dimensional coordinate system includes information related to the first attribute. a first dimension and a second dimension related to the second attribute, the content of the first attribute corresponds to a first value on the first dimension, and the content of the second attribute corresponds to the second dimension a second value on; receiving a user behavior of at least one user interacting with at least one of the graphical objects on the user interface through the motion detector to generate a user behavior corresponding to the A control instruction, wherein the user behavior includes a gesture of the at least one user, the user touching a specific position on the user interface, an action of the user, or a combination thereof; adjusting a function according to the control instruction An object position of the graphical object in the user interface, wherein the object position includes the first value and the second value; changing the adjusted first attribute of the graphical object according to the adjusted object position and at least one of the second attributes; providing an operation application based on the object position of the graphical objects, wherein the operation application is related to the user behavior; generating an object classification report based on the information of the graphical objects , wherein the object classification report records the corresponding relationship between the at least one user and the information of the graphical objects, and the operation application is related to the object classification. The object operating system of claim 19, wherein the processor is further configured to: detect the gesture of the at least one user through the motion sensor; and determine the user behavior based on the gesture. The object operating system of claim 19, wherein the user behavior is a sliding operation, and the processor is further configured to: determine whether the direction of the sliding operation corresponds to the first dimension and the second dimension. One; when the direction of the sliding operation corresponds to the first dimension, increase or decrease the first values of all the graphical objects; and when the direction of the sliding operation corresponds to the second dimension, only increase or decrease Reduce the second value of all the graphical objects in one of a plurality of display areas in the user interface, wherein the operation application is related to the browsing object, and the arrangement direction of the display areas corresponds to the third One dimension. The object operating system of claim 19, wherein the user behavior is a drag operation, and the processor is further configured to: determine the movement trajectory of the drag operation and the initial position of the drag operation. a first object among the graphical objects; and adjusting the object position of the first object according to the movement trajectory. The object operating system of claim 19, wherein the user behavior is a click operation, and the processor is further configured to: time a duration of the click operation; Determine whether the duration corresponds to a short-press operation; determine a second object among the graphical objects corresponding to the position of the short-press operation; and magnify the second object or display the second object through the display An additional content, wherein the additional content is related to the attribute content of the second object, and the operation application is related to the browsing object. The object operating system of claim 19, wherein the user behavior includes a click operation, and the processor is further configured to: time a duration of the click operation; determine whether the duration corresponds to a long Press operation; and when the duration corresponds to the long press operation, at least one favorite folder is displayed through the display, wherein the operation application is related to the browsing object. The object operating system of claim 19, wherein the user behavior further includes a drag operation, and the processor is further configured to: determine the favorite folder corresponding to the end position of the drag operation; And a third object among the graphical objects corresponding to the initial position of the drag operation is associated with the favorite folder. The object operating system of claim 19, wherein the at least one user includes multiple users, the user behaviors of the users are multiple click operations, and the processor is further configured to: The object classification report provides a selection option for information about the users and a fourth object among the graphical objects; Detecting the click operations to select the same fourth object and the selection options of the users; and determining the representative value of the first attribute of the fourth object and the representative value of the second attribute, wherein the first attribute The representative value is the statistical index of the value of the fourth object in the first attribute determined by these users, and the representative value of the second attribute is the statistical index of the fourth object in the second attribute determined by these users. numerical statistical indicators. The object operating system of claim 26, wherein the processor is further configured to: display the fourth value in the user interface through the display according to the representative value of the first attribute and the representative value of the second attribute. Object, wherein the first value in the object position of the fourth object corresponds to the representative value of the first attribute, and the second value corresponds to the representative value of the second attribute. The object operating system as claimed in claim 27, wherein the processor is further configured to: detect that one of the click operations selects the fourth object and the selection option of the user; detects the Another of the clicking operations selects a fifth object among the graphical objects and another of the user's selection options; and maintains the values of the first attributes of the fourth object and the fifth object. and the value of the second attribute. The object operating system as claimed in claim 19, wherein the type attribute further includes a third attribute, and attributes of the first attribute, the second attribute and the third attribute Different types of properties, the operation application is related to object classification, and the processor is further configured to: convert the multi-dimensional coordinate system into a first new coordinate system, wherein the first new coordinate system includes the first dimension and a In the third dimension, the first value of the first dimension of the first new coordinate system corresponds to the value of the first attribute, and a third value of the third dimension of the first new coordinate system corresponds to the third dimension. The value of three attributes. The object operating system of claim 29, wherein the processor is further configured to: provide a dimension attribute bar in the user interface, wherein the dimension attribute bar records the first dimension and the second dimension corresponding to attributes; detect an attribute change of the user behavior to the attribute corresponding to the first dimension or the second dimension in the dimension attribute column; and convert the multi-dimensional coordinate system into the first dimension based on the attribute change. New coordinate system. The object operating system of claim 19, wherein the type attribute further includes a third attribute, the first attribute, the second attribute and the third attribute have different attribute types, the operation application is related to the object classification, and The processor is further configured to: convert the multi-dimensional coordinate system into a second new coordinate system, wherein the second new coordinate system includes the first dimension, the second dimension and a third dimension, and the second new coordinate system The first value of the first dimension of the coordinate system corresponds to the value of the first attribute, the two values of the second dimension of the second new coordinate system correspond to the value of the second attribute, and the second new value A third value of the third dimension of the coordinate system corresponds to the number of the third attribute value. The object operating system of claim 29, wherein the processor is further configured to: provide a dimension attribute bar and a dimension adding option in the user interface, wherein the dimension attribute bar records the first dimension and the the attribute corresponding to the second dimension; detecting the attribute increase of the third attribute corresponding to the third dimension in the option of adding the dimension by the user behavior; and converting the multi-dimensional coordinate system into the multi-dimensional coordinate system according to the attribute increase. The second new coordinate system. The object operating system of claim 29, wherein the processor is further configured to: display a three-dimensional virtual world through the display, wherein any position in the three-dimensional virtual world corresponds to the second new coordinate system One of a plurality of coordinates; and displaying the graphical objects in the three-dimensional virtual world. The object operating system of claim 19, wherein the user behavior is an input operation, the operation application is related to object search, and the processor is further configured to: receive a keyword input by the input operation; Determine a search attribute corresponding to the keyword to be one of the first attribute and the second attribute; and sort the graphical objects according to the search attribute, wherein the value of the search attribute in the graphical objects is greater than The higher one will be sorted earlier, and the graphical objects with lower values of the search attribute will be sorted later. The object operating system of claim 19, wherein the processor is further configured to: use the multi-dimensional coordinate system to classify the graphical objects, wherein the interface of the first dimension and the second dimension is used A first area or a second area in the user interface, and the first area is different from the second area. The object operating system of claim 19, wherein the processor is further configured to display the first dimension and the second dimension in the user interface through the display.

Images