EP2272055B1 - Remote control - Google Patents

Abstract

In a method for controlling objects, objects to be controlled are arranged in a real space. Said real space is linked to a multi-dimensional representational space by a transformation rule. Representations in the representational space are associated with the controllable objects of the real space by a mapping. Said method comprises steps of determining the position and orientation of a pointer in the real space, determining the position and orientation of a pointer representation associated with the pointer in the representational space using the position and orientation of the pointer in the real space and the transformation rule between the real space and the representational space, determining the representations in the representational space that are intersected by the pointer representation, selecting a representation that is intersected by the pointer representation, and controlling the object in the real space that is associated with the pointer representation in the representational space.

Description

The invention relates to a method for controlling objects.

In the field of home electronics remote controls for controlling electronic devices are well known. A variety of electronic devices typically found in homes today are equipped with remote controls. The remote controls allow you to switch the associated electronic device on, off and on. The use of remote controls for the control and monitoring of plants is also known in the industrial environment.

Typically each device has its own remote control. In environments with many remote-controlled devices and systems, therefore, a large number of remote controls is necessary. The different devices and systems associated with remote controls often have different operating concepts. This forces the user of the remote controls to become familiar with a number of different operating concepts.

Conventional remote controls generally send control signals to the device or system to be controlled for controlling remote-controllable devices and systems. For this purpose, the remote control establishes a direct communication connection with the device to be controlled or the system to be controlled. Usually, this communication connection is an infrared data connection. The remote control transmits infrared signals to the device to be controlled, in which the desired control command is coded. A disadvantage of the infrared data exchange is the limited range of the infrared signals and the need for a direct line of sight between the remote control and the device or equipment to be controlled.

The WO 02/43023 A2 describes a remote control that can control a plurality of devices in interaction with a control unit. In the control unit, the spatial coordinates of all controllable devices are stored. The remote control has means to detect the spatial position and orientation of the remote control. The control unit uses this data to determine if the remote control is pointing at any of the controllable devices and, if necessary, selects that device for control.

Also the DE 10 2005 046 218 A1 describes a remote control system for driving a plurality of devices. Again, a control unit is provided which holds the space coordinates of all controllable devices. Again, the position and orientation of the remote will be detected to determine which device the remote is pointing at. The spatial coordinates of the controllable devices can alternatively also be stored in the remote control itself.

Also the US 2005/0225453 describes a remote control system for driving a plurality of devices. Again, a control unit is provided which holds the space coordinates of all controllable devices. Again, the position and orientation of the remote will be detected to determine which device the remote is pointing at. The selected device can be controlled by gestures carried out with the remote control.

For all three proposals, the remote control must be aligned with the device coordinates stored in the respective control unit. This can prove uncomfortable. For very small, distant or hidden devices, it may be difficult to align the remote control with sufficient precision. This applies even more if the devices to be controlled are out of sight or in another room or building.

In addition, the binding to the spatial coordinates of the devices to be controlled limits the flexibility of the previous proposals. There are no possibilities to jointly control groups of devices or provide predefined complex control sequences conveniently accessible.

Also the US 2006/0241864 describes a remote control system for driving a plurality of devices. The room coordinates of all controllable devices are kept available. It is also possible to associate certain spatial coordinates with devices that are actually located elsewhere. A device to be controlled is selected by aiming the remote at or near the device.

This proposal thus simplifies the selection of small or hidden arranged devices. However, there is no provision for jointly controlling groups of devices or providing predefined complex control sequences conveniently accessible.

It is therefore an object of the present invention to provide an improved method for controlling objects, which is a control of a plurality of objects with only one pointer allows. It is a further object of the present invention to provide a method for controlling objects for which there is no need for an immediate visual connection between the pointer and the object to be controlled. It is a further object of the present invention to simplify the control of objects.

These objects are achieved by a method for controlling objects having the features of claim 1. Preferred embodiments will be apparent from the dependent claims.

According to the method of the invention, the objects to be controlled are arranged in a real space. The real space is linked via a linking rule with a multi-dimensional figure space. The objects to be controlled of the real space are assigned by an assignment rule figures in the figure space. The method comprises determining the position and orientation of a pointer in the real space, determining the position and orientation of a selection character associated with the pointer in the figure space based on the position and orientation of the pointer in real space and the linking rule between real space and figure space, determining the figures of the figure space being cut by the selection figure, selecting a figure cut by the selection figure, and controlling the object allocated to the selected figure in the figure space in the real space.

Advantageously, the method according to the invention allows the control of a plurality of objects with only one pointer. There is no direct visual contact between the pointer and the object to be controlled. Advantageously, the selection of an object to be controlled can be done intuitively by pointing with the pointer to the object.

According to a preferred embodiment, steps for setting a mathematical link between the figure space and the real space, for assigning, are defined for defining the figure space executed by figures to the objects to be controlled and for positioning the figures in the figure space.

Advantageously, a high degree of abstraction is achieved by the combination of real and figure space, which allows an adaptation of the method according to the invention to a plurality of applications.

Preferably, the figures are positioned without overlap in the figure space. This facilitates the selection of an object to be controlled, since the probability of a selection figure cutting more than one figure decreases.

In a preferred embodiment, the position and size of the figure space and the figures assigned to the objects to be controlled are automatically determined according to the location and size of detected objects to be controlled. This facilitates the generation of a figure space assigned to a real space. Advantageously, the generation can be largely automatic.

In a preferred embodiment, the objects to be controlled are connected to a control device. In this case, steps for transmitting a control command from the pointer to the control device and for transmitting the control command from the control device to the object are carried out for controlling the object assigned to the selected figure.

Advantageously, direct communication between the pointer and the object to be controlled is not necessary according to this method. This eliminates the need to have a line of sight between the object and the pointer, and the control can be independent of the distance between the object and the pointer.

In a further preferred embodiment, the method additionally comprises steps for assigning one or more setting values of one or more objects to be controlled to an attitude figure, to position the attitude figure in the figure space, to select the attitude figure, and to transmit the one or more attitude values to the one or more objects.

This method makes it possible to deposit and retrieve sets of matching settings for different controllable objects. As a result, frequently recurring scenarios can be taken into account, and suitable settings for various controllable objects do not have to be reentered each time.

Preferably, the pointer has the form of a remote control. As a result, users who are accustomed to the use of a remote control, do not have to get used.

In a preferred embodiment, the pointer has a touch-sensitive display. This allows a more comfortable handling of the pointer.

In a further preferred embodiment, the pointer emits a light beam in a predetermined direction, whose orientation in the real space corresponds to the orientation of the selection figure in the figure space. As a result, an object to which the pointer is aligned is marked by a light spot. This can facilitate the selection of an object to be controlled.

Preferably, the control of the selected object is accomplished by performing fixed movements with the pointer. This makes intuitive and uncomplicated operation of the pointer possible.

Further preferred embodiments will become apparent from the remaining dependent claims.

• Figur 1 eine schematische Darstellung eines Realraums mit steuerbaren und nicht steuerbaren Objekten und einem Zeiger;
• Figur 2 eine schematische Darstellung eines Figurenraums mit einer Figur, einer Einstellungsfigur und einer Auswahlfigur;
• Figur 3 eine schematische Darstellung eines Objekts und einer zugeordneten Figur;
• Figur 4 eine schematische Darstellung einer Mehrzahl von Objekten mit einer zugeordneten Figur;
• Figur 5 eine schematische Darstellung einer Mehrzahl von Objekten mit zugeordneten Figuren;
• Figur 6 eine schematische Darstellung eines Objekts mit einer Mehrzahl zugeordneter Figuren;
• Figur 7 eine schematische Darstellung eines Gebäudeplans mit einer Mehrzahl zweidimensionaler Figuren;
• Figur 8 eine schematische Darstellung eines Steuergeräts, das mit zwei Objekten, einem Zeiger und einem Positionserfassungsgerät verbunden ist;
• Figur 9 ein schematisches Ablaufdiagramm eines Verfahrens zum Steuern von Objekten;
• Figur 10 eine schematische Darstellung eines Verfahrens zum Steuern von Objekten;
• Figur 11 ein schematisches Ablaufdiagramm eines Verfahrens zum Definieren eines Figurenraums;
• Figur 12 eine schematische Darstellung eines Zeigers;
• Figur 13 eine schematische Darstellung eines Zeigers mit zugeordneter Auswahlfigur;
• Figur 14 eine schematische Darstellung eines Zeigers mit zugeordneter Auswahlfigur;
• Figur 15 eine schematische Darstellung eines Zeigers mit zugeordneter Auswahlfigur;
• Figur 16 eine schematische Darstellung eines Zeigers mit zugeordneter Auswahlfigur;
• Figur 17 eine schematische Darstellung eines Zeigers mit zugeordneter Auswahlfigur;
• Figur 18 eine schematische Darstellung eines Zeigers mit zugeordneter Auswahlfigur;
• Figur 19 eine schematische Darstellung eines Zeigers und mehrerer von der zugeordneten Auswahlfigur geschnittener Figuren;
• Figur 20 eine schematische Darstellung eines Zeigers und einer zugeordneten Auswahlfigur;
• Figur 21 eine schematische Darstellung einer Auswahlfigur und einer Mehrzahl von Figuren;
• Figur 22 eine schematische Darstellung eines Zeigers und eines Positionserfassungssystems;
• Figur 23 eine schematische Darstellung eines Zeigers und eines Positionserfassungssystems;
• Figur 24 eine schematische Darstellung eines ortsfesten Zeigers;
• Figur 25 eine schematische Darstellung eines steuerbaren Objekts und eines Zeigers.

The invention will be explained in more detail below with reference to embodiments with reference to the accompanying drawings. Showing:

• FIG. 1 a schematic representation of a real space with controllable and non-controllable objects and a pointer;
• FIG. 2 a schematic representation of a figure space with a figure, a recruitment figure and a selection figure;
• FIG. 3 a schematic representation of an object and an associated figure;
• FIG. 4 a schematic representation of a plurality of objects with an associated figure;
• FIG. 5 a schematic representation of a plurality of objects with associated figures;
• FIG. 6 a schematic representation of an object with a plurality of associated figures;
• FIG. 7 a schematic representation of a building plan with a plurality of two-dimensional figures;
• FIG. 8 a schematic representation of a controller, which is connected to two objects, a pointer and a position detection device;
• FIG. 9 a schematic flow diagram of a method for controlling objects;
• FIG. 10 a schematic representation of a method for controlling objects;
• FIG. 11 a schematic flow diagram of a method for defining a figure space;
• FIG. 12 a schematic representation of a pointer;
• FIG. 13 a schematic representation of a pointer with associated selection figure;
• FIG. 14 a schematic representation of a pointer with associated selection figure;
• FIG. 15 a schematic representation of a pointer with associated selection figure;
• FIG. 16 a schematic representation of a pointer with associated selection figure;
• FIG. 17 a schematic representation of a pointer with associated selection figure;
• FIG. 18 a schematic representation of a pointer with associated selection figure;
• FIG. 19 a schematic representation of a pointer and a plurality of cut from the associated selection figure figures;
• FIG. 20 a schematic representation of a pointer and an associated selection figure;
• FIG. 21 a schematic representation of a selection figure and a plurality of figures;
• FIG. 22 a schematic representation of a pointer and a position detection system;
• FIG. 23 a schematic representation of a pointer and a position detection system;
• FIG. 24 a schematic representation of a fixed pointer;
• FIG. 25 a schematic representation of a controllable object and a pointer.

FIG. 1 shows a schematic representation of a real space 100. The real space 100 may be, for example, a room in a building, such as an apartment or a factory. The real space 100 can also be located outside of a building. The real space 100 may be of any size. The real space 100 may also include multiple rooms of a building or part of a room of a building.

The real space 100 can be assigned a three-dimensional Cartesian coordinate system having a first axis x ₁ , a second axis y ₁ and a third axis z ₁ . The axes x ₁ , y ₁ , z ₁ are perpendicular to each other.

In the real space 100 is a controllable object 101. The controllable object 101 may be, for example, an electrical or electronic device, such as a consumer electronics device or a plant in a factory. For example, the controllable object 101 may be a television. The controllable object 101 has user-adjustable settings. For example, in the case of a television, the user may adjust the program being played or the volume. If the controllable object 101 is a lamp, for example, its brightness can be controlled. If the controllable object 101 is a plant located in a factory, then settings of this plant can be changed.

Furthermore, there is an uncontrollable object 102 in the real space 100. The uncontrollable object 102 can be any object that has no control options for a user. The non-controllable object 102 may be, for example, a houseplant, a shield attached to a wall, or a non-controllable plant of a factory.

In addition to the illustrated controllable object 101 and the illustrated non-controllable object 102, the real space 100 may have any number of further controllable and non-controllable objects. The controllable and non-controllable objects can be arranged arbitrarily within the real space. If the real space 100 comprises several rooms or building parts of a building, the controllable and non-controllable objects can be arranged in different rooms or building parts of the real space 100.

FIG. 1 The pointer 103 serves to control the controllable object 101 and other controllable objects of the real space 100. The pointer 103 may take the form of a remote control, such as those known for television sets. The pointer 103 may also be in the form of a mobile phone or any other shape. In the presentation of FIG. 1 the pointer 103 is a device that is freely movable in the real space 100.

At each point in the real space 100, the pointer 103 has a position that can be specified with respect to the coordinate axes x ₁ , y ₁ , z ₁ . In addition, the pointer 103 can be rotated about arbitrary axes. At any time, the pointer 103 has an orientation within the real space 100, which can be expressed, for example, by a direction vector that can be specified in units of the coordinate axes x ₁ , y ₁ , z ₁ . In FIG. 1 a line of sight 104 is shown indicating the orientation of the pointer 103. In the example of FIG. 1 the line of sight 104 is perpendicular to an outer surface of the pointer 103. If the pointer 103 has the form of a remote control, the line of sight 104 For example, stand perpendicular to an end face of the pointer 103. In FIG. 1 the pointer 103 is oriented such that the line of sight 104 is aligned in the direction of the controllable object 101. This corresponds to the intuitive use of a conventional remote control, which serves to control the controllable object 101.

FIG. 2 shows a schematic representation of a linked with the real space 100 figure space 200. The figure space 200 may be a one, two or three-dimensional figure space. In the presentation of FIG. 2 the figure space 200 is a three-dimensional figure space with a Cartesian coordinate system with axes x ₂ , y ₂ , z ₂ , which are perpendicular to each other. The figure space 200 is linked to the real space 100 via a linking rule. The linking rule can be understood as a relationship between the Cartesian coordinate system with axes x ₁ , y ₁ , z _{1 of} the real space 100 and the Cartesian coordinate system with axes x ₂ , y ₂ , z _{2 of} the figure space 200. The linking rule may be, for example, a linear mapping. The linking rule may include translation, rotation, and enlargement or reduction. The join rule may also include any other mathematical operations or join rules. In a simple case, the join rule between real space 100 and figure space 200 is an identical mapping. In this case, real space 100 and figure space 200 are congruent.

The figure space 200 may have any extension. The figure space 200 may be larger, smaller or the same size as the real space 100.

In the figure space 200, a figure 201 is arranged. The figure 201 is assigned to the controllable object 101 of the real space 100 via an assignment rule. The figure 201 can be arranged at different positions within the figure space 200 be and have different sizes and orientations within the figure space 200. If the figure space 200 is superposed congruently on the real space 100, the figure 201 may preferably be arranged at the same position within the figure space 200 at which the controllable object 101 assigned to the figure 201 is arranged in the real space 100. Preferably, in this case, the figure 201 has a similar shape to the controllable object 101 and has a similar size and the controllable object 101. The controllable object 101 arranged in the real space 100 may have a complicated geometry. In this case, the shape of the figure 201 may be preferably simplified. If the controllable object 101 is a television set, the controllable object 101 can be assigned, for example, a cuboid figure 201 in the figure space 200.

FIG. 2 furthermore shows a selection figure 203 arranged in the figure space 200. The selection figure 203 in the figure space 200 is assigned to the pointer 103 in the real space 100 via an assignment rule. The position and orientation of the selection figure 203 in the figure space 200 correspond to the position and orientation of the pointer 103 in the real space 100 according to the linking rule of the figure space 200 and the real space 100.

In the example of FIG. 2 The selection figure 203 has the shape of a cone. The selection figure 203 can also have any other shape, for example the shape of a cylinder, a pyramid, a cuboid, a tetrahedron, a prism, a straight line or a fan-shaped straight line bundle or another geometric shape.

In the example of FIG. 2 is the tip of the conical selection figure 203 at the position of the figure space 200, which is linked to the position of the pointer 103 in the real space 100 via the linking rule between figure space 200 and real space 100. In FIG. 1 is a perpendicular to a surface of the pointer 103 standing line 104 the controllable object 101 of the real space 100 aligned. Accordingly, the selection figure 203 cuts in FIG. 2 Figure 201. In the in FIGS. 1 and 2 In the examples shown, the linking rule between real space 100 and figure space 200 and the assignment rule between controllable object 101 and FIG. 201 are selected so that selection figure 203 then intersects figure 201 if a line of sight 104 perpendicular to a surface of pointer 103 points to the controllable object 101 of the real space 100 is aligned. However, in other embodiments, the join rule and assignment rule could also be chosen so that the selection figure 203 does not intersect the figure 201 when the pointer 103 is aligned with the controllable object 101. Instead, the selection figure 203 could intersect the figure 201 at a different orientation of the pointer 103 in the real space 100.

The in FIG. 2 Figure space 200 shown additionally has a setting figure 202. The adjustment figure 202 is not an object of the real space 100 FIG. 1 assigned. The adjustment figure 202 represents a set of adjustment values for one or more controllable objects of the real space 100. For example, the adjustment figure 202 may include one or more adjustment values for the controllable object 101 FIG. 1 represent. The adjustment figure 202 is located at the position of the figure space 200, which coincides with the position of the non-controllable object 102 in the real space 100 FIG. 1 is linked. As a result, the selection figure 203 intersects the setting figure 202 in the figure space 200 when the pointer 103 in the linked real space 100 is off FIG. 1 is aligned with the non-controllable object 102. However, the adjustment figure 202 could also be arranged at any other position within the figure space 200. The figure space 200 could also have other attitude figures. The setting figure 202 can also be omitted.

FIG. 3 illustrates again the relationship between a arranged in a real space controllable object 300 and arranged in a linked with the real space figure space Figure 301. The controllable object can be for example a lamp with adjustable brightness or a music system with adjustable volume. The figure 301 is assigned to the object 300 via an assignment rule. The figure 301 may have the same geometry as the object 300. However, the figure 301 may also have a different geometry than the object 300. For example, the geometry of FIG. 301 may be simplified relative to the geometry of the object 300. The figure 301 may be located at the position of the figure space associated with the position of the object 300 in real space. However, the figure 301 may also be located at another position of the figure space. Im in FIG. 3 the example 300 is assigned to the object 300, the figure 301 and the figure 301, the object 300 is assigned.

In FIG. 4 schematically three arranged in a real space controllable objects 400, 401, 402 are shown. The controllable objects 400, 401, 402 arranged in the real space can be, for example, three lamps with controllable brightness. The three controllable objects 400, 401, 402 arranged in the real space are assigned a figure 403 via an assignment rule which is arranged in a figure space linked to the real space via a linking rule. Im in FIG. 4 In the example shown, the three controllable objects 400, 401, 402 are thus assigned a common figure 403. The figure 403, the three controllable objects 400, 401, 402 assigned.

FIG. 5 3 shows a schematic representation of three objects 500, 502, 504 arranged in a real space. The controllable objects 500, 502, 504 can be, for example, lamps with controllable brightness. The objects 500, 502, 504 arranged in real space are in one with the real space via a linking rule associated figure space arranged figures 501, 503, 505 assigned via an assignment rule. The object 500 is associated with the figure 501. The object 502 is associated with the figure 503. The object 504 is associated with the figure 505. Each of the objects 500, 502, 504 is thus assigned to one of the figures 501, 503, 505. Each of the figures 501, 503, 505 is associated with one of the objects 500, 502, 504.

The figures 501, 503, 505 are arranged in the figure space within a further figure 506. The figures 501, 503, 505 are thus grouped or grouped in the figure space to the figure 506. Each of the objects 500, 502, 504 arranged in the real space is thus also assigned to the figure 506 in the figure space. The figure 506 in the figure space is assigned to each of the objects 500, 502, 504 in real space. The object 500 in the real space is assigned to both the figure 501 and the figure 506 in the figure space. The object 502 in the real space is assigned to both the figure 503 and the figure 506 in the figure space. The object 504 is associated with both Figure 505 and Figure 506 in the figure space.

In FIG. 6 schematically a controllable object 600 is shown, which is arranged in a real space. The controllable object 600 may be, for example, a factory. The controllable object 600 arranged in the real space is assigned three figures 601, 602, 603 via an assignment rule, which are arranged in a figure space linked to the real space via a linking rule. Im in FIG. 6 Thus, a number of figures 601, 602, 603 in the associated figure space are assigned to a controllable object 600 in the real space. As in FIG. 5 can the in FIG. 6 Figures 601, 602, 603 shown further figures contained in the FIG. 6 are not shown.

FIG. 7 shows a schematic plan view of a building plan 702. The building plan 702 depicts a building with controllable objects located therein. The one shown on the building plan 702 For example, a building may be an office building with controllable objects therein. The controllable objects located in the office building can be, for example, lamps, air conditioners, loudspeakers, blinds, computers or other controllable devices.

The building plan 702 is arranged in a real space. For example, the building plan 702 may be on a wall of the building depicted on the building plan 702. The real space in which the building plan 702 is arranged is linked to a figure space via a linking rule. The controllable objects depicted on the building plan 702 are assigned to figures 703 arranged in the figure space via an assignment rule. Figures 703 are two-dimensional figures. The two-dimensional figures 703 are arranged in the figure space such that the position of the figures 703 in the figure space is linked via the linking rule between figure space and real space with a position in the real space which is located on the floor plan arranged in real space 702. FIG. 703 is located in the figure space where the controllable object associated with FIG. 703 is depicted in the real space on the building plan 702. If a pointer 700 is now aligned in the real space in such a way that a line of sight 701 perpendicular to a surface of the pointer 700 intersects an image of a controllable object on the floor plan 702, then in the figure space linked to the real space, a selection figure associated with the pointer 700 intersects the cut figure 703. The building plan 702 arranged in the real space thus allows a simple and comfortable selection of all controllable objects arranged in different parts of the building.

In FIG. 8 Fig. 3 is a schematic block diagram of an arrangement for controlling one or more controllable objects. FIG. 8 shows a pointer 800, which is used to control a first controllable object 801 and a second controllable Object 802 can be used. The pointer 800 is connected to a controller 803 via a communication link 810. For example, the controller 803 may be a computer. The communication link 810 may be a wired, but preferably a wireless communication link 810. The communication connection 810 may be a known wireless communication connection, for example a Bluetooth connection or a WLAN connection. The control unit 803 is connected to the first controllable object 801 via a first control connection 811. The controller 803 is connected to the second controllable object 802 via a second control connection 812. The control links 811, 812 may be wired or wireless control links. For example, the control links 811, 812 may be infrared control links. In this case, possibly existing interfaces of the controllable objects 801, 802, which are provided for controlling the controllable objects 801, 802 with a conventional remote control, may be used for the control connections 811, 812.

The block diagram off FIG. 8 further shows a position detection device 804. The position detection device 804 is connected to the control device 803 via a data connection 813. The controllable objects 801, 802, the controller 803, the pointer 800, and the position detector 804 are arranged in a real space. The position detection device 804 can detect the position and orientation of the pointer 800 in real space via a position detection 814. The position detection device 804 communicates the detected position and orientation of the pointer 800 to the control device 803 via a data connection 813. The data connection 813 may be a wired or a wireless data connection.

The control unit 803 determines on the basis of the detected position and orientation of the pointer, based on a stored in the control unit 803 linking rule between real space and figure space and an assignment rule stored in the control unit 803 for the assignment of controllable objects 801, 802 arranged in the real space to figures arranged in the figure space, which figure of the figures arranged in the figure space is cut by the selection figure assigned to the pointer 800 in the figure space. Subsequently, the control unit 803 determines the controllable object 801, 802 of the real space associated with the cut figure. If the selection figure in the figure space intersects more than one figure, the control unit 803 allows the selection of a particular figure according to a later explained method.

The controller 803 notifies the pointer 800 via the communication link 810 of which controllable object 801, 802 is associated with the selected cropped figure. The pointer 800 may communicate the selected controllable object 801, 802 to the user of the pointer 800 via, for example, a screen. If the selection character associated with the pointer 800 intersects the figure associated with the first controllable object 801, the pointer 800 notifies the user that the first controllable object 801 has been selected. The user of the pointer 800 may now enter control commands for the first controllable object 801 via controls of the pointer 800. The pointer 800 transmits the input control commands via the communication link 810 to the controller 803. The controller 803 transmits the input control commands via the first control connection 811 to the first controllable object 801. The first controllable object 801 executes the input control commands. The first controllable object 801 can also send a response to the control command to the control unit 803 via the first control connection 811. The controller 803 transmits the response over the communication link 810 to the pointer 800. The pointer 800 may represent the response of the first controllable object 801 on its screen.

In FIG. 9 the described method for controlling objects is shown again schematically with reference to a flowchart. In a first method step 900, the position and orientation of a pointer in a real space are determined. Position and orientation of the pointer in real space can be determined, for example, with a position detection device described in more detail below.

In a second method step 901, the position and orientation of a selection figure assigned to the pointer in the figure space are determined on the basis of the position and orientation of the pointer in the real space and a linking rule between real space and figure space.

In a third method step 902, those figures arranged in the figure space are determined, which are cut by the selection figure.

In a fourth method step 903, one of the figures of the figure space determined in the preceding method step 902 and cut by the selection figure is selected. The selection can be made automatically based on criteria described below or manually by a user.

In a fifth method step 904, the controllable object assigned to the figure selected in the fourth method step 903 is determined in real space. Subsequently, this object of the real space is controlled.

In FIG. 10 the relationships between real space 1001, figure space 1004, pointer 1000, selection figure 1003, object 1002 and figure 1005 are shown schematically. A real space 1001 is linked to a figure space 1004 via a linking rule 1007. The linking rule 1007 links a coordinate system of the real space 1001 with a coordinate system of the figure space 1004.

A pointer 1000 is assigned a selection figure 1003 via an assignment rule 1006. The assignment rule 1006 indicates the relationship between the position and orientation of the pointer 1000 in the real space 1001 and the position and orientation of the selection figure 1003 in the figure space 1004. The assignment rule 1006 also indicates the size and shape of the selection figure 1003.

A controllable object 1002 is assigned a figure 1005 via an assignment rule 1008. The assignment rule 1008 indicates the size and shape of the figure 1005 and its position in the figure space 1004.

The pointer 1000 and the controllable object 1002 are arranged in the real space 1001. The selection figure 1003 and the figure 1005 are arranged in the figure space 1004.

When the controllable object 1002 is to be controlled, the pointer 1000 assumes a fixed orientation 1009 with respect to the object 1002. For example, in a simple embodiment, the pointer 1000 is aligned with the object 1002. A position and orientation 1010 of the pointer 1000 in the real space 1001 are determined via a position detection device. Via a link 1011, the position and orientation 1010 of the pointer 1000 in the real space 1001 are converted into a position and orientation 1012 of the selection figure 1003 in the figure space 1004. From this, a section 1013 of the selection figure 1003 with the figure 1005 is established. Via an association 1014, the clipped figure 1005 indicates the controllable object 1002. Subsequently, the controllable object 1002 can be controlled.

The method described requires a linking rule between real space and figure space and an assignment rule between controllable objects and associated figures. A method for defining figure space, Linking and assignment rule is in FIG. 11 schematically illustrated by a flow chart.

In a first method step 1100, a mathematical linking rule, which links real space and figure space, is defined. The mathematical linking rule maps real space and figurative space to one another. The mathematical linking rule may include, for example, rotations, translations and scalings. In a simple embodiment, the mathematical connection rule real space and figure space is so identical to one another that the real space and the figure space are congruent to one another.

In a second method step 1101, the controllable objects arranged in the real space are assigned figures. The figures may have the same geometric shape as the controllable objects. The figures may also have a simplified compared to the controllable objects geometric shape. For example, the controllable objects figures can be assigned in the form of simple geometric body such as cuboid, sphere, cylinder and pyramid. The figures may have a different dimensionality than the controllable objects. For example, two-dimensional controllable objects can be assigned two-dimensional figures. The expansion of the figures in the figure space is independent of the extent of the controllable objects in real space. The figures in the figure space can be the same size as the objects in the real space. The figures can also be larger or smaller than the objects.

In a third method step 1102, the figures assigned to the objects to be controlled are arranged in the figure space. The figures can be arranged in the figure space such that an alignment of the pointer to an object located in the real space effects an alignment of the selection figure assigned to the pointer to the figure assigned to the object. The figures can also be arranged at other positions of the figure space. For example, the figures, as in Figure 7 represented, are arranged in the figure space such that an alignment of the pointer to an image of the object located in the real space causes a section between the selected figure assigned to the pointer and the figure arranged in the figure space.

FIG. 12 shows a schematic representation of a pointer 1200 for use in a method according to the invention for controlling objects. The pointer 1200 has a screen 1201. The screen 1201 may be, for example, a liquid crystal panel. The screen 1201 of the pointer 1200 may be used to display information. For example, on screen 1201, the currently selected controllable object may be specified. In the case that the selection figure assigned to the pointer 1200 intersects a plurality of figures arranged in the figure space, a list of the objects associated with the cut selection figures can be displayed on the screen 1201. This allows the user to select one of the displayed objects. The user may, for example, make his selection via controls 1202 of the pointer 1200. In another embodiment, the screen 1201 of the pointer 1200 is a touch-sensitive screen. In this case, the user of the pointer 1200 may make his selection by touching the screen 1201. The screen 1201 may also be used to display information provided by the selected controllable object. The screen 1201 of the pointer 1200 may also display any other information.

A pointer movable in a real space is assigned a selection figure in a figure space via an assignment rule. FIGS. 13 to 18 show different embodiments of the geometric shape of a selection figure.

FIG. 13 12 shows a schematic representation of a pointer 1300 and the selection figure 1301 associated with the pointer 1300. The selection figure 1301 has the form of a half-line or a ray. The selection figure 1301 extends linearly from a starting point in the figure space which depends on the position of the pointer 1300 in the real space to a spatial direction of the figure space which depends on the orientation of the pointer 1300 in real space. The selection figure 1301 may have a fixed finite length, but may be infinitely extended.

FIG. 14 schematically shows a pointer 1400 and the pointer 1400 associated selection figure 1401 in the figure space. The selection figure 1401 has the shape of a beam. The beam of the selection figure 1401 expands in the form of a plurality of rays from a starting point in the figure space in different directions of the figure space. The individual rays of the beam of the selection figure 1401 may lie within a plane arranged in the figure space. In this case, the beam of the selection figure 1401 has a fan-shaped shape. The rays of the beam of the selection figure 1401 can also show in any other spatial directions of the figure space. The rays of the beam of the selection figure 1401 may have finite or infinite length.

FIG. 15 shows a schematic representation of a pointer 1500 and a pointer 1500 assigned in the figure space selection figure 1501. The selection figure 1501 has the shape of a cone. The tip of the cone of the selection figure 1501 is at a point in the figure space. From this point, the cone of the selection figure 1501 extends finally or infinitely into a direction dependent on the orientation of the pointer 1500 in the real space in the figure space.

FIG. 16 shows a schematic representation of a pointer 1600 and a pointer 1600 in the figure space associated Selection figure, which consists of a first part 1601 and a second part 1602. The first part 1601 of the selection figure is linear. From a starting point arranged in the figure space, the first part of the selection figure 1601 expands over a defined length into a direction in the figure space which depends on the orientation of the pointer 1600 in the real space. The second part 1602 of the selection figure has a rectangular shape. The second part 1602 of the selection figure is arranged at the end of the first part 1601 such that the line-shaped first part 1601 of the selection figure is perpendicular to the rectangular second part 1602 of the selection figure. The second part 1602 of the selection figure may also have a circle or other shape. The length of the first part 1601 of the selection figure and the size of the second part 1602 of the selection figure may be fixed or adjustable by the user of the pointer 1600.

FIG. 17 11 shows a schematic representation of a pointer 1700 and a selection figure assigned to the pointer 1700, which consists of a first part 1701 and a second part 1702. The first part 1701 of the selection figure extends from the starting point arranged in the figure space over a predetermined length in a direction dependent on the orientation of the pointer. The length of the first part 1701 of the selection figure may be fixed or adjustable by the user of the pointer 1700. At the end point of the first part 1701 of the selection figure is followed by the second part 1702 of the selection figure. The second part 1702 of the selection figure has the shape of a beam. The rays of the beam of the second part 1702 of the selection figure extend straight from the end point of the first part 1701 in different directions of the figure space. The rays of the beam of the second part 1702 of the selection figure can lie in a common plane in the figure space.

FIG. 18 shows a schematic representation of a pointer 1800 and the pointer 1800 in the figure space associated Selection figure, which consists of a first part 1801 and a second 1802. The first part 1801 and the second part 1802 have the shape in opposite spatial directions of the figure space pointing half-line. The first part 1801 of the selection figure runs from a starting point in the figure space which depends on the position of the pointer 1800 in the real space, in particular in a spatial direction of the figure space which depends on the orientation of the pointer 1800 in the real space. The second part 1802 of the selection figure runs from the same starting point as the first part 1801 of the selection figure, but expands in the opposite spatial direction of the figure space. The first part 1801 and the second part 1802 of the selection figure may have a finite or infinite length.

A picker associated with a pointer may also have other geometric shapes. For example, the selection figure may be configured in the form of a cone, a cylinder, a pyramid, a cuboid, a tetrahedron, a prism, a straight line, a fan-shaped straight line bundle or another geometric shape.

The form of a pointer assigned to a selection figure can be fixed. In another embodiment, the shape of the pointer associated with the selection figure is adjustable by the user of the pointer. In a further embodiment, the shape of the selection figure assigned to the pointer is automatically selected on the basis of predetermined criteria. The selection of the shape of the selection figure can be done, for example, depending on a speed with which the pointer is moved in real space. The shape of the selection figure can also be made depending on the figures cut by the selection figure. For example, in the case that the selection figure intersects a plurality of figures arranged in the figure space, the selection figure can be downsized. The reduction may, for example, the second part 1602 of in FIG. 16 displayed selection figure or the opening angle of in FIG. 15 shown conical selection figure 1501. The shape of the selection figure may also change depending on the distance of a figure cut by the selection figure from the starting point of the selection figure.

A pointer may also have more than one selection figure associated with it. The assigned selection figures can be oriented differently in the figure space. The multiple selection figures may have different properties. For example, it can be provided that one of the selection figures only cuts figures of a defined type.

FIG. 19 shows a schematic representation of a pointer 1900 with a screen 1901 and controls 1902. In real space arranged controllable objects 1904, 1906, 1908 Figures 1905, 1907, 1909 are assigned in the figure space. The selection figure 1903 in the figure space associated with the pointer 1900 intersects all three figures 1905, 1907, 1909 shown. Therefore, further information is required to determine which of the controllable objects 1904, 1906, 1908 the user of the pointer 1900 wishes to control.

In one embodiment, pointer 1900 displays on screen 1901 a list of controllable objects 1904, 1906, 1908 or associated figures 1905, 1907, 1909. The user may now select one of the controllable objects 1904, 1906, 1908 indicated in the list and control. Alternatively, the user of the pointer 1900 may select and jointly control a plurality of the controllable objects 1904, 1906, 1908 listed in the list. For example, if the controllable objects 1904, 1906, 1908 are controllable brightness lamps, the user of the pointer 1900 may simultaneously change the brightness of all selected controllable lamps.

In another embodiment, the selection of one of the objects 1904, 1906, 1909 assigned to the figures 1905, 1907, 1909 cut by the selection figure 1903 is carried out automatically. For example, the object 1904 whose associated figure 1905 is closest to the starting point of the selection figure 1903 can be automatically selected. Alternatively, the object 1908 may be selected whose associated figure 1909 is furthest from the starting point of the selection figure 1903. In another embodiment, the object 1904, 1906, 1908 that has been most frequently controlled in the past may be selected. In another embodiment, the object 1904, 1906, 1908 that was last controlled in the past may be automatically selected. In a further embodiment, that object 1904, 1906, 1908 can be selected automatically, whose associated figure has the largest cutting volume with the selection figure.

To facilitate the selection of a desired controllable object for the user of a pointer, properties of a selection figure associated with the pointer may be automatically or manually varied by the user of the pointer. It is also possible to vary properties of figures assigned to the controllable objects automatically or manually by the user of the pointer.

FIG. 20 shows a schematic representation of a pointer 2000 and a pointer associated with the selection figure with a first part 2002 and a second part 2003. The two-part selection figure 2002, 2003 corresponds to the two-part selection figure 1601, 1602 of FIG. 16 with a line-shaped first part 2002 and a rectangular second part 2003. The size of the rectangular second part 2003 of the selection figure can be changed depending on various parameters. For example, the size of the second part 2003 of the selection figure can be changed automatically in dependence on a speed 2001 with which the pointer 2000 is moved through the real space. If the pointer 2000 is moved through the real space at a high speed 2001, the size of the second part 2003 of the select character is increased. If When the pointer 2000 is moved through the real space at a low speed 2001, the size of the second part 2003 of the selection figure is reduced. The change in size of the second part 2003 of the selection figure can also be reversed. The size of the second part 2003 of the selection figure can also be varied automatically depending on environmental parameters such as brightness, temperature, air pressure, time, etc. The size of the second part 2003 of the selection figure can also be varied manually by the user of the pointer 2000. It can also properties of other forms of selection figures, such as the selection figures of FIGS. 13 to 18 , be varied.

FIG. 21 2 shows a schematic representation of a selection figure 2100 arranged in a figure space. The selection figure 2100 cuts a figure 2101 arranged in the figure space. Subsequently, the figure 2101 is automatically enlarged to a new figure 2102. The enlarged figure 2102 is assigned to the same controllable object in the real space as the original figure 2101. While the figure 2101 is enlarged to the figure 2102, other figures 2103, 2104 arranged in the figure space and not cut by the selection figure are reduced in size. The enlargement of the figure 2101 cut from the selection figure 2100 to the enlarged figure 2102 and the reduction of the figures 2103, 2104 not being selected by the selection figure 2100, the user of a pointer 2100 assigned to the pointer, the control of the controllable object 2101 associated controllable object is facilitated. The enlarged figure 2102 is cut from the selection figure 2100 even if the user easily moves the pointer associated with the selection figure 2100. As a result, the control of the object associated with FIG. 2102 remains possible even when the pointer is moved slightly.

The enlargement of Figure 2101 to Figure 2102 and the reduction of Figures 2103, 2104 may continue for a predetermined time. The enlargement of Figure 2101 to FIG 2102 and the reduction of the figures 2103, 2104 can be undone, for example, if the user has completed the control of the object associated with FIG. 2101. Alternatively, the enlargement and reduction of the figures may be reversed after a predetermined period of time.

In another embodiment, the control of a selected controllable object may be facilitated by leaving a selected controllable object selected until the user of a pointer deselects the controllable object. In this embodiment, once a controllable object has been selected, the pointer no longer has to remain aligned so that the selection character associated with the pointer further cuts the figure associated with the controllable object.

In a further embodiment, a figure cut by a selection figure can be rotated for ease of handling so that a largest surface of the figure faces the starting point of the selection figure. The rotation of the figure may be reversed upon completion of the control of an object associated with the figure or after a predetermined period of time.

In a further embodiment, position, orientation and size in a figure space arranged figures can change time-dependent or automatically depending on environmental parameters such as ambient temperature, brightness or air pressure. For example, a figure associated with a lamp may be automatically enlarged in the dark.

In another embodiment, figures of the figure space may be temporarily removed from the figure space to facilitate control of objects whose associated figures are located behind the figures to be removed. The Removal of the figures from the figure space can be done automatically or manually by a user of a pointer.

In a further embodiment, a controllable object is controlled in dependence on how a figure assigned to the object is cut by a selection figure assigned to a pointer. For example, a set value of the object may be automatically increased when the figure is cut in a first direction. The set value of the object can be automatically reduced when the figure is cut in a second direction. Alternatively, the type of cut can also influence which settings of the controllable object can be changed.

FIGS. 22 and 23 show by way of example two possibilities for the recognition of the position and orientation of a pointer in a real space, as described by the in FIG. 8 shown position detection device 804 is performed.

In FIG. 22 schematically a pointer 2200 is shown. The pointer 2200 has a plurality of transmitters 2201. The transmitters 2201 may be, for example, radio wave transmitters or ultrasonic transmitters. The real space surrounding the pointer 2200 is equipped with a plurality of receivers 2202. The receivers 2202 are configured to detect the signal emitted by the transmitters 2201. The receiver 2202 mounted at different positions of the real space and the transmitter 2201 mounted at different positions of the pointer 2200 allow determination of the position and orientation of the pointer 2200 in real space. The determination of the position and orientation of the pointer 2200 may be effected, for example, by an analysis of the transit time of the signals emitted by the transmitters 2201 and by triangulation.

In FIG. 23 an alternative embodiment of a position detection system is shown schematically. A pointer 2300 is equipped with both a transmitter 2301 and a receiver 2302. In the real space surrounding the pointer 2300, position detecting devices 2303 are mounted, which have both a transmitter 2304 and a receiver 2305. In this embodiment, since signals are both sent from the pointer 2300 to the position detectors 2303 and from the position detectors 2303 to the pointer 2300, the accuracy in detecting the position and orientation of the pointer 2300 in real space increases.

In other embodiments, position and orientation of a pointer movable in real space are detected and evaluated by a plurality of cameras arranged in real space.

In another embodiment, the position and orientation of a pointer relative to a known starting position and orientation of the pointer is detected. For this purpose, the pointer has a fixed, known position and orientation at a start time. From this starting time from movements of the pointer are detected and calculated from the detected movements, the new position and orientation of the pointer. The movements of the pointer can be determined, for example, by means of acceleration and yaw rate sensors integrated in the pointer.

In another embodiment, the pointer has a fixed position in the real space. This case is in FIG. 24 shown schematically. A pointer 2400 is stationarily arranged in a real space. The pointer 2400 in this example has the form of a screen. The pointer 2400 is rotatable about a vertical axis 2402 and about a horizontal axis 2403. The intersection of the vertical axis 2402 and the horizontal axis 2403 lies within the pointer 2400 and always remains in the same location of the real space. A selection figure 2401 associated with the pointer 2400 in one with the real space linked figure space has a fixed starting point. From this starting point, the selection figure 2401 extends in a direction dependent on the orientation of the pointer 2400 direction in the figure space. A rotation of the pointer 2400 about the vertical axis 2402 or the horizontal axis 2403 changes the orientation of the selection figure 2401 in the figure space.

In a further embodiment of the invention, an always stationary selection figure is provided in a figure space. In this embodiment, the stationary selection figure can be activated or deactivated by a user, for example by means of a button. In another embodiment, the stationary selection figure is automatically activated or deactivated in dependence on defined parameters such as an operating temperature of a controllable object or the time of day.

A controllable object selected by means of a pointer can also be controlled by movements of the pointer. This is schematically in FIG. 25 shown. FIG. 25 shows a pointer 2500 and a controllable object 2501 in a real space. When the pointer 2500 is oriented such that a line of sight 2502 perpendicular to a surface of the pointer 2500 intersects the controllable object 2501, a selection figure associated with the pointer 2500 intersects a figure associated with the controllable object 2501 in a figure space associated with the real space; the controllable object 2501 is selected for control. If the pointer 2500 is now rotated or moved in fixed directions, control commands dependent on the direction of rotation or movement are sent to the selected controllable object 2501. The controllable object 2501 may be, for example, a television. When the pointer 2500 is rotated so that a line of sight 2503 perpendicular to a surface of the pointer 2500 sweeps the television towards the right outer edge of the television, the program displayed by the television becomes a program slot switched further. In this way, for example, the volume of the TV can be changed.

If a figure arranged in a figure space a plurality of arranged in a real space controllable objects are assigned, so the multiple controllable objects of the real space can be controlled simultaneously. FIG. 4 shows, for example, arranged in a figure space figure 403, the three controllable objects 400, 401, 402 are assigned in a real space. If the figure 403 is cut by a selection figure assigned to a pointer, then all three objects 400, 401, 402 are selected. Control commands transmitted by a user by means of a pointer are transmitted to all three controllable objects 400, 401, 402.

If a plurality of figures arranged in a figure space is combined to form a larger figure, the selection of an associated controllable object can take place in one or two stages. In FIG. 5 the controllable objects 500, 502, 504 are associated with figures 501, 503, 505. FIGS. 501, 503, 505 are combined to form a larger figure 506. If a selection figure cuts the figure 506 from a greater distance, the controllable objects 500, 502, 504 on a screen of the pointer are offered for selection to the user of a pointer assigned to the selection figure. If the selection figure in the figure space intersects the figure 506 and exactly one of the figures 501, 503, 505 arranged within the figure 506, then the controllable object 500, 502, 504 assigned to the cut figure 501, 503, 505 is selected directly for control.

In FIG. 2 For example, a figure 202 is arranged in a figure space 200 that is not associated with any controllable object in a real space. Instead, the figure 202 represents a set of set values for one or more controllable objects associated with other figures of the figure space. If the figure 202 cut by a selection figure, so they are set other controllable objects to the set values represented by FIG. For example, Figure 202 may represent a combination of set values for a brightness of a lamp, a temperature of an air conditioner, and an opening state of a blind. To facilitate intersecting the figure 202 with a selection figure, the figure 202 may be arranged in the figure space such that a pointer associated with the selection figure must be real-space aligned with an uncontrollable object, such as a houseplant, so that the selection figure associated with the pointer the figure 202 intersects.

The figures assigned to the controllable objects can be positioned in a figure space without overlapping or without overlapping. An overlap-free positioning has the advantage that a clear selection of a controllable object associated with the figures is simplified.

In a further embodiment, a pointer in a real space emits a light beam, for example a laser beam. The light beam runs in the real space in a direction which corresponds to the orientation of a selection figure assigned to the pointer in a figure space linked to the real space. This can facilitate the handling of the pointer. If the pointer is aligned in the real space on a controllable object, the light beam strikes the controllable object and can be perceived as a light spot. This is particularly helpful if a figure associated with the controllable object is arranged in the figure space such that it is cut by the selection figure when the pointer is aligned with the controllable object.

In a further embodiment, a pair of spectacles may be provided on the transparent spectacle lenses of which an image of a figure space linked to a real space can be projected. If the wearer of the glasses is looking at the real space, the image of the real space is superimposed on a computer-generated image of the linked figure space with figures arranged therein. The glasses are equipped for this purpose with devices for detecting the position and orientation of the glasses in real space. Depending on the position and viewing direction of the spectacle wearer, a suitable image of the figure space is generated and projected onto the spectacle lenses. The glasses thus allow their wearer to control the positions and orientations of the figures in the figure space.

In a further embodiment, a screen arranged in a real space linked to the figure space is used to visualize a figure space. The screen shows an optionally reduced projection of the figure space from the perspective of an observer arranged at a fixed position in the figure space. The observer may, for example, be located at a position of the figure space which corresponds to a position in the real space that is in front of the screen according to the linking rule between figure space and real space. A user of the pointer located in real space can be assigned a user figure in the figure space. In this case, the user holding the pointer and looking at the screen sees the user figure assigned to him with a selection figure assigned to the pointer in a rear view in the figure space. If the user moves the pointer in real space, the user figure displayed on the screen carries out a corresponding movement with the selection figure. In order to select a controllable object, in this embodiment the user can orient the pointer in real space so that the selection figure assigned to the pointer intersects a figure in the figure space.

In another embodiment, a screen 2602 depicts an illustration of a figure space 2603 having figures 2604 disposed therein. The representation on the screen 2602 is selected so that a viewer of the screen 2602 is under the impression that the figure space 2603 is behind the screen 2602. The screen 2602 may depict the complete figure space 2603 including all the figures 2604 therein. However, only a section of the figure space 2603 can be visible. The section can be enlarged, reduced and moved by a viewer of the screen 2602.

The figures 2604 arranged in the figure space 2603 are assigned to controllable objects which may be located at any location other than the screen 2602. For example, the screen 2602 may be located in an office building, while the controllable objects associated with the figures 2604 may be machines located in a remote factory floor.

The viewer of the screen 2602 may select different figure spaces. For example, the viewer of the screen 2602 may switch between figure spaces associated with different factory floors.

The real space associated with the figure space 2603 in this embodiment comprises both the real space in which the controllable objects are arranged, for example the factory floor, and the real space in which the screen 2602 is arranged, for example the office building. In this embodiment, the figures 2604 assigned to the controllable objects are not located at the positions of the figure space 2603, which correspond to the positions of the controllable devices in the real space according to the linking rule between the real space and the linked figure space 2603. Rather, the figures 2604 are arranged at positions of the figure space 2603, which lie behind the screen 2602 in the linked real space.

In order to control an object associated with a depicted figure 2604, for example a machine in the factory floor, the viewer of the screen directs a pointer in real space 2600 so that a perpendicular to a surface of the pointer 2600 standing line of sight 2601 points in a direction behind the screen 2602. The viewer thus aligns the pointer 2600 with an image of a figure 2604 shown on the screen 2602. Then, a selection figure associated with the pointer 2600 intersects the figure 2604 in the figure space 2603, and the controllable object associated with the figure 2604 is selected for control.

The screen 2602 may also represent only a portion of the figure space 2603. Then, the viewer of the screen 2602 can also align the pointer 2600 in the direction of a figure, not shown, whose position he can estimate using the figures 2604 shown on the screen 2602.

By suitable choice of a real space associated with a figure space linking rule, appropriate choice of assignment rules between arranged in real space controllable objects and figures arranged in the figures room and appropriate choice of a mapping rule between located in the real space pointer and figure space befindlicher selection figure, further embodiments of the invention will become apparent Wise.

A pointer can also be used to move figures arranged in a figure space. This can, for example, following the above with reference to FIG. 11 described method for defining the figure space can be used to change the arrangement of the figures in the figure space.

In one embodiment, a selection figure assigned to the pointer has a fixed and finite extent in the figure space. In a shift mode in real space from a position where the selection figure associated with the pointer does not intersect any figure in the figure space, the pointer is moved to a position in real space where the pointer associated with the pointer Selection figure just cuts a figure in the figure space, it follows in a further movement of the pointer in real space, the cut figure of the movement of the selection figure in the figure space. For the user of the pointer gives the impression to move the figures in the figure room with a pointer assigned to the floor. The figure may follow the selection figure until the displaced figure is deselected by the user of the pointer.

The displacement of the figure in the figure space can follow any paths in the figure space or run along predetermined paths in the figure space.

When the selection figure approaches the figure to be moved in the figure space, an imaginary impulse can also be transmitted from the selection figure to the figure, as would be the case with a shot of two billiard balls. The magnitude of this imaginary pulse depends on the speed at which the pointer is moved through the real space, and the picker associated with the pointer is moved through the figure space. The initiated figure is set in motion by the momentum transfer in the figure space. The movement can be damped, so that the initiated figure travels a dependent on the size of the transmitted pulse distance in the figure space and then comes to rest. This makes it possible to shoot a figure in the figure space from one position to another. In connection with the above-described visualizations of the figure space with a pair of glasses or a screen, this can be used for games.

A pointer can also be used to set points in a real space. If, for example, a figure in the figure space associated with the real space is associated with a wall of the real space, and if the pointer is aligned with a point on the wall, then a selection figure assigned to the pointer cuts a point of the figure assigned to the wall in the figure space. This point of the figure is in turn according to the assignment and linking rule the point of the wall to which the user has aligned the pointer. The coordinates of this point can be stored by the user of the pointer.

If the user of the pointer has stored a number of points of the wall in this way, he can, for example, display the size of the area enclosed by the points, the distance between two points or the distance of a point from the pointer on the screen of the pointer. In this way, the user of the pointer can also determine a volume enclosed by fixed volumes.

If the user-defined points are located on a floor of the real space, the user of the pointer can define a path based on the specified points. This path can be used by the user of the pointer to control controllable objects. For example, the user can pass the specified path to a controllable vacuum cleaner. The vacuum cleaner then automatically follows the specified path.

As described above, one or more stationary selection figures can also be provided in the figure space. If a figure is moved in the figure space in such a way that it is cut by a stationary selection figure, this can produce definite reactions. For example, the controllable object associated with the figure can be switched on as soon as the figure is cut by the stationary selection figure.

A first figure can be moved in the figure space such that it comes into contact with or intersects with a second figure in the figure space. Again, this can cause a fixed reaction. For example, settings of the controllable object associated with the first figure can be transmitted to the controllable object associated with the second figure. If a figure associated with a first lamp is in Contact with a figure associated with a second lamp brought, the second lamp is set to the same brightness as the first lamp.

In the pointer further functions can be integrated. For example, the pointer can additionally serve as a mobile phone, navigation device, Internet client, three-dimensional computer mouse or as a display device for information of all kinds.

Claims (15)

1. A method for controlling objects,
   wherein a real space is linked to a multi-dimensional representational space by an alterable transformation rule
   and wherein representations in the representational space are associated with the objects to be controlled by an alterable mapping,
   wherein for controlling the objects arranged in the real space, the following steps are carried out:

   - detecting the position and orientation of a pointer in the real space;

   - determining the position and orientation of a pointer representation associated with the pointer in the representational space by means of the position and orientation of the pointer in the real space and by means of the transformation rule between real space and representational space;

   - determining the representations in the representational space which are intersected by the pointer representation;

   - selecting a representation which is intersected by the pointer representation, and

   - controlling the object in the real space which is associated with the pointer representation in the representational space;

   characterized in that
   a setting representation is arranged in the representational space,
   wherein one or multiple setting values of one or multiple objects are associated with the setting representation,
   wherein the following steps are carried out in order to set the one or multiple objects to the one or multiple setting values:

   - detecting the position and orientation of the pointer in the real space;

   - determining the position and orientation of the pointer representation associated with the pointer in the representational space by means of the position and orientation of the pointer in the real space and the transformation rule between real space and representational space; and

   - selecting the setting representation and transmitting the one or multiple setting values to the one or multiple objects if the setting representation is intersected by the pointer representation.
2. The method according to claim 1, wherein for defining the representational space the following steps are carried out:

   - defining a mathematical transformation rule between representational space and real space;

   - associating representations to the objects to be controlled;

   - positioning the representations in the representational space.
3. The method according to claim 2, wherein the position and size of the representational space and the representations associated with the objects to be controlled are automatically determined according to the position and size of recorded objects to be controlled.
4. The method according to any one of the preceding claims, wherein the representational space is a two- or three-dimensional representational space and the representations are two- or three-dimensional representations.
5. The method according to any one of the preceding claims, wherein from a plurality of representations intersected by the pointer representation, the one representation is automatically selected which has been selected most frequently in the past.
6. The method according to any one of the preceding claims, wherein a pointer representation is enlarged temporarily.
7. The method according to any one of the preceding claims, wherein the following further process steps may be carried out:

   - associating one or multiple setting values of one or multiple objects to a settings representation;

   - positioning the settings representation in the representational space.
8. The method according to any one of the preceding claims, wherein the pointer representation comprises the shape of a cone, a cylinder, a pyramid, a cuboid, a tetrahedron, a prism, a straight line or a fan-shaped line bundle or another geometric shape.
9. The method according to any one of the preceding claims, wherein the shape of the pointer representation may change depending on time-dependant parameters.
10. The method according to any one of the preceding claims, wherein the pointer emits a light beam into a predetermined direction, wherein the predetermined direction in the real space corresponds to the orientation of the pointer representation in the representational space.
11. The method according to any one of the preceding claims, wherein controlling the selected object is carried out by conducting predetermined motions with the pointer.
12. The method according to any one of the preceding claims, wherein controlling the selected object is carried out depending on the manner in which the representation associated with the object is intersected by the pointer representation.
13. The method according to any one of the preceding claims, wherein the pointer comprises a predetermined position and/or orientation in the real space.
14. The method according to any one of the preceding claims, wherein the pointer representation comprises a predetermined position and/or orientation in the representational space.
15. The method according to any one of the preceding claims, wherein a visualization device is provided for depicting the representational space.

Images