FR3112628A1 - Computer pointing device - Google Patents

Abstract

Embodiments of the invention provide a computer pointing device for controlling graphical elements. Advantageously, the computer pointing device (100) for controlling graphic elements comprises at least two touch screens (101, 102), each of the touch screens (101, 102) being able to instantly detect the position of at least one touch , the pointing device comprises an electronic calculation device (110) configured so as to determine, during a time window where, simultaneously, a first press is made on the first touch screen (101) and a second press is made on the second touchpad (102), a first gesture performed by all of the two presses during the time window, the first gesture being representative of a first command of a graphic element. Figure for the abstract: Fig. 2

Description

Computer pointing device

Prior art

The present invention relates generally to human-computer interaction systems and in particular to a computer pointing device.

The present invention applies in particular to interactive computer systems equipped with a display screen on which graphic elements can be displayed and manipulated. In this case, a computer pointing device can be used to facilitate manipulation of the state of each of the graphical elements displayed. A computer pointing device generally makes it possible to provide two distinct functions: a first function indicating the position, on the two dimensions of the display screen, of the place where the user wishes to act, and a second function indicating the how the user wants to act. For example, the first function makes it possible to select a graphic element displayed on the display screen, and the second function makes it possible to act on the selected graphic element by modifying its state.

In conventional computer systems, generally fixed and bulky, such as the computer, it is known to use a mouse or a trackball as a computer pointing device. Computer mice are equipped with a tracking unit, mechanical or optical, to track the movement of the mouse. Such a mouse movement is received by the computer before being interpreted as a movement of a pointer, also called a cursor, on a display screen. Buttons are generally incorporated into the computer mouse and allow you to act on graphic elements according to the button(s) pressed. The use of a computer mouse, however, requires a homogeneous and flat support so that the mouse glides easily and regularly. The area required for such a stand is usually several times that of the computer mouse and depends on the resolution of the display screen. Such characteristics of the mat support are nevertheless incompatible with current computer systems that are generally small and mobile in size.

In addition, the use of computer systems has experienced a major spring in recent years in various technical fields such as air transport. In such a technical field, the use of a computer system makes it possible to simplify the piloting actions of an aircraft by proposing a visualization on a set of display screens of numerous functionalities in the form of graphic elements, known as the English term "widgets", and the possibility of interacting with the various functionalities by means of a pointing device. This pointing device allows you to select functions, but not to modify parameters. To do this, it is mandatory to act on graphic objects of the scrolling bar type, or physical rotators. The disturbances to which such an environment can be subjected, the constrained size and the high level of security required by handling such graphic elements exclude the use of a conventional computer mouse as a pointing device.

It is known to jointly use a pointing device whose role is limited to the function of moving a pointer on a display screen and therefore of being able to select a displayed graphic element, in association with one or more physical action objects. such as push buttons in order to act on the state of the selected graphic element. Current pointing devices implemented in an aircraft cockpit (cockpit) use a ball, whose rotation along two orthogonal axes is analyzed by sensors. Other systems instead use a touch screen which, in this case, delivers a set of coordinates corresponding to the position of the operator's finger. The touch screen is generally of the "one-touch" type in the sense that it is able to detect a single press at a given moment. In general, the multitude of graphical elements likely to be displayed requires a considerable number of physical objects to manipulate. Such an architecture is difficult to implement due to the large number of elements (touch tiles, physical action objects, etc.) to be implemented.

It is also known to use a touch screen of the “multi-touch” type in order to provide a compact pointing device capable of selecting and interacting with a graphical element displayed by interpreting gestures with several fingers. This solution nevertheless has several disadvantages related to the high cost and the complexity of setting up such a type of touch screen. In addition, "multi-touch" touch screens have higher latency and lower sensitivity, especially when handled through gloves, compared to a "single-touch" touch screen. Such characteristics are hardly compatible with demanding applications in terms of latency such as in the field of aviation.

There is therefore a need for a computer pointing device that does not have the disadvantages of the state of the art.

General definition of invention

The invention improves the situation by proposing a computer pointing device for controlling graphic elements, comprising at least two touch screens, each of the touch screens being capable of instantaneously detecting the position of at least one press, the pointing device comprises an electronic calculation device configured so as to determine, during a time window in which, simultaneously, a first press is made on the first touch screen and a second press is made on the second touch screen, a first gesture performed by the assembly of the two presses during the time window, the first gesture being representative of a first command of a graphic element.

In one embodiment, the computer pointing device may comprise at least a third touch screen, the electronic device being configured so as to determine, during a time window where, simultaneously, a first press is made on the first touch screen and a second press is performed on the third touch screen, a second gesture performed by all of the two presses during the time window, the second gesture being representative of a second command of a graphic element, the second command being of a different nature from the first order.

In another embodiment, the touch screens can be "single-touch", each of the touch screens being capable of detecting the position of a single press at a given moment.

Advantageously, at least two touch screens can be distinguished from each other.

Alternatively, at least two touch screens can be tilted relative to each other.

In one embodiment, at least two touch screens can be of different colors.

In another embodiment, at least two touch screens can be separated by a separation surface with a width greater than 1 millimeter.

Advantageously, different textures can cover the touch screens, so as to cause different haptic sensations depending on the touch screen.

Alternatively, at least two adjacent touch screens may have a common edge.

In one embodiment, the touch screens can be of the same type.

Advantageously, the touch screens can be of the intrinsic capacitive touch screen type.

As a variant, at least two touch screens can be of different types.

In another embodiment, at least one of the touch screens may be curved.

• un dispositif d’affichage apte à afficher sur un ou plusieurs écrans d’affichage une pluralité d’éléments graphiques, et
• un dispositif de pointage configuré pour interagir avec les éléments graphiques.

There is also provided an interactive display system which may include:

• a display device capable of displaying on one or more display screens a plurality of graphic elements, and
• a pointing device configured to interact with the graphical elements.

Brief description of figures

Other characteristics and advantages of the invention will become apparent with the aid of the description which follows and of the figures in which:

represents a computer pointing device comprising two touch screens according to a first embodiment of the invention;

represents the operation of a computer pointing device according to the invention;

represents a computer pointing device comprising three touch screens according to a second embodiment of the invention;

represents a computer pointing device according to another embodiment of the invention;

represents a computer pointing device comprising inclined touch screens according to another embodiment of the invention;

shows a computer pointing device comprising curved touch screens according to another embodiment of the invention; And

shows an interactive display system according to one embodiment of the invention.

detailed description

There represents a computer pointing device 100 according to a first embodiment of the invention. The computer pointing device 100 comprises a first touch screen 101 and a second touch screen 102 arranged side by side so as to be manipulated by two fingers with one hand, for example the thumb and the thumb. index. Each of the touch screens 101, 102 can advantageously comprise a touch surface 1011, 1021, edges 1012, 1022 and a processing unit 1013, 1023 configured to execute at least one press detection algorithm. Pressing on a touch screen 101, 102 refers to pressing on an associated touch surface 1011, 1021.

Each of the touch screens 101, 102 can be "single-touch" in the sense that a single press exerted on its touch surface 1011, 1021 can be instantly detected by the corresponding processing unit 1013, 1023 by determining the coordinates of the approximate position of the support in a previously defined measurement mark. “Single-touch” operation of a touch screen 101, 102 can be obtained by associating a “single-touch” or “multi-touch” touch surface 1011, 1021 with a processing unit 1013, 1023 executing an algorithm “single-touch” press detection, such an algorithm being capable of detecting at most a single press exerted on the touch surface, “single-touch” or “multi-touch”, associated, at a given moment. Alternatively, the "single-touch" operation of a touch screen 101, 102 can also be ensured by a "multi-touch" touch surface 1011, 1021 associated with a processing unit 1013, 1023 executing a press detection algorithm "multi-touch", such an algorithm being capable of detecting several presses exerted simultaneously on the associated "multi-touch" touch surface, at a given instant. Advantageously, the processing units 1013, 1023 implemented can be configured to raise an error message in the event of detection of several presses made simultaneously on the associated touch surface 1011, 1021.

There illustrates the use of the two touch screens 101, 102 by representing the hand of an operator (H) acting both on their touch surface 1011, 1021 by means of his thumb and his index finger. The concentric circles shown on the symbolize the supports exerted.

A measurement mark can have as its origin the center of the tactile surface 1011, 1021 and can be provided with a base formed by two orthogonal unit vectors. The Cartesian coordinate system can be used to define the coordinates of the position of the touch on the touch surface 1011, 1021. For a touch surface 1011, 1021 of circular shape, the cylindrical coordinate system can be used to define the coordinates of the position of the support.

The two touch screens 101, 102 can be arranged next to each other on the same plane while being separated from each other. Alternatively, the two touch screens 101, 102 may have a common edge 1012. The two touch screens 101, 102 may, moreover, have the same geometric shape which may be bidirectional (2D) flat, and their geometries may be substantially identical. The spacing between the two touch surfaces 1011, 1021 can be optimized so as to allow use by two fingers with one hand.

The computer pointing device 100 further comprises an electronic calculation device 110 connected to the two touch screens 101, 102 implemented in order to determine and interpret the presses exerted on the two touch screens 101, 102. For each press exerted on one of the touch screens 101, 102, the electronic calculation device 110 can be configured to determine geometric parameters such as the position of the press, and temporal parameters such as the moment of the start of the press and the duration of support.

Advantageously, the electronic calculation device 110 can determine a first press made on the first touch screen 101 and a second press made on the second touch screen 102. The two presses can be made simultaneously or successively during a predefined time window. . The set of two presses made on the two touch screens 101, 102 can be interpreted by the electronic computing device 110 as being a first gesture and can be representative of a first command of a graphic element. Examples of graphical elements include, but are not limited to, push buttons, check boxes, scroll bars, toolbars, etc. For a box to be checked, for example, a command determined by the electronic computing device 110 can consist of checking or unchecking the box considered.

The electronic calculation device 110 can also be configured to determine a first slip performed on the first touchpad 101 and a second slip performed on the second touchpad 102 during a predefined time window. From an experimental point of view, a slip can be likened to a succession of presses exerted continuously over time on a touchpad 101, 102. Each of the two slips can be described by a set of slip parameters comprising parameters time such as the sliding start time and the sliding duration, and geometric parameters such as the sliding direction. The first sliding and the second sliding can be carried out simultaneously according to the same sliding start time and the same sliding duration. Alternatively, the first slip and the second slip can be performed successively at two different slip start instants. Depending on the slip parameters characterizing each of the two slips performed, the electronic computing device 110 can be configured to interpret the two slips as being a gesture representing a second command of a graphic element. For example, the action of two simultaneous slides made on the two touch screens can be interpreted as being a gesture representative of a command to zoom in or to zoom out one or more graphic elements depending on whether the fingers making the slides come closer together or drift away over time.

The electronic calculation device 110 can also be configured to determine a press performed on the first touchpad 101 and a sliding performed on the second touchpad 102, or vice versa, during a predefined time window. The support can be carried out before, after or during the duration during which the sliding was carried out. The electronic calculation device 110 can be configured to interpret the sliding and the pressing as being a gesture representative of another command of a graphic element.

The use of two “single-touch” touch screens 101, 102 therefore makes it possible to carry out a multitude of commands of graphic elements which are not possible by means of a single “single-touch” touch screen. Such a multitude of graphical element commands can however be achieved with other pointing devices known to those skilled in the art, in particular "multi-touch" touch screens, which are more complex to implement than the combination of several “single-touch” touch screens according to the embodiments of the invention.

There represents a computer pointing device 100 according to a second embodiment of the invention, the constituent elements of the touch screens, such as the touch surfaces, the edges and the processing units, not being represented. The computer pointing device 100 comprises three "single-touch" touch screens 101, 102, 103 arranged side by side in the same plane so that they can be manipulated simultaneously by the fingers of one hand of a operator (H). The computer pointing device 100 further comprises an electronic calculation device 110 which can be configured according to the first embodiment described above to determine, during a first time window or simultaneously, a first press made on the first touch screen 101 and a second press performed on the second touchpad 102. As described above, the first gesture performed by all of the two presses during the first time window is representative of a first command for a graphic element.

The electronic computing device 110 can also be configured to determine, during a second time window or simultaneously, a first press made on the first touch screen 101 and a second press made on the third touch screen 103. A second gesture performed by all of the two presses during the second time window is representative of a second command of a graphic element. The second command can be different from the first command. For example, the first command may be to check a checkbox and the second command may be to uncheck it.

According to one embodiment of the invention, the touch surfaces 1011, 1021 equipping each of the "one-touch" touch screens 101, 102 implemented in the computer pointing device 100 are of the same type.

Advantageously, the touch surfaces 1011, 1021 can be of the intrinsic capacitive type. In this case, a grid of conductive metal electrodes covers each of the touch surfaces 1011, 1021 so that each horizontal electrode is electrically connected to all of the vertical electrodes. Each of the metal electrodes is subjected to a difference in electric potential, thus generating electric field lines, and presenting an electric capacity measurable by means of a dedicated sensor. The detection of a press on an intrinsic capacitive type touch surface is based on the interaction between the initially generated electric field lines and those of an electrically conductive object, such as a finger of an operator's hand ( H), in contact with the touch surface. This increases the electrical capacitance of the electrodes located near the place of contact with the electrically conductive object. By measuring the electrical capacities of all metal electrodes, vertical and horizontal, the position of the support is determined by the combination of the position of the sensors whose electrical capacity increases. The position of a support corresponds to the intersection of the vertical electrode and the horizontal electrode which present an electrical signal different from that of the other electrodes. In comparison with a "multi-touch" mutual capacitive touch surface where the horizontal metal electrodes are separated from the vertical metal electrodes and the calculation of the electrical capacities is carried out for all the intersections between metal electrodes, the intrinsic capacitive touch surfaces have the advantages of reduced complexity and reduced latency especially for a high number of metallic electrodes. Intrinsic capacitive touch surfaces need to be manipulated directly with a finger or using an electrically conductive glove.

According to another embodiment, the “single-touch” touch surfaces 1011, 1021 can be of the analog resistive type by being composed of two parallel metal layers subjected to low electrical voltages and separated by a thin insulating layer. The pressure exerted by pressing on the upper metal layer leads to its deformation and creates electrical contact between the two metal layers. Such electrical contact can be located by analyzing the resistivities of the two metal layers.

Alternatively, the type of “single-touch” tactile surfaces 1011, 1021 implemented can be chosen from the elements of the non-exhaustive list comprising acoustic surfaces, optical surfaces, infrared technology surfaces and induction technology surfaces.

According to another embodiment of the invention, the computer pointing device 100 can comprise at least two touch surfaces 1011, 1021 “one-touch” of different types. For example, a first touch surface 1011 fitted to a first touch screen 101 can be chosen of the intrinsic capacitive type and a second touch surface 1021 fitted to a second touch screen 102 can be chosen of the analog resistive type.

According to one embodiment of the invention, “one-touch” touch surfaces equipping touch screens implemented in the computer pointing device 100 can have different two-dimensional (2D) geometric shapes. For example, one of the touch surfaces can be rectangular in shape and another touch surface can be circular in shape. Furthermore, “single-touch” touch surfaces having the same geometric shape may have different geometric parameters. For example, two circular touch surfaces can have two different radii.

According to another embodiment of the invention, “one-touch” touch surfaces implemented in the computer pointing device 100 can be of different colors. Such an embodiment of the invention allows a visual distinction between the touch surfaces.

Advantageously, “single-touch” touch screens implemented in the computer pointing device 100 can be distinguished by means of different textures covering their touch surface. Textures can be applied in such a way as to cause different haptic sensations. For example, textures can be etched directly onto tactile surfaces.

There represents a computer pointing device according to another embodiment of the invention. The pointing device comprises two "single-touch" touch screens 101, 102 arranged side by side on the same plane and separated by a separation zone 120 extending over the common edge of the two touch screens 101 , 102. The separation zone 120 can be coated with a different material from that covering the tactile surfaces 101, 102 providing the separation zone 120 with a different haptic sensation from that of the tactile surfaces 101, 102. In addition, the color of the separation zone 120 can be chosen different from that of the touch surfaces 101, 102. The width of the separation zone can be greater than a separation threshold between touch surfaces, such a separation threshold can be chosen greater than a millimeter. The insertion of a separation zone 120 between two touch screens 101, 102 allows the user of the computer pointing device 100 to distinguish, even blind, the two touch surfaces 1011, 1021.

There shows a computer pointing device 100 according to another embodiment of the invention. The pointing device 100 comprises three "single-touch" touch screens 101, 102, 103, a central touch screen 102 and two side touch screens 101, 103, inclined with respect to each other, the central touch screen 102 sharing an edge common with each of the side touch screens 101, 103. The dimensions of the touch screens 101, 102, 103 and their orientation can be optimized so that the pointing device 100 can be manipulated by the fingers of one hand (H) . For example, the width of the central touch screen 102 can be chosen small enough to allow the two side touch screens 101, 103 to be touched simultaneously by two fingers with one hand (H). described in this embodiment makes it possible to effectively delimit each touch screen without having recourse to a separation zone between the neighboring touch screens. Furthermore, the arrangement of the touch screens as described in this embodiment is compatible with numerous gestures which can be interpreted as commands for graphic elements. For example, the simultaneous sliding of two fingers on the central touch screen 102 and one of the two side touch screens 101, 102 can be used to perform, depending on the direction and direction of the slide, horizontal or vertical scrolling of a scroll bar attached to a display area. The installation of the inclined touch screens 101, 102, 103 requires a surface area much smaller than that required by similar touch screens arranged in a flat manner as illustrated in the . Such an advantage is particularly useful in a cockpit of an aircraft where compact pointing devices of reduced size are required. In addition, the use of inclined touch screens 101, 102, 103 makes it possible to extend the field of action associated with several graphical element commands. For example, in the cockpit of an aircraft, the maximum amplitude of a zoom corresponding to approximately 20 centimeters of spacing between two fingers of one hand (H) is difficult to achieve with tactile surfaces arranged in a flat manner. to which a surface of length less than 15 centimeters is generally reserved. The maximum amplitude of a zoom is attainable with touch screens 101, 102, 103 arranged in an inclined manner according to embodiments of the invention.

According to one embodiment of the invention, touch screens implemented in the computer pointing device 100 can be distinguished by at least two means of distinction described above. For example, the touch screens can be tilted relative to each other, having different colors and on which different textures covering their touch surface so as to cause different haptic sensations depending on the touch surface.

According to another embodiment of the invention, the computer pointing device 100 comprises at least three “one-touch” touch screens. One of the touch screens implemented is intended to secure the controls of graphic elements made by pressing and/or sliding on the other touch screens. For example, a graphic element command can only be validated when the associated presses and/or slides are made simultaneously with a press made on the safety touch screen. From a practical point of view, the security touch screen can be manipulated by the palm of the hand (H) and the other touch screens can be manipulated by the fingers of the same hand (H).

There shows a computer pointing device 100 according to another embodiment of the invention in which curved touch screens 101, 102, 103 implementing also curved three-dimensional (3D) touch surfaces are put in place. The touch screens 101, 102, 103 can be incorporated into the outer surface of a 3D object (500) serving as a support. The geometry of the 3D object 500 can be adapted so as to allow manipulation of the computer pointing device 100 by a single hand (H). Furthermore, the arrangement of the touch screens 101, 102, 103 on the 3D object 500 can be optimized so that an operator placing his hand (H) in an adequate manner on the 3D object (500) can be able to manipulate easily each touch screen by means of a specific finger. Advantageously, the non-touch surface of the 3D object 500 can be used to incorporate physical action objects such as push buttons.

According to one embodiment of the invention, at least one of the touch screens implemented in a computer pointing device 100 is of the “multi-touch” type, that is to say combining a “multi-touch” touch surface key” and a processing unit executing a “multi-key” detection algorithm. The "multi-touch" touch screen can be used in a "single-touch" operating mode, i.e. to detect at a given moment at most a single press. The use of a "multi-touch" operating mode of the "multi-touch" touch screen to detect several simultaneous presses at a given moment, can be carried out in the event of a malfunction of one of the "single-touch" touch screens . Such an embodiment thus makes it possible to maintain “multi-touch” operation of the computer pointing device 100 in the event of a malfunction of one or more “single-touch” touch screens implemented.

According to another embodiment of the invention, the "single-touch" touch surfaces implemented in the computer pointing device 100 can correspond to distinct areas of a "multi-touch" touch surface, the " multi-key” being associated with a processing unit executing a “multi-key” detection algorithm. In such an embodiment, the electronic calculation device (110) can be configured to identify the "one-touch" tactile surface on which a press is exerted from the geometric coordinates of the position of such a press as determined by the processing unit.

There shows an interactive display system 200 according to one embodiment of the invention. The display system 200 includes a display device 201 and a computer pointing device 100, the computer pointing device 100 being configurable according to one of the embodiments described above. The display device 201 comprises one or more graphic element display screens. Computer pointing device 100 may be configured to move a graphical pointer across display screens 201 through one of the "one-touch" touch screens implemented. This makes it possible to select a graphic element by positioning the graphic pointer on or near the graphic element of interest. Commands can then be applied to the graphic element of interest by pressing and/or sliding on “single-touch” touch screens. Alternatively, the selection of a graphic element of interest displayed on a display screen can be carried out without recourse to a graphic pointer. In this case, a correspondence between the support positions on a touch surface of a touch pad and the graphic elements displayed on a display screen can be established beforehand. For example, pressing on the top right corner of a touch surface can lead to the selection of a graphic element displayed on the top right corner of a display screen.

The invention is not limited to the embodiments described above by way of non-limiting example. It encompasses all the variant embodiments which may be envisaged by those skilled in the art.

Claims (14)

Computer pointing device (100) for controlling graphic elements, characterized in that it comprises at least two touch screens (101, 102), each of the said touch screens being capable of instantaneously detecting the position of at least one press, the pointing device comprises an electronic calculation device (110) configured so as to determine, during a time window where, simultaneously, a first press is made on the first touch screen (101) and a second press is made on the second screen tactile (102), a first gesture performed by all of the two presses during the time window, said first gesture being representative of a first command of a graphic element. Device according to claim 1, comprising at least a third touchpad (103), said electronic device being configured so as to determine, during a time window where, simultaneously, a first press is made on the first touchpad (101) and a second press is performed on the third touchpad (103), a second gesture performed by all of the two presses during the time window, said second gesture being representative of a second command of a graphic element, said second command being different nature of the first order. Device according to Claim 1 or 2, in which the said touch screens (101, 102, 103) are "single-touch", each of the said touch screens being capable of detecting the position of a single press at a given instant. Device according to claims 1 to 3, in which at least two touch screens are differentiable from each other. Device according to Claim 4, in which at least two touch screens are inclined relative to each other. Device according to claims 3 to 5, in which at least two touch screens are of different colours. Device according to Claims 3 to 6, in which at least two touch screens are separated by a separation surface with a width greater than 1 millimetre. Device according to Claims 3 to 7, in which different textures cover the touch screens, so as to cause different haptic sensations depending on the touch screen. Device according to one of the preceding claims, in which at least two adjacent touch screens have a common edge. Device according to one of the preceding claims, in which the said touch screens are of the same type. Device according to Claim 10, in which the said touch screens are of the intrinsic capacitive touch screen type. Device according to one of Claims 1 to 9, in which at least two touch screens are of different types. Device according to one of the preceding claims, in which at least one of the said touch screens is curved. Interactive display system (200) comprising:

• a display device (201) capable of displaying on one or more display screens a plurality of graphic elements, and
• a pointing device (100) configured to interact with said graphic elements according to one of claims 1 to 13.