JP2015520455A - User interface and method - Google Patents

Abstract

One variation of a method for controlling a dynamic haptic user interface is detecting a capacitance value over a portion of a cavity, wherein the haptic layer defines a deformable region and a peripheral region, and the peripheral region is a deformable region. The adjacent, deformable region cooperates with the substrate to define a cavity, and the vertical position of the haptic surface of the deformable region is estimated according to a second capacitance value over a portion of the cavity; Modifying the vertical position of the deformable region haptic surface by manipulating fluid pressure in the cavity according to the difference between the estimated vertical position of the haptic surface of the region and the target vertical position of the haptic surface of the deformable region And detecting an input on the haptic surface in accordance with a change in capacitance value over a portion of the cavity. [Selection] Figure 1B

Description

FIG. 1A is a plan view of a user interface according to an embodiment of the present invention. FIG. 1B is a front view of a user interface according to an embodiment of the present invention. FIG. 2A is a diagram schematically illustrating the backward setting of the user interface. FIG. 2B is a diagram schematically showing the extended setting of the user interface. FIG. 2C is a diagram schematically showing user interface input settings. FIG. 3 is a diagram schematically showing a modification of the user interface. FIG. 4 is a diagram schematically showing a modification of the user interface. FIG. 5A is a diagram schematically showing a modified example of the user interface for the backward setting. FIG. 5B is a diagram schematically showing a modification of the user interface for extended settings. FIG. 6 is a diagram schematically showing a modified example of the user interface for the backward setting. FIG. 7 is a diagram schematically showing a modified example of the user interface for the backward setting. FIG. 8A is a diagram schematically showing a modified example of the user interface for the backward setting. FIG. 8B is a diagram schematically showing a modification of the user interface for extended settings. FIG. 9A is a plan view showing button deformation of a modified example of the user interface. FIG. 9B is a front view showing button deformation of a modified example of the user interface. FIG. 10A is a plan view showing slider deformation of a modification example of the user interface. FIG. 10B is a front view showing slider deformation of a modification example of the user interface. FIG. 11A is a plan view showing a slider ring deformation of a modified example of the user interface. FIG. 11B is a front view showing a slider ring deformation of a modified example of the user interface. FIG. 12A is a plan view showing guide deformation and pointing stick deformation of a modified example of the user interface. FIG. 12B is a front view showing guide deformation and pointing stick deformation of a modified example of the user interface. FIG. 13 is a diagram schematically showing a modification of the user interface for extended settings. FIG. 14A is a diagram schematically showing a modification of the user interface. FIG. 14B is a diagram schematically showing a modification of the user interface. FIG. 14C is a diagram schematically showing a modification of the user interface. FIG. 14D is a diagram schematically showing a modified example of the user interface. FIG. 15A is a diagram schematically showing a modification of the user interface. FIG. 15B is a diagram schematically showing a modification of the user interface. FIG. 16A is a diagram schematically showing a modification of the user interface. FIG. 16B is a diagram schematically showing a modification of the user interface. FIG. 16C is a diagram schematically showing a modified example of the user interface. FIG. 17A is a diagram schematically showing a modification of the user interface. FIG. 17B is a diagram schematically showing a modification of the user interface. FIG. 18A is a diagram schematically showing a modification of the user interface. FIG. 18B is a diagram schematically showing a modification of the user interface. FIG. 18C is a diagram schematically showing a modification of the user interface. FIG. 18D is a diagram schematically showing a modification of the user interface. FIG. 18E is a diagram schematically showing a modification of the user interface. FIG. 19A is a diagram schematically showing a modification of the user interface. FIG. 19B is a diagram schematically showing a modification of the user interface. FIG. 20 is a flowchart according to a variation of the user interface. FIG. 21A is a diagram schematically showing a modification of the user interface. FIG. 21B is a diagram schematically showing a modification of the user interface. FIG. 21C is a diagram schematically showing a modification of the user interface. FIG. 21D is a diagram schematically showing a modification of the user interface. FIG. 22 is a diagram schematically showing a modification of the user interface. FIG. 23 is a diagram schematically showing a modification of the user interface. FIG. 24A is a diagram schematically showing a modification of the user interface. FIG. 24B is a diagram schematically showing a modification of the user interface. FIG. 24C is a diagram schematically showing a modification of the user interface. FIG. 24D is a diagram schematically showing a modification of the user interface. FIG. 25 is a flowchart of a modification of the user interface. FIG. 26 is a flowchart of a modification of the user interface. FIG. 27A is a diagram schematically showing a modification of the user interface. FIG. 27B is a diagram schematically showing a modification of the user interface. FIG. 28A is a diagram schematically showing a modification of the user interface. FIG. 28B is a diagram schematically showing a modification of the user interface. FIG. 28C is a diagram schematically showing a modification of the user interface. FIG. 29 is a diagram schematically illustrating a modification of the user interface. FIG. 30 is a diagram schematically showing a modification of the user interface. FIG. 31 is a flowchart illustrating a method according to an embodiment of the present invention. FIG. 32 is a flowchart illustrating a method according to an embodiment of the present invention.

  The following description of the embodiments of the invention is not intended to limit the invention to these embodiments, but rather is intended to enable one of ordinary skill in the art to make and use the invention. Yes.

1. User Interface As shown in FIG. 1, the user interface includes a substrate 118 and a tactile layer 110, the tactile surface 111, a deformable region 113 of the tactile layer 110 that cooperates with the substrate 118 to define a cavity 125. And a haptic layer 110 that includes a peripheral region 115 of the haptic layer 110 that is coupled to the substrate 118 adjacent to the periphery of the cavity 125, an amount of fluid 120 disposed in the cavity 125, and an amount of fluid. The displacement device 130 is configured to move the deformable region 113 from the backward setting to the extended setting by operating 120, and the deformable region 113 is flush with the peripheral region 115 on the tactile surface 111 of the backward setting. A sensor 140 including a displacement device 130 and a series of detection elements that are offset from the deformable region 113 in the extended setting tactile surface 111, Each detection element in the series of detection elements is configured to detect a capacitance value over a portion of the haptic layer 110, and based on the sensor 140 output and the reverse setting sensor input threshold, the reverse setting variation. A processor 160 configured to detect an input on the tactile surface 111 of the possible area 113 based on an output of the sensor 140 and an extended setting sensor input threshold different from the backward setting sensor input threshold. And a processor 160 configured to detect an input on the tactile surface 111 of the deformable region 113 of FIG.

  The user interface 100 provides tactile guidance and captures input, such as smartphones, mobile phones, tablets, laptop computers, desktop computers, personal digital assistants (PDAs), personal music players, automobile consoles, televisions, cameras, watches. It can be applied on a display (eg, a touch screen) of a computing device such as a display incorporated in the device. The user interface 100 also provides a tactile guidance to capture input, such as a stand-alone keyboard, computer mouse, television remote control, car handle or case for a mobile computing device (eg, smartphone, tablet). It can be applied to a flat or curved display. Typically, as shown in FIG. 2, the tactile surface 111 of the deformable region 113 is tactile until the tactile guidance is required or desired and / or until input is required or proximal to the deformable region 113. Until the input is predicted on 111, in that position, the displacement device 130 manipulates the fluid pressure in the cavity 125 adjacent to the deformable region 113 to haptic the deformable region. The surface 111 is expanded (or retracted). Accordingly, the displacement device 130 expands the cavity 125 and deforms (eg, expands) the deformable region 113 outward, thereby forming a button-like shape or guide on the haptic surface 111. The button-like shape thus provides the user with haptic guidance when navigating over the expanded deformable area, and provides tactile feedback for the user entering in the form of a force on the deformable area 113. Make it even more possible. The sensor 140 receives an input that deforms the deformable region 113 inward, an input that is on the tactile surface 111 but does not deform the deformable region 113, and / or an input that “covers” the deformable region 113. Can be detected. However, the sensor 140 can detect any other input, such as finger input or stylus input, input type or input mode.

  In general, the phrase “sensor 140 can detect...” Is synonymous with “capable of detecting the output of sensor 140 by processor 160. Similarly, the phrase “sensor 140 can detect ...” is equivalent to “the output of sensor 140 can be executed by processor 160 to detect ...” and the phrase “sensor 140 can be detected. "Can measure ..." is equivalent to "the output of sensor 140 can be executed by processing device 160 to measure ...". Furthermore, the phrase “sensor 140 detects...” Has the same meaning as “the processor executes the output of sensor 140 to detect.

  As shown in FIGS. 1 and 2, the haptic layer 110 includes a haptic surface 111, a deformable region 113 that cooperates with the substrate 118 to define the cavity 125, and a substrate 118 adjacent to the periphery of the cavity 125. A peripheral region 115 coupled to Typically, the haptic layer 110 functions to define the haptic surface 111 that interacts with the user in a haptic manner and cooperates with the substrate 118 to define the cavity 125. The haptic surface 111 may be continuous so that the user does not feel any obstacles or seams when swiping a finger across the haptic surface 111. Alternatively, haptic surface 111 may include features that facilitate a user to distinguish one region of haptic surface 111 from another. The haptic surface 111 may be flat, for example, to define a flat surface in a retracted setting, while the haptic layer 110 may alternatively be arranged with a curved or distorted surface. The tactile surface 111 of the deformable region 113 can be deformed (eg, expanded, retracted) when the pressure of the fluid in the cavity 125 changes and when the pressure of the fluid in the cavity 125 becomes equal to atmospheric pressure, It can return to the normal flat state of “loose” or “undeformed”.

  In one implementation, the haptic layer 110 includes a first portion having elasticity and a second portion having relatively low elasticity. For example, the haptic layer 110 may have a relatively high elasticity in a specific region (eg, the deformable region 113) and a relatively low elasticity in another region (eg, the peripheral region 115). Good. In another implementation, the haptic layer 110 typically has a substantially uniform elasticity across the deformable region and the peripheral region. In yet another implementation, the haptic layer 110 includes or is formed from a smart material having selective and / or variable elasticity, such as, for example, nickel titanium (ie, “Nitinol”) or an electroactive polymer.

  In a variation of the user interface 100 that includes a display coupled to the substrate 118, the haptic layer 110 is optically transparent or translucent so that an image output from the display 150 is transmitted to the user through the haptic layer 110. possible. For example, the tactile layer 110 has the following characteristics: high light transmission, low haze, wide viewing angle, minimal back reflection, scratch resistance, chemical resistance, stain resistance, touch smoothness (i.e. No stickiness), minimal degassing, or relatively low degradation upon exposure to ultraviolet light. The tactile layer 110 may be formed from one or more layers of a suitable elastic material, for example, a polymer, polyurethane, and / or a silicone-based elastomer (eg, polydimethylsiloxane (PDMS), RTV silicone, etc.). In one implementation, where the tactile layer 110 includes a first portion having elasticity and a second portion that is relatively inelastic, the inelastic portion may be, for example, an elastomer, a silicone-based organic polymer (eg, polydimethylsiloxane ( PDMS)), thermosetting plastics (eg polymethyl methacrylate (PMMA)), photocurable solvent resistant elastomers (eg perfluoropolyether), polyethylene terephthalate (PET), or any other suitable material It can be formed from materials including polymers and glass.

  The haptic layer 110 may include multiple sublayers of the same material or different materials. For example, the haptic layer 110 may include a first sublayer of one material that defines the haptic surface 111 and a second sublayer of a second material that attaches to the substrate 118. However, the haptic layer 110 may be any other shape and / or material.

  The substrate 118 of the user interface 100 cooperates with the haptic layer 110 to define the cavity 125. The substrate 118 further functions to define a mounting surface adjacent to the cavity 125, and the peripheral region 115 of the haptic layer 110 is coupled to (eg, rides on, attaches to, and adheres to) the mounting surface. The periphery of the deformable region 113 is defined. As shown in FIG. 2, the cavity 125 functions to contain a quantity of fluid 120 and the substrate 118 is a fluid channel that fluidly couples the cavity 125 to the reservoir and / or to the displacement device 130. Can be further defined. For example, the substrate 118 may define a fluid channel 138 that is a microfluidic channel.

  An increase in the pressure of fluid in the cavity 125 expands the deformable region 113 to an expanded setting (shown in FIG. 2B), and a decrease in the pressure of the fluid in the cavity 125 sets (shown in FIG. 2A). The substrate 118 can be substantially rigid (relative to the haptic layer 110) so as to retract the deformable region 113. Accordingly, in the expanded setting, the cavity 125 can expand the haptic surface 111 of the deformable region 113 above the haptic surface 111 of the peripheral region 115. For example, when implemented in a mobile computing device, the cavity 125 defines a diameter of 2 mm, and the deformable region 113 is deflected by 1 mm outward in an expanded setting, with a diameter of 2 mm and 1 mm on the haptic surface 111. Buttons of different heights can be defined. However, the cavity 125 may have any other suitable dimensions.

  A certain amount of fluid 120 is disposed in the cavity 125, and manipulation of the certain amount of fluid 120 modifies the height of the haptic surface 111 of the deformable region 113. The amount of fluid 120 may be a substantially incompressible fluid. The fluid may be a liquid such as water, glycerin or ethylene glycol, or a gas such as air, nitrogen or argon, and the fluid may be any other such as a gel, airgel, oil, alcohol or water. It may be a suitable substance. The fluid may be conductive or substantially non-conductive.

  The displacement device 130 of the user interface 100 is configured to operate a certain amount of fluid 120 to shift the deformable region 113 from the retracted setting to the expanded setting, and the deformable region 113 is configured to move to the tactile surface 111 in the retracted setting. The peripheral area 115 is the same plane and is shifted from the deformable area 113 of the haptic surface 111 in an expanded setting. Typically, the displacement device 130 functions to manipulate a quantity of fluid 120 to expand the cavity 125 from a retracted setting to an expanded setting, thereby forming a tactilely distinguishable shape from the haptic surface 111 of the peripheral region 115. The tactile surface 111 of the deformable region 113 is deformed. In one example, the displacement device 130 controls the setting of the cavity 125 by modifying the amount of fluid 120 sealed within the cavity 125, for example, by heating or cooling an amount of fluid 120. In another example, the displacement device 130 controls the setting of the cavity 125 by adding fluid to the cavity 125 and removing fluid from the cavity 125. However, the displacement device 130 can manipulate the fluid 120 in any suitable manner. In one example implementation in which the user interface 100 is incorporated into a mobile computing device, the displacement device 130 can increase the amount of fluid 120 in the cavity 125 by about 0.1 ml. However, the displacement device 130 can modify the amount of fluid 120 in the cavity 125 in any other manner to any other degree.

  In one implementation shown in FIGS. 5A and 5B, the amount of fluid 120 is an expandable fluid sealed within the cavity 125 and the displacement device 130 includes a heating element that heats the amount of fluid 120. May be included, thereby expanding the amount of fluid present in the cavity 125. For example, the heating element can be arranged in or adjacent to the cavity 125 to heat the fluid and can include a resistive heating element. In this implementation, the fluid may alternatively include an inflatable material, such as a plastic inflatable microsphere, or may be paraffin. In this implementation, the displacement device 130 may additionally or alternatively include a cooling element that cools an amount of fluid 120, thereby retracting an amount of fluid present in the cavity 125.

  In another implementation, the displacement device 130 can move fluid into and / or out of the cavity 125. In the example shown in FIG. 6, the displacement device 130 is fluidly coupled to a reservoir containing additional fluid, and the displacement device 130 moves fluid from the reservoir 132 to the cavity 125 via the fluid channel described above. Including pumps (eg positive displacement pumps). Thus, the reservoir 132 may be located away from the cavity 125, but may alternatively be arranged adjacent to the cavity 125 and connected directly to the cavity 125 via a short fluid channel. While a portion of the channel may be a microfluidic channel (eg defining a cross-sectional dimension in the range of 1 micron to 100 microns), the channel may have any other suitable dimensions. Pump 134 may be a micropump (eg, pump # MDP2205 sold by ThinXXS Microtechnology AG of Twibrücken, Germany, or pump # mp5 sold by Bartels Mikrotechnik GmbH, Dortmund, Germany) or fluid It may be any other suitable device configured to move or induce a differential pressure to move the fluid. Alternatively, the displacement device 130 may be an air bag and as described, for example, in US Provisional Application No. 61 / 727,083 filed Nov. 15, 2012, which is incorporated herein by reference. A cam actuator may be included.

  The pump 134 may be located away from the cavity 125 and may be connected to the cavity 125 via a fluid channel 138. To expand the cavity 125 from the retracted setting to the expanded setting, the pump 134 can move fluid from the reservoir 132 through the fluid channel 138 and into the cavity 125. To retract the cavity 125 from the expanded setting to the retracted setting, the pump 134 can “release” or pump fluid from the cavity 125 back into the reservoir 132.

  In the above implementation, the user interface 100 may further include a first valve disposed between the pump 134 and the cavity 125 and a second valve disposed between the cavity 125 and the second pump. To expand the cavity 125 from the retracted setting to the expanded setting, the first valve is opened and the second valve is closed, and the first pump moves fluid from the reservoir 132 through the fluid channel 138 and into the cavity 125. Can do. To retract the cavity 125 from the expanded position to the retracted position, the first valve is closed and the second valve is opened, and the second pump can move fluid from the cavity 125 through the fluid channel 138 to the reservoir 132. it can. The user interface 100 may alternatively retract the cavity 125 from the expanded setting to the retracted setting by opening the second valve to allow the cavity 125 to discharge or “out” into the reservoir 132. The aforementioned release or outflow can be assisted by the elasticity of the haptic layer 110 returning to an undeformed state. In another example, as shown in FIGS. 8A and 8B, the displacement device 130 may include an actuator (eg, a linear actuator) that moves fluid into or out of the cavity 125. To expand the cavity 125 from the retracted setting to the expanded setting (as shown in FIG. 8A), the linear actuator moves fluid through the channel into the cavity 125 and retracts from the expanded setting (as shown in FIG. 8B). To retract the cavity 125 for setting, the linear actuator draws fluid from the cavity 125 back into the reservoir 132.

  Accordingly, the displacement device 130 can function to modify the pressure of the fluid in the cavity 125 to expand or retract the cavity 125. For example, when implemented in a mobile computing device, the displacement device 130 can increase the pressure of the fluid in the cavity 125 by 0.1 to 10.0 psi to deform the haptic surface 111 of the deformable region 113. . However, the displacement device 130 may be any other suitable pump or other displacement device that implements any other method to move the cavity 125 between the retracted and expanded settings.

  Typically, deformation of the deformable region 113 (ie, power expansion or retraction) functions to allow haptic feedback and haptic guidance on the haptic surface 111. The deformation of the deformable area 113 can function to indicate the type of input or command associated with the area of the haptic surface 111. In the extended setting, the deformable region 113 can be pressed at (1) a convex button that transmits an input to the sensor 140 as a signal when pressed by the user, and (2) at a plurality of points along the deformation by the user, In addition, a convex slider that transmits a plurality of input positions on the sensor 140 as a signal and / or (3) a convex pointing stick that transmits a plurality of input positions on the sensor as a signal are defined. be able to. The deformable region 113 can similarly define (1) a concave button, (2) a concave slider, and / or (3) a concave pointing stick in the retract setting. The convex buttons can be dome-shaped, cylindrical (i.e. having a flat top), pyramid or frustoconical, cube-shaped (i.e. having a flat top), as shown in Figs. 9A and 9B, or Any other suitable button shape can be defined. As will be described below, the sensor 140 may be recognized as an input on the tactile surface 111 of the deformable region 113 that defines the button (eg, the input 145 shown in FIGS. 9A, 10A, 11A, and 12A). it can. The convex slider can be an elongated projection (shown in FIGS. 10A and 10B), a ring (shown in FIGS. 11A and 11B), a cross-shaped projection, or any other suitable shaped projection or slider. Can be prescribed. As described below, the sensor 140 can identify user input at various positions across the slider and can distinguish input at those positions using different types of inputs. In one example, a slider that defines an annular shape can function as a “click wheel” for a second-generation Apple iPod. A pointing stick (or pointing object) such as a button has a dome shape, a cylindrical shape (ie, having a flat top surface), a pyramid shape, a cubic shape (ie, a flat top portion) as shown in FIGS. 12A and 12B ) Or any other suitable button shape can be defined. The sensor 140 can identify user inputs at various locations along the pointing stick and distinguish these user inputs as different commands or functions. In one example, in one implementation where the pointing stick defines a dome-shaped pointing stick, the pointing stick depressing proximal to the upper right quadrant is different from the pointing stick depressing proximal to the lower right quadrant. Can be interpreted. The sensor 140 can detect the depression of the pointing stick in a quick sweep operation such as a “sweep” from the upper right quadrant to the lower right quadrant, for example. It can be interpreted as a moving input similar to that of Apple's ipod “click wheel”.

  The sensor 140 of the user interface 100 includes a series of detection elements, and each detection element of the series of detection elements is configured to detect a capacitance value that spans a portion of the haptic layer 110. Typically, the sensor 140 implements capacitive sensor technology and detects input at various positions on the haptic layer 111 including the haptic layer 111 in the deformable region 113. The sensor 140 may detect the presence of finger or stylus pen contact on the tactile layer 111, the depression of the deformable region 113 in an expanded setting, and / or the presence of any other suitable type of input. it can. The sensor 140 includes an input direction, an input position, a rate at which the input is applied to the deformable region 113, a level at which the input deforms the deformable region 113 inward, and a user input type (eg, finger input, stylus pen). Can be detected.

  The sensor 140 may be a capacitive sensor that includes at least two conductors that cooperate to sense a variation in the electric field (electromagnetic field) across a portion of the haptic layer 110, and the electric field may be at least two conductors of the sensor 140 (ie, Emitted from a conductive pad). The variation in the electric field may be the result of contact with a finger or stylus pen, deformation of the deformable region 113, changes in the amount of fluid or the position of the fluid in the substrate 118 and / or cavity.

  The sensor 140 may include any number of detection elements configured to sense input at various locations on the haptic surface 111. Each sensing element may be a surface capacitive sensing element that includes one conductive pad, and an input implementation (eg, a finger) proximal to the haptic surface 111 absorbs charge from the conductive pad. Alternatively, each sensing element may be a projected capacitive sensor that includes two or more adjacent conductive pads, where the two or more conductive pads are driven by a time-varying voltage to cause a voltage across the conductive pad to age. To increase or decrease the voltage, causing rise and / or decay times of the voltage associated with capacitive coupling between the conductive pads, and the input on the haptic surface 111 affects the capacitive coupling between the conductive pads. However, each detection element may be any other type of detection element, electrode, conductor or the like.

  In one implementation, the sensor 140 includes a projected capacitive tactile sensor that includes a first layer of a first set of parallel electrodes and a second layer of a second set of parallel electrodes, the second layer being a vertical distance only. Deviating from the first layer, the second set of electrodes bisects the first set of electrodes. In the implementation of this example, each electrode in the first set of parallel electrodes and each electrode in the second set of parallel electrodes can define a plurality of conductive pads, and the conductive pads of the first set of parallel electrodes and the first set of parallel electrodes. Adjacent conductive pads of two sets of parallel electrodes cooperate to define a sensing element. The conductive pads may have a square shape, a straight line, or any other shape, or the substrate 118, the tactile layer 110, the display adjacent to the substrate 118, or any other configuration of the user interface 100. It may be patterned with a uniform distribution across the elements or associated devices. Alternatively, the conductive pads are patterned with a non-uniform distribution in which the conductive pads have a high distribution proximal to the deformable region 113 and the conductive pads have a relatively low distribution proximal to the peripheral region 115. May be. Similarly, the conductive pads have a non-uniform distribution where the conductive pads have a greater total surface area proximal to the deformable region 113 and the conductive pads have a relatively smaller total surface area proximal to the peripheral region 115. Can be patterned. In one example implementation, sensor 140 includes a first sensing element and a second sensing element coupled to substrate 118, the first sensing element detecting a capacitance value over a portion of cavity 125, wherein the second sensing element is The capacitance value is detected over a part of the peripheral region 115. For example, the first sensing element may have a charging voltage, a charge current, a charging time, a discharging time, a communication frequency spanning a first conductive pad and a second conductive pad arranged on the substrate 118 proximal to the deformable region 113. At least one can be detected. However, the sensor 140 may be patterned in any other manner proximal to the haptic surface 111 and configured to detect any other capacitance value in any other manner. A conductive pad may be included.

  The conductive pad (eg, first conductor) of sensor 140, which is a capacitive tactile sensor, may be a transparent conductor such as copper, microwire or nanowire, or indium tin oxide (ITO). For example, the substrate 118 may be masked across both wide surfaces and ITO may be sputtered onto both wide surfaces to form vertical electrodes having a uniform or variable density of conductive pads. However, the conductive pads of the sensor 140 can include any type of conductive metal (or conductive fluid).

  Sensor 140, including a capacitive tactile sensor, detects the height of tactile surface 111 in deformable region 113 in addition to the presence of a finger, stylus pen or other instrument on or adjacent to tactile surface 111. Can function further to do. As shown in FIG. 14A, the first conductor (eg, the first conductive pad) is detected by the capacitive sensor by the deformation inward of the deformable region 113 by changing the height of the fluid in the cavity 125 with respect to the first conductor. May be arranged in or adjacent to the cavity 125 to affect the capacitance that is applied. For example, the first conductor may be arranged on the bottom of the cavity 125 opposite the haptic surface 111 so that the capacitive sensor can be deformed inwardly in response to the expansion, retraction and / or input of the deformable region 113. It is possible to detect the fluctuation of the height of the fluid when it is deformed into the shape. Alternatively, the first conductor may be arranged in or on the back surface of the haptic layer 110 such that the first region when the deformable region 113 is deformed by expansion, retraction and / or input. The conductor deforms with a particular surface, thereby allowing detection of fluid height variations in the cavity 125. However, the first conductor may be arranged in any suitable location within or adjacent to the cavity 125, the substrate 118, or the tactile layer 110.

  As shown in FIG. 14B, the capacitive touch may include second conductors arranged in the cavity 125. When an input is applied to the deformable region 113, the second conductor 144 can detect a change in capacitance across the first conductor and the second conductor 144. For example, when the user deforms the deformable region 113 inward, the amount of fluid and / or the height of the fluid between the first conductor and the second conductor 144 changes, and the first conductor and the second conductor 144 change. A change in capacitance detected between and. The elevation gradient between the first conductor and the second conductor 144 may further cause a measurable change in capacitance between the first conductor and the second conductor 144. For example, an input on the deformable region 113 reduces the distance between the first conductor and the second conductor, thereby changing the capacitance read by the second conductor 144. This change may facilitate identification of the input location for the shape of the deformable region 113.

  The second conductor 144 cooperates with the first conductor to detect fluid height variations in the region above the second conductor 144 that causes a more localized capacitance measurement of the height variation in the cavity 125. Can do. Measurement of the local capacitance change in the cavity 125 by the two sensing elements may allow the relative height difference of the fluids to be measured. For example, when the input deforms the deformable region 113, the height of the fluid on the first conductor is different from the height of the fluid on the second conductor, so that the detected capacitance value of the first conductor and the second A difference from the detected capacitance value of the conductor 144 is generated. The capacitance between the first conductor and the first portion of the second conductor 144 is compared with the capacitance between the first conductor and the second portion of the second conductor 144 to determine the relative height of the fluid. Specific differences are identified. The relative difference in capacitance values between the two conductors can thus facilitate the identification of the input location relative to the shape of the deformable region 113. The first portion and the second portion of the second conductor 144 may be a continuous section along the second conductor 144, but alternatively by a third portion of material different from the first portion and the second portion, Alternatively, it can be separated by a tear in the second conductor 144. The second conductor 144 may be the same as the first conductor in material and manufacturing process, but the first conductive pad and the second conductive pad may have any other similar or different material, shape or arrangement. Good.

  As shown in FIGS. 14C and 14D, a sensor 140 including a capacitive tactile sensor may include a third conductor and / or a fourth conductor. The third and / or fourth conductors may be arranged proximal to the deformable region 113 and thus allow for more accurate input sensing proximal to the deformable region 113. For example, with respect to sensor 140 that includes four conductors proximal to deformable region 113 (shown in FIG. 14D), deformable region 113 is defined by an X-axis and a Y-axis having a proximal origin in the center of deformable region 113. It can be divided into a quadrant coordinate system. In this example, the input location for the shape of the deformable region 113 can be measured in various ways. In the example implementation shown in FIG. 15A, the capacitance and / or the relative capacitance between the first conductor and the third conductor 146 are measured to identify the location of the input along the X axis. , The capacitance and / or the relative capacitance between the second conductor 144 and the fourth conductor 148 is measured to identify the location of the input along the Y axis. The measured location of the X-axis input and the Y-axis input can be used to identify the location of the input on the quadrant coordinate system. In another example implementation shown in FIG. 15, three capacitances and / or relative capacitance values are between the first conductor and the second conductor 144, between the first conductor and the third conductor 146, Measured between the first conductor and the fourth conductor 148. The three capacitance values can be used to identify the location of the input in the quadrant coordinate system (which can be overlaid on the “tridrant” coordinate system). However, the sensor 140 may be in any other suitable manner and any other number of proximal or remote to the deformable region 113 to sense the proximal input of the deformable region and / or the peripheral region. A conductor may be included.

  As shown in FIG. 16A, the first conductor, the second conductor 144, the third conductor, etc. may be arranged at a first level relative to the cavity 125. Alternatively, as shown in FIG. 16B, the first conductor may be arranged at a first level relative to the cavity 125 and the second conductor 144 may be arranged at a second level relative to the cavity 125. A third conductor, a fourth conductor, and / or any other suitable number of conductors may be arranged at the second level or other level relative to the cavity 125. By placing conductors in the cavity 125 at various heights relative to the cavity 125, sensing the location and size of the input can be facilitated. Additionally or alternatively, as shown in FIG. 16C, the first conductor may be arranged on or in the substrate 118 and the second conductor 144 is arranged in the haptic layer 110. It's okay. However, the sensor 140 may include any other combination or arrangement of conductors.

  As shown in FIGS. 17A and 17B, the sensor 140 including the capacitive tactile sensor can detect the height variation of the deformable region through the first conductor and the second conductor. In this implementation, the first conductor is arranged in a place where the user moves when deforming the deformable area 113 inward, and the first conductor is placed in a relatively fixed place when the user deforms the deformable area 113 inward. Two conductors 144 may be arranged. The second conductor 144 may be arranged in the cavity 125 as shown in FIG. 17A, or may be arranged in a relatively fixed location in the user interface 100 as shown in FIG. 17B. In this implementation, a change in the distance between the first conductor and the second conductor changes the capacitance measured between the first conductor and the second conductor, and the change indicates an input. The first conductor may be a flexible conductor so that deformation inward of the deformable region 113 causes the first conductor to similarly deform. The movement of the first conductor can be detected by measuring the capacitance value between the first conductor and the second conductor 144 and the capacitance value between the first conductor and the third conductor 146. The difference between these capacitance values can thus indicate the location of the input to the deformable region 113. Alternatively, the capacitance value between the first conductor and the first portion of the second conductor 144 is compared with the capacitance value between the first conductor and the second portion of the second conductor 144 to determine the amount of fluid. Identify relative height differences. Therefore, the relative difference in the capacitance value between the two conductors can facilitate the identification of the input location for the deformable region 113. The second conductor 144 may be arranged near the periphery of the deformable region 113, near the center of the deformable region 113, or at any other suitable location. Alternatively, as shown in FIGS. 18D and 18E, the second conductor 144 is arranged perpendicular to the first conductor, along the axis of the first conductor and along the axis of the second conductor 144. It allows deformation to be detected, thereby increasing sensor sensitivity.

  Accordingly, as shown in FIG. 18, the sensor 140 including a capacitive tactile sensor may include a conductive pad patterned across the substrate 118, a conductive pad patterned across the tactile layer 110, and / or on the cavity 125. Or it may include a plurality of conductors, such as in the form of conductive pads arranged within the cavity 125. As shown in FIG. 18A, the conductive pads may have the same or similar size and / or shape. Alternatively, as shown in FIGS. 18B-18E, the conductive pads may have different or not similar sizes, shapes and / or outlines, for example based on proximity to the deformable region 113. For example, one conductive pad may define an arrangement according to the arrangement of the cavity 125 and / or the deformable region 113 as shown in FIGS. 18B and 18C. However, any suitable arrangement or arrangement of first and second conductors may be used.

  As described above, the sensor 140 may include a projected capacitive tactile sensor that includes a first layer of a first set of parallel electrodes 140X and a second layer of a second set of parallel electrodes 140Y. Deviation from the first layer by some vertical distance, and the second set of electrodes intersects the first set of electrodes at right angles, as shown in FIG. In this implementation, the electrodes may be arranged below the haptic layer 110 and may be configured to generate an electric field that extends through the haptic layer 110 as shown in FIGS. 24A-24D. Typically, in this implementation, the field electrode (eg, the first conductor) can generate an electric field, and the pair of sensor electrodes (eg, the second conductor) can sense the electric field through capacitive coupling, and the processor 160 can characterize the change in magnitude of capacitive coupling between the field electrode and the pair of sensor electrodes as an input on the haptic surface 111. The electrodes are arranged adjacent to the substrate 118 opposite the tactile layer 110 and arranged in the substrate 118 (eg, in the fluid channel 138 and / or in the cavity 125 as shown in FIG. 24A), or It can be arranged somewhere within the user interface 100. The haptic layer 110 and / or a quantity of fluid may be defined as air so that the haptic layer 110 and / or fluid may facilitate an electric field to penetrate the extended setting cavity 125 and / or the haptic layer 110. It can be a different dielectric. Thus, the fluid, haptic layer material, and / or substrate material may have its magnetic properties and / or its electrical properties to optimize the electric field distribution across the haptic layer 110 in the retracted and extended settings. Can be selected based on. Additionally or alternatively, the sensor 140 may include a charge transfer or surface capacitive tactile sensor, where the charge (ie, electrons) contacts the electrodes (eg, conductive pads) and the finger, stylus pen, or tactile layer 110. To communicate with other touch devices. However, the sensor 140 may be any other suitable type of capacitive tactile sensor.

  Further, as shown in FIGS. 24A-24D, the haptic layer 110 and / or a quantity of fluid 120 may cause a magnetic, metallic or polarized element or ion that further concentrates the electric field through the cavity 125 and / or the haptic layer. 117, which may increase the sensitivity of the sensor 140 to input on the haptic surface 111 in an extended setting. In one example, an amount of fluid 120 contains microscale or nanoscale metal particles in solution. In another example, haptic layer 110 includes a row that extends into cavity 125 and incorporates a magnetic, metallic or polarized element or ion. In yet another example, haptic layer 110 has a substantially uniform thickness and includes magnetic, metallic or polarized elements or ions 117 implanted into haptic layer 110. In this example, as shown in FIG. 24A, magnetic, metallic or polarized elements or ions 117 may be concentrated locally in the deformable region 113 and are substantially non-uniform across the haptic layer 110. Or may be arranged in the haptic layer 110 in any other manner. In yet another example, the haptic layer 110 may include a magnetic, metallic or polarized strip across at least one of the back surface of the haptic layer 110 and the haptic surface 111. However, magnetic, metallic or polarized elements or ions may be arranged in other ways within the user interface 100.

  In one example implementation, the sensor 140 detects an input that is a change in the distribution of the electric field across the haptic layer 110 due to the presence of a finger, stylus pen, or other touch device proximal to the haptic surface 111. For example, as shown in FIGS. 24B and 24C, the sensor 140 can detect changes in the electric field. In another example implementation, as illustrated in FIGS. 24A and 24B, a magnetic, metallic or polarized element or ion or some amount of fluid 120 in the haptic layer 110 destroys the electric field distribution. As the sensor 140 moves through the electric field, the sensor 140 detects a change in the position of the haptic layer 110. In this example implementation, therefore, sensor 140 can detect movement of haptic layer 110 and / or fluid rather than directly detecting the presence of a finger, stylus pen or other touch device.

  In one implementation where sensor 140 is a projected capacitive sensor, sensor 140 may function in various modes. When the deformable region 113 is in the retracted setting, the sensor 140 operates in the first mode by generating a substantially uniform electric field across the haptic layer 110. When the deformable region 113 is in the expanded setting, the sensor 140 can operate in the second mode by generating a non-uniform electric field across the haptic layer 110. In the second mode, capacitive coupling between the sensor elements is stronger near the deformable region 113, otherwise it is elsewhere in the haptic layer 110 between the first mode and the second mode. It does not change. For example, the magnitude of the electric field at the deformable region 113 can be increased by increasing the potential difference across two adjacent electrodes proximal to the deformable region 113. Alternatively, the magnitude of the electric field at other parts of the haptic layer 110 may be reduced, thereby reducing input sensitivity at other parts of the haptic layer 110 while input at the deformable region 113. Sensitivity can be substantially maintained. Similarly, the sensor 140 can suppress the generation of an electric field in the portion of the tactile layer 110 outside the deformable region 113 so that the input is detected only in the deformable region 113.

  In the implementation described above, the sensor 140 can operate in distinct modes, each mode being associated with a particular vertical position or setting of the deformable region 113. Alternatively, the sensor 140 may operate in various modes that define a continuum of sensor settings relative to a continuum of deformable region positions between a fully retracted setting and a fully expanded setting. However, the sensor 140, including a projected capacitive sensor, can function in any other way in the retract setting and the extended setting. Further, the sensor 140 may be any other suitable type of sensor.

  The sensor 140 can output a capacitance map of capacitance values across the haptic layer 111 (ie, the stored initial capacitance value and difference value). For example, the capacitance map may include data indicating the distribution of the electric field across all or part of the haptic surface 111. The position of the input on the haptic surface 111 (ie, the XY coordinates) can be determined by analyzing the capacitance map (shown in FIG. 26). The magnitude, speed, timing, etc. of the input can be similarly identified from the capacity map, for example by comparing the capacity map with the previous capacity map. Typically, the processor 160 can analyze the volume map to identify a centroid (eg, center of mass) of the change in the volume map, and thus associates the centroid of change with the input. Thus, any of the input locations, magnitudes, timings and / or speeds are associated with one or more predetermined time capacity maps and / or at a capacity map change or rate of change over a predetermined period of time. Associated.

  The sensor 140 may alternatively include a resistance sensor. Similar to the capacitive sensor, the resistance sensor may include at least two conductors and may function to detect a resistance between the two conductors. In one example, the two conductors can be arranged at two different locations within the cavity 125. The resistance between the two conductors has a first value for the reverse setting and a second value for the extended setting. In response to an input that deforms the deformable region 113 inwardly, the resistance between the two conductors adapts to a third value between the first value and the second value. By reading this resistance value, the sensor 140 can detect the degree of input, deformation inside the retractable deformable area, and / or deformation inside the deformable area 113.

  A resistance sensor across the deformable region 113 and the adjacent non-deformable region can be detected uniformly. For example, the size and density of the sensor electrodes may be constant across the sensor 140, for example across the substrate 118 and / or the haptic layer 110. Alternatively, the sensor 140 may exhibit non-uniform sensitivity, for example by changing the size and / or density of the electrodes. The sensor 140 may implement non-uniform sensitivity to allow for detection of input on the deformable region 113 with various settings. Usually, since the effective thickness of the tactile layer 110 in the deformable region 113 is substantially larger in the extended setting than in the backward setting, the input on the tactile surface 111 of the deformable region 113 in the extended setting is Distributed over a larger area of the sensor 140, thus limiting the magnitude of the sensor signal at any particular electrode adjacent to the deformable region 113 and thus requiring greater input sensitivity proximal to the deformable region 113 And

  Additionally or alternatively, the elasticity of the haptic layer 110 and / or the substrate may be non-uniform to limit the distribution of input in the deformable region 113 over a wider sensor area. For example, the haptic layer 110 may be more elastic (ie, flexible) proximal to the center of the deformable region 113. In this example, haptic layer 110 may be thinner in the cross section proximal to the center of deformable region 113 than proximal to the periphery of deformable region 113. Alternatively, the material properties of the haptic layer 110 may vary across the deformable region 113 and the most elastic or most flexible portion of the haptic layer 110 is proximal to the center of the deformable region 113. It is. In this implementation, a portion of the haptic layer 110 in the deformable region 113 has a high elasticity so that the input force can be concentrated over a smaller area of the sensor 140, and thus proximal to the deformable region 113. Improve sensitivity to input. Furthermore, by changing the elasticity of the haptic layer 110, specific electrodes of the sensor 140 can be activated in turn, and the number or order of the activated electrodes depends on the displacement of the deformable region 113 that causes the input. Can be shown. When combined with the time component, the number or sequence of activated electrodes further suggests the rate of deformation of the deformable region 113 that causes the input. However, the resistance sensor may function in any other manner, and the haptic layer 110 and the substrate may be any other profile or material, allowing the functionality described above.

  As shown in FIG. 19A, the sensor 140 may additionally or alternatively include a pressure sensor. In this implementation, an amount of fluid 120 substantially fills cavity 125 and may be a substantially compressible fluid, where cavity 125 is pressure responsive to inward deformation of deformable region 113. It can be sealed so that the sensor can detect an increase in pressure in the cavity. The pressure sensor may be an absolute pressure sensor, a differential pressure sensor or any suitable type of pressure sensor. The pressure sensor may alternatively be a strain gauge that is mounted within the cavity 125 and partially defines the cavity 125, and the strain gauge deforms in response to the inward deformation of the deformable region 113. However, the pressure sensor may be any other suitable type configured to detect a pressure change in the cavity 125 due to inward deformation of the deformable region 113.

  As shown in FIG. 19B, the sensor 140 may additionally or alternatively include a flow sensor. The flow sensor can detect the directional flow of the fluid in response to an input on the deformable region 113. In this implementation, the cavity 125 may be coupled to the fluid channel. In response to the inward deformation of the deformable region 113, the total volume of the cavity 125 decreases and pushes fluid out of the channel. Thus, the flow sensor senses and / or detects fluid flow through the fluid channel 138 to identify the deformation of the deformable region 113 and / or the magnitude of the deformation of the deformable region 113. A flow sensor may be fluidly coupled to the fluid channel 138. In one example, the channel may include a valve that is normally closed to maintain a certain amount of fluid in the cavity 125. When there is an inward deformation of the deformable region 113, the valve is opened to allow back flow to the other channel. The flow rate sensor may be a flow rate sensor that detects the flow rate of the fluid. The amount of fluid 120 flowing through the channel can be calculated from the known cross-sectional area and flow rate of the channel. For example, the valves and / or sensors may be arranged near the cavity 125, as shown in FIG. 19B, while the valves and / or sensors are arranged at any other suitable location relative to the cavity 125. Also good. The pressure sensor may alternatively be a Hall effect sensor or any other type of sensor that detects valve opening due to fluid backflow. However, the flow sensor may be any other type of fluid sensor configured to sense and / or detect fluid flow in and / or outside the cavity 125.

  In one implementation, an amount of fluid may include a fluid suspension or fluid solution containing, for example, metallic, magnetic, polarized, or ionic particulates, and the sensor 140 may interact with the particulates. One or more electrodes configured to detect a fluid flow based thereon may be included. In one example, the fluid channel 138 is a microfluidic channel, and the fluid flow through the fluid channel 138 is characterized by ion displacement, which affects the distribution of the electric field around the fluid channel 138. The sensor 140 can detect a change in the electric field across the fluid channel 138 and the processor 160 is associated with the change in the electric field due to the input. In one example, the sensor 140 includes an electrode arranged adjacent to a portion of the fluid channel 138, wherein the electrode is responsible for the movement of ions, polarized and / or magnetic particulates through the portion of the fluid channel 138. Tracking, the number or amount of particulates indicates the flow rate or flow rate of the fluid and can be associated with the input. However, sensor 140, which is a flow sensor, can function in any other manner.

  Sensor 140 may additionally or alternatively include a strain sensor configured to detect strain across deformable region 113 of haptic surface 111. By sensing nominal strain across the deformable region 113 of the retracted and extended settings of the haptic surface 111, the strain sensor can identify when the deformable region 113 of the surface has been depressed in the expanded setting. A plurality of strain sensors may facilitate identification of the input location for the deformable region 113. The plurality of strain sensors may be electrically coupled, for example, above, below or in the haptic layer 110.

  Sensor 140 may include any number of capacitive, resistive, pressure, flow, and / or strain sensors for sensing and / or confirming input on haptic surface 111. The sensor 140 may be arranged in the substrate 118, display or tactile layer 110, may be arranged between the substrate 118, display and / or tactile layer, or any other component of the user interface 100. They may be arranged in whole or in part within or between them. Additionally or alternatively, all or part of the sensor 140 (eg, an electrode for the sensor 140 that is a capacitive sensor) is etched, printed directly on or in the tactile layer 110 or the substrate 118, or May be assembled. The arrangement, shape or distribution of the sensors 140 or electrodes may be matched or paired with one or more deformable regions of the haptic layer 110 and may be matched or paired with the fluid channels in the substrate 118. It may coincide with or be paired with a support member 112 (shown in FIG. 13) adjacent to the deformable region and may coincide with any other feature or component of the user interface 100. For example, sensor 140 may be deformable region 113, cavity 125, fluid channel 138, or any other of user interface 100 to minimize the effects of elements on the electric field of output by sensor 140, including capacitive tactile sensors. It can be oriented, aligned or positioned with respect to a function or component. However, the sensor 140 may have any other type, arrangement, shape or orientation.

  One variation of the user interface 100 includes a display 150 that is coupled to the substrate 118 on the opposite side of the haptic layer 110 and is configured to visually output an image through the haptic surface 111. Display 150 may function to display a visually-guided image or input keys that are substantially aligned with deformable region 113.

  The processor 160 of the user interface 100 is configured to detect an input on the tactile surface 111 of the deformable area 113 of the reverse setting based on the output of the sensor 140 and the reverse setting sensor input threshold. Is configured to detect an input on the tactile surface 111 of the deformable area 113 of the extension setting based on an extension setting sensor input threshold value that is different from the output of the backward setting sensor input threshold value.

  The processor 160 receives the input data from the sensor 140 and controls the displacement device 130 to shift the deformable area 113 between the settings. For example, as shown in FIG. 20, the processor 160 can recognize a first level or magnitude of force applied to the deformable area 113 as a first type of input, and the processor 160 can A second level or magnitude of force applied to 113 can be recognized as a second type of input, the second level being less than the first level. In this example, if the second level input is the result of the user placing his / her finger on the deformable area 113, the processor 160 may ignore the second type of input. The processor 160 may thus allow the user to place a finger on a portion of the haptic surface without activating the input by selectively ignoring inputs that are smaller than the input threshold. Alternatively, if the second level input is the result of the user lightly applying a force to the deformable region 113, the processor 160 may select the second type as an input that is smaller than the first type input. Can interpret input. However, the processor 160 may perform any other suitable relationship between the first type input and the second type input, which may be set by the manufacturer, processor 160 and / or user. Can be modified. When the deformable area 113 is in the backward setting, the processor 160 can recognize the input of the deformable area 113 as a third type input that can be distinguished from the first type input and the second type input. For example, the processor 160 can ignore the third type of input. The processor 160 can also identify any level of force applied to the deformable region 113 as any suitable type of input and in response to the corresponding input.

  The processor 160 can function to detect the amount of change that the user applies to the deformable region 113. When the deformable area 113 is in the expansion setting, the processor 160 can recognize the force applied by the first change amount on the deformable deformable area as the first type input. The processor 160 can recognize the force applied by the second change amount on the deformable deformable region as the second type input, and the second change amount is larger than the first change amount. For example, the processor 160 may interpret the inward deformation of the deformable area 113 as an instruction to scroll the web page. When the force is applied at the first change amount, the processor 160 can therefore scroll the web page at the first speed. When the force is applied at the second amount of change, the processor 160 can scroll the web page at a second speed, which is greater than the first speed. Accordingly, the sensor 140 and the processor 160 can identify various types and sizes of inputs on the deformable region 113. However, the processor 160 may perform any other suitable relationship between the first type input and the second type input. How the processor 160 handles the force applied to the deformable region 113 may be set or modified by the manufacturer, processor 160 or user. Further, when the deformable area 113 is in the backward setting, the processor 160 recognizes the input in the deformable area 113 as a third type input that can be distinguished from the first type input and the second type input. Can do. For example, the processor 160 can ignore the third type of input. However, the processor 160 can process the input on the deformable region 113 in any other suitable manner.

  In one implementation, the processor 160 adjusts the settings of the sensor 140 based on the vertical position of the deformable region 113. As described above, the processor 160 can modify the mode of the sensor 140 to adjust, for example, the magnitude and / or distribution of the electric field across the haptic layer 110 proximal to the deformable region 113. For example, for a sensor 140 that includes a first set of parallel electrodes and a second set of parallel electrodes that are orthogonal to the first set of parallel electrodes, the processor 160 may be responsive to the reversible setting deformable region 113. A first drive voltage can be set across the subset of electrodes, and a second drive voltage can be set across the subset of electrodes in response to the deformable region 113 of the extended setting. Additionally or alternatively, the processor 160 may stop or turn off portions of the sensor 140 and signal from portions of the sensor 140 associated with a particular portion of the haptic surface 111 outside one or more associated areas. Is excluded. For example, when the deformable region 113 is in an expanded setting and designated as an input region adjacent to a designated non-input region (eg, “dead zone”), a portion of the sensor 140 proximal to the dead zone is stopped, And / or the magnitude of the electric field proximal to the deformable region 113 is increased. This can give the advantage of improving the signal-to-noise ratio (SNR) of the system, and the generation of the sensor signal associated with the input on the haptic surface 111 modifies the control or operation of the sensor 140. Limited to a specific input area. However, the processor 160 can implement similar functionality through signal analysis of the sensor output.

  In another implementation, the processor 160 ignores input at the portion of the haptic surface 111 outside the identified input area. For example, when the deformable area 113 is in an extended setting and defines a particular input area, the processor 160 accepts input in the deformable area 113 but may ignore input outside the deformable area 113. . Further in this example, the first portion of the haptic layer 110 includes a plurality of deformable regions, and the processor 160 ignores input within and outside the first portion of the deformable region, but the first portion of the haptic layer 110. Accept input over a second portion of the haptic layer 110 adjacent to the portion. Thus, for example with respect to sensor 140 having a uniform distribution of sensing elements, the input region of haptic layer 110 can be associated with an inconspicuous portion of sensor 140 and / or discretized with processor 160. This gives the advantage of improving the SNR of the system and thus reduces type 1 (missing detection) and type 2 (false detection) errors in the input capture.

  In the foregoing implementation, as shown in FIGS. 28A, 28B, and 28C, the processor 160 may accept input at specific portions of the haptic surface 111 that are larger or smaller than the deformable region 113. In one example, processor 160 ignores input outside the sub-region of deformable region 113. In this example, the sub-region has a smaller area within the deformable region and can be deformed so that the input always touches the sub-region and registers as an input region that is different from the overall appearance of the deformable region. It can be completely contained within region 113. Similarly, sub-regions of the haptic surface 111 can be associated with a particular confidence level for correlation with the input. For example, as shown in FIG. 28A, a first sub-region having an area smaller than the deformable region 113 and centered on the deformable region 113 may be a finger, stylus pen or While requiring a minimum contact area (or time) with other input devices, the second sub-region on the boundary of the deformable region 113 is qualified as input when compared to the first sub-region. May require a substantially larger contact area (or time) with a finger, stylus pen or other input device. In yet another example, as shown in FIG. 28, the processor 160 may move closer to the center of the deformable region 113 depending on the mode in which the electronic device is held by the user (eg, vertically with the left hand and horizontally with the right hand). A typical input contact profile may be set which includes a region of the upper portion and extends downwardly substantially outside the periphery of the deformable region 113 as shown in FIG. 28B. To distinguish between the input on the first deformable area A and the input on the second deformable area B below the first deformable area A, the tactile surface 111 proximal to the center of the deformable area An input that touches and extends below the deformable region 113 qualifies as an input on the deformable region (shown in FIG. 28B), while touching the center of the deformable region proximally but the deformable region. Inputs that do not extend below 113 are not qualified as input on the deformable region (shown in FIG. 28C). However, the processor 160 may filter input on any other part of the haptic surface 111 according to any other rule or schema.

  The processor 160 may additionally or alternatively modify the trigger threshold of the input on the haptic surface 111 of the deformable area 113 based on the position of the deformable area 113. For example, the convex curvature of the tactile surface 111 of the extended setting deformable area 113 is greater than when the finger, stylus pen or other input device contacts the retractable setting deformable area 113, This can result in a small contact surface with the input device. Accordingly, the processor 160 may set the input trigger threshold value of the deformable area 113 with the extended setting lower than the backward setting. In another example, the deformable region 113 in an expanded setting can distribute the electric field across the expanded haptic layer above the cavity 125, thus concentrating the electric field distribution over the deformable region 113 and When the stylus pen or other input device is proximal to the deformable region 113, the volume gradient is concentrated in the deformable region 113. Thus, the processor 160 can modify the input trigger threshold for the deformable region 113 based on the setting or height. In yet another example, the processor 160 can isolate input at a particular location on the haptic surface 111 when the deformable area 113 is in the retracted setting, and the deformable area 113 is in the expanded setting. The input at the normal location of the deformable area 113 at the time can be separated. In this example, the expandable deformable area 113 defines a normal input area, in which the processor 160 can input any input on substantially any portion of the deformable area 113 to an appropriate input. If the input is identified as being on a normal deformable region or proximal, the particular location of the input may be substantially inappropriate. This may have the advantage that the required sensor resolution may be reduced when the deformable region 113 is in the extended setting. The processor 160 can change noise cancellation, input sensitivity, or any other signal analysis schema, sensor mode, or any other relevant variable according to the vertical or XY position of the deformable region 113.

  In the implementations described above, where a certain amount of fluid 120 and / or tactile layer 110 includes magnetic, metallic or polarized elements or ions, processor 160 may be magnetic, metallic or polarized elements or ions relative to an electric field. In response to the motion, the input at the deformable region 113 can be separated based on the disruption (eg, modification) of the electric field across the cavity 125, the substrate 118, and / or a portion of the haptic layer 110. In this implementation, the processor 160 can record the input at the deformable area 113 over time, and the change over time of the deformable area 113 tells the processor 160 the input type. For example, the speed of input (a time-dependent amount) may indicate the size or speed of a desired function of an electronic device incorporating the system. Accordingly, the processor 160 can correlate dynamic changes to the position and / or shape of the deformable region 113 to specific input types and / or user commands based on the time, speed, or duration of input.

  In another example, the processor 160 controls and maintains the vertical position of the deformable region 113 by performing a closed feedback loop to detect the vertical position of the deformable region 113 based on the sensor output, and as described above. As described above and as shown in FIG. 25, the vertical position of the deformable region 113 can be corrected by controlling the displacement device 130. Further, the processor 160 can estimate the position of the deformable area 113 after the input, and the magnitude of the inner deformation of the deformable area 113 (ie, from the first estimated position to the new estimated deformed position) Tell the size of the desired function of the device. Accordingly, the processor 160 can associate various deformation magnitudes of the deformable region 113 with a particular input type and / or user command. Additionally or alternatively, the processor 160 may isolate the input of the deformable region 113 based on the disruption of the magnetic field due to the presence of a finger, stylus pen or other input device proximal to the deformable region 113. However, the processor 160 may function in any other manner that recognizes input on the haptic surface 111.

  In another implementation, sensor 140 includes two or more sensing elements such as capacitive tactile sensors and pressure sensors. In one example, the processor 160 identifies the location of the input on the haptic surface 111 based on the output of the capacitive tactile sensor and identifies the speed and / or magnitude of the input based on the output of the pressure sensor. In another example, the processor 160 identifies the location, magnitude and / or speed of the input on the haptic layer 110 based on the output of the capacitive tactile sensor and manipulates the output of the pressure sensor to identify the identified input. Verify location, size and / or speed of However, the sensor 140 may include any other combination of sensor types, and the processor 160 manipulates the output of the sensor 140 in any other manner to estimate the location, size, and / or speed of the input. And / or can be verified.

  The processor 160 may compensate for changes in the effective thickness of the haptic layer 110 when associating the output of the sensor 140 with the input on the haptic surface 111. The processor 160 accesses the first setting when the deformable area 113 is in the backward setting, accesses the second setting when the deformable area 113 is in the extended setting, and enters the state of one or more other deformable areas. Any other number of settings may be accessed accordingly and / or any other number of settings may be accessed depending on the “intermediate” state of the deformable region 113. The processor 160 may additionally or alternatively access various settings of various types of input devices such as stylus pens and fingers. Each setting is performed by the processor 160 to perform various look-up tables that separate the location, size, and speed of the input, and the processor 160 can reduce noise in the sensor output or ignore portions of the haptic surface 111. It may be defined by various filter settings and various algorithms or correction factors that are executed by the processor 160 to convert the output of the sensor 140 into meaningful input locations, sizes, speeds, and the like. The settings may be preset, for example at the factory, or may be learned, updated and / or improved over time. For example, the processor 160 may perform managed, semi-managed or unmanaged machine learning to adjust processor settings for a particular user input style. However, the processor 160 may function in any other manner, may perform any other algorithm, setting, machine learning, or sensor output to input location, size, speed, etc. You may associate. Additionally or alternatively, as discussed above, layer thickness change compensation can be achieved, for example, by switching the sensor 140 between preconfigured settings or depending on the position of the deformable region 113. It can be performed at the level of the sensor 140 by adjusting the sensor settings immediately.

  The processor 160 can control the displacement device 130. As shown in FIG. 25, the processor 160 performs a closed feedback loop to interact with the sensor 140 and / or any other number of sensing elements, thereby causing the vertical position of the displacement device 130 and the deformable region 113. And can be controlled. Usually, by accessing the output of the sensor 140, the processor 160 can estimate the actual vertical position of the deformable region 113 (ie, the deformable region 113), which is the actual vertical position of the deformable region 113. It can be compared to the desired vertical position. The processor 160 can therefore control the displacement device 130 to reduce the difference between the actual (ie, estimated) vertical position of the deformable region 113 and the desired vertical position. In one implementation where the sensor 140 is a capacitive tactile sensor that includes an electrode that occurs in an electric field proximal to the deformable region 113 and detects a change, as shown in FIG. 24A, an amount of fluid 120 and / or tactile Layer 110 may have a dielectric constant different from that of air so that each location of deformable region 113 may be associated with a distribution of various electric fields proximal to deformable region 113. In another implementation where the sensor 140 is a pressure sensor, the processor 160 can control the displacement of the fluid into the cavity 125 to maintain a desired fluid pressure (eg, relative to atmospheric pressure) The fluid pressure is related to the desired position of the deformable region 113. In this implementation, fluid pressure may also be related to fluid temperature and / or atmospheric temperature proximal to the system. In yet another implementation in which sensor 140 is a strain sensor, each position of deformable region 113 is associated with a particular strain (eg, at haptic surface 111 or proximal to haptic surface 111). In another implementation where the sensor 140 is a resistive tactile sensor, each position (or range of positions) of the deformable region 113 is associated with a specific number and / or contact between the arrays of sensor electrodes.

  In one example, at a very low temperature, it is impossible to transition the deformable region 113 between settings or requires excessive power consumption, and the processor 160 receives temperature data from the temperature sensor, and Therefore, the operation of the displacement device 130 is stopped under such temperature conditions. In another example, at high altitude conditions (or onboard low air pressure), it is not possible to transition the deformable region 113 between settings or require excessive power consumption, and the processor 160 may The atmospheric pressure data can be received from the pressure sensor and the operation of the displacement device 130 can be stopped. Alternatively, in this example, processor 160 may control displacement device 130 to accommodate a specific differential pressure between the measured atmospheric pressure and the fluid pressure in cavity 125. However, sensor 140 may be any other type of sensor that produces any other output, and processor 160 may manipulate the output of sensor 140 to adjust the position of deformable region 113. Create a closed-loop feedback system.

  As shown in FIGS. 21A-21D, the processor 160 can control various input graphics that are displayed on a display 150 proximal (eg, below) to the deformable region 113. For example, when the deformable area 113 is in the expanded setting (shown in FIG. 21A), the display 150 can output a first type (eg, character) input graphic aligned with the deformable area 113, and the sensor 140 can , The input on the deformable area 113 can be detected, and the processor 160 can identify the input associated with the input graphic (eg, a command to input characters). In this example, the display 150 can output a second type (eg, a number) of input graphics aligned with the second deformable region, and the sensor 140 can detect an input on the second deformable region. And the processor 160 can identify an input associated with a second input graphic (eg, a command to enter a number). The display 150 can similarly output input graphics aligned with the reversible deformable area 113 and / or the peripheral area 115, and the processor 160 can receive input on the deformable area and the peripheral area 115. It can be associated with various input types based on the input graphics output by the display 150.

  The processor 160 may function to change the output of the display 150, such as correcting or adjusting optical distortion caused by the deformation of the deformable region 113. For example, expanding the deformable region 113 to an expanded setting can cause a “fish eye” effect for a user viewing the display 150. Accordingly, the processor 160 can adjust the output of the display 150 to adapt (ie, reduce) the fisheye effect through empirical data.

  Accordingly, the processor 160 may include a touch screen processing unit, a haptic processing, and a host processing unit. The touch screen processing unit may be configured to control the display 150 to detect input on the haptic surface 111 by interacting with the sensor 140. The haptic processing unit may be configured to control the displacement device 130 by performing closed loop feedback control to maintain the desired height of the deformable region 113. The host processing unit may be configured to execute commands based on inputs identified by the haptic processing unit. However, the processor 160 may include any other processing unit and may function in any other manner for input on the haptic surface 111 of the deformable region 113.

  As shown in FIG. 1, the substrate 118 may further define a second cavity and / or any additional number of cavities in cooperation with the haptic layer 110. The second cavity and / or the additional cavity may be substantially the same as the cavity 125, or may be slightly or significantly different in configuration, arrangement, size, shape, etc. Each of the cavities 125 is independently controlled to selectively transition various deformable regions between an expanded setting, a retracted setting, or an intermediate setting, thereby allowing the user interface 100 to various user input scenarios. It may be possible to fit. Alternatively, various cavities may be grouped together, and multiple cavities groups are deformed outwardly together. For example, each cavity in a group of cavities may be assigned to one character in or on the dialpad of the mobile phone, or may be assigned as an alphanumeric QWERTY keyboard. The processor 160 may thus selectively control the expansion and retraction of the deformable region 113 associated with each cavity.

  The processor 160 can selectively receive and / or interpret sensor signals indicative of inputs applied to select the deformable region. A sensing element corresponding to each cavity communicates the location of the respective sensing element to the processor 160 to allow the processor 160 to selectively receive and / or interpret the signal associated with each deformable region. Can be arranged in an array network. In the implementation of sensor 140, which is a capacitive tactile sensor (shown in FIGS. 22 and 23), sensor 140 may include an array of conductors including a first number of X conductors and a second number of Y conductors. For example, the first number of X conductors may be equal to the number of cavities, each X conductor may correspond to one cavity, and the second number of Y conductors may be equal to the number of rows of cavities. , Each Y conductor corresponds to all cavities in one row of cavities. In this example, the location of the input can be identified by sensing the change in capacitance value detected between one X conductor and the corresponding Y conductor of a particular cavity. In this example, since each cavity is associated with one X conductor, the processor 160 can detect the location of the cavity 125 where the user applies force. Similarly, the processor 160 can sense the position of the cavity 125 that allows the user to float (ie, not touch) a finger, stylus pen, or other instrument in the air. The processor 160 further compares the capacitance values detected across the X conductor and the corresponding Y conductor corresponding to two or more cavities on the peripheral area of the haptic surface (eg, between the deformable areas). User touch can be interpolated.

  In another example (shown in FIG. 23), the first number of X conductors may be equal to the number of rows of cavities, each X conductor corresponding to all cavities in one row of cavities, and Y The second number of conductors may be equivalent to the number of rows of cavities, and each Y conductor corresponds to all cavities in one row of cavities. In this example, the location of the input can be identified by sensing the change in capacitance value detected between one X conductor and one Y conductor. Since each cavity corresponds to a different intersection of the X and Y conductors, the processor 160 can detect the location of the cavity corresponding to the input on the haptic surface 111. In yet another example, the first number of X conductors and the second number of Y conductors may be equivalent to a cavity having one X conductor and one Y conductor corresponding to one cavity. In this example, the location of the input is the change in capacitance value detected between one X conductor and one Y conductor, eg based on previously detected capacitance values stored in the previous capacitance map. It can be identified by sensing. Since each cavity corresponds to a different pair of X and Y conductors, the processor 160 can thus detect the location of the cavity corresponding to user input on the haptic surface 111.

  Alternatively, sensor 140 may include an array network of detection elements, where each detection element of the array of detection elements is coupled to a cavity, and each detection element outputs a unique signal for the corresponding cavity. For example, the detection element corresponding to the first cavity outputs a signal of 0.5 nF when an input is detected, outputs a signal of 1 nF when no user input is detected, and the detection element corresponding to the second cavity is 5 nF signal is output when input is detected, 10 nF signal is output when user input is not detected, and the detection element corresponding to the third cavity outputs 50 nF signal when input is detected. And outputs a 100 nF signal when no user input is detected. Since each detector element outputs a unique signal, the processor 160 can therefore detect the location of the input based on the type and / or value of the signal received from the various detector elements. The detector elements are arranged in a parallel relationship (eg, the total capacitance value for a plurality of parallel capacitors matches the sum of the individual capacitance values) and the processor's detector element output identifies the location of the input Can make it easier. For example, using the values of the previous example of the signals from the first, second, and third cavity sensing elements, the processor 160 may use all of the first, second, third, and fourth cavities. Receiving a coupling signal of 55.5 nF from the sensing element when the input is sensed from and detecting that there is no user input from any of the first, second, third and fourth cavities When received, a 111 nF signal may be received from the sensing element. When input is sensed from the third cavity and not from the first, second and fourth cavities, the coupling signal to the processor 160 may be 61 nF. Similarly, when input is sensed from both the second and third cavities, the coupling signal to processor 160 may be 56 nF. The processor 160 can therefore directly interpret the location of the input from the values of the aggregate signals received from the various sensing elements adjacent to the various cavities. The detection elements may be arranged in a series or in any other suitable electrical device.

  However, the input on the first deformable area can affect the sensor reading for the second deformable area. Accordingly, the processor 160 can periodically generate a capacitance map of the output of the sensing element over time and compare the new capacitance map with the previous capacitance map to identify the input on the haptic surface 111. To do. For example, the processor 160 may include a first set of electrically coupled conductive pads in a vertical array (eg, 144 in FIG. 23) and a second set in a lateral array (eg, 142 in FIG. 23) patterned across the substrate 118. The capacitive discharge time across the electrically coupled conductive pads can be mapped. In this example, the processor 160 can build a new capacity map or modify an existing capacity map with a frequency corresponding to the refresh rate of the sensor 140. During each detection period, processor 160 may record a first capacitance value and a second capacitance value, the first capacitance value being a first array of first conductive pads and a second array proximal to cavity 125. And the second capacitance value is determined by the second arrangement of the second arrangement pads proximal to the peripheral region 115 and the second arrangement value. (The refresh rate of the sensor 140 may define a limit on the capacity discharge time between the conductive pads of the sensing elements). The processor 160 may thus provide a capacity for the sensing element proximal to the deformable region 113 in the retracted and expanded settings, the peripheral region 115, and / or any other region of the appropriately configured haptic layer 110. A capacity map including the discharge time can be generated periodically. The processor 160 may additionally or alternatively perform a capacitance map including charging voltage, charge current, charging time, electric field distribution, and / or transmit a frequency across two or more conductive pads. .

  As described above, the processor 160 compares the most recent volume map with a previous volume map (eg, generated one cycle prior to the most recent volume map) to indicate two or more indicating inputs on the haptic surface 111. A change in capacitance value between the conductive pads can be identified. Alternatively, the processor 160 selects a stock or electrostatic capacitance map to identify capacitance values between two or more conductive pads that are compared to the most recent capacitance map to indicate an input on the haptic surface 111. Can do. For example, the processor 160 may determine a series of stocks based on the estimated or measured vertical position of the deformable region 113 and / or the vertical position of one or more estimated or measured deformable regions of the haptic layer 110. A stock capacity map can be selected from the capacity map, with each stock capacity map being associated with a particular configuration of the location of the deformable region. The processor 160 can select a volume map of the stock based on ambient ambient temperature, ambient pressure, atmospheric pressure, or ambient humidity, where the volume map for each stock is ambient ambient temperature, ambient pressure, atmospheric pressure, or Associated with a specific range of ambient humidity.

  The type of input device (e.g., finger, stylus pen) can similarly affect the sensor readings of the various deformable areas. The processor 160 can predict the input mode (ie, the type of input instrument), select an input model based on the predicted input mode, and detect over the volume map and a portion of the haptic surface 111 and / or cavity 125. The input on the haptic surface 111 can be identified further based on the output of the input model corresponding to the difference between the capacitance value. Alternatively, as described above, processor 160 may select a stock capacity map based on the predicted input mode, with each stock capacity map being associated with a particular type of input performed.

  Therefore, by comprehensively analyzing the readings from the plurality of detection elements, the processor 160 is on the haptic surface 111 of both the peripheral region 115 and the deformable region 113 of the reverse setting, the expansion setting, and the intermediate setting. Detect input. The processor 160 can identify multiple simultaneous inputs on the haptic surface 111, such as multiple time-dependent inputs having varying magnitudes and / or speeds, in cooperation with the sensing element. However, the processor 160 and sensor 140 may function in any other manner that senses one or more inputs on the haptic surface 111.

2. Tactile Touch Screen System The haptic touch screen system is a user interface 143 and a capacitive touch screen coupled to the user interface 143 and configured to sense a grounded conductive object proximal to the haptic surface of the user interface. And a capacitive touch screen (eg, sensor 140) that includes a touch screen electronic device (eg, a touch screen processing unit).

  The user interface may be a variation of the user interface 100 as described above. In particular, the user interface may include a haptic layer having a deformable region (“tactile element”) that dynamically changes shape to selectively define a raised surface above the touch screen. For example, a haptic touch screen system can be applied to an electronic device to help a user tactilely identify a button, slider, or scroll wheel that defines the input mechanism of the device. A tactile touch screen system is applied to an electronic device to allow a user to tactilely identify the status of a system event in the electronic device, for example by lifting an area on the surface of the touch screen to indicate that the device is on. I can help. The haptic touch screen system includes a processor that can function as a host CPU to execute an operating system of the electronic device and a low-level software driver that communicates with a system electronic device (eg, a user interface). . The host CPU can also control the operation of the haptic touch screen system, such as the vertical position of various haptic elements.

  The haptic touch screen system can detect the presence of a predefined minimum diameter grounded capacitive object that touches or is close to the haptic surface 111 of the user interface. The user interface includes one or more substrates having a transparent, translucent or substantially visually insensitive conductive material (eg, ITO) deposited in one or more layers in a pattern defining a plurality of capacitive sensing elements. A material layer (for example, glass, PET film) is included. For example, the capacitive sensing element can be made on the substrate 118 by a transparent conductive material deposited on one side of the substrate at the location of the haptic element and with the same size as the haptic element. Alternatively, the capacitive sensing element may be defined by a transparent conductive film (eg, indium tungsten oxide or “ITO”) that rotates with adjacent connected corners to form a substrate Linearly patterned (e.g., at 45 degrees) and inclined to form a series of square pads across multiple rows on one layer and across multiple rows on the second layer or alternating sides of substrate 118 Including a square pad. In this example, the ITO film can define an XY grid pattern, and the rows and columns of ITO pads overlap at the intersection of adjacent pads. However, the transparent conductive material may be deposited over the substrate 118 in any other suitable pattern, such as a snowflake pattern.

  Furthermore, in this example, the capacitance detection element may be a pair of individual squares, one in each row and each column, rather than in series connection between the pads between each row and each column. For example, an ITO sensor deposited in a 20 × 10 XY grid pattern using connected square rows and columns may include 200 capacitive sensing elements, but for a touch screen processing unit (described above). Only 30 connections are required, and this sensor is not 200 connections for each capacitance detection element connected directly to the touch screen processing unit, but one connection and each column in each row. Includes one connection. In order to connect the conductive pattern to the touch screen processing unit, each row and column on the sensor 140 (eg, a tactile touch screen) is, for example, around the boundary of the sensor 140 outside the active area of the sensor 140 (shown in FIG. 29), etc. Can be sent to a common area at the edge of the substrate of the sensor 140 using silver ink, metal or any other conductive material. A flexible printed circuit (FPC) may be bonded to this common area by a conductive adhesive to connect the conductive sensor pattern to the touch screen processing unit. During operation of the sensor 140, the touch screen processing unit can detect the capacitance of each capacitive sensing element having, for example, a relaxation oscillator or a switched capacitive front end.

  The number of capacitive sensing elements required to detect a touch through the haptic touch screen system is the required sensor resolution, the physical size of the active area of the capacitive sensing element, the size of the smallest conductive object that will be sensed, And / or based on the pattern of conductive pads deposited on the substrate 118. The pattern of conductive material deposited on the substrate 118 may be designed to detect conductive objects having a predefined size and / or shape, such as a human finger having a diameter of 7 mm or less. However, the pattern of deposited conductive material may be configured to detect any other size or type of conductive object such as a stylus pen formed from a conductive material having a 2 mm tip. Typically, the surface area of the conductive material that defines the capacitive sensing element affects the ability of sensor 140 (and / or tactile touchscreen device or touchscreen processing unit) to accurately detect grounded conductive objects and identify the touch location. Effect. By increasing the surface area of each capacitive sensing element, it increases the sensitivity to grounded conductive objects, thus allowing detection of smaller objects, while this reduces sensor resolution and / or touch May reduce the accuracy of the location. Alternatively, shrinking the surface area of the capacitive sensing element may improve sensor resolution and touch location accuracy, but may reduce the sensitivity of the capacitive sensing element to grounded conductive objects, Therefore, it limits the size of grounded conductive objects that can be detected. For example, it may be desirable to detect only large fingers on the tactile surface 111 and ignore small fingers. Accordingly, the surface area of each sensing element can be set to a size that constitutes the conditions of such a system.

  The haptic element of the user interface may define a three-dimensional haptic element in an expanded setting. A fluid channel in the stack of substrates 118 can connect a non-conductive fluid to the haptic element to lift the haptic surface 111 of the haptic element. When lifted, the haptic element may define a three-dimensional button, slider, and / or scroll wheel. Each haptic element may have a common or unique shape, size and / or raised height above the haptic surface 111.

  As described above, the height of the haptic element can be controlled. In one example, the haptic element is lifted to 25% of its maximum height, and after a period of time it is moved to 100% of its maximum height. In another example, the haptic element is initialized to 100% of its lift height when the system is powered on, but with no user input within a period of time (ie, around the haptic surface 111). (Same plane as the area).

  The area of the haptic surface 111 may include materials of various physical properties that affect the capabilities of the haptic touch screen system to sense a grounded conductive object proximal to the capacitive sensing element. For example, the change in capacitance measured by the capacitive sensing element in response to a finger touching the haptic surface 111 of the haptic element can be smaller than the change in capacitance measured when the finger presses the haptic element. . Thus, a capacitive sensing element can be assigned to a specific physical region of sensor 140 bounded by a haptic element.

  In the example shown in FIG. 30, sensor 140 may define area 1, area 2, area 3, area 4, and / or area 5. Area 1 is defined as a sensor area without a user interface, and when a user interface is not attached to the sensor 140 adjacent to the touch screen surface on the capacitance detection element, the capacitance detection element is arranged in area 1. Area 2 is defined as a sensor region that includes a portion of a user interface that does not include a path channel or haptic element, and a portion of the user interface that does not include a path channel or haptic element is adjacent to the surface of the capacitive sensing element (e.g., The capacitive sensing element is located in area 2. Area 3 is defined as a sensor area that includes a portion of a user interface that contains a fluid channel (conducting or non-conducting) but does not include a haptic element, and that has a chanting element but does not have a haptic element. When a part of the interface is adjacent to the surface of the capacitance detection element, the capacitance detection element is arranged in the area 3. Area 4 is defined as a sensor area attached to a user interface that includes a retracted haptic element, where the center of the capacitive sensing element area is substantially aligned with the center of the retracted haptic element, or A capacitive sensing element is defined as being located in area 4 when the surface of the element is substantially bounded by the boundary of the retracted haptic element. Area 5 is defined as a sensor area attached to a user interface that includes a haptic element in a raised (eg, UP) position, with the center of the surface of the capacitive sensing element aligned with the center of the adjacent raised haptic element. If, or if the surface of the capacitive sensing element is completely bounded by the raised haptic element, the capacitive sensing element may be defined as being in area 5.

  Typically, the size of the haptic element can be smaller, larger or equivalent to the surface area of the adjacent capacitive sensing element. The pitch of adjacent haptic elements (distance between centers) may be greater than the size of the smallest conductive object that will be detected by the sensor 140. The center of the haptic element can be aligned with the center of a pair of adjacent capacitive sensing elements. For example, for a tactile element with a larger surface area than the pair of capacitive sensing elements, one 10 mm diameter tactile element is paired with a 7 mm diameter capacitive sensing element and completely covers the 7 mm diameter capacitive sensing element. Also good. Alternatively, the haptic element can be paired with two or more capacitive sensing elements, and the center of the haptic element can be aligned with the center of at least one capacitive sensing element. For example, as described above, the displacement device 130 moves fluid into the cavity to expand the cavity, thereby transitioning the deformable region to an expanded setting. In this example, the sensing element includes a first component arranged in or adjacent to the cavity, and the second and third components of the sensing element when the deformable region expands to an expanded setting. May include a second component and a third component that are coupled to the haptic layer proximal to the deformable region such that is distributed (ie, spreads). This can extend the effective surface area of the sensing element and improve the sensitivity of the sensing element to a grounded conductive object that touches or is proximal to the haptic surface 111.

  Furthermore, the sensitivity of the capacitive sensing element can be further improved by adding an amount of transparent conductive material on the back of the tactile layer 110 opposite the tactile surface 111 of the tactile element. This improves the capability of the capacitance detection circuit 141 and can detect a finger on the extended tactile element.

  In another implementation, the user interface includes a composite sensor that defines a plurality of unique detection locations that can sense user input. For example, a composite sensor can define a scroll wheel, slider, rotary or cursor control that requires user input at multiple different locations. The pitch of these locations within the composite sensor (ie, the distance between the centers) may be greater than the size of the smallest conductive object that will be sensed by the sensor 140. For example, the cursor-controlled haptic element may be a plus (“+”) shape with up, down, left and right cursor control functions. In this example, the haptic touch screen system can distinguish between an upper, lower, left or right touch when the haptic “+” sign is lifted. The size of the “+” haptic element is such that the pitch between the top, bottom, left and right locations is not smaller than the size of the smallest conductive object that will be detected by the haptic touch screen system. For example, a detection element such as a detection element adjacent to a slider element or scroll element can detect both the height of the touch on the surface of the sensor 140 and the direction of the movement of the touch across the surface of the sensor 140, as described above. it can.

3. Touch Screen Processing Unit As shown in FIG. 29, the tactile touch screen processing unit includes a capacitance detection circuit 141 (for example, a sensor 140), a tactile central processing unit (CPU), and a touch screen CPU 147. The haptic touch screen processing unit may be implemented by multiple discrete components and / or coupled to a single circuit component. The haptic touch screen system may incorporate a touch screen processing unit, and the host CPU may function as the main computer processor of the haptic touch screen system that implements the haptic elements. The host CPU can calculate the touch location from the data received from the haptic CPU 145. The touch screen CPU can also integrate or combine one or more elements of the haptic CPU 145 and the host CPU.

  The capacitance detection circuit 141 can detect the capacitance of each capacitance detection element (for example, the sensor 140). Each capacitance sensing element can include a unique capacitance measurement. Changes in the operating environment of the haptic touch screen system can change the capacitance value measured for each capacitance sensing element during the normal operating mode. For example, a capacitance sensing element pattern, a change in the physical state of a conductive material that defines a change in the environment, or a change in electrical characteristics in the haptic touch screen system may be caused by a change in capacitance measured by the capacitance detection circuit 141. Can cause. Further, when the ground conductive object contacts or comes close to the capacitance detection circuit 141, the ground conductive object can strongly affect the capacitance value detected by the capacitance detection circuit 141.

  Accordingly, the capacitance detection circuit 141 includes adjustable circuit elements that can be reconfigured during the normal operating mode of the haptic touch screen system to control the operation of the haptic touch screen. This is because, for example, depending on the type of area assigned to each capacitive sensing element, the mode or arrangement of adjacent haptic elements, or the operational mode of the haptic touch screen system, It makes it possible to detect the value accurately. Examples of adjustable circuit elements in the capacitance detection circuit 141 include charging voltage, charge current, charging time, discharging time, and transmission frequency. In one example, the voltage or current for charging the capacitance detection element is adjusted. In another example, the amount of time to charge or discharge voltage or current to or from the capacitive sensing element is adjusted.

  A unique set of adjustable circuit element values may be associated with each capacitive sensing element or a subset of capacitive sensing elements. For example, the capacitance detection element in area 3 can be driven with a lower voltage or current than the capacitance detection element in area 5. Additionally or alternatively, the area 2 capacitance sensing element may require a different charging time than the second area sensing element of the same area 2. Depending on the area where the capacitance detection element is located, the capacitance detection element may be associated with more than one set of values for the adjustable circuit element. For example, a capacitive sensing element adjacent to a haptic element in a lifted configuration (ie, area 5) may require a higher charging voltage than when the haptic element is in a retracted position (ie, area 4). The set of values used to detect a touch on the user interface is thus the type of area allocated to the capacitive sensing element, the mode of use of the haptic element adjacent to the capacitive sensing element, and / or the haptic touch screen. It may depend on the operating mode of the system.

  In the tactile touch screen processing unit, the touch screen CPU 147 can control the capacity detection circuit 141 and the state of the user interface. Usually, the touch screen CPU 147 controls the adjustable circuit elements of the capacitance detection circuit 141 to detect the capacitance value of each capacitance detection element, processes the data received from the capacitance detection circuit 141, and the user interface and / or Or the location of any touch detected on the surface of the sensor can be calculated. Touch screen CPU 147 communicates with touch screen CPU 147 and / or haptic CPU 145 via a standard communication interface or protocol, such as i2C, USB, SPI, RF, digital input / output or any other suitable interface or protocol, for example. can do.

  In the haptic touch screen processing unit, the touch screen CPU 147 moves the fluid into the haptic element to move the haptic element between a lift (UP) state, a retract (DOWN) state, and / or a partial lift (PE) state. A motor, pump or other displacement device configured to transition can be further controlled. For example, the touch screen CPU 147 sends a command to the haptic CPU 145 to set the element in the UP, DOWN, or partial lift (PE) state. When in the PE state, the touch screen CPU 147 can set the height of the tactile element. The touch screen CPU 147 can read the state of the tactile element from the capacitance detection circuit 141, and stores the state in the memory for subsequent transmission to the host CPU. The host CPU can then read the state of each haptic element from the touch screen CPU 147, for example, to calculate a touch gesture or user event for a system application that implements the haptic feature. In some applications, the touch screen CPU 147 can calculate system application gestures and user events and can send this information to the host CPU.

  The host CPU may be physically connected to the touch screen CPU 147 via a standard communication interface such as i2C, USB, SPI, RF or other user-defined interface. In implementations where the communication interface implementation defines a master / slave communication protocol, the host CPU may be the master and the touch screen CPU 147 may be the slave. The host CPU can control the operation of the touch screen CPU 147. Therefore, the host CPU can control the capacitance detection circuit 141 and the haptic CPU 145 via the touch screen CPU 147 by executing the command sent on the communication interface. For example, the host CPU notifies the touch screen CPU 147 when to initialize the haptic touch screen system, pauses the haptic touch screen system to the default state or initial factory settings, or instructs the haptic touch screen system to Raise and lower the haptic element. The host CPU can read the location of any one or more fingers or touches adjacent to the capacitance detection circuit 141 or the haptic layer via software commands sent over the communication interface. In addition or alternatively, the host CPU can read the location of any finger or touch that has moved from the capacitive sensing circuit 141 or the adjacent tactile layer previously reported as a touch. The host CPU can analyze the finger location data and calculate the gesture, for example, by comparing the state of the haptic element over time and identifying the user's gesture on the user interface.

4). Tactile Element In a haptic touch screen system, the haptic element can operate in any one or more of binary mode, binary with variable height control mode, force mode, or force with variable height mode.

  In binary mode, the height of the lifted haptic element remains substantially unchanged so that the haptic element can define a standard on / off push button. For example, the haptic element may be considered “off” when in the UP state and the haptic element may be considered “on” when in the DOWN state. During adjustment of the capacitive sensing circuit 141, the parameters of the adjustable circuit element are in contact with (or glaze) the haptic surface 111 of the haptic element, are proximal but not in contact with the surface of the haptic element, or the threshold is “on”. It may be specified to allow accurate detection of a finger or grounded conductive object pushing the haptic element to a level greater than the level. These parameters can be stored in the touch screen CPU memory.

  In binary mode with a variable height control mode, the haptic element can perform two height modes (ie, extended and retracted settings) but has an adjustable raised haptic element height. . For example, some applications may require the haptic element to be raised to 50% of maximum altitude, while other applications may require the button to be raised to maximum altitude. The host CPU can transmit data indicating the desired height of the haptic element by identifying the haptic element to the haptic CPU 145 via the touch screen CPU 147. The capacitance detection circuit 141 can then send this data to the haptic CPU 145, which raises or lowers the haptic element to a desired height based on the data received from the capacitance detection circuit 141. During adjustment of the capacitive sensing circuit 141, the parameters for the adjustable circuit elements are proximal or in contact with the haptic surface 111 of the haptic element, do not contact the surface of the haptic element, or a series of predefined haptic elements. It may be specified to allow accurate detection of a finger or grounded conductive object pushing on the haptic element to a level that is considered “on” for each predefined height at the height. These parameters can be stored in the memory of the touch screen CPU 147.

  In the force mode, the height of the lifted haptic element does not change. However, the haptic touch screen processing unit can report the downward force applied by a finger or grounded conductive object to the lifted haptic element. During adjustment of the capacitance detection circuit 141, parameters for the adjustable circuit element may be specified to allow accurate detection of the force exerted by the finger or grounded conductive object on the lifted haptic element.

  In a force with a variable height control mode, the haptic touchscreen processing unit can control the raised height of the haptic element and is applied by the finger or grounded conductive object to the haptic element in the raised position. Report the power to. The host CPU can transmit to the haptic touch screen CPU 147 data identifying the haptic element and indicating the desired height of the haptic element. The capacitance detection circuit 141 can send this data to the haptic CPU 145, and the haptic CPU 145 raises or lowers the haptic element to a desired height. During adjustment of the capacitance detection circuit 141, the parameters for the adjustable circuit elements provide accurate detection of the force applied by the finger or grounded conductive object to the haptic elements lifted to each of a series of predefined heights. It can be specified to enable. These parameters can be stored in the memory of the haptic CPU 145.

  In one example implementation, the haptic touch screen processing unit tracks the amount of force applied by a finger or grounded conductive object to the raised haptic element. CapNorm is defined as the detected capacitance value of the capacitance detection element adjacent to the center of the tactile element when not touching the finger or the ground conductive object tactile element. CapForce is defined as the detected capacitance value of the capacitive sensing element adjacent to the center of the haptic element when a finger or ground conductive object touches or pushes on the haptic element. TactileForce is defined as the difference between CapNorm and CapForce, and is the detection of inward displacement of a haptic element from an expanded setting due to the force applied to the haptic element by a finger or grounded conductive object. TactileForce is greatest when the haptic element is fully pushed in and can be substantially smaller when a finger or grounded conductive object is lightly resting on the haptic element.

  To detect the force applied to the haptic element by a finger or grounded conductive object while the haptic touch screen is in normal operating mode, the TactileForce reference value is capacitive sensing adjacent to the area 5 force type haptic element. It can be established after adjusting the tactile touch screen processing unit of the device. During adjustment of the haptic touch screen system, CapNorm and CapForce values can be measured at multiple (eg, four) deflection distances of each haptic element. The predefined deflection distance is substantially an accurate measurement of the deflection distance, or is a percentage of the maximum deflection distance, eg, 0-99%, where 99% deflection means that the haptic element is in contact with the haptic surface 111. A 0% deflection defines an example where a finger or grounded conductive object is lightly touching or riding on the haptic element. The TactileForce is then calculated for each deflection distance and is substantially related to the deflection distance of the haptic element. Each TactileForec value and its associated deflection distance may be stored in the non-volatile memory of the touch screen CPU 147 as TactileForexxx, where xx is the deflection rate. During normal operation of the haptic touch screen system, the haptic touch CPU 147 can calculate new TactileForce values and compare them with the stored TactileForce values to identify a deflection value for each haptic element. The deflection value is used by the touch screen CPU 147 or sent to the host CPU when needed by a native application that uses haptic elements for user feedback or system control. For example, in a user interface that allows control of the height of the haptic element, the touch screen CPU 147 may use the deflection data from one haptic element to raise or lower the height of the second haptic element. In another example, the host CPU uses haptic element deflection data in an application that requires user feedback to provide a color palette for use in a graphic arts application running on a digital device incorporating a haptic touch screen system. The brightness level can be controlled.

5. How to adjust the sensor (tactile) When the user interface is applied to a tactile touch screen system, when to adjust the capacitance detection circuit 141 to the optimum sensitivity and process the capacitive touch data to identify the presence of the touch There may be new conditions to be considered. For example, it may be important to distinguish between a finger riding on a lifted tactile button or applying a force on the tactile button. In some applications, it may be more useful to identify how much force a finger or object is exerting on the surface of the lifted haptic element. Typically, the state of the haptic element can affect the capacity detection circuit 141, the firmware running on the touch screen CPU 147, the touch screen CPU 147, and / or the application running on the host CPU. The haptic touch screen processing unit can take into account these effects and / or other effects arising from application of the user interface on the sensor. In the tactile touch screen system and the tactile touch screen processing unit, the capacitance detection element is adjusted for each state of each tactile element to be detected and each conductive object, for example (with a pair of capacitance detection elements). It may be based at least in part on the mode of the haptic element.

  The settings for the adjustable circuit elements of the capacitance detection circuit 141 can be identified, set and / or defined in various ways and with various techniques. The technique for adjusting the capacitance detection circuit 141 for the capacitance detection elements arranged in the area 4 or the area 5 includes the first step, the second step, the third step, the fourth step, and the fifth step, all of which are skilled. Can be performed by any operator and / or machine.

  In the first step, the capacitive sensing element in the absence of any conductive object in contact with the haptic surface, and when not sufficiently close to the haptic surface that acts minimally on the capacitance value measured from the capacitive sensing element The capacitance value of the capacitance detection element is detected. This value is called CapValue1.

  In the second step, a capacitance value is detected when there is a ground conductor object that is in contact with the tactile surface 111 directly above a specific capacitance detection element. The size of the conductive object may be a size specified for the system application. For example, if a human finger is used for system input, use a solid metal slug with the same diameter as the smallest finger specified to be detected by the system. This value is called CapValue2.

  In the third step, the difference between CapValue1 and CapValue2 is calculated. This value is called DiffCount.

  In the fourth step, the adjustable circuit element of the capacitance detection circuit 141 is corrected, and steps 1 to 3 are repeated until DiffCount reaches its maximum value.

  In the fifth step, the setting of the adjustable circuit element of the capacitance detection circuit 141 in the memory of the touch screen CPU 147 is stored. The touch screen CPU 147 reads the stored value during the normal operation of the tactile touch screen system according to the state and operation mode of the capacitance detection circuit 141.

6). Setting Initial Capacitance Detection Element Conditions Prior to operation of the haptic touch screen in normal operation mode, the initial state of the capacitance value of each capacitance detection element can be identified. Normally, the initial capacitance value of the capacitance detection element and the calculation of the finger difference can be stored in the memory of the touch screen CPU 147. This data is then used by the touch screen CPU 147 during normal operation of the capacitance detection circuit 141 to identify whether a touch has been detected and the location of the touch.

  The area of the capacitance detection circuit 141 outside the area where the user interface is attached is called TSA1. For each capacitive sensing element in TSA1, capacitive sensing circuit 141 has no finger or other conductive object in contact with any part of the user interface or sensor surface, and from the user interface or sensor surface. Capacitance values of fingers or other conductive objects can be sensed that are at a substantial distance away and act minimally on the electric field proximal to the capacitive sensing element. The touch screen CPU 147 can read the capacitance value from the capacitance detection circuit 141, saves this value in the memory under the name CVxA1D, and x is the number of specific capacitance detection elements. This capacitance value is used by the touch screen CPU 147 to specify whether a touch has occurred and where in the TSA 1 the touch has occurred.

  For each capacitance detection element in TSA1, capacitance detection circuit 141 can detect the capacitance value due to a specific minimum size finger or grounded conductive object in contact with the haptic surface adjacent to the specific capacitance detection element. . The touch screen CPU 147 can read the capacitance value from the capacitance detection circuit 141, saves this value in the memory together with the name FCVxA1, and x is the number of the specific capacitance detection element. This capacitance value is used by the touch screen CPU 147 to specify whether a touch has occurred and whether a touch has occurred at TSA1. If the haptic touch screen system is designed to detect grounded conductive objects of different sizes and dielectric materials, repeat this measurement for each particular object. Prior to each measurement, the touch screen CPU 147 can initialize the configurable elements of the capacitance detection circuit 141 with the values stored during adjustment of each capacitance detection element with the desired conductive object.

  The touch screen CPU 147 can calculate the difference between CVxA1 and FCVxA1 for each capacitance detection element of TSA1. This value is a capacitance finger difference threshold, and is stored as FDxA1 in the memory of the touch screen CPU 147, where x is the number of specific capacitance detection elements. This value may represent the change in capacitance of a particular capacitance detection element when a finger contacts the haptic surface 111 adjacent to the capacitance detection element. This value is used by the touch screen CPU 147 to identify whether a touch has occurred and where in the TSA 1 the touch has occurred.

  The area of the capacitance detection circuit 141 to which the user interface is attached and does not have a path channel or haptic element is called TSA2. For each capacitive sensing element in TSA 2, capacitive sensing circuit 141 is free from fingers or other conductive objects in contact with any part of the user interface or sensor surface and is substantially from the user interface or sensor surface. The capacitance value of a finger or conductive object that is minimally affected by the electric field proximal to the capacitive sensing element can be detected. The touch screen CPU 147 can read the capacitance value from the capacitance detection circuit 141, saves this value in the memory under the name CVxA2, and x is the number of specific capacitance detection elements. The capacitance value is used by the touch screen CPU 147 to identify whether a touch has occurred and where in the TSA 2 the touch has occurred.

  For each capacitance detection element in TSA2, the capacitance detection circuit 141 can detect the capacitance value with a specified minimum size finger or grounded conductive object that touches the haptic surface adjacent to the specific capacitance detection element. The touch screen CPU 147 can read the capacitance value from the capacitance detection circuit 141, saves this value in the memory with the name FCVxA2, and x is the number of specific capacitance detection elements. This capacitance value is used by the touch screen CPU 147 to identify whether a touch has occurred and where in the TSA 2 the touch has occurred.

  The touch screen CPU 147 can calculate the difference between CVxA2 and FCVxA2 for each capacitance detection element of TSA2. This value is a capacitance finger difference threshold, and is stored as FDxA2 in the memory of the touch screen CPU 147, where x is the number of specific capacitance detection elements. This value may represent the change in capacitance measured for the capacitive sensing element when a finger touches the haptic surface 111 adjacent to the capacitive sensing element. This value is used by the touch screen CPU 147 to identify whether a touch has occurred and where in the TSA2.

  The area of the capacitive sensing circuit 141 that is attached to the user interface and includes a path channel containing a non-conductive fluid and does not have a haptic element is called TSA3. For each capacitive sensing element in TSA 3, capacitive sensing circuit 141 has no finger or other conductive object in contact with any part of the user interface or sensor surface, and the user interface or sensor surface. The capacitance value of the finger or conductive object that is minimally affected by the electric field proximal to the capacitive sensing element can be detected. The touch screen CPU 147 can read the capacitance value from the capacitance detection circuit 141, saves this value in the memory under the name CVxA3, and x is the number of the specific capacitance detection element. This capacitance value is used by the touch screen CPU 147 to identify whether a touch has occurred and where in the TSA 3 the touch has occurred.

  For each capacitance detection element in the TSA 3, the capacitance detection circuit 141 can detect the capacitance value with a specific minimum size finger or grounded conductive object that contacts a user interface adjacent to the specific capacitance detection element. The touch screen CPU 147 can read the capacitance value from the capacitance detection circuit 141, saves this value in the memory under the name FCVxA3, and x is the number of specific capacitance detection elements. This capacitance value is used by the touch screen CPU 147 to identify whether a touch has occurred and where in the TSA 3 the touch has occurred.

  The touch screen CPU 147 can calculate the difference between CVxA3 and FCVxA3 for each capacitance detection element of TSA3. This value is a capacitance finger difference threshold, and is stored as FDxA3 in the memory of the touch screen CPU 147, where x is the number of specific capacitance detection elements. This value may represent a change in capacitance of the capacitance detection element when a finger contacts the user interface located above the capacitance detection element. This value is used by the touch screen CPU 147 to identify whether a touch has occurred and where in the TSA 3 the touch has occurred.

  The area of the capacitance detection circuit 141 that is attached to the user interface and includes the tactile element in the retracted position is referred to as TSA4. For each capacitive sensing element in TSA 4, capacitive sensing circuit 141 is free of fingers or other conductive objects in contact with any part of the user interface or sensor surface and is substantially from the user interface or sensor surface. The capacitance value of a finger or conductive object that is minimally affected by the electric field proximal to the capacitive sensing element can be detected. The touch screen CPU 147 can read the capacitance value from the capacitance detection circuit 141 and stores this value in the memory under the name CVxA4, where x is the number of specific capacitance detection elements. This capacitance value is used by the touch screen CPU 147 to identify whether a touch has occurred and where in the TSA 4 the touch has occurred.

  For each capacitance detection element in TSA 4, the capacitance detection circuit 141 determines the capacitance value of the capacitance detection element with a specific minimum size finger or grounded conductive object that contacts the surface of the retracted tactile element adjacent to the capacitance detection element. Can be detected. The touch screen CPU 147 can read the capacitance value from the capacitance detection circuit 141, saves this value in the memory under the name FCVxA4, and x is the number of specific capacitance detection elements. This capacitance value is used by the touch screen CPU 147 to identify whether a touch has occurred and where in the TSA 4 the touch has occurred.

  The touch screen CPU 147 can calculate the difference between CVxA4 and FCVxA4 for each capacitance detection element of TSA4. This value is a capacitance finger difference threshold, and is stored in the memory of the touch screen CPU 147 as FDxA4, and x is the number of specific capacitance detection elements. This value may represent the change in capacitance of the capacitance detection element when a finger contacts the surface of the retracted tactile element adjacent to the capacitance detection element. This value is used by the touch screen CPU 147 to identify whether a touch has occurred and where in the TSA 4 the touch has occurred.

  The area of the capacitance detection circuit 141 that is attached to the user interface and includes the haptic element in the raised (UP) position is called TSA5. For each capacitive sensing element in TSA 5, capacitive sensing circuit 141 is free of fingers or other conductive objects in contact with any part of the user interface or sensor surface and is substantially from the user interface or sensor surface. The capacitance value of a finger or conductive object that is minimally affected by the electric field proximal to the capacitive sensing element can be detected. The touch screen CPU 147 can read the capacitance value from the capacitance detection circuit 141, saves this value in the memory under the name CVxA5, and x is the number of specific capacitance detection elements. This capacitance value is used by the touch screen CPU 147 to identify whether a touch has occurred and where in the TSA 5 the touch has occurred.

  For each capacitive sensing element in TSA 5, capacitive sensing circuit 141 senses the capacitive value with a specific minimum size finger or grounded conductive object that touches a raised haptic element adjacent to the capacitive sensing element but does not apply pressure. can do. The touch screen CPU 147 can read the capacitance value from the capacitance detection circuit 141, saves this value in the memory under the name FRCVxA5, and x is the number of specific capacitance detection elements. This capacitance value is used by the touch screen CPU 147 to specify whether or not a finger is on the lifted tactile element and the location of the touch.

  The touch screen CPU 147 can calculate the difference between CVxA5 and FRCVxA5 for each capacitance detection element of TSA5. This value is a capacitance finger difference threshold value, and is stored in the memory of the touch screen CPU 147 as FRDxA5, and x is the number of specific capacitance detection elements. This value may represent the change in capacitance of the capacitance sensing element when the finger contacts but does not push into the lifted haptic element (ie, when the finger is “riding” on the haptic element). This value is used by the touch screen CPU 147 to specify whether a finger is on the tactile element at the UP position and the position of the touch.

  For each capacitance detection element in the TSA 5, the capacitance detection circuit 141 can detect the capacitance value with a specific minimum size finger or grounded conductive object that touches or pushes the haptic element into the haptic surface 111. . The touch screen CPU 147 can read the capacitance value from the capacitance detection circuit 141, saves this value in the memory under the name FDCVxA5, and x is the number of specific capacitance detection elements. This capacitance value is used by the touch screen CPU 147 to specify whether the finger is pushing the tactile element at the UP position.

  The touch screen CPU 147 can calculate the difference between CVxA5 and FDCVxA5 for each capacitance detection element of TSA5. This value is a capacitance finger difference threshold, and is stored in the memory of the touch screen CPU 147 as FDDxA5, where x is a number of a specific capacitance detection element. This value can represent the change in capacitance of the capacitance detection element when the finger is pressed down on the tactile element at the UP position, and is used by the touch screen CPU 147 to move the tactile element at the UP position. It is possible to specify whether the button is depressed.

  In an application, the state of the haptic element can affect the capacitance measurements of area 1, area 2 and area 3 capacitance sensing elements. Thus, the method or technique described above can be repeated for Area 1, Area 2 and Area 3 of the haptic element with the haptic element in area 5 lifted. These values are stored in the memory of the touch screen CPU 147 in the table labeled TactileUP_x, where x represents an area where the capacitance detection element is arranged.

7). Operation After the electronic device including the haptic touch screen system is powered on, the host CPU sends a command to the touch screen CPU 147 to initialize the haptic touch screen system, eg, initial extension settings and / or retraction of the haptic elements. Settings can be set. The touch screen CPU 147 can send a command to the touch screen CPU 147 to raise or lower the haptic element as instructed by the host CPU. The touch screen CPU 147 can control fluid displacement that raises and lowers the haptic element. The capacitance detection circuit 141 can communicate with the touch screen CPU 147 via various communication methods such as i2C interface, serial interface, SPI, or digital input / output. The touch screen CPU 147 can transmit the state of the tactile element (for example, expansion or retraction) to the capacitance detection circuit 141. Capacitance detection circuit 141 selects the area of capacitance detection circuit 141 using the state of the haptic element and processes sensor data (eg, the presence and / or location of a touch or depression on the lifted haptic element). Scan).

  The touch screen CPU 147 can set an initial state for a detection element (for example, a programmable detection element) of the capacitance detection circuit 141 used by the capacitance detection circuit 141 in order to detect the capacitance value of each capacitance detection element. In the normal operation mode, depending on the state of the tactile element, the capacitance detection circuit 141 adjusts the circuit element to control the sensitivity of the capacitance detection electronic device used to detect the capacitance value of the capacitance detection element. Can do. These circuit elements may include voltages and currents driven on the capacitance detection elements, scan times of each capacitance detection element, or reference voltages used by analog and / or digital circuits of the capacitance detection circuit 141. These adjustments may affect the sensitivity, signal-to-noise ratio, and / or capacitance sensing circuit 141 with respect to certain physical and / or environmental conditions that may affect system performance during normal operation of the haptic touch screen system. The scan time can be varied.

  The touch screen CPU 147 can send a command to the capacitance detection circuit 141 to scan the capacitance value of the capacitance detection element on the capacitance detection circuit 141. The capacitance detection element arranged in the area 4 can be scanned only when the tactile element is in the DOWN position, and the capacitance detection element arranged in the area 5 can be scanned only when the tactile element is in the UP position. The capacitance detection circuit 141 can stop operating when all the capacitance detection elements in the active sensor area of the sensor 140 are scanned. After the capacitance detection circuit 141 completes scanning of each capacitance detection element of the sensor 140, the capacitance detection circuit 141 can read the capacitance value from the capacitance detection circuit 141 and process the data. During this data processing phase, the capacitance value of the capacitance detection element is filtered (eg, compared with a previously stored capacitance value) by the capacitance detection circuit 141 to remove electrical noise, detect an ESD event, and / or Adjust temperature effects or other physical conditions that affect sensor performance. This can cause a new capacitance value for each capacitance detection element. The capacitance detection circuit 141 can store the capacitance value of the new capacitance detection element in the memory under the name New_CVxAy, x is the number of capacitance detection elements, and y is the capacitance detection circuit 141 in which the capacitance detection elements are arranged. Area. Since the capacitance detection circuit 141 can compare the capacitance value of the new capacitance detection element with the capacitance value stored in the memory from the previous scan, the capacitance detection circuit 141 changes the state of the haptic element. Sensor area 4 and area 5 can be scanned twice.

  In one example implementation, the capacitance detection circuit 141 identifies the presence of a finger touch on the capacitance detection circuit 141 by calculating the difference between NewCVxAy and CVxAy. This result is stored as DIFFCVxAy, where x is the number of capacitance detection elements, and y is the area of the capacitance detection circuit in which the capacitance detection elements are arranged. After that, when DIFFCVxAy is equal to or larger than the capacitance finger difference threshold stored in the memory in advance as FDxA1, FDxA2, and FDXA3 for the capacitance detection element, the capacitance detection circuit 141 selects the specific capacitance of area 1, area 2, or area 3 It can be identified that a touch is present on the sensing element. If the tactile element is in the DOWN state, and if DIFFCVxA4 is greater than FDxA4, it can alternatively be specified that there is a touch for any capacitive sensing element in area 4, where x is the capacitive sensing element Is a number. When the tactile element is in the UP state, and when DIFFCVxA5 is larger than FRDxA5 or FDDxA5, the capacitance detection circuit 141 may alternatively specify that a touch exists for any capacitance detection element in area 5. it can. When the tactile element is in the UP state and when DIFFCVxA5 is larger than FRDxA5 and smaller than FDDxA5, the capacitance detection circuit 141 can specify that a finger is on the tactile element. When the tactile element is in the UP state and when DIFFCVxA5 is larger than FDDxA5, the capacitance detection circuit 141 can specify that the finger is pressing the tactile element. If no touch is detected, the capacitance detection circuit 141 can update the capacitance value (CVxAy) of the capacitance detection element stored in the memory with the latest capacitance value (NewCVxAy). For each capacitance detection element in which a touch is detected, the capacitance detection circuit 141 can calculate the XY location of the touch and store the location data in the memory with the name TOUCH_x_y, where x and y are the X coordinates of the touch, respectively. And the Y coordinate. The range of x and y may be system dependent and may be defined by the size of the capacitance detection circuit 141 and the required touch resolution.

  In implementations that allow direct hardware (h / w) connections to interrupt pins on the host CPU, the capacitance detection circuit 141 may include a digital output pin connected to the interrupt pins on the host CPU. Upon detection of a touch event or removal of a previously reported touch, the capacitance detection circuit 141 sets an output pin to a state required by the host CPU and triggers an interrupt. Thereafter, the host CPU can recognize the interrupt and read the updated touch data from the capacitance detection circuit 141. Further, the host CPU can send a command to the capacitance detection circuit 141 to restart the scan processing of the capacitance detection element.

  In implementations that do not allow direct connection to interrupt pins on the host CPU, a software-based messaging protocol is used between the host CPU and the capacity detection circuit 141 to touch the host CPU from the capacity detection circuit 141. Data can be transmitted. This messaging protocol allows the host CPU to begin scanning the capacitance detection element, waits for the scan to complete by reading the scan status from the capacitance detection circuit 141, and any new touches from the capacitance detection circuit 141. Data can be read out. However, any one or more of these methods or techniques may be performed without interfering with the operation of the capacitance detection circuit 141.

  The foregoing techniques and methods may be implemented with systems and methods that define and store finger thresholds useful for accurate and repeatable touch sensing on the tactile surface. However, the foregoing techniques and methods are systems and methods that define and store noise thresholds that are useful for filtering unwanted noise from the output of electrodes and / or distinguishing noise from touching potentials on the haptic surface. Can be executed. The system and method can also implement data processing algorithms to compensate for finger or noise threshold drift due to temperature changes or other environmental effects, for example. The system and method perform any one or more of any one or more of automatic adjustments, manual adjustments, filtering (in hardware or software), compensation algorithms, and qualification requirements to overcome detector element noise. be able to.

  The system and method described above interpolates the location of the touch on the haptic surface by triangulating, averaging or calculating the center of gravity of the output of a capacitance detection circuit 141 (eg, sensor 140) of multiple electrodes or sensing elements. Can do. The system and method further includes sampling filters (eg, data collection and averaging), integrated filtering (eg, adjustment of measured capacitance time), touch sensing filtering (eg, finger threshold), coordinate filtering (eg, a series of Continuous touch coordinate values averaging), or any other suitable filtering method or technique that identifies touches on the haptic surface and / or identifies the location of the touch in the capacitance detection circuit 141. Can be executed. The system and method can also adjust touch sensor sensitivity based on the near future, ongoing or latest touch on the tactile surface, and the system and method can further perform multiplexing; Minimize the number of processor or CPU inputs required to read the state of multiple row or column electrodes. However, the system and method may additionally or alternatively perform any other suitable element, component, technique or method to detect a touch on a haptic surface or to locate a touch. Can do.

  In the foregoing implementation, the system and method may be configured to detect an ungrounded finger or stylus pen. Further, the capacitive sensing element can be arranged in the capacitive sensing circuit 141 or other area of the haptic touch screen system. For example, the capacitive sensing elements can be arranged in or form part of a liquid crystal display (LCD), for example, such that the electronic drive is in a line between the LCD pixels. Alternatively, the capacitive sensing element may be positioned adjacent to the liquid crystal display opposite the haptic surface 111 or may be integrated into the display 150 system. Thus, the capacitive sensing element can perform in-cell type, on-cell type, hybrid type or any other suitable type of capacitive sensing.

  Further, the capacitance detection element may be a “pressed-capacitive” sensor that detects a change in capacitance when the distance between a series of electrodes changes due to user input. Thus, the systems and methods described above (eg, a projected capacitive sensor) may be applied to a pressure capacitive sensor as well, and the difference in pressure transmitted through the haptic layer 110 having a button lifted compared to a retracted button is Can be associated with various types of user input. The aforementioned systems and methods (eg, projected capacitive sensors) are similarly capacitive sensing elements that are resistive touch sensors that rely on changes in the distance between sensing layers, or any other suitable type of resistive tactile sensor or You may apply to the capacity | capacitance detection element which is a capacity | capacitance touch sensor.

  However, the capacitive sensing element may alternatively be any other suitable type of touch sensor. For example, the capacitive detection element can be a light detection sensor arranged in a pixel-based display incorporating a tactile surface. In this example, the light detection capacitance detection element changes the height of the finger on the tactile surface (eg, a finger placed or depressed) by monitoring the reflected or transmitted light pattern on the light detection grid of the capacitance detection element. Can be detected. The capacitive sensing element may alternatively comprise a resistive touch sensor element, an electromagnetic sensing element, a surface acoustic wave touch sensor, an optical touch sensor, or any other suitable type of touch sensor, and the system described above And any of the methods may similarly be applied or adapted to any suitable type of capacitive sensing element or capacitive sensing sensor.

8). First Method As shown in FIG. 31, a method S100 for controlling a dynamic haptic user interface (including a haptic layer and a substrate) is a step of detecting a capacitance value over a portion of a cavity in block S110, The haptic layer defines a deformable region and a peripheral region, the peripheral region is coupled to the substrate adjacent to the deformable region and opposite the haptic surface, and the deformable region cooperates with the substrate. Defining a cavity; estimating a vertical position of the tactile surface of the deformable region based on a capacitance value detected over a portion of the cavity in block S120; and manipulating pressure of fluid in the cavity in block S130. And the vertical position of the tactile surface of the deformable area according to the difference between the estimated vertical position of the tactile surface of the deformable area and the target vertical position of the tactile surface of the deformable area Modifying the position and detecting in block S140 an input on the tactile surface of the deformable region based on a change in the capacitance value measured over a portion of the cavity.

  Typically, method S100 functions to perform a closed feedback loop to control the height of the deformable region (ie, haptic element) of the dynamic haptic user interface described above.

  Block S110 of method S100 is a step of detecting a capacitance value over a portion of the cavity, wherein the haptic layer defines a deformable region and a peripheral region, the peripheral region being adjacent to the deformable region and the haptic surface. The opposite side is coupled to the substrate and the deformable region lists the step of defining a cavity in cooperation with the substrate. The haptic user interface, cavity, substrate, haptic layer, sensor, etc. may be of any configuration or combination of the above configurations. For example, the sensor may be electrically coupled to a first conductor pad electrically coupled to a vertical array of conductor pads patterned across the substrate and a lateral array of conductor pads patterned across the substrate, as described above. Second conductive pads. In this example, block S110 can thus detect a capacitance value across the first and second conductor pads adjacent to the cavity. Block S110 can also simultaneously detect multiple capacitance values across various portions of the cavity (and / or haptic layer), eg, via multiple sensor elements adjacent to the cavity. However, block S110 can detect one or more capacitance values over one or more portions of the cavity through any other suitable method and any other one or more sensor elements. As described above, block S110 also includes charging voltage, charge current, charging time, discharging time across cavities such as first and second conductor pads arranged on a substrate proximal to the deformable region, for example. Any one or more of the transmission frequencies can be detected. However, block S110 can detect one or more capacitance values over one or more portions of the cavity in any other suitable manner.

  Block S120 of method S100 lists estimating the vertical position of the haptic surface of the deformable region based on the capacitance value detected over a portion of the cavity. Block S120 may perform any of the techniques or methods described above to relate the capacitance value output from the sensor element to the vertical position of the deformable region. In one implementation, block S120 is based on a comparison of the capacitance values detected over the portion of the cavity with a stored capacitance map that identifies the vertical position of the haptic surface of the various deformable regions of the haptic layer. Estimate the vertical position of the tactile surface. In this example, the capacitance map may be a capacitance map specific to the predicted position, atmospheric pressure and / or ambient temperature of various haptic elements of the haptic user interface, as described above. For example, block S120 can estimate the vertical position of the tactile surface of the deformable region based on a capacitance map of the electric field distribution over the portion of the substrate. Accordingly, block S120 may include selecting a volume map from the series of volume maps based on the estimated vertical position of the series of deformable regions of the haptic layer, as described above.

  Block S120 may interact with a pressure sensor that is fluidly coupled to the cavity to verify or identify the vertical position of the deformable region. For example, block S120 can verify the estimated vertical position of the haptic surface by the fluid pressure in the cavity, where the fluid pressure is related to the vertical position of the haptic surface in the deformable region. However, block S120 can function in any other way to estimate the vertical position of the haptic surface of the deformable region.

  Block S130 of method S100 manipulates the fluid pressure in the cavity to deform according to the difference between the estimated vertical position of the deformable area haptic surface and the target vertical position of the deformable area haptic surface. The step of correcting the vertical position of the haptic surface of the region is cited. Typically, block S130 interacts with the displacement device as described above to adjust the height of the deformable region through manipulation of fluid pressure within the cavity. For example, as described above, block S130 can control a displacement device including a pump to move fluid through the fluid channel and into the cavity to expand the deformable region. Thus, block S130 can perform the estimated vertical position output by block S120 to control the vertical position of the deformable region, and thus for a particular size and / or shape on the haptic surface. Achieve specific tactile formation.

  In one implementation, block S130 modifies the vertical position of the deformable region's haptic surface to approach the target vertical position that defines the extended settings. As described above, the haptic surface of the deformable region is lifted upward from the haptic surface of the peripheral region of the extension setting. Alternatively, block S130 controls the fluid pressure in the cavity to rate expansion from 0% expansion (ie, fully retracted setting) to 100% expansion (ie, fully expanded setting). Can be brought close to the target vertical position that defines However, block S130 can function in any other manner to modify the vertical position of the haptic surface in the deformable region.

  Block S130 may further adjust the drive voltage across a portion of the capacitive touch sensor based on the estimated vertical position of the deformable region. In this implementation, the capacitive touch sensor may include a series of conductor pads patterned over the substrate and cooperating to detect a capacitance value over a portion of the tactile layer and block In step S130, the electric field that is output by the capacitive touch sensor (that is, the capacitive detection element) and that passes through the cavity can be adjusted based on the vertical position of the deformable region by adjusting the sensor driving voltage. For example, block S130 performs one or more of the techniques described above to modify the drive voltage, drive frequency, and / or refresh rate, etc., and adjust the output of the capacitive sensing element adjacent to the cavity, thereby varying various It is possible to detect an input on the tactile surface of the position of the deformable region. However, block S130 can function in any other manner to modify the function of the capacitive touch sensor adjacent to the deformable region based on the estimated vertical position of the deformable region.

  The block S110, the block S120, and the block S130 are also proportional (P), proportional derivative (for example, part of each deformable area of the current target vertical position of the deformable area set by the host CPU described above, for example. Performing PD), proportional integral derivative (PID) or other closed loop feedback control (ie, via a displacement device) may be repeated periodically.

  Block S140 of method S100 lists detecting an input on the tactile surface of the deformable region based on a change in the capacitance value measured over a portion of the cavity. Typically, block S140 functions to correlate the change in capacitance value measured over a portion of the cavity with the input on the haptic surface. In one implementation, block S140 includes an expansion setting sensor input threshold that identifies the output of the capacitance sensor coupled to the substrate and the minimum capacitance value change associated with the input on the expansion setting deformable region. And detecting input. For example, block S140 generates a current capacity map based on the recent output of the sensing element of the sensor, compares the recent capacity map with the previous capacity map, and for capacity maps that exceed the threshold capacity value variation. Based on the difference between them, it is possible to identify an input in a specific region associated with a specific sensor element. Accordingly, block S140 may include variations in electrostatic threshold capacitance values, variations in threshold capacitance values specific to one or a subset of the deformable region, or variations in dynamic threshold capacitance values in one or more deformable regions (eg, 1 Associated with the position of the above deformable region).

  Block S140 can also distinguish between touching the deformable region on the tactile surface and deformation inside the deformable region based on the magnitude of the change in capacitance value measured over a portion of the cavity. . For example, the block S140 is a soft input (for example, an input that does not deform the deformable region inwardly based on a change in threshold capacitance that is larger than the variation in threshold soft input capacitance value and smaller than the variation in threshold hard input capacitance value. ) Can be identified. Block S140 may also identify a hard input (eg, an input that deforms the deformable region inward) based on a change in threshold capacitance that is greater than a change in threshold hard input capacitance value. However, block S140 can function in any other manner to detect input on the tactile surface of the deformable region.

9. Second Method As shown in FIG. 31, a method S200 for controlling a dynamic haptic interface (including a haptic layer and a substrate) detects, in block S210, a first capacitance value over a portion of a retracted cavity. The tactile layer defines a deformable region and a peripheral region, the peripheral region is adjacent to the deformable region and bonded to the substrate opposite the tactile surface, and the deformable region cooperates with the substrate. Working to define a cavity; detecting a second capacitance value over a surrounding region at block 220; generating a capacitance map according to the first capacitance and the second capacitance at block S230; In block S240, modifying the fluid pressure in the cavity to transition the cavity to the expanded setting, wherein the deformable region is lifted from the peripheral region of the expanded setting. A step of detecting a third capacitance value over a portion of the extended setting cavity in block S250, updating a capacitance map based on the third capacitance of block S260, and a portion of the cavity in block S270. Detecting input on the tactile surface of the deformable region based on a comparison between the capacitance value detected over time and the capacitance map.

  Generally, method S200 functions to perform a volume map to identify input on the haptic surface of the dynamic haptic user interface described above.

  Block S210 of method S200 is a step of detecting a first capacitance value over a portion of the retracted cavity, wherein the haptic layer defines a deformable region and a peripheral region, the peripheral region adjacent to the deformable region. A step of being coupled to the substrate opposite the tactile surface and the deformable region cooperating with the substrate to define a cavity. Typically, block S210 functions to collect output from sensing elements adjacent or proximal to the deformable region of the haptic layer, as described above. For example, the block S210 can detect a change in the capacitance decay time (or ratio) between the two conductor pads of the capacitance detection element. As described above, the conductor pads of the capacitive sensing element may be capacitively coupled to or driven to the peak drive voltage, and block S210 may be from a first percentage to a second (low) percentage of the peak drive voltage. The capacity decay time can be detected. In this example, therefore, block S210 can detect a first capacitance value that includes the magnitude of the disruption in the change in electric field across a portion of the cavity. However, block S210 can function in any other manner to detect a first capacitance value over a portion of the retracted cavity.

  Block S220 of method S200 lists the step of detecting the second capacitance value over the peripheral region. Typically, block S220 can perform a technique similar to that of block S210 to detect a capacitance value over one or more portions of the surrounding area. However, the block S220 can function in any other way to detect the capacitance value over the surrounding area.

  Block S230 of the method S200 lists generating a capacity map according to the first capacity and the second capacity. Normally, the block S230 functions to output a capacity map including the capacity values measured over the deformable area and the peripheral area, as described above. Block S230 sums any number of capacitance values output by any number of sensing elements at substantially the same time to define a capacitive map defining an image of capacitive coupling between sensor capacitance pads at a particular time. Can be created.

  In one implementation, block S230 provides capacitive discharge time over a first set of electrically coupled conductor pads in a vertical array and a second set of electrically coupled capacitive pads in a lateral array patterned across the substrate. Mapping, the first capacitance value includes a capacitive discharge time between the first conductor pad of the first array and the first conductor pad of the second array proximal to the cavity, and the second capacitance value is as described above. As such, it includes a capacitive discharge time between the second conductor pads of the first array and the second conductor pads of the second array proximal to the peripheral region. However, block S230 can function in any other manner to generate a capacity map.

  Block S240 of method S200 lists the steps in which the fluid pressure in the cavity is changed to transition the cavity to the expanded setting, and the deformable region is lifted above the peripheral region of the expanded setting. In general, block S240 may perform the technique of block S130 of method S100 and / or any other aforementioned technique or other technique for controlling the vertical position of the deformable region of the haptic layer. For example, block S240 may control the displacement device to move fluid from the reservoir into the cavity through the fluid channel to transition the deformable region from the retracted setting to the expanded setting. However, block S240 can function in any other manner to transition the cavity to the expanded setting.

  Block S240 may further modify the drive voltage across the first conductor pads of the first array and the first conductive pads of the second array proximal to the cavity in response to the transition of the cavity to the expanded setting. Normally, block S240 may function similarly to block S130 described above, while block S240 functions in any other manner to adjust or modify the function of one or more capacitive sensing elements of the sensor. Can do.

  Block S250 of method S200 lists detecting a third capacitance value over a portion of the extended setting cavity. Typically, block S250 performs one or more of the techniques described above to function to detect a capacitance value of a portion of the cavity when the deformable region is in an expanded setting and thus lifted over the peripheral region. . Block S250 may further perform a closed feedback loop to control fluid pressure within the cavity based on the height of the deformable region haptic surface, where the height of the deformable region haptic surface is as described above. Associated with a capacitance value measured over a portion of the cavity. However, block S250 may function in any other manner to detect a third capacitance value over a portion of the extended setting cavity.

  Block S260 of method S200 lists the step of updating the capacity map based on the third capacity. Typically, block S260 generates a new or modified capacitance map capacitance map based on the most current sensor output, eg, capacitance values captured substantially simultaneously from various capacitance sensing elements patterned over the substrate. To function. For example, block S260 can update the capacity map based on the capacity values associated with both the deformable area and the surrounding area when the deformable area is in the expanded setting, and block S260 is further defined by the haptic layer. The volume map can be further updated based on volume values associated with a series of additional peripheral regions and cavities defined by the substrate. However, block S260 can function in any other manner to update the capacity map based on one or more recently detected capacity values.

  Block S270 of method S200 lists detecting an input on the tactile surface of the deformable region based on a comparison between the detected capacitance value measured over a portion of the cavity and the capacitance map. Typically, block S270 performs multiple (eg, continuous) capacitance maps to identify changes in capacitance values measured over a portion of the haptic surface and to detect changes in capacitance values in one of the haptic surfaces. Functions to associate with input on the haptic surface proximal to the part. Accordingly, block S270 can perform one or more of the techniques described above to detect input on the haptic surface.

  Block S270 may detect the location, size and / or speed of one or more inputs on the haptic surface of the deformable area of the extended setting. In one implementation, block S270 calculates the centroid of the output of the series of capacitive sensing elements adjacent to the cavity to identify the location of the input. In this implementation, the sensor may thus include a plurality of capacitive sensing elements proximal to the deformable region. In one example, block S270 identifies an input contact point on the haptic surface based on a capacitance value detected across multiple portions of the cavity, identifies the centroid of the contact point, and includes the centroid of the contact point and the deformable region. Based on the comparison between the input area on the haptic surface of the proximal known location, the input on the tactile surface of the deformable region is detected, each input area defining an input confidence interval. As described above, block S270 can therefore apply a confidence level for input across a region or regions on the haptic surface, where the confidence level for each region is the predicted input area or It can be based on a location relative to the input center.

  Additionally or alternatively, block S270 detects input on the haptic surface of the deformable region based on the identified centroid of the contact point in a particular input area on the haptic surface for a period greater than the threshold period. The threshold period may be based on an input confidence interval associated with a particular input area. Block S270 can also calculate the speed of the input based on a time-dependent change in the capacitance value detected over a portion of the cavity. In this implementation, block S270 may further associate the device command with the speed of input. For example, block S270 may relate the input speed to the output magnitude change or scroll speed.

  Block S270 further predicts the input mode (eg, finger, stylus pen), selects an input model based on the predicted input mode, and detects the capacitance value and capacitance detected over a portion of the cavity, as described above. The input on the tactile surface of the deformable region can be detected based on the output of the input model corresponding to the difference from the map. For example, block S270 predicts an input mode that is one of a finger input and a stylus input, and the current vertical position of the input mode and the deformable region, and the current of the second deformable region defined by the haptic layer. The input model corresponding to the vertical position can be selected. However, block S270 can function in any other manner to detect input on the tactile surface of the deformable region.

  The systems and methods of this embodiment may be embodied and / or at least partially implemented as a machine configured to receive a computer readable medium that stores computer readable instructions. The instructions may be executed by computer-executable components integrated with hardware / firmware / software elements of the system, optical sensor, processor, display, system or portable electronic device, or any suitable combination thereof. . Other systems and methods of this embodiment may be embodied and / or at least partially implemented as a machine configured to receive a computer readable medium storing computer readable instructions. The instructions may be executed by a computer-executable component integrated by a computer-executable component integrated into a device and network of the type described above. The computer readable medium is any suitable computer readable medium such as RAM, ROM, flash memory, EEPROM, optical device (CD or DVD), hard drive, floppy drive, or any suitable device. It can be stored on a medium. The computer-executable component may be a processor, but may be any suitable dedicated hardware device capable of executing instructions (alternatively or additionally).

  Those skilled in the art can make modifications and variations to the embodiments of the present invention from the foregoing detailed description and from the drawings and claims without departing from the scope of the present invention as defined in the following claims. You will recognize that.

Claims (38)

A substrate;
A tactile layer comprising a tactile surface, wherein the deformable region of the tactile layer cooperates with the substrate to define a cavity, and the peripheral region of the tactile layer is adjacent to the periphery of the cavity on the substrate. Combined with the tactile layer,
An amount of fluid disposed within the cavity;
A displacement device configured to operate the amount of fluid to shift the deformable region from a retracted setting to an extended setting, wherein the deformable region is the periphery of the tactile surface at the retracted setting. A displacement device that is coplanar with a region and deviates from the peripheral region of the haptic surface with the extended setting;
A sensor comprising a series of sensing elements, wherein each sensing element of the series of sensing elements is configured to detect a capacitance value over a portion of the tactile layer;
A processor configured to detect an input on the tactile layer of the deformable region of the reverse setting according to an output of the sensor and a reverse setting sensor input threshold, the sensor output and the reverse setting sensor input A user interface comprising: a processor further configured to detect an input on the haptic surface of the deformable region of the extended setting according to an extended setting sensor input threshold different from the threshold.   The user interface of claim 1, wherein the amount of fluid comprises a fluid suspension of conductive particulates.   The user interface of claim 1, wherein the haptic layer comprises a layer having a substantially uniform thickness across the deformable region and the peripheral region, further comprising a conductive element embedded in the deformable region. .   The user interface of claim 1, wherein the displacement device comprises a positive displacement pump configured to move fluid between the cavity and a reservoir via a fluid channel defined by the substrate.   The sensor includes a first detection element and a second detection element coupled to the substrate, the first detection element configured to detect a capacitance value over a portion of the cavity, and the second detection element The user interface of claim 1, wherein the element is configured to detect a capacitance value over a portion of the peripheral region.   The sensor comprises a projected capacitive tactile sensor comprising a first layer of a first set of parallel electrodes and a second layer of a second set of parallel electrodes, wherein the second layer is perpendicular to the first layer. The second set of electrodes intersects the first set of electrodes, and each electrode of the first set of parallel electrodes and each electrode of the second set of parallel electrodes has a plurality of conductive properties. The user interface of claim 1, wherein a pad is defined, and a conductive pad of the first set of parallel electrodes and an adjacent conductive pad of the second set of parallel electrodes cooperate to define a sensing element.   The electrodes of the first set of parallel electrodes and the electrodes of the second set of parallel electrodes cooperate to provide a first density conductive pad proximal to the peripheral region and a first proximal to the changeable region. The user interface of claim 6, wherein the second density is greater than the first density.   The processor sets a first drive voltage across a subset of electrodes in response to the deformable region of the retract setting and a second drive across the subset of electrodes in response to the deformable region of the extended setting The user interface of claim 6, wherein the user interface is configured to set a voltage.   A specific detection element of the series of detection elements is configured to detect a capacitance value over a portion of the cavity, and the processor is configured to detect the capacitance value output of the specific detection element according to the capacitance value output of the specific detection element. Configured to perform a closed feedback control of the vertical position of the deformable region in response to a target vertical position in cooperation with the displacement device and the specific sensing element. The user interface according to claim 1.   A display coupled to the substrate on the opposite side of the haptic layer and configured to output an image including an image of an input key substantially aligned with the input area; A touch screen processing unit configured to detect input on a surface; a haptic processing unit configured to control the displacement device; and executing a command according to the input detected by the haptic processing unit. The user interface of claim 1, comprising a configured host processing unit.   The processor generates a first capacitance map according to the capacitance value output by the series of detection elements for the first time in the extended setting, and according to the capacitance value output by the series of detection elements for the second time in the extended setting. Generating a second capacity map, wherein the tactile sensation of the deformable area of the extension setting according to a difference between a part of the first capacity map and a part of the second capacity map corresponding to the deformable area The user interface of claim 1, wherein the user interface is configured to detect input on a surface and the difference exceeds the extended setting sensor input threshold. A method for controlling a dynamic haptic user interface comprising a haptic layer and a substrate, comprising:
Detecting a first capacitance value over a portion of the cavity in a retracted setting, wherein the haptic layer defines a deformable region and a peripheral region, the peripheral region being adjacent to the deformable region; And being coupled to the substrate on the opposite side of the tactile surface, the deformable region cooperating with the substrate to define the cavity;
Detecting a second capacitance value over the peripheral region;
Generating a capacity map according to the first capacity value and the second capacity value;
Modifying fluid pressure in the cavity to transition the cavity to an expanded setting, wherein the deformable region is raised above the peripheral region in the expanded setting;
Detecting a third capacitance value over a portion of the cavity at the extended setting;
Updating the capacity map according to the third capacity value;
Sensing input on the haptic surface of the deformable region according to a comparison between a capacitance value detected over the portion of the cavity and the capacitance map.   The method of claim 12, wherein detecting the first capacitance value comprises detecting a magnitude of an electric field disruption that varies across a portion of the cavity.   The step of generating the capacitive map comprises capacitive discharge across a first set of electrically coupled conductive pads in a vertical array and a second set of electrically coupled conductive pads in a horizontal array patterned over the substrate. Mapping a time, wherein the first capacitance value includes a capacitive discharge time between a first conductive pad of the first array and a first conductive pad of the second array proximal to the cavity; The method of claim 12, wherein the second capacitance value comprises a capacitive discharge time between a second conductive pad of the first array and a second conductive pad of the second array proximal to the peripheral region. .   Responsive to the transition of the cavity to the extended setting, modifying a drive voltage across the first conductive pad of the first array and the first conductive pad of the second array proximal to the cavity; 15. The method of claim 14, further comprising:   The step of modifying the fluid pressure in the cavity to transition the cavity to the expanded setting comprises moving fluid from a reservoir into the cavity through a fluid channel defined by the substrate. The method described in 1.   The step of detecting the third capacitance value performs closed loop feedback to control fluid pressure within the cavity according to the height of the haptic surface of the deformable region relative to the capacitance value over a portion of the cavity. The method of claim 12, comprising steps.   The capacitance map includes capacitance values detected over the peripheral region of the extended setting, and capacitance values detected over a series of additional deformable regions defined by the haptic layer and cavities defined by the substrate. 13. The method of claim 12, further comprising updating the capacity map accordingly.   Sensing the input on the tactile surface of the deformable region includes calculating a speed of the input according to a time-dependent change in the capacitance value detected over the portion of the cavity; and 13. The method of claim 12, further comprising associating a device command with the speed of the input.   Detecting the input on the tactile surface of the deformable region is measured over the portion of the cavity, predicting an input mode, selecting an input model according to the predicted input mode, and Detecting the input on the tactile surface of the deformable region according to an output of the input model corresponding to a difference between the detected capacitance value and the capacitance map. The method described.   The step of predicting the input mode includes the step of predicting one of a finger input and a stylus input, and the step of selecting the input model includes the input mode, a current vertical position of the deformable region, and 21. The method of claim 20, comprising selecting the input mode corresponding to a current vertical position of a second deformable region defined by the haptic layer.   Sensing the input on the tactile layer includes calculating a centroid of outputs of a series of capacitive sensing elements adjacent to the cavity to determine the location of the input, the sensor detecting the series of capacitive sensing The method of claim 12 comprising an element.   Sensing the input on the haptic layer of the deformable region comprises identifying an input contact point on the haptic surface according to a capacitance value detected over a portion of the cavity; and determining a centroid of the contact point. Detecting the input on the haptic surface of the deformable region according to a step of identifying and comparing a centroid of the contact point on the haptic surface at a known location proximal to the deformable region and an input area The method of claim 12 comprising the steps of:   13. The step of sensing the input on the haptic surface of the deformable region includes detecting the location, size, and speed of the input of the haptic surface of the deformable region of the extended setting. The method described in 1. A method for controlling a dynamic haptic user interface comprising a haptic layer and a substrate, comprising:
Detecting a capacitance value over a portion of a cavity, wherein the haptic layer defines a deformable region and a peripheral region, the peripheral region being adjacent to the deformable region and opposite the haptic surface. Coupled to the substrate, the deformable region defining the cavity in cooperation with the substrate;
Estimating a vertical position of the tactile surface of the deformable region according to the capacitance value detected over a portion of the cavity;
Manipulating the fluid pressure in the cavity according to the difference between the estimated vertical position of the haptic surface of the deformable region and the target vertical position of the haptic surface of the deformable region to manipulate the deformable region Modifying the vertical position of the haptic surface;
Detecting an input on the haptic surface of the deformable region in accordance with a change in capacitance value over the portion of the cavity.   Detecting the capacitance value includes detecting a capacitance value across a first conductive pad and a second conductive pad adjacent to the cavity, wherein the first conductive pad is patterned over the substrate. 26. The method of claim 25, wherein the second conductive pad is electrically coupled to a conductive pad of a lateral array patterned across the substrate.   The step of detecting the capacitance value across a portion of the cavity includes charging voltage, charge current, across a first conductive pad and a second conductive pad arranged on the substrate proximal to the deformable region, 26. The method of claim 25, comprising measuring at least one of charging time, discharging time, and transmission frequency.   Predicting the vertical position of the haptic surface of the deformable region identifies the capacitance value detected over a portion of the cavity and the vertical position of the haptic surface of various deformable regions of the haptic layer. 26. The method of claim 25, comprising measuring the vertical position of the haptic surface of the deformable region according to a comparison with a stored volume map.   Predicting the vertical position of the haptic surface of the deformable region includes verifying the predicted vertical position of the haptic surface by fluid pressure in the cavity, wherein the fluid pressure in the cavity is 26. The method of claim 25, associated with a vertical position of the haptic surface of a deformable region.   Predicting the vertical position of the haptic surface of the deformable region includes predicting the vertical position of the haptic surface of the deformable region according to a capacitance map of a distribution of electric fields over a portion of the substrate. 26. The method of claim 25.   31. The predicting the vertical position of the haptic surface includes selecting a capacitance map from a series of capacitance maps according to a predicted vertical position of a series of deformable regions of the haptic layer. Method.   26. Manipulating the fluid pressure within the cavity comprises moving fluid into the cavity through a fluid channel defined by the substrate to expand the deformable region. the method of.   Manipulating the fluid pressure within the cavity includes modifying the vertical position of the haptic surface of the deformable region to approach the target vertical position defining an expanded setting, the deformable region 26. The method of claim 25, wherein the haptic surface of the device is raised above the haptic surface of the peripheral region at the extended setting.   The step of detecting the input on the tactile surface of the deformable region includes the output of a capacitive sensor coupled to the substrate and a minimum capacitance value associated with the input on the deformable region of the extended setting. 34. The method of claim 33, comprising detecting the input according to an extended setting sensor input threshold that identifies a change.   The step of detecting the input on the tactile surface of the deformable region includes touching the tactile surface of the deformable region and a magnitude of a change in a capacitance value over a portion of the cavity. 26. The method of claim 25, comprising distinguishing from inward deformation.   Adjusting the drive voltage across a portion of a capacitive tactile sensor according to the predicted vertical position of the deformable region, the capacitive tactile sensor being patterned across the substrate to form a portion of the tactile layer; 26. The method of claim 25, comprising a series of conductive pads that cooperate to detect a range of capacitance values. A substrate;
A tactile layer comprising a tactile surface, wherein the deformable region of the tactile layer cooperates with the substrate to define a cavity, and the peripheral region of the tactile layer is adjacent to the periphery of the cavity on the substrate. Combined with the tactile layer,
An amount of fluid arranged in the cavity;
A displacement device configured to operate the amount of fluid to shift the deformable region from a retracted setting to an extended setting, wherein the deformable region is the periphery of the tactile surface at the retracted setting. A displacement device that is coplanar with a region and deviates from the peripheral region of the haptic surface with the extended setting;
A sensor comprising a series of sensing elements, each sensing element of the series of sensing elements being configured to detect an electromagnetic value over a portion of the tactile layer, wherein a particular sensing element of the series of sensing elements is A sensor configured to detect an electromagnetic value across a portion of the cavity;
Predicting the vertical position of the tactile surface of the deformable region according to the capacitance value output by the specific detection element, and performing closed loop feedback in cooperation with the displacement device and the specific detection element, A processor for controlling a vertical position of the deformable region according to a vertical position.   Each detection element of the series of detection elements is configured to detect a capacitance value over a portion of the tactile layer, and the particular detection element of the series of detection elements is a capacitance over a portion of the cavity. The user interface of claim 13, configured to detect a value.

Images