CN107491283A - For equipment, method and the graphic user interface of the presentation for dynamically adjusting audio output - Google Patents
For equipment, method and the graphic user interface of the presentation for dynamically adjusting audio output Download PDFInfo
- Publication number
- CN107491283A CN107491283A CN201710364610.3A CN201710364610A CN107491283A CN 107491283 A CN107491283 A CN 107491283A CN 201710364610 A CN201710364610 A CN 201710364610A CN 107491283 A CN107491283 A CN 107491283A
- Authority
- CN
- China
- Prior art keywords
- interaction area
- contact
- application program
- user interface
- input
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 154
- 230000003993 interaction Effects 0.000 claims abstract description 217
- 230000004044 response Effects 0.000 claims abstract description 103
- 238000001514 detection method Methods 0.000 claims abstract description 65
- 230000004913 activation Effects 0.000 claims abstract description 53
- 230000000873 masking effect Effects 0.000 claims description 16
- 238000012545 processing Methods 0.000 claims description 16
- 230000002452 interceptive effect Effects 0.000 claims description 8
- 230000008859 change Effects 0.000 description 74
- 238000003825 pressing Methods 0.000 description 72
- 230000033001 locomotion Effects 0.000 description 50
- 230000014509 gene expression Effects 0.000 description 36
- 238000004891 communication Methods 0.000 description 25
- 230000009467 reduction Effects 0.000 description 23
- 230000000007 visual effect Effects 0.000 description 23
- 230000006870 function Effects 0.000 description 20
- 230000008569 process Effects 0.000 description 18
- 230000001965 increasing effect Effects 0.000 description 17
- 238000003860 storage Methods 0.000 description 16
- 238000010408 sweeping Methods 0.000 description 16
- 230000002093 peripheral effect Effects 0.000 description 15
- 229940061368 sonata Drugs 0.000 description 15
- 238000007726 management method Methods 0.000 description 14
- 230000003287 optical effect Effects 0.000 description 14
- 238000005516 engineering process Methods 0.000 description 12
- 230000004048 modification Effects 0.000 description 12
- 238000012986 modification Methods 0.000 description 12
- 230000003247 decreasing effect Effects 0.000 description 11
- 230000000694 effects Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 230000005611 electricity Effects 0.000 description 8
- 238000006073 displacement reaction Methods 0.000 description 6
- 238000011093 media selection Methods 0.000 description 6
- 238000001914 filtration Methods 0.000 description 5
- 238000009499 grossing Methods 0.000 description 5
- 230000003213 activating effect Effects 0.000 description 4
- 230000006399 behavior Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 4
- 238000010168 coupling process Methods 0.000 description 4
- 238000005859 coupling reaction Methods 0.000 description 4
- 238000004898 kneading Methods 0.000 description 4
- 230000002829 reductive effect Effects 0.000 description 4
- 238000005096 rolling process Methods 0.000 description 4
- 239000013589 supplement Substances 0.000 description 4
- 230000001052 transient effect Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000003490 calendering Methods 0.000 description 3
- 238000007796 conventional method Methods 0.000 description 3
- 230000000977 initiatory effect Effects 0.000 description 3
- 238000007689 inspection Methods 0.000 description 3
- 230000002045 lasting effect Effects 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 238000007430 reference method Methods 0.000 description 3
- 238000010079 rubber tapping Methods 0.000 description 3
- 230000021317 sensory perception Effects 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 238000005303 weighing Methods 0.000 description 3
- PEDCQBHIVMGVHV-UHFFFAOYSA-N Glycerine Chemical compound OCC(O)CO PEDCQBHIVMGVHV-UHFFFAOYSA-N 0.000 description 2
- 241000406668 Loxodonta cyclotis Species 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000000151 deposition Methods 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 229910052738 indium Inorganic materials 0.000 description 2
- 230000010365 information processing Effects 0.000 description 2
- 238000012905 input function Methods 0.000 description 2
- 230000036961 partial effect Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 241001422033 Thestylus Species 0.000 description 1
- 239000012190 activator Substances 0.000 description 1
- 239000000654 additive Substances 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000001143 conditioned effect Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000005662 electromechanics Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000005562 fading Methods 0.000 description 1
- 210000003127 knee Anatomy 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 239000003973 paint Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 229920000642 polymer Polymers 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Software Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Entitled equipment, method and the graphic user interface for being used to dynamically adjust the presentation of audio output of the present invention.A kind of electronic equipment shows the user interface of the first interaction area and the second interaction area including application program over the display.When showing the user interface, the equipment over the display with the user interface element in the first interaction area corresponding to opening position detection pass through input caused by the contact on touch sensitive surface.In response to detecting by input caused by contact, when the input meet based on intensity activation standard (such as, the contact has the characteristic strength higher than intensity threshold) when, in addition to user interface element, the equipment covers the first interaction area of application program, without covering the second interaction area of application program.When the input meets selection standard (for example, the contact has the characteristic strength less than intensity threshold), the equipment performs selection operation corresponding with user interface element, without covering the first interaction area of application program.
Description
Technical field
The present invention relates generally to the electronic equipment for providing audio output, and relates more specifically to dynamically adjust audio
Equipment, method and the graphic user interface of the presentation of output.
Background technology
Some electronic equipments are used as the mode provided on user with the feedback interacted of equipment by the use of audiovisual interface.
The content of the invention
However, some electronic equipments provide audiovisual feedback in a manner of limited, poorly efficient and gloomy.For example,
Certain methods are interrupted and stop providing the audio (for example, lecture) that user is currently listening to and be suddenly switching to some other sounds
Frequently (for example, audio associated with short video messaging).These transformations suddenly have disperseed the notice of user (so as to cause user
Lose focus and some parts for the audio that they are listening to must be replayed), force user to perform additional input and come
The audio that they are listening to is recovered back to, forces user to disable some effects based on audio, and produces additional sense of frustration.
By requiring user's execution additional input and/or forcing user to replay some parts, conventional electronic device wastes energy.
Some electronic equipments are used as the mode provided on user with the feedback interacted of equipment by the use of audiovisual interface.So
And some electronic equipments provide audiovisual feedback in a manner of limited, poorly efficient and gloomy.For example, certain methods are rung
Should interacting to provide predetermined audible feedback (for example, in response to user small in user and graphical user-interface element
Numeral is keyed in provide audible tone for telephony application on keyboard).This predetermined audible feedback is not based on using
Family is interactive and changes, so as to force user to hear the predetermined and constant audible feedback of identical repeatedly.Therefore, it is many
User's disabling some effects and/or deletion based on audio have become too annoying some application programs.
Therefore, electronic equipment needs to provide audiovisual feedback with more effective way and interface.Such method and interface
Optionally supplement or be substituted for the conventional method of offer audiovisual feedback.Such method and interface reduce the input from user
Quantity, scope and/or property, and produce more effective man-machine interface (for example, by together dynamically obscure the audio it is defeated
Go out, embodiment disclosed herein allow user effectively preview new audio output without suddenly stopping listen to present video
Output).In addition, such method reduces the processing electric power that processing touch input is consumed, save power and (filled so as to increase battery
Time between electricity), the input of unnecessary/unrelated/repetition is reduced, and potential reduction memory uses.
According to some embodiments, method is performed at the electronic equipment to be communicated with display and audio system.Should
Method includes：The first acoustic information is provided so that the first audio output is presented to audio system, and first audio output includes：Volume
With the audio attribute in addition to volume.When this method is additionally included in audio system the first audio output is being presented, receive and use
Inputted in presenting corresponding to the request of the second audio output.This method is also included in response to receiving with being used to the second audio be presented
Inputted corresponding to the request of output：Information is provided to audio system, the first audio is dynamically adjusted with the value according to input
The presentation of output, wherein the presentation for dynamically adjusting the first audio output is included as the value of input changes and dynamically adjusts
Non- volume audio attribute；And second sound information is provided to audio system, so that the second sound to be presented simultaneously with the first audio output
Frequency exports.
According to some embodiments, method is performed at the electronic equipment to be communicated with display and audio system.Should
Method includes：When showing that including one group of one or more shows the user interface that can be represented over the display：In first time point
Detection points to the group one or more and shows that first in representing shows the first input that can be represented.This method is also included in response to inspection
Measure sensing first and show the first input that can be represented, start to provide the first acoustic information to audio system, shown with presenting with first
First audio output corresponding to representing, wherein the first audio output has the first audio configuration file.This method is additionally included in
The second time point detection after first time point points to the group one or more and shows that second in representing shows can represent the
Two inputs.This method is also included in response to detecting that pointing to second shows the can represent second input：Meet audio more according to determination
Change standard：So that audio system presentation is shown with first can represent corresponding the first modified audio output, without being to continue with profit
The first audio output is presented with the first audio configuration file, wherein the first modified audio output, which has, is different from the first sound
The modified audio configuration file of frequency configuration file；And second sound information is provided to audio system, to present and second
Show the second audio output corresponding to representing, wherein the second audio output has the second audio configuration file.This method also includes
Audio change standard is unsatisfactory for according to determination：So that audio system continue present show with first can represent it is corresponding and have first
First audio output of audio configuration file；And the 3rd acoustic information is provided to audio system, show energy table with second to present
3rd audio output corresponding to showing, wherein the 3rd audio output have the 3rd audio configuration file.
According to some embodiments, with display, touch sensitive surface and for detecting the strong of the contact with touch sensitive surface
Method is performed on the electronic equipment of one or more sensors of degree.This method includes：Display includes media item over the display
Expression user interface.The expression with media item that this method also includes when showing user interface on touch sensitive surface is corresponding
Opening position detection by contact caused by input.This method is also included in response to detecting by input caused by contact：Root
According to determination, the input meets media cue standard, and wherein the media cue standard includes being higher than the first intensity threshold when the contact has
The standard met during the characteristic strength of value：Commence play out the appropriate section of media item；And when media item plays, with
The characteristic strength of contact changes and dynamically changes one group of one or more audio attribute of media item.This method also includes basis
Determine that the input is unsatisfactory for media cue standard, abandon commencing play out the appropriate section of media item and abandon the spy with contact
Sign intensity changes and dynamically changes the one or more audio attributes of the group of media item.
According to some embodiments, with display, touch sensitive surface and for detecting the strong of the contact with touch sensitive surface
Method is performed on the electronic equipment of one or more sensors of degree.This method includes：Display includes applying journey over the display
The user interface of first interaction area of sequence and the second interaction area of application program.This method is additionally included in display user interface
When over the display opening position corresponding with the first user interface element in the first interaction area detection pass through touch-sensitive table
First input caused by contact on face.This method is also included in response to detecting by the first input caused by contact：According to
Determine that the first input meets the activation standard based on intensity, wherein should the activation standard based on intensity require that contact has higher than the
The characteristic strength of one intensity threshold is to meet the activation standard based on intensity, in addition to the first user interface element, hides
The first interaction area of application program is covered, without covering the second interaction area of application program.This method is also included according to really
Fixed first input meets first choice standard, and the wherein first choice standard does not require contact with higher than the first intensity threshold
Characteristic strength performs first choice operation corresponding with the first user interface element, without masking to meet selection standard
First interaction area of application program.
According to some embodiments, the electronic equipment to be communicated with display and audio system is included at one or more
Manage device, memory and one or more programs；One or more programs be stored in memory and be configured as by this one
Individual or multiple computing devices, and one or more programs include being used to perform or to perform any side described herein
The instruction of the operation of method.According to some embodiments, computer-readable recording medium is stored with instruction wherein, the instruction when by
The electronic equipment to be communicated with display and audio system causes the equipment to perform or make it that execution is described herein when performing
The operation of any method.According to some embodiments, including memory and for perform be stored in memory one or
Graphic user interface on the electronic equipment of the one or more processors of multiple programs is included in any method described herein
One or more of the element of middle display element, these elements are updated in response to input, any side as described herein
Described in method.According to some embodiments, the electronic equipment to be communicated with display and audio system includes being used to perform
Or cause the device for performing the operation of any method described herein.According to some embodiments, for display and sound
The message processing device used in the electronic equipment that display system is communicated includes being used to perform or make it that execution is described herein
The device of the operation of any method.
Therefore, the electronic equipment to be communicated with display and audio system be provided with faster, more effective way and
Interface is for providing audible feedback and fuzzy audio, so as to improve the validity of this kind equipment, efficiency and user satisfaction.
Such method and interface can supplement or be substituted for the conventional method for providing audible feedback and fuzzy audio.
According to some embodiments, electronic equipment includes display, touch sensitive surface, optionally for detection and touch sensitive surface
Contact intensity one or more sensors, one or more processors, memory and one or more programs；This
Or multiple programs are stored in memory and are configured as being performed by the one or more processors, and the one or more
Program includes the instruction for the operation for being used to perform or to perform any method described herein.According to some embodiments, meter
Calculation machine readable storage medium storing program for executing is stored with instruction wherein, and the instruction is when by with display, touch sensitive surface and optionally for inspection
The equipment is caused to perform or make during the electronic equipment execution for surveying one or more sensors of the intensity of the contact with touch sensitive surface
The operation of any method described herein must be performed.According to some embodiments, there is display, touch sensitive surface, optionally use
Memory is stored in one or more sensors of the intensity of contact of the detection with touch sensitive surface, memory and for performing
One or more of graphic user interface on the electronic equipment of the one or more processors of program be included in and be described herein
Any method in one or more of shown element element, these elements be updated in response to input, such as herein
Described in any method of description.According to some embodiments, electronic equipment includes：Display, touch sensitive surface and optionally
For the one or more sensors for the intensity for detecting the contact with touch sensitive surface；And for performing or being retouched herein so that performing
The device of the operation for any method stated.According to some embodiments, for display and touch sensitive surface and optionally
Ground is used in the electronic equipment of one or more sensors of the intensity of contact of the detection with touch sensitive surface the information processing used
Equipment includes the device for the operation for being used to perform or to perform any method described herein.
Therefore, there is one of display, touch sensitive surface and the intensity optionally for contact of the detection with touch sensitive surface
Or the electronic equipment of multiple sensors be provided with faster, more effective way and interface is for providing audible feedback and mould
Audio is pasted, so as to improve the validity of this kind equipment, efficiency and user satisfaction.Such method and interface can supplement or substitute use
In the conventional method for providing audible feedback and fuzzy audio.
Brief description of the drawings
In order to more fully understand various described embodiments, following specific implementation should be referred in conjunction with the following drawings
Mode, drawing reference numeral similar in the accompanying drawings referred in all schemas corresponding to part.
Figure 1A is the block diagram for showing the portable multifunction device with touch-sensitive display according to some embodiments.
Figure 1B is the block diagram for showing the example components for event handling according to some embodiments.
Fig. 2 shows the portable multifunction device with touch-screen according to some embodiments.
Fig. 3 is the block diagram according to the exemplary multifunctional equipment with display and touch sensitive surface of some embodiments.
Fig. 4 A show the exemplary of the application menu on the portable multifunction device according to some embodiments
User interface.
Fig. 4 B are shown according to the multifunctional equipments with the touch sensitive surface separated with display of some embodiments
Exemplary user interface.
Fig. 4 C to 4E show the example of the resistance to vibration threshold value according to some embodiments.
Fig. 5 is shown to be set according to the exemplary electronic to be communicated with display and touch sensitive surface of some embodiments
It is standby, wherein at least one subset of these electronic equipments, display and/or touch sensitive surface are integrated into electronic equipment.
Fig. 6 A to 6Y show according to some embodiments be used for dynamically adjust audio output presentation and optionally
Ground dynamically adjusts the exemplary user interface that the vision of user interface is presented.
Fig. 7 A to 7G are shown according to some embodiments for providing audio output based on audio configuration file
Exemplary user interface.
Fig. 8 A to 8B are the flows for the method for showing the presentation for dynamically adjusting audio output according to some embodiments
Figure.
Fig. 8 C are the flow charts for the method for showing the presentation for dynamically adjusting audio output according to some embodiments.
Fig. 8 D to 8F are the flows for the method for showing the presentation for dynamically adjusting audio output according to some embodiments
Figure.
Fig. 8 G to 8H are the methods for showing to be presented according to the vision for dynamically adjusting user interface of some embodiments
Flow chart.
Fig. 9 A to 9C are to show to provide the method for audio output based on audio configuration file according to some embodiments
Flow chart.
Embodiment
Disclosed embodiment provides a kind of method and apparatus for being used to dynamically adjust the presentation of audio output.More
Body, in some embodiments, provided herein is equipment by the value that is inputted according to user (for example, on touch sensitive surface
The intensity of contact and/or the light length for sweeping gesture) adjustment audio attribute (for example, volume or non-Volume attribute) comes in preview audio
Hold.In some embodiments, when equipment is just providing the first audio output (for example, play First song), equipment according to
The value of user's input and make the second audio output (for example, second song) " fuzzy fade in ".In some embodiments, make
Second audio is fuzzy fade in including based on the value of input come dynamically adjust the non-Volume attribute of the first audio content (for example,
Stereo balance, applied to the first audio content low pass filter cut-off frequency).
Consider via the example of the music application broadcasting song on user equipment.Meanwhile user can open just
(imagine that video not yet plays and user must press the image of video with to it in the message application of display video messaging
Play out).In some embodiments, user by the pressing that is carried out to video messaging and can keep gesture to play video
" prompting " of message.Prompting makes song is fuzzy to fade out (for example, by with pressing and keep the intensity of gesture to increase to reduce sound
Measure and reduce the cut-off frequency of low pass filter) and make video messaging is fuzzy to fade in (by with pressing and keep gesture
Intensity increases and improves volume).In some embodiments, higher than specific contact strength, equipment plays video with full volume and disappeared
Breath, and song is played with amount of bass when filtering out the high fdrequency component of song so that song is only in the background in a manner of soft
Sound like " skirr ".
According to some embodiments, the method and apparatus for changing audible feedback is also provided.For example, when activation is accordingly shown
When can represent make it that equipment produces audible feedback, in extremely rapid succession activate this it is corresponding show can represent twice so that equipment change audio
Feedback.
Below, Figure 1A to 1B, 2 and 3 provide the description to example devices.
Fig. 4 A to 4B and 6A to 6O are shown for the value inputted according to user to make audio output " fuzzy to fade in " (example
Such as, when background audio play when) exemplary user interface.Fig. 8 A to 8B and Fig. 8 C show what is inputted according to user
Value makes the two methods of audio output " fuzzy fade in " (for example, when background audio plays).Fig. 6 A are into 6O
User interface be used to process in Fig. 8 A to 8C be shown.
Fig. 4 A to 4B and 6P to 6Y are shown for the value inputted according to user to dynamically adjust the category of audio output
Property (for example, at audio output prompt) exemplary user interface.Fig. 8 D to 8F show according to user input value come
The method for dynamically adjusting the attribute (for example, being prompted at audio output) of audio output.User interface in Fig. 6 P to 6Y is used
In showing the process in Fig. 8 D to 8F.
In addition, Fig. 4 A to 4B and 6P to 6Y show the exemplary use for providing visual feedback (for example, dimness of vision)
Family interface.Fig. 9 A to 9C show the stream of the method for the offer visual feedback (for example, dimness of vision) according to some embodiments
Cheng Tu.User interface in Fig. 6 P to 6Y is used to show the process in Fig. 9 A to 9C.
Example devices
It is shown in the drawings now with detailed reference to embodiment, its example.Many tools are shown in following detailed description
Body details, to provide the thorough understanding to various described embodiments.But will to one of ordinary skill in the art
It is readily apparent that various described embodiments can be carried out in the case of these no details.In other feelings
Under condition, well known method, program, part, circuit and network are not described in detail, in order to avoid unnecessarily obscure each of the embodiment
Individual aspect.
It will be further understood that although in some cases, term " first ", " second " etc. are various for describing herein
Element, but these elements should not be restricted by the limitation of these terms.These terms are only intended to an element and another element area
Separate.For example, the first contact can be named as the second contact, and similarly, the second contact can be named as the first contact, and
The scope of various described embodiments is not departed from.First contact and the second contact are contact, but they are not same connect
Touch, unless the context clearly.
The term used in the description to the various embodiments is intended merely to describe particular implementation side herein
The purpose of case, and be not intended to be limited.Such as the institute in the description to the various embodiments and appended claims
As use, " one (" a ", " an ") and "the" are intended to also include plural form singulative, unless context is clear and definite in addition
Ground indicates.It will be further understood that term "and/or" used herein refers to and covered in the project listed in association
One or more projects any and all possible combinations.It will be further understood that term " comprising ", "comprising", " containing "
And/or " having " when in this manual use when be specify exist stated feature, integer, step, operation, element and/
Or part, but it is not excluded that in the presence of or other one or more features of addition, integer, step, operation, element, part and/or
Its group.
As used herein, based on context, term " if " be optionally interpreted to mean " and when ... when "
(" when " or " upon ") or " in response to determining " or " in response to detecting ".Similarly, based on context, phrase is " if really
It is fixed ... " or " if detecting [condition or event stated] " be optionally interpreted to refer to " it is determined that ... when " or
" in response to determining ... " or " when detecting [condition or event stated] " or " in response to detecting [the bar stated
Part or event] ".
This document describes electronic equipment, this kind equipment user interface and using this kind equipment associated process reality
Apply scheme.In some embodiments, the equipment is also to include other functions such as PDA and/or music player functionality just
Take formula communication equipment, such as mobile phone.The exemplary of portable multifunction device includes but is not limited to come from
Apple Inc.'s (Cupertino, California)Equipment, iPodEquipment andEquipment.Appoint
Selection of land uses other portable electric appts, such as knee with touch sensitive surface (for example, touch-screen display and/or touch pad)
Laptop or tablet personal computer.It is to be further understood that in some embodiments, the equipment is not portable communication device,
But the desktop computer with touch sensitive surface (for example, touch-screen display and/or touch pad).
In the following discussion, a kind of electronic equipment including display and touch sensitive surface is described.However, it should manage
Solution, electronic equipment optionally include other one or more physical user-interface devices, such as physical keyboard, mouse and/or behaviour
Vertical pole.
The equipment generally supports a variety of application programs, one or more of such as following application program application program：Pen
Remember application program, drawing application program, application program, word-processing application, website establishment application program, disk editor is presented
Application program, spreadsheet applications, game application, telephony application, videoconference application, Email
Application program, instant message application program, body-building support application program, photo management application program, digital camera application program,
Digital camera applications program, web page browsing application program, digital music player application and/or video frequency player
Application program.
The various application programs performed in equipment optionally use at least one common physical user interface facilities, such as
Touch sensitive surface.One or more functions of touch sensitive surface and the corresponding informance being displayed in equipment optionally should with different
Adjusted and/or changed with program, and/or adjusted and/or change in corresponding application program.So, the shared thing of equipment
Reason framework (such as touch sensitive surface) supports various applications optionally with directly perceived for a user and clear user interface
Program.
Focusing on the embodiment of the portable set with touch-sensitive display.Figure 1A is shown according to some embodiment party
The block diagram of the portable multifunction device 100 with touch-sensitive display system 112 of case.Touch-sensitive display system 112 is sometimes
Convenience is called " touch-screen ", and is called touch-sensitive display for short sometimes.Equipment 100 include memory 102 (its optionally
Including one or more computer-readable recording mediums), Memory Controller 122, one or more processing units (CPU) 120,
Peripheral interface 118, RF circuits 108, voicefrequency circuit 110, loudspeaker 111, microphone 113, input/output (I/O) subsystem
System 106, other inputs or control device 116 and outside port 124.Equipment 100 optionally includes one or more optical sensings
Device 164.Equipment 100 optionally includes one or more intensity sensors 165 of the intensity for the contact being used on detection device 100
(for example, touch-sensitive display system 112 of touch sensitive surface, such as equipment 100).Equipment 100 optionally includes being used in equipment 100
Upper generation tactile output is (for example, in the touch-sensitive display system 112 of touch sensitive surface such as equipment 100 or the touch pad of equipment 300
On 355 generate tactile output) one or more tactile output generators 167.These parts are optionally via one or more
Communication bus or signal wire 103 are communicated.
As used in the specification and claims, term " tactile output " refers to utilize user's by user
The equipment that sense of touch detects is relative relative to the part (for example, touch sensitive surface) of the physical displacement of the previous position of equipment, equipment
In another part (for example, shell) of equipment physical displacement or part relative to the barycenter of equipment displacement.For example,
The surface (for example, other parts of finger, palm or user's hand) to touching sensitivity of the part and user of equipment or equipment
In the case of contact, by physical displacement generate tactile output sense of touch will be read as by user, the sense of touch correspond to equipment or
The change perceived of the physical features of the part of equipment.For example, the movement of touch sensitive surface (for example, touch-sensitive display or Trackpad) is appointed
Selection of land is read as " pressing click " or " unclamp and click on " to physical actuation device button by user.In some cases, user will
Feel sense of touch, such as " press click " or " unclamp click on ", (example is physically pressed even in the movement by user
Such as, be shifted) the physical actuation button associated with touch sensitive surface when not moving.In another example, touch sensitive surface
Movement optionally understood by user or sensed " roughness " for touch sensitive surface, the smoothness even in touch sensitive surface is unchanged
When.Although such deciphering of the user to touch will be limited by the individuation sensory perception of user, being permitted for touch be present
Intersensory perception is that most of users share.Therefore, when tactile output is described as the specific sensory perception corresponding to user
When (for example, " pressing click ", " unclamp and click on ", " roughness "), unless otherwise stated, the tactile output otherwise generated is corresponding
In equipment or the physical displacement of its part, the physical displacement will generate the sensory perception of typical case (or common) user.
It should be appreciated that equipment 100 is only an example of portable multifunction device, and equipment 100 optionally has
Have than the shown more or less parts of part, optionally combine two or more parts, or optionally there is this
The different configurations of a little parts or arrangement.Various parts shown in Figure 1A are in hardware, software, firmware or any combination of them
Implement in (including one or more signal processing circuits and/or application specific integrated circuit).
Memory 102 optionally includes high-speed random access memory, and also optionally includes nonvolatile memory,
Such as one or more disk storage equipments, flash memory device or other non-volatile solid state memory equipment.Equipment
The access of such as one or more CPU 120 of 100 miscellaneous part and peripheral interface 118 to memory 102 optionally by
Memory Controller 122 controls.
Peripheral interface 118 can be used for the input peripheral of equipment and output ancillary equipment being couple to one or more
Individual CPU 120 and memory 102.The one or more processors 120 run or carry out existed by storage it is various in reservoir 102
Software program and/or instruction set, to perform the various functions of equipment 100 and processing data.
In some embodiments, peripheral interface 118, one or more CPU 120 and Memory Controller 122 are appointed
Selection of land is such as realized in one single chip on chip 104.In some other embodiments, they are optionally real on separate chips
It is existing.
RF (radio frequency) circuit 108 receives and sent the RF signals for being also designated as electromagnetic signal.RF circuits 108 turn electric signal
Be changed to electromagnetic signal/by electromagnetic signal and be converted to electric signal, and via electromagnetic signal come with communication network and other communicate and set
It is standby to be communicated.RF circuits 108 optionally include being used for the well known circuit for performing these functions, including but not limited to aerial system
System, RF transceivers, one or more amplifiers, tuner, one or more oscillators, digital signal processor, encoding and decoding core
Piece group, subscriber identity module (SIM) card, memory etc..RF circuits 108 come and network and other optionally by radio communication
Equipment is communicated, and these networks are such as internet, also referred to as WWW (WWW), and Intranet and/or wireless network are such as
Cellular phone network, WLAN (LAN) and/or Metropolitan Area Network (MAN) (MAN).Radio communication optionally using a variety of communication standards,
Any one of agreement and technology, including but not limited to global system for mobile communications (GSM), enhancing data GSM environment (EDGE),
High-speed downlink packet access (HSDPA), High Speed Uplink Packet access (HSUPA), evolution, clear data (EV-DO),
HSPA, HSPA+, double small area HSPA (DC-HSPDA), Long Term Evolution (LTE), near-field communication (NFC), WCDMA (W-
CDMA), CDMA (CDMA), time division multiple acess (TDMA), bluetooth, Wireless Fidelity (Wi-Fi) (for example, IEEE802.11a,
IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n), interconnection
FidonetFido voice technology (VoIP), Wi-MAX, Email agreement (for example, internet message access protocol (IMAP) and/or
Post office protocol (POP)), (for example, scalable message transmission and agreement (XMPP) being present, for instant message and depositing in instant message
In Session initiation Protocol (SIMPLE), instant message and the presence service (IMPS) using extension) and/or Short Message Service
(SMS), or including end this document submission date also it is untapped go out communication protocol any other appropriate communication protocols
View.
Voicefrequency circuit 110, loudspeaker 111 and microphone 113 provide the COBBAIF between user and equipment 100.Audio
Circuit 110 receives voice data from peripheral interface 118, voice data is converted into electric signal, and electric signal transmission is arrived
Loudspeaker 111.Loudspeaker 111 converts electrical signals to the audible sound wave of the mankind.Voicefrequency circuit 110 is also received by microphone 113
The electric signal come from sound wave conversion.Voicefrequency circuit 110 converts electrical signals to voice data, and voice data is transferred to outside
Peripheral equipment interface 118 is for processing.Voice data is optionally retrieved from and/or transmitted to storage by peripheral interface 118
Device 102 and/or RF circuits 108.In some embodiments, voicefrequency circuit 110 also includes earphone jack (for example, in Fig. 2
212).Earphone jack provides the interface between voicefrequency circuit 110 and removable audio input/output ancillary equipment, the periphery
The earphone or there is output (for example, single head-receiver or bi-telephone) and input (for example, microphone) that equipment such as only exports
Both headsets.
I/O subsystems 106 are by such as touch-sensitive display system 112 of the input/output ancillary equipment in equipment 100 and other
Input or control device 116 couple with peripheral interface 118.I/O subsystems 106 optionally include display controller 156, light
Learn sensor controller 158, intensity sensor controller 159, tactile feedback controller 161 and input or control for other
One or more input controllers 160 of equipment.One or more input controllers 160 are inputted from other or control device
116 reception electric signals/by electric signal be sent to other input or control device 116.Other inputs or control device 116 are optionally
Including physical button (for example, push button, rocker buttons etc.), dial, slider switch, control stick, click wheel etc..One
A bit in alternative embodiments, one or more input controllers 160 are optionally coupled to any one of the following (or not coupling
It is connected to any one of the following)：Keyboard, infrared port, USB port, stylus, and/or pointing device such as mouse.One
Individual or multiple buttons (for example, 208 in Fig. 2) are optionally included for the control of the volume of loudspeaker 111 and/or microphone 113
Increase/reduction button.One or more buttons optionally include push button (for example, 206 in Fig. 2).
Touch-sensitive display system 112 provides the input interface and output interface between equipment and user.Display controller 156
Electric signal is received from touch-sensitive display system 112 and/or sends electric signal to touch-sensitive display system 112.Touch-sensitive display
System 112 shows visual output to user.Visual output optionally includes figure, text, icon, video and their any group
Close (being referred to as " figure ").In some embodiments, the visual output of some visual outputs or whole corresponds to user interface
Object.As used herein, term " showing to represent " refers to user mutual formula graphical user interface object (for example, being configured as
The graphical user interface object that input to order directional pattern user interface object responds).User mutual formula graphical user circle
Include but is not limited to button, sliding block, icon, optional menu item, switch, hyperlink or other users interface in face of the example of elephant
Control.
Touch-sensitive display system 112 has based on sense of touch and/or tactile to receive the touch-sensitive of the input from user
Surface, sensor or sensor group.Touch-sensitive display system 112 and display controller 156 are (with any phase in memory 102
The module and/or instruction set of association are together) contact in detection touch-sensitive display system 112 (and the contact any movement or
Interrupt), and detected contact is converted to and is displayed on the user interface object in touch-sensitive display system 112
The interaction of (for example, one or more soft-key buttons, icon, webpage or image).In an exemplary embodiment, touch-sensitive display system
Contact point between system 112 and user corresponds to the finger or stylus of user.
Touch-sensitive display system 112 is optionally using LCD (liquid crystal display) technology, LPD (light emitting polymer displays)
Technology or LED (light emitting diode) technology, but other Display Techniques are used in other embodiments.Touch-sensitive display system
System 112 and display controller 156 are optionally using any in a variety of touch-sensing technologies of currently known or later exploitation
Technology and other proximity sensor arrays or its for one or more contact points of determination and touch-sensitive display system 112
His element includes but is not limited to capacitive character, resistance to detect contact and its any movement or interruption, a variety of touch-sensing technologies
Property, infrared ray and surface acoustic wave technique.In an exemplary embodiment, using projection-type mutual capacitance detection technology, such as
From Apple Inc.'s (Cupertino, California)iPodWithThe technology of middle discovery.
Touch-sensitive display system 112 optionally has the video resolution more than 100dpi.In some embodiments, touch
Screen video resolution is touched more than 400dpi (for example, 500dpi, 800dpi or bigger).User optionally uses any suitable thing
Body or additives such as stylus, finger etc. are contacted with touch-sensitive display system 112.In some embodiments, the use
Family interface is designed to work together with the contact based on finger and gesture, due to the contact area of finger on the touchscreen compared with
Greatly, therefore this may be accurate not as the input based on stylus.In some embodiments, equipment is by based on the rough of finger
Input is translated as accurate pointer/cursor position or order, for performing the desired action of user.
In some embodiments, in addition to a touch, equipment 100 optionally includes specific for activating or deactivating
The touch pad (not shown) of function.In some embodiments, touch pad is the touch sensitive regions of equipment, and the touch sensitive regions are with touching
Screen is different, and it does not show visual output.Touch pad is optionally the touch sensitive surface separated with touch-sensitive display system 112, or
It is the extension of the touch sensitive surface formed by touch-screen.
Equipment 100 also includes being used for the power system 162 for various parts power supply.Power system 162 optionally includes electricity
Power management system, one or more power supplys (for example, battery, alternating current (AC)), recharging system, power failure detection circuit,
Power converter or inverter, power status indicator (for example, light emitting diode (LED)) and with the electric power in portable set
Any other associated part of generation, management and distribution.
Equipment 100 optionally also includes one or more optical sensors 164.Figure 1A show with I/O subsystems 106
The optical sensor that optical sensor controller 158 couples.One or more optical sensors 164 optionally include Charged Couple
Device (CCD) or complementary metal oxide semiconductor (CMOS) phototransistor.One or more optical sensors 164 are from environment
The light by one or more lens projects is received, and converts light to represent the data of image.With reference to image-forming module 143
(also referred to as camera model), one or more optical sensors 164 optionally capture still image and/or video.In some realities
Apply in scheme, optical sensor be located at the phase of touch-sensitive display system 112 on the front portion with equipment of equipment 100 back to rear portion
On so that touch-screen can act as the view finder for still image and/or video image acquisition.In some embodiments,
Another optical sensor is located on the front portion of equipment, so as to obtain the image of the user (such as self-timer, for existing in user
Video conference etc. is carried out when other video conference participants are watched on touch-screen).
Equipment 100 optionally also includes one or more contact strength sensors 165.Figure 1A is shown and I/O subsystems 106
In intensity sensor controller 159 couple contact strength sensor.One or more contact strength sensors 165 are optionally
Including one or more piezoresistive strain gauges, capacitive force transducer, power sensor, piezoelectric force transducer, optics force snesor,
Capacitive touch sensitive surfaces or other intensity sensors are (for example, the biography of the power (or pressure) for measuring the contact on touch sensitive surface
Sensor).One or more contact strength sensors 165 receive contact strength information (for example, pressure information or pressure letter from environment
The surrogate of breath).In some embodiments, at least one contact strength sensor and touch sensitive surface are (for example, touch-sensitive display
System 112) Alignment or neighbouring.In some embodiments, at least one contact strength sensor be located at equipment 100 with
The phase of touch-screen display system 112 on the front portion of equipment 100 back to rear portion on.
Equipment 100 optionally also includes one or more proximity transducers 166.Figure 1A is shown and peripheral interface 118
The proximity transducer 166 of coupling.Alternatively, proximity transducer 166 controls with the input in I/O subsystems 106
Device 160 couples.In some embodiments, when multifunctional equipment is placed near user's ear (for example, user beats
During phone), proximity transducer is closed and disables touch-sensitive display system 112.
Equipment 100 optionally also includes one or more tactile output generators 167.Figure 1A is shown and I/O subsystems 106
In tactile feedback controller 161 couple tactile output generator.One or more tactile output generators 167 optionally wrap
One or more electroacoustic equipments, such as loudspeaker or other acoustic components are included, and/or convert the energy into the electromechanics of linear movement
Equipment, such as motor, solenoid, electroactive polymerizer, piezo-activator, electrostatic actuator or other tactiles output generating unit
(for example, converting the electrical signal to the part of the tactile output in equipment).One or more tactile output generators 167 from touch
Feel that feedback module 133 receives touch feedback generation instruction, and generation can be felt by the user of equipment 100 on the appliance 100
The tactile output arrived.In some embodiments, at least one tactile output generator and touch sensitive surface are (for example, touch-sensitive display
Device system 112) Alignment or neighbouring, and optionally by vertically (for example, surface inside/outside to equipment 100) or side
Tactile output is generated to ground (for example, in surface identical plane with equipment 100 rearwardly and a forwardly) mobile touch sensitive surface.
In some embodiments, at least one tactile output generator sensor be located at equipment 100 with positioned at the front portion of equipment 100
On the phase of touch-sensitive display system 112 back to rear portion on.
Equipment 100 optionally also includes one or more accelerometers 168.Figure 1A is shown and the coupling of peripheral interface 118
The accelerometer 168 connect.Alternatively, accelerometer 168 optionally controls with the input in I/O subsystems 106
Device 160 couples.In some embodiments, the analysis based on the data to being received from one or more accelerometers is in touch-screen
Display information is come with longitudinal view or transverse views on display.Equipment 100 is optionally except one or more accelerometers 168
Outside also include magnetometer (not shown) and GPS (or GLONASS or other Global Navigation Systems) receiver (not shown), with
In acquisition on the position of equipment 100 and the information of orientation (for example, vertical or horizontal).
In some embodiments, the software part being stored in memory 102 includes operating system 126, communication mould
Block (or instruction set) 128, contact/motion module (or instruction set) 130, figure module (or instruction set) 132, haptic feedback module
(or instruction set) 133, text input module (or instruction set) 134, global positioning system (GPS) module (or instruction set) 135, should
With program (or instruction set) 136 and module (including audio preview module 163-1, the audio modification module specific to audio
163-2 and audio change module 163-3).In addition, in some embodiments, the internal shape of the storage device of memory 102/overall situation
State 157, as shown in Figure 1A and Fig. 3.Equipment/global internal state 157 includes one or more of the following：Activity should
With program state, the applications active state is used to indicate which application program (if any) is currently movable；It is aobvious
Show state, the dispaly state is used to indicate that what application program, view or other information occupy each of touch-sensitive display system 112
Individual region；Sensor states, the sensor states include each sensor of slave unit and other are inputted or control device 116 obtains
The information taken；With the position on device location and/or posture and/or location information.
Operating system 126 is (for example, iOS, Darwin, RTXC, LINUX, UNIX, OSX, WINDOWS or embedded operation
System such as VxWorks) include be used for control and manage general system task (for example, memory management, storage device control,
Electrical management etc.) various software parts and/or driver, and be advantageous to the communication between various hardware and software parts.
Communication module 128 promotes to be communicated with other equipment by one or more outside ports 124, and also wraps
Include for handling by RF circuits 108 and/or the various software parts of the received data of outside port 124.Outside port 124
(for example, USB (USB), live wire etc.) is suitable to be directly coupled to other equipment or indirectly via network (for example, mutually
Networking, WLAN etc.) coupling.In some embodiments, outside port be with Apple Inc. (Cupertino,
California) someEquipment, iPod30 needle connectors used in equipment and iPod equipment
Same or like and/or compatible spininess (for example, 30 pins) connector.In some embodiments, outside port is and Apple
Inc. some of (Cupertino, California)Equipment, iPodMade in equipment and iPod equipment
The same or like and/or compatible Lightning connectors of Lightning connectors.
Contact/motion module 130 optionally detects and touch-sensitive display system 112 (with reference to display controller 156) and its
The contact of his touch-sensitive device (for example, touch pad or physics click wheel).Contact/motion module 130 include various software parts with
The various operations related for performing detection with contacting (for example, by finger or pass through stylus), such as to determine that whether having sent out
Raw contact (for example, detection finger down event), determine the intensity of contact (for example, the power or pressure of contact, or the power of contact
Or the substitute of pressure), determine whether there is contact movement and track across touch sensitive surface movement (for example, detection one or
Multiple finger drag events) and determine whether contact has stopped (for example, detection digit up event or contact disconnect).
Contact/motion module 130 receives contact data from touch sensitive surface.Determine that the movement of contact point optionally includes determining contact point
Speed (value), speed (value and direction) and/or acceleration (change in value and/or direction), the movement of the contact point by
It is a series of to contact data to represent.These operations are optionally applied to single-contact (for example, single abutment or stylus contact)
Or multiple spot contacts (for example, " multiple point touching "/more abutments) simultaneously.In some embodiments, contact/motion module 130
The contact on touch pad is detected with display controller 156.
Contact/motion module 130 optionally detects the gesture input of user.Different gestures on touch sensitive surface have difference
Contact patterns (for example, the different motion of detected contact, timing and/or intensity).Therefore, it is special optionally by detection
Determine contact patterns and carry out detection gesture.For example, detection, which singly refers to Flick gesture, includes detection finger down event, then pressed with finger
Lower event identical position (or substantially the same position) place (for example, at picture mark position) detection finger lifts and (is lifted away from) thing
Part.In another example, detect that finger gently sweeps gesture and includes detecting finger down event, Ran Houjian on touch sensitive surface
One or more finger drag events are measured, and subsequently detects finger and lifts and (be lifted away from) event.Similarly, optionally by
The specific contact patterns of stylus are detected to touch, gently sweep, drag and other gestures to detect for stylus.
In some embodiments, detection finger tapping down gesture, which depends on, detects that finger down event lifts thing with finger
Time span between part, but it is strong to be independently of detecting that the finger between finger down event and digit up event contacts
Degree.In some embodiments, it is less than according to the time span determined between finger down event and digit up event advance
The value (for example, less than 0.1,0.2,0.3,0.4 or 0.5 second) of determination detects Flick gesture, but regardless of the finger during touch
Whether the intensity of contact meets given intensity threshold (being more than Nominal contact detection intensity threshold value), such as light Compressive Strength threshold value or depth
Compressive Strength threshold value.Therefore, finger tapping down gesture can meet not requiring that the characteristic strength of contact meets given intensity threshold so as to full
The specific input standard of the specific input standard of foot.For the sake of clarity, the finger contact in Flick gesture usually requires to meet mark
Contact detection intensity threshold value is claimed to be detected less than the Nominal contact detection intensity threshold value to detect finger down event
Contact.Similar analysis is applied to detection by stylus or other contacts and the Flick gesture of progress.It is able to detect that in equipment outstanding
In the case of finger or the stylus contact being parked in above touch sensitive surface, Nominal contact detection intensity threshold value does not correspond to hand optionally
Finger or the physical contact between stylus and touch sensitive surface.
Same concept is applied to other kinds of gesture in a similar manner.For example, satisfaction is optionally based on being included in
The intensity of contact in gesture is unrelated or does not require that the one or more contacts for performing gesture reach intensity threshold to be known
Other standard gently sweeps gesture, kneading gesture, cancellation kneading gesture and/or long-pressing gesture to detect.For example, based on one or more
The amount of movement of contact gently sweeps gesture to detect；Kneading gesture is detected based on two or more movements of contact toward each other；
Cancellation kneading gesture is detected based on two or more movements of contact away from each other；And based on having on touch sensitive surface
Long-pressing gesture is detected less than the duration of the contact of amount of threshold shift.Therefore, certain gestures criterion of identification does not require one
Or the intensity of multiple contacts meets respective strengths threshold value to meet that the statement of certain gestures criterion of identification means certain gestures
Criterion of identification can be met in the case where one or more of gesture contacts and is not reaching to respective strengths threshold value, and
It can also be met in the case where one or more of contact in gesture contacts and meets or exceeds respective strengths threshold value.
In some embodiments, finger down and digit up event are detected to detect within the predefined period based on determination
Flick gesture, without considering that contact is above or below respective strengths threshold value during the predefined period, and it is based on
It is determined that contact is mobile gently to sweep gesture more than predefined value to detect, contact is also above corresponding when mobile end is contacted
Intensity threshold.Influenceed even in the detection to gesture by the intensity for the contact for performing gesture (for example, equipment is in the strong of contact
Degree detects long-press, or detection of the delay to touch input when the intensity of contact is higher quickly when being higher than intensity threshold)
Specific implementation in, the detection to those gestures does not require that contact reaches certain strength threshold value, as long as can contact not reach
To meeting in the case of certain strength threshold value for the standard for identifying gesture (for example, even if amount changes the time spent in identification gesture
Become).
In some cases, contact strength threshold value, duration threshold and mobile threshold value are combined into a variety of different groups
Close, to create the heuristics for distinguishing two or more the different gestures for pointing to identical input element or region so that
Multiple distinct interactions with identical input element are enabled to provide one group of more rich user mutual and response.One group of certain gestures
Criterion of identification does not require that the intensity of one or more contacts meets respective strengths threshold value to meet certain gestures criterion of identification
Statement is not precluded from assessing while other intensity rely on gesture identification standard to be had in gesture including with being higher than phase to identify
Other gestures of the standard met during the contact for answering the intensity of intensity threshold.For example, in some cases, for first gesture
(it does not require that the intensity of one or more contacts meets respective strengths threshold value to meet first gesture to first gesture criterion of identification
Criterion of identification) (it is contacted dependent on one or more reaches respective strengths with the second gesture criterion of identification for second gesture
Threshold value) competition.In such competition, if meeting the second gesture criterion of identification for second gesture first, gesture is optional
Ground is not recognized as meeting the first gesture criterion of identification for first gesture.For example, if contact is mobile predefined in contact
Amount of movement before reach respective strengths threshold value, then detect deep pressure gesture rather than gently sweep gesture.On the contrary, if contact is connecing
Mobile predefined amount of movement before reaching respective strengths threshold value is touched, then detects and gently sweeps gesture rather than deep pressure gesture.Even if
In such cases, the first gesture criterion of identification for first gesture does not still require that the intensity of one or more contacts meets
Respective strengths threshold value is to meet first gesture criterion of identification, because if contact keeps below respective strengths threshold value until gesture
Terminate (for example, the contact with the intensity for not increasing to above respective strengths threshold value light sweep gesture), then gesture is by by the
One gesture criterion of identification is identified as gently sweeping gesture.Therefore, it is not required to the intensity of one or more contacts meets respective strengths threshold value
Ignore contact in some cases relative to intensity to meet the certain gestures criterion of identification of certain gestures criterion of identification by (A)
The intensity (for example, for Flick gesture) of threshold value and/or (B) still rely on contact relative to intensity threshold under certain conditions
Intensity, in some sense if certain gestures criterion of identification recognize corresponding with input gesture (for example, for just with
The long-pressing gesture that deep pressure gesture is at war with to be identified) the interdependent gesture identification standard of previous group competitiveness intensity (for example,
Gesture is pressed for deep) input is identified as corresponding to the interdependent gesture of intensity, then the certain gestures criterion of identification is (for example, for length
By gesture) will failure.
Figure module 132 includes being used for being presented and showing figure in touch-sensitive display system 112 or other displays
Various known software parts, including for changing the visual impact of shown figure (for example, brightness, transparency, saturation
Degree, contrast or other perceptual properties) part.As used herein, term " figure " includes that any of user can be displayed to
It is object, including but not limited to text, webpage, icon (such as user interface object including soft key), digital picture, video, dynamic
Draw etc..
In some embodiments, figure module 132 stores the data for being used to represent figure to be used.Each figure is appointed
Selection of land is assigned corresponding code.Figure module 132 specifies one or more of figure to be shown from receptions such as application programs
Individual code, coordinate data and other graphic attribute data are also received in the case of necessary, and then generate screen picture number
Display controller 156 is output to according to this.
Haptic feedback module 133 includes being used for the various software parts for generating instruction, and the instruction is by one or more tactiles
Output generator 167 uses, so as to one or more positions in response to user with interacting for equipment 100 and on the appliance 100
Place produces tactile output.
The text input module 134 for being optionally the part of figure module 132 is provided in various application program (examples
Such as, contact person 137, Email 140, IM 141, browser 147 and any other application program for needing text input) in
Input the soft key of text.
GPS module 135 determines the position of equipment, and provides the information to be used in various application programs (for example, carrying
Supply phone 138 is dialled for location-based, is supplied to camera 143 as photo/video metadata and is supplied to
For the application program of location Based service, such as weather desktop small routine, local Yellow Page desktop small routine and map/navigation
Desktop small routine).
Optionally include using 136 with lower module (or instruction set) or its subset or superset：
Contact module 137 (sometimes referred to as address list or contacts list)；
Phone module 138；
Video conference module 139；
Email client module 140；
Instant message (IM) module 141；
News template 142；
For rest image and/or the camera model 143 of video image；
Image management module 144；
Browser module 147；
Calendaring module 148；
Desktop small routine module 149, it optionally includes one or more of the following：Weather desktop small routine
149-1, stock market desktop small routine 149-2, calculator desktop small routine 149-3, alarm clock desktop small routine 149-4, dictionary desktop
Small routine 149-5 and other desktop small routines obtained by user, and the desktop small routine 149-6 that user creates；
For the desktop small routine builder module 150 for the desktop small routine 149-6 for making user's establishment；
Search module 151；
Video and musical player module 152, it is optionally by video player module and musical player module structure
Into；
Notepad module 153；
Mapping module 154；And/or
Online Video module 155.
The example for the other applications 136 being optionally stored in memory 102 includes other text processing applications
Program, other picture editting's application programs, drawing application program, present application program, support JAVA application program, encryption,
Digital copyright management, speech recognition and speech reproduction.
It is defeated with reference to touch-sensitive display system 112, display controller 156, contact module 130, figure module 132 and text
Enter module 134, contact module 137 includes being used to manage address list or contacts list (for example, being stored in memory 102
Or in the application program internal state 192 of the contact module 137 in memory 370) executable instruction, including：By one
Or multiple names are added to address list；One or more names are deleted from address list；Make one or more telephone numbers, one
Or multiple e-mail addresses, one or more physical address or other information are associated with name；Make image related to name
Connection；Name is classified and sorted；Telephone number is provided and/or e-mail address passes through phone to initiate and/or promote
138th, the communication that video conference 139, Email 140 or IM141 are carried out；Etc..
With reference to RF circuits 108, voicefrequency circuit 110, loudspeaker 111, microphone 113, touch-sensitive display system 112, display
Controller 156, contact module 130, figure module 132 and text input module 134, phone module 138 include being used for inputting with
The phone number that one or more of character string, accessing address list 137 telephone number, modification corresponding to telephone number have inputted
Code, the executable instruction for dialing corresponding telephone number, conversating and disconnecting or hang up when session is completed.As above institute
State, radio communication is optionally using any one of a variety of communication standards, agreement and technology.
With reference to RF circuits 108, voicefrequency circuit 110, loudspeaker 111, microphone 113, touch-sensitive display system 112, display
Controller 156, one or more optical sensors 164, optical sensor controller 158, contact module 130, figure module
132nd, text input module 134, contacts list 137 and phone module 138, video conference module 139 include be used for according to
The executable instruction of the video conference between user and other one or more participants is initiated, carries out and terminated in family instruction.
With reference to RF circuits 108, touch-sensitive display system 112, display controller 156, contact module 130, figure module 132
With text input module 134, email client module 140 includes being used to create, send, receive in response to user instruction
With the executable instruction of management Email.With reference to image management module 144, email client module 140 causes very
Easily create and send with the still image shot by camera model 143 or the Email of video image.
With reference to RF circuits 108, touch-sensitive display system 112, display controller 156, contact module 130, figure module 132
With text input module 134, instant message module 141 includes being used to input character string corresponding with instant message, modification first
The character of preceding input, corresponding instant message is sent (for example, using the Short Message Service for the instant message based on phone
(SMS) or multimedia information service (MMS) agreement or using for the instant message based on internet XMPP, SIMPLE,
Apple sending out notice service (APNs) or IMPS), receive instant message and check the executable finger of received instant message
Order.In some embodiments, the instant message for transmitting and/or receiving optionally includes figure, photo, audio file, regarded
Frequency file and/or other annexes supported in MMS and/or enhancing messenger service (EMS).As used herein, " disappear immediately
Breath " refers to the message (for example, the message sent using SMS or MMS) based on phone and the message based on internet (for example, making
Both the message sent with XMPP, SIMPLE, APNs or IMPS).
With reference to touch-sensitive display system 112, display controller 156, contact/motion module 130 and figure module 132, newly
Hearing module 142 includes being used to show the news article specific to user (for example, based on the preference specific to user from a variety of publication
Thing source collect article) and allow user with specific to user news article interact (or with specific to user's
The partial content included in news article interacts) executable instruction.
With reference to touch-sensitive display system 112, display controller 156, one or more optical sensors 164, optical sensing
Device controller 158, contact module 130, figure module 132 and image management module 144, camera model 143 include being used to capture
Still image or video (including video flowing) and the spy for storing them in memory 102, changing still image or video
Sign, and/or the executable instruction that still image or video are deleted from memory 102.
With reference to touch-sensitive display system 112, display controller 156, contact module 130, figure module 132, text input
Module 134 and camera model 143, image management module 144 include being used to arrange, change (for example, editor) or with its other party
Formula manipulates, tagged, deleting, presenting (for example, in digital slide or photograph album) and storage still image and/or video
The executable instruction of image.
With reference to RF circuits 108, touch-sensitive display system 112, display system controller 156, contact module 130, figure mould
Block 132 and text input module 134, browser module 147 include according to user instruction come browse internet (including search, chain
Be connected to, receive and show webpage or part thereof and be linked to the annex and alternative document of webpage) executable instruction.
With reference to RF circuits 108, touch-sensitive display system 112, display system controller 156, contact module 130, figure mould
Block 132, text input module 134, email client module 140 and browser module 147, calendaring module 148 include using
According to user instruction come create, show, change and store calendar and the data associated with calendar (for example, calendar,
Backlog etc.) executable instruction.
With reference to RF circuits 108, touch-sensitive display system 112, display system controller 156, contact module 130, figure mould
Block 132, text input module 134 and browser module 147, desktop small routine module 149 are optionally to be downloaded and made by user
Miniature applications program is (for example, weather desktop small routine 149-1, stock market desktop small routine 149-2, calculator desktop little Cheng
Sequence 149-3, alarm clock desktop small routine 149-4 and dictionary desktop small routine 149-5) or by user create miniature applications program
(for example, desktop small routine 149-6 that user creates).In some embodiments, desktop small routine includes HTML (hypertext marks
Remember language) file, CSS (CSS) files and JavaScript file.In some embodiments, desktop small routine bag
XML (extensible markup language) files and JavaScript file are included (for example, Yahoo！Desktop small routine).
With reference to RF circuits 108, touch-sensitive display system 112, display system controller 156, contact module 130, figure mould
Block 132, text input module 134 and browser module 147, desktop small routine builder module 150 include being used to create desktop
The executable instruction of small routine (for example, user's specified portions of webpage are gone in desktop small routine).
With reference to touch-sensitive display system 112, display system controller 156, contact module 130, figure module 132 and text
Input module 134, search module 151 include being used to be searched with one or more in searching storage 102 according to user instruction
Rope condition (for example, search term that one or more users specify) matching text, music, sound, image, video and/or its
The executable instruction of his file.
With reference to touch-sensitive display system 112, display system controller 156, contact module 130, figure module 132, audio
Circuit 110, loudspeaker 111, RF circuits 108 and browser module 147, video and musical player module 152 include allowing to use
Download and reset with the record music and other audio files of such as MP3 or AAC files storage of one or more file formats in family
Executable instruction, and for showing, presenting or otherwise resetting video (for example, in touch-sensitive display system 112
Wirelessly or via outside port 124 connect external display on) executable instruction.In some embodiments,
Equipment 100 optionally includes MP3 player such as iPod (trade mark of Apple Inc.) function.
With reference to touch-sensitive display system 112, display controller 156, contact module 130, figure module 132 and text input
Module 134, notepad module 153 include being used to create and manage holding for notepad, backlog etc. according to user instruction
Row instruction.
With reference to RF circuits 108, touch-sensitive display system 112, display system controller 156, contact module 130, figure mould
Block 132, text input module 134, GPS module 135 and browser module 147, mapping module 154 include being used to be referred to according to user
Make to receive, show, change and store map and the data associated with map (for example, steering direction；On ad-hoc location
At or near shop and other points of interest data；And other location-based data) executable instruction.
With reference to touch-sensitive display system 112, display system controller 156, contact module 130, figure module 132, audio
Circuit 110, loudspeaker 111, RF circuits 108, text input module 134, email client module 140 and browser module
147, Online Video module 155 includes executable instruction, these executable instructions allow user access, browse, receiving (for example,
By Streaming Media and/or download), reset (for example, on touch-screen 112 or wirelessly or via outside port 124 connect
On external display), send the Email of the link with specific Online Video, and otherwise management in a kind of or
The Online Video of a variety of file formats such as H.264.In some embodiments, using instant message module 141 rather than electricity
Sub- mail client end module 140 is sent to the link of specific Online Video.
As depicted in fig. 1A, portable multifunction device 100 also includes being used for the sound for providing acoustic information to audio system
Frequency output provides module 163 so that audio output can be presented (for example, as shown in figure 5, audio system can be included in audio system
Separated in portable multifunction device 100 or with portable multifunction device 100).Audio output provides module 163 optionally
Including with lower module (or instruction set) or its subset or superset：
For store on correspond to or in response to for example with the user mutual of portable multifunction device 100 and it is caused
The information of acoustic characteristic audio configuration file 402 (for example, audio envelope characteristic, pitch characteristic, left and right (L-R) equilibrium response,
Reverberation curve, frequency filtering property)；
Audio preview module 163-1, it includes being used to provide information to play the pre- of audio content (for example, particular songs)
Look at and be optionally in response to adjust the presentation of different content (for example, different songs) to the request of the first audio output is presented
(such as so that this two song is fuzzy together) executable instruction；
Audio modification module 163-2, it includes being used in response to detecting that (example can be represented by pointing to showing in user interface
Such as, it is identical show can represent or difference is shown and can represented) second user input and change the first audio output (for example, being used by pointing to
Audio output input caused by the first user that showing in the interface of family can represent input) executable instruction.In some embodiment party
In case, audio modification module 163-1 changes corresponding audio configuration file 402；And
Audio changes standard module 163-3, and it includes being used for changing standard based on audio to determine audio modification module
Whether 163-2 should change the executable instruction of the first audio output.
Above-mentioned identified each module and application program correspond to be used for perform above-mentioned one or more functions and
Method (for example, computer implemented method described herein and other information processing method) described herein
One group of executable instruction.These modules (that is, instruction set) need not be implemented as separated software program, process or module, and
Therefore each seed group of these modules is optionally combined or otherwise rearranged in various embodiments.At some
In embodiment, memory 102 optionally stores the subset of above-mentioned module and data structure.In addition, memory 102 is optionally deposited
Store up add-on module not described above and data structure.
In some embodiments, equipment 100 is such a equipment, i.e. one in the equipment group predefined function
Operation is uniquely performed by touch-screen and/or touch pad.It is used as by using touch-screen and/or touch pad and is used for equipment
The main input control apparatus of 100 operation, optionally reduce equipment 100 on be physically entered control device (such as push by
Button, dial etc.) quantity.
The one group of predefined function of uniquely being performed by touch-screen and/or touch pad is optionally included in user
Navigation between interface.In some embodiments, touch pad will show when being touched by user in the slave unit 100 of equipment 100
Any user interface navigation shown is to main menu, home menus or root menu.It is real using touch pad in such embodiment
Existing " menu button ".In some other embodiments, menu button is physics push button or other are physically entered control
Equipment rather than touch pad.
Figure 1B is the block diagram for showing the example components for event handling according to some embodiments.In some implementations
In scheme, memory 102 (in Figure 1A) or 370 (Fig. 3) include event classifier 170 (for example, in operating system 126) and
Corresponding application program 136-1 is (for example, any one in aforementioned applications program 136,137 to 155,380 to 390 applies journey
Sequence).
The application program 136-1 and answer that event information is delivered to by the reception event information of event classifier 170 and determination
With program 136-1 application view 191.Event classifier 170 includes event monitor 171 and event dispatcher module
174.In some embodiments, application program 136-1 includes application program internal state 192, the application program internal state
The one or more for indicating to show in touch-sensitive display system 112 when application program is activity or is carrying out currently should
Use Views.In some embodiments, equipment/global internal state 157 is used for which to be determined by event classifier 170
(which) application program is currently movable, and application program internal state 192 will for determination by event classifier 170
The application view 191 that event information is delivered to.
In some embodiments, application program internal state 192 includes additional information, such as one of the following
Or more persons：The recovery information used, instruction are just being employed program 136-1 and shown when application program 136-1 recovers to perform
Information or be ready for being employed the user interface state information for the information that program 136-1 is shown, for enabling a user to
Enough return to application program 136-1 previous state or the state queue of view and the repetition of prior actions that user takes/
Cancel queue.
Event monitor 171 receives event information from peripheral interface 118.Event information is included on subevent (example
Such as, as in the touch-sensitive display system 112 of a part for multi-touch gesture user touch) information.Ancillary equipment connects
Mouthfuls 118 transmission its from I/O subsystems 106 or sensor such as proximity transducer 166, one or more accelerometers 168 and/or
The information that microphone 113 (by voicefrequency circuit 110) receives.The letter that peripheral interface 118 is received from I/O subsystems 106
Breath includes the information from touch-sensitive display system 112 or touch sensitive surface.
In some embodiments, event monitor 171 sends the request to ancillary equipment and connect at predetermined intervals
Mouth 118.As response, the transmitting event information of peripheral interface 118.In other embodiments, peripheral interface 118 is only
When notable event being present (for example, receiving higher than the input of predetermined noise threshold and/or lasting more than predetermined
Time) when transmitting event information.
In some embodiments, event classifier 170 also includes hit view determination module 172 and/or life event
Identifier determining module 173.
When touch-sensitive display system 112 shows more than one view, hit view determination module 172 is provided for determining
The subevent software process where occurred in one or more views.View can be seen over the display by user
Control and other elements form.
The another aspect of the user interface associated with application program is one group of view, is otherwise referred to as applied herein
Views or user interface windows, wherein display information and occur the gesture based on touch.Touch is detected wherein
(corresponding application programs) application view optionally corresponding to application program sequencing or view hierarchies structure in
Sequencing is horizontal.For example, detecting that the floor level view of touch is optionally referred to as hitting view wherein, and it is considered as
It is that the event set correctly entered is optionally at least based in part on the hit view of initial touch to determine, the initial touch starts
Gesture based on touch.
Hit view determination module 172 and receive the information related to the subevent of the gesture based on contact.Work as application program
During with the multiple views organized in hierarchy, hit view determination module 172 will hit view, and be identified as should be to sub- thing
Minimum view in the hierarchy that part is handled.In most cases, hit view is to initiate subevent (to form thing
The first subevent in the subevent sequence of part or potential event) the floor level view that occurs wherein.Once hit view
It is hit view determination module to be identified, hit view generally receives to be identified as hitting the targeted same touch of view with it
Or all subevents that input source is related.
It is specific that life event identifier determining module 173 determines which or which view in view hierarchies structure should receive
Subevent sequence.In some embodiments, life event identifier determining module 173 determines that only hit view should receive specific
Subevent sequence.In other embodiments, life event identifier determining module 173 determines the physical location for including subevent
All views be the active view participated in, and it is thus determined that all views actively participated in should receive specific subevent sequence
Row.In other embodiments, even if touch subevent is confined to the region associated with a particular figure completely, it is classified
Higher view in structure will remain in that view for active participation.
Event information is assigned to event recognizer (for example, event recognizer 180) by event dispatcher module 174.Wrapping
In the embodiment for including life event identifier determining module 173, event information is delivered to by living by event dispatcher module 174
The dynamic definite event identifier of event recognizer determining module 173.In some embodiments, event dispatcher module 174 exists
Event information is stored in event queue, the event information is retrieved by corresponding event receiver module 182.
In some embodiments, operating system 126 includes event classifier 170.Alternatively, using journey
Sequence 136-1 includes event classifier 170.In still another embodiment, event classifier 170 is standalone module, or quilt
Storage another module in the memory 102 such as contacts/part of motion module 130.
In some embodiments, application program 136-1 includes multiple button.onreleases 190 and one or more applications
Views 191, wherein each application view includes being used to handle occurring to regard in the corresponding of user interface of application program
The instruction of touch event in figure.Include one or more event recognizers 180 using 136-1 each application view 191.It is logical
Often, respective application view 191 includes multiple event recognizers 180.In other embodiments, one in event recognizer 180
Individual or multiple event recognizers are a parts for standalone module, the standalone module such as user interface tool bag (not shown) or should
With the higher levels of object of program 136-1 therefrom inheritance method and other attributes.In some embodiments, at corresponding event
Manage program 190 include it is following one or more：Data renovator 176, object renovator 177, GUI renovators 178 and/or it is engaged in
The event data 179 that part grader 170 receives.Button.onrelease 190 optionally with or call data renovator 176, right
As renovator 177 or GUI renovators 178 carry out more new application internal state 192.Alternatively, application program
One or more of view 191 application view includes one or more corresponding event processing routines 190.In addition, one
In a little embodiments, one or more of data renovator 176, object renovator 177 and GUI renovators 178 are included in
In corresponding application programs view 191.
Corresponding event recognizer 180 receives event information (for example, event data 179) from event classifier 170, and
From event information identification events.Event recognizer 180 includes Event receiver 182 and event comparator 184.In some embodiment party
In case, event recognizer 180 also includes at least following a subset：Metadata 183 and event transmission instruction 188 (its optionally
Transmit and instruct including subevent).
Event receiver 182 receives event information from event classifier 170.Event information includes for example touching on subevent
Touch or touch the information of movement.According to subevent, event information also includes additional information, the position of such as subevent.Group thing
When part is related to the motion of touch, speed and direction of the event information optionally also including subevent.In some embodiments, thing
Part includes equipment and rotates to another orientation (for example, rotate to horizontal orientation from machine-direction oriented, or vice versa as the same) from an orientation,
And event information includes the corresponding informance of the current orientation (also referred to as equipment posture) on equipment.
Compared with event comparator 184 defines event information with predefined event or subevent, and it is based on
This compares, and determines an event or subevent, or determination or the state of update event or subevent.In some embodiments
In, event comparator 184 includes event and defines 186.Event defines 186 and includes event (such as event 1 (187-1), event 2
(187-2) and other events) definition (for example, predefined subevent sequence).In some embodiments, event
Subevent in 187, which includes for example touching, to be started, touches and terminate, touch mobile, touch cancellation and multiple point touching.In an example
In, the definition of event 1 (187-1) is the double-click on shown object.For example, double-click including advance on shown object
The first time touch (touch starts) for determining duration, the first time for predefining duration are lifted away from (touch terminates), shown object
On touch (touch starts) second of predetermined duration and being lifted away from for the second time for predetermined duration (touches knot
Beam).In another example, the definition of event 2 (187-2) is to show the dragging on object.For example, dragging includes shown pair
Touch (or contact) as upper predetermined duration, touch the movement in touch-sensitive display system 112 and the lift touched
Rise (touch terminates).In some embodiments, event also includes being used for one or more associated button.onreleases 190
Information.
In some embodiments, event defines 187 and includes being used for the definition of the event of respective user interfaces object.One
In a little embodiments, event comparator 184 performs hit test to determine which user interface object is associated with subevent.Example
Such as, shown in touch-sensitive display system 112 in the application view of three user interface objects, when in touch-sensitive display system
When detecting touch on system 112, event comparator 184 performs hit test to determine which of these three user interface objects
User interface object is associated with the touch (subevent).If each shown object and corresponding button.onrelease
190 is associated, then the result that event comparator is tested using the hit determines which button.onrelease 190 should be swashed
It is living.For example, the button.onrelease that the selection of event comparator 184 is associated with the object of subevent and triggering hit test.
In some embodiments, the definition of corresponding event 187 also includes delay voltage, delay voltage delay event letter
The delivering of breath, until having determined that whether subevent sequence exactly corresponds to or do not correspond to the event type of event recognizer.
, should when corresponding event identifier 180 determines that any event that subevent sequence is not defined with event in 186 matches
The entry event of corresponding event identifier 180 is impossible, event fails or event done state, ignores after this based on touch
The follow-up subevent of gesture.In this case, for hit view holding activity other event recognizers (if
Words) continue to track and handle the subevent of the lasting gesture based on touch.
In some embodiments, corresponding event identifier 180 includes having how instruction event delivery system should be held
Configurable attribute, mark and/or the metadata of list 183 that row is delivered the subevent of the event recognizer of active participation.
In some embodiments, metadata 183 includes indicating how event recognizer interacts or how to interact each other and be configurable
Attribute, mark and/or list.In some embodiments, metadata 183 includes whether instruction subevent is delivered to view or journey
Configurable attribute, mark and/or the list of different levels in sequence hierarchy.
In some embodiments, when one or more specific subevents of identification events, corresponding event identifier 180
The activation button.onrelease 190 associated with event.In some embodiments, corresponding event identifier 180 will be with event
Associated event information is delivered to button.onrelease 190.Activation button.onrelease 190 is different from sending subevent
(and delaying to send) hits view to corresponding.In some embodiments, event recognizer 180 is dished out and the event phase that is identified
The mark of association, and the button.onrelease 190 associated with the mark obtains the mark and performs predefined process.
In some embodiments, event delivery instruction 188 includes event information of the delivering on subevent without swashing
The subevent delivery instructions of button.onrelease living.On the contrary, event information is delivered to and subevent sequence by subevent delivery instructions
The associated button.onrelease of row or the view for being delivered to active participation.View with subevent sequence or with active participation
Associated button.onrelease receives event information and performs predetermined process.
In some embodiments, data renovator 176 creates and updated the data used in application program 136-1.
For example, data renovator 176 is updated to the telephone number used in contact module 137, or to video player
Video file used in module 145 is stored.In some embodiments, object renovator 177 is created and updated
The object used in application program 136-1.For example, object renovator 177 creates new user interface object or renewal user circle
In face of the position of elephant.GUI renovators 178 update GUI.For example, GUI renovators 178 prepare display information and send it to figure
Shape module 132 for showing on the touch sensitive display.
In some embodiments, one or more button.onreleases 190 include data renovator 176, object updates
Device 177 and GUI renovators 178 have to their access rights.In some embodiments, data renovator 176, right
As renovator 177 and GUI renovators 178 are included in corresponding application programs 136-1 or the individual module of application view 191
In.In other embodiments, they are included in two or more software modules.
It should be appreciated that the discussed above of the event handling touched on the user on touch-sensitive display is also applied to using defeated
Enter user's input that equipment carrys out the other forms of operating multifunction equipment 100, not all user's input is all in touch-screen
Upper initiation.For example, pressed optionally with mouse movement and mouse button, optionally in combination with single or multiple keyboard pressings or
Keep；Contact movement, touch, dragging, rolling etc. on touch pad；Stylus inputs；The movement of equipment；Spoken command；Inspection
The eye motion measured；Bio-identification inputs；And/or its any combinations is corresponding as the subevent with defining the event to be identified
Input.
Fig. 2 is shown has touch-screen (for example, Figure 1A touch-sensitive display system 112) according to some embodiments
Portable multifunction device 100.Touch-screen one or more figures of display optionally in user interface (UI) 200.In this reality
In other embodiments applied in scheme and be described below, user can be by, for example, one or more fingers
202 (being not necessarily to scale in the accompanying drawings) utilize one or more stylus 203 (being not necessarily to scale in the accompanying drawings)
Gesture is made on figure to select one or more of these figures figure.In some embodiments, when user is interrupted
During the contact with one or more figures, the selection to one or more figures will occur.In some embodiments, gesture is appointed
Selection of land includes one or many touches, one or many gently sweeps (from left to right, from right to left, up and/or down) and/or
The rolling (from right to left, from left to right, up and/or down) for the finger being in contact with equipment 100.In some specific implementations
In or in some cases, inadvertently will not select figure with pattern contact.For example, when gesture corresponding with selection is touch
When, the light gesture of sweeping swept above application icon will not optionally select corresponding application program.
Equipment 100 optionally also includes one or more physical buttons, such as " home " button or menu button 204.Such as
Preceding described, menu button 204 is optionally for navigating to appointing in one group of application program being optionally performed on the appliance 100
What application program 136.Alternatively, in some embodiments, menu button is implemented as being displayed on touch
The soft-key button in GUI on panel type display 112.
In some embodiments, equipment 100 include touch-screen display, menu button 204, for make equipment be powered/
Power-off and the push button 206 for locking device, one or more volume knobs 208, subscriber identity module (SIM) card
Groove 210, earphone jack 212 and docking/charging external port 124.Push button 206 is optionally for by pressing button and making
Button keeps predefined time interval to make equipment power on/off in pressed status；By pressing button and by pre-
Release button carrys out locking device before the time interval of definition；And/or releasing process is unlocked or initiated to equipment.At some
In embodiment, equipment 100 also receives the phonetic entry for activating or deactivating some functions by microphone 113.If
Standby 100 also optionally include one or more contact strengths of the intensity for detecting the contact in touch-sensitive display system 112
Sensor 165, and/or one or more tactile output generators 167 for generating tactile output for the user of equipment 100.
Fig. 3 is the block diagram according to the example of the multifunctional equipment with display and touch sensitive surface of some embodiments.
Equipment 300 needs not be portable.In some embodiments, equipment 300 is laptop computer, desktop computer, flat board electricity
Brain, multimedia player device, navigation equipment, educational facilities (such as children for learning toy), games system or control device (example
Such as, household controller or industrial controller).Equipment 300 generally include one or more processing units (CPU) 310, one or
Multiple networks or other communication interfaces 360, memory 370 and one or more communication bus for making these component connections
320.Communication bus 320 is optionally including making the circuit of the communication between system unit interconnection and control system part (sometimes
It is called chipset).Equipment 300 includes input/output (I/O) interface 330 with display 340, and the display is typically to touch
Touch panel type display.I/O interfaces 330 also optionally include keyboard and/or mouse (or other sensing equipments) 350 and touch pad 355,
For generating the tactile output generator 357 of tactile output in equipment 300 (for example, similar to above with reference to described in Figure 1A
One or more tactile output generators 167), sensor 359 (for example, optical sensor, acceleration transducer, close to sensing
Device, touch-sensitive sensors and/or strong similar to the contact above with reference to one or more contact strength sensors 165 described in Figure 1A
Spend sensor).Memory 370 includes high-speed random access memory such as DRAM, SRAM, DDR RAM or other arbitrary accesses
Solid-state memory device, and optionally deposited including such as one or more disk storage equipments of nonvolatile memory, CD
Store up equipment, flash memory device or other non-volatile solid-state memory devices.Memory 370 optionally include away from one or
One or more storage devices that multiple CPU 310 are positioned.In some embodiments, memory 370 is stored and stored just
Program, module in the memory 102 for taking formula multifunctional equipment 100 (Figure 1A) program similar with data structure, module and
Data structure, or their subgroup.In addition, memory 370 is optionally stored in the memory of portable multifunction device 100
Appendage, module and the data structure being not present in 102.For example, the memory 370 of equipment 300 optionally stores drawing mould
Block 380, module 382, word processing module 384, website creation module 386, disk editor module 388, and/or electrical form is presented
Module 390, and the memory 102 of portable multifunction device 100 (Figure 1A) does not store these modules optionally.
Each element in above-mentioned identified element in Fig. 3 is optionally stored in one or more previously mentioned
In memory devices.Each module in above-mentioned identified module corresponds to the instruction set for being used for performing above-mentioned function.It is above-mentioned
The module or program (that is, instruction set) identified need not be implemented as single software program, process or module, and therefore this
Each seed group of a little modules is optionally combined or otherwise rearranged in various embodiments.In some embodiment party
In case, memory 370 optionally stores the subset of above-mentioned module and data structure.In addition, memory 370 optionally stores above
The add-on module and data structure not described.
It attention is drawn to the reality for the user interface (" UI ") optionally realized on portable multifunction device 100
Apply scheme.
Fig. 4 A show the example of the application menu on the portable multifunction device 100 according to some embodiments
Property user interface.Similar user interface is optionally realized in equipment 300.In some embodiments, user interface 400 is wrapped
Include following element or its subset or superset：
One or more signal intensities for one or more radio communications such as cellular signal and Wi-Fi signal refer to
Show symbol 402；
Time 404；
Bluetooth designator 405；
Battery status indicator 406；
Pallet 408 with the icon for commonly using application program, these icons are such as：
The icon 416 for being marked as " phone " of zero phone module 138, the icon 416 optionally include missed call or
The designator 414 of the quantity of tone information；
The icon 418 for being marked as " mail " of zero email client module 140, the icon 418 optionally include
The designator 410 of the quantity of unread email；
The icon 420 for being marked as " browser " of zero browser module 147；And
Zero video and musical player module 152 (also referred to as iPod (Apple Inc. trade mark) module 152) is marked
It is designated as the icon 422 of " iPod "；And
The icon of other applications, such as：
The icon 424 for being marked as " message " of zero IM modules 141；
The icon 426 for being marked as " calendar " of zero calendaring module 148；
The icon 428 for being marked as " photo " of zero image management module 144；
The icon 430 for being marked as " camera " of zero camera model 143；
The icon 432 for being marked as " Online Video " of zero Online Video module 155；
The zero stock market desktop small routine 149-2 icon 434 for being marked as " stock market "；
The icon 436 for being marked as " map " of zero mapping module 154；
The zero weather desktop small routine 149-1 icon 438 for being marked as " weather "；
The zero alarm clock desktop small routine 149-4 icon 440 for being marked as " clock "；
The icon 442 for being marked as " news " of zero news template 142；
The icon 444 for being marked as " notepad " of zero notepad module 153；With
Zero sets the icon 446 of application program or module, and the icon 446 is provided to equipment 100 and its various application programs
The access of 136 setting.
It should be pointed out that the icon label shown in Fig. 4 A is only example.For example, in some embodiments, depending on
The icon 422 of frequency and musical player module 152 is marked as " music " or " music player ".Other labels optionally for
Various application icons.In some embodiments, the label of corresponding application programs icon includes and the corresponding application programs
The title of application program corresponding to icon.In some embodiments, the label of application-specific icon is different from and the spy
Determine the title of application program corresponding to application icon.
Fig. 4 B are shown with the touch sensitive surface 451 separated with display 450 (for example, flat board or touch pad in Fig. 3
355) the exemplary user interface in equipment (for example, equipment 300 in Fig. 3).Equipment 300 also optionally includes being used to detect
The intensity sensor of one or more contacts of the intensity of contact on touch sensitive surface 451 is (for example, one in sensor 359
Or multiple sensors), and/or for generating one or more tactile output generators of tactile output for the user of equipment 300
359.Although subsequent many will be provided with reference to the input on touch-screen display 112 (being wherein combined with touch sensitive surface and display)
Embodiment, but in some embodiments, the input on touch sensitive surface that equipment detection separates with display, in Fig. 4 B
It is shown.In some embodiments, touch sensitive surface (for example, 451 in Fig. 4 B) has and the master on display (for example, 450)
Main shaft (for example, 452 in Fig. 4 B) corresponding to axle (for example, 453 in Fig. 4 B).According to these embodiments, equipment detection exists
Corresponding to the position of the relevant position on display, (for example, in figure 4b, 460, which correspond to 468 and 462, corresponds to 470) place
The contact with touch sensitive surface 451 (for example, 460 in Fig. 4 B and 462).So, in touch sensitive surface (for example, 451 in Fig. 4 B)
When being separated with the display (for example, 450 in Fig. 4 B) of multifunctional equipment, the user detected by equipment on touch sensitive surface is defeated
Enter (for example, contact 460 and 462 and its movement) to be used to manipulate the user interface on display by the equipment.It is it should be appreciated that similar
Method is optionally for other users interface as described herein.
In addition, though inputted mostly in reference to finger (for example, gesture is gently swept in finger contact, finger tapping down gesture, finger
Deng) provide following embodiment, but it is to be understood that in some embodiments, one in the input of these fingers or
Multiple finger inputs are substituted by the input (for example, input or stylus based on mouse input) from another input equipment.For example,
Light gesture of sweeping optionally clicks on (for example, replacing contacting) by mouse, be cursor afterwards along the moving of the path gently swept (for example,
Instead of the movement of contact) substitute.As another example, position of the Flick gesture optionally by being located at Flick gesture in cursor
Mouse during top is clicked on and (for example, instead of the detection to contact, is off detection contact afterwards) to substitute.Similarly, when same
When detecting multiple users input, it will be appreciated that multiple computer mouses are optionally used simultaneously, or mouse and finger connect
Touch and be optionally used simultaneously.
As used herein, term " focus selector " is the current of the user interface that instruction user is just interacting
Partial input element.In some specific implementations including cursor or other positions mark, cursor serves as " focus selector ",
So that touched when cursor is above particular user interface element (for example, button, window, sliding block or other users interface element)
Input (for example, pressing input) is detected on sensitive surfaces (for example, touch sensitive surface 451 in touch pad 355 or Fig. 4 B in Fig. 3)
In the case of, the particular user interface element is adjusted according to the input detected.On including realization and touch-screen display
User interface element direct interaction touch-screen display (for example, in touch-sensitive display system 112 or Fig. 4 A in Figure 1A
Touch-screen) some specific implementations in, detected contact on the touchscreen is served as " focus selector " so that when touch
Touch on panel type display in the opening position of particular user interface element (for example, button, window, sliding block or other users interface element)
When detecting input (for example, being inputted by the pressing of contact), the particular user interface is adjusted according to detected input
Element.In some specific implementations, focus is moved to another region of user interface from a region of user interface, and nothing
Light requirement target corresponds to the movement of the contact on movement or touch-screen display (for example, by using Tab key or arrow key by Jiao
O'clock it is moved to another button from a button)；In these specific implementations, focus selector is according to the not same district of user interface
Focus between domain is mobile and moves.Do not consider the concrete form that focus selector is taken, focus selector be typically by with
Family control is interacted (for example, by being beaten to the user of equipment indicative user interface to transmit with what the user of user interface intended
The element interacted) user interface element (or contact on touch-screen display).For example, in touch sensitive surface
When pressing input is detected on (for example, touch pad or touch-screen), focus selector (for example, cursor, contact or choice box) exists
Position above the corresponding button instruction user it is expected to activate the corresponding button (rather than other users shown on device display
Interface element).
As used in the present specification and claims, " intensity " of the contact on term touch sensitive surface refers to touch
The power or pressure (power of per unit area) of contact (for example, finger contact or stylus contact) on sensitive surfaces, or refer to touch-sensitive
The power of contact on surface or the substitute (surrogate) of pressure.The intensity of contact has value scope, and the value scope is included at least
Four different values and more typically include a different values up to a hundred (for example, at least 256).The intensity of contact optionally makes
Determined (or measurement) with the combination of various methods and various sensors or sensor.It is for example, below touch sensitive surface or adjacent
In touch sensitive surface one or more force snesors optionally for measurement touch sensitive surface on difference at power.In some tools
During body is implemented, the power measured value from multiple force snesors is merged (for example, weighted average or add and), to determine estimation
The power of contact.Similarly, pressure of the pressure-sensitive top of stylus optionally for determination stylus on touch sensitive surface.As other one
The electric capacity of touch sensitive surface near kind selection, the size of the contact area detected on touch sensitive surface and/or its change, contact
And/or the resistance of the touch sensitive surface near its change and/or contact and/or its change are optionally used as on touch sensitive surface
The power of contact or the substitute of pressure.In some specific implementations, the replacement measured value of contact force or pressure is directly used in really
It is fixed whether to have exceeded intensity threshold (for example, intensity threshold is described with corresponding with substituting measured value unit).At some
In specific implementation, the replacement measured value of contact force or pressure is converted to and estimates power or pressure, and power or pressure are estimated in use
To determine whether to exceed intensity threshold (for example, intensity threshold is with the pressure threshold of pressure unit measurement).Use contact
The attribute that intensity inputs as user, so as to allow user to access user for showing (for example, on the touch sensitive display)
User's input can be represented and/or received (for example, such as being revolved via touch-sensitive display, touch sensitive surface or physical control/mechanical control
Button or button) limited area on the spot smaller equipment on the optional equipment function that can not easily access originally.
In some embodiments, contact/motion module 130 determines user using one group of one or more intensity threshold
Whether executed operates (for example, to determine whether user carries out " click " on icon).In some embodiments, root
Determine at least one subset of intensity threshold (for example, intensity threshold is not swashing by specific physical actuation device according to software parameter
Living threshold value determines, and can be conditioned in the case where not changing the physical hardware of equipment 100).For example, can be by Trackpad
Or mouse " click " threshold value of touch-screen display be arranged in large-scale predefined threshold value any one is predefined
Threshold value, without changing Trackpad or touch-screen viewing hardware.In addition, in some embodiments, the user of equipment is provided
There are software design patterns, for adjusting one or more of this group of intensity threshold (for example, by adjusting single intensity threshold
And/or to adjust multiple intensity thresholds simultaneously by using system-level click " intensity " parameter).
As used in the specification and in the claims, the term " characteristic strength " of contact refers to be based on one or more
The contact characteristic of the intensity of individual contact.In some embodiments, characteristic strength is based on multiple intensity samples.Property strengths are optional
Ground is based on (for example, after contact is detected, before detecting that contact is lifted, detecting relative to predefined event
Before or after contact start movement, before detecting that contact terminates, before or after the intensity for detecting contact increases
And/or detect contact intensity reduce before or after) for the predetermined period (for example, 0.05 second, 0.1
Second, 0.2 second, 0.5 second, 1 second, 2 seconds, 5 seconds, 10 seconds) during collection predefined quantity intensity sample or one group of intensity sample.
The property strengths of contact are optionally based on one or more of the following：The maximum of contact strength, contact strength it is equal
Value, contact average strength, contact strength preceding 10% at value, half maximum of contact strength, the 90% of contact strength
Maximum etc..In some embodiments, it is determined that using the duration of contact (for example, in property strengths during property strengths
When being the average value of the intensity of contact in time).In some embodiments, it is property strengths and one group are one or more strong
Degree threshold value is compared, to determine whether executed operates user.For example, the one or more intensity thresholds of the group may include first
Intensity threshold and the second intensity threshold.In this example, contact of the characteristic strength not less than first threshold causes the first operation, special
Levying contact of the intensity more than the first intensity threshold but not less than the second intensity threshold causes the second operation, and characteristic strength exceedes
The contact of Second Threshold causes the 3rd operation.In some embodiments, using characteristic strength and one or more intensity thresholds
Between comparison come determine whether to perform one or more operations (such as, if perform respective selection or abandon perform it is corresponding
Operation), rather than for determining to perform the first operation or the second operation.
In some embodiments, identify a part for gesture for determination characteristic strength.For example, touch sensitive surface can connect
Receipts continuously gently sweep contact, and this is continuously gently swept contact from original position transition and reaches end position (such as drag gesture),
At the end position, the intensity increase of contact.In this example, the characteristic strength contacted at end position can the company of being based only upon
The continuous light part for sweeping contact, rather than entirely gently sweep contact (for example, gently sweeping contact portion only at end position).At some
, can be it is determined that the intensity application that the forward direction of the characteristic strength of contact gently sweeps gesture smooths algorithm in embodiment.For example, this is flat
Cunningization algorithm optionally includes one or more of the following：Do not weight and gently sweep average smoothing algorithm, triangle smoothing
Algorithm, median filter smoothing algorithm and/or exponential smoothing algorithm.In some cases, in order to determine characteristic strength
Purpose, these smoothing algorithms eliminate light narrow spike or the decline swept in the intensity of contact.
User interface map (for example, Fig. 6 A-6Y and Fig. 7 A-7G) described herein alternatively includes showing on touch sensitive surface
Contact relative to one or more intensity thresholds (for example, contact detection intensity threshold value IT0, light press intensity threshold ITL, deep press
Compressive Strength threshold value ITD(for example, being at least initially higher than IL)) and/or other one or more intensity thresholds (for example, being less than IHIt is strong
Spend threshold value IL) current intensity various intensity maps.The intensity map is not usually a part for shown user interface, still
It is provided to help explain the figure.In some embodiments, light press intensity threshold corresponds to equipment and will performed generally and point
Hit the intensity for the operation that the button of physics mouse or Trackpad are associated.In some embodiments, deep pressing intensity threshold pair
Intensity as Ying Yu：Equipment will perform associated with generally with clicking on the button of physics mouse or Trackpad under the intensity
Operate different operations.In some embodiments, when detect characteristic strength less than light press intensity threshold (for example, and
Higher than the Nominal contact detection intensity threshold value IT that contact is no longer detected less than it0) contact when, the equipment will be according to touch-sensitive table
Contact movement on face carrys out moving focal point selector, related to light press intensity threshold or deep pressing intensity threshold without performing
The operation of connection.Generally, unless otherwise stated, these intensity thresholds are consistent between different groups of user interface map.
In some embodiments, response of the equipment to the input detected by equipment is depended on based on connecing during input
Touch the standard of intensity.For example, for some " light press " input, during input more than the first intensity threshold contact intensity
The response of triggering first.In some embodiments, during the response of input of the equipment to being detected by equipment depends on including input
Contact strength and time-based both criteria standard.For example, for some " deep to press " inputs, only when satisfaction first
Intensity threshold and meet between the second intensity threshold when passing by time delay, more than the second intensity threshold and big during input
The second response is just triggered in the intensity of the contact of the first intensity threshold of light press.The duration of the time delay is typically smaller than
(for example, 40ms, 100ms or 120ms, this depends on the value of the second intensity threshold to 200ms, and wherein time delay is with second
Intensity threshold increases and increased).This time delay helps prevent unexpected deep pressing input.As another example, for
Some " deep pressing " inputs, occur the period that susceptibility reduces after the first intensity threshold is met.Subtract in the susceptibility
During the small period, the increase of the second intensity threshold.This temporarily increase of second intensity threshold also helps to unexpected
Deep pressing input.For other pressing inputs deeply, time-based standard is not dependent on to the deep response for pressing input detection.
In some embodiments, one or more of input intensity threshold value and/or corresponding output are based on one or more
Individual factor and change, such as user's setting, contact movement, incoming timing, application program operation, the speed for applying intensity, concurrent
The quantity of input, user's history, environmental factor (for example, ambient noise), focus selector position etc..In U.S. Patent application sequence
Example factors are described in row number 14/399,606 and 14/624,296, the full content of the patent application is by reference simultaneously
Enter herein.
For example, Fig. 4 C show the dynamic for being based in part on and being changed over time with the intensity of the touch input 476 of time
Intensity threshold 480.Resistance to vibration threshold value 480 be following two components and：First component 474, it is arrived since initial detecting
Decay after the predefined time delay p1 of touch input 476 with the time；And second component 478, it is touched with time-tracking
Touch the intensity of input 476.The initial high intensity threshold value of first component 474 reduces the unexpected triggering of " deep pressing " response, while such as
Fruit touch input 476 provides enough intensity, then still allows for " deep pressing " response immediately.Second component 478 passes through touch
Gradual intensity fluctuation in input reduces the inadvertent free of " deep pressing " response.In some embodiments, touch input is worked as
476 when meeting resistance to vibration threshold value 480 (for example, point 481 at) in figure 4 c, triggering " deep pressing " response.
Fig. 4 D show another resistance to vibration threshold value 486 (for example, intensity threshold ID).Fig. 4 D also show two other
Intensity threshold：First intensity threshold IHWith the second intensity threshold IH.In fig. 4d, although touch input 484 is full before time p2
The first intensity threshold I of footHWith the second intensity threshold IL, but just provide response until having pass by time delay p2 in the time 482.Together
In fig. 4d, resistance to vibration threshold value 486 decays sample with the time, wherein from the time 482 through past predefined time delay p1
Afterwards, the decay starts in the time 488 (when triggering and the second intensity threshold ILDuring associated response).Such dynamic
Intensity threshold reduces：And then the response associated with relatively low intensity threshold is triggered or in triggering and relatively low intensity threshold phase
While the response of association, unexpected triggering and resistance to vibration threshold value IDAssociated response, the relatively low intensity threshold such as first
Intensity threshold IHOr the second intensity threshold IH。
Fig. 4 E show another resistance to vibration threshold value 492 (for example, intensity threshold ID).In Fig. 4 E, since initial
After detecting that touch input 490 passes by time delay p2, triggering and intensity threshold ILAssociated response.Meanwhile certainly
From initial detecting to touch input 490 pass by predefined time delay p1 after, resistance to vibration threshold value 492 decays.Therefore,
Even if when the intensity of touch input 490 is less than another intensity threshold (for example, intensity threshold IL) when, in triggering and intensity threshold
ILThe intensity of touch input 490 reduces after associated response, the intensity increase of subsequent touch input 490, without release
Touch input 490, it can trigger and intensity threshold IDAssociated response (for example, in time 494).
The characteristic strength of contact is from less than light press intensity threshold ITLIntensity increase between light press intensity threshold ITL
With deep pressing intensity threshold ITDBetween intensity be sometimes referred to as " light press " input.The characteristic strength of contact is pressed from less than deep
Compressive Strength threshold value ITDIntensity to higher than deep pressing intensity threshold ITDThe increase of intensity be sometimes referred to as " deep pressing " input.
The characteristic strength of contact is from less than contact detection intensity threshold value IT0Intensity increase between contact detection intensity threshold value IT0With it is light
Press intensity threshold ITLBetween intensity be sometimes referred to as and detect contact on touch-surface.The characteristic strength of contact is from height
In contact detection intensity threshold value IT0Intensity be decreased below contacting detection intensity threshold value IT0Intensity sometimes referred to as detect
Contact is lifted from touch-surface.In some embodiments, IT0It is zero.In some embodiments, IT0More than zero.At some
In diagram, shade circle or the oval intensity for being used to represent the contact on touch sensitive surface.Some diagram in, shadeless circle or
Intensity of the corresponding contact without specifying corresponding contact that ellipse is used to represent on touch sensitive surface.
Herein in some described embodiments, in response to detecting gesture or response including corresponding pressing input
One or more operations are performed in detecting the corresponding pressing performed using corresponding contact (or multiple contacts) input, wherein extremely
It is at least partly based on and detects that the intensity of the contact (or multiple contacts) increases to above pressing input intensity threshold value and detected
Corresponding pressing inputs.In some embodiments, in response to detecting that it is strong that the intensity of corresponding contact increases to above pressing input
Threshold value is spent to perform corresponding operating (for example, performing corresponding operating on " downward stroke " of corresponding pressing input).In some realities
Apply in scheme, the intensity that pressing input includes corresponding contact increases to above pressing input intensity threshold value and the intensity of the contact
Be decreased subsequently to less than pressing input intensity threshold value, and in response to detect the intensity of corresponding contact be decreased subsequently to be less than by
Pressure inputs threshold value to perform corresponding operating (for example, performing corresponding operating on " up stroke " of corresponding pressing input).
In some embodiments, the accident that equipment uses intensity hysteresis to avoid sometimes referred to as " shaking " inputs, wherein
Equipment limits or selection has the hysteresis intensity threshold of predefined relation with pressing input intensity threshold value (for example, hysteresis intensity
Threshold value than the low X volume unit of pressing input intensity threshold value, or hysteresis intensity threshold be pressing input intensity threshold value 75%,
90% or some rational proportion).Therefore, in some embodiments, pressing input includes the intensity of corresponding contact and increases to height
It is decreased subsequently to be less than the hysteresis for corresponding to pressing input intensity threshold value in the intensity of pressing input intensity threshold value and the contact
Intensity threshold, and in response to detecting that the intensity of corresponding contact is decreased subsequently to perform corresponding behaviour less than hysteresis intensity threshold
Make (for example, performing corresponding operating on " up stroke " of corresponding pressing input).Similarly, in some embodiments, only
The intensity for detecting contact in equipment is increased to equal to or higher than pressing input from the intensity equal to or less than hysteresis intensity threshold
The intensity of intensity threshold and the intensity optionally contacted are decreased subsequently to be equal to or less than just to detect during the intensity of hysteresis intensity
Inputted to pressing, and (for example, according to environment, the intensity of contact increases or the intensity of contact in response to detecting pressing input
Reduce) perform corresponding operating.
In order to easily explain, optionally, triggered in response to detecting situations below in response to pressing input intensity
The associated pressing input of threshold value or the description of the operation performed in response to the gesture including pressing input：The intensity of contact increases
It is big to increase to above pressing input from the intensity less than hysteresis intensity threshold to higher than pressing input intensity threshold value, the intensity of contact
The intensity of intensity threshold, the intensity of contact be decreased below pressing input intensity threshold value or contact intensity be decreased below with
Press hysteresis intensity threshold corresponding to input intensity threshold value.In addition, describing the operations as the intensity in response to detecting contact
Be decreased below pressing input intensity threshold value and in the example that performs, be optionally in response to detect contact intensity be reduced to it is low
In corresponding to and perform operation less than the hysteresis intensity threshold of pressing input intensity threshold value.As described above, in some implementations
In scheme, these triggerings responded are also depended on and meet time-based standard (for example, in the first intensity threshold of satisfaction and completely
Pass by time delay between the second intensity threshold of foot).
Fig. 5 shows the example electronic device to be communicated with display 450 and touch sensitive surface 451.Set for electronics
Standby at least one subset, according to some embodiments, display 450 and/or touch sensitive surface 451 are integrated into electronic equipment
In.Although enter with reference to electronic equipment (for example, equipment 300 in portable multifunction device 100 or Fig. 3 in Figure 1A -1B)
The touch sensitive surface 451 and display 450 of row communication describe the example of more detail below, it is to be understood that, according to some
Embodiment, touch sensitive surface and/or display integrate with electronic equipment, and in other embodiments, touch sensitive surface and display
One or more of device separates with electronic equipment.In addition, in some embodiments, electronic equipment has integrated display
And/or integrated touch sensitive surface, and one or more additional displays with being separated with electronic equipment and/or touch sensitive surface are carried out
Communication.
In some embodiments, to user interface navigation logical block 483 Single Electron equipment (for example, with
The computing device A that lower reference chart 5 describes) perform all operations described below with reference to Fig. 6 A-6Y and 7A-7G.However, it should manage
Solution, generally links together multiple different electronic equipments, to perform the behaviour below with reference to Fig. 6 A-6Y and 7A-7G description
Make (for example, electronic equipment with user interface navigation logical block 483 and the independent electronics with display 450 and/
Or the independent electronics with touch sensitive surface 451 are communicated).Any one embodiment in these embodiments
In, the electronic equipment below with reference to Fig. 6 A-6Y and 7A-7G description is that the electronics comprising user interface navigation logical block 483 is set
Standby (or multiple equipment).In addition, it will be appreciated that in various embodiments, user interface navigation logical block 483 can be multiple
Divided between different modules or electronic equipment；However, for the purpose of description herein, user interface navigation logic section
Part 483 will refer mainly to reside in Single Electron equipment, to avoid unnecessarily obscuring other aspects of embodiment.
In some embodiments, user interface navigation logical block 483 includes one or more modules (for example, one
Or multiple event handlers 190, it includes one or more object renovators 177 and one or more GUI renovators 178, such as
It is more fully described above with reference to Fig. 1 C), the one or more modules, which receive, explains input and defeated in response to these explanations
Enter to generate for updating the instruction of graphic user interface according to input is explained, the instruction is used subsequently to update on display
Graphic user interface.In some embodiments, explanation input is detected (for example, by the contact in Figure 1A -1B and 3
Motion 130), identification (for example, by event recognizer 180 in Fig. 1 C), and/or be prioritized (for example, passing through the thing in Fig. 1 C
Part grader 170) input.In some embodiments, explain that input is generated (for example, electronics by the module of electronic equipment
Equipment receives original contact input data to identify gesture from original contact input data).In some embodiments, some
Or all explanation inputs receive (e.g., including electronic equipment of touch sensitive surface 451 by electronic equipment as input is explained
Original contact input data is managed to identify gesture from original contact input data, and the information for indicating gesture is sent to bag
Include the electronic equipment of user interface navigation logical block 483).
In some embodiments, both display 450 and touch sensitive surface 451 are with including user interface navigation logical block
483 electronic equipment (for example, computing device A in Fig. 5) is integrated.For example, electronic equipment can be with integrated display (example
Such as, the 340) desktop computer or laptop computer with touch pad (for example, 355 in Fig. 3) in Fig. 3.It is used as another
Example, electronic equipment can be the portable multifunction devices 100 with touch-screen (for example, 112 in Fig. 2) (for example, intelligence
Phone, PDA, tablet PC etc.).
In some embodiments, touch sensitive surface 451 integrates with electronic equipment, and display 450 is not with including user circle
The electronic equipment (for example, computing device B in Fig. 5) of face navigational logic part 483 is integrated.For example, electronic equipment can be tool
Have and the integrated of independent display (for example, computer, monitor, television set etc.) is connected to (by wired connection or wireless connection)
The equipment 300 (for example, desktop computer or laptop computer) of touch pad (for example, 355 in Fig. 3).As another example,
Electronic equipment can be have be connected to (by wired connection or wireless connection) independent display (for example, computer monitor,
Television set etc.) touch-screen (for example, 112 in Fig. 2) portable multifunction device 100 (for example, smart phone, PDA, flat
Plate computer etc.).
In some embodiments, display 450 integrates with electronic equipment, and touch sensitive surface 451 is not with including user circle
The electronic equipment (for example, computing device C in Fig. 5) of face navigational logic part 483 is integrated.For example, electronic equipment can be tool
Have and independent touch sensitive surface is connected to (by wired connection or wireless connection) (for example, remote touch plate, portable multifunction device
Deng) integrated display (for example, 340 in Fig. 3) equipment 300 (for example, desktop computer, laptop computer, have collection
Into the television set of set top box).As another example, electronic equipment can be had (by wired connection or wireless connection) even
Be connected to independent touch sensitive surface (for example, remote touch plate, have the touch-screen as remote touch plate another is portable
Multifunctional equipment etc.) touch-screen (for example, 112 in Fig. 2) portable multifunction device 100 (for example, smart phone,
PDA, tablet PC etc.).
In some embodiments, both display 450 and touch sensitive surface 451 be not with including user interface navigation logic section
The electronic equipment (for example, computing device D in Fig. 5) of part 483 is integrated.For example, electronic equipment can be (by wired connection or
Wireless connection) it is connected to independent touch sensitive surface (for example, remote touch plate, portable multifunction device etc.) and independent display
The independent electronics 300 of (for example, computer monitor, television set etc.) are (for example, desktop computer, laptop computer, control
Platform processed, set top box etc.).As another example, electronic equipment can have to connect (by wired connection or wireless connection)
To independent touch sensitive surface (for example, remote touch plate, have the touch-screen as remote touch plate another is portable more
Function device etc.) touch-screen (for example, 112 in Fig. 2) portable multifunction device 100 (for example, smart phone, PDA,
Tablet PC etc.).
In some embodiments, computing device has integrated audio system.In some embodiments, computing device with
Separated audio system is communicated with the computing device.In some embodiments, audio system is (for example, be integrated in TV
Audio system in machine unit) it is integrated with independent display 450.In some embodiments, audio system is (for example, stereo
System) it is the autonomous system separated with computing device and display 450.
User interface and associated process
Pay attention to can be used now and communicated with display and touch sensitive surface and/or realized including its electronic equipment
The embodiment of user interface (" UI ") and associated process, the electronic equipment such as computing device is (for example, the meter in Fig. 5
Calculate a computing device in device A-D).In some embodiments, the computing device is included for detection and touch sensitive surface
Contact intensity one or more sensors.In some embodiments, the computing device includes display.In some realities
Apply in scheme, the computing device includes audio system.In some embodiments, the computing device neither include display nor
Including audio system.In some embodiments, display includes audio system (for example, display and audio system are TVs
The part of machine).In some embodiments, some parts of audio system and display are separated (for example, display is electricity
Depending on the part of machine, and audio system includes the bar speaker that is separated with television set).In some embodiments, computing device
Communicated with independent remote control, the computing device is inputted (for example, remote control passes through it including user by remote control user
The touch sensitive surface or touch-screen interacted with computing device).In some embodiments, remote control includes being used to detect remote control
The motion sensor (for example, accelerometer and/or gyroscope) of device motion (for example, user picks up remote control).
Although inputting to provide some following examples on the touch sensitive surface 451 that reference is separated with display 450,
It is that in some embodiments, as shown in Figure 4 A, (wherein touch sensitive surface is with showing for the input on equipment detection touch-screen display
Device combines).For convenience of description, reference pair had into the operation that the equipment of touch-sensitive display system 112 performs to discuss some realities
Apply scheme.In such embodiment, focus selector is alternatively：Corresponding finger or stylus contact and finger or stylus
Point (for example, the centre of form of corresponding contacts or point associated with corresponding contacts) is represented corresponding to contact, or in touch-sensitive display system
The centre of form of two or more contacts detected on 112.However, alternatively, shown in the figure on display display 450
During user interface in response to detect contact on touch sensitive surface 451 and to display 450 and independent touch sensitive surface 451 with
And the equipment of focus selector performs similar operation.
Fig. 6 A-6Y show the exemplary use for being used to dynamically adjust the presentation of audio output according to some embodiments
Family interface.More specifically, Fig. 6 A-6Y show the value based on user's input to adjust the volume of audio content and/or non-sound
The user interface of flow characteristic.For example, when playing song in equipment, user can perform for asking to provide other audio contents
Gesture.For example, song can be played in music application, and user can be in same music application program or different application
Another audio content is asked in program (for example, another audio content can be by another in instant message application
The audio-frequency unit for the video that individual user sends).As explained in further detail below, the fuzzy of audio content includes dynamically adjusting
The non-volume characteristic of first audio content (for example, the song played before user's input in equipment) is (for example, stereo flat
Weighing apparatus).
Fig. 6 A-6H show the example below：Equipment (for example, for simplicity and referred to as equipment 100) is in music application
When First song or special edition being presented in program, the second song in music application according to the length for gently sweeping gesture
Or obscured in special edition.
Fig. 6 A show shown on the touch-screen 112 of equipment 100 music application user interface 602 (in order to regarding
For the sake of feeling clear, the remainder in addition to touch-screen 112 of equipment 100 is not shown).Music application user interface
602 include the title 604 that the Moonlight Sonata of Beethovan is currently played in instruction equipment 100.That is, equipment 100 is to sound
Display system provides acoustic information 606-1 so that Moonlight Sonata (or the moon from Beethovan of Beethovan can be presented in audio system
Track/song of light sonata).As writing a Chinese character in simplified form, phrase " audio content is presented in equipment 100 " etc. is used to represent equipment 100 to sound
Display system provides acoustic information so that audio output corresponding with audio content can be presented in audio system.As explained with reference to figure 5
, audio system can be integrated into equipment 100 or be separated with equipment 100.
As sonagram 608 is schematically shown, the Moonlight Sonata of Beethovan is represented by acoustic information 606-1.Sound is believed
Ceasing 606-1 includes volume (by positional representations of the acoustic information 606-1 on the vertical axis of audio chart 608) and except volume
Outside acoustic characteristic, in this example the acoustic characteristic be left-right stereo balance (by acoustic information 606-1 in sonagram
" the L-R balances " of positional representation on 608 horizontal axis).In some embodiments, non-volume acoustic characteristic is that filtering is special
Property (for example, cut-off frequency and/or decay factor of low pass filter).
Music application user interface 602 also includes audio content and represents 610 (for example, representing that the moonlight of Beethovan is played
The bent audio content of ring represents 610-1；Represent that the audio content of the requiem of Mozart represents 610-2；And represent Bo Lamu
The audio content of this alto rhapsody represents 610-3).Audio content represents that 610 be each to occupy the use on touch-screen 112
The Drawing Object (also referred to as " graphical user interface object ") of the respective regions at family interface 602.In all cases, audio content
Represent that 610 represent：Song, special edition, the tinkle of bells, video content object are (for example, video content occurs in text instant message window
Position), the audio file object that occurs in text instant message window or any other type including audio frequency component
Media content.In this example, audio content represent 610 be special edition expression and including shown album cover.
In the beginning of the example shown in Fig. 6 A-6H, L-R balances are balanced, and in addition to acoustic information 606-1,
Equipment 100 does not provide any other acoustic information.
As shown in Figure 6B, when the Moonlight Sonata of Beethovan is being presented in audio system, equipment 100, which receives to correspond to, is in
The input 612 (for example, gently sweeping gesture) of the request of the requiem of existing Mozart.In this example, because by with Mozart's
Audio content corresponding to requiem represents 610-2 to receive input 612, so input 612 is the peace soul for Mozart to be presented
Bent request.
In some embodiments, in response to the initial part (for example, light slight movement for sweeping gesture) of input 612, if
Standby 100 imply that it will start fuzzy audio (for example, acoustically and/or visually).In some embodiments, as made herein
, term " fuzzy audio " refers to change acoustic characteristic to change high-lighting of the fuzzy audio when it is played, to cause
User can better discriminate between other audios with fuzzy audio while broadcasting.When audio " fuzzy ", " obscuring gradually in audio
Enter " correspond to the high-lighting of the fuzzy audio of increase (for example, by increasing the cut-off frequency of low pass filter and/or making audio court
Offset to center channel), and " fuzzy gradually to go out " corresponds to the high-lighting for reducing fuzzy audio (for example, by reducing LPF
The cut-off frequency of device and/or audio is removed from center channel).In some embodiments, the acoustic characteristic bag being fade-in is obscured
Include volume.In some embodiments, obscure the acoustic characteristic that is fade-in include one or more non-volume acoustic characteristics (for example,
Cut-off frequency or the left/right balance of low pass filter).For example, equipment 100 provides auditory cues, i.e., by using the first of input 612
The value (for example, light slight movement for sweeping gesture) of initial portion dynamically adjusts acoustic information 606-1 L-R balances, and audio will
Start to obscure.In this example, acoustic information 606-1 L-R balances slight shift to the left.Another as auditory cues shows
Example, information volume 606-1 volume reduce.In some embodiments, equipment 100 also represents 610- by increasing audio content
The vision high-lighting of 2 (it is in fig. 6b by representing that 610-2 runic frame is schematically shown around audio content) provides
Visual cues.In some embodiments, increasing vision high-lighting includes visually obscuring in addition to audio content represents 610-2
Other audio contents represent (and alternatively equally visually obscure user interface remainder).In some embodiments
In, as described below, these promptings are provided before the requiem of Mozart acoustically " is obscured and is fade-in ".
In some embodiments, visual effect (for example, blur radius) and the non-volume acoustic characteristic dynamically adjusted
(for example, sweeping extension with light, user interface 602 passes through offset sound (in addition to audio content represents 610-2) for change in combination
Information 606-1 L-R balances are obscured with lockstep).
As shown in Fig. 6 C-6D, equipment 100 provides acoustic information 606-2 to audio system, so that the moonlight with Beethovan is played
The bent requiem that Mozart is presented simultaneously of ring.In some embodiments, the value in response to input 612 exceedes predetermined
Threshold value (for example, this, which gently sweeps movement, exceedes small predetermined amount), complete " fuzzy to be fade-in " of the second audio content.In some realities
Apply in scheme, the requiem of Mozart is statically presented in equipment 100；That is, once the requiem of Mozart commences play out, its just with
Fixed volume and fixed L-R balance (for example, balanced L-R balances) to carry out.Alternately, as illustrated, also according to
The value of input 612 dynamically adjusts the presentation of the requiem of Mozart.For example, when user further moves to left inputting 612
When dynamic, the L-R balances of the requiem of Mozart offset (the acoustic information 606- in sonagram 608 in such as Fig. 6 C-6D more to the left
2 to the left skew shown in).Continue to dynamically adjust the presentation of the Moonlight Sonata of Beethovan according to gesture is gently swept.For example,
When user, which will input 612, further to be moved left, the L-R balances of the Moonlight Sonata of Beethovan offset (such as Fig. 6 C-6D more to the left
In sonagram 608 in acoustic information 606-1 to the left skew shown in).This gives feels below user：The moon of Beethovan
Light sonata is offset to the left from arena theatre, and the requiem of Mozart is displaced on arena theatre from right side,
So as to occupy the position of Moonlight Sonata.
In some embodiments, equipment 100 dynamically adjusts the moonlight of Beethovan always according to the value for gently sweeping gesture
(for example, when input 612 is moved farther leftward as, equipment 100 reduces volume to the volume of sonata, such as the audio in Fig. 6 C-6D
In Figure 60 8 acoustic information 606-1 offset downward it is represented).In some embodiments, equipment 100 is always according to gently sweeping hand
The size of gesture come dynamically adjust the volume of the requiem of Mozart (for example, when input 612 be moved farther leftward as when, equipment
The volume of the requiem of 100 increase Mozarts, as acoustic information 606-2 offsets up institute in the sonagram 608 in Fig. 6 C-6D
Represent).In some embodiments, the volume of the requiem of the Moonlight Sonata of Beethovan and Mozart generally with display
The expression 610-1 that is shown respectively in the predefined region (for example, central area of whole display or display) of device and
610-2 fraction is proportional.Therefore, when user moves audio content expression 610-2 on the center of display to, Mozart's
Requiem becomes more prominent and more placed in the middle acoustically acoustically.
The equipment 100 that Fig. 6 E shows detects the end (for example, user's input 612 has been released) of user's input 612.Cause
This, no longer shows user's input 612 in Fig. 6 E.
In some embodiments, in response to detecting that user inputs 612 end, equipment 100 is based on determining input 612
Value exceed (or having exceeded) predetermined threshold value come determine whether to continue present the first audio content (for example, and stopping
The second audio content is only presented), or vice versa it is as the same.
Fig. 6 F are shown in this example, because input 612 has dragged audio content and represented 610-2 so that it compares audio
Content representation 610-1 is more shown, so the release of input 612 causes audio content to represent that 610-2 is moved in screen
Between position, wherein equipment 100 only shows the requiem of Mozart.Accordingly, in response to the end for detecting input 612, equipment
100 stop that the first audio content (for example, Moonlight Sonata) is presented and continue that the second audio content (peace soul of Mozart is presented
It is bent).In some embodiments, equipment 100 is completed to adjust the dynamic of the requiem of Mozart (for example, in release input 612
Afterwards, L-R balances and volume are gradually changed within the period of 0.5 second so that balancedly present not with the volume that pre-sets
Zha Te requiem).This is offset to show by the upward of the acoustic information 606-2 in the sonagram 608 in Fig. 6 E-6F and to the left
Show to meaning property.In some embodiments, in response to detecting the end of input 612, visual effect (for example, fuzzy) also by
Reversion.
Fig. 6 G-6H are shown if input 612 represents 610-2 so that it is represented than audio content without dragging audio content
610-1 is more shown what will then occur in this example.Therefore, Fig. 6 G are shown immediately in release ratio input
612 it is shorter but similar to input 612 input after user interface 602 state.As response, as shown in figure 6h, equipment
100 stop presenting the requiem of (for example, causing audio system to stop presenting) Mozart, and restart that Beethovan is only presented
Moonlight Sonata.Then the Moonlight Sonata of Beethovan is presented, without being dynamically adjusted to it (for example, at 0.5 second
The change of interior reversion L-R balance and volume, to cause balancedly and the volume to pre-set is played the moonlight of Beethovan is presented
Ring is bent).This is offset schematically to show by the upward of the acoustic information 606-1 in the sonagram 608 in Fig. 6 G-6H and to the left
Go out.In some embodiments, in response to detecting the end of input, visual effect (for example, fuzzy) is also inverted.
In some embodiments, when the value of input 612 meets that be more than the first predetermined threshold value second is advance
During the threshold value of determination, equipment 100 visually and acoustically by the second audio output " ejection " to appropriate position (for example, depositing
In first threshold, if wherein release inputs, the second audio output is moved to appropriate location, and Second Threshold be present, its
In even release input before, the second audio output is ejected into appropriate position).
In some embodiments, the alternative solution as the example shown in Fig. 6 E-6H, in response to detecting input 612
End, equipment 100 continue present adjustment the first audio output and continue present the second audio output.
Fig. 6 I-6O show the example below：Equipment (for example, for simplicity and referred to as equipment 100) is in music application
When song or special edition being presented in program, according to the intensity of pressing input in instant message application (for example, and music application
The different application program of program) in the video for being sent to user audio-frequency unit in obscure.Example shown in Fig. 6 I-60 it is each
Individual aspect is similar to the example shown in Fig. 6 A-6H.These details are not repeated herein.Example and Fig. 6 A-6H institutes shown in Fig. 6 I-60
Difference between the example shown is：In Fig. 6 I-60, input is pressing input, and its value is the intensity of pressing input；And
In addition, in Fig. 6 I-60, equipment 100 is fuzzy to come from two different applications (for example, music application and instant message application
Program) audio.
In addition, Fig. 6 I-60 are shown by dynamically adjusting low pass filter cutoff frequency rather than L-R balances to obscure
Audio.Therefore, Fig. 6 I-60 include sonagram 613.The vertical axis of sonagram 613 represents volume, and horizontal axis represents low
Pass filter cut off frequency.
Fig. 6 I show the user interface 614 of the instant message application program for being shown on touch-screen 112.User circle
Face 614 shows message 616, some message in the message 616 by equipment 100 user (for example, message 616-1 and 616-2)
Receive, and some message in the message 616 send (for example, message 616-3) by the user of equipment 100.User interface 614
Head portrait 618 including the participant in instruction session is (for example, " Alex " and its head portrait that its head portrait is 618-1 are 618-2
" Tina ").For example, Tina sends the message 616-1 of the expression for video to Alex.
In Fig. 6 I, sonagram 613 includes acoustic information 606-3 expression, so as to mean that audio is presented in equipment
Content.In this illustration, acoustic information 606-3 corresponds to Bo Lamusi alto rhapsody, therefore equipment 100 is logical first
Cross and separated from instant message application program or different music applications is presented Bo Lamusi alto rhapsody.With spy
Accordatura amount and provide vigorous drawing by being arranged to the low pass filter cutoff frequency (hereinafter referred to " cut-off frequency ") of high level
This alto rhapsody of nurse.In some embodiments, the peak frequency (example audible higher than people of cut-off frequency during beginning
Such as, about 20kHz) so that when do not perform audio it is fuzzy when, low pass filter does not have audible influence to audio output.One
In a little embodiments, when starting (that is, when do not perform audio it is fuzzy when) do not apply low pass filter.On the contrary, when audio obscures
During beginning, low pass filter is opened.For simplicity, Fig. 6 I show be arranged to during by starting the cut-off frequency of high level come
The acoustic information 606-3 of presentation.
As shown in Fig. 6 J-6K, when alto rhapsody is presented in equipment 100, equipment 100 is received with disappearing for video to be presented
Input 620 corresponding to 616-1 (audio for including video messaging 616-1) request is ceased (for example, input is in touch-screen 112
Input on region corresponding with video messaging 616-1).
In this example, input 620 is the pressing input (for example, press and keep inputting) on touch-screen 112.Touch-screen
112 have the one or more sensors for the intensity for being used to detect contact.The intensity of input 620 is indicated on intensity map 622.
In Fig. 6 J, the intensity for inputting 620 is higher than prompting threshold value (for example, ITH).Therefore, equipment 100 starts video messaging 616-1
Audio-frequency unit in Bo Lamusi alto rhapsody is acoustically obscured.That is, when the intensity of input 620 is higher than prompting threshold
Value is (for example, ITH) but be not above spying on threshold value (for example, ITL) when, equipment 100 reduces female when inputting 620 intensity increase
The volume of bass rhapsody and reduce cut-off frequency.These effects are downward by the acoustic information 606-3's in sonagram 613
Skew is schematically shown to the left.The effect for reducing the cut-off frequency of low pass filter is filter out alto rhapsody more next
More high fdrequency components is so as to its remaining bass.
It is meanwhile (upward such as acoustic information 606-4 corresponding with video messaging 616-1 with the intensity increase of contact 620
Represented by arrow), video messaging 616-1 volume increases (for example, proportionally).Acoustic information 606-4 actually not by
(for example, low pass filter is filtered by the cut-off frequency higher than human audible range to it, or its is basic for LPF
It is not low pass filtering).
In some embodiments, the intensity for simply entering 620 has been higher than prompting threshold value (for example, ITH) but have not exceeded
Threshold value is spied on (for example, ITL), then video messaging 616-1 vision high-lighting dynamically changes (example with the intensity of input 620
Such as, the sense of hearing high-lighting of the vision high-lighting of video and corresponding audio increases with the increase of intensity, and with intensity
Reduce and reduce).For example, as shown in Fig. 6 J-6K, the intensity of increase input 620 increases video messaging 616-1 size,
Make video messaging 616-1 placed in the middle, and by the blur radius user interface 614 proportional to the intensity of input 620
Any message in addition to video messaging 616-1 is fuzzy, and (blur radius of increase in these figures is by except video messaging 616-1
Outside cover all user interfaces 614 the transparency of reduction of pattern schematically show).
IT is can be seen that by comparing Fig. 6 J and Fig. 6 KHAnd ITLBetween increase intensity influence.In some embodiments
In, user can repeatedly purify alto rhapsody and video messaging 616-1 by increasing and reducing the intensity of input 620
Volume (and cut-off frequency of alto rhapsody).For example, if Fig. 6 J and 6K were inverted, acoustic information 606-3 sound
Amount and cut-off frequency will increase, and acoustic information 606-4 volume will reduce.
In this example, when video messaging 616-1 audio output is presented in equipment 100, equipment 100 is also presented video and disappeared
Cease 616-1 video frequency output.Therefore, Fig. 6 J-60 show that video progress (flies for example, video messaging 616-1 is bird around framework
The simple video of Xiang).
As shown in Fig. 6 L-6M, when the intensity for inputting 620 reaches " spying on " threshold value, equipment 100 passes through the cut-off that pre-sets
Bass rhapsody is presented in frequency and the first volume pre-seted (for example, amount of bass), and passes through the second volume pre-seted
(for example, the volume pre-seted than first higher volume) is presented video messaging 616-1, and unrelated with the intensity of input 620
(for example, the intensity for simply entering 620 keeps below " ejection " threshold value, it is IT to be somebody's turn to do " ejection " threshold value in this exampleD).For example,
Equipment 100 detects that the intensity of input 620 increases above ITL(Fig. 6 L), the intensity for subsequently inputting 620 decreases below ITL(figure
6M), but in sonagram 613 by acoustic information 606-3 and acoustic information 606-4 maintain its " spy on " opening position (for example,
Even if the intensity of contact is decreased below ITL, the vision high-lighting of video and the sense of hearing high-lighting of correspondence audio are also maintained at
Rank at least shown in 6K).Effect is that the audio from video messaging 616-1 is mainly presented, wherein only alto rhapsody
Quiet bass background keep it is audible.
In addition, after the intensity of input 620 reaches " spying on " threshold value, vision changes locked.In Fig. 6 L, video disappears
Breath 616-1 is centered about, and the remainder of wherein user interface 614 seriously obscures.When the intensity of input 620 is decreased below
ITLWhen, this fuzzy and video messaging 616-1 center is kept in Fig. 6 M.
However, in some embodiments, the release inputted at 620 any point in Fig. 6 J-6M will cause equipment
100 stop that video messaging 616-1 is presented and recover to present alto rhapsody completely (for example, with the second volume pre-seted
And without filtering), and alternatively return to the state of user interface shown in Fig. 6 I.
Fig. 6 N-60 are shown in some embodiments, when the intensity of input 620 is higher than ejection threshold value (for example, ITD)
When, video messaging 616-1 " ejection " is arrived appropriate position by equipment 100.Even if the intensity of input 620 is subsequently fallen below
ITDOr input 620 is fully completed, once the intensity of input 620 is higher than deep pressing threshold value ITD, video messaging 616-1 sound
Amount is just maintained at the second volume pre-seted and keeps not filtered (Figure 60).In some embodiments, equipment 100 will regard
Frequency message 616-1 be visually ejected into appropriate position (for example, video messaging 616-1 extension so as to occupy whole screen or
Most of screen).In addition, equipment 100 stops that the first audio output (for example, alto rhapsody) is presented.
Fig. 6 P-6Y show the example below：According to some embodiments, because the characteristic strength of contact changes, equipment (example
Such as, for simplicity and referred to as equipment 100) by dynamically change media item one or more acoustic characteristics set come
Audio of the preview from media item.For example, at least for a range of contact strength, when equipment 100 receives the table of song
During the contact shown, equipment 100 will play song with the volume proportional to the intensity of contact.In some embodiments,
When contact reaches the first intensity threshold, even if the intensity of contact then declines, equipment 100 also will be pre- by the way that volume is maintained
The rank of setting carrys out " spying on " previewing media item.In some embodiments, when contact reaches the second intensity threshold, equipment
100 will perform another operation (for example, in addition to previewing media item), such as perform selection operation.
Fig. 6 P-6Y also show the example below：In response to input, equipment 100 hides (for example, fuzzy) whole user interface
(in addition to selected user interface object) or the part for only hiding user interface.In some embodiments, contact is worked as
When meeting the activation standard based on intensity, masking user interface is performed (for example, whole user interface or only one of user interface
Point).For example, intensity rises above prompting threshold value ITHPressing and keep input to cause to cover, and Flick gesture causes to perform
Different operations (for example, selection operation to user interface object).
Fig. 6 P show the user interface 640 for instant message application program.User interface 640 includes interaction area
642-1.Interaction area 642-1 is that the multiple message 644 included between sessions participant (for example, Alex and Tina) are (therein
Message 644-1, message 644-2 and message 644-3 are representational) conversation region.User can be by rolling through message 644
(for example, the position in conversation region is shown by scroll bar 646) or by being interacted with each message 644 (for example, in message
Touched on 644-3 to play video, or (such as and keeping) is pressed " to spy on " video on message 644-3, such as referred to
Described in Fig. 6 I-60) interact with interaction area 642-1.Interaction area 642-1 also include it is multiple show can represent (for example,
Icon 648-1, icon 648-2, icon 648-3 and icon 648-4, it can each realize specific functions of the equipments) and frame 650
(for example, user inputted but be not yet sent to the content of other sessions participants show region).
Fig. 6 P show the input 652 (for example, Flick gesture) on icon 648-3.As shown in Fig. 6 Q, Flick gesture 652
So that user interface 640 shows interaction area 642-2 (for example, independent interaction area different from interaction area 642-1).One
In a little embodiments, interaction area 642-1 is the user interface for primary application program (for example, instant message application program),
And interaction area 642-2 is display configured to come the content of the different miniature applications programs of operation in comfortable primary application program.
User can gently sweep between miniature applications program, so as to change the miniature applications program shown in interaction area 642-2.Interaction
The showing for list that region 642-2 also includes proposing the miniature applications program that will be shown in interaction area 642-2 can represent
659.Designator 654 indicates currently show which miniature applications program (for example, gently sweep to lead to the left in interaction area 642-2
Cause shows different miniature applications programs in the 642-2 of region, and the solid dot in designator 654 is moved right).
In this example, miniature applications program is for selecting shared media in the session between sessions participant
Media selection miniature applications program 656.(for example, nearest 30 song that display plays on the appliance 100 rolls table
It is single).Media selection miniature applications program includes the expression (for example, media item 658-1 to 658-4 expression) of media item 658.
In some embodiments, media item is song, special edition, video etc..Represent 658-3 include relevant media item (for example, artist,
Song title) and album cover picture display information.In some embodiments, the corresponding Flick gesture represented on 658 is not (
Show) selected by placing it in frame 650 it is corresponding represent 658 (for example, being used as audio message so that its be segmented with
For being sent to session).In some embodiments, the corresponding Flick gesture (not shown) represented on 658 is by playing media
(for example, on the appliance 100 local play) selects corresponding to represent 658.
Fig. 6 R are shown including representing the defeated of the contact on 658-2 (for example, represent the pressing on 658-2 and keep gesture)
Enter 660.As shown in intensity map 668, by with higher than prompting threshold value ITHContact strength, press and hold gesture satisfaction
Media cue standard (for example, activation standard based on intensity).Therefore, equipment 100 commence play out media item with represent 658-2
It is corresponding a part (for example, beginning or be selected as comprising media item recognizable part representative part).In audio
By audio output 664 come the broadcasting of presentation medium item in Figure 66 2.Sonagram 662 shows that the volume of media item and time close
System.
As shown in Fig. 6 R-6S, when media item plays, equipment 100 changes and dynamic with the characteristic strength of contact
Ground changes the volume of media item (for example, the volume of media item being as the characteristic strength of contact increases and increases, and with contact
Characteristic strength reduce and reduce).For example, from the intensity increase of Fig. 6 R to Fig. 6 S contact (for example, from being just above ITHArrive
Just it is less than ITL) along with the increase of corresponding volume, (arrow in intensity map 668 in Fig. 6 R-6V is shown from the strong of preceding figure
The change of degree；Similarly, the solid line in the sonagram 662 in Fig. 6 R-6U show the figure with the arrow pair in intensity map 668
The change answered, and the change before dotted line expression in figure).If intensity is inverted (if for example, Fig. 6 S occur before Fig. 6 R),
Then the volume of media item will reduce.
In some embodiments, when having produced different audio output before media item commences play out, such as refer to
Described by Fig. 6 A-60, method 800, method 840 and Fig. 8 A-8C, equipment 100 is fuzzy together by two audio output.
In addition, Fig. 6 R-6S show that equipment 100 dynamically changes interaction area 642-2 when the volume change of media item
Outward appearance.For example, when the characteristic strength of contact changes, the dynamic hidden of equipment 100 (for example, fuzzy) interaction area 642-2 (examples
Such as, with the lockstep of the change with audio so that increase with the characteristic strength of contact, blur radius also increases).Cause
This, increases (when equipment is moved to Fig. 6 S from Fig. 6 R from the intensity increase of Fig. 6 R to Fig. 6 S contact along with the corresponding of fuzziness
When, the fuzziness of the increase in these figures by the other guide in covering interaction area 642-2 pattern reduction transparency
Schematically show).In this example, the dynamic hidden interaction area 642-2 of equipment 100 is without hiding interaction area 642-1
(for example, to indicate that the prompting is related to the miniature applications program part of user interface and is not related to whole user interface).
In addition, the expression 658-2 not being hidden dimensionally increases with the increase of contact strength and is moved to friendship
Mutual region 642-2 center.In this example, as long as contact strength not up to " spies on " intensity threshold (for example, ITL), user
Can by the intensity of " prompting " scope (for example, in ITHWith ITLBetween) change the intensity of contact and repeatedly purify and regard
Feel to change and change with the sense of hearing.
Fig. 6 T-6U show that contact reaches the result for spying on threshold value (for example, equipment 100 is detected higher than ITLContact
The result of characteristic strength increase).In this example, once the intensity of contact, which reaches, spies on threshold value, the volume of audio output 664 is just
Keep fixed (for example, being locked to the rank pre-seted, any volume that equipment 100 is arranged to by such as user).Therefore, ITL
With ITDBetween the intensity increase of contact do not cause the increase of volume.Similarly, as shown in Fig. 6 U, subsequently detect less than ITL
The reduction of characteristic strength of contact volume is not influenceed (as long as example, continuous maintain contact；In certain embodiments,
Lifting gradually or immediately stops the presentation of media item and visible change is inverted into interaction area 642-2).
In some embodiments, once contact reaches ITL, equipment 100, which is just shown, indicates 661, that is, the feature contacted is strong
Degree increase will cause equipment relative to media item to perform selection operation (for example, language " 3D TOUCH TO SHARE ").It is less than
ITLContact intensity subsequent reduction do not change interaction area 642-2 remainder masking, represent 658-2 size,
Or " 3D TOUCH TO SHARE " are indicated.
Fig. 6 V show that equipment 100 is detected higher than " ejection " threshold value (for example, ITD) contact characteristic strength increase.
Therefore, equipment 100 stops playing media item (therefore, do not have sonagram 662 in Fig. 6 V-6X) and performs choosing for media item
Select operation (for example, media item is placed in frame 650 by equipment 100).
In some embodiments, as illustrated, detecting more than ITDContact intensity after be immediately performed selection
Operation.It is invalid that input 660 subsequently becomes.In other words, although input 660 is illustrated in original representation 658-2 in Fig. 6 V
On, but input 660 does not influence on original representation 658-2.User can be inputted by discharging input 660 and inputting new user
To reselect original representation 658-2.
In Fig. 6 V, media item is represented by audio message 644-4 now, and it corresponds to the expression as shown in Fig. 6 Q-6U
658-2.In some embodiments, audio message 644-4 seems identical with the expression 658-2 shown in Fig. 6 R.In addition, equipment
100 stop masking interaction area 642-2 (for example, reversion is fuzzy).
Place the content at also causes equipment 100 to show " transmission " button 670 in frame 650.Fig. 6 W show that selection is sent
The user of button 670 inputs 672 (for example, Flick gestures), and audio message 644-4 is sent to sessions participant and caused by it
Audio message 644-4 is added to conversation region, as shown in Fig. 6 X.
Fig. 6 Y show the contact being included on audio message 644-4 (for example, pressing and guarantor on audio message 644-4
Hold gesture) input 674.Because the contact in the contact of input 674 is higher than ITH, so in addition to audio message 644-4, if
Standby 100 hide interaction area 642-1 and interaction area 642-2.In some embodiments, in response to higher than ITHContact
Under pressing and keep inputting, the mode of equipment 100 also in a manner similar to that previously described (e.g., including dynamically changes
Audio) carry out preview audio message 644-4.By contrast, in response to Flick gesture (for example, with less than ITHIntensity), equipment
100 perform selection operation (for example, playing whole audio message 644-4) relative to audio message 644-4, should without masking
With the second interaction area of program and the first interaction area of application program need not be covered.
The additional detail about Fig. 6 A-6Y (and user interface shown in it) is provided below with reference to Fig. 8 A-8H.
Fig. 7 A to 7G are shown according to some embodiments for providing audio output based on audio configuration file
Exemplary user interface.More specifically, Fig. 7 A-7G show the example below：Showing can represent (for example, pressing on touch-screen 112
Button) activation cause equipment output that there is audio configuration file (for example, management tone, reverberation, and/or audio output are with the time
Decay audio configuration file) sound.Show that equipment determines whether to meet audio change mark when can represent when activating second
Standard, and if it is satisfied, then modification is shown with first can represent corresponding audio configuration file.For example, when energy table is shown in activation first
Activation second shows that the equipment causes first to show that the sound that can be represented quickly is decayed when can represent shortly after showing.
User interface in these figures is used to illustrate the process in procedures described below, including Fig. 9 A-9C.
For convenience's sake, Fig. 7 A-7G are described with reference to equipment 100.As writing a Chinese character in simplified form, " equipment 100 presents and shows energy phrase
Audio corresponding to expression " etc. is used to mean that equipment 100 provides (or initiating to provide) acoustic information to audio system, to cause sound
Display system can be presented can represent corresponding audio output with showing.As explained with reference to figure 5, audio system can be integrated into equipment
Separated in 100 or with equipment 100.
More specifically, Fig. 7 A-7G show the example below：As the threshold time T for showing the activation that can be represented firstthresIt is interior
Activation second is shown when can represent, meets that audio changes standard.
Fig. 7 A show the user interface 702 for telephony application (for example, phone module 138).User interface shows
Show keypad 704, character can be for example input in dialed number column 706 by user by the keypad 704.Therefore, small key
Disk 704 include with numeral corresponding to one group show and can represent 708 (for example, it is corresponding with " 5 " show can represent 708-1 and corresponding with " 2 "
Show can represent 708-2).
As shown in Figure 7 B, equipment 100 is in time T1Detect and show the can represent 708-1 first input 710 for activating, and
And place " 5 " in dialed number column 706.Fig. 7 B also show to provide and be represented with the audio output of time (for example, audio configuration
File) sonagram 712.Detect time T during the first input 7101It is labeled on the horizontal axis of audio chart 712.
The volume for the audio output that the vertical axis instruction of audio figure 712 is shown on audio figure 712.First audio configuration file
714-1 is the first audio output with showing that to represent 708-1 corresponding and in response to showing the table that can be represented 708-1 and be presented
Show.The first audio configuration file 714-1 of the first audio output of display completely in Fig. 7 D sonagram 712.First audio is defeated
Go out in time T1Steeply rise afterwards, then finally decay to zero volume.Come in addition, sonagram 712 indicates with c sharps tone
Produce the first audio output.
Fig. 7 C show equipment 100 in the second time T2(for example, time after T1) detects that sensing is shown and can represented
(for example, detecting the activation of dui " 2 " button, " 2 " are placed into dialed number column 706 by it for 708-2 the second input 716
In).In this example, when equipment 100 detects the activation that can represent showing 708-2, equipment 100 produces is matched somebody with somebody by the second audio
Put the second sound output of file 714-2 expressions.In some embodiments, the second audio configuration file 714-2 and the first sound
Frequency configuration file 714-1 identical (for example, default audio configuration file of keypad sound).
Because detect the second time T of the second input 7162In threshold time TthresAfterwards, so equipment 100 continues root
The first audio output is presented according to the first audio configuration file 714-1.By contrast, Fig. 7 E-7G are similar to Fig. 7 B-7D, except
Detect the second time T of the second input 7162In threshold time TthresOutside before.In this case, audio change mark is met
Standard, therefore equipment 100 does not continue that the first audio output with the first audio configuration file 714-1 is presented, but presenting has
(the first modified audio output follows Fig. 7 F- to modified audio configuration file 714-3 the first modified audio output
The solid line for being is marked in 7G；Be marked as 714-1 dotted line be used for show if less than footsteps frequency change standard without
What the audio configuration file of change should be).
In some embodiments, when the first audio output is presented in equipment 100, equipment 100 presents defeated with the first audio
Go out corresponding visual effect.For example, as shown in figs. 7 c-7d, visual effect includes to represent 708-1 outwards (for example, remote from showing
From) extension one or more figures 718 (for example, ring, ripple).Similarly, when the second audio output is presented in equipment 100,
Equipment 100 is presented away from showing the figure 720 that can be represented 708-2 and stretch out (for example, ring, ripple).
The additional detail about Fig. 7 A-7G (and user interface shown in it) is provided below with reference to Fig. 9 A-9C.
Fig. 8 A-8B are the stream for the method 800 for describing the presentation for dynamically adjusting audio output according to some embodiments
Cheng Tu.Fig. 6 A-60 are used for the method and/or process for illustrating Fig. 8 A-8B.Although touch-sensitive display (wherein touch sensitive surface will be referred to
Be combined with display) on input provide some following examples, but in some embodiments, equipment detect with
Input on the separated touch sensitive surface 451 of display 450, as shown in Figure 4 B.
In some embodiments, method 800 by electronic equipment (for example, Figure 1A portable multifunction device 100) and/
Or one or more parts of electronic equipment (for example, I/O subsystems 106, operating system 126 etc.) perform.In some embodiment party
In case, method 800 is managed by instruction, and the instruction is stored in non-transient computer readable storage medium storing program for executing and by the one of equipment
Individual or multiple processors (such as one or more processors 122 of equipment 100 (Figure 1A)) perform.For convenience of description, below
The method 800 performed by equipment 100 is described.In some embodiments, with reference to figure 1A, the operation of method 800 is at least in part
Performed by audio preview module 163-1, audio modification module 163-2 and touch-sensitive display (for example, touch-screen 112) or it is entered
Exercise and use.Certain operations in method 800 are optionally combined, and/or the order of certain operations is optionally changed.
As described below, method 800 (and associated interface) reduce the quantity of the input from user, scope and/or
Property, and more effective man-machine interface is produced, come and user interface so as to provide the user easy to use and intuitive way
Interact.For battery powered electronic equipment, method 800 by provide should be readily appreciated that with informative audio output come
Effective, seamless and quick interaction is realized, it is saved electric power and increases the time between battery charging (for example, passing through reduction
Draw the demand of the extensive and poorly efficient user mutual of battery electric quantity).
In some embodiments, when equipment provides (802) first sound to the audio system to be communicated with the equipment
When information is to be presented acoustic characteristic (" the non-volume acoustic characteristic ") including volume and in addition to volume, method 800 starts.Example
Such as, in Fig. 6 A-6H, the first audio output is the Moonlight Sonata of Beethovan.In all cases, the first audio output be
The song that occurs in text instant message window, special edition, the tinkle of bells, the audio-frequency unit of video content or from audio file object
Audio.
In some embodiments, non-volume acoustic characteristic is the reverberation time of (804) first audio output, the first audio
(also referred to as left and right is flat for the LPF Cutoff (for example, cut-off frequency) of output or the stereo balance of the first audio output
Weighing apparatus, " L-R " balance).
When audio system the first audio output of presentation, equipment receives (806) and asking for the second audio output of presentation
Ask corresponding input.In some embodiments, when focus selector is located on Drawing Object, carried out with electronic equipment
The input of (808) (or being otherwise associated) corresponding with the second audio output is received on the display of communication.
For example, input be touch sensitive surface (for example, with electronic equipment integrate touch-sensitive display or with electronic equipment carry out
Touch sensitive surface on the remote control of signal communication) on pressing input.In graphical user circle associated with the second audio output
In face of as receiving pressing input on (for example, the video content object in text message window, Fig. 6 I-60).
As another example, input corresponds in the graphical user interface object (example associated with the second audio output
Such as, the artwork of album cover, Fig. 6 A-6H) on light on the touch sensitive surface that starts sweep gesture.
In some embodiments, when graphical user interface object represents song, special edition or video, the second audio output
It is that (for example, a part for song, special edition or video, it has been preselected as representative or recognizable for the preview of song, special edition or video
Song, special edition or video).In some embodiments, a part for song, special edition or video has the length (example pre-seted
Such as, 30 seconds).
For example, input, which corresponds on touch sensitive surface, gently sweeps gesture, this gently sweeps gesture associated with the second audio output
Graphical user interface object (for example, graphical user interface object include for album cover artwork, Fig. 6 A-6H) top
(or thereon) start.Another above-mentioned example is：Wherein it is located at the figure associated with the second audio output in focus selector
In user interface object (for example, graphical user interface object includes the video content object in text message window, Fig. 6 I-60)
Fang Shi, receive pressing input.Other examples of graphical user interface object include the text representation of the tinkle of bells, in text instant message
Audio file object occurred in window etc..
In response to receiving input corresponding with the request for the second audio output to be presented, equipment provides to audio system
(810) information, to dynamically adjust the presentation of the first audio output according to the value of input.In some embodiments,
The value of input be (812) input in contact characteristic strength, input in contact time span or input in contact
The distance (for example, light length for sweeping gesture) of traveling.
Change with the value of input, equipment dynamically adjusts (814) non-volume acoustic characteristic.Change with the value of input
Become and adjusting non-volume acoustic characteristic allows user effectively preview or to listen to the second audio output without interrupting the first audio
Output, and give additional control of the user to audio output by unique user input.Which enhance the operable of equipment
Property, and cause user device interface more effective (for example, must enter in operation equipment/interacted with equipment by reducing user
The quantity of capable user's input), this makes to reduce electric power additionally by allowing users to faster and more efficiently use equipment
With and improve the battery life of equipment.
In some embodiments, the stereo balance degree of the audio output of device shifting first, with the sound of hour offset second
The stereo balance degree (816) (for example, with reference to as described in figure 6A-6O) of frequency output.For example, the input corresponds on touch sensitive surface
It is light sweep gesture, this is gently swept gesture and moves (for example, gently sweeping from left to right) in a first direction away from graphical user interface object
The initial position associated with the second audio output (for example, this gently sweeps gesture by the artwork of album cover towards display
Center drags, Fig. 6 A-6H).In this example, it is defeated including the first audio output of skew and the second audio to offset stereo balance degree
The presentation gone out so that they, which are tracked, gently sweeps the movement of input in the first direction (for example, the stereo balance degree of the first audio output
Offset to the right, and the second audio output fades in since the left side of audio system).In other embodiments, based on input
The change of the intensity of contact offsets the stereo of the first audio output and the second audio output based on the time of contact of input
The degree of balance.
As another embodiment, in some embodiments, non-volume audio attribute is low for the first audio output
Pass filter cutoff.The equipment offsets downward LPF Cutoff according to the increase of the value of input.Therefore, with defeated
The value increase entered, the first audio content are reduced to bass background (for example, " in a grand fashion Hong ") so that the second audio content can be with
Make the clear audible mode of the second audio content and the first audio content while produce (for example, because the high-lighting of background audio
Reduce due to application low pass filter).
In some embodiments, the equipment adjusts the volume of the first audio output with the change of the value of input
(818) (for example, both volume and non-audio attribute change with the change of the value of input).In some embodiments,
The volume of first audio output reduces with the increase of the value of input.The volume of the first audio output is adjusted by this way
The sense of hearing for also increasing the second audio output protrudes, without interrupting the first audio output.This causes the mould of two audio output
Paste is more effective, thus enhances the operability of the equipment and make it that user equipment interface is more effective.
In some embodiments, the equipment is before the presentation of the second audio output, with the change of the value of input
And non-volume audio attribute is dynamically adjusted, until the value of input meets the first predetermined threshold value (820) (for example, defeated
The characteristic strength of contact in entering keeps below Preview Threshold but is higher than prompting threshold value, thus the equipment equipment is provided will be pre-
The auditory cues and/or visual cues of the second audio output are look at, with reference to as described in figure 6B).Once the value of input meets first
Predetermined threshold value (slightly gently sweeping movement, Fig. 6 C for example, exceeding), the second audio output commences play out, and at some
In embodiment, the first audio output further adjusts with the change of the value of input.In the presentation of the second audio output
Provide the user before audio obscures imminent prompting, non-volume sound is dynamically adjusted with the change of the value of input
Frequency attribute, the prompting can be used for for example alerting user when user chances on the equipment input function described in method 800.
In response to receiving input corresponding with the request for the second audio output to be presented, the equipment carries for audio system
For second sound information, so that the second audio output (822) to be presented simultaneously with the first audio output.In some embodiments, should
Equipment provides the presentation (824) that information dynamically adjusts the second audio output with the value according to input.In some embodiment party
In case, performed while the value according to input dynamically adjusts the presentation of the first audio output to the second audio output
Present.So, the first audio output and the second audio output dynamically obscure simultaneously (for example, the first audio output is gradually faded out,
And the second audio output gradually fades in).Therefore, the presentation that the second audio output is dynamically adjusted according to the value of input provides
The seamless transitions of high-lighting from the high-lighting of the first audio output to the second audio output, this causes the fuzzy for idol of audio
So find more pleasant for the user of the equipment input function described in method 800 and less trigger panic.This
Then user is increased to keep realizing the possibility of this function on their device, and therefore by increasing user and equipment
Interactive efficiency and save the power of battery.
In some embodiments, in response to receiving input corresponding with the request for the second audio output to be presented,
The equipment provides data to show with reference to the visual effect for dynamically adjusting non-volume audio attribute and changing to display
(826).For example, the equipment to display provide data with visually obscure user interface in except with the second audio output
Anything outside corresponding graphical user interface object, wherein blur radius are proportional to the value inputted.Display combines
The visual effect for dynamically adjusting non-volume audio attribute and changing provides intuitively visual cues corresponding with the audio changed,
This contributes to user and their equipment to interact.
In some embodiments, the equipment detects that the value of input meets the more than the first predetermined threshold value
Two predetermined threshold values and as response so that audio system stops presenting the first audio output and (and continues presentation the
Two audio output) (828).In some embodiments, the second predetermined threshold value (" ejection " threshold value) with first in advance really
Fixed threshold value compares the intensity of the higher contact corresponding to the input (for example, ejection threshold value is IT in Fig. 6 I-6OD), should
Input the longer time quantum that the bigger distance advanced or the input contact with touch sensitive surface holding.Therefore, audio system is stopped
The first audio output is only presented and provides the user a kind of mode to pass through the identical defeated of its audio output of preview first using user
Enter and be switched to " presenting completely " of the second audio output.This reduces the number for realizing the user mutual needed for specific function
Amount.
In some embodiments, the equipment detects the end (830) (for example, as shown in Fig. 6 E-6H) of input.One
A bit in alternative embodiment, the end for detecting input is substituted, the equipment detects that the change of the value of input has stopped (example
Such as, the intensity of contact returns to its green strength or input returns to its home position).In some alternative embodiments, substitute
The end of input is detected, the equipment detects the value for exceeding predetermined threshold value (for example, ejection threshold value) of input
Increase.In some alternative embodiments, the end for detecting input is substituted, the equipment detects the advance of the value of input
The change of determination.For example, the value of input drops below predetermined threshold value (for example, the value of input drops below
Threshold value is ejected, and inputs and keeps contacting with touch sensitive surface).In some embodiments, substitution detects the end of input, and this sets
The standby change for detecting input has stopped the predetermined period.
Under any circumstance, in response to appropriate condition, the equipment causes audio system to carry out one in following operate
Operation：
Stop that the second audio output is presented and the first audio output is presented, without entering action to the first audio output
State adjustment (832) (for example, revocation adjusts to the dynamic of the first audio output).In some embodiments, the second sound is being played
Frequency export when, adjustment rather than pause the first audio output broadcasting, and the first audio output delete adjust in the case of,
Continue to play after the second audio output stops playing.This, which has provided the user a kind of intuitive way and returned to, only listens to
One audio output, so as to reduce the quantity of user's input.For example, in Fig. 6 H, the equipment stops that the second audio output is presented
And the first audio output is presented in the case where being adjusted without dynamic.
Stop that the first audio output is presented and continue that the second audio output (834) is presented.This has provided the user one
Kind intuitive way, which switches to, only listens to the second audio output, so as to reduce the quantity of user's input.For example, in Fig. 6 H,
The equipment stops that the first audio output is presented and the second audio output is presented in the case where being adjusted without dynamic.
Stop that the first adjusted audio output is presented and continue that the second audio output (836) is presented.This is user
A kind of intuitive way is provided to continue fuzzy audio；Or
Predetermined threshold value (for example, exceeding ejection threshold value during input) is met according to determination value, stopping is in
Show the first audio output and continue that the second audio output is presented；And the threshold value is unsatisfactory for (for example, this is defeated according to determination value
Enter to keep below ejection threshold value during input), stop that the second audio output is presented and be in the case where being adjusted without dynamic
Existing first audio output (for example, recovering to adjust the dynamic of the first audio output) (838).So, the system automatically determines
User, which actually wants to continue to listen to the first audio output, still wants to switch to the second audio output, so as to provide the user one
Intuitive way is planted to realize any result and reduce the quantity of user's input.For example, in Fig. 6 E-6H, the equipment root
Meet still to be unsatisfactory for threshold value according to the value for determining user's input to determine whether to stop the second audio output to be presented and in nothing
The first audio output is presented in the case of adjusting in dynamic.
It should be appreciated that the concrete order of the operation to being described in Fig. 8 A-8H is only an example, it is not intended that table
The bright order is the but one sequence that can perform these operations.One of ordinary skill in the art will recognize that various ways come to this
Operation described in text is resequenced.In some embodiments, by one or more operations of method 800 with it is described herein
Other method (for example, method 840,854,875 and/or 900) one or more operative combinations or by they supplement or replace
Generation.
Fig. 8 C are the flows for the method 840 for showing the presentation for dynamically adjusting audio output according to some embodiments
Figure.In some embodiments, one or more operations by method 840 and other method as described herein are (for example, method
800) one or more operative combinations are supplemented by them or substituted.In addition, many operations described in reference method 840 with
Operation described in upper reference method 800 shares identical benefit (for example, the use that the intuitive of audio is fuzzy, user necessarily be formed
The reduction of the quantity of family input).Therefore, method 840 is also (for example, by helping user operating the equipment/and equipment progress
Correctly input is provided when interactive and reduces user error) strengthen the operability of equipment and user equipment interface is more had
Effect, this in addition also by using family can more rapidly and more efficiently use the equipment and reduce power use and improve
The battery life of the equipment.
In some embodiments, method 840 is held at the electronic equipment with memory and one or more processors
OK, and the electronic equipment is communicated with display and audio system.
In some embodiments, data are provided so that the user interface including media object is presented to display in the equipment
When, method 840 starts, and the media object represents at least one items of media content (842).
The equipment provides the first acoustic information so that the first audio output not corresponding with media object is presented to audio system
(844)。
When providing the first acoustic information to audio system, the equipment detects first of the sensing media object of input
Divide (846).
In response to the Part I for the sensing media object for detecting input, the equipment：(i) start to provide to audio system
Second sound information is to be presented the second audio output corresponding with media object；And (ii) continues to provide first to audio system
Acoustic information is to be presented the first audio output (848) not corresponding with media object.
When providing the first acoustic information and second sound information to audio system, the equipment detects the sensing matchmaker of input
The Part II of body object, wherein detecting that the Part II of input includes detecting change (850) (example of the parameter of input
Such as, detected when focus selector is above media object and the change of the intensity of the contact of touch sensitive surface or detect focus
The position of selector or the change of movement).
In response to the change for the parameter for detecting input, the equipment：
(i) (852) data are provided with (for example, visually obscuring and/or putting by using family interface background to display
Big media object) presented user interface dynamically changed according to the change of the parameter of input；
(ii) information is provided with (for example, by reducing volume, increase reverberation time, reducing LPF to audio system
Device cut-off frequency, and/or the L-R degrees of balance of audio to the right or are moved to the left) according to the change of the parameter of input come dynamically
Change the first audio output not corresponding with media object；And
(iii) information is provided with (for example, by reducing volume, increase reverberation time, reducing LPF to audio system
Device cut-off frequency, and/or the L-R degrees of balance of audio to the right or are moved to the left) according to the change of the parameter of input come dynamically
Second audio output (852) of the change with media object to drink.
It should be appreciated that the concrete order of the operation to being described in Fig. 8 C is only an example, it is not intended that
It is the but one sequence that can perform these operations to show the order.One of ordinary skill in the art will recognize that various ways come pair
Operations described herein is resequenced.In some embodiments, by one or more operations of method 840 and this paper institutes
State one or more operative combinations of other method (for example, method 800,854,875 and/or 900) or supplemented or replaced by them
Generation.
Fig. 8 D-8F are the stream for the method 854 for showing the presentation for dynamically adjusting audio output according to some embodiments
Cheng Tu.Fig. 6 P-6Y are used for the method and/or process for showing Fig. 8 D-8F.Although (will wherein it be combined with tactile with reference to touch-sensitive display
Sensitive surfaces and display) on input provide some embodiments in subsequent embodiment, but in some embodiments,
The input on touch sensitive surface 451 that equipment detection separates with display 450, as shown in Figure 4 B.
In some embodiments, method 854 by electronic equipment (for example, portable multifunction device 100, Figure 1A) and/
Or one or more parts (for example, I/O subsystems 106, operating system 126 etc.) of the electronic equipment perform.In some implementations
In scheme, method 854 is by being stored in non-transient computer readable storage medium storing program for executing and by the one or more of equipment
The instruction that the one or more processors 122 (Figure 1A) of reason device such as equipment 100 perform dominates.In order to easily explain, hereafter
Describe the method 854 performed by equipment 100.In some embodiments, with reference to figure 1A, the operation of method 854 is at least partly
Ground is by audio preview module 163-1, audio modification module 163-2 and touch-sensitive display (for example, touch-screen 112) execution or at least
Partly it is used.Certain operations in method 854 are optionally combined, and/or certain operations order optionally
It is changed.
As described below, method 854 (and associated interface) reduce the quantity of the input from user, scope and/or
Property, and more effective man-machine interface is produced, come and user interface so as to provide the user easy to use and intuitive way
Interact.For battery-operated electronic equipment, method 854 allows to fill twice by providing to save power and increase battery
Time interval between electricity be readily appreciated that and the audio output of informedness is (for example, by reducing to exhausting the close of the power of battery
The demand of collection and poorly efficient user mutual) realize effective, seamless and quick interaction.
In some embodiments, the equipment shows the user interface (855) of the expression including media item over the display
When, method 854 starts.For example, Fig. 6 Q show the user interface 640 of the expression including media item 658.
When showing user interface, the corresponding opening position of expression with media item of the equipment on touch sensitive surface detects
By input (856) caused by contact (for example, finger contact or stylus contact) (for example, media item on the touch sensitive display
Expression on detect contact).For example, Fig. 6 R show the beginning of user's input 660, user input is to represent 658-2
On the pressing that detects and keep gesture.
In response to detecting by input caused by contact：According to determination, the input meets media cue standard, wherein should
Media cue standard is included when the contact has higher than the first intensity threshold (for example, ITH, Fig. 6 R) characteristic strength when meet
Standard：The equipment commences play out the appropriate section of media item (for example, being selected to the beginning of the recognizable part comprising media item
Part represents part) (for example, playing their audio and/or video) (857).For example, in Fig. 6 R, equipment 100 starts
Play Brahms ' s Alto Rhapsody.Moreover, when playing media item, the equipment change with the characteristic strength of contact and
One group of one or more audio attribute is dynamically changed (for example, changing with the characteristic strength of contact by multiple values, the media
The audio attribute of item passes through multiple values and changed).In some embodiments, the volume of media item is with the characteristic strength of contact
Increase and increase and reduce with the reduction of the characteristic strength of contact.For example, as the intensity of input 660 is from Fig. 6 R to figure
6S increases, Brahms ' s Alto Rhapsody volume increase.
In some embodiments, position of the media item based on the contact in input that is played and determine (for example, according to
It is determined that with the first media item corresponding to opening position detect and contact that above step performs for the first media item, and root
According to determine with the second media item corresponding to opening position detect and contact that above step is for the second media item rather than for the
One media item and perform).If for example, represent 658-1 rather than represent 658-2 on detect Fig. 6 R in input 660,
Equipment 100 will commence play out media item corresponding with representing 658-1.
According to determination, the input is unsatisfactory for media cue standard, and the equipment abandons commencing play out the appropriate section of media item,
And abandon dynamically changing this one or more audio attribute of group of media item as the characteristic strength of contact changes.One
In a little embodiments, the equipment performs alternative operation relative to media item.For example, in response to the touch in the expression of media item
Gesture, the equipment perform selection operation relative to media item.
In some embodiments, the audio attribute of media item include volume, low pass filter cut-off frequency and/or
Weighing apparatus sets (858) (for example, Fig. 6 P-6Y are shown in which equipment as the characteristic strength of contact changes and dynamically changes matchmaker
One example of the volume of body item).
In some embodiments, when this of media item, which organizes one or more audio attributes, to be dynamically changed, the equipment
Dynamically change the visual appearance (859) of user interface.In some embodiments, outside the vision for dynamically changing user interface
The size (860) for the expression for including increasing with the increase of the characteristic strength of contact media item is seen (for example, the spy with contact
Levy the increase of intensity and increase the size of the expression of media item and reduce media item with the reduction of the characteristic strength of contact
Expression size).For example, increase with the intensity of input 660 from Fig. 6 R to Fig. 6 S, the volume and expression 658-2 of media item
Size increase.In some embodiments, this is the same expression initially shown in the user interface (such as Fig. 6 R-6T institutes
Show, represent that 658-2 by its original size and position " growth ", is moved, together towards the core of the second area of user interface
When also increase size).In other embodiments, when the expression initially shown and the second area of user interface are maintained at same
During one position, the expression is different from initial representation, and the second different increasings for representing the characteristic strength with contact of media item
Big and increased in size and the second area towards user interface core movement is (for example, the difference represents to be shown in just
The top that beginning represents).
In some embodiments, dynamically changing the visual appearance of user interface includes changing with the characteristic strength of contact
Become and dynamically change the fuzzy quantity (861) of a part for the expression of the neighbouring media item of user interface.For example, with input
660 intensity increases from Fig. 6 R to Fig. 6 S, and interaction area 642-2 is obscured, and its blur radius and the intensity for contacting 660 are proportional
(in these accompanying drawings, the blur radius of increase by cover interaction area 642-2 pattern reduction transparency and schematically
Represent).
In some embodiments, after the appropriate section of media item is commenced play out：The equipment detects the spy of contact
The increase of intensity is levied, detects the reduction (862) of the characteristic strength of contact (for example, Fig. 6 T show the intensity of contact 660 afterwards
Increase；Fig. 6 U show the reduction of the intensity of contact 660).In some embodiments, multiple condition behaviour are described below
Make, whether these conditional operations meet media preview standard according to the strength characteristic for determining contact and be adjusted.These operations
In response to the increase for the characteristic strength for detecting contact, the reduction of the characteristic strength of contact is detected afterwards and is performed.At some
In embodiment, in the increase for the characteristic strength for detecting contact, when detecting the reduction of characteristic strength of contact afterwards, perform
Conditional operation described below.
Therefore, when media item plays, before the reduction of characteristic strength of contact is detected, contacted according to determination
Characteristic strength meet media preview standard, the media preview standard include when contact characteristic strength increase to above than first
Intensity threshold is (for example, ITH) higher the second intensity threshold is (for example, ITL, Fig. 6 T-6U) when the standard that meets, the equipment with
The increase of the characteristic strength of contact and in the first way come change the audio attribute of media item (for example, increase media item audio
Volume) and audio attribute is maintained at first state (for example, continuing to set sound with the reduction of the characteristic strength of contact
Frequency volume playback media item).In some embodiments, change with the audio attribute of media item, the audio of background audio
Attribute also changes (for example, making background audio fade in the reduction of intensity and making increasing of the background audio with intensity
Fade out greatly).Audio attribute is set to be maintained at first state with the reduction of the characteristic strength of contact (for example, continuing to set
Audio volume playback media item) allow user to enter " spying on " pattern, the audio attribute of wherein media item be it is fixed, this for
The user for wanting to listen to a part for media item is convenient, without lasting modification audio attribute.Because audio attribute only exists
Contact strength, which increases to above, to be only after the second intensity threshold fixed, therefore user can neatly select what he or she wanted
Operator scheme.Which reduce realize it is expected functions of the equipments needed for user input quantity, thus (for example, by helping user
When operating the equipment/interact with the equipment, offer is correct inputs and reduces user error) and enhance grasping for equipment
The property made simultaneously make it that user equipment interface is more effective, and this also more rapidly and can more efficiently use the equipment by using family in addition
And reduce power and use and improve the battery life of the equipment.
For example, because the intensity of contact 660 is higher than IT in Fig. 6 TL, therefore the volume of media item is " locked " to preview
Volume (for example, full volume) so that the intensity for contacting 660 then drops below IT as shown in Fig. 6 ULVolume will not be caused
Change.Characteristic strength according to contact is determined is unsatisfactory for media preview standard, and (that is, the characteristic strength of contact does not increase to above the
Two intensity thresholds), when playing media item (and when contact is maintained on touch sensitive surface), the equipment is with the feature of contact
The increase of intensity and in the first way come change the audio attribute of the media item audio volume of media item (for example, increase) and with
The reduction of the characteristic strength of contact and change the audio attribute of media item (for example, increasing audio in turn in a second manner
Volume).For example, if the sequence shown in Fig. 6 S-6R is reverse, the volume of media item reduces with the reduction of intensity.Therefore,
In Fig. 6 S-6R, user can be by increasing and reducing the intensity of contact 660 and the volume of scroll-up/down media item, as long as contacting
660 intensity is no more than ITL.In some embodiments, the appropriate section of media item with contact characteristic strength change and
Continuously play, wherein this organizes one or more audio frequency parameters and changed with the broadcasting of media item.
In some embodiments, in response to detecting that the input meets media preview standard, the equipment is over the display
Display (863) contact characteristic strength increase by cause equipment relative to media item perform selection operation instruction (for example,
" more forcibly pressing to be selected " or " carrying out 3D to touch with shared ").
In some embodiments, after the appropriate section of media item is commenced play out, the equipment is maintained at touch-sensitive in contact
When on surface, the increase (864) of the characteristic strength of contact is detected.In response to the increase for the characteristic strength for detecting contact：Root
According to determine contact characteristic strength meet media selection standard, the media selection standard include when contact characteristic strength be more than than
First intensity threshold it is higher (and also higher than the second intensity threshold, the standard met during operation selection intensity threshold value 862),
The equipment stops showing the appropriate section of media item and performs selection operation (for example, media item is placed for media item
In message compositing area or with another users to share media item in instant messaging session).For example, in Fig. 6 V-6W, due to
The intensity of contact 660 is more than ITD, therefore select to represent 658-2 so that corresponding audio message 644-4 is placed on frame 650
In.Characteristic strength according to contact is determined is unsatisfactory for media selection standard, and the equipment continues to play the appropriate section of media item, and
Selection operation need not be performed.
In some embodiments, when playing media item, the equipment detects the end (865) of input (for example, detection
To causing being lifted away from for contact that media item commences play out).End in response to detecting input, the equipment stop playing media
.In some embodiments, stop playing media item including making neighbouring media item in response to detecting the end of input
The dimness of vision of the content of expression inverts and changes this one or more attribute of group of audio items so that the media item played
Gradually fade out (866).For example, if input 660 has terminated in Fig. 6 R-6U any one figure, equipment 100 will stop broadcasting
Put media item and make interaction area 642-2 fuzzy reversion.
In some embodiments, in response to detecting the end of input after stopping playing media item, the equipment exists
With the expression (for example, Flick gesture) of media item corresponding to caused by opening position detects and contacted by second on touch sensitive surface
Selection input, wherein second contact is without the characteristic strength (867) for reaching the first intensity threshold.In response to detecting selection
Input, the equipment perform selection operation (for example, media item is placed on into message compositing area such as frame 650 for media item
In (Fig. 6 P) or with another users to share media item in instant messaging session).
Operation 868-870 describes the fuzzy of audio (that is, the media item with BACKGROUNDMedia that played in equipment).
Method 800 and 840 is described in detail audio and obscured.Therefore, operation 868-870 can be shared in the feature described in these methods
Any one feature.
In some embodiments, when playing BACKGROUNDMedia in equipment, detect input (868) (for example, operating
The input detected in 856).According to determination, the input meets media cue standard：When playing media item, the equipment is with connecing
Tactile characteristic strength changes and dynamically changes one group of one or more audio attribute (869) of BACKGROUNDMedia item.Therefore, one
In a little embodiments, the equipment makes the media item " fading in " above BACKGROUNDMedia, and this is provided described in reference method 800/840
The benefit all enclosed.
According to determination, the input is unsatisfactory for media cue standard, and the equipment continues to play BACKGROUNDMedia, is carried on the back without changing
This of scape media organizes one or more audio attributes.In some embodiments, when playing media item, the equipment detects defeated
The end (870) entered.End in response to detecting input, the equipment recover play BACKGROUNDMedia item, wherein this group one or
Multiple audio attributes return to their value before input is detected.
It should be appreciated that the concrete order of the operation to being described in Fig. 8 D-8F is only an example, it is not intended that table
The bright order is the but one sequence that can perform these operations.One of ordinary skill in the art will recognize that various ways come to this
Operation described in text is resequenced.In some embodiments, by one or more operations of method 854 with it is described herein
One or more operative combinations of other method (for example, method 800,840,875 and/or 900) are supplemented by them or substituted.
Fig. 8 G-8H are to be shown to cover the stream of the method 875 of some of graphic user interface according to some embodiments
Cheng Tu.Fig. 6 P-6Y are used for the method and/or process for showing Fig. 8 G-8H.Although (will wherein it be combined with tactile with reference to touch-sensitive display
Sensitive surfaces and display) on input provide some examples in subsequent example, but in some embodiments, equipment detection
The input on touch sensitive surface 451 separated with display 450, as shown in Figure 4 B.
In some embodiments, method 875 by electronic equipment (for example, portable multifunction device 100, Figure 1A) and/
Or one or more parts (for example, I/O subsystems 106, operating system 126 etc.) of the electronic equipment perform.In some implementations
In scheme, method 875 is by being stored in non-transient computer readable storage medium storing program for executing and by the one or more of equipment
The instruction that the one or more processors 122 (Figure 1A) of reason device such as equipment 100 perform dominates.In order to easily explain, hereafter
Describe the method 875 performed by equipment 100.
As described below, method 875 (and associated interface) reduce the quantity of the input from user, scope and/or
Property, and more effective man-machine interface is produced, come and user interface so as to provide the user easy to use and intuitive way
Interact.For battery-operated electronic equipment, method 875 allows to fill twice by providing to save power and increase battery
Time interval between electricity be readily appreciated that and the audio output of informedness is (for example, by reducing to exhausting the close of the power of battery
The demand of collection and poorly efficient user mutual) realize effective, seamless and quick interaction.
In some embodiments, the first interaction area (example including application program is shown over the display in the equipment
Such as, interaction area 642-2, Fig. 6 Q) and application program the second interaction area (for example, interaction area 642-1, Fig. 6 Q) user
During interface (876), method 875 starts.In some embodiments, interaction area is that user can be such as a variety of defeated by providing
The interface region for entering any one input gesture in gesture (gently sweep, touch) and interacting, these input hands
Gesture is when being detected so that electronic equipment changes user interface according to these gestures.In other words, interaction area is not
The status bar of any friendship can not be performed by it by being displayed on the user of top section.
In some embodiments, the second interaction area is for primary application program (for example, instant message application program)
User interface (877).First interaction area is configured as display from the difference for being configured as operating in primary application program
The content of miniature applications program, and shown miniature applications program in the first interaction area is defeated based on the user at equipment
Enter that (for example, user can perform in the first interaction area gently sweeps gesture, these are gently swept gesture and are being detected to be selected
When so that the equipment shows user interface for the different miniature applications programs in the first interaction area, such as reference designator
Described in 654 (Fig. 6 Q)).For example, instant message application program can be shown and equipment media (for example, music, video), equipment phase
Machine, paint the miniature applications program that character art etc. interacts.
In some embodiments, the second interaction area is to include multiple message in the session between sessions participant
Conversation region (878) (for example, the second interaction area be instant message application program (user such as with electronic equipment with extremely
The conversation recording of message between few other users) in conversation region such as interaction area 642-1 (Fig. 6 Q).First hands over
Mutual region is for selecting media so that media selection region shared in the session between sessions participant is (for example, immediately
Music sharing region such as interaction area 642-2 (Fig. 6 Q) in message application, the music sharing region include rolling
List, this can roll the expression that list shows 30 songs shown recently in the equipment).
When showing user interface, the equipment over the display with the first user interface element in the first interaction area
Corresponding opening position detection passes through the first input caused by the contact (for example, finger contact or stylus contact) on touch sensitive surface
(879).For example, Fig. 6 R show the beginning of user's input 660, user input is the pressing detected on 658-2 is represented
And keep gesture.
In response to detecting by the first input caused by contact：Activation based on intensity is met according to the input of determination first
Standard, wherein the activation standard based on intensity requires that contact has higher than the first intensity threshold (for example, ITH, Fig. 6 R) feature
Intensity is to meet the activation standard based on intensity, in addition to the first user interface element, the of the equipment hide application program
One interaction area, the second interaction area without hide application program is (for example, obscure interaction area 642-2, without making
Represent that 658-2 is obscured, Fig. 6 R-6V) (880).In addition to the first user interface element, the first interactive areas of application program is covered
Domain, without covering the second interaction area of application program, indicate to the user that he or she for example opens in miniature applications program
With the functions of the equipments based on intensity.Which reduce user will cause the equipment to perform the chance of unnecessary operation, this (for example,
By helping user's offer when operating the equipment/interact with the equipment is correct to input and reduce user error) enhance
The operability of equipment simultaneously make it that user equipment interface is more effective, and this in addition can also more rapidly and more effectively by using family
Reduce power using the equipment to use and improve the battery life of the equipment.
According to determining that the first input meets first choice standard, wherein first choice standard does not require that contact has higher than the
To meet selection standard (for example, first input be Flick gesture), the equipment performs and the characteristic strength of one intensity threshold
First choice corresponding to one user interface element operates, without covering the first interaction area of application program.In some implementations
In scheme, for cover above-mentioned interaction area first choice operate based on contact position (for example, according to determine with the first matchmaker
Opening position corresponding to body item detects contact) and determine, above step performs for the first media item, and is existed according to determination
With the second media item corresponding to opening position detect and contact that above step is for the second media item rather than for the first media item
And perform.If for example, the input 660 in representing 658-1 rather than representing to detect Fig. 6 R on 658-2, equipment 100 are hidden
The anything in addition to 658-1 is represented in interaction area 642-2 is hidden, rather than table is removed in hiding interaction area 642-2
Show the anything outside 658-2.
In some embodiments, first choice standard (881) is met when the first input is Flick gesture.
In some embodiments, covering the first interaction area of application program includes changing with the characteristic strength of contact
And the first interaction area (882) of application program is dynamically covered (for example, changing with the characteristic strength of contact by multiple values
Become, changed applied to the fuzzy blur radius of the first interaction area by multiple values).In some embodiments, first
The fuzzy blur radius of interaction area increases with the increase of the characteristic strength of contact and with the characteristic strength of contact
Reduction and reduce.For example, increasing with the intensity of input 660 from Fig. 6 R to Fig. 6 S, interaction area 642-2 is obscured, and it is fuzzy
Radius is proportional with the intensity for contacting 660, and (in these accompanying drawings, the blur radius of increase is by covering interaction area 642-2 figure
The transparency of the reduction of case and schematically show).
In some embodiments, when showing user interface, the equipment over the display with the second interaction area
Second user interface element corresponding to opening position detection pass through the second input caused by the second contact on touch sensitive surface
(883).In response to detecting by the second input caused by the second contact：Meet that second is based on intensity according to the input of determination second
Activation standard, wherein second based on intensity activation standard requirement second contact with higher than the second intensity threshold feature it is strong
Degree is to meet the second activation standard based on intensity, except second user interface element is in addition to, the equipment hide application program
The first interaction area and application program the second interaction area (for example, the equipment makes the first interaction area and the second interactive areas
The content in domain is faded out, while preview media item corresponding with not fuzzy second user interface element).In some embodiments
In, the second intensity threshold is identical with the first intensity threshold.In some embodiments, the second intensity threshold and the first intensity threshold
It is different.In addition to second user interface element, the first interaction area of application program and the second interactive areas of application program are covered
Domain, indicate to the user that he or she is enabled based on intensity in such as primary application program relative to second user interface element
Functions of the equipments.Which reduce user will cause the equipment to perform the chance of unnecessary operation, and this is (for example, by helping user
When operating the equipment/interact with the equipment, offer is correct inputs and reduces user error) enhance the operable of equipment
Property and make it that user equipment interface is more effective, this in addition also by using family can more rapidly and more efficiently use the equipment and
Reduce power to use and improve the battery life of the equipment.
For example, as shown in Fig. 6 Y, basis 674 has more than ITHIntensity, and therefore interaction area 642-1 and 642-2
Both are blurred.Therefore, it is higher than IT in the expression of the media item in miniature applications programHPressing input cause it is only micro-
Type application program obscures, and in interaction area corresponding with primary application program (for example, the conversation area of instant message application program
Domain) in media item expression on similar pressing input cause the whole user interface for including the two interaction areas 642
It is fuzzy.
According to second input the second selection standard of satisfaction is determined, wherein the second selection standard does not require that the second contact has height
In the characteristic strength of the second intensity threshold to meet the second selection standard (for example, second input be Flick gesture), the equipment
Perform corresponding with second user interface element the second selection operation, without masking application program the second interaction area and
The first interaction area (for example, device playback media item corresponding with second element) of application program need not be covered.For example, figure
Flick gesture in any expression of expression 658 in 6Q media item is placed in frame 650 (or according to some embodiments,
These media items are sent directly to session).
In some embodiments, it is added in the first user interface element based on the input in the first interaction area
After second user interaction area, second user interface element corresponds to the first user interface element (884) (for example, second uses
Family interface element corresponds to being selected from the first interaction area and is added to the session that is shown in the second interaction area
Media item).For example, in Fig. 6 Q-6Y, audio message 644-4 and represent both 658-2 correspond to same media item (for example,
Brahms’s Alto Rhapsody)。
In some embodiments, when the first interaction area that application program is covered in addition to the first user interface element
When (without covering the second interaction area of application program), the equipment detects the increase of the characteristic strength of contact.In response to
Detect the increase of the characteristic strength of contact：Characteristic strength according to contact is determined meets the 3rd selection standard, the 3rd selection
Standard is included when the characteristic strength of contact is more than the selection intensity threshold value higher than the first intensity threshold (for example, ITD, Fig. 6 V) when
The standard of satisfaction, the equipment perform the 3rd selection operation to the first user interface element and stop covering the first of application program
Interaction area.Therefore, because 660 are contacted in Fig. 6 V more than ITD, therefore represent that 658-2 is ejected into frame 650 and (wherein should
Expression is denoted as audio message 644-4 again).Characteristic strength according to contact is determined meets the 3rd selection standard and used first
Once family interface element perform selection operation and stop cover application program the first interaction area allow user user sent out
Play the above-mentioned operation based on intensity and just select the first user interface element, so as to eliminate to the first user interface element of selection simultaneously
And cause the needs of the more effective further user input of man-machine interface.
Characteristic strength according to input is determined is unsatisfactory for the 3rd selection standard, in addition to first user's bound component, the equipment
Continue the first interaction area of hide application program, the second interaction area without hide application program.
It should be appreciated that the concrete order of the operation to being described in Fig. 8 G-8H is only an example, it is not intended that table
The bright order is the but one sequence that can perform these operations.One of ordinary skill in the art will recognize that various ways come to this
Operation described in text is resequenced.In some embodiments, by one or more operations of method 875 with it is described herein
One or more operative combinations of other method (for example, method 840,840,854 and/or 900) are supplemented by them or substituted.
Fig. 9 A-9C are the flows for showing the method 900 for dynamically adjusting audio output presentation according to some embodiments
Figure.Fig. 7 A-7G are used for the method and/or process for showing Fig. 9 A-9C.Although (will wherein it be combined with touch-sensitive with reference to touch-sensitive display
Surface and display) on input provide some examples in subsequent example, but in some embodiments, equipment detection with
Input on the separated touch sensitive surface 451 of display 450, as shown in Figure 4 B.
In some embodiments, method 900 by electronic equipment (for example, portable multifunction device 100, Figure 1A) and/
Or one or more parts (for example, I/O subsystems 106, operating system 126 etc.) of the electronic equipment perform.In some implementations
In scheme, method 900 is by being stored in non-transient computer readable storage medium storing program for executing and being handled by the one or more of equipment
Instruction that the one or more processors 122 (Figure 1A) of device such as equipment 100 perform dominates.In order to easily explain, hereafter retouch
The method 900 performed by equipment 100 is stated.In some embodiments, with reference to figure 1A, the operation of method 900 is at least in part
By audio configuration file 402, audio change module 163-3 and touch-sensitive display (for example, touch-sensitive display system 112) execution or extremely
Partially it is used.Certain operations in method 900 are optionally combined, and/or the order of certain operations is optional
Ground is changed.
As described below, method 900 (and associated interface) reduce the quantity of the input from user, scope and/or
Property, and more effective man-machine interface is produced, come and user interface so as to provide the user easy to use and intuitive way
Interact.For battery-operated electronic equipment, method 900 allows to fill twice by providing to save power and increase battery
Time interval between electricity be readily appreciated that and the audio output of informedness is (for example, by reducing to exhausting the close of the power of battery
The demand of collection and poorly efficient user mutual) realize effective, seamless and quick interaction.
In some embodiments, method 900 is performed on the electronic equipment to be communicated with display and audio system
(902), while on the display of electronic equipment display include one group of one or more show can represent user interface (for example,
Shown user interface includes virtual numeric keypad and this group one or more is shown and can represented including to be displayed on this virtual
Numerical key on numeric keypad, Fig. 7 A-7G).When method 900 starts, equipment detects this group of sensing in first time point
Or it is multiple show in representing first show can represent first input (for example, detecting light on the first key in dummy keyboard
Hit, the touch on " 5 " key in such as Fig. 7 B) (904).
In response to detecting that pointing to first shows the can represent first input, the equipment starts to provide the first sound to audio system
Message breath shows with first to present and can represent corresponding first audio output (906).There is first audio output the first audio to match somebody with somebody
Put file (for example, audio configuration file 714-1, Fig. 7 B-7G).
In some embodiments, corresponding audio configuration file includes changing over time to dominate corresponding audio output
The information of one or more attributes.For example, corresponding audio configuration file is changed over time to dominate the sound of corresponding audio output
Height, voice, tone color, reverberation and/or volume (for example, decay).In some embodiments, corresponding audio configuration file also wraps
Include the information for the one or more static attributes for dominating corresponding audio output.For example, corresponding audio configuration file includes being used for
The information of audio output is produced, there is the audio output C sharps to fix pitch, wherein non-static volume increases over time
Then decay.
In some embodiments, when the first audio output is presented in audio system, the equipment causes (908) to show
Visual effect corresponding with the first audio output is presented (for example, showing can represent extension one or more outward or away from first in device
Individual figure such as ring, wherein such as ripple effect, ring extend outward or away from display with the first corresponding position of input)
(for example, figure 718,720, Fig. 7 C-7D).In some embodiments, these figures, which include showing away from first, can represent movement
One or more Drawing Objects animation.Visual effect corresponding with the first audio output is presented to provide the user and the audio
Intuitive visual corresponding to output is prompted, and this contributes to user and their equipment to interact.
During the equipment detects that this group one or more of sensing is shown and can represented at the second time point after first time point
Second show can represent second input (for example, the touch on the second key in dummy keyboard is detected, in such as Fig. 7 C
Touch on " 2 " key) (910).In some embodiments, second shows and can represent and first shows and can be expressed as same showing and representing
(for example, same key on shown keyboard in shown user interface) (912).In some embodiments, first
Showing can represent to show from second and can represent different (for example, different keys on shown keyboard in shown user interface)
(914)。
In response to detect point to second show can represent second input and according to determine meet audio change standard, be somebody's turn to do
Equipment (916)：
(i) cause audio system is presented to show that can represent corresponding changes the first audio output with first, without being to continue with profit
The first audio output is presented with the first audio configuration file, matches somebody with somebody wherein the first modified audio output has with the first audio
Put the different modified audio configuration file of file.In some embodiments so that audio system is presented modified the
One audio output includes such as instructing to audio system offer information and/or voice data, so that warp can be presented in audio system
First audio output of change；And
(ii) second sound information is provided to audio system, showing with presentation with second can represent that corresponding second audio is defeated
Go out, wherein the second audio output has the second audio configuration file.In some embodiments, the second audio configuration file and
One audio configuration file is identical (for example, each audio configuration file is in response to showing the activation that can be represented and caused audio is defeated
The default audio configuration file gone out).In some embodiments, the second audio configuration file and the first audio configuration file be not
Together.Presentation is shown with first can represent corresponding first audio output, rather than continue with the first audio configuration file to present
First audio output, this makes audio output interfere less with user and is that user is more desirable.This then makes user more likely
Utilize audio output function.
In some embodiments, in response to detecting that pointing to second shows the can represent second input, the equipment determines warp
Whether the first audio output presented by audio system at the second time point meets that audio changes standard (918).
In some embodiments, audio change standard is included when the process between first time point and the second time point
Time quantum is less than predetermined time quantum (for example, TThreshold value, Fig. 7 B-7G) when the standard (920) that meets.
In some embodiments, the audio change standard be included in passed through since the first audio output is initiated when
Between the standard (922) that meets when being less than predetermined time quantum.
In some embodiments, audio change standard includes the value when the first audio output under the second time point
Fall below the standard (924) met during predetermined value.In some embodiments, whether the first audio output is determined
Meet that audio change standard is included in the predetermined time (for example, in the second time point or time close to the second time point)
It is determined that whether elapsed time is less than predetermined time threshold and/or determination first since the first audio output is initiated
Whether the value of audio output drops below predetermined value (for example, the initial magnitude or maximum of the first audio output
The half of value).
In response to detecting that pointing to second shows that can represent second inputs and according to determination less than footsteps frequency change standard,
The equipment (926)：
(i) cause audio system continues to present to show with first and can represent corresponding and there is the first audio configuration file
First audio output；And
(ii) second sound information is provided to audio system with second to show to present and can represent corresponding 3rd audio output,
Wherein the 3rd audio output has the 3rd audio configuration file.In some embodiments, the 3rd audio configuration file and second
Audio configuration file is identical.In some embodiments, the second audio configuration file is different from the 3rd audio configuration file.
In some embodiments, modified audio configuration file has with being continuing with the first audio when audio system
Configuration file produces the first audio output volume when the first audio output is presented compares the volume reduced (for example, modified
Audio configuration file includes the decay of the first audio output of increase).In some embodiments, modified audio configuration file
Include the pitch of the first modified audio output.In some embodiments, modified audio configuration file is in the equipment
Detect at least one period after the second input that there is non-zero volume.
It should be appreciated that the concrete order of the operation to being described in Fig. 9 A-9C is only an example, it is not intended that table
The bright order is the but one sequence that can perform these operations.One of ordinary skill in the art will recognize that various ways come to this
Operation described in text is resequenced.In some embodiments, by one or more operations of method 900 with it is described herein
One or more operative combinations of other method (for example, method 800,840,854 and/or 875) are supplemented by them or substituted.
For illustrative purposes, description above is described by reference to specific embodiment.However, example above
The property shown is discussed being not intended to limit or limits the invention to disclosed precise forms.According to teachings above content, very
More modifications and variations are all possible.Selection and description embodiment are to most preferably illustrate the principle of the present invention
And its practical application, so as to so that others skilled in the art can be most preferably using with being suitable for what is conceived
The described embodiment of the invention and various of the various modifications of special-purpose.
Claims (40)
1. a kind of method, including：
With display, touch sensitive surface and it is being configured as detection and the one or more of the intensity of the contact of the touch sensitive surface
At the electronic equipment of sensor：
Display includes the first interaction area of application program and the second interaction area of the application program on the display
User interface；
It is characterized in that
When showing the user interface, on the display first with the first user interface in first interaction area
Opening position detection passes through the first input caused by the contact on the touch sensitive surface corresponding to element；
In response to detecting by first input caused by the contact：
According to the activation standard of the first input satisfaction based on intensity is determined, wherein the activation standard requirement based on intensity
The characteristic strength of the contact with higher than the first intensity threshold is to meet the activation standard based on intensity, except described the
Outside one user interface element, first interaction area of the application program is covered, without covering the application program
Second interaction area；And
First choice standard is met according to determination first input, wherein the first choice standard does not require the contact tool
There is the characteristic strength higher than first intensity threshold to meet the selection standard, perform and first user interface member
First choice corresponding to element operates, without covering first interaction area of the application program.
2. according to the method for claim 1, wherein cover the application program first interaction area include with
The characteristic strength of the contact changes and dynamically covers first interaction area of the application program.
3. according to the method any one of claim 1-2, including：
When showing the user interface, on the display with the second user Interface Element in second interaction area
Opening position detection corresponding to element passes through the second input caused by the second contact on the touch sensitive surface；
In response to detecting by second input caused by the described second contact：
According to the second input second activation standard based on intensity of satisfaction is determined, wherein the described second activation based on intensity
Standard requires characteristic strength of second contact with higher than the second intensity threshold to meet described second based on intensity
Activation standard, in addition to the second user interface element, cover first interaction area of the application program and described
Second interaction area of application program；And
According to the second input second selection standard of satisfaction is determined, wherein second selection standard does not require that described second connects
The characteristic strength with higher than second intensity threshold is touched to meet second selection standard, performs and is used with described second
Second selection operation corresponding to the interface element of family, without cover the application program second interaction area and need not
Cover first interaction area of the application program.
4. according to the method for claim 3, wherein being based on first interaction area in first user interface element
In input and be added to after second interaction area, the second user interface element corresponds to first user
Interface element.
5. according to the method any one of claim 1-4, wherein：
Second interaction area is to include the conversation region of multiple message in the session between sessions participant；And
First interaction area is the matchmaker for selecting media to be shared in the session between the sessions participant
Body selection region.
6. according to the method any one of claim 1-5, wherein：
Second interaction area is the user interface for primary application program；And
First interaction area is configured as display from the difference for being configured as being operated in the primary application program
The content of miniature applications program, and the shown miniature applications program in first interaction area is based on described set
The user at standby place inputs and is chosen.
7. according to the method any one of claim 1-6, including：
In addition to first user interface element, when first interaction area of the masking application program is without masking
During second interaction area of the application program, the increase of the characteristic strength of the contact is detected；And
In response to the increase for the characteristic strength for detecting the contact：
The characteristic strength according to the contact is determined meets the 3rd selection standard, and the 3rd selection standard is included when described
The characteristic strength of contact is more than the standard met during the selection intensity threshold value higher than first intensity threshold, to described
First user interface element performs the 3rd selection operation and stops covering first interaction area of the application program；With
And
The characteristic strength according to the input is determined is unsatisfactory for the 3rd selection standard, except the first user bound component
Outside, continue to cover first interaction area of the application program, without covering described the second of the application program
Interaction area.
8. according to the method any one of claim 1-7, wherein being inputted described first to meet institute during Flick gesture
State first choice standard.
9. a kind of electronic equipment, including：
Display；
Touch sensitive surface；
One or more sensors, it is strong with the contact of the touch sensitive surface that one or more of sensors are configured as detection
Degree；
One or more processors；
Memory；With
One or more programs, wherein one or more of programs are stored in the memory and are configured as by described
One or more processors perform, and one or more of programs include the instruction for following operation：
Display includes the first interaction area of application program and the second interaction area of the application program on the display
User interface；
When showing the user interface, on the display first with the first user interface in first interaction area
Opening position detection passes through the first input caused by the contact on the touch sensitive surface corresponding to element；
In response to detecting by first input caused by the contact：
According to the activation standard of the first input satisfaction based on intensity is determined, wherein the activation standard requirement based on intensity
The characteristic strength of the contact with higher than the first intensity threshold is to meet the activation standard based on intensity, except described the
Outside one user interface element, first interaction area of the application program is covered, without covering the application program
Second interaction area；And
First choice standard is met according to determination first input, wherein the first choice standard does not require the contact tool
There is the characteristic strength higher than first intensity threshold to meet the selection standard, perform and first user interface member
First choice corresponding to element operates, without covering first interaction area of the application program.
10. electronic equipment according to claim 9, wherein covering first interaction area of the application program includes
Cover as the characteristic strength of the contact changes and dynamically first interaction area of the application program.
11. according to the electronic equipment any one of claim 9-10, one or more of programs include being used to carry out
The instruction operated below：
When showing the user interface, on the display with the second user Interface Element in second interaction area
Opening position detection corresponding to element passes through the second input caused by the second contact on the touch sensitive surface；
In response to detecting by second input caused by the described second contact：
According to the second input second activation standard based on intensity of satisfaction is determined, wherein the described second activation based on intensity
Standard requires characteristic strength of second contact with higher than the second intensity threshold to meet described second based on intensity
Activation standard, in addition to the second user interface element, cover first interaction area of the application program and described
Second interaction area of application program；And
According to the second input second selection standard of satisfaction is determined, wherein second selection standard does not require that described second connects
The characteristic strength with higher than second intensity threshold is touched to meet second selection standard, performs and is used with described second
Second selection operation corresponding to the interface element of family, without cover the application program second interaction area and need not
Cover first interaction area of the application program.
12. electronic equipment according to claim 11, handed over wherein being based on described first in first user interface element
Input in mutual region and be added to after second interaction area, the second user interface element corresponds to described the
One user interface element.
13. according to the electronic equipment any one of claim 9-12, wherein：
Second interaction area is to include the conversation region of multiple message in the session between sessions participant；And
First interaction area is the matchmaker for selecting media to be shared in the session between the sessions participant
Body selection region.
14. according to the electronic equipment any one of claim 9-13, wherein：
Second interaction area is the user interface for primary application program；And
First interaction area is configured as display from the difference for being configured as being operated in the primary application program
The content of miniature applications program, and the shown miniature applications program in first interaction area is based on described set
The user at standby place inputs and is chosen.
15. according to the electronic equipment any one of claim 9-14, one or more of programs include being used to carry out
The instruction operated below：
In addition to first user interface element, when first interaction area of the masking application program is without masking
During second interaction area of the application program, the increase of the characteristic strength of the contact is detected；And
In response to the increase for the characteristic strength for detecting the contact：
The characteristic strength according to the contact is determined meets the 3rd selection standard, and the 3rd selection standard is included when described
The characteristic strength of contact is more than the standard met during the selection intensity threshold value higher than first intensity threshold, to described
First user interface element performs the 3rd selection operation and stops covering first interaction area of the application program；With
And
The characteristic strength according to the input is determined is unsatisfactory for the 3rd selection standard, except the first user bound component
Outside, continue to cover first interaction area of the application program, without covering described the second of the application program
Interaction area.
16. according to the electronic equipment any one of claim 9-15, wherein when the described first input is Flick gesture
Meet the first choice standard.
17. a kind of computer-readable recording medium for storing one or more programs, one or more of programs include instruction,
The instruction is when by with display, touch sensitive surface and being configured as detection and one of the intensity of the contact of the touch sensitive surface
Or multiple sensors electronic equipment perform when cause the equipment：
Display includes the first interaction area of application program and the second interaction area of the application program on the display
User interface；
When showing the user interface, on the display first with the first user interface in first interaction area
Opening position detection passes through the first input caused by the contact on the touch sensitive surface corresponding to element；
In response to detecting by first input caused by the contact：
According to the activation standard of the first input satisfaction based on intensity is determined, wherein the activation standard requirement based on intensity
The characteristic strength of the contact with higher than the first intensity threshold is to meet the activation standard based on intensity, except described the
Outside one user interface element, first interaction area of the application program is covered, without covering the application program
Second interaction area；And
First choice standard is met according to determination first input, wherein the first choice standard does not require the contact tool
There is the characteristic strength higher than first intensity threshold to meet the selection standard, perform and first user interface member
First choice corresponding to element operates, without covering first interaction area of the application program.
18. computer-readable recording medium according to claim 17, wherein hiding described the first of the application program
Interaction area is included as the characteristic strength of the contact changes and dynamically covers described the first of the application program
Interaction area.
19. according to the computer-readable recording medium any one of claim 17-18, including when by the electronic equipment
The electronic equipment is caused to carry out the instruction of following operation during execution：
When showing the user interface, on the display with the second user Interface Element in second interaction area
Opening position detection corresponding to element passes through the second input caused by the second contact on the touch sensitive surface；
In response to detecting by second input caused by the described second contact：
According to the second input second activation standard based on intensity of satisfaction is determined, wherein the described second activation based on intensity
Standard requires characteristic strength of second contact with higher than the second intensity threshold to meet described second based on intensity
Activation standard, in addition to the second user interface element, cover first interaction area of the application program and described
Second interaction area of application program；And
According to the second input second selection standard of satisfaction is determined, wherein second selection standard does not require that described second connects
The characteristic strength with higher than second intensity threshold is touched to meet second selection standard, performs and is used with described second
Second selection operation corresponding to the interface element of family, without cover the application program second interaction area and need not
Cover first interaction area of the application program.
20. computer-readable recording medium according to claim 19, wherein being based in first user interface element
Input in first interaction area and be added to after second interaction area, the second user interface element pair
First user interface element described in Ying Yu.
21. according to the computer-readable recording medium any one of claim 17-20, wherein：
Second interaction area is to include the conversation region of multiple message in the session between sessions participant；And
First interaction area is the matchmaker for selecting media to be shared in the session between the sessions participant
Body selection region.
22. according to the computer-readable recording medium any one of claim 17-21, wherein：
Second interaction area is the user interface for primary application program；And
First interaction area is configured as display from the difference for being configured as being operated in the primary application program
The content of miniature applications program, and the shown miniature applications program in first interaction area is based on described set
The user at standby place inputs and is chosen.
23. according to the computer-readable recording medium any one of claim 17-22, including when by the electronic equipment
The electronic equipment is caused to carry out the instruction of following operation during execution：
In addition to first user interface element, when first interaction area of the masking application program is without masking
During second interaction area of the application program, the increase of the characteristic strength of the contact is detected；And
In response to the increase for the characteristic strength for detecting the contact：
The characteristic strength according to the contact is determined meets the 3rd selection standard, and the 3rd selection standard is included when described
The characteristic strength of contact is more than the standard met during the selection intensity threshold value higher than first intensity threshold, to described
First user interface element performs the 3rd selection operation and stops hiding first interaction area of the application program；With
And
The characteristic strength according to the input is determined is unsatisfactory for the 3rd selection standard, except the first user bound component
Outside, continue to cover first interaction area of the application program, without covering described the second of the application program
Interaction area.
24. according to the computer-readable recording medium any one of claim 17-23, wherein being in the described first input
Meet the first choice standard during Flick gesture.
25. a kind of electronic equipment, including：
Display；
Touch sensitive surface；
One or more sensors, it is strong with the contact of the touch sensitive surface that one or more of sensors are configured as detection
Degree；With
For showing the second interaction of the first interaction area and the application program including application program on the display
The device of the user interface in region；
Enabled when showing the user interface be used on the display with first in first interaction area
The device that opening position detection corresponding to user interface element passes through the first input caused by the contact on the touch sensitive surface；
The device for being operated below is enabled in response to detecting by first input caused by the contact：
According to the activation standard of the first input satisfaction based on intensity is determined, wherein the activation standard requirement based on intensity
The characteristic strength of the contact with higher than the first intensity threshold is to meet the activation standard based on intensity, except described the
Outside one user interface element, first interaction area of the application program is covered, without covering the application program
Second interaction area；And
First choice standard is met according to determination first input, wherein the first choice standard does not require the contact tool
There is the characteristic strength higher than first intensity threshold to meet the selection standard, perform and first user interface member
First choice corresponding to element operates, without covering first interaction area of the application program.
26. electronic equipment according to claim 25, wherein first interactive areas for covering the application program
The described device in domain includes being used for as the characteristic strength of the contact changes and dynamically covers the application program
The device of first interaction area.
27. according to the electronic equipment any one of claim 25-26, including：
Enabled when showing the user interface be used on the display with second in second interaction area
The device that opening position detection corresponding to user interface element passes through the second input caused by the second contact on the touch sensitive surface；
It is used for what is operated below by second input caused by the described second contact and what is started in response to detecting
Device：
According to the second input second activation standard based on intensity of satisfaction is determined, wherein the described second activation based on intensity
Standard requires characteristic strength of second contact with higher than the second intensity threshold to meet described second based on intensity
Activation standard, in addition to the second user interface element, cover first interaction area of the application program and described
Second interaction area of application program；And
According to the second input second selection standard of satisfaction is determined, wherein second selection standard does not require that described second connects
The characteristic strength with higher than second intensity threshold is touched to meet second selection standard, performs and is used with described second
Second selection operation corresponding to the interface element of family, without cover the application program second interaction area and need not
Cover first interaction area of the application program.
28. electronic equipment according to claim 27, handed over wherein being based on described first in first user interface element
Input in mutual region and be added to after second interaction area,
The second user interface element corresponds to first user interface element.
29. according to the electronic equipment any one of claim 25-28, wherein：
Second interaction area is to include the conversation region of multiple message in the session between sessions participant；And
First interaction area is the matchmaker for selecting media to be shared in the session between the sessions participant
Body selection region.
30. according to the electronic equipment any one of claim 25-29, wherein：
Second interaction area is the user interface for primary application program；And
First interaction area is configured as display from the difference for being configured as being operated in the primary application program
The content of miniature applications program, and the shown miniature applications program in first interaction area is based on described set
The user at standby place inputs and is chosen.
31. according to the electronic equipment any one of claim 25-30, including：
In addition to first user interface element, when first interaction area of the masking application program is without masking
What is enabled during second interaction area of the application program is used to detect the increase of the characteristic strength of the contact
Device；With
Enabled in response to the increase for the characteristic strength for detecting the contact for the dress that is operated below
Put：
The characteristic strength according to the contact is determined meets the 3rd selection standard, and the 3rd selection standard is included when described
The characteristic strength of contact is more than the standard met during the selection intensity threshold value higher than first intensity threshold, to described
First user interface element performs the 3rd selection operation and stops covering first interaction area of the application program；With
And
The characteristic strength according to the input is determined is unsatisfactory for the 3rd selection standard, except the first user bound component
Outside, continue to cover first interaction area of the application program, without covering described the second of the application program
Interaction area.
32. according to the electronic equipment any one of claim 25-31, wherein when the described first input is Flick gesture
Meet the first choice standard.
33. a kind of electronic equipment, including：
Display unit, the display unit are configured as showing user interface；
Touch sensitive surface unit, the touch sensitive surface unit are configured as receiving contact；
One or more sensor units, one or more of sensor units are configured as detection and the touch sensitive surface list
The intensity of the contact of member；With
The processing unit coupled with the display unit, the touch sensitive surface unit and one or more of sensor units,
The processing unit is configured as：
Display includes the first interaction area of application program and the second interactive areas of the application program on the display unit
The user interface in domain；
When showing the user interface, on the display unit with the first user interface in first interaction area
Opening position detection passes through the first input caused by the contact on the touch sensitive surface unit corresponding to element；
In response to detecting by first input caused by the contact：
According to the activation standard of the first input satisfaction based on intensity is determined, wherein the activation standard requirement based on intensity
The characteristic strength of the contact with higher than the first intensity threshold is to meet the activation standard based on intensity, except described the
Outside one user interface element, first interaction area of the application program is covered, without covering the application program
Second interaction area；And
First choice standard is met according to determination first input, wherein the first choice standard does not require the contact tool
There is the characteristic strength higher than first intensity threshold to meet the selection standard, perform and first user interface member
First choice corresponding to element operates, without covering first interaction area of the application program.
34. electronic equipment according to claim 33, wherein covering the first interaction area bag of the application program
Include as the characteristic strength of the contact changes and dynamically covers first interaction area of the application program.
35. according to the electronic equipment any one of claim 33-34, the processing unit is further configured to：
When showing the user interface, on the display unit with the second user interface in second interaction area
Opening position detection corresponding to element passes through the second input caused by the second contact on the touch sensitive surface unit；
In response to detecting by second input caused by the described second contact：
According to the second input second activation standard based on intensity of satisfaction is determined, wherein the described second activation based on intensity
Standard requires characteristic strength of second contact with higher than the second intensity threshold to meet described second based on intensity
Activation standard, in addition to the second user interface element, cover first interaction area of the application program and described
Second interaction area of application program；And
According to the second input second selection standard of satisfaction is determined, wherein second selection standard does not require that described second connects
The characteristic strength with higher than second intensity threshold is touched to meet second selection standard, performs and is used with described second
Second selection operation corresponding to the interface element of family, without cover the application program second interaction area and need not
Cover first interaction area of the application program.
36. electronic equipment according to claim 35, handed over wherein being based on described first in first user interface element
Input in mutual region and be added to after second interaction area, the second user interface element corresponds to described the
One user interface element.
37. according to the electronic equipment any one of claim 33-36, wherein：
Second interaction area is to include the conversation region of multiple message in the session between sessions participant；And
First interaction area is the matchmaker for selecting media to be shared in the session between the sessions participant
Body selection region.
38. according to the electronic equipment any one of claim 33-37, wherein：
Second interaction area is the user interface for primary application program；And
First interaction area is configured as display from the difference for being configured as being operated in the primary application program
The content of miniature applications program, and the shown miniature applications program in first interaction area is based on described set
The user at standby place inputs and is chosen.
39. according to the electronic equipment any one of claim 33-38, wherein the processing unit is further configured
For：
In addition to first user interface element, when first interaction area of the masking application program is without masking
During second interaction area of the application program, the increase of the characteristic strength of the contact is detected；And
In response to the increase for the characteristic strength for detecting the contact：
The characteristic strength according to the contact is determined meets the 3rd selection standard, and the 3rd selection standard is included when described
The characteristic strength of contact is more than the standard met during the selection intensity threshold value higher than first intensity threshold, to described
First user interface element performs the 3rd selection operation and stops covering first interaction area of the application program；With
And
The characteristic strength according to the input is determined is unsatisfactory for the 3rd selection standard, except the first user bound component
Outside, continue to cover first interaction area of the application program, without covering described the second of the application program
Interaction area.
40. according to the electronic equipment any one of claim 33-39, wherein when the described first input is Flick gesture
Meet the first choice standard.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810369048.8A CN108829325B (en) | 2016-06-12 | 2017-05-22 | Apparatus, method and graphical user interface for dynamically adjusting presentation of audio output |
| CN202010072444.1A CN111427530B (en) | 2016-06-12 | 2017-05-22 | Apparatus, method and graphical user interface for dynamically adjusting presentation of audio output |
Applications Claiming Priority (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201662349056P | 2016-06-12 | 2016-06-12 | |
| US62/349,056 | 2016-06-12 | ||
| DKPA201670599A DK179033B1 (en) | 2016-06-12 | 2016-08-09 | Devices, methods, and graphical user interfaces for dynamically adjusting presentation of audio outputs |
| DKPA201670597 | 2016-08-09 | ||
| DKPA201670597A DK179034B1 (en) | 2016-06-12 | 2016-08-09 | Devices, methods, and graphical user interfaces for dynamically adjusting presentation of audio outputs |
| DKPA201670599 | 2016-08-09 |
Related Child Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810369048.8A Division CN108829325B (en) | 2016-06-12 | 2017-05-22 | Apparatus, method and graphical user interface for dynamically adjusting presentation of audio output |
| CN202010072444.1A Division CN111427530B (en) | 2016-06-12 | 2017-05-22 | Apparatus, method and graphical user interface for dynamically adjusting presentation of audio output |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107491283A true CN107491283A (en) | 2017-12-19 |
| CN107491283B CN107491283B (en) | 2020-03-27 |
Family
ID=59215873
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710364610.3A Active CN107491283B (en) | 2016-06-12 | 2017-05-22 | Apparatus, method and graphical user interface for dynamically adjusting presentation of audio output |
| CN201810369048.8A Active CN108829325B (en) | 2016-06-12 | 2017-05-22 | Apparatus, method and graphical user interface for dynamically adjusting presentation of audio output |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810369048.8A Active CN108829325B (en) | 2016-06-12 | 2017-05-22 | Apparatus, method and graphical user interface for dynamically adjusting presentation of audio output |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN107491283B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109634499A (en) * | 2018-12-12 | 2019-04-16 | 广州酷狗计算机科技有限公司 | Information display method, device, terminal and storage medium |
| CN110310613A (en) * | 2018-03-27 | 2019-10-08 | 上海新啊利网络科技有限公司 | A kind of method and apparatus for generating color encoded music |
| CN111552431A (en) * | 2019-02-12 | 2020-08-18 | 沃尔沃汽车公司 | Display and input mirroring on head-up display |
| CN112000308A (en) * | 2020-09-10 | 2020-11-27 | 成都拟合未来科技有限公司 | Double-track audio playing control method, system, terminal and medium |
| CN112136127A (en) * | 2018-05-18 | 2020-12-25 | 谷歌有限责任公司 | Action indicator for search operation output element |
| CN112204508A (en) * | 2018-06-03 | 2021-01-08 | 苹果公司 | Method and apparatus for presenting a synthetic reality user interface |
| CN113253844A (en) * | 2018-11-06 | 2021-08-13 | 苹果公司 | Device, method and graphical user interface for interacting with user interface objects and providing feedback |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110321192B (en) * | 2019-04-29 | 2023-03-31 | 上海连尚网络科技有限公司 | Method and equipment for presenting hosted program |
| US20210006730A1 (en) * | 2019-07-07 | 2021-01-07 | Tangible Play, Inc. | Computing device |
| CN117441156B (en) * | 2021-06-06 | 2024-11-01 | 苹果公司 | User interface for audio routing |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101159437A (en) * | 2006-10-04 | 2008-04-09 | 三星电子株式会社 | Broadcast receiving apparatus and control method thereof |
| US20100053348A1 (en) * | 2008-08-29 | 2010-03-04 | Yoshimoto Yoshiharu | Image capture device, image analysis device, external light intensity calculation method, image analysis method, image capture program, image analysis program, and storage medium |
| WO2014105274A1 (en) * | 2012-12-29 | 2014-07-03 | Yknots Industries Llc | Device, method, and graphical user interface for navigating user interface hierarchies |
| CN105389078A (en) * | 2014-09-02 | 2016-03-09 | 苹果公司 | User interface for receiving user input |
| AU2016100246A4 (en) * | 2015-03-08 | 2016-04-07 | Apple Inc. | Device, method, and user interface for processing intensity of touch contacts |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102098606A (en) * | 2009-12-10 | 2011-06-15 | 腾讯科技（深圳）有限公司 | Method and device for dynamically adjusting volume |
| KR101648143B1 (en) * | 2011-11-18 | 2016-08-16 | 센톤스 아이엔씨. | Detecting touch input force |
| CN104903834B (en) * | 2012-12-29 | 2019-07-05 | 苹果公司 | For equipment, method and the graphic user interface in touch input to transition between display output relation |
| CN103928037B (en) * | 2013-01-10 | 2018-04-13 | 先锋高科技(上海)有限公司 | A kind of audio switching method and terminal device |
| CN105117131B (en) * | 2015-08-27 | 2019-02-05 | Oppo广东移动通信有限公司 | A progress bar control method and device |
| CN105163186A (en) * | 2015-08-27 | 2015-12-16 | 广东欧珀移动通信有限公司 | Playing operation method and terminal |
-
2017
- 2017-05-22 CN CN201710364610.3A patent/CN107491283B/en active Active
- 2017-05-22 CN CN201810369048.8A patent/CN108829325B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101159437A (en) * | 2006-10-04 | 2008-04-09 | 三星电子株式会社 | Broadcast receiving apparatus and control method thereof |
| US20100053348A1 (en) * | 2008-08-29 | 2010-03-04 | Yoshimoto Yoshiharu | Image capture device, image analysis device, external light intensity calculation method, image analysis method, image capture program, image analysis program, and storage medium |
| WO2014105274A1 (en) * | 2012-12-29 | 2014-07-03 | Yknots Industries Llc | Device, method, and graphical user interface for navigating user interface hierarchies |
| CN105389078A (en) * | 2014-09-02 | 2016-03-09 | 苹果公司 | User interface for receiving user input |
| AU2016100246A4 (en) * | 2015-03-08 | 2016-04-07 | Apple Inc. | Device, method, and user interface for processing intensity of touch contacts |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110310613A (en) * | 2018-03-27 | 2019-10-08 | 上海新啊利网络科技有限公司 | A kind of method and apparatus for generating color encoded music |
| CN112136127A (en) * | 2018-05-18 | 2020-12-25 | 谷歌有限责任公司 | Action indicator for search operation output element |
| CN112204508A (en) * | 2018-06-03 | 2021-01-08 | 苹果公司 | Method and apparatus for presenting a synthetic reality user interface |
| CN113253844A (en) * | 2018-11-06 | 2021-08-13 | 苹果公司 | Device, method and graphical user interface for interacting with user interface objects and providing feedback |
| US12164752B2 (en) | 2018-11-06 | 2024-12-10 | Apple Inc. | Devices, methods, and graphical user interfaces for interacting with user interface objects and providing feedback |
| CN109634499A (en) * | 2018-12-12 | 2019-04-16 | 广州酷狗计算机科技有限公司 | Information display method, device, terminal and storage medium |
| CN111552431A (en) * | 2019-02-12 | 2020-08-18 | 沃尔沃汽车公司 | Display and input mirroring on head-up display |
| CN112000308A (en) * | 2020-09-10 | 2020-11-27 | 成都拟合未来科技有限公司 | Double-track audio playing control method, system, terminal and medium |
| CN112000308B (en) * | 2020-09-10 | 2023-04-18 | 成都拟合未来科技有限公司 | Double-track audio playing control method, system, terminal and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107491283B (en) | 2020-03-27 |
| CN108829325A (en) | 2018-11-16 |
| CN108829325B (en) | 2021-01-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108351750B (en) | For handling equipment, method and the graphic user interface of strength information associated with touch input | |
| CN104903835B (en) | For abandoning equipment, method and the graphic user interface of generation tactile output for more contact gestures | |
| CN104903834B (en) | For equipment, method and the graphic user interface in touch input to transition between display output relation | |
| CN104471521B (en) | For providing the equipment, method and graphic user interface of feedback for the state of activation for changing user interface object | |
| CN106416210B (en) | Method, electronic equipment and the computer readable storage medium that call routes between equipment | |
| CN106502638B (en) | For providing the equipment, method and graphic user interface of audiovisual feedback | |
| CN104885050B (en) | For determining the equipment, method and the graphic user interface that are rolling or selection content | |
| CN106605196B (en) | remote camera user interface | |
| CN106462283B (en) | Character recognition on computing devices | |
| CN104487929B (en) | For contacting the equipment for carrying out display additional information, method and graphic user interface in response to user | |
| CN104487927B (en) | For selecting the equipment, method and graphic user interface of user interface object | |
| CN105264479B (en) | Equipment, method and graphic user interface for navigating to user interface hierarchical structure | |
| CN107690619B (en) | For handling the device and method of touch input in touch sensitive surface multiple regions | |
| CN107491283A (en) | For equipment, method and the graphic user interface of the presentation for dynamically adjusting audio output | |
| CN109690445A (en) | Special lock mode user interface | |
| CN108140361A (en) | Viewing pattern | |
| CN107924277A (en) | Device, method and graphical user interface for manipulating a user interface by physical gestures | |
| CN109219796A (en) | Digital touch on real-time video | |
| CN107430488A (en) | Threshold value and feedback based on activity | |
| CN107924264A (en) | For adjusting the equipment, method and graphic user interface of user interface object | |
| CN107683470A (en) | Audio frequency control for web browser | |
| CN109196455A (en) | Application shortcuts for carplay | |
| CN107797658A (en) | Equipment, method and graphic user interface for tactile mixing | |
| CN107637073A (en) | Videograph and playback | |
| CN107491186A (en) | Touch keypad for screen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |