JP5752759B2 - Electronic device, method, and program - Google Patents

Description

  Embodiments described herein relate generally to an electronic device capable of displaying a page based on a source described in a markup language, and a display control method applied to the electronic device.

  In recent years, various electronic devices such as a personal computer (PC), a tablet PC, and a smartphone have been developed. In many electronic devices of this type, a browser is used to display various types of pages (web pages). Generally, a page displayed by a browser is composed of a plurality of blocks (a plurality of contexts) that can be visually recognized by the user. The user can display a desired context in the page on the browser screen by operating the browser using a scroll bar or the like on the browser screen.

  Furthermore, in an electronic device equipped with a touch panel, a user can specify a certain context in a page displayed on the screen by a double touch operation or the like to expand the context and display it on the screen. Yes (zoom).

JP 2008-180833 A

  However, a context outside the screen cannot be specified by a double touch operation or the like. In particular, when a certain context in the page is zoomed, there is a high possibility that some other contexts in the page are out of the screen, that is, not displayed.

  In order to magnify and display a desired context that is not displayed, the user doubles the desired context after scrolling the page using a scroll bar or the like so that the desired context is displayed on the screen. It is necessary to designate by a touch operation or the like, or after the page is reduced and displayed so that the entire page is displayed, this desired context must be designated by a double touch operation or the like.

  Thus, many operations are required to display the desired context on the browser screen so that the user can easily browse. Therefore, it is required to display a desired context by a simple operation.

  An object of the present invention is to provide an electronic device and a display control method that can easily display a desired context in a page.

According to the embodiment, the electronic device displays a web page including a plurality of regions for displaying a plurality of elements in the source based on a source having a hierarchical document structure described in a markup language. Can be displayed above. The electronic apparatus includes a processing unit. The processing means is a case where a user's voice is input in a state where the first area of the web page corresponding to the first element of the source is displayed, and the user's voice recognition result is , The next or previous order relation is included for the first element based on the order relation of the plurality of elements in the source based on the document structure of the source. The web page corresponding to the second element by searching for the second element in the source having one of the previous order relationships, scrolling the web page and controlling the display magnification of the web page a second region above performs control to display at the first magnification is determined based on the size of the size and the screen of the second region on the web page. The processing means is a case where a user's voice is input in a state where the second area is displayed at the first magnification, and the next or previous order is added to the recognition result of the user's voice. Having a next or previous order relationship with respect to the second element based on an order relationship of a plurality of elements in the source based on a document structure of the source when a word designating a relationship is included Find the third element in the source, by controlling the display magnification of the web page to scroll through and the web page, from a first state to display the second region in the first magnification, the A second state in which a third area on the web page corresponding to a third element is displayed at a second magnification determined based on the size of the third area on the web page and the size of the screen. Transition to Please is carried out. The first magnification and the second magnification may be different, and when the first magnification and the second magnification are different, the processing means displays the second area on the web page. When the control is performed to change from the first state to the second state for displaying the third region , the display magnification is automatically changed from the first magnification to the second magnification.

1 is a perspective view showing an external appearance of an electronic apparatus according to a first embodiment. FIG. 3 is a diagram illustrating an example of a browser display screen executed by the electronic apparatus of the first embodiment. FIG. 6 is a diagram for explaining a page displayed on the screen of the electronic apparatus according to the first embodiment and a source of the page. FIG. 6 is a diagram illustrating an example of a change in display content displayed on the screen of the electronic apparatus according to the first embodiment. 1 is a block diagram showing a system configuration of an electronic device according to a first embodiment. FIG. 3 is an exemplary block diagram illustrating a configuration example of a display control program executed by the electronic apparatus according to the first embodiment. The block diagram which shows the other structural example of the display control program performed by the electronic device of 1st Embodiment. 6 is an exemplary flowchart illustrating an example of a procedure for changing a context displayed on a screen executed by the electronic apparatus according to the first embodiment. 9 is a flowchart illustrating another example of a procedure for changing the context displayed on the screen executed by the electronic apparatus according to the first embodiment. 6 is an exemplary flowchart illustrating an example of a procedure for analyzing an element on a source which is executed by the electronic apparatus according to the first embodiment. The figure for demonstrating control of the expansion rate of the context of the display control program performed by the electronic device of 1st Embodiment. The figure which shows an example of the change of the display content displayed on the screen of the electronic device of 2nd Embodiment. The figure which shows an example of the display screen of the browser performed by the electronic device of 3rd Embodiment. The figure which shows an example of the source used with the display control program performed by the electronic device of 3rd Embodiment.

(First embodiment)
Hereinafter, embodiments will be described with reference to the drawings.
FIG. 1 is a perspective view illustrating an appearance of an electronic apparatus according to the present embodiment. This electronic device can be realized as, for example, a slate personal computer (PC), a laptop PC, a smartphone, or a PDA. Note that this electronic apparatus may be an embedded device incorporated in another electronic apparatus. In the following, it is assumed that the electronic device is realized as a slate type personal computer 10. As shown in FIG. 1, the slate type personal computer 10 includes a computer main body 11 and a touch screen display 17.

  The computer main body 11 has a thin box-shaped housing. The touch screen display 17 includes a liquid crystal display (LCD) and a touch panel. The touch panel is provided so as to cover the screen of the LCD. The touch screen display 17 is attached to be superposed on the upper surface of the computer main body 11.

  The computer 10 has a web page display function for displaying a web page. The web page is displayed on the display 17 by the browser. The browser is, for example, an application program built in the computer 10. The computer 10 activates a browser according to an instruction from a user, for example.

  The browser acquires web data related to the web page, and displays the web page on the browser screen based on the web data. Web data is acquired from the outside of the computer 10 via the Internet. For example, the web data is acquired from a server that publishes a web page.

  Web data is, for example, the source of a web page. The source is described in a markup language such as HTML language. The configuration of the web page displayed on the browser screen is determined based on the description content of the source. The configuration of the web page is, for example, a positional relationship between a character string or an image displayed on the web page on the web page, a font or color setting of the character string, or a setting of an image size.

  In addition, when the user moves his / her finger while the user's finger is in contact with the touch panel, a part of the web page can be enlarged or the web page can be reduced and displayed on the display 17. Further, when the user moves his / her finger, for example, the scroll function of the browser is executed, and a part of the web page that has not been displayed on the browser screen can be displayed on the display 17.

  The computer 10 includes a microphone or the like and can detect the user's voice. Instead of the operation for changing the appearance of the web page from the user by moving the user's finger on the touch panel as described above, a specific voice from the user (a specific word uttered by the user) ) Can be changed to change the appearance of the web page, that is, the display state of the web page.

  The computer 10 may include, for example, a keyboard other than the touch panel and the microphone. The scroll function of the browser may be executed by the user operating the keyboard. Furthermore, the computer 10 may be incorporated in another electronic device such as a refrigerator. Further, the browser may not be installed in the computer 10. For example, the computer 10 may remotely execute a browser mounted on a server outside the computer 10.

  Further, the web data does not need to be in a server outside the computer 10, but is stored in an auxiliary storage device or the like inside the computer 10, for example, and stored on the browser screen offline using the stored data. A web page may be displayed.

  As described above, the web data may be acquired from an external server via the Internet, but may be other than the Internet, for example, an intranet or another network that can transmit and receive data. Further, the web data may be other than the above-described source, for example, an image of a web page generated based on the source. In this case, the browser may display the image on the browser screen, and when referring to the source that generated the image displayed by the browser, the source may be acquired from an external server as described above. Moreover, the source mentioned above may be described using other markup languages, such as XML language, besides HTML language.

FIG. 2 is a diagram showing a display example of a web page displayed on the screen of the display 17 by the browser.
The browser screen 26 is a browser screen displayed on the display 17 by the browser. The browser screen 26 has an area for displaying a web page in addition to the address bar indicating the address of the web page. A web page is composed of a plurality of contexts.

  A context is a block of blocks displayed on a web page. Further, the context may mean a predetermined area on the web page that is shown in block units that can be visually recognized by the user. That is, the context may be a block of blocks on the web page that can be visually recognized by the user. Therefore, it may be other than a context for moving to another page using a keyboard, a mouse or the like like hyperlink text. For example, another context may be included in an area on a web page of a predetermined context.

  In the example of FIG. 2, the web page displays contexts 21 and 22. The context 21 is a block that displays an image such as a still image and a character string. The context 22 is a block that displays an image such as a still image. The context 21 includes a context 23 and a context 24 in an area on the web page of the context 21. The context 23 displays an image such as a still image. The context 24 displays a character string. Further, the context 25 includes a context 21 and other contexts similar to the context 21.

  In addition, although FIG. 2 demonstrated about the web page comprised from several contexts, the web page may be comprised from one context. Further, the address bar is not necessarily displayed on the browser screen 26.

FIG. 3 is a diagram showing an example of the correspondence between the web page context and the source of the web page.
As described above, the web page is displayed based on the source described in the HTML language. That is, each context displayed on the web page corresponds to an element that is part of the source corresponding to the web page.

  In the present embodiment, it is assumed that some of the plurality of contexts constituting the web page have an order relationship. The order relationship is a relationship between contexts that means the order of contexts that the user should pay attention to.

Specifically, this will be described with reference to FIG. In FIG. 3, a web page composed of contexts having an order relationship will be described.
The web page 33 is shown on the left side of FIG. 3, and the source 34 corresponding to the web page 33 is shown on the right side. In FIG. 3, the web page 33 shows the contents related to the recipe for cooking. On the web page 33, a plurality of contexts such as contexts 30, 31, and 32 having an order relationship indicating cooking procedures are displayed.

  The context 31 is a context including content that follows the content of the context 30. The context 32 is a context including content that precedes the content of the context 30. Each of the contexts 30, 31, and 32 includes an image and a character string. Each of the image and the character string may be a context.

  The source 34 is composed of a plurality of elements respectively corresponding to a plurality of contexts on the web page 33. The source 34 is described in the HTML language as described above. The source 34 has a hierarchical document structure using tags and the like. An element refers to a part of the description on the source 34. The element represents one HTML tag on the source 34. Note that the element may include a document of the source 34 sandwiched between predetermined tags as shown in FIG. In FIG. 3, the elements are indicated by elements 41, 42 and 43.

  Elements 41, 42, and 43 correspond to contexts 30, 31, and 32, respectively. The element 41 will be specifically described. Based on the source 34, the browser determines a display position on the browser screen 26 of the context 30 corresponding to the element 41. Therefore, the display coordinates on the browser screen 26 of the context 30 corresponding to the element 41 can be acquired from the browser. The description content of the source 34 indicated by the element 41 (hereinafter also referred to as the content of the element 41) may include information indicating the coordinate position on the web page 33 of the context 30. Based on the information on the coordinate position, the display arrangement of the context 30 on the web page 33 may be determined. Further, the content of the element 41 includes information indicating content included in an area on the web page 33 indicated by the context 30 (hereinafter also referred to as content of the context 30). For example, according to the description of “<div> procedure 4 </ div>” included in the content of the element 41, the character string “procedure 4” is displayed in the content of the context 30. Similarly, the content of the context 31 is displayed in the area indicated by the context 31 on the web page 33 according to the content of the element 42. The content of the context 32 is displayed in the area indicated by the context 32 on the web page 33 according to the content of the element 43. Thus, the content of the context is displayed on the web page 33 based on the content of the element.

  Assume that the context 30 is currently selected. The currently selected context 30 is referred to as the current context. The current context may be, for example, a context that is enlarged (zoomed) on the screen of the display 17 or a context that is displayed (centered) at the center of the screen of the display 17. In a state where the context 30 is the current context, when the user speaks a word having an order relationship such as “next”, the content of the context 30 is analyzed, and the context corresponding to “next” is searched from the page. Here, the context 31 including the character string “procedure 5” subsequent to the character string “procedure 4” in the context 30 is searched for as the context corresponding to “next”.

  If a context corresponding to “next” is found, this found context becomes a new current context. Then, the display state of the web page 33 is changed so that the found context is displayed on the screen of the display 17. In this case, for example, the context 31 may be displayed at the center of the screen of the display 17 by scrolling the web page 33. Alternatively, by scrolling the web page 33, the context 31 may be moved to the center of the screen of the display 17 and the context 31 may be enlarged.

  On the other hand, when the user speaks a word having an order relationship such as “previous” in a state where the context 30 is the current context, the content of the context 30 is analyzed, and the context corresponding to “previous” is searched from the page. Here, the context 32 including the character string “procedure 3” preceding the character string “procedure 4” in the context 30 is searched for as the context corresponding to “previous”.

  If a context corresponding to “before” is found, this found context becomes a new current context. Then, the display state of the web page 33 is changed so that the found context is displayed on the screen of the display 17. In this case, for example, the context 32 may be displayed at the center of the screen of the display 17 by scrolling the web page 33. Alternatively, the context 32 may be moved to the center of the screen of the display 17 and the context 32 may be enlarged by scrolling the web page 33.

  Furthermore, when a word such as “next” or “previous” is entered while a new current context is displayed, the context corresponding to “next” or “previous” of the new current context is automatically selected. And the found context becomes the new current context.

Next, with reference to FIG. 4, the transition of the display content of the web page 33 displayed on the browser screen 26 in this embodiment is demonstrated.
In this embodiment, when a part of the web page 33 composed of contexts having an order relationship using a browser is enlarged and displayed on the browser screen 26, the user is enlarged and displayed on the browser screen 26. When the next context or the previous context of the displayed context is to be enlarged and displayed on the browser screen 26, the next context or the previous context is enlarged and displayed on the browser screen 26 in accordance with an instruction from the user.

  Specifically, a description will be given with reference to FIG. In FIG. 4, it is assumed that the user is browsing the web page 33 shown in FIG. 3 using a browser. In FIG. 4, the context 30 is enlarged and displayed at the center of the browser screen 26. Almost all contexts other than the context 30 are outside the browser screen 26 and are not displayed. In this state, for example, when a word indicating an order relationship such as “next” is input from the user, the context 31 that is the next context is enlarged and displayed in the center of the browser screen 26. Thus, in the present embodiment, the context (current context) that is currently enlarged (zoomed) and displayed on the browser screen 26 is triggered by a request from the user to change the current context, and responds to the request. The displayed context is displayed on the browser screen 26. Hereinafter, an element on the source 34 corresponding to the current context is referred to as a current element. For example, in FIG. 3, when the current context is the context 30, the current element corresponds to the element 41.

FIG. 5 is a diagram showing a system configuration of the computer 10.
As shown in FIG. 5, the computer 10 includes a CPU 101, a north bridge 102, a main memory 103, a south bridge 104, a graphics controller 105, a sound controller 106, a BIOS-ROM 107, a LAN controller 108, and a solid state drive (SSD) 109. , Wireless LAN controller 112, embedded controller (EC) 113, EEPROM 114, LCD 17A, touch panel 17B, and the like.

  The CPU 101 is a processor that controls the operation of each unit in the computer 10. The CPU 101 executes an operating system (OS) 201 and various application programs loaded from the SSD 109 to the main memory 103. The application program includes a browser 20 and a display control program 202. The browser 20 is software for displaying the above-described web page, and is executed on the operating system (OS) 201. The display control program 202 is executed as a plug-in of the browser 20, that is, a browser plug-in. Note that the display control program 202 may be other than the browser plug-in. For example, the display control program 202 may be a program independent of the browser 20, or the display control program 202 itself may incorporate the function of the browser 20.

The CPU 101 also executes the BIOS stored in the BIOS-ROM 107. The BIOS is a program for hardware control.
The north bridge 102 is a bridge device that connects the local bus of the CPU 101 and the south bridge 104. The north bridge 102 also includes a memory controller that controls access to the main memory 103. The north bridge 102 also has a function of executing communication with the graphics controller 105 via a PCI EXPRESS standard serial bus or the like.

  The graphics controller 105 is a display controller that controls the LCD 17 </ b> A used as a display monitor of the computer 10. A display signal generated by the graphics controller 105 is sent to the LCD 17A. The LCD 17A displays an image based on the display signal. A touch panel 17B is disposed on the LCD 17A. The touch panel 17B is a pointing device for inputting on the screen of the LCD 17A. The user can operate a graphical user interface (GUI) displayed on the screen of the LCD 17A using the touch panel 17B. For example, the user can instruct execution of a function corresponding to the button by touching the button displayed on the screen.

  The HDMI (registered trademark) terminal 2 is an external display connection terminal. The HDMI terminal 2 can send an uncompressed digital video signal and a digital audio signal to the external display device 1 with a single cable. The HDMI control circuit 3 is an interface for sending a digital video signal to the external display device 1 called an HDMI monitor via the HDMI terminal 2. That is, the computer 10 can be connected to the external display device 1 via the HDMI terminal 2 or the like.

  The south bridge 104 controls each device on a peripheral component interconnect (PCI) bus and each device on a low pin count (LPC) bus. Further, the south bridge 104 includes an ATA controller for controlling the SSD 109.

  The south bridge 104 has a built-in USB controller for controlling various USB devices. Further, the south bridge 104 has a function of executing communication with the sound controller 106. The sound controller 106 is a sound source device and outputs audio data to be reproduced to the speakers 18A and 18B. The LAN controller 108 is a wired communication device that executes, for example, IEEE 802.3 standard wired communication. The wireless LAN controller 112 is a wireless communication device that executes wireless communication of, for example, the IEEE 802.11 standard.

  The EC 113 is a one-chip microcomputer including an embedded controller for power management. The EC 113 has a function of turning on / off the computer 10 in accordance with the operation of the power button by the user.

  Next, the functional configuration of the display control program 202 will be described with reference to FIG. The display control program 202 includes an order determination unit 60, a document structure analysis unit 64, an audio processing unit 65, and a display processing unit 66.

  The order determination unit 60 is connected to the touch panel 17B, the voice processing unit 65, the display processing unit 66, and the document structure analysis unit 64. The order determination unit 60 functions as an analysis processing unit that determines the order relationship between a plurality of elements on the source 34 by analyzing the description of the source 34 using the document structure analysis unit 64. By determining the order relation between the elements, the order relation between the contexts on the web page 33 corresponding to each of the elements can be determined. That is, the order determination unit 60 analyzes the source 34 and has a predetermined order relationship with respect to the current element which is a part of the description in the source corresponding to the current context in the web page 33 based on the analysis result. Search the source for another element in the source. More specifically, the order determination unit 60 analyzes a current element which is a part of the description in the source corresponding to the current context in the web page 33, and performs a predetermined process on the current element based on the analysis result of the current element. Another element in the source having the order relationship (“next”, “previous”, etc.) is searched from the source, and the searched other element is selected as a new current element. For example, the order determination unit 60 analyzes a current element to find a character string including a number from within the current element, and another element including a character string having a content that follows or precedes the found character string. Is found from within the source and another found element is selected as the new current element. As a character string including a number, for example, a heading representing a number can be used. A headline representing a number is, for example, a character string including a headword and a number. For example, the above-mentioned “procedure 4” is a headline representing a number, and is composed of a character string including the headword “procedure” and the number “4”. Of course, the headline representing the number may be a character string composed only of the number.

  Here, it is assumed that a character string including the headword “procedure” and the number “4” is found as a key character from the current element. If the word “next” is entered, another element containing the same headword “procedure” and the number “5” is looked up in the source. If a word indicating “previous” is input, another element including the same headword “procedure” and the number “3” is searched from the source. The detailed description of the order determination unit 60 will be described later with reference to FIG.

  The document structure analysis unit 64 is connected to the order determination unit 60 and the document structure analysis rule 67. The document structure analysis unit 64 analyzes the document structure of the source 34 under the control of the order determination unit 60. The document structure of the source 34 is a configuration of a document including tags, character strings (hereinafter also referred to as source character strings) described in the source 34, and the like. Further, the document structure may be a hierarchical structure of tags on the source 34 or an arrangement of source character strings. The document structure analysis unit 64 analyzes the document structure based on data for analyzing the document structure stored in the document structure analysis rule 67 (hereinafter also referred to as document analysis rule). The document structure analysis rule 67 is stored in an auxiliary storage device such as the SSD 109, for example.

  The document analysis rule is an analysis rule for analyzing the document structure. The analysis rule is a rule for searching for an element similar to the current element (with a sibling relationship) based on a character string included in the current element. For example, a source character string consisting of a combination of a character string with a tag type included in the current element and a number included in the current element is registered in the document structure analysis rule 67 in advance, and the current character string is obtained from the registered source character string. A source string contained in an element that is sibling with the element is predicted, and a source string contained in an element that is expected to be sibling is searched from the source. Specifically, for example, a source character string “<div> procedure (4.)” is registered in the document structure analysis rule 67 in advance. If “<div> procedure (4.1)” is included in the current element, the element including “<div> procedure (4.2)” is predicted as an element having a sibling relationship with the current element. The document structure analysis unit 64 searches the source 34 for the source character string of “<div> procedure (4.2)”. In addition, the combination of the tag type and the character string may be composed of a character string including a tag, a number, and a symbol, for example, “<li> (4)”. Note that the source character string registered in advance may not include a tag. Further, the analysis rule may be an analysis rule that searches for an element including a source character string that is similar in character string arrangement even if it is of a different tag type as an element having a sibling relationship. In this way, by using a plurality of analysis rules, the probability of finding an element sibling with the current element increases. The document structure analysis unit 64 analyzes the document structure of the source 34 according to these document analysis rules, and sends the analysis result to the order determination unit 60.

  The voice processing unit 65 executes voice recognition processing. The audio processing unit 65 is connected to the order determination unit 60 and the microphone 19. The voice processing unit 65 receives a voice input signal from the user from the microphone 19. Further, the voice processing unit 65 detects a predetermined word included in the voice input signal by recognizing the received voice input signal. The predetermined word is a word indicating an order relationship, such as “next”, “previous”, “forward”, “back”, “and”, “from”, or “de?”. The voice processing unit 65 sends the recognition result of the voice input signal to the order determination unit 60 as a command for designating the above-described order relationship.

  The display processing unit 66 is connected to the order determination unit 60 and the LCD 17A. Based on the data sent from the order determination unit 60, the display processing unit 66 displays the data on the LCD 17A. The data sent from the order determination unit 60 is, for example, context information displayed on the browser screen 26. The context information is the coordinate information of the context on the web page 33, the information indicating the size of the context, the content of the context, or the like.

  The display processing unit 66 operates the browser 20 based on the context information. The display processing unit 66 changes the display state of the web page 33 so that the context to be displayed (new current context) is displayed on the browser screen 26. Specifically, the display processing unit 66 may display a new current context at the center of the browser screen 26 by scrolling the web page 33 (centering). As a result, the new current context is moved from the outside of the screen to the center of the screen 26, for example. Alternatively, the display processing unit 66 may move the web page 33 to move the new current context) to the center of the screen 26 (centering) and enlarge the new current context (zoom). In this case, the display processing unit 66 increases the enlargement ratio to be applied to the new current context based on the size of the new current context, that is, the web so that the new current context is enlarged to a size suitable for the size of the screen 26. An enlargement ratio to be applied to the page 33 may be calculated, and a new current context may be enlarged and displayed on the browser screen 26 according to the enlargement ratio. As a result, the size of the new current context can be increased so that the entire new current context fits within the browser screen 26. Here, the browser screen 26 means the same screen as the LCD screen.

  The browser 20 is connected to the display control program 202. The browser 20 is controlled based on a control signal from the display control program 202. Further, the browser 20 sends information related to the web page 33 displayed on the browser screen 26 and information on the displayed context to the display control program 202. The information regarding the web page 33 may be, for example, the address of the web page 33 or the source 34.

Next, an example of specific processing of the order determination unit 60 will be described with reference to FIG.
The order determination unit 60 includes a current element detection unit 61, a current element analysis unit 62, and an element search unit 63.
The current element detection unit 61 is connected to the touch panel 17B, the sound processing unit 65, and the current element analysis unit 62. The current element detection unit 61 detects a current element or sets a current element (hereinafter also referred to as current element detection). Current element detection is to determine a current element that serves as a reference when determining the order relationship. By detecting the current element, the element including the content corresponding to “next” of the current element or the element including the content corresponding to “previous” of the current element can be found from the source 34. The current element detection unit 61 detects an element corresponding to the current context indicating the context currently selected in the web page 33 as a current element. The current context is a context that is currently selected, and may be a context that is enlarged and displayed on the browser screen 26, or the current context may be a character string (hereinafter referred to as a character string) displayed on the web page 33. For example, when a user utters “procedure 4” or the like by voice based on data sent from the voice processing unit 65, for example, the content that can identify the content displayed on the web page 33 is also called. The indicated context may be used. Alternatively, the current context may be a context on the web page 33 specified by a double tap gesture by the user.

  The current element analysis unit 62 is connected to the current element detection unit 61, the element search unit 63, and the document structure analysis unit 64. The current element analysis unit analyzes the content (current element description) of the current element detected by the current element detection unit 61. The contents of the current element are the document structure of the current element and the character string included in the current element as described above. Based on the document structure of the source 34 analyzed by the document structure analysis unit 64, the current element analysis unit 62 analyzes the content having the order relationship included in the current element. The content having the order relationship may be, for example, a character string including a number included in the tag of the current element. The current element analysis unit 62 sends the analysis result of the current element to the element search unit 63.

  The element search unit 63 is connected to the current element analysis unit 62, the document structure analysis unit 64, the voice processing unit 65, and the display processing unit 66. Based on the analysis result of the current element by the current element analysis unit 62 and the analysis result of the source 34 by the document structure analysis unit 64, the element search unit 63 has other elements on the source 34 having an order relationship with the current element ( Hereinafter, it is referred to as an order relation element. The element search unit 63 instructs the display processing unit 66 so that the context corresponding to the order relation element is displayed on the browser screen 26.

  Next, an example of context display switching processing displayed on the browser screen 26 will be described with reference to the flowchart of FIG. In FIG. 8, it is assumed that a “next” or “previous” context with respect to the current context is searched after the user gives an instruction to switch the context.

  The current element detection unit 61 detects the current context (step S11). In step S11, for example, the context in the web page 33 that is currently zoomed or centered is detected as the current context. Thereafter, the user utters words having an order relationship such as “next”, and the current element detection unit 61 detects the words via the microphone 19 (YES in step S12). The instruction input from the user may be other than voice input, and may be an instruction input for changing a context displayed on the browser screen 26 using, for example, a remote control for operating the computer 10. Next, according to the instruction indicating the order contents from the user, the current element analysis unit 62 analyzes the current element (step S13). The current element analysis unit 62 analyzes the document structure of the current element based on a document analysis rule using a heading representing a number. This number may be indicated by, for example, “(1)” or “(2)”. Next, the element search unit 63 searches the context corresponding to the content of the instruction from the user for the current context based on the document structure analysis result (step S14). The element search unit 63 may search for an element including a character string having a predetermined order relationship with respect to the character string in the current element. The display processing unit 66 displays a context corresponding to the searched element on the browser screen 26 (step S15). The display processing unit 66 may display the context corresponding to the searched element centered on the browser screen 26, may be zoomed, or may be centered and zoomed. Thereby, the display state of the web page 33 is automatically changed from a display state in which the current context is zoomed or centered to a display state in which a new current context corresponding to “next” or “previous” of the current context is zoomed or centered. Transition.

  Next, another example of the context display switching process displayed on the browser screen 26 will be described with reference to the flowchart of FIG. In FIG. 9, it is assumed that the “next” or “previous” context for the current context is searched before the user gives an instruction to switch the context.

  The current element detection unit 61 detects the current element (step S21), and then analyzes the current element before receiving an instruction having an order relationship from the user (step S22). Based on the analysis result of the current element, the order relation between the current element and each of the other elements included in the source 34 is determined (step S23). Unlike the case described with reference to FIG. 8, the element search unit 63 searches both the “next” element and the “previous” element of the current element. Thereafter, when an instruction input having an order relationship from the user is detected (step S24), it is determined whether the instruction input from the user is an instruction input related to “next” (step S25). If the instruction input from the user is an instruction input related to “next” (YES in step S25), a context corresponding to the “next” element is displayed on the browser screen 26 (step 26). If the instruction input from the user is not an instruction input related to “next” (NO in step S25), it is determined whether or not the instruction input from the user is an instruction input related to “previous” (step S27). If the instruction input from the user is an instruction input related to “Previous” (YES in Step S27), the context corresponding to the “Previous” element is displayed on the browser screen 26 (Step 28). If the instruction input from the user is not an instruction input related to “Previous” (NO in step S27), the process waits until another instruction input is received from the user again.

  As described with reference to FIG. 9, the current element is analyzed before the instruction input from the user is input, and the order of the elements is determined in advance. The time taken to display the “next” or “previous” context on the browser screen 26 can be made shorter than the time taken for the processing described with reference to FIG.

Next, an example of an element search process in this embodiment will be described with reference to FIG.
The current element analysis unit 62 analyzes the structure of the current element (step S31). The element search unit 63 determines whether or not a number is included in the analyzed current element (step S32). The case where a number is included in the current element is, for example, a case where a tag included in the current element is described as “<div id = 1>”, “<div id = 2>”. In this case, the order relationship between elements is determined using the numbers in the tags. In another example in which a number is included in the current element, a number may be included between the tags, for example, “<div> procedure 1 </ div>”. If a number is included in the current element (YES in step S32), an element including a number next to the number included in the current element is searched (step S33). For example, when the tag included in the current element is “<div id = 1>”, another element on the source 34 including “<div id = 2>” is searched. As a result of the search, if there is an element including the next number, a context corresponding to the element including the next number is displayed on the browser screen 26 (step S34). If there is no element including the next number as a result of the search, the fact is notified to the user, for example, by voice.

If a number is not included in the tag of the current element (NO in step S32), the character string of the content of the element (sibling element) in the same hierarchy on the source 34 as the current element is analyzed (step S35). For example, when a part of the source 34 is described as follows and the current element is “<div> procedure 1... </ Div>”,
<Div>
<Div> Procedure 1 ... </ div>
<Div> Procedure 2 ... </ div>
</ Div>
The first character string “procedure 2...” In the second element “<div> procedure 2... </ Div>” in the same hierarchy as the current element is analyzed. As the analysis method, for example, a language processing method is used. Using the language processing method, for example, it is determined whether there is continuity between the first character string in the current element and the first character string in the second element. For example, regarding “procedure 1...” And “procedure 2...”, It is determined that there is continuity because the first character string “procedure” is the same. The display processing unit 66 displays the context on the web page 33 corresponding to the element “<div> procedure 2 </ div>” on the browser screen 26 (step S36). If there is no element at the same level as the current element, an element that is sibling with the current element, for example, a tag of the same type (for example, <div>) is included in the hierarchy one level above the hierarchy to which the current element belongs. Search for an element. The character string described above is not limited to a character string consisting of a headword and a number, such as “Procedure 1” or “Procedure 2”, but for example, “(1)” or “(2)”. A character string composed of symbols and numbers may be used.

  In addition, when the character string included in the current element does not include a number, for example, based on a character string including characters that can express an order relationship, such as “I”, “B”, and “C”, Another element corresponding to “next” or “previous” of the current element may be searched.

For example, (1) the character string is “procedure i”, “procedure b”, or “procedure c”, and (2) the character string is “procedure (a)”, “procedure (i)”, or “procedure (u)”. Or (3) the character string is “I”, “B”, “C”. In such a case, if the character string includes at least characters that can represent the order relationship, the element can be searched using the method described above with reference to FIG.

  Here, a case where a character string is not included in the current element will be described. In this case, an element corresponding to “next” or “previous” is found by analyzing the structure of the source 34 described in the hierarchical structure, that is, the structure of elements (the order of sibling elements). Specifically, for example, a list of photos is displayed on the browser screen 26. In this case, the content of the current context may be only a photo. Therefore, for example, the current element may not include a character string such as “procedure 1” as described above, other than a description of a tag or the like necessary for the browser to display a photograph on the screen 26. . In such a case, a sibling element of the current element is searched from the source 34. From the relationship between the found sibling element and the current element on the source 34, the "next" element or the "previous" element is determined. For example, the “next” element is a sibling element of the current element, and is an element described after the description of the current element. Specifically, the “next” element may be a sibling element described immediately after the current element. The “previous” element is a sibling element of the current element, and is an element described before the description of the current element. Specifically, the “previous” element may be a sibling element described immediately before the current element.

Next, with reference to FIG. 11, an example of a change in the enlargement ratio used when the context is enlarged and displayed in the present embodiment will be described.
Here, it is assumed that the context 300 and the context 301 having different sizes are displayed on the browser screen 26. Also, it is assumed that the context 300 is enlarged and displayed on the browser screen 26 from the state where the context 300 is enlarged and displayed on the browser screen 26 in response to an instruction from the user. . Further, it is assumed that the entire web page 33 is displayed on the browser screen 26. A window 302 and a window 303 indicated by a dotted frame shown in FIG. 11 represent the browser screen 26 or the display 17 when the context 300 and the context 301 are enlarged and displayed on the browser screen 26.

  The context 300 is displayed on the browser screen 26 by the browser 20 based on elements on the source 34 corresponding to the context 300. The coordinates of the upper left corner of the area on the web page 33 occupied by the context 300 are indicated by (x1, y1). Similarly, although not shown, the size of the window 302 is determined based on the coordinates of the lower right corner of the area on the web page 33 occupied by the context 300. Based on the size of the window 302, the enlargement ratio when the context 300 is displayed in an enlarged manner is determined. The enlargement ratio when the context 301 is displayed in an enlarged manner is determined using the enlargement ratio determination method similar to the determination method of the enlargement ratio of the context 300 described above.

  Regarding detection of the current context, when a plurality of contexts are enlarged and displayed on the browser screen 26, any one of the plurality of contexts may be detected as the current context.

  As described above, according to the present embodiment, when a desired context in a page that the user is browsing is displayed on the screen, the user can perform a simple operation by analyzing elements included in the page source. A desired context can be displayed on the screen. Furthermore, by analyzing a character string included in the element, it is possible to search for an element on the source corresponding to a desired context. If a character string included in an element includes a number, the number can be used to search for an element on the source corresponding to the desired context. Furthermore, when the element does not include a character string, the element on the source corresponding to the desired context can be searched by analyzing the configuration of the element on the source. In addition, by scrolling the page, the desired context is displayed in the center of the screen, and the desired context is enlarged and displayed on the screen, so that the user can easily view it without complicated operations. In addition, a desired context can be displayed on the screen at a position on the screen that is easy for the user to see. Alternatively, by calculating the enlargement ratio of the screen so as to match the size of the desired context, the desired context can be enlarged and centered and displayed on the screen. In addition, the currently displayed context can be switched in accordance with an instruction from the user. The instruction from the user is an instruction having an order relationship, and in accordance with this instruction, an element corresponding to a desired context can be searched from the source. Furthermore, when the voice uttered by the user is recognized and the contents indicating the order relation are included in the voice, a desired context can be displayed on the screen according to the contents of the voice.

(Second Embodiment)
The second embodiment will be described below with reference to the drawings. Note that a description of the same configurations and functions as those in the first embodiment will be omitted.
In the first embodiment, when a plurality of contexts having an order relationship are displayed in order on the browser screen 26, the browser screen 26 is enlarged (zoomed) or centered, but in the second embodiment, zooming is performed. Alternatively, a plurality of contexts having an order relationship are displayed on the browser screen 26 in order by a method other than centering.

  FIG. 12 shows an example of the display of the context that should be noted by the user on the browser screen when the context that the user has noticed is changed in accordance with an instruction from the user in the second embodiment. .

  In FIG. 12, it is assumed that the user is browsing a web page related to news. This web page includes a context 400. The context 400 further includes a context 401 and a context 402. Each of the context 401 and the context 402 indicates, for example, a news headline.

  In the second embodiment, the display control program 202 highlights the current context according to an instruction by voice input for changing the context displayed on the browser screen 26.

  Specifically, this will be described with reference to FIG. First, the display control program 202 detects the current context. For example, when the user speaks a character string (page character string) displayed on the browser screen 26 by voice, the display control program 202 may detect the context including the page character string as the current context. . Alternatively, the display control program 202 may detect the context including the page character string as the current context when the user utters a word that can specify the context such as “news on the second line”, for example. The instruction for setting the current context by the user is not limited to voice, and may be performed using the remote controller or the like described in the first embodiment. FIG. 12 shows that the context 401 is detected as the current context.

  The display control program 202 highlights and displays the context 401 on the browser screen 26. Specifically, for example, as shown in FIG. 12, a frame that surrounds the outside of the context 401 may be displayed on the browser screen 26 to highlight the context 401 that is the current context. Further, this frame may be displayed in a more emphasized manner by blinking. Further, assuming that the highlighted current context is not the context desired by the user, the display control program 202 determines whether the context desired by the user is highlighted using, for example, voice. Processing for confirming with the user may be performed.

  Next, when the user speaks a word having an order relationship, the display control program 202 highlights the current context indicating the current context and the order context. For example, when the user speaks the word “next”, the context 402 that is the “next” context of the context 401 that is the current context is highlighted.

  The elements on the source 34 corresponding to each of the context 401 and the context 402 are, for example, the source 34 using the tag <li> as shown as <li> XXXX ... </ li> in FIG. It may be part of the above description.

  As described above, according to the second embodiment, when changing the context focused by the user, it is possible to switch the context highlighting only by using the voice. This eliminates the need for the user to search the page 33 for a context that the user should pay attention to “next”.

(Third embodiment)
Hereinafter, a third embodiment will be described with reference to the drawings. In addition, description is abbreviate | omitted about the structure and function similar to 1st Embodiment and 2nd Embodiment.
In the third embodiment, a current context that should be noted by the user is displayed on the browser screen 26 by a method different from the first embodiment and the second embodiment. In the third embodiment, it is assumed that a context corresponding to “next” of the current context is not displayed on the browser screen 26 before the context is changed. Alternatively, it is assumed that a context corresponding to “next” is displayed in the area occupied by the current context on the browser screen 26. It is assumed that the element corresponding to the context corresponding to “next” is on the same source as the element corresponding to the current context.

  Specifically, this will be described with reference to FIG. FIG. 13 shows an example of a browser screen 26 displaying a web page including a moving image (hereinafter also referred to as a moving image page). The moving image page includes contexts 500, 501, 503, 504, 505, and the like. The content of the context 500 includes reproduction of a moving image. That is, the moving image is played in the area occupied by the context 500 on the moving image page. The context 504 and the context 505 are thumbnail images of moving images that are candidates for moving images to be played back in the context 500.

  As shown in FIG. 13, a case where a moving image list to be played back in the context 500 is displayed “next” in the current context 500 will be described. In this case, when the user speaks “next”, the display control program 202 selects a context corresponding to “next” from the context 504, the context 505, or the like, and a moving image that is the content of the context corresponding to “next”. Are reproduced as the contents of the context 500.

  Furthermore, a case is assumed where a moving image is being played in the current context 500. In this case, when the user speaks “next”, the element corresponding to the context in which the “next” video is played is searched from the source of the video page, and the “next” element is searched according to the content of the found “next” element. The moving image is reproduced as the content of the context 500.

  Next, an example of a moving image page source will be described with reference to FIG. The moving image page is displayed on the browser screen 26 by the source 600 as shown in FIG. Specifically, for example, when the movie movie2 is reproduced as the content of the context 500, the display control program detects <li id = “movie2”>... </ Li> as the current context. Next, when the user speaks “next”, the display control program 202 searches the source 600 for the element “next” for <li id = “movie3”>. Further, the display control program 202 searches the source 600 for an element including the character string “movie2” included in the “next” element. In FIG. 14, an element including the character string “movie2” is indicated by <object id = “movie1”>... Id = “movie2”. Then, the movie movie2 is reproduced as the content of the context corresponding to the element including the character string “movie2”.

  As described above, according to the third embodiment, when a part of the context having the order relationship is not displayed on the page, or when the “next” context is displayed at a different position on the same page. Even in a context that the user cannot visually find in the case of display, etc., by searching for an element having an ordered relationship on the source, the user can simply say “next” and “next” The context can be displayed on the browser screen 26.

  Further, since all the procedures described in the flowcharts of FIGS. 8 to 10 can be executed by a program, the program is installed in a computer through a computer-readable storage medium storing the program and executed. Effects similar to those of the present embodiment can be easily realized.

Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.
The invention described in the claims immediately before the division of the original application of the present application will be appended below.
[1] An electronic device that displays on a screen a web page including a plurality of contexts corresponding to a plurality of elements in the source based on a source having a hierarchical document structure described in a markup language. ,
Next to the first element in the source corresponding to the currently selected first context in the web page based on the ordering relationship of the plurality of elements in the source based on the document structure of the source. Or processing means for searching for a second element in the source having one of the previous order relationships;
An electronic apparatus comprising: display control means for performing control to display a second context on the web page corresponding to the second element on the screen in response to a command including information about an order.
[2] The electronic device according to [1], wherein the processing means searches for the second element using characters that can express an order relationship included in the first element.
[3] The electronic device according to [1], wherein the processing means searches for the second element from another element in the same hierarchy as the first element.
[4] The electronic device according to [1], wherein the display control unit performs control to display the second context in a central portion of the screen by scrolling the web page.
[5] The display control means controls to move the second context to the center of the screen by scrolling the web page and to enlarge and display the second context [1]. The electronic device described.
[6] The display control means performs control to enlarge and display the second context using an enlargement ratio determined based on the size of the screen and the size of the second context [5] ] The electronic device of description.
[7] The instruction includes information about the next or previous order;
When the instruction includes information about the next order, the processing means searches the second element from another element including the next content of the content of the first element, and the instruction includes the second element. The electronic device according to [1], wherein when the information about the previous order is included, the second element is searched from another element including the content before the content of the first element.
[8] The electronic device according to [1], further including voice recognition means for executing voice recognition processing and issuing the command when a user voice including a predetermined word is recognized.
[9] The processing means performs a search for the second element in response to the command,
The display control means performs control to display a second context on the page corresponding to the second element on the screen in response to the search for the second element [1]. The electronic device described.
[10] The first context is a context displayed on the screen in an enlarged manner,
The electronic device according to [1], wherein the display control unit performs control to enlarge and display the second context on the screen when the first context is displayed on the screen.
[11] The processing means retrieves the second element from another element that is in the same hierarchy as the first element and includes the same tag as the tag included in the first element. Electronic equipment.
[12] When the first character string of the first element includes a number, the processing means searches for the second element from an element including the number next to the number in the first character string [1]. The electronic device described.
[13] The electronic device according to [1], wherein the processing means searches for the second element from other elements including the same character string as the first character string of the first element in the first character string.
[14] The electronic device according to [1], wherein, when an ID is included in the first element, the processing unit searches for the second element from an element including an ID next to the ID.
[15] The processing means registers in advance a source character string including a tag type and a character string with a number included in the first element, and a source expected from the registered source character string The electronic device according to [1], wherein the second element is searched from an element having a character string.
[16] A display control method for displaying on a screen a web page including a plurality of contexts corresponding to a plurality of elements in the source based on a source having a hierarchical document structure described in a markup language. And
Next to the first element in the source corresponding to the currently selected first context in the web page based on the ordering relationship of the plurality of elements in the source based on the document structure of the source. Or search for a second element in the source having one of the previous order relationships,
A display control method for performing control to display a second context on the web page corresponding to the second element on the screen in response to a command including information about an order.
[17] In the computer,
A procedure for displaying on a screen a web page including a plurality of contexts corresponding to a plurality of elements in the source based on a source having a hierarchical document structure described in a markup language;
Next to the first element in the source corresponding to the currently selected first context in the web page based on the ordering relationship of the plurality of elements in the source based on the document structure of the source. Or searching for a second element in the source having one of the previous order relationships;
A program for executing a procedure for performing control to display a second context on the web page corresponding to the second element on the screen in response to an instruction including information about an order.

  DESCRIPTION OF SYMBOLS 10 ... Computer, 21 ... Context, 20 ... Browser, 34 ... Source, 41 ... Element, 60 ... Order determination part, 64 ... Document structure analysis part, 65 ... Sound processing part, 66 ... Display processing part, 202 ... Display control program .

Claims (18)

An electronic device capable of displaying on a screen a web page including a plurality of regions for displaying a plurality of elements in a source based on a source having a hierarchical document structure described in a markup language ,
When the user's voice is input in a state where the first area of the web page corresponding to the first element of the source is displayed, the user's voice recognition result includes the next or previous When a word designating one order relation is included, one of the next order and the previous order with respect to the first element based on the order relation of the plurality of elements in the source based on the document structure of the source By searching for a second element in the source having a relationship, scrolling the web page and controlling the display magnification of the web page, a second on the web page corresponding to the second element the region, provided with processing means for performing control to display at the first magnification is determined based on the size of the size and the screen of the second region on the web page,
The processing means includes
A word that designates one of the next or previous order relations in the recognition result of the user's voice when the second area is displayed at the first magnification. Are included in the source having the next or previous order relationship with respect to the second element based on the order relationship of the plurality of elements in the source based on the document structure of the source. Find the third element, by controlling the display magnification of the web page to scroll through and the web page, from a first state to display the second region in the first magnification, the third element Control for transition to a second state in which the corresponding third area on the web page is displayed at a second magnification determined based on the size of the third area on the web page and the size of the screen. Done
The first magnification and the second magnification may be different,
When the first magnification and the second magnification are different, the processing means changes from the first state displaying the second region on the web page to the second state displaying the third region . An electronic apparatus characterized in that, when performing transition control, the display magnification is automatically changed from the first magnification to the second magnification. The processing means is configured to display the current display from another element that is in the same hierarchy as the element corresponding to the currently displayed area and includes the same tag as the tag included in the element corresponding to the currently displayed area. The electronic apparatus according to claim 1, wherein an element having one of the following or previous order relations with respect to an element corresponding to a region that is set can be searched. When the first character string of the element corresponding to the currently displayed area includes a number, the processing means changes from the element including the number next to the number in the first character string to the currently displayed area. 2. The electronic apparatus according to claim 1, wherein an element having one of the following order relations with respect to the corresponding element can be searched. The processing means, the same character string as the beginning of the string of elements corresponding to the area currently displayed from other factors, including the beginning of the string, for elements corresponding to the area where the currently displayed The electronic apparatus according to claim 1, wherein an element having one of the next or previous order relations can be searched. In the case where an ID is included in an element corresponding to the currently displayed area , the processing means performs the next or next to the element corresponding to the currently displayed area from the element including the ID next to the ID. The electronic device according to claim 1, wherein an element having one of the previous order relations can be searched. The processing means registers in advance a source character string including a tag type and a character string with a number included in an element corresponding to the currently displayed area, and is predicted from the registered source character string. 2. The electronic device according to claim 1, wherein an element having a next or previous order relationship with respect to an element corresponding to the currently displayed area can be searched from an element having a source character string. machine. Displaying on the screen a web page including a plurality of regions for displaying a plurality of elements in the source based on a source having a hierarchical document structure described in a markup language;
When the user's voice is input in a state where the first area of the web page corresponding to the first element of the source is displayed, the user's voice recognition result includes the next or previous When a word designating one order relation is included, one of the next order and the previous order with respect to the first element based on the order relation of the plurality of elements in the source based on the document structure of the source By searching for a second element in the source having a relationship, scrolling the web page and controlling the display magnification of the web page, a second on the web page corresponding to the second element and performing control to display the area, in the first magnification is determined based on the size of the second region on the web page and the size of the screen,
A word that designates one of the next or previous order relations in the recognition result of the user's voice when the second area is displayed at the first magnification. Are included in the source having the next or previous order relationship with respect to the second element based on the order relationship of the plurality of elements in the source based on the document structure of the source. Find the third element, by controlling the display magnification of the web page to scroll through and the web page, from a first state to display the second region in the first magnification, the third element Control for transition to a second state in which the corresponding third area on the web page is displayed at a second magnification determined based on the size of the third area on the web page and the size of the screen. To do and Provided,
The first magnification and the second magnification may be different,
When the first magnification and the second magnification are different, performing the transition control displays the third region from the first state displaying the second region on the web page. A method comprising automatically changing a display magnification from the first magnification to the second magnification when performing control for transition to a second state. The search for the second element or the third element is in the same hierarchy as the element corresponding to the currently displayed area, and the tag included in the element corresponding to the currently displayed area, 8. The method according to claim 7, further comprising: searching for an element having one of the next or previous order relations with respect to an element corresponding to the currently displayed area from another element including the same tag. Searching for the second element or the third element means that if the first character string of the element corresponding to the currently displayed area includes a number, the first character string is followed by the number after the number. The method according to claim 7, wherein an element having one of the next or previous order relations with respect to an element corresponding to the currently displayed area is searched from the elements to be included. The search for the second element or the third element is performed by searching for the current element from other elements including the same character string as the first character string of the element corresponding to the currently displayed area in the first character string. 8. The method according to claim 7, wherein an element having one of the next and previous order relations with respect to an element corresponding to the displayed area is searched. When the second element or the third element is searched for, if an ID is included in the element corresponding to the currently displayed area , the current display is started from the element including the ID next to the ID. The method according to claim 7, further comprising: searching for an element having one of the next or previous order relations with respect to an element corresponding to a region . The search for the second element or the third element is performed by previously registering a source character string including a tag type and a character string with a number included in the element corresponding to the currently displayed area. And searching for an element having one of the next or previous order relations with respect to an element corresponding to the currently displayed area from elements having a source string expected from the registered source string. The method according to claim 7. A program executed by a computer,
A procedure for displaying on a screen a web page including a plurality of areas for displaying a plurality of elements in the source based on a source having a hierarchical document structure described in a markup language;
When the user's voice is input in a state where the first area of the web page corresponding to the first element of the source is displayed, the user's voice recognition result includes the next or previous When a word designating one order relation is included, one of the next order and the previous order with respect to the first element based on the order relation of the plurality of elements in the source based on the document structure of the source By searching for a second element in the source having a relationship, scrolling the web page and controlling the display magnification of the web page, a second on the web page corresponding to the second element A procedure for performing control to display an area at a first magnification determined based on a size of the second area on the web page and a size of the screen;
A word that designates one of the next or previous order relations in the recognition result of the user's voice when the second area is displayed at the first magnification. Are included in the source having the next or previous order relationship with respect to the second element based on the order relationship of the plurality of elements in the source based on the document structure of the source. Find the third element, by controlling the display magnification of the web page to scroll through and the web page, from a first state to display the second region in the first magnification, the third element Control for transition to a second state in which the corresponding third area on the web page is displayed at a second magnification determined based on the size of the third area on the web page and the size of the screen. Steps to do and It is executed by the computer,
The first magnification and the second magnification may be different,
When the first magnification and the second magnification are different, the procedure for performing the transition control displays the third region from the first state displaying the second region on the web page. A program for causing a computer to execute a procedure of automatically changing a display magnification from the first magnification to the second magnification when performing control for transition to a second state. The search for the second element or the third element is in the same hierarchy as the element corresponding to the currently displayed area, and the tag included in the element corresponding to the currently displayed area, 14. The program according to claim 13, wherein an element having one of the next or previous order relations with respect to an element corresponding to the currently displayed area is searched from another element including the same tag. Searching for the second element or the third element means that searching for the second element or the third element means that the first character string of the element corresponding to the currently displayed area is When a number is included, search for an element having one of the next or previous order relations with respect to an element corresponding to the currently displayed area from elements including the next number in the first character string The program according to claim 13. The search for the second element or the third element is performed by searching for the current element from other elements including the same character string as the first character string of the element corresponding to the currently displayed area in the first character string. 14. The program according to claim 13, wherein an element having one of the next or previous order relations with respect to an element corresponding to the displayed area is searched. When the second element or the third element is searched for, if an ID is included in the element corresponding to the currently displayed area , the current display is started from the element including the ID next to the ID. 14. The program according to claim 13, wherein an element having one of the following or previous order relations with respect to an element corresponding to a region is searched. The search for the second element or the third element is performed by previously registering a source character string including a tag type and a character string with a number included in the element corresponding to the currently displayed area. And searching for an element having one of the next or previous order relations with respect to an element corresponding to the currently displayed area from elements having a source string expected from the registered source string. The program according to claim 13.

Images