JP6011019B2 - Programs and mobile devices - Google Patents

Description

  The present application relates to a program for displaying an image on a display unit and a portable terminal.

  Japanese Patent Application Laid-Open No. 2004-133867 describes a liquid crystal display based on the image orientation information attached to the image data during image reproduction and the orientation information of the telephone body so that the top and bottom of the image displayed on the liquid crystal monitor coincide with the top and bottom in the direction of gravity. A technique for controlling display on a monitor is disclosed. Thereby, the display of the liquid crystal monitor is rotated and displayed as appropriate according to the posture of the mobile phone.

  In addition, when the LCD monitor display is rotated as appropriate according to the orientation of the mobile phone, the layout of the multiple object images displayed on the LCD monitor is adjusted appropriately depending on the portrait mode or landscape mode. To be done. Portrait mode is a mode in which the user who is facing the LCD monitor's display screen can correctly view the display contents when the LCD monitor is arranged so that the short side extends in the horizontal direction and the long side extends in the vertical direction. It is. The landscape mode is a mode that allows the user who is facing the LCD monitor's display screen to correctly view the display contents when the LCD monitor is arranged so that the long side extends in the horizontal direction and the short side extends in the vertical direction. is there.

JP 2006-27017 A

  When changing the layout of the object image between the portrait mode and the landscape mode, it is necessary to prepare a layout for each of the portrait mode and the landscape mode. When the mode is changed, it is necessary to acquire object image data representing the object image and redisplay the object image based on the changed mode layout. Here, when the object image data is data on the network, it may take time to acquire the object image data due to the influence of network traffic, line speed, and the like. Then, a waiting time may occur before the object image is displayed again. In this specification, the technique which can eliminate such inconvenience is provided.

  The program described in the present specification includes a sensor information output unit that outputs sensor information indicating the attitude of a mobile terminal, a communication unit that communicates with a server that provides first image data, and acquires first image data. , A program readable by a computer of a portable terminal having a storage unit for storing the second image data and a rectangular display unit having a short side and a long side, and the sensor information output units are mutually connected The first orientation of the mobile terminal in which the long side of the display unit extends toward the first direction out of the first direction and the second direction orthogonal to each other, and the mobile terminal in which the long side of the display unit extends toward the second direction. Sensor information indicating which one of the second postures is output, and the computer displays the first image represented on the display unit by the first image data and the second image data represented on the display unit by the second image data. Display two images on the display According to the layout information which is information indicating the position, the display function is made to function as display control means for displaying at least one of the first image and the second image on the display unit, and the layout information is the first layout information corresponding to the first posture. , Second layout information corresponding to the second attitude, common layout information common to the first attitude and the second attitude, and the display control means uses the first layout information and the second layout information as the layout information to be used. In response to the change between the common layout information and the common layout information, the image data representing the image displayed on the display unit is re-acquired, and then the image is displayed again on the display unit according to the changed layout information, and the display control is performed. When the first image is not included in the image to be displayed on the display unit, the means displays the second image according to the first layout information or the second layout information. Is displayed on the display unit, and the first layout information and the second layout are determined in response to the change of the attitude of the mobile terminal indicated by the sensor information between the first attitude and the second attitude during the display period of the second image. The second image is redisplayed on the display unit according to the direction corresponding to the posture of the mobile terminal after the change in the information, and the display control unit includes the first image included in the image displayed on the display unit, The first image and the second image are displayed on the display unit according to the common layout information, and the attitude of the mobile terminal indicated by the sensor information during the display period of the first image and the second image is between the first attitude and the second attitude. According to the change, the first image and the second image are displayed again on the display unit according to the common layout information.

  The layout information may indicate the display position of the first image and the second image on the display unit by various methods. For example, the display position may be indicated by the relative position between displayed images. Moreover, the method of showing a display position by the relative position with respect to the origin of a display part may be used. The relative position with respect to the origin of the display unit is sometimes called the absolute position. When the first image is not included in the image to be displayed on the display unit, it is not necessary to acquire image data by communicating with the server. Therefore, it takes time to acquire the image data due to the influence of the speed of the communication line. This is a case where the situation does not occur. In this case, in the program described in this specification, the image data is reacquired in response to the change in the attitude of the mobile terminal, and the image is displayed on the display unit according to the layout information corresponding to the changed attitude of the mobile terminal. Redisplay. On the other hand, when the first image is included in the image to be displayed on the display unit, it may occur that it may take a long time to acquire image data due to the influence of the speed of the communication line. In this case, in the program described in this specification, the image is re-displayed on the display unit according to the common layout information without re-acquiring the image data even when the attitude of the mobile terminal changes. Thereby, it is possible to achieve both displaying an image with an appropriate layout according to the attitude of the mobile terminal and shortening the display waiting time when switching the display according to the attitude of the mobile terminal.

According to the program described in the present specification, the display mode of the first image and the second image can be changed so as to correspond to the posture of the mobile terminal after the change. As an example of the change in the display mode, there is a mode in which the width of the image is changed in accordance with the width of the display unit. Accordingly, even when the common layout is used, the first image and the second image can be displayed according to the attitude of the mobile terminal while maintaining the positional relationship between the first image and the second image.

A mobile terminal whose screen size of the display unit is smaller than a predetermined screen size has the mobile terminal between the first posture and the second posture as compared with a mobile terminal whose screen size is larger than the predetermined screen size. There is a tendency for more manipulations to be performed. According to the program described in the present specification, a mobile terminal whose display unit has a screen size smaller than a predetermined screen size can redisplay the first image and the second image on the display unit according to the common layout information. . This eliminates the need for the communication unit to re-acquire the first image data when the first image is displayed again on the display unit. Therefore, even if there are many operations for changing the attitude of the mobile terminal, it is possible to control the display waiting time that occurs each time to be shortened, so that the user-friendliness can be improved.

According to the program described in this specification, when the acquisition time necessary for acquiring the first image data from the server is shorter than a predetermined time, the display is switched according to the attitude of the mobile terminal. In this case, the first image data can be reacquired by the communication unit. As a result, the control for suppressing the display waiting time when switching the display according to the attitude of the mobile terminal, and the control for displaying an image with an appropriate layout according to the attitude of the mobile terminal, depending on the speed of the communication line, etc. Can be selected appropriately.

According to the program described in this specification, when the data size of the first image data is smaller than the predetermined data size, the first image data is changed when the display is switched according to the attitude of the mobile terminal. The communication unit can be reacquired. As a result, the control for suppressing the display waiting time when switching the display according to the attitude of the mobile terminal, and the control for displaying an image with an appropriate layout according to the attitude of the mobile terminal, depending on the speed of the communication line, etc. Can be selected appropriately.

According to the program described in this specification , the web page represented by the web page data can be displayed on the display unit.

According to the program described in this specification, the third image data can be generated based on the first image data. An example of the third image is a preview image when the first image is printed.

  The second image data may include fourth image data which is image data for displaying an object image for displaying various types of information on the display unit. Examples of object images include button images that accept input of various commands, input box images that accept input of various character strings, and the like.

According to the program described in this specification , the first layout information can also serve as the common layout information. Therefore, when the mobile terminal is in the first posture, common layout information can be used regardless of whether or not the first image is included in the image to be displayed on the display unit, thereby giving the user the same usability. It becomes possible.

According to the program described in this specification , the second layout information can also serve as the common layout information. Therefore, when the mobile terminal is in the second posture, common layout information can be used regardless of whether or not the first image is included in the image displayed on the display unit, so that the same usability is given to the user. It becomes possible.
The features of the technology described in this specification are listed below.
[Feature 1]
A sensor information output unit that outputs sensor information indicating the attitude of the mobile terminal;
A communication unit that communicates with a server that provides first image data to obtain the first image data;
A storage unit for storing second image data;
A rectangular-shaped display unit having a short side and a long side, and a computer-readable program comprising a portable terminal comprising:
The sensor information output unit includes a first posture of the mobile terminal in which a long side of the display unit extends toward a first direction out of a first direction and a second direction orthogonal to each other, and a position closer to the second direction. Sensor information indicating which posture is the second posture of the mobile terminal in which the long side of the display unit extends,
Information indicating the display position of the first image represented on the display unit by the first image data and the second image represented on the display unit by the second image data on the display unit. According to the layout information, function as display control means for displaying at least one of the first image or the second image on the display unit,
The layout information includes first layout information corresponding to the first attitude, second layout information corresponding to the second attitude, common layout information common to the first attitude and the second attitude,
The display control means is an image data representing an image displayed on the display unit in response to the layout information to be used changing among the first layout information, the second layout information, and the common layout information. And re-display the image on the display unit according to the layout information after the change,
The display control means causes the display unit to display the second image in accordance with the first layout information or the second layout information when the image to be displayed on the display unit does not include the first image. , The first layout information and the second in response to the attitude of the mobile terminal indicated by the sensor information changing between the first attitude and the second attitude during the display period of the second image. Redisplaying the second image on the display unit according to the direction corresponding to the posture of the mobile terminal after the change in the layout information;
When the first image is included in the image to be displayed on the display unit, the display control unit displays the first image and the second image on the display unit according to the common layout information, and According to the common layout information, the attitude of the mobile terminal indicated by the sensor information changes between the first attitude and the second attitude during the display period of the first image and the second image. A program for redisplaying the first image and the second image on the display unit.
[Feature 2]
The display control means uses the acquired first image data and second image data when redisplaying the first image and the second image on the display unit according to the common layout information. The display mode of the first image and the second image is changed so as to correspond to the posture of the mobile terminal after the change while maintaining the relative positions of the first image and the second image. The program according to Feature 1.
[Feature 3]
In the case where the first image is included in an image to be displayed on the display unit,
When the screen size of the display unit is smaller than a predetermined screen size, the display unit displays the first image and the second image again according to the common layout information,
When the screen size of the display unit is larger than the predetermined screen size, redisplaying the first image and the second image on the display unit according to the first layout information or the second layout information. The program according to Feature 1 or 2, which is characterized.
[Feature 4]
Measuring an acquisition time required for acquiring the first image data from the server when the communication unit acquires the first image data based on server specifying information that is information specifying the server; 1 further causing the computer to function as a measuring means;
In the case where the first image is included in the image to be displayed on the display unit and the acquisition time is smaller than a predetermined time, the display control unit is configured to display the portable information indicated by the sensor information. In response to a change in the attitude of the terminal between the first attitude and the second attitude, the communication unit re-acquires the first image data based on the server identification information, and the first layout Any one of the features 1 to 3, wherein the first image and the second image are re-displayed on the display unit according to a direction corresponding to the changed attitude of the portable terminal among the information and the second layout information. The program according to item 1.
[Feature 5]
As second measuring means for measuring the data size of the first image data acquired from the server when the communication unit acquires the first image data based on server specifying information that is information specifying the server. Further functioning the computer;
When the first image is included in an image to be displayed on the display unit and the data size of the first image data is smaller than a predetermined data size, the display control means In response to the attitude of the mobile terminal indicated by the information changing between the first attitude and the second attitude, the communication unit re-acquires the first image data based on the server specifying information. The first image and the second image are re-displayed on the display unit according to a direction corresponding to the changed attitude of the mobile terminal among the first layout information and the second layout information. The program according to any one of 1 to 3.
[Feature 6]
The program according to any one of features 1 to 5, wherein the first image data includes web page data.
[Feature 7]
The second image data includes third image data that is image data generated based on the first image data,
The program according to any one of features 1 to 6, wherein the display control unit does not simultaneously display the third image represented by the third image data and the first image on the display unit. .
[Feature 8]
The said 2nd image data contains the 4th image data which is the image data which displays the object image which displays various information on the said display part, The characteristic any one of the characteristics 1-7 characterized by the above-mentioned. Program.
[Feature 9]
The program according to any one of features 1 to 8, wherein the common layout information is the same information as the first layout information.
[Feature 10]
The program according to any one of features 1 to 8, wherein the common layout information is the same information as the second layout information.
[Feature 11]
A sensor information output unit that outputs sensor information indicating the attitude of the mobile terminal;
A communication unit that communicates with a server that provides first image data to obtain the first image data;
A storage unit for storing second image data;
A rectangular-shaped display unit having a short side and a long side, and a computer-readable program comprising a portable terminal comprising:
The sensor information output unit includes a first posture of the mobile terminal in which a long side of the display unit extends toward a first direction out of a first direction and a second direction orthogonal to each other, and a position closer to the second direction. Sensor information indicating which posture is the second posture of the mobile terminal in which the long side of the display unit extends,
The computer,
According to layout information which is information indicating a display position on the display unit of the first image represented on the display unit by the first image data and the second image represented by the second image data on the display unit, Display control means for displaying the first image and the second image on the display unit;
Measurement for measuring an acquisition time required for acquiring the first image data from the server when the communication unit acquires the first image data based on server specifying information that is information for specifying the server Function as a means,
The layout information includes first layout information corresponding to the first attitude and second layout information corresponding to the second attitude;
The display control means causes the display unit to display the first image and the second image according to the first layout information or the second layout information,
The display control means measures the measurement when the posture of the mobile terminal indicated by the sensor information changes between the first posture and the second posture during the display period of the first image and the second image. When the acquisition time measured by the means is smaller than a predetermined time, the attitude of the mobile terminal indicated by the sensor information changes between the first attitude and the second attitude. Accordingly, the first image data is re-acquired by the communication unit based on the server specifying information, and one of the first layout information and the second layout information corresponding to the changed attitude of the mobile terminal According to the program, the first image and the second image are displayed again on the display unit.
[Feature 12]
A sensor information output unit that outputs sensor information indicating the attitude of the mobile terminal;
A communication unit that communicates with a server that provides first image data to obtain the first image data;
A storage unit for storing second image data;
A rectangular display with short sides and long sides;
According to layout information which is information indicating a display position on the display unit of the first image represented on the display unit by the first image data and the second image represented by the second image data on the display unit, Display control means for displaying at least one of the first image or the second image on the display unit;
With
The sensor information output unit includes a first posture of the mobile terminal in which a long side of the display unit extends toward a first direction out of a first direction and a second direction orthogonal to each other, and a position closer to the second direction. Sensor information indicating which posture is the second posture of the mobile terminal in which the long side of the display unit extends,
The layout information includes first layout information corresponding to the first attitude, second layout information corresponding to the second attitude, common layout information common to the first attitude and the second attitude,
The display control means is an image data representing an image displayed on the display unit in response to the layout information to be used changing among the first layout information, the second layout information, and the common layout information. And re-display the image on the display unit according to the layout information after the change,
The display control means causes the display unit to display the second image in accordance with the first layout information or the second layout information when the image to be displayed on the display unit does not include the first image. , The first layout information and the second in response to the attitude of the mobile terminal indicated by the sensor information changing between the first attitude and the second attitude during the display period of the second image. Redisplaying the second image on the display unit according to the direction corresponding to the posture of the mobile terminal after the change in the layout information,
When the first image is included in the image to be displayed on the display unit, the display control unit displays the first image and the second image on the display unit according to the common layout information, and According to the common layout information, the attitude of the mobile terminal indicated by the sensor information changes between the first attitude and the second attitude during the display period of the first image and the second image. A portable terminal, wherein the first image and the second image are displayed again on the display unit.
[Feature 13]
A sensor information output unit that outputs sensor information indicating the attitude of the mobile terminal;
A communication unit that communicates with a server that provides first image data to obtain the first image data;
A storage unit for storing second image data;
A rectangular display with short sides and long sides;
According to layout information which is information indicating a display position on the display unit of the first image represented on the display unit by the first image data and the second image represented by the second image data on the display unit, Display control means for displaying the first image and the second image on the display unit;
Measurement for measuring an acquisition time required for acquiring the first image data from the server when the communication unit acquires the first image data based on server specifying information that is information for specifying the server Means,
With
The sensor information output unit includes a first posture of the mobile terminal in which a long side of the display unit extends toward a first direction out of a first direction and a second direction orthogonal to each other, and a position closer to the second direction. Sensor information indicating which posture is the second posture of the mobile terminal in which the long side of the display unit extends,
The layout information includes first layout information corresponding to the first attitude and second layout information corresponding to the second attitude;
The display control means causes the display unit to display the first image and the second image according to the first layout information or the second layout information,
The display control means measures the measurement when the posture of the mobile terminal indicated by the sensor information changes between the first posture and the second posture during the display period of the first image and the second image. When the acquisition time measured by the means is smaller than a predetermined time, the attitude of the mobile terminal indicated by the sensor information changes between the first attitude and the second attitude. Accordingly, the first image data is re-acquired by the communication unit based on the server specifying information, and one of the first layout information and the second layout information corresponding to the changed attitude of the mobile terminal According to the above, the first image and the second image are redisplayed on the display unit.

1 is a block diagram of a communication system 1. FIG. It is a figure which shows the operation | movement flowchart of a portable terminal. It is a figure which shows the operation | movement flowchart of a portable terminal. It is a figure which shows the operation | movement flowchart of a portable terminal. It is a figure which shows the operation | movement flowchart of a portable terminal. It is a figure which shows an example of a display screen. It is a figure which shows an example of a display screen. It is a figure which shows an example of a display screen. It is a figure which shows an example of a display screen. 1 is a schematic overview of a mobile terminal. 1 is a schematic overview of a mobile terminal. It is a figure which shows the operation | movement flowchart which concerns on a modification.

  FIG. 1 shows a block diagram of a communication system 1 exemplified as an embodiment according to the present application. The communication system 1 includes a mobile terminal 10, an MFP (abbreviation of Multifunction Peripheral) 51, a first access point 62, a web server 71, and a base station 61. The portable terminal 10 and the MFP 51 have a function as a known wireless LAN terminal device. The MFP 51 is a multifunction peripheral device having a printer function, a scanner function, a copy function, a facsimile function, and the like. The first access point 62 has a function as a known wireless LAN access point. The web server 71 is a device that provides its own functions and data to client devices in the network.

  Note that the mobile terminal 10 and the first access point 62 are capable of performing wireless communication 211 that conforms to the wireless LAN infrastructure mode. Here, the infrastructure mode is a mode in which a plurality of wireless LAN terminal devices perform data communication via an access point. That is, when the mobile terminal 10 accesses the first access point 62 and can perform the wireless communication 211 conforming to the infrastructure mode of the wireless LAN, the mobile terminal 10 can perform data communication with the MFP 51 via the first access point 62. Is possible. An example of the wireless LAN system is a communication system defined by the IEEE 802.11a / b / g / n standard, for example.

  A configuration of the mobile terminal 10 will be described. As shown in FIG. 1, the mobile terminal 10 includes a CPU (abbreviation of central processing unit) 11, a storage unit 12, a wireless transmission / reception unit 15, a wireless antenna unit 16, a button input unit 17, a panel 18, a transmission / reception unit 22, and an antenna unit. 23, an acceleration sensor 26, a camera unit 27, and a tilt sensor (also referred to as a gyroscope) 29. In addition, a speaker 3 and a microphone 4 are provided to perform a call and voice input.

  The button input unit 17 receives an operation by the user of the mobile terminal 10. The button input unit 17 is configured integrally with the panel 18 as a touch panel. The panel 18 displays various function information of the mobile terminal 10. As shown in the schematic overview of the mobile terminal 10 in FIG. 10, the panel 18 has a rectangular shape having a short side and a long side. As shown in FIG. 10, the mobile terminal 10 is a model for both vertical and horizontal directions in which the user can correctly operate the mobile terminal 10 in any of the portrait posture and the landscape posture. The portrait orientation of the mobile terminal 10 is an orientation in which the long side of the panel 18 extends toward the first direction of the first direction and the second direction orthogonal to each other, as shown in FIG. The landscape posture of the mobile terminal 10 is a posture in which the long side of the panel 18 extends toward the second direction of the first direction and the second direction, as shown in FIG. For example, when the posture of the mobile terminal 10 is a posture perpendicular to the horizontal plane, the first direction is the vertical direction and the second direction is the horizontal direction. For example, when the mobile terminal 10 is held by a user, the first direction is a direction away from the user, and the second direction is a direction parallel to the front of the user.

  The acceleration sensor 26 is a sensor that measures the acceleration of the mobile terminal 10 by detecting a change in the position of the weight. The camera unit 27 is a part that captures a predetermined range with a CCD or the like and acquires image data. The tilt sensor 29 is a sensor that measures the tilt angle at which the mobile terminal 10 is tilted with respect to the horizontal plane by detecting the angular velocity. The tilt sensor 29 outputs sensor information indicating whether the posture of the mobile terminal 10 is a portrait posture or a landscape posture.

  The CPU 11 executes processing according to the program 21 in the storage unit 12. Hereinafter, the CPU 11 that executes a program, such as the print application 21a or the operating system 21e, may be simply described as a program name. For example, the description “print application 21a” may mean “the CPU 11 executing the print application 21a”. The storage unit 12 is configured by combining a RAM (abbreviation of random access memory), a ROM (abbreviation of read only memory), a flash memory, an HDD (abbreviation of hard disk), a buffer provided in the CPU 11, and the like.

  The wireless transmission / reception unit 15 performs wireless communication 211 conforming to the infrastructure mode of the wireless LAN via the wireless antenna unit 16. In addition, the transmission / reception unit 22 performs wireless communication 210 conforming to the mobile phone communication scheme with the base station 61 via the antenna unit 23. And the digital signal which comprises various data is transmitted / received by the wireless transmission / reception part 15, the transmission / reception part 22, etc. FIG.

  The storage unit 12 stores a program 21. The program 21 includes a print application 21a and an operating system 21e. The print application 21 a is an application for causing the CPU 11 to execute print processing from the mobile terminal 10 to the MFP 51. The CPU 11 obtains web page data from the web server 71, stores the web page data in the storage unit 12, and displays the web page data in the storage unit 12 by executing processing according to the print application 21a. The web page image to be displayed can be displayed on the panel 18.

  The print application 21 a includes normal screen portrait layout information 31, large screen portrait layout information 32, normal screen landscape layout information 33, large screen landscape layout information 34, and common layout information 35. The layout information is information indicating the display position on the panel 18 of various images such as a web page image, a print preview image, and an object image. These layout information may be XML (abbreviation of Extensible Markup Language) files. There are various methods for indicating the display positions of various images. For example, the display position may be indicated by defining the relative position between displayed images. Further, for each displayed image, a method of indicating the display position by defining a relative position with respect to the display origin of the panel 18 (for example, the upper left corner of the panel 18) may be used.

  The normal screen portrait layout information 31 is information indicating the display positions of various images when various images are displayed on the normal size panel 18 in the portrait posture. An example of the mobile terminal 10 having the normal size panel 18 is a smartphone. The large-screen portrait layout information 32 is information indicating the display positions of various images when various images are displayed on the large-screen panel 18 in the portrait posture. As an example of the portable terminal 10 having the large screen size panel 18, a tablet type terminal can be cited. The tablet terminal is a portable personal computer having a flat outer shape and having a touch panel type display / input unit. The portrait layout information 31 for the normal screen and the portrait layout information 32 for the large screen are information in which various images are arranged so as to be optimized for the portrait posture panel 18.

  The normal-screen landscape layout information 33 is information indicating display positions of various images when various images are displayed on the normal-size panel 18 in the landscape posture. The large-screen landscape layout information 34 is information indicating the display positions of various images when various images are displayed on the large-screen size panel 18 in a landscape orientation. The normal-screen landscape layout information 33 and the large-screen landscape layout information 34 are information in which various images are arranged so as to be optimized for the landscape posture panel 18.

  The common layout information 35 is information indicating the display positions of various images that are common to both the portrait posture panel 18 and the landscape posture panel 18.

  Such layout information is loaded by the CPU 11. When a display screen is displayed for the first time using certain layout information, it is necessary to acquire image data representing an image to be displayed. However, once acquired image data is cached in the storage unit 12, the display screen can be displayed using the cached image data while the layout information to be used is not changed. Therefore, even when it is necessary to redisplay the display screen by screen switching or the like, there is no need to reacquire image data. On the other hand, when the layout information to be used is changed, it is necessary to re-acquire image data representing an image to be displayed when the display screen is displayed for the first time using the changed layout information.

  The operating system 21e is a program that provides basic functions that are commonly used by the print application 21a and the like. The operating system 21e includes a program for displaying various images on the panel 18, a program for causing the transmission / reception unit 22 to perform communication, a program for causing the wireless transmission / reception unit 15 to execute wireless communication 211, and the like. The operating system 21e provides an API (abbreviation of application programming interface) for each program to acquire information calculated by the acceleration sensor 26, the tilt sensor 29, etc., or for each program to instruct various hardware. It is also a program to provide.

  The storage unit 12 stores object image data. The object image data is image data for displaying an object image for displaying various types of information on the display unit. Examples of object images include button images that accept input of various commands, input box images that accept input of various character strings, and the like. The storage unit 12 temporarily stores various data such as web page data and print preview data. Web page data is data for displaying a web page image. The web page data is acquired from the web server 71 via the wireless communication 210. The print preview data is data for displaying a print preview image. The print preview image is an image representing a print image when a web page image is printed. Normally, the print preview image and the web page image are not displayed on the panel 18 at the same time.

  The storage unit 12 stores a cache execution flag. The cache execution flag is information for setting whether or not to execute cache processing. The cache process is a process of temporarily storing the web page data downloaded from the web server 71 in the storage unit 12 and reading the web page data from the storage unit 12 when displaying the web page image again. The cache execution flag may be set in advance by the user.

  The operation of the communication system 1 according to the present embodiment will be described using the flowcharts of FIGS. When the user inputs an operation for starting the print application 21a via the button input unit 17, the CPU 11 starts the print application 21a. Thereby, the flow of FIG. 2 is started.

  In S111, the CPU 11 determines whether or not a web page image display instruction has been input. The display instruction may be an instruction for displaying a web page image to be printed. The display instruction may be input by inputting a URL (for example, http://www.xxx.com) for accessing the web page data. If no web page image display instruction is input (S111: NO), the process returns to S111. If a display instruction is input (S111: YES), the process proceeds to S113.

  In S113, the CPU 11 determines whether or not the screen size of the panel 18 of the mobile terminal 10 is a large screen size. Specifically, the screen size of the panel 18 is acquired by inquiring of the operating system 21e, and compared with a predetermined screen size determined in advance. When it is determined that the screen size of the panel 18 is not larger than the predetermined screen size (S113: NO), it is determined that it is a normal size, and the process proceeds to S115.

  In S115, the CPU 11 loads the common layout information 35. Specifically, the XML file path of the common layout information 35 is passed to the operating system 21e using the API. The operating system 21e determines the display position of various images based on the display origin in accordance with the read common layout information 35. The display origin may be, for example, the upper left corner of the panel 18. Then, the process proceeds to S131.

  On the other hand, when it is determined in S113 that the screen size of the panel 18 is a large screen size (S113: YES), the process proceeds to S117. In S117, the CPU 11 determines whether or not the mobile terminal 10 is in the portrait posture. Specifically, the CPU 11 acquires sensor information from the tilt sensor 29 using the API, and calculates the attitude of the mobile terminal 10 using the acquired sensor information. When the portable terminal 10 is in the portrait posture (S117: YES), the process proceeds to S119. In S <b> 119, the CPU 11 loads the large-screen portrait layout information 32. Since the contents of the load process are the same as the contents described in S115, the description is omitted. Then, the process proceeds to S131.

  On the other hand, when it is determined in S117 that the mobile terminal 10 is not in the portrait posture (S117: NO), the process proceeds to S121. In S121, the CPU 11 loads the large-screen landscape layout information 34. Since the contents of the load process are the same as the contents described in S115, the description is omitted. Then, the process proceeds to S131.

  In S131, the CPU 11 starts a data acquisition timer. The data acquisition timer is a timer for measuring an acquisition time necessary for acquiring the web page data when acquiring the web page data from the web server 71 based on the URL. In S <b> 133, the CPU 11 causes the transmission / reception unit 22 to download the web page data specified by the URL specified by the user via the wireless communication 210.

  In S <b> 134, the CPU 11 determines whether or not the cache execution flag stored in the storage unit 12 is “ON”. When it is not “ON” (S134: NO), the process proceeds to S137, and when it is “ON” (S134: YES), the process proceeds to S135. In S135, the CPU 11 temporarily stores the downloaded web page data in the storage unit 12. In S137, the CPU 11 stops the data acquisition timer. Then, the measured acquisition time is stored in the storage unit 12.

  In S139, the CPU 11 displays a display screen including various images on the panel 18 based on the loaded layout information. 6 and 7 show an example of a display screen displayed according to the common layout information 35 when the common layout information 35 is loaded. FIG. 6 is an example when the mobile terminal 10 is in a portrait posture. On the panel 18, object images B1a to B5a and a web page image P1a are displayed. FIG. 7 is an example when the mobile terminal 10 is in a landscape posture. On the panel 18, object images B1b to B5b and a web page image P1b are displayed. The object images B1a and B1b are input box images that accept an input of a URL character string. The object images B2a to B4a and B2b to B4b are button images that accept input of various commands. The object images B5a and B5b are images that display various types of information related to printing, and are images that are displayed so as to overlap the web page images P1a and P1b. Web page images P1a and P1b are images represented by web page data.

  FIG. 8 shows an example of a display screen displayed according to the large-screen portrait layout information 32 when the large-screen portrait layout information 32 is loaded. On the panel 18, object images B1c to B5c and a web page image P1c are displayed. The object image B5c is an image that displays various types of information related to printing, and is an image that is displayed so as to overlap the web page image P1c. In the display screen example of FIG. 8, the object images B1c to B4c are arranged on the upper side or the lower side of the panel 18 so that the web page image P1c can be displayed in the full width of the panel 18. That is, the large-screen portrait layout information 32 is optimized for the portrait posture panel 18 in which the object images B1c to B4c can be arranged so that the web page image P1c can be widely displayed on the portrait posture panel 18. Layout information.

  FIG. 9 shows an example of a display screen displayed according to the large-screen landscape layout information 34 when the large-screen landscape layout information 34 is loaded. On the panel 18, object images B1d to B5d and a web page image P1d are displayed. The object image B5d is an image that displays various types of information related to printing, and is an image that is displayed so as to overlap the web page image P1d. In the display screen example of FIG. 9, the object images B <b> 1 d to B <b> 5 d are arranged on the right side of the panel 18 so that the web page image P <b> 1 d can be displayed in the full vertical width of the panel 18. That is, the landscape layout information 34 for the large screen is a layout optimized for the landscape posture panel 18 in which the object images B1d to B4d can be arranged so that the web page image P1d can be widely displayed on the landscape posture panel 18. Information.

  The object images B5c and B5d shown in FIGS. 8 and 9 are larger in size than the object images B5a and B5b shown in FIGS. This is because the portrait posture and the landscape posture are better when the layout optimized for the portrait posture (eg: FIG. 8) and when the layout optimized for the landscape posture (eg: FIG. 9) are used. This is because the web page image can be displayed more widely than when a common layout is used (for example, FIGS. 6 and 7). Thereby, since the size of the object image displayed so as to overlap the web page image can be increased, it is possible to display more various information regarding printing.

  In S141, the CPU 11 determines whether or not a command input for print preview display is accepted. Specifically, it is determined whether or not the user selects a print preview button. If no print preview display command is input (S141: NO), the process proceeds to S142 (FIG. 3). The case where the print preview display command is not input is a case where the web page data needs to be reacquired from the web server 71 when the display screen is displayed again.

  In S <b> 142, the CPU 11 determines whether a web page image print instruction has been input. The print instruction is input, for example, when the user touches a print execution button displayed on the panel 18. If a print instruction has been input (S142: YES), the process proceeds to S143. In S143, the CPU 11 creates print data based on the print settings. As an example of processing for generating print data, there are processing for changing the resolution and processing for adding a page description language such as postscript as header information. Further, the CPU 11 transmits the generated print data to the MFP 51 via the wireless communication 211. The MFP 51 prints the print data received from the mobile terminal 10 on a print sheet. Then, the flow ends.

  On the other hand, if no print instruction is input in S142 (S142: NO), the process proceeds to S144. In S144, the CPU 11 determines whether or not the posture of the mobile terminal 10 has changed between the portrait posture and the landscape posture. Specifically, it is determined whether or not an event indicating that the attitude of the mobile terminal 10 has changed has been issued from the operating system 21e. If the posture has not changed (S144: NO), the process returns to S144, and if it has changed (S144: YES), the process proceeds to S145.

  In S145, the CPU 11 determines whether the screen size of the panel 18 is a large screen size. Since the specific determination content is the same as the content of S113, description is abbreviate | omitted. When it is determined that the screen size of the panel 18 is the normal size (S145: NO), the process proceeds to S147.

  In S147, the CPU 11 uses the common layout information 35 to rotate and display the display screen so as to correspond to the posture of the mobile terminal 10 after the change. Specifically, an instruction to execute rotation display is output to the operating system 21e via the API. The operating system 21e switches the display origin so as to correspond to the posture of the mobile terminal 10 after the change. Then, the operating system 21e determines the display positions of various images based on the display origin according to the common layout information 35. Then, the process returns to S139 (FIG. 2), and the display screen is displayed again on the panel 18. At this time, the layout information used is the same as the common layout information 35 before and after the attitude of the mobile terminal 10 changes. Therefore, since the layout information has not changed, it is not necessary to reacquire image data representing various images when redisplaying various images. Therefore, almost no waiting time for redisplaying the display screen can be generated.

  As an example, a display screen switching mode when the posture of the mobile terminal 10 is changed from a portrait posture to a landscape posture will be described. In this case, the display screen in FIG. 6 is switched to the display screen in FIG. The display screen is switched between the object images B1a to B4a and the web page image P1a in FIG. 6 and the object images B1b to B4b and the web page image P1b in FIG. 7 so that the relative positions of the images are maintained. Yes. In addition, the horizontal width of the object image B1b is displayed so as to be adapted to the horizontal width of the panel 18 in the landscape posture. Thereby, even when using the common layout information 35, it turns out that various images can be appropriately displayed according to the attitude | position of the portable terminal 10. FIG. When the posture of the mobile terminal 10 is changed from the landscape posture to the portrait posture, the display screen in FIG. 7 is switched to the display screen in FIG.

  On the other hand, when it is determined in S145 that the screen size of the panel 18 is a large screen size (S145: YES), the process proceeds to S167. In S167, the CPU 11 determines whether or not the posture of the mobile terminal 10 after the change is a portrait posture. Since the specific determination content is the same as the content of S117, description is abbreviate | omitted. When the changed posture is the portrait posture (S167: YES), it is determined that the posture of the mobile terminal 10 has changed from the landscape posture to the portrait posture, and the process proceeds to S169. In S <b> 169, the CPU 11 loads the large-screen portrait layout information 32. In this case, since the layout information to be used has changed, it is necessary to reacquire the web page data. Therefore, it progresses to S173 and re-acquisition of web page data is performed.

  On the other hand, in S167, when the changed posture of the mobile terminal 10 is not the portrait posture (S167: NO), it is determined that the posture of the mobile terminal 10 is changed from the portrait posture to the landscape posture. Proceed to S171. In S <b> 171, the CPU 11 loads the large-screen landscape layout information 34. In this case, since the layout information to be used has changed, it is necessary to reacquire the web page data. Therefore, it progresses to S173 and re-acquisition of web page data is performed.

  In S <b> 173, the CPU 11 determines whether web page data is stored in the storage unit 12. If it is stored (S173: YES), the process proceeds to S175. In S <b> 175, the CPU 11 reads the web page data stored in the storage unit 12. Then, the process returns to S139 (FIG. 2), and the display screen is displayed again on the panel 18.

  On the other hand, if the web page data is not stored in the storage unit 12 in S173 (S173: NO), the process returns to S131 (FIG. 2), and the process of downloading the web page data from the web server 71 again is executed. An example of the case where the web page data is not stored in the storage unit 12 is a case where the cache execution flag is “off”. In step S139, the display screen is displayed again on the panel 18.

  As an example, a display screen switching mode when the posture of the mobile terminal 10 is changed from a portrait posture to a landscape posture will be described. In this case, the display screen in FIG. 8 is switched to the display screen in FIG. Thereby, the arrangement position of the object image is changed from the upper side and the lower side of the panel 18 shown in FIG. 8 to the right side of the panel 18 shown in FIG. Therefore, it can be seen that the object images B1d to B4d can be rearranged so that the web page image P1d is widely displayed on the landscape orientation panel 18. When the posture of the mobile terminal 10 is changed from the landscape posture to the portrait posture, the display screen in FIG. 9 is switched to the display screen in FIG.

  If a print preview display command is input in S141 (FIG. 2) (S141: YES), the process proceeds to S213 (FIG. 4).

  In S213, the CPU 11 determines whether the screen size of the panel 18 is a large screen size. Since the specific determination content is the same as the content of S113, description is abbreviate | omitted. When it is determined that the screen size of the panel 18 is the normal size (S213: NO), the process proceeds to S227.

  In S227, the CPU 11 determines whether or not the mobile terminal 10 is in the portrait posture. If it is a portrait posture (S227: YES), the process proceeds to S229. In S229, the CPU 11 loads the normal screen portrait layout information 31. Then, the process proceeds to S233. On the other hand, in S227, when the mobile terminal 10 is not in the portrait posture (S227: NO), the process proceeds to S231. In S231, the CPU 11 loads the normal screen landscape layout information 33. Then, the process proceeds to S233.

  On the other hand, if it is determined in S213 that the screen size of the panel 18 is a large screen size (S213: YES), the process proceeds to S217. In S217, the CPU 11 determines whether or not the mobile terminal 10 is in the portrait posture. If it is the portrait posture (S217: YES), the process proceeds to S219, and the CPU 11 loads the large-screen portrait layout information 32. Then, the process proceeds to S233. On the other hand, if the portable terminal 10 is not in the portrait orientation in S217 (S217: NO), the process proceeds to S221, and the CPU 11 loads the large-screen landscape layout information 34. Then, the process proceeds to S233.

  In S233, the CPU 11 generates print preview data from the web page data. In S <b> 235, the CPU 11 temporarily stores the generated print preview data in the storage unit 12. This process is also called a cache.

  In S241, the CPU 11 causes the panel 18 to display a display screen including a print preview image based on the loaded layout information. Then, the process proceeds to S242 (FIG. 5).

  In S242, the CPU 11 determines whether or not a print instruction has been input. If a print instruction has been input (S242: YES), the process proceeds to S243. In step S <b> 243, the CPU 11 creates print data based on the print settings, and transmits the print data to the MFP 51 via the wireless communication 211. Then, the flow ends.

  On the other hand, if no print instruction is input in S242 (S242: NO), the process proceeds to S244. In S244, the CPU 11 determines whether or not the posture of the mobile terminal 10 has changed between the portrait posture and the landscape posture. If the posture has not changed (S244: NO), the process returns to S244, and if it has changed (S244: YES), the process proceeds to S245.

  In S245, the CPU 11 determines whether the screen size of the panel 18 is a large screen size. When it is determined that the screen size of the panel 18 is the normal size (S245: NO), the process proceeds to S247. In S247, when it is determined that the changed posture of the mobile terminal 10 is the portrait posture (S247: YES), the process proceeds to S249, and the CPU 11 loads the normal screen portrait layout information. Then, the process proceeds to S253. On the other hand, if it is determined in S247 that the changed posture is not the portrait posture (S247: NO), the process proceeds to S251, and the CPU 11 loads the landscape layout information 33 for normal screen. Then, the process proceeds to S253. In S <b> 253, the CPU 11 reads the print preview data stored in the storage unit 12. Then, the process returns to S241 (FIG. 4), and the display screen including the print preview image is displayed again on the panel 18.

  On the other hand, when it is determined in S245 that the screen size of the panel 18 is a large screen size (S245: YES), the process proceeds to S267. In S267, when it is determined that the attitude of the mobile terminal 10 after the change is the portrait attitude (S267: YES), the process proceeds to S269, and the CPU 11 loads the large-screen portrait layout information 32. Then, the process proceeds to S273. On the other hand, if it is determined in S267 that the changed posture is not the portrait posture (S267: NO), the process proceeds to S271, and the CPU 11 loads the landscape layout information 34 for the large screen. Then, the process proceeds to S273. In S <b> 273, the CPU 11 reads the print preview data stored in the storage unit 12. Then, the process returns to S241 (FIG. 4), and the display screen including the print preview image is displayed again on the panel 18.

(effect)
When the web page image is not included in the image displayed on the panel 18, it is not necessary to communicate with the web server 71 to acquire web page data. Therefore, the web page is affected by the speed of the communication line of the wireless communication 210. This is a case where it takes no time to acquire data. The case where the web page image is not included in the image displayed on the panel 18 is a case where the print preview is displayed after S141: YES. In this case, various image data are re-acquired according to the change in the attitude of the mobile terminal 10 (S244: YES, S253, S273), and the image is displayed in accordance with the layout information corresponding to the changed attitude of the mobile terminal 10. 18 is displayed again (S241). On the other hand, when a web page image is included in the image displayed on the panel 18, it may take a long time to acquire web page data due to the influence of the speed of the communication line of the wireless communication 210. is there. The case where the web page image is included in the image displayed on the panel 18 may be a case where the web page image is displayed from S111 to S139. Moreover, the case where the web page image is included in the image displayed on the panel 18 may be a case where the web page image is displayed after S141: NO. In this case, even when the attitude of the mobile terminal 10 changes, the image is redisplayed on the panel 18 according to the common layout information 35 without acquiring various image data again (S147, S139). As a result, it is possible to achieve both displaying an image with an appropriate layout according to the attitude of the mobile terminal 10 and shortening the display waiting time when switching the display according to the attitude of the mobile terminal 10. Become.

  When the screen size of the panel 18 is a normal size, since the amount of information that can be displayed on the screen is smaller than when the screen size is a large screen size, the posture of the mobile terminal 10 is set between the portrait posture and the landscape posture. There is a tendency for more manipulations to be performed. According to the print application 21a disclosed in the present specification, when the screen size of the panel 18 is the normal size (S145: NO), when the display screen is redisplayed in accordance with the change in the attitude of the mobile terminal 10 And can be displayed again according to the common layout information 35. Thereby, since the layout information used before and after the attitude of the mobile terminal 10 changes does not change, it is not necessary to cause the transmission / reception unit 22 to re-acquire web page data when the display screen is redisplayed on the panel 18. Can do. On the other hand, when the screen size of the panel 18 is a large screen size (S145: YES), when the display screen is redisplayed in accordance with the posture change of the mobile terminal 10, the layout information according to the changed posture ( It can be displayed again using S169, S171). As described above, even if there are many operations for changing the posture of the mobile terminal 10, it is possible to perform control so as to reduce the display waiting time that occurs each time, so that it is possible to improve user convenience.

  Specific examples of the present invention have been described in detail above, but these are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications and changes of the specific examples illustrated above. The modifications of the above embodiment are listed below.

  It may be an aspect in which it is determined whether or not to change the layout information to be used according to the situation when the web page data is acquired when the attitude of the mobile terminal 10 changes. FIG. 12 shows a flow according to the modification. When it is determined that the screen size of the panel 18 is the normal size (S145: NO), the flow of FIG. 12 is started. In S346, the CPU 11 determines whether or not the acquisition time measured in S137 is shorter than a predetermined time. The predetermined time may be set to 3 seconds, for example.

  If the acquisition time is not shorter than the predetermined time (S346: NO), the process returns to S147 (FIG. 3). As a result, the process of loading new layout information and the process of reacquiring web page data are not performed. On the other hand, when the acquisition time is shorter than the predetermined time (S346: YES), it is determined that the display waiting time does not become a long time, and the process proceeds to S347. In steps after S347, the normal screen portrait layout information 31 or the normal screen landscape layout information 33 is loaded, the web page data is reacquired, and the display screen is rotated and displayed on the panel 18. Note that the processing contents of S347 to S355 are the same as the processing contents of S167 to S175 described above, and thus the description thereof is omitted here. Thereby, when the display waiting time does not become long, the image is displayed with an appropriate layout according to the posture of the mobile terminal 10, while when the display waiting time becomes long, the web page data is not reacquired. As described above, the display mode can be controlled in accordance with the speed of the communication line.

  In S346, when the data size of the web page data is smaller than a predetermined data size, it may be determined that the display waiting time does not become a long time, and the process may proceed to S347. In this case, in S135 (FIG. 2), the downloaded web page data may be stored in the storage unit 12, and the data size of the downloaded web page data may be stored in the storage unit 12. The predetermined data size may be set to 1 MB, for example. Thereby, when the display waiting time does not become long, the display mode can be controlled so that the image is displayed with an appropriate layout according to the posture of the mobile terminal 10.

  Further, the determination of the screen size of the panel 18 in S113 may be omitted. In this case, in S119, either the large-screen portrait layout information 32 or the normal-screen portrait layout information 31 may be loaded. In S121, either the large-screen landscape layout information 34 or the normal-screen landscape layout information 33 may be loaded. And when the attitude | position of the portable terminal 10 changes (S144: YES), you may progress to S346 and may determine whether the acquisition time measured by S137 is smaller than the predetermined time defined beforehand. If the acquisition time is shorter than the predetermined time (S346: YES), the layout information corresponding to the changed attitude of the mobile terminal 10 is loaded (S349 or S351), and the web page data is re-acquired. (S355 or S133) The display screen may be redisplayed on the panel 18 (S139). Thereby, when the display waiting time does not become long, the display mode can be controlled so that the image is displayed with an appropriate layout according to the posture of the mobile terminal 10.

  In the present embodiment, the case where three types of layout information, portrait layout information, landscape layout information, and common layout information are used has been described. However, the present invention is not limited to this form. For example, instead of the large-screen portrait layout information 32 and the normal-screen portrait layout information 31, common layout information may be used. In this case, when the mobile terminal 10 is in the portrait posture, the layout information (S147) used when the image displayed on the panel 18 includes a web page image (S141: NO), and the web page image Since the layout information (S229) used when not included (S141: YES) is the same, the same usability can be given to the user. In this case, the “common layout information” may be referred to as “portrait layout information”. Similarly, instead of the large-screen landscape layout information 34 and the normal-screen landscape layout information 33, common layout information may be used. In this case, when the mobile terminal 10 is in the landscape orientation, the layout information (S147) used when the web page image is included in the image displayed on the panel 18 (S141: NO) and the web page image are included. If not (S141: YES), the layout information (S231) used is the same, so the same usability can be given to the user. In this case, the “common layout information” may be referred to as “landscape layout information”.

  In the present embodiment, the case where the normal screen portrait layout information 31 and the large screen portrait layout information 32 are provided has been described. However, the present invention is not limited to this. Regardless of the screen size of the panel 18, only one portrait layout information may be assigned to the portrait posture. Similarly, only one landscape layout information may be assigned to the landscape posture.

  The type of instruction for receiving an input in S111 is not limited to a web page image display instruction. For example, an HTML mail display instruction may be used.

  In S113, the method of acquiring the screen size of the panel 18 is not limited to the method of querying the operating system 21e for the screen size. For example, the list information of the panel size for each model may be stored in the storage unit 12, and the model information may be inquired to the operating system 21e.

  In S135 and S235, the downloaded web page data and the generated print preview data are temporarily stored in the storage unit 12, but this step may be omitted.

  The display mode of the panel 18 shown in FIGS. 6 to 9 is an example, and other display modes can be used.

  The display origin of the panel 18 that is a reference for determining the display position of various images is not limited to the upper left corner of the panel 18. Various positions can be set as the reference position according to the type of the mobile terminal 10.

  The data sharing button, the button for selecting the print application 21a, the print execution button, and the like are not limited to the form displayed on the touch panel of the panel 18. For example, the form using the hard key of the portable terminal 10 may be used.

  In the present embodiment, the case where the CPU 11 executed based on the print application 21a performs various processes has been described. However, it is not limited to this form. As a modified example, the CPU 11 executed based on the print application 21a may issue an instruction to perform various types of processing to the operating system 21e, other programs, and hardware configuration (panel 18 or the like).

  The technical elements described in this specification or the drawings exhibit technical usefulness alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. In addition, the technology illustrated in the present specification or the drawings achieves a plurality of objects at the same time, and has technical utility by achieving one of the objects.

  The mobile terminal 10 is an example of a mobile terminal. The tilt sensor 29 is an example of a sensor information output unit. Web page data is an example of first image data. The transmission / reception unit 22 is an example of a communication unit. The panel 18 is an example of a display unit. The CPU 11 is an example of a computer. The print application 21a is an example of a program. The portrait posture is an example of a first posture. The landscape posture is an example of the second posture. The web page image is an example of a first image. The object images B1a to B4a are examples of the second image. The normal screen portrait layout information 31 to the common layout information 35 are examples of layout information. The CPU 11 that executes S139 and S241 is an example of a display control unit. The URL is an example of server specifying information. The CPU 11 that executes S131 and S137 is an example of a first measurement unit. The print preview data is an example of third image data.

  Each program may be composed of a single program module, or may be composed of a plurality of program modules. In addition, each example may have another replaceable configuration and is within the scope of the present invention. It may be a computer (CPU 11 or the like) that executes processing based on an image processing program (print application 21a or the like), or a computer that executes processing based on a program other than the image processing program, such as an operating system or another application. Alternatively, it may be a hardware configuration (panel 18 or the like) that operates according to instructions from the computer, or may be a configuration in which the computer and the hardware configuration are linked. Of course, it may be a computer that executes processes by linking processes based on a plurality of programs, or may have a hardware configuration that operates according to instructions from a computer that executes processes by linking processes based on a plurality of programs. Good.

  1: communication system, 10: portable terminal, 11: CPU, 12: storage unit, 18: panel, 21a: printing application, 21e: operating system, 29: tilt sensor, 31: portrait layout information for normal screen, 32: Portrait layout information for large screen, 33: Landscape layout information for normal screen, 34: Landscape layout information for large screen, 35: Common layout information, 51: MFP

Claims (12)

A sensor information output unit that outputs sensor information indicating the attitude of the mobile terminal;
A communication unit that communicates with a server that provides first image data to obtain the first image data;
A storage unit for storing second image data;
A rectangular display with short sides and long sides;
A computer readable program of a mobile terminal equipped with
The sensor information output unit includes a first posture of the mobile terminal in which a long side of the display unit extends toward a first direction out of a first direction and a second direction orthogonal to each other, and a position closer to the second direction. Sensor information indicating which posture is the second posture of the mobile terminal in which the long side of the display unit extends,
The computer,
According to layout information which is information indicating a display position on the display unit of the first image represented on the display unit by the first image data and the second image represented by the second image data on the display unit, Display control means for displaying at least one of the first image or the second image on the display unit;
Measuring an acquisition time required for acquiring the first image data from the server when the communication unit acquires the first image data based on server specifying information that is information specifying the server; 1 measuring means;
To function,
The layout information includes first layout information corresponding to the first attitude, second layout information corresponding to the second attitude, common layout information common to the first attitude and the second attitude,
The display control means causes the display unit to display the second image in accordance with the first layout information or the second layout information when the image to be displayed on the display unit does not include the first image. ,
In response to the change of the attitude of the mobile terminal indicated by the sensor information from the first attitude to the second attitude during the display period of the second image, the second layout information and the second image data are Read from the storage unit, redisplay the second image represented by the read second image data on the display unit according to the second layout information,
In response to the change of the attitude of the mobile terminal indicated by the sensor information from the second attitude to the first attitude during the display period of the second image, the first layout information and the second image data are Read from the storage unit, redisplay the second image represented by the read second image data on the display unit according to the first layout information,
Wherein the display control unit, In no event that the first image is included in an image to be displayed on the display unit, if the acquisition time is greater than a predetermined time determined in advance, according to the common layout information Displaying the first image and the second image on the display unit;
In response to the change of the posture of the mobile terminal indicated by the sensor information from the first posture to the second posture during the display period of the first image and the second image, the first image and the second image Rotating the orientation of the image so as to correspond to the second posture, and redisplaying the first image and the second image on the display unit according to the common layout information,
In response to a change in the posture of the mobile terminal indicated by the sensor information from the second posture to the first posture during the display period of the first image and the second image, the first image and the second image Rotating the orientation of the image so as to correspond to the first posture, and redisplaying the first image and the second image on the display unit according to the common layout information ,
In the case where the first image is included in the image to be displayed on the display unit and the acquisition time is smaller than a predetermined time, the display control unit is configured to display the portable information indicated by the sensor information. In response to a change in the attitude of the terminal between the first attitude and the second attitude, the communication unit re-acquires the first image data based on the server identification information, and the first layout A program for causing the display unit to redisplay the first image and the second image according to a direction corresponding to the changed attitude of the portable terminal among the information and the second layout information . A sensor information output unit that outputs sensor information indicating the attitude of the mobile terminal;
A communication unit that communicates with a server that provides first image data to obtain the first image data;
A storage unit for storing second image data;
A rectangular display with short sides and long sides;
A computer readable program of a mobile terminal equipped with
The sensor information output unit includes a first posture of the mobile terminal in which a long side of the display unit extends toward a first direction out of a first direction and a second direction orthogonal to each other, and a position closer to the second direction. Sensor information indicating which posture is the second posture of the mobile terminal in which the long side of the display unit extends,
The computer,
According to layout information which is information indicating a display position on the display unit of the first image represented on the display unit by the first image data and the second image represented by the second image data on the display unit, Display control means for displaying at least one of the first image or the second image on the display unit;
Second measuring means for measuring a data size of the first image data acquired from the server when the communication unit acquires the first image data based on server specifying information that is information specifying the server; ,
To function,
The layout information includes first layout information corresponding to the first attitude, second layout information corresponding to the second attitude, common layout information common to the first attitude and the second attitude,
The display control means causes the display unit to display the second image in accordance with the first layout information or the second layout information when the image to be displayed on the display unit does not include the first image. ,
In response to the change of the attitude of the mobile terminal indicated by the sensor information from the first attitude to the second attitude during the display period of the second image, the second layout information and the second image data are Read from the storage unit, redisplay the second image represented by the read second image data on the display unit according to the second layout information,
In response to the change of the attitude of the mobile terminal indicated by the sensor information from the second attitude to the first attitude during the display period of the second image, the first layout information and the second image data are Read from the storage unit, redisplay the second image represented by the read second image data on the display unit according to the first layout information,
Wherein the display control unit, In no event that the first image included in the image to be displayed on the display unit, when the data size of the first image data is greater than a predetermined data size, Displaying the first image and the second image on the display unit according to the common layout information;
In response to the change of the posture of the mobile terminal indicated by the sensor information from the first posture to the second posture during the display period of the first image and the second image, the first image and the second image Rotating the orientation of the image so as to correspond to the second posture, and redisplaying the first image and the second image on the display unit according to the common layout information,
In response to a change in the posture of the mobile terminal indicated by the sensor information from the second posture to the first posture during the display period of the first image and the second image, the first image and the second image Rotating the orientation of the image so as to correspond to the first posture, and redisplaying the first image and the second image on the display unit according to the common layout information ,
When the first image is included in an image to be displayed on the display unit and the data size of the first image data is smaller than a predetermined data size, the display control means In response to the attitude of the mobile terminal indicated by the information changing between the first attitude and the second attitude, the communication unit re-acquires the first image data based on the server specifying information. A program for causing the display unit to redisplay the first image and the second image according to a direction corresponding to the changed attitude of the mobile terminal among the first layout information and the second layout information. . The display control means uses the acquired first image data and second image data when redisplaying the first image and the second image on the display unit according to the common layout information. The display mode of the first image and the second image is changed so as to correspond to the posture of the mobile terminal after the change while maintaining the relative positions of the first image and the second image. The program according to claim 1 or 2 . The first image data, the program according to any one of claim 1 to 3, characterized in that it includes a web page data. The second image data includes third image data that is image data generated based on the first image data,
Wherein the display control unit, according to any one of claim 1 to 4, characterized in that said third not displayed third image represented by the image data and the first image simultaneously on the display unit program. The said 2nd image data contains the 4th image data which is the image data which displays the object image which displays various information on the said display part, The any one of Claims 1-5 characterized by the above-mentioned. The listed program. The program according to any one of claims 1 to 6 , wherein the common layout information is the same information as the first layout information. The program according to any one of claims 1 to 6 , wherein the common layout information is the same information as the second layout information. A sensor information output unit that outputs sensor information indicating the attitude of the mobile terminal;
A communication unit that communicates with a server that provides first image data to obtain the first image data;
A storage unit for storing second image data;
A rectangular-shaped display unit having a short side and a long side, and a computer-readable program comprising a portable terminal comprising:
The sensor information output unit includes a first posture of the mobile terminal in which a long side of the display unit extends toward a first direction out of a first direction and a second direction orthogonal to each other, and a position closer to the second direction. Sensor information indicating which posture is the second posture of the mobile terminal in which the long side of the display unit extends,
The computer,
According to layout information which is information indicating a display position on the display unit of the first image represented on the display unit by the first image data and the second image represented by the second image data on the display unit, Display control means for displaying the first image and the second image on the display unit;
Measurement for measuring an acquisition time required for acquiring the first image data from the server when the communication unit acquires the first image data based on server specifying information that is information for specifying the server Function as a means,
The layout information includes first layout information corresponding to the first attitude and second layout information corresponding to the second attitude;
The display control means causes the display unit to display the first image and the second image according to the first layout information or the second layout information,
The display control means measures the measurement when the posture of the mobile terminal indicated by the sensor information changes between the first posture and the second posture during the display period of the first image and the second image. When the acquisition time measured by the means is smaller than a predetermined time, the attitude of the mobile terminal indicated by the sensor information changes between the first attitude and the second attitude. Accordingly, the first image data is re-acquired by the communication unit based on the server specifying information, and one of the first layout information and the second layout information corresponding to the changed attitude of the mobile terminal According to the program, the first image and the second image are displayed again on the display unit. A sensor information output unit that outputs sensor information indicating the attitude of the mobile terminal;
A communication unit that communicates with a server that provides first image data to obtain the first image data;
A storage unit for storing second image data;
A rectangular display with short sides and long sides;
According to layout information which is information indicating a display position on the display unit of the first image represented on the display unit by the first image data and the second image represented by the second image data on the display unit, Display control means for displaying at least one of the first image or the second image on the display unit;
Measuring an acquisition time required for acquiring the first image data from the server when the communication unit acquires the first image data based on server specifying information that is information specifying the server; 1 measuring means;
With
The sensor information output unit includes a first posture of the mobile terminal in which a long side of the display unit extends toward a first direction out of a first direction and a second direction orthogonal to each other, and a position closer to the second direction. Sensor information indicating which posture is the second posture of the mobile terminal in which the long side of the display unit extends,
The layout information includes first layout information corresponding to the first attitude, second layout information corresponding to the second attitude, common layout information common to the first attitude and the second attitude,
The display control means causes the display unit to display the second image in accordance with the first layout information or the second layout information when the image to be displayed on the display unit does not include the first image. ,
In response to the change of the attitude of the mobile terminal indicated by the sensor information from the first attitude to the second attitude during the display period of the second image, the second layout information and the second image data are Read from the storage unit, redisplay the second image represented by the read second image data on the display unit according to the second layout information,
In response to the change of the attitude of the mobile terminal indicated by the sensor information from the second attitude to the first attitude during the display period of the second image, the first layout information and the second image data are Read from the storage unit, redisplay the second image represented by the read second image data on the display unit according to the first layout information,
Wherein the display control unit, In no event that the first image is included in an image to be displayed on the display unit, if the acquisition time is greater than a predetermined time determined in advance, according to the common layout information Displaying the first image and the second image on the display unit;
In response to the change of the posture of the mobile terminal indicated by the sensor information from the first posture to the second posture during the display period of the first image and the second image, the first image and the second image Rotating the orientation of the image so as to correspond to the second posture, and redisplaying the first image and the second image on the display unit according to the common layout information,
In response to a change in the posture of the mobile terminal indicated by the sensor information from the second posture to the first posture during the display period of the first image and the second image, the first image and the second image Rotating the orientation of the image so as to correspond to the first posture, and redisplaying the first image and the second image on the display unit according to the common layout information ,
In the case where the first image is included in the image to be displayed on the display unit and the acquisition time is smaller than a predetermined time, the display control unit is configured to display the portable information indicated by the sensor information. In response to a change in the attitude of the terminal between the first attitude and the second attitude, the communication unit re-acquires the first image data based on the server identification information, and the first layout A portable terminal, wherein the first image and the second image are redisplayed on the display unit in accordance with a direction corresponding to the changed attitude of the portable terminal among the information and the second layout information . A sensor information output unit that outputs sensor information indicating the attitude of the mobile terminal;
A communication unit that communicates with a server that provides first image data to obtain the first image data;
A storage unit for storing second image data;
A rectangular display with short sides and long sides;
According to layout information which is information indicating a display position on the display unit of the first image represented on the display unit by the first image data and the second image represented by the second image data on the display unit, Display control means for displaying at least one of the first image or the second image on the display unit;
Second measuring means for measuring a data size of the first image data acquired from the server when the communication unit acquires the first image data based on server specifying information that is information specifying the server; ,
With
The sensor information output unit includes a first posture of the mobile terminal in which a long side of the display unit extends toward a first direction out of a first direction and a second direction orthogonal to each other, and a position closer to the second direction. Sensor information indicating which posture is the second posture of the mobile terminal in which the long side of the display unit extends,
The layout information includes first layout information corresponding to the first attitude, second layout information corresponding to the second attitude, common layout information common to the first attitude and the second attitude,
The display control means causes the display unit to display the second image in accordance with the first layout information or the second layout information when the image to be displayed on the display unit does not include the first image. ,
In response to the change of the attitude of the mobile terminal indicated by the sensor information from the first attitude to the second attitude during the display period of the second image, the second layout information and the second image data are Read from the storage unit, redisplay the second image represented by the read second image data on the display unit according to the second layout information,
In response to the change of the attitude of the mobile terminal indicated by the sensor information from the second attitude to the first attitude during the display period of the second image, the first layout information and the second image data are Read from the storage unit, redisplay the second image represented by the read second image data on the display unit according to the first layout information,
Wherein the display control unit, In no event that the first image included in the image to be displayed on the display unit, when the data size of the first image data is greater than a predetermined data size, Displaying the first image and the second image on the display unit according to the common layout information;
In response to the change of the posture of the mobile terminal indicated by the sensor information from the first posture to the second posture during the display period of the first image and the second image, the first image and the second image Rotating the orientation of the image so as to correspond to the second posture, and redisplaying the first image and the second image on the display unit according to the common layout information,
In response to a change in the posture of the mobile terminal indicated by the sensor information from the second posture to the first posture during the display period of the first image and the second image, the first image and the second image Rotating the orientation of the image so as to correspond to the first posture, and redisplaying the first image and the second image on the display unit according to the common layout information ,
When the first image is included in an image to be displayed on the display unit and the data size of the first image data is smaller than a predetermined data size, the display control means In response to the attitude of the mobile terminal indicated by the information changing between the first attitude and the second attitude, the communication unit re-acquires the first image data based on the server specifying information. The portable device characterized in that the first image and the second image are redisplayed on the display unit according to a direction corresponding to the changed posture of the portable terminal among the first layout information and the second layout information. Terminal. A sensor information output unit that outputs sensor information indicating the attitude of the mobile terminal;
A communication unit that communicates with a server that provides first image data to obtain the first image data;
A storage unit for storing second image data;
A rectangular display with short sides and long sides;
According to layout information which is information indicating a display position on the display unit of the first image represented on the display unit by the first image data and the second image represented by the second image data on the display unit, Display control means for displaying the first image and the second image on the display unit;
Measurement for measuring an acquisition time required for acquiring the first image data from the server when the communication unit acquires the first image data based on server specifying information that is information for specifying the server Means,
With
The sensor information output unit includes a first posture of the mobile terminal in which a long side of the display unit extends toward a first direction out of a first direction and a second direction orthogonal to each other, and a position closer to the second direction. Sensor information indicating which posture is the second posture of the mobile terminal in which the long side of the display unit extends,
The layout information includes first layout information corresponding to the first attitude and second layout information corresponding to the second attitude;
The display control means causes the display unit to display the first image and the second image according to the first layout information or the second layout information,
The display control means measures the measurement when the posture of the mobile terminal indicated by the sensor information changes between the first posture and the second posture during the display period of the first image and the second image. When the acquisition time measured by the means is smaller than a predetermined time, the attitude of the mobile terminal indicated by the sensor information changes between the first attitude and the second attitude. Accordingly, the first image data is re-acquired by the communication unit based on the server specifying information, and one of the first layout information and the second layout information corresponding to the changed attitude of the mobile terminal According to the above, the first image and the second image are redisplayed on the display unit.

Images