JP2020080051A - Information processing apparatus, display method, and program - Google Patents

Abstract

To provide an information processing apparatus suitable for a scene in which multiple materials are displayed on a display device for explanation.SOLUTION: A control unit 50 includes an operation detection unit 52 and a processing execution unit 53. When a first object, a second object that is interlocked with the first object, and a third object that is different from the first object and the second object are displayed on a display unit 21, and when the operation detection unit 52 detects an operation that overlays at least a portion of the third object on one of the first object and the second object, the processing execution unit 53 displays a fourth object corresponding to the third object on the display unit 21.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an information processing device, a display method and a program.

  In recent years, an information processing apparatus including a large display device such as a table display device has been known. The presenter displays the material on a large display device and explains the material.

  Patent Document 1 proposes a technique in which the part explained by the explainer is shown in the material of the other party. The same material is displayed on the own terminal of the explainer and the other terminal, respectively, and when the explainer points a predetermined point on the own terminal, the corresponding point on the other terminal is pointed by the cursor.

JP, 2001-157184, A

  When the table display device is used, the explainer can copy the material on the display device and display the same material on the explainer side and the partner side. However, the method of using one table display device viewed from different directions is different from the case where the presenter's own terminal and the other party's terminal exist. Therefore, the technique of Patent Document 1 cannot be applied to the scene where one table display device is used. Further, the technique of Patent Document 1 does not assume a situation in which explanation is made using a plurality of materials.

  In view of the above problems, it is an object of the present invention to provide an information processing device, a display method, and a program suitable for a situation where a plurality of materials are displayed on a display device for explanation.

  The information processing apparatus of the present invention includes a display unit, an operation detection unit, and a processing execution unit. The display unit displays an object. The operation detection unit detects an operation on the object. The process execution unit executes a process according to the content of the operation. The objects include a first object, a second object, a third object, and a fourth object. The second object is an object that is linked to the first object. The third object is an object different from the first object and the second object. The fourth object is an object corresponding to the third object. The interlocking relationship is a relationship in which an operation on one of the first object and the second object is reflected on the other of the first object and the second object. When the first object, the second object, and the third object are displayed on the display unit, the operation detection unit causes at least one of the first object and the second object to be at least the third object. When the operation of overlapping a part is detected, the processing execution unit causes the display unit to display the fourth object.

  The display method of the present invention includes a first step and a second step. In the first step, when a first object, a second object in a linked relationship with the first object, and a third object different from the first object and the second object are displayed on the display unit. An operation of overlapping at least a part of the third object on one of the first object and the second object is detected. In the second step, when the operation is detected, a fourth object corresponding to the third object is displayed on the display unit. The interlocking relationship is a relationship in which an operation on one of the first object and the second object is reflected on the other of the first object and the second object.

  The program of the present invention is a program that causes a computer to execute the first step and the second step of the display method of the present invention.

  According to the present invention, it is possible to provide an information processing device, a display method, and a program suitable for a scene in which a plurality of materials are displayed on a display device for explanation.

It is a perspective view showing an example of an information processor concerning a 1st embodiment. It is a top view of the information processing apparatus of FIG. It is a block diagram showing an example of an information processor concerning a 1st embodiment. It is a figure which shows an example of the object table in 1st Embodiment. It is a flow chart which shows an example of operation of a control part. It is a flow chart which shows an example of operation of a control part. It is a flow chart which shows an example of operation of a control part. It is a figure which shows an example of a display of a display device. It is a figure which shows an example of a display of a display device. It is a figure which shows an example of a display of a display device. It is a figure which shows an example of a display of a display device. It is a figure which shows an example of a display of a display device. It is a figure which shows an example of a display of a display device. It is a figure which shows an example of a display of a display device. It is a block diagram which shows an example of the information processing apparatus which concerns on 2nd Embodiment. It is a figure which shows an example of the object table in 2nd Embodiment. It is a flow chart which shows an example of operation of a control part. It is a figure which shows an example of a display of a display device.

[First Embodiment]
A first embodiment of the present invention will be described with reference to FIGS. In the drawings, the same or corresponding parts will be denoted by the same reference symbols and description thereof will not be repeated.

  First, the external appearance of the information processing apparatus 10 according to the first embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a perspective view showing an example of the information processing device 10. FIG. 2 is a plan view of the information processing device 10. The information processing device 10 is configured as a table display device.

  As shown in FIG. 1, the information processing device 10 includes legs 15 and a display device 20. The display device 20 corresponds to the top plate portion of the table. The legs 15 support the display device 20.

  As shown in FIG. 2, the display device 20 has a work area W. The work area W is an area in which the user works with images. For example, the first object X1 and the second object X2 are displayed in the work area W. The second object X2 is an object obtained by copying the first object X1. Moreover, the second object X2 is rotated by 180° with respect to the first object X1. The presenter proceeds with the explanation while looking at the first object X1 and the opponent looking at the second object X2.

  According to this embodiment, the interlocking relationship is set between the first object X1 and the second object X2. The interlocking relationship indicates a relationship in which an operation on one of the first object X1 and the second object X2 is reflected on the other of the first object X1 and the second object X2.

  Next, a functional block configuration of the information processing device 10 will be described with reference to FIG. FIG. 3 is a block diagram showing an example of the information processing device 10.

  As illustrated in FIG. 3, the information processing device 10 includes a display control unit 30, a storage unit 40, and a control unit 50 in addition to the display device 20.

  The display device 20 includes a display unit 21 and a touch input unit 22. The display unit 21 is configured, for example, as a liquid crystal panel so as to display an object. The touch input unit 22 is configured as a touch panel, for example.

  The display control unit 30 receives an instruction from the control unit 50 and controls the display on the display unit 21.

  The storage unit 40 includes a storage device and stores data and computer programs. The storage unit 40 includes a main storage device such as a semiconductor memory and an auxiliary storage device such as a semiconductor memory and/or a hard disk drive.

  The storage unit 40 is provided with a content folder 41 and an object folder 42 as storage areas. The content folder 41 stores a file of document data, for example. The object folder 42 stores object data including image data based on the files stored in the content folder 41.

  The control unit 50 includes a processor such as a CPU (Central Processing Unit). The processor of the control unit 50 controls each component of the information processing device 10 by executing the computer program stored in the storage unit 40.

  The control unit 50 includes a touch detection unit 51, an operation detection unit 52, and a process execution unit 53. The control unit 50 functions as the touch detection unit 51, the operation detection unit 52, and the process execution unit 53 by executing the computer program stored in the storage unit 40.

  The touch detection unit 51 detects the touch position from the input signal of the touch input unit 22. Further, the touch detection unit 51 detects the area of the touched area.

  The operation detection unit 52 detects an operation on the displayed object based on the detection result of the touch detection unit 51. The operation detection unit 52 also distinguishes between a palm touch and a fingertip touch according to the size of the touch area. The case where the touch area is larger than the threshold is the palm touch, and the case where the touch area is smaller than the threshold is the fingertip touch.

  More specifically, the operation detection unit 52 detects a basic touch operation such as touchdown or touchup. Touchdown is to touch an object with a palm or a fingertip. At the time of touchdown, the touch detection unit 51 detects the touch position as a new touch. Touch-up is to separate the touched palm or fingertip from the object. At the time of touch-up, the touch detection unit 51 detects the position where the touch disappears.

  The operation detection unit 52 also detects gesture operations such as flick, pinch-in, and pinch-out. The flick is a gesture operation of quickly moving the palm or fingertip that is touching. Pinch-in is a gesture operation that narrows the space between the palm or the fingertip that is touching. Pinch out is a gesture operation for expanding the space between the palm or the fingertip that is touching.

  The process execution unit 53 executes a process according to the content of the detected operation.

  The user can specify an operation on the object by touch operation. For example, an operation such as moving, scaling, rotating an object, or a drawing operation for the object can be designated. Also, when a document file including data of a plurality of pages is displayed as an object, the user can instruct a page forward or page backward operation.

  Next, the object table 421 will be described with reference to FIG. FIG. 4 is a diagram showing an example of the object table 421.

  The object table 421 is a table showing information on objects arranged in the work area W, and is stored in the object folder 42 together with object data. As shown in FIG. 4, the object table 421 includes an object ID, a content file name, work area coordinates, a scaling ratio, an object rotation angle, and a link destination object ID.

  The object ID is information for identifying the object, and is “0x01”, for example. The content file name is a file name of a file displayed as an object, and is, for example, “presentation.ppt”. The work area coordinates are coordinates of the area occupied by the object in the work area W, and are, for example, “(100,500)-(700,900)”. The enlargement/reduction ratio is a ratio of enlargement or reduction of the object, and is “50%”, for example. The object rotation angle is the rotation angle of the image representing the object, and is “0°”, for example. The interlocking destination object ID is information for identifying the object set as the interlocking target, and is, for example, “0x02”.

  Next, the operation of the controller 50 will be described with reference to FIGS. 5 to 7 are flowcharts showing an example of the operation of the control unit 50.

  Step S101: As shown in FIG. 5, the control unit 50 determines whether or not the current mode is the copy mode. The copy mode is a mode for performing an object copy operation. Specifically, when there are two palm touches in the object area, the copy mode is determined. When the control unit 50 determines that the current mode is the copy mode (YES in step S101), the process of the control unit 50 proceeds to step S103. When the control unit 50 determines that the current mode is not the copy mode (NO in step S101), the process of the control unit 50 proceeds to step S113.

  Step S103: The control unit 50 determines whether or not the pinch-out touches up outside the object. When the control unit 50 determines that the touch-up is performed outside the object by pinch-out (YES in step S103), the process of the control unit 50 proceeds to step S105. When the control unit 50 determines that it is not touched up outside the object by pinch-out (NO in step S103), the process of the control unit 50 proceeds to step S113.

  Step S105: The control unit 50 detects the touch-up position. Then, the process of the control unit 50 proceeds to step S107.

  Step S107: The control unit 50 stores the object data of the copy destination object in the object folder 42 separately from the object data of the copy source object. Then, the process of the control unit 50 proceeds to step S109.

  Step S109: The control unit 50 copies and displays the object at the touch-up position. Then, the process of the control unit 50 proceeds to step S111.

  Step S111: The control unit 50 performs the interlocking setting of the copy source object (first object) and the copy destination object (second object). Subsequently, the processing of the control unit 50 proceeds to step S121 shown in FIG.

  Step S113: The control unit 50 executes a process in an operation mode other than the copy mode. Then, the process of the control part 50 is complete|finished.

  Step S121: As shown in FIG. 6, the control unit 50 determines whether or not the thumbnail, which is a reduced image of the original image, is touched. When the control unit 50 determines that the thumbnail is touched (YES in step S121), the process of the control unit 50 proceeds to step S123. When the control unit 50 determines that the thumbnail has not been touched (NO in step S121), the process of the control unit 50 ends.

  Step S123: The control unit 50 determines whether or not the thumbnail is instructed to move. When the control unit 50 determines that the thumbnail is instructed to be moved (YES in step S123), the process of the control unit 50 proceeds to step S125. When the control unit 50 determines that the thumbnail has not been instructed to move (NO in step S123), the process of the control unit 50 ends.

  Step S125: The control unit 50 determines whether or not the destination coordinates of the thumbnail overlap the first object. When the control unit 50 determines that the coordinates of the moving destination of the thumbnail overlap the first object (YES in step S125), the process of the control unit 50 proceeds to step S127. When the control unit 50 determines that the moving destination coordinates of the thumbnail do not overlap the first object (NO in step S125), the process of the control unit 50 ends.

  Step S127: The control unit 50 determines whether or not the first object has a link destination object. When the control unit 50 determines that the first object has the interlocking destination object (YES in step S127), the process of the control unit 50 proceeds to step S131 shown in FIG. 7. When the control unit 50 determines that the first object does not have the interlocking destination object (NO in step S127), the process of the control unit 50 ends.

  Step S131: As shown in FIG. 7, the control unit 50 moves the thumbnail to the position next to the first object. Then, the process of the control unit 50 proceeds to step S133.

  Step S133: The control unit 50 enlarges the thumbnail to form the third object, and further displays the thumbnail with the same height and angle as the first object. Then, the process of the control unit 50 proceeds to step S135.

  Step S135: The control unit 50 creates a fourth object by copying the third object. Then, the process of the control unit 50 proceeds to step S137.

  Step S137: The control unit 50 moves the fourth object to the position next to the second object. Then, the process of the control unit 50 proceeds to step S139.

  Step S139: The control unit 50 rotates the fourth object at the same angle as the second object. Then, the process of the control part 50 is complete|finished.

  Next, a display example of the display device 20 will be described with reference to FIGS. 8 to 14 are diagrams showing an example of display in the work area W of the display device 20.

  First, as shown in FIG. 8, one object A1 is displayed in the work area W of the display device 20. The user uses the palm H1 on one hand and the palm H2 on the other hand to touch two locations on the object A1 with an area equal to or larger than a threshold value. Therefore, the current mode is the copy mode. Then, the user pinches out the palm H2 of the other hand out of the object A1.

  Next, the user touches up the palm H2. As shown in FIG. 9, the control unit 50 copies the object A1 and displays the object A2 at a position away from the palm H2.

  Next, as shown in FIG. 10, the user rotates the copied object A2 so as to face the opponent within a predetermined time. At the time of this rotation, one fingertip F1 and the other fingertip F2 are used.

  Next, as shown in FIG. 11, in response to the rotation operation by the user, the control unit 50 rotates and displays the object A2 so as to face the other party. Further, the control unit 50 performs the interlocking setting of the copy source object A1 and the copy destination object A2. The object table 421 shown in FIG. 4 is updated so that the object A1 is the linked source object and the object A2 is the linked destination object. In FIG. 4, the object ID of the object A1 is “0x01” and the object ID of the object A2 is “0x02”. Further, the object table 421 shown in FIG. 4 is updated so that the object A2 is the interlocking source object and the object A1 is the interlocking destination object.

  Next, as shown in FIG. 12, the user touches the thumbnail B of the document to be additionally described with the palm H2.

  Next, as shown in FIG. 13, the user moves the thumbnail B on the palm H2 and superimposes it on the object A1. When a part of the thumbnail B overlaps the object A1, the state of FIG. 13 shifts to the state of FIG.

  As shown in FIG. 14, the control unit 50 displays the object B1 obtained by enlarging the thumbnail B side by side with the object A1. The height and angle of the object B1 are aligned with the object A1. Further, the control unit 50 displays the object B2 obtained by copying the object B1 side by side with the object A2. The height and angle of the object B2 are aligned with the object A2. Further, the control unit 50 performs the interlocking setting of the copy source object B1 and the copy destination object B2.

  According to the first embodiment, the interlocking relationship is set between the object A1 and the object A2 by the operation described with reference to FIGS. After that, the user performs the operation of overlapping the thumbnail B on the object A1 without repeating the operation described with reference to FIGS. 8 to 11 for the object B1. As a result, the object B1 is displayed side by side with the object A1, and the object B2 is displayed side by side with the object A2. That is, the information processing device 10 is suitable for a situation in which the user explains by displaying a plurality of materials on the display device 20.

  Note that, in FIG. 13, when the icon image is superimposed on the object A1 instead of the thumbnail B, the image associated with the icon image is displayed in the work area W. Then, as in the case of FIG. 14, the objects B1 and B2 are displayed. After the objects B1 and B2 are displayed, the thumbnail B or the icon image may be deleted from the work area W or may be returned to the original position.

  When the object B1 is superimposed on the object A1 instead of the thumbnail B in FIG. 13, the object B1 is displayed side by side with the object A1 and the object B2 is displayed side by side with the object A2, as in the case of FIG. Is displayed.

  Also, when the thumbnail B, the icon image or the object B2 is overlaid on the object A2 in FIG. 13, the object B2 is displayed side by side with the object A2 and the object B1 is displayed on the object A1 as in the case of FIG. Displayed side by side.

[Second Embodiment]
Next, a second embodiment of the information processing device 10 will be described with reference to FIG. FIG. 15 is a block diagram showing an example of the information processing device 10 according to the second embodiment.

  As shown in FIG. 15, the information processing apparatus 10 according to the second embodiment is different from the information processing apparatus 10 according to the first embodiment in that the control unit 50 has a grouping unit 54. The grouping unit 54 specifies a plurality of objects that belong to one group. Within a group, the processing for one object also applies to other objects.

  Next, the object table 421 will be described with reference to FIG. FIG. 16 is a diagram showing an example of the object table 421.

  As shown in FIG. 16, the object table 421 according to the second embodiment differs from the object table 421 (see FIG. 4) of the first embodiment in that it includes a group object ID. The group object ID is information for identifying another object that belongs to the same group as the self object.

  FIG. 17 is a flowchart showing an example of the operation of the control unit 50. After executing the processing shown in FIGS. 5 to 7, the control unit 50 executes the processing of FIG. 17 subsequent to step S139 in FIG.

  Step S201: As shown in FIG. 17, the control unit 50 groups the first object and the third object. Then, the process of the control unit 50 proceeds to step S203.

  Step S203: The control unit 50 groups the second object and the fourth object. Then, the process of the control unit 50 proceeds to step S205.

  Step S205: The control unit 50 determines whether the first object or the third object is instructed to move, scale, or rotate. When the control unit 50 determines that the first object or the third object is instructed to move, scale, or rotate (YES in step S205), the process of the control unit 50 proceeds to step S207. When the control unit 50 determines that neither the movement, the enlargement/reduction, nor the rotation of the first object and the third object is instructed (NO in step S205), the process of the control unit 50 ends.

  Step S207: The control unit 50 sets the first object and the third object as a target of the process of moving, scaling or rotating together. Then, the process of the control unit 50 proceeds to step S209.

  Step S209: The control unit 50 determines whether or not the second object or the fourth object is instructed to move, scale, or rotate. When the control unit 50 determines that the second object or the fourth object is instructed to move, scale, or rotate (YES in step S209), the process of the control unit 50 proceeds to step S211. When the control unit 50 determines that neither the movement, the enlargement/reduction, nor the rotation of the second object or the fourth object has been instructed (NO in step S209), the process of the control unit 50 ends.

  Step S211: The control unit 50 sets the second object and the fourth object as a target of the process of moving, scaling or rotating. Then, the process of the control part 50 is complete|finished.

  Next, a display example of the display device 20 will be described with reference to FIG. FIG. 18 is a diagram showing an example of a display in the work area W of the display device 20.

  As shown in FIG. 18, the object A1 and the object B1 in FIG. 14 are grouped without any special operation by the user. Further, the object A2 and the object B2 are grouped. As described with reference to FIG. 13, the user has to perform only the operation of overlaying the thumbnail B on the object A1. As a result, the object table 421 in FIG. 16 is updated. For example, when the object A1 is moved by the palm H2, the object B1 moves following the object A1.

  According to the second embodiment, convenience is improved by grouping.

[Third Embodiment]
In the first and second embodiments, two objects are displayed side by side on each of the explainer side and the partner side. In the third embodiment, three or more objects are displayed side by side. However, the size of the work area W is limited. Therefore, when the objects cannot be displayed side by side, the objects are partially overlapped and displayed. The latest added object may preferentially display the entire object.

  According to the third embodiment, it is possible to provide the information processing apparatus 10 suitable for a scene in which a large number of materials are displayed on the display device 20 for explanation.

  The program that operates in the information processing apparatus 10 according to the present invention may be a program that controls the CPU (a program that causes a computer to function) so as to realize the functions of the above-described embodiments according to the present invention. Information to be handled is temporarily stored in a RAM (Random Access Memory) during processing, and then stored in various ROMs such as a flash ROM (Read Only Memory) or a hard disk drive, and read and modified by the CPU as necessary. And writing is performed. Further, even if the program for realizing the function of each component is recorded in a computer-readable recording medium, and the program recorded in the recording medium is read into the computer system and executed, the processing of each unit is performed. Good. The “computer system” mentioned here includes an OS and hardware such as peripheral devices.

  Further, the “computer-readable recording medium” refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, or a storage device such as a hard disk built in a computer system. Further, the "computer-readable recording medium" holds the program dynamically for a short time like a communication line when transmitting the program through a network such as the Internet or a communication line such as a telephone line. Including what you do. The "computer-readable recording medium" also includes a volatile memory that holds a program for a certain period of time, such as a volatile memory inside a computer system serving as a server or a client. Further, the above program may realize some of the functions described above, or may further realize the above functions in combination with a program already recorded in the computer system.

  Since the above description of the embodiments describes the preferred embodiments of the present invention, it may have various technically preferable limitations, but the technical scope of the present invention is not limited to the present invention. Unless otherwise stated, the present invention is not limited to these embodiments. That is, the constituent elements in the above-described embodiments can be appropriately replaced with existing constituent elements and the like, and various variations including combinations with other existing constituent elements are possible. The description of the above embodiments does not limit the contents of the invention described in the claims.

  INDUSTRIAL APPLICABILITY The present invention can be used in the fields of information processing devices, display devices, and programs.

10: information processing device 20: display device 21: display unit 22: touch input unit 40: storage unit 50: control unit 51: touch detection unit 52: operation detection unit 53: processing execution unit 54: grouping unit

Claims (17)

A display for displaying objects,
An operation detection unit that detects an operation on the object,
A process execution unit that executes a process according to the content of the operation,
The object is
The first object,
A second object interlocking with the first object;
A third object different from the first object and the second object,
A fourth object corresponding to the third object,
The interlocking relationship indicates a relationship in which an operation on one of the first object and the second object is reflected on the other of the first object and the second object,
When the first object, the second object, and the third object are displayed on the display unit, the operation detection unit causes at least one of the first object and the second object to be at least the third object. The information processing apparatus, wherein the processing execution unit causes the display unit to display the fourth object when an operation of overlapping a part is detected.   The processing execution unit causes the display unit to display the fourth object such that the fourth object is lined up with one of the first object and the second object that is not a target of the overlapping operation. 1. The information processing device according to 1.   The processing execution unit aligns the position of one end of the fourth object in the predetermined direction with the position of one end of the first object and the second object that is not the target of the overlapping operation in the predetermined direction. The information processing apparatus according to claim 2, wherein the fourth object is displayed on the display unit.   The processing execution unit causes the display unit to display the fourth object such that the angle of the fourth object is aligned with the angle of one of the first object and the second object that is not the target of the overlapping operation. The information processing apparatus according to claim 2 or 3, which is displayed.   5. When the third object is a reduced image, the processing execution unit causes the display unit to display an image obtained by enlarging the reduced image as the fourth object. The information processing device described in 1.   5. When the third object is an icon image, the processing execution unit causes the display unit to display an image associated with the icon image as the fourth object. The information processing device according to item 1. A grouping unit configured to group one of the first object and the second object, which is not a target of the overlapping operation, and the fourth object,
When the operation detection unit detects an operation on one of the first object and the second object that is not the target of the overlapping operation and the fourth object, the process execution unit determines 7. The process according to the content of the operation is applied to one of the first object and the second object that is not the target of the overlapping operation and the fourth object, according to any one of claims 1 to 6. The information processing device according to item 1.   When the first object, the second object, and the third object are displayed on the display unit, the operation detection unit causes at least one of the first object and the second object to be at least the third object. When the operation of overlapping a part is detected, the process execution unit causes the display unit to display the third object such that the third object is aligned with an object of the first object and the second object that is a target of the overlapping operation. The information processing apparatus according to claim 1, wherein the information processing apparatus is displayed.   The processing execution unit arranges the third object in line with one of the first object and the second object, which is a target of the overlapping operation, and determines a position of one end of the third object in a predetermined direction as described above. The said 3rd object is displayed on the said display part so that it may align with the position of one end in the said predetermined direction of the object which is the object of the said overlapping operation among the 1st object and the said 2nd object. Information processing equipment.   The processing execution unit arranges the third object in line with one of the first object and the second object that is the target of the overlapping operation, and the angle of the third object is the first object and the second object. The information processing apparatus according to claim 8 or 9, wherein the third object is displayed on the display unit so as to be aligned with the angle of the object that is the target of the overlapping operation among the second objects. When the third object is lined up with one of the first object and the second object that is the object of the overlapping operation, one of the first object and the second object that is the object of the overlapping operation is Further comprising a grouping unit for grouping the object and the third object,
When the operation detection unit detects an operation on one of the first object and the second object, which is the object of the overlapping operation, and the third object, the process execution unit, 11. The process according to the content of the operation is applied to the one of the first object and the second object that is the target of the overlapping operation and the third object, according to claim 8. The information processing apparatus according to any one of items. The objects further include a fifth object,
When the third object is a reduced image, the operation detection unit causes the operation detection unit to display the first object and the third object when the first object, the second object, and the third object are displayed on the display unit. When the operation of overlapping at least a part of the third object on one of the two objects is detected, the processing execution unit determines that the one of the first object and the second object that is the target of the overlapping operation is the first object. Display the fifth object on the display unit so that the five objects are arranged,
The information processing apparatus according to claim 1, wherein the fifth object is an image obtained by enlarging the reduced image. The objects further include a fifth object,
When the third object is an icon image, the operation detection unit causes the operation detection unit to display the first object and the third object when the first object, the second object, and the third object are displayed on the display unit. When the operation of overlapping at least a part of the third object on one of the two objects is detected, the processing execution unit determines that the one of the first object and the second object that is the target of the overlapping operation is the first object. Display the fifth object on the display unit so that five objects are lined up,
The information processing apparatus according to claim 1, wherein the fifth object is an image associated with the icon image.   The information processing apparatus according to claim 12, wherein the processing execution unit erases the third object from the display unit when displaying the fifth object on the display unit.   The information processing apparatus according to claim 12 or 13, wherein the processing execution unit returns the third object to the original position when the fifth object is displayed on the display unit. When a first object, a second object that is linked to the first object, and a third object that is different from the first object and the second object are displayed on the display unit, the first object, A first step of detecting an operation of overlapping at least a part of the third object on one of the second objects;
A second step of displaying a fourth object corresponding to the third object on the display unit when the operation is detected,
The display method, wherein the interlocking relationship indicates a relationship in which an operation on one of the first object and the second object is reflected on the other of the first object and the second object.   A program that causes a computer to execute the first step and the second step of the display method according to claim 16.

Images