JP7597361B2 - Communication system and program - Google Patents

Description

The present invention relates to a communication system and program that supports sessions such as video calls.

In recent years, communication systems that enable video calling and other sessions between users in remote locations have become increasingly popular, and are now widely used not only in private settings but also in business situations.

To improve the convenience of such communication systems, for example, the following Patent Document 1 discloses a system in which a session management server recognizes a media switching request from a terminal and relays between the terminal and the group server, allowing the media to be switched between the terminal as a member and the group server without disconnecting the session or leaving the group. Also, the following Patent Document 2 discloses a system that can switch the communication destination of devices, including peripheral devices such as printers, and notify the connection destination of the IP address of the device after switching.

JP 2009-164841 A JP 2020-178229 A

During a group call, online conference, remote business negotiation, or other session involving multiple users, there are times when you want to switch to another device without interrupting the conversation of others due to battery depletion or changes in the communication environment caused by moving. Also, during a remote business negotiation, you may want to change the device from a desktop computer to a smartphone to continue the business negotiation, for example, to check a product in a different location where it is difficult to bring a wired computer. In either of the above cases, it is sufficient to disconnect the communication once and reconnect, but for example, in the case of a group call or online conference, the more people connected, the more likely it is that the conversation of others will be interrupted when reconnecting, and in the case of a business negotiation, this may cause inconvenience to the customer. Therefore, there is a need for a system that allows you to continue the business negotiation by switching devices while maintaining the session.

To solve these problems, the present invention aims to provide a communication system and program that allows users to easily change the terminal they are using without interrupting a session such as a video call.

To achieve the above object, the communication system of the present invention is a communication system that supports a session between multiple user terminals connected via a communication network, and is characterized by comprising: a code conversion unit that converts access permission information assigned to a session between the user terminals into a readable code when a terminal change operation executed in the user terminal is detected; a communication unit that receives the terminal change operation and transmits the readable code to the user terminal that performed the terminal change; and a screen generation unit that generates a screen that displays the readable code within a system screen displayed on the user terminal during the session.

The program according to the present invention is a program that supports a session between multiple user terminals connected via a communication network, and includes the steps of: upon receiving a terminal change operation executed in the user terminal, converting the access permission information assigned to the session between the user terminals into a readable code; receiving the terminal change operation and transmitting the readable code to the user terminal that performed the terminal change operation; and generating a screen that displays the readable code within a system screen displayed on the user terminal when the session is started, and is characterized in that the program causes a computer to execute these steps.

The communication system and program of the present invention allow users to easily change the terminal they are using without interrupting a session such as a video call.

An example of a system diagram and a server block diagram of a remote interview system according to one embodiment of the present invention. 1A is an example of a block diagram of a host terminal in the embodiment, and FIG. 1B is an example of a block diagram of a guest terminal in the embodiment. A figure showing a schematic flowchart of how a video call starts in the remote interview system of the same embodiment. 5A and 5B are diagrams illustrating an example of a system screen displayed on a display unit of a host terminal according to the embodiment. 13 is a diagram illustrating an example of a system screen displayed on a display unit of the host terminal in the embodiment. FIG. 13 is a diagram illustrating an example of a system screen displayed on a display unit of the host terminal in the embodiment. FIG. 13 is a diagram illustrating an example of a system screen displayed on a display unit of the host terminal in the embodiment. FIG. 13 is a diagram illustrating an example of a system screen displayed on a display unit of the host terminal in the embodiment. FIG. 13 is a diagram illustrating an example of a system screen displayed on a display unit of the host terminal in the embodiment. FIG. 5A and 5B are diagrams illustrating an example of a system screen displayed on a touch panel of a guest terminal according to the embodiment. 13 is a diagram illustrating an example of a system screen displayed on a touch panel of a guest terminal in the embodiment. FIG. 13 is a diagram illustrating an example of a system screen displayed on a touch panel of a guest terminal in the embodiment. FIG. 1A is a diagram showing an example of a system screen displayed on a display unit of a host terminal in the embodiment, and FIG. 1B is an example of a block diagram of a change terminal in the embodiment. 13A and 13B are diagrams showing a schematic flowchart of a terminal change operation in the embodiment. 13 is a diagram illustrating an example of a system screen displayed on a touch panel of a guest terminal in the embodiment. FIG. 5A and 5B are diagrams illustrating an example of a system screen displayed on a touch panel of a guest terminal according to the embodiment. 13 is a diagram illustrating an example of a service history table stored in a history information storage unit of the server in the embodiment. FIG.

The following describes an embodiment of the present invention with reference to the attached drawings.

The communication system 1 in this embodiment is a communication system that supports a session between a plurality of user terminals 2, 2... connected via a communication network 3. The communication system 1 includes a code conversion unit 46 that converts the access permission information assigned to the session between the user terminals 2, 2... into a readable code when it detects a terminal change operation executed in the user terminals 2, 2..., a communication unit 41 that receives the terminal change operation and transmits the readable code k to the user terminal 2 that performed the terminal change, and a screen generation unit 43 that generates a screen that displays the readable code in the system screen 7 that is displayed on the user terminal 2 during the session.

The present invention can be modified or substituted, and the session referred to here can be any of a video call, chat, and an Internet voice-only call, and the number of user terminals 2 that participate in the session is not limited. Below, however, an example in which the above communication system 1 is applied as a remote interview system to a negotiation support tool for car sales is described in detail. Furthermore, the description in this specification of an embodiment as an example does not limit the present invention to the specific form disclosed.

<Remote interview system>
First, as shown in FIG. 1, the remote interview system 1 of this embodiment is composed of a server 4 and a plurality of user terminals 2, 2 via a communication network 3, and is used in a state in which they can freely communicate with each other in a secure environment. The communication network 3 may be a circuit-switched network such as the public switched telephone network (PSTN) or a packet-based network such as the Internet, and the communication standard is not particularly limited as long as the communication network is capable of video calling. The communication network 3 includes any network that provides data communication via wireless signals. An example of the arbitrary network is a wireless local area network (WLAN) that uses WiFi/WiMax communication. The user terminals 2, 2 can access the server 4 through the communication network 3 to obtain a system screen 7 (interface) shown in FIG. 4 and the like to make a video call.

<Server>
The server 4 is configured with an information processing device such as a computer, and is managed by an administrator terminal 10 of the service provider of the remote interview system 1. The server 4 may be a single server, or may be configured with multiple servers, such as an application server and a database server, and may be dedicated or general-purpose. Of course, a firewall may be provided between the server 4 and the communication network 3. As shown in FIG. 1, the server 4 includes at least a control unit 40, a communication unit 41, a storage unit 42, a screen generation unit 43, a content generation unit 44, a mail generation and transmission unit 45, a code conversion unit 46, a detection unit 47, and a chat processing unit 48.

The control unit 40 includes a CPU, and the CPU executes various programs stored in the storage unit 42 to execute various processes. The communication unit 41 transmits and receives data to and from the user terminals 2, 2, etc. For example, the communication unit 41 receives a terminal change operation at the user terminal 2 and transmits a read code to the user terminal 2 that performed the terminal change operation. The storage unit 42 stores various programs and data required for the server 4 to operate. Specifically, various programs such as an operating system (OS), a video call establishment application program, a terminal change application program, a screen sharing application program, and a content editing application program are stored. The storage unit 42 also stores files dropped into the system screen 7. The storage unit 42 includes a user information storage unit 42a and a history information storage unit 42b. The user information storage unit 42a stores user information (login ID (identifier for identifying a user), mobile phone number, etc.) that uses the service (hereinafter referred to as the service) of the remote interview system 1. Since the service allows not only video calls but also message (chat) exchanges and file sharing, the history information storage unit 42b stores the usage status and communication history of the user terminals 2, 2, message exchanges (chats), shared files, etc. The screen generation unit 43 generates a system screen 7 that is displayed on the user terminals 2, 2 during a video call between the user terminals 2, 2. Here, the system screen 7 refers to a screen that is displayed on the display unit 54 or touch panel 64 of the user terminals 2, 2 while the application of the remote interview system 1 is running (see FIG. 4, etc.).

The screen generation unit 43 generates the system screen 7. Specifically, the screen generation unit 43 generates a frame portion 71 that is configured to appear and disappear freely within the system screen 7, and multiple camera frame portions 72 that display the camera images of each of the user terminals 2, 2 (see FIG. 7, etc.). The screen generation unit 43 also generates the frame portions 71 separately for the left and right of the system screen 7, and generates the frame portions 71 so that they slide horizontally and protrude when an operation of the operation tab 70 is detected. Furthermore, when a terminal change operation is performed during a video call, the screen generation unit 43 generates a screen that displays the read code k converted by the code conversion unit 46. The screen generation unit 43 also generates a screen that turns a file dropped onto the system screen 7 into icons 74a, 74b and displays them on the system screen 7.

The content generation unit 44 generates the content to be used in the video call in the frame unit 71. In the case of car sales, the content assumed here refers to content for referencing an inventory list, content for reviewing estimates and sales contracts, content for making payments by card, etc., and chat that can be exchanged between user terminals 2, 2. The content generation unit 44 generates the content displayed in the frame unit 71 on the sending user terminal (host terminal 5) side so that the user can operate and edit it by inputting characters, searching, selecting, etc., while the frame unit 71 on the destination user terminal (guest terminal 6) is generated so that content based on the selection operation performed on the sending user terminal side is displayed.

When the email generation and transmission unit 45 receives an email destination from the user terminal 2, it generates a simple email containing access permission information for starting a video call session with the sender user terminal 2 (host terminal 5) and sends it to the destination user terminal 2 (guest terminal) of the email destination.

When the code conversion unit 46 detects a terminal change operation executed on the user terminal 2 (host terminal 5), it converts the access permission information assigned to the video call between the user terminals 2, 2 into a readable code. In addition, when the code conversion unit 46 detects that the readable code has been read by the camera 53a, it also converts the readable code into access permission information.

The detection unit 47 detects that a file has been dropped onto the system screen 7 during a video call.

The chat processing unit 48 automatically posts access permission information that allows access to the file dropped onto the system screen 7 to each of the user terminals 2 on the chat conversation screen.

<User terminal>
In this embodiment, the user terminals 2, 2 are assumed to be a host terminal 5 used by a salesperson at a car dealership and a guest terminal 6 used by a customer who is considering purchasing a car. The host terminal 5 may be a notebook or desktop computer, a tablet terminal, or a smartphone. In short, any terminal device can be used as the host terminal 5 as long as it can make a video call via the communication network 3 and can transmit and receive data, files, etc. with the server 4. In this embodiment, a case where a computer is used as the host terminal 5 will be described. The host terminal 5 is a user terminal that is registered to use the service, that is, registered to provide personal information such as a telephone number and an email address, corporate information, and a password to a service provider and use the service. As shown in FIG. 2(a), the host terminal 5 includes a control unit 50, a communication unit 51, a storage unit 52, a camera/speaker/microphone 53, a display unit 54, and an operation unit 55. The control unit 50 includes a CPU, and the CPU executes a predetermined program stored in the storage unit 52 to execute various processes. The communication unit 51 executes transmission and reception of data, files, etc. with the server 4. The storage unit 52 is composed of memories such as ROM and RAM, and a HDD, and stores computer programs for transmitting and receiving various data. The camera 53a of the camera/speaker/microphone 53 is a camera capable of transmitting a moving image of the user in a video call, the speaker 53b is a speaker capable of outputting the other party's voice, and the microphone 53c is a microphone capable of transmitting voice in a video call, and is not particularly limited. The display unit 54 is a user interface that displays various information under the control of the control unit 50, and is composed of a liquid crystal panel or the like. The operation unit 55 is a user interface that accepts operations by the user, and is composed of a keyboard and a mouse.

The guest terminal 6 can be any terminal device, such as a personal computer or tablet terminal, as long as it can make a video call via the communication network 3 and can transmit and receive data, files, etc. with the server 4, and is not particularly limited. In this embodiment, a smartphone is used as the guest terminal 6. The guest terminal 6 is a user terminal that has not been registered for use of the service, in other words, does not need to be registered for use of the service, and includes a control unit 60, a communication unit 61, a storage unit 62, a camera, speaker, microphone 63, and a touch panel 64 as shown in FIG. 2(b). The control unit 60 includes a CPU, and the CPU executes a predetermined program stored in the storage unit 62 to execute various processes. The communication unit 61 executes transmission and reception of data, files, etc. with the server 4. The storage unit 62 is composed of memories such as ROM and RAM and a HDD, and stores computer programs for transmitting and receiving various data. The touch panel 64 is a user interface that displays various information based on the control of the control unit 60 and accepts tap operations by the user, and is composed of a display body that can detect contact with an external object. The camera, speaker, and microphone 63 may be any device capable of video calling, similar to the host terminal 5.

<Basic flow for starting a video call with the remote interview system>
Next, with reference to Figures 3 to 5, 10, 11, etc., a basic operation example up to the start of a video call using the remote interview system 1 will be described along with display examples of the display unit 54 and the touch panel 64. Here, a description will be given of the process up to the start of a business negotiation using a video call for the first time by a car sales representative with a new customer. Also, here, an example will be described in which a login ID for a user to access the server 4 on the host terminal 5 side has already been issued and a password has also been set, but it goes without saying that the login ID issuance and registration process is performed separately. Furthermore, the host terminal 5 of the user terminals 2 may be configured to install a dedicated module when using the service, or may be configured to use a browser.

First, the sales representative at the host terminal 5 opens a login screen by starting an application installed on the host terminal 5 or by accessing a specific URL. Then, the sales representative enters an ID and password on the login information input screen (S100, see FIG. 4(a)) and transmits the login ID information. The server 4 executes authentication processing based on the transmitted login information (S101). Once authentication processing is complete, a specific system screen 7 is read (S102) and transmitted to the host terminal 5.

When the authentication process is performed correctly, the system screen 7 is displayed on the display unit 54 of the host terminal 5 (see FIG. 4(b)). FIG. 4(b) shows the system screen 7 when the remote interview system 1 is started. When the operation tab 70a on the left side of the operation tabs 70 displayed on the system screen 7 is clicked, the frame portion 71a pops out, and the video call reservation page 71aa for inputting the guest information of the customer to be invited to the video call is displayed on the system screen 7 (S103, see FIG. 5). Then, the guest name and mobile phone number of the new customer are entered in the designated input field on the video call reservation page 71aa in the frame portion 71a, and the video call issue button a (see FIG. 5) is clicked. The guest information is then sent to the server 4. The mail generation and transmission unit 45 generates a simple mail based on the acquired guest information. A simple mail is generated in which the access permission information that allows the video call to be started is linked, and the simple mail is sent to the mobile phone number (S104). The simple mail referred to here refers to mail sent using, for example, SMS (Short Message Service) or MMS (Multimedia Messaging Service) that can use a mobile phone number as the destination. The text of the simple mail sent to the guest terminal 6 is not particularly limited, but it may be a text that is easy for the customer who receives the simple mail to understand, such as "Video call is ready. Please tap the URL below," as shown in FIG. 10(a). The access permission information linked to the simple mail here means information about a link that allows a video call to be made with the host terminal 5, and although the case of a URL is described, it is not limited to this. The manner in which the access permission information is linked to the simple mail is not limited to the example of displaying a URL, but may be a two-dimensional code such as a QR code (registered trademark) or an icon that allows access to the URL by clicking on it.

When the simple mail arrives at the guest terminal 6, the customer taps the linked URL to access the URL (S106). When access to a specific URL is detected, a screen is displayed requesting permission to access the camera (63) of the guest terminal 6 (S107, see FIG. 10(b)). When access to the camera 63a is permitted by the customer's operation, the image from the camera 63a is displayed, and when access to the camera 53a is canceled, the system screen 7 is switched to a state where there is no image from the camera 63a, and a video call is started (S108, see FIG. 11). Meanwhile, the server 4 generates a video call issuance screen with the guest terminal 6 for the host terminal 5 (S105) and transmits it to the host terminal 5. The video call issuance screen is displayed on the system screen 7 of the host terminal 5 (S109), and when it is detected that the sales representative has clicked the start button b (see FIG. 6) on the video call issuance page 71ab, the video call is started (S110). Then, file and chat exchanges between the host terminal 5 and the guest terminal 6 are stored as a history log in the history information storage unit 42b (S111).

<Modification of the flow until the start of a video call in the remote consultation system>
The flow up to the start of the video call is not limited to the above, and for example, a flow for setting the reservation date and time of the video call and the start time of the video call may be added to the above flow. Also, for example, the video call may be reserved from the homepage of the company (in this embodiment, a car dealership). In this case, a reservation form is set up that allows the customer who accesses the company's homepage to input the reservation date and time, customer name, mobile phone number, or email address. Then, when the communication unit 41 of the server 4 receives the input information of the reservation form, the host terminal 5 may be notified that the video call has been reserved. The notification method may be an email to a specified email address, or, if the application of the service is installed in the host terminal 5, a notification flag may be set on the icon of the application. In this case, the reservation date and time information may be included as guest information in step S103 of FIG. 3, and the reservation date and time information may be included in the simple email generated in step S104 of FIG. 3.

FIG. 17 shows an example of a service history table stored in the history information storage unit 42b. As shown in the figure, the service history table T includes "user ID", "video call URL", "guest name", "guest information", "file log", etc. In this example, the reservation date and time of the video call is also included as management information "video call reservation date and time". The "user ID" is an account set by the service provider, but also includes an account that is arbitrarily changed to text such as an email address by the user. Management information such as "video call URL", "guest name", "guest information", "file log", and "video call reservation date and time" are stored in association with the "user ID" as shown in FIG. 17. Therefore, only a user who has a "user ID" associated with the "video call URL" and a guest who has been invited by the user can access the corresponding "video call URL". In addition, a specific "video call URL" associated with a specific "user ID" is only valid between a user (a sales representative in this embodiment) invited by a user authorized by ID authentication (a customer in this embodiment). Therefore, if the sales representative has not used the service with an invited customer, for example, the customer cannot use the service even if he or she accesses the URL linked in the simple email after the video call ends.

According to the above configuration, by accessing the access permission information (URL) from the user terminal 2 that received the simple mail, a video call can be easily started with the sending user terminal, i.e., the host terminal 5. At this time, the party that received the simple mail, i.e., the guest terminal 6, can make a video call without login authentication, etc., by simply notifying the simple mail destination (mobile phone number). Therefore, a customer who wants to purchase a car can easily negotiate with a sales representative by video call in a secure environment by providing his/her mobile phone number as his/her personal information, without having to download an application or register as a member to receive the service.

<About the host terminal system screen>
Next, the display on the system screen 7 of the host terminal 5 when a service is provided will be described with reference to FIGS.

As mentioned above, FIG. 4(a) shows the login screen for receiving services. When login information is entered from this system screen 7 and authentication processing is properly performed by the server 4, the screen transitions to that shown in FIG. 4(b). FIG. 4(b) shows the system screen 7 before starting a video call with a customer.

As shown in FIG. 4(b), the system screen 7, which is a horizontally long rectangle to match the shape of the display unit 54 of the host terminal 5, includes a camera frame section 72 that displays the users who are making a video call, specifically the sales representative and the customer, captured by the cameras 53a and 63a, a frame section 71 that is configured to appear and disappear freely within the system screen 7, and an operation tab 70 for controlling the appearance and disappearance of the frame section 71. The camera frame section 72 includes a host camera frame section 72a that displays the image (sales representative) captured by the camera 53a on the host terminal 5 side, and a guest camera frame section 72b that displays the image (customer) captured by the camera 63a on the guest terminal 6 side. This camera frame section 72 is generated so that the user's image is displayed small and the image of the other party in the video call is displayed large. Therefore, on the system screen 7 on the host terminal 5 side, the guest camera frame section 72b is displayed large in the approximate center area of the system screen 7, and the host camera frame section 72a is displayed small in the upper left corner of the system screen 7.

The frame parts 71 are generated in an approximately rectangular shape separately on the left and right of the system screen, and are generated so that when an operation of the operation tab 70 is detected, the frame parts 71 slide horizontally and protrude. In FIG. 4(b), the left and right frame parts 71a, 71b are shown in a hidden and stored state, and only the operation tabs 70 (70a, 70b) are displayed on the left and right. The operation tabs 70a, 70b are displayed in a convex shape on the edges 70c, 70d of the protruding sides of the left and right frame parts 71a, 71b. The semicircular convex operation tabs 70a, 70b have directional indications of ">" and "<" that indicate the direction in which the frame parts 71a, 71b are pulled out. This allows the user to intuitively recognize that clicking the operation tabs 70a, 70b will pull out the frame parts 71a, 71b toward the center of the system screen 7. In addition, since the frame parts 71a and 71b are generated on both the left and right sides, the amount of information that can be referred to on the system screen 7 can be significantly increased. Furthermore, since various pages can be added to the frame parts 71a and 71b as shown in Figs. 5 to 9, the amount of information can be further increased according to the content of the business negotiation. Furthermore, by operating the operation tabs 70a and 70b, the frame parts 71a and 71b are slid horizontally and displayed, so the area of the system screen 7 can be effectively utilized. For example, when you want to have a face-to-face meeting while checking the customer's face during a video call, you can store the frame parts 71a and 71b as shown in Fig. 4(b). Furthermore, even when the frame parts 71a and 71b are pulled out, the guest camera frame part 72b is displayed large in the approximate center of the system screen 7, so you can conduct business negotiations as if you were actually having an interview.

The lower section of the system screen 7 is an operation area 73, where various operation buttons are arranged. Here, a terminal change button 73a that allows changing to another terminal during a video call, a camera switch button 73b that changes the shooting direction of the camera 53a, a camera off button 73c that stops shooting with the camera 53a, an off button 75 for ending the video call, a shooting button 73d that takes a screenshot of the system screen 7 as it is, and a business card display button 73e that allows the business card of the sales representative to be displayed are arranged. The terminal change button 73a and the like are displayed as pictograms. This allows the user to intuitively understand the operation functions, making it easy to use even for users who are using the service for the first time. The arrangement order of the various operation buttons in this operation area 73 may be generated so that the user can change it by dragging and dropping according to the content of the business negotiation.

The Change Terminal button 73a allows you to change the terminal you are using during a video call. When the Change Terminal button 73a is clicked, the read code k converted by the code conversion unit 46 is displayed in the center of the system screen 7 (see FIG. 13(a)). When the sales representative reads the read code with the camera of the terminal they wish to change to, they can access the "video call URL" on the terminal that read the code. The Capture button 73d is convenient because it allows you to take a screenshot of the screen displayed during a business meeting. If you set it to automatically post the screenshot file to the chat page 71bc, it will remain as history and will be saved for the next business meeting, allowing you to continue the business meeting smoothly.

5 and 6 are diagrams showing an example of the display of the frame section 71a on the left side, showing the state in which the entire frame section 71a is pulled out. This frame section 71a can be pulled out to a maximum extent of about one-third of the system screen 7 on a horizontally long system screen. The frame section 71a is generated to include content that does not need to be shared with the guest terminal 6, and FIG. 5 shows an example in which a video call reservation page 71aa is displayed as an example. This video call reservation page 71aa is content used by users who have registered to receive the service, and this content is not displayed on the guest terminal 6. A sales representative who receives a request for a video call from a customer starts the system screen 7, logs in from the login screen (see FIG. 4(a)), clicks the operation tab 70a, enters the guest name and mobile phone number on this video call reservation page 71aa, and clicks the video call issue button a, so that the sales representative can reserve a video call with the customer.

Figure 6 shows an example of the display of a video call issuing page 71ab as content to be loaded into the left frame section 71a. A video call reservation list is generated and displayed on this video call issuing page 71ab. The reservation list displays the video reservation date and time and the customer name, and the information is updated sequentially. The sales representative can start a video call with a customer by clicking the start button b displayed on the video call issuing page 71ab.

As described above, if the content generated in frame portion 71a is information that does not need to be shared with the customer, it is possible to separate the use of left frame portion 71a and right frame portion 71b. In this embodiment, the left frame portion 71a contains content that is essential to establish a video call, but is also content that is expected to be rarely seen during a video call. Therefore, frame portion 71a can be stored during negotiations, allowing the system screen 7 to be used effectively. In addition, if other customers' personal information or company information is posted in left frame portion 71a as shown in FIG. 6, it is possible to prevent operational errors such as inadvertently sharing information with customers.

7 to 9 are diagrams showing examples of the display of the frame portion 71b on the right side, showing the state in which the entire frame portion 71b is pulled out. This frame portion 71b can be pulled out to a maximum extent of about half the system screen 7 on a horizontally long system screen. Even when the frame portion 71b is pulled out as shown in FIG. 7, the off button 75 is generated in a position where it can be seen, and a terminal change button 73a, etc. that is likely to be used during a business meeting by video call, is generated on the left side. Therefore, operability can be improved even when the frame portion 71b is referred to. Even when the frame portion 71b is pulled out in this way, the guest camera frame portion 72b is displayed large, so that information in the frame portion 71b can be referred to while meeting with a customer. The meeting can also be carried out while viewing the host camera frame portion 72a at the upper left end. The frame portion 71b is generated to include content to be shared with the guest terminal 6, and FIG. 7 shows an example in which an inventory reference page 71bb is displayed as an example. The inventory reference page 71bb is a page where the customer can select a car while browsing the car inventory status. The content posted on the inventory reference page 71bb may be imported from the inventory reference page of the customer's company homepage and displayed. On the host terminal 5 side, the customer can search by entering keywords that match the customer's request in the input field c provided on the inventory reference page 71bb, or by selecting the car company, model, etc. If the search function is a function unique to the system screen 7 on the host terminal 5 side, the salesperson can lead the negotiation according to the customer's request. If the customer finds a car that interests them, the check box d is marked and the details button e is clicked to check the detailed information of the car. At this time, the guest terminal 6 is viewing the same inventory information as the host terminal 5 side, as shown in FIG. 12, but is purposely different in that it is displayed without a search function.

7 and the like, icons 74a and 74b of files shared during negotiations are displayed in the lower left of the guest camera frame section 72b of the system screen 7. These icons 74a and 74b are files dropped into the system screen 7 by the sales representative during a business negotiation by video call, and the area of the system screen 7 other than the operation area 73 and the camera frame section 72 is saved in the drop storage area 74. For example, if there is a file that is effective for a business negotiation among the files saved in the host terminal 5 and the sales representative wants to share it with a customer, the file is saved in the drop storage area 74 on the host terminal 5 side by dragging the shared file and dropping it into the system screen 7. At this time, by dropping the file, the file is stored in the history information storage section 42b of the server 4. Then, when the file is opened on the host terminal 5 side, the dropped file is also displayed on the guest terminal 6 side, and file sharing becomes possible between the two. The guest terminal 6 does not share the screen of the host terminal 5 itself, but can share files via the storage unit 42 of the server 4, so that the opening/closing, zooming in/out, and downloading of shared files can be performed independently on both the host terminal 5 and the guest terminal 6.

As a result of the above, the same file can be viewed in a clearer state on the host terminal 5 and the guest terminal 6 than when the file is viewed by sharing the screen of the host terminal 5. In addition, since a file can be easily shared during a video call by simply dropping the file, even a first-time user of the service can easily share a file with a customer. In addition, the shared file is iconized and saved in the drop save area 74, so that it is easy to check after saving. Furthermore, if the video call ends and is resumed and the session is called up, the icons 74a and 74b displayed in FIG. 7 are displayed again, so that the dropped file can be opened. Then, the salesperson can share the file with the guest terminal 6 by dropping the file and opening it, i.e., perform the same operation as sending the file to the guest terminal 6, which is very simple compared to the known file sending operation.

Figure 8 shows an example of the display of a chat page 71bc as the content mounted in the frame section 71b on the right side. In this chat page 71bc, a chat can be conducted between the host terminal 5 and the guest terminal 6. When a message is sent from the message field g, the camera image of the host camera frame section 72a and the guest camera frame section 72b may be captured and displayed as the speaker's icon f, or the host terminal 5 may input and set a photo, name, company name, etc. to be displayed in the icon f in advance. In this case, the sender of the chat can be intuitively and immediately recognized as to which side is sending the message. The storage section 42 also stores video calls, chats, and file transmissions and receptions between the host terminal 5 and the guest terminal 6, and stores these contents in association with the access permission information assigned to the "user ID", i.e., the "video call URL". Therefore, even after a terminal change or a video call itself is once terminated, the session can continue based on the previous session contents. Furthermore, the chat processing unit 48 automatically posts access permission information, specifically a link address, that allows access to the file dropped onto the system screen 7 on the conversation screen of the chat page 71bc to both the host terminal 5 and the guest terminal 6. Therefore, by looking at the chat page 71bc, it is possible to check the file exchange history as well as the chat history.

Figure 9 shows an example of the display of a quote page 71ba as content mounted in the right frame 71b. This quote page 71ba lists information that allows a specific quote to be presented when purchasing a car. The page is generated so that operations can be performed only on the host terminal 5 side, and revisions according to customer requests can also be made over a video call. This quote page 71ba is also generated so that a sales contract form is displayed when the sales contract button h of the radio button is clicked. Therefore, by utilizing this right frame 71b, it is possible to proceed with car selection while sharing the same information as the customer, and it is configured to not only confirm and adjust detailed quotes including loan simulations, but also to exchange sales contracts.

As described above, if the content generated in the frame section 71b is information that needs to be shared with the customer and various contents necessary for business negotiations are included, the user can receive the service with the same feeling as if he or she were having a real interview and conducting business negotiations. In this case, by laying out each page (71ba to 71bc) according to categories appropriate for business negotiations, rather than simply summarizing the information to be shared with the customer in the frame section 71b, a user interface that is much easier to use can be realized. In addition, the frame sections 71a and 71b can be made to appear and disappear freely by clicking the operation tabs 70a and 70b. Therefore, the frame sections 71a and 71b can be made to appear and disappear easily without interfering with the display of the camera frame section 72. In addition, the appearance and disappearance of the frame sections 71a and 71b may be in a form in which both users can operate the operation tab 70, but it may also be possible for only the host terminal 5 side to operate it. In this case, the customer side can proceed with the business negotiation in a passive manner without any special operation. In this case, for example, on the host terminal 5 side, while referring to the inventory reference page 71bb, if you want to check the customer's facial expression, you can click the operation tab 70b, and the frame section 71b will immediately be stored and the entire area of the guest camera frame section 72b can be displayed. And because the frame sections 71a, 71b are generated on both the left and right sides in this way, the amount of information that can be referred to in the frame sections 71a, 71b can be increased.

<About the system screen on the guest device>
Next, the display of the system screen 7 on the guest terminal 6 when the service is provided will be described with reference to Figures 10 to 12. Note that the same reference numerals are used in Figures 10 to 12 for matters common to those used in the description of the host terminal 5, but the screen generation unit 43 is programmed to generate screens appropriate for the host terminal 5 and the guest terminal 6. The following mainly describes the differences in the configuration of the system screen 7 for the host terminal 5.

Figure 10(a) is a schematic diagram of a simple email received at the guest terminal 6, opened on the touch panel 64 of the guest terminal 6. Figure 10(b) is a schematic diagram of a display screen for obtaining permission to access the camera 63a. First, the customer taps the URL linked to the simple email shown in Figure 10(a). This displays the screen in Figure 10(b) requesting permission to access the camera 63a. When an operation is performed to permit or cancel access to the camera 63a, a video call is initiated and the system screen 7 is launched on the guest terminal 6.

11 is a diagram showing an example of a state in which the cameras 53a and 63a of both the host terminal 5 and the guest terminal 6 are permitted to access, video calls are possible, and service provision is started. The system screen 7 is a vertically long rectangle that matches the shape of the touch panel 64 of the guest terminal 6, and the system screen 7 includes a camera frame section 72 that displays the users who are making the video call, specifically, the sales representative and the customer captured by the cameras 53a and 63a, a frame section 71 that is configured to appear and disappear freely within the system screen 7, and an operation tab 70 that controls the appearance and disappearance of the frame section 71. The camera frame section 72 includes a host camera frame section 72a that displays the image (sales representative) captured by the camera 53a on the host terminal 5 side, and a guest camera frame section 72b that displays the image (customer) captured by the camera 63a on the guest terminal 6 side. On the system screen 7 on the guest terminal 6 side, the host camera frame section 72a is displayed large across almost the entirety of the system screen 7, and the guest camera frame section 72b is displayed small in the upper left corner of the system screen 7. Note that, although an example is described here in which the cameras 53a, 63a of both the host terminal 5 and the guest terminal 6 are accessible, this is not limiting, and for example, the guest terminal 6 side may communicate by voice only, in which case the guest camera frame section 72b is displayed in an off state.

On the guest terminal 6 as well, the lower section of the system screen 7 is an operation area 73 where various operation buttons are displayed side by side. Here, from the left side, there are a camera switch button 73b for changing the direction of shooting with the camera 63a, a camera off button 73c for stopping shooting with the camera 63a, and an off button 75 for ending the video call. The guest terminal 6 is intentionally configured to have the bare minimum of functions and to make it as easy as possible for the customer to operate, so there is no terminal change button 73a or shooting button 73d, but these may be generated on the guest terminal 6 as well.

In the example of Figure 11, a business card display i is displayed at the top of the system screen 7 so as to overlap the host camera frame portion 72a. This business card display i is the business card of a sales representative, and when the business card display button 73e (see Figure 4(b), etc.) is clicked on the host terminal 5, it is displayed on the guest terminal 6 as shown in Figure 11. This allows the customer to confirm the name of their sales representative.

Figure 12 is a diagram that shows a schematic example of a display in which a business negotiation is in progress via a video call with the host terminal 5, and corresponds to Figure 7 on the host terminal 5 side. The frame portion 71 is generated only on the right side in a roughly rectangular shape, and is generated so that when an operation of the operation tab 70b is detected, the right frame portion 71b slides laterally and protrudes. The operation tab 70b is displayed in a convex shape on the edge portion 70d on the protruding side of the right frame portion 71b. Note that in Figure 11, the right frame portion 71b is shown in a hidden and stored state, and only the operation tab 70b is displayed on the right.

The frame section 71b can be pulled out up to about half the maximum amount of the system screen 7 on a vertically long system screen. In addition, the frame section 71b also generates an estimate page 71ba, an inventory reference page 71bb, and a chat page 71bc, just like the host terminal 5 side, and each page can be referenced by the customer's operation, but text input is limited to the chat page 71bc only. This allows the salesperson to take the lead in proceeding with the business negotiation, and the customer can proceed with the business negotiation by simply looking at the system screen 7. In addition, the frame section 71b on the guest terminal 6 side is configured with a focus on conveying necessary information clearly and in an easy-to-understand manner so that the customer is not overwhelmed with information, so the display contents of the estimate page 71ba and the inventory reference page 71bb are different from those on the host terminal 5 side. For example, the host terminal 5 side can view multiple cars on the inventory reference page 71bb (see FIG. 7), but the guest terminal 6 side displays only one car. In response to a customer's request, the sales representative can operate this inventory reference page 71bb to enlarge the image of the "3.85 million yen" car, and Fig. 12 shows the state in which the image is displayed in enlarged view j on the system screen 7 of the guest terminal 6. In particular, when the guest terminal 6 is a small device such as a smartphone, the display area is approximately 1/6 to 1/8 smaller than that of a desktop computer, so making the information easy to understand is an issue, and by limiting or simplifying the content displayed in the frame section 71b in this way, it becomes easier for customers to obtain the information they want.

<Device change function>
The terminal change operation will be further described with reference to FIGS.
Here, an example will be described in which the host terminal 5 is changed from a personal computer to a smartphone.
Fig. 13(a) is a diagram for explaining the terminal change operation, and shows an example in which the read code k is displayed approximately in the center of the system screen 7 of the host terminal 5. Fig. 13(b) is an example of a block diagram of the changed terminal 8 that has been changed by the terminal change operation.
The change terminal 8 can be any terminal device that can make a video call via the communication network 3 and can transmit and receive data, files, etc. with the server 4, and is not particularly limited thereto. However, as described above, a case where a smartphone is used as the change terminal 8 will be described here. Like the guest terminal 6, the change terminal 8 is also a user terminal that has not been registered for use of the service, in other words, does not need to be registered for use of the service. As shown in FIG. 13(b), the change terminal 8 includes a control unit 80, a communication unit 81, a storage unit 82, a camera, speaker, microphone 83, and a touch panel 84. The control unit 80 includes a CPU, and the CPU executes a predetermined program stored in the storage unit 82 to execute various processes. The communication unit 81 executes transmission and reception of data, files, etc. with the server 4. The storage unit 82 is composed of memories such as ROM and RAM and an HDD, and stores computer programs for transmitting and receiving various data. The touch panel 84 is a user interface that displays various information based on the control of the control unit 60 and accepts a tap operation by the user, and is composed of a display body that can detect contact with an external object. The camera/speaker/microphone 83 may be any that enables video calling in the same manner as the host terminal 5. The code conversion unit 85 converts the read code k displayed on the system screen 7 of the host terminal 5, read by the camera 83a, into access permission information assigned to the video call between the host terminal 5 and the guest terminal 6, specifically, a predetermined "video call URL."

Figure 14 (a) shows the flow after the detection unit 47 detects the operation of the terminal change button 73a. When the sales representative clicks the terminal change button 73a on the host terminal 5, the code conversion unit 46 generates a read code based on the access permission information, i.e., a predetermined "video call URL" (S200). The screen generation unit 43 then generates a screen that displays the read code (S201, see Figure 13 (a)). The read code here is not particularly limited, but examples include two-dimensional codes such as barcodes and QR codes (registered trademark).

14B shows a flow of reading the read code k and changing the terminal. The sales representative reads the read code k, i.e., the QR code (registered trademark) displayed on the system screen 7 of the host terminal 5, with the camera 83a of the change terminal 8 for which the terminal is to be changed (S300). The QR code (registered trademark) read by the change terminal 8 is converted into a predetermined "video call URL" by the code conversion unit 85, and when the sales representative taps and accesses the "video call URL" (S301), the host terminal 5 can be easily switched to the change terminal 8 while maintaining the video call.
Furthermore, when returning from the change terminal 8 to the host terminal 5 of the personal computer, a read code will be displayed by tapping the terminal change button (not shown) on the system screen 7 displayed on the change terminal 8. Similarly, the read code can be read by the camera 53a of the host terminal 5 and a specified "video call URL" can be accessed to continue the video call on the host terminal 5.

Figure 15 is a schematic diagram showing an example of the display on the guest terminal 6 while the terminal is being changed on the host terminal 5 side. As shown here, the video call communication state is not interrupted and is maintained even during the terminal change. Therefore, when the terminal change button 73a is operated on the host terminal 5 side, a message such as "Terminal change in progress, please wait" is displayed in the approximate center of the system screen 7 of the guest terminal 6. At this time, the content of the displayed message is not limited to the above. Even if it is not a message, an hourglass icon may be displayed, or an advertising video or the like may be played even if the change operation (terminal change operation → QR code (registered trademark) reading) does not take much time.

16(a) and (b) are diagrams showing a typical display example of the guest terminal 6, showing an example after the host terminal 5 has changed the terminal used. In a business negotiation scene like this embodiment, it is effectively used when the customer wants to carefully examine the car he is going to buy, not in a photo or catalog, but in the actual car. FIG. 16(a) shows a state in which the seat of the candidate car is displayed at the customer's request. FIG. 16(b) also shows a state in which the area around the shift lever of the candidate car is displayed. In this case, the host terminal 5 is switched from a personal computer to a smartphone, so that the image from the camera 83a mounted on the change terminal 8 is displayed on the host camera frame portion 72a. At this time, the host camera frame portion 72a is displayed large on the system screen 7 on the guest terminal 6 side, so the customer can check the candidate car as if it were a real car. In particular, when the purchase target is a specific item such as a used car, the business negotiation can be carried out while checking the scratches and dirt on the seat portion.

According to the above, for example, if a customer requests to see the actual car (specific item) that they are considering purchasing during a video call negotiation, the sales representative can easily and smoothly change the device from a PC to a smartphone. Even though the negotiation is remote online, the customer can see the actual item they are purchasing, not just a photo or catalog. Furthermore, in remote negotiations, the device can be changed to suit the negotiation scene, such as by conducting face-to-face explanations, contracts, payment processing, etc. on a PC and providing product information on a smartphone.

As described above, the configuration and aspect of the communication system 1 according to the present invention are not limited to the above embodiment. For example, in the above embodiment, a two-party call was described as an example, but two or more parties may be used. When the communication system 1 according to the present invention is used in a group call or online conference, for example, when other people are actively talking or discussing with each other, the terminal can be changed smoothly without interrupting the conversation or disconnecting the session, so it can be used preferably. In addition, an example of communication between a personal computer and a smartphone as the user terminal 2 has been described, but it may also be between smartphones. Although an example of car sales has been described, it can be used in any industry and for any purpose by changing the content mounted on the frame unit 71. For example, in situations such as negotiations with real estate agents and item purchasers, estimates from moving companies, viewing facilities, and on-site inspections of accident situations, the need is not limited to simply making face-to-face calls, but in addition to product information, estimates and contracts can be exchanged and payments can be made on a personal computer, and property selection, site and item confirmation can be performed on a smartphone, etc., by switching between terminals.

To strengthen security, a step may be added in which a customer who has not registered to use the service must enter a password or authentication code before accessing the URL. When a customer accesses a URL linked to a simple email, a cookie may be assigned to the guest terminal 6 as guest terminal identification information, and the "video call URL" may be stored in association with the assigned guest terminal identification information (cookie).

Furthermore, the configuration of the system screen 7 is not limited to the illustrated example. The number of camera frame parts 72 is generated by the number of user terminals 2 that perform video calls, the number of frame parts 71 and the number of various reference pages are not limited to the illustrated example, and the amount of drawing out the frame part 71 is not limited to the illustrated example. For example, when the frame part 71 is drawn out and protruded, it may be displayed on the entire system screen 7, or may be configured to protrude not only from the left and right but also from the top and bottom. The position and size of the camera frame part 72 may be changed appropriately by the user. Furthermore, the appearance and disappearance operation of the frame part 71b by the host terminal 5 side may be configured to be linked to the guest terminal 6 side, or may be configured to be operated individually. If it is configured to be linked to the operation by the host terminal 5 side, there is an advantage that the host terminal 5 side can easily take the initiative. In the above embodiment, since it is assumed that the guest terminal 6 uses a smartphone, the drop storage area 74 and the drop operation are not configured to be detectable, but the guest terminal 6 may also be configured in a similar manner. In the above embodiment, an example of an operation method using clicks and taps is described, but this is not limited to this, and operation using voice recognition is not excluded.

1. Remote interview system (communication system)
2 User terminal 3 Communication network 4 Server 43 Screen generation unit 44 Content generation unit 45 Mail generation and transmission unit 46 Code conversion unit 5 Host terminal 6 Guest terminal 7 System screen 70 Operation tab 71 Frame unit 72 Camera frame unit k Read code

Claims (6)

A communication system that supports a session between a plurality of user terminals connected via a communication network, comprising:
a code conversion unit that converts access permission information assigned to a session between the user terminals into a readable code when a terminal change operation executed in the user terminal is detected;
a communication unit that receives the terminal change operation and transmits the read code to the user terminal that has performed the terminal change;
a screen generating unit that generates a screen for displaying the read code within a system screen that is displayed on the user terminal during the session. In claim 1,
the access permission information is a URL of the session,
The communication system is characterized in that the readable code is a two-dimensional code. In claim 1 or 2,
The communication system, wherein the session includes at least one of a video call, a chat, and an Internet call. In any one of claims 1 to 3,
A storage unit for storing session contents between the user and the terminal,
The communication system according to claim 1, wherein the access permission information and the session content are stored in the storage unit in association with each other. In any one of claims 1 to 3,
The communication system according to the present invention, wherein the session contents include chat history, chat contents, sent and received data history, and sent and received data. A program for supporting a session between a plurality of user terminals connected via a communication network, comprising:
converting access permission information assigned to a session between the user terminals into a readable code when a terminal change operation is received from the user terminal;
receiving the operation to change the terminal and transmitting the read code to the user terminal that performed the operation to change the terminal;
and generating a screen for displaying the read code within a system screen displayed on the user terminal when the session is started, the program comprising:

Images