JP6736919B2 - Communication terminal, communication system, communication method, and program - Google Patents

Description

The present invention relates to a communication terminal, a communication system, a communication method, and a program.

2. Description of the Related Art In recent years, a video conference system for conducting a video conference (also referred to as a "video conference") with a remote place has become widespread in response to a request for reduction of travel expenses and travel time. In such a video conference system, conversation (communication) is realized by transmitting and receiving image data and sound data between communication terminals such as a plurality of video conference terminals (see Patent Document 1).

However, when starting communication with another communication terminal from a predetermined communication terminal, a user of the predetermined communication terminal needs to select desired terminal identification information from destination information such as a destination list. In this case, when a large number of other communication terminals are registered in the destination information, it takes time for the user to search for desired terminal identification information, which causes a problem that communication cannot be started quickly. Has occurred.

The invention according to claim 1 is a communication terminal that communicates with another communication terminal, wherein the storage means stores a plurality of different communication applications for video conferencing, and a destination candidate that requests start of selectable communication. From the display control means for displaying a list on a display screen and the mobile terminal that has acquired specific terminal identification information for identifying the other communication terminal from the other communication terminal by short-range wireless communication, the specific terminal Acquisition means for acquiring identification information by short-range wireless communication; and when the specific terminal identification information is acquired by the acquisition means without selecting a destination candidate from the list of destination candidates by the user, the specific terminal A request for starting a communication for a video conference is made by a specific communication application selected based on the specific terminal identification information among a plurality of different communication applications stored in the storage means , with the identification information as a destination. And a starting unit.

As described above, according to the present invention, it is possible to quickly start communication regardless of whether or not another communication terminal is registered in the destination information.

It is the schematic which showed the communication part of the video conference among the communication systems of this embodiment. It is a hardware block diagram of the video conference terminal which concerns on this embodiment. It is a hardware block diagram of a communication management system and a relay device according to the present embodiment. It is a hardware block diagram of the electronic blackboard which concerns on this embodiment. It is a hardware block diagram of the smart phone which concerns on this embodiment. (A) is a software block diagram of the video conference terminal which concerns on this embodiment, (b) is a software block diagram of the electronic blackboard which concerns on this embodiment. It is the whole communication system lineblock diagram concerning this embodiment. It is each functional block diagram of the communication system concerning this embodiment. It is a conceptual diagram which shows an authentication management table. It is a conceptual diagram which shows a terminal management table. It is a conceptual diagram which shows a destination list management table. It is a conceptual diagram which shows an addition request management table. It is a conceptual diagram which shows the data structure in a near field communication circuit. It is a sequence diagram showing a process of providing terminal identification information. It is the figure which showed the provision screen at the time of providing terminal identification information. It is a sequence diagram showing communication preparation processing. It is an example of a screen showing a destination list. It is a sequence diagram showing a process of providing terminal identification information. 7 is a flowchart showing a destination specifying process. FIG. 8 is a sequence diagram showing a process of adding to the destination list. It is the figure which showed the example of a screen at the time of approving addition to a destination list. It is a sequence diagram showing a method of communicating images and sounds using a communication system.

An embodiment of the present invention will be described below with reference to the drawings.

<<Overall configuration of communication system>>
First, a communication system 1 for performing a video conference between a plurality of communication terminals 10 and 70 will be described with reference to FIG. FIG. 1 is a schematic diagram showing a communication part of a video conference in the communication system of this embodiment.

In some cases, the term “video conference” is used instead of “video conference”. Although a video conference is described here as an example, it may be a simple conversation.

The communication system 1 is constructed by a plurality of communication terminals 10, 70, a relay device 30, and a communication management 50. The communication terminals 10 and 70 perform communication by transmitting and receiving image data and sound data as an example of content data. In FIG. 1, a video conference terminal is shown as an example of the communication terminal 10, and an electronic blackboard is shown as an example of the communication terminal 70. The image of the image data may be a moving image or a still image, or may be both a moving image and a still image.

Further, a communication terminal as a request source for requesting the start of a video conference is represented as a “request source terminal”, and a communication terminal as a destination (relay destination) as a request destination is represented as a “destination terminal”. In FIG. 1, the communication terminal 10 is shown as a request source terminal, and the communication terminal 70 is shown as a destination terminal. However, when requesting the start of the video conference from the communication terminal 70, the communication terminal 70 becomes the request source terminal and the communication terminal 10 becomes the destination terminal. The communication terminals 10 and 70 can be used not only for communication between a plurality of business establishments or communication between different rooms within the same business establishment, but also for communication within the same room or outdoors and indoors or outdoors and outdoors. May be used in communication.

The relay device 30 performs a process of relaying content data between the plurality of communication terminals 10 and 70. The communication management system 50 centrally manages login authentication from the communication terminals 10 and 70, communication status management of the communication terminals 10 and 70, destination list management, communication status of the relay device 30, and the like. The relay device 30 and the communication management system 50 may be constructed by a single computer, or may be constructed by a plurality of computers that are arbitrarily assigned by dividing each unit (function or means). ..

Further, in the communication system 1, a management information session sei for transmitting and receiving various kinds of management information is established between the request source terminal and the destination terminal via the communication management system 50. Further, between the request source terminal and the destination terminal, in order to transmit and receive each of the four data of high resolution image data, medium resolution image data, low resolution image data, and sound data via the relay device 30. 4 sessions are established. In FIG. 1, these four sessions are collectively shown as an image/sound data session sed. Note that the image/sound data session sed does not necessarily have to be four sessions, and may be less or more than four sessions. Further, a communication session may be directly established between the request source terminal and the destination terminal without going through the relay device 30.

Here, the resolution of the image of the image data handled in this embodiment will be described. The low-resolution image data includes, for example, 160 pixels in the horizontal direction and 120 pixels in the vertical direction, and serves as a base image. The image data of medium resolution consists of 320 pixels horizontally and 240 pixels vertically. The high-resolution image data includes, for example, 640 pixels in the horizontal direction and 480 pixels in the vertical direction. Of these, when passing through a narrow band path, low-quality image data consisting of only low-resolution image data serving as a base image is relayed. When the band is relatively wide, medium resolution image data including low resolution image data serving as a base image and medium resolution image data is relayed. When the band is extremely wide, high-quality image data including low-resolution image data, medium-image resolution image data, and high-resolution image data, which are base image quality, is relayed. Since the sound data has a smaller data amount than the image data, it is relayed even through a narrow band path.

<<Hardware Configuration of Embodiment>>
Next, the hardware configuration of this embodiment will be described.

<Hardware configuration of communication terminal 10>
FIG. 2 is a hardware configuration diagram of the communication terminal 10 according to the present embodiment. As shown in FIG. 2, a video conference terminal as an example of the communication terminal 10 of the present embodiment is a CPU 101, a ROM 102, a RAM 103, a flash memory 104, an SSD 105, a media I/F 107, an operation button 108, a power switch 109. , Bus line 110, network I/F 111, camera 112, image sensor I/F, microphone 114, speaker 115, sound input/output I/F 116, display I/F 117, external device connection I/F 118, short-range communication circuit 119, An antenna 119a of the short-range communication circuit 119 is provided. Of these, a CPU (Central Processing Unit) 101 controls the operation of the entire communication terminal 10. A ROM (Read Only Memory) 102 stores a program used for driving the CPU 101 such as an IPL (Initial Program Loader). A RAM (Random Access Memory) 103 is used as a work area for the CPU 101. The flash memory 104 stores various data such as a communication program, image data, and sound data. An SSD (Solid State Drive) 105 controls reading or writing of various data from or to the flash memory 104 under the control of the CPU 101. An HDD may be used instead of the SSD. The media I/F 107 controls reading or writing (storage) of data with respect to the recording medium 106 such as a flash memory. The operation button 108 is a button operated when selecting a destination of the communication terminal 10. The power switch 109 is a switch for switching ON/OFF the power of the communication terminal 10.

A network I/F (Interface) 111 is an interface for performing data communication using the communication network 2 such as the Internet. The camera 112 is a kind of a built-in image pickup unit that obtains image data by picking up an image of a subject under the control of the CPU 101. The image sensor I/F 113 is a circuit that controls driving of the camera 112. The microphone 114 is a kind of built-in sound collecting means for inputting voice. The sound input/output I/F 116 is a circuit that processes input/output of a sound signal between the microphone 114 and the speaker 115 under the control of the CPU 101. The display I/F 117 is a circuit that transmits image data to the external display 120 under the control of the CPU 101. The external device connection I/F 118 is an interface for connecting various external devices. The near field communication circuit 119 is a communication circuit such as NFC (Near Field Communication) (registered trademark) or Bluetooth (registered trademark).

The bus line 110 is an address bus, a data bus, or the like for electrically connecting the constituent elements such as the CPU 101 shown in FIG.

The display 120 is a kind of display means composed of liquid crystal or organic EL for displaying an image of a subject, an operation icon, and the like. Further, the display 120 is connected to the display I/F 117 by the cable 120c. The cable 120c may be a cable for analog RGB (VGA) signals, a cable for component video, or for HDMI (High-Definition Multimedia Interface) or DVI (Digital Video Interactive) signals. May be a cable.

The camera 112 includes a lens and a solid-state imaging device that converts light into an electric charge to digitize an image (video) of a subject. As the solid-state imaging device, a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled) is used. Device) etc. are used. External devices such as an external camera, an external microphone, and an external speaker can be connected to the external device connection I/F 118 by a USB (Universal Serial Bus) cable or the like. When an external camera is connected, the external camera is driven in preference to the built-in camera 112 under the control of the CPU 101. Similarly, when the external microphone is connected or when the external speaker is connected, the external microphone and the internal microphone 114 are given priority over the internal microphone 114 and the internal speaker 115, respectively, under the control of the CPU 101. An external speaker drives.

Further, the recording medium 106 is configured to be removable from the communication terminal 10. Further, as long as it is a non-volatile memory that reads or writes data under the control of the CPU 101, not only the flash memory 104 but also an EEPROM (Electrically Erasable and Programmable ROM) or the like may be used.

<Hardware configuration of communication management system and relay device>
FIG. 3 is a hardware configuration diagram of the communication management system 50 and the relay device 30 according to the present embodiment. A server computer as an example of the communication management system 50 includes a CPU 501, a ROM 502, a RAM 503, an HD 504, an HDD (Hard Disk Drive) 505, a recording medium 506, a media I/F 507, a display 508, a network I/F 509, a keyboard 511, a mouse 512. , A CD-ROM drive 514, and a bus line 510.

Of these, the CPU 501 controls the overall operation of the communication management system 50. The ROM 502 stores a program used for driving the CPU 501 such as an IPL. The RAM 503 is used as a work area for the CPU 501. The HD 504 stores various data such as a communication management program. An HDD (Hard Disk Drive) 505 controls the reading or writing of various data with respect to the HD 504 under the control of the CPU 501. The media I/F 507 controls reading or writing (storage) of data with respect to the recording medium 506 such as a flash memory. The display 508 displays various information such as a cursor, a menu, a window, characters, and an image. The network I/F 509 is an interface for performing data communication using the communication network 2 such as the Internet. The keyboard 511 is a type of input means including a plurality of keys for inputting characters, numerical values, various instructions, and the like. The mouse 512 is a kind of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. The CD-ROM drive 514 controls reading or writing of various data with respect to a CD-ROM (Compact Disc Read Only Memory) 513 as an example of a removable recording medium.

Further, the bus line 510 is an address bus, a data bus, or the like for electrically connecting the respective components such as the CPU 501 shown in FIG.

Further, the hardware configuration of the relay device 30 illustrated in FIG. 1 is similar to the hardware configuration of the communication management system 50, and thus the description thereof will be omitted. However, in the case of the relay device 30, the relay program is stored in the HD 504.

<Hardware configuration diagram of electronic blackboard>
FIG. 4 is a hardware configuration diagram of the electronic blackboard according to the present embodiment. As shown in FIG. 4, the electronic blackboard as an example of the communication terminal 70 includes a CPU 701, a ROM 702, a RAM 703, an SSD 704, a network controller 705, and an external storage controller I/F 706.

Of these, the CPU 701 controls the operation of the entire electronic blackboard. The ROM 702 stores programs used to drive the CPU 701 such as the CPU 701 and the IPL. The RAM 703 is used as a work area for the CPU 701. The SSD 704 stores various data such as a program for an electronic blackboard. The network controller 705 controls communication with the communication network 2. The external storage controller 706 controls communication with the USB memory 755 and external devices (camera 762, speaker 765, microphone 764).

The electronic blackboard also includes a capture device 711, a GPU 712, a display controller 713, a contact sensor 714, a sensor controller 715, an electronic pen controller 716, a short-range communication circuit 719, and an antenna 719a of the short-range communication circuit 719.

Of these, the capture device 711 causes the display of the notebook PC 756 to display video information as a still image or a moving image. A GPU (Graphics Processing Unit) 712 is a semiconductor chip that specializes in graphics. The display controller 713 controls and manages screen display in order to output the output image from the GPU 712 to the display 753 and the like. The contact sensor 714 detects that the electronic pen 754, the user's hand H, or the like touches the display 753. The sensor controller 715 controls the processing of the contact sensor 714. The contact sensor 715 inputs coordinates and detects coordinates by an infrared ray blocking method. The method of inputting the coordinates and detecting the coordinates is such that two light receiving and emitting devices (not shown) installed at both ends of the upper side of the display 753 emit a plurality of infrared rays in parallel with the display 753, and the surroundings of the display 753. This is a method of receiving light that is reflected by a reflecting member provided on the optical axis and returns on the same optical path as the optical path of the light emitted by the light receiving element. The contact sensor 714 outputs the ID (Identification) of infrared rays emitted by the two light emitting/receiving devices blocked by the object to the sensor controller 715, and the sensor controller 715 identifies the coordinate position which is the contact position of the object. The electronic pen controller 716 communicates with the electronic pen 754 to determine whether the display 753 is touched with the pen tip or the pen bottom. The short-distance communication circuit 719 is a communication circuit such as NFC (registered trademark) or Bluetooth (registered trademark).

Further, the bus line 710 is an address bus, a data bus or the like for electrically connecting the respective constituent elements such as the CPU 701 shown in FIG.

The contact sensor 715 is not limited to the infrared blocking method, but is a capacitive touch panel that identifies a contact position by detecting a change in capacitance, and a contact position is identified by a voltage change between two opposing resistance films. Various detection means such as a resistive film type touch panel, an electromagnetic induction type touch panel for identifying the contact position by detecting electromagnetic induction generated when a contact object touches the display unit may be used. Further, the electronic pen controller 716 may determine whether or not the portion of the electronic pen 754 held by the user or the portion of the other electronic pen is touched, in addition to the tip and the pen tip of the electronic pen 754.

<Smartphone hardware configuration>
FIG. 5 is a hardware configuration diagram of the mobile terminal according to the present embodiment. The mobile terminal 90 is any mobile terminal among mobile terminals 90a and 90b shown in FIG. 7 described later. As shown in FIG. 5, a smartphone as an example of the mobile terminal 90 includes a CPU 901, a ROM 902, a RAM 903, an EEPROM 904, a CMOS sensor 905, an acceleration/direction sensor 906, a media I/F 908, and a GPS receiver 909. ing.

Of these, the CPU 901 controls the operation of the entire mobile terminal 90. The ROM 902 stores programs used to drive the CPU 901 such as the CPU 901 and the IPL. The RAM 903 is used as a work area for the CPU 901. An EEPROM (Electrically Erasable and Programmable ROM) 904 reads or writes various data such as a mobile terminal program under the control of the CPU 901. A CMOS (Complementary Metal Oxide Semiconductor) sensor 905 captures an image of a subject and obtains image data under the control of the CPU 901. The acceleration/direction sensor 906 is various sensors such as an electronic magnetic compass that detects geomagnetism, a gyro compass, and an acceleration sensor. The media I/F 908 controls reading or writing (storage) of data with respect to the recording medium 907 such as a flash memory. The GPS receiver 909 receives GPS signals from GPS satellites.

The mobile terminal 90 includes a long-distance communication circuit 911, a camera 912, an image pickup device I/F 913, a microphone 914, a speaker 915, a sound input/output I/F 916, a display 917, an external device connection I/F 918, and a short-distance communication circuit. A near field communication circuit antenna 919a and a touch panel 921 are provided.

Of these, the long-distance communication circuit 911 is a circuit that communicates with other devices via the communication network 3 such as a mobile communication network. The camera 912 is a type of a built-in image pickup unit that obtains image data by capturing an image of a subject under the control of the CPU 901. The image sensor I/F 913 is a circuit that controls driving of the camera 912. The microphone 914 is a kind of built-in sound collecting means for inputting voice. The sound input/output I/F 916 is a circuit that processes input/output of a sound signal between the microphone 914 and the speaker 915 under the control of the CPU 901. The display 917 is a kind of display means such as a liquid crystal display or an organic EL display that displays an image of a subject and various icons. The external device connection I/F 918 is an interface for connecting various external devices. The short-range communication circuit 919 is a communication circuit such as NFC (registered trademark) or Bluetooth (registered trademark). The touch panel 921 is a kind of input means for operating the smartphone when the user presses the display 917.

Further, the bus line 910 is an address bus, a data bus or the like for electrically connecting the respective constituent elements such as the CPU 901 shown in FIG.

The mobile terminal 90 may be not only a smartphone but also a smart watch, a mobile phone, a mobile game machine, or the like.

Further, each of the above programs may be a file in an installable format or an executable format, and may be recorded in a computer-readable recording medium for distribution. Examples of recording media include CD-R (Compact Disc Recordable), DVD (Digital Versatile Disk), Blu-ray disc, SD card, and the like.

<Software configuration of communication terminal>
FIG. 6A is a software configuration diagram of the video conference terminal. As shown in FIG. 6A, the OS (Operating System) 1020, the communication application A1, the communication application A2, and the communication application A3 operate on the work area 1020 of the RAM 103. Hereinafter, the application will be referred to as an “app”.

The OS 1020 is basic software that provides basic functions and manages the entire video conference terminal. The communication applications A1, A2, A3 are applications for communicating with other terminals and have different communication protocols. The communication protocol includes a call control method, a video encoding method, and the like. Examples of this call control method include SIP (Session Initiation Protocol), H.323, SIP extension protocol, instant messenger protocol, SIP MESSAGE method protocol, and Internet relay chat protocol (IRC (Internet Relay Chat )), an extended protocol of the instant messenger protocol, and the like. Among them, the instant messenger protocol is, for example, (4-1)XMPP (Extensible Messaging and Presence Protocol), or (4-2)ICQ (registered trademark), AIM (registered trademark), or Skype (registered trademark). Is a protocol used in. A protocol that extends the instant messenger protocol is, for example, Jingle. In addition, examples of video encoding methods include H.264/SVC, H.264/AVC, and H.265/HEVC.

Also, FIG. 6B is a software configuration diagram of the electronic blackboard. As shown in FIG. 6B, the OS 7020, the communication application A1, the communication application A2, and the communication application 3 operate on the work area 7010 of the RAM 703.

The OS 7020 is basic software that provides basic functions and manages the entire electronic blackboard. The communication applications A1, A2, A3 are the same as the communication applications A1, A2, A3 of the video conference terminal, respectively. Although three types of communication applications have been described for convenience of description, one type, two types, or four or more types may be used.

The OSs 1020, 7020 and the communication applications A1, A2, A3 have been installed in the video conference terminal and the electronic blackboard before factory shipment, respectively.

However, the application may be added or deleted when the software of the video conference terminal is updated after the factory shipment. Specifically, even after the video conference terminal is provided to the user, the video conference terminal can access the communication management system 50 from the video conference terminal to download new software. Further, the video conference terminal can update its own software with the downloaded new software. When the software of the video conference terminal is updated in this way, the software of the video conference terminal itself is updated, and thus the installed communication application can be changed. The electronic blackboard is the same with this update. When the communication application corresponding to the terminal identification information is not installed on the video conference terminal or the electronic blackboard, the video conference terminal or the electronic blackboard displays a message indicating that the available communication application is not installed. Alternatively, a message prompting the user to install a usable communication application may be displayed.

<<Overall configuration of communication system>>
Next, the overall configuration of the communication system will be described with reference to FIG. FIG. 7 is an overall configuration diagram of the communication system according to the embodiment of the present invention.

In FIG. 7, the communication terminal 10, the relay device 30, the communication management system 50, and the communication terminal 70 are connected to the communication network 2 including the Internet. The communication network 2 may include a wireless communication part. The communication terminal 10 is installed at the site A, and the communication terminal 70 is installed at the site D. For example, the base A is in Japan and the base D is in the United Kingdom. In FIG. 7, the user X at the base D moves to the base A with the mobile terminal 90a and starts communication from the communication terminal 10 at the base A to the communication terminal 70 at the base A. It shows the situation of a video conference with the person Y. The mobile terminal 90d can communicate with the mobile terminal 90a via the base station 3d, the communication network 3 such as a mobile communication network, and the base station 3a. In FIG. 7, the communication terminal 10 is the first communication terminal and the communication terminal 70 is the second communication terminal.

<<Functional Configuration of Embodiment>>
Next, the functional configuration of this embodiment will be described with reference to FIGS. 2 to 5 and 8. FIG. 8 is a functional block diagram of the communication system according to the present embodiment.

<Functional configuration of communication terminal 10>
The communication terminal 10 includes a transmission/reception unit 11, a reception unit 12, a communication control unit 13, a display control unit 14, a determination unit 15, a selection unit 16, an activation unit 17, an acquisition/providing unit 18, and a storage/readout processing unit 19. doing. Each of these units has a function realized by any of the components shown in FIG. 2 being operated by an instruction from the CPU 101 according to a communication program expanded from the flash memory 104 onto the RAM 103, or It is a functioning means. Further, the communication terminal 10 has a RAM 103 shown in FIG. 2 and a storage unit 1000 constructed by the flash memory 104 shown in FIG.

(Each functional configuration of the communication terminal 10)
Next, each component of the communication terminal 10 will be described. The transmission/reception unit 11 is realized by an instruction from the CPU 101 shown in FIG. 2, a network I/F 111 and an external device connection I/F 118, and other terminals, devices or systems and various data (via the communication network 2). Or send/receive information). The transmission/reception unit 11 starts receiving, from the communication management system 50, status information indicating the status of each communication terminal 10, 70 as a destination candidate before starting communication with the other communication terminals 10, 70. It should be noted that this state information is not limited to the operating state of each communication terminal 10, 70 (state of ON line or OFF line), but even if it is an ON line, further communication is possible, communication is in progress, or remote It shows detailed status such as whether you are in a seat. Hereinafter, as an example, a case where the state information indicates the operating state will be described.

Further, the transmission/reception unit 11 also functions as a start unit, and performs a process of starting communication with another communication terminal such as the communication terminal 70.

The accepting unit 12 is mainly realized by a command from the CPU 101 and the operation button 108 and the power switch 109 shown in FIG. 2, and accepts various inputs by the user.

The communication control unit 13 is realized by a command from the CPU 101 shown in FIG. 2, a camera 112 and an image sensor I/F 113, images a subject, and outputs image data obtained by this image capture. Further, the communication control unit 13 is realized by a command from the CPU 101 and a voice input/output I/F 116 shown in FIG. 2, and after the voice of the user is converted into a voice signal by the microphone 114, this voice signal is transmitted. Input sound data. Further, the communication control unit 13 is realized by a command from the CPU 101 shown in FIG. 2 and the voice input/output I/F 116 shown in FIG. 2, and outputs a voice signal related to sound data to a speaker, A voice is output from the speaker 115.

The display control unit 14 is realized by the command from the CPU 101 shown in FIG. 2 and the display I/F 117 shown in FIG. 2, and combines the received image data of different resolutions, and the combined image. Control is performed to send data to the display 120. The display control unit 14 can transmit the information of the destination list received from the communication management system 50 to the display 120 and display the destination list on the display 120.

The determination unit 15 is realized by an instruction from the CPU 101 shown in FIG. 2 and determines whether or not the vehicle is in proximity, which will be described later.

The selection unit 16 is realized by a command from the CPU 101 by the activation application 1030 illustrated in FIG. 6A, and selects the communication application to be activated based on the terminal identification information.

For example, when the terminal identification information is the terminal ID, the communication application A1 is selected. In the case of the terminal ID, the selection unit 16 makes a selection by judging whether or not the description format is simply a list of characters and symbols.

When the terminal identification information is the IP address for accessing the communication terminal, the communication application A2 is selected. In the case of an IP address (here, in the case of IPv4), the selection unit 16 makes a selection by judging whether or not the description format represents a 32-bit numerical value that is divided into 4 by 8 bits.

Furthermore, when the terminal identification information is an electronic mail address addressed to each communication terminal, the communication application A3 is selected.
In the case of an e-mail address, it is a character string defined in RFC 2822, and the selection unit 16 determines whether the description format is such that the domain name is on the left side and the mail server is on the right side with "@" in between. Select by.

The terminal identification information includes not only the terminal ID, the IP address, and the e-mail address, but also the user ID for identifying the user of each communication terminal and the name of the user of each communication terminal. The user name is also included.

The activation unit 17 is realized by an instruction from the CPU 101 by the activation application 1030 illustrated in FIG. 6A and activates the communication application selected by the selection unit 16.

The acquisition/provision unit 18 is executed by the command from the CPU 101 and the short-range communication circuit 119 and the antenna 119a shown in FIG. 2, and acquires data by short-range wireless communication with the mobile terminal 90. And provide.

The storage/readout processing unit 19 is executed by an instruction from the CPU 101 and the SSD 105 shown in FIG. 2, stores various data in the storage unit 1000 or the recording medium 1100, or is stored in the storage unit 1000 or the recording medium 1100. Various data are read out and processed. Further, in the storage unit 1000, image data and sound data received when communicating with another communication terminal is overwritten and stored each time it is received. Among these, the image is displayed on the display 120 by the image data before being overwritten, and the sound is output from the speaker 115 by the sound data before being overwritten. The recording medium 1100 is realized by the recording medium 106 shown in FIG.

Note that the terminal identification information of this embodiment is an example of identification information such as a language, characters, symbols, or various indicia used to uniquely identify the communication terminals 10 and 70. Further, the terminal identification information may be identification information in which at least two of the above language, characters, symbols, and various indicia are combined. Further, a user ID for identifying the user of the terminal 10 may be used instead of the terminal ID. In this case, the terminal identification information includes not only the terminal ID but also the manufacturing number of the terminal and the user ID for identifying the user. The user ID also includes the user's name, my number based on the Japanese national uniform number system.

<Functional configuration of relay device>
The relay device 30 includes a transmission/reception unit 31, which also serves as a transfer unit, a determination unit 32, and a storage/readout processing unit 39. Each of these units is a function realized by any one of the components shown in FIG. 3 or a function that is realized by an operation from a CPU 501 according to a relay program expanded from the HD 504 on the RAM 503. Is. Further, the relay device 30 has a storage unit 3000 constructed by the RAM 503 and the HD 504 shown in FIG.

(Functional configuration of relay device)
Next, each functional configuration of the relay device 30 will be described in detail. It should be noted that, in the following, in describing each functional configuration of the relay device 30, the relationship with the main components for realizing each functional configuration of the relay device 30 among the respective components shown in FIG. 3 will also be described. explain.

The transmission/reception unit 31 of the relay device 30 shown in FIG. 8 is realized by the command from the CPU 501 shown in FIG. 3 and the network I/F 509 shown in FIG. It transmits and receives various data (or information) with other terminals, devices, or systems. The transmission/reception unit 31 also functions as a transfer unit, and transfers the image data and sound data transmitted from the communication terminal 10 (70) to the communication terminal 70 (10).

The determination unit 32 is realized by an instruction from the CPU 501 shown in FIG. 3, and determines the delay state of data or the like.

The storage/readout processing unit 39 is realized by an instruction from the CPU 501 shown in FIG. 3 and the HDD 505 shown in FIG. 3, stores various data in the storage unit 3000, and is stored in the storage unit 3000. Various data are read out and processed.

<Functional configuration of communication management system>
The communication management system 50 includes a transmission/reception unit 51, a determination unit 52, and a storage/readout processing unit 59. Each of these units functions or functions realized by any of the components shown in FIG. 8 being operated by an instruction from the CPU 501 according to a communication management program loaded from the HD 504 onto the RAM 503. It is a means. Further, the communication management system 50 has a storage unit 5000 constructed by the HD 504 shown in FIG.

(Authentication management table)
FIG. 9 is a conceptual diagram showing the authentication management table. An authentication management DB 5001 including an authentication management table as shown in FIG. 9 is built in the storage unit 5000. In this authentication management table, each password is associated with each terminal ID of all the communication terminals 10 and 70 managed by the communication management system 50 and managed. For example, the authentication management table shown in FIG. 9 indicates that the terminal ID of the communication terminal 10aa, which is a type of the communication terminal 10, is “01aa” and the password is “aaaa”.

(Terminal management table)
FIG. 10 is a conceptual diagram showing a terminal management table. In the storage unit 5000, a terminal management DB 5002 configured by a terminal management table as shown in FIG. 10 is constructed. In this terminal management table, for each terminal ID of each communication terminal 10, 70, a destination name when each communication terminal 10, 70 is the destination, an operating state of each communication terminal 10, 70, and login request information described below are communicated. The reception date and time received by the management system 50 and the IP addresses of the communication terminals 10 and 70 are associated and managed. For example, in the terminal management table shown in FIG. 10, the terminal 10aa with the terminal ID “01aa” has the destination name “Japan Tokyo Office AA terminal” and the operating state “ON line (communication possible)”. The date and time when the login request information is received by the communication management system 50 is "13:40 on April 10, 2015", and the IP address of this terminal 10aa is "1.2.1.3". It is shown. The terminal ID, the destination name, and the IP address of the terminal are stored when each of the communication terminals 10 and 70 performs pre-registration in order to receive the service provided by the communication management system 50.

(Recipient list management table)
FIG. 11 is a conceptual diagram showing the destination list management table. A destination list management DB 5003 configured by a destination list management table as shown in FIG. 11 is constructed in the storage unit 5000. In this destination list management table, all the terminal IDs of the destination terminals registered as candidates for the destination terminal are managed in association with the terminal IDs of the request source terminals that request the start of communication. For example, in the destination list management table shown in FIG. 11, the candidate of the destination terminal (terminal 10db) that can request the start of communication from the request source terminal (terminal 10aa) whose terminal ID is “01aa” is: It is shown that the terminal ID is “01ab”, the terminal 10ab, the terminal ID is “01ba”, the terminal ID is “01bb”, and the like. This destination terminal candidate is updated by being added or deleted in response to a request from the arbitrary request source terminal to the management system 50 for addition or deletion.

The destination list is an example of the destination information, and the destination information may not be in a list format but may include information about destinations such as terminal IDs.

(Additional request management table)
FIG. 12 is a conceptual diagram showing the addition request management table. In the storage unit 5000, an additional request management DB 5004 including an additional request management table as shown in FIG. 12 is constructed. In the addition request management table, the terminal ID of the call terminal of the request source (hereinafter, referred to as “request source terminal”) that requested the addition of the destination candidate and the call terminal of the request destination for which the addition of the destination candidate is requested (hereinafter, “ The terminal ID of the “request destination terminal” is associated and managed. This makes it possible to manage which communication terminal requests which communication terminal as a destination candidate.

(Each functional configuration of the communication management system)
Next, each functional configuration of the communication management system 50 will be described in detail. In the following, in describing each functional configuration of the communication management system 50, among the respective structural elements shown in FIG. 3, the main structural elements for realizing each functional configuration of the communication management system 50 will be described. The relationship is also explained.

The transmission/reception unit 31 of the communication management system 50 shown in FIG. 8 is realized by the command from the CPU 501 shown in FIG. 3 and the network I/F 509 shown in FIG. It transmits and receives various data (or information) to and from other terminals, devices, or systems.

The determination unit 52 is realized by an instruction from the CPU 501 shown in FIG. 3 and makes various determinations.

The storage/readout processing unit 59 is realized by an instruction from the CPU 501 shown in FIG. 3 and the HDD 505 shown in FIG. 3, and stores various data in the storage unit 5000 or is stored in the storage unit 5000. Various data are read out and processed.

<Functional configuration of communication terminal 70>
The communication terminal 70 includes a transmission/reception unit 71, a reception unit 72, a communication control unit 73, a display control unit 74, a determination unit 75, a selection unit 76, an activation unit 77, an acquisition/provision unit 78, and a storage/readout processing unit 79. doing. Each of these units functions or is realized by any of the components shown in FIG. 4 being operated by an instruction from the CPU 701 according to a communication program expanded from the SSD 704 to the RAM 703. It is a means. Further, the communication terminal 70 has a RAM 703 shown in FIG. 4 and a storage unit 7000 constructed by the SSD 704 shown in FIG.

(Each functional configuration of the communication terminal 70)
Next, each component of the communication terminal 70 will be described. The transmission/reception unit 71 is realized by a command from the CPU 701 shown in FIG. 4, a network I/F 705 and an external device connection I/F 706, and other terminals, devices or systems and various data (via the communication network 2). Or send/receive information). The transmission/reception unit 71 starts receiving, from the communication management system 50, status information indicating the status of each communication terminal 10, 70 as a destination candidate before starting communication with the other communication terminals 10, 70. It should be noted that this state information is not limited to the operating state of each communication terminal 10, 70 (state of ON line or OFF line), but even if it is an ON line, further communication is possible, communication is in progress, or remote It shows detailed status such as whether you are in a seat. In addition, this state information indicates not only the operating states of the communication terminals 10 and 70 but also that the cable 120c is disconnected from the communication terminal 10 in the communication terminal 10, a sound is output but an image is not output, or a sound is output. Indicates various states, such as Disable (MUTE). Hereinafter, as an example, a case where the state information indicates the operating state will be described.

Further, the transmission/reception unit 71 also functions as a start unit, and performs a process of starting communication with another communication terminal such as the communication terminal 10.
The reception unit 72 is mainly realized by the command from the CPU 701 shown in FIG. 4, the contact sensor 715, and the electronic pen controller 716, and receives various inputs from the user.

The communication control unit 73 is realized by a command from the CPU 701 shown in FIG. 4, and performs image processing on image data obtained by the camera 762 capturing an image of a subject. Further, the communication control unit 73 is realized by a command from the CPU 701, and after the voice of the user is converted into a voice signal by the microphone 764, performs voice processing on the sound data related to this voice signal. Further, the communication control unit 73 is realized by a command from the CPU 701 shown in FIG. 4, outputs a sound signal related to sound data to the speaker 765, and causes the speaker 765 to output sound.

Further, the communication control unit 73 performs a process of converting drawing data drawn on the display 753 by the user with the electronic pen 754 or the hand H into coordinate data. When the communication terminal 70 transmits the coordinate data to the other communication terminal 70, the other electronic blackboard displays the drawing of the same content on the display 753 on the other electronic blackboard side based on the coordinate data.

The display control unit 74 is realized by the command from the CPU 701 shown in FIG. 4 and the display controller 713 shown in FIG. Is transmitted to the display 753. The display control unit 74 can transmit the information of the destination list received from the communication management system 50 to the display 753 and display the destination list on the display 753.

The determination unit 75 is realized by an instruction from the CPU 701 shown in FIG.

The selection unit 76 is realized by an instruction from the CPU 701 by the activation application 7030 illustrated in FIG. 6B, and selects the communication application to be activated based on the terminal identification information. The determination of the description format when the selection unit 76 selects is the same as the processing of the selection unit 16 described above.

The activation unit 77 is realized by an instruction from the CPU 701 by the activation application 7030 illustrated in FIG. 6B and activates the communication application selected by the selection unit 76.

The acquisition/provision unit 78 is executed by the command from the CPU 701 shown in FIG. 4 and the short-range communication circuit 719 and the antenna 719a, and acquires data by short-range wireless communication with the mobile terminal 90. And provide.

The acquisition/providing unit 78 is executed by the command from the CPU 701 shown in FIG. 2 and the short-range communication circuit 719 and the antenna 719a, and acquires data by short-range wireless communication with the mobile terminal 90. And provide.

The storage/readout processing unit 79 is executed by the command from the CPU 701 and the SSD 704 shown in FIG. 4, stores various data in the storage unit 7000 or the recording medium 7100, or is stored in the storage unit 7000 or the recording medium 7100. Various data are read out and processed. Further, in the storage unit 7000, image data and sound data received when communicating with another communication terminal are overwritten and stored each time they are received. Among them, an image is displayed on the display 753 by the image data before being overwritten, and a sound is output from the speaker 765 by the sound data before being overwritten. The recording medium 7100 is realized by the USB memory 755 shown in FIG.

<Functional configuration of mobile terminal>
Since the mobile terminals 90a and 90d basically have the same functional configuration, the mechanical configuration of the mobile terminal 90d will be described, and the description of the functional configuration of the mobile terminal 90a will be omitted. In addition, in the code|symbol which shows the function structure of the mobile terminal 90d, and the code|symbol which shows the function structure of the mobile terminal 90a, when "d" and "a" are the same, it has the same function.

The mobile terminal 90d has a transmission/reception unit 91d, a reception unit 92d, a communication control unit 93d, a display control unit 94d, a determination unit 95d, an acquisition/provision unit 98d, and a storage/readout processing unit 99d. Each of these units functions or is realized by any one of the components shown in FIG. 5 being operated by an instruction from the CPU 901 according to a communication program expanded from the EEPROM 904 to the RAM 903. It is a means. Further, the mobile terminal 90 has a RAM 903 shown in FIG. 5 and a storage unit 9000d constructed by the EEPROM 904 shown in FIG.

(Each functional configuration of the mobile terminal)
Next, each component of the mobile terminal 90d will be described. The transmission/reception unit 91d is realized by a command from the CPU 901 shown in FIG. 5, a long-distance communication circuit 911 and an antenna 911a, and various data (call data, etc.) with other terminals, devices or systems via the communication network 3. ) Is sent and received.

The reception unit 92d is mainly realized by the command from the CPU 901 and the touch panel 921 shown in FIG. 5, and receives various inputs by the user.

The communication control unit 93d is realized by a command from the CPU 901 and the image sensor I/F 913 shown in FIG. 5, and performs image processing on image data obtained by capturing an image of a subject by the camera 912. Further, the communication control unit 93d is realized by a command from the CPU 901 and a sound input/output I/F 916, and after the voice of the user is converted into a voice signal by the microphone 914, the sound data relating to this voice signal is output. Performs voice processing. Further, the communication control unit 93d is realized by a command from the CPU 901 and a sound input/output I/F 916 shown in FIG. 5, outputs a sound signal related to sound data to the speaker 915, and outputs a sound from the speaker 915. Let

The display control unit 94d is realized by a command from the CPU 901 shown in FIG. 5, and performs control for displaying image data on the display 917.

The judgment unit 95d is realized by an instruction from the CPU 901 shown in FIG. 5, and judges the response content described later.

The acquisition/providing unit 98d is executed by the command from the CPU 901 shown in FIG. 5 and the short-range communication circuit 919 and the antenna 919a, and performs data communication with the communication terminals 10 and 70 by short-range wireless communication. Acquire and provide.

The storage/readout processing unit 99d is executed by the instruction from the CPU 901 and the EEPROM 904 shown in FIG. 5, stores various data in the storage unit 9000d, and reads out various data stored in the storage unit 9000d. I do. In addition, the storage/readout processing unit 99d performs processing of storing various data in the recording medium 9100d and reading out various data stored in the recording medium 9100d.

(Data structure in short-range communication circuit)
FIG. 13 is a conceptual diagram showing a data structure in the near field communication circuit. A data structure as shown in FIG. 13 is constructed in the short-range communication circuit 919. In this data structure, data is managed for each block No. The block NO1 manages the unique number of the short-range communication circuit 919, and the block 2 manages the user name of the mobile terminal 90 including the short-range communication circuit 919.

Further, in blocks NO3 to NO5, the terminal identification information (acquisition) which is the terminal identification information of the communication terminals 10 and 70 that the mobile terminal 90 has acquired from the communication terminals 10 and 70 by the short-range wireless communication is managed. The (acquired) terminal identification information (1), (2), and (3) indicate the terminal ID, the IP address, and the electronic mail address, respectively. Blocks NO6 to NO8 are terminal identification information that the mobile terminal 90 has received the terminal identification information of the communication terminals 10 and 70 transmitted from another mobile terminal 90 via the communication network 3 (reception ) Terminal identification information (1), (2), (3) is managed.

<<Process or Operation of Embodiment>>
Next, processing or operation in the communication system 1 according to the present embodiment will be described with reference to FIGS. 14 to 22. First, the situation in this embodiment will be briefly described. When the user X (Kato) of the base D makes a business trip to the base A, the user X acquires the terminal ID of the communication terminal 70 by holding his/her mobile terminal 90a over the communication terminal 70 before the business trip. After the user X arrives at the location A, the communication terminal 10 acquires the terminal ID of the communication terminal 70 by holding the mobile terminal 90a over the communication terminal 10 at the location A. In this state, when the user X makes a video conference with the user Y (James) remaining at the base D, the user X makes a phone call to the user Y and conducts a video conference by the communication terminal 10 and the communication terminal 70. Tell the effect. Thereby, the communication terminal 10 starts a video conference with the communication terminal 70 via the communication network 2 using the terminal ID. Hereinafter, it will be described more specifically.

First, the case where the mobile terminal 90d acquires the terminal identification information for identifying the communication terminal 70db from the communication terminal 70db, which is a type of the communication terminal 70, will be described with reference to FIG. Note that FIG. 14 is a sequence diagram showing a process of providing terminal identification information. FIG. 15 is a diagram showing a provision screen when the terminal identification information is provided. Here, a case where a terminal ID is acquired as one type of terminal identification information will be described.

The user X of the site D operates the communication terminal 70db using the electronic pen 754 or the hand H, so that the reception unit 72 of the communication terminal 70db receives the display of the terminal identification information provision screen (step S21). Then, the display control unit 74 causes the display 753 to display the provision screen as shown in FIG. 15 (step S22).

Next, the determination unit 75 determines whether or not the mobile terminal 90a is near (step S23). Hereinafter, a case where the user X brings the mobile terminal 90a close to the communication terminal 70db will be described.

The storage/read processing unit 79 of the communication terminal 70db reads the terminal ID of the communication terminal 70db from the storage unit 7000 (step S24).

Next, the acquisition/providing unit 78 transmits storage request information indicating a storage request to the mobile terminal 90a by short-range wireless communication (step S25). The storage request information includes the terminal ID read in step S24 and storage location information indicating the storage location in the mobile terminal 90a. On the other hand, the acquisition/providing unit 98a of the mobile terminal 90a receives the storage request information. Thereby, the acquisition/providing unit 98a acquires the terminal ID and the storage location information. Then, the storage/readout processing unit 99a stores the terminal ID in the storage unit 9000a based on the storage location information (step S27). Here, the terminal ID is stored in the block NO3 shown in FIG.

After that, as shown in FIG. 7, the user X at the base D moves to the base A. Then, the user X prepares for communication with the user Y at the site D for the video conference.

Next, a process for preparing communication for a video conference between the communication terminals 10aa and 70db will be described with reference to FIGS. 16 and 17. FIG. 16 is a sequence diagram showing a communication preparation process. FIG. 17 is an example of a screen showing a destination list.

Here, the communication terminal 10 shown in FIG. 7 is represented as the communication terminal 10aa, and communication with the communication terminal 10ab of the same type will also be described. Further, in FIG. 16, only the communication terminal 10aa and the communication terminal 10ab are shown via the communication management system 50 for the sake of simplicity.

First, when the user X operates the operation button 108 shown in FIG. 2 to request activation of the activation application 1030, the reception unit 12 accepts the activation request and activates the activation application 1030 (step S61). ). Then, the transmission/reception unit 11 transmits login request information indicating a login request to the communication management system 50 via the communication network 2 (step S62). The login request information includes a terminal ID for identifying the communication terminal 10 which is the terminal itself and a password. These terminal ID and password are data read from the storage unit 1000 via the storage/readout processing unit 19 and sent to the transmission/reception unit 11.

Next, the storage/readout processing unit 59 of the communication management system 50 uses the terminal ID and password included in the login request information received via the transmission/reception unit 51 as a search key to open the authentication management table (see FIG. 9). The terminal authentication is performed by searching and determining whether the same terminal ID and the same password are managed (step S63). When the storage/read processing unit 59 manages the same terminal ID and the same password, it is determined that the login request is made from the communication terminal 10 in which the startup application having the proper usage authority is installed. In addition, the storage/read processing unit 59 changes the field portion of the operating state of the record of the terminal ID received in step S62 to “ON line (communicable)” in the terminal management table (see FIG. 10). At the same time, the reception date and time at which the login request information was received in step S63 is stored in the reception date and time field portion (step S64). As a result, in the terminal management table, the terminal ID “01aa”, the operating state “online (communicable)”, the reception date and time “2015.4.10.13:40”, and the IP address “1.2.1.3”. Will be managed in association with each other. The IP address of the terminal may be transmitted from the communication terminal 10aa in step S62, instead of being registered in advance.

Then, the transmission/reception unit 51 of the communication management system 50 transmits the authentication result information indicating the authentication result obtained by the storage/read processing unit 59 via the communication network 2 to the request source terminal (communication It is transmitted to the terminal 10aa) (step S65). In the present embodiment, a case in which the storage/read processing unit 59 determines that the communication terminal has a valid usage right will be continuously described below.

When the transmission/reception unit 11 of the request source terminal (communication terminal 10aa) receives the authentication result information indicating the result of the determination that the communication terminal has the proper usage authority, the transmission/reception unit 11 transmits the communication result via the communication network 2. The destination list request information indicating that the destination list is requested is transmitted to the communication management system 50 (step S66). As a result, the transmission/reception unit 51 of the communication management system 50 receives the destination list request information.

Next, the storage/read processing unit 59 searches the destination list management table (see FIG. 11) using the terminal ID “01aa” of the request source terminal (communication terminal 10aa) that has made the login request as a search key, and the request source terminal ( The terminal ID of the destination candidate that can communicate with the terminal 10aa) is read out, and the destination name corresponding to this terminal ID is read out from the terminal management table (see FIG. 10) (step S67). Here, each terminal ID (“01ab”,...) Of the destination candidates (10ab,...) Corresponding to the terminal ID “01aa” of the request source terminal (communication terminal 10aa) and the corresponding destinations. The name (“AB terminal of Japan Tokyo office”,...) Is extracted.

Next, the transmission/reception unit 51 of the communication management system 50 reads out the data of the destination list frame and the data of the icon indicating the operating state from the storage unit 5000 via the storage/readout processing unit 59 (step S68), and at the same time, the destination list. The “source list information (destination list frame, icon, terminal ID, destination name)” including the frame and the icon, and the terminal ID and the destination name read by the storage/read processing unit 59 is transmitted to the request source terminal (communication terminal 10aa) (step S69). As a result, in the request source terminal (communication terminal 10aa), the transmission/reception unit 11 receives the destination list information, and the storage/read processing unit 19 stores the destination list information in the storage unit 1000 (step S70).

As described above, in this embodiment, the communication management system 50 centrally manages the destination list information of all the communication terminals, instead of managing the destination list information in each communication terminal. Therefore, the communication system 1 may include a new communication terminal, a communication terminal of a new model may be included in place of the communication terminal already included, and the appearance of the destination list frame may be changed. Even in the case of the above, since the communication management system 50 side collectively handles, it is possible to save the trouble of changing the destination list information on each communication terminal side.

Further, the storage/read processing unit 59 of the communication management system 50 searches the terminal management table (see FIG. 10) using the terminal ID (“01ab”,...) Of the read destination candidate described above as a search key. By reading out the corresponding operating state for each terminal ID, each operating state of the communication terminal (10ab,...) As a destination candidate is acquired (step S71).

Next, the transmission/reception unit 51 sends the “terminal operating status information” including the terminal IDs as the search keys used in step S67 and the operating statuses of the corresponding destination terminals to the communication network 2. It transmits to the request origination terminal (communication terminal 10aa) via (step S72).

Next, the storage/read processing unit 19 of the request source terminal (communication terminal 10aa) sequentially stores the terminal status information received from the communication management system 50 in the storage unit 1000 (step S73). Therefore, the request source terminal (communication terminal 10aa) receives the status information of each of the communication terminals, and thereby receives the state information of the communication terminal 10ab or the like that is a destination candidate capable of communicating with the request source terminal (communication terminal 10aa). Each operating status can be acquired.

Next, the display control unit 14 of the request source terminal (communication terminal 10aa) reflects the state of the communication terminal as a destination candidate based on the destination list information stored in the storage unit 1000 and the state information of the terminal. While creating the destination list, the display controller 14 displays the destination list shown in FIG. 17 on the display 120 shown in FIG. 2 (step S74). The icon indicating the operating state is shown at the left end of each destination. In FIG. 17, the icons indicating the operating states of the respective communication terminals are “online (communicable)”, “offline”, “online (communicable)”, and “online (in communication)” from the top. Showing.

On the other hand, the storage/read processing unit 59 of the communication management system 50 searches the destination list management table (see FIG. 11) based on the terminal ID “01aa” of the request source terminal (communication terminal 10aa) that has made the login request. Then, the terminal IDs of other request source terminals that have registered the terminal ID “01aa” of the request source terminal (communication terminal 10aa) as a destination candidate are extracted (step S75). In the destination list management table shown in FIG. 11, the terminal IDs of the other start request source terminals that are read are "01ab", "07db", and the like.

Next, the storage/read processing unit 59 of the communication management system 50 searches the terminal management table (see FIG. 10) based on the terminal ID “01aa” of the request source terminal (communication terminal 10aa) that has made the login request. Then, the operating state of the request source terminal (communication terminal 10aa) that has made the login request is acquired (step S76).

Then, the transmitting/receiving unit 51 operates in the terminal management table (see FIG. 10) of the communication terminals (10ab, 70db,...) Associated with the terminal IDs (“01ab”, “07db”, etc.) extracted in step S75. The communication terminal (10ab,...) whose status is “online” includes the terminal ID “01aa” of the request source terminal (communication terminal 10aa) acquired in step S76 and the operating status “online”. State information” is transmitted (step S77). When the transmission/reception unit 51 transmits the terminal status information to the communication terminals (10ab,... ), it is managed by the terminal management table (see FIG. 10) based on each terminal ID (“01ab”,... ). The IP address of the existing communication terminal is referred to. Thereby, the terminal of the request source terminal (communication terminal 10aa) for which the login request is made to each of the other destination terminals (10ab,...) That can communicate with the request source terminal (communication terminal 10aa) for which the login request is made as a destination candidate. The ID “01aa” and the operating status “online” can be transmitted. As a result, the destination candidate (communication terminal 10ab) can also display the state of the destination candidate as shown in FIG. 16 (step S78).

Subsequently, a case where the communication terminal 10aa acquires the terminal identification information for identifying the communication terminal 70db from the mobile terminal 90a will be described with reference to FIGS. 18 and 19. Note that FIG. 18 is a sequence diagram showing a process of acquiring terminal identification information. FIG. 19 is a flowchart showing the destination specifying process.

First, with the destination list shown in FIG. 17 being displayed on the display 120, the user X who has moved to the site A brings the mobile terminal 90 a closer to the communication terminal 10. On the other hand, in the communication terminal 10aa, the determination unit 15 determines whether or not the mobile terminal 90a is near (step S81). Hereinafter, a case where the user X brings the mobile terminal 90a close to the communication terminal 10 will be described.

The acquisition/providing unit 98a of the communication terminal 10aa transmits a request for reading the terminal identification information to the mobile terminal 90a by short-range wireless communication (step S82). On the other hand, the storage/readout processing unit 99a of the mobile terminal 90a reads out the terminal identification information (here, the terminal ID) of the communication terminal 70db from the storage unit 9000a (step S83).

Next, the acquisition/providing unit 98a transmits the terminal ID to the communication terminal 10aa by short-range wireless communication (step S84). Thereby, the acquisition/providing unit 18 of the communication terminal 10aa acquires the terminal ID. Then, the storage/readout processing unit 19 stores the terminal ID in the storage unit 1000 (step S85).

Next, the communication terminal 10aa performs a process of identifying the destination using the terminal identification information (here, terminal ID) received in step S85 (step S86). Here, the process of step S86 will be described in detail with reference to FIG.

As illustrated in FIG. 19, the selection unit 16 selects a communication application to be activated, based on the terminal identification information (step S86-1). Here, since the terminal identification information is the terminal ID, the communication application A1 that requires the terminal ID to start communication is selected. Then, the activation unit 17 activates the communication application A1 (step S86-2).

Next, the storage/read processing unit 99a searches the destination list information stored in the storage unit 1000 in step S70, using the terminal ID received in step S84 as a search key (step S86-3). Then, when it is determined in step S86-3 that the address list information is included in the destination list information (YES), the process proceeds to step S121 described below. On the other hand, if it is determined in step S86-4 that the address list information is not included (NO), the process proceeds to step S101.

Subsequently, the process of adding the destination list will be described with reference to FIGS. 20 and 21. FIG. 20 is a sequence diagram showing the process of adding to the destination list. FIG. 21 is a diagram showing a screen example in the case of approval for addition to the destination list.

Note that a case will be described here where the communication terminal 10aa makes an approval request to the communication terminal 70db for adding the communication terminal 70db to the destination list of the communication terminal 10aa.
Here, the communication terminal 10aa is a “request source terminal”, and the communication terminal 70db is a “request destination terminal”.

First, the transmission/reception unit 11 of the request source terminal (communication terminal 10aa) transmits, to the communication management system 50 via the communication network 2, addition request information indicating a request to add a destination candidate (step S101). The addition request information includes a terminal ID for identifying the request source terminal (communication terminal 10aa) and a terminal ID "07db" for identifying the request destination terminal (communication terminal 70db). As a result, the transmission/reception unit 51 of the communication management system 50 receives the addition request information.

Next, in the communication management system 50, the storage/read processing unit 59 causes the terminal ID field of the request source terminal of the new record of the addition request management table (see FIG. 12) to include the terminal ID of the received request source terminal. "01aa" is stored and managed, and the terminal ID "07db" of the request destination terminal is additionally stored and managed in the terminal ID field of the request destination terminal of the new record (step S102).

Next, the determination unit 52 determines the corresponding operating state by searching the terminal management table (see FIG. 9) based on the terminal ID “07db” of the request destination terminal (step S103). Then, when the determination unit 52 determines that the operating state is online but communication is not started, the transmission/reception unit 51 continues to request the addition request to the request destination terminal (communication terminal 70db). The additional approval request information indicating a request as to whether or not to approve is transmitted (step S104). This additional approval request information includes the terminal ID “01aa” of the request source terminal. As a result, the transmission/reception unit 71 of the request destination terminal (communication terminal 10db) receives the additional approval request information.

Next, in the request destination terminal (communication terminal 70db), the display control unit 74 displays the addition request response screen as shown in FIG. 21 on the display 753 (step S105).

Next, the transmission/reception unit 71 of the request destination terminal (communication terminal 70db) transmits addition request response information indicating an addition request response of approval, rejection, or suspension to the communication management system 50 (step S106). When the user D approves, the “YES” button on the addition request response screen is pressed. When the user D rejects, the “NO” button on the addition request response screen is pressed. When the user D holds the call, the "CANCEL" button on the addition request response screen is pressed. Thereby, the transmission/reception unit 51 of the communication management system 50 receives the addition request response information. Here, the case where the addition request response indicates “approval” will be described subsequently.

The storage/read processing unit 59 requests the terminal ID “07db” of the request destination terminal associated with the terminal ID “01aa” of the request source terminal in the addition request management table (see FIG. 12). It is additionally managed in association with the terminal ID “01aa” of the request source terminal in the same destination list management table as the terminal ID “01aa” of the original terminal (step S107).

When the addition request response indicates "rejected", in step S107, the storage/read processing unit 59 causes the addition request management table (see FIG. 12) to indicate the terminal ID of the rejected request destination terminal " The record of “01aa” is deleted. If the addition request response indicates "hold", the storage/read processing unit 59 does not perform additional management in step S107, and the record of the addition request management table (see FIG. 12) is not added. Leave without deleting.

Next, the storage/readout processing unit 59 searches the terminal management table (see FIG. 10) on the basis of the terminal ID “01aa” of the request source terminal and the terminal ID “07db” of the request destination terminal, so as to correspond to each. Each information (destination name, operating status) of is read (step S108). Then, the transmission/reception unit 51 transmits the addition completion information to the request source terminal (communication terminal 10aa) and the request destination terminal (communication terminal 70db) (steps S109-1 and S109-1). Among these, the addition completion information transmitted to the request source terminal (communication terminal 10aa) includes a message indicating that the addition is completed, and each piece of information (terminal ID, destination name, and operation) of the request destination terminal (communication terminal 70db). State) is included. That is, only each piece of information (terminal ID, destination name, and operating state) of the request destination terminal (communication terminal 70db) portion in the destination list is transmitted to the request source terminal (communication terminal 10aa), and the entire destination list is updated again. It is not sent. On the other hand, the addition completion information transmitted to the request destination terminal (communication terminal 70db) includes a message indicating that the addition has been completed, and each piece of information (terminal ID, destination name, and operation) of the request source terminal (communication terminal 10aa). State) is included.

Then, in the request source terminal (communication terminal 10aa), the display control unit 14 displays a screen indicating completion on the display 120 (step S110-1). On the other hand, in the request destination terminal (communication terminal 70db), the display control unit 74 displays a screen indicating completion on the display 753 (step S110-2). Further, on the communication management system 50 side, when the processes of steps S110-1 and S110-2 are completed, the storage/read processing unit 59 causes the terminal ID “of the approved request destination terminal in the addition request management table (see FIG. 12)”. By deleting the record "07db", all the processing of the request for adding the destination candidate is completed (step S101). After that, the process of step 121 described below is automatically started.

Next, processing for preparing for image/sound communication using the communication system will be described with reference to FIG. FIG. 22 is a sequence diagram showing a process for preparing for image/sound communication using the communication system.

When it is determined in step 86-4 in FIG. 19 that the destination list information includes the terminal ID (YES), the user X purposely needs to select the communication terminal 70db from the destination list in FIG. Automatically, a process of starting communication from the request source terminal (communication terminal 10aa) to the communication management system 50 is performed. Specifically, the transmission/reception unit 11 transmits start request information indicating a communication start request to the communication management system 50 via the communication network 2 (step S121). The start request information includes the terminal ID “01aa” of the request source terminal (communication terminal 10aa) and the terminal ID “07db” of the destination terminal (communication terminal 70db). As a result, the transmission/reception unit 51 of the communication management system 50 receives the communication start request information.

Next, the storage/read processing unit 59 of the communication management system 50 causes the terminal ID “01aa” of the request source terminal (communication terminal 10aa) and the terminal ID “07db” of the destination terminal (communication terminal 70db) included in the start request information. On the basis of the above, in the terminal management table (see FIG. 10), both the field portions of the operating state of the records including the terminal ID “01aa” and the terminal ID “07db” are changed to “in communication” (step S122). ). In this state, the request source terminal (communication terminal 10aa) and the destination terminal (communication terminal 70db) have not started the video conference, but are in the communicating state, and the other communication terminal is the request source terminal (communication terminal). 10aa) or an attempt to start communication with the destination terminal (communication terminal 70db), a notification sound or display indicating a so-called communication state is output.

Next, the storage/read processing unit 59 of the communication management system 50 uses the terminal IDs of the request source terminal (communication terminal 10aa) and the destination terminal (communication terminal 70db) received by the processing of step S121 as search keys. Each corresponding IP address is read by searching the terminal management table (see FIG. 10) (step S123).

Then, the transmission/reception unit 51 of the communication management system 50 transmits the communication start request information to the IP address of the destination terminal (communication terminal 70db) read in step S123 (step S124). The start request information includes the terminal IDs “01aa” and “07db” received by the process of step S121. As a result, the transmission/reception unit 71 of the destination terminal (communication terminal 70db) receives the start request information.

On the other hand, the transmission/reception unit 71 of the destination terminal (communication terminal 70db) transmits the response propriety information indicating the response propriety to the communication management system 50 (step S125). As a result, the transmission/reception unit 51 of the communication management system 50 receives the response availability information. The response propriety information indicates that communication is possible or not possible. Here, a case where communication is possible will be described below.

The transmission/reception unit 51 of the communication management system 50 transmits relay start request information indicating a relay start request to the relay device 30 (step 126). The relay start request information includes each IP address read by the process of step S123. As a result, the transmission/reception unit 31 of the relay device 30 receives the relay start request information.

Furthermore, the transmission/reception unit 51 of the communication management system 50 transmits the response propriety information received in the process of step S125 to the request source terminal (communication terminal 10aa) (step S127). As a result, the transmission/reception unit 11 of the request source terminal (communication terminal 10aa) receives the response availability information (here, communication is possible).

As described above, the image/sound communication session (second communication session) is established between the request source terminal (communication terminal 10aa), the relay device 30, and the destination terminal (communication terminal 70db) (steps S128-1, 2). By this, the communication terminals 10aa, 70db) can start a video conference call at two locations.

<<Main effects of this embodiment>>
As described above, according to the present invention, the mobile terminal 90a of the user X acquires the terminal identification information of the communication terminal 70 from the communication terminal 70 of the base D, and the user X moves from the base D to the base A. After that, by providing the terminal identification information to the communication terminal 10 at the location A, it is possible to shorten the time required to start communication between the communication terminals 10 and 70.

That is, conventionally, when the communication terminal 10 communicates with the communication terminal 70, the user X selects the terminal identification information of the communication terminal 70 from the destination list. However, when terminal identification information of a large number of communication terminals is managed in the destination list, it takes a long time to start communication because selection takes time. On the other hand, the communication terminal 10 of the present embodiment acquires this terminal identification information from the mobile terminal 90a that has acquired the terminal identification information from the communication terminal 70 (see S84), and is identified by this terminal identification information. The communication terminal 70 performs a process of starting communication via the communication session 2 (see S121). Thereby, the user X does not have to select the terminal identification information even when the terminal identification information of a large number of communication terminals is managed in the destination list, so that communication between a plurality of communication terminals is possible. The time to start can be shortened.

Further, conventionally, when each communication terminal 10, 70 has a plurality of communication applications A1, A2, A3, in order for the communication terminal 10 to communicate with the communication terminal 70 (the other party), there is a difference in communication protocol. , The terminal ID, the IP address, the electronic mail address, or the like must be input or selected as the terminal identification information for identifying the communication terminal 70 in the communication terminal 10 on the self side. On the other hand, the communication terminal 10 of the present embodiment can be activated to start a specific communication application based on the description format of the terminal identification information of the communication terminal 70 among the plurality of communication applications A1, A2, and A3. At the same time (see S86-1 and S86-2), the communication terminal 70 as a communication destination on the communication network 2 can be identified (see S86-3). This can solve the problem that it takes time to start communication.

<<Supplement to Embodiment>>
In the above embodiment, the processing of providing and acquiring the identification information is performed by the short-range wireless communication, but the present invention is not limited to this. For example, the processing of providing and acquiring may be performed by wired communication using a USB cable or the like.

Moreover, although the video conference terminal and the office equipment such as the electronic blackboard have been described as an example of the communication terminal, the invention is not limited to this. Other examples of communication terminals include IP (Internet Protocol) telephones, Internet telephones, car navigation terminals, and surveillance cameras. Other office devices include a printer, a fax machine, an MFP (Multifunction Peripheral/Printer/Product), and the like. Further, the communication terminal includes a medical device. The medical device includes an electronic endoscope, a radiotherapy device, and the like.

Moreover, although the mobile communication terminal which is a smartphone has been described as an example of the mobile terminal, the present invention is not limited to this. Other examples of the mobile communication terminal include a mobile phone, a digital camera, a mobile game machine, an IC card, a wearable computer, or the like. The wearable computer includes a smart watch, a head mounted display and the like.

Further, in the above embodiment, the image data and the sound data have been described as an example of the content data, but the present invention is not limited to this, and may be tactile data. In this case, the feeling that the user has touched on one terminal side is transmitted to the other terminal side. Further, the content data may be smell data. In this case, the odor of one terminal side is transmitted to the other terminal side. The content data may be at least one of image data, sound data, tactile data, and olfactory data.

Further, in the above-described embodiment, the case where the video conference is held by the communication system 1 has been described, but the present invention is not limited to this, and a meeting, a general conversation such as between family members and friends, or information in one direction can be performed. It may be used for presentation.

Further, since the communication terminal 70 as the electronic blackboard has a large size, the functions of the communication management system 50 and the relay device 30 may be delegated to the communication terminal 70. In this case, the system configuration between the base A and the base D can be constructed by the intranet (on-premise type), so that the security can be improved.

Further, in the above embodiment, an example of short-range wireless communication such as NFC has been described for the storage request and the read request, but ultrasonic communication may be used.

Furthermore, each function of the embodiments described above can be realized by one or a plurality of processing circuits. Here, the processing circuit is a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, or an ASIC (Application Specific Integrated Circuit) designed to execute each function described above. ), DSP (Digital Signal Processor), FPGA (Field Programmable Gate Array) and conventional circuit modules.

1 communication system 2 communication network 3 communication network 10 communication terminal (an example of communication terminal)
11 Transmitter/receiver (one example of starting means, one example of transmitting means, one example of receiving means)
15 Judgment unit 16 Selection unit (an example of selection means)
17 Starting unit (an example of starting means)
18 Acquisition/Provision Department (an example of acquisition means)
30 relay device 50 communication management system 70 communication terminal (an example of another communication terminal)
71 Transmitter/receiver (an example of starting means)
75 Judgment unit 76 Selection unit (an example of selection means)
77 Activation unit (an example of activation means)
78 Acquisition/Provision Department (an example of acquisition means)
90a mobile terminal 90b mobile terminal 5000 storage unit 5001 authentication management DB
5002 terminal management DB
5003 Destination list management DB
5004 Additional request management DB

JP, 2012-178135, A

Claims (15)

A communication terminal that communicates with another communication terminal,
Storage means for storing a plurality of different communication applications for video conferencing,
Display control means for displaying a list of destination candidates requesting start of communication for the selectable video conference ;
Acquisition means for acquiring the specific terminal identification information by the short-range wireless communication from the mobile terminal that acquires the specific terminal identification information for identifying the other communication terminal from the other communication terminal by the short-range wireless communication. When,
When the specific terminal identification information is acquired by the acquisition unit without the user selecting the destination candidate from the list of the destination candidates, a plurality of addresses stored in the storage unit with the specific terminal identification information as the destination. Starting means for making a request to start communication for a video conference by a specific communication application selected based on the specific terminal identification information among different communication applications of
A communication terminal comprising: In the state where the display control unit displays the list of destination candidates, the start unit acquires the specific terminal identification information by the acquisition unit without selecting a destination candidate from the list of destination candidates by the user. The communication terminal according to claim 1, wherein a request is made to start communication for a video conference by a specific communication application selected based on the specific terminal identification information . The communication terminal according to claim 1 or 2, wherein
The storage means stores destination information including predetermined terminal identification information of each predetermined communication terminal that can communicate as a destination of the communication terminal,
When the specific terminal identification information acquired by the acquisition unit is included in the destination information, the start unit communicates with the other communication terminal identified by the specific terminal identification information. A communication terminal characterized by performing a process of starting. The communication terminal according to claim 3,
A determining unit that determines whether the specific terminal identification information acquired by the acquiring unit is included in the destination information,
When the determination unit determines that the specific terminal identification information is included, the start unit starts communication with the other communication terminal identified by the specific terminal identification information. A communication terminal, characterized by performing a process of The communication terminal according to any one of claims 1 to 4,
Based on the description format of the specific terminal identification information acquired by the acquisition means, a start-up means for starting a specific communication application among a plurality of different communication applications for the video conference ,
The communication terminal, which is realized by the specific communication application, performs a process of starting communication with the other communication terminal identified by the specific terminal identification information. The communication terminal according to claim 5, wherein
Based on a description format of the specific terminal identification information acquired by the acquisition means, a selection means for selecting the specific communication application from among a plurality of different communication applications for the video conference ,
A communication terminal, wherein the activation means activates the selected specific communication application. The communication terminal according to claim 1, wherein the short-range wireless communication is communication by NFC or Bluetooth. The communication terminal and the other communication terminal are a video conference terminal, an electronic blackboard, a projector, an IP telephone, an internet telephone, a car navigation terminal, a surveillance camera, a printer, a FAX, an MFP, an electronic endoscope, or a radiotherapy apparatus. The communication terminal according to any one of claims 1 to 7, characterized in that. A communication terminal according to claim 1,
With the other communication terminal,
A communication management system for managing communication between the communication terminal and the other communication terminal,
A communication system comprising: 10. The communication system according to claim 9, wherein the start unit transmits a request to start communication with the other communication terminal to the communication management system. The communication system according to claim 9 or 10, wherein
A communication system comprising a relay device for relaying content data between the communication terminal and the other communication terminal. The communication system according to any one of claims 9 to 11,
A communication system comprising the mobile terminal. The communication system according to claim 12, wherein the mobile terminal is a smartphone, a mobile phone, a digital camera, a mobile game machine, an IC card, a smart watch, or a head mounted display. A communication method executed by a communication terminal having a storage unit for storing a plurality of different communication applications for a video conference, the communication terminal communicating with another communication terminal,
A display control step of displaying a list of destination candidates requesting the start of communication for the selectable video conference on a display screen;
An acquisition step of acquiring the specific terminal identification information by the short-range wireless communication from the mobile terminal that acquires the specific terminal identification information for identifying the other communication terminal from the other communication terminal by the short-range wireless communication. When,
When the user does not select a destination candidate from the list of destination candidates and the specific terminal identification information is acquired in the acquisition step , a plurality of addresses stored in the storage means are specified as the specific terminal identification information. Of different communication applications of the start step of making a request to start communication for a video conference by a specific communication application selected based on the specific terminal identification information ,
A communication method characterized by executing. A program that causes a computer to execute each step according to claim 14.

Images