WO2020066932A1 - Communication terminal, content management server, information sharing system, display control method, and storage medium storing program - Google Patents
Communication terminal, content management server, information sharing system, display control method, and storage medium storing program Download PDFInfo
- Publication number
- WO2020066932A1 WO2020066932A1 PCT/JP2019/037073 JP2019037073W WO2020066932A1 WO 2020066932 A1 WO2020066932 A1 WO 2020066932A1 JP 2019037073 W JP2019037073 W JP 2019037073W WO 2020066932 A1 WO2020066932 A1 WO 2020066932A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- content
- display area
- operation display
- data
- management server
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/02—Details
- H04L12/16—Arrangements for providing special services to substations
- H04L12/18—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
- H04L12/1813—Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
- H04L12/1827—Network arrangements for conference optimisation or adaptation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
Definitions
- the present disclosure relates to sharing contents via a communication network.
- ICT information communication technology
- a sever sets up a virtual room. Users who have joined this virtual room share materials or documents, thereby a virtual meeting close to a real meeting room can be held (See Patent Literature 1).
- Such information sharing system allows an individual user to share a content of his or her own document in the virtual room or to import a content of a document being shared in the virtual room as his or her own document.
- a given user from among the users joining the virtual room causes his or her personal terminal such as a personal computer (PC) to display two windows, each of which is a rectangular operation display area on which operations are performed or contents are displayed by graphical user interfaces (GUIs) of the PC or the like.
- the given user creates his or her personal content on one of the two windows.
- the certain user performs a copying operation or the like to cause his or her personal content to be imported to the other one of the two windows on which a shared content is displayed, thereby causing the personal content to be shared.
- a user causes a personal terminal such as a PC to display a shared window (GUI of the PC) by a web browser, and causes the shared window to display a shared content acquired from a server, thereby conducting a remote conference. Further, the user activates a personal window, different from the shared window, at the same terminal by using word processor software, spreadsheet software or presentation software, thereby conducting a remote conference while viewing the personal documents.
- GUI shared window
- the present disclosure suggests that at least one browser running on a communication terminal displays multiple operation display areas.
- the browser(s) are in communication with a content management server.
- the communication terminal is operative to transfer content from one of the display areas to another.
- the content management server is typically operative to communicate with multiple communication terminals.
- each of the multiple communication terminals is operative to display an operation display area (window) which is “shared” between the multiple communication terminals, such that the same content can be displayed in that operation display area at each of the multiple communication terminals.
- the present disclosure makes it possible to display a shared window but also a personal window by the at least one web browser, and display content acquired from a server on the personal window as well, thereby linking contents between operation display areas such as a plurality of windows displayed by the web browser.
- Example embodiments of the present invention include a communication terminal communicable with a content management server.
- the communication terminal includes display control means for displaying a first operation display area and a second operation display area using at least one web browser, accepting means for accepting a process for causing a content displayed in the first operation display area to be displayed in the second operation display area, transmitting means for transmitting a request relating to the content to the content management server in response to acceptance of the process by the accepting means, and receiving means for receiving data of the content, the data of the content being transmitted by the content management server in response to the request relating to the content by the transmitting means.
- the display control means displays, in the second operation display area, the content represented by the data of the content that is received by the receiving means.
- each of the operation display areas may be associated with a respective URL, or other data indicating a storage location associated with the operation display area and accessible to the browser over the world wide web.
- a single web browser may be employed to implement the invention on the communication terminals.
- a different web browser or a different version of the same web browser may be employed on different ones of the communication terminals.
- the concepts of the present disclosure may be expressed as a communication terminal, as a server operative to interact with the communication terminal. For example, they may be expressed as a content management server operative to communicate with at least one respective web browser running on a plurality of communication terminals.
- the content management server is configured to receive a request from a web browser of any one of the plurality of communication terminals relating to content displayed in a first operation display area of the one communication terminal; and in response to the request, to transmit data of the content to the one communication terminal, whereby the one communication terminal displays content based on the data of the content in a second operation display area.
- the transmission may be to all the communication terminals, whereby the content can be displayed in a second operation display area of all the communication terminals.
- the first operation display area may be one which displays shared content which is displayed by a first operation display area generated by the respective web browsers of all the communication terminals.
- the concepts of the present disclosure may alternatively be expressed as a computer system comprising a server and one or more communication terminals, or as a method performed by a communication terminal, or as a method performed by a server, or as a method performed by a computer system, or as a computer program product carrying program instructions operative by a processor of a computer to cause the computer to carry out one of the methods.
- the computer program product may, for example, be a storage medium (e.g. a tangible recording medium) storing program instructions, e.g. in non-transitory form. Alternatively, it may be a software product which is downloadable, e.g. without ever being stored other than in a transitory form.
- contents can be linked between a first operation display area and a second operation display area, which are displayed by a web browser.
- FIG. 1 is a schematic diagram illustrating an overview of an information sharing system, according to an embodiment of the present disclosure.
- FIG. 2 is a block diagram illustrating an example of a hardware configuration of a personal terminal, a shared terminal, and a content management server of the information sharing system, according to an embodiment of the present disclosure.
- FIG. 3B are a block diagram illustrating an example of a functional configuration of the personal terminal, the shared terminal, and the content management server of the information sharing system, according to an embodiment of the present disclosure.
- FIG. 4A and FIG. 4B are conceptual diagrams illustrating example data structures of a personal content management table and a shared content management table, respectively, according to an embodiment of the present disclosure.
- FIG. 5 is an illustration of a display example of an operation display area for displaying a personal electronic canvas, according to an embodiment of the present disclosure.
- FIG. 6 is an illustration of a display example of an operation display area for displaying a shared electronic canvas, according to an embodiment of the present disclosure.
- FIG. 7 is an illustration of a display example of an operation display area for displaying a shared electronic screen, according to an embodiment of the present disclosure.
- FIG. 8 is a conceptual diagram illustrating an operation of capturing a content of the shared electronic screen into the personal electronic canvas by pressing a capture button on the operation display area for displaying the personal electronic canvas, according to an embodiment of the present disclosure.
- FIG. 9 is a conceptual diagram illustrating an operation of capturing a content of the shared electronic screen into the shared electronic canvas by pressing a capture button on the operation display area for displaying the shared electronic canvas, according to an embodiment of the present disclosure.
- FIG. 10 is a conceptual diagram illustrating an operation of capturing a content of the shared electronic screen into the shared electronic canvas by pressing a capture button on the operation display area for displaying the shared electronic screen, according to an embodiment of the present disclosure.
- FIG. 10 is a conceptual diagram illustrating an operation of capturing a content of the shared electronic screen into the shared electronic canvas by pressing a capture button on the operation display area for displaying the shared electronic screen, according to an embodiment of the present disclosure.
- FIG. 11 is a sequence diagram illustrating an operation of inputting and displaying a content, according to an embodiment of the present disclosure.
- FIG. 12 is a sequence diagram illustrating an operation of capturing a content of the shared electronic screen into the personal electronic canvas by pressing a capture button on the operation display area for displaying the personal electronic canvas, according to a first embodiment of the present disclosure.
- FIG. 13 is a flowchart illustrating a screen capturing process, according to an embodiment of the present disclosure.
- FIG. 14 is a flowchart illustrating an operation of storing data of a content, according to an embodiment of the present disclosure.
- FIG. 15 is a sequence diagram illustrating an operation of capturing a content of the shared electronic screen into the shared electronic canvas by pressing a capture button on the operation display area for displaying the shared electronic canvas, according to the first embodiment of the present disclosure.
- FIG. 16 is a sequence diagram illustrating an operation of capturing a content of the shared electronic screen into the shared electronic canvas by pressing a capture button on the operation display area for displaying the shared electronic screen, according to the first embodiment of the present disclosure.
- FIG. 17 is a sequence diagram illustrating an operation of capturing a content of the shared electronic screen into the personal electronic canvas by pressing a capture button on the operation display area for displaying the personal electronic canvas, according to a second embodiment of the present disclosure.
- FIG. 16 is a sequence diagram illustrating an operation of capturing a content of the shared electronic screen into the shared electronic canvas by pressing a capture button on the operation display area for displaying the personal electronic canvas, according to a second embodiment of the present disclosure.
- FIG. 18 is a sequence diagram illustrating an operation of capturing a content of the shared electronic screen into the shared electronic canvas by pressing a capture button on the operation display area for displaying the shared electronic canvas, according to the second embodiment of the present disclosure.
- FIG. 19 is a sequence diagram illustrating an operation of capturing a content of the shared electronic screen into the shared electronic canvas by pressing a capture button on the operation display area for displaying the shared electronic screen, according to the second embodiment of the present disclosure.
- FIG. 20 illustrates Variation 1 of a screen display.
- FIG. 21 illustrates Variation 2 of the screen display.
- FIG. 1 is a schematic diagram illustrating an overview of the information sharing system according to the present embodiment.
- FIG. 1 illustrates a case in which a user A and a user B who are in a meeting room X of the company and a user C who is at home Y are conducting a remote meeting by using the information sharing system.
- the user A users a personal terminal 2a in the meeting room X
- the user B uses a personal terminal 2b in the meeting room X.
- a shared terminal 4 that can be shared by multiple users is provided in the meeting room X.
- the user C uses a personal terminal 2c at the home Y.
- the personal terminal 2a, the personal terminal 2b, and the personal terminal 2c are collectively referred to as simply a “personal terminal 2” or “personal terminals 2”, unless they need to be distinguished from each other.
- the personal terminal 2 is a computer that a user can use individually or exclusively and whose screen is viewed by the user individually.
- the personal terminal 2 is not limited to being privately-owned.
- the personal terminal 2 may be public, private, non-profit, rental or any other type of ownership terminal in which a user may individually or exclusively use the terminal and whose screen is viewed by the user individually.
- the shared terminal 4 is a computer that multiple users can use together or share and whose screen is viewed by the multiple users.
- Examples of the personal terminal 2 and the shared terminal 4 include a tablet terminal, a smartphone, a PC, a personal digital assistant (PDA), a smartwatch, an electronic whiteboard, a digital television, a game apparatus, and a multifunction peripheral (MFP) having a copier function, and a car navigation system.
- Each of the personal terminal 2 and the shared terminal 4 is an example of a communication terminal (or an information processing terminal).
- the communication network 9 is, for example, one or more local area networks (LANs) inside the firewall.
- the network 9 includes the Internet that is outside the firewall in addition to the LAN.
- the communication network 9 further includes a virtual private network (VPN) and/or a wide-area Ethernet (registered trademark).
- the communication network 9 is any one of a wired network, a wireless network, and a combination of the wired network and the wireless network.
- the shared terminal 4 connects to the communication network 9 through a mobile phone network such as 3G, Long Term Evolution (LTE), 4G
- LTE Long Term Evolution
- the content management server 6 is a computer, or a plurality of computers, having a function as a web server (or HTTP server) that stores and manages data of contents to be transmitted to the personal terminal 2 and the shared terminal 4.
- the content management server 6 includes a storage unit 6000 described below.
- the storage unit 6000 includes a storage location (or a storage area) for implementing a personal electronic canvas that can be accessed only from each personal terminal 2. More specifically, only the personal terminal 2a, the personal terminal 2b and the personal terminal 2c can access a personal electronic canvas dc1, a personal electronic canvas dc2 and a personal electronic canvas dc3, respectively.
- the personal electronic canvas dc1, the personal electronic canvas dc2 and the personal electronic canvas dc3 are collectively referred to as simply a “personal electronic canvas dc”, unless they need to be distinguished from each other.
- the content management server 6 supports cloud computing.
- the “cloud computing” refers to computing where resources on a network are used or accessed without identifying specific hardware resources.
- the storage unit 6000 of the content management server 6 includes a storage location (or a storage area) for implementing a shared electronic canvas cc that can be accessed from each of the personal terminals 2. Furthermore, the storage unit 6000 of the content management server 6 includes a storage location (or a storage area) for implementing a shared electronic screen ss that can be accessed from each of the personal terminals 2.
- the “electronic canvas” is not a plain-woven thick cloth but a virtual space generated in the storage location (or the storage area) in the storage unit 6000 of the content management server 6.
- the electronic canvas can be accessed by using a web application for an electronic canvas, the web application having a function of allowing a user to view and edit a content with the canvas element and JavaScript (registered trademark).
- the “web application” refers to software that operates by cooperation between a program described in a script language such as JavaScript (registered trademark) operating on a browser application and a program on the web server side, which operate in cooperation with each other, and is used on the browser or such mechanism.
- the personal electronic canvas and the shared electronic canvas have infinite (i.e. without a pre-determined size) areas within the range of the storage area in the storage unit 6000.
- the “electronic screen” is not a white screen for projecting a movie or a slide image for viewing but a virtual space generated in a storage location (or storage area) in the storage unit 6000 of the content management server 6.
- the electronic screen has a function of holding data of a content to be transmitted (distributed) to the personal terminals 2 and the shared terminal 4 and holding the previous content until acquiring the next content.
- the electronic screen can be accessed by using a web application for an electronic screen, the web application having a function of allowing a user to view content.
- the “personal electronic canvas” refers to an electronic space dedicated to each user participating in a remote meeting.
- the personal terminal 2 of each user can access only the personal electronic canvas dedicated to the corresponding user, thereby allowing the corresponding user to view and/or edit (input, delete, copy, etc.) contents such as characters and images on the accessed personal electronic canvas.
- the “shared electronic canvas” refers to an electronic space that users participating in the remote meeting use together or share. Any of the personal terminals 2 of the users can access the shared electronic canvas, thereby allowing the users to view and/or edit (input, delete, copy, etc.) contents such as characters and images.
- the “shared electronic screen” refers to an electronic space shared by users participating in the remote meeting. Any of the personal terminals 2 of the users can access the shared electronic screen, thereby allowing the users to view a shared screen held by the shared electronic screen.
- the shared electronic screen has a simple function of holding data of content to be transmitted (distributed) to the personal terminals 2 and the shared terminal 4 and holding the previous content before acquiring the next content. For example, in a case where data of a content is transmitted from the personal terminal 2a to the shared electronic screen ss and thereafter data of a content is transmitted from the personal terminal 2b to the shared electronic screen ss, data of a content held by the shared electronic screen ss is the data received latest.
- the content management server 6 stores, for each of virtual rooms, information (data) such as contents developed on the shared electronic screen ss, the shared electronic canvas cc, and the personal electronic canvas dc in association with the corresponding virtual room. Thereby, even when the content management server 6 manages multiple virtual rooms, data of a content are not communicated over different virtual rooms.
- Each personal terminal 2 causes the above-described web application operating on the web browser installed in the personal terminal 2 to display a content of the personal electronic canvas dc, the shared electronic canvas cc, and the shared electronic screen ss.
- FIG. 1 illustrates a case where the remote meeting is held between two sites (e.g., the meeting room X and the home Y), this is just an example. In another example, a meeting is held in one site or a remote meeting is performed in three or more sites.
- FIG. 2 is a block diagram illustrating an example of any one of a hardware configuration of the personal terminal 2, the shared terminal 4, and the content management server 6 of the information sharing system.
- the personal terminal 2 includes a central processing unit (CPU) 201, a read only memory (ROM) 202, a random access memory (RAM) 203, a hard disk (HD) 204, a hard disk drive (HDD) controller 205, a storage medium 206, a medium interface (I/F) 207, a display 208, a touch panel 209, a network I/F 210, a keyboard 211, a mouse 212, a compact disc rewritable (CD-RW) drive 214, and a bus line 220.
- CPU central processing unit
- ROM read only memory
- RAM random access memory
- HD hard disk
- HDD hard disk drive
- the CPU 201 controls entire operation of the personal terminal 2.
- the ROM 202 stores a program to boot the CPU 201.
- the RAM 203 is used as a work area for the CPU 201.
- the HD 204 stores various data such as a control program.
- the HDD controller 205 controls reading and writing of various data from and to the HD 204 under control of the CPU 201.
- the medium I/F 207 controls reading and writing (storing) of data from and to the storage medium 206 such as a flash memory.
- the display 208 displays various information such as a cursor, menu, window, characters, or image.
- the touch panel 209 is one example of an input device (input means) that allows a user to operate the personal terminal 2 by touching a screen of the display 208.
- the network I/F 210 is an interface that controls communication of data through the communication network 9.
- the keyboard 211 is one example of input device (input means) provided with a plurality of keys for allowing a user to input characters, numerals, or various instructions.
- the mouse 212 is one example of an input device (input means) that allows a user to select a specific instruction or execution, select a target for processing, or move a cursor being displayed.
- the CD-RW drive 214 reads and writes various data to and from to a CD-RW 213, which is one example of a removable storage medium. Any one of the display 208, touch panel 209, keyboard 211, and mouse 212 may be provided separately from the personal terminal 2 as long as the personal terminal 2 is capable of interacting with the user.
- the shared terminal 4 includes a CPU 401, a ROM 402, a RAM 403, an HD 404, an HDD controller 405, a storage medium 406, a medium I/F 407, a display 408, a touch panel 409, a network I/F 410, a keyboard 411, a mouse 412, a CD-RW drive 414, and a bus line 420.
- the content management server 6 includes a CPU 601, a ROM 602, a RAM 603, an HD 604, an HDD controller 605, a storage medium 606, a medium I/F 607, a display 608, a touch panel 609, a network I/F 610, a keyboard 611, a mouse 612, a CD-RW drive 614, and a bus line 620.
- the content management server 6 may not include the touch panel 609.
- Each of the personal terminal 2, the shared terminal 4 and the content management server 6 can be configured by a single computer or a plurality of computers to which divided portions (functions, means, or storages) are arbitrarily allocated.
- FIG. 3A and FIG. 3B are a block diagram illustrating an example of a functional configuration of the personal terminal 2, the shared terminal 4, and the content management server 6 of the information sharing system.
- the personal terminal 2a includes a data exchange unit 21a, a receiving unit 22a, an image processor 23a, a display control unit 24a, a determination unit 25a, a storing and reading processor 29a, and a communication management unit 30a. These units are functions that are implemented by or that are caused to function by operating any of the hardware elements illustrated in FIG. 2 in cooperation with the instructions of the CPU 201 according to the control program expanded from the HD 204 to the RAM 203.
- the personal terminal 2a further includes a storage unit 2000a, which is implemented by the RAM 203 and the HD 204 illustrated in FIG. 2.
- the data exchange unit 21a, the receiving unit 22a, the image processor 23a, the display control unit 24a, the determination unit 25a, and the storing and reading processor 29a are implemented by the web browser (the web application of the web browser) that displays the operation display area described below.
- the communication management unit 30a is implemented by a dedicated communication application.
- FIG. 4A is a conceptual diagram illustrating an example data structure of a personal content management table.
- the storage unit 2000a of the personal terminal 2a stores a personal content management database (DB) 2001a implemented by the personal content management table as illustrated in FIG. 4A. Since the personal content management DB 2001a is generated for each personal electronic canvas (URL) to be displayed by the web browser in the cache of the web browser, the personal content management DB 2001a is present only while the web browser is activated.
- DB personal content management database
- Data stored in the personal content management table is the same as data stored for each of the personal terminals 2 in a personal content management DB 6001 described below of the content management server 6.
- the personal terminal 2a acquires data for the personal terminal 2a from among the data for the personal terminals 2 stored in the content management server 6 and stores the acquired data in the personal content management DB 2001a.
- the personal content management table stores, for each uniform resource locator (URL) specifying an access location (position) of the personal electronic canvas, a content ID, data of a content, and content display position information in association with each other.
- the content ID is an example of content identification information for identifying each content.
- the data of a content is data such as text data, image data such as screen capture image data, and vector data obtained by drawing.
- the display position information indicates a display position of the content on the personal electronic canvas. This display position indicates a position where the corresponding content is to be displayed on the personal electronic canvas as an infinite canvas.
- the URL is an example of location specifying information.
- Examples of the location specifying information further include a uniform resource identifier.
- FIG. 4B is a conceptual diagram illustrating an example data structure of a shared content management table.
- the storage unit 2000a of the personal terminal 2a stores a shared content management DB 2002a implemented by the shared content management table as illustrated in FIG. 4B. Since the shared content management DB 2002a is generated for each shared electronic canvas (URL) to be displayed by the web browser in the cache of the web browser, the shared content management DB 2002a is present only while the web browser is activated.
- URL shared electronic canvas
- Data stored in the shared content management table is the same as data stored in a shared content management DB 6002 described below of the content management server 6.
- the personal terminal 2a acquires the data stored in the shared content management DB 6002 of the content management server 6 and stores the acquired data in the shared content management DB 2002a.
- the shared content management table stores, for each URL specifying an access location (position) of the shared electronic canvas, a content ID, data of a content, and content display position information in association with each other.
- the data exchange unit 21a transmits and receives various data (or information) to and from other terminals, apparatuses, etc. via the communication network 9.
- the data exchange unit 21a receives, from the content management server 6, content data described in a hypertext markup language (HTML), Cascading Style Sheet (CSS), and JavaScript (registered trademark).
- the data exchange unit 21a transmits operation information input by the user to the content management server 6.
- the receiving unit 22a receives various selections or instructions input by the user using the keyboard 211 and the mouse 212.
- the image processor 23a performs processing such as generating vector data (or stroke data) according to drawing by the user, for example.
- the image processor 23a further has a function as a capturing unit.
- the image processor 23a performs screen capturing of an operation display area 132a described below to capture image data of the screen.
- the display control unit 24a controls the display 208 to display contents of various images and screens.
- the determination unit 25a performs various determinations.
- the storing and reading processor 29a is implemented by the HDD controller 205, the medium I/F 207 and the CD-RW drive 214, which operate in accordance with instructions of the CPU 201 illustrated in FIG. 2.
- the storing and reading processor 29a stores various types of data in the storage unit 2000a, the storage medium 206 and the CD-RW 213. Further, the storing and reading processor 29a reads out various types of data from the storage unit 2000a, the storage medium 206 and the CD-RW 213.
- the communication management unit 30a which is implemented mainly by instructions of the CPU 201 illustrated in FIG. 2, performs data input/output with the data exchange unit 21a, etc.
- the communication management unit 30a further includes a data exchange unit 31a, a capturing unit 33a, and a determination unit 35a.
- the data exchange unit 31a transmits and receives various data (or information) to and from the content management server 6 via the communication network 9 independently of the data exchange unit 21a.
- the capturing unit 33a has the same or substantially the same function as the capturing unit of the image processor 23a. For example, the capturing unit 33a performs screen capturing of the operation display area 132a described below to capture image data of the screen.
- the determination unit 35a performs various determinations such as determining whether the operation display area 132a for the shared electronic screen is displayed on the display 208 of the personal terminal 2a.
- the personal terminal 2b includes a data exchange unit 21b, a receiving unit 22b, an image processor 23b, a display control unit 24b, a determination unit 25b, a storing and reading processor 29b, and a communication management unit 30b.
- the personal terminal 2c includes a data exchange unit 21c, a receiving unit 22c, an image processor 23c, a display control unit 24c, a determination unit 25c, a storing and reading processor 29c, and a communication management unit 30c. These units are functions that are implemented by or that are caused to function by operating any of the hardware elements illustrated in FIG. 2 in cooperation with the instructions of the CPU 201 according to the control program expanded from the HD 204 to the RAM 203.
- the personal terminal 2b and the personal terminal 2c further include a storage unit 2000b and a storage unit 2000c, respectively, each of which is implemented by the RAM 203 and the HD 204 illustrated in FIG. 2.
- the functions of the data exchange units 21b and 21c, the receiving units 22b and 22c, the image processors 23b and 23c, the display control units 24b and 24c, the determination units 25b and 25c, the storing and reading processors 29b and 29c, the communication management units 30b and 30c, and the storage units 2000b and 2000c are the same or substantially the same as those of the data exchange unit 21a, the receiving unit 22a, the image processor 23a, the display control unit 24a, the determination unit 25a, the storing and reading processor 29a, the communication management unit 30a and the storage unit 2000a of the personal terminal 2a respectively, and therefore redundant description thereof are omitted below.
- the communication management unit 30b includes a data exchange unit 31b, a capturing unit 33b, and a determining unit 35b.
- the communication management unit 30c includes a data exchange unit 31c, a capturing unit 33c, and a determination unit 35c.
- the functions of the data exchange units 31b and 31c, the capturing units 33b and 33c, and the determination units 35b and 35c are the same of substantially the same as those of the data exchange unit 31a, the capturing unit 33a, and the determination unit 35a of the communication management unit 30a respectively, and therefore redundant descriptions thereof are omitted below.
- the storage unit 2000b of the personal terminal 2b stores a personal content management DB 2001b and a shared content management DB 2002b.
- the storage unit 2000c of the personal terminal 2c stores a personal content management DB 2001c and a shared content management DB 2002c.
- the personal content management DBs 2001b and 2001c and the shared content management DBs 2002b and 2002c have the same or substantially the same data structures as the personal content management DB 2001a and the shared content management DB 2002a, respectively, and therefore redundant descriptions thereof are omitted below.
- the shared terminal 4 includes a data exchange unit 41, a receiving unit 42, an image processor 43, a display control unit 44, a determination unit 45, a storing and reading processor 49, and a communication management unit 50. These units are functions that are implemented by or that are caused to function by operating any of the hardware elements illustrated in FIG. 2 in cooperation with the instructions of the CPU 401 according to the control program expanded from the HD 404 to the RAM 403.
- the shared terminal 4 further includes a storage unit 4000, which is implemented by the RAM 403 and the HD 404 illustrated in FIG. 2.
- the functions of the data exchange unit 41, the receiving unit 42, the image processor 43, the display control unit 44, the determination unit 45, the storing and reading processor 49, the communication management unit 50, and the storage unit 4000 of the shared terminal 4 are the same of the substantially the same as those of the data exchange unit 21a, the receiving unit 22a, the image processor 23a, the display control unit 24a, the determination unit 25a, the storing and reading processor 29a, the communication management unit 30, and the storage unit 2000a of the personal terminal 2a respectively, and therefore redundant descriptions thereof are omitted below.
- the communication management unit 30 further includes a data exchange unit 51, a capturing unit 53, and a determination unit 55.
- the functions of the data exchange unit 51, the capturing unit 53, and the determination unit 55 are the same or the substantially the same as those of the data exchange unit 31a, the capturing unit 33a, and the determination unit 35a, respectively, redundant descriptions thereof are omitted below.
- the storage unit 4000 of the shared terminal 4 stores a shared content management DB 4002. Since the shared content management DB 4002 has the same or substantially the same data structure as the shared content management DB 2002a of the personal terminal 2a, a redundant description thereof is omitted below.
- the data exchange unit 41, the receiving unit 42, the image processor 43, the display control unit 44, the determination unit 45, and the storing and reading processor 49 are implemented by the web browser (the web application of the web browser) that displays the operation display area described below.
- the communication management unit 50 is implemented by a dedicated communication application.
- the content management server 6 includes a data exchange unit 61, an image processor 63, a generation unit 64, a determination unit 65, and a storing and reading processor 69. These units are functions that are implemented by or that are caused to function by operating any of the hardware elements illustrated in FIG. 2 in cooperation with the instructions of the CPU 601 according to the control program expanded from the HD 604 to the RAM 603.
- the content management server 6 further includes a storage unit 6000, which is implemented by the RAM 603 and the HD 604 illustrated in FIG. 2.
- Each Functional Unit of Content Management Server Next, a detailed description is given of each functional unit of the content management server 6.
- the data exchange unit 61 transmits and receives various data (or information) to and from other terminals, apparatuses, etc. via the communication network 9.
- the image processor 63 further has a function as a capturing unit.
- the image processor 63 performs screen capturing of the shared electronic canvas cc described below to capture image data of the screen.
- the generation unit 64 generates a unique content ID, etc.
- the determination unit 65 determines whether the content ID has been received by the data exchange unit 61.
- the storing and reading processor 69 is implemented by the HDD controller 605, the medium I/F 607 and the CD-RW drive 614, which operate in accordance with instructions of the CPU 601 illustrated in FIG. 2.
- the storing and reading processor 69 stores various types of data in the storage unit 6000, the storage medium 606 and the CD-RW 613. Further, the storing and reading processor 69 reads out various types of data from the storage unit 6000, the storage medium 606 and the CD-RW 613.
- the storage unit 6000 of the content management server 6 stores the personal content management DB 6001 and the shared content management DB 6002.
- the personal content management DB 6001 and the shared content management DB 6002 have the same or substantially the same data structures as the personal content management DB 2001a and the shared content management DB 2002a, respectively, and therefore redundant descriptions thereof are omitted below.
- the personal content management DB 6001 stores all data of the personal content management DBs 2001a, 2001b, and 2001c.
- the shared content management DB 6002 has all data of the shared content management DBs 2002a, 2002b, 2002c and the shared content management DB 4002.
- the above described programs may be stored in a storage medium such as a CD-R or a DVD-R for domestic or overseas distribution.
- the operation display area is an area on a screen for displaying information to be presented to a user with graphical user interfaces (GUIs) or for accepting an operation from the user.
- the operation display area is a display mode of a web browser or application software. For example, Microsoft Windows (registered trademark) or the like corresponds to the operation display area.
- An operation display area 110 represents a given area in the personal electronic canvas dc having an infinite space.
- An operation display area 120 represents a given area in the shared electronic canvas cc having an infinite space.
- FIG. 5 is an illustration of a display example of the operation display area 110 for displaying the personal electronic canvas. As illustrated in FIG. 5, the operation display area 110 for displaying the personal electronic canvas is displayed in response to selection of a tab t1 labeled with “Personal electronic canvas” by the user among three tabs displayed in the upper area.
- a function icon section f10 On the left side of the operation display area 110, a function icon section f10 is displayed.
- the function icon section f10 includes various function icons such as a screen movement and a drawing pen.
- a scrollbar re1 for specifying stepwise reduction or enlargement of displayed characters or the like is displayed.
- a capture button c1 In the lower right portion of the operation display area 110, a capture button c1, an upload/share button su1, a download/share button sd1, a reduction button r1, and an enlargement button e1 are displayed.
- the capture button c1 is a button, when selected, for causing the capturing unit 33c to capture a screen that is to be displayed (or has been displayed) in the operation display area for the shared electronic screen and importing and displaying the captured screen in the operation display area 110 for the personal electronic canvas.
- capturing of a screen of the operation display area for the shared electronic screen is initiated by pressing the button on the operation display area 110 for the personal electronic canvas, which is a destination to which image data is to be imported.
- the capture button c1 is represented by an icon having a shape of a camera.
- the upload/share button su1 a button, when selected, for uploading image data of an entire screen displayed on the display 208 of the personal terminal 2 to the content management server 6 and expanding the uploaded image data on the shared electronic screen ss.
- the download/share button sd1 is a button, when selected, for downloading image data expanded on the shared electronic screen ss from the content management server 6 and displaying an image represented by the downloaded image data in the operation display area 110 for the personal electronic canvas.
- the reduction button r1 is a button, when selected, for reducing the proportion of the operation display area 110 in the display.
- the enlargement button e1 is a button, when selected, for increasing the proportion of the operation display area 110 in the display.
- FIG. 6 is an illustration of a display example of the operation display area 120 for displaying the shared electronic canvas. As illustrated in FIG. 6, the operation display area 120 for displaying the sharing electronic canvas is displayed in response to selection of a tab t2 labeled with “Shared electronic canvas” by the user among three tabs displayed in the upper area.
- a function icon section f20 On the left side of the operation display area 120, a function icon section f20 is displayed.
- the function icon section f20 includes various function icons such as a screen movement and a drawing pen.
- a scrollbar re2 for specifying stepwise reduction or enlargement of displayed characters or the like is displayed.
- a capture button c2 In the lower right portion of the operation display area 120, a capture button c2, an upload/share button su2, a download/share button sd2, a reduction button r2, and an enlargement button e2 are displayed.
- the capture button c2 is a button, when selected, for causing the capturing unit 33c to capture a screen that is to be displayed (or has been displayed) in the operation display area for the shared electronic screen and importing and displaying the captured screen in the operation display area 120 for the shared electronic canvas.
- capturing of a screen of the operation display area for the shared electronic screen is initiated by pressing the button on the operation display area 120 for the shared electronic canvas, which is a destination to which image data is to be imported.
- the capture button c2 is represented by an icon having a shape of a camera.
- the upload/share button su2 is a button, when selected, for uploading image data of a screen displayed in the operation display area 120 for the shared electronic canvas to the content management server 6 and expanding the uploaded image data to the shared electronic screen ss.
- the download/share button sd2 is a button, when selected, for downloading image data expanded on the shared electronic screen ss from the content management server 6 and displaying an image represented by the downloaded image data in the operation display area 120 for the shared electronic canvas. Since the reduction button r2 and the enlargement button e2 have the same or substantially the same function as the reduction button r1 and the enlargement button e1 in the operation display area 110, respectively, redundant descriptions thereof are omitted below.
- FIG. 7 is an illustration of a display example of the operation display area 130 for displaying the shared electronic screen. As illustrated in FIG. 7, the operation display area 130 for displaying the shared electronic screen is displayed in response to selection of a tab t3 labeled with “Shared electronic screen” by the user among three tabs displayed in the upper area.
- a capture button c3 In the lower portion of the operation display area 130, a capture button c3, a reduction button r3 and an enlargement button e3 are displayed.
- the capture button c3 is a button, when selected, for capturing a screen that is displayed in the operation display area for the shared electronic screen and importing and displaying the captured screen in the operation display area 120 for the shared electronic canvas.
- a destination to which the image data is to be imported is the operation display area 120 for the shared electronic canvas.
- the capture button c3 is represented by an icon having a shape of a camera.
- FIG. 8 is a conceptual diagram illustrating an operation of capturing the content of the shared electronic screen into the personal electronic canvas by pressing the capture button on the operation display area for displaying the personal electronic canvas.
- the operation display area 112c represents a given area in the personal electronic canvas dc3 having an infinite space.
- FIG. 8 illustrates a state where the personal terminal 2a transmits, to the shared electronic screen ss, image data of the entire screen displayed on the display 208 of the personal terminal 2a according to the user A’s instruction, to cause the screen to be shared with the personal terminal 2b, the personal terminal 2c and the shared terminal 4.
- a screen on which text data “RI” is input is illustrated as an example of the entire screen.
- FIG. 8 illustrates a state in which according to the user C’s instruction, the personal terminal 2c displays the content shared by the personal terminal 2a on the operation display area 132c for displaying the shared electronic screen, and thereafter copies and imports the shared content to the operation display area 112c for displaying the personal electronic canvas.
- the content of the entire screen is an example of a specific content.
- a content “RI” is displayed on the operation display area 112a, and data of the content of the entire screen is transmitted to the shared electronic screen ss of the content management server 6 (S11).
- the content management server 6 stores the data of the content of the entire screen in a storage area for the shared electronic screen ss in the storage unit 6000.
- the data transmitted in step S11 can be either moving image data or still image data.
- the user C operates the personal terminal 2c to display the operation display area 132c to send a request for data of a content of the shared electronic screen ss to the content management server 6 (S12).
- the content management server 6 transmits data of the content of the entire screen of the shared electronic screen ss to the personal terminal 2c (S13). Thereby, at the personal terminal 2c, the content of the entire screen is displayed in the operation display area 132c by the web browser.
- the operation display area 112c for displaying a content of the personal electronic canvas dc3 is displayed.
- the operation display area 132c is an example of a first operation display area
- the operation display area 112c is an example of a second operation display area.
- the personal terminal 2c transmits data of a content of the captured entire screen to the content management server 6 by the web browser displaying the operation display area 112c (S15). Then, the content management server 6 transmits the data of the content of the entire screen to the personal terminal 2c (S16). Thereby, at the personal terminal 2c, the content of the entire screen is displayed on the operation display area 112c by the web browser.
- FIG. 9 is a conceptual diagram illustrating an operation of capturing the content of the shared electronic screen into the shared electronic canvas by pressing the capture button on the operation display area for displaying the shared electronic canvas. Note that the operation display area 122c represents a given area in the shared electronic canvas cc having an infinite space.
- FIG. 9 illustrates a state where the personal terminal 2a transmits, to the shared electronic screen ss, data of a content of the entire screen on which text data “RI” is displayed according to the user A’s instruction, to cause the screen to be shared with the personal terminal 2b, the personal terminal 2c and the shared terminal 4. Further, FIG. 9 illustrates a state in which according to the user C’s instruction, the personal terminal 2c displays the content shared by the personal terminal 2a on the operation display area 132c for the shared electronic screen, and thereafter copies and imports the shared content to the operation display area 122c for displaying the shared electronic canvas.
- the content of the entire screen is an example of a specific content.
- a storage location (storage area) in the storage unit 6000 which is an access destination (URL) to the shared electronic screen ss, is an example of a first location in the storage unit 6000.
- a storage location (storage area) in the storage unit 6000 which is an access destination (URL) to the personal electronic canvas dc3, is an example of a second location in the storage unit 6000.
- the content “RI” is displayed on the operation display area 112a, and data of the content of the entire screen is transmitted to the shared electronic screen ss of the content management server 6 (S31).
- the content management server 6 stores the data of the content of the entire screen in a storage area for the shared electronic screen ss in the storage unit 6000.
- the data transmitted in step S31 can be either moving image data or still image data.
- the user C operates the personal terminal 2c to display the operation display area 132c to send a request for data of a content of the shared electronic screen ss to the content management server 6 (S32).
- the content management server 6 transmits data of the content of the entire screen of the shared electronic screen ss to the personal terminal 2c (S33).
- the personal terminal 2c the content of the entire screen is displayed in the operation display area 132c by the web browser.
- the processes in steps S31 to S33 are the same or substantially the same as those in steps S11 to S13.
- the operation display area 122c for displaying a content of the shared electronic canvas cc is displayed.
- the personal terminal 2c transmits data of a content of the captured entire screen to the content management server 6 by the web browser displaying the operation display area 122c (S35). Then, the content management server 6 transmits the data of the content of the entire screen to the personal terminal 2c (S36). Thereby, at the personal terminal 2c, the content of the entire screen is displayed on the operation display area 122c by the web browser.
- the screen displayed in the operation display area 132c different from the operation display area 122c is copied to the operation display area 122c.
- FIG. 10 is a conceptual diagram illustrating an operation of capturing the content of the shared electronic screen into the shared electronic canvas by pressing the capture button on the operation display area for displaying the shared electronic screen.
- FIG. 10 illustrates a state where the personal terminal 2a transmits, to the shared electronic screen ss, data of a content of the entire screen on which text data “RI” is displayed according to the user A’s instruction, to cause the screen to be shared with the personal terminal 2b, the personal terminal 2c and the shared terminal 4. Further, FIG. 10 illustrates a state in which according to the user C’s instruction, the personal terminal 2c displays the content shared by the personal terminal 2a on the operation display area 132c for the shared electronic screen, and thereafter copies and imports the shared content to the operation display area 122c for displaying the shared electronic canvas.
- the content “RI” is displayed on the operation display area 112a, and data of the content of the entire screen is transmitted to the shared electronic screen ss of the content management server 6 (S51).
- the content management server 6 stores the data of the content of the entire screen in a storage area for the shared electronic screen ss in the storage unit 6000.
- the data transmitted in step S51 can be either moving image data or still image data.
- the user C operates the personal terminal 2c to display the operation display area 132c to send a request for data of a content of the shared electronic screen ss to the content management server 6 (S52).
- the content management server 6 transmits data of a content of the entire screen of the shared electronic screen ss to the personal terminal 2c (S53).
- the personal terminal 2c the content of the entire screen is displayed in the operation display area 132c by the web browser.
- the processes in steps S51 to S53 are the same or substantially the same as those in steps S11 to S13 (steps S31 to S33).
- the operation display area 122c for displaying a content of the shared electronic canvas cc is displayed.
- the personal terminal 2c transmits data of a content of the captured entire screen to the content management server 6 by the web browser displaying the operation display area 122c (S55). Then, the content management server 6 transmits data of a content of the entire screen to the personal terminal 2c (S66). Thereby, at the personal terminal 2c, the content of the entire screen is displayed on the operation display area 122c by the web browser.
- FIG. 11 is a sequence diagram illustrating an operation of inputting and displaying a content.
- a description is now given of a basic operation of displaying a content of a screen element (not an entire screen) such as characters in the operation display area for the personal electronic canvas (in this example, the operation display area 112c of the personal terminal 2c) by using a web browser.
- the receiving unit 22c receives the input (S71). Then, the data exchange unit 21c transmits, to the content management server 6, data of the content of the screen element and display position information p0 indicating a display position of the content in the personal electronic canvas dc3 (S72). The data exchange unit 61 of the content management server 6 receives the data of the content and the display position information p0.
- the storing and reading processor 69 of the content management server 6 stores the content data and the display position information p0 in association with each other in the personal content management table in which an URL of the personal electronic canvas dc3 is managed in the personal content management DB 6001 (S73). Then, the generation unit 64 generates a unique content ID 10 (S74).
- the storing and reading processor 69 stores the content ID 10 generated in step S74 in association with the content data and display position information p0 stored in step S73 (S75).
- the data exchange unit 61 transmits an update notification, which is a notification indicating an update of the personal electronic canvas, to the personal terminal 2c (S76).
- an update notification which is a notification indicating an update of the personal electronic canvas
- the content management server 6 sends the update notification to each of the multiple personal terminals 2 of the user C.
- the data exchange unit 21c receives the update notification.
- the data exchange unit 21c transmits a request for updated content data and display position information to the content management server 6 (S77).
- the data exchange unit 61 of the content management server 6 receives the request for the content data and the display position information.
- the storing and reading processor 69 of the content management server 6 reads out the content ID 10, the data of the content, and the display position information p0 corresponding to the updated content from the personal content management table for the personal electronic canvas dc3 in the personal content management DB 6001 (S78). Then, the data exchange unit 61 transmits the content ID 10, the data of the content, and the display position information p0 to the personal terminal 2c (S79). Thereby, at the web browser of the personal terminal 2c, the data exchange unit 21c receives the content ID 10, the data of the content, and the display position information p0.
- the storing and reading processor 29c of the personal terminal 2c stores the content ID 10, the data of the content, and the display position information p0 received in step S79 in association with each other in the personal content management DB 2001c (S80). Thereby, at the web browser of the personal terminal 2c, the display control unit 24c updates the operation display area 112c to display the content, which is the screen element such as a character (S81).
- the receiving unit 22c receives a screen capturing process by the web browser (the web application of the web browser) of the personal terminal 2c (S111).
- the screen capture process is an example of a process for causing a content displayed in the first operation display area to be displayed in the second operation display area.
- An instruction for causing a content displayed in the first operation area to be displayed in the second operation area can be input by voice, which is collected by, for example, a microphone built in or connected to the personal terminal 2c.
- the receiving unit 22c sends a screen capture request to the communication management unit 30c (S112). This request includes the URL of the shared electronic screen ss.
- the communication management unit 30c receives the screen capture request.
- the communication management unit 30c performs the screen capture process (S113). A detailed description is now given of the screen capturing process with reference to FIG. 13.
- the determination unit 35c of the communication management unit 30c determines whether the operation display area for the shared electronic screen is displayed (S101).
- the capturing unit 33c of the communication management unit 30c performs screen capturing of the operation display area 132c to capture image data of the screen (S102).
- the determination unit 35c determines in step S101 that the operation display area for the shared electronic screen is not displayed, processes of steps S114 to S116 are performed.
- the data exchange unit 31c of the communication management unit 30c transmits, to the content management server 6, request information indicating a request for data of a content of the shared electronic screen ss (S114).
- the data exchange unit 61 of the content management server 6 receives the request information.
- the determination unit 35c determines that the operation display area for the shared electronic screen is displayed in a case where the personal terminal 2c has already opened a display area for the shared electronic screen as a different tab t2 even when the operation display area for the shared electronic screen is not displayed.
- the capturing unit 33c receives and captures a screen displayed on the shared screen from the content management server 6, based on information specifying the shared screen such as a URL of the shared screen corresponding to the personal electronic canvas on which the capture button is pressed.
- the storing and reading processor 69 of the content management server 6 reads out data of a content from the storage location (storage area) for the shared electronic screen ss in the same virtual room as a virtual room in which participate by using the personal electronic canvas corresponding to the operation display area 112c on which the capture button c1 is pressed in step S111 (S115). Then, the data exchange unit 61 of the content management server 6 transmits the data of the content read by the storing and reading processor 69 to the communication management unit 30c of the personal terminal 2c (S116). The data exchange unit 31c of the communication management unit 30c receives the data of the content.
- the communication management unit 30c outputs the data of the content of the screen capture image obtained by the screen capturing to the data exchange unit 21c implemented by the web browser displaying the operation display area 112c (S117), whereby the data exchange unit 21c inputs data of the content of an image obtained by the screen capturing.
- the data exchange unit 21c transmits a content storage request to the content management server 6 (S118).
- This content storage request includes the data of the content of the screen capture image.
- the data exchange unit 61 of the content management server 6 receives the content storage request and the data of the content of the screen capture image.
- this content storage request is, for example, an HTTP request.
- FIG. 14 is a flowchart illustrating the operation of storing data of a content.
- the determination unit 65 of the content management server 6 determines which one of the capture buttons c1, c2 and c3 is pressed (S90). Specifically, when the data of the content is received by the web browser that displays the operation display area 112c with which a communication session is established, the determination unit 65 determines that the capture button c1 is pressed. Further, when the data of the content is received by the web browser that displays the operation display area 122c with which a communication session is established, the determination unit 65 determines that the capture button c2 is pressed. Furthermore, when the data of the content is received by the web browser that displays the operation display area 132c with which a communication session is established, the determination unit 65 determines that the capture button c3 is pressed.
- the determination unit 65 determines that the capture button c1 is pressed. Then, the storing and reading processor 69 stores the data of the content in the personal content management DB 6001 (S91). Then, the generation unit 64 generates a unique content ID 11 (S92). Further, the generation unit 64 generates a display position information p1 indicating a display position of the content of the screen capture image on the personal electronic canvas dc3 (S93). Although the display position of the screen capture image in the personal electronic canvas dc3 is arbitrary, when there is a screen capture image already displayed, the display position is a position below the screen capture image already displayed, for example.
- step S120 ends.
- the data exchange unit 61 transmits an update notification, which is a notification indicating an update of the personal electronic canvas, to the personal terminal 2c (S121).
- the content management server 6 sends the update notification to each of the multiple personal terminals 2 of the user C.
- the data exchange unit 21c receives the update notification.
- the data exchange unit 21c transmits a request for updated content data and display position information to the content management server 6 (S122).
- the data exchange unit 61 of the content management server 6 receives the request for the content data and the display position information.
- the storing and reading processor 69 of the content management server 6 reads out the content ID 11, the data of the content, and the display position information p1 corresponding to the updated content from the personal content management table for the personal electronic canvas dc3 in the personal content management DB 6001 (S123). Then, the data exchange unit 61 transmits the content ID 11, the data of the content, and the display position information p1 to the personal terminal 2c (S124). Thereby, at the web browser of the personal terminal 2c, the data exchange unit 21c receives the content ID 11, the data of the content, and the display position information p1.
- the storing and reading processor 29c of the personal terminal 2c stores the content ID 11, the data of the content, and the display position information p1 received in step S124 in association with each other in the personal content management DB 2001c (S125).
- the display control unit 24c updates the operation display area 112c to display a content, which is the screen capture image (the entire screen) (S126).
- the entire image displayed or to be displayed in the operation display area 132c for the shared electronic screen is captured and displayed in the operation display area 112c for the personal electronic canvas, whereby allowing the user C to import a shared image as a personal image.
- Second Operation or Processes Referring to FIG. 15, a detailed description is now given of the second operation or processes illustrated in FIG. 9. More specifically, a detailed description is given of processes of step S34 performed by the personal terminal 2c and subsequent steps on the assumption that the processes of the step S33 and previous steps has already been performed.
- the second operation or processes is substantially the same as the first operation or processes, except that the operations on the operation display area 112c are replaced with operations on the operation display area 122c.
- the receiving unit 22c receives a screen capturing process by the web browser (the web application of the web browser) of the personal terminal 2c (S131). In response, the receiving unit 22c sends a screen capture request to the communication management unit 30c (S132). This request includes the URL of the shared electronic screen ss. The communication management unit 30c receives the screen capture request.
- the communication management unit 30c performs the screen capture process (S133).
- This screen capture process is the same or substantially the same as the process described above with reference to FIG. 13, and therefore the redundant description thereof is omitted below.
- the processes of steps S134 to S136 of FIG. 15 are the same or substantially the same as the processes of steps 114 to S116.
- the communication management unit 30c outputs the data of the content of the screen capture image to the data exchange unit 21c implemented by the web browser displaying the operation display area 122c (S137), whereby the data exchange unit 21c inputs the data of the content of the screen capture image.
- the data exchange unit 21c transmits a content storage request to the content management server 6 (S138).
- This content storage request includes the data of the content of the screen capture image.
- the data exchange unit 61 of the content management server 6 receives the content storage request and the data of the content of the screen capture image.
- this content storage request is, for example, an HTTP request.
- the content management server 6 performs an operation of storing data of a content (S140). A detailed description is now given of the operation of storing data of a content with reference to FIG. 14.
- step S90 the determination unit 65 determines that the capture button c2 is pressed from among the capture buttons c1, c2 and c3. Then, the storing and reading processor 69 stores the data of the content in the shared content management DB 6002 (S95). Then, the generation unit 64 generates a unique content ID 12 (S96). Further, the generation unit 64 generates a display position information p2 indicating a display position of the content of the screen capture image on the shared electronic canvas cc (S97). Although the display position of the screen capture image in the shared electronic canvas cc is arbitrary, when there is a screen capture image already displayed, the display position is a position below the screen capture image already displayed, for example.
- step S98 the storing and reading processor 69 stores the content ID generated in step S96 and the display position information p2 generated in step S97 in association with the content data stored in step S95.
- the process of step S140 ends.
- the data exchange unit 61 transmits an update notification, which is a notification indicating an update of the shared electronic canvas, to the personal terminal 2c (S141).
- the content management server 6 transmits the update notification to each of the multiple personal terminals 2.
- the data exchange unit 21c receives the update notification.
- the data exchange unit 21c transmits a request for updated content data and display position information to the content management server 6 (S142).
- the data exchange unit 61 of the content management server 6 receives the request for the content data and the display position information.
- the storing and reading processor 69 of the content management server 6 reads out the content ID 12, the data of the content, and the display position information p2 corresponding to the updated content from the shared content management table for the shared electronic canvas cc in the shared content management DB 6002 (S143). Then, the data exchange unit 61 transmits the content ID 12, the data of the content, and the display position information p2 to the personal terminal 2c (S144). Thereby, at the web browser of the personal terminal 2c, the data exchange unit 21c receives the content ID 12, the data of the content, and the display position information p2.
- the storing and reading processor 29c of the personal terminal 2c stores the content ID 12, the data of the content, and the display position information p2 received in step S144 in association with each other in the shared content management DB 2002c (S145). Thereby, at the web browser of the personal terminal 2c, the display control unit 24c updates the operation display area 122c to display a content, which is the screen capture image (the entire screen) (S146).
- the entire image displayed or to be displayed in the operation display area 132c for the shared electronic screen is captured and displayed in the operation display area 122c for the shared electronic canvas, whereby allowing the user C to import an image shared by the shared electronic screen as an image shared by the electronic canvas.
- the data exchange unit 61 of the content management server 6 transmits data of the content of the entire screen of the shared electronic screen ss to the personal terminal 2c (S151). Thereby, at the web browser displaying the operation display area 132c, the data exchange unit 21c receives the data of the content of the entire screen. Then, at the web browser displaying the operation display area 132c, the display control unit 24c causes the content of the entire screen to be displayed on the operation display area 132c (S152).
- step S153 when the user C presses the capture button c3 illustrated in FIG. 7, at the web browser displaying the operation display area 132c, the receiving unit 22c receives a screen capturing (S153). Since the process of step S154 is the same as the process described with reference to FIG. 13, the redundant description thereof is omitted below. However, the determination unit 25c performs the process of step S101. In addition, the image processor 23c having a function as a capturing unit to capture image data of a screen by performing screen capturing of the operation display area 132c performs the process of step S102. Since the operation display area for the shared electronic screen is displayed in step S152, the determination unit 25c determines in step S101 that the display operation area for the shared electronic screen is displayed (YES). Then, in step S102, at the web browser displaying the operation display area 132c, the image processor 23c performs screen capturing of the operation display area 132c of itself.
- the data exchange unit 21c transmits a content storage request to the content management server 6 (S155).
- This content storage request includes the data of the content of the screen capture image.
- the data exchange unit 61 of the content management server 6 receives the content storage request and the data of the content of the screen capture image. Note that this content storage request is, for example, an HTTP request.
- the content management server 6 performs an operation of storing data of a content (S160). A detailed description is now given of the operation of storing data of a content with reference to FIG. 14.
- step S90 the determination unit 65 determines that the capture button c3 is pressed from among the capture buttons c1, c2 and c3. Since the processes after the step S90 are the same or substantially the same as the processes of steps S95 to S98, the redundant description thereof is omitted below. Note that in this operation, the content ID 12 and the display position information p2 are replaced with the content ID 13 and the display position information p3, respectively.
- the data exchange unit 61 transmits an update notification, which is a notification indicating an update of the shared electronic canvas, to the web browser displaying the operation display area 122c of the personal terminal 2c (S161).
- the content management server 6 transmits the update notification to all the personal terminals 2 and the shared terminal 4 participating in the remote conference.
- the data exchange unit 21c receives the update notification.
- the receiving of screen capturing is not performed in the operation display area 112c to which an image of the shared screen is to be imported. Therefore, the content management server 6 cannot identify the personal electronic canvas dc3 for the operation display area 112c to which an image obtained by the screen capturing is to be imported from among the plurality of personal electronic canvases. However, the content management server 6 can identify the shared electronic canvas cc since one shared electronic canvas cc is present in one virtual room. Therefore, the data exchange unit 61 of the content management server 6 transmits an update notification, which is a notification indicating an update of the shared electronic canvas, to the web browser displaying the operation display area 122c of the personal terminal 2c.
- the data exchange unit 21c transmits a request for updated content data and display position information to the content management server 6 (S162).
- the data exchange unit 61 of the content management server 6 receives the request for the content data and the display position information.
- the storing and reading processor 69 of the content management server 6 reads out the content ID 13, the data of the content, and the display position information p3 corresponding to the updated content from the shared content management table for the shared electronic canvas cc in the shared content management DB 6002 (S163). Then, the data exchange unit 61 transmits the content ID 13, the data of the content, and the display position information p3 to the personal terminal 2c (S164). Thereby, at the web browser of the personal terminal 2c, the data exchange unit 21c receives the content ID 13, the data of the content, and the display position information p3.
- the storing and reading processor 29c of the personal terminal 2c stores the content ID 13, the data of the content, and the display position information p3 received in step S164 in association with each other in the shared content management DB 2002c (S165).
- the display control unit 24c updates the operation display area 122c to display a content, which is the screen capture image (the entire screen) (S166).
- the entire image displayed in the operation display area 132c for the shared electronic screen is captured and displayed in the operation display area 122c for the shared electronic canvas, whereby allowing the user C to import an image shared by the shared electronic screen as an image shared by the electronic canvas.
- the user C using the personal terminal 2c spends a long time to capture an image of a screen (content) from one operation display area 132c into the other operation display area 112c or 122c, the user C will miss a conversation in a meeting or the like. If a user misses a conversation in a remote meeting or the like performed via a communication network, the user finds it more difficult to tell the remote partner that the user wants him or her to repeat previous remarks or comments, compared with when the user joins the meeting or the like in the real meeting room, for example.
- the user C can capture an image of the screen only by pressing the capture button c1, c2, or c3, whereby the drawback of missing a conversation in a meeting or the like such as a meeting can be overcome.
- the shared electronic canvas and the personal electronic canvas are associated in advance with the shared electronic screen, the user C is saved from specifying the URL or the like of the shared electronic screen, whereby an image of a screen can be captured and imported quickly.
- Second Embodiment A description is now given of a second embodiment of the present disclosure, with reference to FIG. 17 to FIG. 19.
- a detailed description is given of an operation or processes in a state where the operation display area 132c is already displayed on the personal terminal 2c and a content is displayed in the operation display area 132c.
- the present embodiment is different from the first embodiment in that the communication management units 30a, 30b and 30c and the communication management unit 50 are not provided, and the screen capturing process is performed not on the personal terminal 2c side but on the content management server 6 side. Except for the above differences, the hardware configuration and the functional configuration of the present embodiment are substantially the same as those of the first embodiment, and therefore redundant description thereof are omitted below.
- the data exchange unit 61 of the content management server 6 transmits data of the content of the entire screen of the shared electronic screen ss to the personal terminal 2c (S211). Thereby, at the web browser displaying the operation display area 132c, the data exchange unit 21c receives the data of the content of the entire screen. Then, at the web browser displaying the operation display area 132c, the display control unit 24c causes the content of the entire screen to be displayed on the operation display area 132c (S212).
- step S213 can be performed even when the processes of steps S211 and S212 are not performed.
- the data exchange unit 21c transmits a screen capture request (information) to the content management server 6 (S214).
- the data exchange unit 61 of the content management server 6 receives the screen capture request.
- the image processor 63 of the content management server 6 performs a screen capturing process of an entire screen of the shared electronic screen ss (S215).
- the entire image displayed in the operation display area 132c for the shared electronic screen is captured on the content management server 6 side and displayed in the operation display area 112c for the personal electronic canvas, whereby allowing the user C to capture an image shared by the shared electronic screen as an image shared by the electronic canvas.
- the data exchange unit 61 of the content management server 6 transmits data of the content of the entire screen of the shared electronic screen ss to the personal terminal 2c (S231). Thereby, at the web browser displaying the operation display area 132c, the data exchange unit 21c receives the data of the content of the entire screen. Then, at the web browser displaying the operation display area 132c, the display control unit 24c causes the content of the entire screen to be displayed on the operation display area 132c (S232).
- the receiving unit 22c receives a screen capturing (S233).
- the data exchange unit 21c transmits a screen capture request (information) to the content management server 6 (S234).
- the data exchange unit 61 of the content management server 6 receives the screen capture request.
- the image processor 63 of the content management server 6 performs a screen capturing process of an entire screen of the shared electronic screen ss (S235).
- the entire image displayed in the operation display area 132c for the shared electronic screen is captured on the content management server 6 side and displayed in the operation display area 122c for the shared electronic canvas, whereby allowing the user C to import an image shared by the shared electronic screen as an image shared by the electronic canvas.
- the data exchange unit 61 of the content management server 6 transmits data of the content of the entire screen of the shared electronic screen ss to the personal terminal 2c (S251). Thereby, at the web browser displaying the operation display area 132c, the data exchange unit 21c receives the data of the content of the entire screen. Then, at the web browser displaying the operation display area 132c, the display control unit 24c causes the content of the entire screen to be displayed on the operation display area 132c (S252).
- the receiving unit 22c receives a screen capturing (S253).
- the data exchange unit 21c transmits a screen capture request (information) to the content management server 6 (S254).
- the data exchange unit 61 of the content management server 6 receives the screen capture request.
- the image processor 63 of the content management server 6 performs a screen capturing process of an entire screen of the shared electronic screen ss (S255).
- the entire image displayed in the operation display area 132c for the shared electronic screen is captured on the content management server 6 side and displayed in the operation display area 122c for the shared electronic canvas, whereby allowing the user C to import an image shared by the shared electronic screen as an image shared by the electronic canvas.
- the information sharing system achieves the advantageous effects described above referring to the first embodiment. Furthermore, in the present embodiment, instead of transmitting content data of the screen capture image from the personal terminal 2c to the content management server 6 (S118, S138, S155) as in the first embodiment, the screen capture request is sent (S214, S234, S254). Thereby, even when the data amount of the screen capture image is large, screen capturing can be performed more speedily.
- FIG. 20 illustrates the variation 1 of the screen display on the personal terminal 2.
- this variation 1 is a variation of the screen display on the personal terminal 2c illustrated in FIG. 8.
- the operation display areas 112c and 132c are displayed on the display of the personal terminal 2c in substantially the similar manner to FIG. 8.
- a read button r1 and a read button r2 are displayed by the display control unit 24c at the lower right portion of the display.
- the read button r1 implements the same or substantially the same function as the capture button c1 in FIG. 5.
- the read button r1 is a button, when pressed (selected), to cause an image of a screen of the operation display area 132c for the shared electronic screen ss to be captured into the operation display area 112c for the personal electronic canvas dc 3.
- the read button r2 implements the same or substantially the same function as the capture button c2 in FIG. 6.
- the read button r2 is a button, when pressed (selected), to cause an image of a screen of the operation display area 132c for the shared electronic screen ss to be captured into the operation display area 122c for the shared electronic canvas cc.
- the read buttons r1 and r2 are displayed outside the operation display area 112c and the operation display area 132c.
- FIG. 21 illustrates the variation 2 of the screen display on the personal terminal 2.
- this variation 2 is a variation of the screen display on the personal terminal 2c illustrated in FIG. 8.
- one operation display area 112c1 is displayed on the entire display of the personal terminal 2c.
- the operation display area 112c1 is divided into two operation display areas 112c2 and 112c3.
- a content of the shared electronic screen ss is displayed in the operation display area 112c3 on the right side.
- the captured contents are displayed from the top to the bottom in the operation display area 112c3.
- a content c11 obtained by capturing a content of the shared screen ss first is displayed, and a content c12 obtained by capturing another content of the shared screen ss next is displayed.
- the relative positions of the operation display area 112c2 and the operation display area 112c3 illustrated in FIG. 21 is just one example.
- the operation display area 112c3 is displayed on the left side and the operation display area 112c2 is displayed on the right side.
- the operation display area 112c2 is displayed on the upper side and the operation display area 112c3 is displayed on the lower side.
- the operation display area 112c2 is displayed on the lower side and the operation display area 112c3 is displayed on the upper side.
- the capture buttons c1, c2 and c3 are each represented by an icon having a shape of a camera, this is just one example of “instruction information”.
- the instruction information can be characters such as “CAPTURE”, an arrow, or a combination of an icon and characters, for example.
- two operation display areas are displayed by one web browser
- two web browsers a first web browser and a second web browser respectively display two operation display areas (a first operation display area and a second operation display area).
- three or more web browsers can display operation display areas respectively (in this case, three or more operation display areas).
- one web browser can display three or more operation display areas.
- each of the personal electronic canvas and the shared electronic canvas is an infinite electronic canvas
- the present disclosure is not limited to this.
- each of the personal electronic canvas and the shared electronic canvas can be a finite electronic canvas.
- the personal electronic canvas can be a limited finite electronic canvas displayed within the displayable range of the display 208 of the personal terminal 2.
- the shared electronic canvas can be a limited finite electronic canvas displayed within the displayable range of the display 408 of the shared terminal 4.
- the shared terminal 4 and the shared electronic canvas cc can be omitted.
- the description given heretofore of the embodiments is of a case where multiple users conduct a teleconference
- the present disclosure is not limited to such a remote conference but can be applied to various events in which multiple persons at different remote sites or even at the same site communicate via a network in a virtual room.
- Example of the various events include a business meeting between a vendor and a client at different remote sites or at the same site, and exhibitions held at multiple venues at different remote sites.
- Processing circuitry includes a programmed processor, as a processor includes circuitry.
- a processing circuit also includes devices such as an application specific integrated circuit (ASIC), digital signal processor (DSP), field programmable gate array (FPGA), and conventional circuit components arranged to perform the recited functions.
- ASIC application specific integrated circuit
- DSP digital signal processor
- FPGA field programmable gate array
- the content storage request (see S118, S138, and S155) and the screen capture request (S214, S234, and S254) are each an example of a request relating to a content.
- Each communication terminal can transmit data of a content without transmitting the content storage request (see S118, S138, and S155).
- settings are configured in advance that cause the content management server 6 to store the data of the content of the screen capture image in response to receiving the data.
- the operation display area 132c is an example of a first operation display area
- the operation display area 112c is an example of a second operation display area.
- a background color of the screen capture image can be is changed.
- an icon (or characters) indicating that capturing has been performed can be added to the screen capture image.
- a tool bar or the like can be deleted from the screen capture image.
- a part of the screen capture image can be masked or the color of a part of the screen capture image can be changed.
- the processing apparatuses can include any suitably programmed apparatuses such as a general purpose computer, personal digital assistant, mobile telephone (such as a WAP or 3G-compliant phone) and so on. Since the present disclosure can be implemented as software, each and every aspect of the present disclosure thus encompasses computer software implementable on a programmable device.
- the computer software can be provided to the programmable device using any conventional carrier medium (carrier means).
- the carrier medium can include a transient carrier medium such as an electrical, optical, microwave, acoustic or radio frequency signal carrying the computer code.
- An example of such a transient medium is a TCP/IP signal carrying computer code over an IP network, such as the Internet.
- the carrier medium can also include a storage medium for storing processor readable code such as a floppy disk, hard disk, CD ROM, magnetic tape device or solid state memory device.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Information Transfer Between Computers (AREA)
Abstract
A communication terminal is communicable with a content management server. The communication terminal includes: display control means for displaying a first operation display area and a second operation display area using at least one web browser; accepting means for accepting a process for causing a content displayed in the first operation display area to be displayed in the second operation display area; transmitting means for transmitting a request relating to the content to the content management server in response to acceptance of the process by the accepting means; and receiving means for receiving data of the content, the data of the content being transmitted by the content management server in response to the request relating to the content by the transmitting means. The display control means displays, in the second operation display area, the content represented by the data of the content that is received by the receiving means.
Description
The present disclosure relates to sharing contents via a communication network. [Background Art]
In recent years, telework using an information communication technology (ICT) has been adopted, which allows employees to work flexibly without being restricted by where and when they work. To allow persons at different remote places to join a conference or a meeting even when one or more of them works remotely, materials or documents used in the conference or meeting are shared via a communication network or a videoconference is held via the communication network. In this case, a sever sets up a virtual room. Users who have joined this virtual room share materials or documents, thereby a virtual meeting close to a real meeting room can be held (See Patent Literature 1). Such information sharing system allows an individual user to share a content of his or her own document in the virtual room or to import a content of a document being shared in the virtual room as his or her own document. For example, a given user from among the users joining the virtual room causes his or her personal terminal such as a personal computer (PC) to display two windows, each of which is a rectangular operation display area on which operations are performed or contents are displayed by graphical user interfaces (GUIs) of the PC or the like. The given user creates his or her personal content on one of the two windows. The certain user performs a copying operation or the like to cause his or her personal content to be imported to the other one of the two windows on which a shared content is displayed, thereby causing the personal content to be shared. For example, a user causes a personal terminal such as a PC to display a shared window (GUI of the PC) by a web browser, and causes the shared window to display a shared content acquired from a server, thereby conducting a remote conference. Further, the user activates a personal window, different from the shared window, at the same terminal by using word processor software, spreadsheet software or presentation software, thereby conducting a remote conference while viewing the personal documents.
There is a need to provide more convenient sharing of content between multiple communication terminals, to provide more efficient communication and collaboration between multiple users using different private terminals respectively. Furthermore, this should ideally be provided in a way which minimizes technical complexity and the usage of computer resources.
In general terms, the present disclosure suggests that at least one browser running on a communication terminal displays multiple operation display areas. The browser(s) are in communication with a content management server. The communication terminal is operative to transfer content from one of the display areas to another.
The content management server is typically operative to communicate with multiple communication terminals. Typically, each of the multiple communication terminals is operative to display an operation display area (window) which is “shared” between the multiple communication terminals, such that the same content can be displayed in that operation display area at each of the multiple communication terminals.
Thus, the present disclosure makes it possible to display a shared window but also a personal window by the at least one web browser, and display content acquired from a server on the personal window as well, thereby linking contents between operation display areas such as a plurality of windows displayed by the web browser.
Example embodiments of the present invention include a communication terminal communicable with a content management server. The communication terminal includes display control means for displaying a first operation display area and a second operation display area using at least one web browser, accepting means for accepting a process for causing a content displayed in the first operation display area to be displayed in the second operation display area, transmitting means for transmitting a request relating to the content to the content management server in response to acceptance of the process by the accepting means, and receiving means for receiving data of the content, the data of the content being transmitted by the content management server in response to the request relating to the content by the transmitting means. The display control means displays, in the second operation display area, the content represented by the data of the content that is received by the receiving means.
Optionally, each of the operation display areas may be associated with a respective URL, or other data indicating a storage location associated with the operation display area and accessible to the browser over the world wide web.
In example implementations of the present disclosure, a single web browser may be employed to implement the invention on the communication terminals. Optionally a different web browser or a different version of the same web browser, may be employed on different ones of the communication terminals.
The concepts of the present disclosure may be expressed as a communication terminal, as a server operative to interact with the communication terminal. For example, they may be expressed as a content management server operative to communicate with at least one respective web browser running on a plurality of communication terminals. The content management server is configured to receive a request from a web browser of any one of the plurality of communication terminals relating to content displayed in a first operation display area of the one communication terminal; and in response to the request, to transmit data of the content to the one communication terminal, whereby the one communication terminal displays content based on the data of the content in a second operation display area.
The transmission may be to all the communication terminals, whereby the content can be displayed in a second operation display area of all the communication terminals. Alternatively, the first operation display area may be one which displays shared content which is displayed by a first operation display area generated by the respective web browsers of all the communication terminals.
The concepts of the present disclosure may alternatively be expressed as a computer system comprising a server and one or more communication terminals, or as a method performed by a communication terminal, or as a method performed by a server, or as a method performed by a computer system, or as a computer program product carrying program instructions operative by a processor of a computer to cause the computer to carry out one of the methods. The computer program product may, for example, be a storage medium (e.g. a tangible recording medium) storing program instructions, e.g. in non-transitory form. Alternatively, it may be a software product which is downloadable, e.g. without ever being stored other than in a transitory form.
The content management server is typically operative to communicate with multiple communication terminals. Typically, each of the multiple communication terminals is operative to display an operation display area (window) which is “shared” between the multiple communication terminals, such that the same content can be displayed in that operation display area at each of the multiple communication terminals.
Thus, the present disclosure makes it possible to display a shared window but also a personal window by the at least one web browser, and display content acquired from a server on the personal window as well, thereby linking contents between operation display areas such as a plurality of windows displayed by the web browser.
Example embodiments of the present invention include a communication terminal communicable with a content management server. The communication terminal includes display control means for displaying a first operation display area and a second operation display area using at least one web browser, accepting means for accepting a process for causing a content displayed in the first operation display area to be displayed in the second operation display area, transmitting means for transmitting a request relating to the content to the content management server in response to acceptance of the process by the accepting means, and receiving means for receiving data of the content, the data of the content being transmitted by the content management server in response to the request relating to the content by the transmitting means. The display control means displays, in the second operation display area, the content represented by the data of the content that is received by the receiving means.
Optionally, each of the operation display areas may be associated with a respective URL, or other data indicating a storage location associated with the operation display area and accessible to the browser over the world wide web.
In example implementations of the present disclosure, a single web browser may be employed to implement the invention on the communication terminals. Optionally a different web browser or a different version of the same web browser, may be employed on different ones of the communication terminals.
The concepts of the present disclosure may be expressed as a communication terminal, as a server operative to interact with the communication terminal. For example, they may be expressed as a content management server operative to communicate with at least one respective web browser running on a plurality of communication terminals. The content management server is configured to receive a request from a web browser of any one of the plurality of communication terminals relating to content displayed in a first operation display area of the one communication terminal; and in response to the request, to transmit data of the content to the one communication terminal, whereby the one communication terminal displays content based on the data of the content in a second operation display area.
The transmission may be to all the communication terminals, whereby the content can be displayed in a second operation display area of all the communication terminals. Alternatively, the first operation display area may be one which displays shared content which is displayed by a first operation display area generated by the respective web browsers of all the communication terminals.
The concepts of the present disclosure may alternatively be expressed as a computer system comprising a server and one or more communication terminals, or as a method performed by a communication terminal, or as a method performed by a server, or as a method performed by a computer system, or as a computer program product carrying program instructions operative by a processor of a computer to cause the computer to carry out one of the methods. The computer program product may, for example, be a storage medium (e.g. a tangible recording medium) storing program instructions, e.g. in non-transitory form. Alternatively, it may be a software product which is downloadable, e.g. without ever being stored other than in a transitory form.
According to one or more embodiments of the present disclosure, contents can be linked between a first operation display area and a second operation display area, which are displayed by a web browser.
The accompanying drawings are intended to depict example embodiments of the present disclosure and should not be interpreted to limit the scope thereof. The accompanying drawings are not to be considered as drawn to scale unless explicitly noted. Also, identical or similar reference numerals designate identical or similar components throughout the several views.
FIG. 1 is a schematic diagram illustrating an overview of an information sharing system, according to an embodiment of the present disclosure.
FIG. 2 is a block diagram illustrating an example of a hardware configuration of a personal terminal, a shared terminal, and a content management server of the information sharing system, according to an embodiment of the present disclosure.
FIG. 3A and FIG. 3B are a block diagram illustrating an example of a functional configuration of the personal terminal, the shared terminal, and the content management server of the information sharing system, according to an embodiment of the present disclosure.
FIG. 4A and FIG. 4B are conceptual diagrams illustrating example data structures of a personal content management table and a shared content management table, respectively, according to an embodiment of the present disclosure.
FIG. 5 is an illustration of a display example of an operation display area for displaying a personal electronic canvas, according to an embodiment of the present disclosure.
FIG. 6 is an illustration of a display example of an operation display area for displaying a shared electronic canvas, according to an embodiment of the present disclosure.
FIG. 7 is an illustration of a display example of an operation display area for displaying a shared electronic screen, according to an embodiment of the present disclosure.
FIG. 8 is a conceptual diagram illustrating an operation of capturing a content of the shared electronic screen into the personal electronic canvas by pressing a capture button on the operation display area for displaying the personal electronic canvas, according to an embodiment of the present disclosure.
FIG. 9 is a conceptual diagram illustrating an operation of capturing a content of the shared electronic screen into the shared electronic canvas by pressing a capture button on the operation display area for displaying the shared electronic canvas, according to an embodiment of the present disclosure.
FIG. 10 is a conceptual diagram illustrating an operation of capturing a content of the shared electronic screen into the shared electronic canvas by pressing a capture button on the operation display area for displaying the shared electronic screen, according to an embodiment of the present disclosure.
FIG. 11 is a sequence diagram illustrating an operation of inputting and displaying a content, according to an embodiment of the present disclosure.
FIG. 12 is a sequence diagram illustrating an operation of capturing a content of the shared electronic screen into the personal electronic canvas by pressing a capture button on the operation display area for displaying the personal electronic canvas, according to a first embodiment of the present disclosure.
FIG. 13 is a flowchart illustrating a screen capturing process, according to an embodiment of the present disclosure.
FIG. 14 is a flowchart illustrating an operation of storing data of a content, according to an embodiment of the present disclosure.
FIG. 15 is a sequence diagram illustrating an operation of capturing a content of the shared electronic screen into the shared electronic canvas by pressing a capture button on the operation display area for displaying the shared electronic canvas, according to the first embodiment of the present disclosure.
FIG. 16 is a sequence diagram illustrating an operation of capturing a content of the shared electronic screen into the shared electronic canvas by pressing a capture button on the operation display area for displaying the shared electronic screen, according to the first embodiment of the present disclosure.
FIG. 17 is a sequence diagram illustrating an operation of capturing a content of the shared electronic screen into the personal electronic canvas by pressing a capture button on the operation display area for displaying the personal electronic canvas, according to a second embodiment of the present disclosure.
FIG. 18 is a sequence diagram illustrating an operation of capturing a content of the shared electronic screen into the shared electronic canvas by pressing a capture button on the operation display area for displaying the shared electronic canvas, according to the second embodiment of the present disclosure.
FIG. 19 is a sequence diagram illustrating an operation of capturing a content of the shared electronic screen into the shared electronic canvas by pressing a capture button on the operation display area for displaying the shared electronic screen, according to the second embodiment of the present disclosure.
FIG. 20 illustrates Variation 1 of a screen display.
FIG. 21 illustrates Variation 2 of the screen display.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present disclosure. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
In describing embodiments illustrated in the drawings, specific terminology is employed for the sake of clarity. However, the disclosure of this specification is not intended to be limited to the specific terminology so selected and it is to be understood that each specific element includes all technical equivalents that have a similar function, operate in a similar manner, and achieve a similar result.
In describing embodiments illustrated in the drawings, specific terminology is employed for the sake of clarity. However, the disclosure of this specification is not intended to be limited to the specific terminology so selected and it is to be understood that each specific element includes all technical equivalents that have a similar function, operate in a similar manner, and achieve a similar result.
First Embodiment:
A description is now given of a first embodiment of the present disclosure, with reference to FIG. 1 to FIG. 16.
Overview of Information Sharing System:
First, with reference to FIG. 1, an overview of an information sharing system according to the present embodiment is described. FIG. 1 is a schematic diagram illustrating an overview of the information sharing system according to the present embodiment. FIG. 1 illustrates a case in which a user A and a user B who are in a meeting room X of the company and a user C who is at home Y are conducting a remote meeting by using the information sharing system. The user A users apersonal terminal 2a in the meeting room X, and the user B uses a personal terminal 2b in the meeting room X. Further, a shared terminal 4 that can be shared by multiple users is provided in the meeting room X. On the other hand, the user C uses a personal terminal 2c at the home Y. In the following description, the personal terminal 2a, the personal terminal 2b, and the personal terminal 2c are collectively referred to as simply a “personal terminal 2” or “personal terminals 2”, unless they need to be distinguished from each other.
A description is now given of a first embodiment of the present disclosure, with reference to FIG. 1 to FIG. 16.
Overview of Information Sharing System:
First, with reference to FIG. 1, an overview of an information sharing system according to the present embodiment is described. FIG. 1 is a schematic diagram illustrating an overview of the information sharing system according to the present embodiment. FIG. 1 illustrates a case in which a user A and a user B who are in a meeting room X of the company and a user C who is at home Y are conducting a remote meeting by using the information sharing system. The user A users a
The personal terminal 2 is a computer that a user can use individually or exclusively and whose screen is viewed by the user individually. The personal terminal 2 is not limited to being privately-owned. The personal terminal 2 may be public, private, non-profit, rental or any other type of ownership terminal in which a user may individually or exclusively use the terminal and whose screen is viewed by the user individually. The shared terminal 4 is a computer that multiple users can use together or share and whose screen is viewed by the multiple users. Examples of the personal terminal 2 and the shared terminal 4 include a tablet terminal, a smartphone, a PC, a personal digital assistant (PDA), a smartwatch, an electronic whiteboard, a digital television, a game apparatus, and a multifunction peripheral (MFP) having a copier function, and a car navigation system. Each of the personal terminal 2 and the shared terminal 4 is an example of a communication terminal (or an information processing terminal).
Each of the personal terminal 2 and the shared terminal 4 can communicate with the content management server 6 via a communication network 9 such as the Internet. The communication network 9 is, for example, one or more local area networks (LANs) inside the firewall. In another example, the network 9 includes the Internet that is outside the firewall in addition to the LAN. In another example, the communication network 9 further includes a virtual private network (VPN) and/or a wide-area Ethernet (registered trademark). The communication network 9 is any one of a wired network, a wireless network, and a combination of the wired network and the wireless network. In a case where the shared terminal 4, the personal terminal 2 or the content management server 6 connects to the communication network 9 through a mobile phone network such as 3G, Long Term Evolution (LTE), 4G, the LAN can be omitted.
The content management server 6 is a computer, or a plurality of computers, having a function as a web server (or HTTP server) that stores and manages data of contents to be transmitted to the personal terminal 2 and the shared terminal 4. The content management server 6 includes a storage unit 6000 described below. The storage unit 6000 includes a storage location (or a storage area) for implementing a personal electronic canvas that can be accessed only from each personal terminal 2. More specifically, only the personal terminal 2a, the personal terminal 2b and the personal terminal 2c can access a personal electronic canvas dc1, a personal electronic canvas dc2 and a personal electronic canvas dc3, respectively. In the following description, the personal electronic canvas dc1, the personal electronic canvas dc2 and the personal electronic canvas dc3 are collectively referred to as simply a “personal electronic canvas dc”, unless they need to be distinguished from each other.
In one example, thecontent management server 6 supports cloud computing. The “cloud computing” refers to computing where resources on a network are used or accessed without identifying specific hardware resources.
In one example, the
Further, the storage unit 6000 of the content management server 6 includes a storage location (or a storage area) for implementing a shared electronic canvas cc that can be accessed from each of the personal terminals 2. Furthermore, the storage unit 6000 of the content management server 6 includes a storage location (or a storage area) for implementing a shared electronic screen ss that can be accessed from each of the personal terminals 2.
In this disclosure, the “electronic canvas” is not a plain-woven thick cloth but a virtual space generated in the storage location (or the storage area) in the storage unit 6000 of the content management server 6. For example, the electronic canvas can be accessed by using a web application for an electronic canvas, the web application having a function of allowing a user to view and edit a content with the canvas element and JavaScript (registered trademark). The “web application” refers to software that operates by cooperation between a program described in a script language such as JavaScript (registered trademark) operating on a browser application and a program on the web server side, which operate in cooperation with each other, and is used on the browser or such mechanism. The personal electronic canvas and the shared electronic canvas have infinite (i.e. without a pre-determined size) areas within the range of the storage area in the storage unit 6000.
In addition, the “electronic screen” is not a white screen for projecting a movie or a slide image for viewing but a virtual space generated in a storage location (or storage area) in the storage unit 6000 of the content management server 6. Different from the electronic canvas, the electronic screen has a function of holding data of a content to be transmitted (distributed) to the personal terminals 2 and the shared terminal 4 and holding the previous content until acquiring the next content. The electronic screen can be accessed by using a web application for an electronic screen, the web application having a function of allowing a user to view content.
The “personal electronic canvas” refers to an electronic space dedicated to each user participating in a remote meeting. The personal terminal 2 of each user can access only the personal electronic canvas dedicated to the corresponding user, thereby allowing the corresponding user to view and/or edit (input, delete, copy, etc.) contents such as characters and images on the accessed personal electronic canvas. The “shared electronic canvas” refers to an electronic space that users participating in the remote meeting use together or share. Any of the personal terminals 2 of the users can access the shared electronic canvas, thereby allowing the users to view and/or edit (input, delete, copy, etc.) contents such as characters and images.
The “shared electronic screen” refers to an electronic space shared by users participating in the remote meeting. Any of the personal terminals 2 of the users can access the shared electronic screen, thereby allowing the users to view a shared screen held by the shared electronic screen. However, unlike the personal electronic canvas and the shared electronic canvas, the shared electronic screen has a simple function of holding data of content to be transmitted (distributed) to the personal terminals 2 and the shared terminal 4 and holding the previous content before acquiring the next content. For example, in a case where data of a content is transmitted from the personal terminal 2a to the shared electronic screen ss and thereafter data of a content is transmitted from the personal terminal 2b to the shared electronic screen ss, data of a content held by the shared electronic screen ss is the data received latest.
The content management server 6 stores, for each of virtual rooms, information (data) such as contents developed on the shared electronic screen ss, the shared electronic canvas cc, and the personal electronic canvas dc in association with the corresponding virtual room. Thereby, even when the content management server 6 manages multiple virtual rooms, data of a content are not communicated over different virtual rooms.
Each personal terminal 2 causes the above-described web application operating on the web browser installed in the personal terminal 2 to display a content of the personal electronic canvas dc, the shared electronic canvas cc, and the shared electronic screen ss.
Although FIG. 1 illustrates a case where the remote meeting is held between two sites (e.g., the meeting room X and the home Y), this is just an example. In another example, a meeting is held in one site or a remote meeting is performed in three or more sites.
Hardware Configuration:
With reference to FIG. 2, a description is given of an example of any one of a hardware configuration of thepersonal terminal 2, the shared terminal 4, and the content management server 6 of the information sharing system. FIG. 2 is a block diagram illustrating an example of any one of a hardware configuration of the personal terminal 2, the shared terminal 4, and the content management server 6 of the information sharing system.
With reference to FIG. 2, a description is given of an example of any one of a hardware configuration of the
Hardware Configuration of Personal Terminal:
As illustrated in FIG. 2, thepersonal terminal 2 includes a central processing unit (CPU) 201, a read only memory (ROM) 202, a random access memory (RAM) 203, a hard disk (HD) 204, a hard disk drive (HDD) controller 205, a storage medium 206, a medium interface (I/F) 207, a display 208, a touch panel 209, a network I/F 210, a keyboard 211, a mouse 212, a compact disc rewritable (CD-RW) drive 214, and a bus line 220.
As illustrated in FIG. 2, the
The CPU 201 controls entire operation of the personal terminal 2. The ROM 202 stores a program to boot the CPU 201. The RAM 203 is used as a work area for the CPU 201. The HD 204 stores various data such as a control program. The HDD controller 205 controls reading and writing of various data from and to the HD 204 under control of the CPU 201. The medium I/F 207 controls reading and writing (storing) of data from and to the storage medium 206 such as a flash memory. The display 208 displays various information such as a cursor, menu, window, characters, or image. The touch panel 209 is one example of an input device (input means) that allows a user to operate the personal terminal 2 by touching a screen of the display 208. The network I/F 210 is an interface that controls communication of data through the communication network 9. The keyboard 211 is one example of input device (input means) provided with a plurality of keys for allowing a user to input characters, numerals, or various instructions. The mouse 212 is one example of an input device (input means) that allows a user to select a specific instruction or execution, select a target for processing, or move a cursor being displayed. The CD-RW drive 214 reads and writes various data to and from to a CD-RW 213, which is one example of a removable storage medium. Any one of the display 208, touch panel 209, keyboard 211, and mouse 212 may be provided separately from the personal terminal 2 as long as the personal terminal 2 is capable of interacting with the user.
Hardware Configuration of Content Management Server:
The sharedterminal 4 includes a CPU 401, a ROM 402, a RAM 403, an HD 404, an HDD controller 405, a storage medium 406, a medium I/F 407, a display 408, a touch panel 409, a network I/F 410, a keyboard 411, a mouse 412, a CD-RW drive 414, and a bus line 420. Since these hardware elements are the same or substantially the same as the CPU 201, ROM 202, RAM 203, the HD 204, the HDD controller 205, the storage medium 206, the medium I/F 207, the display 208, the touch panel 209, the network I/F 210, the keyboard 211, the mouse 212, the CD-RW drive 214, and the bus line 220, redundant descriptions thereof are omitted below.
The shared
The content management server 6 includes a CPU 601, a ROM 602, a RAM 603, an HD 604, an HDD controller 605, a storage medium 606, a medium I/F 607, a display 608, a touch panel 609, a network I/F 610, a keyboard 611, a mouse 612, a CD-RW drive 614, and a bus line 620. Since these hardware elements are the same or substantially the same as the CPU 201, ROM 202, RAM 203, the HD 204, the HDD controller 205, the storage medium 206, the medium I/F 207, the display 208, the touch panel 209, the network I/F 210, the keyboard 211, the mouse 212, the CD-RW drive 214, and the bus line 220, redundant descriptions thereof are omitted below. The content management server 6 may not include the touch panel 609.
Instead of the CD-RW drive, a digital versatile disc recordable (DVD-R) drive or the like can be used. Each of the personal terminal 2, the shared terminal 4 and the content management server 6 can be configured by a single computer or a plurality of computers to which divided portions (functions, means, or storages) are arbitrarily allocated.
Functional Configuration:
With reference to FIG. 3A and FIG. 3B, a description is given of an example of a functional configuration of each of thepersonal terminal 2, the shared terminal 4, and the content management server 6 of the information sharing system. FIG. 3A and FIG. 3B are a block diagram illustrating an example of a functional configuration of the personal terminal 2, the shared terminal 4, and the content management server 6 of the information sharing system.
With reference to FIG. 3A and FIG. 3B, a description is given of an example of a functional configuration of each of the
Functional Configuration of Personal Terminal:
First, a description is given of an example of a functional configuration of thepersonal terminal 2a. As illustrated in FIG. 3A, the personal terminal 2a includes a data exchange unit 21a, a receiving unit 22a, an image processor 23a, a display control unit 24a, a determination unit 25a, a storing and reading processor 29a, and a communication management unit 30a. These units are functions that are implemented by or that are caused to function by operating any of the hardware elements illustrated in FIG. 2 in cooperation with the instructions of the CPU 201 according to the control program expanded from the HD 204 to the RAM 203. The personal terminal 2a further includes a storage unit 2000a, which is implemented by the RAM 203 and the HD 204 illustrated in FIG. 2.
First, a description is given of an example of a functional configuration of the
The data exchange unit 21a, the receiving unit 22a, the image processor 23a, the display control unit 24a, the determination unit 25a, and the storing and reading processor 29a are implemented by the web browser (the web application of the web browser) that displays the operation display area described below. The communication management unit 30a is implemented by a dedicated communication application.
Personal Content Management DB:
FIG. 4A is a conceptual diagram illustrating an example data structure of a personal content management table. Thestorage unit 2000a of the personal terminal 2a stores a personal content management database (DB) 2001a implemented by the personal content management table as illustrated in FIG. 4A. Since the personal content management DB 2001a is generated for each personal electronic canvas (URL) to be displayed by the web browser in the cache of the web browser, the personal content management DB 2001a is present only while the web browser is activated.
FIG. 4A is a conceptual diagram illustrating an example data structure of a personal content management table. The
Data stored in the personal content management table is the same as data stored for each of the personal terminals 2 in a personal content management DB 6001 described below of the content management server 6. For example, the personal terminal 2a acquires data for the personal terminal 2a from among the data for the personal terminals 2 stored in the content management server 6 and stores the acquired data in the personal content management DB 2001a.
Further, the personal content management table stores, for each uniform resource locator (URL) specifying an access location (position) of the personal electronic canvas, a content ID, data of a content, and content display position information in association with each other. The content ID is an example of content identification information for identifying each content. The data of a content is data such as text data, image data such as screen capture image data, and vector data obtained by drawing. The display position information indicates a display position of the content on the personal electronic canvas. This display position indicates a position where the corresponding content is to be displayed on the personal electronic canvas as an infinite canvas.
The URL is an example of location specifying information. Examples of the location specifying information further include a uniform resource identifier.
Shared Content Management DB:
FIG. 4B is a conceptual diagram illustrating an example data structure of a shared content management table. Thestorage unit 2000a of the personal terminal 2a stores a shared content management DB 2002a implemented by the shared content management table as illustrated in FIG. 4B. Since the shared content management DB 2002a is generated for each shared electronic canvas (URL) to be displayed by the web browser in the cache of the web browser, the shared content management DB 2002a is present only while the web browser is activated.
FIG. 4B is a conceptual diagram illustrating an example data structure of a shared content management table. The
Data stored in the shared content management table is the same as data stored in a shared content management DB 6002 described below of the content management server 6. For example, the personal terminal 2a acquires the data stored in the shared content management DB 6002 of the content management server 6 and stores the acquired data in the shared content management DB 2002a.
Further, the shared content management table stores, for each URL specifying an access location (position) of the shared electronic canvas, a content ID, data of a content, and content display position information in association with each other. The same description given above with reference to FIG. 4A of the content ID, the data of a content, and the display position information of the personal content management table applies to the content ID, the content data, and the display position information of the shared content management table, and therefore redundant descriptions thereof are omitted below.
Each Functional Unit of Personal Terminal:
Next, a detailed description is given of each functional unit of thepersonal terminal 2a.
Next, a detailed description is given of each functional unit of the
The data exchange unit 21a transmits and receives various data (or information) to and from other terminals, apparatuses, etc. via the communication network 9. For example, the data exchange unit 21a receives, from the content management server 6, content data described in a hypertext markup language (HTML), Cascading Style Sheet (CSS), and JavaScript (registered trademark). In addition, the data exchange unit 21a transmits operation information input by the user to the content management server 6.
The receiving unit 22a receives various selections or instructions input by the user using the keyboard 211 and the mouse 212.
The image processor 23a performs processing such as generating vector data (or stroke data) according to drawing by the user, for example. The image processor 23a further has a function as a capturing unit. For example, the image processor 23a performs screen capturing of an operation display area 132a described below to capture image data of the screen.
The display control unit 24a controls the display 208 to display contents of various images and screens.
The determination unit 25a performs various determinations.
The storing and reading processor 29a is implemented by the HDD controller 205, the medium I/F 207 and the CD-RW drive 214, which operate in accordance with instructions of the CPU 201 illustrated in FIG. 2. The storing and reading processor 29a stores various types of data in the storage unit 2000a, the storage medium 206 and the CD-RW 213. Further, the storing and reading processor 29a reads out various types of data from the storage unit 2000a, the storage medium 206 and the CD-RW 213.
The communication management unit 30a, which is implemented mainly by instructions of the CPU 201 illustrated in FIG. 2, performs data input/output with the data exchange unit 21a, etc. The communication management unit 30a further includes a data exchange unit 31a, a capturing unit 33a, and a determination unit 35a. The data exchange unit 31a transmits and receives various data (or information) to and from the content management server 6 via the communication network 9 independently of the data exchange unit 21a. The capturing unit 33a has the same or substantially the same function as the capturing unit of the image processor 23a. For example, the capturing unit 33a performs screen capturing of the operation display area 132a described below to capture image data of the screen. The determination unit 35a performs various determinations such as determining whether the operation display area 132a for the shared electronic screen is displayed on the display 208 of the personal terminal 2a.
The personal terminal 2b includes a data exchange unit 21b, a receiving unit 22b, an image processor 23b, a display control unit 24b, a determination unit 25b, a storing and reading processor 29b, and a communication management unit 30b. The personal terminal 2c includes a data exchange unit 21c, a receiving unit 22c, an image processor 23c, a display control unit 24c, a determination unit 25c, a storing and reading processor 29c, and a communication management unit 30c. These units are functions that are implemented by or that are caused to function by operating any of the hardware elements illustrated in FIG. 2 in cooperation with the instructions of the CPU 201 according to the control program expanded from the HD 204 to the RAM 203. The personal terminal 2b and the personal terminal 2c further include a storage unit 2000b and a storage unit 2000c, respectively, each of which is implemented by the RAM 203 and the HD 204 illustrated in FIG. 2. The functions of the data exchange units 21b and 21c, the receiving units 22b and 22c, the image processors 23b and 23c, the display control units 24b and 24c, the determination units 25b and 25c, the storing and reading processors 29b and 29c, the communication management units 30b and 30c, and the storage units 2000b and 2000c are the same or substantially the same as those of the data exchange unit 21a, the receiving unit 22a, the image processor 23a, the display control unit 24a, the determination unit 25a, the storing and reading processor 29a, the communication management unit 30a and the storage unit 2000a of the personal terminal 2a respectively, and therefore redundant description thereof are omitted below. Further, the communication management unit 30b includes a data exchange unit 31b, a capturing unit 33b, and a determining unit 35b. Similarly, the communication management unit 30c includes a data exchange unit 31c, a capturing unit 33c, and a determination unit 35c. The functions of the data exchange units 31b and 31c, the capturing units 33b and 33c, and the determination units 35b and 35c are the same of substantially the same as those of the data exchange unit 31a, the capturing unit 33a, and the determination unit 35a of the communication management unit 30a respectively, and therefore redundant descriptions thereof are omitted below.
Further, the storage unit 2000b of the personal terminal 2b stores a personal content management DB 2001b and a shared content management DB 2002b. The storage unit 2000c of the personal terminal 2c stores a personal content management DB 2001c and a shared content management DB 2002c. The personal content management DBs 2001b and 2001c and the shared content management DBs 2002b and 2002c have the same or substantially the same data structures as the personal content management DB 2001a and the shared content management DB 2002a, respectively, and therefore redundant descriptions thereof are omitted below.
Functional Configuration of Shared Terminal:
A description is now given of an example of a functional configuration of the sharedterminal 4. As illustrated in FIG. 3B, the shared terminal 4 includes a data exchange unit 41, a receiving unit 42, an image processor 43, a display control unit 44, a determination unit 45, a storing and reading processor 49, and a communication management unit 50. These units are functions that are implemented by or that are caused to function by operating any of the hardware elements illustrated in FIG. 2 in cooperation with the instructions of the CPU 401 according to the control program expanded from the HD 404 to the RAM 403. The shared terminal 4 further includes a storage unit 4000, which is implemented by the RAM 403 and the HD 404 illustrated in FIG. 2. The functions of the data exchange unit 41, the receiving unit 42, the image processor 43, the display control unit 44, the determination unit 45, the storing and reading processor 49, the communication management unit 50, and the storage unit 4000 of the shared terminal 4 are the same of the substantially the same as those of the data exchange unit 21a, the receiving unit 22a, the image processor 23a, the display control unit 24a, the determination unit 25a, the storing and reading processor 29a, the communication management unit 30, and the storage unit 2000a of the personal terminal 2a respectively, and therefore redundant descriptions thereof are omitted below. The communication management unit 30 further includes a data exchange unit 51, a capturing unit 53, and a determination unit 55. Since the functions of the data exchange unit 51, the capturing unit 53, and the determination unit 55 are the same or the substantially the same as those of the data exchange unit 31a, the capturing unit 33a, and the determination unit 35a, respectively, redundant descriptions thereof are omitted below.
A description is now given of an example of a functional configuration of the shared
Further, the storage unit 4000 of the shared terminal 4 stores a shared content management DB 4002. Since the shared content management DB 4002 has the same or substantially the same data structure as the shared content management DB 2002a of the personal terminal 2a, a redundant description thereof is omitted below.
The data exchange unit 41, the receiving unit 42, the image processor 43, the display control unit 44, the determination unit 45, and the storing and reading processor 49 are implemented by the web browser (the web application of the web browser) that displays the operation display area described below. The communication management unit 50 is implemented by a dedicated communication application.
Functional Configuration of Content Management Server:
A description is now given of an example of a functional configuration of thecontent management server 6. As illustrated in FIG. 3A, the content management server 6 includes a data exchange unit 61, an image processor 63, a generation unit 64, a determination unit 65, and a storing and reading processor 69. These units are functions that are implemented by or that are caused to function by operating any of the hardware elements illustrated in FIG. 2 in cooperation with the instructions of the CPU 601 according to the control program expanded from the HD 604 to the RAM 603. The content management server 6 further includes a storage unit 6000, which is implemented by the RAM 603 and the HD 604 illustrated in FIG. 2.
A description is now given of an example of a functional configuration of the
Each Functional Unit of Content Management Server:
Next, a detailed description is given of each functional unit of thecontent management server 6.
Next, a detailed description is given of each functional unit of the
The data exchange unit 61 transmits and receives various data (or information) to and from other terminals, apparatuses, etc. via the communication network 9.
The image processor 63 further has a function as a capturing unit. For example, the image processor 63 performs screen capturing of the shared electronic canvas cc described below to capture image data of the screen.
The generation unit 64 generates a unique content ID, etc.
The determination unit 65 determines whether the content ID has been received by the data exchange unit 61.
The storing and reading processor 69 is implemented by the HDD controller 605, the medium I/F 607 and the CD-RW drive 614, which operate in accordance with instructions of the CPU 601 illustrated in FIG. 2. The storing and reading processor 69 stores various types of data in the storage unit 6000, the storage medium 606 and the CD-RW 613. Further, the storing and reading processor 69 reads out various types of data from the storage unit 6000, the storage medium 606 and the CD-RW 613.
The storage unit 6000 of the content management server 6 stores the personal content management DB 6001 and the shared content management DB 6002. The personal content management DB 6001 and the shared content management DB 6002 have the same or substantially the same data structures as the personal content management DB 2001a and the shared content management DB 2002a, respectively, and therefore redundant descriptions thereof are omitted below.
However, the personal content management DB 6001 stores all data of the personal content management DBs 2001a, 2001b, and 2001c. Further, the shared content management DB 6002 has all data of the shared content management DBs 2002a, 2002b, 2002c and the shared content management DB 4002.
The above described programs may be stored in a storage medium such as a CD-R or a DVD-R for domestic or overseas distribution.
Display Example of Operation Display Area:
A description is now given of display examples of operation display areas with reference to FIGs. 5 to 7. The operation display area is an area on a screen for displaying information to be presented to a user with graphical user interfaces (GUIs) or for accepting an operation from the user. The operation display area is a display mode of a web browser or application software. For example, Microsoft Windows (registered trademark) or the like corresponds to the operation display area. Anoperation display area 110 represents a given area in the personal electronic canvas dc having an infinite space. An operation display area 120 represents a given area in the shared electronic canvas cc having an infinite space.
A description is now given of display examples of operation display areas with reference to FIGs. 5 to 7. The operation display area is an area on a screen for displaying information to be presented to a user with graphical user interfaces (GUIs) or for accepting an operation from the user. The operation display area is a display mode of a web browser or application software. For example, Microsoft Windows (registered trademark) or the like corresponds to the operation display area. An
FIG. 5 is an illustration of a display example of the operation display area 110 for displaying the personal electronic canvas. As illustrated in FIG. 5, the operation display area 110 for displaying the personal electronic canvas is displayed in response to selection of a tab t1 labeled with “Personal electronic canvas” by the user among three tabs displayed in the upper area.
On the left side of the operation display area 110, a function icon section f10 is displayed. The function icon section f10 includes various function icons such as a screen movement and a drawing pen. In the lower left portion of the operation display area 110, a scrollbar re1 for specifying stepwise reduction or enlargement of displayed characters or the like is displayed. In the lower right portion of the operation display area 110, a capture button c1, an upload/share button su1, a download/share button sd1, a reduction button r1, and an enlargement button e1 are displayed.
The capture button c1 is a button, when selected, for causing the capturing unit 33c to capture a screen that is to be displayed (or has been displayed) in the operation display area for the shared electronic screen and importing and displaying the captured screen in the operation display area 110 for the personal electronic canvas. In other words, capturing of a screen of the operation display area for the shared electronic screen is initiated by pressing the button on the operation display area 110 for the personal electronic canvas, which is a destination to which image data is to be imported. In the example of FIG. 5, the capture button c1 is represented by an icon having a shape of a camera.
The upload/share button su1 a button, when selected, for uploading image data of an entire screen displayed on the display 208 of the personal terminal 2 to the content management server 6 and expanding the uploaded image data on the shared electronic screen ss. The download/share button sd1 is a button, when selected, for downloading image data expanded on the shared electronic screen ss from the content management server 6 and displaying an image represented by the downloaded image data in the operation display area 110 for the personal electronic canvas. The reduction button r1 is a button, when selected, for reducing the proportion of the operation display area 110 in the display. The enlargement button e1 is a button, when selected, for increasing the proportion of the operation display area 110 in the display.
FIG. 6 is an illustration of a display example of the operation display area 120 for displaying the shared electronic canvas. As illustrated in FIG. 6, the operation display area 120 for displaying the sharing electronic canvas is displayed in response to selection of a tab t2 labeled with “Shared electronic canvas” by the user among three tabs displayed in the upper area.
On the left side of the operation display area 120, a function icon section f20 is displayed. The function icon section f20 includes various function icons such as a screen movement and a drawing pen. In the lower left portion of the operation display area 120, a scrollbar re2 for specifying stepwise reduction or enlargement of displayed characters or the like is displayed. In the lower right portion of the operation display area 120, a capture button c2, an upload/share button su2, a download/share button sd2, a reduction button r2, and an enlargement button e2 are displayed.
The capture button c2 is a button, when selected, for causing the capturing unit 33c to capture a screen that is to be displayed (or has been displayed) in the operation display area for the shared electronic screen and importing and displaying the captured screen in the operation display area 120 for the shared electronic canvas. In other words, capturing of a screen of the operation display area for the shared electronic screen is initiated by pressing the button on the operation display area 120 for the shared electronic canvas, which is a destination to which image data is to be imported. In the example of FIG. 6, the capture button c2 is represented by an icon having a shape of a camera.
The upload/share button su2 is a button, when selected, for uploading image data of a screen displayed in the operation display area 120 for the shared electronic canvas to the content management server 6 and expanding the uploaded image data to the shared electronic screen ss. The download/share button sd2 is a button, when selected, for downloading image data expanded on the shared electronic screen ss from the content management server 6 and displaying an image represented by the downloaded image data in the operation display area 120 for the shared electronic canvas. Since the reduction button r2 and the enlargement button e2 have the same or substantially the same function as the reduction button r1 and the enlargement button e1 in the operation display area 110, respectively, redundant descriptions thereof are omitted below.
FIG. 7 is an illustration of a display example of the operation display area 130 for displaying the shared electronic screen. As illustrated in FIG. 7, the operation display area 130 for displaying the shared electronic screen is displayed in response to selection of a tab t3 labeled with “Shared electronic screen” by the user among three tabs displayed in the upper area.
In the lower portion of the operation display area 130, a capture button c3, a reduction button r3 and an enlargement button e3 are displayed.
The capture button c3 is a button, when selected, for capturing a screen that is displayed in the operation display area for the shared electronic screen and importing and displaying the captured screen in the operation display area 120 for the shared electronic canvas. In other words, when capturing of the screen of the operation display area for the shared electronic screen is initiated by pressing the button on the operation display area 130 for the shared electronic screen, which is a source from which the image data is to be captured, a destination to which the image data is to be imported is the operation display area 120 for the shared electronic canvas. In the example of FIG. 7, the capture button c3 is represented by an icon having a shape of a camera.
Processes or Operation:
A description is given now of an operation or processes according to the present embodiment, with reference to FIG. 8 to FIG. 16.
A description is given now of an operation or processes according to the present embodiment, with reference to FIG. 8 to FIG. 16.
Overview of First Operation or Processes:
First, with reference to FIG. 8, a description is given of an operation or processes in which the user C using thepersonal terminal 2c presses the capture button c1 on an operation display area 112c for displaying the personal electronic canvas to copy the content of the shared electronic screen ss to the personal electronic canvas dc3. FIG. 8 is a conceptual diagram illustrating an operation of capturing the content of the shared electronic screen into the personal electronic canvas by pressing the capture button on the operation display area for displaying the personal electronic canvas. Note that the operation display area 112c represents a given area in the personal electronic canvas dc3 having an infinite space.
First, with reference to FIG. 8, a description is given of an operation or processes in which the user C using the
FIG. 8 illustrates a state where the personal terminal 2a transmits, to the shared electronic screen ss, image data of the entire screen displayed on the display 208 of the personal terminal 2a according to the user A’s instruction, to cause the screen to be shared with the personal terminal 2b, the personal terminal 2c and the shared terminal 4. In FIG. 8, a screen on which text data “RI” is input is illustrated as an example of the entire screen. Further, FIG. 8 illustrates a state in which according to the user C’s instruction, the personal terminal 2c displays the content shared by the personal terminal 2a on the operation display area 132c for displaying the shared electronic screen, and thereafter copies and imports the shared content to the operation display area 112c for displaying the personal electronic canvas.
Note that in the present embodiment, the content of the entire screen is an example of a specific content.
First, at the personal terminal 2a, a content “RI” is displayed on the operation display area 112a, and data of the content of the entire screen is transmitted to the shared electronic screen ss of the content management server 6 (S11). The content management server 6 stores the data of the content of the entire screen in a storage area for the shared electronic screen ss in the storage unit 6000. The data transmitted in step S11 can be either moving image data or still image data.
Next, the user C operates the personal terminal 2c to display the operation display area 132c to send a request for data of a content of the shared electronic screen ss to the content management server 6 (S12). The content management server 6 transmits data of the content of the entire screen of the shared electronic screen ss to the personal terminal 2c (S13). Thereby, at the personal terminal 2c, the content of the entire screen is displayed in the operation display area 132c by the web browser.
Further, at the personal terminal 2c, the operation display area 112c for displaying a content of the personal electronic canvas dc3 is displayed.
In this state, in order to copy the content of the entire screen displayed on the operation display area 132c to the personal electronic canvas dc3 of the user C, the user C presses the capture button c1 on the operation display area 112c to perform screen capturing of the operation display area 132c different from the operation display area 112c (S14). Note that in the present embodiment, the operation display area 132c is an example of a first operation display area, and the operation display area 112c is an example of a second operation display area.
Next, the personal terminal 2c transmits data of a content of the captured entire screen to the content management server 6 by the web browser displaying the operation display area 112c (S15). Then, the content management server 6 transmits the data of the content of the entire screen to the personal terminal 2c (S16). Thereby, at the personal terminal 2c, the content of the entire screen is displayed on the operation display area 112c by the web browser.
Thus, when the user C using the personal terminal 2c presses the capture button c1 on the operation display area 112c at the personal terminal 2c, the screen displayed in the operation display area 132c different from the operation display area 112c is copied to the operation display area 112c.
Overview of Second Operation or Processes:
Next, with reference to FIG. 9, a description is given of an operation or processes in which the user C using thepersonal terminal 2c presses the capture button c2 on an operation display area 122c for displaying the shared electronic canvas to copy the content of the shared electronic screen ss to the shared electronic canvas cc. FIG. 9 is a conceptual diagram illustrating an operation of capturing the content of the shared electronic screen into the shared electronic canvas by pressing the capture button on the operation display area for displaying the shared electronic canvas. Note that the operation display area 122c represents a given area in the shared electronic canvas cc having an infinite space.
Next, with reference to FIG. 9, a description is given of an operation or processes in which the user C using the
FIG. 9 illustrates a state where the personal terminal 2a transmits, to the shared electronic screen ss, data of a content of the entire screen on which text data “RI” is displayed according to the user A’s instruction, to cause the screen to be shared with the personal terminal 2b, the personal terminal 2c and the shared terminal 4. Further, FIG. 9 illustrates a state in which according to the user C’s instruction, the personal terminal 2c displays the content shared by the personal terminal 2a on the operation display area 132c for the shared electronic screen, and thereafter copies and imports the shared content to the operation display area 122c for displaying the shared electronic canvas.
Note that in the present embodiment, the content of the entire screen is an example of a specific content. Further, a storage location (storage area) in the storage unit 6000, which is an access destination (URL) to the shared electronic screen ss, is an example of a first location in the storage unit 6000. Further, a storage location (storage area) in the storage unit 6000, which is an access destination (URL) to the personal electronic canvas dc3, is an example of a second location in the storage unit 6000.
First, at the personal terminal 2a, the content “RI” is displayed on the operation display area 112a, and data of the content of the entire screen is transmitted to the shared electronic screen ss of the content management server 6 (S31). The content management server 6 stores the data of the content of the entire screen in a storage area for the shared electronic screen ss in the storage unit 6000. The data transmitted in step S31 can be either moving image data or still image data.
Next, the user C operates the personal terminal 2c to display the operation display area 132c to send a request for data of a content of the shared electronic screen ss to the content management server 6 (S32). The content management server 6 transmits data of the content of the entire screen of the shared electronic screen ss to the personal terminal 2c (S33). Thereby, at the personal terminal 2c, the content of the entire screen is displayed in the operation display area 132c by the web browser. The processes in steps S31 to S33 are the same or substantially the same as those in steps S11 to S13.
Further, at the personal terminal 2c, the operation display area 122c for displaying a content of the shared electronic canvas cc is displayed.
In this state, in order to copy the content of the entire screen displayed on the operation display area 132c to the shared electronic canvas cc, the user C presses the capture button c2 on the operation display area 122c to perform screen capturing of the operation display area 132c different from the operation display area 122c (S34).
Next, the personal terminal 2c transmits data of a content of the captured entire screen to the content management server 6 by the web browser displaying the operation display area 122c (S35). Then, the content management server 6 transmits the data of the content of the entire screen to the personal terminal 2c (S36). Thereby, at the personal terminal 2c, the content of the entire screen is displayed on the operation display area 122c by the web browser.
As described above, when the user C using the personal terminal 2c presses the capture button c2 on the operation display area 122c at the personal terminal 2c, the screen displayed in the operation display area 132c different from the operation display area 122c is copied to the operation display area 122c.
Overview of Third Operation or Processes:
Next, with reference to FIG. 10, a description is given of an operation or processes in which the user C using thepersonal terminal 2c presses the capture button c3 on an operation display area 132c for displaying the shared electronic screen ss to copy the content of the shared electronic screen ss to the shared electronic canvas cc. FIG. 10 is a conceptual diagram illustrating an operation of capturing the content of the shared electronic screen into the shared electronic canvas by pressing the capture button on the operation display area for displaying the shared electronic screen.
Next, with reference to FIG. 10, a description is given of an operation or processes in which the user C using the
FIG. 10 illustrates a state where the personal terminal 2a transmits, to the shared electronic screen ss, data of a content of the entire screen on which text data “RI” is displayed according to the user A’s instruction, to cause the screen to be shared with the personal terminal 2b, the personal terminal 2c and the shared terminal 4. Further, FIG. 10 illustrates a state in which according to the user C’s instruction, the personal terminal 2c displays the content shared by the personal terminal 2a on the operation display area 132c for the shared electronic screen, and thereafter copies and imports the shared content to the operation display area 122c for displaying the shared electronic canvas.
First, at the personal terminal 2a, the content “RI” is displayed on the operation display area 112a, and data of the content of the entire screen is transmitted to the shared electronic screen ss of the content management server 6 (S51). The content management server 6 stores the data of the content of the entire screen in a storage area for the shared electronic screen ss in the storage unit 6000. The data transmitted in step S51 can be either moving image data or still image data.
Next, the user C operates the personal terminal 2c to display the operation display area 132c to send a request for data of a content of the shared electronic screen ss to the content management server 6 (S52). The content management server 6 transmits data of a content of the entire screen of the shared electronic screen ss to the personal terminal 2c (S53). Thereby, at the personal terminal 2c, the content of the entire screen is displayed in the operation display area 132c by the web browser. The processes in steps S51 to S53 are the same or substantially the same as those in steps S11 to S13 (steps S31 to S33).
Further, at the personal terminal 2c, the operation display area 122c for displaying a content of the shared electronic canvas cc is displayed.
In this state, in order to copy the content of the entire screen displayed on the operation display area 132c to the shared electronic canvas cc, the user C presses the capture button c3 on the operation display area 132c to perform screen capturing of the same operation display area 132c (S54).
Next, the personal terminal 2c transmits data of a content of the captured entire screen to the content management server 6 by the web browser displaying the operation display area 122c (S55). Then, the content management server 6 transmits data of a content of the entire screen to the personal terminal 2c (S66). Thereby, at the personal terminal 2c, the content of the entire screen is displayed on the operation display area 122c by the web browser.
As described above, when the user C using the personal terminal 2c presses the capture button c3 on the operation display area 132c at the personal terminal 2c, the screen displayed in this operation display area 132c is copied to the operation display area 122c.
Details of Basic Operation or Processes:
Referring to FIG. 11 to FIG. 19, a detailed description is given of a basic operation or processes. FIG. 11 is a sequence diagram illustrating an operation of inputting and displaying a content. Prior to describing an operation of copying a content from theoperation display area 132c for the shared electronic screen, a description is now given of a basic operation of displaying a content of a screen element (not an entire screen) such as characters in the operation display area for the personal electronic canvas (in this example, the operation display area 112c of the personal terminal 2c) by using a web browser.
Referring to FIG. 11 to FIG. 19, a detailed description is given of a basic operation or processes. FIG. 11 is a sequence diagram illustrating an operation of inputting and displaying a content. Prior to describing an operation of copying a content from the
First, at the personal terminal 2c, when the user C inputs a content of a screen element (such as a character) at a desired position on the operation display area 112c by using the keyboard 211 and the mouse 212, the receiving unit 22c receives the input (S71). Then, the data exchange unit 21c transmits, to the content management server 6, data of the content of the screen element and display position information p0 indicating a display position of the content in the personal electronic canvas dc3 (S72). The data exchange unit 61 of the content management server 6 receives the data of the content and the display position information p0.
Next, the storing and reading processor 69 of the content management server 6 stores the content data and the display position information p0 in association with each other in the personal content management table in which an URL of the personal electronic canvas dc3 is managed in the personal content management DB 6001 (S73). Then, the generation unit 64 generates a unique content ID 10 (S74).
Next, the storing and reading processor 69 stores the content ID 10 generated in step S74 in association with the content data and display position information p0 stored in step S73 (S75).
Next, the data exchange unit 61 transmits an update notification, which is a notification indicating an update of the personal electronic canvas, to the personal terminal 2c (S76). In a case where the user C has multiple personal terminals 2 and accesses the same personal electronic canvas (URL) from the multiple personal terminals 2, the content management server 6 sends the update notification to each of the multiple personal terminals 2 of the user C. Thereby, at the web browser displaying the operation display area 112c of the personal terminal 2c, the data exchange unit 21c receives the update notification.
Next, at the web browser displaying the operation display area 112c of the personal terminal 2c, the data exchange unit 21c transmits a request for updated content data and display position information to the content management server 6 (S77). The data exchange unit 61 of the content management server 6 receives the request for the content data and the display position information.
Next, the storing and reading processor 69 of the content management server 6 reads out the content ID 10, the data of the content, and the display position information p0 corresponding to the updated content from the personal content management table for the personal electronic canvas dc3 in the personal content management DB 6001 (S78). Then, the data exchange unit 61 transmits the content ID 10, the data of the content, and the display position information p0 to the personal terminal 2c (S79). Thereby, at the web browser of the personal terminal 2c, the data exchange unit 21c receives the content ID 10, the data of the content, and the display position information p0.
Next, the storing and reading processor 29c of the personal terminal 2c stores the content ID 10, the data of the content, and the display position information p0 received in step S79 in association with each other in the personal content management DB 2001c (S80). Thereby, at the web browser of the personal terminal 2c, the display control unit 24c updates the operation display area 112c to display the content, which is the screen element such as a character (S81).
Thus, the operation of inputting and displaying the content ends.
Details of First Operation or Processes:
Referring to FIG. 12 to FIG. 14, a detailed description is now given of the first operation or processes illustrated in FIG. 8. More specifically, a detailed description is given of processes of step S14 performed by thepersonal terminal 2c and subsequent steps on the assumption that the processes of the step S13 and previous steps has already been performed.
Referring to FIG. 12 to FIG. 14, a detailed description is now given of the first operation or processes illustrated in FIG. 8. More specifically, a detailed description is given of processes of step S14 performed by the
First, when the user C presses the capture button c1 displayed in the operation display area 112c on the personal terminal 2c, the receiving unit 22c receives a screen capturing process by the web browser (the web application of the web browser) of the personal terminal 2c (S111). The screen capture process is an example of a process for causing a content displayed in the first operation display area to be displayed in the second operation display area. An instruction for causing a content displayed in the first operation area to be displayed in the second operation area can be input by voice, which is collected by, for example, a microphone built in or connected to the personal terminal 2c. In response, the receiving unit 22c sends a screen capture request to the communication management unit 30c (S112). This request includes the URL of the shared electronic screen ss. The communication management unit 30c receives the screen capture request.
Next, the communication management unit 30c performs the screen capture process (S113). A detailed description is now given of the screen capturing process with reference to FIG. 13.
First, the determination unit 35c of the communication management unit 30c determines whether the operation display area for the shared electronic screen is displayed (S101). When the determination unit 35c determines that the operation display area for the shared electronic screen is displayed, the capturing unit 33c of the communication management unit 30c performs screen capturing of the operation display area 132c to capture image data of the screen (S102). By contrast, when the determination unit 35c determines in step S101 that the operation display area for the shared electronic screen is not displayed, processes of steps S114 to S116 are performed. Specifically, in FIG. 12, the data exchange unit 31c of the communication management unit 30c transmits, to the content management server 6, request information indicating a request for data of a content of the shared electronic screen ss (S114). The data exchange unit 61 of the content management server 6 receives the request information. Note that in step S101, the determination unit 35c determines that the operation display area for the shared electronic screen is displayed in a case where the personal terminal 2c has already opened a display area for the shared electronic screen as a different tab t2 even when the operation display area for the shared electronic screen is not displayed. In addition, at step S102, in a case where the personal terminal 2c has already opened a display area for the shared electronic screen as the different tab t2 even when the operation display area for the shared electronic screen is not displayed, the capturing unit 33c receives and captures a screen displayed on the shared screen from the content management server 6, based on information specifying the shared screen such as a URL of the shared screen corresponding to the personal electronic canvas on which the capture button is pressed.
Then, the storing and reading processor 69 of the content management server 6 reads out data of a content from the storage location (storage area) for the shared electronic screen ss in the same virtual room as a virtual room in which participate by using the personal electronic canvas corresponding to the operation display area 112c on which the capture button c1 is pressed in step S111 (S115). Then, the data exchange unit 61 of the content management server 6 transmits the data of the content read by the storing and reading processor 69 to the communication management unit 30c of the personal terminal 2c (S116). The data exchange unit 31c of the communication management unit 30c receives the data of the content.
Next, the communication management unit 30c outputs the data of the content of the screen capture image obtained by the screen capturing to the data exchange unit 21c implemented by the web browser displaying the operation display area 112c (S117), whereby the data exchange unit 21c inputs data of the content of an image obtained by the screen capturing.
Then, the data exchange unit 21c transmits a content storage request to the content management server 6 (S118). This content storage request includes the data of the content of the screen capture image. The data exchange unit 61 of the content management server 6 receives the content storage request and the data of the content of the screen capture image. Note that this content storage request is, for example, an HTTP request.
Next, the content management server 6 performs an operation of storing data of a content (S120). A detailed description is now given of the operation of storing data of a content with reference to FIG. 14. FIG. 14 is a flowchart illustrating the operation of storing data of a content.
As illustrated in FIG. 14, the determination unit 65 of the content management server 6 determines which one of the capture buttons c1, c2 and c3 is pressed (S90). Specifically, when the data of the content is received by the web browser that displays the operation display area 112c with which a communication session is established, the determination unit 65 determines that the capture button c1 is pressed. Further, when the data of the content is received by the web browser that displays the operation display area 122c with which a communication session is established, the determination unit 65 determines that the capture button c2 is pressed. Furthermore, when the data of the content is received by the web browser that displays the operation display area 132c with which a communication session is established, the determination unit 65 determines that the capture button c3 is pressed.
In the case of the operation of FIG. 12, the determination unit 65 determines that the capture button c1 is pressed. Then, the storing and reading processor 69 stores the data of the content in the personal content management DB 6001 (S91). Then, the generation unit 64 generates a unique content ID 11 (S92). Further, the generation unit 64 generates a display position information p1 indicating a display position of the content of the screen capture image on the personal electronic canvas dc3 (S93). Although the display position of the screen capture image in the personal electronic canvas dc3 is arbitrary, when there is a screen capture image already displayed, the display position is a position below the screen capture image already displayed, for example.
Next, the storing and reading processor 69 stores the content ID generated in step S92 and the display position information p1 generated in step S93 in association with the content data stored in step S91 (S94). Thus, the process of step S120 ends.
Next, the same or substantially the same processes as those of steps S76 to S81 are performed. Specifically, the data exchange unit 61 transmits an update notification, which is a notification indicating an update of the personal electronic canvas, to the personal terminal 2c (S121). In a case where the user C has multiple personal terminals 2 and accesses the same personal electronic canvas (URL) from the multiple personal terminals 2, the content management server 6 sends the update notification to each of the multiple personal terminals 2 of the user C. Thereby, at the web browser displaying the operation display area 112c of the personal terminal 2c, the data exchange unit 21c receives the update notification.
Next, at the web browser displaying the operation display area 112c of the personal terminal 2c, the data exchange unit 21c transmits a request for updated content data and display position information to the content management server 6 (S122). The data exchange unit 61 of the content management server 6 receives the request for the content data and the display position information.
Next, the storing and reading processor 69 of the content management server 6 reads out the content ID 11, the data of the content, and the display position information p1 corresponding to the updated content from the personal content management table for the personal electronic canvas dc3 in the personal content management DB 6001 (S123). Then, the data exchange unit 61 transmits the content ID 11, the data of the content, and the display position information p1 to the personal terminal 2c (S124). Thereby, at the web browser of the personal terminal 2c, the data exchange unit 21c receives the content ID 11, the data of the content, and the display position information p1.
Next, the storing and reading processor 29c of the personal terminal 2c stores the content ID 11, the data of the content, and the display position information p1 received in step S124 in association with each other in the personal content management DB 2001c (S125). Thereby, at the web browser of the personal terminal 2c, the display control unit 24c updates the operation display area 112c to display a content, which is the screen capture image (the entire screen) (S126).
Thus, the entire image displayed or to be displayed in the operation display area 132c for the shared electronic screen is captured and displayed in the operation display area 112c for the personal electronic canvas, whereby allowing the user C to import a shared image as a personal image.
Details of Second Operation or Processes:
Referring to FIG. 15, a detailed description is now given of the second operation or processes illustrated in FIG. 9. More specifically, a detailed description is given of processes of step S34 performed by thepersonal terminal 2c and subsequent steps on the assumption that the processes of the step S33 and previous steps has already been performed. The second operation or processes is substantially the same as the first operation or processes, except that the operations on the operation display area 112c are replaced with operations on the operation display area 122c.
Referring to FIG. 15, a detailed description is now given of the second operation or processes illustrated in FIG. 9. More specifically, a detailed description is given of processes of step S34 performed by the
First, when the user C presses the capture button c2 displayed in the operation display area 122c on the personal terminal 2c, the receiving unit 22c receives a screen capturing process by the web browser (the web application of the web browser) of the personal terminal 2c (S131). In response, the receiving unit 22c sends a screen capture request to the communication management unit 30c (S132). This request includes the URL of the shared electronic screen ss. The communication management unit 30c receives the screen capture request.
Next, the communication management unit 30c performs the screen capture process (S133). This screen capture process is the same or substantially the same as the process described above with reference to FIG. 13, and therefore the redundant description thereof is omitted below. Note that, the processes of steps S134 to S136 of FIG. 15 are the same or substantially the same as the processes of steps 114 to S116.
Next, the communication management unit 30c outputs the data of the content of the screen capture image to the data exchange unit 21c implemented by the web browser displaying the operation display area 122c (S137), whereby the data exchange unit 21c inputs the data of the content of the screen capture image.
Then, the data exchange unit 21c transmits a content storage request to the content management server 6 (S138). This content storage request includes the data of the content of the screen capture image. The data exchange unit 61 of the content management server 6 receives the content storage request and the data of the content of the screen capture image. Note that this content storage request is, for example, an HTTP request.
Next, the content management server 6 performs an operation of storing data of a content (S140). A detailed description is now given of the operation of storing data of a content with reference to FIG. 14.
In the case of the operation of FIG. 15, in step S90, the determination unit 65 determines that the capture button c2 is pressed from among the capture buttons c1, c2 and c3. Then, the storing and reading processor 69 stores the data of the content in the shared content management DB 6002 (S95). Then, the generation unit 64 generates a unique content ID 12 (S96). Further, the generation unit 64 generates a display position information p2 indicating a display position of the content of the screen capture image on the shared electronic canvas cc (S97). Although the display position of the screen capture image in the shared electronic canvas cc is arbitrary, when there is a screen capture image already displayed, the display position is a position below the screen capture image already displayed, for example.
Next, in step S98, the storing and reading processor 69 stores the content ID generated in step S96 and the display position information p2 generated in step S97 in association with the content data stored in step S95. Thus, the process of step S140 ends.
Next, the same or substantially the same processes as those of steps S76 to S81 (steps S121 to S126) are performed. Specifically, the data exchange unit 61 transmits an update notification, which is a notification indicating an update of the shared electronic canvas, to the personal terminal 2c (S141). Note that when multiple personal terminals 2 access the same shared electronic canvas (URL), the content management server 6 transmits the update notification to each of the multiple personal terminals 2. Thereby, at the web browser displaying the operation display area 122c of the personal terminal 2c, the data exchange unit 21c receives the update notification.
Next, at the web browser displaying the operation display area 122c of the personal terminal 2c, the data exchange unit 21c transmits a request for updated content data and display position information to the content management server 6 (S142). The data exchange unit 61 of the content management server 6 receives the request for the content data and the display position information.
Next, the storing and reading processor 69 of the content management server 6 reads out the content ID 12, the data of the content, and the display position information p2 corresponding to the updated content from the shared content management table for the shared electronic canvas cc in the shared content management DB 6002 (S143). Then, the data exchange unit 61 transmits the content ID 12, the data of the content, and the display position information p2 to the personal terminal 2c (S144). Thereby, at the web browser of the personal terminal 2c, the data exchange unit 21c receives the content ID 12, the data of the content, and the display position information p2.
Next, the storing and reading processor 29c of the personal terminal 2c stores the content ID 12, the data of the content, and the display position information p2 received in step S144 in association with each other in the shared content management DB 2002c (S145). Thereby, at the web browser of the personal terminal 2c, the display control unit 24c updates the operation display area 122c to display a content, which is the screen capture image (the entire screen) (S146).
Thus, the entire image displayed or to be displayed in the operation display area 132c for the shared electronic screen is captured and displayed in the operation display area 122c for the shared electronic canvas, whereby allowing the user C to import an image shared by the shared electronic screen as an image shared by the electronic canvas.
Details of Third Operation or Processes:
Referring to FIG. 16, a detailed description is now given of the third operation or processes illustrated in FIG. 10. More specifically, a detailed description is given of processes of step S53 performed by thepersonal terminal 2c and subsequent steps.
Referring to FIG. 16, a detailed description is now given of the third operation or processes illustrated in FIG. 10. More specifically, a detailed description is given of processes of step S53 performed by the
First, the data exchange unit 61 of the content management server 6 transmits data of the content of the entire screen of the shared electronic screen ss to the personal terminal 2c (S151). Thereby, at the web browser displaying the operation display area 132c, the data exchange unit 21c receives the data of the content of the entire screen. Then, at the web browser displaying the operation display area 132c, the display control unit 24c causes the content of the entire screen to be displayed on the operation display area 132c (S152).
In this state, when the user C presses the capture button c3 illustrated in FIG. 7, at the web browser displaying the operation display area 132c, the receiving unit 22c receives a screen capturing (S153). Since the process of step S154 is the same as the process described with reference to FIG. 13, the redundant description thereof is omitted below. However, the determination unit 25c performs the process of step S101. In addition, the image processor 23c having a function as a capturing unit to capture image data of a screen by performing screen capturing of the operation display area 132c performs the process of step S102. Since the operation display area for the shared electronic screen is displayed in step S152, the determination unit 25c determines in step S101 that the display operation area for the shared electronic screen is displayed (YES). Then, in step S102, at the web browser displaying the operation display area 132c, the image processor 23c performs screen capturing of the operation display area 132c of itself.
Next, at the web browser displaying the operation display area 132c, the data exchange unit 21c transmits a content storage request to the content management server 6 (S155). This content storage request includes the data of the content of the screen capture image. The data exchange unit 61 of the content management server 6 receives the content storage request and the data of the content of the screen capture image. Note that this content storage request is, for example, an HTTP request.
Next, the content management server 6 performs an operation of storing data of a content (S160). A detailed description is now given of the operation of storing data of a content with reference to FIG. 14.
In the case of the operation of FIG. 16, in step S90, the determination unit 65 determines that the capture button c3 is pressed from among the capture buttons c1, c2 and c3. Since the processes after the step S90 are the same or substantially the same as the processes of steps S95 to S98, the redundant description thereof is omitted below. Note that in this operation, the content ID 12 and the display position information p2 are replaced with the content ID 13 and the display position information p3, respectively.
Next, the same or substantially the same processes as those of steps S76 to S81 (steps S121 to S126, S141 to S146) are performed. Specifically, the data exchange unit 61 transmits an update notification, which is a notification indicating an update of the shared electronic canvas, to the web browser displaying the operation display area 122c of the personal terminal 2c (S161). In this case, the content management server 6 transmits the update notification to all the personal terminals 2 and the shared terminal 4 participating in the remote conference. Thereby, at the web browser displaying the operation display area 122c of the personal terminal 2c, the data exchange unit 21c receives the update notification. Note that in the third operation or processes, unlike the process of step S111 in the first operation of processes, the receiving of screen capturing is not performed in the operation display area 112c to which an image of the shared screen is to be imported. Therefore, the content management server 6 cannot identify the personal electronic canvas dc3 for the operation display area 112c to which an image obtained by the screen capturing is to be imported from among the plurality of personal electronic canvases. However, the content management server 6 can identify the shared electronic canvas cc since one shared electronic canvas cc is present in one virtual room. Therefore, the data exchange unit 61 of the content management server 6 transmits an update notification, which is a notification indicating an update of the shared electronic canvas, to the web browser displaying the operation display area 122c of the personal terminal 2c.
Next, at the web browser displaying the operation display area 122c of the personal terminal 2c, the data exchange unit 21c transmits a request for updated content data and display position information to the content management server 6 (S162). The data exchange unit 61 of the content management server 6 receives the request for the content data and the display position information.
Next, the storing and reading processor 69 of the content management server 6 reads out the content ID 13, the data of the content, and the display position information p3 corresponding to the updated content from the shared content management table for the shared electronic canvas cc in the shared content management DB 6002 (S163). Then, the data exchange unit 61 transmits the content ID 13, the data of the content, and the display position information p3 to the personal terminal 2c (S164). Thereby, at the web browser of the personal terminal 2c, the data exchange unit 21c receives the content ID 13, the data of the content, and the display position information p3.
Next, the storing and reading processor 29c of the personal terminal 2c stores the content ID 13, the data of the content, and the display position information p3 received in step S164 in association with each other in the shared content management DB 2002c (S165). Thereby, at the web browser of the personal terminal 2c, the display control unit 24c updates the operation display area 122c to display a content, which is the screen capture image (the entire screen) (S166).
Thus, the entire image displayed in the operation display area 132c for the shared electronic screen is captured and displayed in the operation display area 122c for the shared electronic canvas, whereby allowing the user C to import an image shared by the shared electronic screen as an image shared by the electronic canvas.
If the user C using the personal terminal 2c spends a long time to capture an image of a screen (content) from one operation display area 132c into the other operation display area 112c or 122c, the user C will miss a conversation in a meeting or the like. If a user misses a conversation in a remote meeting or the like performed via a communication network, the user finds it more difficult to tell the remote partner that the user wants him or her to repeat previous remarks or comments, compared with when the user joins the meeting or the like in the real meeting room, for example. On the other hand, according to the present embodiment, the user C can capture an image of the screen only by pressing the capture button c1, c2, or c3, whereby the drawback of missing a conversation in a meeting or the like such as a meeting can be overcome.
In addition, since the shared electronic canvas and the personal electronic canvas are associated in advance with the shared electronic screen, the user C is saved from specifying the URL or the like of the shared electronic screen, whereby an image of a screen can be captured and imported quickly.
Thus, more convenient sharing of content between multiple communication terminals is provided, and more efficient communication and collaboration between multiple users using different private terminals respectively is provided. Furthermore, this is provided in a way which minimizes technical complexity and the usage of computer resources.
Second Embodiment:
A description is now given of a second embodiment of the present disclosure, with reference to FIG. 17 to FIG. 19. In the present embodiment, a detailed description is given of an operation or processes in a state where theoperation display area 132c is already displayed on the personal terminal 2c and a content is displayed in the operation display area 132c. The present embodiment is different from the first embodiment in that the communication management units 30a, 30b and 30c and the communication management unit 50 are not provided, and the screen capturing process is performed not on the personal terminal 2c side but on the content management server 6 side. Except for the above differences, the hardware configuration and the functional configuration of the present embodiment are substantially the same as those of the first embodiment, and therefore redundant description thereof are omitted below.
A description is now given of a second embodiment of the present disclosure, with reference to FIG. 17 to FIG. 19. In the present embodiment, a detailed description is given of an operation or processes in a state where the
Details of First Operation or Processes:
First, referring to FIG. 17, a detailed description is given of the first operation or processes illustrated in FIG. 8, according to the present embodiment. More specifically, a detailed description is given of processes of step S13 performed by thepersonal terminal 2c and subsequent steps.
First, referring to FIG. 17, a detailed description is given of the first operation or processes illustrated in FIG. 8, according to the present embodiment. More specifically, a detailed description is given of processes of step S13 performed by the
First, the data exchange unit 61 of the content management server 6 transmits data of the content of the entire screen of the shared electronic screen ss to the personal terminal 2c (S211). Thereby, at the web browser displaying the operation display area 132c, the data exchange unit 21c receives the data of the content of the entire screen. Then, at the web browser displaying the operation display area 132c, the display control unit 24c causes the content of the entire screen to be displayed on the operation display area 132c (S212).
In this state, when the user C presses the capture button c1 illustrated in FIG. 5, at the web browser displaying the operation display area 112c, the receiving unit 22c receives a screen capturing (S213). Note that the process of step S213 can be performed even when the processes of steps S211 and S212 are not performed.
Next, at the web browser displaying the operation display area 112c, the data exchange unit 21c transmits a screen capture request (information) to the content management server 6 (S214). The data exchange unit 61 of the content management server 6 receives the screen capture request.
Next, the image processor 63 of the content management server 6 performs a screen capturing process of an entire screen of the shared electronic screen ss (S215).
The processes of S220 to S226 are performed in substantially the similar manner to step S120 to S126 of the first embodiment, and therefore the redundant description thereof is omitted below.
Thus, the entire image displayed in the operation display area 132c for the shared electronic screen is captured on the content management server 6 side and displayed in the operation display area 112c for the personal electronic canvas, whereby allowing the user C to capture an image shared by the shared electronic screen as an image shared by the electronic canvas.
Details of Second Operation or Processes:
Referring to FIG. 18, a detailed description is now given of the second operation or processes illustrated in FIG. 9 according to the present embodiment. More specifically, a detailed description is given of processes of step S33 performed by thepersonal terminal 2c and subsequent steps.
Referring to FIG. 18, a detailed description is now given of the second operation or processes illustrated in FIG. 9 according to the present embodiment. More specifically, a detailed description is given of processes of step S33 performed by the
First, the data exchange unit 61 of the content management server 6 transmits data of the content of the entire screen of the shared electronic screen ss to the personal terminal 2c (S231). Thereby, at the web browser displaying the operation display area 132c, the data exchange unit 21c receives the data of the content of the entire screen. Then, at the web browser displaying the operation display area 132c, the display control unit 24c causes the content of the entire screen to be displayed on the operation display area 132c (S232).
In this state, when the user C presses the capture button c2 illustrated in FIG. 6, at the web browser displaying the operation display area 122c, the receiving unit 22c receives a screen capturing (S233).
Next, at the web browser displaying the operation display area 122c, the data exchange unit 21c transmits a screen capture request (information) to the content management server 6 (S234). The data exchange unit 61 of the content management server 6 receives the screen capture request.
Next, the image processor 63 of the content management server 6 performs a screen capturing process of an entire screen of the shared electronic screen ss (S235).
The processes of S240 to S246 are performed in substantially the similar manner to step S140 to S146 of the first embodiment, and therefore the redundant description thereof is omitted below.
Thus, the entire image displayed in the operation display area 132c for the shared electronic screen is captured on the content management server 6 side and displayed in the operation display area 122c for the shared electronic canvas, whereby allowing the user C to import an image shared by the shared electronic screen as an image shared by the electronic canvas.
Details of Third Operation or Processes:
Referring to FIG. 19, a detailed description is now given of the third operation or processes illustrated in FIG. 10, according to the present embodiment. More specifically, a detailed description is given of processes of step S53 performed by thepersonal terminal 2c and subsequent steps.
Referring to FIG. 19, a detailed description is now given of the third operation or processes illustrated in FIG. 10, according to the present embodiment. More specifically, a detailed description is given of processes of step S53 performed by the
First, the data exchange unit 61 of the content management server 6 transmits data of the content of the entire screen of the shared electronic screen ss to the personal terminal 2c (S251). Thereby, at the web browser displaying the operation display area 132c, the data exchange unit 21c receives the data of the content of the entire screen. Then, at the web browser displaying the operation display area 132c, the display control unit 24c causes the content of the entire screen to be displayed on the operation display area 132c (S252).
In this state, when the user C presses the capture button c3 illustrated in FIG. 7, at the web browser displaying the operation display area 132c, the receiving unit 22c receives a screen capturing (S253).
Next, at the web browser displaying the operation display area 132c, the data exchange unit 21c transmits a screen capture request (information) to the content management server 6 (S254). The data exchange unit 61 of the content management server 6 receives the screen capture request.
Next, the image processor 63 of the content management server 6 performs a screen capturing process of an entire screen of the shared electronic screen ss (S255).
The processes of S260 to S266 are performed in substantially the similar manner to step S160 to S166 of the first embodiment, and therefore the redundant description thereof is omitted below.
Thus, the entire image displayed in the operation display area 132c for the shared electronic screen is captured on the content management server 6 side and displayed in the operation display area 122c for the shared electronic canvas, whereby allowing the user C to import an image shared by the shared electronic screen as an image shared by the electronic canvas.
The information sharing system according to the present embodiment achieves the advantageous effects described above referring to the first embodiment. Furthermore, in the present embodiment, instead of transmitting content data of the screen capture image from the personal terminal 2c to the content management server 6 (S118, S138, S155) as in the first embodiment, the screen capture request is sent (S214, S234, S254). Thereby, even when the data amount of the screen capture image is large, screen capturing can be performed more speedily.
Variations:
The above-described embodiments are illustrative and do not limit the present disclosure. Thus, numerous additional modifications and variations are possible in light of the above teachings. For example, elements and/or features of different illustrative embodiments may be combined with each other and/or substituted for each other within the scope of the present disclosure.
The above-described embodiments are illustrative and do not limit the present disclosure. Thus, numerous additional modifications and variations are possible in light of the above teachings. For example, elements and/or features of different illustrative embodiments may be combined with each other and/or substituted for each other within the scope of the present disclosure.
For example, a description is given of a variation 1 of a screen display on the personal terminal 2 with reference to FIG. 20. FIG. 20 illustrates the variation 1 of the screen display on the personal terminal 2. Note that this variation 1 is a variation of the screen display on the personal terminal 2c illustrated in FIG. 8. As illustrated in FIG. 20, the operation display areas 112c and 132c are displayed on the display of the personal terminal 2c in substantially the similar manner to FIG. 8. Further, in the variation 1, as illustrated in FIG. 20, a read button r1 and a read button r2 are displayed by the display control unit 24c at the lower right portion of the display. The read button r1 implements the same or substantially the same function as the capture button c1 in FIG. 5. Specifically, the read button r1 is a button, when pressed (selected), to cause an image of a screen of the operation display area 132c for the shared electronic screen ss to be captured into the operation display area 112c for the personal electronic canvas dc 3. The read button r2 implements the same or substantially the same function as the capture button c2 in FIG. 6. Specifically, the read button r2 is a button, when pressed (selected), to cause an image of a screen of the operation display area 132c for the shared electronic screen ss to be captured into the operation display area 122c for the shared electronic canvas cc. In this variation 1, the read buttons r1 and r2 are displayed outside the operation display area 112c and the operation display area 132c.
A description is now given of a variation 2 of a screen display of the personal terminal 2, with reference to FIG. 21. FIG. 21 illustrates the variation 2 of the screen display on the personal terminal 2. Note that this variation 2 is a variation of the screen display on the personal terminal 2c illustrated in FIG. 8. As illustrated in FIG. 21, one operation display area 112c1 is displayed on the entire display of the personal terminal 2c. Further, the operation display area 112c1 is divided into two operation display areas 112c2 and 112c3. In the operation display area 112c2 on the left side, a content of the shared electronic screen ss is displayed. In the operation display area 112c3 on the right side, contents, each being obtained by capturing a content of the shared electronic screen, are displayed. The captured contents are displayed from the top to the bottom in the operation display area 112c3. In FIG. 21, a content c11 obtained by capturing a content of the shared screen ss first is displayed, and a content c12 obtained by capturing another content of the shared screen ss next is displayed. The relative positions of the operation display area 112c2 and the operation display area 112c3 illustrated in FIG. 21 is just one example. In another example, the operation display area 112c3 is displayed on the left side and the operation display area 112c2 is displayed on the right side. In still another example, the operation display area 112c2 is displayed on the upper side and the operation display area 112c3 is displayed on the lower side. In still another example, the operation display area 112c2 is displayed on the lower side and the operation display area 112c3 is displayed on the upper side.
Although in the above-described embodiments and variations, the capture buttons c1, c2 and c3 are each represented by an icon having a shape of a camera, this is just one example of “instruction information”. In addition to an image such as an icon, the instruction information can be characters such as “CAPTURE”, an arrow, or a combination of an icon and characters, for example.
In addition, although the description of the embodiments given heretofore is of a case where the Canvas element of HTML is used, alternatively, WebGL, SVG (scalable vector graphics), FLASH (registered trademark), etc. can be used.
Also, although in the above embodiments, two operation display areas are displayed by one web browser, alternatively two web browsers (a first web browser and a second web browser) respectively display two operation display areas (a first operation display area and a second operation display area). In another example, instead of two operation display areas, three or more web browsers can display operation display areas respectively (in this case, three or more operation display areas). In still another example, one web browser can display three or more operation display areas.
Although the description given heretofore of the embodiment is of a case where each of the personal electronic canvas and the shared electronic canvas is an infinite electronic canvas, the present disclosure is not limited to this. Alternatively, each of the personal electronic canvas and the shared electronic canvas can be a finite electronic canvas.
In addition, the personal electronic canvas can be a limited finite electronic canvas displayed within the displayable range of the display 208 of the personal terminal 2. Similarly, the shared electronic canvas can be a limited finite electronic canvas displayed within the displayable range of the display 408 of the shared terminal 4.
Although in the above embodiments, no description is given of a case where one or more other terminals or one or more other servers relay data (or information) on a communication path between the personal terminal 2 and the shared terminal 4 and the content management server 6, one or more other terminals or one or more other servers can relay data (or information).
Further, in the example of FIG. 1, the shared terminal 4 and the shared electronic canvas cc can be omitted.
In addition, although the description given heretofore of the embodiments is of a case where multiple users conduct a teleconference, the present disclosure is not limited to such a remote conference but can be applied to various events in which multiple persons at different remote sites or even at the same site communicate via a network in a virtual room. Example of the various events include a business meeting between a vendor and a client at different remote sites or at the same site, and exhibitions held at multiple venues at different remote sites.
Each of the functions (see FIG. 3A and FIG. 3B) of the above-described embodiments can be implemented by one or more processing circuits or circuitry. Processing circuitry includes a programmed processor, as a processor includes circuitry. A processing circuit also includes devices such as an application specific integrated circuit (ASIC), digital signal processor (DSP), field programmable gate array (FPGA), and conventional circuit components arranged to perform the recited functions.
The content storage request (see S118, S138, and S155) and the screen capture request (S214, S234, and S254) are each an example of a request relating to a content.
Each communication terminal can transmit data of a content without transmitting the content storage request (see S118, S138, and S155). In this case, settings are configured in advance that cause thecontent management server 6 to store the data of the content of the screen capture image in response to receiving the data.
Each communication terminal can transmit data of a content without transmitting the content storage request (see S118, S138, and S155). In this case, settings are configured in advance that cause the
Furthermore, in the present embodiment, the operation display area 132c is an example of a first operation display area, and the operation display area 112c is an example of a second operation display area.
For example, a background color of the screen capture image can be is changed. Further, an icon (or characters) indicating that capturing has been performed can be added to the screen capture image. Furthermore, a tool bar or the like can be deleted from the screen capture image. In addition, a part of the screen capture image can be masked or the color of a part of the screen capture image can be changed.
The above-described embodiments are illustrative and do not limit the present disclosure. Thus, numerous additional modifications and variations are possible in light of the above teachings. For example, elements and/or features of different illustrative embodiments may be combined with each other and/or substituted for each other within the scope of the present disclosure.
Any one of the above-described operations may be performed in various other ways, for example, in an order different from the one described above.
The present disclosure can be implemented in any convenient form, for example using dedicated hardware, or a mixture of dedicated hardware and software. The present disclosure may be implemented as computer software implemented by one or more networked processing apparatuses. The processing apparatuses can include any suitably programmed apparatuses such as a general purpose computer, personal digital assistant, mobile telephone (such as a WAP or 3G-compliant phone) and so on. Since the present disclosure can be implemented as software, each and every aspect of the present disclosure thus encompasses computer software implementable on a programmable device. The computer software can be provided to the programmable device using any conventional carrier medium (carrier means). The carrier medium can include a transient carrier medium such as an electrical, optical, microwave, acoustic or radio frequency signal carrying the computer code. An example of such a transient medium is a TCP/IP signal carrying computer code over an IP network, such as the Internet. The carrier medium can also include a storage medium for storing processor readable code such as a floppy disk, hard disk, CD ROM, magnetic tape device or solid state memory device.
Any one of the above-described operations may be performed in various other ways, for example, in an order different from the one described above.
The present disclosure can be implemented in any convenient form, for example using dedicated hardware, or a mixture of dedicated hardware and software. The present disclosure may be implemented as computer software implemented by one or more networked processing apparatuses. The processing apparatuses can include any suitably programmed apparatuses such as a general purpose computer, personal digital assistant, mobile telephone (such as a WAP or 3G-compliant phone) and so on. Since the present disclosure can be implemented as software, each and every aspect of the present disclosure thus encompasses computer software implementable on a programmable device. The computer software can be provided to the programmable device using any conventional carrier medium (carrier means). The carrier medium can include a transient carrier medium such as an electrical, optical, microwave, acoustic or radio frequency signal carrying the computer code. An example of such a transient medium is a TCP/IP signal carrying computer code over an IP network, such as the Internet. The carrier medium can also include a storage medium for storing processor readable code such as a floppy disk, hard disk, CD ROM, magnetic tape device or solid state memory device.
This patent application is based on and claims priority pursuant to 35 U.S.C. §119(a) to Japanese Patent Application Nos. 2018-185542, filed on September 28, 2018 and 2019-166828, filed on September 13, 2019 in the Japan Patent Office, the entire disclosures of which are incorporated herein by reference.
2a, 2b, 2c Personal terminal (an example of a communication terminal)
4 Shared terminal (an example of a communication terminal)
6 Content management server
21a, 21b, 21c Data exchange unit (an example of transmitting means, an example of receiving means)
22a, 22b, 22c Receiving unit (an example of accepting means)
23a, 23b, 23c Image processor (an example of capturing means)
24a, 24b, 24b Display control unit (an example of display control means)
25a, 25b, 25c Determination unit
29a, 29b, 29c Storing and reading processor
30a, 30b, 30c Communication management unit
31a, 31b, 31c Data exchange unit
33a, 33b, 33c Capturing unit (an example of capturing means)
35a, 35b, 35c Determination unit (an example of determining means)
41 Data exchange unit (an example of transmitting means, an example of receiving means) 42 Receiving unit
43 Image processor (an example of capturing means)
44 Display control unit
45 Determination unit
49 Storing and reading processor
50 Communication management unit
51 Data exchange unit
53 Capturing unit (an example of capturing means)
55 Determination unit (an example of determining means)
61 Data exchange unit
63 Image processor
64 Generation unit
65 Determination unit
69 Storing and reading processor
2000 Storage unit
2001 Personal content management DB
2002 Shared content management DB
4000 Storage unit
4002 Shared content management DB
6000 Storage unit
6001 Personal content management DB
6002 Shared content management DB
4 Shared terminal (an example of a communication terminal)
6 Content management server
21a, 21b, 21c Data exchange unit (an example of transmitting means, an example of receiving means)
22a, 22b, 22c Receiving unit (an example of accepting means)
23a, 23b, 23c Image processor (an example of capturing means)
24a, 24b, 24b Display control unit (an example of display control means)
25a, 25b, 25c Determination unit
29a, 29b, 29c Storing and reading processor
30a, 30b, 30c Communication management unit
31a, 31b, 31c Data exchange unit
33a, 33b, 33c Capturing unit (an example of capturing means)
35a, 35b, 35c Determination unit (an example of determining means)
41 Data exchange unit (an example of transmitting means, an example of receiving means) 42 Receiving unit
43 Image processor (an example of capturing means)
44 Display control unit
45 Determination unit
49 Storing and reading processor
50 Communication management unit
51 Data exchange unit
53 Capturing unit (an example of capturing means)
55 Determination unit (an example of determining means)
61 Data exchange unit
63 Image processor
64 Generation unit
65 Determination unit
69 Storing and reading processor
2000 Storage unit
2001 Personal content management DB
2002 Shared content management DB
4000 Storage unit
4002 Shared content management DB
6000 Storage unit
6001 Personal content management DB
6002 Shared content management DB
Claims (17)
- A communication terminal communicable with a content management server, the communication terminal comprising:
display control means for displaying a first operation display area and a second operation display area using at least one web browser;
accepting means for accepting a process for causing a content displayed in the first operation display area to be displayed in the second operation display area;
transmitting means for transmitting a request relating to the content to the content management server in response to acceptance of the process by the accepting means; and
receiving means for receiving data of the content, the data of the content being transmitted by the content management server in response to the request relating to the content by the transmitting means,
wherein the display control means displays, in the second operation display area, the content represented by the data of the content that is received by the receiving means.
- The communication terminal of claim 1,
wherein the communication terminal further comprises capturing means for capturing data of the content displayed in the first operation display area in response to acceptance of the process by the accepting means,
the transmitting means transmits the data of the content captured by the capturing means to the content management server, and
the receiving means receives data of the content transmitted by the content management server in response to transmission the data of the content by the transmitting means.
- The communication terminal of claim 2,
wherein the request relating to the content is a storage request of the data of the content.
- The communication terminal of claim 3,
wherein the display control means displays instruction information used for accepting capturing of the data of the content displayed in the first operation display area, and
the accepting means accepts the process by an operation to the instruction information.
- The communication terminal of claim 4, wherein the display control means displays the instruction information on the second operation display area.
- The communication terminal of any one of claims 1 to 5,
wherein the first operation display area is an operation display area for displaying a content of a shared screen, which is an electronic screen shared and viewed by a plurality of users, and the second operation display area is an operation display area for displaying a personal content, which is a content edited and viewed individually by a user operating the communication terminal.
- The communication terminal of any one of claims 1 to 5,
wherein the first operation display area is an operation display area for displaying a content of a shared screen, which is an electronic screen shared and viewed by a plurality of users, and a second operation display area is an operation display area for displaying a shared content, which is a content edited and viewed by any of the plurality of users.
- The communication terminal of claim 4,
wherein the display control means displays the instruction information on the first operation display area for displaying a content of a shared screen, which is an electronic screen shared and viewed by a plurality of users.
- The communication terminal of claim 1,
wherein in response to acceptance of the process by the accepting means, the transmitting means transmits, as the request relating to the content, request information indicating a request for capturing data of a content that has been transmitted to be displayed in the first operation display area, to the content management server, and
in response transmission of the request information by the transmitting means, the receiving means receives the data of the content captured and transmitted by the content management server.
- The communication terminal of claim 2 or 3,
wherein the capturing means captures the data of a content to be displayed in the first display operation area associated in advance with the second operation display area.
- An information sharing system comprising:
the communication terminal according to any one of claims 1 to 10; and
the content management server.
- The information sharing system of claim 11, further comprising another communication terminal configured to transmit data of the content to be displayed in the first operation display area to the content management server.
- A display control method performed by a communication terminal communicable with a content management server, the method comprising:
displaying a first operation display area and a second operation display area by a web browser;
accepting a process of causing a content displayed in the first operation display area to be displayed in the second operation display area;
in response to acceptance of the process, capturing data of the content displayed in the first operation display area;
transmitting the data of the content captured by the capturing to the content management server;
in response to transmission of the data of the content by the transmitting, receiving data of the content transmitted by the content management server; and
displaying the content represented by the data received by the receiving in the second operation display area.
- A display control method performed by a communication terminal communicable with a content management server, the method comprising:
displaying a first operation display area and a second operation display area by a web browser;
accepting a process of causing a content displayed in the first operation display area to be displayed in the second operation display area;
in response to acceptance of the process, transmitting, to the content management server, request information indicating a request for capturing data of a content that has been transmitted to be displayed in the first operation display area;
in response to transmission of the request information by the transmitting, receiving the data of the content captured and transmitted by the content management server; and
displaying the content represented by the data received by the receiving in the second operation display area.
- A computer program product comprising program instructions operative, when performed by the processor of a computer, to cause the computer to perform the method of claims 13 or 14.
- A storage medium storing a program for causing a computer to perform the method of claim 13 or 14.
- A content management server operative to communicate with at least one respective web browser running on a plurality of communication terminals of any of claims 1 to 9, the content management server being configured:
to receive a request from a web browser of any one of the plurality of communication terminals relating to content displayed in a first operation display area of the one communication terminal; and
in response to the request, to transmit data of the content to the one communication terminal, whereby the one communication terminal displays content based on the data of the content in a second operation display area.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2018185542 | 2018-09-28 | ||
JP2018-185542 | 2018-09-28 | ||
JP2019-166828 | 2019-09-13 | ||
JP2019166828A JP2020058024A (en) | 2018-09-28 | 2019-09-13 | Content management server, information sharing system, communication method, and program |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020066932A1 true WO2020066932A1 (en) | 2020-04-02 |
Family
ID=69950588
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2019/037073 WO2020066932A1 (en) | 2018-09-28 | 2019-09-20 | Communication terminal, content management server, information sharing system, display control method, and storage medium storing program |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2020066932A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023103672A1 (en) * | 2021-12-08 | 2023-06-15 | 华为技术有限公司 | Method, apparatus and device for displaying shared content, and computer program product |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000215244A (en) * | 1999-01-26 | 2000-08-04 | Fuji Xerox Co Ltd | Work process management device |
US20060288083A1 (en) * | 2005-06-17 | 2006-12-21 | Ntt Docomo, Inc. | Communication apparatus and browser switching method |
CN102143156A (en) * | 2010-12-31 | 2011-08-03 | 华为技术有限公司 | Desktop sharing method and device |
US20140032489A1 (en) * | 2009-01-22 | 2014-01-30 | Adobe Systems Incorporated | Method and apparatus for viewing collaborative documents |
US8707185B2 (en) * | 2000-10-10 | 2014-04-22 | Addnclick, Inc. | Dynamic information management system and method for content delivery and sharing in content-, metadata- and viewer-based, live social networking among users concurrently engaged in the same and/or similar content |
CN108008927A (en) * | 2017-11-30 | 2018-05-08 | 努比亚技术有限公司 | Multi-screen meeting implementation method, mobile terminal and computer-readable recording medium |
-
2019
- 2019-09-20 WO PCT/JP2019/037073 patent/WO2020066932A1/en active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000215244A (en) * | 1999-01-26 | 2000-08-04 | Fuji Xerox Co Ltd | Work process management device |
US8707185B2 (en) * | 2000-10-10 | 2014-04-22 | Addnclick, Inc. | Dynamic information management system and method for content delivery and sharing in content-, metadata- and viewer-based, live social networking among users concurrently engaged in the same and/or similar content |
US20060288083A1 (en) * | 2005-06-17 | 2006-12-21 | Ntt Docomo, Inc. | Communication apparatus and browser switching method |
US20140032489A1 (en) * | 2009-01-22 | 2014-01-30 | Adobe Systems Incorporated | Method and apparatus for viewing collaborative documents |
CN102143156A (en) * | 2010-12-31 | 2011-08-03 | 华为技术有限公司 | Desktop sharing method and device |
CN108008927A (en) * | 2017-11-30 | 2018-05-08 | 努比亚技术有限公司 | Multi-screen meeting implementation method, mobile terminal and computer-readable recording medium |
Non-Patent Citations (2)
Title |
---|
HOW TO DUPLICATE A TAB WITH A SHORTCUT KEY CHROME OR FIREFOX, 3 November 2016 (2016-11-03), XP055701202, Retrieved from the Internet <URL:https://www.howtogeek.com/howto/5239/stupid-geek-tricks-duplicate-a-tab-with-a-shortcut-key-in-chrome-or-firefox> * |
HOW TO OCR SCREENSHOT ON WINDOWS - EASY SCREEN OCR, 16 March 2018 (2018-03-16), XP055649958, Retrieved from the Internet <URL:https://easyscreenocr.com/how-to-ocr-screenshot-on-windows> * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023103672A1 (en) * | 2021-12-08 | 2023-06-15 | 华为技术有限公司 | Method, apparatus and device for displaying shared content, and computer program product |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11979244B2 (en) | Configuring 360-degree video within a virtual conferencing system | |
US10402483B2 (en) | Screenshot processing device and method for same | |
CN103124283B (en) | Electronic device and method capable of collaboratively editing with a plurality of mobile devices | |
US11394757B2 (en) | Communication terminal, communication system, and method of sharing data | |
US11310064B2 (en) | Information processing apparatus, information processing system, and information processing method | |
US20200177645A1 (en) | Content management server, information sharing system, and communication control method | |
JP6511868B2 (en) | INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING METHOD, INFORMATION PROCESSING APPARATUS, AND PROGRAM | |
EP3817326A1 (en) | Communication terminal, communication system, method for sharing data, and carrier means | |
US20240411446A1 (en) | Screen control method, screen control apparatus, electronic device, program, and medium | |
EP3675483A1 (en) | Content server, information sharing system, communication control method, and carrier means | |
US12002231B2 (en) | Communication system, method for communicating to share images, and non-transitory recording medium | |
WO2020066932A1 (en) | Communication terminal, content management server, information sharing system, display control method, and storage medium storing program | |
US20200104024A1 (en) | Communication terminal, information sharing system, display control method, and non-transitory computer-readable medium | |
EP3770748A1 (en) | Communication terminal, communication system, display control method, and carrier medium | |
JP2021039616A (en) | Information processing system, information processing apparatus, image display method, and program | |
JP6458345B2 (en) | Electronic information linkage system | |
JP2020198078A (en) | Information processing apparatus, information processing system, and information processing method | |
US12199784B2 (en) | Configuring broadcast media quality within a virtual conferencing system | |
US10904026B2 (en) | Information processing apparatus, information processing system, and information processing method | |
US20210037070A1 (en) | Information processing system, information processing apparatus, information processing method, and non-transitory computer-readable medium | |
JP2020058024A (en) | Content management server, information sharing system, communication method, and program | |
JP2020109954A (en) | Content management server, information sharing system, communication method, and program | |
JP2022052986A (en) | Service provision system, information processing system, display control method and program | |
JP2021060949A (en) | Communication system, information processing apparatus, communication method, and program | |
JP2021036400A (en) | Information processing system, information processing apparatus, information processing method, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19867913 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19867913 Country of ref document: EP Kind code of ref document: A1 |