Embodiment
First embodiment
Below with reference to Fig. 1 to Figure 15, first embodiment according to the method for IP phone terminal of the present invention, IP phone program, IP phone coroutine, IP telephony system, control IP telephony system is described.
Fig. 1 is the block diagram that illustrates according to the structure of the IP telephony system 1 of the first embodiment of the present invention.
IP telephony system 1 in Fig. 1 comprises: personal computer PC 1, the equipment 2 that is connected to personal computer PC 1, personal computer PC 2, the equipment 11 that is connected to personal computer PC 2, personal computer PC 3, a plurality of personal computer (not shown) that are connected to the equipment 15 of personal computer PC 3 and are connected to network.
Fig. 1 illustrates example, wherein is connected to equipment 2 scan images of personal computer PC 1, and the equipment 11 that is connected to personal computer PC 2 is printed the image that is scanned.
IP telephony application 4 and intermediate application program 3 are installed on the personal computer PC 1.IP telephony application 7 and intermediate application program 10 are installed on the personal computer PC 2.IP telephony application 12 and intermediate application program 14 are installed on the personal computer PC 3.Here, being installed in IP telephony application on each personal computer is the communication software that can implement call via network between personal computer such as Skype.
On personal computer PC 2, intermediate application program 10 is registered in the log-on data on the equipment 11 in the log-on data storage area 8 of IP telephony application 7.The log-on data of record comprises the function recognition data that is used for the function that equipment 11 possessed in log-on data storage area 8.More specifically, if equipment 11 possesses printing function, scan function and saves the data in hold function on the dielectric card, the data that indication equipment 11 can be implemented these functions are recorded among the region of data storage 8.
Next, the processing that explanation is carried out when data that execution will comprise the function recognition data are recorded in the log-on data storage area 8 of equipment 2.Carrying out carrying out this processing before a series of IP phone processing via network.
Fig. 2 is the block diagram that the structure of personal computer PC 2 is shown.As shown in Figure 2, personal computer PC 2 comprises IP telephony application 7, intermediate application program 10, is included in character string interpolation module 16 and equipment monitor module 17, device data tabulation and PC data in the intermediate application program 10.
When beginning intermediate application program 10, character string is added module 16 and is obtained display Name " yamada " from IP telephony application 7, obtain PC name " pc " from the PC data of personal computer PC 2, generate character string " pc_yamada ", and this character string is sent to equipment monitor module 17.In order to handle the variation that takes place in PC name or display Name, this processing can be gone back regularly or be carried out when name changes.
When sending character string, equipment monitor module 17 stores from character string adds the character string that module 16 receives at every turn.
Whether as mentioned below, equipment monitor module 17 monitors the equipment that is connected to personal computer PC 2, upgraded or whether the equipment that is connected to personal computer PC 2 supports IP phone with the facility environment of determining personal computer PC 2.Based on monitoring the result, equipment monitor module 17 generates display Name and files for each equipment that monitors, and these data are sent to character string interpolation module 16.
In the example of Fig. 2, device A, B and C send to equipment monitor module 17 with its implementor name " Br_mfc_Ink_330 ", " Br_dcp_Ink_420 " and " Br_mfc_laser_480 " separately.
Equipment monitor module 17 is familiar with three equipment and support IP phone communication, and display Name " pc_yamada_3devces_d1_Br_mfc_Ink_330_d2_Br_dcp_Ink_420_d3 _ Br_mfc_laser_480 " is sent to character string adds module 16.In this display Name, " pc_yamada_3devices " expression has detected three equipment that are connected to pc_yamada.Further, character string " dn_ " (wherein n=1-3) is inserted in before each implementor name.
As described below because also with each implementor name as dossier, so can from display Name, omit the character string of indication equipment name.
In addition, equipment monitor module 17 sends to character string interpolation module 16 with archives " Device1=Br_mfc_Ink_330Device2=Br_dcp_Ink_420 Device3=Br_mfc_laser_480 ".
Character string is added module 16 reference device data lists, and the function that possesses of the equipment that obtains each implementor name that receives corresponding to slave unit monitor module 17, and will represent that the character string of obtaining function of each equipment appends to the archives of the correspondence of slave unit monitor module 17 receptions.
This device data tabulation comprises the data of appointment by the function of the equipment support of each type.
Character string is added module 16 also with reference to the PC data, obtaining the function that personal computer PC 2 possesses, and will represent that the character string of the function that these are acquired appends to archives.Here, " PCDATA " (" PC data ") are to being stored in the general designation of the data in registration table on the personal computer PC 2 and ini file etc., and comprise the os release on the personal computer PC 2 and be used for mounted application's data.Can wait from os release, mounted type of application and discern the function that personal computer PC 2 possesses.
Particularly, character string interpolation module 16 archives are set to:
“Device1=Br_mfc_Ink_330,Print?Scan?Card?FAX?Color?Ink
Device2=Br_dcp_Ink_420,Print?Scan?Card?Color?Ink
Device3=Br_mfc_laser_480,Print?Scan?FAX
Mono?Laser
Pc=Win_XP,OCR”。In archives, " Print " represents printing function, " Scan " represents scan function, " FAX " represents facsimile function, " Color " and " Mono " expression colour print and monochromatic printing function, " Ink " and " Laser " expression ink-jet system and laser system, the OS that " Win_XP " is illustrated on the personal computer is Windows (registered trade mark) XP, and " OCR " expression optical character identification function.Character string is added module 16 and is also used the same display Name that is generated by equipment monitor module 17, promptly
“pc_yamada_3devices_d1_Br_mfc_Ink_330_d2_Br_dcp_Ink_420_d3_Br_mfc_laser_480”。
With display Name and dossier in IP telephony application 7.
Next, the top processing of device registration data is described with reference to Fig. 3.Fig. 3 is the flow chart that is illustrated in the step in this processing.In the flow chart of Fig. 3, the processing of being undertaken among S1-S5 and the S8 by equipment monitor module 17, and add the processing that module 16 is carried out in S6, S7 and S9-S11 by character string.
In the S1 of Fig. 3, equipment monitor module 17 determines whether the facility environment of personal computer PC 2 changes.If environment upgrades (S1: be), equipment monitor module 17 advances to S2 so, if environment does not change (S1: deny), so with regard to termination device data location registration process.If after personal computer PC 2 starts, carry out this processing immediately, equipment monitor module 17 determines that facility environments have changed and advance to S2 so.
In S2, equipment monitor module 17 determines to support whether the equipment of IP phone communication is present among the equipment of renewal.If in the equipment that has upgraded one supports IP phone equipment (S2: be), equipment monitor module 17 advances to S3 so, if perhaps IP phone equipment is not related in renewal, and termination device data location registration process so.When after personal computer PC 2 starts, when carrying out this processings immediately, equipment monitor module 17 definite IP phone equipments are included among the equipment of renewal and advance to S3.
In S3, equipment monitor module 17 determines whether equipment is connected to personal computer PC 2.When equipment connects (S3: be), equipment monitor module 17 advances to S4, and when equipment does not connect (S3: deny), advances to S8.
In S4, equipment monitor module 17 is added the character string of the connection name of indication equipment to each device name, with character string " _ dn_ " (wherein n be 1 and the number of connected equipment between numeral) add the head of each device name to, and the character string that will be formed by each device name cascade sends to character string and adds module 16 as display Name.Subsequently, equipment monitor module 17 advances to S5.
In S5, equipment monitor module 17 is obtained the device data character string from each equipment, by with " devicen=" (wherein n be 1 and the number of connected equipment between numeral) head that adds this character string to forms new character string, and the character string that this is new sends to character string as archives and adds module 16.Subsequently, processing continues from S6.
In S6, character string is added the character string that module 16 slave unit data lists and PC data are obtained the function that is illustrated in each equipment that sends in the archives and personal computer PC 2, advances to S7 then.
In S7, the character string that character string is added the function of equipment that module 16 obtains expression and personal computer PC 2 appends to each device data in archives, advances to S11 subsequently.
In S8, equipment monitor module 17 sends to character string with the character string that does not have the display Name of equipment connection as expression and adds module 16, advances to S9 with reprocessing.
In S9, character string is added module 16 and is obtained the function of personal computer PC 2 from the PC data, advances to S10 subsequently.
In S10, character string is added module 16 and is added the character string of the function of expression personal computer PC 2 to archives, advances to S11 subsequently.
In S11, character string interpolation module 16 record display Names and archives are in IP telephony application 7.
According to the intermediate application program 10 understanding personal computer PC 2 of preferred embodiment or be connected to the function that equipment possessed of personal computer PC 2.To be familiar with the function that as being recorded in the IP telephony application 7 by the function recognition data that other IP telephony application obtains.The function recognition data constitutes at least a portion that is recorded in the log-on data in the IP telephony application 7, and can be provided to other personal computer of implementing IP phone communication via another IP telephony application.
On personal computer PC 3, intermediate application program 14 will comprise that the log-on data of the function recognition data that is used for the function that possessed by equipment 15 is recorded in the log-on data storage area 13 of IP telephony application 12.This registration is carried out in the manual input of user by personal computer PC 3 grades.The intermediate application program 3 of personal computer PC 1 also has and intermediate application program 10 similar functions, is used for comprising that the function recognition data that is used for the function that possessed by equipment 2 is recorded in the log-on data storage area (not shown) of IP telephony application 4.
In Fig. 1, a plurality of personal computer (not shown) except personal computer PC 1-PC3 are connected to network.For personal computer PC 1-PC3, IP telephony application and intermediate application program are installed in these personal computers each, and equipment is connected to computer.Correspondingly, will comprise that the log-on data of the function recognition data that is used for the function that possessed by each equipment is recorded in the log-on data storage area of corresponding IP telephony application.
In other words, the log-on data that will comprise the function recognition data that is used for the function that possessed by each equipment is recorded in the log-on data storage area that is installed in each the corresponding IP telephony application on personal computer PC 1-PC3 and other personal computer.
To be stored in log-on data storage area 8, log-on data storage area 13 and be installed in log-on data in the registration storage area of each IP telephony application on a plurality of other personal computers via network, the IP telephony application 4. that is sent in personal computer PC 1 be stored in this log-on data among the log-on data storage area 5 of IP telephony application 4 then.
Next,, use from the equipment 2 that is connected to personal computer PC 1 and obtained, subsequently the example of the data of handling by the equipment 11 that is connected to personal computer PC 2 step in describe handling.Fig. 4 illustrates the series of steps of carrying out according to the IP phone program of preferred embodiment.
At first, intermediate application program 3 is published to IP telephony application 4 with look-up command, to seek subscriber equipment.The subscriber equipment that IP telephony application 4 is sought on the IP telephony application (IP telephony application 7 etc.) that is installed on other personal computer.At this moment, IP telephony application 7 grades send to IP telephony application 4 with customer equipment data (log-on data), and IP telephony application 4 is stored in this log-on data among the log-on data storage area 5.
In P1, intermediate application program 3 based on receive from other personal computer and be stored in the processing that the log-on data the log-on data storage area 5 is obtained contacts list.The back will illustrate this processing in further detail, but this processing allows intermediate application program 3 to obtain the contacts list of user Equipment in IP telephony application.Contacts list is that representative can be from the tabulation of IP telephony application 4 called candidates' subscriber equipment.So although do not illustrate in the accompanying drawings, IP telephony application 4 stores the log-on data of obtaining from the IP telephony application that is installed on other personal computer, IP telephony application 7 and 12 also is provided with contacts list.In addition, can be outside IP telephony application edit contact listings.
In P2, receiving terminal and function that 3 selections of intermediate application program will be used.The back will describe this processing in detail, and after selecting the function that needs, intermediate application program 3 will be obtained order corresponding to the data of selecteed function and be published to the equipment 2 that is connected to personal computer PC 1.
In P3, equipment 2 obtains data based on selecteed function.For example, equipment 2 is sent to the view data of scanning the intermediate application program 3 of personal computer PC 1.
In P4, intermediate application program 3 generates the view data and the order data that will send.To describe this processing in detail below,, generate the view data and the order data that will transmit with the data of obtaining based on the type of the processing that on target device, will carry out.
In P5,3 issue an orders of intermediate application program, the data of obtaining with transmission.The order that will be used for being sent in the data that P3 obtains is published to IP telephony application 4.Next, the IP telephony application 4 of personal computer PC 1 is published to the IP telephony application 7 of personal computer PC 2 with order, authorizes to confirm that data send.
In P6, intermediate application program 10 monitors confirms that data send the data of the reception of the order of authorizing.At this moment, when this order is forwarded from IP telephony application 4, and when being received by IP telephony application 7, intermediate application program 10 detects such order.
In P7, in response to the order that is forwarded to IP telephony application 7 from IP telephony application 4, intermediate application program 10 is specified the processing of preserving the place that receives data, and subsequently order is published to IP telephony application 7, come authorization data to send, and send the place regulation of preserving the reception data.IP telephony application 7 will confirm that data send the order of authorizing and are published to IP telephony application 4.
In P8, intermediate application program 3 monitors the data that receive for the order that authorization data sends, and when this order when IP telephony application 7 is forwarded to IP telephony application 4, detecting data transmission authorization command.
In P9, IP telephony application 4 is carried out the data sending function.Particularly, the data of obtaining in P3 will be provided corresponding to the order data of the function that provides on equipment 11 the file transmitting element 6 that provides in IP telephony application 4, and the file receiving element 9 that provides in IP telephony application 7 is provided these data.
In P10, data to be sent such as intermediate application program 10, and be received in the data that send among the P9 subsequently.
In P11, intermediate application program 10 is explained the order data among the data that receive from IP telephony application 4, and based on the order data of having explained, and the data processing command of the function selected is outputed to equipment 11.
In P12, the function that equipment 11 uses based on the appointment of data processing command is carried out data processing.
By above-mentioned processing P1-P12, slave unit 2 obtains the data that are used for selecteed function, and the selecteed function of equipment 11 uses is carried out the data processing to the data of having obtained.
Processing in P5-P10 is configured for view data and order data are sent to from personal computer PC 1 processing of personal computer PC 2.
Carry out according to the function that the intermediate application program 3 of preferred embodiment can select personal computer PC 2 to be possessed, obtaining will be by the data of the form of selecteed function treatment, and guides IP telephony application 4 to send these data.Correspondingly, when the IP telephony application 4 on being installed in personal computer PC 1 only possesses function with other personal computer communication, the function that the intermediate application program can guide personal computer PC 2 to implement to stipulate.
In addition because according to the intermediate application program 3 of preferred embodiment except data to be processed, also send the data of the selecteed function of identification, so the data that personal computer PC 2 can use the function treatment of appointment to receive from middle application program 3.
Next, will illustrate in greater detail this processing.When the user of personal computer PC 1 in the time of needs, when instruction is input to intermediate application program 3, start the user interface of the intermediate application program 3 shown in Fig. 5.
Be used for via the IP telephony application 4 that is installed on the personal computer PC 1 in the user interface shown in Fig. 5, obtain the data in the processing that is recorded in the S1-S11 in the IP telephony application (for example IP telephony application 7) that is installed on another PC, and the function that is used to use other PC and is connected to the equipment of other PC.So, the user interface of intermediate application program 10 comprises: " Search for User Devices... " (" seeking subscriber equipment ... the ") button that is used for explicit user interface (see figure 7), to obtain the data that are recorded on the IP telephony application that is installed on another PC, and comprise " FunctionsUsing User Devices... " (" using the function of subscriber equipment ... the ") button that is used for explicit user interface (seeing Figure 12), to use other PC and the function that is connected to the equipment of other PC.
In user interface, be labeled as the function recognition data of the frame demonstration of " Device Data for the Selected User Device " (" device data of selecteed subscriber equipment ") corresponding to selecteed display Name in " Contact list " (" contacts list ") (display Name of in contacts list, giving prominence to) with chain-dotted line.In the example shown in Fig. 5, to be shown as device data corresponding to the device name " Br DCP 420 " and the functions of the equipments " PRINTER; SCANNER, MEDIA CARD SLOT " (" printer, scanner, medium draw-in groove ") of outstanding subscriber equipment " Br_dcp_420_sato ".
The user can carry out any basic function that IP telephony application possesses by press corresponding button " Chat... " (" chat ... "), " Call... " (" calling ... "), " File Transfer... " (" file transmits ... ") and " Search for User... " (" the seeking the user ... ") of listing under " Basic Functions of the IP TelephoneApplication " (" basic function of IP telephony application ").
In addition, press the user interface implementing to use the function of subscriber equipment and be used to seek subscriber equipment of being used to that in button " Functions Using UserDevices... " under " Expanded Functions of the IP Telephone Application " (" expanded function of IP telephony application ") (" using the function of subscriber equipment ... ") and " Search for User Devices... " (" seeking subscriber equipment ... ") one starts correspondence.
Fig. 6 is the flow chart that is illustrated in the step of the processing that is used for showing the device data relevant with outstanding subscriber equipment display Name.When each display Name outstanding in the user interface of Fig. 5 changes, just carry out this processing.
In the S12 of Fig. 6, intermediate application program 3 is obtained the device data corresponding to outstanding display Name from display Name and archives.
In S13, intermediate application program 3 determines whether that success obtained device data.When successfully obtaining device data (S13: be), handle and to jump to S15, and (S13: not), advance to S14 when not becoming merit.
In S14, in the 3 slave unit data lists of intermediate application program, obtain the type that is illustrated in appointed equipment in the outstanding display Name and the data of the function that equipment possessed.
In S15, intermediate application program 3 shows device name and the functions of the equipments of obtaining in above " DeviceData for the Selected User Device " in the user interface shown in Fig. 5 (" device data of selected subscriber equipment ") frame.
Here, provided example, promptly, perhaps extracted device data indirectly by the reference device data list based on outstanding display Name from display Name or the direct processing of extracting the device data of the display Name that is used to give prominence to of archives.
In addition, may extract the function that each equipment possesses, and come the configuration feature recognition data by the display Name that these functions is appended to individually the correspondence of subscriber equipment from the log-on data that is used for each equipment.For example, the function recognition data that extracts from log-on data can be " deviceA_userB_printer ", " deviceA_userB_scanner ", " deviceA_userB_FAX " and " deviceA_card ".
Next, the processing of obtaining contacts list that explanation is carried out in the P1 of Fig. 4.
Fig. 7 illustrates when the user presses " Search for UserDevices... " (" searching subscriber equipment ... ") button in the user interface of Fig. 5, shown is used for the example user interface that subscriber equipment is searched.Use this user interface, the user can obtain the data of registering in the IP telephony application on being installed in another PC.Be used for the user interface that subscriber equipment searches and be included in selector (having selected " Display name " (" display Name ") in this example) that " 1.Please Select the Search Criteria " (" 1. please select the standard of searching ") shows down; The radio button (having selected in this example, " Search by Device Function " (" searching ")) that " Search by Device Function " (" searching by functions of the equipments ") and " Search by Device Type " (" searching by device type ") next door under " 2.Please Select the Function or Type of Device " (" 2. please select the function or the type of equipment ") provides by functions of the equipments; " Search " (" searching ") button that under " 3.Please Press the Search Button " (" 3. please press and search button "), shows; Tabulate at the lookup result that " User Device Search Results " (" subscriber equipment lookup result ") shows down; When being pressed, outstanding subscriber equipment that will be in the subscriber equipment lookup result is inserted into " Insert Selected User Device into Contact List " (" selecteed subscriber equipment is inserted in the contacts list ") in the contacts list; And " Cancel " (" cancellation ") button that the cancellation subscriber equipment is searched when pressing.
The user at first specifies the standard that is used for searching subscriber equipment from the project of log-on data, the attribute of user's subscriber equipment that designated user obtains in wishing searching in " 2.Please Select the Function or Type of Device " (" 2. please select the function or the type of equipment ") then in " 1.Please Select the Search Criteria " (" 1. please select the standard of searching ").Press the user after " searching " button, processing among the S 16 of the Fig. 8 that illustrates later is performed, to obtain corresponding to the designated user equipment lookup result above under " User Device Search Results " (" subscriber equipment lookup result ").
Fig. 8 is the flow chart that the step of the processing that is used for obtaining contacts list is shown.
In the S16 of Fig. 8, intermediate application program 3 is supported the searching of subscriber equipment of IP telephony application.When pressing " Search " (" searching ") button after function of specifying the equipment of being searched in the user interface of user at Fig. 7 or the type, carry out this processing.Intermediate application program 3 is obtained function or the type that subscriber equipment lookup result (log-on data) also shows the equipment the lookup result that is included in from IP telephony application.
In S17, intermediate application program 3 is handled, to add the subscriber equipment from the support IP telephony application of searching the result to contacts list.More specifically, when the user pressed " Insert Selected User Device into Contact List " (" selected subscriber equipment is inserted into contacts list ") in the user interface of Fig. 7, intermediate application program 3 was added the outstanding subscriber equipment in the subscriber equipment lookup result to provide contacts list in IP telephony application 4.Subsequently, intermediate application program 3 stops contacts list and obtains processing.
Next, detailed description is used to search the processing of the subscriber equipment of supporting IP telephony application.Fig. 9 is illustrated in this that carry out among the S16 of Fig. 8 to search the flow chart of the step in the processing.
In the S18 of Fig. 9, intermediate application program 3 will represent that the data storing of appointment in user's " 1.Please Select the Search Criteria " (" 1. please select the standard of searching ") and " 2.Please Select the Function or Type of Device " (" 2. please select the function or the type of equipment ") in the user interface of Fig. 7 is among variables D EV.
In S19, intermediate application program 3 is handled in the next IP telephony application from the log-on data of having obtained and is obtained the subscriber equipment lookup result.
In S20, intermediate application program 3 is handled and is searched subscriber equipment.Subsequently, intermediate application program 3 terminates in the processing of searching the subscriber equipment of supporting IP telephony application that begins among the S16 of Fig. 8.
Figure 10 illustrates the flow chart that is used for obtaining from the S 19 initialized IP telephony applications of Fig. 9 the step the processing of subscriber equipment lookup result.
In the S21 of Figure 10, intermediate application program 3 sends to the subscriber equipment look-up command application programming interfaces (API) of IP telephony application 4.In response, IP telephony application 4 is according to being stipulated that by IP phone defined process searches subscriber equipment to obtain log-on data.
In S22, intermediate application program 3 from IP telephony application 4, is obtained the result that this subscriber equipment is searched via the API of IP telephony application 4.
After finishing S22, the processing that 3 terminations of intermediate application program are obtained the subscriber equipment lookup result from IP telephony application.
Figure 11 is the flow chart that the step in the processing of being carried out in the S20 of Fig. 9 by intermediate application program 3 of searching subscriber equipment is shown.
In the S23 of Figure 11, the variables D EV of the equipment of the target that intermediate application program 3 is searched based on identification, character string is obtained in the slave unit data list.Device data tabulation comprises expression and the function of the similar equipment of value that stores or the value of type in variables D EV, also comprise corresponding data, and its form has the character string of the equipment of the equipment of these functions or these types for identification.
In S24, intermediate application program 3 is searched the character string of obtaining in S23 from the subscriber equipment lookup result that IP telephony application receives.
In S25, intermediate application program 3 determines whether to exist the Any user equipment corresponding to the character string of using in searching.If there be (S25: be) in such equipment, intermediate application program 3 advances to S26 so, and if there is not (S25: not), advance to S28 so in such equipment.
In S26, intermediate application program 3 is extracted all subscriber equipmenies with the string matching of using in searching.
In S27, all subscriber equipmenies that intermediate application program 3 will be extracted in S26 are presented in the tabulation under " Results of the user device search " (" result that subscriber equipment is searched ") in the user interface of Fig. 7.Subsequently, intermediate application program 3 stops searching processing for the subscriber equipment of the subscriber equipment of supporting IP telephony application.
In S28, intermediate application program 3 shows the non-existent message of the selecteed subscriber equipment of expression.For example, intermediate application program 3 output messages " The selected user device was notfound.Either the user device does not exist or is not online. " (" do not find the user of selection, this subscriber equipment does not exist or be not online ").Press " OK " (" determining ") the user afterwards, intermediate application program 3 stops searching processing for the subscriber equipment of searching the subscriber equipment of supporting IP telephony application.
Integrated on the personal computer PC 1 of IP telephony application, even in the IP telephony system that does not adopt server, also can obtain the function recognition data of other personal computer of identification or miscellaneous equipment according to the intermediate application program 3 of preferred embodiment.Intermediate application program 3 or from the log-on data of being obtained by IP telephony application 4, extract these data, perhaps based on this log-on data indirectly getting data, this log-on data is recorded in another IP telephony application that is installed on the NetPC Network PC.Correspondingly, intermediate application program 3 can be discerned the function that other personal computer or miscellaneous equipment possesses based on the data that are recorded on other IP telephony application.
In addition, has intermediate application program 3, a plurality of functions that the user of personal computer PC 1 can visually discern other personal computer or other telephone terminal and possessed according to preferred embodiment.
Next, with the processing of explanation selective reception terminal and function of needing in the P2 of Fig. 4.
When the user any the time, when in the user interface of Fig. 5, pressing " Functions UsingUserDevices... " (" using the function of subscriber equipment ... ") button, intermediate application program 3 starts the user interface of the function that is used to use the subscriber equipment shown in Figure 12, and the processing of execution in the P2 of Fig. 4, below with reference to Figure 13 it is elaborated.
In Figure 12, be used to use the user interface of the function of subscriber equipment to comprise: " ContactList " (" contacts list ") and " Target User Device " (" target UE ") frame, be used for the targeted customer is added to " Target User Device " (" target UE ") and " Add " (" interpolation ") and " Delete " (" deletion ") button from wherein deleting, be used for (in this example at the radio button of contacts list intended target data, be used for selecting " Scanned Data " (" data of scanning ") or " Exist Files " (" existing file ")), the radio button that is used to specify the function that will carry out on target UE (in this example, select " Print " (" printing "); " Save Image to Media Card " (" image is saved on the dielectric card ") or " OCR "); be used to carry out " OK " (" determining ") button of function and be used to cancel function " Cancel " (" cancellation ") button.
Target UE is that target is the subscriber equipment handled based on selected function.Can specify a plurality of target UEs.For subscriber equipment being added to " Target UserDevices " (" target UE ") frame, the user can give prominence to the subscriber equipment that will add target UE in contacts list to, and presses " Add " (" interpolation ") button.Similarly, if the user wishes subscriber equipment is deleted from " Target User Devices " (" target UE ") frame, the user can give prominence to the subscriber equipment that will delete from " target UE ", and presses " Delete " (" deletion ") button.
(" determine ") button, intermediate application program 3 is carried out the section processes among the P2 of Fig. 4 based on selected function, and the processing that equipment 2 is carried out among the P3 in case the user presses " OK " in the user interface of Figure 12.
Figure 13 be its when being illustrated in the user interface that shows Figure 12, be used for the flow chart of step of processing of function of the needs of selective reception terminal and execution.
In the S29 of Figure 13, intermediate application program 3 determines whether " Add " (" interpolation ") button is pressed.If " Add " (" interpolation ") button is pressed (S29: be), intermediate application program 3 advances to S30 so, if the and (S29: not), then advance to S33 that is not pressed.
In S30, intermediate application program 3 is added subscriber equipment outstanding in contacts list to target UE.
In S31, intermediate application program 3 is presented at the subscriber equipment that increases newly in " Target User Devices " (" target UE ") frame of user interface.
In S32, intermediate application program 3 is stored in target UE among the variable TD.
In S33, intermediate application program 3 determines that " OK " (" determines whether ") button is pressed.If (" determine that ") button is pressed (S33: be), intermediate application program 3 advances to S35 so, if the and (S33: not), then advance to S34 that is not pressed " OK ".
In S34, for in the user interface that is chosen in Figure 12 as the user " Target Data " under (" target data ") during the radio button on " Existing Files " (" existing file ") next door, or the situation of user when pressing " Cancel " (" cancellation ") button, select intermediate application program 3 to carry out extra processing.If the user has selected the radio button on " Existing Files " (" existing file ") next door, intermediate application program 3 is carried out the processing of specified file so.Subsequently, intermediate application program 3 turns back to S29.
When the user pressed " Cancel " (" cancellation ") button, intermediate application program 3 was closed the UI window of the function that is used to use subscriber equipment, and all subsequent steps of handling of cancellation.
In S35, intermediate application program 3 will be stored among the variable TF by the function that target UE carried out.Subsequently, intermediate application program 3 is obtained order based on the function of needs (function that will be carried out by target UE) with data and is published to equipment 2, the processing of the P3 in prompt facility 2 execution graphs 4.In this point, intermediate application program 3 stops the processing of selective reception terminal and the function that needs.
In case the processing of P3 among equipment 2 executed Fig. 4, and intermediate application program 3 slave unit 2 received data, the processing among the P4 of intermediate application program 3 execution graphs 4 is used to generate the view data and the order data that will send so.Figure 14 is the flow chart that is illustrated in the step of the processing that is used for generating the view data that will send and order data.
In the S35 of Figure 14, intermediate application program 3 is based on variable TF, the function that selection will be carried out on target UE.When selected function is " Print " (" printing "), intermediate application program 3 advances to S37, when selected function is " Save to Media Card " (" being saved in dielectric card "), advances to S39, when selected function is " OCR ", advance to S40.
In S37, intermediate application program 3 is converted to print data with the view data of obtaining.More specifically, intermediate application program 3 is converted to the form that is used for printing with view data on target UE, and additional is used to print the code of control.
In S38, intermediate application program 3 generates the print command file.Particularly, intermediate application program 3 is stored in print order data in the order data shown in Fig. 1.Subsequently, intermediate application program 3 stops generating the view data that will send and the processing of order data.
In S39, intermediate application program 3 generates the order data that is used to save the data on the dielectric card.More specifically, intermediate application program 3 with storage card hold-over command data storing in the order data shown in Fig. 1.Subsequently, intermediate application program 3 stops generating the view data that will send and the processing of order data.
In S40, intermediate application program 3 is carried out image processing, is converted to the data that OCR supports with the view data that will obtain.More specifically, the threshold value that intermediate application program 3 is suitable for OCR is provided with, and based on this threshold value, in the enterprising row binaryization of view data.
In S41, intermediate application program 3 is created the OCR order datas, and stops generating the view data that will send and the processing of order data subsequently.
Carry out the processing of above-mentioned S36-S41 on all target devices in the array that is stored in variable TD.
Other personal computer or other telephone terminal send with data because will be identified in the data of the function of the needs that will use in the deal with data according to the intermediate application program 3 of preferred embodiment, so can use the function of appointment to handle the data of reception.
In addition, can obtain and show the termination function recognition data of a plurality of other personal computers of identification or a plurality of miscellaneous equipments at least according to the intermediate application program 3 of preferred embodiment.The user can select to guide one display terminal function recognition data in other personal computer or the equipment to come deal with data.
The relevant function recognition data of function that can show in addition, the user's appointment that possesses with other personal computer or miscellaneous equipment according to the intermediate application program 3 of preferred embodiment.
In addition, under situation about having according to the IP telephony system 1 of preferred embodiment and the method for controlling telephone system 1, even when IP telephony system does not adopt server, intermediate application program 3 also can and be discerned the function that other personal computer or miscellaneous equipment possesses by directly or indirectly obtain the function recognition data of these functions of identification from the log-on data that IP telephony application 4 is obtained.Log-on data is the data in another IP telephony application that is recorded on other personal computer that is installed on the network.
In addition, function that another personal computer or another equipment possessed as IP telephony application 4 retrievable function recognition data, is recorded in other corresponding IP telephony application.The function recognition data constitutes at least a portion that is recorded in the log-on data in other IP telephony application.When carrying out the IP phone calling via IP telephony application 4, personal computer PC 1 can be obtained this function recognition data.
Even when the IP telephony application 4 on being installed in personal computer PC 1 only had function with personal computer communication, intermediate application program 3 also can be implemented the function of regulation on another person's computer on the network or equipment.Particularly, intermediate application program 3 can be selected the function that possessed on the personal computer that will carry out or the miscellaneous equipment, obtains the data of the required form of selected function treatment, and guides IP telephony application 4 to send these data.
For example, when will only being included in the IP telephony application of implementing the function of communication between the terminal when being installed on the self networks terminal, the resource of IP telephony system can be used effectively, and does not need to be used for the processing time of the length of substitute I P telephony application.
In addition, because intermediate application program 3 will be discerned the data of the function that will be used for deal with data with sending in IP telephony system 1 data to be processed according to present embodiment, so personal computer or miscellaneous equipment can use the function of appointment to handle the data of reception.
Use can be handled the data that sent by a network terminal by the selected processing capacity of the network terminal that sends data on another network terminal, so effectively utilizes at the network terminal of transmitter side with in the resources of network terminal of receiver side.
The variation of embodiment
Next, with the firmware router of explanation according to the variation of embodiment.Figure 15 is illustrated in the example of the user interface in the firmware router.
The firmware router is used to send the firmware from the manufacturer's of development equipment specified devices.In this variation, firmware comprises the firmware of specified devices self and the intermediate application program of moving between equipment and IP telephony application.
The user interface of the firmware router shown in Figure 15 comprises: " Select User Data " (" selection user data ") selector, " Device Type " (" device type ") selector, " Device Model " (" unit type ") tabulation, " Firmware Selection " (" firmware selection ") line of input, " User Search Results " (" user's lookup result ") tabulation, " Device Data for Selected User " (" selecteed user's device data ") subwindow, " Search " (" searching ") button, " Transmit " (" transmission ") button and " Cancel " (" cancellation ") button.
The keeper who supports at the manufacturer firmware in needs, the user interface of starting in Figure 15; Use " 1.Please Select the Search Criteria " (" 1. please select the standard of searching ") selector (selecting " Display name " (" display Name ") in this example), come the regulation of from log-on data, selecting subscriber equipment to search; Select the type (in this example, selecting " Inkjet printer, multifunction device " (" ink-jet printer, multifunctional equipment ")) of the equipment search with " Device Type " (" device type ") selector; And from " DeviceModel " (" unit type ") tabulation, the model of the equipment that selection is searched (in this example, selecting " MFC-420CN ").Selector have with Fig. 7 in the function identical functions.When the keeper presses " Search " (" searching ") button subsequently, intermediate application program 3 is carried out processing illustrated in fig. 9 searching the subscriber equipment of supporting IP telephony application, and will be presented in " User DeviceSearch Results " (" subscriber equipment lookup result ") frame with the display Name of the subscriber equipment of the device type coupling of being searched etc.
In addition, when in the outstanding equipment at lookup result any variation being arranged, the processing of execution graph 6 shows the title of outstanding subscriber equipment and the function that this equipment is possessed.When the filename of the firmware that the keeper will send is input in " Firmware Selection " (" firmware selection ") line of input, and when pressing " Transmit " (" transmission ") button, be sent to the subscriber equipment that in " subscriber equipment lookup result " frame, shows by the firmware of filename appointment.In case subscriber equipment receives this firmware, subscriber equipment just upgrades their firmware.
In this way, intermediate application program 3 can be based on the data that are recorded in its IP telephony application, upgrade the network terminal that possesses IP telephony application or the firmware on the telephone terminal.Sometimes, the manufacturer is every kind of function establishment of equipment and upgrades firmware.Under the situation that embodiment changes, the function that intermediate application program 3 can verifying user equipment possesses, and send the correct firmware that is used to upgrade.
Second embodiment
Next, 16-20 illustrates IP phone terminal of the present invention, IP phone program and IP telephony system according to second embodiment with reference to the accompanying drawings.
Figure 16 illustrates the structure according to the IP telephony system 20 of second embodiment.
In the IP telephony system 20 of second embodiment, for parts and the assembly identical with IP telephony system among first embodiment shown in Fig. 1 have been specified identical label, to avoid repeat specification.
IP telephony application 4 and intermediate application program 3 are installed on the personal computer PC 1 among first embodiment, and IP telephony application 24 is installed on the personal computer PC 1 of second embodiment.IP telephony application 24 is the functional programs that can implement IP telephony application 4 described in first embodiment and intermediate application program 3.
Similar ground, IP telephony application 27 is installed on the personal computer PC 2 of second embodiment, and wherein IP telephony application 27 is the functional programs that can implement IP telephony application 7 described in first embodiment and intermediate application program 19.
Although IP telephony application 24 and IP telephony application 27 have identical operations and effect in a second embodiment, for convenience, used different labels in the following description.
In addition, character string is added module 16 and equipment monitor module 17 (see figure 2)s all be integrated among IP telephony application 24 and 27, be used for facilities and equipments data location registration process (see figure 3) on personal computer PC 1 and personal computer PC 2.Yet, because character string is added identical with described in first embodiment of module 16 and equipment monitor module 17 and device data location registration process, so no longer repeat explanation to these modules and processing.
Figure 17 is the block diagram that illustrates according to the electric structure of the IP telephony system 20 of second embodiment.
As shown in Figure 17, personal computer PC 1 has CPU 31, ROM 32, RAM 33 and hard disk drive (HDD) 34.Personal computer PC 1 also has: can be connected to the audio interface 37 of audio stream equipment 37a, be used for via internet 80, and implement IP phone by another IP phone terminal of display Name appointment and communicate by letter; Network interface 38; The USB interface 39 that can be connected with external equipment.Personal computer PC 1 also has other assembly, such as the monitor (not shown) that is used to show with reference to illustrated user interface such as figure 5, the explanation of having omitted these equipment.
CPU31 controls the assembly of personal computer PC 1 based on the fixed value and the program that are stored among ROM 32, RAM 33 and the HDD 34.Above-mentioned IP telephony application 24 is stored among the HDD 34.
Although in the example of Figure 17, personal computer PC 1 is to connect the equipment of being connected to 2 via USB, and significantly, personal computer PC 1 can be operatively connected to the equipment on the LAN.
Next the processing of handling the data of being obtained from the equipment 2 that is connected to personal computer PC 1 will be described on the equipment 70 that is connected to personal computer PC 2.
Figure 18 is the sequence chart that the series of steps of carrying out according to the program on the IP telephony system of second embodiment is shown.At first, IP telephony application 24 is carrying out searching of subscriber equipment by to IP telephony application (the IP telephony application 27 etc.) releasing inquiry that is installed on other personal computer on the internet.
IP telephony application 27 grades will comprise that the customer equipment data (log-on data) of display Name (example of recognition data) turns back to IP telephony application 24, and IP telephony application 24 is stored in this log-on data in the log-on data storage area 5 and (sees Figure 16).
Some systems can have the special user's equipment that is called as super node, the log-on data that is used to manage all IP telephony applications.In this case, super node returns the log-on data of each IP telephony application in response to searching of carrying out on IP telephony application program 24.
If in the system described in first embodiment, there is super node, should will return the log-on data of each IP telephony application in response to searching of being undertaken by IP telephony application 4 by super node so.
In P21, the IP telephony application 24 of personal computer PC 1 is based on the log-on data from other personal computer that is recorded in the log-on data storage area 5, the processing of obtaining contacts list.Basic identical among this processing and first embodiment with reference to figure 8,9 and 11 described processing, so no longer repeat at this.
Yet,, described in the S19 of intermediate application program such as Fig. 9, obtain the subscriber equipment lookup result from IP telephony application because carry out obtaining processing according to the contacts list of first embodiment with the intermediate application program.In the situation of second embodiment, IP telephony application can directly be searched the subscriber equipment of supporting IP telephony application and not pass through the intermediate application program.
In P22, IP telephony application 24 carries out the processing of selective reception terminal and the function that needs.Basic identical among this processing and first embodiment with reference to the described processing of Figure 13, so no longer repeat at this.Yet the processing described in Figure 13 is carried out with the intermediate application program, and the processing of second embodiment is carried out with IP telephony application.
After the function of need selecting in this is handled, IP telephony application will obtain order based on the data of this function and be published to the equipment 2 that is connected to personal computer PC 1.
In P23, the selected function of equipment 2 usefulness is obtained data to be processed.For example, equipment 2 will be sent to the IP telephony application 24 of personal computer PC 1 by the view data of equipment 2 scannings.
In P24, IP telephony application 24 generates the view data that will send and the processing of order data.This processing has been described, so no longer repeat with reference to Figure 14.Yet the processing described in Figure 14 is carried out with the intermediate application program, and the processing among second embodiment is carried out with IP telephony application.
In P24, IP telephony application 24 generates the view data and the order data that will send based on the data type that will handle on target device.
In P25, IP telephony application 24 is published to the IP telephony application 27 of equipment 2 with order, sends with specified data and authorizes.
In P26, IP telephony application 27 sends the order of authorizing and the data that monitor in order to confirm data.At this moment, when such order is forwarded from IP telephony application 24, and when being received by IP telephony application 27, IP telephony application 27 detects this order.
In P27, send the order of authorizing in response to detecting the affirmation data that receive from IP telephony application 24, IP telephony application 27 is specified the processing of preserving the place that receives data.Next, IP telephony application 27 is published to IP telephony application 24 with order, sends with authorization data.
In P28, the order that IP telephony application 24 sends for authorization data and the data that monitor into, and, detect data transmission authorization command when when IP telephony application 27 receives such order.
In P29, IP telephony application 24 is carried out the data sending function.Particularly, the data that IP telephony application 24 in Figure 16 will obtain in P23 with the additional command data of the function that provides on the equipment 11 are provided, send to the file receiving element 9 of IP telephony application 27 from the file transmitting element 6 of IP telephony application 24 via IP phone communication.Use this mode, personal computer PC 1 can send the data that will be used effectively on target device.
In P30, data to be sent such as IP telephony application 27, and be received in the data that send among the P29 subsequently.
In P31, IP telephony application 27 is explained the order data among the data that receive from IP telephony application 24, and based on the order of having explained, and the data processing command of selected function is outputed to equipment 11.
In P32, the appointed function that equipment 11 uses based on data processing command carries out data processing.
This program can show the data relevant with another network terminal of the function that possesses user's appointment, and can effectively utilize the processing resource of representing in video data.
In above-mentioned P31 and P32, the selected function of equipment 11 is handled the data that slave unit 2 obtains.As a result, can effectively utilize the resource of the IP phone terminal on data transmitter side and Data Receiving side.
As in above-mentioned first embodiment, when the user is input to instruction in the IP telephony application 24 at needs the time, show with reference to figure 5 described user interfaces according to the personal computer PC 1 of second embodiment.Because the user interface of second embodiment is basically the same as those in the first embodiment, difference only is that user interface is shown by IP telephony application 24 rather than shown by intermediate application program 3, so the user interface of IP telephony application 24 is omitted from this explanation and accompanying drawing.
In addition, when the outstanding display Name of subscriber equipment changes in the user interface of Fig. 5 at every turn, the processing described in the execution graph 6.
Processing according to Fig. 6 of second embodiment will be described here.As in above-mentioned first embodiment, in the S12 of Fig. 6, IP telephony application 24 obtains the device data of the display Name of outstanding subscriber equipment from display Name and archives.
In S13, IP telephony application 24 determines whether that success obtained device data.When successfully having obtained device data (S13: be), IP telephony application 24 advances to S 15, (S13: not), advance to S14 when not becoming merit.
Figure 19 (a) is the flow chart of detailed step that the processing of S12 is shown.In the S121 of Figure 19 (a), IP telephony application 24 determines whether outstanding display Name comprises the extraction character string A (obtaining the example of data) that stores in advance.
Figure 19 (b) illustrates the sample list of extracting character string.The HDD34 that this extraction character string tabulation is stored in personal computer PC 1 in advance goes up (seeing Figure 17).In the example of Figure 19 (b), " device " and " pc_ " stored as the extraction character string that meets display Name.
As described in reference to figure 2, when display Name comprises the PC title, during such as " pc_ " that comprise the indication equipment title and " device ", it is that the further part of display Name will comprise PC title and device name that very high possibility is arranged.
If comprising, display Name extracts character string (S121: be), promptly, when IP telephony application 24 determines that PC name and implementor name are associated with display Name, in S122, IP telephony application 24 is removed (or from its extraction) with device name from closely follow the character string after extracting character string.
In S123, IP telephony application 24 obtains the extraction character string B corresponding to detected extraction character string A in display Name, and determines whether extraction character string B is present among the archives.
Extract character string B (S123: be) if archives comprise, in S124, IP telephony application 24 removes device name from closely follow the character string after this extraction character string, and turns back to the S15 of Fig. 6 so.As mentioned above, the character string of the function that indication equipment possessed has been added to (see figure 2) among the device data.
In other words, by above-mentioned processing, IP telephony application 24 can obtain and the related device name of display Name that receives from another IP phone terminal by the internet, and can be based on this device name, and identification has the function that other IP phone terminal of this display Name can be controlled.So IP telephony application 24 can obtain device name by the simple process of extracting device name from display Name, has avoided the use of unnecessary processing resource.
Yet (S121: deny or S123: not), in the time of promptly can not obtaining device data, IP telephony application 24 turns back to the S14 of Fig. 6 when negating definite if IP telephony application 24 is made in S121 or S123.
For example, although device data comprises that in the archives of above preferred embodiment, device data can alternatively be included in the display Name.In the case, be not to determine in S123 whether archives comprise to extract character string B, but IP telephony application 24 can be determined whether display Name comprises and extract character string B.When display Name comprises when extracting character string B, in S124, configurable I P telephony application 24 with device data from followed by removing in the character string the display Name that extracts after the character string B.
In first embodiment, device data also can be included in the display Name.
In S14, IP telephony application 24 determines whether the device name (see figure 2) that is stored in the device data tabulation is included in the outstanding display Name, if in the slave unit data list, obtain the device data corresponding to this device name so.
Figure 20 is the flow chart that is illustrated in the detailed step of the processing among the S14 of Fig. 6.In S141, IP telephony application 24 determines whether outstanding display Name comprises in the device name that is stored in the device data tabulation.
If display Name does not comprise the device name (S141: not), handle stopping so that is stored in the device data tabulation.Yet if display Name comprises one (S141: be) in the device name that is stored in the device data tabulation, in S142, IP telephony application 24 extracts device name from display Name so.Processing in S142 is the example of terminal data obtaining means.
In S143, the device data corresponding to the device name of extracting is obtained in IP telephony application 24 slave unit data lists, and turns back to the S15 of Fig. 6 subsequently.
Because device name is not included in the archives in a preferred embodiment, thus can determine in S141 whether archives comprise device name, rather than whether display Name comprises device name.
In first embodiment, can determine also whether device name is included among the archives.
As in above-mentioned first embodiment, in S15, IP telephony application 24 is presented at device name and the functions of the equipments of obtaining in " Device Data for the Selected User Device " (" device data of the subscriber equipment of selection ") of the user interface shown in Fig. 5.
The same with personal computer PC 1 according to first embodiment, can easily use the function of other IP phone terminal according to the personal computer PC 1 of second embodiment, to effectively utilize the resource of IP telephony system.
Other IP phone terminal can receive the IP phone terminal of self can be by the terminal data recognition function of other IP phone terminal control.So therefore the function that the user of self IP phone terminal can be notified can be controlled by other IP phone terminal can effectively utilize these functions.
Although the present invention is had been described in detail with reference to specific embodiment, but apparently, under the premise of without departing from the spirit of the present invention, those skilled in the art can make many modifications and variations, and scope of the present invention is limited by claims.
For example, although in a preferred embodiment, the equipment that is connected to personal computer is illustrated that as scanner and printer the present invention also can be applied to facsimile machine or miscellaneous equipment.
This equipment can have voice I/O function, such as loud speaker and microphone.The user uses loud speaker and the microphone provide in equipment to make call on IP phone, and the device data that will be used to implement the equipment of call is registered among the IP telephony application.
In this case, the speech data that IP telephony application will receive from another IP phone terminal is by the loud speaker output of equipment, and the speech data that will be input to the microphone of equipment sends to other IP phone terminal.
In addition, for event message is sent to the intermediate application program, and the intermediate application program will be forwarded to equipment from the event message of IP telephony application with IP telephony application and equipment disposition, and will be from the forwards of equipment to IP telephony application.
For example, when IP telephony application when another IP phone terminal receives call request, IP telephony application is sent to equipment with call request event via the intermediate application program.If user's operating equipment is represented call accepted, so this is accepted incident and be sent to IP telephony application, after this begin call.
When middle application program is obtained when instruction from the equipment of expression call accepted, this application program can suppose in the S1-S3 of Fig. 3 all determine it all is " Yes " ("Yes"), and in S4-S7, device data that can recording equipment, wherein the instruction of call accepted is initiated by described equipment in IP telephony application.
On the other hand, if the instruction that other subscriber equipment is searched in the input of user's operating equipment, equipment is sent to IP telephony application via the intermediate application program with the look-up command incident so, and IP telephony application sends the request of searching subscriber equipment by the internet.After the contacts list that receives the result who searches as this, IP telephony application is sent to equipment via the intermediate application program with contacts list, and equipment is presented at this tabulation on the display unit then.
At this moment, user operable device is come selective call target from the contacts list that shows.When incoming call instructs after the user is selecting the contact person, equipment is sent to IP telephony application via the intermediate application program with call request event, and IP telephony application sends to the IP phone terminal at call targets place with call request, and the permission of calling to be performed such as follows.
Obtain on the basis of instruction at equipment from the request call, among the S1-S3 of intermediate application program supposition Fig. 3 all determine it all is " Yes " ("Yes"), and in S4-S7, the device data of recording equipment wherein asks the instruction of call to be initiated from described equipment in IP telephony application.
In addition, the user interface in Fig. 5 and Fig. 7 can be merged in equipment.In this case, the user operates in the user interface of Fig. 5 of providing in the equipment or Fig. 7 with input instruction, and this instruction is sent to IP telephony application via the intermediate application program that is used to search etc.User interface among the Fig. 7 that provides on the equipment can also be provided the user, uses the function that is provided with input instruction on another IP phone terminal, and this instruction is sent to the intermediate application program.