[go: up one dir, main page]

WO2008072653A1 - Mobile terminal device, and image selecting method - Google Patents

Mobile terminal device, and image selecting method Download PDF

Info

Publication number
WO2008072653A1
WO2008072653A1 PCT/JP2007/073921 JP2007073921W WO2008072653A1 WO 2008072653 A1 WO2008072653 A1 WO 2008072653A1 JP 2007073921 W JP2007073921 W JP 2007073921W WO 2008072653 A1 WO2008072653 A1 WO 2008072653A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
image data
terminal device
mobile terminal
received
Prior art date
Application number
PCT/JP2007/073921
Other languages
French (fr)
Japanese (ja)
Inventor
Kazushige Yamada
Toshimasa Takaki
Original Assignee
Panasonic Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Corporation filed Critical Panasonic Corporation
Publication of WO2008072653A1 publication Critical patent/WO2008072653A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00132Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00132Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
    • H04N1/00148Storage

Definitions

  • Portable terminal device and image selection method are Portable terminal device and image selection method
  • the present invention relates to a mobile terminal device having a communication function and an image selection method.
  • Some portable terminal devices such as digital cameras in recent years have a wireless communication function and can immediately send a photograph taken to an image server on the Internet. For example, when an attendee takes a photo with his / her camera or camera-equipped mobile phone terminal at an event such as a wedding ceremony, all the images are sent to the image server by sending the photograph taken by each participant to the image server. Management, and participants can share images via the image server
  • a digital camera in the vicinity is provided with means for acquiring a list of digital cameras, thumbnail lists, and image data that exist in the vicinity of the mobile terminal device.
  • a system has been proposed to select one of the images, obtain a thumbnail list, select a desired image from the thumbnail list, and download the image data! Reference 1).
  • Patent Document 1 Japanese Patent Application Laid-Open No. 2003-234987
  • Patent Document 2 Japanese Patent Application Laid-Open No. 2004-179920
  • Patent Document 2 also receives and records photos that are not required for broadcast communication, and if there are many recipients, the sender has a huge amount of computation and memory. Is required.
  • the present invention has been made in view of the above-described conventional circumstances, and it is an object to provide a mobile terminal device and an image selection method capable of easily sharing image data with other mobile terminal devices. Say it.
  • a mobile terminal device of the present invention includes an image receiving unit that receives image data from another mobile terminal device, image data received from another mobile terminal device, and image data stored in a storage unit. And image selecting means for storing the received image data in the storing means in accordance with a preset image selection criterion based on the comparison result of the image comparing means.
  • the invention's effect [0013] According to the present invention, if image selection criteria are set in advance, the received image data can be selectively stored according to the priority, so that the memory capacity can be used effectively. Therefore, it is possible to easily collect desired image data without performing complicated operations.
  • FIG. 1 is a block diagram showing a configuration of a mobile terminal device according to a first embodiment of the present invention.
  • FIG. 4 is a flowchart for explaining an operation procedure when registering an application management table by the mobile terminal device according to the first embodiment of the present invention.
  • FIG. 5 is a block diagram showing a configuration of a mobile terminal device according to a second embodiment of the present invention.
  • FIG. 6 is a flowchart for explaining an operation procedure when registering an application management table by the mobile terminal device according to the second embodiment of the present invention.
  • FIG. 7 is a block diagram showing a configuration of a mobile terminal device according to a third embodiment of the present invention.
  • FIG. 8 is a flowchart for explaining an operation procedure during a received image saving process by the mobile terminal device of the third embodiment of the present invention.
  • FIG. 9 is a block diagram showing a configuration of a mobile terminal device according to a fourth embodiment of the present invention.
  • FIG. 10 is an explanatory diagram when the image comparison means 120 is made to function as the subject number comparison means.
  • FIG. 11 is an explanatory diagram when the image comparison means 120 functions as a facial expression comparison means.
  • FIG. 12 is a schematic diagram for explaining the storage area of the storage means 105
  • FIG. 13 is a diagram for explaining the operation of the mobile terminal device according to the seventh embodiment of the present invention.
  • FIG. 1 is a block diagram showing the configuration of the mobile terminal device according to the first embodiment of the present invention.
  • a mobile terminal device 100 includes a communication means 101, an image transmission means 102, an imaging means 103, an image reception means 104, a storage means 105, an image selection means 106, a policy setting means 107, And a feature point comparison means 108.
  • the mobile terminal device (partner mobile terminal device) of the other party who wants to share the image data is connected by the communication means 101 and can communicate between the mobile terminal devices.
  • the image data includes data of the image itself and meta information which is an example of additional information of the image data.
  • the communication unit 101 transmits image data in response to an instruction from the image transmission unit 102. Also, the image data transmitted by the other mobile terminal device is automatically received and transferred to the image receiving means 104.
  • a wireless communication device capable of near field communication such as WLAN or Bluetooth is desirable, but a wired LAN or a mobile phone network may also be used.
  • the image transmission unit 102 converts the image data received from the imaging unit 103 into a format suitable for transmission, and transmits the image data to the counterpart mobile terminal device using the communication unit 101.
  • the transmission method at this time is peer-to-peer communication or broadcast communication, and is encrypted and transmitted as necessary. Details of the operation of transmitting image data will be described later.
  • the imaging unit 103 takes a picture according to a user instruction, and transfers the generated image data to the image transmission unit 102.
  • the image receiving unit 104 assigns an image ID that is unique within the mobile terminal device to the image data received via the communication unit 101, and the image selection unit 106 uses the image data and the image ID as an image record. Notify The image receiving means 104 discards the image record and the power to save the image record in the storage means 105 based on the determination of the image selection means 106.
  • the image selection unit 106 receives the received image record from the image reception unit 104 and passes it to the feature point comparison unit 108. Further, the image selection means 106 gives priority to the received image data in accordance with a policy (image selection criterion) preset in the policy setting means 107 based on the comparison result of the feature point comparison means 108 described later. Give a degree. Further, the image selection means 106 selectively stores the received image data in the storage means 105 according to the assigned priority. In the present embodiment, the case where the policy setting means 107 is set so that a photograph having a composition different from the photograph (image data) stored in the storage means 105 is newly stored in the storage means 105 will be described. To do.
  • the image selection means 106 uses the feature point comparison means 108 to search the storage means 105 for a photo having the same composition as the received image record (about the composition comparison method by the feature point comparison means 108) Will be described later). If there is a photograph with the same composition as a result of the search, the image selecting means 106 notifies the image receiving means 104 to discard the received image record. At this time, if there is sufficient free space in the storage means 105, the fact that it can be deleted may be stored in the image record and deleted when the free space is low.
  • the image selecting means 106 notifies the image receiving means 104 to save the received image record. Whether or not to delete an image record when a photo having the same composition exists is set in advance by the user using the policy setting means 107.
  • the feature point comparison unit 108 receives from the image selection unit 106 a set of received image records and image records to be compared.
  • the feature point comparison means 108 extracts and compares feature points from the image data of each image record using a feature point extraction algorithm to determine whether the composition is the same as the received image record, and the result is an image selection means. Inform 106.
  • meta information image data management
  • Information may be recorded together with the image record. In this case, it is not necessary to extract feature points again for the same image record, and the system speed can be increased.
  • the meta information includes information such as feature points and IDs acquired from images.
  • the storage unit 105 stores the image record according to an instruction from the image receiving unit 104. Further, the image record is read and deleted according to the instruction of the image selection means 106.
  • the policy setting means 107 preferentially saves photos with different compositions, preferentially saves non-backlit photos, preferentially saves photos with different shooting times, and shows a laughing face if the composition is the same.
  • the selection policy of the received image is set for the image selection means 106 by the user's selection. Details of the method for comparing the composition, back light intensity, facial expression of the subject, etc. will be described later.
  • FIG. 2 shows an example of selectable policies. A plurality of these policies may be selected at the same time. In addition, as shown in FIG. 3, it may be possible to select one from each of!; Furthermore, a policy may be set by user input.
  • FIG. 4 is a flowchart for explaining an operation procedure at the time of a received image storing process by the mobile terminal device according to the first embodiment of the present invention.
  • the image receiving means 104 When the image receiving means 104 receives the image data by the communication means 101 (S101), the image receiving means 104 notifies the image selecting means 106 as an image record with an image ID unique to the terminal (S102).
  • the image selection means 106 that has received the notification, when the policy setting means 107 has been set to prioritize photographs with different compositions (S103), stores the received image records from the storage means 105. Read one by one and notify the feature point comparison means 108 together with the received image record.
  • the feature point comparison means 108 extracts and compares feature points using the feature point extraction algorithm from the received image record and the image data of the received image record. It is determined whether or not, and the result is notified to the image selection means 106 (S104 S105).
  • the image selection means 106 displays the image reception means 10. 4 is notified to discard the received image record (S107). On the other hand, if there is no photo having the same composition, the image selection means 106 notifies the storage means 105 to save the received image record (S106).
  • the image receiving unit 104 Upon receiving the notification, the image receiving unit 104 stores the received image record in the storage unit 105 based on the notification from the image selection unit 106.
  • the mobile terminal device of the first exemplary embodiment of the present invention users who want to share an image upload the image to the server and download it to the other party. You can preferentially share photos with different compositions while concentrating on shooting events that do not require cumbersome tasks such as replacing memory cards, and at the same time save storage space.
  • FIG. 5 shows the configuration of the mobile terminal device according to the second embodiment of the present invention.
  • the image selection means 106 to which the processing content is added and the newly added facial expression comparison means 109 will be described.
  • Other configurations are the same as those described in the first embodiment, and thus description thereof is omitted.
  • the mobile terminal device includes the feature point extraction unit 108 as an image comparison unit.
  • the feature point comparison unit 1 In addition to 08, facial expression comparison means 109 is provided.
  • the expression comparison means 109 receives from the image selection means 106 a set of received image records and image records to be compared.
  • the facial expression comparison means 109 performs facial expression recognition of the image data from the image data of each image record by using a face recognition algorithm and a facial expression recognition algorithm (for example, the eyes are not closed, the face is smiling, or the face is smooth).
  • the image selection means 106 is notified of the result by determining which is the better facial expression.
  • the result of facial expression recognition may be recorded in the storage means 105 together with the image record as meta information. In this case, facial expressions are recognized again for the same image record. This eliminates the need for the system and speeds up the system.
  • the image selecting means 106 receives the received image record from the image receiving means 104 and uses the feature point comparing means 108 based on the setting by the policy setting means 107 to receive the received image from the storage means 105. Search for photos with the same composition as the record.
  • the image selection means 106 further uses the expression comparison means 109 to search for an image record having the most unfavorable expression. As a result of the search, when it is determined that the received image record is the most unfavorable facial expression, the image selection unit 106 notifies the image reception unit 104 to discard the received image record.
  • the image selection unit 106 deletes the corresponding image record from the storage unit 105 and stores the received image record in the image reception unit 104. Notify me. Similarly, even when there is no photo having the same composition, the image selection unit 106 notifies the image reception unit 104 to save the received image record.
  • the storage means 105 If there is sufficient free space in the storage means 105, it is stored as meta information in the image record that is most unfavorable at the present time, and the next time the image with the most unfavorable expression is retrieved. By comparing the received image record with priority, the number of comparisons may be omitted, and the speed may be increased.
  • FIG. 6 is a flowchart for explaining an operation procedure at the time of a received image storing process by the mobile terminal device according to the second embodiment of the present invention.
  • the image receiving means 104 gives an image ID unique to the terminal and notifies the image selection means 106 as an image record (S202).
  • the image selection means 106 that has received the notification sets the received image record from the storage means 105 when the policy setting means 107 has been set to give priority to the smiley face photo if the composition is the same (S203). One by one is read, and the feature point comparison means 108 is used to search for a photo having the same composition as the received image record (S204). [0049] If there is a photograph with the same composition, the facial expression comparison means 109 is further used to search for an image record having the most unfavorable facial expression (S205, S207). As a result of the search, if it is determined that the received image record is the most unfavorable facial expression, the image selection means 106 notifies the image reception means 104 to discard the received image record (S208, S210).
  • the image selection unit 106 deletes the corresponding image record from the storage unit 105 and stores the received image record in the image reception unit 104. (S209, S206).
  • the image selection unit 106 notifies the image reception unit 104 to save the received image record (S206).
  • the image receiving unit 104 stores the received image record in the storage unit 105 based on the notification from the image selection unit 106.
  • the mobile terminal device of the second exemplary embodiment of the present invention users who want to share an image upload the image to the server and download it to the other party. You can preferentially share photos with different compositions and expressions while concentrating on shooting events that do not require cumbersome tasks such as changing memory cards, and at the same time save storage space.
  • FIG. 7 shows the configuration of the mobile terminal device according to the third embodiment of the present invention.
  • the image selection means 106 to which the processing content has been added and the imaging time comparison means 110 and the backlight intensity comparison means 111 that have been newly added will be described. Since other configurations are the same as those described in the first embodiment, description thereof is omitted.
  • the mobile terminal device includes the feature point extraction unit 108 as an image comparison unit. However, in the mobile terminal device according to the third embodiment, as the image comparison unit.
  • the photographing time comparing means 110 and the backlight level comparing means 111 are provided.
  • the photographing time comparison unit 110 receives from the image selection unit 106 a set of received image records and image records to be compared.
  • the shooting time comparison means 110 receives and extracts the shooting time information from the meta information added to the image data of each image record. It is determined whether or not the photograph was taken at a time close to the image record, and the result is notified to the image selection means 106.
  • the backlight level comparison unit 111 receives the received image record and the set of image records to be compared from the image selection unit 106.
  • the backlight level comparison unit 111 calculates the backlight level of the image data of each image record, determines which is the image with less backlight, and notifies the image selection unit 106 of the result.
  • the result of calculating the degree of backlight may be recorded in the storage unit 105 as meta information together with the image record. In this case, it is not necessary to calculate the backlight level again for the same image record, and the system speed can be increased.
  • the image selection means 106 receives the received image record from the image reception means 104 and receives it from the storage means 105 using the shooting time comparison means 110 based on the setting by the policy setting means 107. Search for photos taken at a time close to the image record
  • the image selection means 106 further uses the backlight level comparison means 111 to select the image record with the highest backlight level. Search for. As a result of the search, when it is determined that the received image record has the highest backlight level, the image selection unit 106 notifies the image reception unit 104 to discard the received image record.
  • the image selection means 106 deletes the corresponding image record from the storage means 105, and stores the received image record in the image reception means 104. Notify you. Similarly, even when there is no photograph taken at a close time, the image selection unit 106 notifies the image reception unit 104 to save the received image record.
  • the storage means 105 If the storage means 105 has sufficient free space, it is stored as meta information in an image record with the highest degree of backlighting at the present time, and the next time the image with the highest degree of backlighting is searched. In addition, the number of comparisons may be omitted to increase the speed by preferentially comparing the received image records.
  • FIG. 8 is a flowchart for explaining an operation procedure at the time of a received image saving process by the mobile terminal device according to the third embodiment of the present invention.
  • the image receiving means 104 When the image receiving means 104 receives the image data by the communication means 101 (S301), the image receiving means 104 gives the image ID unique to the terminal and notifies the image selecting means 106 as an image record (S302).
  • the image selection means 106 that has received the notification sets the received image record when the policy setting means 107 is set to give priority to a photograph with little backlight if it was taken at a close time (S303). Are read one by one from the storage means 105, and the photograph taken at the time close to the received image record is searched using the photographing time comparison means 110 (S304).
  • the backlight level comparison means When there is a photograph taken at a close time, the backlight level comparison means
  • the image receiving means 104 is notified to discard the received image record (S308, S310).
  • the image selection unit 106 deletes the corresponding image record from the storage unit 105 and stores the received image record in the image reception unit 104. (S309, S306).
  • the image selection means 106 notifies the image receiving means 104 to save the received image record even if the photograph taken at close time does not exist (S3). 06).
  • the image receiving unit 104 stores the received image record in the storage unit 105 and the power to discard the received image record based on the notification from the image selecting unit 106.
  • FIG. 9 shows the configuration of the mobile terminal device according to the fourth embodiment of the present invention. Detailed description of the same configuration as that of the first embodiment is omitted.
  • the mobile terminal device 100 of the present embodiment includes an image receiving unit 104 that receives image data from another mobile terminal device, image data received from another mobile terminal device, image data stored in the storage unit 105, and And a function for assigning priority to received image data in accordance with a preset image selection criterion based on the comparison result of the image comparison means 120 and the image comparison means 120.
  • the image selection means 106 for selectively storing the received image data in the storage means 105, the policy setting means 107 for setting the image selection criteria by user selection, and the free space in the storage means 105 are detected.
  • Capacity detecting means 121 is an image receiving unit 104 that receives image data from another mobile terminal device, image data received from another mobile terminal device, image data stored in the storage unit 105, and And a function for assigning priority to received image data in accordance with a preset
  • the image selection unit 106 deletes the image data stored in the storage unit 105 according to the assigned priority. Further, the image selection means 106 selectively stores the received image data in the storage means 105 according to the free capacity detected by the capacity detection means 121, or the free capacity detected by the capacity detection means 121. In response, the image data stored in the storage means 105 is selectively deleted.
  • the image comparison unit 120 functions as a composition comparison unit, a facial expression comparison unit, a defocus degree comparison unit, a backlight level comparison unit, or a subject number comparison unit in accordance with the control of the image selection unit 106.
  • a known technique can be used as the processing of each comparison means.
  • the image comparison unit 120 divides the image data based on the edge information extracted based on the hue value and the luminance value, and compares the feature values based on the hue value and the luminance value for each divided region. . Further, the image comparison unit 120 extracts a feature amount from the key image, compares it with data in the feature amount table indicating edge information for all the search target images, and notifies the image selection unit 106 of an image having a high degree of similarity. To do.
  • composition comparison method a method for detecting feature points such as edges and corners and a method using a spatial distribution of colors are known (for example, http: ⁇ www.brl.ntt.co .jp / p eople / akisato / pdf / prmu20050o.pdf http: //vokoya.naist.ip/ posters / 199 8 / pdfs / hideno -y. See pdf).
  • FIG. 10 is an explanatory diagram in the case where the contour is extracted from the image and the number of subjects is extracted when the image comparison means 120 is made to function as the subject number comparison means.
  • the image comparison means 120 calculates the number of subjects by extracting the contour (FIG. 10 (b)) from the target image shown in FIG. 10 (a) and specifying the shape of the head relative to the shoulder and neck.
  • FIG. 11 is an explanatory diagram in a case where the image comparison unit 120 functions as a facial expression comparison unit.
  • the image comparison means 120 cuts out a face region (FIG. 11 (b)) from the target image shown in FIG. 11 (a), and estimates the facial expression of the person from the position information of eyes, nose and mouth.
  • facial expressions are assumed by detecting the degree of opening and bending of the contours of the parts that make up the face. For example, the strength of each facial expression is obtained based on a membership function with the feature value obtained by normalizing the open state between the contours of the eyes, nose and mouth and the curved state of each contour as a parameter.
  • the facial expression of the target image is estimated by obtaining the facial expression.
  • facial recognition methods using higher-order local autocorrelation (HLAC) methods and Fisherfaces / Fisherfaces methods are also known! /, Ru (for example, http: // www. isi. see .pdf).
  • HLAC local autocorrelation
  • a person extraction method can be used as a method for comparing the number of persons photographed in a photo and discriminating a group photo and a background photo.
  • a person extraction method the use of color information has been dissatisfied. ( ⁇ : http://www.nlab.sogol.ynu.ac.jp/ynu/r1 sa mples / no 1 4.html , JP 2005-222304 Koyuki “No-turn device” (Technology for learning skin color and hair color and improving the extraction accuracy of the skin area with a neural network using cupropropagation)).
  • FIG. 12 shows an outline of the storage area of the storage means 105.
  • the storage means 105 includes a first storage area 122 for storing image data captured by its own device, and a second storage for storing image data received from other portable terminal devices. It is divided into area 123.
  • FIG. 12 (b) shows a case where image data is stored in the storage area 124 together with the identification information of the photographed terminal device.
  • the storage unit 105 stores the image data captured by the image capturing unit 103 together with identification information (local device) indicating that the image is captured by the local terminal device, and adds the received image data to the received image data. It is stored together with identification information (other device X, other device Y) indicating the force that is an image taken by any terminal device.
  • the image that the user took is secured (not deleted), and is taken by another person, and the photograph desired by the user (not owned by the user).
  • the power S you can easily collect as many photos with good composition and quality as possible according to the available capacity.
  • a method of physically separating the storage areas may be used as a method of distinguishing between the image taken by oneself and the image taken by another person.
  • the image data may have an “attribute for identifying which camera the image was taken (own device, other device X, etc.)”. In the latter case, it is necessary to divide the area V, so the storage area can be used more effectively.
  • the mobile terminal device 100 of the present embodiment has capacity detection means 121 for detecting the free capacity of the storage means 105, and leaves high priority images according to the free capacity of the storage means 105. , Delete low priority images. The priority is given when the image receiving unit 104 receives an image.
  • the mobile terminal device 100 shown in FIG. 9 functions as the image data transmission side.
  • functions required when the mobile terminal device 100 functions as a transmission side will be described.
  • broadcast communication is performed between three or more mobile terminal devices. An example is shown.
  • the image comparison unit 120 compares the image data newly captured by the imaging unit 103 with the image data stored in the storage unit 105.
  • the image selection unit 106 has a function of giving priority to image data newly captured by the imaging unit 103 based on the comparison result of the image comparison unit 120 according to a preset image selection criterion.
  • the image data to be sent is selected according to the priority.
  • the image transmission unit 102 transmits image data to another mobile terminal device via the communication unit 101 based on the selection result of the image selection unit 106. Further, the image transmitting means 102 transmits the image data to be transmitted with the identification ID of its own device.
  • image data captured by the own device if image selection criteria are set in advance, image data captured by the own device according to priority. Since image data that would be desired by other portable terminal devices can be selected and transmitted, image data can be easily shared while suppressing the amount of transmission data. For example, a new photograph taken by the own device is a preferable photograph (less out of focus, composition is different, etc.) compared to a photograph previously taken by the own device or a photo received from another mobile terminal device. Since it can be transmitted only in such a case, it is possible to easily share preferable image data while suppressing the amount of transmission data.
  • the image comparison unit 120 may compare image data with reference to a device ID (identification information indicating a device that has captured the image data) given to the image data. For example, a comparison result that a new photograph taken by the image comparison unit 120 has a lower priority than a photograph taken by the own apparatus, but a higher priority than a photograph taken by another apparatus.
  • the image selection means 106 can select this photo as a transmission target.
  • Peer-to-peer communication may be performed between three or more portable terminal devices.
  • the amount of transmission data can be suppressed by determining which image data is transmitted to the other party using the identification ID assigned to each image data.
  • An example of determination using identification ID is shown below.
  • camera A sends image a taken with its own terminal to camera B
  • camera B sends received image a and image b taken with its own terminal to camera C
  • camera C power S Consider the case where the image a and the image b received from the camera B are stored in addition to the image c taken by the own terminal.
  • Camera C can collect the picture (image a) taken by camera A by receiving it from camera B, so there is no need to receive it from camera A.
  • camera C (having image a, image b, and image c) determines that the image to be transmitted to camera A is image b and image c using the identification ID assigned to the image.
  • Camera A can collect the picture (image b) taken by camera B by receiving it from camera c, eliminating the need to receive it from camera B.
  • an image captured by the own device is secured while the image taken by another person is taken, and a desired photograph (for example, the user owns the image). It is possible to easily collect as many photos as possible with no image composition and good image quality on the spot according to the available capacity.
  • a desired photograph for example, the user owns the image.
  • the transmitting-side portable terminal device has a function of assigning priority to image data, it is possible to more easily transfer images between terminal devices while suppressing the amount of transmission data. Share data.
  • the image pickup means 103 may collect only photographs taken by others that are not essential. Further, the policy in the policy setting unit 107 may be dynamically changed according to the free capacity of the storage unit 105.
  • a policy is set for the image data that the user wants to collect, it can be automatically selected and prioritized according to the policy and selectively received or deleted. In such events, many of the photos taken by other participants can be acquired on-the-fly as much as the digital camera's capacity allows for image data that they want later.
  • the image selecting unit 106 is the image receiving unit 104.
  • the priority is given to the received image data.
  • the image selection unit 106 uses the image data received by the image reception unit 104 and all or part of the image data stored in the storage unit 105 in advance. Priorities may be given to objects in accordance with the comparison results of image comparison means (such as feature point comparison means 108 and facial expression comparison means 109) and preset policies (image selection criteria). By giving priority to the image data stored in the storage means 105, it is possible to delete from the image data with low priority when the free space is low. Therefore, more images desired by the user can be collected.
  • the image comparison unit compares the composition of the photograph.
  • the meta information given to the image data may be compared.
  • attribute information given at the time of shooting or after shooting such as shooting time (see Fig. 2), focal length when shooting the subject, camera position force and subject distance to the subject, etc. Can be used.
  • information indicating the contents of photographing name of subject, photographing location, event name, etc.
  • a photographer's comment, etc. may be used as meta information.
  • a mobile terminal device 100 according to a sixth embodiment will be described.
  • the processing content in the image selection means 106 is added in order to select received photo records prior to comparison between photo records.
  • the configuration of the mobile terminal device 100 of this embodiment is the same as that of the first embodiment shown in FIG.
  • the image selection unit 106 is a policy selection unit.
  • the received photo records are saved by skipping the comparison between the photo records, or the received photo records are discarded prior to the comparison between the photo records.
  • the photo group ID stored as meta information of the received photo records is the same as the photo group ID set by the policy selection means 107. Or received image record if different Discard or save.
  • the photograph group ID is the photographer's identification information, participating event identification information, location identification information, group identification information to which the sender or receiver belongs, and a beacon installed at the venue or entrance of the venue.
  • Signal information transmitted from the terminal identification information acquired from a two-dimensional code such as a QR code (registered trademark), feature point information generated from a photograph taken once, and the like.
  • the mobile terminal device 100 of the present embodiment since the received photo records are selected prior to the comparison between the photo records, it is possible to limit the transmission destinations or to select the photo records to be stored in advance. The type can be limited.
  • the image selection means 106 has a case where the photo record to be compared is not stored in the receiving terminal, or a space for storing the received photo record is the receiving side. If it remains in the terminal storage, the comparison between the received photo record and the stored photo record is skipped, and the image is saved unconditionally or under the conditions of the policy setting means 107.
  • the comparison between the received photo record and the stored photo record is skipped, and the image is stored unconditionally or according to the conditions of the policy setting means 107. Therefore, you can limit the destinations and the types of photo records that you want to save in advance.
  • the mobile terminal device 100 when the mobile terminal device 100 according to the present embodiment is configured so that the received photo record can be retransmitted to another terminal, the copy number limit information recorded as the meta information of the image record is displayed as the image record. When the number of copies reaches the specified value when resending the image record to another terminal, the resending is stopped.
  • the mobile terminal device 100 of the present embodiment is also applicable to a sender side terminal or a receiver side terminal that does not have an imaging unit.
  • a sender side terminal or a receiver side terminal that does not have an imaging unit For example, it may be a receiver side terminal that does not have an imaging unit and performs only reception.
  • a sender-side terminal that does not have an imaging unit and transmits a photo record obtained by means other than imaging (a photo record stored in advance in a storage or a photo record obtained using a network). It may be.
  • information that can identify the photographer such as the photographer's signature and the URL of the Web page, is transmitted as the metadata of the photo record in the image to be transmitted. Techniques can be used.
  • the photographer can advertise his / her skill in photographing, guide the recipient of the photograph record to the company's web page, and use the photographer's identification information. Can be used to select photos.
  • Meta information such as feature points and smiles can be generated on the sending side and sent to the receiving side at the same time as sending the photo record or prior to sending the photo record.
  • the recipient compares the photo record stored in the image comparison means with the meta information of the received photo record.
  • the sender is requested to send the photo record.
  • FIG. 13 is a diagram for explaining the operation of the mobile terminal device 100 according to the seventh embodiment of the present invention.
  • the configuration of the mobile terminal device 100 is the same as that of the first embodiment shown in FIG.
  • the mobile terminal device 100 according to the present embodiment acquires an event ID from a two-dimensional code such as a QR code captured by the imaging unit 103, and assigns the event ID to the image data.
  • a two-dimensional code such as a QR code captured by the imaging unit 103
  • the image data can be easily shared with other portable terminal devices.
  • a QR code is prepared at an event venue such as a wedding hall or a concert hall. Then, as shown in FIG. 13 (a), each event participant takes a QR code with the mobile terminal device 100 and acquires an event ID. The QR code image may be discarded after the event ID is extracted from the QR code.
  • the mobile terminal device 100 on the transmission side adds the event ID to the captured image data and transmits it.
  • the mobile terminal device 100 on the receiving side for example, can set a policy of “collecting image data with a specific ID” and set a desired Only image data with event IDs can be collected (see Fig. 13 (d)).
  • the image data may be encrypted using the event ID obtained from the QR code as a key. According to this, only recipients with the same QR code (event ID) can decrypt, so the destination can be limited.
  • the network itself may be encrypted only by a person having the same QR code.
  • the event ID obtained from the QR code is used as a key of a wireless LAN SSID (Service Set Identifier), WEP (Wire Equivalent Privacy), WPA (W-Fi Protected Access), or the like. According to this, it is possible to limit transmission destinations that are not encrypted each time image data is transmitted.
  • the mobile terminal device 100 transmits a still image such as a photograph and shares the still image based on meta information or event ID given to the still image. It can also be applied when sharing moving images as well as still images. Although it takes a very long time to make a selection decision after playing a moving image, according to the present embodiment, it is possible to quickly select a necessary moving image according to a policy set by the user.
  • each functional block such as the image transmission unit 102, the image reception unit 104, the image selection unit 106, and the like is typically realized as an LSI that is an integrated circuit. These may be individually made into one chip, or may be made into one chip so as to include a part or all of them. Here, it is called IC, system LSI, super LSI, or ultra LSI due to the difference in power integration as LSI.
  • the method of circuit integration is not limited to LSI, but a dedicated circuit or general-purpose processor It may be realized with. You can use a field programmable gate array (FPGA) that can be programmed after manufacturing the LSI, or a reconfigurable processor that can reconfigure the connection and settings of the circuit cells inside the LSI.
  • FPGA field programmable gate array
  • the mobile terminal device of the present invention stores image data received from other mobile terminal devices, image data received from other mobile terminal devices, and storage means. Based on the comparison result of the image comparing means and the image comparing means, the received image data is stored in the storage means in accordance with a preset image selection criterion. Image selection means for storing.
  • the received image data can be stored according to the force priority set as the image selection criteria, so that the memory capacity can be used effectively. Therefore, it is possible to easily collect desired image data without performing complicated operations. For example, by automatically receiving photos taken by others, determining the photos that are preferred by the user, and preferentially saving them to a storage medium, even if the event is in progress, The user can easily collect desired photos on the spot while concentrating on events that do not require complicated operations. In addition, you can collect the photos you want while effectively using the memory capacity.
  • the image selection means is stored in the storage means according to a preset image selection criterion based on the comparison result of the image comparison means! / The image data is deleted.
  • the storage area can be saved by deleting the image data stored in the storage medium according to the priority according to the image selection criteria.
  • the image selection means has a function of assigning priority, and selectively stores the received image data according to the assigned priority.
  • the image data stored in the storage means, the image data stored in the storage means can be deleted, and the image data to be transmitted can be selected.
  • the mobile terminal device of the present invention includes policy setting means for setting the image selection criterion.
  • the mobile terminal device of the present invention includes capacity detection means for detecting the free capacity of the storage means, and the image selection means receives the received data according to the free capacity detected by the capacity detection means. Image data is stored in the storage means.
  • the mobile terminal device of the present invention includes capacity detection means for detecting a free capacity of the image storage means, and the image selection means performs the storage according to the free capacity detected by the capacity detection means.
  • the image data stored in the means is deleted.
  • the mobile terminal device of the present invention includes an imaging unit, and the storage unit stores a first storage area for storing image data captured by the device itself and an image received from another mobile terminal device. It is divided into a second storage area for storing image data!
  • the mobile terminal device of the present invention includes an imaging unit, and the storage unit is identification information indicating that the image data captured by the imaging unit is an image captured by the own terminal device. And the received image data is stored together with identification information indicating! /, Which is an image taken by a terminal device with a deviation, attached to the received image data.
  • the image comparison means adds the received image data. Additional information comparing means for comparing the additional information with the additional information of the image data stored in the storage means is provided.
  • the portable terminal device of the present invention skips comparison of image data by the image comparison means when the free space satisfies a predetermined condition.
  • the policy setting means can set a policy for skipping comparison of image data by the image comparison means, and the image selection means can be set according to the policy.
  • the image data received from the other portable terminal device is saved or discarded.
  • the policy setting means can set a predetermined group ID as the image selection criterion, and the image selection means receives from the other mobile terminal device Depending on whether or not the group ID assigned to the image data is the same as the group ID set in the policy setting means, the image data received from the other portable terminal device is saved or discarded.
  • the received image data is saved or discarded depending on whether or not the group ID assigned to the received image data is the same as the group ID set in the policy setting means. Therefore, it is easy to collect the desired image data without performing complicated operations.
  • the group ID includes photographer identification information, event identification information, location identification information, and group identification information to which a sender or receiver belongs.
  • Information signal information transmitted from a beacon installed at the venue, identification information obtained from a two-dimensional code, and feature point information generated from a photograph taken.
  • the image data received from another mobile terminal device can be automatically saved in the storage medium in accordance with the group ID. You can easily collect the desired image data on the spot while concentrating on events that do not require complicated operations.
  • the mobile terminal device of the present invention includes capacity detection means for detecting the free capacity of the storage means, and the image selection means is configured to detect the free capacity from the other mobile terminal device in response to the detection of the free capacity. Save the received image data.
  • the received image data can be stored unconditionally as long as the storage means has room, so that the memory capacity can be effectively utilized.
  • the user can easily collect desired image data while effectively utilizing the memory capacity without performing complicated operations.
  • the policy setting means can set an event ID as the image selection criterion, and the image selection means can receive an image received from the other mobile terminal device. Depending on whether the event ID assigned to the data is the same as the event ID set in the policy setting means, the image data received from the other mobile terminal device is saved or discarded.
  • the received image data is saved or discarded depending on whether or not the event ID assigned to the received image data is the same as the event ID set in the policy setting unit. Therefore, it is possible to easily collect desired image data without performing complicated operations.
  • the mobile terminal device of the present invention has imaging means for capturing an event ID by capturing a two-dimensional code, and the policy setting means uses the event ID acquired by the imaging means as the image. Set as selection criteria.
  • the mobile terminal device of the present invention is a mobile terminal device that transmits image data, Based on the comparison result of the imaging means, the image comparison means for comparing the newly captured image data with the image data stored in the storage means, and the comparison result of the image comparison means, Image selection means for selecting image data to be transmitted, and image transmission means for transmitting image data to another portable terminal device based on a selection result of the image selection means.
  • an image selection criterion is set in advance, among the image data captured by the own device in accordance with the image selection criterion, an image that may be desired by another mobile terminal device Since data can be selected and transmitted, image data can be easily shared while suppressing the amount of data to be transmitted. For example, when a new photo taken with your device is a better photo (less out of focus, composition is different, etc.) compared to a photo previously taken with your device or a photo received from another mobile terminal device Therefore, it is possible to easily share preferred image data while suppressing the amount of transmission data.
  • the imaging unit acquires the image data, and also captures an event ID by capturing a two-dimensional code
  • the image transmission unit adds the image data to the image data.
  • the event ID is given and transmitted.
  • the image data can be received only by the mobile terminal device having the same event ID, and the captured image data can be transmitted with peace of mind. That's the power S.
  • the image data is image data of a photograph taken by a camera
  • the image comparison unit includes a composition of the photograph, a facial expression of the subject, and a defocus of the photograph. Compare at least! /, The degree, the degree of backlighting of the photos, or the number of people in each photo.
  • any of the following can be realized.
  • photos with the same composition can be preferentially collected, and conversely, photos with different compositions can be preferentially collected.
  • it is possible to preferentially collect only photographs with more preferable facial expressions such as eyes that are not closed, a smile, or a smile), or preferentially collect photographs with unusual facial expressions.
  • only images with low backlighting and images are excellent. It can be collected first.
  • the image selection method of the present invention is an image selection method in a mobile terminal device, the step of receiving image data from another mobile terminal device, the image data received from another mobile terminal device, and Comparing the received image data according to a preset image selection criterion based on a comparison result of the image comparing means and a comparison result of the image comparing means stored in the storage means! Storing in the means.
  • the received image data can be stored according to the image selection criteria based on the comparison result of the image comparison means.
  • desired image data can be easily collected without complicated operations. For example, by automatically receiving photos taken by others, determining the photos that are preferred for the user, and preferentially saving them to a storage medium, the user will be able to use the event even when the event is in progress. It is possible to easily collect desired photos on the spot while concentrating on events without performing complicated operations. In addition, a desired photograph can be collected while effectively utilizing the memory capacity.
  • the image selection method of the present invention is an image selection method in a mobile terminal device, the step of receiving first image data, the first image data, and the received second image. Comparing the data and determining whether the composition is the same; if the first and second image data have the same composition, discard the first image; if not, the first composition Storing image data.
  • the facial expressions of the first and second images are extracted, and the extracted facial expressions are predetermined.
  • a step of determining whether or not the policy corresponds to a policy, and if the facial expression of the first image corresponds to a predetermined policy, the first image data is discarded, and the facial expression of the second image corresponds to the predetermined policy A step of discarding the second image data and storing the first image data.
  • the present invention is an image selection method in a mobile terminal device, the step of receiving first image data, and the first image data from the received image data at a time close to the first image data.
  • the degree is high
  • the first image data is discarded, and when the degree of backlighting of the second image data is high! /,
  • the second image data is discarded, and the first image data is discarded.
  • the image selection method of the present invention includes a step of selectively storing or deleting the first image data in accordance with a free space in an area for storing the image data.
  • the mobile terminal device of the present invention is a mobile terminal device that transmits image data, and compares the imaging means, the newly captured image data, and the image data stored in the storage means. Based on a comparison result between the image comparison unit and the image comparison unit, a priority is given to the newly captured image data in accordance with a preset image selection criterion.
  • An image selection unit that selects image data to be transmitted according to the assigned priority, and transmits the image data to another mobile terminal device based on a selection result of the image selection unit.
  • Image transmission means is a mobile terminal device that transmits image data, and compares the imaging means, the newly captured image data, and the image data stored in the storage means. Based on a comparison result between the image comparison unit and the image comparison unit, a priority is given to the newly captured image data in accordance with a preset image selection criterion.
  • An image selection unit that selects image data to be transmitted according to the assigned priority, and transmits the image data to another mobile terminal device based on a selection result of the image
  • the image data captured by the own device may be desired by another mobile terminal device according to the priority according to the image selection criterion. Since it is possible to select and transmit image data, it is possible to easily share image data while suppressing the amount of transmission data. For example, a new photo taken by the device is a preferable photo (less out of focus, composition is different, etc.) compared to a photo previously taken by the device or a photo received from another mobile terminal device. Only in this case, the transmission power S can be reduced. Therefore, it is possible to easily share preferable image data while suppressing the amount of transmission data.
  • the received image data can be selectively stored according to the priority, so that the memory capacity can be effectively utilized. Therefore, it has an effect of easily collecting desired image data without performing complicated operations, and is useful for a portable terminal device having a communication function, an image selection method, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Telephone Function (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

Provided are a mobile terminal device capable of sharing image data easily with another mobile terminal device, and an image selecting method. Image receiving means (104) notifies image selecting means (106) of the image data received through communication means (101), as an image record. On the basis of the decision of the image selecting means (106), the image receiving means (104) either stores the image record in storage means (105) or scraps the image record. The image selecting means (106) accepts the received image record from the image receiving means (104), and retrieves a photograph having the same composition as that of the received image record, from the storage means (105) by using featuring point comparing means (108), on the basis of the setting by policy setting means (107).

Description

明 細 書  Specification
携帯端末装置および画像選択方法  Portable terminal device and image selection method
技術分野  Technical field
[0001] 本発明は、通信機能を備える携帯端末装置および画像選択方法に関する。  The present invention relates to a mobile terminal device having a communication function and an image selection method.
背景技術  Background art
[0002] 近年のデジタルカメラ等の携帯端末装置には、無線通信機能を持ち、撮影した写 真を即座にインターネット上の画像サーバに送信できるものがある。例えば、結婚式 などのイベントで、参加者が各自のカメラやカメラ付携帯電話端末で写真をとる場合 に、各参加者が撮影した写真を画像サーバに送信することにより、画像サーバで全 画像の管理が可能となり、参加者は、画像サーバを介して画像を共有することができ  [0002] Some portable terminal devices such as digital cameras in recent years have a wireless communication function and can immediately send a photograph taken to an image server on the Internet. For example, when an attendee takes a photo with his / her camera or camera-equipped mobile phone terminal at an event such as a wedding ceremony, all the images are sent to the image server by sending the photograph taken by each participant to the image server. Management, and participants can share images via the image server
[0003] しかし、上記技術を使用して各参加者が写真を収集するためには、各端末におい て、画像サーバのアドレスを取得すること、および、画像サーバにアクセス可能な環 境が必要となる。 [0003] However, in order for each participant to collect photographs using the above-described technology, it is necessary for each terminal to acquire the address of the image server and to have an environment in which the image server can be accessed. Become.
[0004] これに対し、画像サーバを経由することなぐその場で携帯端末装置同士で直接写 真の送受信が出来れば、インターネット等の環境が必要がない上、画像サーバのァ ドレスを教えあうなどの手間が省けるため、より手軽に画像データの共有を行うことが でき、便利である。  [0004] On the other hand, if it is possible to directly send and receive photos between mobile terminal devices on the spot without going through the image server, the environment such as the Internet is not necessary, and the address of the image server is taught. This saves the time and effort of sharing image data more conveniently.
[0005] この種の、複数のカメラ間で直接画像を送受信する技術として、携帯端末装置に近 傍に存在するデジタルカメラの一覧、サムネイル一覧、画像データを取得する手段を 設け、近傍のデジタルカメラのうちの 1台を選択して、サムネイル一覧を取得し、サム ネイル一覧の中から所望の画像を選択して、画像データのダウンロードを行うシステ ムが提案されて!/、る (例えば、特許文献 1参照)。  [0005] As a technology for directly transmitting and receiving images between a plurality of cameras of this type, a digital camera in the vicinity is provided with means for acquiring a list of digital cameras, thumbnail lists, and image data that exist in the vicinity of the mobile terminal device. A system has been proposed to select one of the images, obtain a thumbnail list, select a desired image from the thumbnail list, and download the image data! Reference 1).
[0006] また、パーティ会場やイベント会場などのある範囲内にいるお客がそれぞれ撮影し た画像を共有するために、受信者側カメラが、あらかじめ近傍のカメラに写真データ 取得条件を送信しておき、送信者側のカメラで条件に一致する写真データのみ、受 信者側に送付することが提案されている(例えば、特許文献 2参照)。 [0007] 特許文献 1 :特開 2003— 234987号公報 [0006] In addition, in order to share images taken by customers in a certain area such as a party venue or an event venue, the receiver-side camera sends a photo data acquisition condition to a nearby camera in advance. It has been proposed to send only photo data that matches the conditions with the camera on the sender side to the receiver side (see, for example, Patent Document 2). [0007] Patent Document 1: Japanese Patent Application Laid-Open No. 2003-234987
特許文献 2:特開 2004— 179920号公報  Patent Document 2: Japanese Patent Application Laid-Open No. 2004-179920
発明の開示  Disclosure of the invention
発明が解決しょうとする課題  Problems to be solved by the invention
[0008] しかしながら、特許文献 1に記載された方法で写真を共有しょうとすると、写真の取 得を所望するユーザは、大量の画像データの中から所望する写真を選択しなければ ならず、煩雑である。 [0008] However, if a photograph is to be shared by the method described in Patent Document 1, a user who wants to obtain a photograph must select the desired photograph from a large amount of image data, which is complicated. It is.
[0009] 特に、イベントが進行して!/、るその場で写真を共有した!/、場合に、特許文献 1に記 載された技術を適用しょうとすると、サムネイル一覧を取得する動作、およびサムネィ ルー覧を見て所望の画像を選択してダウンロードする動作をユーザが行う必要があ るため、ユーザはイベントに集中できなくなるおそれがある。また、ユーザが自ら撮影 を行って!/、る状況にお!/、ては、特許文献 1に記載された方法で他者が撮影した写真 を取得しょうとするのはさらに困難である。したがって、特許文献 1に記載された技術 は、イベントが進行して!/、るその場で写真を共有した!/、場合には適用できなレ、。  [0009] In particular, when an event is progressing! /, A photo is shared on the spot! /, And if the technique described in Patent Document 1 is applied, an operation for obtaining a thumbnail list, and Since the user needs to perform an operation of selecting and downloading a desired image by looking at the thumbnail view, the user may not be able to concentrate on the event. In addition, it is even more difficult for a user to take a picture by himself / herself! // and to obtain a picture taken by another person by the method described in Patent Document 1. Therefore, the technology described in Patent Document 1 is not applicable in the event that an event has progressed!
[0010] また、特許文献 2に記載された方法では、同報通信した場合に必要のない写真も 受信して記録してしまうほか、受信者側が多いと送信者側は膨大な計算量やメモリを 必要とする。  [0010] In addition, the method described in Patent Document 2 also receives and records photos that are not required for broadcast communication, and if there are many recipients, the sender has a huge amount of computation and memory. Is required.
[0011] 本発明は、上記従来の事情に鑑みてなされたものであって、他の携帯端末装置と 手軽に画像データを共有することができる携帯端末装置および画像選択方法を提供 することを目白勺とする。  [0011] The present invention has been made in view of the above-described conventional circumstances, and it is an object to provide a mobile terminal device and an image selection method capable of easily sharing image data with other mobile terminal devices. Say it.
課題を解決するための手段  Means for solving the problem
[0012] 本発明の携帯端末装置は、他の携帯端末装置から画像データを受信する画像受 信手段と、他の携帯端末装置から受信した画像データと、記憶手段に記憶されてい る画像データとを比較する画像比較手段と、前記画像比較手段の比較結果に基づ いて、予め設定した画像選択基準にしたがって、前記受信した画像データを前記記 憶手段に記憶させる画像選択手段と、を備える。  [0012] A mobile terminal device of the present invention includes an image receiving unit that receives image data from another mobile terminal device, image data received from another mobile terminal device, and image data stored in a storage unit. And image selecting means for storing the received image data in the storing means in accordance with a preset image selection criterion based on the comparison result of the image comparing means.
発明の効果 [0013] 本発明によれば、予め画像選択基準を設定しておけば、受信した画像データを、 優先度に応じて選択的に記憶させることができるため、メモリ容量を有効活用するとと もに、煩雑な操作を行うことなぐ所望の画像データを手軽に収集することができる。 図面の簡単な説明 The invention's effect [0013] According to the present invention, if image selection criteria are set in advance, the received image data can be selectively stored according to the priority, so that the memory capacity can be used effectively. Therefore, it is possible to easily collect desired image data without performing complicated operations. Brief Description of Drawings
[0014] [図 1]本発明の第 1の実施形態の携帯端末装置の構成を示すブロック図  FIG. 1 is a block diagram showing a configuration of a mobile terminal device according to a first embodiment of the present invention.
[図 2]ポリシ選択手段によって、選択可能なポリシの一例(1)  [Figure 2] Examples of policies that can be selected by policy selection means (1)
[図 3]ポリシ選択手段によって、選択可能なポリシの一例(2)  [Figure 3] Examples of policies that can be selected by policy selection means (2)
[図 4]本発明の第 1の実施形態の携帯端末装置によるアプリ管理テーブル登録時の 動作手順を説明するためのフローチャート  FIG. 4 is a flowchart for explaining an operation procedure when registering an application management table by the mobile terminal device according to the first embodiment of the present invention.
[図 5]本発明の第 2の実施形態の携帯端末装置の構成を示すブロック図  FIG. 5 is a block diagram showing a configuration of a mobile terminal device according to a second embodiment of the present invention.
[図 6]本発明の第 2の実施形態の携帯端末装置によるアプリ管理テーブル登録時の 動作手順を説明するためのフローチャート  FIG. 6 is a flowchart for explaining an operation procedure when registering an application management table by the mobile terminal device according to the second embodiment of the present invention.
[図 7]本発明の第 3の実施形態の携帯端末装置の構成を示すブロック図  FIG. 7 is a block diagram showing a configuration of a mobile terminal device according to a third embodiment of the present invention.
[図 8]本発明の第 3の実施形態の携帯端末装置による受信画像保存処理時の動作 手順を説明するためのフローチャート  FIG. 8 is a flowchart for explaining an operation procedure during a received image saving process by the mobile terminal device of the third embodiment of the present invention.
[図 9]本発明の第 4の実施形態の携帯端末装置の構成を示すブロック図  FIG. 9 is a block diagram showing a configuration of a mobile terminal device according to a fourth embodiment of the present invention.
[図 10]画像比較手段 120を被写体人数比較手段として機能させる場合の説明図 FIG. 10 is an explanatory diagram when the image comparison means 120 is made to function as the subject number comparison means.
[図 11]画像比較手段 120を表情比較手段として機能させる場合の説明図 FIG. 11 is an explanatory diagram when the image comparison means 120 functions as a facial expression comparison means.
[図 12]記憶手段 105の記憶領域を説明するための概要図  FIG. 12 is a schematic diagram for explaining the storage area of the storage means 105
[図 13]本発明の第 7の実施形態の携帯端末装置の動作を説明するための図  FIG. 13 is a diagram for explaining the operation of the mobile terminal device according to the seventh embodiment of the present invention.
符号の説明  Explanation of symbols
[0015] 100 携帯端末装置 [0015] 100 mobile terminal device
101 通信手段  101 Communication means
102 画像送信手段  102 Image transmission means
103 撮像手段  103 Imaging means
104 画像受信手段  104 Image receiving means
105 記憶手段  105 Storage means
106 画像選択手段 107 ポリシ選択手段 106 Image selection means 107 Policy selection means
108 特徴点比較手段  108 Feature point comparison means
109 表情比較手段  109 facial expression comparison means
110 撮影時間比較手段  110 Shooting time comparison means
111 逆光度合い比較手段  111 Backlight comparison means
120 画像比較手段  120 Image comparison means
121 容量検出手段  121 Capacity detection means
122, 123, 124 記憶領域  122, 123, 124 storage area
発明を実施するための最良の形態  BEST MODE FOR CARRYING OUT THE INVENTION
[0016] 以下、本発明の携帯端末装置の実施形態について、図面を用いて説明する。  Hereinafter, embodiments of the mobile terminal device of the present invention will be described with reference to the drawings.
[0017] (第 1の実施形態)  [0017] (First embodiment)
図 1は、本発明の第 1の実施形態の携帯端末装置の構成を示すブロック図である。 図 1において、携帯端末装置 100は、通信手段 101と、画像送信手段 102と、撮像 手段 103と、画像受信手段 104と、記憶手段 105と、画像選択手段 106と、ポリシ設 定手段 107と、特徴点比較手段 108と、を有する構成である。また、画像データを共 有したい相手の携帯端末装置 (相手側携帯端末装置)とは、通信手段 101により接 続され、携帯端末装置間で通信可能になっている。なお、画像データは、画像その もののデータと画像データの付加情報の一例であるメタ情報とを含むものである。  FIG. 1 is a block diagram showing the configuration of the mobile terminal device according to the first embodiment of the present invention. In FIG. 1, a mobile terminal device 100 includes a communication means 101, an image transmission means 102, an imaging means 103, an image reception means 104, a storage means 105, an image selection means 106, a policy setting means 107, And a feature point comparison means 108. In addition, the mobile terminal device (partner mobile terminal device) of the other party who wants to share the image data is connected by the communication means 101 and can communicate between the mobile terminal devices. The image data includes data of the image itself and meta information which is an example of additional information of the image data.
[0018] 通信手段 101は、画像送信手段 102の指示で、画像データの送信を行う。また、相 手の携帯端末装置が送信した画像データを自動的に受信し、画像受信手段 104に 転送する。具体的には、 WLANや Bluetooth等の近傍通信可能な無線通信デバイ スであることが望ましいが、有線 LANや携帯電話網等であってもよい。  The communication unit 101 transmits image data in response to an instruction from the image transmission unit 102. Also, the image data transmitted by the other mobile terminal device is automatically received and transferred to the image receiving means 104. Specifically, a wireless communication device capable of near field communication such as WLAN or Bluetooth is desirable, but a wired LAN or a mobile phone network may also be used.
[0019] 画像送信手段 102は、撮像手段 103から受け取った画像データを、送信に適した フォーマットに変換し、通信手段 101を用いて、相手側携帯端末装置に送信する。こ の際の送信方法は、ピアツーピア通信、もしくは、同報通信で行われ、必要に応じて 暗号化されて送信される。画像データを送信する動作の詳細については後述する。  The image transmission unit 102 converts the image data received from the imaging unit 103 into a format suitable for transmission, and transmits the image data to the counterpart mobile terminal device using the communication unit 101. The transmission method at this time is peer-to-peer communication or broadcast communication, and is encrypted and transmitted as necessary. Details of the operation of transmitting image data will be described later.
[0020] 撮像手段 103は、ユーザの指示によって写真撮影を行い、生成された画像データ を画像送信手段 102に転送する。 [0021] 画像受信手段 104は、通信手段 101を経由して受信した画像データに、携帯端末 装置内で一意となる画像 IDをふり、画像データおよび画像 IDを、画像レコードとして 、画像選択手段 106に通知する。画像受信手段 104は、画像選択手段 106の判定 に基づいて、記憶手段 105に画像レコードを保存する力、、画像レコードを破棄する。 The imaging unit 103 takes a picture according to a user instruction, and transfers the generated image data to the image transmission unit 102. The image receiving unit 104 assigns an image ID that is unique within the mobile terminal device to the image data received via the communication unit 101, and the image selection unit 106 uses the image data and the image ID as an image record. Notify The image receiving means 104 discards the image record and the power to save the image record in the storage means 105 based on the determination of the image selection means 106.
[0022] 画像選択手段 106は、画像受信手段 104から、受信した画像レコードを受け取り、 特徴点比較手段 108に渡す。また、画像選択手段 106は、後述する特徴点比較手 段 108の比較結果に基づいて、前記受信した画像データに、ポリシ設定手段 107に おいて予め設定されたポリシ(画像選択基準)にしたがって優先度を付与する。さら に、画像選択手段 106は、付与された優先度に応じて、選択的に、前記受信した画 像データを記憶手段 105に記憶させる。本実施形態においては、ポリシ設定手段 10 7において、記憶手段 105に記憶されている写真(画像データ)と異なる構図の写真 を、新たに記憶手段 105に記憶させる、と設定されている場合について説明する。  The image selection unit 106 receives the received image record from the image reception unit 104 and passes it to the feature point comparison unit 108. Further, the image selection means 106 gives priority to the received image data in accordance with a policy (image selection criterion) preset in the policy setting means 107 based on the comparison result of the feature point comparison means 108 described later. Give a degree. Further, the image selection means 106 selectively stores the received image data in the storage means 105 according to the assigned priority. In the present embodiment, the case where the policy setting means 107 is set so that a photograph having a composition different from the photograph (image data) stored in the storage means 105 is newly stored in the storage means 105 will be described. To do.
[0023] 画像選択手段 106は、特徴点比較手段 108を用いて、記憶手段 105の中から、受 信した画像レコードと同じ構図の写真を検索する(特徴点比較手段 108による構図 比較の手法については、後述する。)。検索した結果、同じ構図の写真が存在した場 合には、画像選択手段 106は、受信した画像レコードを破棄するよう画像受信手段 1 04に通知する。その際、記憶手段 105に十分空き容量がある場合には、削除可能で あることを画像レコードに記憶しておき、空き容量が少なくなつたタイミングで消去す るようになっていても良い。  The image selection means 106 uses the feature point comparison means 108 to search the storage means 105 for a photo having the same composition as the received image record (about the composition comparison method by the feature point comparison means 108) Will be described later). If there is a photograph with the same composition as a result of the search, the image selecting means 106 notifies the image receiving means 104 to discard the received image record. At this time, if there is sufficient free space in the storage means 105, the fact that it can be deleted may be stored in the image record and deleted when the free space is low.
[0024] 一方、同じ構図の写真が存在しな力、つた場合には、画像選択手段 106は、画像受 信手段 104に、受信した画像レコードを保存するよう通知する。なお、同じ構図の写 真が存在した場合に画像レコードを削除するかどうかは、ポリシ設定手段 107を用い て、ユーザによってあらかじめ設定される。  [0024] On the other hand, if the photo with the same composition does not exist, the image selecting means 106 notifies the image receiving means 104 to save the received image record. Whether or not to delete an image record when a photo having the same composition exists is set in advance by the user using the policy setting means 107.
[0025] 特徴点比較手段 108は、画像選択手段 106から、受信した画像レコードと、比較し たい画像レコードの組を受け取る。特徴点比較手段 108は、各画像レコードの画像 データから、特徴点抽出アルゴリズムを用いて特徴点を抽出、比較することで、受信 した画像レコードと同じ構図であるか判断し、結果を画像選択手段 106に通知する。  The feature point comparison unit 108 receives from the image selection unit 106 a set of received image records and image records to be compared. The feature point comparison means 108 extracts and compares feature points from the image data of each image record using a feature point extraction algorithm to determine whether the composition is the same as the received image record, and the result is an image selection means. Inform 106.
[0026] なお、特徴点を抽出した結果は、記憶手段 105に、メタ情報 (画像データを管理す るための情報)として画像レコードとともに記録しておいてもよい。この場合、同じ画像 レコードに対して再度特徴点を抽出する必要がなくなり、システムの高速化が図れる 。なお、メタ情報は、画像から取得した特徴点、 ID等の情報も含むものである。 It should be noted that the result of extracting the feature points is stored in the storage means 105 as meta information (image data management). Information) may be recorded together with the image record. In this case, it is not necessary to extract feature points again for the same image record, and the system speed can be increased. The meta information includes information such as feature points and IDs acquired from images.
[0027] 記憶手段 105は、画像受信手段 104の指示によって、画像レコードを保存する。ま た、画像選択手段 106の指示によって、画像レコードの読み出し、削除を行う。  The storage unit 105 stores the image record according to an instruction from the image receiving unit 104. Further, the image record is read and deleted according to the instruction of the image selection means 106.
[0028] ポリシ設定手段 107は、構図の異なる写真を優先して保存する、逆光でない写真を 優先して保存する、撮影時間の異なる写真を優先して保存する、構図が同じなら笑 顔の写っている写真を優先して保存するといつた、受信画像の選択ポリシを、ユーザ の選択により、画像選択手段 106に対して設定する。なお、写真の構図や逆光度合 い、被写体の表情等を比較する手法の詳細につ!、ては後述する。  [0028] The policy setting means 107 preferentially saves photos with different compositions, preferentially saves non-backlit photos, preferentially saves photos with different shooting times, and shows a laughing face if the composition is the same. When the selected photograph is preferentially stored, the selection policy of the received image is set for the image selection means 106 by the user's selection. Details of the method for comparing the composition, back light intensity, facial expression of the subject, etc. will be described later.
[0029] 図 2に、選択可能なポリシの一例を示す。これらのポリシは、複数同時に選択できる ようになつていても良い。また、図 3のように、;!〜 3の各選択肢の中から、 1つずつ選 択できるようになつていても良い。さらに、ユーザ入力によってポリシを設定してもよい  [0029] FIG. 2 shows an example of selectable policies. A plurality of these policies may be selected at the same time. In addition, as shown in FIG. 3, it may be possible to select one from each of!; Furthermore, a policy may be set by user input.
[0030] 次に、以上のように構成された本実施形態の携帯端末装置の動作について、フロ チャートを用いて説明する。図 4は、本発明の第 1の実施形態の携帯端末装置に よる受信画像保存処理時の動作手順を説明するためのフローチャートである。 Next, the operation of the mobile terminal device of the present embodiment configured as described above will be described using a flowchart. FIG. 4 is a flowchart for explaining an operation procedure at the time of a received image storing process by the mobile terminal device according to the first embodiment of the present invention.
[0031] 画像受信手段 104は、通信手段 101によって画像データを受信すると(S101)、端 末固有の画像 IDをふり、画像レコードとして、画像選択手段 106に通知する(S 102)  [0031] When the image receiving means 104 receives the image data by the communication means 101 (S101), the image receiving means 104 notifies the image selecting means 106 as an image record with an image ID unique to the terminal (S102).
[0032] 通知を受けた画像選択手段 106は、ポリシ設定手段 107によって、異なる構図の写 真を優先するよう設定されていた場合に(S 103)、受信済み画像レコードを、記憶手 段 105から 1つずつ読み出し、受信した画像レコードとともに、特徴点比較手段 108 に通知する。 [0032] The image selection means 106 that has received the notification, when the policy setting means 107 has been set to prioritize photographs with different compositions (S103), stores the received image records from the storage means 105. Read one by one and notify the feature point comparison means 108 together with the received image record.
[0033] 特徴点比較手段 108は、受信した画像レコードと、受信済み画像レコードの画像デ ータから、特徴点抽出アルゴリズムを用いて特徴点を抽出、比較することで、同じ構 図の写真かどうか判定し、結果を画像選択手段 106に通知する(S 104 S105)。  [0033] The feature point comparison means 108 extracts and compares feature points using the feature point extraction algorithm from the received image record and the image data of the received image record. It is determined whether or not, and the result is notified to the image selection means 106 (S104 S105).
[0034] 同じ構図の写真が見つかった場合には、画像選択手段 106は、画像受信手段 10 4に対して、受信した画像レコードを破棄するよう通知する(S107)。一方、画像選択 手段 106は、同じ構図の写真が存在しなかった場合には、受信した画像レコードを、 記憶手段 105に保存するよう通知する(S 106)。 When a photo having the same composition is found, the image selection means 106 displays the image reception means 10. 4 is notified to discard the received image record (S107). On the other hand, if there is no photo having the same composition, the image selection means 106 notifies the storage means 105 to save the received image record (S106).
[0035] 通知を受けた画像受信手段 104は、画像選択手段 106からの通知に基づき、受信 した画像レコードの破棄をする力、、記憶手段 105に受信した画像レコードを記憶する Upon receiving the notification, the image receiving unit 104 stores the received image record in the storage unit 105 based on the notification from the image selection unit 106.
[0036] 以上で説明したように、本発明の第 1の実施形態の携帯端末装置によれば、画像 を共有したいと思うユーザ同士が、画像をサーバへアップロードして相手にダウン口 ードさせたり、メモリーカードの交換などの煩わしい作業をすることなぐイベント等の 撮影に集中したまま、異なる構図の写真を優先的に共有でき、同時に記憶域の節約 を行うことが出来る。 [0036] As described above, according to the mobile terminal device of the first exemplary embodiment of the present invention, users who want to share an image upload the image to the server and download it to the other party. You can preferentially share photos with different compositions while concentrating on shooting events that do not require cumbersome tasks such as replacing memory cards, and at the same time save storage space.
[0037] (第 2の実施形態)  [0037] (Second Embodiment)
図 5に、本発明の第 2の実施形態の携帯端末装置の構成を示す。処理内容が追加 された画像選択手段 106と、新たに追加された、表情比較手段 109について説明す る。その他の構成は、第 1の実施形態で説明した通りであるため、説明を省略する。  FIG. 5 shows the configuration of the mobile terminal device according to the second embodiment of the present invention. The image selection means 106 to which the processing content is added and the newly added facial expression comparison means 109 will be described. Other configurations are the same as those described in the first embodiment, and thus description thereof is omitted.
[0038] 本発明の第 1の実施形態の携帯端末装置は、画像比較手段として特徴点抽出手 段 108を具備していたが、第 2の実施形態の携帯端末装置では、特徴点比較手段 1 08のほかに、表情比較手段 109が備わっている。  The mobile terminal device according to the first embodiment of the present invention includes the feature point extraction unit 108 as an image comparison unit. However, in the mobile terminal device according to the second embodiment, the feature point comparison unit 1 In addition to 08, facial expression comparison means 109 is provided.
[0039] 表情比較手段 109は、画像選択手段 106から、受信した画像レコードと、比較した い画像レコードの組を受け取る。表情比較手段 109は、各画像レコードの画像デー タから、顔認識アルゴリズム、ならびに、表情認識アルゴリズムによって、画像データ の表情認識(たとえば、 目をつむっていない、笑顔である、すましている等)を行い、 どちらがよりよい表情であるか判断し、結果を画像選択手段 106に通知する。  The expression comparison means 109 receives from the image selection means 106 a set of received image records and image records to be compared. The facial expression comparison means 109 performs facial expression recognition of the image data from the image data of each image record by using a face recognition algorithm and a facial expression recognition algorithm (for example, the eyes are not closed, the face is smiling, or the face is smooth). The image selection means 106 is notified of the result by determining which is the better facial expression.
[0040] なお、どのような表情をよりよいと判断するかは、ポリシ設定手段 107による設定に 基づくが、笑顔である画像データが笑顔でない画像データに優先されるなど、あらか じめ決められた判断基準に従うようにしてもよい。  [0040] It should be noted that what expression should be determined is based on the setting by policy setting means 107, but is determined in advance, for example, image data with a smile is given priority over image data with no smile. You may be made to follow the judged criteria.
[0041] なお、表情認識を行った結果は、記憶手段 105に、メタ情報として画像レコードとと もに記録しておいてもよい。この場合、同じ画像レコードに対して再度表情認識する 必要がなくなり、システムの高速化が図れる。 [0041] Note that the result of facial expression recognition may be recorded in the storage means 105 together with the image record as meta information. In this case, facial expressions are recognized again for the same image record. This eliminates the need for the system and speeds up the system.
[0042] 画像選択手段 106は、画像受信手段 104から、受信した画像レコードを受け取り、 ポリシ設定手段 107による設定に基づき、特徴点比較手段 108を用いて、記憶手段 105の中から、受信した画像レコードと同じ構図の写真を検索する。  The image selecting means 106 receives the received image record from the image receiving means 104 and uses the feature point comparing means 108 based on the setting by the policy setting means 107 to receive the received image from the storage means 105. Search for photos with the same composition as the record.
[0043] 検索した結果、同じ構図の写真が存在した場合には、画像選択手段 106は、さらに 表情比較手段 109を用い、その中で、もっとも好ましくない表情の画像レコードを検 索する。検索した結果、受信した画像レコードがもっとも好ましくない表情と判定され た場合には、画像選択手段 106は、受信した画像レコードを破棄するよう画像受信 手段 104に通知する。  If there is a photograph having the same composition as a result of the search, the image selection means 106 further uses the expression comparison means 109 to search for an image record having the most unfavorable expression. As a result of the search, when it is determined that the received image record is the most unfavorable facial expression, the image selection unit 106 notifies the image reception unit 104 to discard the received image record.
[0044] 一方、もっとも好ましくない表情の画像が受信済み画像レコードである場合、画像 選択手段 106は、該当画像レコードを記憶手段 105から削除し、画像受信手段 104 に、受信した画像レコードを保存するよう通知する。同様に、同じ構図の写真が存在 しなかった場合にも、画像選択手段 106は、画像受信手段 104に、受信した画像レ コードを保存するよう通知する。  On the other hand, when the most unfavorable facial expression image is the received image record, the image selection unit 106 deletes the corresponding image record from the storage unit 105 and stores the received image record in the image reception unit 104. Notify me. Similarly, even when there is no photo having the same composition, the image selection unit 106 notifies the image reception unit 104 to save the received image record.
[0045] なお、記憶手段 105に十分空き容量がある場合には、現時点でもっとも表情の好ま しくない画像レコードにメタ情報として記憶しておき、次回、もっとも好ましくない表情 の画像を検索する際に、受信した画像レコードと優先的に比較することで、比較回数 を省き、高速化を図るようにしてもよい。  [0045] If there is sufficient free space in the storage means 105, it is stored as meta information in the image record that is most unfavorable at the present time, and the next time the image with the most unfavorable expression is retrieved. By comparing the received image record with priority, the number of comparisons may be omitted, and the speed may be increased.
[0046] 次に、以上のように構成された本実施形態の携帯端末装置の動作について、フロ 一チャートを用いて説明する。図 6は、本発明の第 2の実施形態の携帯端末装置に よる受信画像保存処理時の動作手順を説明するためのフローチャートである。  Next, the operation of the mobile terminal device of the present embodiment configured as described above will be described using a flowchart. FIG. 6 is a flowchart for explaining an operation procedure at the time of a received image storing process by the mobile terminal device according to the second embodiment of the present invention.
[0047] 画像受信手段 104は、通信手段 101によって画像データを受信すると(S201)、端 末固有の画像 IDをふり、画像レコードとして、画像選択手段 106に通知する(S202) [0047] When image data is received by the communication means 101 (S201), the image receiving means 104 gives an image ID unique to the terminal and notifies the image selection means 106 as an image record (S202).
Yes
[0048] 通知を受けた画像選択手段 106は、ポリシ設定手段 107によって、同じ構図なら笑 顔の写真を優先するよう設定されていた場合に(S203)、受信済み画像レコードを、 記憶手段 105から 1つずつ読み出し、特徴点比較手段 108を用いて、受信した画像 レコードと同じ構図の写真を検索する(S204)。 [0049] 同じ構図の写真が存在した場合には、さらに表情比較手段 109を用い、その中で、 もっとも好ましくない表情の画像レコードを検索する(S205、 S207)。検索した結果、 受信した画像レコードがもっとも好ましくない表情と判定された場合には、画像選択 手段 106は、受信した画像レコードを破棄するよう画像受信手段 104に通知する(S 208、 S210)。 [0048] The image selection means 106 that has received the notification sets the received image record from the storage means 105 when the policy setting means 107 has been set to give priority to the smiley face photo if the composition is the same (S203). One by one is read, and the feature point comparison means 108 is used to search for a photo having the same composition as the received image record (S204). [0049] If there is a photograph with the same composition, the facial expression comparison means 109 is further used to search for an image record having the most unfavorable facial expression (S205, S207). As a result of the search, if it is determined that the received image record is the most unfavorable facial expression, the image selection means 106 notifies the image reception means 104 to discard the received image record (S208, S210).
[0050] 一方、もっとも好ましくない表情の画像が受信済み画像レコードである場合、画像 選択手段 106は、該当画像レコードを記憶手段 105から削除し、画像受信手段 104 に、受信した画像レコードを保存するよう通知する(S209、 S206)。  On the other hand, when the most unfavorable facial expression image is the received image record, the image selection unit 106 deletes the corresponding image record from the storage unit 105 and stores the received image record in the image reception unit 104. (S209, S206).
[0051] 同様に、同じ構図の写真が存在しなかった場合にも、画像選択手段 106は、画像 受信手段 104に、受信した画像レコードを保存するよう通知する(S206)。通知を受 けた画像受信手段 104は、画像選択手段 106からの通知に基づき、受信した画像レ コードの破棄をする力、、記憶手段 105に受信した画像レコードを記憶する。  Similarly, even when there is no photo having the same composition, the image selection unit 106 notifies the image reception unit 104 to save the received image record (S206). Upon receiving the notification, the image receiving unit 104 stores the received image record in the storage unit 105 based on the notification from the image selection unit 106.
[0052] 以上で説明したように、本発明の第 2の実施形態の携帯端末装置によれば、画像 を共有したいと思うユーザ同士が、画像をサーバへアップロードして相手にダウン口 ードさせたり、メモリーカードの交換などの煩わしい作業をすることなぐイベント等の 撮影に集中したまま、異なる構図、表情のよい写真を優先的に共有でき、同時に記 憶域の節約を行うことが出来る。  [0052] As described above, according to the mobile terminal device of the second exemplary embodiment of the present invention, users who want to share an image upload the image to the server and download it to the other party. You can preferentially share photos with different compositions and expressions while concentrating on shooting events that do not require cumbersome tasks such as changing memory cards, and at the same time save storage space.
[0053] (第 3の実施形態)  [0053] (Third embodiment)
図 7に、本発明の第 3の実施形態の携帯端末装置の構成を示す。処理内容が追加 された画像選択手段 106と、新たに追加された、撮影時間比較手段 110、逆光度合 い比較手段 111について説明する。その他の構成は、第 1の実施形態で説明した通 りであるため、説明を省略する。  FIG. 7 shows the configuration of the mobile terminal device according to the third embodiment of the present invention. The image selection means 106 to which the processing content has been added and the imaging time comparison means 110 and the backlight intensity comparison means 111 that have been newly added will be described. Since other configurations are the same as those described in the first embodiment, description thereof is omitted.
[0054] 本発明の第 1の実施形態の携帯端末装置は、画像比較手段として特徴点抽出手 段 108を具備していたが、第 3の実施形態の携帯端末装置では、画像比較手段とし て、撮影時間比較手段 110、逆光度合い比較手段 111が備わっている。  [0054] The mobile terminal device according to the first embodiment of the present invention includes the feature point extraction unit 108 as an image comparison unit. However, in the mobile terminal device according to the third embodiment, as the image comparison unit. The photographing time comparing means 110 and the backlight level comparing means 111 are provided.
[0055] 撮影時間比較手段 110は、画像選択手段 106から、受信した画像レコードと、比較 したい画像レコードの組を受け取る。撮影時間比較手段 110は、各画像レコードの画 像データに付加されたメタ情報から、撮影時間情報を抽出、比較することで、受信し た画像レコードに近接した時間に撮影された写真であるかどうか判断し、結果を画像 選択手段 106に通知する。 The photographing time comparison unit 110 receives from the image selection unit 106 a set of received image records and image records to be compared. The shooting time comparison means 110 receives and extracts the shooting time information from the meta information added to the image data of each image record. It is determined whether or not the photograph was taken at a time close to the image record, and the result is notified to the image selection means 106.
[0056] 逆光度合い比較手段 111は、画像選択手段 106から、受信した画像レコードと、比 較したい画像レコードの組を受け取る。逆光度合い比較手段 111は、各画像レコード の画像データの逆光度合いを算出し、どちらがより逆光の少ない画像であるか判断し 、結果を画像選択手段 106に通知する。  The backlight level comparison unit 111 receives the received image record and the set of image records to be compared from the image selection unit 106. The backlight level comparison unit 111 calculates the backlight level of the image data of each image record, determines which is the image with less backlight, and notifies the image selection unit 106 of the result.
[0057] なお、逆光度合いの算出を行った結果は、記憶手段 105に、メタ情報として画像レ コードとともに記録しておいてもよい。この場合、同じ画像レコードに対して再度逆光 度合いを算出する必要がなくなり、システムの高速化が図れる。  It should be noted that the result of calculating the degree of backlight may be recorded in the storage unit 105 as meta information together with the image record. In this case, it is not necessary to calculate the backlight level again for the same image record, and the system speed can be increased.
[0058] 画像選択手段 106は、画像受信手段 104から、受信した画像レコードを受け取り、 ポリシ設定手段 107による設定に基づき、撮影時間比較手段 110を用いて、記憶手 段 105の中から、受信した画像レコードに近接した時間に撮影された写真を検索す  The image selection means 106 receives the received image record from the image reception means 104 and receives it from the storage means 105 using the shooting time comparison means 110 based on the setting by the policy setting means 107. Search for photos taken at a time close to the image record
[0059] 検索した結果、近接した時間に撮影された写真が存在した場合には、画像選択手 段 106は、さらに逆光度合い比較手段 111を用い、その中で、もっとも逆光度合いの 高い画像レコードを検索する。検索した結果、受信した画像レコードがもっとも逆光 度合いが高いと判定された場合には、画像選択手段 106は、受信した画像レコード を破棄するよう画像受信手段 104に通知する。 [0059] If there is a photograph taken at a close time as a result of the search, the image selection means 106 further uses the backlight level comparison means 111 to select the image record with the highest backlight level. Search for. As a result of the search, when it is determined that the received image record has the highest backlight level, the image selection unit 106 notifies the image reception unit 104 to discard the received image record.
[0060] 一方、もっとも逆光度合いの高い画像が受信済み画像レコードである場合、画像選 択手段 106は、該当画像レコードを記憶手段 105から削除し、画像受信手段 104に 、受信した画像レコードを保存するよう通知する。同様に、近接した時間に撮影され た写真が存在しなかった場合にも、画像選択手段 106は、画像受信手段 104に、受 信した画像レコードを保存するよう通知する。  [0060] On the other hand, when the image with the highest degree of backlight is the received image record, the image selection means 106 deletes the corresponding image record from the storage means 105, and stores the received image record in the image reception means 104. Notify you. Similarly, even when there is no photograph taken at a close time, the image selection unit 106 notifies the image reception unit 104 to save the received image record.
[0061] なお、記憶手段 105に十分空き容量がある場合には、現時点でもっとも逆光度合 いの高い画像レコードにメタ情報として記憶しておき、次回、もっとも逆光度合いの高 い画像を検索する際に、受信した画像レコードと優先的に比較することで、比較回数 を省き、高速化を図るようにしてもよい。  [0061] If the storage means 105 has sufficient free space, it is stored as meta information in an image record with the highest degree of backlighting at the present time, and the next time the image with the highest degree of backlighting is searched. In addition, the number of comparisons may be omitted to increase the speed by preferentially comparing the received image records.
[0062] 次に、以上のように構成された本実施形態の携帯端末装置の動作について、フロ 一チャートを用いて説明する。図 8は、本発明の第 3の実施形態の携帯端末装置に よる受信画像保存処理時の動作手順を説明するためのフローチャートである。 Next, the flow of the operation of the mobile terminal device of the present embodiment configured as described above will be described. This will be described using one chart. FIG. 8 is a flowchart for explaining an operation procedure at the time of a received image saving process by the mobile terminal device according to the third embodiment of the present invention.
[0063] 画像受信手段 104は、通信手段 101によって画像データを受信すると(S301)、端 末固有の画像 IDをふり、画像レコードとして、画像選択手段 106に通知する(S302)[0063] When the image receiving means 104 receives the image data by the communication means 101 (S301), the image receiving means 104 gives the image ID unique to the terminal and notifies the image selecting means 106 as an image record (S302).
Yes
[0064] 通知を受けた画像選択手段 106は、ポリシ設定手段 107によって、近接した時間に 撮影されたなら逆光の少ない写真を優先するよう設定されていた場合に(S303)、受 信済み画像レコードを、記憶手段 105から 1つずつ読み出し、撮影時間比較手段 11 0を用いて、受信した画像レコードに近接した時間に撮影された写真を検索する(S3 04)。  [0064] The image selection means 106 that has received the notification sets the received image record when the policy setting means 107 is set to give priority to a photograph with little backlight if it was taken at a close time (S303). Are read one by one from the storage means 105, and the photograph taken at the time close to the received image record is searched using the photographing time comparison means 110 (S304).
[0065] 近接した時間に撮影された写真が存在した場合には、さらに逆光度合い比較手段  [0065] When there is a photograph taken at a close time, the backlight level comparison means
111を用い、その中で、もっとも逆光度合いの高い画像レコードを検索する(S305、 S307)。検索した結果、受信した画像レコードがもっとも逆光度合いが高いと判定さ れた場合には、受信した画像レコードを破棄するよう画像受信手段 104に通知する( S308、 S310)。  111 is used to search for an image record having the highest degree of backlighting (S305, S307). As a result of the search, when it is determined that the received image record has the highest backlight level, the image receiving means 104 is notified to discard the received image record (S308, S310).
[0066] 一方、もっとも逆光度合いの高い画像が受信済み画像レコードである場合、画像選 択手段 106は、該当画像レコードを記憶手段 105から削除し、画像受信手段 104に 、受信した画像レコードを保存するよう通知する(S309、 S306)。  On the other hand, when the image with the highest degree of backlight is the received image record, the image selection unit 106 deletes the corresponding image record from the storage unit 105 and stores the received image record in the image reception unit 104. (S309, S306).
[0067] 同様に、近接した時間に撮影された写真が存在しな力、つた場合にも、画像選択手 段 106は、画像受信手段 104に、受信した画像レコードを保存するよう通知する(S3 06)。通知を受けた画像受信手段 104は、画像選択手段 106からの通知に基づき、 受信した画像レコードの破棄をする力、、記憶手段 105に受信した画像レコードを記憶 する。  [0067] Similarly, the image selection means 106 notifies the image receiving means 104 to save the received image record even if the photograph taken at close time does not exist (S3). 06). Upon receiving the notification, the image receiving unit 104 stores the received image record in the storage unit 105 and the power to discard the received image record based on the notification from the image selecting unit 106.
[0068] 以上で説明したように、本発明の第 3の実施形態の携帯端末装置によれば、画像 を共有したいと思うユーザ同士が、画像をサーバへアップロードして相手にダウン口 ードさせたり、メモリーカードの交換などの煩わしい作業をすることなぐイベント等の 撮影に集中したまま、近接した時間に撮影された写真の中からもっとも逆光度合いの 低い写真を優先的に共有でき、同時に記憶域の節約を行うことが出来る。 [0069] (第 4の実施形態) [0068] As described above, according to the mobile terminal device of the third exemplary embodiment of the present invention, users who want to share an image upload the image to the server and download it to the other party. You can preferentially share photos with the lowest backlighting level among photos taken at close times while concentrating on shooting events that do not require cumbersome work such as replacing memory cards. Savings. [0069] (Fourth embodiment)
図 9に、本発明の第 4の実施形態の携帯端末装置の構成を示す。第 1の実施形態 と同じ構成については詳細な説明を省略する。本実施形態の携帯端末装置 100は、 他の携帯端末装置から画像データを受信する画像受信手段 104と、他の携帯端末 装置から受信した画像データと、記憶手段 105に記憶されている画像データとを比 較する画像比較手段 120と、画像比較手段 120の比較結果に基づいて、受信した 画像データに、予め設定した画像選択基準にしたがって優先度を付与する機能を有 し、付与された優先度に応じて、選択的に、受信した画像データを記憶手段 105に 記憶させる画像選択手段 106と、画像選択基準をユーザの選択により設定するポリ シ設定手段 107と、記憶手段 105の空き容量を検出する容量検出手段 121とを備え  FIG. 9 shows the configuration of the mobile terminal device according to the fourth embodiment of the present invention. Detailed description of the same configuration as that of the first embodiment is omitted. The mobile terminal device 100 of the present embodiment includes an image receiving unit 104 that receives image data from another mobile terminal device, image data received from another mobile terminal device, image data stored in the storage unit 105, and And a function for assigning priority to received image data in accordance with a preset image selection criterion based on the comparison result of the image comparison means 120 and the image comparison means 120. In response to this, the image selection means 106 for selectively storing the received image data in the storage means 105, the policy setting means 107 for setting the image selection criteria by user selection, and the free space in the storage means 105 are detected. Capacity detecting means 121
[0070] 画像選択手段 106は、付与された優先度に応じて、記憶手段 105に記憶されてい る画像データを削除する。また画像選択手段 106は、容量検出手段 121が検出した 空き容量に応じて、選択的に、受信した画像データを記憶手段 105に記憶させ、ま たは、容量検出手段 121が検出した空き容量に応じて、選択的に、記憶手段 105に 記憶されている画像データを削除する。 The image selection unit 106 deletes the image data stored in the storage unit 105 according to the assigned priority. Further, the image selection means 106 selectively stores the received image data in the storage means 105 according to the free capacity detected by the capacity detection means 121, or the free capacity detected by the capacity detection means 121. In response, the image data stored in the storage means 105 is selectively deleted.
[0071] 画像比較手段 120は、画像選択手段 106の制御に応じて、構図比較手段、表情比 較手段、ピンぼけ度合い比較手段、逆光度合い比較手段、または被写体人数比較 手段として機能する。各比較手段の処理としては、公知の技術を利用できる。  The image comparison unit 120 functions as a composition comparison unit, a facial expression comparison unit, a defocus degree comparison unit, a backlight level comparison unit, or a subject number comparison unit in accordance with the control of the image selection unit 106. A known technique can be used as the processing of each comparison means.
[0072] 画像比較手段 120を構図比較手段として機能させた場合について説明する。画像 比較手段 120は、画像データに対して、色相値、輝度値によって抽出されたエッジ情 報を元に領域分割を行い、分割された領域ごとに色相値、輝度値に基づく特徴量を 比較する。また、画像比較手段 120は、キー画像から特徴量を抽出し、検索対象画 像全てについてのエッジ情報を示す特徴量テーブル内のデータと比較し、類似度の 高い画像を画像選択手段 106に通知する。  A case where the image comparison unit 120 is caused to function as a composition comparison unit will be described. The image comparison unit 120 divides the image data based on the edge information extracted based on the hue value and the luminance value, and compares the feature values based on the hue value and the luminance value for each divided region. . Further, the image comparison unit 120 extracts a feature amount from the key image, compares it with data in the feature amount table indicating edge information for all the search target images, and notifies the image selection unit 106 of an image having a high degree of similarity. To do.
[0073] また、構図比較手法としては、エッジ ·コーナー等の特徴点を検出する方法や、色 の空間分布を利用する方法が知られている(例えば、 http:〃 www.brl.ntt.co.jp/p eople/ akisato/ pdf/ prmu20050o.pdf http: //vokoya.naist.ip/ posters/ 199 8/pdfs/hideno -y. pdf参照)。 [0073] Further, as a composition comparison method, a method for detecting feature points such as edges and corners and a method using a spatial distribution of colors are known (for example, http: 〃 www.brl.ntt.co .jp / p eople / akisato / pdf / prmu20050o.pdf http: //vokoya.naist.ip/ posters / 199 8 / pdfs / hideno -y. See pdf).
[0074] 図 10は、画像比較手段 120を被写体人数比較手段として機能させた場合に、画像 から輪郭を抽出し、被写体の人数を抽出する場合の説明図である。画像比較手段 1 20は、図 10 (a)に示す対象画像から輪郭(図 10 (b) )を抽出し、肩および首に対する 頭部の形状を特定することにより、被写体の人数を計算する。  FIG. 10 is an explanatory diagram in the case where the contour is extracted from the image and the number of subjects is extracted when the image comparison means 120 is made to function as the subject number comparison means. The image comparison means 120 calculates the number of subjects by extracting the contour (FIG. 10 (b)) from the target image shown in FIG. 10 (a) and specifying the shape of the head relative to the shoulder and neck.
[0075] 図 11は、画像比較手段 120を表情比較手段として機能させる場合の説明図である 。画像比較手段 120は、図 11 (a)に示す対象画像から顔領域(図 11 (b) )を切り出し 、 目、鼻および口の位置情報から人物の表情を推定する。この場合に、顔を構成す るパーツの輪郭の開き具合や曲がり具合を検出して表情を想定する。例えば、 目、 鼻および口の各輪郭間の開き状態及び各輪郭の曲がり状態を正規化した特徴量を ノ ラメータとしたメンバシップ関数に基づいて各表情の強度を求め、当該強度が最大 となる表情を求めて対象画像の表情を推定する。  FIG. 11 is an explanatory diagram in a case where the image comparison unit 120 functions as a facial expression comparison unit. The image comparison means 120 cuts out a face region (FIG. 11 (b)) from the target image shown in FIG. 11 (a), and estimates the facial expression of the person from the position information of eyes, nose and mouth. In this case, facial expressions are assumed by detecting the degree of opening and bending of the contours of the parts that make up the face. For example, the strength of each facial expression is obtained based on a membership function with the feature value obtained by normalizing the open state between the contours of the eyes, nose and mouth and the curved state of each contour as a parameter. The facial expression of the target image is estimated by obtaining the facial expression.
[0076] なお、表情認識手法としては、高次局所自己相関(HLAC)法や、 Fisherfaces/ Fisherf aces法を用いた表情認識手法も知られて!/、る(例えば、 http: //www.isi. imi.i.u— tokyo.ac.jp%2F~u— suke%2Fdoc%2Fprmu2004.ppt http : / / www.ipsj .or.jp/ Olkyotsu/ award/ fit― young/ 2005― pdf/l― 007.pdf 参照)。  [0076] As facial expression recognition methods, facial recognition methods using higher-order local autocorrelation (HLAC) methods and Fisherfaces / Fisherfaces methods are also known! /, Ru (for example, http: // www. isi. see .pdf).
[0077] また、ピンぼけ判別手法としては、手ぶれ'ピンぼけ写真の検索 ·判定が可能なソフ トウエアが商品化されている(例えば、メディアドライブ (株)「やさしくケータイ'デジ力 メファィリング」、 http : //pac.mediadrive.jp/topics/20041104— ydf.html 参照)。  [0077] In addition, software that can search and determine camera shake 'out-of-focus photos' has been commercialized as an out-of-focus discrimination method (for example, Media Drive Co., Ltd. “Easy Mobile Phone Digi Power Mefiling”, http: / /pac.mediadrive.jp/topics/20041104—see ydf.html).
[0078] また、逆光度合いを判断するために用いる、方角、位置、焦点距離、照度の比較手 法としては、メタ情報を用いるものがある。撮影した際に、方角等の情報をメタ情報と して画像データに対応付けて記録することで、比較することが可能である。  [0078] In addition, as a method for comparing the direction, position, focal length, and illuminance used to determine the degree of backlight, there is a method using meta information. When shooting, information such as direction can be compared by recording it as meta information in association with image data.
[0079] また、写真に写った人物の数を比較し、集合写真、背景写真を判別する手法として は、人物抽出手法を用いることができる。人物抽出手法としては、色情報を用いる手 法力失口られている (ί列えは、 http : / / www.nlab.sogol .ynu.ac.jp/ ynu/ r一 sa mples/no 1 4.html、特開 2005— 222304号公幸 「ノ ターン由出装置」(ノ ッ クプロパゲーションを用いたニューラルネットワークで、肌色、髪の色を学習し、肌領 域の抽出精度を向上させる技術)参照)。 [0079] In addition, a person extraction method can be used as a method for comparing the number of persons photographed in a photo and discriminating a group photo and a background photo. As a person extraction method, the use of color information has been dissatisfied. (Ί: http://www.nlab.sogol.ynu.ac.jp/ynu/r1 sa mples / no 1 4.html , JP 2005-222304 Koyuki “No-turn device” (Technology for learning skin color and hair color and improving the extraction accuracy of the skin area with a neural network using cupropropagation)).
[0080] 図 12は、記憶手段 105の記憶領域の概要を示す。記憶手段 105は、図 12 (a)に 示すように、自装置で撮影した画像データを記憶する第一の記憶領域 122と、他の 携帯端末装置から受信した画像データを記憶する第二の記憶領域 123とに分割さ れている。 FIG. 12 shows an outline of the storage area of the storage means 105. As shown in FIG. 12 (a), the storage means 105 includes a first storage area 122 for storing image data captured by its own device, and a second storage for storing image data received from other portable terminal devices. It is divided into area 123.
[0081] 図 12 (b)は、画像データを、記憶領域 124に、撮影した端末装置の識別情報ととも に記憶する場合を示す。記憶手段 105は、撮像手段 103で撮影した画像データを、 自端末装置で撮影された画像であることを示す識別情報(自装置)とともに記憶し、 受信した画像データを、受信した画像データに付与されている、いずれの端末装置 で撮影された画像である力、を示す識別情報 (他装置 X、他装置 Y)とともに記憶する。  FIG. 12 (b) shows a case where image data is stored in the storage area 124 together with the identification information of the photographed terminal device. The storage unit 105 stores the image data captured by the image capturing unit 103 together with identification information (local device) indicating that the image is captured by the local terminal device, and adds the received image data to the received image data. It is stored together with identification information (other device X, other device Y) indicating the force that is an image taken by any terminal device.
[0082] 本実施形態の携帯端末装置 100によれば、自分が撮影した画像は確保(削除しな い)しつつ、他者が撮ったもので、ユーザが所望する写真(自分が持っていない構図 で、画質がよい写真など)を、空き容量に応じてできるだけ多ぐその場で手軽に収集 すること力 Sでさる。  [0082] According to the mobile terminal device 100 of the present embodiment, the image that the user took is secured (not deleted), and is taken by another person, and the photograph desired by the user (not owned by the user). With the power S, you can easily collect as many photos with good composition and quality as possible according to the available capacity.
[0083] この場合、自分が撮影した画像と他人が撮影した画像の区別の仕方としては、図 1 2 (a)に示したように、それぞれの格納領域を物理的に分ける方法でもよぐまたは、 図 12 (b)に示したように、画像データに、「どのカメラで撮った画像かを識別する属性 (自装置、他装置 Xなど)」を持たせてもよい。後者の場合は、領域を分ける必要がな V、ので、記憶領域をより有効に利用できる。  [0083] In this case, as shown in Fig. 1 2 (a), a method of physically separating the storage areas may be used as a method of distinguishing between the image taken by oneself and the image taken by another person. As shown in FIG. 12 (b), the image data may have an “attribute for identifying which camera the image was taken (own device, other device X, etc.)”. In the latter case, it is necessary to divide the area V, so the storage area can be used more effectively.
[0084] また、本実施形態の携帯端末装置 100は、記憶手段 105の空き容量を検出する容 量検出手段 121を持ち、記憶手段 105の空き容量に応じて、優先度の高い画像を残 し、優先度の低い画像を削除する。なお、優先度は、画像受信手段 104が画像を受 信する際に付与する。  In addition, the mobile terminal device 100 of the present embodiment has capacity detection means 121 for detecting the free capacity of the storage means 105, and leaves high priority images according to the free capacity of the storage means 105. , Delete low priority images. The priority is given when the image receiving unit 104 receives an image.
[0085] (第 5の実施形態)  [0085] (Fifth embodiment)
次に、図 9に示す携帯端末装置 100が画像データの送信側として機能する場合に ついて説明する。以下、携帯端末装置 100が送信側として機能する場合に必要とな る機能について説明する。ここでは、 3以上の携帯端末装置間で、同報通信を行なう 例を示す。 Next, the case where the mobile terminal device 100 shown in FIG. 9 functions as the image data transmission side will be described. Hereinafter, functions required when the mobile terminal device 100 functions as a transmission side will be described. Here, broadcast communication is performed between three or more mobile terminal devices. An example is shown.
[0086] 画像比較手段 120は、撮像手段 103が新たに撮像した画像データと記憶手段 105 に記憶されている画像データとを比較する。画像選択手段 106は、画像比較手段 12 0の比較結果に基づいて、撮像手段 103が新たに撮像した画像データに、予め設定 した画像選択基準にしたがって優先度を付与する機能を有し、付与された優先度に 応じて、送信対象の画像データを選択する。画像送信手段 102は、通信手段 101を 介して、画像選択手段 106の選択結果に基づいて、他の携帯端末装置に画像デー タを送信する。また、画像送信手段 102は、送信対象の画像データに自装置の識別 IDを付して送信する。  The image comparison unit 120 compares the image data newly captured by the imaging unit 103 with the image data stored in the storage unit 105. The image selection unit 106 has a function of giving priority to image data newly captured by the imaging unit 103 based on the comparison result of the image comparison unit 120 according to a preset image selection criterion. The image data to be sent is selected according to the priority. The image transmission unit 102 transmits image data to another mobile terminal device via the communication unit 101 based on the selection result of the image selection unit 106. Further, the image transmitting means 102 transmits the image data to be transmitted with the identification ID of its own device.
[0087] 以上説明したように、本発明の第 5の実施形態の携帯端末装置によれば、予め画 像選択基準を設定しておけば、優先度に応じて、 自装置で撮像した画像データのう ち、他の携帯端末装置で所望されるであろう画像データを選択して、送信することが できるため、送信データ量を抑制しながら手軽に画像データを共有することができる 。例えば、自装置で新たに撮影した写真が、自装置で以前に撮影した写真や他の携 帯端末装置から受信した写真と比較して、好ましい写真(ピンボケが少ない、構図が 異なる等)である場合にのみ、送信することができるため、送信データ量を抑制しなが ら、好ましい画像データを手軽に共有することができる。  [0087] As described above, according to the mobile terminal device of the fifth embodiment of the present invention, if image selection criteria are set in advance, image data captured by the own device according to priority. Since image data that would be desired by other portable terminal devices can be selected and transmitted, image data can be easily shared while suppressing the amount of transmission data. For example, a new photograph taken by the own device is a preferable photograph (less out of focus, composition is different, etc.) compared to a photograph previously taken by the own device or a photo received from another mobile terminal device. Since it can be transmitted only in such a case, it is possible to easily share preferable image data while suppressing the amount of transmission data.
[0088] なお、画像比較手段 120は、画像データに付与されている装置 ID (画像データを 撮影した装置を示す識別情報)を参照して画像データを比較してもよい。例えば、画 像比較手段 120によって、新たに撮影した写真が、自装置で撮影した写真と比較す ると優先度は低いが、他装置で撮影された写真よりも優先度が高いとの比較結果が 出された場合に、画像選択手段 106は、この写真を送信対象として選択することがで きる。また、このように、他の携帯端末装置にとってより好ましい画像データを選択し て送信することができ、ユーザの利便性を一層向上させることができる。  Note that the image comparison unit 120 may compare image data with reference to a device ID (identification information indicating a device that has captured the image data) given to the image data. For example, a comparison result that a new photograph taken by the image comparison unit 120 has a lower priority than a photograph taken by the own apparatus, but a higher priority than a photograph taken by another apparatus. When is issued, the image selection means 106 can select this photo as a transmission target. In addition, as described above, it is possible to select and transmit image data that is more preferable for other portable terminal devices, thereby further improving user convenience.
[0089] なお、 3以上の携帯端末装置間で、互いにピアツーピア通信を行なってもよい。こ の場合、各画像データに付与された識別 IDを使って、どの画像データを相手に送信 する力、を判断することにより、送信データ量を抑制できる。識別 IDを用いた判断例を 以下に示す。 [0090] カメラ Aとカメラ Bとの間において、はじめに、カメラ Aが受信側、カメラ Bが送信側で 、カメラ Aが画像 bを受信したとする。次に、逆に、カメラ Bが受信側、カメラ Aが送信側 になった場合には、カメラ Aは画像 bを送信しな!/、。 [0089] Peer-to-peer communication may be performed between three or more portable terminal devices. In this case, the amount of transmission data can be suppressed by determining which image data is transmitted to the other party using the identification ID assigned to each image data. An example of determination using identification ID is shown below. [0090] Suppose that between camera A and camera B, camera A is the receiving side, camera B is the transmitting side, and camera A receives image b. Next, conversely, if camera B becomes the receiving side and camera A becomes the transmitting side, camera A will not send image b! /.
[0091] また、カメラ Aが自端末で撮影した画像 aをカメラ Bに送信し、カメラ Bは、受信した画 像 aと自端末で撮影した画像 bをカメラ Cに送信し、カメラ C力 S、自端末で撮影した画 像 cに加え、カメラ Bから受信した画像 aおよび画像 bを記憶する場合を考える。カメラ Cは、カメラ Bから受信することで、カメラ Aが撮った写真(画像 a)も収集できるので、 カメラ Aから受信する必要がなくなる。次に、カメラ C (画像 a、画像 b、画像 cを有する) は画像に付与された識別 IDを使ってカメラ Aに送信すべき画像が画像 b、画像 cであ ると判断し、カメラ Aに送信する。カメラ Aは、カメラ cから受信することで、カメラ Bが撮 つた写真(画像 b)も収集でき、カメラ Bから受信する必要がなくなる。  [0091] In addition, camera A sends image a taken with its own terminal to camera B, and camera B sends received image a and image b taken with its own terminal to camera C, where camera C power S Consider the case where the image a and the image b received from the camera B are stored in addition to the image c taken by the own terminal. Camera C can collect the picture (image a) taken by camera A by receiving it from camera B, so there is no need to receive it from camera A. Next, camera C (having image a, image b, and image c) determines that the image to be transmitted to camera A is image b and image c using the identification ID assigned to the image. Send to. Camera A can collect the picture (image b) taken by camera B by receiving it from camera c, eliminating the need to receive it from camera B.
[0092] 上記第 1〜第 4の実施形態の携帯端末装置 100によれば、自装置で撮影した画像 は確保しつつ、他者が撮ったもので、所望する写真 (例えば、 自分が持っていない構 図の、画質がよい写真)を、空き容量に応じてできるだけ多ぐその場で手軽に収集 すること力 Sできる。また、集合写真をとる場面で、一台のカメラで撮影した写真を各力 メラ (端末)に送ることにより、各自のカメラで写真を撮る必要がなくなる。また、第 5の 実施形態で説明したように、画像データに優先順位を付与する機能を送信側携帯端 末装置が有することにより、送信データ量を抑えながら、一層手軽に端末装置間で画 像データを共有できる。  [0092] According to the mobile terminal device 100 of the first to fourth embodiments, an image captured by the own device is secured while the image taken by another person is taken, and a desired photograph (for example, the user owns the image). It is possible to easily collect as many photos as possible with no image composition and good image quality on the spot according to the available capacity. In addition, when taking a group photo, you can send photos taken with one camera to each camera (terminal), eliminating the need to take photos with your own camera. Further, as described in the fifth embodiment, since the transmitting-side portable terminal device has a function of assigning priority to image data, it is possible to more easily transfer images between terminal devices while suppressing the amount of transmission data. Share data.
[0093] なお、携帯端末装置 100において、撮像手段 103は必須でなぐ他者が撮った写 真を収集するだけでもよい。また、記憶手段 105の空き容量に応じて、ポリシ設定手 段 107におけるポリシを動的に変更してもよい。  [0093] Note that in the mobile terminal device 100, the image pickup means 103 may collect only photographs taken by others that are not essential. Further, the policy in the policy setting unit 107 may be dynamically changed according to the free capacity of the storage unit 105.
[0094] すなわち、 自分が収集したい画像データについてポリシを設定しておけば、ポリシ に従って自動的に優先順位をつけて取捨選択し、選択的に受信又は削除することが できるため、例えば、結婚式などのイベントにおいて、他の参加者が撮影した写真の うち、 自分が後で欲しくなる画像データを、デジタルカメラ等の容量が許す限り多数、 その場で取得することができる。  [0094] In other words, if a policy is set for the image data that the user wants to collect, it can be automatically selected and prioritized according to the policy and selectively received or deleted. In such events, many of the photos taken by other participants can be acquired on-the-fly as much as the digital camera's capacity allows for image data that they want later.
[0095] なお、上記第 1〜第 4の実施形態では、画像選択手段 106が、画像受信手段 104 が受信した画像データに優先順位を付与する例を説明したが、画像選択手段 106 は、画像受信手段 104が受信した画像データと記憶手段 105に予め記憶されている 画像データの全部又は一部を対象に、画像比較手段(特徴点比較手段 108、表情 比較手段 109等)の比較結果と予め設定したポリシ (画像選択基準)に従って、優先 度を付与してもよい。記憶手段 105に記憶されている画像データにも優先度を付与 することにより、空き容量が少なくなつた場合に優先度の低い画像データから削除す ること力 Sできる。したがって、ユーザが希望する画像を、より多く収集することができる In the first to fourth embodiments, the image selecting unit 106 is the image receiving unit 104. In the example described above, the priority is given to the received image data. However, the image selection unit 106 uses the image data received by the image reception unit 104 and all or part of the image data stored in the storage unit 105 in advance. Priorities may be given to objects in accordance with the comparison results of image comparison means (such as feature point comparison means 108 and facial expression comparison means 109) and preset policies (image selection criteria). By giving priority to the image data stored in the storage means 105, it is possible to delete from the image data with low priority when the free space is low. Therefore, more images desired by the user can be collected.
[0096] また、上記各実施形態では、画像比較手段が、写真の構図等を比較する例を説明 したが、画像データに付与されたメタ情報を比較してもよい。画像データのメタ情報と しては、撮影時刻(図 2参照)、被写体を撮影した際の焦点距離、カメラ位置力も被写 体までの被写体距離等といった、撮影時又は撮影後に付与される属性情報を使用 できる。また、撮影内容を示す情報 (被写体の名前、撮影地、イベント名称等)や撮影 者のコメント等をメタ情報として使用してもよい。このようなメタ情報を用いることにより 、ポリシ設定の自由度を向上でき、ユーザは所望する画像データを一層収集しやす くなる。 Further, in each of the above-described embodiments, the example in which the image comparison unit compares the composition of the photograph has been described. However, the meta information given to the image data may be compared. As meta information of image data, attribute information given at the time of shooting or after shooting, such as shooting time (see Fig. 2), focal length when shooting the subject, camera position force and subject distance to the subject, etc. Can be used. Further, information indicating the contents of photographing (name of subject, photographing location, event name, etc.), a photographer's comment, etc. may be used as meta information. By using such meta information, the degree of freedom of policy setting can be improved, and the user can more easily collect desired image data.
[0097] (第 6の実施形態)  [0097] (Sixth embodiment)
次に、第 6の実施形態の携帯端末装置 100について説明する。本実施形態の携帯 端末装置 100は、写真レコード同士の比較に先だって、受信した写真レコードを取 捨選択するために、画像選択手段 106における処理内容が追加されている。本実施 形態の携帯端末装置 100の構成は、図 1に示す第 1の実施形態と同様である。  Next, a mobile terminal device 100 according to a sixth embodiment will be described. In the mobile terminal device 100 of the present embodiment, the processing content in the image selection means 106 is added in order to select received photo records prior to comparison between photo records. The configuration of the mobile terminal device 100 of this embodiment is the same as that of the first embodiment shown in FIG.
[0098] 本実施形態の携帯端末装置 100において、画像選択手段 106は、ポリシ選択手段  In the mobile terminal device 100 of the present embodiment, the image selection unit 106 is a policy selection unit.
107による条件によって、写真レコード同士の比較をスキップして受信した写真レコ ードを保存し、または写真レコード同士の比較に先立って受信した写真レコードを破 棄する。  Depending on the conditions of 107, the received photo records are saved by skipping the comparison between the photo records, or the received photo records are discarded prior to the comparison between the photo records.
[0099] 例えば、画像選択手段 106において、画像レコード同士の比較に先立って、受信 した写真レコードのメタ情報として記憶された写真グループ IDが、ポリシ選択手段 10 7で設定された写真グループ IDと同一もしくは異なる場合に、受信した画像レコード を破棄または保存する。 [0099] For example, in the image selection means 106, prior to comparison between image records, the photo group ID stored as meta information of the received photo records is the same as the photo group ID set by the policy selection means 107. Or received image record if different Discard or save.
[0100] ここで、写真グループ IDは、撮影者の識別情報、参加中のイベント識別情報、場所 識別情報、送信者や受信者が所属するグループ識別情報、会場や会場の入り口に 設置されたビーコンから発信された信号情報、 QRコード (登録商標)等の二次元コ ードから取得した識別情報、一度撮影した写真から生成した特徴点情報等である。 [0100] Here, the photograph group ID is the photographer's identification information, participating event identification information, location identification information, group identification information to which the sender or receiver belongs, and a beacon installed at the venue or entrance of the venue. Signal information transmitted from the terminal, identification information acquired from a two-dimensional code such as a QR code (registered trademark), feature point information generated from a photograph taken once, and the like.
[0101] このように本実施形態の携帯端末装置 100によれば、写真レコード同士の比較に 先だって受信した写真レコードを取捨選択するので、送信先を限定したり、あらかじ め保存したい写真レコードの種類を限定できる。 [0101] As described above, according to the mobile terminal device 100 of the present embodiment, since the received photo records are selected prior to the comparison between the photo records, it is possible to limit the transmission destinations or to select the photo records to be stored in advance. The type can be limited.
[0102] また、本実施形態の携帯端末装置 100は、画像選択手段 106において、比較すベ き写真レコードが受信側端末に保存されていない場合や、受信した写真レコードを 保存するスペースが受信側端末のストレージに残って!/、る場合は、受信した写真レコ ードと、保存されている写真レコードの比較をスキップし、無条件もしくはポリシ設定 手段 107による条件で画像を保存する。 [0102] Also, in the mobile terminal device 100 of the present embodiment, the image selection means 106 has a case where the photo record to be compared is not stored in the receiving terminal, or a space for storing the received photo record is the receiving side. If it remains in the terminal storage, the comparison between the received photo record and the stored photo record is skipped, and the image is saved unconditionally or under the conditions of the policy setting means 107.
[0103] 例えば、画像レコードを受信した場合に、ストレージに余裕があるうちは比較をスキ ップして保存する、また、ポリシ設定手段 107が、 "笑顔度 80%以上の写真レコードの み保存"という条件に設定されている状態で画像レコードを受信した場合に、笑顔度[0103] For example, when an image record is received, the comparison is skipped and saved as long as there is enough storage. Smile level when an image record is received with the condition "
80%以上なら比較をスキップして保存する。 If over 80%, skip comparison and save.
[0104] このように本実施形態の携帯端末装置 100によれば、受信した写真レコードと保存 されている写真レコードの比較をスキップし、無条件もしくはポリシ設定手段 107によ る条件に従って画像を保存するので、送信先を限定したり、あらかじめ保存したい写 真レコードの種類を限定できる。 As described above, according to the mobile terminal device 100 of the present embodiment, the comparison between the received photo record and the stored photo record is skipped, and the image is stored unconditionally or according to the conditions of the policy setting means 107. Therefore, you can limit the destinations and the types of photo records that you want to save in advance.
[0105] また、本実施形態の携帯端末装置 100は、受信した写真レコードを別の端末に再 送信できるようにした場合に、画像レコードのメタ情報として記録されたコピー回数制 限情報を画像レコード保存時に増減し、画像レコードを別の端末に再送信する際、コ ピー回数が規定値に達していた場合に、再送信を中止する。  [0105] In addition, when the mobile terminal device 100 according to the present embodiment is configured so that the received photo record can be retransmitted to another terminal, the copy number limit information recorded as the meta information of the image record is displayed as the image record. When the number of copies reaches the specified value when resending the image record to another terminal, the resending is stopped.
[0106] これによれば、コピー回数制限の範囲内に送信先を限定できるとともに、コピー回 数制限を越えて再送信できないので、写真レコードの著作権を保護することができる [0107] また、本実施形態の携帯端末装置 100は、撮像部を持たない送信者側端末または 受信者側端末にも適用可能である。例えば、撮像部を持たず、受信のみを行う受信 者側端末であってもよい。 [0106] According to this, the transmission destination can be limited within the range of the copy number limit, and since the re-transmission cannot be performed beyond the copy number limit, the copyright of the photo record can be protected. [0107] The mobile terminal device 100 of the present embodiment is also applicable to a sender side terminal or a receiver side terminal that does not have an imaging unit. For example, it may be a receiver side terminal that does not have an imaging unit and performs only reception.
[0108] 同様に、撮像部を持たず、撮像以外の手段で取得した写真レコード (ストレージに あらかじめ保存されている写真レコードや、ネットワークを用いて取得した写真レコー ド)を送信する送信者側端末であってもよい。 [0108] Similarly, a sender-side terminal that does not have an imaging unit and transmits a photo record obtained by means other than imaging (a photo record stored in advance in a storage or a photo record obtained using a network). It may be.
[0109] この場合に、撮影者を識別するための手法として、送信する画像に撮影者のシグネ チヤや、 Webページの URL等といった撮影者を識別できる情報を、写真レコードのメ タデータとして送信する手法が利用できる。 [0109] In this case, as a method for identifying the photographer, information that can identify the photographer, such as the photographer's signature and the URL of the Web page, is transmitted as the metadata of the photo record in the image to be transmitted. Techniques can be used.
[0110] これによれば、写真の撮影者が撮影の腕前を宣伝することが出来たり、写真レコー ドの受信者を自社の Webページに誘導することが出来るほか、撮影者の識別情報に よって写真の取捨選択に利用できる。 [0110] According to this, the photographer can advertise his / her skill in photographing, guide the recipient of the photograph record to the company's web page, and use the photographer's identification information. Can be used to select photos.
[0111] 次に、メタ情報を送信者側で生成するパターンについて説明する。特徴点や、笑顔 度などのメタ情報を送信側で生成し、写真レコードの送信と同時、もしくは写真レコー ドの送信に先立って受信側に送信することができる。 Next, a pattern for generating meta information on the sender side will be described. Meta information such as feature points and smiles can be generated on the sending side and sent to the receiving side at the same time as sending the photo record or prior to sending the photo record.
[0112] 写真レコードの送信に先立ってメタ情報を送信する場合は、受信者側が、画像比 較手段にて保存されている写真レコードと受信した写真レコードのメタ情報を比較し[0112] When sending meta information prior to sending a photo record, the recipient compares the photo record stored in the image comparison means with the meta information of the received photo record.
、保存されている写真レコードより送信者側の写真レコードを保存すべきと判断した 場合は、送信者側に写真レコードの送信を依頼する。 If it is determined that the sender's photo record should be saved from the stored photo record, the sender is requested to send the photo record.
[0113] これによれば、写真レコードの送信と同時にメタ情報を送信する場合は、受信者毎 にメタ情報を算出する必要がなくなる。また、写真レコードの送信に先だってメタ情報 を送信する場合は、通信量の削減ができる。 [0113] According to this, when meta information is transmitted simultaneously with transmission of a photo record, it is not necessary to calculate meta information for each recipient. In addition, if meta information is sent prior to sending a photo record, the amount of communication can be reduced.
[0114] (第 7の実施形態) [0114] (Seventh embodiment)
図 13は、本発明の第 7の実施形態にかかる携帯端末装置 100の動作を説明する ための図である。携帯端末装置 100の構成は、図 1に示す第 1の実施形態と同様で ある。本実施形態の携帯端末装置 100は、撮像手段 103で撮影した QRコード等の 二次元コードからイベント IDを取得し、画像データにイベント IDを付与することにより FIG. 13 is a diagram for explaining the operation of the mobile terminal device 100 according to the seventh embodiment of the present invention. The configuration of the mobile terminal device 100 is the same as that of the first embodiment shown in FIG. The mobile terminal device 100 according to the present embodiment acquires an event ID from a two-dimensional code such as a QR code captured by the imaging unit 103, and assigns the event ID to the image data.
、他の携帯端末装置と手軽に画像データを共有することができる。 [0115] 例えば、結婚式場、コンサート会場等のイベント会場に QRコードを用意しておく。 そして、イベント参加者が、図 13 (a)に示すように、各自、携帯端末装置 100によって QRコードを撮影し、イベント IDを取得する。なお、 QRコードからイベント IDを抽出し た後は、 QRコード画像を破棄してもよい。 The image data can be easily shared with other portable terminal devices. [0115] For example, a QR code is prepared at an event venue such as a wedding hall or a concert hall. Then, as shown in FIG. 13 (a), each event participant takes a QR code with the mobile terminal device 100 and acquires an event ID. The QR code image may be discarded after the event ID is extracted from the QR code.
[0116] 送信側の携帯端末装置 100は、図 13 (b)に示すように、撮影した画像データにィ ベント IDを付与して送信する。一方、受信側の携帯端末装置 100は、図 13 (c)に示 すように、例えば、「特定の IDが付与された画像データを収集する」というポリシを設 定しておけば、所望のイベント IDが付与された画像データのみを収集することができ る(図 13 (d)参照)。  [0116] As shown in Fig. 13 (b), the mobile terminal device 100 on the transmission side adds the event ID to the captured image data and transmits it. On the other hand, as shown in FIG. 13 (c), the mobile terminal device 100 on the receiving side, for example, can set a policy of “collecting image data with a specific ID” and set a desired Only image data with event IDs can be collected (see Fig. 13 (d)).
[0117] なお、 QRコードから取得したイベント IDをキーとして画像データを暗号化してもよ い。これによれば、同じ QRコード (イベント ID)を持つ受信者しか復号できないので、 送信先を限定できる。  [0117] The image data may be encrypted using the event ID obtained from the QR code as a key. According to this, only recipients with the same QR code (event ID) can decrypt, so the destination can be limited.
[0118] また、同じ QRコードを持つ人のみでネットワーク自体を暗号化してもよい。すなわち 、 QRコードから取得したイベント IDを無線 LANの SSID (Service Set Identifier)や、 W EP(Wire Equivalent Privacy)、 WPA(Wト Fi Protected Access)などの喑号鍵として用 いる。これによれば、画像データを送信する都度暗号化等することなぐ送信先を制 限できる。  [0118] Further, the network itself may be encrypted only by a person having the same QR code. In other words, the event ID obtained from the QR code is used as a key of a wireless LAN SSID (Service Set Identifier), WEP (Wire Equivalent Privacy), WPA (W-Fi Protected Access), or the like. According to this, it is possible to limit transmission destinations that are not encrypted each time image data is transmitted.
[0119] 尚、上記各実施形態では、携帯端末装置 100が、写真等の静止画像を送信し、静 止画像に付与されたメタ情報またはイベント IDにより静止画像を共有する例を説明し たが、静止画像だけでなく動画を共有する場合にも適用できる。動画を再生した後に 取捨選択の判断をすると非常に時間がかかるが、本実施形態によれば、ユーザが設 定したポリシに従って必要な動画を高速に取捨選択することができる。  [0119] In each of the above-described embodiments, an example has been described in which the mobile terminal device 100 transmits a still image such as a photograph and shares the still image based on meta information or event ID given to the still image. It can also be applied when sharing moving images as well as still images. Although it takes a very long time to make a selection decision after playing a moving image, according to the present embodiment, it is possible to quickly select a necessary moving image according to a policy set by the user.
[0120] 尚、画像送信手段 102、画像受信手段 104、画像選択手段 106等の各機能ブロッ クは典型的には集積回路である LSIとして実現される。これらは個別に 1チップ化さ れても良いし、一部又は全てを含むように 1チップ化されても良い。ここでは、 LSIとし た力 集積度の違いにより、 IC、システム LSI、スーパー LSI、ウルトラ LSIと呼称され るこど ある。  [0120] Note that each functional block such as the image transmission unit 102, the image reception unit 104, the image selection unit 106, and the like is typically realized as an LSI that is an integrated circuit. These may be individually made into one chip, or may be made into one chip so as to include a part or all of them. Here, it is called IC, system LSI, super LSI, or ultra LSI due to the difference in power integration as LSI.
[0121] また、集積回路化の手法は LSIに限るものではなぐ専用回路又は汎用プロセッサ で実現してもよい。 LSI製造後に、プログラムすることが可能な FPGA (Field Progr ammableGate Array)や、 LSI内部の回路セルの接続や設定を再構成可能なリコ ンフィギユラブル'プロセッサーを利用しても良い。 [0121] Further, the method of circuit integration is not limited to LSI, but a dedicated circuit or general-purpose processor It may be realized with. You can use a field programmable gate array (FPGA) that can be programmed after manufacturing the LSI, or a reconfigurable processor that can reconfigure the connection and settings of the circuit cells inside the LSI.
[0122] さらには、半導体技術の進歩又は派生する別技術により LSIに置き換わる集積回 路化の技術が登場すれば、当然、その技術を用いて機能ブロックの集積化を行って もよい。ノ ィォ技術の適応等が可能性としてありえる。  [0122] Furthermore, if integrated circuit technology that replaces LSI emerges as a result of advances in semiconductor technology or other derived technology, it is naturally also possible to integrate functional blocks using this technology. There is a possibility of adaptation of nanotechnology.
[0123] 以上説明したように、本発明の携帯端末装置は、他の携帯端末装置から画像デー タを受信する画像受信手段と、他の携帯端末装置から受信した画像データと、記憶 手段に記憶されて!/、る画像データとを比較する画像比較手段と、前記画像比較手段 の比較結果に基づレ、て、予め設定した画像選択基準にしたがって前記受信した画 像データを前記記憶手段に記憶させる画像選択手段と、を備える。  [0123] As described above, the mobile terminal device of the present invention stores image data received from other mobile terminal devices, image data received from other mobile terminal devices, and storage means. Based on the comparison result of the image comparing means and the image comparing means, the received image data is stored in the storage means in accordance with a preset image selection criterion. Image selection means for storing.
[0124] この構成により、予め画像選択基準を設定しておけば、受信した画像データを、画 像選択基準にした力 優先度に応じて記憶させることができるため、メモリ容量を有効 活用するとともに、煩雑な操作を行うことなぐ所望の画像データを手軽に収集するこ とができる。例えば、他者が撮影した写真を自動的に受信し、ユーザにとって好まし い写真を判定し、優先的に記憶媒体に保存することにより、イベント等が進行してい るその場であっても、ユーザは、煩雑な操作を行うことなぐイベント等に集中したまま 、その場で手軽に所望の写真を収集できる。また、メモリ容量を有効活用しながら、所 望の写真を収集できる。  [0124] With this configuration, if image selection criteria are set in advance, the received image data can be stored according to the force priority set as the image selection criteria, so that the memory capacity can be used effectively. Therefore, it is possible to easily collect desired image data without performing complicated operations. For example, by automatically receiving photos taken by others, determining the photos that are preferred by the user, and preferentially saving them to a storage medium, even if the event is in progress, The user can easily collect desired photos on the spot while concentrating on events that do not require complicated operations. In addition, you can collect the photos you want while effectively using the memory capacity.
[0125] また、本発明の携帯端末装置は、前記画像選択手段が、前記画像比較手段の比 較結果に基づいて、予め設定した画像選択基準にしたがって、前記記憶手段に記 憶されて!/、る画像データを削除するものである。  [0125] Also, in the mobile terminal device of the present invention, the image selection means is stored in the storage means according to a preset image selection criterion based on the comparison result of the image comparison means! / The image data is deleted.
[0126] この構成により、記憶媒体に記憶されている画像データを画像選択基準にしたがう 優先度に応じて削除することにより、記憶域を節約できる。  With this configuration, the storage area can be saved by deleting the image data stored in the storage medium according to the priority according to the image selection criteria.
[0127] また、本発明の携帯端末装置は、前記画像選択手段が、優先度を付与する機能を 有し、付与された優先度に応じて、選択的に、前記受信した画像データを前記記憶 手段に記憶させたり、前記記憶手段に記憶されている画像データを削除したり、送信 対象の画像データを選択したりすることが可能である。 [0128] また、本発明の携帯端末装置は、前記画像選択基準を設定するポリシ設定手段を 備える。 [0127] Further, in the mobile terminal device of the present invention, the image selection means has a function of assigning priority, and selectively stores the received image data according to the assigned priority. The image data stored in the storage means, the image data stored in the storage means can be deleted, and the image data to be transmitted can be selected. [0128] Further, the mobile terminal device of the present invention includes policy setting means for setting the image selection criterion.
[0129] この構成により、ユーザは、入力や選択により、画像選択基準を自由に設定できる  [0129] With this configuration, the user can freely set image selection criteria by input or selection.
[0130] また、本発明の携帯端末装置は、前記記憶手段の空き容量を検出する容量検出 手段を備え、前記画像選択手段が、前記容量検出手段が検出した空き容量に応じ て、前記受信した画像データを前記記憶手段に記憶させるものである。 [0130] Further, the mobile terminal device of the present invention includes capacity detection means for detecting the free capacity of the storage means, and the image selection means receives the received data according to the free capacity detected by the capacity detection means. Image data is stored in the storage means.
[0131] この構成により、画像選択基準にしたがう優先度と記憶手段の空き容量とのバラン スを考慮して、所望の画像データをできるだけ多く収集することができる。  With this configuration, it is possible to collect as much desired image data as possible in consideration of the balance between the priority according to the image selection criterion and the free capacity of the storage unit.
[0132] また、本発明の携帯端末装置は、前記画像記憶手段の空き容量を検出する容量 検出手段を備え、前記画像選択手段が、前記容量検出手段が検出した空き容量に 応じて、前記記憶手段に記憶されてレ、る画像データを削除する。  [0132] Further, the mobile terminal device of the present invention includes capacity detection means for detecting a free capacity of the image storage means, and the image selection means performs the storage according to the free capacity detected by the capacity detection means. The image data stored in the means is deleted.
[0133] この構成により、画像選択基準にしたがう優先度と記憶手段の空き容量とのバラン スを考慮して、例えば、空き容量が減った場合には優先度の低い画像データを削除 して空き容量を増やすことができるため、より優先度の高い画像データをより多く収集 すること力 Sでさる。  [0133] With this configuration, considering the balance between the priority according to the image selection criteria and the free space of the storage means, for example, when the free space is reduced, the image data with low priority is deleted and freed up. Since the capacity can be increased, it is possible to collect more high-priority image data with the power S.
[0134] また、本発明の携帯端末装置は、撮像手段を備え、前記記憶手段が、自装置で撮 影した画像データを記憶する第一の記憶領域と、他の携帯端末装置から受信した画 像データを記憶する第二の記憶領域と、に分割されて!、るものである。  [0134] Further, the mobile terminal device of the present invention includes an imaging unit, and the storage unit stores a first storage area for storing image data captured by the device itself and an image received from another mobile terminal device. It is divided into a second storage area for storing image data!
[0135] この構成により、 自分が撮影した画像は確保(削除しない)しつつ、他者が撮った画 像で自分が撮影した画像より好ましいもの、例えば、 自分が持っていない構図の画質 がよレ、写真等を、できるだけ多く収集することが可能となる。  [0135] With this configuration, while securing (not deleting) images taken by yourself, images taken by others that are preferable to images taken by yourself, such as a composition that you do not have, are better. It is possible to collect as many photos and photos as possible.
[0136] また、本発明の携帯端末装置は、撮像手段を備え、前記記憶手段が、前記撮像手 段で撮影した画像データを、自端末装置で撮影された画像であることを示す識別情 報とともに記憶し、前記受信した画像データを、前記受信した画像データに付与され ている、!/、ずれの端末装置で撮影された画像である力、を示す識別情報とともに記憶 する。  [0136] In addition, the mobile terminal device of the present invention includes an imaging unit, and the storage unit is identification information indicating that the image data captured by the imaging unit is an image captured by the own terminal device. And the received image data is stored together with identification information indicating! /, Which is an image taken by a terminal device with a deviation, attached to the received image data.
[0137] また、本発明の携帯端末装置は、前記画像比較手段が、受信した画像データの付 加情報と、前記記憶手段に記憶されている画像データの付加情報とを比較する付加 情報比較手段を有するものである。 [0137] Further, in the mobile terminal device of the present invention, the image comparison means adds the received image data. Additional information comparing means for comparing the additional information with the additional information of the image data stored in the storage means is provided.
[0138] この構成により、例えば付加情報の一例であるメタ情報として、画像データの属性 情報や画像データの内容を示す情報を画像データに付与しておけば、画像選択基 準設定の自由度を向上でき、ユーザは所望する画像データを一層収集しやすくなる [0138] With this configuration, for example, by adding attribute information of image data and information indicating the content of image data to the image data as meta information that is an example of additional information, the degree of freedom in setting the image selection standard is increased. The user can collect the desired image data more easily.
[0139] また、本発明の携帯端末装置は、前記空き容量が予め定められた条件を満たす場 合には、前記画像比較手段による画像データの比較をスキップする。 [0139] Also, the portable terminal device of the present invention skips comparison of image data by the image comparison means when the free space satisfies a predetermined condition.
[0140] この構成により、画像データの比較をスキップすることで、送信先を限定したり、あら 力、じめ保存したい写真レコードの種類を限定できる。  [0140] With this configuration, by skipping the comparison of image data, it is possible to limit the destination, or to limit the types of photo records that you want to save.
[0141] また、本発明の携帯端末装置において、前記ポリシ設定手段は、前記画像比較手 段による画像データの比較をスキップするポリシを設定可能であり、前記画像選択手 段は、前記ポリシに従って、前記他の携帯端末装置から受信した画像データを保存 または破棄させる。  [0141] In addition, in the mobile terminal device of the present invention, the policy setting means can set a policy for skipping comparison of image data by the image comparison means, and the image selection means can be set according to the policy. The image data received from the other portable terminal device is saved or discarded.
[0142] この構成によれば、画像データ同士の比較に先だって、受信した画像データを取 捨選択するポリシを設定できるので、送信先を限定したり、あらかじめ保存したい画像 データの種類を限定できる。  [0142] According to this configuration, it is possible to set a policy for selecting received image data prior to comparison between image data, so that it is possible to limit the transmission destination and the type of image data to be stored in advance.
[0143] また、本発明の携帯端末装置において、前記ポリシ設定手段は、前記画像選択基 準として所定のグループ IDを設定可能であり、前記画像選択手段は、前記他の携帯 端末装置から受信した画像データに付与されているグループ IDが前記ポリシ設定手 段に設定されたグループ IDと同一か否かに応じて、前記他の携帯端末装置から受 信した画像データを保存または破棄させる。  [0143] Also, in the mobile terminal device of the present invention, the policy setting means can set a predetermined group ID as the image selection criterion, and the image selection means receives from the other mobile terminal device Depending on whether or not the group ID assigned to the image data is the same as the group ID set in the policy setting means, the image data received from the other portable terminal device is saved or discarded.
[0144] この構成によれば、受信した画像データに付与されているグループ IDがポリシ設定 手段に設定されたグループ IDと同一か否かに応じて、受信した画像データを保存ま たは破棄するので、煩雑な操作を行うことなぐ所望の画像データを手軽に収集する こと力 Sでさる。  [0144] According to this configuration, the received image data is saved or discarded depending on whether or not the group ID assigned to the received image data is the same as the group ID set in the policy setting means. Therefore, it is easy to collect the desired image data without performing complicated operations.
[0145] また、本発明の携帯端末装置において、前記グループ IDは、撮影者の識別情報、 イベント識別情報、場所識別情報、送信者または受信者が所属するグループ識別情 報、会場に設置されたビーコンから発信された信号情報、二次元コードから取得した 識別情報、および撮影した写真から生成した特徴点情報を含む。 [0145] In addition, in the mobile terminal device of the present invention, the group ID includes photographer identification information, event identification information, location identification information, and group identification information to which a sender or receiver belongs. Information, signal information transmitted from a beacon installed at the venue, identification information obtained from a two-dimensional code, and feature point information generated from a photograph taken.
[0146] この構成によれば、他の携帯端末装置から受信した画像データをグループ IDに応 じて自動的に記憶媒体に保存することができるので、イベント等が進行している会場 でユーザは煩雑な操作を行うことなぐイベント等に集中したままその場で手軽に所 望の画像データを収集できる。 [0146] According to this configuration, the image data received from another mobile terminal device can be automatically saved in the storage medium in accordance with the group ID. You can easily collect the desired image data on the spot while concentrating on events that do not require complicated operations.
[0147] また、本発明の携帯端末装置は、前記記憶手段の空き容量を検出する容量検出 手段を備え、前記画像選択手段は、前記空き容量の検出に応じて、前記他の携帯 端末装置から受信した画像データを保存させる。 [0147] In addition, the mobile terminal device of the present invention includes capacity detection means for detecting the free capacity of the storage means, and the image selection means is configured to detect the free capacity from the other mobile terminal device in response to the detection of the free capacity. Save the received image data.
[0148] この構成によれば、記憶手段に余裕があるうちは受信した画像データを無条件に 記憶することができるため、メモリ容量を有効活用することができる。また、煩雑な操 作を行うことなぐメモリ容量を有効活用しながら所望の画像データを手軽に収集する こと力 Sでさる。 [0148] According to this configuration, the received image data can be stored unconditionally as long as the storage means has room, so that the memory capacity can be effectively utilized. In addition, the user can easily collect desired image data while effectively utilizing the memory capacity without performing complicated operations.
[0149] また、本発明の携帯端末装置において、前記ポリシ設定手段は、前記画像選択基 準としてイベント IDを設定可能であり、前記画像選択手段は、前記他の携帯端末装 置から受信した画像データに付与されているイベント IDが前記ポリシ設定手段に設 定されたイベント IDと同一か否かに応じて、前記他の携帯端末装置から受信した画 像データを保存または破棄させる。  [0149] Further, in the mobile terminal device of the present invention, the policy setting means can set an event ID as the image selection criterion, and the image selection means can receive an image received from the other mobile terminal device. Depending on whether the event ID assigned to the data is the same as the event ID set in the policy setting means, the image data received from the other mobile terminal device is saved or discarded.
[0150] この構成によれば、受信した画像データに付与されているイベント IDがポリシ設定 手段に設定されたイベント IDと同一か否かに応じて、受信した画像データを保存また は破棄するので、煩雑な操作を行うことなく所望の画像データを手軽に収集すること ができる。  [0150] According to this configuration, the received image data is saved or discarded depending on whether or not the event ID assigned to the received image data is the same as the event ID set in the policy setting unit. Therefore, it is possible to easily collect desired image data without performing complicated operations.
[0151] また、本発明の携帯端末装置は、二次元コードを撮影してイベント IDを取得する撮 像手段を有し、前記ポリシ設定手段が、前記撮像手段により取得されたイベント IDを 前記画像選択基準として設定する。  [0151] Further, the mobile terminal device of the present invention has imaging means for capturing an event ID by capturing a two-dimensional code, and the policy setting means uses the event ID acquired by the imaging means as the image. Set as selection criteria.
[0152] この構成によれば、イベント IDにより画像選択基準を設定し、その画像選択基準に したがって、選択的に画像データの保存や破棄等を行うことが可能である。  [0152] According to this configuration, it is possible to set an image selection criterion based on an event ID, and selectively store or discard image data according to the image selection criterion.
[0153] また、本発明の携帯端末装置は、画像データを送信する携帯端末装置であって、 撮像手段と、新たに撮像した画像データと、記憶手段に記憶されている画像データと を比較する画像比較手段と、前記画像比較手段の比較結果に基づいて、予め設定 した画像選択基準にしたがって、送信対象の画像データを選択する画像選択手段と 、前記画像選択手段の選択結果に基づいて、他の携帯端末装置に画像データを送 信する画像送信手段とを備える。 [0153] The mobile terminal device of the present invention is a mobile terminal device that transmits image data, Based on the comparison result of the imaging means, the image comparison means for comparing the newly captured image data with the image data stored in the storage means, and the comparison result of the image comparison means, Image selection means for selecting image data to be transmitted, and image transmission means for transmitting image data to another portable terminal device based on a selection result of the image selection means.
[0154] この構成により、予め画像選択基準を設定しておけば、その画像選択基準にしたが つて、自装置で撮像した画像データのうち、他の携帯端末装置で所望されるであろう 画像データを選択して、送信することができるため、送信データ量を抑制しながら手 軽に画像データを共有することができる。例えば、自装置で新たに撮影した写真が、 自装置で以前に撮影した写真や他の携帯端末装置から受信した写真と比較して、 好ましい写真(ピンボケが少ない、構図が異なる等)である場合にのみ、送信すること ができるため、送信データ量を抑制しながら、好ましい画像データを手軽に共有する こと力 Sでさる。 [0154] With this configuration, if an image selection criterion is set in advance, among the image data captured by the own device in accordance with the image selection criterion, an image that may be desired by another mobile terminal device Since data can be selected and transmitted, image data can be easily shared while suppressing the amount of data to be transmitted. For example, when a new photo taken with your device is a better photo (less out of focus, composition is different, etc.) compared to a photo previously taken with your device or a photo received from another mobile terminal device Therefore, it is possible to easily share preferred image data while suppressing the amount of transmission data.
[0155] また、本発明の携帯端末装置は、前記撮像手段が、前記画像データを取得すると ともに、二次元コードを撮影してイベント IDを取得し、前記画像送信手段が、前記画 像データに前記イベント IDを付与して送信する。  [0155] In addition, in the mobile terminal device of the present invention, the imaging unit acquires the image data, and also captures an event ID by capturing a two-dimensional code, and the image transmission unit adds the image data to the image data. The event ID is given and transmitted.
[0156] この構成によれば、画像データにイベント IDを付与して送信するので、同一のィべ ント IDを持った携帯端末装置でしか受信できず、撮影した画像データを安心して送 信すること力 Sでさる。 [0156] According to this configuration, since the event ID is assigned to the image data for transmission, the image data can be received only by the mobile terminal device having the same event ID, and the captured image data can be transmitted with peace of mind. That's the power S.
[0157] また、本発明の携帯端末装置は、前記画像データが、カメラで撮影された写真の画 像データであり、前記画像比較手段が、写真の構図、被写体の表情、写真のピンぼ け度合い、写真の逆光度合レヽ又は各写真に写った人物の数の少なくとも!/、ずれかを 比較する。  [0157] In addition, in the mobile terminal device of the present invention, the image data is image data of a photograph taken by a camera, and the image comparison unit includes a composition of the photograph, a facial expression of the subject, and a defocus of the photograph. Compare at least! /, The degree, the degree of backlighting of the photos, or the number of people in each photo.
[0158] この構成によれば、以下のいずれかを実現可能である。すなわち、同じ構図の写真 を優先して収集したり、逆に異なる構図の写真を優先して収集することができる。また 、より好ましい表情(目をつむっていない、笑顔である、すましている等)の写真だけを 優先的に収集したり、変わった表情の写真を優先して収集できる。また、ピンぼけの 少な!/ヽ画像だけを優先的に収集できるようになる。また、逆光の少なレ、画像だけを優 先的に収集できるようになる。また、被写体人数の多い集合写真や、人物が写ってい ない背景写真の画像だけを優先的に収集できるようになる。 [0158] According to this configuration, any of the following can be realized. In other words, photos with the same composition can be preferentially collected, and conversely, photos with different compositions can be preferentially collected. In addition, it is possible to preferentially collect only photographs with more preferable facial expressions (such as eyes that are not closed, a smile, or a smile), or preferentially collect photographs with unusual facial expressions. In addition, it will be possible to preferentially collect only images with little blur! Also, only images with low backlighting and images are excellent. It can be collected first. In addition, it is possible to preferentially collect only group photos with a large number of subjects and background photos that do not contain people.
[0159] また、本発明の画像選択方法は、携帯端末装置における画像選択方法であって、 他の携帯端末装置から画像データを受信するステップと、他の携帯端末装置から受 信した画像データと、記憶手段に記憶されて!/、る画像データとを比較するステップと 、前記画像比較手段の比較結果に基づいて、予め設定した画像選択基準にしたが つて、前記受信した画像データを前記記憶手段に記憶させるステップと、を備える。  [0159] Further, the image selection method of the present invention is an image selection method in a mobile terminal device, the step of receiving image data from another mobile terminal device, the image data received from another mobile terminal device, and Comparing the received image data according to a preset image selection criterion based on a comparison result of the image comparing means and a comparison result of the image comparing means stored in the storage means! Storing in the means.
[0160] この構成により、予め画像選択基準を設定しておけば、受信した画像データを、画 像比較手段の比較結果に基づいて、その画像選択基準にしたがって、記憶させるこ とができるため、メモリ容量を有効活用するとともに、煩雑な操作を行うことなぐ所望 の画像データを手軽に収集することができる。例えば、他者が撮影した写真を自動 的に受信し、ユーザにとって好ましい写真を判定し、優先的に記憶媒体に保存する ことにより、イベント等が進行しているその場であっても、ユーザは、煩雑な操作を行う ことなく、イベント等に集中したまま、その場で手軽に所望の写真を収集できる。また 、メモリ容量を有効活用しながら、所望の写真を収集できる。  [0160] With this configuration, if image selection criteria are set in advance, the received image data can be stored according to the image selection criteria based on the comparison result of the image comparison means. In addition to making effective use of memory capacity, desired image data can be easily collected without complicated operations. For example, by automatically receiving photos taken by others, determining the photos that are preferred for the user, and preferentially saving them to a storage medium, the user will be able to use the event even when the event is in progress. It is possible to easily collect desired photos on the spot while concentrating on events without performing complicated operations. In addition, a desired photograph can be collected while effectively utilizing the memory capacity.
[0161] また、本発明の画像選択方法は、携帯端末装置における画像選択方法であって、 第一の画像データを受信するステップと、前記第一の画像データと、受信済みの第 二の画像データを比較し、同じ構図かどうか判定するステップと、前記第一と第二の 画像データが同じ構図の場合に、前記第一の画像を破棄し、同じ構図でない場合に は、前記第一の画像データを保存するステップとを有する。  [0161] Further, the image selection method of the present invention is an image selection method in a mobile terminal device, the step of receiving first image data, the first image data, and the received second image. Comparing the data and determining whether the composition is the same; if the first and second image data have the same composition, discard the first image; if not, the first composition Storing image data.
[0162] この構成により、画像を共有したいと思うユーザ同士が、画像をサーバへアップロー ドして相手にダウンロードさせたり、メモリーカードの交換などの煩わしい作業をするこ となぐイベント等の撮影に集中したまま、異なる構図の写真を優先的に共有できると ともに、記憶域の節約を行うことができる。  [0162] With this configuration, users who want to share images can upload images to the server, download them to the other party, and take pictures of events and other troublesome tasks such as exchanging memory cards. While concentrating, you can preferentially share photos with different compositions and save storage space.
[0163] また、本発明の画像選択方法は、前記第一と第二の画像データが同じ構図の場合 には、前記第一と第二の画像の表情を抽出し、抽出した表情が所定のポリシに該当 するか判断するステップと、前記第一の画像の表情が所定のポリシに該当する場合 は、前記第一の画像データを破棄し、前記第二の画像の表情が所定のポリシに該当 する場合は、前記第二の画像データを破棄し、前記第一の画像データを保存するス テツプとを有する。 [0163] Also, in the image selection method of the present invention, when the first and second image data have the same composition, the facial expressions of the first and second images are extracted, and the extracted facial expressions are predetermined. A step of determining whether or not the policy corresponds to a policy, and if the facial expression of the first image corresponds to a predetermined policy, the first image data is discarded, and the facial expression of the second image corresponds to the predetermined policy A step of discarding the second image data and storing the first image data.
[0164] この構成により、画像を共有したいと思うユーザ同士が、画像をサーバへアップロー ドして相手にダウンロードさせたり、メモリーカードの交換などの煩わしい作業をするこ となぐイベント等の撮影に集中したまま、異なる構図、表情のよい写真を優先的に共 有でき、同時に記憶域の節約を行うことができる。  [0164] With this configuration, users who want to share images can upload images to the server and download them to the other party, or take pictures of events and other troublesome tasks such as exchanging memory cards. While concentrating, you can preferentially share photos with different compositions and expressions, and at the same time save storage space.
[0165] また、本発明は、携帯端末装置における画像選択方法であって、第一の画像デー タを受信するステップと、受信済みの画像データから前記第一の画像データと近レ、 時間に撮影された第二の画像データを検索するステップと、前記第二の画像データ が存在する場合に、前記第一と第二の画像データの逆光度合いを比較し、前記第 一の画像データの逆光度合いが高い場合に、前記第一の画像データを破棄し、前 記第二の画像データの逆光度合!/、が高!/、場合に、前記第二の画像データを破棄し 、前記第一の画像データを保存するステップと、前記第二の画像データが存在しな V、場合に、前記第一の画像データを保存するステップとを有する画像選択方法であ  [0165] Further, the present invention is an image selection method in a mobile terminal device, the step of receiving first image data, and the first image data from the received image data at a time close to the first image data. A step of retrieving the captured second image data; and when the second image data is present, the backlight levels of the first image data are compared by comparing the backlight levels of the first and second image data. When the degree is high, the first image data is discarded, and when the degree of backlighting of the second image data is high! /, The second image data is discarded, and the first image data is discarded. An image selection method, and a step of storing the first image data if the second image data does not exist.
[0166] この構成により、画像を共有したいと思うユーザ同士が、画像をサーバへアップロー ドして相手にダウンロードさせたり、メモリーカードの交換などの煩わしい作業をするこ となぐイベント等の撮影に集中したまま、近接した時間に撮影された写真の中からも つとも逆光度合いの低い写真を優先的に共有でき、同時に記憶域の節約を行うこと ができる。 [0166] With this configuration, users who want to share an image can upload images to the server and download them to the other party, or take pictures of events and other troublesome tasks such as exchanging memory cards. You can preferentially share photos with low backlighting from photos taken in close proximity while concentrating, and at the same time save storage space.
[0167] また、本発明の画像選択方法は、前記画像データを記憶する領域の空き容量に応 じて、選択的に、前記第一の画像データを記憶または削除するステップを有する。  [0167] Further, the image selection method of the present invention includes a step of selectively storing or deleting the first image data in accordance with a free space in an area for storing the image data.
[0168] この構成により、空き容量を考慮して、所望の画像データをできるだけ多く収集する こと力 Sでさる。  [0168] With this configuration, it is possible to collect as much desired image data as possible in consideration of the free space.
[0169] また、本発明の携帯端末装置は、画像データを送信する携帯端末装置であって、 撮像手段と、新たに撮像した画像データと、記憶手段に記憶されている画像データと を比較する画像比較手段と、前記画像比較手段の比較結果に基づいて、前記新た に撮像した画像データに、予め設定した画像選択基準にしたがって優先度を付与す る機能を有し、付与された優先度に応じて、送信対象の画像データを選択する画像 選択手段と、前記画像選択手段の選択結果に基づいて、他の携帯端末装置に画像 データを送信する画像送信手段と、を備える。 [0169] Further, the mobile terminal device of the present invention is a mobile terminal device that transmits image data, and compares the imaging means, the newly captured image data, and the image data stored in the storage means. Based on a comparison result between the image comparison unit and the image comparison unit, a priority is given to the newly captured image data in accordance with a preset image selection criterion. An image selection unit that selects image data to be transmitted according to the assigned priority, and transmits the image data to another mobile terminal device based on a selection result of the image selection unit. Image transmission means.
[0170] この構成により、予め画像選択基準を設定しておけば、画像選択基準にしたがう優 先度に応じて、自装置で撮像した画像データのうち、他の携帯端末装置で所望され るであろう画像データを選択して、送信することができるため、送信データ量を抑制し ながら手軽に画像データを共有することができる。例えば、自装置で新たに撮影した 写真が、自装置で以前に撮影した写真や他の携帯端末装置から受信した写真と比 較して、好ましい写真(ピンボケが少ない、構図が異なる等)である場合にのみ、送信 すること力 Sできるため、送信データ量を抑制しながら、好ましい画像データを手軽に 共有すること力 Sでさる。 [0170] With this configuration, if the image selection criterion is set in advance, the image data captured by the own device may be desired by another mobile terminal device according to the priority according to the image selection criterion. Since it is possible to select and transmit image data, it is possible to easily share image data while suppressing the amount of transmission data. For example, a new photo taken by the device is a preferable photo (less out of focus, composition is different, etc.) compared to a photo previously taken by the device or a photo received from another mobile terminal device. Only in this case, the transmission power S can be reduced. Therefore, it is possible to easily share preferable image data while suppressing the amount of transmission data.
[0171] 本発明を詳細にまた特定の実施態様を参照して説明したが、本発明の精神と範囲 を逸脱することなく様々な変更や修正を加えることができることは当業者にとって明ら 力、である。  [0171] Although the invention has been described in detail and with reference to specific embodiments, it will be apparent to those skilled in the art that various changes and modifications can be made without departing from the spirit and scope of the invention. It is.
本出願は、 2006年 12月 15日出願の日本特許出願(特願 2006— 337998)に基づくも のであり、その内容はここに参照として取り込まれる。  This application is based on a Japanese patent application filed on December 15, 2006 (Japanese Patent Application No. 2006-337998), the contents of which are incorporated herein by reference.
産業上の利用可能性  Industrial applicability
[0172] 本発明によれば、予め画像選択基準を設定しておけば、受信した画像データを、 優先度に応じて選択的に記憶させることができるため、メモリ容量を有効活用するとと もに、煩雑な操作を行うことなぐ所望の画像データを手軽に収集することができる効 果を有し、通信機能を備える携帯端末装置および画像選択方法等に有用である。 [0172] According to the present invention, if image selection criteria are set in advance, the received image data can be selectively stored according to the priority, so that the memory capacity can be effectively utilized. Therefore, it has an effect of easily collecting desired image data without performing complicated operations, and is useful for a portable terminal device having a communication function, an image selection method, and the like.

Claims

請求の範囲 The scope of the claims
[1] 他の携帯端末装置から画像データを受信する画像受信手段と、  [1] Image receiving means for receiving image data from another mobile terminal device;
他の携帯端末装置から受信した画像データと、記憶手段に記憶されている画像デ 一タとを比較する画像比較手段と、  Image comparison means for comparing image data received from another portable terminal device with image data stored in the storage means;
前記画像比較手段の比較結果に基づ!/、て、予め設定した画像選択基準にしたが つて、前記受信した画像データを前記記憶手段に記憶させる画像選択手段と、 を備える携帯端末装置。  A portable terminal device comprising: an image selection unit that stores the received image data in the storage unit according to a preset image selection criterion based on a comparison result of the image comparison unit.
[2] 請求項 1記載の携帯端末装置であって、 [2] The mobile terminal device according to claim 1,
前記画像選択手段は、前記画像比較手段の比較結果に基づいて、予め設定した 画像選択基準にしたがって、前記記憶手段に記憶されている画像データを削除する 携帯端末装置。  The portable terminal device, wherein the image selection unit deletes image data stored in the storage unit in accordance with a preset image selection criterion based on a comparison result of the image comparison unit.
[3] 請求項 1記載の携帯端末装置であって、 [3] The mobile terminal device according to claim 1,
前記画像選択基準を設定するポリシ設定手段を備える携帯端末装置。  A portable terminal device comprising policy setting means for setting the image selection criteria.
[4] 請求項 1記載の携帯端末装置であって、 [4] The mobile terminal device according to claim 1,
前記記憶手段の空き容量を検出する容量検出手段を備え、  Capacity detecting means for detecting the free capacity of the storage means,
前記画像選択手段は、前記容量検出手段が検出した空き容量に応じて、前記受 信した画像データを前記記憶手段に記憶させる携帯端末装置。  The portable terminal device in which the image selection means stores the received image data in the storage means according to the free space detected by the capacity detection means.
[5] 請求項 2記載の携帯端末装置であって、 [5] The mobile terminal device according to claim 2,
前記画像記憶手段の空き容量を検出する容量検出手段を備え、  Capacity detecting means for detecting the free capacity of the image storage means,
前記画像選択手段は、前記容量検出手段が検出した空き容量に応じて、前記記 憶手段に記憶されている画像データを削除する携帯端末装置。  The mobile terminal device, wherein the image selection means deletes image data stored in the storage means according to the free space detected by the capacity detection means.
[6] 請求項 1記載の携帯端末装置であって、 [6] The mobile terminal device according to claim 1,
撮像手段を備え、  Comprising imaging means,
前記記憶手段は、自装置で撮影した画像データを記憶する第一の記憶領域と、他 の携帯端末装置から受信した画像データを記憶する第二の記憶領域と、に分割され ている携帯端末装置。  The storage means is divided into a first storage area for storing image data captured by the own apparatus and a second storage area for storing image data received from another mobile terminal apparatus. .
[7] 請求項 1記載の携帯端末装置であって、 [7] The mobile terminal device according to claim 1,
撮像手段を備え、 前記記憶手段は、前記撮像手段で撮影した画像データを、 自端末装置で撮影され た画像であることを示す識別情報とともに記憶し、前記受信した画像データを、前記 受信した画像データに付与されて!/、る、 V、ずれの端末装置で撮影された画像である かを示す識別情報とともに記憶する携帯端末装置。 Comprising imaging means, The storage means stores the image data captured by the imaging means together with identification information indicating that the image is captured by the terminal device, and the received image data is added to the received image data. ! /, Ru, v, portable terminal device that stores together with identification information indicating whether the image was taken by a misplaced terminal device.
[8] 請求項 1記載の携帯端末装置であって、 [8] The mobile terminal device according to claim 1,
前記画像比較手段は、受信した画像データの付加情報と、前記記憶手段に記憶さ れている画像データの付加情報とを比較する付加情報比較手段を有する携帯端末 装置。  The mobile terminal device, wherein the image comparison means includes additional information comparison means for comparing the additional information of the received image data with the additional information of the image data stored in the storage means.
[9] 請求項 4記載の携帯端末装置であって、  [9] The mobile terminal device according to claim 4,
前記空き容量が予め定められた条件を満たす場合には、前記画像比較手段による 画像データの比較をスキップする携帯端末装置。  A portable terminal device that skips comparison of image data by the image comparison means when the free space satisfies a predetermined condition.
[10] 請求項 5記載の携帯端末装置であって、 [10] The mobile terminal device according to claim 5,
前記空き容量が予め定められた条件を満たす場合には、前記画像比較手段による 画像データの比較をスキップする携帯端末装置。  A portable terminal device that skips comparison of image data by the image comparison means when the free space satisfies a predetermined condition.
[11] 請求項 8記載の携帯端末装置であって、 [11] The mobile terminal device according to claim 8,
受信した画像データの付加情報が予め定められた条件を満たす場合には、前記画 像比較手段による画像データの比較をスキップする携帯端末装置。  A portable terminal device that skips comparison of image data by the image comparison means when additional information of received image data satisfies a predetermined condition.
[12] 請求項 3記載の携帯端末装置であって、 [12] The mobile terminal device according to claim 3,
前記ポリシ設定手段は、前記画像比較手段による画像データの比較をスキップする ポリシを設定可能であり、  The policy setting means can set a policy for skipping comparison of image data by the image comparison means,
前記画像選択手段は、前記ポリシに従って、前記他の携帯端末装置から受信した 画像データを保存または破棄させる携帯端末装置。  The mobile terminal device that saves or discards image data received from the other mobile terminal device according to the policy.
[13] 請求項 12記載の携帯端末装置であって、 [13] The mobile terminal device according to claim 12,
前記ポリシ設定手段は、前記画像選択基準として所定のグループ IDを設定可能で あり、  The policy setting means can set a predetermined group ID as the image selection criterion,
前記画像選択手段は、前記他の携帯端末装置から受信した画像データに付与さ れているグループ IDが前記ポリシ設定手段に設定されたグループ IDと同一か否か に応じて、前記他の携帯端末装置から受信した画像データを保存または破棄させる 携帯端末装置。 The image selection means determines whether the group ID assigned to the image data received from the other portable terminal device is the same as the group ID set in the policy setting means. Save or discard image data received from the device Mobile terminal device.
[14] 請求項 13記載の携帯端末装置であって、  [14] The mobile terminal device according to claim 13,
前記グループ IDは、撮影者の識別情報、イベント識別情報、場所識別情報、送信 者または受信者が所属するグループ識別情報、会場に設置されたビーコンから発信 された信号情報、二次元コードから取得した識別情報、および撮影した写真から生 成した特徴点情報を含む携帯端末装置。  The group ID is obtained from photographer identification information, event identification information, location identification information, group identification information to which the sender or receiver belongs, signal information transmitted from a beacon installed at the venue, and a two-dimensional code. A mobile terminal device including identification information and feature point information generated from a photograph taken.
[15] 請求項 12記載の携帯端末装置であって、  [15] The mobile terminal device according to claim 12,
前記記憶手段の空き容量を検出する容量検出手段を備え、  Capacity detecting means for detecting the free capacity of the storage means,
前記画像選択手段は、前記空き容量の検出に応じて、前記他の携帯端末装置から 受信した画像データを保存させる携帯端末装置。  The mobile terminal device that stores the image data received from the other mobile terminal device in response to the detection of the free space.
[16] 請求項 13記載の携帯端末装置であって、  [16] The mobile terminal device according to claim 13,
前記ポリシ設定手段は、前記画像選択基準としてイベント IDを設定可能であり、 前記画像選択手段は、前記他の携帯端末装置から受信した画像データに付与され ているイベント IDが前記ポリシ設定手段に設定されたイベント IDと同一か否かに応じ て、前記他の携帯端末装置力 受信した画像データを保存または破棄させる携帯端 未 。  The policy setting means can set an event ID as the image selection criterion, and the image selection means sets an event ID given to image data received from the other portable terminal device in the policy setting means. Depending on whether or not the received event ID is the same as the received event ID, the mobile terminal device that stores or discards the received image data.
[17] 請求項 16記載の携帯端末装置であって、  [17] The mobile terminal device according to claim 16,
二次元コードを撮影してイベント IDを取得する撮像手段を有し、  It has an imaging means to capture the event ID by shooting the two-dimensional code,
前記ポリシ設定手段は、前記撮像手段により取得されたイベント IDを前記画像選 択基準として設定する携帯端末装置。  The policy setting means is a portable terminal device that sets the event ID acquired by the imaging means as the image selection criterion.
[18] 画像データを送信する携帯端末装置であって、  [18] A mobile terminal device for transmitting image data,
撮像手段と、  Imaging means;
新たに撮像した画像データと、記憶手段に記憶されている画像データとを比較する 画像比較手段と、  Image comparison means for comparing newly captured image data and image data stored in the storage means;
前記画像比較手段の比較結果に基づ!/、て、予め設定した画像選択基準にしたが つて、送信対象の画像データを選択する画像選択手段と、  Based on the comparison result of the image comparison means! /, Image selection means for selecting image data to be transmitted in accordance with preset image selection criteria;
前記画像選択手段の選択結果に基づいて、他の携帯端末装置に画像データを送 信する画像送信手段と、 を備える携帯端末装置。 An image transmitting means for transmitting image data to another portable terminal device based on a selection result of the image selecting means; A mobile terminal device comprising:
請求項 18記載の携帯端末装置であって、  The mobile terminal device according to claim 18, wherein
前記撮像手段は、前記画像データを取得するとともに、二次元コードを撮影してィ ベント IDを取得し、  The imaging means acquires the image data, captures a two-dimensional code, acquires an event ID,
前記画像送信手段は、前記画像データに前記イベント IDを付与して送信する、携 帯端末装置。  The image transmitting means is a portable terminal device that transmits the image data with the event ID assigned thereto.
請求項 1記載の携帯端末装置であって、  The mobile terminal device according to claim 1, wherein
前記画像データは、カメラで撮影された写真の画像データであり、  The image data is image data of a photograph taken with a camera,
前記画像比較手段は、写真の構図、被写体の表情、写真のピンぼけ度合い、写真 の逆光度合い又は各写真に写った人物の数の少なくともいずれかを比較する携帯 端末装置。  The mobile terminal device that compares at least one of a composition of a photograph, a facial expression of a subject, a degree of defocusing of a photograph, a degree of backlighting of a photograph, or the number of persons photographed in each photograph.
携帯端末装置における画像選択方法であって、  An image selection method in a mobile terminal device,
他の携帯端末装置から画像データを受信するステップと、  Receiving image data from another mobile terminal device;
他の携帯端末装置から受信した画像データと、記憶手段に記憶されている画像デ 一タとを比較するステップと、  Comparing image data received from another portable terminal device with image data stored in the storage means;
前記画像比較手段の比較結果に基づ!/、て、予め設定した画像選択基準にしたが つて、前記受信した画像データを前記記憶手段に記憶させるステップと、  Based on the comparison result of the image comparison means! /, And storing the received image data in the storage means according to a preset image selection criterion;
を備える画像選択方法。  An image selection method comprising:
携帯端末装置における画像選択方法であって、  An image selection method in a mobile terminal device,
第一の画像データを受信するステップと、  Receiving first image data; and
前記第一の画像データと、受信済みの第二の画像データを比較し、同じ構図かどう 前記第一と第二の画像データが同じ構図の場合に、前記第一の画像を破棄し、同 じ構図でなレ、場合には、前記第一の画像データを保存するステップとを有する画像 選択方法。  The first image data is compared with the received second image data. If the first and second image data have the same composition, the first image is discarded. An image selection method comprising: storing the first image data in a case where the composition is not in the same composition.
請求項 22記載の画像選択方法であって、  The image selection method according to claim 22, wherein
前記第一と第二の画像データが同じ構図の場合には、前記第一と第二の画像の表 前記第一の画像の表情が所定のポリシに該当する場合は、前記第一の画像デー タを破棄し、前記第二の画像の表情が所定のポリシに該当する場合は、前記第二の 画像データを破棄し、前記第一の画像データを保存するステップとを有する画像選 択方法。 When the first and second image data have the same composition, the first and second image tables are displayed. When the expression of the first image corresponds to a predetermined policy, the first image data is discarded, and when the expression of the second image corresponds to a predetermined policy, the second image Discarding data and storing the first image data.
[24] 携帯端末装置における画像選択方法であって、  [24] An image selection method in a mobile terminal device,
第一の画像データを受信するステップと、  Receiving first image data; and
受信済みの画像データから前記第一の画像データと近い時間に撮影された第二 の画像データを検索するステップと、  Retrieving second image data taken at a time close to the first image data from received image data;
前記第二の画像データが存在する場合に、前記第一と第二の画像データの逆光 度合いを比較し、前記第一の画像データの逆光度合いが高い場合に、前記第一の 画像データを破棄し、前記第二の画像データの逆光度合いが高い場合に、前記第 二の画像データを破棄し、前記第一の画像データを保存するステップと、  When the second image data exists, the backlight levels of the first and second image data are compared. When the backlight level of the first image data is high, the first image data is discarded. And, when the second image data has a high degree of backlighting, discarding the second image data and storing the first image data;
前記第二の画像データが存在しなレ、場合に、前記第一の画像データを保存するス テツプとを有する画像選択方法。  And a step of storing the first image data when the second image data does not exist.
[25] 請求項 21ないし 24のいずれか一項に記載の画像選択方法であって、 [25] The image selection method according to any one of claims 21 to 24,
前記画像データを記憶する領域の空き容量に応じて、選択的に、前記第一の画像 データを記憶または削除するステップを有する画像選択方法。  An image selection method comprising a step of selectively storing or deleting the first image data in accordance with a free space in an area for storing the image data.
PCT/JP2007/073921 2006-12-15 2007-12-12 Mobile terminal device, and image selecting method WO2008072653A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2006337998 2006-12-15
JP2006-337998 2006-12-15

Publications (1)

Publication Number Publication Date
WO2008072653A1 true WO2008072653A1 (en) 2008-06-19

Family

ID=39511670

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2007/073921 WO2008072653A1 (en) 2006-12-15 2007-12-12 Mobile terminal device, and image selecting method

Country Status (1)

Country Link
WO (1) WO2008072653A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011234321A (en) * 2010-04-30 2011-11-17 Canon Inc Imaging device, control method of the same, and program
JP2012227814A (en) * 2011-04-21 2012-11-15 Sony Corp Electronic device, method of controlling the same, and program
JP6909902B1 (en) * 2020-06-24 2021-07-28 Kddi株式会社 Image management device, image management system and image management method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11220691A (en) * 1998-02-02 1999-08-10 Casio Comput Co Ltd Image depositing apparatus and image depositing method
JP2001333365A (en) * 2000-05-19 2001-11-30 Olympus Optical Co Ltd Electronic camera and recording medium
JP2006115062A (en) * 2004-10-13 2006-04-27 Konica Minolta Photo Imaging Inc Photographing device
JP2006166409A (en) * 2004-11-09 2006-06-22 Canon Inc Data processing apparatus and control method thereof
JP2006520496A (en) * 2003-02-28 2006-09-07 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ How to share files between user stations on a network
JP2006295509A (en) * 2005-04-08 2006-10-26 Sharp Corp Device and method for managing electronic information, computer program, and recording medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11220691A (en) * 1998-02-02 1999-08-10 Casio Comput Co Ltd Image depositing apparatus and image depositing method
JP2001333365A (en) * 2000-05-19 2001-11-30 Olympus Optical Co Ltd Electronic camera and recording medium
JP2006520496A (en) * 2003-02-28 2006-09-07 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ How to share files between user stations on a network
JP2006115062A (en) * 2004-10-13 2006-04-27 Konica Minolta Photo Imaging Inc Photographing device
JP2006166409A (en) * 2004-11-09 2006-06-22 Canon Inc Data processing apparatus and control method thereof
JP2006295509A (en) * 2005-04-08 2006-10-26 Sharp Corp Device and method for managing electronic information, computer program, and recording medium

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011234321A (en) * 2010-04-30 2011-11-17 Canon Inc Imaging device, control method of the same, and program
JP2012227814A (en) * 2011-04-21 2012-11-15 Sony Corp Electronic device, method of controlling the same, and program
JP6909902B1 (en) * 2020-06-24 2021-07-28 Kddi株式会社 Image management device, image management system and image management method
JP2022006723A (en) * 2020-06-24 2022-01-13 Kddi株式会社 Image management device, image management system and image management method

Similar Documents

Publication Publication Date Title
US10459968B2 (en) Image processing system and image processing method
US8810684B2 (en) Tagging images in a mobile communications device using a contacts list
US9253340B2 (en) Wireless camera with image sharing prioritization
US7714911B2 (en) Image pickup apparatus having communication function, method for controlling the same, and computer-readable storage medium
CN103945130B (en) The image acquisition method of electronic equipment and electronic equipment
US20130120592A1 (en) Method for wireless sharing of images
JP2005267146A (en) Method and device for creating email by means of image recognition function
TW201516939A (en) Method and device for inquiring user identity, method and device for acquiring user identity, and method and device for adding friend in instant messaging
JP2007116658A (en) Image assembly creating system, image assembly creating method and image assembly creating program
JP2008165700A (en) Image processing apparatus, electronic device, image processing system, image processing method, and program
JP2007334696A (en) Data sharing system, communication terminal and server
CN100486300C (en) Photographed image transmitting apparatus
JP2014067131A (en) Image processing apparatus, image processing system, image processing method, and computer program
JP2011082913A (en) Imaging apparatus, imaging method and imaging program
JP2004280254A (en) Content classification method and apparatus
WO2008072653A1 (en) Mobile terminal device, and image selecting method
WO2018092378A1 (en) Information processing device, information processing method, and program
JP2004356985A (en) Camera photographing device and program
KR20090044313A (en) Method and system of photography service using robot
JP2019180017A (en) Image processing device, imaging device, image processing method, and program
KR20060098524A (en) Complaint Complaint System Using Mobile Communication Terminal and Its Operation Method
US20160189412A1 (en) Image processing apparatus for generating a new moving image from a moving image
JP5635253B2 (en) Network camera
KR20110139441A (en) How to share image content via network
KR101619091B1 (en) Method for transmitting image and image pickup apparatus applying the same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07850472

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07850472

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP