JP2008027336A - Location information delivery apparatus, camera, location information delivery method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide means for efficiently sharing and distributing shooting location data while ensuring the secrecy of shooting locations. <P>SOLUTION: A location information delivery apparatus comprises a communication part for data transmission and reception, a recording part, an image processing part, a view control part, an authentication part and a delivery part. The recording part records and associates captured image data and location data. The image processing part executes masking to protect captured images partly from disclosure. The view control part makes the captured image data after masking viewable to terminal devices connected via the communication part, and makes the location data after masking secret. The authentication part authenticates terminal devices in accordance with authentication information acquired from the terminal devices. The delivery part sends to terminal devices authenticated by the authentication part the location data corresponding to captured images designated by the terminal devices. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a position information distribution device, a camera, a position information distribution method, and a program suitable for sharing and distribution of shooting positions of captured images.

In recent years, electronic cameras that electronically record subject images using an image sensor have been rapidly spreading. In such an electronic camera, shooting position data acquired by a GPS (Global Positioning System) can be recorded together with the shot image data. For example, Patent Literature 1 discloses a data search apparatus that manages captured image data and shooting position data in association with each other using tags of the Exif (Exchangeable image file format for digital still cameras) standard.
JP 2001-282814 A

By the way, depending on the subject to be photographed, such as a natural object with high preciousness and cashability (such as a natural matsutake mushroom), the photographing position data may have a high exchange value. When considering the business of distributing the shooting position information for the subject as described above, it is necessary to ensure the secrecy of the shooting position data while releasing the shot image data on the Internet or the like.
However, when the shooting position data is managed using the Exif standard tag as in the above-mentioned Patent Document 1, the shooting position can be easily known by acquiring the shooting image data by downloading, so the confidentiality of the shooting position is ensured. Can not.

  The present invention is for solving the above-described problems of the prior art, and its purpose is to provide means capable of efficiently sharing and distributing shooting position data while ensuring the confidentiality of the shooting position. It is to be.

  According to a first aspect of the present invention, there is provided a position information distribution device including a communication unit that transmits and receives data, a first recording unit, an image processing unit, a browsing control unit, an authentication unit, and a distribution unit. The first recording unit records the captured image data and the position data related to the captured position of the captured image in association with each other. The image processing unit performs a mask process that partially prevents disclosure of the captured image on the captured image data. The browsing control unit makes the captured image data after the mask processing in a state where it can be browsed with respect to the terminal device connected via the communication unit, and sets the position data after the mask processing in a concealed state. The authentication unit authenticates the terminal device based on the authentication information acquired from the terminal device. The distribution unit transmits position data corresponding to the captured image designated by the terminal device to the terminal device authenticated by the authentication unit.

  A position information distribution apparatus according to a second aspect includes a communication unit that performs data transmission / reception, a recording unit, a grouping processing unit, a browsing control unit, an authentication unit, and a distribution unit. The recording unit records the photographed image data and the position data related to the photographing position of the photographed image in association with each other. The grouping processing unit groups data and position data of a plurality of captured images having relevance. A browsing control part makes the state which can browse the data of a picked-up image with respect to the terminal device connected via the communication part, and makes a positional data secret state. The authentication unit authenticates the terminal device based on the authentication information acquired from the terminal device. The distribution unit transmits position data corresponding to the captured image designated by the terminal device to the terminal device authenticated by the authentication unit. Further, the distribution unit transmits the grouped captured image data and position data to the terminal device.

  A location information distribution device according to a third aspect of the present invention includes a communication unit that transmits and receives data, a recording unit, a keyword adding unit, a browsing control unit, an authentication unit, and a distribution unit. The recording unit records the photographed image data and the position data related to the photographing position of the photographed image in association with each other. The keyword adding unit records the keyword in association with the captured image data based on the position data. A browsing control part makes the state which can browse the data of a picked-up image with respect to the terminal device connected via the communication part, and makes a positional data secret state. The authentication unit authenticates the terminal device based on the authentication information acquired from the terminal device. The distribution unit transmits position data corresponding to the captured image designated by the terminal device to the terminal device authenticated by the authentication unit. And a browsing control part searches the data of the picked-up image recorded on the recording part based on the keyword, and shows a search result with respect to a terminal device.

  According to a fourth aspect of the present invention, there is provided a position information distribution apparatus including a communication unit that performs data transmission / reception, a recording unit, a browsing control unit, an authentication unit, a distribution unit, a change unit, and a price change unit. The recording unit records the captured image data in association with the position data including the map image indicating the captured position of the captured image and the price used for the charging process. A browsing control part makes the state which can browse the data of a picked-up image with respect to the terminal device connected via the communication part, and makes a positional data secret state. The authentication unit authenticates the terminal device based on the authentication information acquired from the terminal device. The distribution unit transmits position data corresponding to the captured image designated by the terminal device to the terminal device authenticated by the authentication unit. The changing unit changes the scale or resolution of the map image transmitted to the terminal device in response to an operation from the terminal device. The price changing unit resets the price at the time of the change so that the price increases in proportion to the scale size or the height of the resolution.

  A camera of a fifth invention includes an imaging unit, a position data generation unit, and an image processing unit. The imaging unit captures a subject and generates captured image data. The position data generation unit generates position data related to the shooting position of the shot image and associates the position data with the data of the shot image. The image processing unit performs a mask process that partially prevents disclosure of the captured image on the captured image data.

  A camera according to a sixth aspect includes an imaging unit, a position data generation unit, and a grouping processing unit. The imaging unit captures a subject and generates captured image data. The position data generation unit generates position data related to the shooting position of the shot image and associates the position data with the data of the shot image. The grouping processing unit groups data and position data of a plurality of photographed images having relevance with reference to the photographing position.

  A camera according to a seventh aspect includes an imaging unit, a position data generation unit, and a keyword addition unit. The imaging unit captures a subject and generates captured image data. The position data generation unit generates position data related to the shooting position of the shot image and associates the position data with the data of the shot image. The keyword adding unit records the keyword in association with the captured image data based on the position data.

  An eighth invention is a position information distribution method using a computer including a communication unit that performs data transmission / reception, a recording unit, and a control unit. This position information distribution method has the following first to fourth steps. In the first step, the control unit records the captured image data and the position data indicating the captured position of the captured image in association with the recording unit. In the second step, the control unit makes the captured image data viewable with respect to the terminal device connected via the communication unit, and sets the position data in a secret state. In the third step, the control unit authenticates the terminal device based on the authentication information. In the fourth step, the control unit transmits position data corresponding to the captured image designated from the terminal device to the authenticated terminal device.

  A ninth aspect of the invention is a program for a location information distribution device including a communication unit that performs data transmission / reception, a recording unit, and a control unit. This program causes the control unit to execute the following first to fourth steps. In the first step, the control unit records the captured image data and the position data indicating the captured position of the captured image in association with the recording unit. In the second step, the control unit sets the position data in a concealed state while making the captured image data viewable with respect to the terminal device connected via the communication unit. In the third step, the control unit authenticates the terminal device based on the authentication information. In the fourth step, the control unit transmits position data corresponding to the captured image designated from the terminal device to the authenticated terminal device.

  In addition, what expressed the structure regarding said positional information delivery apparatus converted into a positional information delivery method, a program, a recording medium, etc. is also effective as a specific aspect of the present invention.

  According to the present invention, it is possible to efficiently share and distribute shooting position data while ensuring the confidentiality of the shooting position.

(Description of the first embodiment)
FIG. 1 is a schematic diagram of a position information distribution system according to the first embodiment. The position information distribution system according to the first embodiment includes an electronic camera 11, a server 12, and a plurality of terminal devices 13 (such as personal computers). The electronic camera 11, the server 12, and each terminal device 13 are connected by a known communication line to form a network. Here, the network may include either wired or wireless.

(Configuration of electronic camera)
FIG. 2 is a block diagram showing the configuration of the electronic camera of the first embodiment. In the first embodiment, the electronic camera 11 is used by a seller (information registrant) who sells photographed image data and photographing position data.
The electronic camera 11 includes a photographing lens 20, a lens driving unit 21, an image sensor 22, an A / D conversion unit 23, a buffer memory 24, an image processing unit 25, a card I / F 26, and a GPS unit 27. , Direction sensor 28, communication unit 29, operation member 30, liquid crystal monitor 31, CPU 32 and bus 33. The buffer memory 24, the image processing unit 25, the card I / F 26, the communication unit 29, the liquid crystal monitor 31 and the CPU 32 are connected via a bus 33.

The taking lens 20 is composed of a plurality of lens groups including a zoom lens and a focusing lens for adjusting a focus position. The position of the photographing lens 20 is driven and adjusted in the optical axis direction by the lens driving unit 21.
The image sensor 22 photoelectrically converts the light beam that has passed through the photographing lens 20 to generate an analog image signal of the subject image. The A / D converter 23 converts the analog image signal of the image sensor 22 into a digital image signal. The buffer memory 24 temporarily stores data in the pre-process and post-process of image processing in the image processing unit 25.

The image processing unit 25 performs image processing (defective pixel correction, gamma correction, interpolation, color conversion, edge enhancement, etc.) on the digital image signal to generate photographed image data. In addition, the image processing unit 25 performs a known compression / decompression process on the captured image data.
The card I / F 26 is formed with a connector for connecting the recording medium 34. The recording medium 34 is composed of a known semiconductor memory or the like. The card I / F 26 controls writing / reading of photographed image data with respect to the recording medium 34.

The GPS unit 27 acquires information on the latitude, longitude, and altitude (shooting position) of the electronic camera 11 at the time of shooting and outputs the information to the CPU 32.
The direction sensor 28 incorporates a biaxial magnetic sensor that detects geomagnetic components in directions orthogonal to each other. This azimuth sensor 28 obtains the azimuth of terrestrial magnetism from the magnetic field detection values in both directions by each magnetic sensor, and outputs the direction (photographing azimuth) that the photographing lens 20 faces at the time of photographing to the CPU 32.

The communication unit 29 controls data transmission / reception with the server 12 connected via a communication line. The operation member 30 includes an input button, a release button, and the like. The input button of the operation member 30 receives, for example, an input for switching the shooting mode of the electronic camera 11.
The liquid crystal monitor 31 is mainly disposed on the back portion of the electronic camera 11. The liquid crystal monitor 31 displays a captured image data reproduction screen, a setting screen for changing various settings of the electronic camera 11, and the like.

The CPU 32 controls the operation of each part of the electronic camera 11 according to a sequence program stored in a ROM (not shown). For example, the CPU 32 executes a known AF calculation and AE calculation. Particularly in the first embodiment, the CPU 32 executes the following processing.
(1) The CPU 32 generates shooting position data from the above-described shooting position and shooting direction information. The photographing position data includes at least one or more of coordinate system data indicating the coordinates (latitude, longitude, altitude) and photographing direction of the photographing position, map image data, and text data such as a place name. Note that the electronic camera 11 in the first embodiment generates shooting position data including only coordinate system data and generates shooting position data including all the above three data according to user settings. And can be switched.

  Here, in the above map image, a mark indicating the shooting position is superimposed and displayed on the surrounding map corresponding to the coordinates of the shooting position. The map image data may include a plurality of map images having different scales of the surrounding maps. The surrounding map also includes a map based on aerial photographs and satellite photographs. On the other hand, the text data includes information such as the country name corresponding to the shooting position, the prefecture name, the municipality name, the zip code, the distance from the nearest facility to the shooting position, and the required time.

  In addition, when the CPU 32 generates map image data or text data, a map DB (database) that records the surrounding map and a text DB that records the correspondence between the text data and the coordinate system data are required. For example, in the first embodiment, the CPU 32 can generate map image data and text data by using the map DB and text DB in the external device via the communication unit 29. Alternatively, map DB or text DB data may be stored in advance in the recording medium 34 or the like so that the CPU 32 can generate map image data or text data from the data in the electronic camera 11 (map DB and text). DB is not shown).

  (2) The CPU 32 generates a data file including photographed image data and photographing position data. Here, the CPU 32 generates captured image data in conformity with the Exif standard. Further, the data file has a data structure that allows the shooting position data to be edited independently from the shot image data. For example, the CPU 32 may configure the data file by storing the captured image data and the shooting position data, which are independent of each other, in one folder. Alternatively, the CPU 32 may record shooting position data in a file of shot image data by using an Exif standard MakerNote tag (a tag by which a camera maker can uniquely define the content).

(Server and terminal configuration)
FIG. 3A is a block diagram illustrating a configuration of the server 12 according to the first embodiment.
The server 12 includes a communication unit 40, a user information DB (database) 41, a captured image DB 42, a shooting position DB 43, and a control unit 44.
The communication unit 40 controls data transmission / reception with the electronic camera 11 or the terminal device 13.

  In the user information DB 41, user information including a user ID, a password, and payment means information (for example, user bank account information, credit card information, etc.) is recorded. This user information includes information of both information registrants (mainly photographers) and information purchasers. The registered image ID is recorded in the user information of the information registrant. This registered image ID is used to specify the photographed image data and the photographing position data registered with a user ID having a corresponding relationship.

In the photographed image DB 42, photographed image data and a registered image ID are recorded in association with each other.
In the shooting position DB 43, shooting position data and a registered image ID are recorded in association with each other. Note that the shooting position data of the shooting position DB 43 includes coordinate system data, map image data, and text data.

The control unit 44 controls the operation of each unit of the server. Specifically, the control unit 44 includes (1) user authentication, (2) registration of photographed image data and photographing position data, (3) control regarding browsing of photographed images from the terminal device, and (4) information purchaser. Calculation processing necessary for billing and payment for information registrants is executed.
Furthermore, the control unit 44 can generate map image data and text data based on the coordinate system data of the shooting position data. When the control unit 44 generates map image data or text data, the map DB or text DB described above is required. For example, in the first embodiment, the control unit 44 can generate map image data and text data by using the map DB and text DB in the external device via the communication unit 40. Alternatively, a map DB or a text DB may be stored in the server 12 in advance (the illustration of the map DB or the text DB is omitted).

FIG. 3B is a block diagram illustrating a configuration of the terminal device 13 according to the first embodiment. The terminal device 13 of the first embodiment is a personal computer or the like, and is mainly used by information purchasers.
The terminal device 13 includes a communication unit 50 that controls data transmission and reception with the server 12, an input unit 51 such as a keyboard and a pointing device, a monitor 52 that displays various types of information, and a CPU 53 that executes arithmetic control of each unit of the terminal device. have.

(Operation of location information distribution system)
Next, the operation of the position information distribution system of the first embodiment will be described separately for “data registration by an information registrant” and “purchase of shooting position data by an information purchaser”. Prior to the use of the location information distribution system, the user needs to register user information in the user information DB 41 of the server 12 in advance.

FIG. 4 is a flowchart showing an operation in “data registration by an information registrant”. In this case, data transmission / reception is performed between the electronic camera 11 and the server 12.
Step S101: First, the photographer (information registrant) photographs the subject with the electronic camera 11. The CPU 32 of the electronic camera 11 captures a subject according to the release of the photographer and generates captured image data.

  Step S102: The CPU 32 of the electronic camera 11 generates shooting position data based on outputs at the time of shooting by the GPS unit 27 and the direction sensor 28. In this S102, for convenience of explanation, it is assumed that the CPU 32 generates shooting position data of only coordinate system data. Of course, the CPU 32 of the electronic camera 11 may generate shooting position data including coordinate system data, map image data, and text data.

Then, the CPU 32 generates a data file by associating the shooting position data with the shooting image data (S101). Editing (generation) of the shooting position data and data file is performed using the work area of the buffer memory 24. The data file generated in S102 is recorded on the recording medium 34.
Step S103: The CPU 32 of the electronic camera 11 starts data communication with the server 12 via the communication unit 29 in accordance with an instruction from the photographer. When connecting to the server 12, the photographer inputs the user ID and password to the electronic camera 11, and the CPU 32 of the electronic camera 11 transmits the user ID and password to the server 12.

  Step S104: The control unit 44 of the server 12 authenticates the electronic camera 11 with the user ID and password (S103) transmitted from the electronic camera 11. Then, the control unit 44 transmits a code indicating successful authentication to the electronic camera 11 via the communication unit 40. If the user ID and password do not correspond, authentication is not performed. In this case, the process ends without performing the following steps.

Step S105: The CPU 32 of the electronic camera 11 transmits the data file selected by the user after authentication by the server 12 to the server 12.
Step S106: The control unit 44 of the server 12 generates a registered image ID by receiving the data file. Further, the control unit 44 records the registered image ID in the user information DB 41 in association with the user information of the photographer.

  Step S107: The control unit 44 of the server 12 records the captured image data and the captured position data separately. Specifically, the control unit 44 records the captured image data of the data file in the captured image DB 42 in association with the registered image ID (S106). Further, the control unit 44 records the shooting position data of the data file in the shooting position DB 43 in association with the registered image ID (S106). Note that when shooting position data is recorded using an Exif-standard MakerNote tag, the control unit 44 records the shooting position data in the shooting position DB 43 and then deletes the shooting position data from the tag area of the shot image data.

  Further, the control unit 44 generates map image data and text data based on the coordinate system data. First, generation of map image data will be briefly described. First, the control unit 44 acquires a surrounding map corresponding to the shooting position from the map DB based on the coordinate system data. Secondly, the control unit 44 generates map image data by superimposing a mark indicating the shooting position on the surrounding map.

  Next, the generation of text data will be briefly described. The control unit 44 acquires text corresponding to the shooting position from the text DB based on the coordinate system data. And the control part 44 uses the data of the country name corresponding to the imaging | photography position, a prefecture name, a municipality name, and a postal code as text data among said text as it is. In addition, the control unit 44 acquires position information of the nearest facility (for example, a railway station, an intersection, an interchange position, etc.) from the text position from the text DB. Then, the control unit 44 calculates the distance and required time from the nearest facility to the photographing position from the positional relationship between the photographing position and the above-described facility. And the control part 44 produces | generates the text data of the distance from the nearest facility to an imaging | photography position, and required time from said calculation result.

The map image data and the text data are recorded as shooting position data in the shooting position DB 43 by the control unit 44.
Step S108: The control unit 44 of the server 12 sets the photographed image data registered in the photographed image DB 42 so that it can be viewed from the outside. Note that the shooting position data in the shooting position DB 43 is placed in a concealed state in which access from the outside is restricted.

Step S109: The control unit 44 of the server 12 determines whether or not the current captured image data and the captured position data are captured within a predetermined range from the registered captured position. When the image is taken within the predetermined range (YES side), the process proceeds to S110. On the other hand, if the image is not photographed within the predetermined range (NO side), the data registration process is terminated as it is.
Step S110: The control unit 44 of the server 12 determines whether or not the user ID of the current captured image data and the captured position data is different from the user ID of the registered captured position data in S109. If the user ID is different (YES side), the process proceeds to S111. On the other hand, if the user ID is the same (NO side), the data registration process is terminated as it is.

  Step S111: This case corresponds to a case where a person other than the registered person registers photographed image data photographed within a predetermined range from the registered photographing position. In such a case, it is highly likely that the later registrant's data was shot based on the photographic position data of the registered person, and the profit generated by “Purchasing of photographic position data by the information purchaser” described later is already registered In some cases, it may be preferable to distribute to a person.

  Therefore, the control unit 44 of the first embodiment changes the setting of the user information in the user information DB 41 so as to distribute the profit generated by the charging to the registered registrants for the currently registered shooting position data. In addition, when there are a plurality of registered persons in the same shooting range, the control unit 44 may be set so as to provide the profit generated by the charging only to the registered person with the earliest registration date and time. . This completes the data registration process.

On the other hand, FIG. 5 is a flowchart showing an operation in “purchasing of photographing position data by an information purchaser”. In this case, data transmission / reception is performed between the terminal device 13 and the server 12.
Step S201: The CPU 53 of the terminal device 13 starts data communication with the server 12 according to an instruction from the information purchaser. The CPU 53 of the terminal device 13 displays a list of images of the captured image data that can be browsed from the outside on the monitor 52. Then, the CPU 53 of the terminal device 13 transmits a shooting position acquisition request for the image selected by the information purchaser to the server.

Step S202: When receiving the photographing position acquisition request, the control unit 44 of the server 12 returns a user ID and password authentication input request to the terminal device 13.
Step S203: The CPU 53 of the terminal device 13 accepts a user ID and password authentication input from the information purchaser. Then, the CPU 53 transmits the user ID and password input by the information purchaser to the server 12.

Step S204: The control unit 44 of the server 12 authenticates the terminal device 13 with the user ID and password (S203) transmitted from the terminal device 13. If the user ID and password do not correspond, authentication is not performed. In this case, the process ends without performing the following steps.
Step S205: The control unit 44 of the server 12 searches the shooting position DB 43 based on the registered image ID of the shooting image data for which a shooting position acquisition request has been made. Then, the control unit 44 extracts shooting position data corresponding to the shot image data. Thereafter, the control unit 44 transmits the extracted shooting position data to the terminal device 13. Thereby, the information purchaser can know position information such as latitude, longitude, altitude and shooting direction corresponding to the shot image data. Note that the communication between the server 12 and the terminal device 13 may be terminated at this stage.

  Step S206: The control unit 44 of the server 12 executes a charging process for the user ID of the information purchaser and also executes a payment process for the user ID of the information registrant. For example, in the case of settlement using a financial institution account, the control unit 44 transmits a price withdrawal request from the information purchaser's account to the financial institution based on the settlement means information in the user information DB 41. Similarly, the control unit 44 transmits a payment request to the account of the information registrant to the financial institution. Then, when the financial institution receives the price withdrawal request and the price transfer request from the server 12, the financial institution withdraws the price of the shooting position data from the account of the information purchaser and pays the price of the shooting position data to the account of the information registrant. Deposit money.

Here, the charging amount (cost) of the shooting position data is basically set by the information registrant. For example, the control unit 44 of the server 12 imposes a predetermined condition according to the nature of the information as follows. You can also change the amount.
(1) When the value of the shooting position data changes with time, the control unit 44 changes the charge amount according to the elapsed time from the time of registration. For example, when the value of the information greatly decreases with time, the control unit 44 may execute a process of gradually reducing the billing amount as time passes. In addition, when the value of information is increased only for a specific period, such as a cherry blossom viewing spot, the control unit 44 sets the billing amount so that the specific period (the cherry blossom blooming time in the above example) peaks. May be executed.

(2) When the value of the shooting position data changes according to the number of people who know the information, the control unit 44 executes a process of gradually reducing the charge amount according to the cumulative number of shooting position acquisition requests. May be.
Hereinafter, the effect of the position information distribution system of the first embodiment will be described.
In the position information distribution system according to the first embodiment, the photographed image data can be viewed by a third party in a state where the photographed position data is kept secret, and the photographed image data can be provided as information purchase determination material. Only the information purchaser can view the shooting position data on the terminal device. Further, since the information registrant who intends to sell the shooting position data only needs to transmit the data file, the management burden of the shooting image data and the shooting position data is remarkably reduced. From the above, according to the position information distribution system of the first embodiment, it is possible to efficiently develop a business for distributing shooting position data.

(Description of Second Embodiment)
Next, a location information distribution system according to a second embodiment, which is a modification of the first embodiment, will be described. Here, the positional information distribution system of the following embodiment has the same basic configuration as that of the first embodiment, and the functions of some components are different from those of the first embodiment. Therefore, in the following embodiment, the same reference numerals are given to the components corresponding to the configuration of the first embodiment, and the duplicate description is omitted.

In a position information distribution system that discloses a photographed image and conceals the photographing position, when the subject indicating the photographing position is photographed in the photographed image, the confidentiality of the photographing position is lost due to the disclosure of the photographed image. Therefore, also in the above case, there has been a demand for means that can ensure the secrecy of the shooting position while disclosing the shot image.
In the position information distribution system according to the second embodiment, one of the electronic camera and the server executes a mask process that partially prevents disclosure of a captured image with respect to captured image data.

First, in the second embodiment, a case where the electronic camera performs mask processing will be described. FIG. 6 is a block diagram showing the configuration of the electronic camera of the second embodiment.
In addition to the configuration of the electronic camera of the first embodiment shown in FIG. 2, the electronic camera 11 of the second embodiment includes a microphone 35 for recording external audio, an audio analysis unit 36, and a mask processing DB 37. In addition. The electronic camera 11 of the second embodiment has a still image shooting function and a moving image shooting function. Therefore, the electronic camera 11 of the second embodiment can generate still image captured image data and moving image captured image data according to an instruction from the CPU 32. In the second embodiment, the CPU 32 can additionally include recorded data recorded by the microphone 35 in the captured image data of a still image or a moving image.

  In addition, the image processing unit 25 in the second embodiment performs a mask process on a captured image according to an instruction from the CPU 32. Here, the mask processing for the captured image means image processing that partially prevents disclosure of the captured image. For example, the mask process includes (a) a process for painting a secret part of a photographed image, (b) a trimming process for cutting out a secret part of the photographed image, (c) a mosaic process for reducing the resolution of the secret part of the photographed image, (D) A process of superimposing a mark on a concealed portion of a captured image to cover it is included.

  The voice analysis unit 36 is connected to the CPU 32 and the microphone 35. The voice analysis unit 36 generates recording data based on the output of the microphone 35. In addition, the voice analysis unit 36 performs voice analysis and mask processing on the recorded data. Here, the masking process for the recorded data means a process for preventing the reproduction of the confidential voice (specific phrase) included in the recorded data. For example, the masking process includes (a) a process of covering other words with a specific word and phrase (b) a process of prohibiting reproduction of a part or all of the recorded data.

  The mask processing DB 37 is connected to the bus 33. In the mask processing DB 37, first feature information and second feature information are recorded. The first feature information indicates the feature of the specific subject extracted from the captured image, and is used by the image processing unit 25 for subject recognition for mask processing. The second feature information indicates the feature of the specific phrase extracted from the speech data, and is used by the speech analysis unit 36 in the speech analysis processing. For example, the second feature information is constituted by acoustic model data of a specific phrase obtained from a large amount of speech data by an unspecified speaker.

Hereinafter, the mask processing operation in the electronic camera 11 of the second embodiment will be described in detail with reference to FIG. Here, an example will be described in which the electronic camera 11 performs a mask process on a data file recorded on the recording medium 34.
Step 301: The CPU 32 selects a mask processing target from a data file (photographed image data) of the recording medium 34 based on a user input. For example, the CPU 32 selects a captured image designated by the user at the time of reproduction as a mask processing target.

  Step 302: The CPU 32 changes a detailed setting item of the mask process by a user operation. Note that when the detailed setting of the mask process is input to the CPU 32 in advance, or when the CPU 32 receives an input for omitting the detailed setting, the CPU 32 can omit the process of S302. In the detailed setting of the mask process, the user can set on / off of each of a plurality of different mask processes and the mutual priority relationship in the mask process to the CPU 32.

  Step 303: The CPU 32 instructs the image processing unit 25 and the sound analysis unit 36 to execute the mask process based on the detailed setting of the mask process (S302). Then, the image processing unit 25 and the sound analysis unit 36 execute any one of the mask processes shown in the following (1) to (6). Then, the image processing unit 25 and the sound analysis unit 36 generate the captured image data and the recording data (sample data) subjected to the masking process separately from the captured image data and the recording data before the mask processing.

(1) Mask processing with reference to focus detection area The image processing unit 25 performs mask processing on a part of the captured image based on the position of the focus detection area at the time of shooting. Specifically, the CPU acquires focus detection area information indicating the focus detection area at the time of shooting from the shot image data compliant with the Exif standard. Then, the image processing unit 25 performs mask processing on the captured image with reference to the focus detection area at the time of shooting.

  For example, the image processing unit 25 performs the masking process using a certain range centered on the focus detection area as a hidden part. In the captured image of the sample data in this case, the subject considered as the main subject can be concealed. On the other hand, the image processing unit 25 can also perform the masking process with the outside of a certain range centered on the focus detection area as a hidden part. In the captured image of the sample data in this case, the background portion that is unlikely to contain the main subject can be concealed.

(2) Mask process with character recognition process The image processing unit 25 performs a known character recognition process on the captured image. Then, the image processing unit 25 performs a mask process on the character portion included in the photographed image based on the result of the character recognition process. For example, even when characters indicating a shooting position (such as a telephone pole or billboard address display) are included in the shot image, such information can be concealed in the shot image of the sample data.

(3) Mask processing for two-dimensional barcode The image processing unit 25 executes recognition processing of a two-dimensional barcode (such as a QR code (registered trademark)) on a captured image. Then, the image processing unit 25 performs a mask process on the portion of the two-dimensional barcode included in the captured image based on the result of the recognition process. Specifically, the image processing unit 25 can realize the above recognition process by means similar to that for reading data from a two-dimensional barcode. For example, even when a captured image includes a two-dimensional barcode indicating an address or the like, such information can be concealed in the captured image of the sample data.

(4) Mask processing with subject recognition The image processing unit 25 executes subject recognition processing for recognizing a specific subject from a captured image. Specifically, the image processing unit 25 recognizes a specific subject corresponding to the first feature information from the captured image by a known means such as pattern matching based on the first feature information of the mask processing DB 37. Then, the image processing unit 25 performs the mask process on the specific subject based on the result of the subject recognition process. For example, even when the shooting position can be easily estimated based on famous buildings and terrain (Tokyo Tower, Mt. Fuji, etc.) included in the captured image, information such as famous buildings and terrain is registered in the first feature information in advance. By doing so, it is possible to more reliably conceal the shooting position in the sample data.

  Here, the image processing unit 25 may execute a human face recognition process from the captured image. The image processing unit 25 may perform mask processing on the position of the recognized person's face. For example, there is a possibility that the shooting position can be estimated from a person (resident in the vicinity of the shooting position) included in the shot image. Further, it is necessary to protect the portrait right of the person included in the photographed image when the sample data is disclosed. The face recognition process of the image processing unit 25 is performed by a known means. For example, the image processing unit 25 extracts a face area by a feature point extraction process. Alternatively, the image processing unit 25 may detect the face area by extracting the outline of the skin color area based on the color information of the subject and further matching with a template of a face component prepared in advance.

(5) Mask processing for modulated light source of moving image When the captured image is a moving image, the image processing unit 25 detects a portion of the modulated light source that repeatedly blinks between frames of the moving image. Then, when the image processing unit 25 detects the modulated light source, the image processing unit 25 performs a mask process on the portion of the modulated light source in the captured image. For example, the image processing unit 25 may directly mask the portion of the modulated light source in each frame, or may not be able to reproduce the period during which the modulated light source is captured in the moving image.

  In recent years, visible light communication capable of distributing position data to surroundings by blinking of a modulated light source (for example, a traffic light or a lighting fixture) is being put into practical use. Therefore, when the value of the frame rate of the moving image is larger than the value of the sampling rate of visible light communication, there is a possibility that the shooting position can be determined by reading out the signal of visible light communication from the moving image. Therefore, if the modulated light source in the moving image is masked in advance, the shooting position can be more securely concealed in the sample data.

  Note that the image processing unit 25 can also conceal an arbitrary position of the captured image in accordance with the on / off of the mask processing (1) to (5) and the setting of the priority order (S302). As an example, the image processing unit 25 performs mask processing with a certain range centered on the focus detection area as a concealed portion, and also performs mask processing on characters and two-dimensional barcodes in the background portion. it can.

(6) Masking process for recorded data When the recorded image data includes recorded data, the voice analysis unit 36 performs a voice analysis process for extracting a specific phrase from the voice of the recorded data. Specifically, the speech analysis unit 36 determines the presence / absence of a specific word / phrase by a known speech recognition process using a hidden Markov model based on the second feature information of the mask processing DB 37. If the voice analysis unit 36 determines that the specific phrase is included in the voice of the recording data, the voice analysis unit 36 performs a mask process for preventing the specific phrase from being reproduced on the recording data.

For example, even when the sound indicating the shooting position is included in the recording data, if the place name word / phrase is registered in advance in the second feature information, the shooting position can be more reliably concealed in the sample data.
Step 304: The CPU 32 records the sample data (S303) in association with the data file including the data of the captured image or the sound recording data to be masked. This is the end of the description of the mask processing operation in the electronic camera 11. The data file is then transmitted from the electronic camera 11 to the server 12 as in the first embodiment. In the server 12, the sample data is placed in a viewable state, and the captured image data and the captured position data are kept secret.

Next, a case where mask processing is performed in the server in the second embodiment will be described. FIG. 8 is a block diagram showing the configuration of the server according to the second embodiment.
The server 12 of the second embodiment further includes an image processing unit 45, a voice analysis unit 46, and a mask processing DB 47 in addition to the configuration of the server of the first embodiment shown in FIG. Yes. The image processing unit 45, the sound analysis unit 46, and the mask processing DB 7 are all connected to the control unit 44.

  The image processing unit 45 performs a mask process on the captured image according to an instruction from the control unit 44. The voice analysis unit 46 performs voice analysis and mask processing on the recorded data according to instructions from the control unit 44. In the mask processing DB 47, first feature information and second feature information are recorded. Note that the image processing unit 45, the sound analysis unit 46, and the mask processing DB 47 described above have substantially the same functions as those of the electronic camera, and thus a duplicate description is omitted.

Hereinafter, the mask processing and data registration operations in the server according to the second embodiment will be described in detail with reference to FIG. The flowchart of FIG. 9 shows a modification of the post-authentication operation (S106 to S111) on the server 12 side of FIG. Note that S407 to S409 in FIG. 9 correspond to S109 to S111 in FIG.
Step 401: The control unit 44 of the server 12 generates a registered image ID by receiving a data file. Further, the control unit 44 records the registered image ID in the user information DB 41 in association with the user information of the photographer. This S401 corresponds to S106 in FIG.

Step 402: The control unit 44 determines whether sample data is included in the data file. If sample data is included (YES side), the mask process has already been executed by the electronic camera 11, and the process proceeds to S405. On the other hand, if sample data is not included (NO side), the process proceeds to S403.
Step 403: The control unit 44 changes the detailed setting of the mask process by a user operation from the electronic camera 11. In the detailed setting of the mask process, the user can set on / off of each of a plurality of different mask processes and the mutual priority relationship in the mask process to the control unit 44.

  Step 404: The control unit 44 instructs the image processing unit 45 and the sound analysis unit 46 to execute the mask processing based on the detailed setting of mask processing (S403). Then, the image processing unit 45 and the sound analysis unit 46 perform mask processing to generate sample data separately from the captured image data and the recording data before the mask processing. Note that the masking process by the server 12 in S404 is substantially the same as the masking process by the electronic camera 11 (corresponding to S303 in FIG. 7), and thus a duplicate description is omitted.

  Step 405: The control unit 44 records the captured image data and the sample data in the captured image DB 42 in association with the registered image ID (S401). Further, the control unit 44 records the shooting position data of the data file in the shooting position DB 43 in association with the registered image ID (S401). Note that when shooting position data is recorded using the Exif-standard MakerNote tag, the control unit 44 records the shooting position data in the shooting position DB 43 and then deletes the shooting position data from the tag area of the shot image data. .

When there is no map image data and text data in the shooting position data, the control unit 44 generates map image data and text data based on the coordinate system data. The map image data and text data generation method in the second embodiment is the same as that in the first embodiment, and a duplicate description is omitted.
Step 406: The control unit 44 sets the sample data out of the data registered in the photographed image DB 42 so that it can be browsed from the outside. Further, the control unit 44 keeps the captured image data registered in the captured image DB 42 and the captured position data in the captured position DB 43 in a concealed state in which access from the outside is restricted.

That is, in the second embodiment, only the image or sound after the mask process can be viewed from the terminal device 13 in the state before the billing process, so that the shooting position can be more securely concealed. Note that the server 12 in the second embodiment transmits the captured image data and the recording data together with the shooting position data to the terminal device 13 that has been charged.
Hereinafter, the effect of the position information distribution system of the second embodiment will be described.

In the second embodiment, the electronic camera 11 or the server 12 performs a mask process on captured image data and recorded data. Therefore, in the second embodiment, in addition to the same effects as those in the first embodiment, it is possible to avoid a situation in which the confidentiality of the shooting position is lost due to the shot image and recorded data disclosed on the server 12.
(Description of the third embodiment)
Next, a position information distribution system according to a third embodiment, which is a modification of the first embodiment, will be described.

For example, there may be a close relationship between a series of photographed images and photographing position data handled on the position information distribution system like a group of photographed images obtained by photographing a certain object from a plurality of directions. In such a case, if a series of captured image data and captured position data can be traded together, a position information distribution system is required.
In the position information distribution system according to the third embodiment, one of the electronic camera and the server generates a group file by grouping data and position data of a plurality of photographed images having relevance with reference to the photographing position.

  First, the operation when the electronic camera performs grouping processing in the third embodiment will be described with reference to the flowchart of FIG. Here, the CPU 32 generates a group file based on a plurality of data files recorded on the recording medium 34. Note that the electronic camera 11 of the third embodiment is substantially the same as that of the first embodiment except that the CPU 32 executes grouping processing, and thus the description of the configuration of the electronic camera 11 is omitted.

  Step 501: The CPU 32 starts up an operation mode of grouping processing in accordance with a user operation. Then, the CPU 32 displays a menu screen on the liquid crystal monitor 31. On this menu screen, the user can select and input one of the following items to the CPU 32: (1) manual grouping, (2) grouping by designating representative images, and (3) grouping by designating positions ( Note that illustration of the menu screen in S501 is omitted).

Step 502: The CPU 32 determines whether or not a manual grouping item has been selected on the menu screen (S501). If the above requirement is satisfied (YES side), the process proceeds to S503. On the other hand, if the above requirement is not satisfied (NO side), the process proceeds to S504.
Step 503: In this case, the CPU 32 executes manual grouping processing. Specifically, the CPU 32 groups all data files manually designated by the user among the data files in the recording medium 34, and generates a group file in which the designated data files are collected. Then, the CPU 32 sets a captured image designated by the user among the captured images included in the group file as a representative image, and ends the grouping process.

Step 504: The CPU 32 determines whether or not a grouping item by designating a representative image has been selected on the menu screen (S501). If the above requirement is satisfied (YES side), the process proceeds to S505. On the other hand, when the above requirement is not satisfied (NO side), the process proceeds to S506.
Step 505: In this case, the CPU 32 executes a grouping process by designating a representative image. In S505, the CPU 32 groups the captured images captured within a certain range from the capturing position of the representative image designated by the user.

  Specifically, first, the CPU 32 receives a representative image designation input and a radius input that defines the grouping range from the user. Secondly, the CPU 32 sets the inside of a circle drawn with the input radius as the grouping range with the coordinates of the shooting position of the representative image as the center. Thirdly, the CPU searches the shooting position data of the data file in the recording medium 34, and extracts the data file in which the coordinates of the shooting position are included in the circle range. Fourth, the CPU 32 generates a group file by collecting the extracted data files, and ends the grouping process. In the case of S505, the captured image first designated by the user is set as a representative image by the CPU 32.

Step 506: In this case, the CPU 32 executes a grouping process by specifying a position. In S506, the CPU 32 groups the captured images captured within the range designated by the user.
Specifically, first, the CPU 32 receives from the user an input for specifying a region for photographing positions to be grouped. For example, the CPU 32 displays a map on the liquid crystal monitor 31 and allows the user to specify and input an area to be grouped. The area designation input may be a circular area designation by inputting a reference point and a radius on the map, or a rectangular area designation by inputting a diagonal point on the map. Second, the CPU 32 searches the shooting position data of the data file in the recording medium 34, and extracts the data file in which the coordinates of the shooting position are included in the specified area. Thirdly, the CPU 32 collects the extracted data files and generates a group file. Fourthly, the CPU 32 sets a representative image from the captured images included in the group file, and ends the grouping process. Note that the representative image in S506 may be based on the user's designation, or may be automatically designated by the CPU 32 based on a reference point on the map.

Here, the group file is then transmitted from the electronic camera 11 to the server 12 as in the first embodiment. Then, the server 12 processes the captured image data group and the captured position data group in the group file as a unit.
Next, the operation when the server performs grouping processing in the third embodiment will be described with reference to the flowchart of FIG. This FIG. 11 will be described on the assumption that the information registrant (seller) has registered two or more data files in the server 12 in advance. The server 12 of the third embodiment is almost the same as that of the first embodiment except that the control unit 44 executes the grouping process, and thus the description of the configuration of the server 12 is omitted.

Step 601: When the seller who registered the data file accesses the server 12 with the electronic camera 11 or the terminal device 13, the control unit 44 of the server 12 displays a menu screen on the connection destination terminal.
On this menu screen, the connection destination terminal can instruct the server 12 to perform grouping of data files in the server 12. On the menu screen, the user can select and input one of the following items: (1) Manual grouping, (2) Grouping by designation of representative image, and (3) Grouping by designation of position (in S601) (The menu screen is not shown.) Note that the captured images and shooting position data to be grouped are limited to those corresponding to the seller's user ID.

Step 602: The control unit 44 determines whether or not the connection destination terminal has instructed manual grouping. If the above requirement is satisfied (YES side), the process proceeds to S603. On the other hand, when the above requirement is not satisfied (NO side), the process proceeds to S604.
Step 603: In this case, the control unit 44 executes manual grouping processing. Specifically, firstly, the control unit 44 accepts designation of captured images to be grouped from a connection destination terminal (seller). Secondly, the control unit 44 links and groups the captured image data of the captured image DB and the captured position data of the captured position DB based on the registered image ID corresponding to the designated captured image. Thirdly, the control unit 44 sets a photographed image designated by the user among the grouped photographed images as a representative image, and ends the grouping process.

Step 604: The control unit 44 determines whether or not the connection destination terminal has instructed grouping by designating a representative image. If the above requirement is satisfied (YES side), the process proceeds to S605. On the other hand, when the above requirement is not satisfied (NO side), the process proceeds to S606.
Step 605: In this case, the control unit 44 executes a grouping process by designating a representative image. In step S605, the control unit 44 groups the captured images captured within a certain range from the representative image capturing position designated by the seller.

  Specifically, firstly, the control unit 44 receives a designation input of a representative image and an input of a radius defining a grouping range from a connection destination terminal (seller). Secondly, the control unit 44 sets the inside of a circle drawn with the input radius as the grouping range with the coordinates of the shooting position of the representative image as the center. Thirdly, the control unit 44 searches the shooting position DB 43 for shooting position data corresponding to the user ID of the seller, and extracts a registered image ID in which the coordinates of the shooting position are included in the range of the circle. Fourth, based on the extracted registered image ID, the control unit 44 links the photographed image data in the photographed image DB 42 and the photographing position data in the photographing position DB 43 to group them, and ends the grouping process. .

Step 606: In this case, the control unit 44 executes a grouping process by specifying a position. In S606, the control unit 44 groups the captured images captured within the range designated by the seller.
Specifically, first, the control unit 44 accepts an input for specifying a region for photographing positions to be grouped from a connection destination terminal (seller). The area designation of the shooting position is the same as in the case of S506 described above, and thus the description thereof is omitted. Secondly, the control unit 44 searches the shooting position DB 43 for shooting position data corresponding to the seller's user ID, and extracts a registered image ID in which the coordinates of the shooting position are included in the specified area. Third, based on the extracted registered image ID, the control unit 44 links the photographed image data in the photographed image DB 42 and the photographing position data in the photographing position DB 43 to group them, and ends the grouping process. .

  Thereafter, the server 12 of the third embodiment manages the grouped captured image data and the captured position data as a unit. The representative image is used as an index for grouped captured images. In addition, when the seller intends to restrict browsing of the grouped captured images, the control unit 44 may set the other captured images included in the group in a concealed state so that only the representative images can be viewed. it can.

Further, when the information purchaser designates the grouped captured images and instructs the server 12 to purchase the capturing position, the control unit 44 instructs the information purchaser's terminal device 13 to group the captured images. And the shooting position data are transmitted.
Hereinafter, the effect of the position information distribution system of the third embodiment will be described.
In the third embodiment, the electronic camera 11 or the server 12 groups the captured image data and the captured position data. Therefore, in the third embodiment, in addition to the same effects as those of the first embodiment, it is possible to collectively manage captured image data and shooting position data having a close relationship, so that the convenience of the position information distribution system is achieved. Is greatly improved.

(Explanation of Fourth Embodiment)
Next, a location information distribution system according to a fourth embodiment, which is a modification of the first embodiment, will be described.
When the position information distribution system is operated, a large number of photographed image data and photographed position data are accumulated on the server, and an information purchaser is required to take a great deal of time to access necessary information. Therefore, a means for facilitating access to necessary information by information purchasers is required.

In the positional information distribution system according to the fourth embodiment, one of the electronic camera and the server records a photographed image data in association with a keyword, and the server performs a photographed image search based on the keyword.
First, the server 12 of the position information distribution system of the fourth embodiment will be described. The server 12 of the fourth embodiment has the same configuration as the server of the first embodiment shown in FIG. 3A, but there are the following differences in the functions of the photographed image DB 42 and the control unit 44.

In the photographed image DB 42, search keywords are recorded in a state associated with each photographed image.
The control unit 44 executes a keyword addition process for adding the keyword to the captured image. The details of the keyword addition process will be described later. Further, the control unit 44 has a search function for searching for keywords in the captured image DB 42 based on input of search terms from the terminal device 13. Then, the control unit 44 presents the captured image having the keyword corresponding to the search term condition to the terminal device 13. Thereby, in the terminal device 13, the information purchaser can narrow down a desired picked-up image easily.

  In order for the control unit 44 to execute the keyword addition process, a keyword DB that records the correspondence between the shooting date / time or shooting position and the keyword is required. In the fourth embodiment, the control unit 44 executes keyword addition processing by using a keyword DB in an external device (not shown) via the communication unit 40. A keyword DB may be provided in the server 12 (the keyword DB is not shown in any case).

FIG. 12 is a flowchart for explaining the operation when the server performs keyword addition processing in the fourth embodiment.
Step 701: The control unit 44 selects a photographic image to be subjected to keyword addition processing from the photographic images recorded in the photographic image DB 42, and acquires the registered image ID. For example, the control unit 44 sets a photographed image newly registered in the photographed image DB 42 as a target for keyword addition processing. Alternatively, the control unit 44 may collectively specify data of a plurality of photographed images in the photographed image DB 42 as keywords addition processing targets.

  Step 702: For the registered image ID acquired in S701, the control unit 44 acquires shooting date / time and shooting position data of the shot image. Specifically, the control unit 44 acquires the shooting date / time data from the header of the shot image data compliant with the Exif standard. Further, the control unit 44 searches the shooting position DB 42 based on the registered image ID, and acquires shooting position data.

Step 703: The control unit 44 searches the keyword DB based on the shooting date and time and the shooting position acquired in S702. Then, for example, the CPU acquires the following information (1) to (3).
(1) When the keyword DB has weather information, the control unit 44 uses the shooting position and shooting date / time data to determine the weather information (data such as weather, temperature, humidity, rainfall, and snow cover) at the shooting position. To get.

(2) When the keyword DB has event information, the control unit 44 acquires keywords of event information (data of concerts, festivals, performances, etc.) held at the shooting position from the shooting position and shooting date / time data. .
(3) When the keyword DB has news information, the control unit 44 acquires keywords of news information (for example, data on incidents, accidents, disasters, etc.) related to the photographing position from the photographing position data. Note that the control unit 44 may further narrow down the conditions of the news information using the shooting date / time data.

  Of course, regarding the news information, for example, the user may request photographed images before and after the occurrence of the accident, so the control unit 44 does not have to narrow down the news information by the photographing date and time. In addition, when adding a keyword for news information regardless of the shooting date and time, it is preferable that the control unit 44 periodically executes a keyword addition process for news information on the captured image data registered in the server 12. Thereby, the server 12 can sequentially add keywords of news report information regarding accidents that occurred after registration.

Step 704: The control unit 44 records the keyword acquired in S703 in the captured image DB 42 in association with the captured image data to be processed. Above, description of the flowchart of FIG. 12 is complete | finished.
By the way, in the above keyword adding process, if it is insufficient for specifying the shooting position, the control unit 44 may generate the keyword directly from the shooting position data. For example, the control unit 44 may use the name of an administrative district or area name having a size that makes it difficult to specify the shooting position as a keyword. As an example, when the address of the municipality level is set to be concealed, the control unit 44 adds the name of the prefecture or the name of the region (Tokyo, Kanto region, etc.) as a keyword based on the data of the shooting position. May be.

  The keyword addition process may be executed by the CPU 32 of the electronic camera 11. For example, in the electronic camera having the same configuration as that of the first embodiment, the CPU 32 may add a keyword to the data file recorded on the recording medium 34 based on the shooting date / time or the shooting position. In this case, however, the CPU 32 needs to acquire a keyword from the keyword DB of the external device via the communication unit 29. Note that the keyword addition processing by the electronic camera 11 is almost the same as that in the case of the server 12 described above, and therefore the illustration of the flowchart and detailed description thereof are omitted.

Hereinafter, the effect of the position information distribution system of the fourth embodiment will be described.
In the fourth embodiment, in addition to the same effects as in the first embodiment, the information purchaser can easily narrow down the desired photographed image by the keyword added by the electronic camera 11 or the server 12, The convenience of the location information distribution system is greatly improved.
(Description of Fifth Embodiment)
Next, a location information distribution system according to a fifth embodiment, which is a modification of the first embodiment, will be described.

For example, when the scale of the map indicating the shooting position and the resolution of the shot image can be changed on the position information distribution system, the value of the information may vary depending on these states. Therefore, in the position information distribution system, a means that can cope with the change in the value of the information is required.
The position information distribution system of the fifth embodiment changes the price of information that the server charges to the information purchaser in accordance with the change in the scale of the map and the resolution of the captured image.

FIG. 13 is a flowchart showing an operation in purchase of shooting position data by an information purchaser in the fifth embodiment. In this case, data transmission / reception is performed between the terminal device 13 and the server 12. Note that in the fifth embodiment, the control unit 44 of the server 12 executes processing related to changing the scale of the map image and changing the resolution of the captured image.
Step 801: The CPU 53 of the terminal device 13 starts data communication with the server 12 according to an instruction from the information purchaser. The CPU 53 of the terminal device 13 displays the image of the captured image data in a state that can be browsed from the outside on the monitor 52 together with the map image indicating the capturing position.

  Here, on the monitor 52 of the terminal device 13 in step S801, a sample photographed image and a sample map image that are set free of charge are displayed as one set. As an example, the sample photographed image is set to a resolution as low as the Exif standard thumbnail image. The sample map image is a rough map with a very small scale. Therefore, at the stage of S801, the information purchaser can determine the outline of information to be considered for purchase, but cannot accurately grasp the shooting position from the map image.

Step 802: When acquiring a captured image that is finer than the captured image for the sample or a detailed map image that is larger in scale than the sample map image, the information purchaser acquires an image from the terminal device 13 to the server 12 Make a request. In this image acquisition request, the information purchaser can specify the resolution size of the captured image and the scale size of the map image.
Then, the CPU 53 of the terminal device 13 transmits an image acquisition request to the server 12 based on the input of the information purchaser.

Step 803: Upon receiving the image acquisition request (S802), the control unit 44 of the server 12 returns a user ID and password authentication input request to the terminal device 13.
Step 804: The CPU 53 of the terminal device 13 accepts a user ID and password authentication input from the information purchaser. Then, the CPU 53 transmits the user ID and password input by the information purchaser to the server 12.

Step 805: The control unit 44 of the server 12 authenticates the terminal device 13 with the user ID and password (S804) transmitted from the terminal device 13. If the user ID and password do not correspond, authentication is not performed. In this case, the process ends without performing the following steps.
Step 806: The control unit 44 of the server 12 searches the photographed image DB 42 and the photographed position DB 43 based on the registered image ID for which an image acquisition request has been made. Then, the control unit 44 transmits the captured image having the resolution specified in the image acquisition request and the scaled map image specified in the image acquisition request to the terminal device 13.

Step 807: The CPU 53 of the terminal device 13 displays the captured image and the map image transmitted from the server 12 on the monitor 52. Therefore, the information purchaser can grasp the state of the subject and the shooting position more accurately than the state of S801 by using the high-resolution shot image and the large-scale detailed map.
Step 808: On the other hand, the control unit 44 of the server 12 changes the price of the charging process based on the designation of the resolution and the designation of the scale in the image acquisition request. Specifically, when the scale of the map image is changed, the control unit 44 adjusts so that the price increases in proportion to the size of the scale. That is, when the information purchaser acquires a map image with a relatively small scale, the control unit 44 executes a discount process by reducing the price of the billing process. When the resolution of the captured image is changed, the control unit 44 adjusts the price so as to increase in proportion to the resolution height. That is, when the information purchaser acquires a captured image with a relatively low resolution, the control unit 44 executes a discount process by reducing the price of the billing process.

  Step 809: The control unit 44 executes a charging process for the user ID of the information purchaser and also executes a payment process for the user ID of the information registrant. For example, in the case of settlement using a financial institution account, the control unit 44 transmits a price withdrawal request from the information purchaser's account to the financial institution based on the settlement means information in the user information DB 41. Similarly, the control unit 44 transmits a payment request to the account of the information registrant to the financial institution. Then, when the financial institution receives the price withdrawal request and the price transfer request from the server 12, the financial institution withdraws the price of the shooting position data from the account of the information purchaser and pays the price of the shooting position data to the account of the information registrant. Deposit money. Above, description of FIG. 13 is complete | finished. Note that when the information purchaser intends to acquire a captured image with a higher resolution or a map image with a larger scale, the process returns to S802 and an image acquisition request may be executed again with respect to the server 12.

Hereinafter, the effect of the position information distribution system of the fifth embodiment will be described.
In the fifth embodiment, the price of information charged by the server 12 to the information purchaser is changed according to a change in the scale of the map or the resolution of the captured image. Therefore, in addition to the same effects as those of the first embodiment, the billing amount can be flexibly adjusted according to the needs of the information purchaser, so that the convenience of the location information distribution system is greatly improved.

(Description of the sixth embodiment)
FIG. 14 is a block diagram illustrating a configuration of the server 12 according to the sixth embodiment. The sixth embodiment is an example in which the server 12 is configured by, for example, a portable personal computer with a camera. The server includes an imaging unit 48 for capturing a subject and generating captured image data, and a GPS unit 49 and an orientation sensor 49a for generating capturing position data.

According to the sixth embodiment described above, it is possible to generate photographic image data and photographic position data by the server 12 alone.
(Supplementary items of the embodiment)
(1) In the first embodiment, the information registrant may take out a data file from the electronic camera 11 and register the data file in the server 12 from the terminal device 13.

(2) The photographing position data generation means of the electronic camera 11 is not limited to the GPS unit 27, but is information transmitted from a plurality of base stations such as a cellular mobile communication network (PHS or the like) or a mobile phone, for example. You may comprise with the positioning apparatus etc. which utilized. In this case, the photographing position data generation unit and the communication unit can be used together.
(3) The terminal device of the first embodiment may be a mobile phone device having a data communication function.

  (4) In the above embodiment, from the viewpoint of preventing data tampering, the electronic camera encrypts the captured image data and the captured position data with the secret key, and the server decrypts the data with the public key. You may make it perform. In order to prevent data tampering more reliably, it is more preferable that the electronic camera encrypts the data after shooting in hardware, and the electronic camera cannot edit trading data. .

(5) In the mask process of the second embodiment, an image or sound of sample data may be reproduced to allow the user to confirm the suitability of the mask process.
(6) The invention described in the above embodiment may be implemented by installing a program for causing the computer to execute the invention.

Schematic diagram of the location information distribution system of the first embodiment The block diagram which shows the structure of the electronic camera of 1st Embodiment. (A) Block diagram showing the configuration of the server of the first embodiment, (b) Block diagram showing the configuration of the terminal device of the first embodiment. Flow chart showing operation in "Data registration by information registrant" Flow chart showing operation in "Purchase of shooting position data by information buyer" The block diagram which shows the structure of the electronic camera of 2nd Embodiment. Flowchart for explaining an operation of mask processing in the electronic camera of the second embodiment The block diagram which shows the structure of the server of 2nd Embodiment. Flowchart for explaining operations of mask processing and data registration in the server of the second embodiment Flowchart for explaining the operation when the electronic camera performs grouping processing in the third embodiment Flow chart for explaining the operation when the server performs grouping processing in the third embodiment Flowchart for explaining the operation when the server performs keyword addition processing in the fourth embodiment Flowchart showing operations in purchase of shooting position data in the fifth embodiment The block diagram which shows the structure of the server of 6th Embodiment

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 ... Electronic camera, 12 ... Server, 13 ... Terminal device, 22 ... Image sensor, 25, 45 ... Image processing part, 27, 49 ... GPS unit, 28, 49a ... Direction sensor, 35 ... Microphone, 36, 46 ... Audio | voice Analysis unit 37, 47 ... Mask processing DB, 40 ... Communication unit, 41 ... User information DB, 42 ... Shooting image DB, 43 ... Shooting position DB, 44 ... Control unit, 48 ... Imaging unit

Claims (21)

A communication unit for transmitting and receiving data;
A first recording unit that records data of a captured image and position data related to a captured position of the captured image in association with each other;
An image processing unit that executes mask processing that partially prevents disclosure of the photographed image with respect to the data of the photographed image;
For the terminal device connected via the communication unit, the browsing control unit that allows the data of the captured image after the masking process to be browsed, and the position data after the masking process is concealed;
An authentication unit for authenticating the terminal device based on authentication information acquired from the terminal device;
A delivery unit that transmits the position data corresponding to the captured image designated by the terminal device to the terminal device authenticated by the authentication unit;
A position information distribution apparatus comprising: The position information distribution device according to claim 1,
The data of the captured image includes focus detection area information indicating the position of the focus detection area at the time of shooting,
The position information distribution apparatus, wherein the image processing unit executes the mask processing based on the focus detection area information. The position information distribution device according to claim 1,
The position information distribution apparatus, wherein the image processing unit performs a character recognition process on the photographed image and performs the mask process on a character portion included in the photographed image. The position information distribution device according to claim 1,
The position information distribution apparatus, wherein the image processing unit extracts a two-dimensional barcode from the photographed image, and executes the mask process on a portion of the two-dimensional barcode included in the photographed image. The position information distribution device according to claim 1,
A second recording unit that records first characteristic information indicating characteristics of a specific subject to be extracted from the captured image;
A subject recognition unit that recognizes the specific subject included in the captured image based on the first feature information;
The position information distribution apparatus, wherein the image processing unit performs the masking process based on a position of the specific subject included in the captured image. The position information distribution device according to claim 5,
The position information distribution device, wherein the subject recognition unit recognizes a human face from the captured image. The position information distribution device according to claim 1,
The image processing unit, when the captured image is a moving image, extracts a modulated light source from the moving image and performs the mask process on a portion where the modulated light source is captured. Distribution device. The position information distribution device according to claim 1,
The data of the photographed image further includes recording data obtained by recording sound,
A third recording unit that records second characteristic information indicating characteristics of a specific phrase to be extracted from the recording data;
Based on the second feature information, an analysis unit for determining whether or not the specific phrase is recorded in the recording data;
A position information distribution apparatus, further comprising: an audio processing unit that performs a process of preventing reproduction of the specific phrase of the recorded data when the voice of the recorded data includes the specific phrase. A communication unit for transmitting and receiving data;
A recording unit that records the captured image data in association with the position data related to the captured position of the captured image; and
A grouping processing unit that groups the plurality of captured image data and the position data having relevance;
For a terminal device connected via the communication unit, the browsing control unit that makes the data of the photographed image viewable and the position data is in a secret state;
An authentication unit for authenticating the terminal device based on authentication information acquired from the terminal device;
A delivery unit that transmits the position data corresponding to the captured image designated by the terminal device to the terminal device authenticated by the authentication unit;
The distribution unit transmits the grouped captured image data and the position data to the terminal device. In the positional information delivery apparatus according to claim 9,
The grouping processing unit selects the photographic images to be grouped based on a designation operation for the photographic images received from a user. In the positional information delivery apparatus according to claim 9,
The grouping processing unit groups the data of the photographed images photographed within a predetermined range from the photographing position of the representative image based on a designation operation of the representative image received from the user. Distribution device. A communication unit for transmitting and receiving data;
A recording unit that records the captured image data in association with the position data related to the captured position of the captured image; and
A keyword adding unit for associating and recording a keyword with the captured image data based on the position data;
For a terminal device connected via the communication unit, the browsing control unit that makes the data of the photographed image viewable and the position data is in a secret state;
An authentication unit for authenticating the terminal device based on authentication information acquired from the terminal device;
A delivery unit that transmits the position data corresponding to the captured image designated by the terminal device to the terminal device authenticated by the authentication unit;
The browsing control unit searches for data of the captured image recorded in the recording unit based on the keyword, and presents the search result to the terminal device. The position information distribution device according to claim 12,
The data of the captured image includes shooting date information,
The keyword adding unit further associates the keyword with data of the photographed image based on the photographing date / time information. A communication unit for transmitting and receiving data;
A recording unit that records the captured image data in association with the location data that includes the map image that indicates the captured position of the captured image and that is set with the price used for the charging process;
For a terminal device connected via the communication unit, the browsing control unit that makes the data of the photographed image viewable and the position data is in a secret state;
An authentication unit for authenticating the terminal device based on authentication information acquired from the terminal device;
A delivery unit that transmits the position data corresponding to the captured image designated by the terminal device to the terminal device authenticated by the authentication unit;
A change unit that changes the scale or resolution of the map image to be transmitted to the terminal device in response to an operation from the terminal device;
A price changing unit for resetting the price at the time of change so that the price is increased in proportion to the scale size or the height of the resolution;
A position information distribution apparatus comprising: In the positional information delivery apparatus of any one of Claims 1-14,
An imaging unit that shoots a subject and generates data of the captured image;
And a position data generation unit that generates the position data. An imaging unit that shoots a subject and generates data of the captured image;
A position data generating unit that generates position data related to the shooting position of the shot image and associates the position data with the data of the shot image;
An image processing unit that executes mask processing that partially prevents disclosure of the photographed image with respect to the data of the photographed image;
A camera comprising: An imaging unit that shoots a subject and generates data of the captured image;
A position data generating unit that generates position data related to the shooting position of the shot image and associates the position data with the data of the shot image;
A grouping processing unit for grouping data of the plurality of photographed images and the position data having relevance on the basis of the photographing position;
A camera comprising: An imaging unit that shoots a subject and generates data of the captured image;
A position data generating unit that generates position data related to the shooting position of the shot image and associates the position data with the data of the shot image;
A keyword adding unit for associating and recording a keyword with the captured image data based on the position data;
A camera comprising: The camera according to any one of claims 16 to 18,
The camera further comprising a communication unit capable of transmitting the image data and the position data. A location information delivery method using a computer having a communication unit for performing data transmission and reception, a recording unit and a control unit,
A first step in which the control unit records data of a captured image and position data indicating a shooting position of the captured image in association with the recording unit;
A second step in which the control unit is in a state in which the data of the captured image can be viewed with respect to a terminal device connected via the communication unit, and the position data is in a secret state;
A third step in which the control unit authenticates the terminal device based on authentication information;
A fourth step in which the control unit transmits the position data corresponding to the captured image designated by the terminal device to the authenticated terminal device;
A position information delivery method characterized by comprising: A program for a location information distribution device including a communication unit that performs data transmission and reception, a recording unit, and a control unit,
A first step in which the control unit records data of a captured image and position data indicating a shooting position of the captured image in association with the recording unit;
A second step in which the control unit sets the position data in a concealed state while allowing the data of the captured image to be browsed with respect to the terminal device connected via the communication unit;
A third step in which the control unit authenticates the terminal device based on authentication information;
A fourth step in which the control unit transmits the position data corresponding to the captured image designated by the terminal device to the authenticated terminal device;
Is executed by the control unit.

Images