[go: up one dir, main page]

CN105721752B - Photographic device and image capture method - Google Patents

Photographic device and image capture method Download PDF

Info

Publication number
CN105721752B
CN105721752B CN201610186833.0A CN201610186833A CN105721752B CN 105721752 B CN105721752 B CN 105721752B CN 201610186833 A CN201610186833 A CN 201610186833A CN 105721752 B CN105721752 B CN 105721752B
Authority
CN
China
Prior art keywords
image
dynamic image
mentioned
face
dynamic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201610186833.0A
Other languages
Chinese (zh)
Other versions
CN105721752A (en
Inventor
川口胜久
石原晴之
新谷浩
新谷浩一
野中修
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Aozhixin Digital Technology Co ltd
Original Assignee
Olympus Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Olympus Corp filed Critical Olympus Corp
Publication of CN105721752A publication Critical patent/CN105721752A/en
Application granted granted Critical
Publication of CN105721752B publication Critical patent/CN105721752B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Television Signal Processing For Recording (AREA)
  • Studio Devices (AREA)
  • Studio Circuits (AREA)
  • Image Processing (AREA)

Abstract

The object of the present invention is to provide a kind of photographic device and image capture method, the appreciator that can obtain appreciation dynamic image is easy interested dynamic image.Thus, when the operating mode of digital camera (100) is communication pattern during reproducing the dynamic image in the record portion (105) for being recorded in digital camera (100) in the display unit of (200) TV (202), start the image pickup part (101) of digital camera (100) to obtain the face image of the appreciator of dynamic image, acquired face image is synthesized with the dynamic image reproduced and show on display unit (202).

Description

Photographic device and image capture method
The application is that application No. is the application for a patent for invention of the No.201010222803.3 (applyings date: 07 month 2010 for original bill 02 day, priority date: on 07 03rd, 2009, denomination of invention: photographic device and moving image reproduction method) divisional application.
Technical field
The present invention relates to the photographic device with the function of reproducing dynamic image using external equipment and such dynamics Imaging reconstruction method.
Background technique
In recent years, there is the portable equipment of various camera functions to have been able to carry out for digital camera and portable telephone etc. Dynamic image photography.However, capturing the movement of the subject moved without regulation accurately to shoot dynamic image, this is for general It is more difficult for general family.Therefore, for ordinary user, dull dynamic image can only be shot.In contrast, for interior The TV programme etc. of pedestrian scholar's production, can photograph while through multiple video camera frequent switching compositions.Therefore, may be used To shoot not dull dynamic image.However, it is very difficult that ordinary user, which takes this method for imaging,.
Even dynamic image dull when photography, if by editing operating appropriate, can also become it will be appreciated that Dynamic image.In recent years it has been proposed that the various technologies that can carry out dynamic image editor to the dynamic image reproduced on television image (referring for example to No. 2822187 bulletins of Japanese Patent No.).
In the existing dynamic image editing technique such as No. 2822187 bulletins of Japanese Patent No., for being obtained after appreciating editor To dynamic image appreciator the case where do not make any consideration, the dynamic image obtained after editor may not for appreciator It is interested dynamic image.Therefore, the appreciator of dynamic image probably feels bored.
Summary of the invention
The object of the present invention is to provide a kind of available appreciators for appreciating dynamic image to be easy interested dynamic image Photographic device and image capture method.
In order to achieve the above object, the photographic device of the 1st mode of the invention, which is characterized in that the photographic device includes Image pickup part obtains dynamic image;Record portion records the dynamic image obtained by above-mentioned image pickup part;Face detection portion, from Face is detected in the dynamic image that above-mentioned image pickup part obtains;And combining unit, moving in above-mentioned record portion will be recorded in The dynamic image of dynamic image and above-mentioned reproduction for making above-mentioned image pickup part work when the reproduction of state image and obtaining is synthesized, on Combining unit is stated according to the expression shape change of sound variation or the face detected by above-mentioned face detection portion to determine that above-mentioned camera shooting will be made The dynamic image that portion works and obtains is synthesized to the opportunity in the dynamic image being recorded in above-mentioned record portion.
In order to achieve the above object, the image capture method of the 2nd mode of the invention, which is characterized in that the image capture method includes: Dynamic image is obtained by image pickup part;Record portion will be recorded in by the dynamic image of above-mentioned acquirement;It is obtained by face detection portion from above-mentioned Face is detected in the dynamic image obtained;It will make above-mentioned image pickup part in the reproduction for the dynamic image being recorded in above-mentioned record portion Work and the dynamic image and the dynamic image of above-mentioned reproduction obtained are synthesized, and in above-mentioned synthesis process, are become according to sound The expression shape change for the face for changing or being detected by above-mentioned face detection portion determines the dynamic that above-mentioned image pickup part will be made to work and obtained Image is synthesized to the opportunity in the dynamic image being recorded in above-mentioned record portion.
Detailed description of the invention
Fig. 1 be show with as an embodiment of the invention photographic device an example digital camera move The figure of the structure of state image reproducing system.
Fig. 2 is figure the case where showing when dynamic image playback system uses.
Fig. 3 is the 1st figure for showing the flow chart of main work of digital camera.
Fig. 4 A is the display example for indicating the thumbnail image of dynamic image.
Fig. 4 B is the display example for the picture for selecting the reproduction destination of dynamic image.
Fig. 4 C is example when dynamic image reproduces.
Fig. 4 D is to indicate it is display example in the communication mode.
Fig. 5 is the 2nd figure for showing the flow chart of main work of digital camera.
Fig. 6 A is the figure for showing the synthesis example of face image.
Fig. 6 B is the figure for showing the synthesising position modification of face image.
Fig. 7 is the flow chart for showing position exception processes.
Fig. 8 is the 3rd figure for showing the flow chart of main work of digital camera.
Fig. 9 A is to show remote controller operation to show that the 1st of image shows exemplary figure.
Fig. 9 B is to show remote controller operation to show that the 2nd of image shows exemplary figure.
Figure 10 is to show the external flow chart for reproducing and ending processing.
Figure 11 be confirmation screen is shown show exemplary figure.
Specific embodiment
Hereinafter, being described with reference to embodiments of the present invention.
Fig. 1 is shown with digital camera (its an example as the photographic device of an embodiment of the invention) The figure of the structure of dynamic image playback system.As shown in Figure 1, the dynamic image playback system is configured to make digital camera 100 It is connected in a manner of free communication with television receiver (hereinafter referred to as TV) 200 via communication cable.
The digital camera 100 of present embodiment includes image pickup part 101, face detection portion 102, display unit 103, sound Acquisition portion 104, record portion 105, clock portion 106, control unit 107, operation portion 108 and communication interface part 109.In addition, this reality Applying the digital camera 100 in mode at least has following operating mode: the dynamic image for carrying out dynamic image photography is taken the photograph Shadow mode, for carrying out the dynamic image reproduction mode of dynamic image reproduction, and for carrying out data communication with TV 200 Communication pattern.
Image pickup part 101 is with the camera lens for being assembled to shot object image (not shown) and will be assembled by camera lens Shot object image be converted into the photographing element etc. of electric signal.The image pickup part 101 images subject, obtains the quiet of subject State image.In addition, passing through the camera shooting for being consecutively carried out image pickup part 101, moreover it is possible to obtain dynamic image.
Detect the face of the subject in the image obtained by the camera shooting of image pickup part 101 in face detection portion 102.By face The information for the face that portion's test section 102 detects for example can be used for making to constitute the focus alignment face position of the camera lens of image pickup part 101 The control set and control the exposure of the face in image suitably.In addition, the face detection in face detection portion 102 is Such as pass through characteristic quantity (shape and positional relationship etc. of eye and nose) Lai Jinhang's of the face in detection image.Also, this reality Countenance (especially smiling face) can also be detected by applying the face detection portion 102 in mode.
Display unit 103 shows the still image or dynamic image obtained by image pickup part 101.The display unit 103 be for example with It is located at the liquid crystal display at 100 back side of digital camera.
Sound collection portion 104 obtains the sound around the digital camera 100 when dynamic image is photographed, by acquired sound Sound signal is converted into electric signal.
Record portion 105 records the still image or dynamic image obtained by image pickup part 101.The record portion 105 is for example may be used The semiconductor memory card of disassembled and assembled freely is carried out on digital camera 100.Clock portion 106 is static to carrying out in image pickup part 101 The date and time of image photography or dynamic image photography carries out timing.By 106 timing of the clock portion photography date and time with The still image as acquired by image pickup part 101 or dynamic image are recorded in association in record portion 105.
Control unit 107 carries out the control (camera work including image pickup part 101 of each module inside digital camera 100 Control, display unit 103 display work control, the job control in sound collection portion 104 etc.).In addition, control unit 107 is also It is directed to by the image procossing of the image obtained of image pickup part 101, for the sound by the sound obtained of sound collection portion 104 The various data processings such as sound processing.Here, the control unit 107 in present embodiment also has the function as combining unit.That is, control Portion 107 processed also carries out such processing: will be recorded in the dynamic image in record portion 105 and appreciates the appreciator of the dynamic image Image synthesized, and the sound for the person of will appreciate that associates with the dynamic image being recorded in record portion 105.Moreover, control Portion 107 processed also has the function as cutting portion, to by the face image (face image) in the image obtained of image pickup part 101 It is cut and is extracted.
Operation portion 108 is the operation portion for carrying out the various operations of digital camera 100 for user.Identify operation portion 108 operation, control unit 107 execute processing corresponding with the operation of operation portion 108.In addition, as operation portion 108, such as wrap Contain: for setting the operation portion of the operating mode of digital camera 100, the photography for being used to indicate digital camera 100 executes/ The operation portion of end, for carrying out the operation portion etc. of various selection work.
Communication interface part 109 is the interface for carrying out data communication between digital camera 100 and TV 200.At this In embodiment, by HDMI (High Definition Multimedia Interface, high-definition multimedia interface) (note Volume trade mark) it is used as communication interface part 109.However, as long as communication interface part 109 is suitable for the interface of dynamic image transmission, just not It is particularly limited.Also, wireline interface is shown in Fig. 1, but also can be used and infrared communication or radio wave communication etc. pair The wireless interface answered.
The TV 200 of an example of the external equipment as present embodiment includes broadcast reception portion 201, display unit 202, net Network communication unit 203, information overlap portion 204, control unit 205, remote controller signal receiving unit 206 and communication interface part 207.
Broadcast reception portion 201 includes for the antenna etc. from receiving television broadcastings such as TV stations (not shown).Display unit 202 Show the dynamic image based on the television broadcasting received via broadcast reception portion 201.In addition, the display unit in present embodiment 202 can also show the dynamic image come as numerical data from the transmission of digital camera 100.
Network communication unit 203 is for connecing for TV 200 via what internet and server (not shown) etc. were communicated Mouthful.Information superposition portion 204 make the various data obtained via network communication unit 203 from server (not shown) etc. be shown in it is aobvious Show the dynamic image superposition in portion 202.
Control unit 205 carries out control and the job control in information superposition portion 204 of the display work comprising display unit 202 etc. , the control of each module inside TV 200.Remote controller signal receiving unit 206 receives the distant of the remote controler 400 from TV 200 Control device signal.Identify that the remote controller signal received by remote controller signal receiving unit 206, control unit 205 execute and remote controler 400 The corresponding processing of operation.
Communication interface part 207 is for the interface for carrying out data communication between TV 200 and digital camera 100.This is logical Believe that interface portion 207 is for example also HDMI.
The figure of the case where when Fig. 2 is the dynamic image playback system use for showing present embodiment.As shown in Fig. 2, digital Camera 100 is connect via communication cable 300 with TV 200.In such a state, appreciator 500 may be viewed by being shown in TV Dynamic image 202a in 200 display unit 202.Also, appreciator 500 can carry out TV 200 by remote controller 400 Remote operation.
Here, in the present embodiment, in the dynamic image transmitted from digital camera 100 via communication cable 300 During the reproduction of 202a, the face image of appreciator 500 is obtained by the image pickup part 101 of digital camera 100, the person of will appreciate that 500 Face image 202b with from the display unit 202 that the dynamic image that digital camera 100 transmits synthesized and be shown in TV 200. By the such display of progress, such as shown in Fig. 2, two appreciators 500 can be in display unit when appreciating dynamic image 202a Mutual reaction is confirmed on 202, thus, it is possible to make the appreciation lively atmosphere of dynamic image 202a.In this way, even if non-pre-edit is real The dynamic image that border reproduces, can assign to the dynamic image is not the enjoyment for only watching the dynamic image yet.That is, In present embodiment, display has effect identical with like watching edited image on the display unit 202 of TV 200 Image.
Hereinafter, illustrating the operational detail of dynamic image playback system shown in Fig. 2 referring to Fig. 3~Figure 11.In addition, this implementation TV 200 in mode are worked as follows: the dynamic image that display is sent from digital camera 100;And it is distant operating In the case where controlling device 400, Digital photographic is sent as external signal using the operation signal for indicating the operation content of remote controler 400 Machine 100.Therefore, the work of 100 side of digital camera is illustrated in the following description.In addition, in present embodiment Digital camera 100 also can be carried out the photography and reproduction of still image, but in the following description, to dynamic image photography and Dynamic image reproduces related work and is illustrated.
In Fig. 3, the control unit 107 of digital camera 100 determine first digital camera 100 operating mode whether be Dynamic image photograph mode (step S101).It is dynamic in the operating mode of digital camera 100 in the judgement of step S101 In the case where image photography mode, what control unit 107 made 101 continuous work of image pickup part to carry out image is taken into (step S102), By the dynamic image real-time display obtained by the continuous work of image pickup part 101 on display unit 103 (step S103).It is watching While the dynamic image being shown on the display unit 103, cameraman can determine the opportunity that photography starts and composition etc..It is showing After showing dynamic image in portion 103, control unit 107 determine whether cameraman by operating the operating department 108 and moved The photography of state image starts to indicate (step S104).In the judgement of step S104, start in the photography for not carrying out dynamic image In the case where instruction, the operating mode that control unit 107 carries out step S101 again determines.Also, in the judgement of step S104, In the case where the photography for carrying out dynamic image starts instruction, control unit 107 starts the dynamic that will be obtained via image pickup part 101 Image and via sound collection portion 104 obtain SoundRec to record portion 105 in (step S105).Here, as Dynamic Graph The recording mode of picture in the present embodiment, such as uses Motion JPEG mode.Using the reason of Motion JPEG be because To be easier to by unit editing dynamic graphics picture (specially aftermentioned face image synthesis) of frame.Certainly, as long as allowing to synthesize The standard of the predetermined conditions such as the restriction on opportunity, so that it may be handled using the interframe compression H.264 waited.Furthermore, it is assumed that via camera shooting The dynamic image in portion 101 records and is to carry out simultaneously via the SoundRec in sound collection portion 104, so that synchronized with each other.
After the photography of dynamic image starts, control unit 107 determine whether cameraman by operating the operating department 108 and carry out The photography termination instruction (step S106) of dynamic image.In the judgement of step S106, in the photography for not carrying out dynamic image In the case where termination instruction, processing returns to step S105, and control unit 107 continues the record of dynamic image.Also, in step S106 Judgement in, in the case where having carried out the photography termination instruction of dynamic image, control unit 107 terminate dynamic image record. At this point, control unit 107 is by the dynamic image being recorded in record portion 105 and photography date and time for being recorded by clock portion 106 It associates and is recorded.After the record end of dynamic image, control unit 107 carries out the later processing of step S101.
It is not dynamic image photograph mode in the operating mode of digital camera 100 also, in the judgement of step S101 In the case where, control unit 107 determines whether the operating mode of digital camera 100 is dynamic image reproduction mode (step S107).In the judgement of step S107, in the case where the operating mode of digital camera 100 is dynamic image reproduction mode, Control unit 107 is as shown in Figure 4 A by the thumbnail image for indicating the dynamic image (being also associated with sound) being recorded in record portion 105 Ground is shown on display unit 103 (step S108).Further, it is assumed that being each dynamic image as the image that thumbnail image is shown Representative image.The representative image is, for example, the image of the first frame in dynamic image or the figure of the aftermentioned frame with index Picture.
After showing thumbnail image, control unit 107 determine whether appreciator by operating the operating department 108 and moved The selection (step S109) of state image.In the judgement of step S109, in the case where not carrying out the selection of dynamic image, control Continue to show thumbnail image in portion 107.Also, in the judgement of step S109, in the case where the selection for carrying out dynamic image, Control unit 107 shows the picture that the reproduction destination of dynamic image is selected shown in Fig. 4 B on display unit 103.Fig. 4 B's In example, " 1. reproduce " indicates that the reproduction destination of dynamic image is the display unit 103 of digital camera 100, and " 2.TV " is indicated The reproduction destination of dynamic image is the display unit 202 of TV 200.After the picture of display Fig. 4 B, the judgement of control unit 107 is No to show dynamic image on display unit 103, i.e., whether the reproduction destination of dynamic image is 103 (step of display unit S110).In the judgement of step S110, in the case where the reproduction destination of dynamic image is display unit 103, control unit 107 It is read from record portion 105 currently by the selected dynamic image of appreciator, as shown in Figure 4 C, is started on display unit 103 again Existing read-out dynamic image (step S111).At this point, as shown in Figure 4 C, can show that expression is reproducing disappearing for dynamic image Breath.
After the reproduction of dynamic image starts, control unit 107 determine whether user by operating the operating department 108 and carry out The switching (step S112) for the dynamic image to be reproduced on display unit 103.In the judgement of step S112, dynamic is being carried out In the case where the switching of image, control unit 107 terminates the reproduction of dynamic image, carries out the switching for the dynamic image to be reproduced later (step S113).What the switching was performed such, for example, the dynamic image that will be reproduced is cut whenever operating operation portion 108 It is changed to photography date and time (or late) dynamic image more early than the dynamic image being currently reproduced by.Switch in dynamic image Afterwards, control unit 107 carries out the later processing of step S109 to the dynamic image by switching selection.
Also, in the judgement of step S112, in the case where not carrying out the switching of dynamic image, control unit 107 determines Whether user by operating the operating department 108 and the reproduction that indicates dynamic image terminates (step S114).In sentencing for step S114 In fixed, in the case where not indicating that dynamic image terminates, control unit 107 carries out the later processing of step S109.On the other hand, exist In the judgement of step S114, in the case where the end operation for carrying out dynamic image, control unit 107 is carried out after step S101 Processing.
It is not dynamic image reproduction mode in the operating mode of digital camera 100 also, in the judgement of step S107 In the case where, control unit 107 executes the processing of flow chart shown in fig. 5.The processing of the Fig. 5 is place corresponding with communication pattern Reason.Concrete condition will be described later, but in the communication mode, dynamic image is reproduced on the display unit 202 of TV 200.So Afterwards, digital camera 100 is according to the operation of the remote controler 400 carried out by appreciator, according to the external signal inputted from TV 200 It works.
In the communication mode, control unit 107 determines whether to receive external signal from TV 200 via communication interface part 109 (step S201).In the judgement of step S201, in the case where not inputting external signal from TV 200, processing returns to Fig. 3 Step S101.Also, in the judgement of step S201, in the case where having input external signal from TV 200, control unit 107 (step S202) is identified to the external signal inputted.Then, control unit 107 determines whether external signal is to indicate face The signal (step S203) of the synthetic order of image.In the judgement of step S203, face image is not representing in external signal Synthetic order signal in the case where, control unit 107 in the case where current image pickup part 101 is working, stop image pickup part 101 work (step S204).Concrete condition will be described later, but in the communication mode, image pickup part 101 is indicating face The synthetic order of image works during being entered.After the work that stopped image pickup part 101, control unit 107 determines Whether external signal is the signal (step S205) for indicating the reproduction order of dynamic image.In the judgement of step S205, outside In the case that portion's signal is the signal for indicating the reproduction order of dynamic image, control unit 107 is by the image for the frame that should then send It is sent to TV 200 (step S206).On the other hand, in the judgement of step S206, dynamic image is not representing in external signal Reproduction order signal in the case where, control unit 107, which is reproduced and ended processing outside carrying out for example after the predetermined time, (to be walked Rapid S207).Reproducing to end processing about the outside will be described later.Processing terminate in step S206 or step S207 Afterwards, the step S101 of the progress of control unit 107 Fig. 3 later processing.
Also, in the judgement of step S203, in the case where external signal is the signal for indicating synthetic order, control unit 107 temporarily cease the reproduction of the dynamic image reproduced, start image pickup part 101 later, obtain appreciator's as unit of frame Image (step S208).Then, control unit 107 detects the appreciator's obtained via image pickup part 101 using face detection portion 102 Face in image cuts the face image detected, and the face image cut is synthesized to the display unit 202 in TV 200 On outside the display box of dynamic image that is reproducing.Then, face image is for example temporarily recorded in record portion by control unit 107 In 105, as needed to will appreciate that face image and the dynamic image being currently reproduced by of person are synthesized simultaneously later It saves (step S209).In this way, the recording capacity of record portion 105 can be saved by only cutting face image.In addition, pass through by Synthesis range is limited to relatively narrow range, and background of Lian Duoyu etc. is not also shown, can easily see the expression of appreciator.This When, sound collection portion 104 can be made to start, while being taken into sound, can monitor sound variation as needed, it can also be such as rear institute It states, the opportunity being synthesized to face in the dynamic image reproduced is determined according to sound variation.It is of course also possible to specified face Either in image and sound.
(or peripheral portion of the dynamic image reproduced) carries out at synthesis display face image outside reproduced picture After reason and temporarily record, control unit 107 carries out position exception processes (step S210).For Fig. 6 A, Fig. 6 B, Fig. 7 The bright position exception processes.Position exception processes are such processing, as shown in Figure 6 A and 6 B, in reproduction display in TV 200 Display unit 202 on dynamic image 202a pre-position synthesis appreciator face image 202b, or change closed At face image 202b position.At this point it is possible to change the size of face.
In Fig. 7, control unit 107 determines whether the tupe in the exception processes of position is automatic change mode (step S301)。
In the judgement of step S301, in the case where tupe is automatic change mode, control unit 107 is according to scheming The face image of appreciator of the record into record portion 105 in 5 step S209, detects appreciator using face detection portion 102 Countenance, determine whether the countenance detected changes as such as smiling face (step S302).The judgement is for example to pass through Determine whether the countenance that detects is consistent with the feature of smiling face is indicated to carry out.In the judgement of step S302, glad In the case that the countenance variation of reward person is smiling face, nothing of the control unit 107 in the image of frame for being subsequently sent to TV 200 Comparison portion (such as background portion in image shown in Fig. 6 B) synthesizes the face image (step S303) in camera shooting.In order to determine Synthesis of the face image in the dynamic image reproduced shows opportunity, can be with other than the variation for using expression Utilize the variation of laugh or Conversation Voice size.This is because expression when lively atmosphere is that everybody is lain in.Scheme by face As when being synthesized in the dynamic image reproduced, control unit 107 schemes the opportunity for carrying out face image synthesis, face at this time Picture indicates that the information of the position of frame is used as synthesis historical record in record portion 105.At this point, being laughed at as described above, also can recorde The sound such as sound or Conversation Voice.As a result, then it will be seen which kind of reaction appreciator has carried out.In this way, face image is suitably closed At into the dynamic image reproduced, thus display abundant can be changed.Even being easy to sink into dull amateurish people Dynamic image captured by scholar also enters the Dynamic Graph of this effect in picture at the face image with appreciator sometimes Picture can get the dynamic image changed.Here, only smiling face has entered in the dynamic image reproduced, still, if It is that in the case where seeming that boring face enters, for the idea for changing dull image, also can use this table Feelings.
In addition, if remaining that face image enters the state of the dynamic image reproduced, enjoyment will be lost, Thus in the case where expression or the size of sound are restored, or in the case where there is the operation using remote controler 400, make The face image of entrance keeps out of the way other than the picture reproduced or peripheral portion.In digital camera 100, in order to realize this The playback system of sample shows on TV 200 although the dynamic image reproduced is synthesized with face image and (uses HDMI Send), but in this case, as composite signal (history), relieve synthesis.
Also, outside the display box that face image is located at the dynamic image reproduced or in the case where peripheral portion, most It is well as far as possible explicitly unobtrusively and small, thus face's figure can also be changed according to the screen size of the display unit 202 of TV 200 The display size of picture.If it is the TV 200 of big picture, even if not using wide picture range, the face shown also can confirm that out Portion.
Additionally, it is also contemplated that the appreciator of dynamic image is more people, in this case, the expression of not necessarily all people is all Variation is smiling face.It is this as the appreciator's image obtained via image pickup part 101 there are in the case where multiple faces, such as only The face image that expression shape change is smiling face is synthesized.It is of course also possible to which proprietary face image is synthesized.It can also To determine such switching according to sound size.If it is big sound, then proprietary face is synthesized to reproduction image In, if it is small sound, then only by the face of smiling face be synthesized to reproduce image it is medium.In addition, although to simplify the explanation and It omits, however in the case where the expression of appreciator is no longer smiling face, the synthesis of step S303 is released, face image is moved back Keep away reproduce image picture outside or peripheral portion.In addition it is also possible to be not the part of time change and replace no comparison portion. In the case where personage is subject, if it is the position for not hiding character facial, then other positions can also be with.
In addition, in the judgement of step S301, in the case where tupe is not automatic change mode, or in step In the judgement of S302, the countenance of appreciator is unchanged turn to smiling face in the case where, control unit 107 determines whether to pass through appreciation Person's remote controller 400 and have input indicate change face image synthesising position the meaning external signal (step S304). In the judgement of step S304, the case where having input the external signal for the meaning of synthesising position for indicating change face image Under, control unit 107 in the image of frame for being subsequently sent to TV 200, according to specified by appreciator's remote controller 400 The face image being recorded in record portion 105 is synthesized (step S305) by position.After face image synthesis, control unit 107 will indicate to have carried out the information of the position for the frame that face image synthesizes as synthesis historical record in record portion 105.
After the synthesis of step S303 or step S305, control unit 107 assigns the image for the frame for being subsequently sent to TV 200 Give index information (step S306).By this way, retrieval auxiliary when then watching again can be used as.Later, it controls The image of the frame after having synthesized face image is sent TV 200 (step S307) by portion 107.Later, control unit 107 terminates Fig. 7 Processing.In addition, control unit 107 will indicate to have carried out the position of the frame of face image synthesis after the synthesis of face image Information is as synthesis historical record in record portion 105.
In this way, in the present embodiment, index information is assigned in dynamic image by automatic or manual, it can automatic or hand It is dynamic to specify the point for being considered lively atmosphere in the reproduction of dynamic image.As a result, when appreciating next time, in this way it is easy to determine dynamic image In lively atmosphere point.Also, in particular, can also see the table of each appreciator at that time when more people have appreciated dynamic image Feelings can generate the higher dynamic image of entertaining for appreciator.
Also, in the judgement of step S304, in the case where not inputting external signal, control unit 107 for example by After predetermined time, position other than the main display unit being subsequently sent in the image of frame of TV 200 (such as shown in Fig. 6 A The outside of dynamic image 202a), the face image being recorded in record portion 105 is synthesized, after having synthesized face image The image of frame be sent to TV 200 (step S308).
Here, the explanation of Fig. 3 is turned again to.In the judgement of the step S110 of Fig. 3, in the reproduction destination of dynamic image Be TV 200 display unit 202 in the case where, control unit 107 carries out the transfer processing to communication pattern shown in Fig. 8.That is, control Portion 107 processed sends the representative image (example of the dynamic image currently selected by appreciator via communication interface part 109 to TV 200 Such as, the image of first frame or impart index information frame image) (step S401).
After sending representative image, control unit 107 sends remote controller operation to TV 200 via communication interface part 109 and shows Image (step S402).Remote controller operation shows that image is shown in Fig. 9 A and Fig. 9 B, will be from the dynamic of digital camera 100 The display image 202c of operation when state image is shown on the display unit 202 of TV 200, for guiding remote controler 400.It is logical It crosses the such remote controller operation of viewing and shows image 202c, appreciator is readily appreciated that, as long as which button of remote controller 400 Just can be carried out which kind of operation.
Here, remote controller operation shown in Fig. 9 A shows that image 202c is that TV 200 is shown in after the transmission of representative image Display unit 202 on image.Remote controler 400 is pressed when foring remote controller operation shown in Fig. 9 A and showing image 202c Reproduction button in the case where, from TV 200 to digital camera 100 input indicate reproduction order signal.On the other hand, exist In the case where the camera shooting button for pressing remote controler 400, from TV 200 to digital camera 100, input indicates the letter of synthetic order Number.In addition, remote controller operation shown in Fig. 9 B shows that image 202c is shown after the camera shooting button for pressing remote controler 400 Image on the display unit 202 of TV 200.It is pressed when foring remote controller operation shown in Fig. 9 B and showing image 202c In the case where the reproduction button of remote controler 400, from TV 200 to digital camera 100, input indicates the signal of reproduction order.Separately On the one hand, in the case where button is changed in the position for pressing remote controler 400, the face image that is shown on display unit 202 The position of 202b is changed, and input indicates the synthesis of change face image 202b from TV 200 to digital camera 100 The signal of the meaning of position.
After sending remote controller operation and showing image 202c, control unit 107 closes the display unit 103 of digital camera 100 Display (step S403).After the display for closing display unit 103, the step S101 of the progress of control unit 107 Fig. 1 later place Reason.That is, the dynamic image being recorded in digital camera 100 is shown in the display unit 202 of TV 200 due in the communication mode On, it is thus regarded that appreciator will not watch the display unit 103 of digital camera 100.Therefore, in order to realize energy conservation, display is closed The display in portion 103.After the display for closing display unit 103, control unit 107 shifts the operating mode of digital camera 100 To communication pattern (step S404).Furthermore it is possible to not close the display of display unit 103 and be indicated in communication shown in Fig. 4 D Display in mode.
In the following, 0 and Figure 11 illustrates that external reproduce ends processing referring to Fig.1.In Figure 10, control unit 107 determines and terminates Whether the corresponding synthesis history of the dynamic image of reproduction is recorded in record portion 105 (step S501).In sentencing for step S501 In fixed, in the case where synthesizing history and being recorded in record portion 105, control unit 107 to TV200 send for show be used to Appreciator is confirmed whether the image (step that will have been synthesized the dynamic image after face image and be recorded in the picture in record portion 105 S502).Figure 11 is the figure for showing an example of the confirmation screen on the display unit 202 for being shown in TV 200.In the example of Figure 11, The representative image 202a of the dynamic image of end of reproduction is shown on display unit 202, and shows that the outside reproduces and ends processing In for guide appreciator remote controler 400 operation remote controller operation show image 202c.
After sending the image for showing confirmation screen shown in Figure 11, control unit 107 determines whether that appreciator passes through Remote controller 400 and indicate save dynamic image (step S503).In the judgement of step S503, preservation is being indicated In the case of, the frame synthesized in dynamic image is determined according to synthesis history, the face image of record portion 105 will be recorded in It is synthesized and is recorded in record portion 105 (step S504) with the image of identified frame.Face has been synthesized by recording again Situation when dynamic image after portion's image, other members then can also add experience for example everybody appreciate dynamic image.For example, In the case where having taken the situation etc. of movement meeting using digital camera 100, the dynamic image of movement meeting situation is had recorded It is appreciated first by parent-child, if giving dynamic image at this time to grand parents etc., grand parents can experience like participating in The experience that parent-child is reunited.As described above, in the dynamic image reproduced not face image enter processing In the case of, outside the picture that face image is in the dynamic image reproduced or as shown in Figure 6A in the feelings of peripheral portion Under condition, it is believed that do not synthesize history.It is the object for synthesizing history that only face image shown in Fig. 6 B, which enters scene,.In the situation Under, it can use the size that remote controler 400 changes face.Also, when showing face same as before, since also someone is unwilling The face of oneself is watched, thus can replace showing with other face images such as A Fanda.
In this way, in the present embodiment, the form of the synthesis history of face image is had recorded due to being, thus also can be simple The face image recorded is replaced into other image by ground.
In the case that synthesis history is not recorded in record portion 105 in step S501, do not indicated in step S503 In the case where saving dynamic image, or after step S504, control unit 107 determines whether that appreciator passes through remote controller 400 and the reproduction of dynamic image when indicating communication pattern terminates (step S505).In the judgement of step S505, indicating In the case that the reproduction of dynamic image when communication pattern terminates, control unit 107 becomes the operating mode of digital camera 100 More reproduction mode (step S506).Later, the later processing of step S101 is carried out.On the other hand, in the judgement of step S505 In, in the case that the reproduction of the dynamic image when not indicating communication pattern terminates, control unit 107 determines whether that appreciator passes through Remote controller 400 and indicate playback (step S507).In the judgement of step S507, in the case where not indicating playback, Control unit 107 carries out the later processing of step S505.Also, in the judgement of step S507, in the case where indicating playback, The step S201 of the execution of control unit 107 Fig. 5 later processing.
As described above, according to the present embodiment, in the record portion 105 that will be recorded in digital camera 100 Dynamic image can also reproduce the face for appreciating the appreciator of the dynamic image when reproducing on the display unit 202 of TV 200 together Image.The appreciator that can get dynamic image as a result, is easy interested dynamic image.Also, for face's table of appreciator End of love has carried out the frame after the synthesis of face image for smiling face and has specified the synthesising position of face image by appreciator Frame can also determine the important scenes in dynamic image by assigning index information to these in retrieval below.
Moreover, because the dynamic image to be reproduced in TV 200 is only to pass through the dynamic image that digital camera 100 selects, The private dynamic image being thus recorded in digital camera 100 will not be unexpectedly on the display unit 202 of TV 200 Big picture is carried out to show.
Here, in the above-described embodiment, the face image for the person of will appreciate that with reproduce on the display unit 202 of TV 200 Dynamic image is synthesized.In contrast, present embodiment can also apply to the face image for the person of will appreciate that and in Digital photographic The case where dynamic image reproduced on the display unit 103 of machine 100 is synthesized.And it is possible to have TV 200 for shooting The image pickup part of the face image of appreciator.
Also, face image in the above-described embodiment, is synthesized as unit of the frame of dynamic image, as long as thus making face The synthesising position of portion's image is staggered by each frame, with regard to can also make face image carry out animation etc..
Moreover, in the above-described embodiment, face image is carried out with the dynamic image being recorded in digital camera 100 It synthesizes and is reproduced on TV 200, however it is without being limited thereto, and the method for present embodiment can apply to take the photograph with dynamic image The various portable equipments of shadow function.
Also, it is illustrated premised on applying variation to dynamic image, still, be can be used for certainly such here Purposes: it while showing still image on TV 200, synthesizes the face image obtained in reproducing or is believed based on face image The image of the A Fanda of breath etc..As a result, in the case where watching a large amount of still images, on the spot it is known that other people can be with Know which image has popularity etc..
The present invention is illustrated above according to embodiment, however the present invention is not limited to above-mentioned embodiment, certain energy Various modifications and application are carried out in the range of the purport of the present invention.
Moreover, in the above-described embodiment including the invention in each stage, by by disclosed appropriate group of multiple constitutive requirements It closes, can extract various inventions.For example, even if deleting several constitutive requirements from whole constitutive requirements shown in embodiment, It can solve the above problem, in the case where obtaining said effect, the structure after deleting this composition important document can also be come as invention It extracts.

Claims (6)

1. a kind of photographic device, which is characterized in that the photographic device includes
Image pickup part obtains dynamic image;
Record portion records the dynamic image obtained by above-mentioned image pickup part;
Face detection portion detects face from the dynamic image that above-mentioned image pickup part obtains;And
Combining unit will make above-mentioned image pickup part work and the dynamic image obtained and above-mentioned reproduction in the reproduction of dynamic image Dynamic image is synthesized,
Above-mentioned combining unit determines to make according to the expression shape change of sound variation or the face detected by above-mentioned face detection portion The dynamic image stating image pickup part work and obtaining is synthesized to the opportunity in the dynamic image being recorded in above-mentioned record portion and shown.
2. photographic device according to claim 1, which is characterized in that above-mentioned record portion record is carried out by above-mentioned combining unit Image after synthesis.
3. photographic device according to claim 1, which is characterized in that above-mentioned combining unit is in above-mentioned photographic device and reproduces note It records and carries out above-mentioned synthesis when the external equipment connection of the dynamic image of above-mentioned record portion.
4. photographic device according to claim 3, which is characterized in that above-mentioned combining unit has input from said external equipment It indicates to carry out above-mentioned synthesis when the signal of synthetic order.
5. photographic device according to any one of claim 1 to 4, which is characterized in that above-mentioned combining unit will it is above-mentioned again So that above-mentioned image pickup part is worked now and the corresponding dynamic image in the region with defined by the dynamic image that obtains, with it is above-mentioned again Dynamic image in existing is synthesized.
6. a kind of image capture method, which is characterized in that the image capture method includes:
Dynamic image is obtained by image pickup part;
Record portion will be recorded in by the dynamic image of above-mentioned acquirement;
Face is detected from the above-mentioned dynamic image obtained by face detection portion;
The dynamic image and the dynamic image of above-mentioned reproduction that above-mentioned image pickup part will be made to work in the reproduction of dynamic image and obtained It is synthesized,
In above-mentioned synthesis process, determined according to the expression shape change of sound variation or the face detected by above-mentioned face detection portion The dynamic image that above-mentioned image pickup part will be made to work and obtained is synthesized in the dynamic image being recorded in above-mentioned record portion and shows Opportunity.
CN201610186833.0A 2009-07-03 2010-07-02 Photographic device and image capture method Expired - Fee Related CN105721752B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2009158881A JP5457092B2 (en) 2009-07-03 2009-07-03 Digital camera and composite image display method of digital camera
JPJP2009-158881 2009-07-03
CN201010222803.3A CN101945216B (en) 2009-07-03 2010-07-02 Camera head and moving image reproduction method

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201010222803.3A Division CN101945216B (en) 2009-07-03 2010-07-02 Camera head and moving image reproduction method

Publications (2)

Publication Number Publication Date
CN105721752A CN105721752A (en) 2016-06-29
CN105721752B true CN105721752B (en) 2019-04-05

Family

ID=43436958

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201010222803.3A Expired - Fee Related CN101945216B (en) 2009-07-03 2010-07-02 Camera head and moving image reproduction method
CN201610186833.0A Expired - Fee Related CN105721752B (en) 2009-07-03 2010-07-02 Photographic device and image capture method

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201010222803.3A Expired - Fee Related CN101945216B (en) 2009-07-03 2010-07-02 Camera head and moving image reproduction method

Country Status (2)

Country Link
JP (1) JP5457092B2 (en)
CN (2) CN101945216B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6119534B2 (en) * 2013-09-30 2017-04-26 株式会社Jvcケンウッド Imaging display apparatus and control method
CN104637078B (en) 2013-11-14 2017-12-15 腾讯科技(深圳)有限公司 A kind of image processing method and device
JP6289107B2 (en) * 2014-01-14 2018-03-07 キヤノン株式会社 Image reproduction apparatus, control method thereof, and control program
CN104869283B (en) * 2015-05-11 2018-12-14 联想(北京)有限公司 A kind of image pickup method and electronic equipment
JP2017038344A (en) * 2015-08-13 2017-02-16 辰巳電子工業株式会社 Game imaging apparatus and image processing method
JP2017046162A (en) * 2015-08-26 2017-03-02 隆正 光信 Synthetic moving image creation system, synthetic moving image creation support system and synthetic moving image creation program
CN106341608A (en) * 2016-10-28 2017-01-18 维沃移动通信有限公司 Emotion based shooting method and mobile terminal
JP6520975B2 (en) * 2017-03-16 2019-05-29 カシオ計算機株式会社 Moving image processing apparatus, moving image processing method and program
JP7005340B2 (en) * 2017-12-27 2022-01-21 キヤノン株式会社 Electronics
JP7281951B2 (en) * 2019-04-22 2023-05-26 シャープ株式会社 ELECTRONIC DEVICE, CONTROL DEVICE, CONTROL PROGRAM AND CONTROL METHOD

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1156377A (en) * 1995-12-27 1997-08-06 娱乐消遣技术株式会社 Karaoke system
JP2000069348A (en) * 1998-08-20 2000-03-03 Canon Inc Image pickup device
CN1520159A (en) * 1998-03-16 2004-08-11 ������������ʽ���� Digita pick-up device able to process image
CN1841187A (en) * 2005-04-01 2006-10-04 佳能株式会社 Image pickup apparatus and control method thereof
CN101056362A (en) * 2006-04-14 2007-10-17 富士胶片株式会社 Image display control apparatus, method of controlling the same, and control program therefor
CN101472063A (en) * 2007-12-28 2009-07-01 希姆通信息技术(上海)有限公司 Method for capturing smiling face by mobile phone camera

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2999501B2 (en) * 1990-02-26 2000-01-17 パイオニア株式会社 Recording medium playing device
JPH04183183A (en) * 1990-11-19 1992-06-30 Ee D S:Kk Image signal processor
ITRM920546A1 (en) * 1992-07-17 1994-01-17 Giorgio Belmonte MULTIFUNCTIONAL SYSTEM FOR EXTEMPORARY SHOOTING AND VIDEO RECORDING, OVERLAYED WITH MUSIC BACKING TRACKS AND VIDEO IMAGES
JP2000312336A (en) * 1999-04-27 2000-11-07 Koji Nakamura Video television device
CN1383543A (en) * 2000-06-20 2002-12-04 皇家菲利浦电子有限公司 Karaoka system
CN1748410A (en) * 2003-08-11 2006-03-15 松下电器产业株式会社 Photographic systems and photographic methods
CN201042038Y (en) * 2006-09-08 2008-03-26 郭鹏飞 A video advertisement display screen for receiver playing real time roles
JP4596280B2 (en) * 2007-12-14 2010-12-08 ソニー株式会社 Video output device and method for forcibly displaying menu screen of video output device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1156377A (en) * 1995-12-27 1997-08-06 娱乐消遣技术株式会社 Karaoke system
CN1520159A (en) * 1998-03-16 2004-08-11 ������������ʽ���� Digita pick-up device able to process image
JP2000069348A (en) * 1998-08-20 2000-03-03 Canon Inc Image pickup device
CN1841187A (en) * 2005-04-01 2006-10-04 佳能株式会社 Image pickup apparatus and control method thereof
CN101056362A (en) * 2006-04-14 2007-10-17 富士胶片株式会社 Image display control apparatus, method of controlling the same, and control program therefor
CN101472063A (en) * 2007-12-28 2009-07-01 希姆通信息技术(上海)有限公司 Method for capturing smiling face by mobile phone camera

Also Published As

Publication number Publication date
CN101945216A (en) 2011-01-12
JP2011015279A (en) 2011-01-20
CN101945216B (en) 2016-04-13
CN105721752A (en) 2016-06-29
JP5457092B2 (en) 2014-04-02

Similar Documents

Publication Publication Date Title
CN105721752B (en) Photographic device and image capture method
KR101000605B1 (en) Imaging Apparatus, Image Recording Apparatus, and Image Recording Method
JP6267961B2 (en) Image providing method and transmitting apparatus
KR101530826B1 (en) Playing method and the system of 360 degree spacial video
CN102473172A (en) improved audio/video method and system
CN108282598A (en) A kind of software director system and method
CN106851088A (en) Camera head, image capture method
KR20160021706A (en) Playing method and the system of 360 degree spacial video
JP5292399B2 (en) Content editing device
JP2004312281A (en) Video image editing apparatus and processing method thereof
JP4923517B2 (en) Imaging device, imaging method, and semiconductor device
JPWO2011099254A1 (en) Data processing apparatus and data encoding apparatus
JP4946935B2 (en) Imaging device
JP2009100316A (en) Photography equipment
CN100382582C (en) Method and device for realizing static image capture on digital television receiving device
CN102340672A (en) Image processing apparatus and image pickup apparatus using the image processing appratus
JP4371170B2 (en) Imaging apparatus, image recording apparatus, and image recording method
JP5963921B2 (en) Digital camera and composite image display method of camera
JP5774731B2 (en) Digital camera and composite image display method of digital camera
JP2006295572A (en) Program recording/reproducing apparatus and system
JP5654148B2 (en) Digital camera and composite image display method of digital camera
JP2023026844A (en) Video recording system, video recording playback device and image processing method
JP2006165767A (en) Digital camera
KR20230068852A (en) Vertical mode streaming method, and portable vertical mode streaming system
JPH07226881A (en) Method for selecting title video of picture camera

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20211206

Address after: Tokyo, Japan

Patentee after: Aozhixin Digital Technology Co.,Ltd.

Address before: Tokyo, Japan

Patentee before: OLYMPUS Corp.

TR01 Transfer of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20190405

CF01 Termination of patent right due to non-payment of annual fee