CN101568969B - Storyshare automation - Google Patents
Storyshare automation Download PDFInfo
- Publication number
- CN101568969B CN101568969B CN200780047783.7A CN200780047783A CN101568969B CN 101568969 B CN101568969 B CN 101568969B CN 200780047783 A CN200780047783 A CN 200780047783A CN 101568969 B CN101568969 B CN 101568969B
- Authority
- CN
- China
- Prior art keywords
- resource
- metadata
- theme
- resources
- story
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000000694 effects Effects 0.000 claims abstract description 54
- 238000000034 method Methods 0.000 claims abstract description 44
- 238000009795 derivation Methods 0.000 claims description 20
- 238000006243 chemical reaction Methods 0.000 claims description 19
- 238000012545 processing Methods 0.000 claims description 16
- 238000003860 storage Methods 0.000 claims description 12
- 238000005096 rolling process Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 abstract description 8
- 238000004458 analytical method Methods 0.000 description 11
- 238000003384 imaging method Methods 0.000 description 10
- 238000000605 extraction Methods 0.000 description 7
- 239000012634 fragment Substances 0.000 description 6
- SHXWCVYOXRDMCX-UHFFFAOYSA-N 3,4-methylenedioxymethamphetamine Chemical compound CNC(C)CC1=CC=C2OCOC2=C1 SHXWCVYOXRDMCX-UHFFFAOYSA-N 0.000 description 4
- 241000110847 Kochia Species 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 239000000284 extract Substances 0.000 description 3
- 239000004615 ingredient Substances 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 238000003032 molecular docking Methods 0.000 description 3
- 230000000712 assembly Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 2
- 230000033228 biological regulation Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000005055 memory storage Effects 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 238000007639 printing Methods 0.000 description 2
- 238000004064 recycling Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 241000191291 Abies alba Species 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 239000011230 binding agent Substances 0.000 description 1
- 208000024754 bloodshot eye Diseases 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000005034 decoration Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000036651 mood Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 201000005111 ocular hyperemia Diseases 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004091 panning Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 230000002787 reinforcement Effects 0.000 description 1
- GOLXNESZZPUPJE-UHFFFAOYSA-N spiromesifen Chemical compound CC1=CC(C)=CC(C)=C1C(C(O1)=O)=C(OC(=O)CC(C)(C)C)C11CCCC1 GOLXNESZZPUPJE-UHFFFAOYSA-N 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000001550 time effect Effects 0.000 description 1
Images
Landscapes
- Television Signal Processing For Recording (AREA)
Abstract
A method and system simplifies the creation process of a multimedia story for a user. It does this by using input and/or derived metadata, by providing constraints on the usability of assets, by automatically suggesting a theme for a story, and identifying appropriate assets and effects to be included in a story, which assets and effects are owned by the user or a third party.
Description
Technical field
The present invention relates to for automatically producing architecture, method and the software that story is shared product.Especially, the present invention relates to simplify the generation processing of multimedia slide projection, pasteup, film, photograph album and other image product.
Background technology
Digital resource generally comprises rest image, video and music file, and they are produced and download in personal computer (PC) memory storage so that the individual enjoys.In general, when expectation is browsed, listened to or plays these digital resources, it is conducted interviews.
The many multimedia application that are used for the consumer concentrate on such as the video on video, CD/DVD, perhaps on the single output type of printed matter.The processing of the output in using for generation of these is mainly manual mode, and usually very time-consuming.Can only come those resources of choice for use by the user, produce what output, how to arrange resource, how resource is used any editor and what impact is resource applied.In addition, the selection of a kind of output type being done is selected not keep for being applied to replace to export.Exemplary application comprises video editor, for generation of the program of DVD, calendar, greeting card etc.
Have some now and introduced the program of the robotization of certain level.Normally, they also require the user to select resource.In some cases, they provide the additional input such as text, and will how to select to one group of limited alternatives of those resources application from indicating effect and conversion subsequently.The application of those effects is that fix, random, perhaps usually used, and usually not based on the attribute of image self.
The present invention is by can using a kind of computer utility, shortcoming for above-mentioned prior art provides solution, the information about the content of digital resource is derived in this computer utility intelligently, with the application of guiding conversion, effect and template, comprise to automatically produce the third party content that desired output is incorporated into to be provided or can use by network on computers from the set of number resource as input.
Summary of the invention
A preferred embodiment of the present invention relates to a kind of computer-implemented method, and it is used for the multimedia resource of automatic Selective storage on computer system.The method is utilized the input metadata with resource dependency, and derives metadata from wherein generating.Then, resource-based input metadata and derivation metadata are carried out classification to resource, and automatically select the subset of resource based on this classification.Another preferred embodiment comprises the user profile information of storage such as user preference, and the step of classification comprises user profile information.Another preferred embodiment of the present invention comprises: use the theme look-up table that comprises a plurality of themes with different themes attribute; And will input and derive metadata and these attributes compare, with identification with input with derive the theme that metadata has broadly similar.These attributes can to such as birthday, anniversary, spend a holiday, interested event or the subject matter of red-letter day, family or motion be relevant.In general, these resources are made of picture, rest image, text, figure, music, video, audio frequency, multimedia presentation or descriptor file.
Another preferred embodiment of the present invention comprises the use such as the effect able to programme of convergent-divergent or translation that is applied to resource of being controlled by rule database, this rule database be used for restriction with effects applications to those resources that shown by best results.Can come design motif and effect by the user or by the third party.Third party's theme and effect comprise dynamic auto zoomed image template, automated graphics placement algorithm, video scene conversion, rolling title, figure, text, poem, audio frequency, music, song, and digital motion picture and the rest image of famous person, welcome personage or cartoon character.Based on theme, resource and the rule database selected, resource being enrolled story shares in descriptor file.This document can be stored on portable memory, perhaps is sent to other computer system.Can show each descriptor file on different output mediums and form.
Another preferred embodiment of the present invention is a kind of computer system, and it has to the entrance of the multimedia resource of storage and is used for reading and the metadata of resource dependency and the assembly that is used for generating the derivation metadata.This computer system also has to the entrance of subject description symbol file, and this subject description symbol file comprises the effect that can be applicable to resource and the theme template that is used for coming with preferred output format Demo Asset.Subject description symbol file comprises the data of selecting from positional information, background information, special-effect, conversion or music.The addressable rule database of computer system comprises some conditions, is used for application restric-tion with effect in the resource of these conditions that meet rule database.The addressable instrument of computer system can enroll story with resource based on the condition of the output format of selecting and rule-based database and share in descriptor file.Multimedia resource comprises the digital resource of selecting from picture, rest image, text, figure, music, video, audio frequency, multimedia presentation and descriptor file.
The invention provides be used to the method for writing story, system and software, its service regeulations database so that with the random Availability constraints of resource and effect in the story scope.
Another aspect of the present invention is provided for writing method, system and the software of story, and wherein metadata database is built into and comprises input metadata, derivation metadata and metadata relationship.This metadata database is used to the story suggested subject.
Another aspect of the present invention is provided for identifying based on the metadata database that will use method, system and the software of suitable resource and effect in story.These resources and effect can be had by user or third party.They can be available on the computer system the user during story produces, and perhaps can access them by network remote.
Provide in another aspect of this invention and be used for sharing according to story system, method and the software that descriptor file, output descriptor file and demonstration rule produce different output products.
The contemplated other embodiment of the present invention comprises computer-readable medium and program storage device, they comprise or the program of portable or processor instructions effectively, are used for making machine or computer processor to carry out instruction or data structure stored thereon.This computer-readable medium can be any available medium, and it can be by universal or special computer access.This computer-readable medium can comprise physical computer-readable media, for example, and such as RAM, ROM, EEPROM, CD-ROM, DVD, or other optical disc memory, magnetic disk memory or other magnetic memory apparatus.Can be used for carrying or storing and to be considered within the scope of the invention by any other medium of the software program of universal or special computer access.
When considering in conjunction with the following description and drawings, will be familiar with better and understand these and other aspect of the present invention and purpose.Yet, should be understood that, shown the preferred embodiments of the present invention and its a large amount of detail although below describe, these descriptions illustrate and unrestricted providing as an example.Without departing from the premise in the spirit of the present invention, can carry out within the scope of the invention multiple change and correction, and the present invention includes all such corrections.Following accompanying drawing need not be drawn about any accurate ratio of size, angular relationship or relative position.
Description of drawings
Fig. 1 is the block diagram that can implement the computer system of different embodiments of the invention.
Fig. 2 is the diagrammatic representation of the architecture of the system that is used for writing story constructed according to the invention.
Fig. 3 is the process flow diagram of the operation of keymake module constructed according to the invention;
Fig. 4 is the process flow diagram of the operation of previewing module constructed according to the invention;
Fig. 5 is the process flow diagram of the operation of functional modules constructed according to the invention;
Fig. 6 be according to of the present invention from obtain and the use system the list of the extraction metadata tag that obtains;
Fig. 7 is the list according to the derivation metadata tag that obtains from the analysis of resource content and existing extraction metadata tag of the present invention;
Fig. 8 A-8D illustrates the list of sharing descriptor file according to the example story of the relation between two kinds of different outputs of resource continuous time effects of the present invention;
Fig. 9 is that exemplary slideshow constructed according to the invention represents; And
Figure 10 is that exemplary pasteup constructed according to the invention represents.
Embodiment
Resource is the digital document that is made of picture, rest image, text, figure, music, film, video, audio frequency, multimedia presentation or descriptor file.Every kind of resource has some standard formats.Story shared system described in literary composition about: easily produce the entertaining story of intelligence with sharable form, and transmit consistent optimum playback experience on numerous imaging system.Story is shared and is allowed the user easily to produce, play and shared story.Story can comprise picture, video and/or audio.The user can share their story with the imaging service, and this imaging service will be format and the transmission of recipient's contents processing.Then, the recipient can easily ask from the story output of sharing, and the form of output is printed matter, DVD or exports such as the customization of pasteup, placard, atlas etc.
As shown in Figure 1, be used for implementing system of the present invention and comprise computer system 10.Computer system 10 comprises the CPU 14 that communicates by letter with other device by bus 12.For example, CPU 14 carries out the software that is stored on hard disk drive 20.Video display devices 52 is connected in CPU 14 by DIU display interface unit 24.Mouse 44 and keyboard 46 are connected in CPU 14 by desktop interface device 28.Computer system 10 also comprises CD-R/W driver 30, in order to read different CD media, and writes to CD-R or CD-RW writable media 42.Computer system 10 also comprises DVD driver 32, in order to read or write to it from DVD dish 40.The Audio Interface Unit 26 that is connected with bus 12 allows, and for example, is converted into the simulated audio signal that is applicable to loudspeaker 50 from the voice data that is stored in the digital sound files on hard disk drive 20.Audio Interface Unit 26 also will convert from the simulated audio signal of microphone 48 numerical data that is applicable to be stored in hard disk drive 20 for example to.In addition, computer system 10 is connected with external network 60 by network connection device 18.Digital camera 6 can pass through, and for example, USB interface device 34 is connected with home computer 10, in order to 20 transmit rest image, audio/video and audio files from video camera to hard disk drive, vice versa.USB interface can be used for the mobile storage means of USB compatibility is connected on computer system.The set of digital multimedia or single medium object (digital picture) can exclusively reside on hard disk drive 20, CD 42, perhaps such as, by the remote storage place of network 60 addressable web servers.Set also can be across distributing arbitrarily or all among these.
Should be understood that, these digital multimedia objects can be: digital still, such as the digital still that is produced by digital camera; Voice data is such as any different-format, such as " WAV " or " MP3 " audio file formats, digital music or voice document, perhaps, these digital multimedia objects can be the digital video fragments that has or do not have sound, such as MPEG-1 or MPEG-4 video.The digital video object also comprises the file that graphics software produces.The database of digital multimedia object can comprise only a kind of object, perhaps combination in any.
Utilize minimum user's input, the story shared system can automatically produce story intelligently.The story of system constructed according to the invention is shared architecture and workflow is carried out simple and clear illustrating by Fig. 2, and comprises with lower unit:
Story is shared descriptor file 112.
The story of writing is shared descriptor file 115.
Subject description symbol file 111.
Output descriptor file 113.
Story keymake/editing machine 114.
Story performance device/browser 116.
Also have the topic style table except said units, this topic style table is for the background of theme and prospect resource.The prospect resource is the image that can be superimposed upon on another image.Background image is that the main body to digital photos provides the image such as the background patterns of border or position.In order to produce unique product, multilayer prospect and background resource can be added on image.
Initial story descriptor file 112 can be default XML file, and it can selectively be used for providing any default information by any system.In case this document is filled fully by keymake 114, this document will become the story descriptor file 115 of writing.In the default version of story descriptor file, it comprises be used to the essential information of writing story, for example, can define the simple slideshow form that shows delegation's text, for some images keep white space, define the demonstration duration of each, and can select background music.
The story descriptor file of writing provides a description the needed necessary information of entertaining story.As described below, the story descriptor file of writing will comprise the information of resource information, subject information, effect, conversion, metadata and all other needs, so that build complete and entertaining story.In some aspects, the story descriptor file of writing is similar to Storyboard and can is default descriptor, as mentioned above, filled the resource of selecting its minimum level, perhaps, for example, it can comprise a large amount of users or third party's resource, comprises a plurality of effects and conversion.
Therefore, in case produced this descriptor file of writing 115 (it has represented a story), this document can be stored in portable memory together to the resource relevant with story so, perhaps be sent to any imaging system with performance assembly 116, and be used therein to produce the shared output products of story.This permission system writes story, preserves information by this story descriptor file of writing, and shares output file (slideshow, film etc.) in after a while time on different computing machines or to the story that different output produces performance subsequently.
Subject description symbol file 111 is another XML files, and for example, it provides necessary subject information, such as artistic expression.This will comprise:
The position of theme, such as, in computer system, perhaps on the network such as the internet.
Background/foreground information.
Specific to such as red-letter day theme theme or special-effect, the conversion with individual meaning.
Music file with Topic relative.
Subject description symbol file is, for example, XML file layout, and point to the image template file, such as the JPG file, it provides one or more appointments to be used for showing the space of the resource 110 of selecting from resource set.For example, this template can be in the text message of saying " happy birthday " shown in the birthday template.
The keymake 114 that is used for the development story comprises use the subject description symbol file 111 of above-mentioned information.This module obtains input from three previous assemblies, and can selectively use the automated graphics selection algorithm to write story descriptor file 115.The user can choosing a topic, and perhaps theme can be selected with algorithm by the content of the resource that provides.When sharing descriptor file 115, the story that keymake 114 is write in foundation will utilize subject description symbol file 111.
Resource location and resource related information (metadata).The user selects resource 110, perhaps can automatically select resource 110 from the analysis of associated metadata.
Subject description symbol file 111.
The user input relevant to effect, conversion and image organizational.Normally, subject description symbol file will comprise the major part of this information, but the user can select to edit the part of this information.
Utilize this input message, keymake assembly 114 will be arranged necessary information, in order to write complete story in the story descriptor file of writing, this story descriptor file of writing comprises the information of the required whole requirements of performance device.To reflect any editor that the user is undertaken by keymake on story descriptor file 115.
In the situation that given input, keymake will carry out following operation:
The intellectuality tissue of resource is such as organizing into groups or set up chronology.
Use suitable effect, conversion etc. based on selected theme.
Analyze resource and read and produce the needed necessary information of entertaining story.This requires the detailed description information about resource, and it can be used for determining whether effect is feasible on specific resources.
For example, output descriptor file 113 is XML files, and it comprises about will produce the information of what output, and produces the needed information of this output.This document will comprise the constraint based on following factor:
The device capability of output unit.
The hard copy output format.
Output file form (MPEG, Flash, MOV, MPV).
The expression regulation that uses, as described below, it is used for promoting performance (because output unit be unknown-descriptor can be on another device recycling) of story when the output form requires not to be included in the information of story descriptor file.
Such as the XSL code-switching descriptor information converting of (be used for revising the story descriptor file, thereby it does not comprise telescopic information, and only comprise specific to the XSLT program of the information of output form).
Story performance device 116 is configurable assemblies, and it is made of optional plug-in unit corresponding to the different output formats of supporting from representation system.Story performance device 116 is set the form of story analysis descriptor file 115 according to the output format of the selection that is used for the shared product of story.For example, if browse output on little mobile phone, giant-screen device or the printed matter form such as photograph album, can revise form.Then, the performance device is determined the resolution of the requirement that resource is required etc. based on output format constraint etc.When operation, this assembly will read the story of writing that keymake 114 produces and share descriptor file 115, and act on the shared descriptor file 115 of this story of writing by the output 18 of processing story and produce such as the requirement of DVD or other hard copy format (slideshow, film, customization output etc.).116 pairs of story descriptor file 115 elements of performance device make an explanation, and depend on selected output type, and the performance device will produce story with the desired form of output system.For example, the performance device can read the story of writing and share descriptor file 115, and based on the full detail of describing in the story descriptor file 115 of writing, produces the MPEG-2 slideshow.Performance device 116 will be carried out following functions:
Read the story descriptor file 115 of writing and correctly it made an explanation.
Explanation is translated, and call suitable plug-in unit to carry out actual encoded/transcoded.
Produce the output format of the performance that requires.
This assembly obtains the story of generation and the output by as requested, suitably produces menu, title, credit and chapters and sections and writes story.
After having described specific story in the story descriptor file 115 of writing, this document can be reused to produce the different output format of this particular story.This allows story to write by a computer system or on a computer system, and retains by descriptor file.Can store the story descriptor file of writing on any system or portable memory, and it be reused to produce subsequently the different output on different imaging systems.
In other embodiment of the present invention, story descriptor file 115 does not comprise presentation information, but quotes the identifier for the particular presentation of storing with the template form.In these embodiments, as the description of doing for subject description symbol file 111, template base will be embedded in keymake 114 and performance device 116.Then, the story descriptor file will be pointed to template file, but they will not be included as the part of descriptor file self.By this way, will not represent complete story to the third party that may be the non-intended recipinent of story descriptor file.
As described in a preferred embodiment, for example understand respectively in more detail three main modular in the shared architecture of story in Fig. 3,4 and 5, be keymake module 114, previewing module (not shown in Fig. 2) and functional modules 116, and in more detail below they be described.With reference to Fig. 3, for example understand the operational flowchart of keymake module of the present invention.In step 600, the user himself begins to process by system is shown.This form that can get has username and password, bio-measurement ID, or the account by selecting first to deposit.By ID is provided, system can incorporate into any user's preference and configuration information, before use pattern, such as the personal information of existing individual and family relationship, and key dates and major event.This also can be used for being provided to the entrance that promotes intended recipinent is shared the needed user's of product who completes address book, phone and/or email list.User ID also can be used for being provided to the entrance of user resources collection, as shown in step 610.The third party content that the user resources collection can comprise corporally or business ground generates, it comprises: digital still, text, figure, video segment, sound, music, poem etc.At step 620 place, system reads and records the existing metadata that is associated with each resource file, is called in the text the input metadata, such as time/date stamp, exposure information, video segment duration, GPS position, image orientation and filename.At step 630 place, such as human eye/people's face is distinguished/is identified, object is distinguished/identification, text identification, speech-to-text, indoor/outdoor are determined, a series of resource analysis technology of scene lighting and main body sorting algorithm are used to provide additional resource derives metadata.Some different graphical analyses and sorting algorithms have been described in several patents of owning together and patented claim.For example, as No. the 6606411st, the commonly assigned United States Patent (USP) that is entitled as " A Method For Automatically Classifying Images Into Events " issued on August 12nd, 2003; And No. the 6351556th, the commonly assigned United States Patent (USP) that is entitled as " A Method For Automatically Comparing Content of Images forClassification Into Events " of issuing on February 26th, 2002 is described in detail, by with unstructured one group of media resource automatic classification, cut apart and be clustered into discrete timeliness event and subevent, the timeliness affair clustering of synthetic image resource.As described in detail in No. the 6480840th, the commonly assigned United States Patent (USP) that is entitled as " Method And Computer Program Product ForSubjective Image Content Similarity-Based Retrieval " issued on November 12nd, 2002, CBIR (CBIR) from database retrieval of similar in the image of example (or inquiry) image.Can judge whether image is similar based on a lot of different modules, for example, color, texture or such as the similarity of other content identified of people's face.This concept can expand to part or interested zone (ROI) of image.Inquiry can be the part (ROI) of whole image or image.The image of retrieval can mate by whole image, perhaps also can search for each image for the respective regions that is similar to this inquiry.In the context of the present invention, CBIR can be used for automatically selecting with classification and other resources-type like or with resource like theme class.For example, " Valentine's Day " theme may need to find take redness as main image, perhaps finds the color in autumn for " Halloween " theme.The scene classification device is with scene Recognition or be categorized into one or more scene type (for example, seabeach, indoor etc.), perhaps one or more activities (for example, run etc.).The details of operation of exemplary scene classification type and they has been described: No. the 6282317th, the United States Patent (USP) that is entitled as " Method ForAutomatic Determination Of Main Subjects In Photographic Images " in following patent and patented claim; No. the 6697502nd, the United States Patent (USP) that is entitled as " Image Processing Method ForDetecting Human Figures In A Digital Image Assets "; No. the 6504951st, the United States Patent (USP) that is entitled as " Method For Detecting Sky In Images "; The U. S. application that is numbered US2005/0105776A1 that is entitled as " Method For Semantic Scene ClassificationUsing Camera Metadata And Content-Based Cues " is open; The U. S. application that is numbered US 2005/0105775A1 that is entitled as " Method Of Using TemporalContext For Image Classification " is open; And the U. S. application that is numbered US 2004/003746A1 that is entitled as " Method For Detecting Objects In DigitalImage Assets " is open.People's face detection algorithm is used in and finds people's face as much as possible in resource set, in following patent and application, this is described: No. the 7110575th, the United States Patent (USP) that is entitled as " Method For LocatingFaces In Digital Color Images " of issuing on September 19th, 2006; No. the 6940545th, the United States Patent (USP) that is entitled as " Face Detecting Camera And Method " of issuing on September 6th, 2006; The U. S. application that is numbered US 2004/0179719A1 open (U.S. Patent application of submitting on March 12nd, 2003) that is entitled as " Method And System For Face Detection InDigital Image Assets ".Recognition of face is based on facial characteristics with recognition of face or sorts out adult's example or the label relevant to the people, as described in following patented claim: 11/559544 the U.S. Patent application of being numbered that is entitled as " User Interface For FaceRecognition " of submitting on November 14th, 2006; 11/342053 the U.S. Patent application of being numbered that is entitled as " Finding Images With Multiple People Or Objects " of submitting on January 27th, 2006; And 11/263156 the U.S. Patent application of being numbered that is entitled as " Determining A Particular Person From A Collection " of submitting on October 31st, 2005.People's face cluster is used by detecting the data that generate with feature extraction algorithm the people's face that seems similar is organized into groups.As hereinafter describing in detail, can trigger this selection based on digital the value of the confidence.Disclose described location-based data as the U. S. application that is numbered US 2006/0126944A1 that is entitled as " Variance-Based Event Clustering " of submitting on November 17th, 2004, can comprise mobile phone launching tower position, gps coordinate and network router position.Harvester can comprise or not comprise the metadata of filing together with image or video file; Yet, generally store these as metadata by the pen recorder that gathers image, video or sound together with resource.When using location-based metadata with other attribute cooperation that is used for the media cluster, this location-based metadata can be very powerful.For example, keep the information of place names system about U.S.'s geologic prospect special column of place name, it provides latitude and longitude coordinate has been mapped to generally acknowledged feature title and the instrument of characteristic type, and characteristic type comprises the type such as church, park or school.In the U.S. Patent Application Publication that is numbered US 2007/0008321A 1 that is entitled as " Identifying Collection Images With Special Events " that is to submit on July 11st, 2005, describe the event recognition that will detect and the semantic classes that is referred to such as birthday, wedding etc. in detail.Due to identical position, setting or activity, classify as the media resource of event can time per unit by so related, and purpose is relevant to the subjective intention of user or user's group.In each event, media resource can also be clustered into the discrete group of related content, is referred to as the subevent.Media in event and identical setting or movable relevant, and the media in the subevent have similar content in an event.image value index (" IVI ") is defined as significance level (importance, attractive force, serviceability or practicality) tolerance, individual consumer's it can be associated with specific resources (and can be the grade as metadata store that the user inputs), and be the U.S. Patent application that is numbered N0.11/403686 that is entitled as " Value Index From Incomplete Data " that on April 13rd, 2006 submitted to, and on April 13rd, 2006 submit to be entitled as being numbered in 11/403583 U.S. Patent application of " Camera User InputBased Image Value Index ", this image value index is described in detail.Automatically the IVI algorithm can utilize the characteristics of image such as acutance, illumination and other quality index.The metadata (exposure, time, date) that video camera is relevant, image understanding (size of skin or the detection of people's face and skin/human face region), or behavior measure (browsing time, amplification, editor, printing or shared) also can be used to any specific media resource to calculate IVI.Full content with the prior art reference listed in this section is combined in herein by reference.
At step 640 place, with the existing metadata of corresponding resource dependency together with store new derivation metadata, in order to increase existing metadata.The new metadata group is used in the resource of step 650 place organizing user and to user's resource order of classification.This classification is based on according to the analysis of correlativity and the output of sorting algorithm, or alternatively, provides as mentioned above the image value index of quantitative result.
At determination step 660 places, can be based on metadata and the user preference subset of automatically selecting user resources of combination.The editor's who determines technology such as order of classification and the quality of image value index resource group is used in this selection expression.At step 670 place, the user can select alternatively to ignore automatic resource and select and select manually to select and edit asset.At determination step 680 places, the analysis of the set of metadata of execution combination and the resource of selection is to determine whether advising suitable theme.Theme in literary composition be such as move, spend a holiday, the resource descriptor of family, red-letter day, birthday, anniversary etc., and can be by automatically advising such as the metadata of the time/date stamp that conforms to the birthday with the relatives that obtain from user profile information.This is favourable, because the resource that nowadays generates for the consumer, it is almost hard-core that available theme is processed.For the user, search all over countless option with find pass on suitable emotion mood and with the theme of the format and content feature compatibility of user resources are the challenges that are bound to arouse fear.By analysis relation and picture material, can advise theme more specifically.For example, if face recognition algorithms identification " Molly ", and user profile information indication " Molly " is user's daughter.User profile information can also comprise the information that this time last year user has made the souvenir DVD of " birthday party in four years old of Molly ".Can provide Dynamic Theme to have the general theme such as " birthday " of additional detail with automatic customization.If use image template in can be with the theme that automatically " filling a vacancy " text and figure be modified, this will make it possible to " happy birthday " changed over " happy birthday in five years old Molly ", and not require that the user participates in.Box 690 is included in step 680, and comprises the list of available theme, can in this locality by the mobile storage means such as storage card or DVD, perhaps by being connected with service supplier's network, provide the list of this available theme.Third party participant and content of copyright owner can also provide theme according to the scheme of the type of paying per use.The input of combination and the resource set that derives metadata, analysis and sorting algorithm output and tissue be used to user's selectional restriction to be applicable to resource content and with the theme of resource type compatibility.At step 200 place, the user can select the theme accepting or refuse to advise.If the place does not have suggested subject in step 680, perhaps determine step 200 user of place the theme refusing to advise, she can select at step 210 place from the limited list of theme or from the whole available storehouse of available theme manual choosing a topic.
Use the theme of selection to obtain third party's resource and the effect specific to theme together with metadata.At step 220 place, this additional content and processing can be provided by mobile storage means, perhaps can access from the service supplier by communication network, perhaps visit by the pointer that points to third-party vendor.System can based on and the different participants of the popularity distribution of income that comes automatic monitoring and document to relate to use these assets and expense between arrangement.These records also can be used for determining user preferences, make to be graded highlyer specific to third party's resource of fashion theme and effect, perhaps are given with higher right of priority, thereby increase the possibility of Customer Satisfaction.These third party's resources and effect comprise dynamic auto zoomed image template, automated graphics placement algorithm, video scene conversion, rolling title, figure, text, poem, music, song, and digital moving and the rest image of famous person, welcome personage and cartoon character, use together with the resource that they all are designed to generate with the user and/or obtain.Both be suitable for generally hard copy such as greeting card, pasteup, placard, mouse pad, cup, atlas, calendar specific to third party's resource of theme and effect, also be suitable for the soft copy such as film, video, digital slideshow, interactive game, web website, DVD and digital cartoon.The resource of selecting and effect can be used as graph image, Storyboard, descriptive list or multimedia presentation and show to obtain its agreement to the user.At determination step 230 places, the user can select to accept or refuse resource and the effect specific to theme, and if she selects to refuse them, system shows that at step 250 place one group of resource of replacing and effect are to obtain user's agreement or refusal.In case the user has accepted third party's resource and effect specific to theme at step 230 place, these are combined with the user resources of tissue at step 240 place specific to third party's resource of theme and effect, and start previewing module at step 260 place.
Referring now to Fig. 4, illustrate the operational flowchart of previewing module.At step 270 place, make the user resources of arrangement and can use for previewing module specific to resource and the effect of theme.At step 280 place, the output type that user's selection is wanted.Output type comprises different hard copies and soft copy form, such as printed matter, atlas, placard, video, DVD, digital slideshow, Downloadable film, and the web website etc.Output type can be static, such as printed matter and atlas, or interactive demonstration, such as DVD and video-game.Can obtain these types from look-up table (LUT) 290, can provide this look-up table 290 to previewing module on removable medium, perhaps by this look-up table 290 of communication network access.Can provide them when new output type is available, and can be provided by third party vender.Output type comprises demonstrating user resources with the form of the output form compatibility of selecting and specific to the resource of theme and needed whole rules and the step of effect.Output type rule is used for from user resources and the project of selecting to be suitable for exporting form specific to resource and the effect of theme.For example, if song " happy birthday " is the resource specific to theme of appointment, will from the hard copy output such as photograph album, this song " happy birthday " be shown as sheet music or it will be omitted fully.If selected video, digital slideshow or DVD, the audio content of song will be selected so.Similarly, derive metadata if people's face detection algorithm is used to generating content, this identical information can be used to use for hard copy output provides the image of automatically cutting out, and perhaps using for soft copy provides zooming and panning dynamic, centered by people's face.
At step 300 place, for the output type wanted is used effect specific to theme to the user who arranges with specific to the resource of theme.At step 310 place, with such as showing virtual output type rough draft to the user together with the resource that provides in LUT 320 and output parameter, LUT 320 comprises the parameter specific to output such as image total number, video segment total number, fragment duration, printed matter size, photograph album page layout, the selection of music and playing duration time.The place shows these details together with virtual output type rough draft to the user in step 310.At determination step 330 places, the user can select to accept virtual output type rough draft or revise resource and output parameter.If the user wants to revise resource/output parameter, she advances to step 340.How that Downloadable video is shortened to the video with 5 minute duration from the total duration of 6 minutes to its example that uses.The user can select manual editing's resource, perhaps allows system automatically to eliminate and/or shorten the displaying time of resource, quickening conversion etc. to shorten the length of video.In case the user is satisfied to virtual output type rough draft at determination step 330 places, the place should be sent to functional modules by virtual output type rough draft in step 350.
Referring now to Fig. 5, illustrate the operational flowchart of the operation of functional modules 116.Turn to now step 360, make the user resources of arrangement and can use for functional modules specific to the resource of theme and the applied effect of output type of wanting.At step 370 place, the user is from selecting output format the available look-up table shown in step 390.Can connect to provide this LUT by mobile storage means or network.These output formats comprise the different digital form of supporting such as personal computer, mobile phone, based on the multimedia device of the web website of server or HDTV.These output formats are also supported to produce such as unbound 4 " * 6 " the desired digital format of hard copy output print form of printed matter, binder and placard, for example JPG and TIFF.At step 380 place, to the user who arranges with specific to the processing of the resource of theme and the output format selected specific to the effects applications of theme specific to the user.The place shows virtual output rough draft to the user in step 400, and at determination step 410 places, the user can agree or refuse this virtual output rough draft.If virtual output rough draft is rejected, the user can select to replace output format, and if the user agreed, produce output products at step 420 place.Output products can produce in this locality, for example uses the PC of family and/or printer, perhaps remotely produces, and for example uses Kodak Easy ShareGallery
TMAt step 430 place, for the soft copy type output products of long-range generation, connect by network they are sent to the user, perhaps physically transported to the recipient of user or appointment.
Referring now to the list of the extraction metadata tag of Fig. 6-obtain from resource acquisition and use system, resource acquisition and use system comprise video camera, mobile phone camera, personal computer, digital frame, video camera docking system, imaging device, networking display and printer.Extract metadata and be synonymous to the input metadata, and comprise by imaging device record and from the mutual information of user and device automatically.The canonical form of extracting metadata comprises: time/date stamp, the positional information that is provided by GPS (GPS), nearest mobile phone launching tower or mobile launching tower triangulation, camera setting, image and audio frequency histogram, file layout information, and proofread and correct such as color range adjustment and the automated graphics of eliminating blood-shot eye illness.Except this aut.eq. central information record, user interactions also can be registered as metadata, and comprises: " sharing ", " hobby " or " not wiping " are specified; " figure punch command format (DPOF) "; " the wallpaper appointment " or " image information transmission " that be used for mobile phone camera that the user selects; " image information transmission " recipient who passes through Mobile Directory Number or E-mail address that the user selects; And the drainage pattern of selecting such as the user of " motion ", " microspur/low coverage ", " pyrotechnics " and " portrait ".The image operative installations is such as operation Kodak Easy Share
TMThe personal computer of software or other image management system and image printer independent or that be connected also provide the source of extracting metadata.The information of the type comprises that to show that image has been printed the history of printing of how many times, when shows and has where stored or backed up the storage of image historical, and shows the type of the digit manipulation that has occured and the edit history of quantity.Extracting metadata is used to offer help and obtains the background that derives metadata.
List referring now to the derivation metadata tag of Fig. 7-obtain from resource content and existing analysis of extracting metadata tag.Can be produced by resource acquisition and use system and derive metadata tag, collection of resources and utilize system to comprise: video camera, mobile phone camera, personal computer, digital frame, video camera docking system, imaging device, networking display and printer.Can automatically produce the derivation metadata tag satisfying specific predetermined standard time, perhaps produce alternately the derivation metadata tag from the end user.The mutual example that extracts metadata and derive between metadata is the image acquisition time/date stamp that uses video camera to generate in conjunction with user's digital calendar.Two systems can all be configured on identical equipment such as mobile phone camera, perhaps can be dispersed between the imaging device and personal computer video camera docking system such as video camera.Digital calendar can not only comprise the individual interested key dates, such as " mother and father's wedding anniversary ", " aunt's Betty birthday " and " the small-sized corporations dinner party of Tommy ", and comprise the popular interested key dates, such as, May 5, Independence Day, Halloween, Christmas Day etc.Time/date stamp that video camera generates can be used as the inquiry of check figures calendar, in order to determine whether any image or other resource gather masses on the interested date interested or individual.If produced coupling, metadata can be upgraded the derived information that comprises that this is new.By comprising other extraction metadata and the derivation metadata such as positional information and location recognition, can set up other context and set.For example, if, after several weeks idle, be in day entry in September 5 in the position that is identified as " mother and father's house " a series of image and video.In addition, user's digital calendar shows that September 5 was " mother and father's anniversary ", and some images comprise the have demonstration cake picture of text of " mother and father, the anniversary is happy ".Now, the extraction metadata of combination and derivation metadata can provide context very accurately for event " mother and father's anniversary " automatically.Setting up in this contextual situation, only having relevant theme to select to use for the user with making, finding the needed workload of suitable theme thereby reduced significantly.Due to now system's known event type and Primary Actor, can also help to realize making marks, Attach Title or write blog, perhaps make their robotizations.
As mentioned above, the other method of context setting is called as " event is cut apart ".Its service time/date stamp is recording the use pattern, and when the method was used together with image histogram, it provided the method that image, video and related resource Auto-grouping is become " event ".This makes the user to organize and to browse large-scale resource set by event.
Can end user's face, object, language and text identification and algorithm come the content of analysis image, Audio and Video resource.Relative position in the number of people's face and a scene or a series of scene can disclose material particular, in order to be the Resource Supply context.For example, a large amount of people's faces that are arranged in several rows and some row indicate the context of formal posture to can be applicable to family reunion, team sport, graduation etc.Additional information indication " motion event " such as the team uniform of the sign with identification and text; The cap that matches and robe indication " graduation "; The clothing indication " family reunion " that mixes; And white robe, the robe that mixes colours mutually and man's indication " wedding " of wearing full dress.These indications are combined with the extraction metadata of adding and derivation metadata context accurately are provided, and it makes system can select suitable resource, the related subject of the resource that is provided for selecting, and provide relevant additional resource to the source material collection.
Story shares-rule in theme:
Theme is the ingredient that story is shared, and it has strengthened the displaying of user resources.Content, the third party content that provides based on the user and how to show that content sets up specific story.Displaying can be hard copy or soft copy, rest image, video or audio frequency, perhaps their combination or whole.Theme will affect the selection of third party content and the type of the displaying option that story adopts.Show that option comprises conversion between background, visible resource, is applied to the effect of visible resource, and audio frequency, video or the static content of replenishing.If show it is soft copy, theme namely, is showed the speed of content also with the influence time benchmark.
In story, show to relate to content and to the operation of this content.It should be noted that these operations will be affected by the type of their operated contents.Be not that all operations were that is included in particular topic all is suitable for the full content that particular story comprises.
When the story keymake had been determined the displaying of story, this story keymake progressively formed the description to the sequence of operations of one group of given content.Theme can comprise the information as the framework of this series operation in story.Write the comprehensive framework of middle use in " key " story.When the user writes the mutual control of processing, use comprehensive weak framework.Usually should the series operation be called template.Can think that template is unfilled story,, does not have allocated resource that is.Under any circumstance, when to the template Resources allocation, operating in when being applied to content of describing in template follows the principles.
Normally, with the rule of Topic relative with resource as input variable.Rule for carrying out what operation on what content during writing in story retrains.In addition, if resource comprises certain metadata, can revise or strengthen this series operation or template with the rule of Topic relative, make story can become more complicated.
The rule example:
1) be not that all image files all have identical resolution.Therefore, be not that all image files can be supported identical zoom operations scope.The rule of the zoom operations of restriction on specific resources will based on certain combination of the metadata of resource dependency, such as, for example, resolution, main body distance, size of main body or focal length.
2) will be based on the existence of the resource with certain metadata characteristic, perhaps based on the ability to this resource application specific algorithms in the operation of writing middle use of story.Exist or the applicability condition if can not satisfy, can not comprise this operation for this resource so.For example, searching " tree " if write search attribute, and do not comprising the picture of tree in set, will not select picture so.After this can not use any algorithm of searching " Christmas tree decoration " picture.
3) certain operations requires two (perhaps may be more) resources.Conversion is the example of two resources of requirement.The description of series operation must be mentioned the resource of the needed correct number of specific operation.In addition, the operation of mentioning must have suitable type.That is to say, conversion can not produce between audio resource and rest image.Normally, operation is specific to type, such as not amplifying on audio resource.
4) depend on operation and the added constraint of theme of use, the order of the operation of carrying out on resource may be restrained.That is, writing processing may require translation before zoom operations.
5) particular topic can forbid carrying out specific operation.For example, story may not comprise video content, and includes only rest image and audio frequency.
6) particular topic can limit the displaying time that any specific resources or resource type can have in story.In this case, will limit demonstration, displaying or play operation.For audio or video, this rule will require keymake to carry out temporal pre-service before in the description that resource is included in series operation.
7) theme that has comprehensive framework might comprise quoting non-existent operation on the keymake of particular version.Therefore, theme is necessary to comprise the operation alternative rule.Especially, alternate application is in conversion.When carrying out conversion between two resources, " wiping " can have some mixed effects.If keymake can not be described more advanced conversion, simple sharp edge is wiped and be can be used as alternative transforms.Should be noted in the discussion above that for the performance device to show the situation of the described conversion of story descriptor, this performance device also has alternative rule.Under many circumstances, might substitute the operation of not supporting with blank operation.
8) rule of particular topic will check whether resource comprises certain metadata.If specific resources comprises certain metadata, the additional operations that the template that exists in can being executed in theme on this resource limits.Therefore, particular topic can allow the condition execution to the operation of content.This has provided the outward appearance that story is dynamically changed as what resource function relevant to story, perhaps, more specifically, as the outward appearance to story dynamic change of what metadata with the function of the resource dependency relevant with story.
The rule that is used for the business constraint:
Depend on specific embodiment, theme can be limited operation according to the complexity of keymake or price or user's privilege.Single theme will retrain based on the identifier of keymake or class of subscriber and write the operation that allows in processing, rather than distribute not on the same group theme to different keymakes.
Story is shared, but additional application rule:
Show that rule can be the ingredient of theme.When having selected theme, the rule in the subject description symbol is embedded in the story descriptor.Show that rule also can be embedded in keymake.The story descriptor can be mentioned a large amount of art processing that can draw from specific Main Resources.Due to before the art of mentioning in the story descriptor processes, must produce and store them in intrasystem somewhere, comprise that more art processing writes the required time of story with lengthening.Yet the generation that art is processed makes the performance efficient of story higher, especially for the multimedia playback.Be similar to the rule of theme described in selecting, the number that the art that draws from Main Resources during writing processing is processed and form will be required in user profile and the performance of record farthest increase the weight of, succeeded by the selected theme of ordinary populace.
Expression regulation is the ingredient of output descriptor.When the user selected to export descriptor, these rules helped to guide performance to process.Specific story descriptor will be mentioned the main code of digital resource.For rest image, this will be original figure negative film (ODN).The story descriptor will probably be mentioned other art processing of this Main Resources.The output descriptor will probably be associated with specific output unit, so rule will be present in the output descriptor, in order to select to be used for the specific art processing of performance.
The theme selective rule is embedded in keymake.The user selects processing to guide the input of keymake and the metadata that exists in user content to theme.The metadata relevant to the specific collection of user content can be guided the suggestion of some themes into.Keymake will have the entrance to database, and this database will show which has based on the theme of the suggestion of metadata the maximum probability of being selected by the user.Rule will farthest increase the weight of to be fit to the theme of user profile, succeeded by the selected theme of ordinary populace.
With reference to Fig. 8, illustrate the exemplary fragment of the shared descriptor file of story of definition " slideshow " output format in this example.Xml code starts from normative document header 801, and the resource that will be included in this output products starts from the Resources list 802.With boldface letter, the variable information that above-mentioned keymake module is filled is shown.The resource that is included in this descriptor file comprises AASID0001803 to ASID0005804, and they comprise MP3 audio file and the JPG image file that is arranged in the local resource catalogue.Resource can be placed on the different memory storages that any and local system connect or on the webserver such as web website, internet.This exemplary slideshow also will show resource artist name 805.Also comprise the shared resource such as background image resource 806 and audio file 803 in this slideshow.Story is shared information and is started from row " story shared segment " 807.The audio frequency duration 808 was defined as 45 seconds.The demonstration of resource ASID0001.jpg809 is programmed to the demonstration duration 810 of 5 seconds.Next resource ASID0002.jpg812 is programmed to the demonstration duration 811 of 15 seconds.Other the different standard of displaying that is used for the resource of slideshow is also included within this exemplary fragment of descriptor file, and is known by the those skilled in the art, will it be further described.
Fig. 9 represents slideshow output fragment 900:ASID0001.jpg910 and the ASID0002.jpg 920 of above-mentioned two resources.Resource ASID0003.jpg 930 has 5 seconds demonstration duration in the slideshow fragment.Figure 10 represents the recycling of same descriptor file, shares from the identical story of Fig. 8 illustrated the slideshow that generates Fig. 9 descriptor file with pasteup output format 1000.This pasteup output format illustrates the non-time representation of the time reinforcement of the given resource ASID0002.jpg 1020 in the slideshow form, for example, the size that increases, this is because resource ASID0002.jpg 1020 had than other resource ASID0001.jpg 1010 and longer duration of ASID0003.jpg 1030.This understands that for example the resource continuous time is in two kinds of different output-slideshows and the impact in pasteup.
List of parts
6 digital cameras
10 computer systems
12 data buss
14 CPU
16 ROM (read-only memory)
18 network connection devices
20 hard disk drives
22 random access memory
24 DIU display interface units
26 Audio Interface Units
28 desktop interface devices
30 CD-R/W drivers
32 DVD drivers
34 USB interface devices
40 removable mediums based on DVD are such as DVD R-or DVD R+
42 removable mediums based on CD are such as CD-ROM or CD-R/W
44 mouses
46 keyboards
48 microphones
50 loudspeakers
52 video displays
60 networks
110 resources
111 subject description symbol and template files
112 default stories are shared descriptor file
113 output descriptor file
114 story keymake/editor module
115 stories of writing are shared descriptor file
116 story performance device/browser module
117 story writing modules
118 produce different output
The theme that 200 users accept a proposal
210 user's choosing a topics
220 use metadata obtain third party's resource and the effect specific to theme
Do 230 users accept resource and the effect specific to theme?
240 user resources that arrange+specific to resource and the effect of theme
250 obtain third party's resource and the effect specific to theme of replacement
260 to previewing module
270 user resources that arrange+specific to resource and the effect of theme
The output type that 280 users' selections are wanted
290 output type look-up tables
300 use effect specific to theme to the user resources that arrange with specific to the resource of theme for the output type wanted
310 show to the user the virtual output type rough draft that comprises resource/output parameter
Parameter list is searched in 320 resource/outputs
390 output format look-up tables
400 virtual output rough drafts
Do 410 users agree?
420 produce output products
430 send output products
600 user ID/summary
610 user resources collection
620 obtain existing metadata
630 extract new metadata
640 process metadata
650 use metadata are come organizational resources and resource are carried out order of classification
Are 660 automatic resources selected?
670 user resources are selected
Can 680 metadata suggested subject?
690 theme look-up tables
700 xml codes
710 resources
720 seconds
730 resources
800 slideshows represent
801 normative document headers
802 the Resources lists
803 “AASID0001”
804 “ASID0005”
805 resource artist name
806 background image resources
807 story shared segments
808 audio frequency duration
The demonstration of 809 resource ASID0001.jpg
810 resources
The demonstration duration of 811 15 seconds
812 resource ASID0002.jpg
820 resources
830 resources
900 pasteups represent
910 resources
920 resources
930 resources
1000 pasteup output formats
1010 ASID0001.jpg
1020 ASID0002.jpg
1030 ASID0003.jpg
Claims (16)
1. computer-implemented method, it is used for automatically selecting some multimedia resources from a plurality of multimedia resources that are stored on computer system, and the method comprising the steps of:
Read the input metadata with described a plurality of resource dependencies;
Generating based on described input metadata derives metadata and stores this derivation metadata;
Input metadata and derivation metadata based on described resource are carried out classification to described a plurality of resources;
Subset based on the described a plurality of resources of grading automatical selection of described a plurality of resources;
The theme look-up table that comprises a plurality of themes that have separately an association attributes is provided and accesses this theme look-up table;
More described input and derivation metadata and described theme look-up table attribute are to identify with described input and to derive the theme that metadata has broadly similar;
The effect a plurality of able to programme that can be applicable to described a plurality of resources is provided;
Provide rule database, so that resource-based metadata limits effects applications on resource; And
Based on theme, described a plurality of resources and the described rule database selected, described a plurality of resources are embedded story share in descriptor file.
2. the method for claim 1, further comprise the step that obtains and store the user profile information that comprises user preference information, and the step of wherein classification further comprises the step of described a plurality of resources being carried out classification based on described user profile information.
3. the method for claim 1, wherein multimedia resource is the digital resource of selecting from picture, rest image, text, figure, video, audio frequency, multimedia presentation or descriptor file.
4. the method for claim 1, wherein said input metadata comprises the input metadata tag.
5. the method for claim 1, wherein said derivation metadata comprises the derivation metadata tag.
6. the attribute that the method for claim 1, wherein said theme look-up table comprise from birthday, anniversary, spend a holiday, select red-letter day, family or motion.
7. the method for claim 1, wherein metadata and the described rule database according to resource comes constraint applies in the zooming effect of resource.
8. the method for claim 1, wherein metadata and the described rule database according to resource comes constraint applies in the image processing algorithm of resource.
9. the method for claim 1, the step that wherein provides theme to search comprise from local storage that computer system is connected obtain the step of third party's theme look-up table.
10. the method for claim 1, the step that wherein provides theme to search comprise obtain the step of third party's theme look-up table by network from another computer systems.
11. the method for claim 1, wherein provide the step of a plurality of effects able to programme comprise from local storage that computer system is connected obtain the step of third party's effect able to programme.
12. the method for claim 1 wherein provides the step of a plurality of effects able to programme to comprise and obtain the step of third party's effect able to programme by network from another computer system.
13. method as claimed in claim 12 is wherein selected third party's theme and effect from the digital moving of dynamic auto zoom image template, automated graphics placement algorithm, video scene conversion, rolling title, figure, text, audio frequency, famous person, welcome personage or cartoon character and rest image.
14. a system that is used for automatically selecting from being stored in a plurality of multimedia resources on computer system some multimedia resources, this system comprises:
Be used for reading the device with the input metadata of described a plurality of resource dependencies;
Be used for generating based on described input metadata and derive metadata and store the device of this derivation metadata;
For the device that described a plurality of resources is carried out classification based on input metadata and the derivation metadata of described resource;
Be used for the device based on the subset of the described a plurality of resources of grading automatical selection of described a plurality of resources;
Be used for providing the theme look-up table that comprises a plurality of themes that have separately an association attributes and the device of accessing this theme look-up table;
Be used for more described input and derivation metadata and described theme look-up table attribute and have the device of the theme of broadly similar with identification and described input and derivation metadata;
Be used for providing the device of a plurality of effects able to programme that can be applicable to described a plurality of resources;
Be used for providing rule database so that resource-based metadata limits with effects applications the device on resource; And
Be used for based on theme, described a plurality of resources and the described rule database selected, with the device in the shared descriptor file of described a plurality of resources embedding stories.
15. system as claimed in claim 14, wherein said multimedia resource is the digital resource of selecting from picture, rest image, text, figure, video, audio frequency, multimedia presentation or descriptor file.
16. system as claimed in claim 14, it is the XML form that wherein said story is shared descriptor file.
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US87097606P | 2006-12-20 | 2006-12-20 | |
| US60/870,976 | 2006-12-20 | ||
| US11/958,894 | 2007-12-18 | ||
| US11/958,894 US20080215984A1 (en) | 2006-12-20 | 2007-12-18 | Storyshare automation |
| PCT/US2007/025982 WO2008079249A2 (en) | 2006-12-20 | 2007-12-20 | Storyshare automation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101568969A CN101568969A (en) | 2009-10-28 |
| CN101568969B true CN101568969B (en) | 2013-05-08 |
Family
ID=41284169
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200780047783.7A Expired - Fee Related CN101568969B (en) | 2006-12-20 | 2007-12-20 | Storyshare automation |
| CN2007800477127A Expired - Fee Related CN101584001B (en) | 2006-12-20 | 2007-12-20 | Automated production of multiple output products |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2007800477127A Expired - Fee Related CN101584001B (en) | 2006-12-20 | 2007-12-20 | Automated production of multiple output products |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN101568969B (en) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011170690A (en) * | 2010-02-19 | 2011-09-01 | Sony Corp | Information processor, information processing method and program |
| JP5730090B2 (en) * | 2011-03-23 | 2015-06-03 | キヤノン株式会社 | Display control apparatus, display control method, and program |
| US9483877B2 (en) * | 2011-04-11 | 2016-11-01 | Cimpress Schweiz Gmbh | Method and system for personalizing images rendered in scenes for personalized customer experience |
| US9069781B2 (en) * | 2012-05-24 | 2015-06-30 | Microsoft Technology Licensing, Llc | Techniques to automatically manage file descriptors |
| US9250779B2 (en) * | 2013-03-15 | 2016-02-02 | Intel Corporation | System and method for content creation |
| US10140369B2 (en) * | 2014-07-01 | 2018-11-27 | Vf Worldwide Holdings Limited | Computer implemented system and method for collating and presenting multi-format information |
| US9781392B2 (en) * | 2015-09-16 | 2017-10-03 | Intel Corporation | Facilitating personal assistance for curation of multimedia and generation of stories at computing devices |
| CN105302315A (en) | 2015-11-20 | 2016-02-03 | 小米科技有限责任公司 | Image processing method and device |
| EP3188019B1 (en) * | 2015-12-30 | 2019-09-18 | InterDigital CE Patent Holdings | Method for selecting a content comprising audiovisual data and corresponding electronic device, system, computer readable program product and computer readable storage medium |
| WO2017147484A1 (en) * | 2016-02-24 | 2017-08-31 | Vivhist Inc. | Personal life story simulation system |
| CN108235092A (en) * | 2016-12-14 | 2018-06-29 | 杭州芯讯科技有限公司 | information issuing method and device |
| CN110521213B (en) * | 2017-03-23 | 2022-02-18 | 韩国斯诺有限公司 | Story image making method and system |
| CN107170027A (en) * | 2017-05-18 | 2017-09-15 | 中邮电子商务有限公司 | A kind of image synthesis and joining method and system based on theme post office APP |
| CN108536658B (en) * | 2018-03-06 | 2024-01-23 | 杭州优工品科技有限公司 | Method and device for generating custom tag data |
| CN110400494A (en) * | 2018-04-25 | 2019-11-01 | 北京快乐智慧科技有限责任公司 | A kind of method and system that children stories play |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1189437A2 (en) * | 2000-09-14 | 2002-03-20 | Sharp Kabushiki Kaisha | System for management of audiovisual recordings |
| EP1345443A2 (en) * | 2002-03-07 | 2003-09-17 | Chello Broadband NV | Enhancement for interactive tv formatting apparatus |
| EP1408424A2 (en) * | 2002-09-13 | 2004-04-14 | Eastman Kodak Company | A method and a software program for creating an image product having predefined criteria |
| EP1422668A2 (en) * | 2002-11-25 | 2004-05-26 | Matsushita Electric Industrial Co., Ltd. | Short film generation/reproduction apparatus and method thereof |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU732696B2 (en) * | 1997-04-01 | 2001-04-26 | Medic Interactive, Inc. | System for automated generation of media programs from a database of media elements |
| WO2001077777A2 (en) * | 2000-04-05 | 2001-10-18 | Abyan, Inc. | Method and system for cell rendering and manipulation |
| US7352952B2 (en) * | 2003-10-16 | 2008-04-01 | Magix Ag | System and method for improved video editing |
-
2007
- 2007-12-20 CN CN200780047783.7A patent/CN101568969B/en not_active Expired - Fee Related
- 2007-12-20 CN CN2007800477127A patent/CN101584001B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1189437A2 (en) * | 2000-09-14 | 2002-03-20 | Sharp Kabushiki Kaisha | System for management of audiovisual recordings |
| EP1345443A2 (en) * | 2002-03-07 | 2003-09-17 | Chello Broadband NV | Enhancement for interactive tv formatting apparatus |
| EP1408424A2 (en) * | 2002-09-13 | 2004-04-14 | Eastman Kodak Company | A method and a software program for creating an image product having predefined criteria |
| EP1422668A2 (en) * | 2002-11-25 | 2004-05-26 | Matsushita Electric Industrial Co., Ltd. | Short film generation/reproduction apparatus and method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101584001B (en) | 2012-06-13 |
| CN101584001A (en) | 2009-11-18 |
| CN101568969A (en) | 2009-10-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101568969B (en) | Storyshare automation | |
| US20080155422A1 (en) | Automated production of multiple output products | |
| US20200026751A1 (en) | Narrative-based media organizing system for transforming and merging graphical representations of digital media within a work area | |
| US20080215984A1 (en) | Storyshare automation | |
| US8364755B2 (en) | System for digital yearbook with social networking | |
| JP5710804B2 (en) | Automatic story generation using semantic classifier | |
| US20070124325A1 (en) | Systems and methods for organizing media based on associated metadata | |
| GB2507036A (en) | Content prioritization | |
| US20080281776A1 (en) | Interactive System For Creating, Organising, and Sharing One's Own Databank of Pictures Such as Photographs, Drawings, Art, Sketch, Iconography, Illustrations, Portraits, Paintings and Images | |
| US20090083642A1 (en) | Method for providing graphic user interface (gui) to display other contents related to content being currently generated, and a multimedia apparatus applying the same | |
| JP5406201B2 (en) | Process for organizing multimedia data | |
| KR20130005455A (en) | Knowledge card based on digital information and the generating method and system thereof and computer readable recording medium | |
| JP2005346492A (en) | Content sharing system and content container generating method | |
| KR101813902B1 (en) | Systems for combining video modules and method thereof | |
| KR102538156B1 (en) | Method for supporting scenario writing in electronic device and apparauts thereof | |
| CN100498765C (en) | Method and device for making electric newspaper printing plate | |
| KR102242055B1 (en) | Adaptated e-Book Sharing Platform and Adaptated e-Book Sharing solution | |
| CN100454997C (en) | Image description system and method | |
| WO2005081638A2 (en) | Interactive system for creating, organising, and sharing one’s own databank of pictures such as photographs, drawings, art, sketch, iconography, illustrations, portraits, paintings, and images |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: GAOZHI 83 FOUNDATION LLC Free format text: FORMER OWNER: EASTMAN KODAK COMPANY (US) 343 STATE STREET, ROCHESTER, NEW YORK Effective date: 20130401 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20130401 Address after: Nevada, USA Applicant after: Gaozhi 83 Foundation Co.,Ltd. Address before: American New York Applicant before: Eastman Kodak Co. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130508 Termination date: 20151220 |
|
| EXPY | Termination of patent right or utility model |