US20080248873A1 - Systems, methods and computer products for running a multi-stage online elimination competition based on member generated content - Google Patents
Systems, methods and computer products for running a multi-stage online elimination competition based on member generated content Download PDFInfo
- Publication number
- US20080248873A1 US20080248873A1 US12/060,327 US6032708A US2008248873A1 US 20080248873 A1 US20080248873 A1 US 20080248873A1 US 6032708 A US6032708 A US 6032708A US 2008248873 A1 US2008248873 A1 US 2008248873A1
- Authority
- US
- United States
- Prior art keywords
- content
- subset
- content submissions
- submissions
- members
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims description 65
- 230000008030 elimination Effects 0.000 title claims description 13
- 238000003379 elimination reaction Methods 0.000 title claims description 13
- 238000012552 review Methods 0.000 claims description 79
- 238000004891 communication Methods 0.000 claims description 45
- 238000012216 screening Methods 0.000 claims description 35
- 238000011156 evaluation Methods 0.000 claims description 13
- 230000008520 organization Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 description 28
- 238000004590 computer program Methods 0.000 description 11
- 230000008901 benefit Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000001413 cellular effect Effects 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000004075 alteration Effects 0.000 description 1
- 238000005267 amalgamation Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000003651 drinking water Substances 0.000 description 1
- 235000020188 drinking water Nutrition 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000003340 mental effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000002250 progressing effect Effects 0.000 description 1
- 238000000746 purification Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07F—COIN-FREED OR LIKE APPARATUS
- G07F17/00—Coin-freed apparatus for hiring articles; Coin-freed facilities or services
- G07F17/32—Coin-freed apparatus for hiring articles; Coin-freed facilities or services for games, toys, sports, or amusements
Definitions
- the present invention generally relates online competitions, and more particularly to systems, methods, and computer products for running a multi-stage online elimination competition based on member generated content.
- the present invention provides systems, methods and computer program products for running a multi-stage online elimination competition based on member generated content.
- Content is submitted by and voted on, in part, by members, after the content survives a multi-stage filtering process involving predetermined evaluation criteria and evaluated by members, automated screening procedures, internal competition staff, and an advisory committee.
- a member can enter member-generated content for consideration in the competition.
- a first evaluation stage subjects the content to automated word-based screening and preliminary vendor screening before being accepted into submission.
- all members rate submitted content, and can report objectionable content to have it flagged for vendor review and possible removal.
- the third stage has a succession of iterative internal vendor reviews of the top member voted content from each distinct succession of predefined voting periods.
- the fourth stage matches content with potential implementation of the content to provide a check on feasibility of the content winning, with feasibility determined by the purposes, aims, and scopes of each individual competition.
- the fifth stage submits the content to an advisory committee for voting and narrowing down the potential winners. The members again vote on the remaining content to determine a winner.
- Such member submissions may take place over any technology that allows for an electronic parsing of the contained information, such as e-mail, filling in of a web-based vendor generated form, an SMS text message, or similar means of communication.
- Member voting may take place over any technology that allows communication with the members, such as mail, e-mail, conventional phone, cellular phone, SMS text message, web pages, or similar means of communication.
- FIG. 1 is a block diagram of a competition system in accordance with an example embodiment of the present invention.
- FIG. 2 is a flowchart illustrating the flow of a piece of content through the submission and judging process according to an example embodiment of the present invention.
- FIG. 3 is a flowchart illustrating the content submission process according to an example embodiment of the present invention.
- FIG. 4 is a flowchart illustrating a member reported violation of competition rules of a particular piece of submitted content according to an example embodiment of the present invention.
- FIG. 5 is a flowchart illustrating an elimination decision flow during one period of an iterative judging process according to an example embodiment of the present invention.
- FIG. 6 is an example computer system used in one embodiment of the present invention.
- the present invention is directed to systems, methods, and computer products for running a multi-stage online elimination competition based on member generated content and is now described in more detail herein in terms of an exemplary competition system for selecting a community service report, as described below. This is for convenience only and is not intended to limit the application of the present invention. In fact, after reading the following description, it will be apparent to one skilled in the relevant art(s) how to implement the following invention in alternative embodiments (e.g., competitions for best member generated artwork, or best member generated fictional short stories, etc.).
- the main participants in the competition are cardmembers, and non-cardmembers are encouraged to become a cardmember in order to participate.
- ideas for community service projects are solicited from cardmembers and other cardmembers are allowed to review and vote on the projects.
- projects are internally narrowed down to a list of the top (e.g., 100) projects.
- the top projects are submitted to an advisory committee of judges, such as high profile celebrities and/or experts.
- the advisory committee narrows the projects down further (e.g., top 50), the results of which are then submitted to the cardmembers for several rounds of voting on which project should win an endowment from the card provider for third-party sponsor.
- Competition system 100 could be used, for example, to select as a winning charity project idea a plan to distribute water purification devices to some of the world's poorest countries and train the denizens on how to use the devices.
- cardmember “member,” “participant,” “competitor,” “user,” and/or the plural form of these terms are used interchangeably throughout herein to refer to those persons or entities capable of accessing, using, being affected by and/or benefiting from the tool that the present invention provides for a multi-stage online elimination competition based on member generated content.
- “Content” may encompass any amalgamation of material that is discernable to the public at large and transmittable, such as text, images, video, audio, links to websites, or anything else communicative. Exact limits on types of eligible content may be enforced on a competition specific basis.
- “Member generated content” includes any competition-eligible content generated by a particular member personally, as well as any content that the member has appropriate permission to represent as his or her own in the competition.
- a participant system 102 represents an interface a member utilizes to communicate with and participate in the competition.
- Such a system can encompass a myriad of devices that facilitate communication, such as, but not limited to: a personal computer connected to the Internet, a conventional telephone, a fax machine, a cellular phone, a mailbox, or a personal digital assistant (PDA) or similar digital personal device capable of external communication.
- PDA personal digital assistant
- a communications engine 104 facilitates communication between participant system 102 and the other components of competition system 100 , such as a parsing engine 106 , an internal review engine 108 , and an advisory review engine 110 .
- Communications engine 104 may consist of any form of communications technology, both automated such as fax machines, network routers, personal computers connected to the Internet, and the like, and manual such as telephone operators and the postal system, and the like.
- Parsing engine 106 parses the content submitted by the participant system 102 and screen out any content that fails a set of predefined criteria.
- the predefined criteria used by the parsing engine 106 may be distinct, overlapping, or similar to the predefined criteria utilized by the internal review engine 108 and the advisory review engine 110 , described below. Moreover, such a screening may be automated or manual. If content passes screening performed by the parsing engine 106 , it is then submitted to internal review engine 108 for a more detailed review of submitted content.
- An internal review engine 108 performs a more detailed review and screening of the submitted content utilizing predefined criteria.
- the review is conducted with the aim of narrowing down the entries in the competition utilizing the predefined criteria.
- Such a review may be automated or manual, and may utilize any number of distinct or overlapping sets of predefined criteria. Further, such a review may be conducted during any part of the competition to cause the removal, combination, reclassification, or other similar alteration of a plurality of content submissions.
- the predefined criteria used by the internal review engine 108 may be distinct, overlapping, or similar to the predefined criteria utilized by parsing engine 106 and advisory review engine 110 .
- Internal review engine 108 may analyze content obtained for different sources within competition system 100 , such as communications engine 104 or the parsing engine 106 . Moreover, content within a specific competition may be reviewed by the internal review engine 108 one time or a plurality of times, and either with a simple review or an iterative review (described below), depending on the design of the competition.
- Advisory review engine 110 performs a high-level review and screening of the submitted content utilizing predefined criteria. Such a review is conducted with the aim of narrowing down the entries in the competition which have passed through one or more applications of internal review engine 108 described above. Such a review may also be automated or manual.
- the predefined criteria used by the advisory review engine 108 may be distinct, overlapping, or similar to the predefined criteria utilized by parsing engine 106 and internal review engine 108 .
- FIG. 2 represents a flowchart illustrating a process flow of content through competition system 100 in accordance with an example embodiment of the present invention.
- Blocks 224 collectively represent an example content submission process, which is defined in greater detail with respect to FIG. 3 below.
- Blocks 226 collectively represent an example for gradually eliminating competition entries until a single entry or a group of entries is determined to be the competition winner.
- the member submits content through participant system 102 to the communications engine 104 for inclusion in the competition.
- the type of content, form of submission, and method of submission may take on multiple configurations.
- a member is any potential user that has gone through a registration process and submits a community service project idea to the competition through a form on the competition's website.
- parsing engine 106 parses the member submitted content and flags content that contained certain pre-determined content, for instance text containing profanity. If such content is flagged, the process proceeds to block 206 , where the submitting member is prompted to resubmit a competition entry if they desire further consideration in the competition, otherwise the submission method then ends.
- Block 208 utilizes a higher level of review than block 204 , and can analyze the content and compare it to a set of pre-defined submission criteria. Examples of such criteria that would prompt entry rejection include, but are not limited to, the inclusion of offensive or divisive material, the use of propaganda, the inclusion of third party references within the content, the inclusion of personal information in the content, the inclusion of a URL or other online reference in the content, the inclusion of content that violates the law, the inclusion of content that violates the rules of the particular competition, and the like.
- the content moves on to public availability through communications engine 104 , which would enable review and voting on by all members, possible including the content-submitting member, in block 210 .
- members may flag specific entries for further review, which will be explained in greater detail in connection with FIG. 4 .
- the member may review content which has passed the content submission process 224 . Further, members may rate the content in accordance with their own preference.
- cardmembers may log on to the competition webpage, view a list of all submitted projects, and view a detailed profile of each individual submitted charity idea. Cardmembers may then rate each idea, such as with a 1-5 star rating, where 1 star is least desirable and 5 stars is most desirable. The average star ratings of each project are evaluated in conjunction with the number of total rankings that each submitted project received, such that there is a bias toward projects with significant numbers of ratings over those with an equal average rating but fewer total ratings.
- the top ranked content from block 210 is subjected to a feasibility check for the consequences of the specific content winning the overall competition by internal review engine 108 . Any content submissions rejected during this step will be removed from the competition in block 222 . The content submissions that are qualified in block 214 will be passed along to block 216 , detailed below.
- Block 214 is iterative because all content passed on from block 210 is not examined at once, but rather several times over the course of the competition. The time the iterative judging process runs is described in terms of a submission period.
- the top X ranked content entries are evaluated and either qualified or rejected.
- the top X+Y ranked content entries from periods 1 and 2 are evaluated, with those entries evaluated during period 1 keeping their previously determined qualified or rejected status. These entries are not reevaluated.
- the top X+Y+Z ranked content entries are evaluated from periods 1-3, with those entries evaluated during periods 1 and 2 keeping their previously determined qualified or rejected status. These entries also are not reevaluated. This process continues until the submission periods are over. Thus, the total number of submissions qualified from block 210 is reduced, and the submissions qualified under block 214 are then passed on to block 216 .
- the evaluative criteria used in block 214 can be different from the criteria utilized in block 208 .
- the iterative review in block 214 can be layered with multiple sets of evaluative criteria, where only content submissions that are qualified under an iterative review using a first set of evaluative criteria are entered into consideration of an iterative review using a second set of evaluative criteria.
- the first set of evaluative criteria is used to provide a feasibility check on the foreseeable ability to implement a charity project in the content submission.
- the second set of evaluative criteria is used to match each charity project with an organization that can effectively implement the described project. After being qualified content qualified in both will be promoted to the next level of the competition.
- An example round of the iterative content feasibility check can be seen in FIG. 5 and its related discussion.
- advisory review engine 110 utilizes a set of predefined evaluative criteria to analyze, rate, and narrow down the remaining content submissions through, for example, a conventional scoring of the content. This evaluation may be either automated or manual. Moreover, the evaluative criteria may vary between different embodiments.
- advisory review engine 110 is a small committee with high profile members, possibly including such people as celebrities or respected participants in a community relevant to the competition; this allows the competition to receive several benefits, such as increased publicity, respectability, or accuracy in determining which submissions deserve to win the competition.
- the advisory review engine 110 evaluates and ranks the content submissions that were qualified from block 214 based on predetermined criteria. After receiving the rankings of the advisory review engine 110 , the specific content submissions are again separated out by the competition system 100 so that a predetermined number of “top ranking” submissions may be made publicly available by the communications engine 104 and passed along to block 218 , with all other submissions being eliminated from the contest in block 222 .
- the member community votes on the top ranked content submissions from block 216 .
- the voting may take place in a multitude of fashions through communications engine 104 , from clicking on a web page selection button, to sending an SMS text message, to calling a specified phone number, to other similar technologies.
- the voting also can take place in any number of voting rounds, so that content submissions are narrowed down after the first vote in some fashion and members may vote again on the newly narrowed list of top ranked content submissions, with this repeating until a winner or a group of winners is chosen.
- Content submissions that win the member vote in block 218 proceed to block 220 as winners of the competition. All other content submissions lose the competition, progressing to block 222 .
- any rankings obtained during block 218 of content submissions that progress to block 222 could be utilized in providing tiered awards for the non-winners of the competition (e.g., a second place prize, a finalists' prize, an honorable mention prize, etc.).
- FIG. 3 is a flowchart illustrating a content submission process 300 method according to an example embodiment of the present invention.
- a registered member submits content from the participant system 102 to the competition system 100 for consideration.
- Such content can take on many forms, so long as it conveys information and is capable of being parsed by electronic systems. In one exemplary embodiment, such content takes on the form of descriptions of potential community service projects and brief biographies of the member submitting the project.
- Parsing engine 106 performs a screening of the content in block 304 to rule out any submissions that fail a previously identified set of criteria.
- Example criteria that qualify an entry for rejection by the automated screening include the use of profanity or other unacceptable words.
- the process proceeds to block 306 where the member is notified of the rejection and prompted to resubmit alternate content if they wish to be considered in the competition.
- the method thus proceeds to block 308 , where the member may either resubmit alternate content, taking them back to block 302 , or quitting the method altogether.
- Example decision criteria that can be used in block 310 include, but are not limited to, the inclusion of offensive or divisive material, the use of propaganda, the inclusion of third party references within the content, the inclusion of personal information in the content, the inclusion of a URL or other online reference in the content, the inclusion of content that violates the law, or inclusion of content that violates the rules of the particular competition.
- the method will proceed to block 313 wherein an appropriate communication is sent to the participant system 102 through the communications engine 104 .
- Such a process can be automated by having the internal review engine 108 in block 310 specify a rejection type and having that rejection type elicit a pre-determined response which varies by rejection type.
- the communication in block 313 could read: “Thank you for your contribution. Unfortunately, the project you submitted did not meet our submission criteria. References to third parties—including people, companies, and brands—are not permitted due to Copyright and Trademark concerns. We invite you to revise your entry, which is included below, and try again.” The process would then proceed to block 306 , as described above.
- the internal review engine 108 conducts a rating of content according to pre-established competition criteria.
- the method would pass into block 312 , wherein an escalated review of the content could take place by the internal review engine 108 .
- Such a review could be ‘escalated’ as compared to the review in block 310 by, for example, having multiple manual reviewers examine the content or utilizing a different algorithm to review the content.
- the method would proceed to the above described block 313 . If the content is accepted by the escalated review in block 312 , the method would proceed to the above described block 316 . If the escalated review in block 312 still cannot determine whether the content fails to meet the pre-defined criteria, the method would proceed to block 314 wherein a higher level is requested to review the content. Examples of the higher level include the designer of the pre-defined criteria, the client of the competition provider, or the management of the competition provider. For instance, the reviewers could contact the credit card issuer sponsoring the community project competition for their decision on the content. After block 314 , the method proceeds to block 326 where it stops.
- Step 318 the method moves on to block 318 , wherein the approved content is displayed publicly through communications engine 104 .
- the method moves on to block 320 , wherein an appropriate communication is sent to the participant system 102 through the communications engine 104 .
- Both Steps 318 and 320 can be automated to increase efficiency, although automation is not required.
- block 322 the content is made available for perusal, comment, and rating (and possible flagging for review as described below in more detail with respect to FIG. 4 ) by any member through communications engine 104 .
- the method proceeds to block 324 , wherein a submission is considered complete.
- FIG. 4 is a flowchart illustrating a process 400 for providing a member reported violation of competition rules of a particular piece of submitted content according to an example embodiment of the present invention.
- the content in question is automatically appended to the report or otherwise displayed in block 404 so as to be capable of review by the internal review engine 108 .
- the report with the appended or otherwise displayed content submission is communicated to the internal review engine 108 in block 406 to again judge the submission against a set of pre-defined contest eligibility criteria, which may or may not be the same as utilized in block 310 in FIG. 3 as described above.
- the process proceeds to block 410 wherein the submitted content is removed from the list of accepted submissions and the public listing of such submissions as accessible through the communications engine 104 .
- the process proceeds to block 412 , wherein a communication is sent through the communications engine 104 both to the member who reported a problem with the content in question and the member who submitted the content in question. Both blocks 410 and 412 can be automated so as to increase efficiency, yet this is not required.
- the process proceeds to block 414 , where the submitting member is prompted through the communications engine 104 to submit other content into the contest if so desired. The method then progresses to block 416 , where the user reported violation portion ends.
- block 406 If the decision in block 406 is to accept the submitted content as in accord with the pre-defined contest eligibility criteria utilized in block 406 , then the process proceeds to block 420 , where a message is sent to the reporting member through the communications engine 104 indicating that the content has been reviewed but still deemed acceptable. Following block 420 , the process proceeds to block 422 where the user reported violation portion ends. Both blocks 420 and 422 could be automated to increase efficiency, but this is not required.
- the process progresses to block 408 where an escalated review of the content by the internal review engine 108 takes place.
- a review could be ‘escalated’ in comparison to the review in block 406 by having, for instance, multiple reviewers examine the content, a different algorithm examine the content, or a reviewer higher up within the organization examine the content.
- the process proceeds to block 418 wherein a higher level is requested to review the content.
- a higher level include the designer of the pre-defined criteria, the client of the competition provider, or the management of the competition provider. For instance, in the charity project competition, the internal review engine 108 contacts the card issuer for their decision on the content.
- the method proceeds to block 424 where it stops.
- FIG. 5 is a flowchart illustrating a process 500 providing elimination decision flow during one period of an iterative judging step in the internal review engine according to an example of the present invention.
- the review period consists of a week, and the second review period 500 is depicted.
- the top ranked content submissions from the preliminary member rankings are selected for review. These top ranked submissions may include submissions that have been submitted during any submission period to date, in this case within week 1 or week 2, even if the submissions were qualified or disqualified in week 1.
- the submissions that were reviewed in the previous submission period, week 1 are removed from consideration during this period and keep their qualified or rejected status assigned to them in week 1.
- the remaining non-evaluated projects are assigned to individual reviewers within the internal review engine 108 .
- those individual reviewers will compare each project against a set of predefined criteria, such as in this embodiment where the criteria are the feasibility of enacting the suggested charity project detailed in the content submission.
- the individual reviewers must decide whether to accept, reject, or further examine a content submission.
- the process proceeds to block 512 , where the content submission is added to a “qualified list”, which is maintained in block 518 .
- This qualified list will be utilized in future iterative judging submission rounds in block 504 in order to avoid reviewing already qualified ideas.
- the process proceeds to block 516 , where the content submission is added to a “disqualified list”, which is maintained in block 520 .
- This disqualified list will be utilized in future iterative judging submission rounds in block 504 in order to avoid reviewing already disqualified ideas, even if they still rank in the top specified portion of rated content submissions for that particular review period.
- the method proceeds to block 522 . If this is not the last submission period, the method will return to block 502 where it will re-commence during the next submission period. If this is the last submission period and there are no more iterations to proceed through, the method proceeds to block 524 where it stops and the qualified list functions as the list of content submissions that have passed through this iterative screening.
- the individual reviewer in block 510 may defer the content submission to an escalated review in block 514 .
- the escalated review is a panel made up of all of the individual reviewers who were assigned content submissions in block 506 , but this could also possibly include other reviewers, different reviewing algorithms, utilizing different evaluative criteria, etc. Determination of acceptance of the content submission will lead to block 512 , described above, and determination of rejection of the content submission will lead to block 516 , also described above.
- the present invention may be implemented using hardware, software or a combination thereof and may be implemented in one or more computer systems or other processing systems.
- the manipulations performed by the present invention were often referred to in terms, such as reviewing, screening, or flagging, which are commonly associated with mental operations performed by a human operator. No such capability of a human operator is necessary, or desirable in most cases, in any of the operations described herein which form part of the present invention. Rather, the operations are machine operations.
- Useful machines for performing the operation of the present invention include general purpose digital computers or similar devices.
- the invention is directed toward one or more computer systems capable of carrying out the functionality described herein.
- An example of a computer system 600 is shown in FIG. 6 .
- the computer system 600 includes one or more processors, such as processor 604 .
- the processor 604 is connected to a communication infrastructure 606 (e.g., a communications bus, cross-over bar, or network).
- a communication infrastructure 606 e.g., a communications bus, cross-over bar, or network.
- Computer system 600 can include a display interface 602 that forwards graphics, text, and other data from the communication infrastructure 606 (or from a frame buffer not shown) for display on the display unit 630 .
- Computer system 600 also includes a main memory 608 , preferably random access memory (RAM), and may also include a secondary memory 610 .
- the secondary memory 610 may include, for example, a hard disk drive 612 and/or a removable storage drive 614 , representing a floppy disk drive, a magnetic tape drive, an optical disk drive, etc.
- the removable storage drive 614 reads from and/or writes to a removable storage unit 618 in a well known manner.
- Removable storage unit 618 represents a floppy disk, magnetic tape, optical disk, etc. which is read by and written to by removable storage drive 614 .
- the removable storage unit 618 includes a computer usable storage medium having stored therein computer software and/or data.
- secondary memory 610 may include other similar devices for allowing computer programs or other instructions to be loaded into computer system 600 .
- Such devices may include, for example, a removable storage unit 622 and an interface 620 .
- Examples of such may include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as an erasable programmable read only memory (EPROM), or programmable read only memory (PROM)) and associated socket, and other removable storage units 622 and interfaces 620 , which allow software and data to be transferred from the removable storage unit 622 to computer system 600 .
- EPROM erasable programmable read only memory
- PROM programmable read only memory
- Computer system 600 may also include a communications interface 624 .
- Communications interface 624 allows software and data to be transferred between computer system 600 and external devices. Examples of communications interface 624 may include a modem, a network interface (such as an Ethernet card), a communications port, a Personal Computer Memory Card International Association (PCMCIA) slot and card, etc.
- Software and data transferred via communications interface 624 are in the form of signals 628 which may be electronic, electromagnetic, optical or other signals capable of being received by communications interface 624 . These signals 628 are provided to communications interface 624 via a communications path (e.g., channel) 626 . This channel 626 carries signals 628 and may be implemented using wire or cable, fiber optics, a telephone line, a cellular link, a radio frequency (RF) link and other communications channels.
- RF radio frequency
- computer program medium and “computer usable medium” are used to generally refer to media such as removable storage drive 614 , a hard disk installed in hard disk drive 612 , and signals 628 .
- These computer program products provide software to computer system 600 .
- the invention is directed to such computer program products.
- Computer programs are stored in main memory 608 and/or secondary memory 610 . Computer programs may also be received via communications interface 624 . Such computer programs, when executed, enable the computer system 600 to perform the features of the present invention, as discussed herein. In particular, the computer programs, when executed, enable the processor 604 to perform the features of the present invention. Accordingly, such computer programs represent controllers of the computer system 600 .
- the software may be stored in a computer program product and loaded into computer system 600 using removable storage drive 614 , hard drive 612 or communications interface 624 .
- the control logic when executed by the processor 604 , causes the processor 604 to perform the functions of the invention as described herein.
- the invention is implemented primarily in hardware using, for example, hardware components such as application specific integrated circuits (ASICs).
- ASICs application specific integrated circuits
- the invention is implemented using a combination of both hardware and software.
- FIGS. 1-6 which highlight the functionality and advantages of the present invention, are presented for example purposes only.
- the architecture of the present invention is sufficiently flexible and configurable, such that it may be utilized (and navigated) in ways other than that shown in the accompanying figures.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
- This application claims priority to, and the benefit of, U.S. Provisional Patent Application Ser. No. 60/909,745, filed Apr. 3, 2007, which is hereby incorporated by reference in its entirety.
- 1. Field of the Invention
- The present invention generally relates online competitions, and more particularly to systems, methods, and computer products for running a multi-stage online elimination competition based on member generated content.
- 2. Related Art
- There are many considerations inherent in running an online elimination competition. For instance, online competitions must contend with securing the involvement and interest of the general public. Moreover, since online competitions have a potential to generate a multitude of entries, competitions must narrow down the entries to choose a winner in both a money-conscious and resource-effective way. Still, competitors have a great potential for enjoyment through competitions, and the use of an online competition has the benefit of reaching many potential users.
- It would be useful to have a multi-stage online elimination competition based on member generated content which includes member evaluation, vender evaluation, expert evaluation, as well as automatic parsing all in combination to arrive at a competition winner. Such a method could be used to implement a competition for a variety of socially beneficial goals, such as choosing a worthy charity project for a large vender, and result in the very real consequences of putting corporate money to good use by providing necessities, such as much needed safe drinking water to the children of the world's poorest countries.
- The present invention provides systems, methods and computer program products for running a multi-stage online elimination competition based on member generated content. Content is submitted by and voted on, in part, by members, after the content survives a multi-stage filtering process involving predetermined evaluation criteria and evaluated by members, automated screening procedures, internal competition staff, and an advisory committee.
- A member can enter member-generated content for consideration in the competition. A first evaluation stage subjects the content to automated word-based screening and preliminary vendor screening before being accepted into submission. In the second stage, all members rate submitted content, and can report objectionable content to have it flagged for vendor review and possible removal. The third stage has a succession of iterative internal vendor reviews of the top member voted content from each distinct succession of predefined voting periods. The fourth stage matches content with potential implementation of the content to provide a check on feasibility of the content winning, with feasibility determined by the purposes, aims, and scopes of each individual competition. The fifth stage submits the content to an advisory committee for voting and narrowing down the potential winners. The members again vote on the remaining content to determine a winner.
- Such member submissions may take place over any technology that allows for an electronic parsing of the contained information, such as e-mail, filling in of a web-based vendor generated form, an SMS text message, or similar means of communication. Member voting may take place over any technology that allows communication with the members, such as mail, e-mail, conventional phone, cellular phone, SMS text message, web pages, or similar means of communication.
- Further features and advantages of the present invention as well as the structure and operation of various embodiments of the present invention are described in detail below with reference to the accompanying drawings.
- The features and advantages of the present invention will become more apparent from the detailed description set forth below when taken in conjunction with the drawings in which like reference numbers indicate identical or functionally similar elements.
-
FIG. 1 is a block diagram of a competition system in accordance with an example embodiment of the present invention. -
FIG. 2 is a flowchart illustrating the flow of a piece of content through the submission and judging process according to an example embodiment of the present invention. -
FIG. 3 is a flowchart illustrating the content submission process according to an example embodiment of the present invention. -
FIG. 4 is a flowchart illustrating a member reported violation of competition rules of a particular piece of submitted content according to an example embodiment of the present invention. -
FIG. 5 is a flowchart illustrating an elimination decision flow during one period of an iterative judging process according to an example embodiment of the present invention. -
FIG. 6 is an example computer system used in one embodiment of the present invention. - The present invention is directed to systems, methods, and computer products for running a multi-stage online elimination competition based on member generated content and is now described in more detail herein in terms of an exemplary competition system for selecting a community service report, as described below. This is for convenience only and is not intended to limit the application of the present invention. In fact, after reading the following description, it will be apparent to one skilled in the relevant art(s) how to implement the following invention in alternative embodiments (e.g., competitions for best member generated artwork, or best member generated fictional short stories, etc.).
- The main participants in the competition are cardmembers, and non-cardmembers are encouraged to become a cardmember in order to participate. Generally, ideas for community service projects are solicited from cardmembers and other cardmembers are allowed to review and vote on the projects. In addition, projects are internally narrowed down to a list of the top (e.g., 100) projects. The top projects are submitted to an advisory committee of judges, such as high profile celebrities and/or experts. The advisory committee narrows the projects down further (e.g., top 50), the results of which are then submitted to the cardmembers for several rounds of voting on which project should win an endowment from the card provider for third-party sponsor.
Competition system 100 could be used, for example, to select as a winning charity project idea a plan to distribute water purification devices to some of the world's poorest countries and train the denizens on how to use the devices. - The terms “cardmember,” “member,” “participant,” “competitor,” “user,” and/or the plural form of these terms are used interchangeably throughout herein to refer to those persons or entities capable of accessing, using, being affected by and/or benefiting from the tool that the present invention provides for a multi-stage online elimination competition based on member generated content.
- “Content” may encompass any amalgamation of material that is discernable to the public at large and transmittable, such as text, images, video, audio, links to websites, or anything else communicative. Exact limits on types of eligible content may be enforced on a competition specific basis. “Member generated content” includes any competition-eligible content generated by a particular member personally, as well as any content that the member has appropriate permission to represent as his or her own in the competition.
- More detailed descriptions of the function of each component will be discussed in relation to later figures.
- A
participant system 102 represents an interface a member utilizes to communicate with and participate in the competition. Such a system can encompass a myriad of devices that facilitate communication, such as, but not limited to: a personal computer connected to the Internet, a conventional telephone, a fax machine, a cellular phone, a mailbox, or a personal digital assistant (PDA) or similar digital personal device capable of external communication. - A
communications engine 104 facilitates communication betweenparticipant system 102 and the other components ofcompetition system 100, such as aparsing engine 106, aninternal review engine 108, and anadvisory review engine 110.Communications engine 104 may consist of any form of communications technology, both automated such as fax machines, network routers, personal computers connected to the Internet, and the like, and manual such as telephone operators and the postal system, and the like. -
Parsing engine 106 parses the content submitted by theparticipant system 102 and screen out any content that fails a set of predefined criteria. The predefined criteria used by theparsing engine 106 may be distinct, overlapping, or similar to the predefined criteria utilized by theinternal review engine 108 and theadvisory review engine 110, described below. Moreover, such a screening may be automated or manual. If content passes screening performed by theparsing engine 106, it is then submitted tointernal review engine 108 for a more detailed review of submitted content. - An
internal review engine 108 performs a more detailed review and screening of the submitted content utilizing predefined criteria. In addition the review is conducted with the aim of narrowing down the entries in the competition utilizing the predefined criteria. Such a review may be automated or manual, and may utilize any number of distinct or overlapping sets of predefined criteria. Further, such a review may be conducted during any part of the competition to cause the removal, combination, reclassification, or other similar alteration of a plurality of content submissions. Moreover, the predefined criteria used by theinternal review engine 108 may be distinct, overlapping, or similar to the predefined criteria utilized byparsing engine 106 andadvisory review engine 110.Internal review engine 108 may analyze content obtained for different sources withincompetition system 100, such ascommunications engine 104 or theparsing engine 106. Moreover, content within a specific competition may be reviewed by theinternal review engine 108 one time or a plurality of times, and either with a simple review or an iterative review (described below), depending on the design of the competition. -
Advisory review engine 110 performs a high-level review and screening of the submitted content utilizing predefined criteria. Such a review is conducted with the aim of narrowing down the entries in the competition which have passed through one or more applications ofinternal review engine 108 described above. Such a review may also be automated or manual. In addition, the predefined criteria used by theadvisory review engine 108 may be distinct, overlapping, or similar to the predefined criteria utilized by parsingengine 106 andinternal review engine 108. -
FIG. 2 represents a flowchart illustrating a process flow of content throughcompetition system 100 in accordance with an example embodiment of the present invention.Blocks 224 collectively represent an example content submission process, which is defined in greater detail with respect toFIG. 3 below.Blocks 226 collectively represent an example for gradually eliminating competition entries until a single entry or a group of entries is determined to be the competition winner. - In
block 202, the member submits content throughparticipant system 102 to thecommunications engine 104 for inclusion in the competition. The type of content, form of submission, and method of submission may take on multiple configurations. In an example embodiment, a member is any potential user that has gone through a registration process and submits a community service project idea to the competition through a form on the competition's website. - In
block 204, parsingengine 106 parses the member submitted content and flags content that contained certain pre-determined content, for instance text containing profanity. If such content is flagged, the process proceeds to block 206, where the submitting member is prompted to resubmit a competition entry if they desire further consideration in the competition, otherwise the submission method then ends. - If content passes the screening in
block 204, it then proceeds to the competition vendor's preliminary screening inblock 208 utilizing theinternal review engine 108.Block 208 utilizes a higher level of review thanblock 204, and can analyze the content and compare it to a set of pre-defined submission criteria. Examples of such criteria that would prompt entry rejection include, but are not limited to, the inclusion of offensive or divisive material, the use of propaganda, the inclusion of third party references within the content, the inclusion of personal information in the content, the inclusion of a URL or other online reference in the content, the inclusion of content that violates the law, the inclusion of content that violates the rules of the particular competition, and the like. - Upon successful passing of the vendor preliminary screening in
block 208, the content moves on to public availability throughcommunications engine 104, which would enable review and voting on by all members, possible including the content-submitting member, inblock 210. During this block, members may flag specific entries for further review, which will be explained in greater detail in connection withFIG. 4 . Otherwise, the member may review content which has passed thecontent submission process 224. Further, members may rate the content in accordance with their own preference. These ratings are used such that content must achieve a certain member rating threshold in order to advance on to block 214, such as being within a specific number or percentage from the top when the content is arranged by numeric ranking, receiving at least a specified minimum of rankings which would indicate member interest, or a weighted combination of any comparison factors (including those discussed above). The term “top ranked” refers to those content entries which have passed this threshold. - In one exemplary embodiment, cardmembers may log on to the competition webpage, view a list of all submitted projects, and view a detailed profile of each individual submitted charity idea. Cardmembers may then rate each idea, such as with a 1-5 star rating, where 1 star is least desirable and 5 stars is most desirable. The average star ratings of each project are evaluated in conjunction with the number of total rankings that each submitted project received, such that there is a bias toward projects with significant numbers of ratings over those with an equal average rating but fewer total ratings.
- In
block 214, the top ranked content fromblock 210 is subjected to a feasibility check for the consequences of the specific content winning the overall competition byinternal review engine 108. Any content submissions rejected during this step will be removed from the competition inblock 222. The content submissions that are qualified inblock 214 will be passed along to block 216, detailed below. -
Block 214 is iterative because all content passed on fromblock 210 is not examined at once, but rather several times over the course of the competition. The time the iterative judging process runs is described in terms of a submission period. In an example embodiment of the invention, duringsubmission period 1 the top X ranked content entries are evaluated and either qualified or rejected. Duringperiod 2, the top X+Y ranked content entries fromperiods period 1 keeping their previously determined qualified or rejected status. These entries are not reevaluated. During period 3, the top X+Y+Z ranked content entries are evaluated from periods 1-3, with those entries evaluated duringperiods block 210 is reduced, and the submissions qualified underblock 214 are then passed on to block 216. - The evaluative criteria used in
block 214 can be different from the criteria utilized inblock 208. In addition, the iterative review inblock 214 can be layered with multiple sets of evaluative criteria, where only content submissions that are qualified under an iterative review using a first set of evaluative criteria are entered into consideration of an iterative review using a second set of evaluative criteria. For instance, the first set of evaluative criteria is used to provide a feasibility check on the foreseeable ability to implement a charity project in the content submission. The second set of evaluative criteria is used to match each charity project with an organization that can effectively implement the described project. After being qualified content qualified in both will be promoted to the next level of the competition. An example round of the iterative content feasibility check can be seen inFIG. 5 and its related discussion. - In
block 216, the content that is qualified fromblock 214 is presented to anadvisory review engine 110 for evaluation and ranking.Advisory review engine 110 utilizes a set of predefined evaluative criteria to analyze, rate, and narrow down the remaining content submissions through, for example, a conventional scoring of the content. This evaluation may be either automated or manual. Moreover, the evaluative criteria may vary between different embodiments. In an example embodimentadvisory review engine 110 is a small committee with high profile members, possibly including such people as celebrities or respected participants in a community relevant to the competition; this allows the competition to receive several benefits, such as increased publicity, respectability, or accuracy in determining which submissions deserve to win the competition. - The
advisory review engine 110 evaluates and ranks the content submissions that were qualified fromblock 214 based on predetermined criteria. After receiving the rankings of theadvisory review engine 110, the specific content submissions are again separated out by thecompetition system 100 so that a predetermined number of “top ranking” submissions may be made publicly available by thecommunications engine 104 and passed along to block 218, with all other submissions being eliminated from the contest inblock 222. - In
block 218, the member community votes on the top ranked content submissions fromblock 216. The voting may take place in a multitude of fashions throughcommunications engine 104, from clicking on a web page selection button, to sending an SMS text message, to calling a specified phone number, to other similar technologies. The voting also can take place in any number of voting rounds, so that content submissions are narrowed down after the first vote in some fashion and members may vote again on the newly narrowed list of top ranked content submissions, with this repeating until a winner or a group of winners is chosen. Content submissions that win the member vote inblock 218 proceed to block 220 as winners of the competition. All other content submissions lose the competition, progressing to block 222. However, any rankings obtained duringblock 218 of content submissions that progress to block 222 could be utilized in providing tiered awards for the non-winners of the competition (e.g., a second place prize, a finalists' prize, an honorable mention prize, etc.). -
FIG. 3 is a flowchart illustrating a content submission process 300 method according to an example embodiment of the present invention. Inblock 302, a registered member submits content from theparticipant system 102 to thecompetition system 100 for consideration. Such content can take on many forms, so long as it conveys information and is capable of being parsed by electronic systems. In one exemplary embodiment, such content takes on the form of descriptions of potential community service projects and brief biographies of the member submitting the project. - Parsing
engine 106 performs a screening of the content inblock 304 to rule out any submissions that fail a previously identified set of criteria. Example criteria that qualify an entry for rejection by the automated screening include the use of profanity or other unacceptable words. - If the content fails the screening in
block 304, the process proceeds to block 306 where the member is notified of the rejection and prompted to resubmit alternate content if they wish to be considered in the competition. The method thus proceeds to block 308, where the member may either resubmit alternate content, taking them back to block 302, or quitting the method altogether. - If the content passes the screening in
block 304, it proceeds to the screening that takes place inblock 310 through theinternal review engine 108. Example decision criteria that can be used inblock 310 include, but are not limited to, the inclusion of offensive or divisive material, the use of propaganda, the inclusion of third party references within the content, the inclusion of personal information in the content, the inclusion of a URL or other online reference in the content, the inclusion of content that violates the law, or inclusion of content that violates the rules of the particular competition. - If the content fails the screening in
block 310, the method will proceed to block 313 wherein an appropriate communication is sent to theparticipant system 102 through thecommunications engine 104. Such a process can be automated by having theinternal review engine 108 inblock 310 specify a rejection type and having that rejection type elicit a pre-determined response which varies by rejection type. For example, if the content is rejected because of the inclusion of a third party reference, the communication inblock 313 could read: “Thank you for your contribution. Unfortunately, the project you submitted did not meet our submission criteria. References to third parties—including people, companies, and brands—are not permitted due to Copyright and Trademark concerns. We invite you to revise your entry, which is included below, and try again.” The process would then proceed to block 306, as described above. - If the content passes the screening in
block 310, inblock 316 theinternal review engine 108 conducts a rating of content according to pre-established competition criteria. - If the
internal review engine 108 cannot determine whether the content passes or fails the screening inblock 310, the method would pass intoblock 312, wherein an escalated review of the content could take place by theinternal review engine 108. Such a review could be ‘escalated’ as compared to the review inblock 310 by, for example, having multiple manual reviewers examine the content or utilizing a different algorithm to review the content. - If content is rejected by the escalated review in
block 312, the method would proceed to the above describedblock 313. If the content is accepted by the escalated review inblock 312, the method would proceed to the above describedblock 316. If the escalated review inblock 312 still cannot determine whether the content fails to meet the pre-defined criteria, the method would proceed to block 314 wherein a higher level is requested to review the content. Examples of the higher level include the designer of the pre-defined criteria, the client of the competition provider, or the management of the competition provider. For instance, the reviewers could contact the credit card issuer sponsoring the community project competition for their decision on the content. Afterblock 314, the method proceeds to block 326 where it stops. - Once the method has progressed to block 316 and has been rated according to program criteria, the method moves on to block 318, wherein the approved content is displayed publicly through
communications engine 104. Next the method moves on to block 320, wherein an appropriate communication is sent to theparticipant system 102 through thecommunications engine 104. BothSteps - In
block 322 the content is made available for perusal, comment, and rating (and possible flagging for review as described below in more detail with respect toFIG. 4 ) by any member throughcommunications engine 104. Afterblock 322, the method proceeds to block 324, wherein a submission is considered complete. -
FIG. 4 is a flowchart illustrating aprocess 400 for providing a member reported violation of competition rules of a particular piece of submitted content according to an example embodiment of the present invention. After the content has been submitted (described above with respect toFIG. 3 ), it is available through thecommunications engine 104 for members to view and comment on. If a member believes that a specific content has been accepted into submission in violation of the rules, they may contact thecommunications engine 104 as provided inblock 402 to initiate a review of the content. - After the member has initiated the report in
block 402, the content in question is automatically appended to the report or otherwise displayed inblock 404 so as to be capable of review by theinternal review engine 108. Followingblock 404, the report with the appended or otherwise displayed content submission is communicated to theinternal review engine 108 inblock 406 to again judge the submission against a set of pre-defined contest eligibility criteria, which may or may not be the same as utilized inblock 310 inFIG. 3 as described above. - If the decision in
block 406 is to reject the submitted content as a violation of the pre-defined contest eligibility criteria utilized inblock 406, then the process proceeds to block 410 wherein the submitted content is removed from the list of accepted submissions and the public listing of such submissions as accessible through thecommunications engine 104. Next, the process proceeds to block 412, wherein a communication is sent through thecommunications engine 104 both to the member who reported a problem with the content in question and the member who submitted the content in question. Bothblocks communications engine 104 to submit other content into the contest if so desired. The method then progresses to block 416, where the user reported violation portion ends. - If the decision in
block 406 is to accept the submitted content as in accord with the pre-defined contest eligibility criteria utilized inblock 406, then the process proceeds to block 420, where a message is sent to the reporting member through thecommunications engine 104 indicating that the content has been reviewed but still deemed acceptable. Followingblock 420, the process proceeds to block 422 where the user reported violation portion ends. Bothblocks - If the
internal review engine 108 inblock 406 is unable to determine if the submitted content is in violation of the pre-defined contest eligibility criteria utilized inblock 406, the process progresses to block 408 where an escalated review of the content by theinternal review engine 108 takes place. Such a review could be ‘escalated’ in comparison to the review inblock 406 by having, for instance, multiple reviewers examine the content, a different algorithm examine the content, or a reviewer higher up within the organization examine the content. - If the escalated review in
block 408 results in rejection of the content, the process proceeds to block 410 as described above. If the escalated review inblock 408 results in the acceptance of the content, the process proceeds to block 420, as described above. - If the escalated review in
block 408 cannot determine whether the content submission should be accepted or rejected, the process proceeds to block 418 wherein a higher level is requested to review the content. Examples of the higher level include the designer of the pre-defined criteria, the client of the competition provider, or the management of the competition provider. For instance, in the charity project competition, theinternal review engine 108 contacts the card issuer for their decision on the content. Afterblock 418, the method proceeds to block 424 where it stops. -
FIG. 5 is a flowchart illustrating aprocess 500 providing elimination decision flow during one period of an iterative judging step in the internal review engine according to an example of the present invention. Here, the review period consists of a week, and thesecond review period 500 is depicted. - In
block 502, the top ranked content submissions from the preliminary member rankings are selected for review. These top ranked submissions may include submissions that have been submitted during any submission period to date, in this case withinweek 1 orweek 2, even if the submissions were qualified or disqualified inweek 1. Inblock 504, the submissions that were reviewed in the previous submission period,week 1, are removed from consideration during this period and keep their qualified or rejected status assigned to them inweek 1. Inblock 506, the remaining non-evaluated projects are assigned to individual reviewers within theinternal review engine 108. Inblock 508, those individual reviewers will compare each project against a set of predefined criteria, such as in this embodiment where the criteria are the feasibility of enacting the suggested charity project detailed in the content submission. Inblock 510, the individual reviewers must decide whether to accept, reject, or further examine a content submission. - If the individual reviewer in
block 510 decides to accept the content submission as in conformance with their evaluation criteria, the process proceeds to block 512, where the content submission is added to a “qualified list”, which is maintained inblock 518. This qualified list will be utilized in future iterative judging submission rounds inblock 504 in order to avoid reviewing already qualified ideas. - If the individual reviewer in
block 510 decides to reject the content submission as not in conformance with their evaluation criteria, the process proceeds to block 516, where the content submission is added to a “disqualified list”, which is maintained inblock 520. This disqualified list will be utilized in future iterative judging submission rounds inblock 504 in order to avoid reviewing already disqualified ideas, even if they still rank in the top specified portion of rated content submissions for that particular review period. - After
blocks - If the individual reviewer in
block 510 is unable to determine with sufficient certainty whether the content submission satisfied the predetermined evaluation criteria, they may defer the content submission to an escalated review inblock 514. In the present embodiment, the escalated review is a panel made up of all of the individual reviewers who were assigned content submissions inblock 506, but this could also possibly include other reviewers, different reviewing algorithms, utilizing different evaluative criteria, etc. Determination of acceptance of the content submission will lead to block 512, described above, and determination of rejection of the content submission will lead to block 516, also described above. - The present invention (i.e.,
systems engines - In fact, in one embodiment, the invention is directed toward one or more computer systems capable of carrying out the functionality described herein. An example of a
computer system 600 is shown inFIG. 6 . - The
computer system 600 includes one or more processors, such asprocessor 604. Theprocessor 604 is connected to a communication infrastructure 606 (e.g., a communications bus, cross-over bar, or network). Various software embodiments are described in terms of this exemplary computer system. After reading this description, it will become apparent to a person skilled in the relevant art(s) how to implement the invention using other computer systems and/or architectures. -
Computer system 600 can include adisplay interface 602 that forwards graphics, text, and other data from the communication infrastructure 606 (or from a frame buffer not shown) for display on thedisplay unit 630. -
Computer system 600 also includes amain memory 608, preferably random access memory (RAM), and may also include asecondary memory 610. Thesecondary memory 610 may include, for example, ahard disk drive 612 and/or aremovable storage drive 614, representing a floppy disk drive, a magnetic tape drive, an optical disk drive, etc. Theremovable storage drive 614 reads from and/or writes to aremovable storage unit 618 in a well known manner.Removable storage unit 618 represents a floppy disk, magnetic tape, optical disk, etc. which is read by and written to byremovable storage drive 614. As will be appreciated, theremovable storage unit 618 includes a computer usable storage medium having stored therein computer software and/or data. - In alternative embodiments,
secondary memory 610 may include other similar devices for allowing computer programs or other instructions to be loaded intocomputer system 600. Such devices may include, for example, aremovable storage unit 622 and aninterface 620. Examples of such may include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as an erasable programmable read only memory (EPROM), or programmable read only memory (PROM)) and associated socket, and otherremovable storage units 622 andinterfaces 620, which allow software and data to be transferred from theremovable storage unit 622 tocomputer system 600. -
Computer system 600 may also include a communications interface 624. Communications interface 624 allows software and data to be transferred betweencomputer system 600 and external devices. Examples of communications interface 624 may include a modem, a network interface (such as an Ethernet card), a communications port, a Personal Computer Memory Card International Association (PCMCIA) slot and card, etc. Software and data transferred via communications interface 624 are in the form ofsignals 628 which may be electronic, electromagnetic, optical or other signals capable of being received by communications interface 624. Thesesignals 628 are provided to communications interface 624 via a communications path (e.g., channel) 626. Thischannel 626 carriessignals 628 and may be implemented using wire or cable, fiber optics, a telephone line, a cellular link, a radio frequency (RF) link and other communications channels. - In this document, the terms “computer program medium” and “computer usable medium” are used to generally refer to media such as
removable storage drive 614, a hard disk installed inhard disk drive 612, and signals 628. These computer program products provide software tocomputer system 600. The invention is directed to such computer program products. - Computer programs (also referred to as computer control logic) are stored in
main memory 608 and/orsecondary memory 610. Computer programs may also be received via communications interface 624. Such computer programs, when executed, enable thecomputer system 600 to perform the features of the present invention, as discussed herein. In particular, the computer programs, when executed, enable theprocessor 604 to perform the features of the present invention. Accordingly, such computer programs represent controllers of thecomputer system 600. - In an embodiment where the invention is implemented using software, the software may be stored in a computer program product and loaded into
computer system 600 usingremovable storage drive 614,hard drive 612 or communications interface 624. The control logic (software), when executed by theprocessor 604, causes theprocessor 604 to perform the functions of the invention as described herein. - In another embodiment, the invention is implemented primarily in hardware using, for example, hardware components such as application specific integrated circuits (ASICs). Implementation of the hardware state machine so as to perform the functions described herein will be apparent to persons skilled in the relevant art(s).
- In yet another embodiment, the invention is implemented using a combination of both hardware and software.
- While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example, and not limitation. It will be apparent to persons skilled in the relevant art(s) that various changes in form and detail can be made therein without departing from the spirit and scope of the present invention. Thus, the present invention should not be limited by any of the above described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.
- In addition, it should be understood that the
FIGS. 1-6 , which highlight the functionality and advantages of the present invention, are presented for example purposes only. The architecture of the present invention is sufficiently flexible and configurable, such that it may be utilized (and navigated) in ways other than that shown in the accompanying figures. - Further, the purpose of the foregoing Abstract is to enable the U.S. Patent and Trademark Office and the public generally, and especially the scientists, engineers and practitioners in the art who are not familiar with patent or legal terms or phraseology, to determine quickly from a cursory inspection the nature and essence of the technical disclosure of the application. The Abstract is not intended to be limiting as to the scope of the present invention in any way. It is also to be understood that the blocks and procedures recited in the claims need not be performed in the order presented.
Claims (21)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/060,327 US20080248873A1 (en) | 2007-04-03 | 2008-04-01 | Systems, methods and computer products for running a multi-stage online elimination competition based on member generated content |
PCT/US2008/058995 WO2008124385A1 (en) | 2007-04-03 | 2008-04-01 | Methods for running a multi-stage online elimination competition based on member generated content |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US90974507P | 2007-04-03 | 2007-04-03 | |
US12/060,327 US20080248873A1 (en) | 2007-04-03 | 2008-04-01 | Systems, methods and computer products for running a multi-stage online elimination competition based on member generated content |
Publications (1)
Publication Number | Publication Date |
---|---|
US20080248873A1 true US20080248873A1 (en) | 2008-10-09 |
Family
ID=39827433
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/060,327 Abandoned US20080248873A1 (en) | 2007-04-03 | 2008-04-01 | Systems, methods and computer products for running a multi-stage online elimination competition based on member generated content |
Country Status (2)
Country | Link |
---|---|
US (1) | US20080248873A1 (en) |
WO (1) | WO2008124385A1 (en) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100075762A1 (en) * | 2008-09-24 | 2010-03-25 | Incredible Technologies | Segmented Memory Control System for Gaming Devices |
US20100121650A1 (en) * | 2009-06-19 | 2010-05-13 | Hughes John M | System and method for content development |
US8663017B1 (en) * | 2013-03-15 | 2014-03-04 | International Awards Group, LLC | Matrix judging systems and methods |
US9707474B1 (en) | 2015-01-09 | 2017-07-18 | TwoTube, LLC | Group-judged multimedia competition |
CN108475400A (en) * | 2015-10-26 | 2018-08-31 | 美莱纽恩株式会社 | Competition method and device on line |
US10124261B1 (en) | 2015-01-09 | 2018-11-13 | TwoTube, LLC | Group-judged multimedia competition |
US20210342408A1 (en) * | 2020-05-04 | 2021-11-04 | Big Idea Lab, Inc. | Computer-aided methods and systems for distributed cognition of digital content comprised of knowledge objects |
US11235224B1 (en) * | 2020-11-30 | 2022-02-01 | International Business Machines Corporation | Detecting and removing bias in subjective judging |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9720901B2 (en) | 2015-11-19 | 2017-08-01 | King Abdulaziz City For Science And Technology | Automated text-evaluation of user generated text |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030033161A1 (en) * | 2001-04-24 | 2003-02-13 | Walker Jay S. | Method and apparatus for generating and marketing supplemental information |
US20030195795A1 (en) * | 2000-01-12 | 2003-10-16 | Chacker Aaron R. | Method and system for an online talent business |
US20040225569A1 (en) * | 2000-03-28 | 2004-11-11 | Renee Bunnell | Method and system for creating a multi-tiered, e-commerce extranet for a community of businesses |
US20060252547A1 (en) * | 2000-05-01 | 2006-11-09 | Invoke Solutions, Inc. | Large Group Interactions |
US7162433B1 (en) * | 2000-10-24 | 2007-01-09 | Opusone Corp. | System and method for interactive contests |
US20070162951A1 (en) * | 2000-04-28 | 2007-07-12 | Rashkovskiy Oleg B | Providing content interruptions |
US20070282874A1 (en) * | 2003-08-19 | 2007-12-06 | Rapid Intelligence Pty Ltd. | Content System |
US7308413B1 (en) * | 1999-05-05 | 2007-12-11 | Tota Michael J | Process for creating media content based upon submissions received on an electronic multi-media exchange |
US20090177519A1 (en) * | 1999-05-05 | 2009-07-09 | Tota Michael J | Process for creating media content based upon submissions received on an electronic multi-media exchange |
US7596598B2 (en) * | 2005-10-21 | 2009-09-29 | Birthday Alarm, Llc | Multi-media tool for creating and transmitting artistic works |
-
2008
- 2008-04-01 WO PCT/US2008/058995 patent/WO2008124385A1/en active Application Filing
- 2008-04-01 US US12/060,327 patent/US20080248873A1/en not_active Abandoned
Patent Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7308413B1 (en) * | 1999-05-05 | 2007-12-11 | Tota Michael J | Process for creating media content based upon submissions received on an electronic multi-media exchange |
US8090605B2 (en) * | 1999-05-05 | 2012-01-03 | Virtual Creative Artists, LLC | Process for creating media content based upon submissions received on an electronic multi-media exchange |
US20090177519A1 (en) * | 1999-05-05 | 2009-07-09 | Tota Michael J | Process for creating media content based upon submissions received on an electronic multi-media exchange |
US20030195795A1 (en) * | 2000-01-12 | 2003-10-16 | Chacker Aaron R. | Method and system for an online talent business |
US20040225569A1 (en) * | 2000-03-28 | 2004-11-11 | Renee Bunnell | Method and system for creating a multi-tiered, e-commerce extranet for a community of businesses |
US20090304358A1 (en) * | 2000-04-28 | 2009-12-10 | Rashkovskiy Oleg B | Providing Content Interruptions |
US20070162951A1 (en) * | 2000-04-28 | 2007-07-12 | Rashkovskiy Oleg B | Providing content interruptions |
US20060252547A1 (en) * | 2000-05-01 | 2006-11-09 | Invoke Solutions, Inc. | Large Group Interactions |
US20090024457A1 (en) * | 2000-10-24 | 2009-01-22 | Iman Foroutan | System and method for interactive contests |
US7162433B1 (en) * | 2000-10-24 | 2007-01-09 | Opusone Corp. | System and method for interactive contests |
US20030033161A1 (en) * | 2001-04-24 | 2003-02-13 | Walker Jay S. | Method and apparatus for generating and marketing supplemental information |
US20070282874A1 (en) * | 2003-08-19 | 2007-12-06 | Rapid Intelligence Pty Ltd. | Content System |
US7596598B2 (en) * | 2005-10-21 | 2009-09-29 | Birthday Alarm, Llc | Multi-media tool for creating and transmitting artistic works |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100075762A1 (en) * | 2008-09-24 | 2010-03-25 | Incredible Technologies | Segmented Memory Control System for Gaming Devices |
US20100121650A1 (en) * | 2009-06-19 | 2010-05-13 | Hughes John M | System and method for content development |
US8663017B1 (en) * | 2013-03-15 | 2014-03-04 | International Awards Group, LLC | Matrix judging systems and methods |
US9707474B1 (en) | 2015-01-09 | 2017-07-18 | TwoTube, LLC | Group-judged multimedia competition |
US10124261B1 (en) | 2015-01-09 | 2018-11-13 | TwoTube, LLC | Group-judged multimedia competition |
CN108475400A (en) * | 2015-10-26 | 2018-08-31 | 美莱纽恩株式会社 | Competition method and device on line |
US20210342408A1 (en) * | 2020-05-04 | 2021-11-04 | Big Idea Lab, Inc. | Computer-aided methods and systems for distributed cognition of digital content comprised of knowledge objects |
US11748439B2 (en) * | 2020-05-04 | 2023-09-05 | Big Idea Lab, Inc. | Computer-aided methods and systems for distributed cognition of digital content comprised of knowledge objects |
US11235224B1 (en) * | 2020-11-30 | 2022-02-01 | International Business Machines Corporation | Detecting and removing bias in subjective judging |
Also Published As
Publication number | Publication date |
---|---|
WO2008124385A1 (en) | 2008-10-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20080248873A1 (en) | Systems, methods and computer products for running a multi-stage online elimination competition based on member generated content | |
US20220036480A1 (en) | Synchronous and asynchronous electronic voting terminal system and network | |
Maestas et al. | Shifting the blame: Federalism, media, and public assignment of blame following Hurricane Katrina | |
Born et al. | An experimental investigation of election promises | |
Newall | Behavioral complexity of British gambling advertising | |
US20160294753A1 (en) | System and Method for Implementing an Integrity-Based Social Network Filtering System and Related Environment | |
Steunenberg et al. | The transposition of European law in EU member states: between process and politics | |
Cass et al. | Preserving Competition: Economic Analysis, Legal Standards and Microsoft | |
US10592596B2 (en) | Techniques for providing a narrative summary for fantasy games | |
Deck et al. | On the robustness of higher order risk preferences | |
US20150170101A1 (en) | Electronic Platform and System for Obtaining Direct Interaction with Celebrities | |
US8761913B2 (en) | Enabling community tournaments | |
Daaji et al. | Multi-criteria web services selection: Balancing the quality of design and quality of service | |
Aondover et al. | Influence of Social Media on News Consumption and Credibility in Nigeria | |
CN110059850A (en) | Exam pool optimization method and device calculates equipment and computer readable storage medium | |
Leung | How do one's peers on a leaderboard affect oneself? | |
Vliegenthart et al. | A matter of misunderstanding? Explaining (mis) perceptions of electoral integrity across 25 different nations | |
López et al. | Analysis of local online review systems as digital word-of-mouth | |
EP2715648A1 (en) | Rating items | |
Haan | Facebook's Alternative Facts | |
Risch | Procedural Posture and Social Choice | |
Collins | Is the sum greater than its parts? Circuit court composition and judicial behavior in the courts of appeals | |
Samaha et al. | Is the Second Amendment a Second-Class Right | |
Provost | Antitrust law and distributive politics in the American states | |
Le Mire | Regulation of judicial misconduct in Australia: why, how and where next? |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: AMERICAN EXPRESS TRAVEL RELATED SERVICES COMPANY, Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LANG, BELINDA;REEL/FRAME:020734/0482 Effective date: 20080331 |
|
AS | Assignment |
Owner name: III HOLDINGS 1, LLC, DELAWARE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AMERICAN EXPRESS TRAVEL RELATED SERVICES COMPANY, INC.;REEL/FRAME:032722/0746 Effective date: 20140324 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: LIBERTY PEAK VENTURES, LLC, TEXAS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:III HOLDINGS 1, LLC;REEL/FRAME:045660/0060 Effective date: 20180315 |