IN THE UNITED STATES DISTRICT COURT

FOR THE DISTRICT OF DELAWARE

VEDANTI SYSTEMS LIMITED and
MAX SOUND CORPORATION,

Plaintiffs,

v.

GOOGLE, INC., YOUTUBE, LLC, and
ON2 TECHNOLOGIES, INC.,

Defendants.

)
)
)
)
)
)
)
)
)
)
)
)
)


C.A. No.__________

JURY TRIAL DEMANDED





COMPLAINT FOR PATENT INFRINGEMENT

Plaintiffs Vedanti Systems Limited (VSL) and Max Sound Corporation (Max Sound)
file this Complaint for patent infringement against Defendants Google, Inc. (Google),
YouTube, LLC (YouTube), and On2 Technologies, Inc. (On2) (collectively Defendants)
and allege as follows:
1. This case arises out of Defendants willful infringement of United States Patent
No. 7,974,339 and Defendants incorporation of this patented technology into products made,
used, sold, offered for sale, and/or imported, including, but not limited to, VP8, VP9, WebM,
YouTube, Google Adsense, Google Play, Google TV, Chromebook, Google Drive, Google
Chromecast, Google Play-per-view, Google Glasses, Google +, Googles Simplify, Google Maps
and Google Earth. In short, Defendants infringement pervades virtually every website and
product offered by Google and its Defendant subsidiaries.
Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 1 of 15 PageID #: 1

2
2. Despite Googles well-publicized Code of Conduct Dont be Evil which
it explains is about doing the right thing, following the law, and acting honorably, Google,
in fact, has an established pattern of conduct which is the exact opposite of its claimed piety.
3. Indeed, time and time again, Google has willfully infringed the patents and used
the proprietary information of others without offering to compensate the owners of those patents
and/or proprietary information. This case is yet another of the many occasions on which Google
has unlawfully taken, rather than developed for itself and/or paid for, valuable and proprietary
technology that is core to the functioning of its many businesses and products.
PARTIES
4. Plaintiff Vedanti Systems Limited is a British company having its principal place
of business at 43 Overstone Road London W6 0AD.
5. Plaintiff Max Sound Corporation is a Delaware corporation having its principal
place of business at 2902A Colorado Avenue, Santa Monica, California 90404.
6. Google is a corporation organized under the laws of the State of Delaware, and
has a principal place of business at 1600 Amphitheatre Parkway, Mountain View, California
94043 and/or is conducting business through an affiliate located at this address. Google may be
served through its registered agent for service of process, Corporation Trust Company, at
Corporation Trust Center, 1209 Orange Street, Wilmington, Delaware 19801.
7. On information and belief, YouTube is a limited liability company organized
under the laws of the State of Delaware, and headquartered in San Bruno, California. YouTube
is a wholly-owned subsidiary of Google. YouTube is in the business of the sharing and display
of user-generated and corporate media video. Available content on YouTube includes video
clips, TV clips, music videos, and other content such as video blogging, short original videos,
Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 2 of 15 PageID #: 2

3
and educational videos. YouTube may be served through its registered agent for service of
process, Corporation Trust Company, at Corporation Trust Center, 1209 Orange Street,
Wilmington, Delaware 19801.
8. On information and belief, On2 is a corporation organized under the laws of the
State of Delaware, and has a principal place of business in Clifton Park, New York. On2 is
wholly-owned subsidiary of Google. On2, formerly known as The Duck Corporation, engaged
in the business of developing video compression technologies known as codecs. In February
2010, Google acquired On2 for an estimated $124.6 million. On2 claims the authorship of a
number of video codecs, including video codecs known as VP8 and VP9. On2 may be served
through its registered agent for service of process, Corporation Service Company, at 2711
Centerville Road, Suite 400, Wilmington, Delaware 19808.
JURISDICTION AND VENUE
9. This civil action for patent infringement arises under the Patent Laws of the
United States, 35 U.S.C. 1, et seq. This Court has jurisdiction over the claims presented
herein pursuant to 28 U.S.C. 1331 and 1338(a).
10. Defendants make, import, use, sell, and/or offer for sale the Accused
Instrumentalities (as defined below) within the United States, including this District, that infringe
one or more claims of United States Patent No. 7,974,339 entitled Optimized Data
Transmission System and Method (the 339 Patent). The 339 Patent was duly and legally
issued by the United States Patent and Trademark Office on J uly 5, 2011. A true and correct
copy of the 339 Patent is attached hereto as Exhibit 1.
11. The 339 Patent is referred to herein as the Asserted Patent.
Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 3 of 15 PageID #: 3

4
12. VSL is the owner by assignment of all rights, title, and interests in the Asserted
Patent, and is entitled to sue for past and future infringement thereof.
13. Max Sound and VSL have agreed that Max Sound shall have the right to enforce
VSLs patent rights on VSLs behalf.
14. A codec is a device or computer program capable of encoding or decoding a
digital data stream or signal.
15. Defendants are engaged in the business of developing, using, and selling a
variety of video computer programs, including those commonly referred to as the VP8, VP9,
H.264, and WebM video codecs (collectively the Accused Codec Instrumentalities).
16. Defendants embed these Accused Codec Instrumentalities into products that
Defendants make, use, and sell, including in this District, such as the Android operating system
used in many mobile phones and tablet computers (collectively the Accused Android
Instrumentalities).
17. Defendants use these Accused Codec Instrumentalities to deliver video content
from Defendants websites and products such as VP8, VP9, WebM, YouTube.com, Google
Adsense, Google Play, Google TV, Chromebook, Google Drive, Google Chromecast, Google
Play-per-view, Google Glasses, Google +, Googles Simplify, Google Maps and Google Earth
(collectively the Accused Website and Product Instrumentalities).
18. Defendants distribute software such as the Chrome web browser that implements
the Accused Codec Instrumentalities (collectively the Accused Software Instrumentalities).
19. Collectively, the Accused Codec Instrumentalities, the Accused Android
Instrumentalities, the Accused Website and Product Instrumentalities, and the Accused Software
Instrumentalities comprise the Accused Instrumentalities.
Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 4 of 15 PageID #: 4

5
20. On information and belief, Defendants directly and/or indirectly import,
manufacture, use, offer for sale, and/or sell the Accused Instrumentalities within the United
States, including this District, that infringe one or more claims of the Asserted Patent.
21. Venue is proper in this District pursuant to 28 U.S.C. 1400(b).
GENERAL ALLEGATIONS
VSL and the 339 Patent
22. In 2001, Constance Nash, one of the two named inventors of the 339 Patent, had
the goal of offering to the public an Internet subscription service to deliver digitized video of
musical concerts via the Internet.
23. After reviewing and testing numerous video compression and decompression
technologies for use with the subscription services, Ms. Nash concluded that none of the then-
existing video compression technologies could provide the level of video quality necessary to
launch the project.
24. The then-existing video standards resulted in jittery, low-quality video and sound
for large-sized video files.
25. The available technologies relied solely on compression, i.e., the encoding of
digital information by reducing the number of bits in the representation, by identifying and
deleting unnecessary bits (lossy compression).
26. Ms. Nash hired Alex Krichevsky to work for VSL. Together, Ms. Nash and
Mr. Krichevsky developed the technology, specifically a video codec (the VSL Codec), and
the inventions described in the 339 Patent.
27. The VSL Codec implemented a proprietary and unique system of optimizing data
transmission using methods for key frame partitioning, slicing and analyzing pixel variation of
Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 5 of 15 PageID #: 5

6
video content to significantly reduce the volume of digital video files, while minimizing any
resulting loss of video quality.
28. Ms. Nash and Mr. Krichevsky filed United States and numerous other
international patent applications that covered some of the methods and systems used in the VSL
Codec.
29. Germane to this lawsuit, on J anuary 16, 2002, Ms. Nash and Mr. Krichevsky
filed the United States patent application that resulted in the issuance of the 339 patent.
Google, H.264, and VP8
30. During the mid- to late-2000s, video compression and streaming technology had
become integral to Google products, including but not limited to the YouTube.com website, the
Chrome web browser, and the Android mobile device operating system.
31. Google and Google products began supporting a video codec known as H.264.
32. The first version of the H.264 codec was completed in 2003 by a standardization
committee called the J oint Video Team, which was formed by the Video Coding Experts Group
and the Moving Pictures Experts Group.
33. Since that time, H.264 has developed into a widely used codec with substantial
penetration in the optical disc, broadcast, and streaming video markets.
34. MPEG LA, LLC (MPEG LA), a Colorado-based firm, licenses patent pools
that cover essential patents necessary for use in various video codec standards. MPEG LA is not
related to the Moving Pictures Experts Group.
35. MPEG LA was initially founded in the late 1990s by several international
companies that owned patents necessary to practice the MPEG-2 video standard in order to pool
Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 6 of 15 PageID #: 6

7
those patents under a single entity for purposes of granting pooled licenses to those patents and
to generate patent royalties.
36. Since that time, MPEG LA has asserted that multiple video standards, including
H.264, require a license to its pooled patents, and hundreds of companies have obtained licenses
from MPEG LA for the rights to the H.264 patent pool.
37. For many years Google refused to obtain a license from MPEG LA to cover its
implementations of the H.264 standard, despite multiple notices from MPEG LA that Google
required a license.
38. Rather than obtaining a license from MPEG LA for Googles implementations of
H.264, Google decided instead to seek alternatives to H.264 that would not require paying
royalties to MPEG LA.
39. VP8 is a video compression standard released by Defendant On2 in September
2008.
40. As of September 2008, MPEG LA had not established a patent pool that covered
the VP8 codec.
41. In August 2009, Google targeted VP8 as a potential alternative to H.264 and
initiated negotiations to acquire On2.
42. In February 2010, Google completed the acquisition of On2.
43. Through its acquisition of On2, Google obtained ownership of the VP8 codec
and On2s patents and pending patent applications covering the VP8 codec and possessed a
potential alternative to avoid paying licensing royalties to MPEG LA.
44. In May 2010, Google announced that its new WebM video file format would
incorporate the VP8 codec.
Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 7 of 15 PageID #: 7

8
45. YouTube now uses WebM/VP8 video and has committed to encode its entire
portfolio of videos to WebM.
46. WebM was enabled in Google Android operating system in late 2010.
47. After the release of WebM/VP8 by Google, however, numerous reviews by the
public concluded that the video quality of WebM/VP8 was significantly weaker than the quality
produced using H.264.
Googles Discussions with VSL
48. In March 2010, with the understanding that WebM/VP8 was in desperate need of
improvement, Alpesh Patel, VSLs CEO at that time, communicated with Googles Nikesh
Arora to discuss licensing VSLs video technology and/or the possible acquisition of VSL and
the 339 Patent by Google.
49. In April 2010, Mr. Patel and Megan Smith, Googles Vice President of New
Business Development, executed a non-disclosure agreement (NDA) for the purpose of
engaging in negotiations regarding VSLs technology.
50. During those negotiations, Laura Majerus, one of Googles in-house counsel
advised that if VSLs patent portfolio read on the H.264 video codec, then Google would seek to
buy the technology or to acquire VSL.
51. During the course of the negotiations and pursuant to the NDA, VSL provided a
working VSL codec to Google for testing and analysis, and further provided copies of VSLs
patents, patent applications (including the patent application that led to the 339 Patent), and
claim charts comparing the inventions claimed in the 339 Patent to the H.264 standard.
52. The parties continued to meet over the course of the next eight months. During
the course of those meetings, Google requested, and VSL provided, technical guidance to Google
Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 8 of 15 PageID #: 8

9
regarding the implementation of VSLs technology, the VSL Codec, and the inventions claimed
in the 339 Patent.
53. By December 2010, negotiations between the parties stalled, and the parties
terminated discussions.
54. On December 16, 2010, Ms. Majerus shipped back to VSL materials that VSL
had provided to Google pursuant to the NDA. Ms. Majerus included a cover letter that provided
an itemized list of documents and other things being returned to VSL pursuant to the NDA, with
the only apparent missing components being the claim charts comparing the inventions claimed
in the 339 Patent to the H.264 standard.
55. Included with the materials was a collection of Post-It notes, which appear to
have been authored by Google personnel.
56. The Post-It notes included statements that suggest that Google intended to
infringe VSLs patents and that Googles infringement was knowing and willful.
57. Examples of such statements in the Post-It notes include the following:
a. Google engineers should be discouraged from digging deep and should
close eyes to existing IP, and from talking further to Qualcomm IP engineer Seyfullah
Oguz who had agreed to assist VSL in providing understanding to Google ;
b. Google was concerned that its infringement could be considered
recklessness (the standard applicable to willful infringement);
c. Google had concerns that products in development should be carefully
monitored because of potential infringement;
d. Google personnel should try to destroy incriminating emails;
e. Google needed to obtain a non-infringement opinion from outside counsel;
Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 9 of 15 PageID #: 9

10
f. Google should evaluate the risk of getting sued for infringement if
Googles infringing products were money making; and
g. Google should consider a design around because it was facing a risk of
litigation.
58. On information and belief, Google began to incorporate VSLs patented
technology into WebM/VP8 soon after it initiated negotiations with VSL and received from VSL
confidential information regarding VSLs patent portfolio.
59. Indeed, subsequent to meeting with VSL, Google and On2 either amended a
number of their pending patent applications to incorporate various claims of the 339 Patent or
filed for new patents which incorporated various claims of the 339 Patent, without disclosing to
the United States Patent and Trademark Office the 339 Patent or its underlying application as
prior art or Ms. Nash or Mr. Krichevsky as prior inventors. Nonetheless, Defendants
incorporation of claims of the 339 Patent into their patent applications and patents constitute
tacit admissions of Defendants infringement of the 339 Patent.
CLAIM FOR RELIEF
(Infringement of the 339 Patent)
60. VSL incorporates paragraphs 1 through 59 as though fully set forth herein.
61. Upon information and belief, Defendants have been and now are directly
infringing one or more claims of the 339 Patent by making, importing, using (including use for
testing purposes), offering for sale, and/or selling the patented inventions, including but not
limited to the Accused Instrumentalities.
62. In addition and/or in the alternative, Defendants have been and/or now are
indirectly infringing one or more claims of the Asserted Patent by inducing customers,
Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 10 of 15 PageID #: 10

11
consumers, and end users to use the Accused Instrumentalities to directly infringe one or more
claims of the Asserted Patent in violation of 35 U.S.C. 271(b).
63. Google was informed in 2010 of the pending application that became the 339
Patent and had actual knowledge of the applicability of the inventions claimed therein to video
codecs such as those used in the Accused Instrumentalities.
64. Furthermore, Google has been provided actual notice of the existence of the 339
Patent.
65. The Post-It notes are unequivocal evidence of Googles knowledge of the 339
Patent and infringement by Defendants.
66. In spite of having received such notice, Google and its Defendant subsidiaries
have intended, and continue to intend, to induce patent infringement by customers and end users,
and have had knowledge that the inducing acts would cause infringement or, alternatively, have
been willfully blind to the possibility that its inducing acts would cause infringement.
67. The Accused Instrumentalities comprise the systems claimed in one or more
claims of the 339 Patent, and, when used as described in Defendants technical publications,
perform the method(s) described and claimed in the Asserted Patent.
68. Defendants have engaged in indirect infringement by providing their customers
and end users with the infringing Accused Instrumentalities, and/or by providing the Accused
Instrumentalities and providing instructions to enable those customers and end users to use the
Accused Instrumentalities, each of which constitute the system claimed in one or more claims of
the 339 Patent, and/or to utilize the Accused Instrumentalities so as to practice the method
claimed in one or more claims of the 339 Patent.
Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 11 of 15 PageID #: 11

12
69. By way of example, and not as a limitation, Defendants induce such infringement
by at least making its Internet websites available to customers and end users and providing links
and/or other directions on its websites and/or the Internet to instruct and teach users to use the
Accused Instrumentalities in an infringing manner.
70. Defendants engaged and continue to engage in such activities knowingly,
and, as early as 2010, have done so with the knowledge that such activities induce customers and
end users to directly infringe the Asserted Patent.
71. In addition, or, in the alternative, Defendants engaged and continue to engage
in such activities knowingly, and, as early as 2010, have sold or distributed the Accused
Instrumentalities knowing that such Accused Instrumentalities are especially made or adapted for
use by their customers and end users in an infringing use of one or more claims of the Accused
Instrumentalities.
72. On information and belief, Defendants customers and end users configure the
Accused Instrumentalities to encode and/or decode digital video as described and claimed in the
Asserted Patent. Thus, Defendants customers and end users, by using the Accused
Instrumentalities, directly infringe the claimed method(s) of the Asserted Patent.
73. VSL has been damaged by Defendants infringing activities and will be
irreparably harmed unless those infringing activities are preliminarily and permanently enjoined
by this Court.
74. Google and its Defendant subsidiaries either had actual knowledge of the 339
Patent or recklessly disregarded the existence of the 339 Patent, so VSL is entitled to damages
against Google for indirect infringement for the period prior to the filing of this Complaint
through the date of trial.
Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 12 of 15 PageID #: 12

13
75. Defendants infringement of the 339 Patent is and has been willful.
76. Defendants past and continued infringement of the 339 Patent has caused VSL
damage and will continue to cause irreparable damage to VSL unless Google is enjoined by this
Court.
77. VSL does not have an adequate remedy at law.
REQUEST FOR RELIEF

WHEREFORE, Plaintiffs VSL and Max Sound request the following relief:
(a) A judgment in favor of VSL and Max Sound that Defendants have directly
infringed, and/or have indirectly infringed by way of inducement, one or more claims of the
Asserted Patent and that such infringement has been willful;
(b) A judgment that VSL and Max Sound have been irreparably harmed by the
Defendants infringing activities and are likely to continue to be irreparably harmed by Googles
continued infringement;
(c) Imposition of preliminary and permanent injunctions prohibiting Defendants and
their officers, agents, servants, employees, and those persons in active concert or participation
with any of them, as well as all successors or assignees of the interests or assets related to the
Accused Instrumentalities, from further infringement, direct and indirect, of the Asserted Patent;
(d) A judgment and order requiring Defendants to pay VSL and Max Sound
damages adequate to compensate for infringement under 35 U.S.C. 284, which damages may
include lost profits but in no event shall be less than a reasonable royalty for the use made of the
inventions of the Asserted Patent, including pre- and post-judgment interest and costs, including
expenses and disbursements;
(e) A judgment awarding treble damages to VSL and Max Sound pursuant to 35
U.S.C. 284, in view of the willful and deliberate nature of the infringement, with interest;
Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 13 of 15 PageID #: 13

14
(f) A judgment declaring this to be an exceptional case under 35 U.S.C. 285 and
awarding VSL and Max Sound their attorneys fees;
(g) Pre- and post-judgment interest as permitted by law; and
(h) Any and all such further necessary or proper relief as this Court may deem just.
DEMAND FOR JURY TRIAL
Pursuant to Rule 38(b) of the Federal Rules of Civil Procedure, VSL and Max Sound
hereby demand a trial by jury of all issues so triable.

Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 14 of 15 PageID #: 14

15
Dated: August 9, 2014 GRANT & EISENHOFER P.A.

By: /s/ Geoffrey C. J arvis
Geoffrey C. J arvis


Christopher M. J oe
(pro hac vice to be submitted)
Brian A. Carpenter
(pro hac vice to be submitted)
Eric W. Buether
(pro hac vice to be submitted)
Mark D. Perantie
(pro hac vice to be submitted)
BUETHER JOE & CARPENTER, LLC
1700 Pacific Avenue, Suite 4750
Dallas, Texas 75201
Tel: (214) 466-1272
Fax: (214) 635-1828
Chris.J oe@BJ CIPlaw.com
Eric.Buether@BJ CIPlaw.com
Brian.Carpenter@BJ CIPlaw.com
Mark.Perantie@BJ CIPlaw.com

Geoffrey C. J arvis
J ustin K. Victor
GRANT & EISENHOFER P.A.
123 J ustison Street
Wilmington, Delaware 19801
Tel: (302) 622-7000
Fax: (302) 622-7100
gjarvis@gelaw.com
jvictor@gelaw.com

J ay W. Eisenhofer
Deborah A. Elman
(pro hac vice to be submitted)
GRANT & EISENHOFER P.A.
485 Lexington Avenue
New York, New York 10017
Tel: (646) 722-8500
Fax: (646) 722-8501
jeisenhofer@gelaw.com
delman@gelaw.com

Adam J . Levitt
(pro hac vice to be submitted)
Catherine Silleabhin
(pro hac vice to be submitted)
GRANT & EISENHOFER P.A.
30 North LaSalle Street
Suite 1200
Chicago, Illinois 60602
Tel: (312) 214-0000
Fax: (312) 214-0001
alevitt@gelaw.com
cosuilleabhain@gelaw.com

Attorneys for Plaintiffs
Vedanti Systems Limited and
Max Sound Corporation


Case 1:14-cv-01029-UNA Document 1 Filed 08/09/14 Page 15 of 15 PageID #: 15


EXHIBIT 1
Case 1:14-cv-01029-UNA Document 1-1 Filed 08/09/14 Page 1 of 12 PageID #: 16
US007974339B2
( 1 2) Ulllted States Patent ( 1 0) Patent N 0. : US 7, 974, 339 B2
Krichevsky et al. ( 45 ) Date o f Patent: J u l. 5 , 201 1
( 5 4) OPTIMIZED DATA TRAN SMISSION SYSTEM 5 , 778 , 092 A 7/ 1 998 MacLeo d et al.
AN D METHOD 5 , 78 4, 1 75 A 7/ 1 998 Lee
5 , 8 38 , 333 A * 1 1 / 1 998 Matsu o . . . . . . . . . . . . . . . . . . . . . . . . . 345 / 604
. 5 , 8 78 , 1 69 A * 3/ 1 999 Mi amo to . . 38 2/ 236
( 76) Invento rs: Alex Krlchevsky, Lagu na Beach, CA 6, 01 4, 1 8 1 A * V2000 Su i, " " " " " " 348 / 699
( Us) ; Co nstance N ash, Lagu na Beach, 6, 078 , 307 A * 6/ 2000 Daly . . . . . . . 345 / 600
CA ( US) 6, 1 98 , 467 B1 * 3/ 2001 Chiang . . . . . . . 345 / 698
6, 326, 98 1 B1 * 1 2/ 2001 Mo ri et al. 345 / 695
( * ) N o tice: Su b j ect to any disclaimer, the term o f this 6, 473, 062 B1 : 1 0/ 2002 Deb lez et al' " 345 / 63
tent is extended o r ad' u sted u nder 35 6 608 632 B2 8 / 2003 Daly et a1 345 / 698
Pa 1 7, 05 0, 639 B1 * 5 / 2006 Barnes et al. . . 38 2/ 239
U-S-C- 1 5 4( 1 ) ) b y 1 401 days- 7, 5 5 1 , 1 8 9 B2 * 6/ 2009 Hu nter . . . . . . . . . . . . . . . . . . . . . . . . . . 345 / 698
( 21 ) Ap p 1 _ N O; 1 0/ 8 92, 690 FOREIGN PATEN T DOCUMEN TS
EP 0 71 2 08 8 A2 5 / 1 996
( 22) Filed: J u l. 1 6, 2004 EP 1 006 71 5 A2 6/ 2000
EP 1 006 71 7 A2 6/ 2000
( 65 ) Prio r Pu b licatio n Data OTHER PUBLICATION S
Us 2004/ 025 8 1 5 0 A1 Dec' 23 2004 Su p p lementary Eu ro p ean Search Rep o rt, dated Sep . 23, 2005 .
. . Stro b ach, Tree Stru ctu red Scene Adap tive Co der, IEEE Transactio ns
Related U' s' Ap p hcatlo n Data o n Co mmu nicatio ns, Ap r. 1 990, vo l. 38 , N o . 4, p p . 477-48 6.
( 63) Co ntinu atio n o f ap p licatio n N o . PCT/ US02/ 005 03, * _ _
? led On J an. 1 6, 2002. ted b y exammer
( 5 1 ) Int CL Primary Examiner * Tu ng Vo
H04N 7/ 1 2 ( 2006. 01 ) 5 7 ABSTRACT
( 5 2) US. Cl. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 375 / 240. 01 ( )
( 5 8 ) Field o f Classi? catio n Search . . . . . . . . . . . . . 375 / 24001 , A system f o r transmitting data is Pro vided The System
375 / 240, l5 , 240, 23; 38 0/ 5 4; 38 2/ 239, 236; inclu des a f rame analysis system receiving f rame data, su ch
348 / 699 as a f rame o f video data, and generating regio n data, su ch as
See ap p licatio n ? le f o r co mp lete Search histo ry, a u nif o rm matrix siZe that is u sed to divide the f rame into a
p redetermined set o f matrices. A p ixel selectio n system
( 5 6) Ref erences Cited receives the regio n data and generates o ne set o f p ixel data f o r
US. PATEN T DOCUMEN TS
4, 776, 01 3 A * 1 0/ 1 98 8 Kaf riet al. . . . . . . . . . . . . . . . . . . . . . . 38 0/ 5 4
4, 78 5 , 349 A * ll/ l98 8 Keithet al. . . . . . . . . . . . . . . 375 / 240. 23
each regio n, su ch as b y selecting o ne o f the p ixels co ntained
W ithin each o f the o riginal matrices that co mp rise the f rame.
1 3 Claims, 4 Drawing Sheets
DATA TRAN SMISSION SYSTEM 1 _ o g
FRAME PIXEL
AN ALYSIS SELECTION
SYSTEM SYSTEM
1 99 1 %
L l
1 1 4
L |
PIXEL DATA D' SPLAY
SYSTEM GEN ERATION
1 1 0 SYSTEM
1 2
DATA RECEIVIN G SYSTEM E4;
1 00?
Case 1:14-cv-01029-UNA Document 1-1 Filed 08/09/14 Page 2 of 12 PageID #: 17
US. Patent J u l . 5 , 2 0 1 1 Sh eet 1 0 1 4 US 7 , 9 7 4 , 3 3 9 B2
DATA TRANSMISSION SYSTEM 1 _ q g
FRAME PIXEL
ANALYSIS SELECTION
SYSTEM SYSTEM
.1 _ 0 _ 1 %
L l
1 1 4
L |
PIXEL DATA D'SPLAY
SYSTEM GENERATION
SYSTEM
1 3 9 1 1 2
DATA RECEIVING SYSTEM 3 9 5
FIGURE 1 we?
PIXEL MATRIX
VARIATION Mg l g ?Es h nz E IDENTIFICATION
SYSTEM 2 0 4 SYSTEM
2 9 2 2 2 f ;
FRAME ANALYSIS SYSTEM 1 0 5
FIGURE 2 2 0 0 %>
Case 1:14-cv-01029-UNA Document 1-1 Filed 08/09/14 Page 3 of 12 PageID #: 18
US. Patent J u l . 5 , 2011 Sh eet 2 of4
US 7 , 9 7 4, 3 3 9 B2
PIXEL
a
RANDOMIZER
SYSTEM
PIXEL
SEQUENCER
SYSTEM SYSTEM
w 3 i
PIXEL
IDENTIFICATION
l l
PIXEL SELECTION SYSTEM 1E
FIGURE 3
MATRIX
DEFINITION
SYSTEM
E
I I
PIXEL DATA SYSTEM 1
PIXEL LOCATION
SYSTEM
? l
FIGURE 4
4001?
DETERMINE MATRIX SIZE
I
SELECT PIXEL l N MATRIX
I
TRANSMIT MATRIX AND PIXEL DATA
I
ASSEMBLE MATRIX AND PIXEL DATA INTO FRAME
I
GENERATE DISPLAY USING MATRIX AND PIXEL DATA
NO
FRAME COMPLETE?
5 12
GO TO NEXT FRAME
YES
5 02
5 04
5 06
5 08
5 10
FIGURE 5
5 00?
5 14
Case 1:14-cv-01029-UNA Document 1-1 Filed 08/09/14 Page 4 of 12 PageID #: 19
US. Patent J u l . 5 , 2 0 1 1 Sh eet 3 o f 4 US 7 , 9 7 4 , 3 3 9 B2
>I D E T E R M IN E PIX E L V A R IA T IO N I 6 0 2
V A R IA T IO N > T O L ?
| GO T O N E X T PIX E L | | A SSIGN M A T R IX SIZ E
I 6 0 8 6 0 6
| M O D IF Y T O L |
6 1 0 F IGUR E S s o o ?
R E CE IV E M A T R IX D A T A I 7 0 2
SE QUE N CE
R A N D O M O R SE QUE N CE ?
R A N D O M
GE N E R A T E R A N D O M N UM BE R I | O BT A IN SE QUE N CE D A T A |
I 7 1 I 7 0 6
SE L E CT PIX E L BA SE D O N SE L E CT PIX E L BA SE D O N
R A N D O M N UM BE R SE QUE N CE D A T A
7 1 2
7 0 8
F IGUR E 7 7 0 0 ?
R E CE IV E M A T R IX A N D PIX E L D A T A I 8 0 2
I
I CO M BIN E M A T R IX , PIX E L D A T A IN T O F R A M E D A T A I 8 0 4
N O /I\Y E S
F R A M E CO M PL E T E ?
8 0 6 I
I GO T O N E X T F R A M E I
8 0 8
F IGUR E 8 8 0 0 i ]
Case 1:14-cv-01029-UNA Document 1-1 Filed 08/09/14 Page 5 of 12 PageID #: 20
US. Patent J u l . 5 , 2 0 1 1 Sh eet 4 o f 4 US 7 , 9 7 4 , 3 3 9 B2
X X X X
x_ r_ m
x x
x
F I G UR E 9 9 0 0 ?
X X
F I G UR E 1 0 1 0 0 $
Case 1:14-cv-01029-UNA Document 1-1 Filed 08/09/14 Page 6 of 12 PageID #: 21
US 7 , 9 7 4 , 3 3 9 B2
1
OPTIMIZED DATA TRANSMISSION SYSTEM
AND METHOD
FIELD OF THE INVENTION
The p r es en t i n v en t i o n p er t a i n s t o t he ? el d o f d a t a t r a n s m i s
s i o n , a n d m o r e p a r t i c u l a r l y t o a s y s t em a n d m et ho d f o r o p t i
m i Zi n g d a t a t r a n s m i s s i o n t ha t d ec r ea s es b a n d w i d t h r eq u i r e
m en t s f o r d a t a t r a n s m i s s i o n .
BACKGROUND OF THE INVENTION
Da t a t r a n s m i s s i o n s y s t em s a r e kn o w n i n t he a r t . Su c h d a t a
t r a n s m i s s i o n s y s t em s o f t en u s e c o m p r es s i o n t o d ec r ea s e
b a n d w i d t h r eq u i r em en t s . Fo r ex a m p l e, c o m p r es s i o n t ec h
n i q u es ha v e b een c ha r a c t er i z ed a s l o s s l es s w hen n o r ed u c
t i o n i n d a t a o c c u r s , o r l o s s y w hen a l o s s o f d a t a o c c u r s t ha t
d o es n o t a d v er s el y a f f ec t t he i n t en d ed u s e.
On e d r a w b a c k w i t h s u c h d a t a t r a n s m i s s i o n s y s t em s i s t ha t
t he c o m p r es s ed d a t a m u s t b e d ec o m p r es s ed o n t he r ec ei v
i n g en d . Thu s , f o r l o s s l es s d a t a c o m p r es s i o n s y s t em s , t he
ex a c t c o n ? g u r a t i o n o f t he d a t a m u s t b e a c hi ev ed w hen t he
d a t a i s d ec o m p r es s ed . Li kew i s e, ev en f o r l o s s y d a t a c o m p r es
s i o n s y s t em s , t he d a t a i s d ec o m p r es s ed a n d t he l o s t d a t a i s
t hen a p p r o x i m a t ed . The n eed f o r s u c h d ec o m p r es s i o n c o n
t r i b u t es t o t he o v er a l l d i ? i c u l t y i n i m p l em en t i n g d a t a t r a n s
m i s s i o n i n c o n j u n c t i o n w i t h c o m p r es s i o n .
SUMMARY OF THE INVENTION
In a c c o r d a n c e w i t h t he p r es en t i n v en t i o n , a s y s t em a n d
m et ho d f o r t r a n s m i t t i n g d a t a a r e p r o v i d ed t ha t o v er c o m e
kn o w n p r o b l em s w i t h d a t a t r a n s m i s s i o n s y s t em s a n d m et h
o d s .
In p a r t i c u l a r , a s y s t em a n d m et ho d f o r d a t a t r a n s m i s s i o n a r e
p r o v i d ed t ha t u s e d a t a o p t i m i Za t i o n i n s t ea d o f c o m p r es s i o n ,
s o a s t o p r o v i d e a m i x ed l o s s l es s a n d l o s s y d a t a t r a n s m i s s i o n
t ec hn i q u e.
In a c c o r d a n c e w i t h a n ex em p l a r y em b o d i m en t o f t he
p r es en t i n v en t i o n , a s y s t em f o r t r a n s m i t t i n g d a t a i s p r o v i d ed .
The s y s t em i n c l u d es a f r a m e a n a l y s i s s y s t em r ec ei v i n g f r a m e
d a t a , s u c h a s a f r a m e o f v i d eo d a t a , a u d i o d a t a , g r a p hi c a l d a t a ,
t ex t d a t a , o r o t her s u i t a b l e d a t a , a n d g en er a t i n g r eg i o n d a t a ,
s u c h a s a u n i f o r m m a t r i x s i Ze t ha t i s u s ed t o d i v i d e t he f r a m e
i n t o a p r ed et er m i n ed s et o f m a t r i c es . A p i x el s el ec t i o n s y s t em
r ec ei v es t he r eg i o n d a t a a n d g en er a t es o n e s et o f p i x el d a t a f o r
ea c h r eg i o n , s u c h a s b y s el ec t i n g o n e o f t he p i x el s c o n t a i n ed
w i t hi n ea c h o f t he o r i g i n a l m a t r i c es t ha t c o m p r i s e t he f r a m e.
Fo r d a t a t ha t i s u s ed f o r p u r p o s es o t her t ha n t he g en er a t i o n o f
a d i s p l a y , t he p i x el d a t a c a n i n s t ea d b e a u d i o d a t a , t ex t d a t a , o r
o t her s u i t a b l e d a t a .
The p r es en t i n v en t i o n p r o v i d es m a n y i m p o r t a n t t ec hn i c a l
a d v a n t a g es . On e i m p o r t a n t t ec hn i c a l a d v a n t a g e o f t he p r es en t
i n v en t i o n i s a s y s t em a n d m et ho d f o r t r a n s m i t t i n g d a t a t ha t d o
n o t r eq u i r e t he d a t a t o b e c o m p r es s ed a t t he s en d i n g en d a n d
d ec o m p r es s ed a t t he r ec ei v i n g en d . The p r es en t i n v en t i o n
u s es d a t a o p t i m i Za t i o n t o t r a n s m i t o n l y t he d a t a t ha t i s n ec es
s a r y f o r t he a p p l i c a t i o n , s u c h t ha t d ec o m p r es s i o n o f t he d a t a
o n t he r ec ei v i n g en d i s n o t r eq u i r ed . In t hi s m a n n er , t he
p r es en t i n v en t i o n i n c o r p o r a t es f ea t u r es o f b o t h l o s s l es s a n d
l o s s y c o m p r es s i o n w i t ho u t r eq u i r i n g t he d a t a t o b e d ec o m
p r es s ed o n t he r ec ei v i n g en d .
Tho s e s ki l l ed i n t he a r t w i l l f u r t her a p p r ec i a t e t he a d v a n
t a g es a n d s u p er i o r f ea t u r es o f t he i n v en t i o n t o g et her w i t h
o t her i m p o r t a n t a s p ec t s t her eo f o n r ea d i n g t he d et a i l ed
d es c r i p t i o n t ha t f o l l o w s i n c o n j u n c t i o n w i t h t he d r a w i n g s .
20
25
3 0
3 5
4 0
4 5
50
55
60
65
2
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 i s a d i a g r a m o f a s y s t em f o r t r a n s m i t t i n g d a t a i n
a c c o r d a n c e w i t h a n ex em p l a r y em b o d i m en t o f t he p r es en t
i n v en t i o n ;
FIG. 2 i s a d i a g r a m o f a s y s t em f o r p er f o r m i n g f r a m e
a n a l y s i s i n a c c o r d a n c e w i t h a n ex em p l a r y em b o d i m en t o f t he
p r es en t i n v en t i o n ;
FIG. 3 i s a d i a g r a m o f a s y s t em f o r s el ec t i n g o p t i m i Zed
p i x el d a t a f o r t r a n s m i s s i o n i n a c c o r d a n c e w i t h a n ex em p l a r y
em b o d i m en t o f t he p r es en t i n v en t i o n ;
FIG. 4 i s a d i a g r a m o f a s y s t em f o r g en er a t i n g a f r a m e i n
a c c o r d a n c e w i t h a n ex em p l a r y em b o d i m en t o f t he p r es en t
i n v en t i o n ;
FIG. 5 i s a ? o w c ha r t o f a m et ho d f o r o p t i m i Zi n g d a t a
t r a n s m i s s i o n i n a c c o r d a n c e w i t h a n ex em p l a r y em b o d i m en t
o f t he p r es en t i n v en t i o n ;
FIG. 6 i s a ? o w c ha r t o f a m et ho d f o r d et er m i n i n g o r a s s i g n
i n g m a t r i x o r r eg i o n s i Ze b a s ed o n a n ex em p l a r y em b o d i m en t
o f t he p r es en t i n v en t i o n ;
FIG. 7 i s a ? o w c ha r t o f a m et ho d f o r s el ec t i n g a p i x el w i t hi n
a r eg i o n i n a c c o r d a n c e w i t h a n ex em p l a r y em b o d i m en t o f t he
p r es en t i n v en t i o n ;
FIG. 8 i s a ? o w c ha r t f o r m et ho d f o r g en er a t i n g o p t i m i Zed
f r a m e d a t a i n a c c o r d a n c e w i t h a n ex em p l a r y em b o d i m en t o f
t he p r es en t i n v en t i o n ;
FIG. 9 i s a d i a g r a m 9 00 s ho w i n g a n ex em p l a r y u n i f o r m
m a t r i x s eg m en t a t i o n o f a n a r r a y o f p i x el d a t a ; a n d
FIG. 1 0 i s a d i a g r a m 1 000 s ho w i n g a n ex em p l a r y n o n
u n i f o r m m a t r i x s eg m en t a t i o n o f a n a r r a y o f p i x el d a t a .
DETAILED DESCRIPTION OF PREFERRED
EMBODIMENTS
In t he d es c r i p t i o n t ha t f o l l o w s , l i ke p a r t s a r e m a r ked
t hr o u g ho u t t he s p ec i ? c a t i o n a n d d r a w i n g s w i t h t he s a m e r ef
er en c e n u m er a l s , r es p ec t i v el y . The d r a w i n g ? g u r es m i g ht n o t
b e t o s c a l e, a n d c er t a i n c o m p o n en t s c a n b e s ho w n i n g en er
a l i Zed o r s c hem a t i c f o r m a n d i d en t i ? ed b y c o m m er c i a l d es
i g n a t i o n s i n t he i n t er es t o f c l a r i t y a n d c o n c i s en es s .
FIG. 1 i s a d i a g r a m o f a s y s t em 1 00 f o r t r a n s m i t t i n g d a t a i n
a c c o r d a n c e w i t h a n ex em p l a r y em b o d i m en t o f t he p r es en t
i n v en t i o n . Sy s t em 1 00 a l l o w s d a t a s u c h a s v i d eo d a t a t o b e
t r a n s m i t t ed i n a m a n n er t ha t d o es n o t r eq u i r e t he d a t a t o b e
c o m p r es s ed , a n d w hi c h r es u l t s i n s i g n i ? c a n t d ec r ea s es i n
b a n d w i d t h r eq u i r em en t s f o r d a t a t r a n s m i s s i o n .
Sy s t em 1 00 i n c l u d es d a t a t r a n s m i s s i o n s y s t em 1 02, w hi c h
i s c o u p l ed t o d a t a r ec ei v i n g s y s t em 1 04 o v er a s u i t a b l e c o m
m u n i c a t i o n s m ed i u m 1 1 4 . As u s ed her ei n , t he t er m c o u p l e
a n d i t s c o g n a t e t er m s , s u c h a s c o u p l es a n d c o u p l ed , c a n
i n c l u d e a p hy s i c a l c o n n ec t i o n ( s u c h a s a c o p p er c o n d u c t o r ) , a
v i r t u a l c o n n ec t i o n ( s u c h a s t hr o u g h r a n d o m l y a s s i g n ed
m em o r y l o c a t i o n s o f a d a t a m em o r y d ev i c e) , a l o g i c a l c o n
n ec t i o n ( s u c h a s t hr o u g h l o g i c a l g a t es o f a s em i c o n d u c t i n g
d ev i c e) , o t her s u i t a b l e c o n n ec t i o n s , o r a s u i t a b l e c o m b i n a t i o n
o f s u c h c o n n ec t i o n s . In o n e ex em p l a r y em b o d i m en t , s y s t em s
a n d c o m p o n en t s a r e c o u p l ed t o o t her s y s t em s a n d c o m p o
n en t s t hr o u g h i n t er v en i n g s y s t em s a n d c o m p o n en t s , s u c h a s
t hr o u g h a n o p er a t i n g s y s t em o f a g en er a l p u r p o s e c o m p u t i n g
p l a t f o r m . Co m m u n i c a t i o n s m ed i u m 1 1 4 c a n b e t he In t er n et ,
t he p u b l i c s w i t c hed t el ep ho n e n et w o r k, a w i r el es s n et w o r k, a
l o c a l a r ea n et w o r k, a n o p t i c a l n et w o r k, o t her s u i t a b l e c o m
m u n i c a t i o n s m ed i a , o r a s u i t a b l e c o m b i n a t i o n o f s u c h c o m
m u n i c a t i o n s m ed i a .
Da t a t r a n s m i s s i o n s y s t em 1 02 i n c l u d es f r a m e a n a l y s i s s y s
t em 1 06 a n d p i x el s el ec t i o n s y s t em 1 08 , ea c h o f w hi c h c a n b e
i m p l em en t ed i n ha r d w a r e, s o f t w a r e, o r a s u i t a b l e c o m b i n a
Case 1:14-cv-01029-UNA Document 1-1 Filed 08/09/14 Page 7 of 12 PageID #: 22
US 7 , 9 7 4 , 3 3 9 B2
3
t i o n o f hardware an d s o ft ware, an d whi ch can be o n e o r mo re
s o ft ware s y s t ems o p erat i n g o n a g en eral p u rp o s e p ro ces s i n g
p l at fo rm. As u s ed herei n , a s o ft ware s y s t em can i n cl u de o n e
o r mo re o bj ect s , ag en t s , t hreads , l i n es o f co de, s u bro u t i n es ,
s ep arat e s o ft ware ap p l i cat i o n s , u s er- readabl e ( s o u rce) co de,
machi n e- readabl e ( o bj ect ) co de, t wo o r mo re l i n es o f co de i n
t wo o r mo re co rres p o n di n g s o ft ware ap p l i cat i o n s , dat abas es ,
o r o t her s u i t abl e s o ft ware archi t ect u res . I n o n e exemp l ary
embo di men t , a s o ft ware s y s t em can i n cl u de o n e o r mo re l i n es
o f co de i n a g en eral p u rp o s e s o ft ware ap p l i cat i o n , s u ch as an
o p erat i n g s y s t em, an d o n e o r mo re l i n es o f s o ft ware i n a
s p eci ? c p u rp o s e s o ft ware ap p l i cat i o n .
D at a t ran s mi s s i o n s y s t em 102 redu ces dat a t ran s mi s s i o n
req u i remen t s by el i mi n at i n g dat a t hat i s n o t req u i red fo r t he
ap p l i cat i o n o f t he dat a o n t he recei v i n g en d. I n o n e exemp l ary
embo di men t , dat a t ran s mi s s i o n s y s t em 102 can recei v e
frames o f v i deo dat a, an d can s el ect p i xel s o f dat a fo r t ran s
mi s s i o n t hat are n eeded i n o rder t o al l o w t he frames o f v i deo
dat a t o be v i ewed by t he hu man ey e. I n t hi s exemp l ary
embo di men t , a v i deo di s p l ay hav i n g a q u i es cen t s t at e o f p i x
el s i n ei t her t he o n o r o ff s t at es can be u s ed t o g en erat e
v i deo dat a by s el ect i n g a s u bs et o f p i xel s wi t hi n t he frame t o
di s p l ay i mag e dat a. I n t hi s exemp l ary embo di men t , i f a frame
o f v i deo dat a has l o w det ai l , i t may o n l y be n eces s ary t o
p ro v i de a dat a v al u e fo r o n e o f ev ery t wen t y - ? v e p i xel s o r l es s
i n o rder t o creat e t he i mag e t o be v i ewed by t he hu man ey e.
L i k ewi s e, i f t he frame o f v i deo dat a has a l arg e amo u n t o f
det ai l , i t may be n eces s ary t o t ran s mi t each p i xel i n o rder t o
g en erat e a s u i t abl e i mag e. When a frame o f v i deo dat a
i n cl u des reg i o n s o f hi g h det ai l an d l o w det ai l , i t may l i k ewi s e
be des i rabl e t o t ran s mi t o n l y t he n eces s ary n u mber o f p i xel s
i n each reg i o n t hat are req u i red t o g en erat e t he i mag e. I n t hi s
exemp l ary embo di men t , t he n u mber o f p i xel s t o t ran s mi t can
be deci ded o n a reg i o n - by - reg i o n bas i s wi t hi n t he frame.
D at a recei v i n g s y s t em 104 i n cl u des p i xel dat a s y s t em 110
an d di s p l ay g en erat i o n s y s t em 112, each o f whi ch can be
i mp l emen t ed i n hardware, s o ft ware, o r a s u i t abl e co mbi n a
t i o n o f hardware an d s o ft ware, an d whi ch can be o n e o r mo re
s o ft ware s y s t ems o p erat i n g o n a g en eral p u rp o s e p ro ces s o r
p l at fo rm. D at a recei v i n g s y s t em 104 recei v es t he dat a fro m
dat a t ran s mi s s i o n s y s t em 102, an d g en erat es a di s p l ay fo r a
u s er t hat u t i l i Z es t he o p t i mi Z ed dat a s et t ran s mi t t ed by dat a
t ran s mi s s i o n s y s t em 102. I n o n e exemp l ary embo di men t ,
dat a recei v i n g s y s t em 104 can g en erat e a v i deo di s p l ay , s u ch
as by i l l u mi n at i n g p redet ermi n ed p i xel s wi t hi n a frame bas ed
o n t he det ermi n at i o n o f t he l ev el o f det ai l req u i red fo r t he
frame, an d by l eav i n g t he remai n i n g p i xel s i n a q u i es cen t s t at e
o f ei t her o ff o r o n . L i k ewi s e, dat a recei v i n g s y s t em 104
can g en erat e frames o f v i deo dat a t hat hav e v ari abl e l ev el s o f
det ai l , t o acco mmo dat e t he i mag e dat a bei n g t ran s mi t t ed.
F rame an al y s i s s y s t em 106 recei v es frame dat a i n cl u di n g
p i xel dat a an d g en erat es mat ri x s i Z e dat a bas ed u p o n t he p i xel
dat a. I n o n e exemp l ary embo di men t , frame an al y s i s s y s t em
106 can an al y Z e adj acen t p i xel dat a v al u es i n t he frame, an d
can ap p l y o n e o r mo re p redet ermi n ed v ari at i o n t o l eran ces t o
s el ect a mat ri x s i Z e fo r a dat a o p t i mi Z at i o n reg i o n . I n t hi s
exemp l ary embo di men t , t he mat ri x s i Z e fo r each dat a o p t i mi
Z at i o n reg i o n o f a frame can be u n i fo rm, s u ch t hat each dat a
o p t i mi Z at i o n mat ri x has t he s ame di men s i o n s . T hu s , i f a 6 4 0x
4 8 0 p i xel frame i s bei n g t ran s mi t t ed, t hen t he 6 4 0x4 8 0 p i xel
frame can be s p l i t u p i n t o a 6 4 x4 8 frame o f mat ri ces , where
each mat ri x i s a 10x10 mat ri x. L i k ewi s e, frame an al y s i s s y s
t em 106 can as s i g n a di fferen t mat ri x s i Z e o n a frame by frame
bas i s , s u ch as where a ? rs t frame i s t ran s mi t t ed u s i n g 10x10
mat ri ces fo r a 6 4 x4 8 mat ri x frame, an d a s u bs eq u en t frame
co u l d t hen be t ran s mi t t ed u s i n g 5 > < 5 dat a mat ri ces , fo r a
128 x9 6 mat ri x frame. I n an o t her exemp l ary embo di men t , t he
20
25
3 0
3 5
4 0
4 5
5 0
5 5
6 0
6 5
4
s i Z e o f mat ri ces wi t hi n t he frame can be v ari ed, s u ch t hat a
g i v en frame i s made u p o f mat ri ces v ary i n g i n s i Z e, s u ch as
fro m a 1x1 mat ri x t o a 5 x5 mat ri x o r g reat er. I n y et an o t her
exemp l ary embo di men t , t he s i Z e o f t he mat ri ces can be n o n
s y mmet ri cal , s u ch t hat an N> < M mat ri x can be u s ed where N
an d M are i n t eg er v al u es t hat are n o t eq u i v al en t . L i k ewi s e,
o t her s u i t abl e dat a o p t i mi Z at i o n reg i o n s can be s el ect ed, s u ch
as o n es t hat are n o t bas ed o n a mat ri x s t ru ct u re, bu t whi ch may
be ci rcu l ar, el l i p t i cal , amo rp ho u s , o r bas ed o n o t her s u i t abl e
s t ru ct u res .
P i xel s el ect i o n s y s t em 108 s el ect s o n e o r mo re p i xel wi t hi n
a p rede? n ed mat ri x o r o t her reg i o n fo r t ran s mi s s i o n i n an
o p t i mi Z ed dat a t ran s mi s s i o n s y s t em. I n o n e exemp l ary
embo di men t , p i xel s el ect i o n s y s t em 108 can ran do ml y s el ect
a p i xel fro m a l o cat i o n wi t hi n a mat ri x o r o t her reg i o n , can u s e
a s eq u en ce s el ect i o n s cheme s u ch t hat t he p i xel i s s el ect ed i n
acco rdan ce wi t h a p redet ermi n ed s eq u en ce, o r o t her s u i t abl e
s el ect i o n cri t eri a can be u s ed. P i xel s el ect i o n s y s t em 108 can
fu rt her g en erat e p i xel l o cat i o n dat a wi t hi n t he mat ri x, s u ch
t hat t he p i xel can be reg en erat ed at a p redet ermi n ed l o cat i o n ,
at a ran do m l o cat i o n , o r i n o t her s u i t abl e man n ers . F o r
examp l e, i f a p redet ermi n ed l o cat i o n i s u s ed, t he p redet er
mi n ed l o cat i o n can be t he s ame fo r each mat ri x o r o t her
reg i o n , s u ch as by as s i g n i n g a q u adran t o r o t her l o cat i o n ( e. g . ,
t he ? rs t ro w an d co l u mn p o s i t i o n i n t he mat ri x) . L i k ewi s e, i f
ran do mi Z at i o n i s u s ed, co n t ro l dat a can be g en erat ed t hat wi l l
cau s e dat a recei v i n g s y s t em 104 t o ran do mi Z e t he l o cat i o n o f
each p i xel i n each mat ri x o r o t her reg i o n wi t ho u t req u i ri n g
i n di v i du al co n t ro l dat a fo r each mat ri x o r o t her reg i o n . L i k e
wi s e, o t her s u i t abl e p i xel s el ect i o n dat a can be g en erat ed.
P i xel dat a s y s t em 110 recei v es mat ri x dat a an d p i xel dat a
an d as s embl es frame dat a bas ed o n t he mat ri x dat a an d p i xel
dat a. I n o n e exemp l ary embo di men t , p i xel dat a s y s t em 110
recei v es a mat ri x s i Z e i den t i ? er fo r an en t i re frame, s u ch t hat
i t can be det ermi n ed t hat a u n i fo rm mat ri x s i Z e i s u s ed fo r
each frame. L i k ewi s e, p i xel dat a s y s t em 110 can recei v e
mat ri x map dat a, s u ch t hat a s eq u en ce o f mat ri ces an d t he s i Z e
o f each mat ri x can be det ermi n ed. L i k ewi s e, p i xel dat a s y s
t em 110 can recei v e p i xel dat a fo r each mat ri x, s u ch as p i xel
dat a wi t h each mat ri x i den t i ? er, p i xel dat a i n a p redet ermi n ed
o rder bas ed o n t he o rder o f mat ri x dat a t ran s mi t t ed, o r o t her
s u i t abl e dat a.
D i s p l ay g en erat i o n s y s t em 112 recei v es frames o f dat a
fro m p i xel dat a s y s t em 110 an d g en erat es v i deo dat a, au di o
dat a, g rap hi cal dat a, t ext u al dat a, o r o t her s u i t abl e dat a fo r u s e
by a u s er. I n o n e exemp l ary embo di men t , di s p l ay g en erat i o n
s y s t em 112 recei v es an en t i re frame o f dat a aft er i t has been
reco n s t ru ct ed by p i xel dat a s y s t em 110. I n an o t her exemp l ary
embo di men t , di s p l ay g en erat i o n s y s t em 112 can recei v e
frame dat a as i t i s g en erat ed by p i xel dat a s y s t em 110 p ri o r t o
t he g en erat i o n o f t he en t i re frame. O t her s u i t abl e co n ? g u ra
t i o n s can be u s ed.
I n o p erat i o n , s y s t em 100 al l o ws dat a t ran s mi s s i o n t o be
o p t i mi Z ed s o as t o decreas e ban dwi dt h req u i remen t s . Sy s t em
1 00 det ermi n es t he o p t i mal dat a fo r t ran s mi s s i o n bas ed o n t he
en d u s e o f t he dat a. F o r examp l e, s y s t em 100 can redu ce t he
dat a t ran s mi t t ed fo r v i deo di s p l ay g en erat i o n , s u ch as by
det ermi n i n g t he l ev el o f det ai l req u i red, an d t hen t ran s mi t t i n g
dat a bas ed o n t he l ev el o f det ai l req u i red. L i k ewi s e, s i mi l ar
o p t i mi z at i o n p ro ces s es can be u s ed fo r au di o dat a, g rap hi cal
dat a, t ext u al dat a, o r o t her s u i t abl e dat a. T hu s , s y s t em 100 i s
a l o s s y dat a t ran s mi s s i o n s y s t em, bu t can al s o be a l o s s l es s
dat a t ran s mi s s i o n s y s t em dep en di n g o n t he dat a ? el ds wi t hi n
a s et o f dat a fo r whi ch l o s s y o r l o s s l es s dat a t ran s mi s s i o n i s
des i red. I n t hi s exemp l ary embo di men t , s y s t em 100 al l o ws
dat a s et s t o be p ro ces s ed i n a man n er t hat al l o ws dat a t ran s
Case 1:14-cv-01029-UNA Document 1-1 Filed 08/09/14 Page 8 of 12 PageID #: 23
US 7 , 9 7 4 , 3 3 9 B2
5
m i s s i o n t o b e b o t h l o s s l e s s an d l o s s y b as e d o n ap p l i c at i o n
c r i t e r i a f o r t h e dat a o n t h e r e c e i v i n g e n d.
Sy s t e m 100 c an al s o b e us e d i n c o n j un c t i o n wi t h a c o m
p r e s s i o n s y s t e m , a f r am e e l i m i n at i o n s y s t e m , o r wi t h o t h e r
s ui t ab l e s y s t e m s o r p r o c e s s e s t o ac h i e v e f ur t h e r s av i n g s i n
b an dwi dt h r e q ui r e m e n t s . F o r e x am p l e , af t e r dat a o p t i m i Z a
t i o n h as b e e n ac h i e v e d, t h e o p t i m i Z e d dat a c an t h e n b e c o m
p r e s s e d us i n g a l o s s y o r l o s s l e s s c o m p r e s s i o n t e c h n i q ue .
L i k e wi s e , f r am e e l i m i n at i o n c an b e us e d wh e r e s uc h t e c h
n i q ue s do n o t r e s ul t i n an un ac c e p t ab l e de c r e as e i n t h e q ual i t y
o f t h e dat a at t h e r e c e i v i n g e n d.
F I G . 2 i s a di ag r am o f a s y s t e m 200 f o r p e r f o r m i n g f r am e
an al y s i s i n ac c o r dan c e wi t h an e x e m p l ar y e m b o di m e n t o f t h e
p r e s e n t i n v e n t i o n . Sy s t e m 200 i n c l ude s f r am e an al y s i s s y s
t e m 106 an d p i x e l v ar i at i o n s y s t e m 202, m at r i x s i Z e s y s t e m
204 , an d m at r i x i de n t i ? c at i o n s y s t e m 206 , e ac h o f wh i c h c an
b e i m p l e m e n t e d i n h ar dwar e , s o f t war e , o r a s ui t ab l e c o m b i
n at i o n o f h ar dwar e an d s o f t war e , an d wh i c h c an b e o n e o r
m o r e s o f t war e s y s t e m s o p e r at i n g o n a g e n e r al p ur p o s e p r o
c e s s i n g p l at f o r m .
P i x e l v ar i at i o n s y s t e m 202 de t e r m i n e s t h e l e v e l o f de t ai l
r e q ui r e d b as e d o n v ar i at i o n s i n p i x e l dat a. I n o n e e x e m p l ar y
e m b o di m e n t , p i x e l v ar i at i o n s y s t e m 202 c an r e c e i v e p i x e l
dat a v al ue s , s uc h as ( x / y / Z ) i n a s ui t ab l e p i x e l c o l o r p i x e l
s y s t e m ( e . g . , 16 - b i t v al ue s f o r R / G / B, Y / C b / C r , Y / U/ V , o r
o t h e r s ui t ab l e c o l o r dat a f o r m at s ) . P i x e l v ar i at i o n s y s t e m 202
c an t h e n c o m p ar e t wo adj ac e n t p i x e l s t o de t e r m i n e wh e t h e r
t h e am o un t o f v ar i at i o n b e t we e n t h o s e t wo adj ac e n t p i x e l s
e x c e e ds a p r e de t e r m i n e d t o l e r an c e , s uc h t h at t h e am o un t o f
p i x e l dat a r e q ui r e d t o t r an s m i t i m ag e dat a o r o t h e r s ui t ab l e
dat a f o r p e r c e p t i o n b y a h um an e y e o r o t h e r s ui t ab l e ap p l i c a
t i o n s c an b e de t e r m i n e d. I n t h i s e x e m p l ar y e m b o di m e n t , p i x e l
v ar i at i o n s y s t e m 202 c an h av e a n um b e r o f t o l e r an c e s e t t i n g s ,
s o t h at a m at r i x s i Z e , r e g i o n , o r o t h e r dat a o p t i m i z at i o n s e t c an
b e de t e r m i n e d. F o r e x am p l e , c o n s i de r t h e f o l l o wi n g p i x e l s e t :
P 1( 121/ 3 4 / 18 7 ) P 2( 119 / 3 9 / 19 8 ) P 3 ( 117 / 4 2/ 202)
I n t h i s e x am p l e , t h e v ar i at i o n b e t we e n P 1 an d P 2 m ay b e
l o we r t h an a ? r s t t o l e r an c e f o r t h e p ur p o s e s o f s e l e c t i n g a ? r s t
dat a s e t , s uc h as a 2x 2 m at r i x , b ut t h e v ar i at i o n b e t we e n P 1
an d P 3 m ay b e g r e at e r t h an a s e c o n d t o l e r an c e f o r t h e p ur p o s e
o f s e l e c t i n g a s e c o n d dat a s e t , s uc h as a 3 x 3 m at r i x . I n t h i s
m an n e r , i n c r e as i n g g r o up s o f p i x e l s c an b e an al y Z e d s o as t o
i n s ur e t h at de s i r e d l e v e l s o f de t ai l ar e n o t i n adv e r t e n t l y o m i t
t e d. F o r e x am p l e , i f v i de o dat a i n c l ude s an i m ag e o f an e s s e n
t i al l y un i f o r m o b j e c t , s uc h as t h e o c e an o r a g r as s y ? e l d, an d
wh e r e t h at e s s e n t i al l y un i f o r m o b j e c t h as de t ai l s t h at ar e
n o n e t h e l e s s o f i n t e r e s t t o t h e v i e we r , s uc h as wav e wh i t e c ap s
o r wi l d? o we r s , p i x e l v ar i at i o n s y s t e m 202 c an i n c l ude t o l e r
an c e s e t t i n g s s uc h t h at v ar i at i o n s b e t we e n p i x e l s t h at i de n t i f y
s uc h de t ai l s wo ul d b e i de n t i ? e d, b ut wh e r e s uc h v ar i at i o n s
b e t we e n t wo adj ac e n t p i x e l s wi t h i n t h e ? e l d wo ul d b e
i g n o r e d. L i k e wi s e , o t h e r s ui t ab l e p i x e l v ar i at i o n de t e c t i o n
f un c t i o n al i t y c an b e p r o v i de d.
M at r i x s i Z e s y s t e m 204 g e n e r at e s m at r i x s i Z e dat a b as e d o n
p i x e l v ar i at i o n dat a. I n o n e e x e m p l ar y e m b o di m e n t , m at r i x
s i Z e s y s t e m 204 c an r e c e i v e p i x e l v ar i at i o n dat a b as e d o n an
an al y s i s o f an e n t i r e f r am e o f dat a, s uc h t h at a un i f o r m m at r i x
s i Z e c an b e as s i g n e d. L i k e wi s e , m at r i x s i Z e s y s t e m 204 c an
r e c e i v e p i x e l v ar i at i o n dat a f r o m p i x e l v ar i at i o n s y s t e m 202,
an d c an g e n e r at e n o n s y m m e t r i c al m at r i x di m e n s i o n al dat a,
s uc h as N><M di m e n s i o n s wh e r e N an d M ar e i n t e g e r s
t h at ar e n o t e q ui v al e n t , c i r c ul ar r e g i o n dat a, e l l i p t i c al r e g i o n
dat a, am o r p h o us r e g i o n dat a, o r o t h e r s ui t ab l e r e g i o n i de n t i
? c at i o n dat a. M at r i x s i Z e s y s t e m 204 c an al s o g e n e r at e m at r i x
s i Z e c o n t r o l dat a, s uc h as wh e r e a n o n - un i f o r m m at r i x o r
r e g i o n s i Z e i s us e d wi t h i n a f r am e . I n t h i s e x e m p l ar y e m b o di
m e n t , m at r i x s i Z e s y s t e m 204 c an i de n t i f y a s e q ue n c e f o r
20
25
3 0
3 5
4 0
4 5
5 0
5 5
6 0
6 5
6
m at r i c e s , c o o r di n at e dat a f o r m at r i c e s , s i Z e dat a f o r m at r i c e s ,
o r o t h e r s ui t ab l e dat a t h at c an b e us e d t o as s e m b l e o r s e q ue n c e
p i x e l dat a wi t h i n m at r i c e s .
M at r i x i de n t i ? c at i o n s y s t e m 206 r e c e i v e s m at r i x s i Z e dat a
an d g e n e r at e s m at r i x i de n t i ? c at i o n dat a. I n o n e e x e m p l ar y
e m b o di m e n t , m at r i x i de n t i ? c at i o n s y s t e m 206 c an r e c e i v e
m at r i x s e q ue n c e dat a, an d c an as s e m b l e t h e m at r i x s e q ue n c e
dat a f o r us e wi t h p i x e l dat a g e n e r at e d b y p i x e l s e l e c t i o n
s y s t e m 108 . I n t h i s e x e m p l ar y e m b o di m e n t , m at r i x i de n t i ?
c at i o n s y s t e m 206 c an i de n t i f y wh e t h e r a un i f o r m m at r i x s i Z e
i s b e i n g g e n e r at e d, t h e n um b e r o f m at r i c e s wi t h i n a f r am e ,
s e q ue n c e dat a f o r t h e m at r i c e s wh e n a n o n - un i f o r m m at r i x o r
r e g i o n i s b e i n g us e d, o r o t h e r s ui t ab l e dat a. M at r i x i de n t i ?
c at i o n s y s t e m 206 g e n e r at e s m at r i x i de n t i ? c at i o n dat a f o r us e
b y dat a r e c e i v i n g s y s t e m 104 , s o as t o al l o w dat a r e c e i v i n g
s y s t e m 104 t o g e n e r at e t h e o p t i m i Z e d dat a di s p l ay .
I n o p e r at i o n , s y s t e m 200 al l o ws f r am e s t o b e an al y Z e d s o as
t o de t e r m i n e t h e o p t i m al dat a t o b e t r an s m i t t e d, b as e d o n t h e
i n t e n de d us e o f t h e f r am e . I n o n e e x e m p l ar y e m b o di m e n t ,
p i x e l v ar i at i o n s y s t e m 202 o r o t h e r s ui t ab l e s y s t e m s c an b e
us e d t o i de n t i f y l o s s y an d l o s s l e s s r e g i o n s wi t h i n t h e f r am e .
L i k e wi s e , un i f o r m l o s s y r e g i o n s c an b e i de n t i ? e d, s uc h as
m at r i c e s h av i n g p r e de t e r m i n e d di m e n s i o n s o f g r e at e r t h an
1x 1 o r o t h e r s ui t ab l e dat a.
F I G . 3 i s a di ag r am o f a s y s t e m 3 00 f o r s e l e c t i n g o p t i m i Z e d
p i x e l dat a f o r t r an s m i s s i o n i n ac c o r dan c e wi t h an e x e m p l ar y
e m b o di m e n t o f t h e p r e s e n t i n v e n t i o n . Sy s t e m 3 00 i n c l ude s
p i x e l s e l e c t i o n s y s t e m 108 an d p i x e l r an do m i Z e r s y s t e m 3 02,
p i x e l s e q ue n c e r s y s t e m 3 04 , an d p i x e l i de n t i ? c at i o n s y s t e m
3 06 , e ac h o f wh i c h c an b e i m p l e m e n t e d i n h ar dwar e , s o f t
war e , o r a s ui t ab l e c o m b i n at i o n o f h ar dwar e an d s o f t war e ,
an d wh i c h c an b e o n e o r m o r e s o f t war e s y s t e m s o p e r at i n g o n
a g e n e r al p ur p o s e p r o c e s s o r p l at f o r m .
P i x e l r an do m i Z e r s y s t e m 3 02 s e l e c t s a r an do m p i x e l wi t h i n
a m at r i x o r o t h e r r e g i o n . I n o n e e x e m p l ar y e m b o di m e n t , p i x e l
r an do m i Z e r s y s t e m 3 02 c an g e n e r at e a r an do m n um b e r an d
c an s e l e c t a p i x e l b as e d up o n a p i x e l s e q ue n c e an d t h e r e l a
t i o n s h i p o f t h e g e n e r at e d r an do m n um b e r t o t h at p i x e l
s e q ue n c e . I n t h i s e x e m p l ar y e m b o di m e n t , p i x e l r an do m i Z e r
s y s t e m 3 02 c an g e n e r at e a r an do m n um b e r b e t we e n 0 an d 1,
an d c an m ul t i p l y t h at r an do m n um b e r t i m e s t h e n um b e r o f
p i x e l s wi t h i n a r e g i o n , an d c an t h e n s e l e c t t h e p i x e l b as e d
up o n a p i x e l s e q ue n c e f r o m a p r e de t e r m i n e d l o c at i o n . L i k e
wi s e , o t h e r s ui t ab l e r an do m p i x e l s e l e c t i o n p r o c e s s e s c an b e
us e d. P i x e l r an do m i Z e r s y s t e m 3 02 g e n e r at e s r an do m p i x e l
l o c at i o n dat a an d r an do m p i x e l v al ue dat a.
P i x e l s e q ue n c e r s y s t e m 3 04 g e n e r at e s p i x e l s e l e c t i o n dat a
b as e d o n p i x e l s e q ue n c e dat a. I n o n e e x e m p l ar y e m b o di m e n t ,
s uc h as wh e n a un i f o r m f r am e m at r i x s i Z e i s b e i n g us e d, p i x e l
s e q ue n c e r s y s t e m 3 04 c an s e l e c t p i x e l s i n a p r e de t e r m i n e d
o r de r , s uc h t h at i f a 3 x 3 m at r i x i s us e d un i f o r m l y ac r o s s t h e
f r am e , t h e p i x e l at l o c at i o n ( 1, 1) i s t r an s m i t t e d i n t h e ? r s t
f r am e , t h e p i x e l at l o c at i o n ( 1, 2) i s t r an s m i t t e d i n t h e s e c o n d
f r am e , t h e p i x e l at l o c at i o n ( 1, 3 ) i s t r an s m i t t e d i n t h e t h i r d
f r am e , an d s o f o r t h , un t i l t h e p i x e l at l o c at i o n ( 3 , 3 ) h as b e e n
t r an s m i t t e d, af t e r wh i c h t h e p i x e l at l o c at i o n ( 1, 1) wi l l b e
t r an s m i t t e d. P i x e l s e q ue n c e r s y s t e m 3 04 c an l i k e wi s e s e n d
o t h e r s ui t ab l e s e q ue n c e s , s uc h as s k i p p i n g e v e r y o t h e r p i x e l ,
s k i p p i n g p i x e l s b as e d o n p r e de t e r m i n e d di s p l ay g e n e r at i o n
c h ar ac t e r i s t i c s , o r o t h e r s ui t ab l e s e q ue n c e s .
P i x e l i de n t i ? c at i o n s y s t e m 3 06 g e n e r at e s p i x e l i de n t i ? c a
t i o n dat a, s uc h as m ay b e r e q ui r e d b y a dat a r e c e i v i n g s y s t e m
t o i l l um i n at e t h e p i x e l i n a di s p l ay . I n o n e e x e m p l ar y e m b o di
m e n t , p i x e l i de n t i ? c at i o n s y s t e m 3 06 c an i de n t i f y t h e c o o r di
n at e s o f a p i x e l wh e r e g e n e r at i o n o f t h e p i x e l b y t h e dat a
r e c e i v i n g s y s t e m at t h e e x ac t l o c at i o n i s de s i r e d. L i k e wi s e ,
p i x e l i de n t i ? c at i o n s y s t e m 3 06 c an i de n t i f y a un i f o r m p i x e l
Case 1:14-cv-01029-UNA Document 1-1 Filed 08/09/14 Page 9 of 12 PageID #: 24
US 7 , 9 7 4 , 3 3 9 B2
7
l o c a t i o n w i t h i n ea c h m a t r i x o r o t h er r eg i o n , suc h a s l o c a t i o n
( 1 , 1 ) f o r a l l m a t r i c es, suc h a s r a n d o m i Z er c o n t r o l d a t a t h a t w i l l
r a n d o m l y p l a c e a p i x el w i t h i n a m a t r i x o r r eg i o n , o r o t h er
sui t a b l e p i x el i d en t i ? c a t i o n d a t a .
I n o p er a t i o n , syst em 3 00 a l l o w s a p i x el w i t h i n a m a t r i x o r
o t h er sui t a b l e r eg i o n t o b e sel ec t ed b a sed o n d a t a o p t i m i Z a
t i o n . Syst em 3 00 a l l o w s r a n d o m , seq uen c ed , o r o t h er sui t a b l e
p r o c esses t o b e used t o sel ec t a n d l o c a t e p i x el s w i t h i n o p t i
m i Z ed r eg i o n s.
F I G . 4 i s a d i a g r a m o f a syst em 4 00 f o r g en er a t i n g a f r a m e
i n a c c o r d a n c e w i t h a n ex em p l a r y em b o d i m en t o f t h e p r esen t
i n v en t i o n . Syst em 4 00 i n c l ud es p i x el d a t a syst em 1 1 0, m a t r i x
d e? n i t i o n syst em 4 02 a n d p i x el l o c a t i o n syst em 4 04 , ea c h o f
w h i c h c a n b e i m p l em en t ed i n h a r d w a r e, so f t w a r e, o r a sui t
a b l e c o m b i n a t i o n o f h a r d w a r e a n d so f t w a r e, a n d w h i c h c a n b e
o n e o r m o r e so f t w a r e syst em s o p er a t i n g o n a g en er a l p ur p o se
p r o c esso r p l a t f o r m .
M a t r i x d e? n i t i o n syst em 4 02 r ec ei v es m a t r i x d e? n i t i o n
d a t a f o r use i n g en er a t i n g f r a m e d a t a . I n o n e ex em p l a r y
em b o d i m en t , m a t r i x d e? n i t i o n d a t a c a n i n c l ud e d a t a t h a t
i d en t i ? es a un i f o r m m a t r i x si Z e t h r o ug h o ut t h e f r a m e. I n
a n o t h er ex em p l a r y em b o d i m en t , m a t r i x d e? n i t i o n d a t a c a n
i n c l ud e d a t a t h a t i d en t i ? es m a t r i x d i m en si o n s a n d seq uen c es,
so t h a t a seq uen c e o f n o n -si m i l a r m a t r i c es c a n b e a ssem b l ed
i n t o a f r a m e. L i k ew i se, m a t r i x d e? n i t i o n syst em 4 02 c a n
i n c l ud e r eg i o n d e? n i t i o n d a t a , suc h a s f o r el l i p ses, c i r c l es,
a m o r p h o us sh a p es, o r o t h er sui t a b l e d e? n i t i o n d a t a .
P i x el l o c a t i o n syst em 4 04 r ec ei v es p i x el l o c a t i o n d a t a f o r
l o c a t i n g a p i x el w i t h i n a m a t r i x o r o t h er r eg i o n . I n o n e ex em
p l a r y em b o d i m en t , p i x el l o c a t i o n syst em 4 04 c a n r ec ei v e d a t a
t h a t l o c a t es p i x el s f o r ea c h m a t r i x w i t h i n a f r a m e o n a un i f o r m
b a si s, suc h t h a t ea c h p i x el r ec ei v ed w i l l b e g en er a t ed i n a
p r ed et er m i n ed l o c a t i o n ( eg ( 1 , 1 ) i n a 3 x 3 m a t r i x ) . L i k ew i se,
p i x el l o c a t i o n syst em 4 04 c a n r ec ei v e r a n d o m i z a t i o n d a t a ,
suc h t h a t t h e l o c a t i o n o f a p i x el w i t h i n a m a t r i x o r o t h er r eg i o n
i s r a n d o m l y a s si g n ed . I n yet a n o t h er ex em p l a r y em b o d i m en t ,
p i x el l o c a t i o n syst em 4 04 c a n r ec ei v e ex a c t c o o r d i n a t es f o r
p l a c em en t o f p i x el s. O t h er sui t a b l e p r o c esses c a n b e i m p l e
m en t ed b y p i x el l o c a t i o n syst em 4 04 .
I n o p er a t i o n , syst em 4 00 i s used t o l o c a t e p i x el s o f d a t a
w i t h i n a m a t r i x o r o t h er r eg i o n i n a n o p t i m i Z ed d a t a t r a n sm i s
si o n syst em . Syst em 4 00 t h us a l l o w s o p t i m i Z ed d a t a , suc h a s
v i d eo d a t a , a ud i o d a t a , o r o t h er sui t a b l e d a t a , t o b e used t o
g en er a t e a d i sp l a y, a n a ud i o st r ea m , g r a p h i c i m a g es, t ex t ua l
d a t a , a n d o t h er sui t a b l e d a t a o n a f r a m e b y f r a m e b a si s.
F I G . 5 i s a ? o w c h a r t o f a m et h o d 5 00 f o r o p t i m i Z i n g d a t a
t r a n sm i ssi o n i n a c c o r d a n c e w i t h a n ex em p l a r y em b o d i m en t
o f t h e p r esen t i n v en t i o n . M et h o d 5 00 b eg i n s a t 5 02 w h er e a
m a t r i x si Z e i s d et er m i n ed . I n o n e ex em p l a r y em b o d i m en t , t h e
m a t r i x si Z e c a n b e un i f o r m l y a ssi g n ed a c r o ss t h e f r a m e, a
m a t r i x si Z e c a n a ssi g n ed b a sed up o n r eg i o n s w i t h i n t h e f r a m e,
a r eg i o n o t h er t h a n a m a t r i x c a n b e used , o r o t h er sui t a b l e
m a t r i x si Z es o r r eg i o n si Z es c a n b e d et er m i n ed . Th e m et h o d
t h en p r o c eed s t o 5 04 .
At 5 04 a p i x el w i t h i n t h e m a t r i x i s sel ec t ed . I n o n e ex em
p l a r y em b o d i m en t , t h e p i x el c a n b e sel ec t ed b a sed o n a p r e
d et er m i n ed l o c a t i o n w i t h i n t h e m a t r i x , suc h a s w h en un i f o r m
m a t r i x si Z es a r e used w i t h i n a f r a m e, o r i n o t h er sui t a b l e
m a n n er s. I n a n o t h er ex em p l a r y em b o d i m en t , p i x el sel ec t i o n
c a n b e p er f o r m ed b a sed o n r a n d o m sel ec t i o n , b a sed up o n
p r ed et er m i n ed r ul es r eg a r d i n g sel ec t i o n o f p i x el s, o r i n o t h er
sui t a b l e m a n n er s. Th e m et h o d t h en p r o c eed s t o 5 06 .
At 5 06 t h e m a t r i x a n d p i x el d a t a i s t r a n sm i t t ed . I n o n e
ex em p l a r y em b o d i m en t , t h e m a t r i x a n d p i x el d a t a c a n b e
t r a n sm i t t ed i n p a i r s, suc h t h a t ea c h set o f m a t r i x d e? n i t i o n
d a t a o r l o c a t i o n d a t a i s p a i r ed w i t h c o r r esp o n d i n g p i x el
b r i g h t n ess d a t a . L i k ew i se, m a t r i x d a t a a n d p i x el d a t a c a n b e
20
25
3 0
3 5
4 0
4 5
5 0
5 5
6 0
6 5
8
t r a n sm i t t ed i n seq uen c e, suc h t h a t t h e seq uen c e o f m a t r i x d a t a
i s r ec ei v ed ? r st , a n d t h e seq uen c e o f p i x el d a t a f o r ea c h
c o r r esp o n d i n g m a t r i x i s t h en r ec ei v ed . O t h er sui t a b l e t r a n s
m i ssi o n seq uen c es c a n l i k ew i se b e used . Th e m et h o d t h en
p r o c eed s t o 5 08 .
At 5 08 t h e m a t r i x a n d p i x el d a t a i s a ssem b l ed i n t o a f r a m e.
I n o n e ex em p l a r y em b o d i m en t , t h e f r a m e a ssem b l y c a n b e
p er f o r m ed o n a l i n e-b y-l i n e b a si s, suc h t h a t ea c h l i n e o f d a t a
c a n b e g en er a t ed a s i t i s c r ea t ed . I n a n o t h er ex em p l a r y
em b o d i m en t , a n en t i r e f r a m e o f d a t a c a n b e g en er a t ed p r i o r t o
ut i l i Z a t i o n o f t h e f r a m e o f d a t a . Th e m et h o d t h en p r o c eed s t o
5 1 0.
At 5 1 0 a d i sp l a y i s g en er a t ed usi n g t h e m a t r i x a n d p i x el
d a t a . As p r ev i o usl y d esc r i b ed , t h e d i sp l a y c a n b e g en er a t ed
f r o m a n en t i r e f r a m e d a t a set a f t er i t h a s b een c o m p l et ed .
L i k ew i se, t h e d i sp l a y c a n b e g en er a t ed o n a l i n e-b y-l i n e b a si s,
a ud i o st r ea m s o r g r a p h i c a l d i sp l a ys c a n b e g en er a t ed , o r o t h er
sui t a b l e d i sp l a ys c a n b e g en er a t ed . Th e m et h o d t h en p r o c eed s
t o 5 1 2.
At 5 1 2 i t i s d et er m i n ed w h et h er a f r a m e i s c o m p l et ed . I f t h e
f r a m e i s n o t c o m p l et ed t h e m et h o d r et ur n s t o 5 08 . O t h er w i se
t h e f r a m e i s c o m p l et e, t h e m et h o d p r o c eed s t o 5 1 4 a n d t h e
m et h o d p r o c eed s t o t h e n ex t f r a m e.
F I G . 6 i s a ? o w c h a r t o f a m et h o d 6 00 f o r d et er m i n i n g o r
a ssi g n i n g m a t r i x o r r eg i o n si Z e b a sed o n a n ex em p l a r y
em b o d i m en t o f t h e p r esen t i n v en t i o n . M et h o d 6 00 b eg i n s a t
6 02 w h er e a p i x el v a r i a t i o n i s d et er m i n ed . I n o n e ex em p l a r y
em b o d i m en t , t h e p i x el d a t a v a l ues f o r t w o a d j a c en t p i x el s c a n
b e c o m p a r ed , a n d i t c a n b e d et er m i n ed w h et h er t h e v a r i a t i o n s
b et w een t h e t w o a d j a c en t p i x el d a t a v a l ues ex c eed p r ed et er
m i n ed a l l o w a b l e v a r i a t i o n s. Th e sui t a b l e v a r i a t i o n t ec h n i q ues
c a n b e i m p l em en t ed . Th e m et h o d t h en p r o c eed s t o 6 04 .
At 6 04 i t i s d et er m i n ed w h et h er t h e v a r i a t i o n i s g r ea t er t h a n
a p r ed et er m i n ed t o l er a n c e. I f i t i s d et er m i n ed a t 6 04 t h a t t h e
v a r i a t i o n i s g r ea t er t h a n t h e t o l er a n c e t h e m et h o d p r o c eed s t o
6 06 w h er e t h e m a t r i x si Z e i s a ssi g n ed b a sed o n t h e n um b er o f
p i x el s un d er c o n si d er a t i o n . I n o n e ex em p l a r y em b o d i m en t , i f
a ? r st a n d sec o n d p i x el h a v e b een c o m p a r ed a n d i t i s d et er
m i n ed t h a t t h e v a r i a t i o n b et w een p i x el s ex c eed s t h e t o l er a n c e,
t h en a m a t r i x si Z e o f 1 x 1 ( i . e. , a n i n d i v i d ua l p i x el ) , c a n b e
t r a n sm i t t ed suc h t h a t d a t a t r a n sm i ssi o n i s l o ssl ess. I f i t i s
d et er m i n ed t h a t t h e v a r i a t i o n i s n o t g r ea t er t h a n t h e t o l er a n c e,
t h e m et h o d p r o c eed s t o 6 08 .
At 6 08 , t h e n ex t p i x el i s sel ec t ed . I n o n e ex em p l a r y
em b o d i m en t , t h e n ex t p i x el c a n b e sel ec t ed b a sed up o n a n
N><N m a t r i x si Z e, a n N><M m a t r i x si Z e, a c i r c ul a r r eg i o n si Z e,
a n el l i p t i c a l r eg i o n si Z e, a n a m o r p h o us r eg i o n si Z e, o r o t h er
sui t a b l e r eg i o n s. Th e m et h o d t h en p r o c eed s t o 6 1 0.
At 6 1 0 t h e t o l er a n c e i s m o d i ? ed . I n o n e ex em p l a r y
em b o d i m en t , t h e t o l er a n c e c a n b e m o d i ? ed w i t h ea c h i n c r ea s
i n g r eg i o n si Z e, suc h t h a t sm a l l er t o l er a n c es a r e i m p o sed f o r
l a r g er r eg i o n s. L i k ew i se, a m a x i m um r eg i o n si Z e c a n b e
i m p o sed suc h t h a t t h e t o l er a n c e i s set t o Z er o . L i k ew i se, i f i t i s
d et er m i n ed a t 6 04 t h a t t h e m a x i m um r eg i o n si Z e h a s b een
r ea c h ed , t h e m et h o d c a n p r o c eed d i r ec t l y t o 6 06 . Af t er t h e
t o l er a n c e i s m o d i ? ed a t 6 1 0, t h e m et h o d r et ur n s t o 6 02.
I n o p er a t i o n , m et h o d 6 00 a l l o w s a m a t r i x o r o t h er sui t a b l e
r eg i o n si Z e t o b e d et er m i n ed b a sed up o n p i x el v a r i a t i o n s. I n
o n e ex em p l a r y em b o d i m en t , p i x el v a r i a t i o n c a n b e d et er
m i n ed a t 6 02 o n a f r a m e b a si s, suc h t h a t a ? r st t o l er a n c e i s set
f o r h a v i n g un i f o r m m a t r i c es o f 2x 2 si Z e, a sec o n d t o l er a n c e i s
set f o r h a v i n g un i f o r m m a t r i c es o f a 3 x 3 si Z e, a n d o t h er
sui t a b l e t o l er a n c es c a n b e used . L i k ew i se, t o l er a n c es c a n b e
set a n d r eg i o n s c a n b e d et er m i n ed b a sed o n a r eg i o n -b y
r eg i o n b a si s, suc h t h a t i n a r ea s h a v i n g l o w i n f o r m a t i o n c o n
sen t , t h e m a t r i x si Z e i s i n c r ea sed w h er ea s i n a r ea s h a v i n g h i g h
i n f o r m a t i o n c o n t en t t h e m a t r i x si Z e i s d ec r ea sed . I n o n e
Case 1:14-cv-01029-UNA Document 1-1 Filed 08/09/14 Page 10 of 12 PageID #: 25
US 7 , 9 7 4 , 3 3 9 B2
exemplary embodiment, th e matrix s iz e c an be dec reas ed to
l> < l, s u c h th at in areas h av ing h ig h inf ormation c ontent, th e
data trans mis s ion c an be los s les s , bu t in areas h av ing low
inf ormation c ontent, th e data trans mis s ion c an be los s y.
FIG. 7 is a ?owc h art of a meth od 7 00 f or s elec ting a pixel
with in a reg ion in ac c ordanc e with an exemplary embodiment
of th e pres ent inv ention. Meth od 7 00 beg ins at 7 02 wh ere
matrix or oth er reg ion data is rec eiv ed. In one exemplary
embodiment, th e matrix data c an inc lu de a matrix s iZ e, a
reg ion s iZ e, a reg ion bou ndary f or amorph ou s reg ions , or
oth er s u itable data. Th e meth od th en proc eeds to 7 04 .
At 7 04 , it is determined wh eth er random or s eq u enc ing
s elec tion is being u s ed f or s elec ting th e pixel data. If it is
determined th at s eq u enc ing data is u s ed, th e meth od proc eeds
to 7 06 wh ere th e s eq u enc e data is obtained. In one exemplary
embodiment, s u c h as wh ere a u nif orm matrix s iZ e is u s ed
with in th e f rame, a s eq u enc e of pixels c an be u s ed s u c h th at
th e pixels are s wept ac ros s th e matrix. L ik ewis e, oth er
s u itable s eq u enc e data c an be u s ed. Af ter th e s eq u enc e is
obtained at 7 06 th e meth od proc eeds to 7 08 wh ere a pixel is
s elec ted bas ed on th e s eq u enc e data. Th e pixel data f or th e
matrix is th en s tored.
L ik ewis e, if it is determined at 7 04 th at a random pixel
s elec tion is being u s ed, th e meth od proc eeds to 7 10 wh ere a
random nu mber is g enerated. Th e meth od th en proc eeds to
7 12.
At 7 12 a pixel is s elec ted bas ed on a random nu mber. In one
exemplary embodiment, a random nu mber g enerated
between 0 and 1 c an be mu ltiplied by th e nu mber of pixels
with in th e matrix or reg ion, and a predetermined s eq u enc e
c an be u s ed to s elec t th e pixel. L ik ewis e, th e pixel data v alu es
c an be randomly identi?ed or oth er s u itable random s elec tion
proc es s es c an be u s ed.
In operation, meth od 7 00 allows pixel data with in a matrix
or oth er reg ion to be s elec ted, wh ic h are bas ed on s eq u enc ing ,
random s elec tion, or in oth er s u itable manners . Meth od 7 00
allows pixel data f or optimiZ ed data applic ations to be u s ed,
s u c h as wh ere v ideo data h av ing low inf ormation c ontent and
reg ions of h ig h inf ormation c ontent are being trans mitted or
in oth er s u itable applic ations .
FIG. 8 is a ?owc h art of a meth od 800 f or g enerating opti
miZ ed f rame data in ac c ordanc e with an exemplary embodi
ment of th e pres ent inv ention. Meth od 800 beg ins at 802
wh ere matrix and pixel data are rec eiv ed. In one exemplary
embodiment, th e matrix and pixel data c an inc lu de a s tandard
or u nif orm matrix s iZ e and a s eq u enc e of pixels f or th e f rame.
In anoth er exemplary embodiment, th e matrix and pixel data
c an inc lu de a s eq u enc e of matrix s iZ es th at de?ne a f rame and
a s eq u enc e of pixels f or g eneration with in eac h matrix. In yet
anoth er exemplary embodiment, th e matrix and pixel data c an
be reg ion and pixel data, s u c h as wh ere th e reg ion data de?nes
one or more reg ions with in a f rame and th e pixel data inc lu des
points th at g o with in th at reg ion. O th er s u itable data c an als o
be u s ed, s u c h as au dio data, g raph ic al data, text data, or oth er
s u itable data. Th e meth od th en proc eeds to 802.
At 802 th e matrix and pixel data are c ombined into a f rame.
In one exemplary embodiment, th e f rame c an be g enerated on
a line- by- line bas is , s u c h th at th e matric es are as s embled in
rows and th at th e pixel f or eac h matrix are as s ig ned af ter a row
is c omplete. In th is exemplary embodiment, s u c h as wh ere
matrix s iZ es exc eed 2x2, th en as s embling a row of matric es
c an res u lt in th e as s embly or two or more lines of data, s u c h
as wh ere v ideo data is g enerated by s c anning lines f rom th e
top of a dis play to th e bottom of a dis play. In th is exemplary
embodiment, th e f rame c an be g enerated as eac h line is c om
pleted. Th e meth od th en proc eeds to 804 .
20
25
3 0
3 5
4 0
4 5
50
55
60
65
10
At 804 it is determined wh eth er th e f rame h as been c om
pleted. In one exemplary embodiment, an entire f rame of data
c an be c ons titu ted prior to g eneration of th e f rame. L ik ewis e,
in anoth er exemplary embodiment, th e data c an be g enerated
on a line- by- line bas is , s o th at th e data does not need to be
bu f f ered u ntil a c omplete f rame is g enerated. O th er s u itable
proc es s es c an als o be u s ed. If it is determined at 804 th at th e
f rame is not c omplete, th e meth od retu rns to 800. O th erwis e,
th e meth od proc eeds to 804 and adv anc es to th e next f rame.
In operation, meth od 800 allows f rames of data, s u c h as
v ideo data, au dio data, g raph ic al data, textu al data, or oth er
s u itable data, to be g enerated in an optimiZ ed manner, s u c h
th at los s y, los s les s , or a c ombination of los s y and los s les s data
trans mis s ion is u s ed bas ed u pon th e end u s e of th e data. In th is
exemplary embodiment, u nif orm or non- u nif orm matric es or
reg ions c an be u s ed, s u c h th at only one of two or more points
of data with in a data s et f or eac h reg ion needs to be trans mit
ted.
FIG. 9 is a diag ram 9 00 s h owing an exemplary u nif orm
matrix s eg mentation of an array of pixel data. Eac h matrix of
th e array is of u nif orm s iZ e, s u c h as 4 > < 4 . Th u s , th e matrix s iZ e
data f or th e entire f rame c an be repres ented by a s ing le data
s et.
In th e ?rs t row of matric es , th e loc ation X of a s ing le
pixel of data is identic al ( e. g . ( 2, 2) ) , s u c h as wh ere th e loc a
tion of th e pixel in eac h matrix is bas ed on s eq u ential data. In
th e s ec ond row, th e loc ation of th e pixel in eac h matrix is
dif f erent, s u c h as wh ere th e loc ation of th e pixel in eac h
matrix is random. In th is exemplary embodiment, th e matrix
data c an inc lu de th e s ing le u nif orm s iz e ( eg 4 > < 4 ) , th e pixel
loc ation data c an inc lu de th e loc ation of th e pixel in eac h
matrix ( e. g . ( 2, 2) , random, or th e c oordinates of eac h pixel
s tarting with th e ?rs t matrix and s weeping ac ros s f rom lef t to
rig h t u ntil th e las t matrix in th e las t row is reac h ed ( e. g . ( 4 , 1)
( 1, 4 ) , ( 3 , 2) , ( 3 , 4 ) ) and th e pixel data f or eac h matrix c an
inc lu de th e ( X/ Y / Z ) data, s u c h as wh ere th e pixel is a c olor
pixel. L ik ewis e, oth er s u itable data c an be u s ed.
FIG. 10 is a diag ram 1000 s h owing an exemplary non
u nif orm matrix s eg mentation of an array of pixel data. Eac h
matrix of th e array c an be of dif f erent s iZ e, bu t th e matric es
mu s t f orm th e array wh en c ombined. In eac h matrix, th e
loc ation of th e pixel in eac h matrix is dif f erent, s u c h as wh ere
th e loc ation of th e pixel in eac h matrix is random. In th is
exemplary embodiment, th e matrix data c an inc lu de th e s iZ e
of eac h matrix in s eries , s tarting f rom th e ?rs t matrix and
s weeping ac ros s f rom lef t to rig h t u ntil th e las t matrix is
reac h ed ( e. g . ( 7 x3 ) , ( 5x6) , ( 5x4 ) , ( 7 x7 ) , ( 2x3 ) , ( 2> < 7 ) ) , th e
pixel loc ation data c an inc lu de th e loc ation of th e pixel in eac h
matrix ( e. g . ( 2, 2) , random, or th e c oordinates of eac h pixel
s tarting with th e ?rs t matrix and s weeping ac ros s f rom lef t to
rig h t u ntil th e las t matrix in th e las t row is reac h ed ( e. g . ( 2, 1) ,
( 4 , 4 ) , ( 2, 2) , ( 5, 6) , ( 2, 2) , ( 2, 2) ) , and th e pixel data f or eac h
matrix c an inc lu de th e ( X/ Y / Z ) data, s u c h as wh ere th e pixel
is a c olor pixel. L ik ewis e, oth er s u itable data c an be u s ed.
Alth ou g h exemplary embodiments of a s ys tem and meth od
of th e pres ent inv ention h av e been des c ribed in detail h erein,
th os e s k illed in th e art will als o rec og niZ e th at v ariou s s u b
s titu tions and modi?c ations c an be made to th e s ys tems and
meth ods with ou t departing f rom th e s c ope and s pirit of th e
appended c laims .
Wh at is c laimed is :
1. A s ys tem f or trans mitting data trans mis s ion c ompris ing :
a analys is s ys tem rec eiv ing f rame data and g enerating
reg ion data c ompris ed of h ig h detail and or low detail;
a pixel s elec tion s ys tem rec eiv ing th e reg ion data and g en
erating one s et of pixel data f or eac h reg ion f orming a
new s et of data f or trans mis s ion;
Case 1:14-cv-01029-UNA Document 1-1 Filed 08/09/14 Page 11 of 12 PageID #: 26
US 7 , 9 7 4 , 3 3 9 B2
1 1
a d a t a r e c e i v i n g s y s t e m r e c e i v i n g t h e r e g i o n d a t a a n d t h e
p i x e l d a t a f o r e a c h r e g i o n a n d g e n e r a t i n g a d i s p l a y ;
W h e r e i n t h e d a t a r e c e i v i n g s y s t e m c o m p r i s e s a p i x e l d a t a
s y s t e m r e c e i v i n g m a t r i x d e ? n i t i o n d a t a a n d p i x e l d a t a
a n d g e n e r a t i n g p i x e l l o c a t i o n d a t a ;
W h e r e i n t h e d a t a r e c e i v i n g s y s t e m c o m p r i s e s a d i s p l a y
g e n e r a t i o n s y s t e m r e c e i v i n g p i x e l l o c a t i o n d a t a a n d g e n
e r a t i n g d i s p l a y d a t a t h a t i n c l u d e s t h e p i x e l d a t a p l a c e d
a c c o r d i n g t o t h e l o c a t i o n d a t a .
2. Th e s y s t e m o f c l a i m 1 W h e r e i n t h e f r a m e a n a l y s i s s y s t e m
c o m p r i s e s a m a t r i x s i Z e s y s t e m r e c e i v i n g p i x e l v a r i a t i o n d a t a
a n d g e n e r a t i n g m a t r i x s i Z e d a t a .
3 . Th e s y s t e m o f c l a i m 1 W h e r e i n t h e f r a m e a n a l y s i s s y s t e m
c o m p r i s e s a m a t r i x i d e n t i ? c a t i o n s y s t e m r e c e i v i n g m a t r i x
s i Z e d a t a a n d g e n e r a t i n g m a t r i x i d e n t i ? c a t i o n d a t a .
4 . Th e s y s t e m o f c l a i m 1 W h e r e i n t h e p i x e l s e l e c t i o n s y s t e m
c o m p r i s e s a p i x e l Ra n d o m i Z e r s y s t e m r e c e i v i n g t W o o r m o r e
s e t s o f p i x e l d a t a f o r e a c h r e g i o n a n d r a n d o m l y s e l e c t i n g o n e
o f t h e t W o o r m o r e s e t s o f p i x e l d a t a .
5 . Th e s y s t e m o f c l a i m 1 W h e r e i n t h e p i x e l s e l e c t i o n s y s t e m
c o m p r i s e s a p i x e l s e q u e n c e r s y s t e m r e c e i v i n g t W o o r m o r e
s e t s o f p i x e l d a t a f o r e a c h r e g i o n a n d s e l e c t i n g o n e o f t h e t W o
o r m o r e s e t s o f p i x e l d a t a ba s e d o n s e q u e n c e d a t a .
6 . Th e s y s t e m o f c l a i m 1 W h e r e i n t h e p i x e l s e l e c t i o n s y s t e m
c o m p r i s e s a p i x e l i d e n t i ? c a t i o n s y s t e m g e n e r a t i n g p i x e l l o c a
t i o n d a t a ba s e d o n a l o c a t i o n o f t h e s e t o f p i x e l d a t a a s s o c i a t e d
W i t h e a c h o f t h e r e g i o n s .
7 . A m e t h o d f o r t r a n s m i t t i n g d a t a c o m p r i s i n g :
r e c e i v i n g f r a m e d a t a ;
g e n e r a t i n g o p t i m i Z e d m a t r i x d a t a f r o m t h e f r a m e d a t a ;
s e l e c t i n g o n e o f t W o o r m o r e s e t s o f p i x e l d a t a ba s e d o n t h e
o p t i m i Z e d m a t r i x d a t a ;
W h e r e i n r e c e i v i n g f r a m e d a t a c o m p r i s e s r e c e i v i n g a n a r r a y
o f p i x e l d a t a ;
20
25
3 0
1 2
W h e r e i n g e n e r a t i n g t h e o p t i m i Z e d m a t r i x d a t a f r o m t h e
f r a m e d a t a c o m p r i s e s s e t t i n g a m a t r i x s i Z e ba s e d o n p i x e l
s e l e c t i o n d a t a ;
a n d t r a n s m i t t i n g t h e s e l e c t i o n p i x e l d a t a a n d t h e o p t i m i Z e d
m a t r i x d a t a by a s s e m bl i n g t h e o p t i m i Z e d m a t r i x d a t a a n d
t h e s e l e c t i o n p i x e l d a t a i n t o a g e n e r a t e d d i s p l a y f r a m e .
8 . Th e m e t h o d o f c l a i m 7 W h e r e i n s e l e c t i n g o n e o f t W o o r
m o r e s e t s o f p i x e l d a t a c o m p r i s e s s e l e c t i n g t h e p i x e l f r o m a
m a t r i x o f s e t s o f p i x e l d a t a .
9 . Th e m e t h o d o f c l a i m 7 W h e r e i n t r a n s m i t t i n g t h e p i x e l
d a t a a n d t h e m a t r i x d a t a c o m p r i s e s t r a n s m i t t i n g a n a r r a y o f
p i x e l d a t a a n d u n i f o r m m a t r i x s i Z e d a t a .
1 0. A m e t h o d f o r t r a n s m i t t i n g d a t a c o m p r i s i n g :
d i v i d i n g a n a r r a y o f p i x e l d a t a i n t o t W o o r m o r e r e g i o n s ;
s e l e c t i n g a s e t o f p i x e l d a t a f r o m e a c h r e g i o n ;
W h e r e i n d i v i d i n g t h e a r r a y o f p i x e l d a t a c o m p r i s e s d i v i d i n g
t h e a r r a y o f p i x e l d a t a i n t o t W o o r m o r e m a t r i c e s h a v i n g
a u n i f o r m s i Z e ;
W h e r e i n d i v i d i n g t h e a r r a y o f p i x e l d a t a c o m p r i s e s d i v i d i n g
t h e a r r a y o f p i x e l d a t a i n t o t W o o r m o r e m a t r i c e s h a v i n g
t W o o r m o r e d i f f e r e n t s i Z e s ;
a n d t r a n s m i t t i n g t h e r e g i o n d a t a a n d t h e s e l e c t i o n p i x e l d a t a
f o r e a c h r e g i o n by a s s e m bl i n g t h e r e g i o n d a t a a n d t h e
s e l e c t i o n p i x e l d a t a i n t o a g e n e r a t e d d i s p l a y f r a m e .
1 1 . Th e m e t h o d o f c l a i m 1 0 W h e r e i n s e l e c t i n g t h e s e t o f
p i x e l d a t a f r o m e a c h r e g i o n c o m p r i s e s s e l e c t i n g a r a n d o m s e t
o f p i x e l d a t a .
1 2. Th e m e t h o d o f c l a i m 1 0 W h e r e i n t r a n s m i t t i n g t h e
r e g i o n d a t a a n d t h e p i x e l d a t a f o r e a c h r e g i o n c o m p r i s e s
t r a n s m i t t i n g m a t r i x d a t a a n d t h e p i x e l d a t a f o r e a c h m a t r i x .
1 3 . Th e s y s t e m o f c l a i m 1 W h e r e i n t h e f r a m e a n a l y s i s
s y s t e m c o m p r i s e s a p i x e l v a r i a t i o n s y s t e m r e c e i v i n g t W o o r
m o r e s e t s o f p i x e l d a t a a n d g e n e r a t i n g t h e r e g i o n d a t a ba s e d
o n p i x e l v a r i a t i o n d a t a f r o m t h e t W o o r m o r e s e t s o f p i x e l d a t a .
* * * * *
Case 1:14-cv-01029-UNA Document 1-1 Filed 08/09/14 Page 12 of 12 PageID #: 27
JS 44 (Rev. 12/12)
CIVIL COVER SHEET
The JS 44 civil cover sheet and the inIormation contained herein neither replace nor supplement the Iiling and service oI pleadings or other papers as required by law, except as
provided by local rules oI court. This Iorm, approved by the Judicial ConIerence oI the United States in September 1974, is required Ior the use oI the Clerk oI Court Ior the
purpose oI initiating the civil docket sheet. (SEE INSTRUCTIONS ON NEXT PAGE OF THIS FORM.)
I. (a) PLAINTIFFS DEFENDANTS
(b) County oI Residence oI First Listed PlaintiII County oI Residence oI First Listed DeIendant
(EXCEPT IN U.S. PLAINTIFF CASES) (IN U.S. PLAINTIFF CASES ONLY)
NOTE: IN LAND CONDEMNATION CASES, USE THE LOCATION OF
THE TRACT OF LAND INVOLVED.

(c) Attorneys (Firm Name, Address, and Telephone Number) Attorneys (If Known)
II. BASIS OF JURISDICTION (Place an X in One Box Only) III. CITIZENSHIP OF PRINCIPAL PARTIES (Place an X in One Box for Plaintiff
(For Diversity Cases Only) and One Box for Defendant)
1 U.S. Government 3 Federal Question PTF DEF PTF DEF
PlaintiII (U.S. Government Not a Party) Citizen oI This State 1 1 Incorporated or Principal Place 4 4
oI Business In This State
2 U.S. Government 4 Diversity Citizen oI Another State 2 2 Incorporated and Principal Place 5 5
DeIendant (Indicate Citizenship of Parties in Item III) oI Business In Another State
Citizen or Subject oI a 3 3 Foreign Nation 6 6
Foreign Country
IV. NATURE OF SUIT (Place an X in One Box Only)
CONTRACT TORTS FORFEITURE/PENALTY BANKRUPTCY OTHER STATUTES
110 Insurance PERSONAL INJURY PERSONAL INJURY 625 Drug Related Seizure 422 Appeal 28 USC 158 375 False Claims Act
120 Marine 310 Airplane 365 Personal Injury - oI Property 21 USC 881 423 Withdrawal 400 State Reapportionment
130 Miller Act 315 Airplane Product Product Liability 690 Other 28 USC 157 410 Antitrust
140 Negotiable Instrument Liability 367 Health Care/ 430 Banks and Banking
150 Recovery oI Overpayment 320 Assault, Libel & Pharmaceutical PROPERTY RIGHTS 450 Commerce
& EnIorcement oI Judgment Slander Personal Injury 820 Copyrights 460 Deportation
151 Medicare Act 330 Federal Employers` Product Liability 830 Patent 470 Racketeer InIluenced and
152 Recovery oI DeIaulted Liability 368 Asbestos Personal 840 Trademark Corrupt Organizations
Student Loans 340 Marine Injury Product 480 Consumer Credit
(Excludes Veterans) 345 Marine Product Liability LABOR SOCIAL SECURITY 490 Cable/Sat TV
153 Recovery oI Overpayment Liability PERSONAL PROPERTY 710 Fair Labor Standards 861 HIA (1395II) 850 Securities/Commodities/
oI Veteran`s BeneIits 350 Motor Vehicle 370 Other Fraud Act 862 Black Lung (923) Exchange
160 Stockholders` Suits 355 Motor Vehicle 371 Truth in Lending 720 Labor/Management 863 DIWC/DIWW (405(g)) 890 Other Statutory Actions
190 Other Contract Product Liability 380 Other Personal Relations 864 SSID Title XVI 891 Agricultural Acts
195 Contract Product Liability 360 Other Personal Property Damage 740 Railway Labor Act 865 RSI (405(g)) 893 Environmental Matters
196 Franchise Injury 385 Property Damage 751 Family and Medical 895 Freedom oI InIormation
362 Personal Injury - Product Liability Leave Act Act
Medical Malpractice 790 Other Labor Litigation 896 Arbitration
REAL PROPERTY CIVIL RIGHTS PRISONER PETITIONS 791 Employee Retirement FEDERAL TAX SUITS 899 Administrative Procedure
210 Land Condemnation 440 Other Civil Rights Habeas Corpus: Income Security Act 870 Taxes (U.S. PlaintiII Act/Review or Appeal oI
220 Foreclosure 441 Voting 463 Alien Detainee or DeIendant) Agency Decision
230 Rent Lease & Ejectment 442 Employment 510 Motions to Vacate 871 IRSThird Party 950 Constitutionality oI
240 Torts to Land 443 Housing/ Sentence 26 USC 7609 State Statutes
245 Tort Product Liability Accommodations 530 General
290 All Other Real Property 445 Amer. w/Disabilities - 535 Death Penalty IMMIGRATION
Employment Other: 462 Naturalization Application
446 Amer. w/Disabilities - 540 Mandamus & Other 465 Other Immigration
Other 550 Civil Rights Actions
448 Education 555 Prison Condition
560 Civil Detainee -
Conditions oI
ConIinement
V. ORIGIN (Place an X in One Box Only)
1 Original
Proceeding
2 Removed Irom
State Court
3 Remanded Irom
Appellate Court
4 Reinstated or
Reopened
5 TransIerred Irom
Another District
(specify)
6 Multidistrict
Litigation
VI. CAUSE OF ACTION
Cite the U.S. Civil Statute under which you are Iiling (Do not cite jurisdictional statutes unless diversity):

BrieI description oI cause:
VII. REQUESTED IN
COMPLAINT:
CHECK IF THIS IS A CLASS ACTION
UNDER RULE 23, F.R.Cv.P.
DEMAND $ CHECK YES only iI demanded in complaint:
JURY DEMAND: Yes No
VIII. RELATED CASE(S)
IF ANY
(See instructions):
JUDGE DOCKET NUMBER
DATE SIGNATURE OF ATTORNEY OF RECORD
FOR OFFICE USE ONLY
RECEIPT # AMOUNT APPLYING IFP JUDGE MAG. JUDGE

VEDANTI SYSTEMS LIMITED and MAX SOUND CORPOATION,
London, UK
Geoffrey C. Jarvis, Grant & Eisenhofer P.A., 123 Justison Street,
Wilmington, DE 19801, (302) 622-7000.

GOOGLE, INC., YOUTUBE, LLC, and On2 Technologies, Inc.
Santa Clara County, CA
28 U.S.C. 1331 and 1338(a)
Patent Infringement
08/09/2014 /s/ Geoffrey C. Jarvis
Case 1:14-cv-01029-UNA Document 1-2 Filed 08/09/14 Page 1 of 2 PageID #: 28
x
JS 44 Reverse (Rev. 12/12)
INSTRUCTIONS FOR ATTORNEYS COMPLETING CIVIL COVER SHEET FORM JS 44
Authority For Civil Cover Sheet
The JS 44 civil cover sheet and the inIormation contained herein neither replaces nor supplements the Iilings and service oI pleading or other papers as
required by law, except as provided by local rules oI court. This Iorm, approved by the Judicial ConIerence oI the United States in September 1974, is
required Ior the use oI the Clerk oI Court Ior the purpose oI initiating the civil docket sheet. Consequently, a civil cover sheet is submitted to the Clerk oI
Court Ior each civil complaint Iiled. The attorney Iiling a case should complete the Iorm as Iollows:
I.(a) Plaintiffs-Defendants. Enter names (last, Iirst, middle initial) oI plaintiII and deIendant. II the plaintiII or deIendant is a government agency, use
only the Iull name or standard abbreviations. II the plaintiII or deIendant is an oIIicial within a government agency, identiIy Iirst the agency and
then the oIIicial, giving both name and title.
(b) County of Residence. For each civil case Iiled, except U.S. plaintiII cases, enter the name oI the county where the Iirst listed plaintiII resides at the
time oI Iiling. In U.S. plaintiII cases, enter the name oI the county in which the Iirst listed deIendant resides at the time oI Iiling. (NOTE: In land
condemnation cases, the county oI residence oI the "deIendant" is the location oI the tract oI land involved.)
(c) Attorneys. Enter the Iirm name, address, telephone number, and attorney oI record. II there are several attorneys, list them on an attachment, noting
in this section "(see attachment)".
II. Jurisdiction. The basis oI jurisdiction is set Iorth under Rule 8(a), F.R.Cv.P., which requires that jurisdictions be shown in pleadings. Place an "X"
in one oI the boxes. II there is more than one basis oI jurisdiction, precedence is given in the order shown below.
United States plaintiII. (1) Jurisdiction based on 28 U.S.C. 1345 and 1348. Suits by agencies and oIIicers oI the United States are included here.
United States deIendant. (2) When the plaintiII is suing the United States, its oIIicers or agencies, place an "X" in this box.
Federal question. (3) This reIers to suits under 28 U.S.C. 1331, where jurisdiction arises under the Constitution oI the United States, an amendment
to the Constitution, an act oI Congress or a treaty oI the United States. In cases where the U.S. is a party, the U.S. plaintiII or deIendant code takes
precedence, and box 1 or 2 should be marked.
Diversity oI citizenship. (4) This reIers to suits under 28 U.S.C. 1332, where parties are citizens oI diIIerent states. When Box 4 is checked, the
citizenship oI the diIIerent parties must be checked. (See Section III below; NOTE: federal question actions take precedence over diversity
cases.)
III. Residence (citizenship) of Principal Parties. This section oI the JS 44 is to be completed iI diversity oI citizenship was indicated above. Mark this
section Ior each principal party.
IV. Nature of Suit. Place an "X" in the appropriate box. II the nature oI suit cannot be determined, be sure the cause oI action, in Section VI below, is
suIIicient to enable the deputy clerk or the statistical clerk(s) in the Administrative OIIice to determine the nature oI suit. II the cause Iits more than
one nature oI suit, select the most deIinitive.
V. Origin. Place an "X" in one oI the six boxes.
Original Proceedings. (1) Cases which originate in the United States district courts.
Removed Irom State Court. (2) Proceedings initiated in state courts may be removed to the district courts under Title 28 U.S.C., Section 1441.
When the petition Ior removal is granted, check this box.
Remanded Irom Appellate Court. (3) Check this box Ior cases remanded to the district court Ior Iurther action. Use the date oI remand as the Iiling
date.
Reinstated or Reopened. (4) Check this box Ior cases reinstated or reopened in the district court. Use the reopening date as the Iiling date.
TransIerred Irom Another District. (5) For cases transIerred under Title 28 U.S.C. Section 1404(a). Do not use this Ior within district transIers or
multidistrict litigation transIers.
Multidistrict Litigation. (6) Check this box when a multidistrict case is transIerred into the district under authority oI Title 28 U.S.C. Section 1407.
When this box is checked, do not check (5) above.
VI. Cause of Action. Report the civil statute directly related to the cause oI action and give a brieI description oI the cause. Do not cite jurisdictional
statutes unless diversity. Example: U.S. Civil Statute: 47 USC 553 BrieI Description: Unauthorized reception oI cable service
VII. Requested in Complaint. Class Action. Place an "X" in this box iI you are Iiling a class action under Rule 23, F.R.Cv.P.
Demand. In this space enter the actual dollar amount being demanded or indicate other demand, such as a preliminary injunction.
Jury Demand. Check the appropriate box to indicate whether or not a jury is being demanded.
VIII. Related Cases. This section oI the JS 44 is used to reIerence related pending cases, iI any. II there are related pending cases, insert the docket
numbers and the corresponding judge names Ior such cases.
Date and Attorney Signature. Date and sign the civil cover sheet.
Case 1:14-cv-01029-UNA Document 1-2 Filed 08/09/14 Page 2 of 2 PageID #: 29