WO2014083472A1

WO2014083472A1 - Use of ambience light for removing black bars next to video content displayed on a screen

Info

Publication number: WO2014083472A1
Application number: PCT/IB2013/060153
Authority: WO
Inventors: Femke Walter Marleen DE POORTER; Maarten Marinus Johannes Wilhelmus Van Herpen
Original assignee: Koninklijke Philips N.V.
Priority date: 2012-11-27
Filing date: 2013-11-15
Publication date: 2014-06-05

Abstract

The invention provides a method for projecting video content and ambience light on a remote screen with a cinema system, wherein the cinema system comprises a projector, wherein the video content comprises a plurality of images to be displayed sequentially, wherein the method comprises displaying with the projector the images sequentially on a first part of the remote screen, and displaying with the projector ambience light on a second part of the remote screen, wherein the ambience light is controlled as function of the video content.

Description

Use of ambience light for removing black bars next to video content displayed on a screen

FIELD OF THE INVENTION

The invention relates to a method for projecting video content (on a remote screen) in combination with the use of ambience lighting. The invention also relates to a cinema system, a media server, and a projector that can be used in such method. The invention further relates to a method to remove so-called "Cinemascope" strips (black bars).

BACKGROUND OF THE INVENTION

In the art, a device is known that is designed to project images in a projection mode or to illuminate a room in an illumination mode, as desired. The change between the projection mode and the illumination mode is accomplished by means of pairs of mirrors comprising two mirrors, with one mirror in each pair of mirrors of this kind being arranged to be hingeable. In the illumination mode, the hingeable mirrors are pivoted out of the beam path of the light, and beams of light of the three primary colors red, green and blue are beamed out by means of the rest of the mirrors, at different intensities depending on the control exerted. The illumination of a room that is modulated as desired is only obtainable as an alternative to the image projection and not simultaneously with the latter, which is a disadvantage. However, US-2006/126028 proposes a device for projecting images, in which device specific illumination can be obtained in the room simultaneously with the projection or reproduction of images, of a video film. In addition, US-2006/126028 also describes to provide a technique by which the so-called "Cinemascope" strips (the strips that appear at the top or bottom edge of the image when video films that have an aspect ratio of 9: 16 are reproduced in a 3:4 format) can be reduced or totally avoided in the reproduction of the images, the space that is thereby gained in the image format being used for other purposes. US-2006/126028 describes a device for projecting images onto a projection surface, having an electro-optical arrangement for generating and emitting light on the basis of image data, and having an optical system for directing the light onto the projection surface, which optical system has a movable redirecting mechanism for the light, which redirecting mechanism includes a redirecting part for the image projection and a separate light transmitting part for selective ambience light projection. SUMMARY OF THE INVENTION

Ambilight, which is short for Ambient Lighting Technology, is a feature invented by Philips, generating lighting effects around the TV that correspond to the video content. Ambilight may have the advantages of a larger virtual screen, a more immersive viewing experience, and it may reduce viewer eye strain.

The concepts, as well as various methods of calculating the color from the video signal, are described in for instance US-2006/062424, WO-2006/003600, and WO- 2006/003624, which are herein incorporated by reference.

The creation of ambience light in for instance cinemas is known in the art.

WO-2011/073877, incorporated herein by reference, for instance, describes a method for providing an ambience lighting effect in a cinema comprising a cinema display screen arranged on a front wall of the cinema and a plurality of light sources, comprising receiving first and second image content to be sequentially displayed on the cinema display screen, determining at least one of a color and intensity for the second image content, determining a second set of control data for controlling the plurality of light sources to emit an ambient lighting effect based on at least one of the color and intensity for the second image content, and associating the second set of control data with the first set of image content. Advantages of the method of WO-2011/073877 include the possibility to provide an improved ambient lighting experience by using the "extra space" specifically available in a cinema, e.g. walls, floor and ceiling. Note that in WO-2011/073877, ambience lighting is generated by light sources that are not necessarily behind or directly adjacent to the screen (on a front wall), but may be arranged remote, such on side walls, or comprised by the ceiling or the floor.

Herein, the concept of Ambient light or Ambilight is further indicated as ambience light or ambience lighting. Note that ambience light may be based on the content of a video image displayed on the screen, but may also be based on the video content of a plurality of video images, of which one or more may be preceding a current video image and/or one or more may be subsequent to a current video image. Especially the color, and optionally also the intensity, of the ambience light is related to a dominant color of at least part of the image (or plurality of images).

As e.g. indicated in e.g. WO-2006/003624 and WO-2006/003600, a method may be applied for dominant color extraction from video content (i.e. one (or more consecutive) image(s)) encoded in a rendered color space to produce, using perceptual rules, a dominant color for emulation by the ambient light source. This ambient light source in the present context comprises at least the projector (though additional ambience light sources may also be applied).

Especially, this may include a method for dominant color extraction from video content encoded in a rendered color space (e.g. YUV, YCrCb, RGB) to produce, using perceptual rules, a dominant color for emulation by an ambient light source, comprising: (1) performing dominant color extraction from pixel chromaticities from said video content in said rendered color space to produce a dominant color by extracting any of: (a) a mode of said pixel chromaticities; (b) a median of said pixel chromaticities; (c) a weighted average by chromaticity of said pixel chromaticities; (d) a weighted average of said pixel chromaticities using a pixel weighting function that is a function of any of pixel position (i, j), chromaticity (x,y,R), and luminance; (2) further deriving the chromaticity of said dominant color in accordance with a perceptual rule, said perceptual rule chosen from any of: (a) a simple chromaticity transform; (b) a weighted average using said pixel weighting function so further formulated as to exhibit an influence from scene content that is obtained by assessing any of chromaticity and luminance for a plurality of pixels in said video content; (c) an extended dominant color extraction using a weighted average where said pixel weighting function is formulated as a function of scene content that is obtained by assessing any of chromaticity and luminance for a plurality of pixels in said video content, with said pixel weighting function further formulated such that weighting is at least reduced for majority pixels; and (3) transforming said dominant color from said rendered color space to a second rendered color space (R'G'B') so formed as to allow driving said ambient light source.

In yet another embodiment, this may involve a method for dominant color extraction from video content encoded in a rendered color space (RGB) to produce, using perceptual rules in accordance with a user preference, a dominant color for emulation by an ambient light source, comprising: (1) performing dominant color extraction from pixel chromaticities from said video content in said rendered color space to produce a dominant color by extracting any of: (a) a mode of said pixel chromaticities; (b) a median of said pixel chromaticities; (c) a weighted average by chromaticity of said pixel chromaticities; (d) a weighted average of said pixel chromaticities using a pixel weighting function that is a function of any of pixel position ((iota), j), chromaticity (x, y, R), and luminance; (2) further deriving at least one of the luminance, the chromaticity, a temporal delivery, and a spatial extraction of said dominant color in accordance with respective perceptual rules to produce a preferred ambient broadcast, and where said respective perceptual rules are varied in character an d effect by at least one of a plurality of possible explicit indicated user preferences; and where said respective perceptual rules comprise at least one of: (I) a luminance perceptual rule chosen from any of: (a) a luminance increase; (b) a luminance decrease; (c) a luminance floor; and (4) a luminance ceiling; (5) a suppressive luminance threshold; (6) a luminance transform; (II) a chromaticity perceptual rule chosen from at least one of: (a) a simple chromaticity transform; (b) a weighted average using said pixel weighting function so further formulated as to exhibit an influence from scene content that is obtained by assessing any of chromaticity and luminance for a plurality of pixels in said video content; (c) an extended dominant col or extraction using a weighted average where said pixel weighting function is formulated as a function of scene content that is obtained by assessing any of chromaticity and luminance for a plurality of pixels in said video content, with said pixel weighting function further formulated such that weighting is at least reduced for majority pixels; (III) a temporal delivery perceptual rule chosen from at least one of: (a) a decrease in the rate of change in at least one of luminance and chromaticity of said dominant color; (b) an increase in the rate of change in at least one of luminance and chromaticity of said dominant color; (IV) a spatial extraction perceptual rule chosen from at least one of: (a) giving greater weight in said pixel weighting function to scene content containing newly appearing features; (b) giving lesser weight in said pixel weighting function to scene content containing newly appearing features; (c) giving greater weight in said pixel weighting function to scene content from a selected extraction region; and (d) giving lesser weight in said pixel weighting function to scene content from a selected extraction region; and (3)

Transforming the luminance and chromaticity of said preferred ambient broadcast from said rendered color space to a second rendered color space (R'G'B') so formed as to allow driving said ambient light source.

The term "rendered color space" may especially denote an image or color space captured from a sensor, or specific to a source or display device, which is device and image specific. Most RGB color spaces are rendered image spaces, including the video spaces used to drive video display. Herein, both the color spaces specific to the video display and the ambient light source may be rendered color spaces. Most LED light sources will use RGB color space, because a LED luminaire typically comprises a red, green and blue LED. The term "scene brightness" especially refers to any measure of luminance in scene content according to any desire criterion. The term "scene content" or "image content" may especially refer to that characteristic of video information capable of forming a viewable image that can be used to influence a desired choice of dominant color. Examples include white clouds, or darkness throughout much of a video image, which might cause certain pixels making such an image to be deemed majority pixels, or might result in non -isotropic treatment of pixels in a pixel weighting function; or might cause an image feature to be detected and subject to special or extended dominant color extraction. The term "simple chromaticity transform" may especially refer to a change or derivation of a dominant color or chromaticity according to a perceptual rule, not chosen or derived as a function of scene content, and where the change or derivation results in a chromaticity which is different from that which might otherwise be chosen. An example: a transform of a first dominant color (x, y) chosen via dominant color extraction (e.g., purple) to a second color (χ', y') in order to satisfy a perceptual rule. Further, the phrase "transforming color information to an unrendered color space" herein may especially comprise either direct transformation to the unrendered color space, or use or benefit derived from using inversion of a tristimulus primary matrix obtained by transforming to the unrendered color space, or any calculational equivalent. The term "unrendered color space" may especially denote a standard or non - device-specific color space, such as those describing original image colorimetry using standard CIE XYZ; ISO RGB, such as defined in ISO 17321 standards; Photo YCC; and the CIE LAB color space.

Ambience light may differ in intensity and/or color for instance as function from the distance to the screen. By way of example, when dividing a (projected) video image in four parts, the dominant color from each part may be extracted and be used as color for ambience light that is provided adjacent to the (projected) video image and adjacent to the respective (projected) video image part. The term "adjacent" may be understood in one embodiment as practically no distance between the (projected) video image part and the ambience light adjacent to the (projected) video image part. However, the ambience light may also be provided more remote from the (projected) video image, such as for instance may be the case in WO-2011/073877.

A problem for cinemas is that when Flat content is displayed on a Scope screen, black bars will appear on the left and right edge of the screen. Similarly, when Scope content is displayed on a Flat screen, black bars will appear on the bottom and top of the screen. However, also other formats may cause similar problems when they are not displayed on a screen that exactly matches the dimensions of the content. These black bars are not appreciated by viewers, and they do not use the screen and projector to its full capacity. Such bars are in the art sometimes also indicated as pillar boxing (black bars at the sides) and letterboxing (black bars on the top and bottom). Herein, the term "black bar" especially relates to a part of the screen that is not illuminated with the image, and (thus) substantially does not receive light from the projector.

The creation of ambience light in for instance cinemas is known in the art (see above with respect to WO-2011/073877).

When the cinema screen is combined with a cinema Ambilight system, the problem of the bars may become even worse, because the black bar may create a large distance between the ambilight effect and the movie content. When this distance becomes too large, the ambilight effect loses part of its beneficial effects and/or is less appreciated by the viewers.

Hence, it is an aspect of the invention to provide an alternative method to project the video content on a remote screen in combination with the use of ambience lighting.

In an embodiment, the solution proposed here is to project an ambilight effect on the screen where normally black bars would appear. To the human eye it will appears if the screen is fully used. This ambience light is not (substantially) provided by external light sources, e.g. adjacent to the screen or providing light adjacent to the screen, but is provided by the (same) projector(s) (that provide the image on the screen). The black bars may advantageously substantially be removed by the present invention.

Hence, in a first aspect, the invention provides a method for projecting video content and ambience light on a remote screen (herein often also indicated as "screen") with a cinema system, wherein the cinema system comprises a projector, wherein the video content comprises a plurality of images (in the art also indicated as "frames") to be displayed sequentially (on the remote screen), wherein the method comprises displaying with the projector the images sequentially on a first part of the remote screen, and displaying with the projector ambience light on a second part of the remote screen, wherein the ambience light is controlled as function of the video content.

In this way, advantageously ambience light from a projector (i.e. ambience light generated by the projector) may be used for replacing at least part of a black bar on a screen next to images of a movie, wherein the ambience light is projected on the screen by the projector together with the images of the movie. Hence, advantageously, the same projector that provides the video content on the remote screen also provides the ambience light on the remote screen. This is especially indicated with the phrase "displaying with the projector the images sequentially on a first part of the remote screen, and displaying with the projector ambience light on a second part of the remote screen". The term "next" herein may refer to one or more of "above", "below", "left" and "right". Further, the fact that the cinema system is used to provide the ambience light on the remote screen does not exclude the cinema system also being configured to provide ambience light next to the video content on the remote screen or next to the remote screen. Hence, the ambience light generated by the projector, may in an embodiment extend beyond the screen.

The screen may especially comprise a projection screen, such as especially a (white) area, on which a movie can be projected (with a projector (remote from the screen)), such as a cinema screen. The screen can be a rigid wall-mounted screen, a pull-down screen, an electric screen (with an electric motor to position the screen to a use and non-use position), a switchable projection screen (can be opaque and clear), or (even) a mobile screen. The term "screen" may also relate to a plurality of screens. Hence, the term screen may also relate to an aggregate screen, i.e. an arrangement of screens that are used as one screen to project the image(s) on with the projector.

The term "video content" refers to an image, especially to a plurality of images which are to be displayed sequentially (consecutively) on the screen. Hence, the term video content may refer to the content of a movie ("motion pictures") that is to be displayed on a (remote) screen. In this way, moving images can be projected on the (remote) screen.

The invention may especially be used when the format (or aspect ratio) of the video content is not compatible with the screen format (or aspect ratio). Hence, in an embodiment the video content has a first movie format for a first type of screen format and the remote screen has a second type of screen format unequal to the first type of screen format, such that when displaying the image(s) on the remote screen this would lead to a second part on the remote screen not being covered by the projected image(s), wherein the method comprises displaying with the projector ambience light on the second part of the remote screen.

The two most common projector film formats are "Cinemascope" (also simply referred to as "Scope"), which generally refers to any 2.35: 1, 2.39: 1, or 2.40: 1 format, and "Flat", which generally relates to a 1.85: 1 format. The problem of the appearance of black bars especially arises when a film in a Scope format is projected on a screen that basically facilitates Flat film formats, and the other way around. As indicated above, when Flat content is displayed on a Scope screen, black bars may appear on the left and right edge of the screen. Similarly, when Scope content is played on a Flat screen, black bars may appear on the bottom and top of the screen. Hence, in an embodiment the video content is configured for a flat film format or a cinema scope format, whereas the remote screen is configured for a cinema scope format or flat film format, respectively. Therefore, in an embodiment, the second part comprises two bars above and below the images or at the right and left sides of the images. Hence, especially the terms "second part" may also relate to a plurality of second parts, such as two bars at both sides or above and below the projected image. The plurality of second parts may be different parts of the screen, remote from each other. Note that the terms "first part" and "second part" especially relate to parts of one and the same screen (or aggregate screen), which are distinguished as "first" and "second", as the former is used to project the image(s) on and the latter is used to provide (or "project") the ambience on.

Actually, these different parts may only distinguishable during operation of the method: under such conditions, the part of the remote screen that is occupied by the image(s) is perceivable, and the non-image part, the second part, is also visible.

During the act of projecting the video content on the screen, a substantial part of the screen may contain the image on the first part (of the screen) and the ambience light on the second part (of the screen). For instance, the first part and the second part together include at least 80 %, such as at least 90 %, especially at least 95 % of the area of the screen, especially of a cinema scope format or a flat film format screen. As mentioned above, the term part may also relate to a plurality of parts.

It may however be desired to mark on the screen the difference between the image(s) and the ambience light. For instance, a strip between the image and the ambience light that is (substantially) not illuminated by the projector may assist the viewer in perceiving in a good way the image in the context of the ambience light. Hence, in an embodiment the method comprises displaying with the projector images on the first part of the remote screen, and displaying with the projector ambience light on the second part of the remote screen, while maintaining between the first part and the second part a black part (an "intermediate part"). The term "black part" and similar terms may thus especially relate to that part (or parts) of the remote screen that during display of the video content is

substantially not illuminated by the projector.

Instead of a black part, also a colored part may be chosen, wherein the color is chosen in such a way, that it clearly distinguishes between the first and the second part. Note that the color(s) may vary over the length of the intermediate part. Therefore, in an alternative embodiment the method and projector may include displaying with the projector images on the first part of the remote screen, and displaying with the projector ambience light on the second part of the remote screen, while projecting between the first part and the second part a colored part (an "intermediate part"), which has a color that is at least (clearly) different from an adjacent image part and optionally also (clearly) different from (the ambience light of) an adjacent second part that is provided with ambience light. Hence, in a specific embodiment the dominant wavelengths of two adjacent parts of the image and the intermediate part are different, and especially also the dominant wavelength of two adjacent parts of the second part and the intermediate part are different. Especially, the dominant wavelength differences between two adjacent parts is in the range of at least 20 nm, such as at least 25 nm, like at least 30 nm, such as at least 50 nm, for example depending on the size of the screen. In color science, the dominant wavelength is a way of describing non-spectral (polychromatic) light mixtures in terms of the spectral (monochromatic) light that would evoke an identical perception of hue. On the CIE color coordinate space, a straight line drawn between the point for a given color and the point for the color of the illuminant can be extrapolated out so that it intersects the perimeter of the space in two points. The point of intersection nearer to the color in question reveals the dominant wavelength of the color as the wavelength of the pure spectral color at that intersection point. The point of intersection on the opposite side of the color space gives the complementary wavelength, which when added to the color in question in the right proportion will yield the color of the illuminant (since the illuminant point necessarily sits between these points on a straight line in CIE space, according to the definition just given).

As indicated above, the ambience light is controlled as function of the video content. This especially implies that one or more of the color of the ambiance light and the intensity of the ambiance light is controlled as function of the video content, i.e. especially of the image displayed (and optionally of one or more preceding and/or one or more subsequent images). Hence, in an embodiment the ambience light comprises one or more colors determined on one or more average colors of one or more sub-sections of an image. In yet a further embodiment, the ambience light comprises one or more colors determined on one or more average colors of one or more sub-sections of a plurality of subsequent images.

The advantages of the invention can be provided in different ways. For instance, the projector may be designed to replace at least part of the black bar(s) (if any) by the ambience light. Alternatively or additionally, a media server may be used that is designed to replace at least part of the black bar(s) (if any) by the ambience light.

Hence, in an embodiment the projector is configured to amend the video content to be displayed, which video content would when projected on the remote screen in unamended state lead to a black second part on the remote screen, by introducing ambience lighting content (wherein the ambience lighting content is controlled (by the projector) as function of the video content).

Alternatively or additionally, the cinema system comprises a media server, wherein the media server is configured to amend the video content to be displayed, which video content would when projected on the remote screen in unamended state lead to a black second part on the remote screen, by introducing ambience lighting content (wherein the ambience lighting content is controlled (by the media server) as function of the video content). The phrases "designed to replace at least part of the black bar(s) (if any) by the ambience light" or "configured to amend the video content to be displayed, which video content would when projected on the remote screen in unamended state lead to a black second part on the remote screen, by introducing ambience lighting content" and similar phrases may for instance relate to embodiments wherein the indicated device comprises a processor that is able to modify input video content into output video content (i.e. the content that is displayed (by a projector)) in such a way that when the image(s) are displayed on the remote screen, potential black bar(s) are at least partially replaced by ambience light

(provided by the projector). Or, such device, or a processor (or controller) comprised by such device, is able to modify input video content into output video content (i.e. the content that is displayed (by a projector)) in such a way that when the image(s) are displayed on the remote screen, the screen is substantially divided in two parts, a first part displaying the image(s) and a second part being used to display ambience light. The term "amending" may relate to altering or replacing, but may also relate to adding. For instance, an image, as input video content, may be transformed, e.g. by a processor to the same image with ambience lighting content added to one or more sides of the image, thereby providing output video content, that is displayed on the remote screen as image and the ambience lighting. The term "ambience lighting content" especially refers to that content that is displayed by the projector that leads to the ambience lighting on the remote screen. In general, this will be a low-resolution distribution of colors (as known in the present TV Ambilight).

Herein, the term "media server", which may also be indicated as "cinema server", may be defined as a dedicated computer appliance or to a specialized application software, for storing various digital media (meaning digital videos/movies, audio/music, and picture files). The cinema server has a data container with the movie file, and/or it has a satellite connection to receive the movie content. It can often decrypt, decompress and encrypt the movie, before it is sent to the projector. It is often combined with a theatre management system. A cinema server is a server that receives movie data, especially from an external provider; the cinema server may handle content security (like decryption with a key code, watermarking) and may decompress the content, which may then sent to a digital cinema projector using link-encrypted data exchange.

As will further elucidated below, the cinema system may (substantially only) comprise a projector, or (substantially only) comprise a media server, but usually comprises both the projector and the media server. In addition, the cinema system may further comprise one or more of a theatre management system (control of one or more of curtains, lights, etc.), an audio cinema processer. The cinema system may also include one or more of lights, an amplifier and speakers. A media server may be configured to serve one or more different projectors (in different display spaces). In general, the cinema system may thus be a system comprising a plurality of units, e.g. a kit of parts, wherein a media server (or another controller) may be functionally connected to a display device and an (additional) ambience light source.

In addition to the ambience light generated by the cinema system, a display space may further comprise one or more light sources that are configured to generate ambience light, but not especially on the remote screen, or more especially which are configured to not substantially generate ambience light on the remote screen, but on one or more parts of a wall, a ceiling and a floor. Hence, in an embodiment, the cinema system further controls (or is configured to control) an additional ambience light source configured to provide ambience light in a display space wherein also the remote screen is arranged, wherein said additional ambience light source is configured to provide ambience light at a display space part of one or more of a wall, a ceiling and a floor, wherein the display space part does not coincide with the remote screen. Such additional ambience light sources are e.g. described in WO-2011/073877, which is incorporated herein by reference. Ambience light sources may e.g. wall washers, and/or may be integrated in walls and/or in wall coverings, and/or in ceiling coverings, and/or in floor coverings. Note that the ambience light source is configured to provide ambiance light at this display space part. This does not exclude that some light might nevertheless imping on the screen, but the light source may not be configured to do so. Herein, the term "display space" may refer to a cinema, a music hall, a theater, an opera house, a stadium, an arena, a conference room, a home, a hospitality area (such as a restaurant, like a restaurant lobby, a pub, etc.) a church, an exhibition ground, and an open square.

In a further aspect, the invention also provides a cinema system per se, especially a cinema system comprising a media server and a projector. Hence, in an embodiment the invention provides such cinema system especially comprising a media server and a projector, wherein the media server is configured to retrieve video content (from a video content source), wherein the video content comprises a plurality of images to be displayed sequentially, wherein the projector is configured to display the images on a first part of a remote screen, and wherein the cinema system is further configured to project ambience light on a second part of the remote screen, wherein the ambience light is controlled as function of the video content. In a specific embodiment (see also above), the projector is configured to amend the video content to be displayed, which video content would when projected on the remote screen in unamended state lead to a black second part on the remote screen, by introducing ambience lighting content (wherein the ambience lighting content is controlled (by the projector) as function of the video content).

Additionally or alternatively, the media server is configured to amend the video content to be displayed, which video content would when projected on the remote screen in unamended state lead to a black second part on the remote screen, by introducing ambience lighting content (wherein the ambience lighting content is controlled (by the media server) as function of the video content). The term "video content source" may in an embodiment relate to a data carrier, such as a hard drive, containing such video content, or can for example relate to a satellite connection providing streaming video content. The term "video content source" may also relate to a (secure(d)) source of this video content. As known from the art, presently, encrypted content is delivered to cinemas on a hard drive. A separate key is supplied to the cinema, which is used to decrypt the content on a digital media server. Next, the digital media server decompresses the video content (for example it may be compressed with MPEG2 or JPEG2000). However, before sending the decompressed content to the projector it is encrypted again for a so-called "link encryption", which protects the communication between the digital media server and the projector (for example with High- bandwidth Digital Content Protection).

As indicated above, the cinema system may also control a (separate) additional ambience light source. Hence, in an embodiment, the cinema system further comprises an additional ambience light source configured to provide ambience light in a display space wherein also the remote screen is arranged, wherein said additional ambience light source is configured to provide ambience light at a display space part of one or more of a wall, a ceiling and a floor, wherein the display space part does not coincide with the remote screen, and wherein the cinema system is further configured to control the ambience light of the additional ambience light source. As indicated also below, the term "additional ambience light source" may also relate to a plurality of additional ambience light sources.

However, the invention (thus) also provides a media server, comprising a controller, wherein the media server is configured to retrieve video content (from a video content source), wherein the video content comprises a plurality of images to be displayed sequentially with a projector on a first part of a remote screen, and wherein the controller is further configured to project with said projector ambience light on a second part of the remote screen, wherein the ambience light is controlled as function of the video content. Especially, such media server may further comprise a communication facility configured to allow the media server communicate with an external controller configured to control an additional ambience light source. Such communication facility may be a physical (data) output like a port, such as an USB port. In this way, the cinema system may control the projector, including the generation of ambience light thereby on the remote screen, and the external light source (i.e. the additional ambience light source), either directly or via an external controller of (of the additional ambience light source).

The invention (thus) also provides a projector, comprising a controller, wherein the projector is configured to display video content provided by a media server, wherein the video content comprises a plurality of images to be displayed sequentially on a first part of a remote screen, wherein the controller is configured to amend the video content to be displayed, which video content would when projected on the remote screen in unamended state lead to a black second part on the remote screen, by introducing ambience lighting content, wherein the ambience lighting content is controlled (by the controller) as function of the video content. Especially, such projector may further comprise a

communication facility configured to allow the projector communicate with an external controller configured to control an additional ambience light source. Such communication facility may be a physical (data) output like a port, such as an USB port. In this way, the projector may control the external light source (i.e. the additional ambience light source), either directly or via an external controller of (of the additional ambience light source).

The term "projector" may also relate to a plurality of projectors. The term "additional ambience light source" may also relate to a plurality of ambience light sources. This term may especially relate to a ambience lighting system comprising a plurality of ambience light sources (that may be arranged at a plurality of locations in the display space).

Instead of, or additional to, using e.g. an output data port on the projector or server, also a color (and intensity sensor) can be applied, which is used to monitor the ambience lighting color that is projected on the screen. The additional ambience light source(s) can then copy the color closest to the location of the screen. In an embodiment, one or more sensors could be placed remotely from the screen. For instance, one or more sensors may be integrated in the projector. However, one or more sensors may also be arranged behind the (remote) screen. In one embodiment one or more additional ambience light source(s) are connected to one or more sensor(s), wherein the one or more sensor(s) are placed behind the screen, especially at the closest location near the one or more light source(s). The light source then copies exactly the color/intensity that is measured with the one or more sensor(s). In this way, couples of one or more sensors and one or more additional ambience light sources may be applied, wherein in general an additional ambience light source is associated with the sensor that is closest to said ambience light source.

As will be clear to a person skilled in the art, especially the ambience light herein comprises light having a wavelength in the visible part of the spectrum. The terms "visible" light or "visible emission" refer to light having a wavelength in the range of about 380 nm to 750 nm. Especially at least 50 %, even more especially at least 80 %, yet even more especially at least 90 % of the light intensity (in Watt) of the ambience light source is in the visible part of the spectrum.

The term "substantially" herein, such as in "substantially all emission" or in "substantially consists", will be understood by the person skilled in the art. The term

"substantially" may also include embodiments with "entirely", "completely", "all", etc.

Hence, in embodiments the adjective substantially may also be removed. Where applicable, the term "substantially" may also relate to 90 % or higher, such as 95 % or higher, especially 99 % or higher, even more especially 99.5 % or higher, including 100 %. The term

"comprise" includes also embodiments wherein the term "comprises" means "consists of.

Furthermore, the terms first, second, third and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances and that the embodiments of the invention described herein are capable of operation in other sequences than described or illustrated herein.

The devices herein are amongst others described during operation. As will be clear to the person skilled in the art, the invention is not limited to methods of operation or devices in operation. It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. Use of the verb "to comprise" and its conjugations does not exclude the presence of elements or steps other than those stated in a claim. The article "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

The invention further applies to a device comprising one or more of the characterizing features described in the description and/or shown in the attached drawings. The invention further pertains to a method or process comprising one or more of the characterising features described in the description and/or shown in the attached drawings.

The various aspects discussed in this patent can be combined in order to provide additional advantages. Furthermore, some of the features can form the basis for one or more divisional applications.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the invention will now be described, by way of example only, with reference to the accompanying schematic drawings in which corresponding reference symbols indicate corresponding parts, and in which:

Figs, la to lc schematically depicts some aspects of video content and how it can be displayed on a screen;

Figs. 2a to 2b schematically depict some embodiments in a display setting, such as in a cinema;

Figs. 3a to 3e schematically depict some aspects of embodiments of the cinema system;

Fig. 4 schematically depicts some aspects of ambience light.

The drawings are not necessarily on scale. DETAILED DESCRIPTION OF THE EMBODIMENTS

Figs, la to lb schematically depicts some aspects of video content and how it can be displayed on a screen. Fig. la schematically depicts a film 100. This film 100 contains video content 101, which comprises a plurality of images 102. This figure shows by way of example a video film to illustrate the different frame, but the film 100 is typically a digital file which contains the frames. By displaying these images consecutively, moving images are displayed. By way of example, a bar is shown, that tilts to the right, assuming 102" being the first image, 102' being the second image, and 102" ' being the third image being displayed on a screen.

Fig. lb schematically depicts the image 102' on a screen 201. This screen 201 is a remote screen, see below. By way of example, the images 102 have the cinema scope format, whereas the screen 201 has a flat format. This leads in general, when the invention is not applied as in the prior art, to black bars above and under the displayed image 102. The displayed image is indicated as projected image 1102. The part of the screen 201 displaying the image is indicated as first part 11. The rest of the screen 201 can be indicated as second part 12. The second part 12 consists essentially of two black bars in prior art situations. However, in the invention this/these can be replaced by ambience light (see below).

Fig. lc schematically depicts an embodiment wherein the black bars in the second region are replaced by ambience lighting, but a (narrow) black bar is maintained in between. The intermediate part is indicated with reference 17. Instead of a (narrow) black bar (as intermediate part 17), also a colored bar may be chosen, but black is preferred. Note that the video content from film, i.e. the image(s) (see fig. la), which is input video content, has been amended in such a way that these image(s) is (are) displayed but also ambience lighting is displayed. Hence, ambience lighting content and video content is displayed. Therefore, the output video content, which is displayed on the screen, includes the image(s) and the ambience lighting content.

Figs, lb and lc schematically depict embodiments wherein scope content is displayed on a flat content screen. However, equally, this problem arises when the pictures are flat content shown on a scope screen, so black bars appear on the sides. As indicated above, this may also apply to other types of formats of video content and non-compatible screens, and may also be solved with this invention.

The ambience lighting (content) may vary from image (frame) to image (frame). The ambience lighting (content) is controlled as function of the video content. The ambience light (content) comprises one or more colors determined on one or more average colors of one or more sub-sections of a plurality of subsequent images.

Referring again to fig. la, the displayed ambience light (content) related to image 102', may solely based on the video content of image 102', but may also be based on the video content of an earlier image 102" and/or a later image 102"'. Basing the ambience light on more frames is advantageous, because more information is used to determine the ambience light. Figs, lc schematically depicts image 102' (after it was amended).

Fig. 2a schematically depicts (in side view or cross-sectional view) an embodiment of a display situation. Reference 200 indicates a display space, such as cinema. Reference 230 indicates a projector, which projects an image 102 on the remote screen 201. The beam containing the image(s) information is indicated with reference 231. The projected image (i.e. the projection of image 102) is again indicated with reference 1102. The projected image 1102 is displayed on the first part 11 of the screen. The projector 230 further provides ambience light, with a beam of ambience light 232. Again, this may be multiple beams or multiple parts of the projection beam. The entire projection beam is indicated with reference 234. The beam 232 with ambience light provides ambience light at the second part 12.

Hence, instead of one or two black bars (see fig. lb), this second part 12 may at least partly (see fig. lc), or entirely, be provided with light: ambience light that has a relation to the content of the image displayed. If desired, the beam 232 with ambience light may extend beyond the second part 12. This is indicated with beam 235, which is an optional extension of the ambience light (beam). Reference 600 indicates a cinema system, here comprising projector 230, with it specific ability to provide ambience light 232 on the screen. The cinema system may additionally or alternatively also comprise other items, see also below.

Fig. 2b schematically depicts a top view of an alternative embodiment. Here, potential black bars at the sides of the image 102 are removed. Further, the display space 200 may optionally comprise one or more additional ambience light sources. The additional ambience light source(s) are especially configured to provide ambience light at a display space part of one or more of a wall, a ceiling and a floor, wherein the display space part (preferably) does not coincide with the remote screen 201. For instance, wall washers may be applied. Note that nevertheless, in embodiments, part of the ambience light of the additional ambience light sources may impinge on the remote screen 201.

Figs. 3a to 3e schematically depict some aspects of embodiments of the cinema system. The cinema system is indicated with reference 600. In fig. 3a, an embodiment is schematically displayed, wherein the cinema system 600 comprises the projector 230. This projector 230 may have an input port 237. This may be a physical port for a plug, or a receiver for a wireless signal. In general, this will be a physical port, such as a USB port or HDMI port, etc. Fig. 3b schematically depicts an embodiment of the cinema system 600 comprising a media server 500. This media server 500 may comprise a data input port 501, a video data output port 502 (for a projector), and an audio output port 504 for an audio device. These ports may be physical ports for a plug, or a receiver for a wireless signal. In general, these will be physical ports, such as a USB port or HDMI port, etc.

Fig. 3c schematically depicts an embodiment of the cinema system 600 which comprises both the media server 500 and the projector 230, which is functionally coupled to the media server (as schematically depicted).

Figs. 3d and 3e schematically depict an embodiment of the cinema system 600 comprising a media server 500, which further comprises a communication facility 504 configured to allow the media server communicate with an additional ambience light source 210 (see fig. 3d) or communicate with an external controller 1210 configured to control an additional ambience light source 210. In fig. 3d, the additional ambience light source 210 is functionally coupled to the media server 500, and controlled thereby. In fig. 3e, the external controller 1210 is functionally coupled to the media server 500, and controlled thereby. The additional ambience light source 210 is functionally coupled to the external controller 1210, and (directly) controlled thereby (and indirectly controlled by the media server 500). This may be a physical port for a plug, or a receiver for a wireless signal. In general, the communication facility 504 will be a physical port, such as a USB port or HDMI port, etc.

Fig. 4 schematically depict some aspects of ambience light. The rectangle indicates an image 102 and 232, outside the rectangle, indicates ambience light. The colored regions (indicated by shading) within the image (indicated with roman numbers) and the colored regions outside the image (indicated with roman numerals and an accent mark), i.e. the ambience light, correspond, which is indicated by the areas external from the image having the same type of shading. Of course, the ambience light does not (substantially) depict images, but is a low resolution distribution of colors or even a single color (as is known from TV Ambilight). This is shown by example with the flower in the image, which is a high resolution display of information, whereas external from the image, the ambience light is a single color or a low resolution distribution of colors (in this example only one color for area 232). The ambience light comprises one or more colors determined on one or more average colors of one or more sub-sections, which are indicated by reference 239 of an image.

Alternatively, the ambience light comprises one or more colors determined on one or more average colors of one or more sub-sections of a plurality of subsequent images. In this schematic drawing, the image 102 is, by way of example, divided in 10*6 subsections. Subsections adjacent to the edge of the image may especially be of importance to evaluate the color of the ambience light external from the image 102 / screen 201. For example, the color in area 232 is an average color and intensity of the bottom-right 30 % of the screen, averaged over the last 10 frames.

Claims

CLAIMS:

1. A method for projecting video content and ambience light on a remote screen with a cinema system, wherein the cinema system comprises a projector, and wherein the video content comprises a plurality of images to be displayed sequentially, wherein the method comprises the steps of:

sequentially displaying, with the projector, the images on a first part of the remote screen, and

displaying, with the projector, ambience light on a second part of the remote screen,

wherein the ambience light is controlled as function of the video content.

2. The method according to claim 1, wherein the video content has a first movie format for a first type of screen format and wherein the remote screen has a second type of screen format unequal to the first type of screen format, such that when displaying the images on the remote screen this would lead to a second part on the remote screen not being covered by the projected images, wherein the method comprises displaying with the projector ambience light on the second part of the remote screen.

3. The method according to any one of the preceding claims, wherein the method comprises displaying with the projector images on the first part of the remote screen, and displaying with the projector ambience light on the second part of the remote screen, while maintaining a black part between the first part and the second part.

4. The method according to any one of the preceding claims, wherein the cinema system further controls an additional ambience light source configured to provide ambience light in a display space wherein also the remote screen is arranged, wherein the additional ambience light source is configured to provide ambience light at a display space part of one or more of a wall, a ceiling and a floor, and wherein the display space part does not coincide with the remote screen.

5. The method according to any one of the preceding claims, wherein the video content, when projected on the remote screen in an unamended state, would lead to a black second part on the remote screen, and wherein the method comprises the step of amending the video content by introducing ambience lighting content, which step is either performed by the projector or by a media server that is comprised in the cinema system.

6. The method according to any of claims 1 to 5, wherein the ambience light comprises one or more colors determined on one or more average colors of one or more subsections of an image, or wherein the ambience light comprises one or more colors determined on one or more average colors of one or more sub-sections of a plurality of subsequent images.

7. The method according to any one of the preceding claims, wherein the video content is configured for a Flat format or a Scope format, whereas the remote screen is configured for a Scope format or a Flat format, respectively.

8. The method according to any one of the preceding claims, wherein the first part and the second part together include at least 90 % of the area of a Scope format or a Flat format screen.

9. A cinema system comprising a media server and a projector, wherein the media server is configured to retrieve video content from a video content source, wherein the video content comprises a plurality of images to be displayed sequentially, wherein the projector is configured to display the images on a first part of a remote screen, and wherein the cinema system is further configured to project ambience light on a second part of the remote screen, wherein the ambience light is controlled as function of the video content.

10. The cinema system according to claim 9, wherein the video content, when projected on the remote screen in an unamended state, would lead to a black second part on the remote screen, wherein the projector or the media server is configured to amend the video content to be displayed by introducing ambience lighting content.

11. The cinema system according to any one of claims 9 to 10, further comprising an additional ambience light source configured to provide ambience light in a display space wherein also the remote screen is arranged, wherein the additional ambience light source is configured to provide ambience light at a display space part of one or more of a wall, a ceiling and a floor, wherein the display space part does not coincide with the remote screen, and wherein the cinema system is further configured to control the ambience light of the additional ambience light source.

12. A media server comprising a controller, wherein the media server is configured to retrieve video content from a video content source, wherein the video content comprises a plurality of images to be displayed sequentially with a projector on a first part of a remote screen, and wherein the controller is further configured to project with the projector ambience light on a second part of the remote screen, wherein the ambience light is controlled as function of the video content.

13. The media server according to claim 12, further comprising a communication facility configured to allow the media server to communicate with an external controller configured to control an additional ambience light source.

14. A projector comprising a controller, wherein the projector is configured to display video content provided by a media server, wherein the video content comprises a plurality of images to be displayed sequentially on a first part of a remote screen, wherein the video content, when projected on the remote screen in an unamended state, would lead to a black second part on the remote screen, and wherein the controller is configured to amend the video content to be displayed by introducing ambience lighting content that is controlled as function of the video content.

15. Use of ambience light for replacing at least part of a black bar that appears on a screen next to images of a movie, wherein the ambience light and the images of the movie are projected on the screen by a projector.