CN103155585A - Systems and methods for networked in-context, high-resolution image viewing - Google Patents

Abstract

Systems and methods are provided for viewing portions of an image in high resolution and in context with a full image, which is displayed at a base resolution that is lower resolution than the resolution of the high-resolution image. A user can select an area of interest from the base-resolution image for viewing at a higher resolution on the client device. The server, or in some implementations the client device, can generate a high-resolution image representing the area of interest and the client device can display a portion of the high-resolution image in a virtual lens overlaid on the base-resolution image.

Description

System and method for high-resolution viewing of networked context-sensitive images

technical field

The present invention relates to image processing in general, and more particularly to systems and methods for viewing context-sensitive partial images of a complete image on the web at high resolution.

Background technique

Being able to view high-resolution images downloaded over the network is important for many applications. In the medical field, this ability is valuable for diagnosing and treating patients, as well as for research and education of physicians. Other applications that may benefit from this capability include engineering design, equipment operation and maintenance, digital maps, satellite imagery, forensics, and more. High resolution images can be very large and may exceed the ability of a computer system to store and display images. Furthermore, the transmission of the entire high-resolution image over the network can cause significant load on the network, which can negatively impact the response time of an application if the application needs to wait for this image data to be delivered across the network.

Contents of the invention

The systems and methods provided herein are for viewing at high resolution a contextually associated portion of an image with a base resolution that is lower than the resolution of the high resolution portion of the image. The entire image can be downloaded from the server to a remote or local client device via a network connection. The server may generate a full base-resolution image from a high-resolution image stored on, generated on, or input to the server, and the server sends the full image to the client device. The base resolution can be selected according to the capabilities of the client's mobile device or the network. Client devices can display images at a base resolution and can be configured to allow users to select areas of interest to view at a higher resolution. To this end, the client device may request from the server a high-resolution image corresponding to the region of interest specified by the user. The server can then generate a high-resolution image for the client device. This high-resolution image may be derived from an image of equal or greater resolution that is stored, generated, or input to a server. The server sends the high-resolution image to the client device, which can display the partial high-resolution image in a virtual lens overlaid on the base-resolution image. The resolution of the high resolution image may be less than or equal to the maximum resolution of the image stored, generated on, or input to the server. In some embodiments, only a portion of the high resolution image corresponding to the region of interest, or the region including the high resolution image of the region of interest, may be sent by the server to the client device. In some embodiments, the client may generate base-resolution and high-resolution images from images of equal or greater resolution downloaded from the server.

In one aspect, a computer-implemented method configures one or more processors to perform the steps of the method for displaying a portion of an image contextually associated with a base resolution image at high resolution. The method includes the following steps: receiving a request for viewing an image on a client device, sending the request corresponding to the required basic resolution image to a server on the network, receiving the basic resolution image transmitted by the server from the network, The base resolution image is displayed on the display of the client device, and upon receiving a request to display an area of interest in the base resolution image at high The request for the region of interest is sent to the server via the network, and the high-resolution image sent by the server is received through the network, and the part corresponding to the region of interest is displayed in high resolution at the position of the region of interest in the basic resolution image image. In some embodiments, the overlay includes a virtual lens, which may include accessories such as frame processing.

In one aspect, a computer-implemented method configures one or more processors to perform the steps of the method for displaying a portion of an image contextually associated with a base resolution image at high resolution. The method includes the following steps: receiving a request for viewing an image on a client device, sending the request for viewing a desired top-level resolution image to a server on the network, receiving the top-level resolution image transmitted by the server from the network, Generate a base-resolution image based on the top-level resolution image received from the server, display the base-resolution image on the display of the client device, and display one of the base-resolution images received in high resolution A request for a region of interest generates a high-resolution image based on the top-level resolution image received from the server, and displays the location of the region of interest in the base-resolution image in high-resolution text corresponding to the Partial image of the region of interest. In some embodiments, the overlay includes a virtual lens, which may include accessories such as frame processing.

In another aspect, a computer-implemented method configures one or more processors to perform the steps of the method to provide high resolution images. The method includes the following steps: the client device receives a request for a basic resolution image, generates a basic resolution image on the basis of an image of equal or greater resolution associated with the requested basic resolution image, and transmits the request through the network A connection sends a base-resolution image to a client device, receives a request for a high-resolution image associated with a base-resolution image, on the basis of an image of equal or greater resolution generated, imported, or stored on a server Generate a high-resolution image corresponding to the request on the server and send the high-resolution image to the client device.

In another aspect, a computer-implemented method configures one or more processors to perform the steps of the method to provide high resolution images. The method includes the following steps: the client device receives a request for a top-level resolution image, and generates a top-level resolution corresponding to the request based on an image of equal or greater resolution generated, input, or stored on the server. high-resolution images and send top-level resolution images to client devices over a network connection.

In another aspect, a computer-implemented method configures one or more processors to perform the steps of the method of displaying a partial image in high resolution associated with a base resolution image context. The method includes the following steps: the client device receives a request for viewing an image, sends the image request to a server, receives the image from the server and displays the image on a display of the client device.

In yet another aspect, a computer-implemented method provides one or more processors configured to perform the steps of the method to provide high resolution images. The method includes the steps of: receiving an image request from a client device, generating, inputting, or retrieving an image, and sending the image to the client device through a network connection.

In another aspect, the present invention provides a technical system for high-resolution images. The system includes a non-transitory computer-readable medium for storing computer-executable program modules, and a processor with the non-transitory computer-readable medium coupled in communication with the processor for executing the stored program modules. The system also includes a network interface module stored on a non-transitory computer-readable medium and configured to receive requests for images at a resolution selected by a client device over a network, such that when the client or client device has access to the image through The network transmits the image to the client device. The system also includes a request processing module stored on the non-transitory computer readable medium and capable of communicating with the network interface module. The request processing module is configured to receive a request for an image at a resolution selected by the client via the network interface module, process the request, and send the requested image from the network interface module to the client device at the requested resolution. The system also includes an access control module stored on the non-transitory computer readable medium and in communication with the request processing module, the access control module configured to receive a client device authorization request from the request processing module to verify that the client device Or the user's image access rights, verify the access rights according to the access control regulations, and send an authorization response indication whether the client device or the user has the right to access the image to the request processing module. The system also includes an image management module stored on the non-transitory computer readable medium and in communication with the request processing module, the image management module configured to use the data store to process image management requests from the request processing module.

In another aspect, the present invention provides a technical system for viewing high-resolution images. The system includes a non-transitory computer-readable medium for storing computer-executable program modules, and a processor coupled in communication with the non-transitory computer-readable medium for executing the program modules stored thereon. The system further includes a network interface module stored on a non-transitory computer readable medium and configured to send a request from a network to a server for an image requested by a user of the system and retrieved from a network The server receives the requested image. The system also includes a user interface module stored on a non-transitory computer readable medium, configured to receive a request from a user to view an image, receive a base resolution image corresponding to the requested image, and display on a display of the system displaying the basic resolution image, receiving a request from a user to display a region of interest in the basic resolution image at a high resolution, and receiving a high Combined image of the resolution image part and display its combined image. The system also includes a request processing module stored on the non-transitory computer readable medium and in communication with the user interface module and the network interface module. The request processing module is configured to receive a request for a base resolution image from the user interface module, in response to a user viewing the image, process the request for the base resolution image from the user interface module, provide the base resolution image for display to the user interface module, receive A request for a combined image that includes a portion of the high-resolution image corresponding to the region of interest superimposed on the base image at the location of the region of interest, processing the request for the combined image, and providing the combined image to the user interface module for display . The system also includes an image management module stored on the non-transitory computer readable medium. In communication with the request processing module and the network interface module, the image management module is configured to use the data store to process image management requests.

These and other features, profiles, and embodiments are described in the following section entitled "Detailed Description."

Description of drawings

Describe its feature, overview, and embodiment in conjunction with accompanying drawing, wherein:

FIG. 1 is a block diagram of an image viewing system described in an embodiment;

Fig. 2 is a flow chart of the continuous downloading method. According to one embodiment, the method can be configured on the client device of the image viewing system shown in Figure 1;

Fig. 3 is a flow chart of the continuous downloading method. According to one embodiment, the method can be configured on the server of the image viewing system shown in Figure 1;

Figure 4 is a block diagram of a display area of a client device in one embodiment;

Fig. 5 is a flow chart of a client downscaling method. According to one embodiment, the method can be configured on the client device of the image viewing system shown in Figure 1;

Fig. 6 is a flow chart of a client downscaling method. According to one embodiment, the method can be configured on the server of the image viewing system shown in Figure 1;

Fig. 7 is a flow chart of the server combination method. According to one embodiment, the method can be configured on the client device of the image viewing system shown in Figure 1;

Fig. 8 is a flow chart of the server combination method. According to one embodiment, the method can be configured on the server of the image viewing system shown in Figure 1;

9A and 9B are flowcharts of the collaboration method. According to one embodiment, the method can be configured on the client device of the image viewing system shown in Figure 1;

Figure 10 is a flowchart of a collaboration method. According to one embodiment, the method can be configured on the server of the image viewing system shown in Figure 1;

Figure 11 is a block diagram of logical components of the server shown in Figure 1, in one embodiment;

Figure 12 is a block diagram of logical components of the client device shown in Figure 1, in one embodiment.

Detailed ways

The systems and methods are used to view high resolution partial images through a virtual lens on a client device. In response to a user request to view an image, the client device may obtain a copy of the image at the base horizontal resolution from the server over the network. Based on high-quality, high-resolution images previously stored, retrieved, or input to the server, the server may store, generate, or input a base-resolution image and may transmit the base-resolution image to the client on the device. A base-resolution image has a lower resolution than a high-resolution image that was previously stored, generated, or input to a server. The capabilities of the client device or network may determine, at least in part, the resolution of its base resolution image. The client device is configured to receive the base resolution image from the server and display the base resolution image from the display interface. A user of a client device can select an area of interest on a base-resolution image and request a high-resolution image from the server corresponding to the user-identified area of interest at a resolution up to The resolution of stored, generated, or imported high-resolution images. For example, in some embodiments, the client device may be configured to present a "virtual lens" over the region of interest, overlaid on top of the base resolution image, and display a localized high-resolution image corresponding to the region of interest. image. This virtual lens can display a more detailed image of the region of interest, enabling the user to "zoom in" to details within the region of interest. The capabilities of a client device or network may determine, at least in part, the size of its virtual lens and the resolution of the displayed high-resolution images.

In some embodiments, only a portion of the high-resolution image corresponding to the region of interest or a partial image including the region of interest may be sent from the server to the client device. In other embodiments, a complete high-resolution image may be sent by the server to the client device, and the client device may be configured to select a partial high-resolution image corresponding to the region of interest and display that portion through a virtual lens. High resolution images.

In some embodiments, the virtual lens may provide an overlay on the full base resolution image at the corresponding displayed portion of the high resolution image, such that the virtual lens may simultaneously display the higher resolution image while providing its selected resolution level. This setting makes it possible to view high-resolution images within the display space available in an application, while providing context-sensitive overlay images. According to one embodiment, even in cases where the resolution of the computer system is insufficient to represent the full high-resolution image, and where it is undesirable or unnecessary to use a large amount of display space to display the full high-resolution image, These techniques can be used to display at least one image corresponding to local high-resolution content.

In some embodiments, the user is able to view images of selected regions of interest in high resolution. Other embodiments enable the user to select an area of interest by moving around any part of the image. These techniques help reduce the amount of data that is sent over a network for high-resolution images in a given amount of time, and can also reduce the amount of image data required to display on a display area, as well as the processing required by client devices and servers capacity and storage capacity. Furthermore, these techniques can be used to optimize its response time in various usage scenarios.

FIG. 1 is a block diagram of an image viewing system 100 in one embodiment. The image viewing system includes a client device 110 , a server 120 , and a network 130 . Client device 110 may be a computing device characterized by including one or more processors, volatile and non-volatile memory, display, keyboard (hard or soft), pointing device (e.g., mouse, touchpad), , joystick, touch screen, trackball, etc.), network interface, and other input/output devices. Client device 110 may be a desktop computer, notebook computer, computer workstation, computer disk, tablet computer, document reader, smartphone, cell phone, personal digital assistant, network appliance, thin client system, and Digital television with a computer, memory, and network interface, or other types of devices capable of receiving image data over a network and displaying the image data transmitted to user equipment. According to some embodiments, the functions of the client device 110 may be implemented in one device, or distributed among multiple devices.

Server 120 may be a computing device characterized by including one or more processors, volatile and non-volatile memory, network interfaces, and other input/output devices. According to some embodiments, the functions of the client device 120 may be implemented in one device, or distributed among multiple devices. According to some embodiments, image viewing system 100 may include a plurality of servers 120 arranged to provide image data to one or more client devices 110 via one or more networks 130 . In some embodiments, the server 120 is a web server that can be configured to provide content to the client device 110 via the network 130 . According to one embodiment, server 120 may communicate with one or more data repositories (not shown) that may be used to store image data for provision to client devices. According to one embodiment, the data repository may be configured on the server 120, or may be configured on a separate data server (not shown). The web server may also communicate with one or more image input devices (eg, cameras, scanners, sensors, etc.).

According to one embodiment, network 130 may represent one or more wired or wireless network connections between server 120 and client device 110 . According to one embodiment, network 130 includes the Internet, local area network, wide area network, metropolitan area network, telephone network, television network, wireless network or link, satellite network or link, bus, or other type of network or interconnection method.

According to another embodiment, the functions of the server 120 and the client device 110 may be configured on a single device or device components. For example, the techniques disclosed herein can be used to review data captured by a digital microscope scanning system.

Image viewing system 100 enables users to view partial high-resolution images on client device 110 without sending the entire high-resolution image to client device 110 by server 120 . In one embodiment, the client device 110 may be configured to display a “base resolution” image and a virtual lens 160 superimposed on the base resolution image in the display area 150 of the client device 110 . The base resolution image may be a lower resolution image representing a high resolution image stored, generated, or imported on the server 120 . Since base resolution images have a lower resolution than high resolution images, less bandwidth is required to be sent from network 130 to client device 110 . The base resolution image in display area 150 may provide client device 110 with a context-sensitive image of a user-specified region of interest displayed in high resolution.

The virtual lens 160 may display a partial high resolution image of the basic resolution image in the image display area 150 with a higher resolution. According to one embodiment, the resolution of the high-resolution partial image displayed in the virtual lens 160 may be the same resolution as the high-resolution image stored, generated, or input to the server 120 . According to another embodiment, the resolution of the high-resolution partial image displayed in the virtual lens 160 may be a different resolution than the high-resolution image stored, generated, or input to the server 120 . For example, the virtual lens 160 may be configured to display a partial high-resolution image at a resolution between the resolution of the base-resolution image and the resolution of the high-resolution image stored, generated, or input to the server 120 between. According to one embodiment, the user can select a set of different resolutions to display their images on the virtual lens 160 . Image viewing system 100 may determine a range of different resolutions depending on the capabilities of its client device or network and the resolution of the base resolution image. In another embodiment, the user may select from a contiguous set of image resolutions at which to display his image on the virtual lens 160 . The image viewing system 100 may determine a set of continuous lower and upper limits of image resolution according to the capabilities of the client device or network, and the resolution of the base resolution image.

According to one embodiment, the high-resolution image can be uploaded to the server 120, generated on the server 120, or connected to the server 120 after being generated on a digital scanning microscope, digital camera, or scanner.

According to one embodiment, the user of the client device 110 can select an area of interest in the basic resolution image on the display area 150 , and display its corresponding high resolution image part through the virtual lens 160 . According to one embodiment, the client device may be configured to allow a user to select a display area using a pointing device of the client device 110, such as a mouse, trackball, touchpad, touchscreen, joystick, arrow keys, buttons, or other input device 150 local base resolution images. According to one embodiment, the client device may also be configured to enable the user to select different regions of interest in the base resolution image on the display area 150 by using the pointing device of the client device 110 . According to one embodiment, the client device 110 is configured to display in the display area 150 a complete lower resolution base image and a high resolution image corresponding to the selected region of interest superimposed on the base resolution image. Since the high-resolution image displayed in the virtual lens has a higher resolution than the base-resolution image, and an area smaller than the base-resolution image it covers. The ability to move the virtual lens using a pointing device may have enabled the user of the client device to finally view the entire image in high resolution.

The term "resolution" used herein refers to the total number of pixels of an image, and may also be the total number of colors of each pixel of an image. For example, resolution can be the total number of horizontal pixels in the image multiplied by the total number of vertical pixels. In other embodiments, a third dimension may optionally be included, and the resolution may include a depth component. Resolution can also include a temporal dimension if the image changes over time. For video content, resolution may be the total number of frames per second. Resolution can also be the level or amount of detail in an image. For example, the number of roads or other features are shown on a map.

In some embodiments, the following levels of resolution may be used here to differentiate between different resolutions for images:

• Maximum resolution, which is less than or equal to the resolution of the captured (eg, by a digital camera, scanner, or sensor), input, or generated (eg, image or video authoring tool) image.

• Base resolution, which is sufficient for basic inspection of the image, and for viewing the surrounding parts surrounding the superimposed high-resolution image. The base resolution is a resolution lower than the maximum resolution.

· High resolution is a resolution that is higher than the basic resolution and less than or equal to the maximum resolution.

• The top resolution is a resolution that is greater than or equal to the high resolution and less than or equal to the maximum resolution.

In one embodiment, a high resolution still image may be 3648x2736 pixels (horizontal x vertical) with 24 bits of color per pixel, a typical digital camera has a resolution of 10 megapixels. However, this is only an example and skilled artisans will recognize that high resolution images may have various resolutions.

A typical high-resolution image can consume a considerable amount of memory, which may be too large to be fully displayed at the native resolution within the available area on the customer's display. A typical high-resolution image may also take a considerable amount of time (eg, a few seconds or more) to download from a server over the network, placing a load on the client, the server, or the network. In many applications, a base resolution (low to medium) image may be sufficient for basic inspection of the image. Occasionally users need to look at high resolution (higher resolution than base resolution) images to examine image details in regions of interest. In some embodiments, a user can view a partial image at high resolution overlaid on a base resolution image.

和Microsoft

只是放大整个图像或文档页面，而不是用户选择的感兴趣的领域内的图像或文档页面。Some conventional image viewing systems allow the user to zoom in on a portion of the image, however, these systems typically just use digital zoom to magnify portions of the computer display rather than acquiring and displaying a higher resolution image that contains additional detail. In some conventional systems, digital zooming is used to create a magnification effect corresponding to the portion of the pixel array of the image displayed to the user. This method does not provide any additional detail, but simply uses a lower resolution image to create a simulated upscaled image. For example, pixels in the original lower-resolution image may be copied to create a simulated upscaled image, and one or more smoothing laws may be applied to the upscaled image only. However, the resulting simulated upscaled image lacks additional detail and may appear coarse grained that was not present in the original original image. Some conventional systems only magnify the entire image rather than an image of a user-selected region of interest. For example, Adobe

and Microsoft

Just magnifies the entire image or document page, not the image or document page within the user-selected area of interest.

In contrast, the image viewing system 100 displays a user-selected region of interest at high resolution at the maximum resolution at which such images were captured or generated. The client device 110 may provide all details in maximum resolution to display a user-selected region of interest, which may be displayed in a context-sensitive full base-resolution image. According to one embodiment, images within a user-selected area may be displayed in high resolution and overlaid on the full base resolution image.

Conventional systems also do not use client-server based approaches for digital magnification or context-sensitive high-resolution displays. In conventional systems, the image or file is stored locally on the computer system and all or part of the file is enlarged using the conventional techniques described above. In contrast, the image viewing system 100 can use a client-server based approach, where a large high-resolution image is stored, generated, or input to the server 120, and a smaller base-resolution image, available from The network 130 sends to the client device 110 for basic verification of the image. High-resolution images are sent only when needed, rather than for each base-resolution image, saving network bandwidth, as well as processing and storage resources at client devices and servers. In some embodiments, as a further optimization, if the user expects to view only a portion of the image in high resolution, that portion rather than the entire high resolution image may be sent by the server to the client device over the network 130 . Since a high-resolution image can be one megabyte or larger even after being compressed, reducing the number of transmissions, or simply transmitting over the network a local high-resolution image corresponding to the region of interest selected by the client user image, the good overall response time of this high-efficiency system is reflected.

Now, returning to FIG. 1 , client device 110 in image viewing system 100 may be configured to allow users to view the images it stores, generates, or inputs to server 120 at different resolutions. The display area 150 of the client device 110 displays the base resolution image, and the virtual lens 160 displays the high resolution image portion superimposed on the base resolution image. According to one embodiment, display area 150 may be all or part of a display window of an application running on client device 110, such as a web viewer, word processing application, image viewer or editor application, and a Other types of applications in which high-resolution image content is viewed.

According to one embodiment, the client device 110 may be configured to display virtual lenses 160 of different shapes. For example, a virtual lens may be rectangular, circular, oval, or other shapes. According to some embodiments, the virtual lens may include accessories such as a frame and handles. For example, in one embodiment, the virtual lens may be in the shape of a magnifying glass, superimposed on the base resolution image as a movable magnifying glass. On this magnifying glass-shaped virtual lens 160, the user can view a partial image of his selected region of interest in high resolution, which is transmitted from the server 120 to the client device 110 via the network 130 (transmission 140).

According to one embodiment, the client device 110 may be configured to allow the user to use a pointing device to move the virtual lens 160 superimposed on the base resolution image in the display area 150 to transform the high-resolution partial image displayed in the virtual lens 160 . As mentioned above, the virtual lens 160 acts as a high-resolution image magnifying glass on the base-resolution image in the display area 150, and does not actually magnify the base-resolution image, but the virtual lens 160 displays the local high-resolution images received from the server 120. image.

For example, a provider of an online medical postgraduate continuing education course may use image viewing system 100 to display training slides, including digital microscope images. These digital images can be very large in size, and sending a full-scale high-resolution image from the server 120 to the client device 110 would consume a large amount of network bandwidth. Server 120 may however provide base resolution digital slide images to convey a particular concept. If the user wants to see more details, the user can select an area of interest on the base resolution image, and the client device 110 can present a high resolution image with the virtual lens 160 superimposed on the base resolution image. Users can see more details in high-resolution images. This approach allows for more efficient use of the server 120 and client device 110 network and computing resources because the client device does not need to request the server 120 to send a high resolution image for every base resolution image viewed. When the user only needs to view part of the image in high resolution (for example, a selected region of interest and surrounding area), since only the part rather than the entire high-resolution image is sent from the server to the client's device, its efficiency be further improved. In some embodiments, the virtual lens 160 can be set to appear at a specific position of the base resolution image, so as to highlight a specific feature in the digital slide to show the key point in the teaching material. In some embodiments, the user can also dynamically control the positioning and size of the virtual lens 160, and can dynamically update the high-resolution content in the virtual lens 160 from the server 120 according to changes in the user's region of interest. In some embodiments, the user may also change the "magnification" (ie, resolution level) of the virtual lens display. If the user requests that the image be zoomed in further, the virtual lens can display a higher resolution image (up to the maximum resolution supported by the server), and, if the user requests that their virtual lens zoom out, a lower resolution image can be displayed on the virtual lens .

In another example, an online map application may use image viewing system 100 to display more detail or more detailed satellite imagery, or both, for an area of interest. When the user requests a map, the server 120 can send the base resolution map to the client device, and when the user requires a more detailed view, the virtual lens can provide a partially detailed view overlaid on the map. That way, its high-resolution images are only downloaded when you want them. In some embodiments, as a further optimization, when the user only requests to view a partial image (for example, a selected region of interest and surrounding areas) in high resolution, only this part of the image is sent from the server to the client's device via the network . This technique is particularly useful in mobile devices, including navigation applications, as these devices typically have bandwidth and memory constraints.

According to one embodiment, the image viewing system 100 can be configured to use three different modes of operation: continuous download method, client downscaling method, or server combination method. In some embodiments, these methods can be used alone or in combination. In another embodiment, the image viewing system 100 may be configured to provide a collaborative approach that may use any combination of the continuous download approach, the client-side downscaling approach, or the server combination approach.

Continuous download method

2 and 3 are flowcharts of the continuous downloading method. According to one embodiment, the method may be used in conjunction with image viewing system 100 . Figure 2 shows the steps of the continuous download method. According to one embodiment, the method can be performed on the client device 110 . FIG. 3 shows method steps for continuous downloading by the server 120 .

The method in FIG. 2 starts when the client's device 110 receives a request to view an image (step 210). According to one embodiment, the request may include the user accessing the file or image using the application. In other embodiments, the request may include the user accessing a particular web page or other content using an application running in a viewer on the client device 110 . In yet another embodiment, the request may include content that the user executes an application program on the client device 110 using a high-resolution image obtained from the server 120 .

As shown in FIG. 2, the client device 110 sends a request to the server 120 for a base resolution image corresponding to the requested image (step 220). According to one embodiment, the display module is configured on the client device 110 . In this way, the display module can process the image request from the application on the client device 110 and send the request for the base resolution image corresponding to the requested image to the server 120 via the network 130 .

Client device 110 determines whether an image is received from server 120 (step 225). According to one embodiment, if an image is restricted from access, the server 120 may determine whether the user of the client device or the client device 110 (or both) has the right to view the image according to its image control policy. According to one embodiment, the request sent by client device 110 may include identifying information associated with the user or client device 110 that may be used to determine whether server 120 should grant it access to images stored, generated, or input to server 120. access permission. If the user is not authorized to access the requested image, server 120 may choose to send a message indicating that the user of client device 110 or client device 110 is not authorized to access the requested image. According to one embodiment, the client device 110 may also be configured to record the time elapsed after sending the request to the server 120 . The request times out if the base resolution image is not received within the predetermined time.

If no image is received from server 120, client device 110 may choose to display a message to the user indicating that the requested image cannot be accessed (step 260). According to some embodiments, the detailed error message may describe why the image cannot be accessed. For example, if no response is received within a certain amount of time, the information could indicate that the request timed out, or that the user is not authorized to view the requested content.

If the client device 110 receives the image from the server 120, the client device 110 may display the base resolution image in its display area 150 (step 230). According to one embodiment, the display of the client device may be configured to resize the base resolution image on the client device 110 according to the space available on the display area. Figure 4 shows an example of a display area on a client device. For example, if client device 110 includes a display area 410 that is 1200 pixels wide and 800 pixels high, and if 60% of the display area's width is available to display base resolution image 420, and the total height minus its top 140 The pixels and the bottom 120 pixels are the available display area on which the display module of the client device will display a base resolution image 720 pixels wide by 540 pixels high. According to one embodiment, display area 410 may include a desktop display screen or other display device on client device 110 . In one embodiment, the display area 410 may include an application window, which includes application information, as well as window controls and other information. For example, in some embodiments, a user may access content such as a high-resolution image or a web page or other content including a high-resolution image in a viewer. The embodiment in FIG. 4 shows that the display area 415 is used to display a portion of the text content, thereby reducing the available space for displaying the base resolution image. If a base-resolution image is displayed in an application window, the space available for displaying the base-resolution image is also affected. As a result, the display area 420 displaying the base resolution image may be smaller than the total amount of the client device's display area. As can be seen from these exemplary embodiments, the resolution of the base resolution image may be determined at least in part based on the resolution and screen size of the client device 110 and the available area on the display area 420 .

Client device 110 may receive a request from a user to view a high-resolution image of the region of interest (step 235). According to one embodiment, the user may use an input device, such as a pointing device, including a mouse, touch screen, touch pad, joystick, trackball, arrow keys, buttons, or other input device, so that the user can select a sense of touch in the base resolution image. region of interest and view that partial image in high resolution.

The client device may send a request to server 120 for a high resolution image corresponding to the base resolution image (step 240). According to one embodiment, the request may include a high-resolution image at the desired resolution level. The desired resolution ranges above the base resolution of the image, up to the maximum resolution of the image it is stored, generated, or input to server 120 .

According to some embodiments, the client device 110 may send a request to the server 120, and the request may only contain the high-resolution image portion of the region of interest determined by the user, rather than the entire high-resolution image. In cases where the user only wishes to view a portion of the base-resolution image at high resolution, or where network transmission of the complete image would adversely affect response time, or where the amount of memory on the client side is insufficient to store the complete In the case of a high-resolution image, another request may be to request only a portion of the high-resolution image. According to one embodiment, the request may include a set of reference points on the base resolution image corresponding to the region of interest. For example, in some embodiments, the client device 110 is configured as a rectangle that the user can draw on the base-resolution image to indicate that the user wishes to see a high-resolution image of the region of interest. When requesting the server 120 to send a high-resolution image, the width and height of the upper left corner and the lower right corner of the rectangle, or the upper left corner and the center point of the rectangle may be provided. According to one embodiment, the display module may be configured to convert the screen coordinates of the base resolution image into pixel coordinates, and may include the pixel coordinates of the region of interest specified by the user when requesting the server to send the high resolution image. According to another embodiment, the client device 110 may provide a user interface for the user to receive a high-resolution image corresponding to the region of interest in the base-resolution image in the area indicated by the cursor, or overlaid by a shape , you can drag or move the cursor or shape, such as a rectangle or ellipse, on its location.

Client device 110 determines whether a high-resolution image is received from server 120 (step 245). If no image is received from server 120, client device 110 may choose to display a message to the user indicating that the requested image cannot be accessed. Otherwise, if the client device 110 can receive the requested high-resolution image corresponding to the region of interest, the client device 110 can display the high-resolution image corresponding to the portion of the region of interest in the virtual lens 160 image (step 255). The virtual lens may be positioned over a region of interest in the base resolution image and may be configured to display a portion of the high resolution image that corresponds to the region of interest as determined by the user. According to one embodiment, the virtual lens 160 may be set back to an original size and shape. In one embodiment, the size of the virtual lens may be proportional to the size of the base resolution image displayed on the client device 110 . For example, in one embodiment, the size of the virtual lens may be one quarter the size of the base resolution image. For example, if the size of the base resolution image is 720 pixels wide by 540 pixels high, the size of the virtual lens is 360 pixels wide by 270 pixels high.

According to one embodiment, the display module of the client device 110 can determine the part of the high-resolution image corresponding to the region of interest selected by the user, and display the corresponding part of the high-resolution image on the virtual lens 160 in a high-resolution The image replaces the portion of the base-resolution image in the corresponding region of interest. According to one embodiment, if the user selects an area with horizontal and vertical coordinates [180, 270] relative to the upper left of the base resolution map as the center of the displayed higher resolution image, the virtual lens can be positioned in the base resolution map Center of coordinates [180, 270]. If the resolution of the high-resolution image is 1080 pixels wide by 810 pixels high, the portion of the high-resolution image to be displayed (for example, the size of the virtual lens) would be 360 pixels wide by 270 pixels high, and the portion of the high-resolution image to be displayed would be 360 pixels wide by 270 pixels high, and The region center point of the high resolution image will be [270, 405], while the corresponding center point of the base resolution image will be [180, 270] (across the quarter and directly below the half). According to some embodiments, a border of the virtual lens 160 may be present to demarcate the virtual lens 160 in the base resolution image display area 150 . It should be noted that a high resolution image that is smaller than the area covered by the virtual lens on the base resolution image can also be displayed on the virtual lens. In this example, in a 360x270 virtual lens, about 11% of the high-resolution image can be displayed in the virtual lens ((360x270)/(1080x810)). The virtual lens will cover about 25% of the base resolution image ((360x270)/(720x540), excluding borders). This ability to move the virtual lens of the high-resolution image allows all parts of the base-resolution image to be viewed at high resolution.

According to one embodiment, to improve response time, high-resolution images may be downloaded from server 120 prior to a user's request to view a portion of the high-resolution image in virtual lens 160 . In such an embodiment, the high resolution image of the portion is displayed on the virtual lens 160 only when the user requests the image. According to one embodiment, this prefetching of high-resolution images may be initiated by some user action and trigger the client device 110 to send a request to the server 120 . For example, in some embodiments, downloading the high-resolution image may occur at the same time as the base-resolution image is requested from the server 120, or shortly after the base-resolution image is received from the server. Alternatively, the client device 110 may be configured to initiate the download of a high-resolution image in response to the user pressing a soft or hard key (eg, an "image viewing system activate" button), or by clicking a pointing device button. Continuing with this preloading technique, a higher resolution image can be requested to be downloaded as each high resolution image download completes, and so on, until the maximum resolution is reached.

According to one embodiment, the client device 110 may be configured to allow the user to move the virtual lens 160 overlaid on the base resolution image in the display area 150 . In one embodiment, the client device 110 is configured such that a user can move the virtual lens by using a pointing device, such as a mouse, touchpad, touchscreen, joystick, trackball, arrow keys, or buttons. In one embodiment, the display module of the client device 110 is configured to change in real time, that is, as the user moves the cursor across the base resolution image, the selected region of interest will have a virtual lens superimposed on its position corresponding to the The region of interest that changes as the cursor position changes is displayed in the virtual lens in high resolution. According to one embodiment, the cursor position of the base resolution image within the display relative to a reference point, such as the upper left corner of the image, is considered to determine the high resolution image position of the virtual lens 160 . In one embodiment, the display module may also take into account whether the user is scrolling through the display on the client device display and adjust the amount of horizontal or vertical scrolling (or both). If not the full high-resolution image has been requested from the server 120, or if the cursor moves to a position that requires more high-resolution images to fill the virtual lens 160, the client device 110 can send a request to the server 120 for additional A high-resolution image of is displayed on the virtual lens 160.

According to one embodiment, the display module of the client device 110 may be configured to allow a user to request a change in the resolution level of the high resolution image displayed in the virtual lens 160 . According to one embodiment, the display module can be configured to provide user interface controls, such as soft buttons, sliders, pointer controls for mobile devices, or other types of interface components, so that the user can interact to select a desired resolution level A high-resolution image of is displayed in the virtual lens 160. In one embodiment, the user may select a certain level of resolution for images to be displayed in the virtual lens 160 , up to the maximum resolution level of the images stored, generated, or input to the server 120 . In one embodiment, the user may select a resolution level greater than the base resolution and up to the maximum resolution of the image.

In response to a request to change the resolution of the portion of the image displayed by the virtual lens 160, the display module may be configured to issue a request to the server 120 to transmit all or part of the image corresponding to the base resolution and the selected resolution level. High resolution images. The portion of the image it requests can be the same size or larger than the image displayed on the virtual lens 160 . Once the server 120 sends the high-resolution image to the client device 110 through the network 130 , the display module can display the high-resolution image corresponding to the portion of the region of interest in the virtual lens 160 . When the user requests to increase the resolution of the image currently displayed on the virtual lens 160, a higher resolution image smaller than the image currently displayed on the virtual lens 160 will be displayed on the virtual lens 160 at the requested resolution. When the user requests to reduce the resolution of the image currently displayed on the virtual lens 160, a higher resolution image than the image currently displayed on the virtual lens 160 will be displayed on the virtual lens 160 at the requested resolution. According to one embodiment, for each base resolution image stored in memory, server 120 may have a plurality of images of different resolutions, each image having a resolution greater than or equal to that generated in server 120, input to, or stored in The resolution of the image. The server 120 may store the maximum resolution images in memory and generate high resolution images (lower than the maximum resolution) according to the client's request. According to one embodiment, the user can change the resolution of the image displayed by the virtual lens 160 at any time.

According to one embodiment, the display of the client device 110 may also be set to allow the user to change the size of the virtual lens 160 and the resolution of the image displayed by the virtual lens 160 . According to one embodiment, the display may provide options including soft buttons (buttons or other interface components drawn on the client device display and selected with a pointer movement device), hard buttons (keyboard or other buttons or switches), or pointer movement devices. Controls (eg, left or right mouse button clicks, mouse up or down buttons, scroll wheel controls, trackball controls, touch controls, or other pointing device controls). According to one embodiment, the display may also be configured to provide controls enabling the user to fix the virtual lens at its current position (i.e., stop tracking pointing device motion), freeze the virtual lens, or unfreeze the virtual lens (resume tracking pointing device motion). According to one embodiment, the display may also be configured to provide controls that allow the user to turn off the virtual lenticular display so that the full base resolution image is displayed without overlapping the high resolution image, or to enable the user to turn the virtual lenticular display back on. Some controls can perform multiple functions, such as changing the size of the virtual lens and the resolution of the image displayed by the virtual lens 160 at the same time.

The method shown in FIG. 3 is the server 120 taking steps corresponding to the steps performed by the client device 110 in FIG. 2 . The server 120 receives a request from the client device 110 to send a base resolution image (step 310). If access is restricted, the server 120 may check whether the user or client device 110 has access rights to the requested image in accordance with access control regulations (step 320). According to one embodiment, when an image has access restrictions, the request sent by the client device 110 may include identification information associated with the user or client device 110, which may be used to determine whether the server 120 should grant the user or client device 110 Access rights to image content stored, generated, or imported to the server 120.

Server 120 determines whether the user or client device 110 (or both) has permission to access the requested image (step 325). If the user or client device 110 does not have permission to access the requested image, server 120 may be arranged to send a message to client device 110 indicating that the user of the client device or client device 110 does not have permission to access the requested content (step 360). Otherwise, if the user has access to the requested image, the server 120 will generate a base resolution image (step 330) from the stored high resolution image with a resolution greater than or equal to its stored, Generated or input to the server 120, corresponding to the resolution of the base resolution image. According to some embodiments, the base resolution image may have been generated from a specific high resolution image. In one embodiment, the server may be configured to generate a corresponding base resolution image for each high resolution image uploaded, imported or generated on the server 120 . In some embodiments, the resolution level of the base resolution image may be set based on the properties of the client device displaying the base resolution image and used to display the base resolution image. For example, server 120 may be configured to generate lower resolution images for use on mobile devices, such as mobile phones, which typically have smaller sized displays. The server 120 may also be configured to generate a base resolution image with a correspondingly higher resolution for use on laptop or desktop computer systems with larger display screens and higher resolutions. Server 120 may then send its base resolution image to client device 120 via network 130 (step 335).

Server 120 may receive a request from client device 110 for a full high-resolution image, or a partial high-resolution image corresponding to a region of interest in the image (step 340). The requested portion of the image may be the same size as displayed on the virtual lens 160 or larger. If access is restricted, it may again be determined whether the user or client device 110 (or both) has access rights based on access control regulations (step 345). If the user or client device 110 does not have permission to access the requested image, server 120 may be arranged to send a message to client device 110 indicating that the user of the client device or client device 110 does not have permission to access the content ( Step 360). Otherwise, the server 120 may generate or retrieve from memory a complete high-resolution image, or a partial high-resolution image corresponding to the region of interest (step 350). The resolution of this high-resolution image is equal to or less than the maximum resolution of its stored, generated, or imported high-resolution images on the server 120, but greater than the resolution of the base-resolution image provided to the client in step 335. Rate. Server 120 may transmit the high-resolution image generated in step 350 to client device 110 via network 130 (step 355). According to some embodiments, a request is received from the client device 110 , which may specify the resolution level it uses for the high resolution image generated in step 350 . For example, the execution of an application requesting a high-resolution image on client device 110 may include a user interface that includes a "zoom" tool that enables the user to select the resolution level of their high-resolution image for display on a virtual on the lens 160. In some embodiments, the server 120 may cache the high-resolution image it generates in response to the client's request, so that when a request for the image at the resolution level is received again in the future, the server 120 does not need to generate the high-resolution image again. image.

According to some embodiments, various optimization schemes may be used on the continuous download method. For example, in some embodiments, images in multiple resolutions may be pre-loaded on the client device in anticipation that users will request to view these images. In another embodiment, images of various resolutions downloaded by the client may be cached in the memory. According to another embodiment, the client device 110 may be configured to request a high-resolution image of only a portion of or a region containing a portion thereof to be displayed on the virtual lens, while the server 120 may be configured to send only a portion of or a portion thereof A high-resolution image of the region, rather than the entire high-resolution image. In one example, this could be used if sending the entire high-resolution image would take too long, or if the user only wishes to view a subsection of the high-resolution image.

In some embodiments, the resolution level of the base resolution image may be determined according to the properties of the client device displaying the image, the bandwidth, and the delay characteristics of the network 130 connecting the client device 110 and the server 120 . For example, server 120 may be configured to generate a base resolution image, which has a lower resolution for a mobile device, such as a mobile phone, which generally has a smaller display screen, while server 120 may be configured to generate a base resolution image, It has an equivalent high resolution for a laptop or desktop computer system with a larger display area and higher resolution. In one embodiment, the resolution level of the high-resolution image corresponding to the base-resolution image can also be adjusted according to the properties of the client device 110 , the server 120 and the network 130 .

Client-side downscaling method

5 and 6 are flowcharts of client-side downscaling methods that may be used with the image viewing system 100 described in one embodiment. The method steps shown in FIG. 5 can be executed on the client device 110 . The method steps shown in FIG. 6 may be executed by the server 120 .

The method in FIG. 5 begins when the client device 110 receives a request to view an image on the client device (step 510). Client device 110 sends a request to server 120 for an image at a top-level resolution (step 520 ), which is less than or equal to the maximum resolution of the image generated, imported or stored on server 120 . According to one embodiment, the display module configured on the client device 110 can be configured to process an image request from an application program in the client device 110, and send a request to the server 120 through the network 130, requiring it to correspond to the initially requested image. The top resolution image of the image.

Client device 110 determines whether a top-level high-resolution image is received from server 120 (step 525). According to one embodiment, if access to the image is restricted, the server 120 may determine whether the user or the user of the client device 110 (or both) is authorized to view the image content based on access control regulations. According to one embodiment, the request sent by client device 110 may include identifying information associated with the user or client device 110, whereby server 120 may determine whether the user or client device 110 should be granted access to store, generate, or input Access rights to the image content of the server 120. If the user or client device 110 does not have access to the requested image, the server 120 may choose to send a message indicating that the user or client device 110 does not have access to the requested image. According to one embodiment, the client device 110 may also be arranged to log the time elapsed since it sent a request to the server 120 and indicate that the request timed out if it has not received a top resolution image within a predetermined amount of time.

If no images are received from server 120, client device 110 may choose to display a message indicating to the user that the requested image cannot be accessed (step 560). According to some embodiments, detailed error messages, such as describing why the image cannot be accessed. For example, the information may indicate that the request has timed out if no response is received within a predetermined time, or that the user is not authorized to view the requested content.

If an image is received from server 120, client device 110 may generate a base resolution image from the top resolution image it received (step 530). According to one embodiment, the display on the client device 110 may be configured to downscale its top-level resolution image when receiving an image from the server 120 . According to one embodiment, the display may be set to downscale its top resolution image according to the available display space.

According to some embodiments, the base resolution image may have already been generated by the client device 110 from a certain top resolution image previously received at the server 120 . In some embodiments, the resolution level of the top-resolution image may be set according to the properties of the client device displaying the image, and/or the bandwidth and latency characteristics of the network 130 connecting the client device 110 and the server 120 . For example, server 120 may be configured to generate a top resolution image with a lower resolution image available for a mobile device, such as a mobile phone, which generally has a smaller display screen. While the server 120 can also be configured to generate top-resolution images, images with higher resolutions can be used on laptop or desktop computer systems with larger display areas and higher resolutions.

Client device 110 may display the base resolution image in its display area 150 (step 533). According to one embodiment, the display of the client device may be configured to resize the base resolution image according to the space available on its display area to display the base resolution image. Client device 110 may then receive a request from the user to view a high-resolution image of the region of interest (step 535). According to one embodiment, a user may use an input device, such as a pointing device, including a mouse, touch pad, touch screen, joystick, trackball, arrow keys, buttons, or other input device, to enable the user to select a sensory element within the base resolution image. region of interest to view its high-resolution image. According to one embodiment, the client device 110 may provide a user interface in which the user may drag or move a cursor or shape, such as a rectangle or an ellipse, to the location of the region of interest in the base resolution image.

The client device 100 may then generate a high-resolution image corresponding to the user-determined region of interest (step 540). On top of the top resolution images received from the server 120, the client device may generate a high resolution image. According to one embodiment, when a user requests to view an image in a region of interest at a higher resolution than the base resolution, the client device 110 may downscale the top-resolution image to a high-resolution image that resolves The resolution is higher than the base resolution (eg, 1080x810 versus base resolution 720x540), and a portion of the high-resolution image corresponding to the user-selected region of interest is displayed on the virtual lens 160 (step 555). The virtual lens 160 overlays the region of interest in the base resolution image. According to one embodiment, if the user requests a higher resolution image, the display may generate another higher resolution image at a higher resolution than the previous high resolution image, up to and including the resolution received from the server 120 The resolution of the top-resolution image is displayed on the virtual lens 160 corresponding to a part of the high-resolution image in the region of interest selected by the user. The virtual lens 160 can again be overlaid on the region of interest in the base resolution image. Additionally, in some embodiments, the display module may be configured to provide a user interface that enables a user to request changes in the size of the virtual lens and the resolution of the image displayed on the virtual lens 160 .

The method shown in FIG. 6 shows steps performed by the server 120 which correspond to the steps performed by the client device 110 shown in FIG. 5 . Server 120 receives a request from client device 110 for a top resolution image (step 610). If the image is access-restricted, the server 120 may check whether the user or client device 110 has and has access rights to the requested image in accordance with access control regulations (step 620). According to one embodiment, the request sent by the client device 110 may include identifying information associated with the user or client device 110, which may be used to decide whether to authorize the user or client device 110 to store, generate, or input to the server 120 access rights to image content.

Server 120 determines whether the user or client device 110 has access rights to the requested image (step 625). If the user does not have access rights to the requested image, server 120 may be configured to optionally send a message to client device 110 indicating that either the user or client device 110 does not have access rights to the requested image content (step 660 ). Otherwise, if the user has access to the requested image, server 120 may generate a top-level resolution image from an associated image of equal or higher resolution that was previously generated, stored, or imported onto server 120, and pass Network 130 transmits this top-level resolution image to client device 110 (step 630).

Various optimizations are available for client downscaling methods, including preloading top-resolution images in anticipation that the user will ask to view them (for example, if the image is the next in a series of different images to view).

The client downscaling method can be used together with the continuous download method. For example, in one embodiment, a custom downscaling method may be used for a specific resolution. The continuous download method can be used when high-resolution images above a threshold are requested. In this case, the top-resolution image downloaded for the client downscaling method can be lower than the maximum resolution available on the server. Alternatively, the continuous download method can be used up to a specific resolution and the custom downscaling method used above a predetermined resolution threshold. In some embodiments, a combination of these two approaches can be used to optimize various performance parameters for certain usage scenarios.

server combination method

Figures 7 and 8 illustrate a server combination method that may be used with the image viewing system 100 according to one embodiment. According to an embodiment, the steps of the method shown in FIG. 7 may be executed on the client device 110 . FIG. 8 shows steps of a method that may be performed by the server 120 .

The method of FIG. 7 begins when the client device 110 receives a request to view an image at the client device (step 710). According to one embodiment, the request may include the user accessing a file or image from an application. In other embodiments, the request may include the user accessing a particular web page or other content from a viewer application running on the client device 110 . In yet another embodiment, the request may include the user executing an application on the client device 110 using the high-resolution image content retrieved from the server 120 .

In the example of FIG. 7, client device 110 sends a request to server 120 for a base resolution image corresponding to the image originally requested by the user (step 720). According to one embodiment, the display module on the client device 110 may be configured to process a request for an image from the client device 110 application and send a request to the server 120 via the network 130 for a basic image corresponding to the image originally requested by the user. resolution image.

Client device 110 determines whether an image is received from server 120 (step 725). According to one embodiment, if access to images is restricted, server 120 may determine, based on access control regulations, whether the client device user or client device 110 (or both) is granted permission to view the requested image content. According to one embodiment, the request sent by client device 110 may include identifying information associated with the user or client device 110 that may be used to determine whether it should be granted permission to store, generate, or input image content on server 120 access permission. If the user does not have access rights to the requested image, server 120 may optionally send a message to client device 110 indicating that the user or client device 110 does not have access rights to the requested image content. According to one embodiment, the client device 110 may also be arranged to log the time elapsed since it sent a request to the server 120 and indicate that the request timed out if the base resolution image has not been received within a predetermined amount of time.

If an image cannot be received from server 120, client device 110 may optionally display a message to the user indicating that the requested image cannot be accessed (step 760). According to some embodiments, the detailed error message may describe why the image cannot be accessed. For example, the information may be that if no response is received within a predetermined amount of time, indicating that the request timed out, or that the user is not authorized to view the requested content.

If an image is received from server 120, display area 150 of client device 110 may display its base resolution image (step 730). According to one embodiment, the display of the client device may be configured to resize the base resolution image according to the space available in its display area.

Client device 110 may then receive a request from the user to view a high-resolution image of the region of interest (step 735). According to one embodiment, a user may use an input device, such as a pointing device including a mouse, touch screen, touch pad, joystick, trackball, arrow keys, buttons, or other input device, to enable the user to select an object of interest within the base resolution image. area to view its high-resolution image.

The client device may then send a request to the server 120 for a combined image including the base resolution image and a virtual lens showing the high resolution image overlaid on the base resolution image for the region of interest (step 740). According to one embodiment, the request may include the coordinates of the image relative to the region of interest, the desired resolution level of the high resolution image, and the size and shape of the virtual lens. The desired resolution range may be above the resolution of the base resolution image and up to the resolution of the maximum resolution image stored, generated, or input on the server 120 . The request may specify one or more regions of interest, each with its specific location, resolution, and size and shape of the virtual lens.

According to one embodiment, the request may include a set of reference coordinates on the base resolution image corresponding to the region of interest. For example, in some embodiments, the client device 110 is configured so that the user can draw a rectangle on the base resolution image to show an area of interest that the user wishes to view in high resolution, and request a high resolution image from the server 120 The provided coordinates for the resolution image, that is, the coordinates of the upper-left and lower-right corners of the rectangle, or the coordinates of the upper-left and width plus height of the rectangle. According to one embodiment, the display module may be configured to convert the screen coordinates on the base resolution image into pixel coordinates, and the request to the server to send the high resolution image may include the pixel coordinates of the region of interest specified by the user. According to another embodiment, the client device 110 may provide a user interface by which the user may drag or move a cursor or a shape, such as a rectangle or an ellipse, to the position of the region of interest of the base resolution image in order to receive the corresponding A high-resolution image of the area indicated by the cursor or covered by a shape.

Client device 110 determines whether a combined image has been received from server 120 (step 745). If an image is not received from server 120, client device 110 may optionally display a message to the user indicating that the requested image cannot be accessed. Otherwise, if the requested combined image is received from the server 120, the client device 110 may replace the high resolution image with the combined image in its display area 150 (step 755).

According to another embodiment, to improve response time, the combined image may be downloaded from the server 120 before the user requests to view the local high-resolution image in the virtual lens 160 . In such an embodiment, the combined image is not displayed until requested by the user. According to one embodiment, the prefetching of the combined image may be initiated by some user action, triggering the client device 110 to send a request to the server 120 . For example, in some embodiments, the request to download the combined image may be made when the base resolution image is requested from the server 120, or shortly after the base resolution image is received from the server. If the region of interest can be predetermined before the user actually requests that part of the image, its request can be issued. For example, when displaying a route on a map, the areas of interest might be the origin and destination. More than one such image of different areas of interest or different high resolution levels may be prefetched. Additionally, in other embodiments, the client device 110 may be configured to respond to the user pressing a soft or hard key (eg, an "image viewing system activation" button), or clicking a pointing device button or other button or key. Continue this pre-downloading technique, request to download the next combined image to be displayed on the virtual lens with a higher resolution after each combined image is downloaded, and continue until the maximum resolution is reached.

According to one embodiment, client device 110 may be configured to allow a user to move virtual lens 160 overlaid on the base resolution image in display area 150 . In one embodiment, the client device 110 is configured to allow a user to move the virtual lens by using a pointing device, such as a mouse, touchpad, touchscreen, joystick, trackball, arrow keys, or buttons. In one embodiment, the display module of the client device 110 is configured to request the combined image from the server 120 in real time. As the user moves the cursor across the base-resolution image, the position of the cursor relative to a reference point on the base-resolution image indicates the location of the combined image of the region of interest, all of which are displayed at the same resolution level at the same size and shape on the virtual lens. When a new combined image is received, client device 110 may display the new combined image in place of the previously received combined image. With the server-combined approach, the ability to track cursor movement and change the location and content of the region of interest and virtual lens, in turn, relies on a high-bandwidth, low-latency network 130 and responsive server 120 . According to one embodiment, the coordinates of the region of interest are determined taking into account the position of the cursor in the base resolution image on the display relative to a reference point, such as the upper left corner of the image. In one embodiment, the display module may also take into account whether the user has scrolled the display on the client device display and adjust the amount of horizontal or vertical scrolling (or both).

According to one embodiment, the display module of the client device 110 may be configured to allow a user to request a change in the resolution level of the high resolution image displayed on the virtual lens 160 . According to one embodiment, the display module may be configured to provide user interface controls, such as soft buttons, sliders, pointer device controls, or other types of interface components, that allow the user to interactively select the desired high-resolution display on the virtual lens 160. The resolution level of the high-rate image. In one embodiment, the user selects the resolution level of the images displayed in the virtual lens 160 , up to the maximum resolution of the images it stores, generates, or imports to the server 120 . In one embodiment, the user may select resolution levels up to a maximum resolution and greater than the base resolution.

In response to a request to change the resolution of the portion of the image displayed by its virtual lens 160, the display module may be configured to send a request to the server 120 to obtain an image comprising the base resolution image and superimposed on the base resolution image corresponding to the selected sense of touch. The region of interest displays the combined image of the virtual lens of the high-resolution image at the selected resolution level.

According to an embodiment, the display of the client device 110 may also be set to allow the user to change the size of the resolution of the virtual lens 160 and the image displayed by the virtual lens 160 . According to one embodiment, the display may provide controls including soft buttons (buttons or other interface components displayed on the client device display and selected by a pointing device), hard buttons (keyboard or other buttons or switches), or pointer Device controls (eg, left or right mouse button clicks, mouse up or down buttons, scroll wheel controls, trackball controls, touch controls, or other pointing device controls). According to one embodiment, the display may also be configured to provide controls that allow the user to freeze the virtual lens at its current position (i.e., stop it from tracking pointing device motion), or unfreeze the virtual lens (resume it to track pointing device motion). According to one embodiment, the display may also be configured to provide controls enabling the user to turn off the virtual lenticular display so that no high resolution image is superimposed on the full base resolution image it displays, or to turn the virtual lenticular display back on. Some controls may perform functions such as changing the size of the virtual lens and the resolution of the image displayed by the virtual lens 160 . For any change in the size or position of the virtual lens 160, or to change whether the virtual lens 160 is displayed or hidden, the client device 110 may send a request to the server 120 for a new combined image, unless a matching combined image is already available on the client side. on the memory 100 of the device. Upon receiving this combined image, client device 110 may display the new combined image in place of the previous combined image.

The method shown in FIG. 8 is steps taken by the server 120 corresponding to the steps performed by the client device 110 in FIG. 7 . Server 120 receives a request from client device 110 for a base resolution image (step 810). If access to the image is restricted, server 120 may check whether the user or client device 110 (or both) has access to the requested image in accordance with access control regulations (step 820). According to one embodiment, the request sent by client device 110 may include identifying information associated with the user or client device 110 that may be used to decide whether it should be granted access to image content stored, generated, or input to server 120 authority.

Server 120 determines whether the user has access rights to the requested image (step 825). If the user does not have access rights to the requested image, the server 120 may be arranged to send a message indicating that the user does not have access rights to the requested image (step 860). Otherwise, if the user or client device 110 has access to the requested image, the server 120 may generate a base resolution image from its stored, generated, or imported image (step 830). According to some embodiments, a base resolution image for a particular high resolution image may already be generated. In one embodiment, the server may be configured to generate a base resolution image for each high resolution image uploaded, generated on, or input to the server 120 . In some embodiments, the resolution level of a base resolution image may be set according to the properties of the client device whose image is displayed. For example, server 120 may be configured to generate a base resolution image, which has a lower resolution for a mobile device, such as a mobile phone, which typically has a smaller display, while server 120 may also be configured to generate a base resolution image. Images with higher resolution for laptop or desktop computer systems with larger displays and higher resolutions. Server 120 may then send the base resolution image to client device 110 via network 130 (step 835).

The server 120 may then receive a request from the client device 110 for the combined image, the request including the coordinates of the region of interest, the resolution levels of the base resolution image and the overlaid high resolution image, and the size and shape of the virtual lens (step 840). If access to the image is restricted, server 120 may again determine whether the user or client device 110 has access to the requested image in accordance with access control regulations (step 845). If the user does not have access to the requested image, the server 120 may be arranged to send a message to the client device 110 indicating that the user does not have access to the requested image (step 860). Otherwise, server 120 may generate or retrieve from memory a combined image comprising the base resolution image and a virtual lens overlaid on the region of interest and displaying a high resolution partial image of the region of interest specified in the request (step 850 ). In one embodiment, the resolution of the high resolution image may be equal to the maximum resolution of the image stored, generated, or input to the server 120 . The resolution of the high-resolution image may also be less than the maximum resolution of the image it stores, generates, or inputs to the server 120, but greater than the resolution of the base-resolution image provided to the client in step 835. Server 120 may then send the combined image generated in step 850 to client device 110 via network 130 (step 855). According to some embodiments, a request is received from client device 110 , which may specify the resolution level it used to generate the partial high resolution image in step 350 . For example, a request for a high-resolution image executed by an application on client device 110 may include a user interface that includes a "zoom" tool that enables the user to select the resolution at which the high-resolution image is displayed on virtual lens 160. rate level. In some embodiments, the server 120 may cache the combined image generated in response to the client's request, so that if another request for an image of the same resolution level is received in the future, the server 120 does not have to generate the combined image again.

According to some embodiments, various optimizations may be applied to the server composition method. For example, in some embodiments, combined images may be preloaded by the client device in anticipation of user requests to view these images. In some embodiments, the resolution level of the base resolution image may be determined according to the properties of the client device displaying the base resolution image, bandwidth, and delay characteristics of the network 130 connecting the client device 110 and the server 120 . For example, server 120 may be configured to generate a base resolution image with a lower resolution for a mobile device, such as a mobile phone, which typically has a smaller display screen. While the server 120 may also be configured to generate base resolution images with higher resolutions for laptop or desktop computer systems with larger display screens and higher resolutions. The resolution level of the high resolution image corresponding to the base resolution image may also be adjusted according to the properties of the client device 110 .

collaborative approach

According to another embodiment, the image browsing system 100 may be configured to allow a first user to select an area of interest, resolution, and shape and size of a virtual lens on behalf of a second user. This technology can be used in applications such as collaboration or teaching. In one embodiment, the first user's selection may be stored for use when the second user requests the image. The selected parameters may be communicated to the second user's client device 110 to send an image request to the server, or may be stored on the server 120 for use when the second user requests an image. Using this technique, the second user can bypass the steps of selecting the region of interest, the resolution level of the high-resolution image, and the shape and size of the virtual lens, since these selections have already been made by the first user. In one embodiment, this technique may be used in conjunction with a continuous download approach, a client downscaling approach, or a server composition approach. Either way, the first user may specify selection parameters for the second user. In another embodiment, the first user may enter the selection parameters through the client device, eg by means of menus or commands. In one embodiment, either the continuous download method, the client-side downscaling method, or the server combination method can be used by the second user to retrieve or determine the step of his selection parameters instead of selecting the region of interest, high-resolution The resolution level of the image, and the shape and size of the virtual lens. Then, methods such as continuous downloading method, client-side downscaling method, or server combination method can be used to, for example, move the virtual lens or change the size and shape of the virtual lens, or change the resolution of the high-resolution image displayed in the virtual lens Rate. In one embodiment, this collaboration can be done in real-time, for example, by the first user moving the virtual lens for the second user, or changing the resolution of the image displayed in the virtual lens, or changing the size or shape of the virtual lens, etc.

9A and 9B show a flowchart of a collaboration method that may be configured on a client device in an image viewing system. FIG. 9A illustrates a method for specifying a set of selection parameters for displaying an image for a second user, according to one embodiment. Selection parameters may include region of interest, resolution specification, virtual lens specification, and other display parameters or combinations thereof. The resolution specification may include the resolution of the base resolution image and the resolution of the high resolution image, or the ratio of high resolution to base resolution, or an equivalent amount thereto. Resolution ratios can be used to enable the first user's client device and the second user's client device to display base-resolution images at different resolutions (for example, when the The second user's client device displays the portion of the high-resolution image with a high-resolution increase rate relative to the base resolution that matches the increase rate used by the first user. The virtual lens specification includes the shape of the virtual lens and the absolute size of the virtual lens or the size relative to the base resolution image.

The first user specifies selection parameters to be used by the image browsing system 100 for displaying images for the second user (step 910). The first user may then communicate the selection parameters to the second user (step 920). According to an embodiment, the first user may send selection parameters from said first user's client device 110 to the second user's client device 110 . For example, for a web application, the first user may send selection parameters via email including a Uniform Resource Locator (URL) link that includes the selection parameters in the query string. When the link is clicked by the second user, the e-mail client at the second user's client device 110 transmits this link to the browser, which can then ask the web page containing these logic to request from the server 120 the partial high-resolution rate the image and present it on a display screen of the second user's client device. The high-resolution image corresponding to the specified region of interest of the base-resolution image is displayed at the specified resolution on a virtual lens of the specified size and shape that overlays the specified region of interest of the base-resolution image area. In another embodiment, a first application running on a first user's client device 110 may send selection parameters to a second application running on a second user's client device 110 . In another embodiment, an application running on the client device 110 of the first user may send selection parameters to the server 120 for retrieval and retrieval by an application running on the client device 110 of the second user. use. In another embodiment, the selection parameter may be derived by a computer program by the first user's client device, the second user's client device, or the server. The calculation program can be used in combination with user input. As an exemplary embodiment, in a map application, a computing program can locate a specific location on the map, such as the origin or destination of a route. The computing program may also allow a route to be tracked at high resolution over a period of time or in response to user input. As another example, for video, a computing program may be used to track moving objects over time with high resolution video overlaid on a base resolution video range. Its initial position and characteristics of the object can be specified by the user.

The method shown in FIG. 9B is used to receive a set of selection parameters and a requirement to display an image, and request an image from the server 120, according to an embodiment. Client device 110 receives a request from a second user to view images corresponding to the selected parameters (step 930). The second user may specify selection parameters for displaying the requested image, or logic executing on the second user's client device 110 may automatically determine the presence of selection parameters for his image and use to process the display of the corresponding image. The following conditions can be used to determine the existence of selection parameters, that is, whether the selection parameters are obtained from the client device of the first user, or query the selection parameters from the server through the network, or whether they are available on the client device of the second user. Calculation procedure to generate selection parameters. The client device 110 then sends a request to the server 120 requesting an image (step 935). The request includes some or all of the selection parameters, depending on the method used. In one embodiment, for the continuous download method, the client device 110 sends a single request or a combined request to the server 120 for the base resolution image and the high resolution image (or a portion of the high resolution image). The client device 110 may determine the base resolution and high resolution levels based on selection parameters, the available display space of the client device 110 , and the capabilities of the network 130 . When requesting a high-resolution image of a portion, the client device 110's request includes the coordinates of a reference point corresponding to the image or a set of coordinates for a reference object, the region of interest, the resolution level of the high-resolution image, and the The dimensions and shape of a high-resolution image of the requested part. These parameters are derived from selection parameters and can be adjusted according to the function of the second user's client device 110 or the function of the network 130 connecting the second user's client device 110 to the server 120 . In another embodiment, for the client-side downscaling method, the client device 110 sends a request to the server 120 for a top-level resolution image. Its top resolution level may be determined from selection parameters and capabilities of client device 110 and network 130 . In another embodiment, for the server combination method, the client device 110 sends a request to the server 120, which includes the base resolution level, the high resolution level, the coordinates of the region of interest relative to the reference point, and the size of the virtual lens and shape, all of which can be determined from selection parameters and can be modified according to the capabilities of the client device 110 and network 130.

Client device 110 determines whether the requested image has been received from server 120 (step 945). According to one embodiment, if an image is restricted from access, the server 120 may determine whether the client device 110 or its user (or both) is authorized to view the requested image based on access control regulations. According to one embodiment, the request sent by client device 110 may include identifying information associated with the user or client device 110, which server 120 may use to determine whether it should be granted access to images stored, generated, or input to server 120 Content Access Rights. If the user does not have access to the requested image, server 120 may choose to send a message indicating that the user of client device 110 or client device 110 does not have access to the requested image. According to one embodiment, the client device 110 may also be configured to record the time elapsed after sending the request to the server 120 . If a base resolution image is not received within the predetermined time, the request times out.

If an image is not received from server 120, client device 110 may choose to display a message indicating to the user that the requested image cannot be accessed (step 960). According to some embodiments, the detailed error message may describe why the image cannot be accessed. For example, if a response is not received within a predetermined amount of time, indicating that the request has timed out, or indicating that the user is not authorized to view the requested content.

If client device 110 receives the requested one or more images from server 120, client device 110 may display the requested images using selection parameters provided by the first user or computing program (step 950). In one embodiment, when the second user uses the continuous downloading method, the client device 110 can receive the base resolution image and the high resolution image from the server 120, and display the base resolution image and the overlay at the region of interest position A high-resolution image corresponding to the region of interest. In one embodiment, when the second user uses the client-side downscaling method, the client device 110 may receive the top-resolution image and use it to generate the base-resolution image and the high-resolution image. Client device 110 may then display the base resolution image with a high resolution image corresponding to the region of interest superimposed at the location of the region of interest. In one embodiment, the client device 110 may receive and display the combined image when the second user uses the server combination method.

FIG. 10 is a flowchart of a collaboration method, which can be configured on the server in the image browsing system described in FIG. 1 . The method in Figure 10 illustrates the steps taken by the server 120 corresponding to the steps performed by the client device 110 in Figures 9A and 9B. The server 120 receives an image request from the second user's client device 110 based on certain selection parameters (step 1010). If the image is restricted, the server 120 may check whether the second user or its client device 110 has access rights according to the access control regulations (step 1020). According to one embodiment, the request sent by client device 110 may include identifying information associated with the user or client device 110, which may be used by server 120 to determine whether it should be granted access to images stored, generated, or imported onto server 120. Content Access Rights.

The server 120 determines whether the user or the client device 110 (or both) has access rights to the requested image according to the access control policy (step 1025). If the user does not have permission to access the requested image, server 120 may choose to send a message indicating that the user of client device 110 or client device 110 does not have permission to access the requested image (step 1060). Otherwise, if the user has access to the requested images, the server 120 may generate the requested image or images according to the selection parameters (step 1030) and send them to the client device 110 via the network 130 (step 1035). In one embodiment, for the continuous download method, the image request may be for a base-resolution image, a high-resolution image, or a portion of a high-resolution image, or both a base-resolution image and a high-resolution image, or both a part of. Server 120 may generate and send the requested image to client device 110 . In another embodiment, for the client-side downscaling method, the image request may be for an image with a top-level resolution, and the server 120 may generate the top-level resolution image and send it to the client device 110, whose top-level resolution is less than or Equal to the resolution of the largest resolution image it generates, inputs to or stores on server 120 . In another embodiment, for the server combination method, the image request may include selection parameters that can be adjusted with the functions of the client device 110 and the network 130, and the server 120 may combine the images according to the selection parameters and transmit them to the client device 110.

According to another embodiment, the region of interest and other selection parameters may be selected for the user by a computing program executing on the client device 110 or the server 120 . For example, for maps, the origin or destination of a road, and for medical imaging, a specific anatomical feature or abnormality.

additional method

Other additional methods can optionally be used in conjunction with the continuous download method, client downscaling method, server combining method, and cooperative method described above. Some examples of these methods are described below.

The method described in one embodiment is used to prevent the virtual lens 160 from extending beyond the boundary of the base resolution image. In the above method, the display module of the client device 110 adjusts the virtual lens and the high-resolution image part of the region of interest in the base-resolution image displayed by the virtual lens to the center. This portion of the high-resolution image is displayed on the virtual lens over the region of interest selected in the base-resolution image. In one embodiment, the display module of the client device 110 may be configured to determine whether the virtual lens 160 will extend beyond the border of the base resolution image, and may also be configured to determine the amount by which the virtual lens extends past the border of the base resolution image. Compensates for positional shifts of the virtual lens and the high-resolution image displayed within it. In one embodiment, the display of the client device 110 can adjust the size and shape of the virtual lens and compensate for the positional shift of the virtual lens 160 to improve the functionality of the application program that is using the virtual lens 160 . For example, in an e-reader application, the virtual lens can be placed over a column in a newspaper or periodical, and the display can be set so that the virtual lens 160 remains centered on the column as long as the user keeps the pointer/cursor inside the column .

According to another embodiment, the virtual lens may have a border to distinguish the virtual lens from the underlying base resolution image. Types of borders may include single-sided lines of various styles, thicknesses, and colors, multi-sided lines of various styles, thicknesses, and colors, and beveled or other types of edges. The frame of another type of virtual lens can reduce the size and resolution of the image part at the edge of the virtual lens, so that the transition between the high-resolution image displayed on the virtual lens and the basic resolution image will be smoother, and due to the high-resolution The size difference between high-resolution and base-resolution images with little or no loss of image parts. In such an embodiment, the virtual lens may be a bubble or raised area protruding above the base resolution image, the bubble or raised area having a relatively flat central portion and curved in the third dimension. edge (above the image). Some warped images appear on curved edges in the third dimension.

According to another embodiment, the display can be configured to freeze, at the user's request, regions and locations of interest displayed in high resolution in the virtual lens 160 so that the virtual lens cannot automatically track the movement of the pointing device. The display can also be configured to unfreeze the virtual lens 160 at the user's request so that the virtual lens position and content will automatically follow the pointing device.

According to another embodiment, the display can be configured to increase or decrease the size of the virtual lens 160, to change the shape, size, or boundaries of the virtual lens, to change the accessories displayed on the virtual lens, to increase the size of the image displayed on the virtual lens 160. resolution, up to the maximum resolution of the image stored, generated, or input to the server, reduced resolution of the image displayed on the virtual lens 160 up to but not including the base resolution, or any combination thereof. When the size of the virtual lens is increased or the shape is changed, if the portion of the high-resolution image in the memory of the client device 110 is insufficient to fill the virtual lens, the client device 110 can request the server 120 to send a large enough high-resolution image.

The display can also be configured to simultaneously change the resolution displayed in the virtual lens and the size of the virtual lens at the user's request. In addition, the display can also be configured to, upon user request, hide the virtual lens or reveal a previously hidden virtual lens. In addition, for example, for video pictures or other images that change over time, the display can be set to change the display of the basic resolution image in its changing time according to the frame rate of the video content or image content that changes over time, and change the display synchronously A high-resolution image corresponding to the base-resolution image displayed in the virtual lens. In one embodiment, the frame rate and base resolution video content and the high-resolution video content displayed in the virtual lens in the currently displayed frame can be synchronized so that the high-resolution video content displayed in the virtual lens Partially synchronized with video content at base resolution.

According to another embodiment, the image viewing system 100 may be configured to save the region of interest of the image selected by the user, the shape and size of the virtual lens, and the resolution displayed on the virtual lens. These parameters may be saved on the server 120 or client device 110 for the user for future retrieval and use.

These methods can be applied to various performance situations or timing conditions. The display can be configured to provide some indication to the user that the high-resolution image to be displayed by the virtual lens has not yet completed downloading from the server over the network. In addition, the display can be arranged to internally render display planes with virtual lenses on top of the base images, and from these planes the image to be displayed is computed. For example, the display module can be configured to insert an additional opaque plane between the virtual lens and the underlying base image when the virtual lens is not hidden. This opaque plane can be the same size and shape as the virtual lens and be located directly below the virtual lens. The display module can be configured to present an opaque plane when there is no image to be displayed on the plane of the virtual lens, for example, a high-resolution image has not yet been downloaded from the server.

According to one embodiment, multiple images can be supported in the image browsing system 100 . Image browsing system 100 may be configured to support multiple client devices 110 and users of client devices, each possibly viewing a different image. The image browsing system 100 may include multiple servers 120 . Multiple servers 120 may be used for load balancing purposes, for increased functionality and for failover in the event of a server failure or loss of network-to-server connectivity. Image browsing system 100 may be configured to support multiple networks 130 for load sharing or failsafe. The detection of the failure and the response of the failover may occur in the client device 110 , the server 120 , or the network 130 . Image browsing system 100 may be configured to support multiple virtual lenses 160 overlaid on the same base resolution image in image display area 150 . The image browsing system 100 may be configured to support multiple base resolution images and display them on different display areas on the client device 110, each base resolution image having one or more overlapping virtual lenses 160 to display its area of interest.

According to one embodiment, various security methods may be employed in the image browsing system 100 . For example, the image browsing system 100 can be configured to restrict public access to certain specified content on the server 120 . As part of access control enforcement, server 120 may employ various methods to verify the identity of the user of the client device (e.g., through a login procedure on client device 110, including username and password, security token, biometrics, asymmetric encryption methods, methods of asymmetric encryption and digital certificates, symmetric encryption methods, one-way hash methods, or other user authentication methods), and/or the identity of the client device 110 (e.g., using a passcode, asymmetric encryption method, asymmetric encryption and digital certificate method, symmetric encryption method, one-way hash method, or other device authentication methods). Whether or not access control is enforced on the client device 110, the user of the client device 110 or both the client device 110 and the user are determined by the access control policies of the system. When the user invokes the image browsing system 100 for the first time or another system invokes the image browsing system 100 on the user's behalf, the authentication performed may be for a specific viewing session. After performing the verification, the server 120 may assign a session identifier that is submitted with the client device 110 request. For example, for a web application, the server can store the session identifier in a cookie of the client device's 110 browser, and the browser can send the value of this cookie to the server along with the image request. According to one embodiment, the server may use authentication to authenticate user and/or client device 110 access to the requested image. The identification information, as well as the images themselves, may be protected using encryption (eg, using Transport Layer Security [TLS], IPSec for Internet Protocol Security, or other security protocols and encryption methods) as they are transmitted over the network 130 . In another embodiment, access control may be enforced based on rules that use information other than the identity of the user or device to determine access rights (eg, mandatory access control at a network or subnet level).

According to one embodiment, in order to improve its transmission time across the network 130 , the images may be compressed before being sent from the server 120 over the network 130 and then decompressed on the client device 110 . Compression can also be used on server 120 to reduce memory requirements.

According to one embodiment, the display on the client device 110 may be set to request an image at a specified resolution in anticipation that the user will request to view the image at that resolution. Or, in the case that the client device 110 does not give an explicit specified resolution or combined resolution or does not have an explicit image update request corresponding to a time change, the server 120 can be set to use a specific resolution or combined resolution The image is sent to the client device 110.

exemplary embodiment

For purposes of illustration, an exemplary embodiment of a continuous download method in an image viewing system is described below. There are also many other ways of implementing the method of the invention, as known to those skilled in the art.

In this embodiment, the display at the client device may consist of a viewer that renders a web page containing Hypertext Markup Language (HTML) or Extended HTML (XHTML) elements, Cascading Style Sheet (CSS) declarations, and The JavaScript code downloaded by the server. Other programming languages (such as Java, C#) can also be used instead of JavaScript.

In this embodiment, the display area 150 of the client device displaying the base resolution image may be an HTML div element with an identification code of graphics0. The z-index property of div elements can be set to 0. The display area containing the virtual lens 160 may be a div of the identification code of graphics2. The z-index property of the virtual lens div can be set to 2, and the div can have an initial border of 5 pixels wide. An additional opaque div with an identifier of graphics1 is placed between the virtual lens and the base resolution image. The added div's z-index property can be set to 1 and be the same size and size as the virtual lens. The pattern 1 div can have an opaque background (for example, a black background). The fourth div can also be positioned on the divs of the other three graphics3 (graphics3) identifiers. The fourth div can be the same size as pattern 0, and can be positioned exactly above pattern 0 with a solid border, transparent background, and empty content. All these divs can be positioned on the page with absolute coordinates.

A user of client device 110 may request to view an image using a user interface as described above. The display module receives the request, and in turn sends a request to the server 120 through the network, requesting to obtain the image with the basic resolution corresponding to the requested image. Server 120 may authenticate the user to determine whether the user is authorized to access the requested content. In one embodiment, if the user was logged into the server and the server has set a cookie containing the session identifier on the client device 110 viewer, the viewer sends the cookie containing the session identifier over a TLS encrypted connection to server. If the user is allowed to access the image, the server 120 can send the base resolution image to the client device 110, whereupon the display module can display the base resolution image of the pattern 0 div (either in the foreground or in the background)

According to one embodiment, the user can activate the image browsing system by clicking a button displayed on the user interface of the client device 110 . Then, the display module can set up a mouse move, mouse down, mouse hover, and mouse move out (mousemove, mousedown, mouseover, and mouseout) event handler (or similar touch screen event handler) for the div of pattern 3. The virtual lens can be configured to an initial rectangular size. The width of the virtual lens may start at 50% of the width of the pattern 0 div, while the height of the virtual lens may start at 50% of the height of the pattern 0 div. The code in the client device 110 then sends a request to the server to obtain a first high resolution image. The server performs the verification of its access rights according to the access control regulations. The server will send this high resolution image to the client device 110 if the user has access rights.

During the download of the high resolution image, the display module may be configured to blink an indicator light on the display to indicate that the high resolution image is being downloaded from the server. When the download is complete, the display module can provide the user with an indication that the download is complete and the system is ready. In addition, the display can change the cursor to show "waiting" (for example, an hourglass symbol on a PC) for download, and return to normal when the download is complete. When the download is complete, the display module sends a request for the next higher resolution image (if there is one) to the server 120 in anticipation of the user's request to view the next higher resolution image.

The user can click in the base image with a pointing device and ask a virtual lens showing that part of the high-resolution image to appear over the region of interest. The display can calculate where the virtual lens will be placed on the display. In one embodiment, the virtual lens is centered on the center point of the region of interest, unless such a central location would cause the virtual lens to overlap the border of the pattern 0 div. In such cases, the virtual lens may prevent such overlap by the amount needed to offset such that the center point of the corresponding region of interest is offset from the center of the virtual lens. The display module can then calculate the position of the high resolution image within the possibly offset region of interest, determining the upper left position within the high resolution image. The display module can put the inverse of these coordinates on the style background position property of the pattern2 div. The display module can also set the upper left position of the div of pattern 2 on the absolute position of the virtual lens on the page. The display module can then load a high resolution image onto the background of the pattern 2 div. The display module can also set the upper left position of the div of pattern 1 to match that of the div of pattern 2. While loading the high-res image, the pattern 1 div's opaque background will appear in place of the dummy lens.

As the user moves the cursor over the pattern 3 div via a pointing device, a mousemove event handler can track its movement and cause the virtual lens to change position to adjust the position of the portion of the high-resolution image shown within the virtual lens , so that the cursor position of the high-resolution image displayed by the virtual lens matches the cursor position of the underlying basic image.

When the user left-clicks on the pointing device, the display can freeze the position of the virtual lens. A subsequent left click unfreezes the virtual lens position and resumes tracking the cursor position. These steps can be repeated indefinitely. Alternatively, the display can unfreeze the virtual lens when the user presses the left mouse button, and then freeze the position of the virtual lens when the user releases the button. Likewise, with a touch screen, the display can unfreeze the virtual lens when the user touches it, and freeze the virtual lens when the user stops touching it.

When the user right-clicks on the pointing device, the display module can simultaneously increase the virtual lens size (the width and height of the pattern 2 div and the pattern 1 div) and the resolution displayed on the virtual lens. To do this, the display module can send a request to the server if the next higher resolution image has not yet been downloaded. After receiving the request, the server 120 verifies the user's access rights according to the access control regulations, and if the access is allowed, the requested image will be sent from the network to the client device. The display can display the portion of the image corresponding to the region of interest in a virtual lens. In some embodiments, to improve performance, the display module may request the next higher-resolution image as soon as the download of the current high-resolution image is complete, so that the downloaded next-resolution image can be viewed with the user. images at the current resolution overlap. If the download is not complete when the user requests the next resolution, the loading indicator will show accordingly, the cursor will change to "Waiting", and the opaque background of the pattern 1 div will be displayed at the virtual lens position. The display module can cache higher resolution images downloaded for the base image so that it can be revisited without re-downloading the image data.

The display can provide soft buttons on the display that optionally use a pointing device to increase or decrease the size of the lens (pattern 2div and the underlying pattern 1div), increase or decrease the resolution displayed in the virtual lens, and hide or show the virtual lens .

When the user moves to another image or other activity, the display module can automatically deactivate the image viewing system and the virtual lens display.

logical architecture

Figure 11 is a block diagram of the logical components of server 120 in one embodiment. According to one embodiment, the server 120 may be used to implement the processes shown in FIG. 3 , FIG. 6 , FIG. 8 , and FIG. 10 . The server 120 includes a network interface module 1110 , an image management module 1120 , an access control module 1130 , and a request processing module 1140 . Server 120 is also in communication with data storage 1150 for storing image and/or video content therefor. In some embodiments, the data storage 1150 can be a storage area configured on the server 120 (as shown in the figure), while in other embodiments, the data storage 1150 can be configured on an external server or computer system, directly or indirectly communicate with the server 120 through a wired or wireless network connection.

The network interface module 1110 may be configured to receive an image acquisition request from the client device 110 through the network 130 , and send the requested image to the client device 110 through the network 130 . The network interface module 1110 is configured to send incoming requests from client devices to the request processing module 1140 and to receive requested image transmissions from the request processing module 1140 to the client device 110 . For a collaborative approach, the network interface module 1110 may be configured to receive selection parameters from the first user's client device 110 and store them in the data storage area 1150 . The network interface module 1110 may also be configured to use a computing program to generate selection parameters. The network interface module 1110 is further configured to receive a request from the second user's client device 110 for obtaining selection parameters, retrieve the requested selection parameters from the data storage 1150 or generate selection parameters using a calculation program, and send the selection parameters to to the second user's client device.

Image management module 1120 is configured to receive image management requests regarding images (or other content, such as video content) stored in data storage 1150, access the images stored in data storage 1150, and provide the requested images to senders. on the requested module. The image management module 1120 is also configured to input images from an image input device or system 1160 and store its image data in the memory 1150 .

The request processing module 1140 is configured to receive an image request from the client device 110 via the network interface module 1110, send an image management request to the image management module 1120 to request retrieval of related images or other content such as video, generate the requested image , and send the requested image to the network interface module 1110 for transmission to the client device 110. In one embodiment, when using the continuous download method, the request processing module 1140 may generate the requested base resolution image, a high resolution image, or a partial high resolution image using an image retrieved from the image management module 1120, Its resolution is greater than or equal to the resolution of the requested image. In one embodiment, when using the client-side downscaling method, the request processing module 1140 can generate a top-level resolution image using the image retrieved from the image management module 1120, the resolution of the retrieved image is greater than or equal to the requested The resolution of the top resolution. In one embodiment, when using the server composition method, the request processing module 1140 may generate the base resolution image as if using the continuous download method. The request processing module 1140 may generate a combined image from the base-resolution image and the high-resolution image retrieved from the image management module 1120, or generate a base-resolution image and a high-resolution image from the retrieved top-resolution image, and then Its partial high-resolution image corresponding to the region of interest is superimposed on the region of interest of the corresponding base image. In some embodiments, the request processing module 1140 is configured to request the access control module 1130 to verify the access rights of the client device 110 or the user of the client device 110 (or both) to generate and send the requested image to the network Before the interface module 1110 is transmitted to the client device 110, it is determined whether to allow access according to access control regulations.

The access control module 1130 may be configured to, if an image is restricted to access, determine whether to allow access to the requested content according to access control regulations. If access to the image is restricted, the access control module 1130 may determine whether the user of the client device 110 or the client device 110 (or both) has access rights to the image for which access is requested, based on access control regulations. If the user or device does not have access rights to the requested image, the authentication module may optionally send a message indicating that the user or device does not have access rights to the requested image. The request processing module 1140 can send an authorization request to the access control module 1130 to determine whether the user or the user's equipment is authorized to access the requested image, and the access control module 1130 can send an authorization response to the request processing module 1140 to indicate to the user Or whether the client device has permission to access the image.

FIG. 12 is a block diagram of the logical components of client device 110 in one embodiment. According to one embodiment, the client device 110 may be configured to implement the processes shown in FIG. 2 , FIG. 5 , FIG. 7 , and FIG. 9 . The client device 110 includes a network interface module 1210 , an image management module 1220 , a user interface module 1230 , and a request processing module 1240 . According to some embodiments, the client device 110 may also communicate with a data store 1250 for storing image and/or video content therefor. In some embodiments, the data storage 1250 may be a storage area configured on the client device 110 (as shown in the figure), while in other embodiments, the data storage 1250 may be configured on an external server or computer system, Communicate with the client device 110 directly or indirectly through a wired or wireless network connection.

The network interface module 1210 may be configured to send a request for obtaining image content from the client device 110 to the server 120 through the network 130 , and receive the image sent to the client device 110 through the network 130 . As mentioned above, the content of the images may include still images as well as video content. For a collaborative approach, the network interface module 1210 may be configured to receive selection parameters set by the first user and send their selection parameters to the server 120 via the network 130 for transfer to the second user's client device 110, or directly to the second user's client device 110. The client device 110 of the second user. The network interface module 1210 on the second user's client device 110 may be further configured to send a request for acquiring selection parameters to the server 120, and receive the selection parameters from the server 120 or the first user's client device.

The image management module 1220 is configured to receive a request for an image with a predetermined resolution, and return the image with a predetermined resolution to the requester. If the image is in data storage 1250 , image management module 1220 will retrieve the image from data storage 1250 instead of requesting its image from server 120 . If the requested image is not in the data storage 1250, the image management module 1220 will send a request to the network interface module 1210 for transmission to the server 120, and receive the image from the server 120 on the network interface module 1210, and cache the image in the data in memory 1250. Image management module 1220 returns its image to the requesting module.

As shown in FIGS. 1 and 4 , user interface module 1230 may be configured to accept user input from input device 1270 and display images (and other information) on display 1260 . The user interface module may display the base resolution image 150 and show the high resolution image in a virtual lens 160 superimposed on the base resolution image. According to some embodiments, the user interface module 1230 (and some or all of the other modules shown in FIG. Invoked device drivers, such as viewer applications or other applications that may execute on client device 110 . User interface module 1230 may also receive input from one or more input devices 1270, such as buttons, keys, pointing devices, or other input devices that allow a user to interact with the image viewing system. For example, the user interface module 110 may provide controls enabling a user to select a region of interest, the size of the virtual lens and/or the resolution of the image displayed by the virtual lens.

The user interface module 1230 may also be configured to receive a request for base resolution or high resolution image content from a user, and instruct the request processing module 1240 to retrieve or generate the requested image, and display the image content from the request processing module 1240 on the display 1260 received image. According to some embodiments, user interface module 1230 may be configured to send a request to request processing module 1240 to obtain a base resolution image, or to have a portion of a high resolution image corresponding to a region of interest in a base resolution image and Combined image overlaid on the corresponding region of interest. The user interface module 1230 displays the image requested by the user received from the request processing module on the display 1260 . For a collaborative approach, the user interface module 1230 may send the selection parameters set by the first user to the network interface module 1210 for transmission to the server 120 for retrieval by the second user, or the user interface module 1230 may send the selection parameters either directly from the network or via a transmission device The selection parameters set by the first user are sent to the client device 110 of the second user.

The request handling module 1240 may be configured to receive image requests from the user interface module 1230 . The request can be a base resolution image. In one embodiment, if the selection parameters have been set by the first user for the second user, or generated for the second user by a computer program, and the image request is from the second user, the request processing module 1240 may base on its Select parameters to generate a combined image. For the basic resolution image, when using the continuous download method or the server combination method, the request processing module 1240 sends a request to the image management module 1220 to obtain a certain basic resolution image, and receives the basic resolution image from the image management module 1220 . When using the client downscaling method, the request processing module 1240 sends a request to the image management module 1220 to obtain the top resolution image, and receives the top resolution image from the image management module 1220, and then generates its Base resolution image. The request processing module 1240 sends a user's request for a base resolution image to the user interface module 1230 to display the base resolution image on the display 1260 . For combined images, when using the continuous download method, the request processing module 1240 sends a request to the image management module 1220 to obtain a base resolution image and a partial high resolution image corresponding to the region of interest. The request processing module 1240 receives the requested base resolution image and high resolution image from the image management module 1220, and then, the request processing module 1240 generates the combined image requested by the user, that is, the base resolution image together with the base resolution image superimposed on the base resolution A portion of the high-resolution image corresponding to the region of interest at the corresponding region of interest position on the image. When using the client-side downscaling method, the request processing module 1240 requests an image at the top resolution from the image management module 1220 . Once the top-level resolution image is received, the request processing module 1240 will generate the base-resolution image and the high-resolution image from it, and then generate the combined image requested by the user, which is the base-resolution image together with an overlay on the base-resolution image A portion of the high-resolution image corresponding to the region of interest at the corresponding region of interest location. When using the server combination method, the request processing module 1240 requests a combined image from the image management module 1220 . The request processing module 1240 sends the combined image generated using any of these methods to the user interface module for display on the display 1260 .

For the collaborative method, the request processing module 1240 of the client device 110 of the second user may be configured to request from the network interface module 1210 the selection parameters set by the first user for the second user, and receive them from the network interface module 1210 Select parameters. The request processing module 1240 may also be configured to calculate program generation selection parameters. The request processing module 1240 may be configured to use the selection parameters to generate its combined image with specific selection parameters, and send the combined image to the user interface module 1230 for display on the display 1260 . When generating the combined image, the request processing module may be configured to use the continuous downloading method, the client downscaling method, or the server combining method as described above.

Those skilled in the art will understand that various exemplary modules and method steps related to the above-mentioned figures and the embodiments disclosed herein can generally be realized by electronic hardware, software, firmware or a combination thereof. To clearly illustrate this interchangeability of hardware and software, various illustrative modules and method steps have been described above generally in terms of their functionality. Whether this function is implemented by hardware or software depends on the specific application and the design constraints of the overall system. Skilled artisans may implement the functionality described herein in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention. Also, the grouping of functions or steps within a module is for convenience of description. Specific functions may be transferred from one module or step to another without departing from the invention.

In addition, the various exemplary modules and method steps described in the embodiments disclosed herein can be implemented by hardware, such as: general purpose processors, digital signal processors (“DSPs”), application specific integrated circuits (“ASICs”), field programmable Programmed gate arrays ("FPGAs"), or other programmable logic devices, discrete gate or transistor logic, discrete hardware components, or combinations thereof to implement or perform the functions described above. A general purpose processor is hardware and can also be a microprocessor, but in the alternative, the processor can be any hardware processing controller, microcontroller. A processor may also be implemented by a combination of computing devices, eg, a combination of a DSP and a microprocessor, a multi-body microprocessor, one or more microprocessors with a DSP core, or any other similar configuration.

In addition, the methods or calculation program steps described in the embodiments disclosed herein may be directly embodied by hardware, software modules executed by a processor, or a combination of both. Software modules can reside in computers or controllers on readable storage media, including RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM, or any other access In the form of storage media including network storage media. An exemplary storage medium may be coupled to the processor such that the processor can read information, and write information to the storage medium. In another example, the storage medium can be integrated into the processor. Processors and storage media can also reside in an ASIC. According to some embodiments, the software module may reside on a non-transitory computer readable storage medium.

The above description of the embodiments disclosed herein is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles described herein may be applied to other embodiments without departing from the spirit and scope of the invention. Accordingly, the description and drawings herein should be considered to represent several exemplary embodiments of the invention, and are therefore representative of the subject matter for which the invention is generally contemplated. It must be further realized that the scope of the present invention encompasses all other embodiments and that the scope of the present invention is not limited by anything other than the appended claims.

Claims (215)

1. a computer-implemented method is used for it is characterized by at the local high-definition picture of the context-sensitive of base resolution image, and one or more processors programme to carry out following steps, comprising:

Client device receives request, to check image;

Transmit a request to server by network, require to obtain the base resolution image corresponding to the image of asking;

Receive this base resolution image by network from server;

Show this base resolution image on the display of client device;

Reception shows the request of the area-of-interest of this base resolution image with high-resolution;

Transmit a request to server by network, require to obtain the high-definition picture corresponding to this base resolution image;

Receive this high-definition picture by network from server; With

Show the high-definition picture corresponding to this area-of-interest in the position that is overlapped in area-of-interest on the base resolution image, wherein said overlapping layer has comprised a virtual lens;

Follow the tracks of the movement of the cursor of being controlled by pointing apparatus on the base resolution image of client device;

The position of the cursor on the corresponding base resolution image of root a tree name, the virtual lens on mobile corresponding base resolution image;

The position of the cursor on the corresponding base resolution image of root a tree name is along with virtual lens moves across corresponding base resolution image, the high-definition picture of the part of update displayed in virtual lens.

2. in the 1st described method of Patent right requirement, the resolution of described base resolution image is less than the resolution that generates, inputs or be stored in the ultimate resolution image on server.

3. in the 1st described method of Patent right requirement, the resolution of described high-definition picture is less than or equal to the resolution of ultimate resolution image, and the resolution of described high-definition picture is greater than the resolution of base resolution image.

4. in the 1st described method of Patent right requirement, further comprised:

Client device receives request, to adjust the size of virtual lens;

Adjust the size of virtual lens;

Client device need to determine whether the high-definition picture of greater part;

If need the high-definition picture of greater part, transmit a request to server to obtain the high-definition picture of greater part;

Receive the high-definition picture of greater part from server; With

Show that the high-definition picture of greater part is in virtual lens.

5. in the 1st described method of Patent right requirement, further comprised:

Client device receives request, the resolution of the high resolution graphics that shows with the change virtual lens;

Transmit a request to server, require to obtain the high-definition picture corresponding to the given resolution of base resolution image;

Receive this high-definition picture from server; With

Demonstration is corresponding to the high-definition picture of the part of area-of-interest, and this high-definition picture overlaps the position of area-of-interest on corresponding base resolution image.

6. in the 1st described method of Patent right requirement, show that on the display of client device this base resolution image further comprises:

Determine that whether the base resolution image surpasses the size of the viewing area that this base resolution image will be shown therein; With

Show the part of base resolution image in the viewing area; And

The position of the cursor on the corresponding base resolution image of root a tree name wherein, the virtual lens on mobile corresponding base resolution image also comprises:

Determine whether virtual lens has reached the edge of viewing area; With

If virtual lens has reached the edge of viewing area, stop the movement of virtual lens and scrolling base resolution image on the direction opposite with the movement of being indicated by pointing apparatus.

7. in the 6th described method of Patent right requirement, with the direction opposite by the movement of pointing apparatus indication on scrolling base resolution image also comprise: with the direction opposite by the movement of pointing apparatus indication on scrolling base resolution image until stopped or the edge of base resolution image and the justified margin of viewing area by the movement of pointing apparatus indication.

8. in the 1st described method of Patent right requirement, further comprised:

The response user instruction freezes virtual lens corresponding position on the base resolution image.

9. in the 8th described method of Patent right requirement, in the 27th described method of Patent right requirement, further comprised:

The response user instruction, the virtual lens corresponding position on the base resolution image that thaws and before freezed.

10. in the 1st described method of Patent right requirement, the described high-definition picture part that is shown in virtual lens that receives from server has further comprised:

Add upper side frame around virtual lens, so that virtual lens is divided out from the base resolution image.

11. in the 1st described method of Patent right requirement, the described high-definition picture part that is shown in virtual lens that receives from server has further comprised:

Present virtual lens in the center of area-of-interest.

12. in the 1st described method of Patent right requirement, the described high-definition picture part that is shown in virtual lens that receives from server has further comprised:

If virtual lens is presented in the center of area-of-interest, determine whether that at least a portion virtual lens will be outside the border of base resolution image; With

If the virtual lens of at least a portion is in outside the border of base resolution image, determine virtual lens deviation post so that virtual lens not beyond the border of base resolution image; With

Present virtual lens and shown part high-definition picture in the center of deviation post.

13. in the 1st described method of Patent right requirement, further comprise:

Adjust size, shape or the position of virtual lens, to improve the function of the application program of using virtual lens.

14. in the 1st described method of Patent right requirement, further comprised:

Virtual lens is hidden in response user's instruction.

15. in the 1st described method of Patent right requirement, further comprised:

Response user's instruction illustrates the previous virtual lens of hiding.

16. in the 1st described method of Patent right requirement, further comprised:

Present an opaque plane between the primary image of virtual lens and described bottom, wait for that after transmiting a request to server described opaque plane can be visible from the process of server receiving high definition image.

17. in the 1st described method of Patent right requirement, further comprised:

Identify the resolution levels that the user of client device may ask;

Transmit a request to server, require to obtain other high-definition picture of stage resolution ratio that the user of client device may ask.

18. a computer-implemented method is used for it is characterized by at the local high-definition picture of the context-sensitive of base resolution image, one or more processors programme to carry out following steps, comprising:

Client device receives request, to check image;

Transmit a request to server by network, require to obtain the base resolution image corresponding to the image of asking;

Receive this base resolution image by network from server;

Show this base resolution image on the display of client device;

Reception shows the request of the area-of-interest of this base resolution image with high-resolution;

Transmit a request to server by network, require to obtain the high-definition picture corresponding to this base resolution image;

Receive this high-definition picture by network from server; With

Show the high-definition picture corresponding to this area-of-interest in the position that is overlapped in area-of-interest on the base resolution image.

19. in the 18th described method of Patent right requirement, the resolution of described base resolution image is less than the resolution that generates, inputs or be stored in the ultimate resolution image on server.

20. in the 18th described method of Patent right requirement, the resolution of described high-definition picture is less than or equal to the resolution of ultimate resolution image, and the resolution of described high-definition picture is greater than the resolution of base resolution image.

21. in the 18th described method of Patent right requirement, the selection of the resolution of described base resolution or high-definition picture at least in part root a tree name client device or network function and determine.

22. in the 18th described method of Patent right requirement, described overlapping layer has comprised a virtual lens.

23. in the 22nd described method of Patent right requirement, further comprised:

Client device receives request, to adjust the size of virtual lens;

Adjust the size of virtual lens;

Client device need to determine whether the high-definition picture of greater part;

If need the high-definition picture of greater part, transmit a request to server to obtain the high-definition picture of greater part;

Receive the high-definition picture of greater part from server; With

Show that the high-definition picture of greater part is in virtual lens.

24. in the 22nd described method of Patent right requirement, further comprised:

Client device receives request, with the shape of being asked that is shaped as of change virtual lens; With

Presenting virtual lens is desired shape;

Client device need to determine whether the high-definition picture of greater part;

If need the high-definition picture of greater part, transmit a request to server to obtain the high-definition picture of greater part;

Receive the high-definition picture of this greater part from server; With

Show that the high-definition picture of this greater part is in virtual lens.

25. in the 22nd described method of Patent right requirement, further comprised:

Client device receives request, the resolution of the high resolution graphics that shows with the change virtual lens;

Transmit a request to server, require to obtain the high-definition picture corresponding to the given resolution of base resolution image;

Receive this high-definition picture from server; With

Demonstration is corresponding to the high-definition picture of the part of area-of-interest, and this high-definition picture overlaps the position of area-of-interest on corresponding base resolution image.

26. in the 22nd described method of Patent right requirement, further comprised:

Follow the tracks of the movement of the cursor of being controlled by pointing apparatus on the base resolution image of client device;

The position of the cursor on the corresponding base resolution image of root a tree name, the virtual lens on mobile corresponding base resolution image;

The position of the cursor on the corresponding base resolution image of root a tree name, the high-definition picture of the part of update displayed in virtual lens.

27. in the 26th described method of Patent right requirement, further comprised:

The response user instruction freezes virtual lens corresponding position on the base resolution image.

28. in the 27th described method of Patent right requirement, further comprised:

The response user instruction, the virtual lens corresponding position on the base resolution image that thaws and before freezed.

29. in the 22nd described method of Patent right requirement, the described high-definition picture part that is shown in virtual lens that receives from server has further comprised:

Add upper side frame around virtual lens, so that virtual lens is divided out from the base resolution image.

30. in the 22nd described method of Patent right requirement, the described high-definition picture part that is shown in virtual lens that receives from server has further comprised:

Present virtual lens in the center of area-of-interest.

31. in the 30th described method of Patent right requirement, the described virtual lens that presents has further comprised in the center of area-of-interest:

If virtual lens is presented in the center of area-of-interest, determine whether that at least a portion virtual lens will be in outside the border of base resolution image; With

If the virtual lens of at least a portion is in outside the border of base resolution image, determine virtual lens deviation post so that virtual lens not beyond the border of base resolution image; With

Present virtual lens and shown part high-definition picture in the center of deviation post.

32. in the 31st described method of Patent right requirement, further comprised:

Adjust the size and dimension of virtual lens, to improve the function of the application program of using virtual lens.

33. in the 22nd described method of Patent right requirement, further comprised:

Virtual lens is hidden in response user's instruction.

34. in the 22nd described method of Patent right requirement, further comprised:

Response user's instruction illustrates the previous virtual lens of hiding.

35. in the 22nd described method of Patent right requirement, further comprised:

Present an opaque plane between the primary image of virtual lens and described bottom, wait for that after transmiting a request to server described opaque plane can be visible from the process of server receiving high definition image.

36. in the 18th described method of Patent right requirement, describedly further comprised from server receiving high definition image:

Receive only the high-definition picture of the part that comprises area-of-interest.

37. in the 18th described method of Patent right requirement, further comprised:

Identify the resolution levels that the user of client device may ask;

Transmit a request to server, require to obtain other high-definition picture of stage resolution ratio that the user of client device may ask.

38. in the 18th described method of Patent right requirement, further comprised:

Identify the one or more extra base resolution image that the user of client device may ask;

Transmit a request to server, require to obtain one or more extra base resolution images, thus before the user asks one or more extra base resolution images this image of prestrain.

39. in the 18th described method of Patent right requirement, described image is video.

40. in the 39th described method of Patent right requirement, described demonstration is corresponding to the high-definition picture of the part of area-of-interest, this high-definition picture overlaps the position of area-of-interest on corresponding base resolution image, has further comprised:

The frame of synchronous processed frame speed and the current high-definition picture that shows with its frame rate and the frame of current demonstration base resolution video.

41. in the 18th described method of Patent right requirement, the user's of described client device selection is stored in and is used in the memory of client device using later on.

42. a computer-implemented method is characterized by for the high-definition picture in base resolution image identical text display part, one or more processors programme to carry out following steps, comprising:

Client device receives request, to check image;

Transmit a request to server by network, require to obtain the top image in different resolution corresponding to the image of asking;

Receive this top image in different resolution by network from server;

Basis at the top image in different resolution that receives from server produces the base resolution image;

Show that this base resolution image is on the display of client device;

Reception shows the request of the area-of-interest of this base resolution image with high-resolution;

Basis at the top image in different resolution that receives from server produces high-definition picture; With

Show the high-definition picture corresponding to the part of this area-of-interest in the position that is overlapped in area-of-interest on the base resolution image.

43. in the 42nd described method of Patent right requirement, the resolution of described top image in different resolution is less than or equal to generation, input or is stored in the resolution of the ultimate resolution image on server.

44. in the 42nd described method of Patent right requirement, the resolution of described base resolution image is less than the resolution of described top image in different resolution.

45. in the 42nd described method of Patent right requirement, the resolution of described high-definition picture is less than or equal to the resolution of described top image in different resolution, the resolution of described high-definition picture is greater than the resolution of base resolution image.

46. in the 42nd described method of Patent right requirement, the selection of the resolution of described base resolution, high-definition picture or top image in different resolution at least in part root a tree name client device or network function and determine.

47. in the 46th described method of Patent right requirement, the user produces base resolution image and high-definition picture on the basis of the top image in different resolution that receives from server.

48. in the 42nd described method of Patent right requirement, described overlapping layer has comprised a virtual lens.

49. in the 48th described method of Patent right requirement, further comprised:

Client device receives request, to adjust the size of virtual lens;

Adjust the size of virtual lens;

Generate that size and dimension with virtual lens is complementary the high-definition picture of part; With

Show the high-definition picture of this part in virtual lens.

50. in the 48th described method of Patent right requirement, further comprised:

Client device receives request, with the shape of being asked that is shaped as of change virtual lens; With

Presenting virtual lens is the shape of asking;

Generate that size and dimension with virtual lens is complementary the high-definition picture of part; With

Show the high-definition picture of this part in virtual lens.

51. in the 48th described method of Patent right requirement, further comprised:

Client device receives request, the resolution of the high resolution graphics that shows with the change virtual lens;

Generate high-definition picture with the resolution of being asked on the basis of the top image in different resolution that receives from server; With

Show the high-definition picture corresponding to the part of this area-of-interest in the position that is overlapped in area-of-interest on the base resolution image.

52. in the 48th described method of Patent right requirement, further comprised:

Follow the tracks of the movement of the cursor of being controlled by pointing apparatus on client device;

The position of the cursor on the corresponding base resolution image of root a tree name, the virtual lens on mobile corresponding base resolution image;

The position of the cursor on the corresponding base resolution image of root a tree name, the high-definition picture of the part of update displayed in virtual lens.

53. in the 52nd described method of Patent right requirement, further comprised:

The response user instruction freezes the virtual lens position on the base resolution image accordingly.

54. in the 53rd described method of Patent right requirement, further comprised:

The response user instruction, the virtual lens of thawing is the position on the base resolution image accordingly.

55. in the 48th described method of Patent right requirement, further comprised:

Virtual lens is hidden in response user's instruction.

56. in the 55th described method of Patent right requirement, further comprised:

Response user's instruction illustrates the previous virtual lens of hiding.

57. in the 48th described method of Patent right requirement, the described high-definition picture that is shown in the part virtual lens that receives from server has further comprised:

Add upper side frame around virtual lens, so that virtual lens is divided out from the base resolution image.

58. in the 48th described method of Patent right requirement, the described high-definition picture part that is shown in virtual lens that receives from server has further comprised:

Present virtual lens in the center of area-of-interest.

59. in the 58th described method of Patent right requirement, the described virtual lens that presents has further comprised in the center of area-of-interest:

If virtual lens is presented in the center of area-of-interest, determine whether that at least a portion virtual lens will be outside the border of base resolution image; With

If the virtual lens of at least a portion is in outside the border of base resolution image, determine virtual lens deviation post so that virtual lens not beyond the border of base resolution image; With

Present virtual lens and shown part high-definition picture in the center of deviation post.

60. in the 42nd described method of Patent right requirement, further comprised:

Identify the one or more extra base resolution image that the user of client device may ask;

Transmit a request to server, require to obtain one or more extra base resolution images, thus before the user asks one or more extra base resolution images this image of prestrain.

61. in the 42nd described method of Patent right requirement, described image is video.

62. in the 61st described method of Patent right requirement, described demonstration is corresponding to the high-definition picture of the part of area-of-interest, this high-definition picture overlaps the position of area-of-interest on corresponding base resolution image, has further comprised:

The frame of synchronous processed frame speed and the current high-definition picture that shows with its frame rate and the frame of current demonstration base resolution video.

63. in the 42nd described method of Patent right requirement, the user's of described client device selection is stored in and is used in the memory of client device using later on.

64. a computer-implemented method is used for providing high-definition picture, it is characterized by, one or more processors programme to carry out following steps, comprising:

Client device receives the request of base resolution image;

Generate, input or be stored on server and with the base resolution image correlation connection of this request equate or the basis of the image of larger resolution on base resolution image of generation;

Connect by network the base resolution image is sent to client device;

Receive the request of the high-definition picture that joins with the base resolution image correlation;

Produce and ask corresponding high-definition picture on the basis of the image that is created on, is input to or be stored in the equal or larger resolution on server;

High-resolution image is sent to client device.

65. in the 64th described method of Patent right requirement, the request of high-definition picture comprises one group of coordinate of specifying area-of-interest, wherein produces high-definition picture and also comprises:

Generate, input or be stored on server and with the basis of the image of equating of being associated of the high-definition picture of asking or larger resolution on produce a part corresponding with the area-of-interest of high-definition picture.

66. in the 64th described method of Patent right requirement, further comprised:

Generate a plurality of images, each in these a plurality of images have different level of resolution and from generate, input or be stored on server equate or the image of larger resolution generates.

67. in the 66th described method of Patent right requirement, the base resolution image generates by the image in different resolution of selecting to ask from a plurality of images of different resolution.

68. in the 66th described method of Patent right requirement, high-definition picture generates by the image of the resolution selecting to ask from a plurality of images of different resolution.

69. in the 64th described method of Patent right requirement, further comprised:

One group of user's Selective storage is used for use later in the memory of server.

70. a computer-implemented method is used for providing high-definition picture, it is characterized by, one or more processors programme to carry out following steps, comprising:

Client device receives the request of top image in different resolution;

Generate, input or be stored on server and with the basis of the image of equating of being associated of the top image in different resolution of this request or larger resolution on top image in different resolution of asking of generation;

Connect by network the base resolution image is sent to client device.

71. in the 70th described method of Patent right requirement, further comprised:

Generate a plurality of top image in different resolution, each in these a plurality of top image in different resolution have different level of resolution and from generate, input or be stored on server equate or the image of larger resolution generates.

72. in the 71st described method of Patent right requirement, top image in different resolution generates by the image in different resolution of selecting to ask from a plurality of images of different resolution.

73. in the 70th described method of Patent right requirement, further comprised:

One group of user's Selective storage that will be relevant to request is used for using later in the memory of server.

74. a computer-implemented method is used for it is characterized by at the local high-definition picture of the context-sensitive of base resolution image, one or more processors programme to carry out following steps, comprising:

Client device receives request, to check image;

Transmit a request to server, require to obtain image;

Receive this image from server;

Show this image on the display of client device.

75. in the 74th described method of Patent right requirement, further comprised:

Determine whether network connects is available to server, is disabled and if network connects, and selects another server to process request.

76. in the 74th described method of Patent right requirement, further comprised:

When image being encrypted before server is sending image, the image that receives from server is decrypted.

77. in the 74th described method of Patent right requirement, further comprised:

When image having been compressed before server is sending image, the image that receives from server is decompressed.

78. a computer-implemented method is used for providing high-definition picture, it is characterized by, one or more processors programme to carry out following steps, comprising:

Client device receives the request of image;

Generate, input or retrieving images;

Connect by network and send images to client device.

79. in the 78th described method of Patent right requirement, further comprised:

Before sending images to client device, image is encrypted.

80. in the 78th described method of Patent right requirement, further comprised:

Before sending images to client device, image is compressed.

81. in the 78th described method of Patent right requirement, further comprised:

In case receive the request of image from client device, select server to process request from the server of a plurality of operations, wherein this server is selected according to each the relative load in the server of operation.

82. in the 78th described method of Patent right requirement, further comprised:

As the prerequisite that sends image, have access rights to the image of asking according to the user of access control regulations Authentication Client equipment or client device.

83. in the 82nd described method of Patent right requirement, further comprised:

If the user of client device or client device is not authorized to access the image of asking, send error message to client device.

84. a technological system that is used for providing high-definition picture, this system comprises:

The non-transience computer-readable medium that is used for the executable program module of storage computer;

With storing the processor of Program module with execution with the non-transience computer-readable medium of processor coupled communication;

A Network Interface Module that is stored in non-transience computer-readable medium, and be set to

Receive the image request of the selected resolution of client device by network, and

When having the image access authority, the user of client device or client device by network, image transmitting is arrived client device;

The request processing module that is stored in non-transience computer-readable medium and can be communicated with Network Interface Module, request processing module is set to

Receive the request of the selected image in different resolution of client through Network Interface Module,

Process this request, and

From Network Interface Module, the image of asking is sent to client device with desired resolution;

One is stored in non-transience computer-readable medium and the access control module that is communicated with request processing module, and this access control module is set to

Reception is from the client device authorization requests of request processing module, confirming client device or its user's image access right,

According to access control regulations authentication-access authority, and

Whether there is the authorization response of the authority of access images to indicate to request processing module transmission client device or user; And

Be stored in non-transience computer-readable medium and the image management module that can be communicated with request processing module, this image management module is configured usage data and stores to process image management request from request processing module.

85. in Patent right requirement the 84th described system, request processing module is set to when processing request:

Whether there is the authorization response indication of access rights to determine whether to send the image of asking according to the user from the client device of access control module or client device and sends to requesting client equipment to Network Interface Module.

86. in Patent right requirement the 84th described system, request processing module further is set to when processing request:

Transmit a request to image management module, require to obtain and equate with resolution that client device is asked or the image of the request of larger resolution; And

Equate or the image of larger resolution from the resolution that image management module receives with client device is asked.

87. in Patent right requirement the 86th described system, request processing module further is set to when processing request:

Generate the image of being asked from the image that receives from image management module with the desired resolution of client device.

88. in Patent right requirement the 86th described system, request processing module further is set to when processing request:

From the image that receives from the image management module part of being asked with the desired resolution synthetic image of client device.

89. in Patent right requirement the 84th described system, image management module further is set to:

From image input device or system's input picture; And

This image is stored in this data storage.

90. in Patent right requirement the 84th described system, image management module further is set to:

Synthetic image; And

This image is stored in this data storage.

91. in Patent right requirement the 84th described system, image management module further is set to:

Generate a plurality of images, each in these a plurality of images have different level of resolution and from generate, input or be stored on server equate or the image of larger resolution generates, and a plurality of images are stored in this data storage.

92. in Patent right requirement the 84th described system, request processing module further is set to when processing request:

One group of user's Selective storage is used for using later in this data storage.

93. a technological system that is used for checking high-definition picture, this system comprises:

The non-transience computer-readable medium that is used for the executable program module of storage computer;

With storing the processor of Program module with execution with the non-transience computer-readable medium of processor coupled communication;

A Network Interface Module that is stored in non-transience computer-readable medium, and be set to

Send image request to server by network, image by system the user asked, and

Receive the image of asking from server by network;

A subscriber interface module that is stored in non-transience computer-readable medium, and be set to

Reception is from user's the request of checking image,

Reception is corresponding to the base resolution image of the image of asking,

Show the base resolution image on the display of system,

Reception shows the request of area-of-interest in this base resolution image from the user's with high-resolution,

Reception has comprised that the position of the area-of-interest that overlaps this primary image is corresponding to the combination image of the high-definition picture part of area-of-interest; And

Show its combination image;

Be stored in non-provisional computer-readable medium, and the request processing module of communicating by letter with described Network Interface Module with subscriber interface module, request processing module is set to

Receive the request of base resolution image from subscriber interface module, check this image with the response user;

Process the request of this base resolution image from subscriber interface module,

Provide the base resolution image to be shown to subscriber interface module;

Receive the request of combination image, its combination image has comprised that the area-of-interest position that overlaps this primary image is corresponding to the high-definition picture part of area-of-interest;

The request for the treatment of combination image; And

Provide combination image to subscriber interface module for demonstration; And

Be stored in the image management module in non-temporary computer readable medium, with the communication of request processing module and Network Interface Module in, image management module is set to usage data and stores to process the image management request.

94. in Patent right requirement the 93rd described system, request processing module further is set to when processing the request of base resolution image

Reception requires to obtain the base resolution image from the request of subscriber interface module;

Transmit a request to image management module, require to obtain the base resolution image;

Reception is from the base resolution image of image management module; And

Send the base resolution image to subscriber interface module with demonstration.

95. in Patent right requirement the 93rd described system, request processing module further is set to when processing the request of base resolution image

Reception requires to obtain the base resolution image from the request of subscriber interface module;

Transmit a request to image management module, require to obtain the top image in different resolution corresponding to the base resolution image;

Reception is from the top image in different resolution of image management module;

Generate the base resolution image from top image in different resolution; And

The base resolution image is sent to subscriber interface module to show.

96. in Patent right requirement the 93rd described system, image management module further is set to when processing the image management request

Reception requires to obtain image from the request of request processing module;

The image that retrieval is asked; And

Send the image of asking and arrive request processing module.

97. in Patent right requirement the 96th described system, image management module further is set to when the image that retrieval is asked

Check whether the image of asking is buffered in this data storage; And

Whether retrieval is buffered from the image of asking of this data storage.

98. in Patent right requirement the 96th described system, image management module further is set to when the image that retrieval is asked

Transmit a request to Network Interface Module, require to obtain image;

Reception is from the image of asking of Network Interface Module; And

With the image buffer storage that receives in this data storage.

99. in Patent right requirement the 93rd described system, request processing module further is set to when processing request

One group of user's Selective storage is used for using later in this data storage.

100. a computer-implemented method is used for it is characterized by at the local high-definition picture of the context-sensitive of base resolution image, one or more processors programme to carry out following steps, comprising:

Client device receives request, to check image;

Determine to check a group selection parameter of image;

Transmit a request to server by network, require to obtain the image according to selecting parameter;

Receive according to this image of selecting parameter from server by network; And

Show according to this image of selecting parameter on client device.

101. in the 100th described method of Patent right requirement, select parameter to be consisted of by image identifier, resolution specification, virtual lens specification and the area-of-interest position with respect to the reference point in image.

102. in the 101st described method of Patent right requirement, the resolution specification comprises base resolution and high-resolution.

103. in the 102nd described method of Patent right requirement, the resolution specification comprises the ratio of high-resolution and base resolution or suitable parameter therewith.

104. in the 101st described method of Patent right requirement, wherein the virtual lens specification comprises size and shape.

105. in the 104th described method of Patent right requirement, the virtual lens specification comprises with respect to the specification of the virtual lens size of the size of base resolution image and the specification of virtual lens shape.

106. in the 100th described method of Patent right requirement, determine to select parameter to comprise:

Be that the second user specifies the selection parameter by first user;

Transmit and select parameter; And

According to the function of a tree name the second user's client device or network and adjust the selection parameter of transmission.

107. in the 106th described method of Patent right requirement, transmit and select parameter to comprise:

To select parameter to send to the second user's client device from the client device of first user; And

Client device by the second user receives the selection parameter.

108. in the 106th described method of Patent right requirement, transmit and select parameter to comprise:

The client device of selecting parameter from first user is sent to server;

Client device request by the second user is from the selection parameter of server; And

Client device by the second user receives the selection parameter.

109. in the 106th described method of Patent right requirement, determine to select parameter also to comprise:

Client device request by the second user is from the selection parameter of server;

Client device by the second user receives the selection parameter; And

According to the function of a tree name the second user's client device and adjust the selection parameter.

110. in the 106th described method of Patent right requirement, determine to select parameter also to comprise by first user being that the second user specifies the selection parameter; Transmit and select parameter and adjust in real time and select parameter.

111. in the 100th described method of Patent right requirement, determine to select parameter also to comprise and use the calculation procedure that is executed on client device to calculate the selection parameter.

112. in the 106th described method of Patent right requirement, be that the second user carries out and selects parameter to comprise first user input selection parameter on the client device of first user by first user.

113. in the 106th described method of Patent right requirement, be that the second user specifies the selection parameter to comprise by first user:

The client device of first user receives the request from first user, to check image;

Transmit a request to server, require to obtain the base resolution image corresponding to the image of asking;

Receive the base resolution image from server;

Show the base resolution image on the display of the client device of first user;

Reception shows the request of the area-of-interest of base resolution image with high-resolution;

Transmit a request to server, require to obtain the high-definition picture corresponding to the base resolution image;

From server receiving high definition image;

On the client device of first user, show the high-definition picture corresponding to this area-of-interest in the position that is overlapped in area-of-interest on the base resolution image;

Resolution selected according to first user and area-of-interest arrange the selection parameter; And

Select parameter according to the request adjustment of first user.

114. in the 106th described method of Patent right requirement, be that the second user specifies the selection parameter to comprise by first user:

The client device of first user receives request, to check image;

Transmit a request to server, require to obtain the top image in different resolution corresponding to the image of asking;

Receive top image in different resolution from server;

Generate the base resolution image according to the top image in different resolution that receives from server;

Show the base resolution image on the display of the client device of first user;

Reception shows the request of the area-of-interest of base resolution image with high-resolution;

Generate high-definition picture according to the top image in different resolution that receives from server;

Demonstration is corresponding to the high-definition picture of the part of area-of-interest, and this high-definition picture overlaps the position of area-of-interest on corresponding base resolution image;

Resolution selected according to first user and area-of-interest arrange the selection parameter; And

Select parameter according to the request adjustment of first user.

115. in the 106th described method of Patent right requirement, be that the second user specifies the selection parameter to comprise by first user:

The client device of first user receives request, to check image;

Transmit a request to server, require to obtain the base resolution image corresponding to the image of asking;

Receive the base resolution image from server;

Show the base resolution image on the display of the client device of first user;

Reception shows the request of the area-of-interest of base resolution image with high-resolution;

Transmit a request to server, require to obtain the combination image corresponding to the base resolution image;

Receive combination image from server;

Show combination image on the display of the client device of first user;

Resolution selected according to first user and area-of-interest arrange the selection parameter; And

Select parameter according to the request adjustment of first user.

116. in the 100th described method of Patent right requirement, the request that sends image comprises to server:

According to selecting parameter to transmit a request to server, require to obtain the base resolution image corresponding to the image of asking; And

According to selecting parameter to transmit a request to server, require to obtain the high-definition picture corresponding to the base resolution image.

117. in the 116th described method of Patent right requirement, receive image and comprise:

Receive the base resolution image from server; And

From server receiving high definition image.

118. in the 116th described method of Patent right requirement, the resolution of base resolution image is less than the resolution that generates, inputs or be stored in the ultimate resolution image on server.

119. in the 116th described method of Patent right requirement, the resolution of high-definition picture is less than or equal to the resolution of ultimate resolution image, and wherein the resolution of high-definition picture greater than the resolution of base resolution image.

120. in the 116th described method of Patent right requirement, the selection of the resolution of base resolution image at least in part root a tree name client device or network function and determine.

121. in the 116th described method of Patent right requirement, the selection of the resolution of high-definition picture at least in part root a tree name client device or network function and determine.

122. in the 116th described method of Patent right requirement, show high-definition picture corresponding to this area-of-interest according to the position of selecting the parameter display image to be included in to be overlapped in area-of-interest on the base resolution image.

123. in the 122nd described method of Patent right requirement, this overlapping layer has comprised a virtual lens.

124. in the 122nd described method of Patent right requirement, the selection of the size of virtual lens at least in part root a tree name client device or network function and determine.

125. in the 100th described method of Patent right requirement, according to selecting parameter to transmit a request to server, require to obtain image and comprise and transmit a request to server, require to obtain the top image in different resolution corresponding to the image of asking.

126. in the 125th described method of Patent right requirement, comprise from the top image in different resolution of server reception according to selecting parameter to receive image.

127. in the 125th described method of Patent right requirement, according to selecting the parameter display image to comprise:

Generate the base resolution image according to the top image in different resolution that receives from server;

Generate high-definition picture according to the high-definition picture that receives from server; And

Show the base resolution image and corresponding to the high-definition picture of the part of area-of-interest, this high-definition picture overlaps the position of area-of-interest on corresponding base resolution image.

128. in the 125th described method of Patent right requirement, the resolution of top image in different resolution is less than the resolution that generates, inputs or be stored in the ultimate resolution image on server.

129. in the 125th described method of Patent right requirement, the resolution of base resolution image is less than the resolution of top image in different resolution.

130. in the 125th described method of Patent right requirement, the resolution of high-definition picture is less than or equal to the resolution of top image in different resolution, and wherein the resolution of high-definition picture greater than the resolution of base resolution image.

131. in the 125th described method of Patent right requirement, the selection of the resolution of base resolution image at least in part root a tree name client device or network function and determine.

132. in the 125th described method of Patent right requirement, the selection of the resolution of top image in different resolution at least in part root a tree name client device or network function and determine.

133. in the 127th described method of Patent right requirement, this overlapping layer has comprised a virtual lens.

134. in the 133rd described method of Patent right requirement, the selection of the size of virtual lens at least in part root a tree name client device or network function and determine.

135. in the 100th described method of Patent right requirement, transmit a request to server and comprise according to selecting parameter to transmit a request to server, require to obtain the combination image corresponding to the image of asking.

136. in the 135th described method of Patent right requirement, request comprises the Presentation Function of client device.

137. in the 135th described method of Patent right requirement, comprise from server reception combination image according to selecting parameter to receive image.

138. in the 135th described method of Patent right requirement, according to selecting the parameter display image to comprise the demonstration combination image.

139. a computer-implemented method is used for providing high-definition picture, it is characterized by, one or more processors programme to carry out following steps, comprising:

Receive the selection parameter request of client device;

Produce this selection parameter;

Connecting by network to select parameter to send to client device;

Receive the image request of client device;

Have access rights to image according to the user of access control regulations Authentication Client equipment or client device;

Produce this image;

Connect by network and send images to client device.

140. in the 139th described method of Patent right requirement, produce and select parameter to comprise:

Receive the selection parameter that is used for the second user from first user;

To select Parameter storage in memory; And

Retrieval is used for the second user's selection parameter.

141. in the 139th described method of Patent right requirement, produce the calculation procedure of selecting parameter to comprise that use is executed on server and calculate the selection parameter.

142. in the 139th described method of Patent right requirement, produce image and be included in generations, input or be stored in the image that produces the resolution of asking on the basis of the image that is associated of equal on server or larger resolution.

143. in the 139th described method of Patent right requirement, produce image and comprise according to being included in selection parameter in image request and the Presentation Function of client device and produce combination image.

144. in the 143rd described method of Patent right requirement, produce combination image and comprise:

Generate, input or be stored on server and with this base resolution image correlation connection equate or the basis of the image of larger resolution on base resolution image of generation;

Generate, input or be stored on server and with the basis of the image of equating of being associated of this high-definition picture or larger resolution on high-definition picture of generation; And

On will the base resolution image corresponding to the position of area-of-interest of overlapping corresponding to the high-definition picture of area-of-interest.

145. a technological system that is used for providing high-definition picture, this system comprises:

The non-transience computer-readable medium that is used for the executable program module of storage computer;

With storing the processor of Program module with execution with the non-transience computer-readable medium of processor coupled communication;

A Network Interface Module that is stored in non-transience computer-readable medium, and be set to

Receiving from the client device of first user by network is a group selection parameter of second user's appointment by first user,

To select Parameter storage to be used for the second user's retrieval in the data storage,

Receive the request of selection parameter from the second user's client device by network,

To select parameter to send to the second user's client device by network,

Receive the request of image from client device first user or the second user by network, and

When having the image access authority, the user of client device or client device by network, image transmitting is arrived the client device of the request of sending out;

The request processing module that is stored in non-transience computer-readable medium and can be communicated with Network Interface Module, this request processing module is set to

Receive the request of this image through Network Interface Module,

Process this request, and

From Network Interface Module, the image of asking is sent to client device;

One is stored in non-transience computer-readable medium and the access control module that is communicated with request processing module, and this access control module is set to

Reception is from the client device authorization requests of request processing module, confirming client device or its user's image access right,

According to access control regulations authentication-access authority, and

Whether there is the authorization response of the authority of the required image of access to indicate to request processing module transmission client device or user; And

Be stored in non-transience computer-readable medium and the image management module that can be communicated with request processing module, and this image management module is configured usage data and stores to process the image management request.

146. in Patent right requirement the 145th described system, Network Interface Module further is set to be stored as from data the selection parameter that the second user search is asked when selecting parameter sending.

147. in Patent right requirement the 145th described system, Network Interface Module further is set to use calculation procedure to produce the selection parameter of asking when selecting parameter sending.

148. in Patent right requirement the 145th described system, request processing module further is set to when processing request:

Whether there is the authorization response indication of access rights to determine whether to send the image of asking according to the user from the client device of access control module or client device and sends to requesting client equipment to Network Interface Module.

149. in Patent right requirement the 145th described system, request processing module further is set to when processing request:

Request is sent to image management module, require to obtain resolution more than or equal to the image of asking of the desired resolution of client device; And

Receive resolution more than or equal to the image of the desired resolution of client device from image management module.

150. in Patent right requirement the 149th described system, request processing module further is set to when processing request:

The image that receives from image management module produces the image of asking of the resolution of client device request.

151. in Patent right requirement the 149th described system, request processing module further is set to when processing request:

The image that receives from image management module produces the part of asking of image of the resolution of client device request.

152. in Patent right requirement the 145th described system, image management module further is set to:

From image input device or system's input picture; And

Store the image in the data storage.

153. in Patent right requirement the 145th described system, image management module further is set to:

Produce image; And

Store the image in the data storage.

154. in Patent right requirement the 145th described system, image management module further is set to:

Generate a plurality of images, each in these a plurality of images have different level of resolution and from generate, input or be stored on server equate or the image of larger resolution generates, and

A plurality of images are stored in the data storage.

155. in Patent right requirement the 145th described system, request processing module further is set to when processing request:

One group of user's Selective storage is used for using later in the data storage.

156. a technological system that is used for checking high-definition picture, this system comprises:

The non-transience computer-readable medium that is used for the executable program module of storage computer;

With storing the processor of Program module with execution with the non-transience computer-readable medium of processor coupled communication;

A Network Interface Module that is stored in non-transience computer-readable medium, and be set to

Sending by first user by network is a group selection parameter of second user's appointment,

Receive a group selection parameter that is used for the second user by network,

Send image request to server by network,

Receive the image of asking from server by network;

A subscriber interface module that is stored in non-transience computer-readable medium and can be communicated with Network Interface Module, this subscriber interface module is set to

Accept to be used for the second user's selection parameter from first user,

Reception is from the second user's request, checking image,

Transmit a request to request processing module, require to obtain the image that the second user asks,

The combination image of the image that reception is asked corresponding to the second user, and

Show combination image on the display of the second user's client device;

A request processing module that is stored in non-transience computer-readable medium and can be communicated with subscriber interface module, this request processing module is set to

In response to the request of checking this image that receives from first user, the request that processing is obtained image from the requirement of the first user of subscriber interface module,

In response to the request of checking this image that receives from the second user, receive the request of obtaining image for the second user's requirement from subscriber interface module;

It is the selection parameter that the second user is identified for image;

It is the request that second user's processing requirements obtains image; And

Provide the combination image of the image of asking corresponding to the second user to subscriber interface module, to be shown to the second user; And

Be stored in the image management module in non-temporary computer readable medium, with the communication of request processing module and Network Interface Module in, image management module is set to usage data and stores to process the image management request.

157. in Patent right requirement the 156th described system, Network Interface Module further is set to send the selection parameter to the second user's client device by network when sending a group selection parameter.

158. in Patent right requirement the 156th described system, when sending a group selection parameter Network Interface Module further be set to by network sends select parameter to server to be retrieved by the second user's client device.

159. in Patent right requirement the 156th described system, Network Interface Module further is set to receive from the client device of first user by network and selects parameter when receiving a group selection parameter.

160. in Patent right requirement the 156th described system, Network Interface Module further is set to when receiving one group of selection parameter that is used for the second user

Select parameter by network from server request; And

Receive from server by network and select parameter.

161. in Patent right requirement the 156th described system, subscriber interface module further is set to when accepting to select parameter from first user

Reception is from the request of first user, to check image;

Transmit a request to request processing module, require to obtain image;

Receive image from request processing module;

Show image on the display of the client device of first user;

From first user input selection parameter; And

Provide select parameter to Network Interface Module to pass through Internet Transmission.

162. in Patent right requirement the 156th described system, request processing module further is set to when the request that image is obtained in the requirement of processing first user

Transmit a request to image management module, require to obtain the image of the image of asking corresponding to subscriber interface module;

Receive image from image management module;

Produce the image that subscriber interface module is asked; And

Provide image to subscriber interface module to be shown to first user.

163. in Patent right requirement the 156th described system, request processing module further is set to receive from Network Interface Module and selects parameter when determining to select parameter.

164. in Patent right requirement the 156th described system, request processing module further is set to use calculation procedure to produce and selects parameter when determining to select parameter.

165. in Patent right requirement the 156th described system, request processing module further is set to when the request that image is obtained in the requirement of processing the second user

Transmit a request to image management module, require to obtain the base resolution image corresponding to combination image;

Receive the base resolution image from image management module;

Transmit a request to image management module, require to obtain the high-definition picture corresponding to selecting the area-of-interest of appointment in parameter;

From image management module receiving high definition image; And

By producing combination image corresponding to the base resolution image of the position of the image of interest that overlaps of the high-definition picture of area-of-interest.

166. in Patent right requirement the 156th described system, request processing module further is set to when the request that image is obtained in the requirement of processing the second user

Transmit a request to image management module, require to obtain the base resolution image corresponding to combination image;

Receive the base resolution image from image management module;

Transmit a request to image management module, require to obtain the part corresponding to the high-definition picture of selecting area-of-interest specified in parameter, this part comprises area-of-interest;

Part from image management module receiving high definition image; And

By producing combination image corresponding to the base resolution image of the position of the area-of-interest that overlaps of the high-definition picture of area-of-interest.

167. in Patent right requirement the 156th described system, request processing module further is set to when the request that image is obtained in the requirement of processing the second user

Transmit a request to image management module, require to obtain the top image in different resolution corresponding to combination image;

Receive top image in different resolution from image management module;

Produce the base resolution image from top image in different resolution;

Produce high-definition picture from top image in different resolution; And

By producing combination image corresponding to the base resolution image that overlaps corresponding to the position of area-of-interest of the high-definition picture of selecting area-of-interest specified in parameter.

168. in Patent right requirement the 156th described system, request processing module further is set to when the request that image is obtained in the requirement of processing the second user

Transmit a request to image management module, require to obtain the combination image corresponding to selecting parameter; And

Receive combination image from image management module.

169. in Patent right requirement the 156th described system, image management module further is set to when processing the image management request

Reception requires to obtain image from the request of request processing module;

The image that retrieval is asked; And

Send the image of asking and arrive request processing module.

170. in Patent right requirement the 169th described system, image management module further is configured to when the image that retrieval is asked

Check whether the image of asking is buffered in the data storage; And

Whether the image of asking from search data memory is buffered.

171. in Patent right requirement the 169th described system, image management module further is set to when the image that retrieval is asked

Transmit a request to Network Interface Module, require to obtain image;

Reception is from the image of asking of Network Interface Module; And

With received image buffer storage in data storages.

172. in Patent right requirement the 156th described system, request processing module further is set to when processing request:

One group of user's Selective storage is used for using later in the data storage.

173. a computer-implemented method is used for it is characterized by at the local high-definition picture of the context-sensitive of base resolution image, one or more processors programme to carry out following steps, comprising:

Client device receives request, to check image;

Transmit a request to server by network, require to obtain the base resolution image corresponding to the image of asking;

Receive this base resolution image by network from server;

Show this base resolution image on the display of client device;

Reception shows the request of the area-of-interest of this base resolution image with high-resolution;

Transmit a request to server by network, require to obtain the combination image corresponding to this base resolution image;

Receive this combination image by network from server; With

Show combination image on the display of client device.

174. in the 173rd described method of Patent right requirement, the resolution of base resolution image is less than the resolution that generates, inputs or be stored in the ultimate resolution image on server.

175. in the 173rd described method of Patent right requirement, combination image is by the base resolution image and the part high-definition picture corresponding to this area-of-interest consists of in the position that is overlapped in area-of-interest on the base resolution image.

176. in the 175th described method of Patent right requirement, the resolution of high-definition picture is less than or equal to the resolution of ultimate resolution image, and wherein the resolution of high-definition picture greater than the resolution of base resolution image.

177. in the 174th described method of Patent right requirement, the selection of the resolution of base resolution image at least in part root a tree name client device or network function and determine.

178. in the 177th described method of Patent right requirement, shown base resolution image equates or larger image generation from received resolution.

179. in the 175th described method of Patent right requirement, this overlapping layer has comprised a virtual lens.

180. in the 179th described method of Patent right requirement, further comprised:

Client device receives request, to adjust the size of virtual lens;

Transmit a request to server, require to obtain the combination image of the virtual lens with the size of asking;

Receive combination image from server; And

Show combination image on the customer equipment display.

181. in the 179th described method of Patent right requirement, further comprised:

Client device receives request, take the shape of alteration of form as being asked with virtual lens; And

Transmit a request to server, require to obtain the combination image of the virtual lens with the shape of asking;

Receive combination image from server; And

Show combination image on the client device display.

182. in the 179th described method of Patent right requirement, further comprised:

Client device receives request, to change the resolution of the shown high-definition picture of virtual lens;

Transmit a request to server, require obtain combination image and be overlapped in the position of area-of-interest on the base resolution image corresponding to the high-resolution parts of images of asking of this area-of-interest;

Receive combination image from server; And

Show combination image on the client device display.

183. in the 179th described method of Patent right requirement, further comprised:

Follow the tracks of the movement of the cursor of being controlled by pointing apparatus on the base resolution image of client device;

Send the request of combination image to server, combination image is made of the high-resolution parts of images of asking of the position that is overlapped in area-of-interest on the base resolution image corresponding to this area-of-interest;

Receive combination image from server; And

Show combination image on the client device display.

184. in the 183rd described method of Patent right requirement, further comprised:

The response user instruction freezes virtual lens corresponding position on the base resolution image.

185. in the 184th described method of Patent right requirement, further comprised:

The response user instruction, the virtual lens corresponding position on the base resolution image that thaws and before freezed.

186. in the 179th described method of Patent right requirement, further comprised:

Response user's instruction shows that the base resolution image is to hide virtual lens.

187. in the 186th described method of Patent right requirement, further comprised:

Response user's instruction shows that combination image is to illustrate the previous virtual lens of hiding.

188. in the 173rd described method of Patent right requirement, the user's of client device selection is stored in and is used in the memory of client device using later on.

189. a computer-implemented method is used for providing high-definition picture, it is characterized by, one or more processors programme to carry out following steps, comprising:

Receive the request of base resolution image from client device;

Have access rights to the base resolution image according to the user of access control regulations Authentication Client equipment or client device;

Generate, input or be stored on server and with the base resolution image correlation connection of this request equate or the basis of the image of larger resolution on base resolution image of generation;

Connect by network the base resolution image is sent to client device;

Receive the request of the combination image that is associated with base resolution image and area-of-interest;

Have access rights to combination image according to the user of access control regulations Authentication Client equipment or client device;

Produce combination image; And

Combination image is sent to client device.

190. in the 189th described method of Patent right requirement, combination image is by the base resolution image and the high-resolution parts of images of asking corresponding to this area-of-interest consists of in the position that is overlapped in area-of-interest on the base resolution image.

191. in the 190th described method of Patent right requirement, the base resolution image is from generating, input or be stored in equating or the generation of larger image in different resolution on server.

192. in the 190th described method of Patent right requirement, high-definition picture is from generating, input or be stored in equating or the generation of larger image in different resolution on server.

193. in the 190th described method of Patent right requirement, this overlapping layer has comprised a virtual lens.

194. in the 193rd described method of Patent right requirement, generation comprises that the combination image of virtual lens has further comprised:

Add upper side frame around virtual lens, so that virtual lens is divided out from the base resolution image.

195. in the 193rd described method of Patent right requirement, generation comprises that the combination image of virtual lens has further comprised:

Present virtual lens in the center of area-of-interest.

196. in the 195th described method of Patent right requirement, present virtual lens and further comprised in the center of area-of-interest:

If virtual lens is presented in the center of area-of-interest, determine whether that at least a portion virtual lens will be outside the border of base resolution image;

If the virtual lens of at least a portion is in outside the border of base resolution image, determine virtual lens deviation post so that virtual lens not beyond the border of base resolution image; With

Present virtual lens so that shown virtual lens and part high-definition picture in the center of deviation post.

197. in the 193rd described method of Patent right requirement, further comprised:

Adjust the size and dimension of virtual lens, to improve the function of the application program of using virtual lens.

198. in the 190th described method of Patent right requirement, described image is video.

199. in the 198th described method of Patent right requirement, described demonstration is corresponding to the high-definition picture of the part of area-of-interest, this high-definition picture overlaps the position of area-of-interest on corresponding base resolution image, has further comprised:

The frame of synchronous processed frame speed and the current high-definition picture that shows with its frame rate and the frame of current demonstration base resolution video.

200. in the 189th described method of Patent right requirement, the user's of client device selection is stored in and is used in the memory of client device using later on.

201. a technological system that is used for providing high-definition picture, this system comprises:

The non-transience computer-readable medium that is used for the executable program module of storage computer;

With storing the processor of Program module with execution with the non-transience computer-readable medium of processor coupled communication;

A Network Interface Module that is stored in non-transience computer-readable medium, and be set to

Receive the image request of the selected resolution of client device by network, and

When having the image access authority, the user of client device or client device by network, image transmitting is arrived client device;

Receive request from the combination image of client device by network, this combination image is made of the part high-definition picture of the position that is overlapped in area-of-interest on the base resolution image corresponding to this area-of-interest, and

If the user of client device or client device has the image access authority, by network, combination image is sent to client device;

The request processing module that is stored in non-transience computer-readable medium and can be communicated with Network Interface Module, request processing module is set to

Receive the request of the selected image in different resolution of client through Network Interface Module,

Process the request of the selected image in different resolution of this client,

From Network Interface Module, the image of asking is sent to client device with desired resolution,

Receive the request of combination image through Network Interface Module,

Process the request of this combination image, and

From Network Interface Module, combination image is sent to client device;

One is stored in non-transience computer-readable medium and the access control module that is communicated with request processing module, and this access control module is set to

Reception is from the authorization requests of request processing module, with verification client device or its user right to access to the image of request,

According to access control regulations authentication-access authority, and

Whether there is the authorization response of the authority of access images to indicate to request processing module transmission client device or user;

The image management module that is stored in non-transience computer-readable medium and can be communicated with request processing module, this image management module is configured usage data and stores to process from the image management request.

202. in Patent right requirement the 201st described system, request processing module is set to when processing request:

Whether there is the authorization response indication of access rights to determine whether to send the image of asking according to the user from the client device of access control module or client device and sends to requesting client equipment to Network Interface Module.

203. in Patent right requirement the 201st described system, request processing module further is set to when treatment of selected is decided the image request of resolution:

Transmit a request to image management module, require to obtain with ask in specified base resolution equate or the image of larger resolution; And

From image management module receive with ask specified base resolution equate or the image of larger resolution; And

Produce the base resolution image according to the image that receives.

204. in Patent right requirement the 201st described system, request processing module further is set to when the request for the treatment of combination image:

Transmit a request to image management module, require to obtain with ask in specified base resolution equate or the image of larger resolution;

From image management module receive with ask specified base resolution equate or the image of larger resolution;

Produce the base resolution image according to the image that receives;

Transmit a request to image management module, require to obtain with ask in specified high-resolution equate or the image of larger resolution;

From image management module receive with ask specified high-resolution equate or the image of larger resolution;

Produce high-definition picture according to the image that receives; And

By producing combination image corresponding to the position that partially overlaps in corresponding to the base resolution image of area-of-interest of the high-definition picture of specified area-of-interest in request.

205. in Patent right requirement the 201st described system, image management module further is set to:

From image input device or system's input picture; And

This image is stored in this data storage.

206. in Patent right requirement the 201st described system, image management module further is set to:

Synthetic image; And

This image is stored in this data storage.

207. in Patent right requirement the 201st described system, image management module further is set to:

From equating or the image of larger resolution generates a plurality of images, each in these a plurality of images have different level of resolution and from generate, input or be stored on server equate or the image of larger resolution generates, and

A plurality of images are stored in this data storage.

208. in Patent right requirement the 201st described system, request processing module further is set to when processing request:

One group of user's Selective storage is used for using later in this data storage.

209. a technological system that is used for checking high-definition picture, this system comprises:

The non-transience computer-readable medium that is used for the executable program module of storage computer;

With storing the processor of Program module with execution with the non-transience computer-readable medium of processor coupled communication;

A Network Interface Module that is stored in non-transience computer-readable medium, and be set to

Send image request to server by network,

Receive the image of asking from server by network;

Send the combination image request to server by network, and

Receive combination image by network from server;

A subscriber interface module that is stored in non-transience computer-readable medium, and be set to

Reception is from user's the request of checking image,

Reception is corresponding to the base resolution image of the image of asking,

Show the base resolution image on the display of system,

Reception shows the request of area-of-interest in this base resolution image from the user's with high-resolution,

Send the request of combination image to request processing module, this combination image is made of the part high-definition picture of the position that is overlapped in area-of-interest on the base resolution image corresponding to this area-of-interest,

Reception is from the combination image of request processing module, and

Show combination image on the display of system; And

Be stored in non-provisional computer-readable medium, and the request processing module of communicating by letter with described Network Interface Module with subscriber interface module, request processing module is set to

Processing is from the request of the base resolution image of subscriber interface module; And

Processing is from the request of the combination image of subscriber interface module; And

The image management module that is stored in non-temporary computer readable medium and can be communicated with request processing module and Network Interface Module, image management module is set to usage data and stores to process the image management request.

210. in Patent right requirement the 209th described system, request processing module further is set to when processing the request of base resolution image:

Reception requires to obtain the base resolution image from the request of subscriber interface module;

Transmit a request to image management module, require to obtain the base resolution image;

Reception is from the base resolution image of image management module; And

Send the base resolution image to subscriber interface module with demonstration.

211. in Patent right requirement the 209th described system, request processing module further is set to when the request for the treatment of combination image:

Reception requires to obtain combination image from the request of subscriber interface module, and this combination image is made of the part high-definition picture of the position that is overlapped in area-of-interest on the base resolution image corresponding to this area-of-interest;

Transmit a request to image management module, require to obtain combination image;

Reception is from the combination image of image management module; And

The combination image that transmission is asked is to subscriber interface module.

212. in Patent right requirement the 209th described system, image management module further is set to when processing the image management request

Reception requires to obtain image from the request of request processing module;

The image that retrieval is asked; And

Send the image of asking and arrive request processing module.

213. in Patent right requirement the 212nd described system, image management module further is set to when the image that retrieval is asked

Check whether the image of asking is buffered in this data storage; And

Whether retrieval is buffered from the image of asking of this data storage.

214. in Patent right requirement the 212nd described system, image management module further is set to when the image that retrieval is asked

Transmit a request to Network Interface Module, require to obtain image;

Reception is from the image of asking of Network Interface Module; And

With the image buffer storage that receives in this data storage.

215. in Patent right requirement the 209th described system, request processing module further is set to when processing request

One group of user's Selective storage is used for using later in this data storage.

Images