CN103155585A - Systems and methods for networked in-context, high-resolution image viewing - Google Patents

Systems and methods for networked in-context, high-resolution image viewing Download PDF

Info

Publication number
CN103155585A
CN103155585A CN2011800438580A CN201180043858A CN103155585A CN 103155585 A CN103155585 A CN 103155585A CN 2011800438580 A CN2011800438580 A CN 2011800438580A CN 201180043858 A CN201180043858 A CN 201180043858A CN 103155585 A CN103155585 A CN 103155585A
Authority
CN
China
Prior art keywords
image
request
resolution
client
requirement
Prior art date
Application number
CN2011800438580A
Other languages
Chinese (zh)
Inventor
T·塔汉
Original Assignee
欧普斯梅迪库斯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US12/834,806 priority Critical
Priority to US12/834,810 priority
Priority to US12/834,810 priority patent/US8667054B2/en
Priority to US12/834,809 priority
Priority to US12/834,806 priority patent/US8296359B2/en
Priority to US12/834,809 priority patent/US20120011568A1/en
Priority to US12/954,269 priority patent/US7991837B1/en
Priority to US12/954,269 priority
Application filed by 欧普斯梅迪库斯股份有限公司 filed Critical 欧普斯梅迪库斯股份有限公司
Priority to PCT/US2011/043755 priority patent/WO2012021246A2/en
Publication of CN103155585A publication Critical patent/CN103155585A/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • H04N21/23106Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving caching operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234345Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/23439Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements for generating different versions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2541Rights Management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808Management of client data
    • H04N21/25816Management of client data involving client authentication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808Management of client data
    • H04N21/25825Management of client data involving client display capabilities, e.g. screen resolution of a mobile phone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440245Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4438Window management, e.g. event handling following interaction with the user interface
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637Control signals issued by the client directed to the server or network components
    • H04N21/6377Control signals issued by the client directed to the server or network components directed to server
    • H04N21/6379Control signals issued by the client directed to the server or network components directed to server directed to encoder, e.g. for requesting a lower encoding rate
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection

Abstract

Systems and methods are provided for viewing portions of an image in high resolution and in context with a full image, which is displayed at a base resolution that is lower resolution than the resolution of the high-resolution image. A user can select an area of interest from the base-resolution image for viewing at a higher resolution on the client device. The server, or in some implementations the client device, can generate a high-resolution image representing the area of interest and the client device can display a portion of the high-resolution image in a virtual lens overlaid on the base-resolution image.

Description

The high-resolution of network type context relation image is checked System and method for

Technical field

The present invention relates to general pattern and process, more particularly, relate to for check the System and method for of the context-sensitive topography of a complete image with high-resolution on network.

Background technology

Can check that the high-definition picture of downloading by network is very important concerning many application programs.In medical field, this ability is to diagnosis and treatment patient, and for research and doctor's education be valuable.Other application programs may be benefited from this ability, this comprise engineering design, equipment operating and maintenance, numerical map, satellite image, evidence obtaining, etc.High-resolution image can be very large, and may surpass the ability of a computer system stores and demonstration image.In addition, whole high-definition picture can cause the remarkable load of network in transmission over networks, thus response time that can application programs have a negative impact, if this application program need to treat that this view data is by whole network delivery.

Summary of the invention

System and method provided herein is for checking with high-resolution and the context-sensitive part of the image of a base resolution, and the resolution of this base resolution image is lower than the resolution of high-resolution parts of images.Whole image can connect from server by network and downloads to long-range or local client device.Server can generate the image of a complete base resolution from a high-definition picture that is stored in, is created on or be input to server, and by server, complete image is sent to client device.Base resolution can be according to deciding that the ability of the mobile device of client or network is selected.Client device can show the image of base resolution, and can be set up and allow the user to select its interested zone to check with higher resolution.Client device can be to the image of server request corresponding to the specified interested high-resolution region of user for this reason.Then, server can generate a high-definition picture for client device.This high-definition picture can be from being stored in, generating or be input to server, and its resolution equates or larger image and producing.Server sends high-resolution image to client device, and client device can show the high-definition picture of part in the virtual lens of an image that is overlapped in base resolution.The resolution of this high-definition picture can be to be less than or equal to the ultimate resolution that is stored in, is created on or be input to the image of server.In certain embodiments, only have part corresponding to interested zone, or comprise the high-definition picture in zone of the high-definition picture of area-of-interest, can send to client device by server.In certain embodiments, client can produce base resolution and high-resolution image from the image of equating of downloading of server or larger resolution.

In one aspect, a kind of computer-implemented method is that the step that one or more processors are carried out the method is set, and shows a part of image of base resolution image context association with high-resolution.the method comprises the following steps: receive the request of checking image at client device, to send to corresponding to the request of required base resolution image the server on network, receive the base resolution image that server sends from network, show this base resolution image on the display of client device, receive the request that shows certain interested zone in this base resolution image with high-resolution, to show that the request in interested zone in certain base resolution image sends to server through network with high-resolution, receive by network the high-definition picture that server sends, and show parts of images corresponding to this area-of-interest with the high-resolution identical text on the position of area-of-interest in the base resolution image.In certain embodiments, this cover layer comprises a virtual lens, and it can comprise such as frame processes annex.

In one aspect, a kind of computer-implemented method is that the step that one or more processors are carried out the method is set, and shows a part of image of base resolution image context association with high-resolution.the method comprises the following steps: receive the request of checking image at client device, the request of checking required top image in different resolution is sent to server on network, receive the top image in different resolution that is sent from network by server, generate the image of a base resolution on the basis of the top image in different resolution that receives from server, show this base resolution image on the display of client device, receive the request that shows certain interested zone in this base resolution image with high-resolution, basis at the top image in different resolution that receives from server produces a high-resolution image, and show parts of images corresponding to this area-of-interest with the high-resolution identical text on the position of area-of-interest in basic image in different resolution.In certain embodiments, this cover layer comprises a virtual lens, and it can comprise such as frame processes annex.

On the other hand, a kind of computer-implemented method is that the step that one or more processors are carried out the method is set, so that high-definition picture to be provided.the method comprises the following steps: client device receives the request of base resolution image, with the base resolution image correlation of this request connection equate or the basis of the image of larger resolution on base resolution image of generation, connect by network the base resolution image is sent to client device, receive the request of the high-definition picture that joins with the base resolution image correlation, be created on, be input to or be stored on server equate or the basis of the image of larger resolution on produce and ask corresponding high-definition picture, and high-resolution image is sent to client device.

On the other hand, a kind of computer-implemented method is that the step that one or more processors are carried out the method is set, so that high-definition picture to be provided.The method comprises the following steps: client device receives the request of top image in different resolution, be created on, be input to, be stored on server equate or the basis of the image of larger resolution on produce and ask corresponding top image in different resolution, and connect by network top image in different resolution sent to client device.

On the other hand, a kind of computer-implemented method is that the step that one or more processors are carried out the method is set, and shows the topography related with the base resolution image context with high-resolution.The method comprises the following steps: client device receives the request of checking image, sends image request to server, receives image and shows this image at the display of client device from server.

Aspect another, a kind of computer-implemented method is that the step that one or more processors are carried out the method is set, so that high-definition picture to be provided.The method comprises the following steps: receive the image request of client device, generate, input or retrieving images, and connect by network and send images to client device.

Another aspect the invention provides the technical system of a high-definition picture.This system comprises the non-transience computer-readable medium for the executable program module of storage computer, and with storing the processor of Program module with execution with the non-transience computer-readable medium of processor coupled communication.This system also comprises a Network Interface Module that is stored in non-transience computer-readable medium, and be set up the image request that receives the selected resolution of client device by network, thus when client or client device have the image access authority by network with image transmitting to client device.This system also comprises the request processing module that is stored in non-transience computer-readable medium and can be communicated with Network Interface Module.Request processing module is set up the request that receives the selected image in different resolution of client through Network Interface Module, processes this request, and from Network Interface Module, the image of asking is sent to client device with desired resolution.Native system comprises that also one is stored in non-transience computer-readable medium and the access control module that is communicated with request processing module, this access control module is set to receive the client device authorization requests from request processing module, to confirm client device or its user's image access right, according to access control regulations authentication-access authority, and whether there is the authorization response of the authority of access images to indicate to request processing module transmission client device or user.This system also comprises and is stored in non-transience computer-readable medium and the image management module that can be communicated with request processing module, and this image management module is configured usage data and stores to process image management request from request processing module.

Another aspect the invention provides a technical system of checking high-definition picture.This system comprises the non-temporary computer readable medium for the executable program module of storage computer, and is used for carrying out program module and the processor non-temporary computer readable medium coupled communication that is stored in wherein.This system has further comprised Network Interface Module, it is stored in non-provisional computer-readable medium, and be set to send from network to server the request of asking for image, this image is the user's request by this system, and receives the image of asking from the server of network.this system also comprises a subscriber interface module that is stored in non-provisional computer-readable medium, be set to receive the request of checking image from the user, reception is corresponding to the base resolution image of institute's requested image, and show this base resolution image on the display of system, reception shows the request of area-of-interest in this base resolution image from the user's with high-resolution, reception has comprised that the position of the area-of-interest that overlaps this primary image is corresponding to the combination image of the high-definition picture part of area-of-interest, and show its combination image.This system also comprises and being stored in non-provisional computer-readable medium, and the request processing module of communicating by letter with described Network Interface Module with subscriber interface module.Request processing module is set to receive from subscriber interface module the request of base resolution image, check this image with the response user, process the request of this base resolution image from subscriber interface module, provide the base resolution image to be shown to subscriber interface module, receive the request of combination image, its combination image has comprised that the area-of-interest position that overlaps this primary image is corresponding to the high-definition picture part of area-of-interest, the request for the treatment of combination image, and provide combination image to subscriber interface module for demonstration.This system has also comprised the image management module that is stored in non-temporary computer readable medium.With the communication of request processing module and Network Interface Module in, image management module is set to usage data and stores to process the image management request.

These and other features, overview, and embodiment is entitled as below being described in a joint of " detailed description ".

Description of drawings

Its feature is described by reference to the accompanying drawings, overview, and embodiment, wherein:

Fig. 1 is the block diagram of described image viewing system in an embodiment;

Fig. 2 is the flow chart of continuous method for down loading.According to an embodiment, the method can be configured on the client device of shown in Figure 1 image viewing system;

Fig. 3 is the flow chart of continuous method for down loading.According to an embodiment, the method can be configured on the server of shown in Figure 1 image viewing system;

Fig. 4 is the block diagram of the viewing area of client device in an embodiment;

Fig. 5 is the flow chart that two time scales approach falls in client.According to an embodiment, the method can be configured on the client device of shown in Figure 1 image viewing system;

Fig. 6 is the flow chart that two time scales approach falls in client.According to an embodiment, the method can be configured on the server of shown in Figure 1 image viewing system;

Fig. 7 is the flow chart of server combination method.According to an embodiment, the method can be configured on the client device of shown in Figure 1 image viewing system;

Fig. 8 is the flow chart of server combination method.According to an embodiment, the method can be configured on the server of shown in Figure 1 image viewing system;

Fig. 9 A and 9B are the flow chart of collaboration method.According to an embodiment, the method can be configured on the client device of shown in Figure 1 image viewing system;

Figure 10 is the flow chart of collaboration method.According to an embodiment, the method can be configured on the server of shown in Figure 1 image viewing system;

Figure 11 is in an embodiment, the block diagram of the logic module of the server shown in Fig. 1;

Figure 12 is in an embodiment, the block diagram of the logic module of the client device shown in Fig. 1.

Embodiment

This system and method is used for checking high-resolution parts of images with virtual lens on client device.Check the request of image for the response customer requirements, client device can pass through network, tries to achieve the copy of the image of basic horizontal resolution from server.From its previous storage, retrieval or be input to high-quality on server, on the basis of high-resolution image, the base resolution image can be stored, produces or input to server also can be with the image transmitting of this base resolution to client device.The resolution of base resolution image is before be stored in, produce or resolution that be input to the high-definition picture on server lower than it.The function of client device or network can determine the resolution of its base resolution image at least in part.Client device is set to receive the base resolution image and show its base resolution image from display interface from server.The user of client device can select interested zone on the base resolution image, the high-definition picture of the area-of-interest that acquisition request is determined corresponding to the user from the server, the resolution of this high-definition picture can be up to the resolution of the high-definition picture of that store on server, that generate or input.For example, in certain embodiments, client device can be set to present one " virtual lens " on interested zone, be stacked and placed on the base resolution image, and demonstration is corresponding to the local high-resolution image of area-of-interest.This virtual lens can show the more detailed image of area-of-interest, makes the user can " amplify " the interior details of area-of-interest.The ability of client device or network can determine the size of its virtual lens and the resolution of shown high-definition picture at least in part.

In certain embodiments, corresponding to area-of-interest or comprise the topography of area-of-interest, only have the high-definition picture of part to send to client device from server.In other embodiments, a complete high-definition picture can send to client device by server, and client device can be set to select corresponding to the local high-definition picture of area-of-interest and be shown the high-definition picture of this part by virtual lens.

In certain embodiments, virtual lens can provide superimposed images on complete base resolution image, its position is shown corresponding high-definition picture part, but the virtual lens identical text shows more high-resolution image like this, and its selected level of resolution is provided simultaneously.Check high-resolution image in can be in an application program available display space of this setting, the context-sensitive superimposed images are provided simultaneously.According to an embodiment, even in the situation that the lack of resolution of computer system is to show complete high-definition picture, and in the situation that do not wish or display space that unnecessary use is a large amount of shows complete high-definition picture, the resolution content of the part that these technology can be used for showing that at least one image is corresponding.

In some embodiments, the user can check with high-resolution the image of selected area-of-interest.Other embodiment make the user to move in any part of image and select interested zone.These technology can help to reduce the data volume that sends high-definition picture within the given time by network, and can reduce the required pictorial data amount that shows on the viewing area, and client device and required disposal ability and the memory space of server.In addition, these technology can be used for optimizing its response time in various use scenes.

Fig. 1 is the block diagram of an image viewing system 100 in embodiment.The image viewing system comprises client device 110, server 120 and network 130.Client device 110 can be a calculation element, it is characterized in that, comprise one or more processors, volatibility and nonvolatile memory, display, keyboard (hard or soft), pointing apparatus (for example, mouse, touch pad, joystick, touch-screen, tracking ball etc.), network interface and other input-output apparatus.Client device 110 can be desktop computer, notebook, computer workstation, computer disks, flat computer, document reader, smart mobile phone, mobile phone, personal digital assistant, network home appliance, thin client machine system and can receive view data and show that it is transferred to the device of the view data on subscriber equipment by network with Digital Television or the other types of embedded or ppu, internal memory and network interface.According to some embodiment, the function of client device 110 can realize in an equipment, also can be distributed in a plurality of equipment and realize.

Server 120 can be a calculation element, it is characterized in that, comprises one or more processors, volatibility and nonvolatile memory, network interface and other input-output apparatus.According to some embodiment, the function of client device 120 can realize in an equipment, also can be distributed in a plurality of equipment and realize.According to some embodiment, can comprise that in image viewing system 100 a plurality of servers 120 are set to provide view data to arrive one or more client devices 110 by one or more networks 130.In certain embodiments, server 120 is webservers, can be set to by network 130, content be offered client device 110.According to an embodiment, server 120 can be linked up (not shown) with one or more data repositories, can be used for storing image data to offer client device.According to an embodiment, data repository can be configured on server 120, maybe can be configured in (not shown) on an independent data server.Website server can be also to link up with one or more image-input devices (for example, camera, scanner, sensor).

In an embodiment, network 130 can represent between server 120 and client device 110 that one or more wired or wireless networks connect.According to an embodiment, network 130 has comprised network or the interconnecting method of the Internet, local area network, Wide Area Network, metropolitan area network, telephone network, TV network, wireless network or link, satellite network or link, bus or other type.

According to another embodiment, the function of server 120 and client device 110 can be configured on a single equipment or equipment unit.For example, the disclosed technology of this paper data that the digital microscope scanning system is caught that can be used for reading.

Image viewing system 100 makes the user can check local high-definition picture on client device 110, and need not to send whole high-definition picture to client device 110 by server 120.In one embodiment, client device 110 can be set to show the image and the virtual lens 160 that overlaps on this base resolution image of " base resolution " in the viewing area 150 of client device 110.The image of base resolution can be the lower resolution image of the high-definition picture of representative storage on server 120, generation or input.Due to the resolution of the base resolution image resolution lower than high-definition picture, only need a bandwidth still less send to client device 110 from network 130.Base resolution image in viewing area 150 provides a context-sensitive image can for client device 110, and it is the area-of-interest with user's appointment of high-resolution demonstration.

Virtual lens 160 can be presented at higher resolution the local high-definition picture of base resolution image in image display area 150.According to an embodiment, the resolution of the high-resolution topography that shows in virtual lens 160 can with the equal resolution of the high-definition picture that is stored in, generates or be input to server 120.According to another embodiment, the resolution that the resolution of the high-resolution topography that shows in virtual lens 160 again can be different from the high-definition picture that is stored in, generates or be input to server 120.For example, virtual lens 160 can be set to show local high-definition picture, and its resolution is between the resolution of the resolution of the image of base resolution and the high-definition picture that is stored in, generates or be input to server 120.According to an embodiment, the user can select a different set of resolution to show its image in virtual lens 160.Image viewing system 100 can its client device of root a tree name or the ability of network and the resolution of base resolution image determine a series of different resolution.In another embodiment, the user can select resolution from one group of continuous image resolution ratio, thereby shows its image in virtual lens 160.Image viewing system 100 can be according to the ability of client device or network, and the resolution of base resolution image is determined lower limit and the upper limit of one group of continuous image resolution ratio.

According to an embodiment, high-resolution image can be uploaded to server 120, generate on server 120, or at the digital scan microscope, and digital camera, or be connected on server 120 after generating on the equipment such as scanner.

According to an embodiment, the user of client device 110 can select an interested zone in the base resolution image on viewing area 150, shows its corresponding high-definition picture part by virtual lens 160.According to an embodiment, client device can be set to allow the user to use the indicator device of client device 110, and for example mouse, trace ball, touch pad, touch-screen, joystick, arrow key, button or other input equipments are selected base resolution image local in viewing area 150.According to an embodiment, client device can also be set to make the user by selecting different interested zones in the base resolution image of indicator device on viewing area 150 that uses client device 110.According to an embodiment, client device 110 is set in the viewing area 150 and shows the primary image of complete low resolution and overlap on basic image in different resolution high-definition picture corresponding to selected area-of-interest.Due to high-definition picture shown in virtual lens, its resolution is higher than the resolution of base resolution image, and area is less than the base resolution image of its covering.Use the function of indicator device mobile virtual lens can make the user of client device finally check whole images with high-resolution.

Term used herein " resolution " refers to the sum of the pixel of image, can be also the sum of color of each pixel of image.For example, resolution can be the sum that in image, the sum of horizontal pixel multiply by vertical pixel.In other embodiments, also optionally comprise third dimension degree, resolution can comprise depth component.If image temporal evolution, resolution also can comprise time dimension.For video content, resolution can be the total number of the frame of per second.Resolution can be also level of detail or the quantity of image.Quantity or the further feature of road for example are shown on map.

In certain embodiments, other resolution of following these grades can use to distinguish the different resolution for image here:

Ultimate resolution is the resolution that is less than or equal to (for example, by digital camera, scanner or transducer), the input of catching or (for example, image or the video authoring tools) image that produces.

Base resolution is the basic inspection that is sufficient to image, is also the resolution that is enough to check the peripheral part that is centered around overlapping high-definition picture.Base resolution is lower than the resolution of ultimate resolution.

High-resolution is higher than base resolution, and is less than or equal to the resolution of ultimate resolution.

Top resolution is more than or equal to high-resolution, and is less than or equal to the resolution of ultimate resolution.

In one embodiment, high-resolution still image can be 3648x2736 pixel (level * vertical), and the color of each pixel is 24, and typical digital camera has the resolution of 10,000,000 pixels.Yet this is only an example, and those skilled in the art can recognize, high-definition picture can have various resolution.

A typical high-definition picture can consume sizable amount of ram, and it is measured possible excessive and can not show fully in Free Region on client's display with resolution originally.A typical high-definition picture also may spend consumption considerable time (for example, several seconds or longer time) to download from server by network, and increases load for client, server or network.In many application, the image of base resolution (low to medium) can enough be used for the basic inspection of image.The user needs to see the image of high-resolution (than the higher resolution of base resolution) once in a while, checks the details of the image of area-of-interest.In certain embodiments, the user can check the topography that is overlapped in the base resolution image with high-resolution.

Some conventional image viewings system allows the part of user's enlarged image, and still, these systems just use the Computer display of digital zoom method amplifier section usually, rather than obtains and show the more high-resolution image that has comprised additional detail.In some traditional systems, corresponding to the pixel array portion of the image that is shown to the user, can set up an enlarge-effect with digital zoom method.This method does not provide any extra details, and just uses the image of a lower resolution to simulate enlarged image to create.For example, the pixel in the image of low resolution originally can be replicated and create the simulation enlarged image, may apply one or more level and smooth rules simultaneously and arrive enlarged image.Yet resulting simulation enlarged image like this lacks extra details, and may be apparent in unexistent coarse grain shape in the image that originally begins.The image of the area-of-interest of whole image rather than user's selection amplifies in some traditional systems.For example, Adobe And Microsoft Just amplify whole image or document file page, rather than image or document file page in the interested field of user's selection.

In contrast to this, image viewing system 100 shows with high-resolution the interested zone that the user selects, and such image is caught or produced with ultimate resolution.Client device 110 can provide details all in ultimate resolution to show the area-of-interest that the user selects, and can show that interested zone is in the complete base resolution image of context-sensitive.According to an embodiment, the image in the zone that the user selects can high-resolution show, and overlaps on complete base resolution image.

Traditional system does not also have use to carry out digital amplification based on the method for client-server or the context-sensitive high-resolution shows.In traditional system, image or file are stored on local computer system, and use above-described conventional art with all or part of amplification of file.In contrast to this, image viewing system 100 can use the method on client-server basis, wherein large high-definition picture is stored, produces or be input to server 120, and the image of a less base resolution can send to client device 110 from network 130 and make image and substantially check.High-definition picture only sends when needed, and it be not necessary for each base resolution image and send, thereby has saved the network bandwidth, and in the resource of processing and the storage of client device and server.In certain embodiments, as further optimization, if when user expection only need to be checked image a part of with high-resolution, this part rather than whole high-definition picture can send to client device by server by network 130.Even because a high-resolution image can be also a Mbytes or larger number after compressed, if minimizing the number of transmissions, only perhaps that the good Whole Response time that this high efficiency systems has is embodied by the local high-definition picture of Internet Transmission corresponding to the area-of-interest of client user's selection.

Now, turn back to Fig. 1, the client device 110 in image viewing system 100 can be set to allow the user to check its storage, produce or be input to the image of server 120 with different resolution.The viewing area 150 of client device 110 shows the base resolution image, and virtual lens 160 shows that it overlaps the high-resolution image section on the base resolution image.According to an embodiment, viewing area 150 can be all or part of display window of application program of operation on client device 110, wishes to check therein the other types application program of high-definition picture content as network reader, word-processing application, image viewer or editor application and user.

According to an embodiment, client device 110 can be set to show difform virtual lens 160.For example, virtual lens can be rectangle, circle, avette or other shape.According to some embodiment, virtual lens can comprise some annexes, as a frame and handle.For example, in one embodiment, virtual lens can be the shape of a magnifying glass, become one movably magnifying glass overlap on the base resolution image.On the virtual lens 160 of this magnifying glass shape, the user can check with high-resolution the topography of the area-of-interest of its selection, and this topography is transferred to client device 110 (transmission 140) from server 120 by network 130.

According to an embodiment, client device 110 can be set to allow the user to use the virtual lens 160 that overlaps in pointing apparatus moving display area 150 on the base resolution image, with high-resolution topography shown in conversion virtual lens 160.As mentioned above, virtual lens 160 is as the high-definition picture magnifying glass on the base resolution image in viewing area 150, in fact do not amplify the base resolution image, but virtual lens 160 shows the local high-definition picture that receives from server 120.

For example, the supplier of online medical science education continuing education course can show the training lantern slide with image viewing system 100, comprises the digital microscope image.These digital pictures can be very large sizes, will consume a large amount of network bandwidths if the high-definition picture of an actual size is sent to client device 110 from server 120.Yet server 120 can provide the digital slide image of base resolution to express specific concept.If the user wants to see more details, the user can select an interested zone on the base resolution image, and client device 110 can present a high-resolution image with the virtual lens 160 that overlaps on the base resolution image.The user can see the more details of high-definition picture.This method can more effectively be used network and the computational resource of server 120 and client device 110, is that each base resolution image of checking sends high-definition picture because client device does not need request server 120.When the user only need to (for example check image partly with high-resolution, selected area-of-interest and neighboring area), owing to only having this part rather than whole high-resolution image to send to the equipment of client from server, its efficient is able to further raising.In certain embodiments, virtual lens 160 can be set to appear on the specific position of base resolution image, so that in outstanding digital lantern slide, certain specific feature shows emphasis in teaching material.In certain embodiments, the user also can dynamically control location and the size of virtual lens 160, and the resolution content that dynamically upgrades virtual lens 160 from server 120 of change that can root a tree name user area-of-interest.In certain embodiments, the user also can change " multiplying power " (that is, level of resolution) that virtual lens shows.If the customer requirements image further amplifies, virtual lens can show more high-resolution image (ultimate resolution of supporting up to server), and if the user asks its virtual lens to be dwindled, the image of low resolution can show on virtual lens.

In another example, the Online Map application program can use image viewing system 100 for interested field, show more details or more detailed satellite image, or both haves both at the same time.When the customer requirements map, server 120 can send the base resolution map to client device, and when the user needed a more detailed view, virtual lens can provide the part that overlaps on map detailed view.Like this, only just download its high-resolution image when wanting.In certain embodiments, as further optimization, check topography's (for example, selected area-of-interest and neighboring area) when the user only requires with high-resolution, only have this part image to send to the equipment of client through network from server.This technology comprises in navigation application very useful especially at mobile device, because these equipment have bandwidth and storage quantitative limitation usually.

According to an embodiment, image viewing system 100 can be set to use three kinds of different operator schemes: two time scales approach or server combination method fall in method for down loading, client continuously.In some embodiment, these methods can be used singly or in combination.In another embodiment, image viewing system 100 can be set to provide the method for a cooperation, and the method two time scales approach can be fallen in continuous method for down loading, client or any of server combination method is combined with.

Continuous method for down loading

Fig. 2 and Fig. 3 are the flow charts of continuous method for down loading.According to an embodiment, the method can be used together with image viewing system 100.Fig. 2 illustrates the step of continuous method for down loading.According to an embodiment, the method can be carried out on client device 110.Fig. 3 illustrates by server 120 and carries out the method step of download continuously.

When the method in Fig. 2 receives a request of checking image in the equipment 110 of client (step 210).According to an embodiment, this request can comprise that the user uses application access file or image.In other embodiments, this request can comprise that the user uses the specific webpage of application access or the other guide that moves in reader on client device 110.In another embodiment, this request can comprise that user's executive utility from the client device 110 uses the content of the high-definition picture that obtains from server 120.

As shown in Figure 2, client device 110 sends the request (step 220) corresponding to the base resolution image of required image to server 120.According to an embodiment, display apparatus module is configured on client device 110.Like this, display apparatus module can be processed from the image request in application program on client device 110, and sends this request corresponding to the base resolution image of required image via network 130 to server 120.

Client device 110 determines whether to receive image from server 120 (step 225).According to an embodiment, if an image is limited access, server 120 can its image control regulations of root a tree name be sentenced the user of client device or client device 110 (or both) and whether is had the right to check this image.According to an embodiment, the request that is sent by client device 110 can comprise the identifying information that is associated with user or client device 110, can be used for determining whether server 120 should authorize it to storing, generate or be input to the access rights of the image of server 120.If the user is not authorized to access the image of asking, server 120 can select to send an information, haves no right to access the image of being asked with user or the client device 110 of indication client device 110.According to an embodiment, client device 110 can also be provided to record the rear time of experiencing of server 120 that transmit a request to.If the base resolution image does not receive within the predetermined time, this request timed out cancels.

If do not receive the image from server 120, client device 110 can select to show a message, shows to the user and can't access the image (step 260) of asking.According to some embodiments, what image detailed error message can be described as can't be accessed.For example, if do not receive within a certain period of time response, this information can show that this request timed out cancels, and shows that perhaps this user haves no right to check the content of asking.

If client device 110 receives the image from server 120, client device 110 can show the image (step 230) of base resolution in its viewing area 150.According to an embodiment, the display of client device can be set to the size that free space on root a tree name viewing area is adjusted the image of the base resolution on client device 110.Fig. 4 illustrates an example of viewing area on client device.For example, if client device 110 comprises a viewing area 410 that 1200 pixels are wide and 800 pixels are high, and, if the width of 60% viewing area can with show base resolution image 420, and total height deducts 140 pixels at its top and 120 pixels of bottom are available viewing areas, and the display apparatus module of client device will show the base resolution image that 720 pixels are wide and 540 pixels are high on available display area 420.According to an embodiment, viewing area 410 can comprise desk-top display screen or other display unit on client device 110.In one embodiment, viewing area 410 can comprise the window of an application program, comprising application information, and window control and other information.For example, in certain embodiments, the user can access just like high-definition picture or webpage or comprise the other guide of the high-definition picture in reader.Embodiment in Fig. 4 has shown viewing area 415 and has been used for showing the part of content of text, thereby has reduced the image free space that is used for showing base resolution.If the base resolution image shows, be used for showing that the free space of base resolution image also can be affected in application window.Consequently, the viewing area 420 of demonstration base resolution image can be the total amount less than the viewing area of client device.Can find out from these exemplary embodiments, the resolution of base resolution image can partly decide according to the resolution of client device 110 and the usable area on screen size and viewing area 420 at least.

Client device 110 can receive the request from the user, checks the high-resolution image (step 235) of area-of-interest.According to an embodiment, the user can use input unit, as pointing device, comprise mouse, touch-screen, touch pad, joystick, trace ball, arrow key, button or other input equipments, the user can select interested zone in the base resolution image like this, checks The topography with high-resolution.

Client device can send to request server 120, requires the high-definition picture (step 240) corresponding with the base resolution image.According to an embodiment, this request can comprise the high-definition picture of required level of resolution.Ultimate resolution of the image of server 120 can store, generate or be input to up to it to the scope of required resolution on the base resolution of image.

According to some embodiment, client device 110 can send a request to server 120, and this request can only comprise the high-definition picture part of the determined area-of-interest of user, rather than whole high-definition picture.In the situation that the part of user in only wishing to check the base resolution image with high-resolution, perhaps in the situation that the complete image of Internet Transmission will cause adverse influence to the response time, perhaps in the situation that the amount of ram of client is not enough to store complete high-definition picture, another kind of request can be to only require the high-definition picture that uses part.According to an embodiment, this request can comprise one group corresponding to the reference point of area-of-interest on the image of base resolution.For example, in certain embodiments, client device 110 is set to rectangle that the user can be drawn on the image of base resolution, wishes to see the high-definition picture of this area-of-interest to indicate the user.The bight, upper left of its rectangle and width and the height of bight, bottom right or bight, upper left and central point when sending high-resolution image, request server 120 can be provided.According to an embodiment, the picture screen coordinate that display apparatus module can be set to change base resolution is pixel coordinate, and can comprise the pixel coordinate of the area-of-interest of user's appointment when request server sends high-definition picture.According to another embodiment, client device 110 can provide a user interface, the user is in order to receive in the zone of cursor indication, an or high-resolution image corresponding to area-of-interest in the base resolution image that is covered by shape, can be its locational dragging or mobile cursor or shape, as rectangle or ellipse etc.

Client device 110 determines whether to receive the high-resolution image (step 245) from server 120.If do not receive the image from server 120, client device 110 can select to show that a piece of news shows to the user can't access the image of asking.Otherwise, if client device 110 can receive the high-resolution image corresponding to interested zone of asking, client device 110 can show the high-resolution image (step 255) corresponding to the part in interested zone in virtual lens 160.Virtual lens is put and can be arranged on base resolution image interested zone, and can be set to show the high-definition picture corresponding to interested area part of being determined by the user.According to an embodiment, virtual lens 160 can arrange and revert to initial size and shape.In one embodiment, the size of virtual lens can with being in proportion of the base resolution image that shows on client device 110.For example, in one embodiment, the size of virtual lens may be the base resolution image size 1/4th.For example, if that the size of base resolution image is 720 pixels is wide, 540 pixels are high, the size of virtual lens is that 360 pixels are wide, 270 pixels are high.

In an embodiment, the display apparatus module of client device 110 can be determined the part corresponding to the high-definition picture of the area-of-interest of user's selection, and show corresponding high-definition picture part on virtual lens 160, replace the part of the base resolution image in corresponding area-of-interest with high-resolution image.According to an embodiment, if the user has selected horizontal and vertical coordinate [180,270] upper left quarter with respect to base resolution figure is to show the more zone at the center of high-definition picture, and virtual lens can be by the center of fixation coordinate [180,270] in base resolution figure.If the resolution of high-resolution image be that wide to multiply by 810 pixels high for 1080 pixels, the high-definition picture part that shows (for example, the size of virtual lens) will be that wide to multiply by 270 pixels high for 360 pixels, and the regional center of wanting display of high resolution images to name a person for a particular job be [270,405], and corresponding base resolution image center be [180,270] (across 1/4th and straight lower half).According to some embodiment, the frame of virtual lens 160 can present, to mark off virtual lens 160 in base resolution image display area 150.Should be noted that a regional little high-definition picture that covers than virtual lens on base resolution image also may be displayed on virtual lens.In this example, in a 360x270 virtual lens, approximately 11% high-definition picture can show in virtual lens ((360x270)/(1080x810)).Virtual lens will cover approximately 25% base resolution image ((360x270)/(720x540) do not comprise the border).The ability of this mobile high-definition picture virtual lens can be checked with high-resolution all parts of base resolution image.

According to an embodiment, in order to improve the response time, high-resolution image can be downloaded from server 120 before virtual lens 160 middle high-resolution image sections are checked in user's request.In such an embodiment, when asking this image, the high-definition picture user of this part just shows on virtual lens 160.According to an embodiment, this high-definition picture of looking ahead can be initiated by some user's operations, and triggering client device 110 sends a request to server 120.For example, in certain embodiments, download high-definition picture and can require the same time of base resolution image from server 120, or carrying out soon after a while from server reception base resolution image.Perhaps, client device 110 can be set to respond the user and press soft or hardkey (for example, " image-watching system activate " button), or downloads high-definition picture by clicking the pointing apparatus pushbutton enable.Continue this pre-loaded technology, download at each high-definition picture and can ask when completing to download a more high-resolution image, can so go on, until reach ultimate resolution.

According to an embodiment, client device 110 can be set to allow to overlap in user's moving display area 150 virtual lens 160 on the base resolution image.In one embodiment, client device 110 is provided so that the user can by using pointing apparatus, come the mobile virtual lens as mouse, touch pad, touch-screen, joystick, trace ball, arrow key or button.In one embodiment, the display apparatus module of client device 110 is set to real time altering, namely work as the user and move cursor across the base resolution image, selected area-of-interest overlaps the upper of its position with virtual lens, and the area-of-interest that changes corresponding to changing with mobile cursor position is presented in virtual lens with high-resolution.In an embodiment, consider the cursor position of base resolution image relative reference point in display, the upper left corner of image for example is with the high-resolution picture position of definite virtual lens 160.In one embodiment, display apparatus module it is also conceivable that the user whether on the client device display scrolling page turning show, and adjust level or vertical scrolling amount (or both).If be not complete high-resolution image from server 120 request, if or cursor movement to a position, need more high-definition picture to fill up virtual lens 160, client device 110 can be sent out request and require extra high-definition picture to be presented on virtual lens 160 to server 120.

According to an embodiment, the display apparatus module of client device 110 can be set to allow the user to ask to change the level of resolution that is presented at the high-definition picture in virtual lens 160.According to an embodiment, display apparatus module can be set to provide user interface controls, control as the mobile device of soft key, slide block, pointer, or the interface module of other types, the user can show in virtual lens 160 with the high-definition picture of selecting desirable level of resolution by interaction like this.In one embodiment, the user can select the image of certain other resolution of level to show in virtual lens 160, and its resolution levels can be up to the ultimate resolution rank of storing, generate or be input to the image of server 120.In one embodiment, the user can select a level of resolution greater than base resolution and can be up to the ultimate resolution of image.

Change the request of the resolution of the shown image section of virtual lens 160 for response, display apparatus module can be set to send a request to server 120, requires its transmission corresponding to all or part of high-definition picture of base resolution image and selected level of resolution.The image section of its request can be presented at virtual lens 160 on image size identical or larger.In case server 120 sends high-definition picture to client device 110 by network 130, display apparatus module just can show the high-definition picture corresponding to the area-of-interest part in virtual lens 160.When the user asks to increase when at present just being presented at the resolution of virtual lens 160 epigraphs, one less than the high-definition picture that is presented at present virtual lens 160 epigraphs with desired resolution, will be presented on virtual lens 160.When the user asks to reduce when at present just being presented at the resolution of virtual lens 160 epigraphs, one greater than the high-definition picture that is presented at present virtual lens 160 epigraphs with desired resolution, will be presented on virtual lens 160.According to an embodiment, corresponding each be stored in base resolution image in memory, server 120 can have the image of a plurality of different resolutions, and the resolution of each image is more than or equal to resolution that generate in server 120, image that be input to or store.Server 120 can be stored the image of ultimate resolution in memory, and produces high-resolution image (lower than ultimate resolution) according to the request of client.According to an embodiment, the user can change the resolution of the shown image of virtual lens 160 at any time.

According to an embodiment, the display of client device 110 also can be set to allow the user to change the size of the resolution of virtual lens 160 sizes and the shown image of virtual lens 160.According to an embodiment, display can provide and comprise that (button or other interface assembly are used on the client device display and draw soft key, and select with pointer movement equipment), the control of hard button (keyboard or other button or switch) or pointer movement equipment (as, left or right mouse button is clicked, control up or down, trace ball is controlled by key, rolling wheel for mouse, touch control or other pointing devices control).According to an embodiment, display also can be configured to provide control, make the user fixedly virtual lens in current position (that is, stop pointer tracker device motion), freeze virtual lens or the virtual lens of thawing (recovering to follow the tracks of the motion of pointing apparatus).According to an embodiment, display also can be configured to provide control, makes the user can close virtual lens and shows, makes the image of complete base resolution show to no longer include high-definition picture overlapping, or makes the user can reopen virtual lens to show.Some control can be carried out several functions, the resolution of the image that shows as the size that changes simultaneously virtual lens with by virtual lens 160.

Method shown in Figure 3 is server 120, corresponding to the step of being taked by the performed step of client device 110 in Fig. 2.Server 120 receives the request (step 310) that requires to send the base resolution image from client device 110.If access is restricted, server 120 can root a tree name access control regulations check whether user or client device 110 have the access rights (step 320) to the image of asking.According to an embodiment, when certain image has restrict access, the request that is sent by client device 110 can comprise the identifying information that is associated with user or client device 110, can be used for determining whether server 120 should authorize the user or the access rights of the picture material of server 120 are stored, produced or be input to client device 110 to it.

Server 120 determines whether user or client device 110 (or both) have the authority (step 325) of the image of access request.If user or client device 110 do not have the authority of the image that access asks, server 120 can be set to not have to the user of client device 110 transmission information indication client devices or client device 110 authority (step 360) of the content that access asks.Otherwise, if the user has the authority of the image that access asks, server 120 will generate a base resolution image (step 330) from the high-definition picture of storing, the resolution of this high-definition picture stores, produces or be input to server 120, the resolution of corresponding base resolution image with it more than or equal to it.According to some embodiment, the base resolution image may generate from specific high-definition picture.In one embodiment, server can be provided to produce corresponding base resolution image for each high-definition picture of uploading, being input to or be created on server 120.In certain embodiments, the resolution levels of base resolution image can arrange based on the attribute of the client device that shows the base resolution image, and is used for showing the image of base resolution.For example, server 120 can be set to produce the image of low resolution, is used in the mobile device that usually has smaller szie to show, such as mobile phone.Server 120 also can be set to generate a corresponding higher base resolution image of resolution, is used in display screen is large and resolution is higher notebook computer or desktop computer system.Then, server 120 can send via network 130 image (step 335) of its base resolution to client device 120.

Server 120 can receive request from client device 110, require a complete high-definition picture, or corresponding to the local high-definition picture of area-of-interest (step 340) in image.The parts of images of asking may with show on virtual lens 160 big or small identical or larger.If access is restricted, root a tree name access control regulations determine whether user or client device 110 (or both) have access rights (step 345) again.If user or client device 110 do not have the authority of the image that access asks, server 120 can be set to represent that to client device 110 transmission information the user of client device or client device 110 do not have the access rights (step 360) to this content.Otherwise server 120 can generate or retrieve complete high-resolution image from memory, or corresponding to the local high-resolution image (step 350) of area-of-interest.That the resolution of this high-definition picture is equal to or less than is that it is stored on server 120, the ultimate resolution of high-definition picture that produce or input, but greater than the resolution of the base resolution image that offers client in step 335.Server 120 can be transmitted in the high-definition picture of generation in step 350 to client device 110 (step 355) via network 130.According to some embodiment, receive request from client device 110, this request can specify it to be used for the level of resolution of the high-definition picture that generates in step 350.For example, the application program of request high-definition picture can comprise user interface in carrying out on client device 110, this interface comprises the instrument of " convergent-divergent ", makes the user can select its high-resolution image resolution ratio rank to be presented on virtual lens 160.In certain embodiments, server 120 can its customer in response end request of buffer memory and the high-definition picture that generates, so that when again received request at this image of this level of resolution future, server 120 need not be produced this high-definition picture again.

According to some embodiments, various prioritization schemes can be used on continuous method for down loading.For example, in certain embodiments, the image of multiple resolution can be contained on client device in advance can ask to check these images with prospective users.At another embodiment, the image of the various different resolutions that client has been downloaded can be buffered in memory.According to another embodiment, client device 110 only can be set to ask, and part or high-definition picture zone that comprise its part is presented on virtual lens, simultaneously server 120 can be configured to the only high-definition picture in transmitting portion or zone that comprise its part, rather than whole high-definition picture.In one example, if it is oversize to send the time of whole high-definition picture, if perhaps the user only wishes to check and can make subordinate's part of the image of high-res in this way.

In certain embodiments, but the resolution levels root a tree name of base resolution image shows the attribute of the client device of image, bandwidth and network 130 when connecting client device 110 and server 120 lag characteristic and determine.For example, server 120 can be set to produce the base resolution image, it has lower resolution and is used for mobile device, such as the less mobile phone of common display screen, and server 120 can be set to produce the base resolution image, and it has with contour resolution the notebook computer that is used for having larger display area and high-resolution or desktop computer system.In one embodiment, it also can root a tree name client device 110 corresponding to the level of resolution of the high-definition picture of base resolution image, the attribute of server 120 and network 130 and adjusting.

Two time scales approach falls in client

Fig. 5 and Fig. 6 are the flow charts that two time scales approach falls in client, and the method can be used together with the image viewing system 100 described in an embodiment.Method step shown in Fig. 5 can be carried out at client device 110.Method step shown in Fig. 6 can be carried out by server 120.

Method in Fig. 5 starts from when client device 110 receives request and will check image on client device (step 510).Client device 110 transmit a request to server 120, requires the image (step 520) of top resolution, and its resolution is less than or equal on server 120 ultimate resolution of this image that generates, inputs or store.According to an embodiment, be configured in display apparatus module on client device 110 and can be provided to process image request from application program in client device 110, and send a request to server 120 by network 130, require it corresponding to the top image in different resolution of initial desired image.

Client device 110 determines whether to receive top high-definition picture (step 525) from server 120.According to an embodiment, if access images is restricted, server 120 can root a tree name access control regulations judges whether the user of user or client device 110 (or both) has the right to check this picture material.According to an embodiment, the request that is sent by client device 110 can comprise the identifying information that is associated with user or client device 110, can determine the access rights that whether should authorize user or 110 pairs of storages of client device, generate or be input to the picture material of server 120 with this server 120.If user or client device 110 have no right to access the image of asking, server 120 can select to send an information, and expression user or client device 110 have no right to access the image of asking.According to an embodiment, client device 110 also can be set to record it and transmit a request to the rear time of experiencing of server 120, and if also do not receive top image in different resolution within the time of scheduled volume, indicates this request timed out.

If do not receive the image from server 120, client device 110 can select to show an information, shows to the user and can't access the image (step 560) of asking.According to some embodiment, detailed error message, as be described as what image and can't access.For example, do not indicate this request timed out when this information can receive response within the predetermined time, perhaps indicate this user to have no right to check the content of asking.

If receive the image from server 120, client device 110 can produce a base resolution image (step 530) from the top image in different resolution of its reception.According to an embodiment, the display on client device 110 can be set to reduce its top image in different resolution when the image of receiving from server 120.According to an embodiment, display can be set to the display space that the root a tree name can use and reduce its top image in different resolution.

According to some embodiment, the base resolution image may be already by client device 110 from before producing certain specific top image in different resolution that server 120 receives.In certain embodiments, but the resolution levels root a tree name of top image in different resolution shows the attribute of the client device of image, and/or bandwidth and network 130 when connecting client device 110 and server 120 lag characteristic and arrange.For example, server 120 can be set to produce top image in different resolution, and its image with low resolution can be used for mobile device, such as the less mobile phone of common display screen.And server 120 also can be set to produce top image in different resolution, and its image with high-resolution can be used for having notebook computer or the desktop computer system of larger display area and high-resolution.

Client device 110 can show base resolution image (step 533) in its viewing area 150.According to an embodiment, the display of client device can be set to show on root a tree name its viewing area that the free space of base resolution image adjusts the size of base resolution image.Then, client device 110 can receive the request from the user, to check the high-definition picture (step 535) of area-of-interest.According to an embodiment, the user can use input unit, as pointing device, comprise mouse, touch pad, touch-screen, joystick, tracking ball, arrow key, button or other input equipments, make the user can select an interested zone in the base resolution image, to check its high-resolution image.According to an embodiment, client device 110 can provide a user interface, and the user can drag or mobile cursor or shape therein, as rectangle or ellipse, in the base resolution image on the position of area-of-interest.

Then client device 100 can generate the high-definition picture (step 540) of the definite area-of-interest of respective user.On the image of the top resolution that receives from server 120, client device can produce high-resolution image.According to an embodiment, when image in area-of-interest is checked in user request with high-resolution (its resolution is higher than base resolution), it is high-definition picture that client device 110 can reduce top image in different resolution, its resolution higher than base resolution (for example, and show the part (step 555) of the high-definition picture of the area-of-interest of selecting corresponding to the user on virtual lens 160 1080x810 contrast base resolution 720x540).Virtual lens 160 overlaps on area-of-interest in the base resolution image.According to an embodiment, if the user asks a more high-resolution image, display can produce another higher than the high-definition picture of previous high-definition picture resolution, this resolution can up to the resolution that comprises the top image in different resolution that receives from server 120, and show that on virtual lens 160 this is corresponding to the part high-definition picture in user-selected area-of-interest.Virtual lens 160 can overlap in the base resolution image on area-of-interest again.In addition, in certain embodiments, display apparatus module can be set to provide a user interface, makes the user can ask to change the size of virtual lens, and on virtual lens 160 resolution of shown image.

Method shown in Figure 6 has been showed the step of being carried out by server 120, its corresponding to show in Fig. 5 by the performed step of client device 110.Server 120 receives the request (step 610) that client device 110 requires top image in different resolution.If image is limiting access, whether server 120 can root a tree name access control regulations checks user or client device 110 and access rights (step 620) to the image of asking is arranged.According to an embodiment, the request that is sent by client device 110 can comprise the identifying information that is associated with user or client device 110, and it can be used for determining whether authorize the user or the access rights of the picture material of server 120 are stored, generated or be input to client device 110 to it.

Server 120 determines whether user or client device 110 have access rights (step 625) to the image of asking.If the user does not have the access rights to institute's requested image, server 120 can be set to optionally send an information to client device 110, and indicating user or client device 110 do not have the access rights (step 660) to institute's requested image content.Otherwise, if the user has the access rights to institute's requested image, server 120 can from before generation, storage or be input on server 120 be associated equate or more high-resolution image produces a top image in different resolution, and by network 130, this top image in different resolution is sent to client device 110 (step 630).

Various optimizations can be used for the client and dwindle two time scales approach, comprise that the top image in different resolution of preload can require to check these images (for example, if image is that next will be watched in a series of different images) with prospective users.

The client falls two time scales approach and can use in the lump with continuous method for down loading.For example, in one embodiment, the client falls two time scales approach and can be used for specific resolution.Method for down loading can be used for when the high-definition picture of request higher than threshold value continuously.In this case, fall the image of the top resolution of two time scales approach download for the client, its resolution can be lower than ultimate resolution available on server.Perhaps, method for down loading can be used for up to a specific resolution continuously, and the client falls two time scales approach for the threshold value higher than predetermined resolution.In certain embodiments, the combination of these two kinds of methods can be utilized for the various performance parameters of some use scenes optimization.

The server combination method

Fig. 7 and Fig. 8 are server combination methods, and the method can be used together with the described image viewing of an embodiment system 100.According to an embodiment, the step of the method shown in Fig. 7 can be carried out on client device 110.Fig. 8 illustrates the step of a method and can be carried out by server 120.

The method of Fig. 7 starts from client device 110 and receives request when client device is checked requiring of image (step 710).According to an embodiment, this request can comprise that the user is from application access file or image.In other embodiments, this request can comprise that the user is from the viewer application program specific webpage of access or other guide in client device 110 operations.In another embodiment, this request can comprise that user's executive utility on client device 110 uses from the high-resolution picture material of server 120 retrievals.

In the example of Fig. 7, client device 110 sends a request to server 120, requires the base resolution image (step 720) corresponding to the image of user's initial request.According to an embodiment, on client device 110, display apparatus module can be set to process the request from the image of client device 110 application programs, and send a request via network 130 to server 120, require the base resolution image corresponding to the image of user's initial request.

Client device 110 determines whether from server 120 and receives image (step 725).According to an embodiment, if access images is restricted, server 120 can root a tree name access control regulations determines whether client device user or client device 110 (or both) are awarded the authority of checking desired picture material.According to an embodiment, the request that is sent by client device 110 can comprise the identifying information that is associated with user or client device 110, can be used for determining whether should authorize it to storing, generate or be input to the access rights of the picture material on server 120.If the user does not have the access rights to institute's requested image, server 120 can optionally send an information to client device 110 and represent that user or client device 110 do not have the access rights to institute's requested image content.According to an embodiment, client device 110 also can be set to record it and transmit a request to the rear time of experiencing of server 120, and if also do not receive the base resolution image within the time of scheduled volume, indicates this request timed out.

If fail to receive image from server 120, client device 110 can optionally show a message, shows to the user and can't access the image (step 760) of asking.According to some embodiments, what image detailed error message can be described as can't be accessed.For example, this information can be, if do not receive response in the time of scheduled volume, indicates this request timed out, and perhaps this user is not authorized to check the content of asking.

If receive the image from server 120, the viewing area 150 of client device 110 can show its base resolution image (step 730).According to an embodiment, the free space that the display of client device can be set to root a tree name its viewing area is adjusted the size of base resolution image.

Then, client device 110 can receive the request from the user, to check the high-definition picture (step 735) of area-of-interest.According to an embodiment, the user can use input unit, comprise mouse, touch-screen, touch pad, joystick, trace ball, arrow key, button or other input equipments as pointing device, make the user can select area-of-interest to check its high-resolution image in the base resolution image.

Then, client device can transmit a request to server 120, the virtual lens (step 740) that requires a combination image to comprise the base resolution image and overlap the display of high resolution images of area-of-interest in the base resolution image.According to an embodiment, this request can comprise the coordinate with respect to the image of area-of-interest, the level of resolution of desirable high-definition picture, and the size of virtual lens and shape.Desired resolving range can be on the resolution of base resolution image and can be up to the resolution of storage on server 120, ultimate resolution image that generate or input.This request can be specified one or more interested zones, and there is the size and shape of its specific position, resolution and virtual lens in each zone.

According to an embodiment, this request can comprise one group corresponding to the reference coordinate on the base resolution image of area-of-interest.For example, in certain embodiments, client device 110 is set to make the user can draw a rectangle on the base resolution image, the area-of-interest of checking with high-resolution so that its hope to be shown, and the coordinate that provides to the server 120 high-resolution image of request the time, be the coordinate in the upper left corner and the lower right corner of rectangle, or the upper left quarter of rectangle and width add the coordinate of height.According to an embodiment, display apparatus module can be set to the screen coordinate on the base resolution image is converted to the coordinate of pixel, and the request that requires server to send high-definition picture can comprise the pixel coordinate of the area-of-interest of user's appointment.According to another embodiment, client device 110 can provide a user interface, the user can drag or mobile cursor or shape, as rectangle or ellipse, to the position of the area-of-interest of base resolution image, so as to receive its corresponding to cursor indication or the high-definition picture zone that shape covers.

Client device 110 determines whether from server 120 and receives combination image (step 745).If do not receive image from server 120, client device 110 can show optionally that an information shows to the user and can't access the image of asking.Otherwise if receive the combination image of asking from server 120, client device 110 can replace high-definition picture (step 755) with combination image in its viewing area 150.

According to another embodiment, in order to improve the response time, can user's request is checked local high-definition picture in virtual lens 160 before, download combination image from server 120.In such an embodiment, combination image just shows when the user asks.According to an embodiment, looking ahead of combination image can be initiated by some user's operations, sends request thereby trigger client device 110 to server 120.For example, in certain embodiments, the request of downloading combination image can be to server 120 request base resolution image the time, or sends soon after receiving the base resolution image from server.If interested zone can be before the part of user's actual request image predetermined words, can send its request.For example, when a route on the demonstration map, interested zone may be departure place and destination.More than so different domain of interest or different high-resolution level image can be prefetched.In addition, in other embodiments, client device 110 can be set to respond the user and press soft key or hardkey (for example, " image viewing system activate " button), or clicks button or other buttons or the button of pointing device.Continue this pre-download technology, the next combination image of request download is presented on virtual lens with higher resolution after each combination image download is completed, and can so continue, until reach ultimate resolution.

According to an embodiment, client device 110 can be set to allow the user to move the virtual lens 160 that overlaps on the base resolution image in viewing area 150.In one embodiment, client device 110 is set to make the user by using pointing apparatus, to come the mobile virtual lens as mouse, touch pad, touch-screen, joystick, trace ball, arrow key or button.In one embodiment, be set to can be from server 120 Real time request combination images for the display apparatus module of client device 110.When the user moves cursor across the base resolution image, the position of cursor can indicate the constitutional diagram the position of image of area-of-interest with respect to reference point on the base resolution image, and all combination images are presented on the virtual lens of same size and shape with identical level of resolution.When new combination image was received, client device 110 can show the combination image of new combination image to replace before having received.Along with the method for server combination, tracking cursor moves and changes the position of interested zone and virtual lens and the ability of content correspondingly depends on high bandwidth, the network 130 of low retardance and the server 120 of response.According to an embodiment, consider on display that in the base resolution image, cursor position with respect to reference point, as the upper left corner of image, is determined the coordinate of area-of-interest.In one embodiment, display apparatus module it is also conceivable that the user whether scrolling the demonstration on the client device display, and adjust level or vertical scrolling amount (or both).

According to an embodiment, the display apparatus module of client device 110 can be set to allow the user to ask to change the level of resolution of the high-definition picture that is presented at virtual lens 160.According to an embodiment, display apparatus module can be set to provide user interface controls, as the control of soft key, slide block, pointing device or the interface module of other types, make the user can the desirable level of resolution that is presented at the high-definition picture of virtual lens 160 of interactive selection.In one embodiment, the user selects to be presented at the resolution levels of image in virtual lens 160, can store, generate or be input to up to it ultimate resolution of the image of server 120.In one embodiment, the user can select up to ultimate resolution and greater than the resolution levels of base resolution.

Response changes the request of the resolution of the shown parts of images of its virtual lens 160, display apparatus module can be set to transmit a request to server 120, comprises the base resolution image and overlaps in the base resolution image corresponding to the combination image of selected area-of-interest with the virtual lens of the resolution levels display of high resolution images of selection to obtain.

According to an embodiment, the display of client device 110 also can be set to allow the user to change the size of the resolution of virtual lens 160 and the shown image of virtual lens 160.According to an embodiment, display can provide control, these controls comprise that (button or other are presented on the client device display soft key, other interface assembly of being selected by pointing apparatus), hard button (keyboard or other button or switch) or pointing device control (as, left or right mouse button is clicked, control up or down, trace ball is controlled by key, rolling wheel for mouse, touch control or other pointing devices control).According to an embodiment, display also can be provided to provide control, make the user can freeze virtual lens and (that is, stop it and follow the tracks of the pointing apparatus motion) in current position, or the virtual lens of thawing (recovering the motion that it follows the tracks of pointing apparatus).According to an embodiment, display also can be configured to provide control, makes the user can close virtual lens and shows do not have like this high-definition picture to overlap on its shown complete base resolution image, or reopen the virtual lens demonstration.Some control can be carried out several functions, as the size of change virtual lens and the resolution of the image as shown in virtual lens 160.For the size of any virtual lens 160 or the variation of position, perhaps change whether show or hide of virtual lens 160, client device 110 can transmit a request to server 120, the combination image of looking for novelty is unless the image of the combination of a coupling is on the internal memory 100 of client device.When receiving this combination image, client device 110 can show that new combination image is to replace previous combination image.

Method shown in Figure 8 is the step of being taked corresponding to the performed step of client device in Fig. 7 110 by server 120.Server 120 receives the request (step 810) from the base resolution image of client device 110.If the access of this image is restricted, server 120 can root a tree name access control regulations checks whether user or client device 110 (or both) have the access rights (step 820) to the image of asking.According to an embodiment, the request that is sent by client device 110 can comprise the identifying information that is associated with user or client device 110, can be used for determining whether should authorize it to storing, generate or be input to the access rights of the picture material of server 120.

Server 120 determines whether the user has the access rights (step 825) to institute's requested image.If the user does not have the access rights to institute's requested image, server 120 can be set to send an information, indicates this user to have no right to access institute's requested image (step 860).Otherwise if user or client device 110 have the access rights to institute's requested image, server 120 can produce a base resolution image (step 830) from its image of storing, generating or input.According to some embodiment, the base resolution image of certain specific high-definition picture may generate.In one embodiment, server can be provided to generate its base resolution image for each high-definition picture that uploads to, is created in or be input on server 120.In certain embodiments, but the resolution levels root a tree name of base resolution image shows that the attribute of the client device of its image arranges.For example, server 120 can be set to produce the base resolution image, it has lower resolution and is used for mobile device, such as the mobile phone that usually has than small display, and server 120 also can be set to produce the base resolution image, and it has higher resolution and is used for having notebook computer or the desktop computer system of larger display screen and high-resolution.Then, server 120 can send base resolution image (step 835) to client device 110 via network 130.

Then, server 120 can receive the request of obtaining combination image from client device 110, this request has comprised the coordinate of area-of-interest, the resolution levels of base resolution image and overlapping high-definition picture, and the size and dimension (step 840) of virtual lens.If the access of this image is restricted, server 120 can root a tree name access control regulations determine again whether user or client device 110 have the access rights (step 845) to institute's requested image.If the user does not have the access rights to institute's requested image, server 120 can be set to send an information to client device 110, indicates this user to have no right to access institute's requested image (step 860).Otherwise, server 120 can generate or retrieve combination image from memory, wherein comprise the base resolution image and overlap on area-of-interest and show the virtual lens (step 850) of the high-resolution topography of area-of-interest specified in request.In one embodiment, the resolution of high-definition picture can equal its ultimate resolution of storing, producing or being input to the image on server 120.Ultimate resolution of the image on server 120 can store, produce or be input to less than it to the resolution of high-definition picture also, but greater than the resolution of the base resolution image that offers client in step 835.Then, server 120 can be sent in via network 130 combination image (step 855) that generates in step 850 to client device 110.According to some embodiment, receive request from client device 110, this request can specify it to be used for the resolution levels of step 350 generating portion high-definition picture.For example, the request of the performed high-definition picture of application program can comprise user interface on client device 110, this interface comprises the instrument of " convergent-divergent ", makes the user can be chosen in the resolution levels of display of high resolution images on virtual lens 160.In certain embodiments, the combination image that server 120 can its customer in response end request of buffer memory generates, if receive another with the request of the image of level of resolution in future like this, server 120 needn't generate this combination image again.

According to some embodiments, multiple optimization can be applied in the server combination method.For example, in certain embodiments, combination image can be checked these images with the prospective users request by client device is pre-loaded.In certain embodiments, but the resolution levels root a tree name of base resolution image shows attribute, bandwidth and the network 130 of the client device of base resolution image connects the lag characteristic of client devices 110 and server 120 and determine.For example, server 120 can be set to produce the base resolution image, and it has lower resolution and is used for mobile device, such as the mobile phone that usually has than small display.And server 120 also can be set to produce the base resolution image, and it has higher resolution and is used for having notebook computer or the desktop computer system of larger display screen and high-resolution.Corresponding to the resolution levels of the high-definition picture of base resolution image also can root a tree name client device 110 attribute and adjust.

Collaboration method

According to another embodiment, image browsing system 100 can be set to allow first user to represent that the second user selects the shape and size of interested zone, resolution and virtual lens.This technology can be used in such as cooperation or teaching and use.In one embodiment, the selection of first user can store when being second user's requested image and use.The client device 110 that selected parameter can convey to second user sends image request to server, in the time of perhaps can being kept on server 120 for second user's requested image.Utilize this technology, second user can walk around and select interested zone, the resolution levels of high-definition picture and the steps such as shape and size of virtual lens, because first user has been completed these selections.In one embodiment, this technology can be fallen two time scales approach with continuous method for down loading, client or the server combination method is united use.No matter be which kind of method can be that the second user specifies the selection parameter by first user.In another embodiment, first user can pass through client terminal device input selection parameter with the mode of for example menu or instruction.In one embodiment, no matter that two time scales approach falls in continuous method for down loading, client or the server combination method can be used by the second user, with retrieval or determine that its step of selecting parameter replaces selecting the step of the shape and size of the resolution levels of interested zone, high-definition picture and virtual lens.Then, method for down loading, client are fallen the methods such as two time scales approach or server combination method and can be used for continuously, for example, and the size and dimension of mobile virtual lens or change virtual lens, or change the resolution that is presented at the high-definition picture in virtual lens.In one embodiment, this cooperation can be done in real time, and for example, is second user's mobile virtual lens by first user, or changes the resolution that is presented at image in virtual lens, or the size of change virtual lens or shape etc.

Fig. 9 A and 9B illustrate configurable in the image viewing system flow chart of the collaboration method on client device.Fig. 9 A shows the described of an embodiment, is the method that the second user specifies a group selection parameter that is used for the demonstration image.Select parameter can comprise interested zone, resolution specification, virtual lens specification and other display parameters or their combination.The resolution specification can comprise the resolution of base resolution image and the resolution of high-definition picture, or the ratio of high-resolution and base resolution, or suitable amount therewith.The resolution ratio can be used for making base resolution image that first user's client device and the second user's client device can show different resolution (for example, when display is different size), also can be used for the part at the second user's client device display of high resolution images, its high-resolution is complementary with the increase ratio that first user uses with respect to the increase ratio of base resolution.The virtual lens specification comprises the absolute dimension size of the shape of virtual lens and virtual lens or with respect to the size of base resolution image.

First user is specified and is used to the second user to show the selection parameter (step 910) that the image browsing system 100 of image will use.Then, first user can will select parameter to send second user's (step 920) to.According to an embodiment, first user can send from the client device 110 of described first user selects parameter to the second user's client device 110.For example, for a network (Web) application program, first user can send by the Email that comprises uniform resource locator (URL) link selects parameter, its link to comprise the parameter selection in the inquiry string.When link is clicked by the second user, transmit this at the client email of the second user's client device 110 and be linked to browser, then it can require to comprise the part high-definition picture that the webpage of these logics has specific selection parameter to server 120 requests, and it is presented on the second user's the display screen of client device.This high resolution graphics corresponding to the area-of-interest of the appointment of base resolution image similarly is on the virtual lens of the size and shape that is presented at appointment of the resolution with appointment, and this virtual lens overlaps on the area-of-interest of appointment of base resolution image.In another embodiment, in the client device 110 of first user, the first application program of operation can send the second application program of selecting parameter operation in the second user's the client device 110.In another embodiment, in the client device 110 of described first user, an application program of operation can send and select parameter to server 120, is used for retrieval and the use of the application program of operation on the second user's client device 110.In another embodiment, select parameter to be drawn with calculation procedure by the client device of first user, the second user's client device or server.This calculation procedure can be used in combination with user's input.As an exemplary embodiment, in map application, calculation procedure can be located specific position for example area of origin or the destination of a route on map.Calculation procedure also can allow within a period of time or in response to user's input, follow the tracks of a route with high-resolution.As another example, be used for video, calculation procedure can be used for overlapping with high-resolution video the moving object of following the tracks of on the base resolution range of video along with passage of time.The feature of its initial position and object can be specified by the user.

Method shown in Fig. 9 B is used for receiving the requirement of a group selection parameter and demonstration image, and to server 120 requested image, according to an embodiment.Client device 110 receives the request from the second user, requires to check the image (step 930) corresponding to selecting parameter.Second user can specify for the selection parameter that shows institute's requested image, and the logic of perhaps carrying out on the second user's client device 110 can be determined the existence of the selection parameter of its image automatically, and for the treatment of the demonstration of image accordingly.Following condition can be used for determining to select the existence of parameter, namely select parameter whether to obtain from the client device of first user, perhaps select parameter by network to server lookup, perhaps whether exist to be used for producing the calculation procedure of selecting parameter on the second user's client device.Then, client device 110 transmit a request to server 120, requires to obtain image (step 935).This request comprises part or all of selection parameter, specifically depends on the method for using.In one embodiment, for continuous method for down loading, client device 110 sends the request of an independent request or combination to server 120, requires to obtain base resolution image and high-definition picture (or high-definition picture of part).But client device 110 root a tree names select parameter, the available display space of client device 110 and the function of network 130 to determine base resolution and high-resolution level.When the high-resolution image of requested part, the request of client device 110 has comprised the size and dimension corresponding to the high-definition picture of the level of resolution of the area-of-interest of one group of set coordinate of the coordinate of image reference point or Reference, high-definition picture and the part of asking.These parameters are to come from the selection parameter, and can the root a tree name second user's client device 110 functions, or the client device 110 that connects the second user is adjusted with the function of the network 130 of server 120.In another embodiment, fall two time scales approach for client, client device 110 transmit a request to server 120, requires to obtain top image in different resolution.Its top level of resolution can be determined from the function of selecting parameter and client device 110 and network 130.In another embodiment, for the server combination method, client device 110 transmit a request to server 120, comprising resolution level, high-resolution level, area-of-interest with respect to the coordinate of reference point and the size and dimension of virtual lens, all these can be determined from selecting parameter, and can revise according to the function of a tree name client device 110 and network 130.

Client device 110 determines whether to have received the image (step 945) of asking from server 120.According to an embodiment, if certain image is limited to access, server 120 can root a tree name access control regulations judges whether client device 110 or its user (or both) have the right to check desired image.According to an embodiment, the request that is sent by client device 110 can comprise the identifying information that is associated with user or client device 110, and server 120 can determine whether should authorize it to storing, generate or be input to the access rights of the picture material of server 120 with this.If the user haves no right to access the image of asking, server 120 can select to send an information, haves no right to access the image of being asked with user or the client device 110 of indication client device 110.According to an embodiment, client device 110 can also be provided to record the rear time of experiencing of server 120 that transmit a request to.If do not receive within the predetermined time the base resolution image, this request timed out cancels.

If do not receive image from server 120, client device 110 can select to show an information, shows to the user and can't access the image (step 960) of asking.According to some embodiments, what detailed error message can be described as can't access this image.For example, if do not receive response within the time of scheduled volume, indicate this request timed out to cancel, or indicate this user not have no right to check the content of asking.

If client device 110 receives one or more images of asking from server 120, client device 110 can show with the selection parameter that first user or calculation procedure provide the image (step 950) of asking.In one embodiment, when the second user uses continuous method for down loading, client device 110 can receive base resolution image and high-definition picture from server 120, and shows base resolution image and the high-definition picture corresponding to area-of-interest that overlaps the area-of-interest position.In one embodiment, when the second user used client to fall two time scales approach, client device 110 can receive top image in different resolution, and generated base resolution image and high-definition picture with it.Then, client device 110 can show base resolution image and the high-definition picture corresponding to area-of-interest that overlaps the area-of-interest position.In one embodiment, when the second user used the server combination method, client device 110 can receive and show combination image.

Figure 10 is the flow chart of a collaboration method, and the method can be configured on server in the described image browsing system of Fig. 1.Method in Figure 10 has been shown server 120 corresponding to the step of being taked by the performed step of client device 110 in Fig. 9 A and Fig. 9 B.Server 120 receives from the second user's client device 110 and selects the image request (step 1010) of parameter based on certain.If this image has restrict access, server 120 can root a tree name access control regulations inspection the second user or its client device 110 whether have access right (step 1020).According to an embodiment, the request that is sent by client device 110 can comprise the identifying information that is associated with user or client device 110, and server 120 can determine whether should authorize it to storing, generate or be input to the access rights of the picture material on server 120 with this.

120 a tree name access control regulations of server determine whether user or client device 110 (or both) have the access rights (step 1025) to the image of asking.If the user haves no right to access the image of asking, server 120 can select to send an information, haves no right to access the image (step 1060) of being asked with user or the client device 110 of indication client device 110.Otherwise if the image that user's Internet access is asked, server 120 can select parameter to generate one or more images (step 1030) of asking by the root a tree name, and sends it to client device 110 (step 1035) by network 130.In one embodiment, for continuous method for down loading, the request of image can be to ask for the base resolution image, the part of high-resolution image or high-definition picture, or have simultaneously base resolution image and high-definition picture or both parts.Server 120 can generate the image of asking and send to client device 110.In another embodiment, two time scales approach is fallen for client, the request of image can be the image of asking for a top resolution, server 120 can generate this top image in different resolution and send to client device 110, and its top resolution is less than or equal to its resolution that is created on, is input to or be stored in the ultimate resolution image on server 120.In another embodiment, for the server combination method, the request of image can comprise the selection parameter that can adjust with the function of client device 110 and network 130, and server 120 can be selected parameter and be combined into image by the root a tree name, and sends it to client terminal device 110.

According to another embodiment, area-of-interest and other selection parameters can be that the user selects by carrying out calculation procedure on client device 110 or server 120.For example, for map, the departure place on a road or destination, for medical image, specific anatomical features or abnormality.

Extra method

Other extra methods can optionally be fallen two time scales approach, server combination method and collaboration method with continuous method for down loading as above, client and be united use.Some examples of these methods are described below.

Method described in one embodiment is used for preventing that virtual lens 160 from extending the border of base resolution image.In above-mentioned method, the display apparatus module of client device 110 partly arranges the high-definition picture of the area-of-interest in virtual lens and its shown base resolution image in the center.This part high-definition picture is presented on virtual lens and is arranged on the selected area-of-interest of base resolution image.In one embodiment, the display apparatus module of client device 110 can be provided to determine virtual lens 160 whether with the border of extend through base resolution image, and the amount with virtual lens extend through base resolution image boundary of also can being provided to compensates virtual lens and is presented at the position skew of high-definition picture wherein.In one embodiment, the display of client device 110 can be adjusted the size and dimension of virtual lens, and the position of compensation virtual lens 160 is offset to improve the function of the application program of using virtual lens 160.For example, virtual lens can be placed at above the special column of newspaper or periodical in the electronic reader application program, and display can be set to, as long as the user keeps pointer/cursor in the special column, virtual lens 160 just remains on the center in special column.

In another embodiment, virtual lens can have a frame that virtual lens and following base resolution image area are branched away.The type of frame can comprise the monolateral line of various styles, thickness and color, the polygon line of various styles, thickness and color, and the edge of inclined-plane or other types.And the frame of another kind of type virtual lens can reduce size and the resolution of virtual lens edge image section, on virtual lens, the transition meeting between display of high resolution images and base resolution image is level and smooth like this, and due to the size difference between high-resolution and base resolution image, make its image section that less loss or not loss only be arranged.In such embodiments, virtual lens can be that the area of a kind of air bubble type shape or projection is given prominence on the base resolution image, and the area of bubble or projection has the core of a relatively flat and the edge (above image) of bending on third dimension degree.Some diastrophic image can appear on edge crooked on third dimension degree.

According to another embodiment, display can be set to, and when the user asks, freezes in virtual lens 160 the interested zone and the position that show with high-resolution, makes the virtual lens can not be from the movement of motion tracking pointing device.Display also can be set to, and according to user's the request virtual lens 160 of thawing, like this, virtual lens position and content will the automatic following pointing devices.

According to another embodiment, display can be provided to increase or reduce the size of virtual lens 160, change shape, size or the border of virtual lens, change the accessory that shows on virtual lens, increase the resolution of the image that shows on virtual lens 160, it reaches as high as storage, generates or be input to the ultimate resolution of the image of server, and the resolution that reduces the image that shows on virtual lens 160 is close to but does not comprise base resolution, or what combination above appointing closes.When the size of virtual lens is increased or shape when being changed, if the high-resolution image section in 110 memories of client device is not enough to fill up virtual lens, client device 110 can send enough large high-definition picture by request server 120.

Display can also be provided to request according to the user and change simultaneously the resolution that shows in virtual lens and the size of virtual lens.In addition, display also can be provided to, and when the user asks, hides virtual lens or shows the previous virtual lens of hiding.In addition for example, picture or other time dependent images for video, display can be provided to, change the demonstration of base resolution image in its transformation period according to the frame rate of time dependent video content or picture material, and show in the synchronous change virtual lens with the corresponding high-definition picture of this base resolution image.In one embodiment, the frame of the current demonstration in the content that the high-resolution video in frame rate and base resolution video content and virtual lens shows, can synchronization, so that the high-resolution of the video content that virtual lens shows part is synchronizeed with the video content of base resolution.

According to another embodiment, image viewing system 100 can be provided to preserve the image that the user selects area-of-interest, virtual lens shape and size and be presented at resolution on virtual lens.These parameters can be kept on server 120 or client device 110 for the user, in order to retrieval in the future and use.

These methods can be applicable to various performance situations or timing condition.Display can be set to, and downloads from server in the situation that the high-definition picture that virtual lens will show is not yet completed by network, provides certain indication to the user.In addition, display can be set to present in inside display plane together with virtual lens on primary image, and the image that will show from these plane computations.For example, display apparatus module can be provided to, and when virtual lens is not hidden, inserts an extra opaque plane between virtual lens and bottom primary image.This opaque plane can be identical with the size and dimension of virtual lens and be positioned at virtual lens under.Display apparatus module can be set to, and when the image that will not show on the plane in virtual lens, for example high-definition picture is not also completed when downloading from server, is rendered as an opaque plane.

According to an embodiment, can support a plurality of images at image browsing system 100.Image browsing system 100 can be configured to support the user of a plurality of client devices 110 and client device, and each may check different images.Image browsing system 100 can comprise multiple servers 120.Multiple servers 120 can be used for the purpose of equally loaded, to improve function and to break down or network carries out the fault transfer during to the disconnecting of server at certain station server.Image browsing system 100 can be configured to support a plurality of networks 130 to share or error protection to realize load.The response that the detection of fault and fault shift can be carried out in client device 110, server 120 or network 130.Image browsing system 100 can be provided in and support a plurality of virtual lens 160 that overlap on same base resolution image in image display area 150.Image browsing system 100 can be configured to support a plurality of base resolution images and be presented at viewing areas different on client device 110, and each base resolution image has one or more overlapping virtual lens 160 and shows its interested zone with high-resolution.

According to an embodiment, can adopt various safety methods at image browsing system 100.For example, this image browsing system 100 can be set to limit the public access to certain given content on server 120.a part as the access control execution, server 120 can adopt the whole bag of tricks come verification client device the user identity (for example, by the logging program on client device 110, comprise username and password, security token, biological identification technology, asymmet-ric encryption method, the method of asymmetric encryption and digital certificate, symmetric encryption method, one-way Hash process, or other user authen methods), and/or the identity of client device 110 (for example, adopt pass code, asymmet-ric encryption method, asymmetric encryption and digital certificate method, symmetric encryption method, one-way Hash process, or miscellaneous equipment authentication method).No matter whether the execution of access control is carried out on client device 110, and the user of client device 110 or client device 110 and users person are determined by the access control regulations of system.When the user called for the first time image browsing system 100 or other system representative of consumer and calls image browsing system 100, performed checking can be specifically to browse the time of the meeting for one.After carrying out checking, server 120 can distribute the identifier in a time of the meeting, submits to together with the request of this identifier and client device 110.For example, for a web application, server can be in the cookie of 110 browsers of client device storage time of the meeting identifier, and browser can send to server with the value of this cookie together with image request.According to an embodiment, server can use certificate comes the access rights of authenticated user and/or 110 pairs of images of asking of client device.When identification information and image originally transmit, can use encipherment protection (for example, using IPSec or other security protocols and the encryption method of Transport Layer Security [TLS], internet protocol security) on network 130.In another embodiment, access control can some rules of root a tree name be carried out, and the information beyond the identity of these regular users or equipment is determined the access rights pressure access control of a network or sub-network level (for example).

According to an embodiment, in order to improve its transmission time on whole network 130, image can be compressed before sending by network 130 from server 120, then decompressed on client device 110.Compression also can be used on server 120, to reduce the requirement to memory.

According to an embodiment, the display on client device 110 can be set to ask the image of the resolution of appointment will ask to check this image with this resolution with prospective users.Perhaps, in the situation that client device 110 does not provide clear and definite given resolution or makes up resolution or there is no the clear and definite image update request corresponding to the time change, server 120 can be set to send image to client device 110 with a specific resolution or combination resolution.

Exemplary embodiment

For the purpose of illustrating, the exemplary embodiment of method for down loading continuously is described below in the image viewing system.As known to persons skilled in the art, also have in addition many other modes to implement method of the present invention.

In the present embodiment, display at client device can be comprised of the reader that presents webpage, wherein contains Hypertext Markup Language (HTML) or expansion HTML (XHTML) element, the statement of CSS (CSS) and the JavaScript code of downloading from Web server.Other programming languages (as Java, C#) also can be used for replacing JavaScript.

In the present embodiment, the viewing area 150 of the client device of demonstration base resolution image can be a HTML div element with identification code of pattern 0 (graphics0).The attribute of the z-index of div element can be set to 0.The viewing area that comprises virtual lens 160 can be the div of the identification code of a pattern 2 (graphics2).The z-index attribute of the div of virtual lens can be set to 2, and div can have initial line circle of 5 pixel wide.The opaque div of an extra identification code with pattern 1 (graphics1) is between virtual lens and base resolution image.The z-index attribute of the div of this interpolation can be set to 1, and is size and the size identical with virtual lens.The div of pattern 1 can have an opaque background (for example, black background).The 4th div also can be positioned on the div of identification code of other three patterns 3 (graphics3).The 4th div can have identical size with pattern 0, and can be exactly with solid border, transparent background, and empty content is positioned on pattern 0.All these div can fix on the page with absolute coordinate.

The user of client device 110 can use user interface requests as above to check image.Display apparatus module receives this request, then sends a request to server 120 by network, requires to obtain the base resolution image corresponding to required image.Server 120 can authentication of users to determine user's content whether Internet access is asked.In one embodiment, if the user once signed in to server, and this server has been provided with a cookie who comprises time of the meeting identifier on client device 110 readers, and reader sends by a TLS encryption connection and comprises the cookie of time of the meeting identifier to server.If allow the user to access this image, server 120 can send to client device 110 image of base resolution, so the base resolution image (no matter being on the foreground or in background) of the div that display apparatus module can display pattern 0

According to an embodiment, the user can be by a button showing on the user interface of clicking client device 110 to activate image browsing system.So, display apparatus module can set up for the div of pattern 3 that a mouse moves, mouse is pressed, mouse-over and mouse shift out (mousemove, mousedown, mouseover, and mouseout) button.onrelease (or similar touchscreen events handling procedure).Virtual lens can be configured to initial rectangular dimension.The width of virtual lens can originate in pattern 0 div width 50%, simultaneously the height of virtual lens can originate in pattern 0 div height 50%.Then, the code in client device 110 transmit a request to server to obtain the first high-resolution image.Server root a tree name access control regulations are carried out the checking of its access rights.If the user has access rights, server will send this high-definition picture to client device 110.

During the download of high-definition picture, the indicator light that display apparatus module can be set on display screen glimmers to indicate high-definition picture to download from server.After download was completed, display apparatus module can provide the user indication, show to download to complete, and system was ready to.In addition, display can be changed cursor, downloads to show " wait " (for example, the hourglass symbol on PC), and recovers normal after download is completed.Display apparatus module sends to server 120 and asks for the next more request of high-definition picture (if Next words are arranged) after download is completed, and checks the image of next higher resolution with the prospective users request.

The user can click in primary image by using pointing apparatus, and requirement shows that the virtual lens of the high-definition picture of this part is presented on this interested zone.Display can calculate virtual lens will be placed on position on display.In one embodiment, virtual lens is positioned at the center of the central point of area-of-interest, unless this center position can make the border of div of virtual lens and pattern 0 overlapping.Under these circumstances, virtual lens can prevent so overlappingly to offset needed amount, makes the central point of corresponding area-of-interest and the off-centring of virtual lens.Then display apparatus module can calculate the position of the high-definition picture in the area-of-interest that may be offset, and determines the top-left position in high-definition picture.Display apparatus module can be put into the anti-interpolation value of these coordinates on the style background position attribution of div of pattern 2.Display apparatus module can also arrange the top-left position of div of pattern 2 on the absolute position of virtual lens on the page.Then display apparatus module can load high-definition picture on the div background of pattern 2.Display apparatus module can also arrange being complementary of div of the top-left position of div of pattern 1 and pattern 2.When loading high-resolution image, the opaque background of the div of pattern 1 will appear on the virtual lens position.

When the user moves the div of cursor at pattern 3 via pointing apparatus, mouse moves (mousemove) button.onrelease and can follow the tracks of it and move, and cause virtual lens to change the position, with the position of the part of the high-definition picture shown in adjusting in virtual lens, make the cursor loca of the high-definition picture that virtual lens shows and the cursor position point of following primary image be complementary.

When left button was clicked on pointing apparatus as the user, display can freeze the position of virtual lens.Left button is subsequently clicked the position of the virtual lens of just can thawing and is recovered the tracking cursor position.These steps can ad infinitum repeat down.Perhaps, when the user presses left mouse button, the display virtual lens of can thawing, then when user's release-push, the position of freezing virtual lens.Equally, for a touch-screen, when the user touches it, the display virtual lens of can thawing, when the user stopped contacting, display can freeze virtual lens.

On pointing apparatus during right-click, display apparatus module can increase simultaneously virtual lens size (width of the div of the div of pattern 2 and pattern 1 and height) and be presented at resolution on virtual lens as the user.Accomplish this point, if the more high-resolution image of the next one also is not downloaded, display apparatus module can transmit a request to server.After receiving this request, the access rights of 120 a tree name access control regulations authentication of users of server, if allow its access, the image of asking will send to client device from network.Display can show in virtual lens that this is corresponding to the parts of images of area-of-interest.In certain embodiments, in order to improve performance, display apparatus module can be when the download of present high-definition picture be completed the more high-resolution image of the acquisition request next one immediately, the doubling of the image of the present resolution that the image of the next resolution of downloading like this can just be checked with the user.Also do not complete if download when the user asks next resolution, the indicating device of loading is with corresponding demonstration, and cursor will become " wait ", and the opaque background of the div of pattern 1 also will be presented at the virtual lens position.Display apparatus module can be kept in high-speed cache for the more high-definition picture that primary image is downloaded, in order to can accomplish its resolution of re-examine, and need not again to download view data.

Display can provide soft key on the display screen of choice for use pointing apparatus, be used for increasing or reducing size (the pattern 1div of pattern 2div and bottom), the increase of lens or reduce the resolution that shows in virtual lens and hide or the demonstration virtual lens.

When the user moved to another image or other activities, the image viewing system that display apparatus module can be stopped using automatically and virtual lens showed.

The architecture of logic

Figure 11 is the block diagram of the logic module of a server 120 in embodiment.According to an embodiment, server 120 can be used for implementing the flow process shown in Fig. 3, Fig. 6, Fig. 8 and Figure 10.Server 120 has comprised Network Interface Module 1110, image management module 1120, access control module 1130 and request processing module 1140.Server 120 is also linked up mutually with the data storage 1150 that is used to its memory image and/or video content.In certain embodiments, data storage 1150 can be the storage area (as shown in the figure) that is configured on server 120, and in other embodiments, data storage 1150 can be configured on outside server or computer system, connects by wired or wireless network directly or indirectly and links up mutually with server 120.

Network Interface Module 1110 can be set to receive the request of obtaining image by network 130 from client device 110, and sends the image of its request to client device 110 by network 130.Network Interface Module 1110 is set to send the request of importing into from client device to request processing module 1140, and receives the image transmitting of asking to client device 110 from request processing module 1140.For collaboration method, Network Interface Module 1110 can be set to receive the selection parameter from the client device 110 of first user, and they are stored in data storage area 1150.Network Interface Module 1110 also can be set to produce the selection parameter with calculation procedure.Network Interface Module 1110 further is set to receive the request of obtaining the selection parameter from the second user's client device 110, retrieve the selection parameter of asking or use calculation procedure to produce the selection parameter from data storage 1150, and selecting parameter to send to the second user's client device it.

Image management module 1120 is set to receive relevant image (or other content that is stored in data storage 1150, such as video content) the image management request, access is stored in the image in data storage area 1150, and provides the image of asking on the module of sending out request.Image management module 1120 also is arranged to and can and be stored its view data memory 1150 from image-input device or system's 1160 input pictures.

Request processing module 1140 is configured to, receive via Network Interface Module 1110 from the image request of client device 110, to image management module 1120 send the image management requests with require to retrieve relevant image or other content such as video, generate the image of being asked, and send the image of being asked to Network Interface Module 1110 to be transferred to client device 110.In one embodiment, when using continuous method for down loading, request processing module 1140 can produce the base resolution image of asking, high-definition picture or use the part high-definition picture of the image that retrieves from image management module 1120, and its resolution is more than or equal to the resolution of the image of asking.In one embodiment, when using client to fall two time scales approach, request processing module 1140 can use the image that retrieves from image management module 1120 to generate top image in different resolution, and the resolution of the image that it retrieves is more than or equal to the resolution of the top resolution of asking.In one embodiment, when using the server combination method, request processing module 1140 can generate the base resolution image as using continuous method for down loading.Request processing module 1140 can generate combination image by base resolution image and the high-definition picture that retrieves from image management module 1120, or generate base resolution image and high-definition picture from the top image in different resolution that retrieves, then its part high-definition picture corresponding to area-of-interest is overlapped on the area-of-interest of corresponding primary image.In certain embodiments, request processing module 1140 is set to user's's (or both) of request access control module 1130 verification client device 110 or client device 110 access rights, with the image of being asked generating and sending to Network Interface Module 1110 and before being transferred to client device 110, root a tree name access control regulations determine whether to allow its access.

Access control module 1130 can be configured to, if certain image is limited access, root a tree name access control regulations are to determine whether to allow to access the content of being asked.If access images is restricted, but whether access control module 1130 root a tree name access control regulations have the access rights to the image of institute's request access with the user that determines client device 110 or client device 110 (or both).If user or equipment do not have the access rights of the image that access asks, authentication module can select to send an information, indicates this user or equipment not to have the access rights of access institute requested image.Request processing module 1140 can send an authorization requests to access control module 1130, to determine user or user's the equipment image whether Internet access is asked, and access control module 1130 can send an authorization response to request processing module 1140, with indicating user or client device this image of Internet access whether.

Figure 12 is the block diagram of the logic module of a client device 110 in embodiment.According to an embodiment, client device 110 can be used for implementing the flow process shown in Fig. 2, Fig. 5, Fig. 7 and Fig. 9.Client device 110 has comprised Network Interface Module 1210, image management module 1220, subscriber interface module 1230 and request processing module 1240.According to some embodiment, client device 110 also can be used to the data storage 1250 of its memory image and/or video content to link up mutually.In certain embodiments, data storage 1250 can be a storage area (as shown in the figure) that is configured on client device 110, and in other embodiments, data storage 1250 can be configured on outside server or computer system, connects by wired or wireless network directly or indirectly and links up mutually with client device 110.

Network Interface Module 1210 can be set to send the request of obtaining picture material by network 130 to server 120 from client device 110, and receives the image that sends to client device 110 by network 130.As mentioned above, the content of image can comprise still image and video content.For collaboration method, Network Interface Module 1210 can be provided to receive the selection parameter of being set by first user and send it by network 130 selects parameter to the client device 110 of server 120 to transfer to the second user, or directly sends to the second user's client device 110.Network Interface Module 1210 on the second user's client device 110 can further be set to send the request of obtaining the selection parameter and arrive server 120, and receives the selection parameter from the client device of server 120 or first user.

Image management module 1220 be set to receive decide the request of the image of resolution, and return decide the image of resolution to the requestor.If this image is in data storage 1250, image management module 1220 will be from data storage 1250 retrieving images, rather than from server 120 its images of request.If the image of asking is not in data storage 1250, image management module 1220 will transmit a request to Network Interface Module 1210 to be transferred to server 120, and receive image from server 120 on Network Interface Module 1210, and with image buffer storage in data storage 1250.Image management module 1220 is passed its image back on the module of the request of sending.

As shown in Figure 1 and Figure 4, subscriber interface module 1230 can be set to accept user's input and show image (and out of Memory) at display 1260 from input unit 1270.Subscriber interface module can show base resolution image 150 and at high-definition picture shown in the virtual lens 160 that is overlapped on the base resolution image.According to some embodiments, subscriber interface module 1230 (with other some or all of modules illustrated in fig. 12) can comprise a plug-in unit, software library, service routine, program function piece, process, thread or the device driver that can be carried out or be called by another program, as viewer application program or other application programs that can carry out on client device 110.Subscriber interface module 1230 also can from one or more input equipments 1270, be inputted as button, key, pointing apparatus or other permission users and image viewing system mutual input unit.For example, subscriber interface module 110 can provide control, makes the user can select interested zone, the resolution of the size of virtual lens and/or the image that shown by virtual lens.

Subscriber interface module 1230 can also be set to receive from the user request of base resolution or high-definition picture content, and the image that indication request processing module 1240 is retrieved or generation is asked, and show the image that receives from request processing module 1240 on display 1260.According to some embodiments, subscriber interface module 1230 can be set to, request is sent to request processing module 1240 obtaining the image of base resolution, or have one corresponding to the part high-definition picture of area-of-interest in the base resolution image and overlap combination image on corresponding area-of-interest.The image that the user that subscriber interface module 1230 receives from request processing module in display 1260 demonstrations asks.For collaboration method, subscriber interface module 1230 can send selection parameter that first user sets to Network Interface Module 1210 to be transferred to server 120 for the second user search, perhaps subscriber interface module 1230 can or directly send selection parameter that first user sets to the second user's client device 110 from network or by transmission equipment.

Request processing module 1240 can be set to receive image request from subscriber interface module 1230.This request can be the image of a base resolution.In one embodiment, if selecting parameter has been that the second user sets by first user, or be that the second user generates by calculation procedure, and image request comes from the second user, request processing module 1240 can the root a tree name its select parameter and generate a combination image.For the base resolution image, when using continuous method for down loading or server combination method, request processing module 1240 sends the request of obtaining certain base resolution figure to image management module 1220, and receives this base resolution image from image management module 1220.When using client to fall two time scales approach, request processing module 1240 sends the request of obtaining top image in different resolution to image management module 1220, and receive the image of top resolution from image management module 1220, then the image from top resolution generates its base resolution image.The request of base resolution image that request processing module 1240 sends users to subscriber interface module 1230 to show that this base resolution image is on display 1260.For combination image, when using continuous method for down loading, request processing module 1240 transmit a request to image management module 1220 to obtain the base resolution image and corresponding to the part high-definition picture of area-of-interest.Request processing module 1240 receives base resolution image and the high-definition picture of asking from image management module 1220, then, request processing module 1240 generates the combination image that the user asks, and is the base resolution image together with the part high-definition picture corresponding to area-of-interest that overlaps corresponding area-of-interest position on the base resolution image.When using client to fall two time scales approach, request processing module 1240 is from the image of the image management module 1220 top resolution of request.In case receive the image of top resolution, request processing module 1240 will produce base resolution image and high-resolution image from it, then generate the combination image that the user asks, be the base resolution image together with the part high-definition picture corresponding to area-of-interest that overlaps corresponding area-of-interest position on the base resolution image.When using the server combination method, request processing module 1240 is from combination image of image management module 1220 requests.Request processing module 1240 sends the combination image that uses any these methods and generate to subscriber interface module, to be presented on display 1260.

For collaboration method, the request processing module 1240 of the second user's client device 110 can be set to, be the selection parameter that the second user sets from Network Interface Module 1210 requests by first user, and receive its selection parameter from Network Interface Module 1210.Request processing module 1240 also can be configured to calculation procedure and generate the selection parameter.Request processing module 1240 can be set to generate with the selection parameter combination image that it has specific selection parameter, and sends combination image to subscriber interface module 1230, is used for being presented at display 1260.When generating combination image, request processing module can be set to use as mentioned above continuously method for down loading, client to fall two time scales approach or server combination method.

Will be understood that those skilled in the art, the various example modules relevant to above-mentioned picture and text and the disclosed embodiment of this paper and method step usually can electronic hardware, software, firmware or its make up to realize.For the interchangeability of hardware and software clearly is described, above according to its function, various example modules and method step are described substantially.Realize it being the design constraint that depends on concrete application and total system as for this function by hardware or software.The personnel that are skilled in technique can implement function as described herein by different way for each concrete application, but this type of implementation decision should not be interpreted as departing from scope of the present invention lead because of.In addition, the function in module or the grouping of step are for convenience of explanation.Concrete function can be transferred to another module or step and not deviate from the present invention from a module or step.

In addition, various example modules and method step described in the embodiment that this paper discloses can be by hardware, as general processor, digital signal processor (" DSP "), application-specific integrated circuit (ASIC) (" ASIC "), field programmable gate array (" FPGA ") or other programmable logic device, discrete gate or transistor logic, discrete hardware components or its make up to realize or carry out above-mentioned functions.General processor is that hardware can be also microprocessor, but in certain replacement scheme, processor can be any hardware handles controller, microcontroller.Processor also can be realized by the combination of computing equipment, for example, and the combination of the combination of DSP and microprocessor, many bodies microprocessor, one or more microprocessor and DSP core or any other similar configuration.

In addition, the method described in the embodiment that discloses of this paper or calculation procedure step can be directly embodied by the performed software module of hardware, processor or both combinations.Software module can reside in the readable storage medium storing program for executing in computer or controller, comprise RAM memory, flash memory, ROM memory, eprom memory, eeprom memory, register, hard disk, removable dish, CD-ROM or other any access stencils, comprise the storage medium of network storage medium.An exemplary medium can be coupled with processor, makes the processor readable information, and writes information to described storage medium.In another example, this storage medium can be integrated into processor.Processor and storage medium also can reside in ASIC.According to some embodiment, this software module can reside in the computer-readable recording medium of a non-instantaneity.

More than provide the description to the disclosed embodiment of this paper, so that anyly can realize or use the present invention those skilled in the art.The various improvement of these embodiment will be apparent concerning technical staff in the art, and can be applied to other embodiment to general principles as described herein in the situation that do not break away from spiritual scope of the present invention.Therefore therefore, the description of this paper and accompanying drawing are construed as and have represented some exemplary embodiments of the present invention, have the representativeness of the theme that the present invention roughly imagines.Must further recognize, scope of the present invention is summarized other embodiment fully, and scope of the present invention is not subjected to appended claims any restriction in addition simultaneously.

Claims (215)

1. a computer-implemented method is used for it is characterized by at the local high-definition picture of the context-sensitive of base resolution image, and one or more processors programme to carry out following steps, comprising:
Client device receives request, to check image;
Transmit a request to server by network, require to obtain the base resolution image corresponding to the image of asking;
Receive this base resolution image by network from server;
Show this base resolution image on the display of client device;
Reception shows the request of the area-of-interest of this base resolution image with high-resolution;
Transmit a request to server by network, require to obtain the high-definition picture corresponding to this base resolution image;
Receive this high-definition picture by network from server; With
Show the high-definition picture corresponding to this area-of-interest in the position that is overlapped in area-of-interest on the base resolution image, wherein said overlapping layer has comprised a virtual lens;
Follow the tracks of the movement of the cursor of being controlled by pointing apparatus on the base resolution image of client device;
The position of the cursor on the corresponding base resolution image of root a tree name, the virtual lens on mobile corresponding base resolution image;
The position of the cursor on the corresponding base resolution image of root a tree name is along with virtual lens moves across corresponding base resolution image, the high-definition picture of the part of update displayed in virtual lens.
2. in the 1st described method of Patent right requirement, the resolution of described base resolution image is less than the resolution that generates, inputs or be stored in the ultimate resolution image on server.
3. in the 1st described method of Patent right requirement, the resolution of described high-definition picture is less than or equal to the resolution of ultimate resolution image, and the resolution of described high-definition picture is greater than the resolution of base resolution image.
4. in the 1st described method of Patent right requirement, further comprised:
Client device receives request, to adjust the size of virtual lens;
Adjust the size of virtual lens;
Client device need to determine whether the high-definition picture of greater part;
If need the high-definition picture of greater part, transmit a request to server to obtain the high-definition picture of greater part;
Receive the high-definition picture of greater part from server; With
Show that the high-definition picture of greater part is in virtual lens.
5. in the 1st described method of Patent right requirement, further comprised:
Client device receives request, the resolution of the high resolution graphics that shows with the change virtual lens;
Transmit a request to server, require to obtain the high-definition picture corresponding to the given resolution of base resolution image;
Receive this high-definition picture from server; With
Demonstration is corresponding to the high-definition picture of the part of area-of-interest, and this high-definition picture overlaps the position of area-of-interest on corresponding base resolution image.
6. in the 1st described method of Patent right requirement, show that on the display of client device this base resolution image further comprises:
Determine that whether the base resolution image surpasses the size of the viewing area that this base resolution image will be shown therein; With
Show the part of base resolution image in the viewing area; And
The position of the cursor on the corresponding base resolution image of root a tree name wherein, the virtual lens on mobile corresponding base resolution image also comprises:
Determine whether virtual lens has reached the edge of viewing area; With
If virtual lens has reached the edge of viewing area, stop the movement of virtual lens and scrolling base resolution image on the direction opposite with the movement of being indicated by pointing apparatus.
7. in the 6th described method of Patent right requirement, with the direction opposite by the movement of pointing apparatus indication on scrolling base resolution image also comprise: with the direction opposite by the movement of pointing apparatus indication on scrolling base resolution image until stopped or the edge of base resolution image and the justified margin of viewing area by the movement of pointing apparatus indication.
8. in the 1st described method of Patent right requirement, further comprised:
The response user instruction freezes virtual lens corresponding position on the base resolution image.
9. in the 8th described method of Patent right requirement, in the 27th described method of Patent right requirement, further comprised:
The response user instruction, the virtual lens corresponding position on the base resolution image that thaws and before freezed.
10. in the 1st described method of Patent right requirement, the described high-definition picture part that is shown in virtual lens that receives from server has further comprised:
Add upper side frame around virtual lens, so that virtual lens is divided out from the base resolution image.
11. in the 1st described method of Patent right requirement, the described high-definition picture part that is shown in virtual lens that receives from server has further comprised:
Present virtual lens in the center of area-of-interest.
12. in the 1st described method of Patent right requirement, the described high-definition picture part that is shown in virtual lens that receives from server has further comprised:
If virtual lens is presented in the center of area-of-interest, determine whether that at least a portion virtual lens will be outside the border of base resolution image; With
If the virtual lens of at least a portion is in outside the border of base resolution image, determine virtual lens deviation post so that virtual lens not beyond the border of base resolution image; With
Present virtual lens and shown part high-definition picture in the center of deviation post.
13. in the 1st described method of Patent right requirement, further comprise:
Adjust size, shape or the position of virtual lens, to improve the function of the application program of using virtual lens.
14. in the 1st described method of Patent right requirement, further comprised:
Virtual lens is hidden in response user's instruction.
15. in the 1st described method of Patent right requirement, further comprised:
Response user's instruction illustrates the previous virtual lens of hiding.
16. in the 1st described method of Patent right requirement, further comprised:
Present an opaque plane between the primary image of virtual lens and described bottom, wait for that after transmiting a request to server described opaque plane can be visible from the process of server receiving high definition image.
17. in the 1st described method of Patent right requirement, further comprised:
Identify the resolution levels that the user of client device may ask;
Transmit a request to server, require to obtain other high-definition picture of stage resolution ratio that the user of client device may ask.
18. a computer-implemented method is used for it is characterized by at the local high-definition picture of the context-sensitive of base resolution image, one or more processors programme to carry out following steps, comprising:
Client device receives request, to check image;
Transmit a request to server by network, require to obtain the base resolution image corresponding to the image of asking;
Receive this base resolution image by network from server;
Show this base resolution image on the display of client device;
Reception shows the request of the area-of-interest of this base resolution image with high-resolution;
Transmit a request to server by network, require to obtain the high-definition picture corresponding to this base resolution image;
Receive this high-definition picture by network from server; With
Show the high-definition picture corresponding to this area-of-interest in the position that is overlapped in area-of-interest on the base resolution image.
19. in the 18th described method of Patent right requirement, the resolution of described base resolution image is less than the resolution that generates, inputs or be stored in the ultimate resolution image on server.
20. in the 18th described method of Patent right requirement, the resolution of described high-definition picture is less than or equal to the resolution of ultimate resolution image, and the resolution of described high-definition picture is greater than the resolution of base resolution image.
21. in the 18th described method of Patent right requirement, the selection of the resolution of described base resolution or high-definition picture at least in part root a tree name client device or network function and determine.
22. in the 18th described method of Patent right requirement, described overlapping layer has comprised a virtual lens.
23. in the 22nd described method of Patent right requirement, further comprised:
Client device receives request, to adjust the size of virtual lens;
Adjust the size of virtual lens;
Client device need to determine whether the high-definition picture of greater part;
If need the high-definition picture of greater part, transmit a request to server to obtain the high-definition picture of greater part;
Receive the high-definition picture of greater part from server; With
Show that the high-definition picture of greater part is in virtual lens.
24. in the 22nd described method of Patent right requirement, further comprised:
Client device receives request, with the shape of being asked that is shaped as of change virtual lens; With
Presenting virtual lens is desired shape;
Client device need to determine whether the high-definition picture of greater part;
If need the high-definition picture of greater part, transmit a request to server to obtain the high-definition picture of greater part;
Receive the high-definition picture of this greater part from server; With
Show that the high-definition picture of this greater part is in virtual lens.
25. in the 22nd described method of Patent right requirement, further comprised:
Client device receives request, the resolution of the high resolution graphics that shows with the change virtual lens;
Transmit a request to server, require to obtain the high-definition picture corresponding to the given resolution of base resolution image;
Receive this high-definition picture from server; With
Demonstration is corresponding to the high-definition picture of the part of area-of-interest, and this high-definition picture overlaps the position of area-of-interest on corresponding base resolution image.
26. in the 22nd described method of Patent right requirement, further comprised:
Follow the tracks of the movement of the cursor of being controlled by pointing apparatus on the base resolution image of client device;
The position of the cursor on the corresponding base resolution image of root a tree name, the virtual lens on mobile corresponding base resolution image;
The position of the cursor on the corresponding base resolution image of root a tree name, the high-definition picture of the part of update displayed in virtual lens.
27. in the 26th described method of Patent right requirement, further comprised:
The response user instruction freezes virtual lens corresponding position on the base resolution image.
28. in the 27th described method of Patent right requirement, further comprised:
The response user instruction, the virtual lens corresponding position on the base resolution image that thaws and before freezed.
29. in the 22nd described method of Patent right requirement, the described high-definition picture part that is shown in virtual lens that receives from server has further comprised:
Add upper side frame around virtual lens, so that virtual lens is divided out from the base resolution image.
30. in the 22nd described method of Patent right requirement, the described high-definition picture part that is shown in virtual lens that receives from server has further comprised:
Present virtual lens in the center of area-of-interest.
31. in the 30th described method of Patent right requirement, the described virtual lens that presents has further comprised in the center of area-of-interest:
If virtual lens is presented in the center of area-of-interest, determine whether that at least a portion virtual lens will be in outside the border of base resolution image; With
If the virtual lens of at least a portion is in outside the border of base resolution image, determine virtual lens deviation post so that virtual lens not beyond the border of base resolution image; With
Present virtual lens and shown part high-definition picture in the center of deviation post.
32. in the 31st described method of Patent right requirement, further comprised:
Adjust the size and dimension of virtual lens, to improve the function of the application program of using virtual lens.
33. in the 22nd described method of Patent right requirement, further comprised:
Virtual lens is hidden in response user's instruction.
34. in the 22nd described method of Patent right requirement, further comprised:
Response user's instruction illustrates the previous virtual lens of hiding.
35. in the 22nd described method of Patent right requirement, further comprised:
Present an opaque plane between the primary image of virtual lens and described bottom, wait for that after transmiting a request to server described opaque plane can be visible from the process of server receiving high definition image.
36. in the 18th described method of Patent right requirement, describedly further comprised from server receiving high definition image:
Receive only the high-definition picture of the part that comprises area-of-interest.
37. in the 18th described method of Patent right requirement, further comprised:
Identify the resolution levels that the user of client device may ask;
Transmit a request to server, require to obtain other high-definition picture of stage resolution ratio that the user of client device may ask.
38. in the 18th described method of Patent right requirement, further comprised:
Identify the one or more extra base resolution image that the user of client device may ask;
Transmit a request to server, require to obtain one or more extra base resolution images, thus before the user asks one or more extra base resolution images this image of prestrain.
39. in the 18th described method of Patent right requirement, described image is video.
40. in the 39th described method of Patent right requirement, described demonstration is corresponding to the high-definition picture of the part of area-of-interest, this high-definition picture overlaps the position of area-of-interest on corresponding base resolution image, has further comprised:
The frame of synchronous processed frame speed and the current high-definition picture that shows with its frame rate and the frame of current demonstration base resolution video.
41. in the 18th described method of Patent right requirement, the user's of described client device selection is stored in and is used in the memory of client device using later on.
42. a computer-implemented method is characterized by for the high-definition picture in base resolution image identical text display part, one or more processors programme to carry out following steps, comprising:
Client device receives request, to check image;
Transmit a request to server by network, require to obtain the top image in different resolution corresponding to the image of asking;
Receive this top image in different resolution by network from server;
Basis at the top image in different resolution that receives from server produces the base resolution image;
Show that this base resolution image is on the display of client device;
Reception shows the request of the area-of-interest of this base resolution image with high-resolution;
Basis at the top image in different resolution that receives from server produces high-definition picture; With
Show the high-definition picture corresponding to the part of this area-of-interest in the position that is overlapped in area-of-interest on the base resolution image.
43. in the 42nd described method of Patent right requirement, the resolution of described top image in different resolution is less than or equal to generation, input or is stored in the resolution of the ultimate resolution image on server.
44. in the 42nd described method of Patent right requirement, the resolution of described base resolution image is less than the resolution of described top image in different resolution.
45. in the 42nd described method of Patent right requirement, the resolution of described high-definition picture is less than or equal to the resolution of described top image in different resolution, the resolution of described high-definition picture is greater than the resolution of base resolution image.
46. in the 42nd described method of Patent right requirement, the selection of the resolution of described base resolution, high-definition picture or top image in different resolution at least in part root a tree name client device or network function and determine.
47. in the 46th described method of Patent right requirement, the user produces base resolution image and high-definition picture on the basis of the top image in different resolution that receives from server.
48. in the 42nd described method of Patent right requirement, described overlapping layer has comprised a virtual lens.
49. in the 48th described method of Patent right requirement, further comprised:
Client device receives request, to adjust the size of virtual lens;
Adjust the size of virtual lens;
Generate that size and dimension with virtual lens is complementary the high-definition picture of part; With
Show the high-definition picture of this part in virtual lens.
50. in the 48th described method of Patent right requirement, further comprised:
Client device receives request, with the shape of being asked that is shaped as of change virtual lens; With
Presenting virtual lens is the shape of asking;
Generate that size and dimension with virtual lens is complementary the high-definition picture of part; With
Show the high-definition picture of this part in virtual lens.
51. in the 48th described method of Patent right requirement, further comprised:
Client device receives request, the resolution of the high resolution graphics that shows with the change virtual lens;
Generate high-definition picture with the resolution of being asked on the basis of the top image in different resolution that receives from server; With
Show the high-definition picture corresponding to the part of this area-of-interest in the position that is overlapped in area-of-interest on the base resolution image.
52. in the 48th described method of Patent right requirement, further comprised:
Follow the tracks of the movement of the cursor of being controlled by pointing apparatus on client device;
The position of the cursor on the corresponding base resolution image of root a tree name, the virtual lens on mobile corresponding base resolution image;
The position of the cursor on the corresponding base resolution image of root a tree name, the high-definition picture of the part of update displayed in virtual lens.
53. in the 52nd described method of Patent right requirement, further comprised:
The response user instruction freezes the virtual lens position on the base resolution image accordingly.
54. in the 53rd described method of Patent right requirement, further comprised:
The response user instruction, the virtual lens of thawing is the position on the base resolution image accordingly.
55. in the 48th described method of Patent right requirement, further comprised:
Virtual lens is hidden in response user's instruction.
56. in the 55th described method of Patent right requirement, further comprised:
Response user's instruction illustrates the previous virtual lens of hiding.
57. in the 48th described method of Patent right requirement, the described high-definition picture that is shown in the part virtual lens that receives from server has further comprised:
Add upper side frame around virtual lens, so that virtual lens is divided out from the base resolution image.
58. in the 48th described method of Patent right requirement, the described high-definition picture part that is shown in virtual lens that receives from server has further comprised:
Present virtual lens in the center of area-of-interest.
59. in the 58th described method of Patent right requirement, the described virtual lens that presents has further comprised in the center of area-of-interest:
If virtual lens is presented in the center of area-of-interest, determine whether that at least a portion virtual lens will be outside the border of base resolution image; With
If the virtual lens of at least a portion is in outside the border of base resolution image, determine virtual lens deviation post so that virtual lens not beyond the border of base resolution image; With
Present virtual lens and shown part high-definition picture in the center of deviation post.
60. in the 42nd described method of Patent right requirement, further comprised:
Identify the one or more extra base resolution image that the user of client device may ask;
Transmit a request to server, require to obtain one or more extra base resolution images, thus before the user asks one or more extra base resolution images this image of prestrain.
61. in the 42nd described method of Patent right requirement, described image is video.
62. in the 61st described method of Patent right requirement, described demonstration is corresponding to the high-definition picture of the part of area-of-interest, this high-definition picture overlaps the position of area-of-interest on corresponding base resolution image, has further comprised:
The frame of synchronous processed frame speed and the current high-definition picture that shows with its frame rate and the frame of current demonstration base resolution video.
63. in the 42nd described method of Patent right requirement, the user's of described client device selection is stored in and is used in the memory of client device using later on.
64. a computer-implemented method is used for providing high-definition picture, it is characterized by, one or more processors programme to carry out following steps, comprising:
Client device receives the request of base resolution image;
Generate, input or be stored on server and with the base resolution image correlation connection of this request equate or the basis of the image of larger resolution on base resolution image of generation;
Connect by network the base resolution image is sent to client device;
Receive the request of the high-definition picture that joins with the base resolution image correlation;
Produce and ask corresponding high-definition picture on the basis of the image that is created on, is input to or be stored in the equal or larger resolution on server;
High-resolution image is sent to client device.
65. in the 64th described method of Patent right requirement, the request of high-definition picture comprises one group of coordinate of specifying area-of-interest, wherein produces high-definition picture and also comprises:
Generate, input or be stored on server and with the basis of the image of equating of being associated of the high-definition picture of asking or larger resolution on produce a part corresponding with the area-of-interest of high-definition picture.
66. in the 64th described method of Patent right requirement, further comprised:
Generate a plurality of images, each in these a plurality of images have different level of resolution and from generate, input or be stored on server equate or the image of larger resolution generates.
67. in the 66th described method of Patent right requirement, the base resolution image generates by the image in different resolution of selecting to ask from a plurality of images of different resolution.
68. in the 66th described method of Patent right requirement, high-definition picture generates by the image of the resolution selecting to ask from a plurality of images of different resolution.
69. in the 64th described method of Patent right requirement, further comprised:
One group of user's Selective storage is used for use later in the memory of server.
70. a computer-implemented method is used for providing high-definition picture, it is characterized by, one or more processors programme to carry out following steps, comprising:
Client device receives the request of top image in different resolution;
Generate, input or be stored on server and with the basis of the image of equating of being associated of the top image in different resolution of this request or larger resolution on top image in different resolution of asking of generation;
Connect by network the base resolution image is sent to client device.
71. in the 70th described method of Patent right requirement, further comprised:
Generate a plurality of top image in different resolution, each in these a plurality of top image in different resolution have different level of resolution and from generate, input or be stored on server equate or the image of larger resolution generates.
72. in the 71st described method of Patent right requirement, top image in different resolution generates by the image in different resolution of selecting to ask from a plurality of images of different resolution.
73. in the 70th described method of Patent right requirement, further comprised:
One group of user's Selective storage that will be relevant to request is used for using later in the memory of server.
74. a computer-implemented method is used for it is characterized by at the local high-definition picture of the context-sensitive of base resolution image, one or more processors programme to carry out following steps, comprising:
Client device receives request, to check image;
Transmit a request to server, require to obtain image;
Receive this image from server;
Show this image on the display of client device.
75. in the 74th described method of Patent right requirement, further comprised:
Determine whether network connects is available to server, is disabled and if network connects, and selects another server to process request.
76. in the 74th described method of Patent right requirement, further comprised:
When image being encrypted before server is sending image, the image that receives from server is decrypted.
77. in the 74th described method of Patent right requirement, further comprised:
When image having been compressed before server is sending image, the image that receives from server is decompressed.
78. a computer-implemented method is used for providing high-definition picture, it is characterized by, one or more processors programme to carry out following steps, comprising:
Client device receives the request of image;
Generate, input or retrieving images;
Connect by network and send images to client device.
79. in the 78th described method of Patent right requirement, further comprised:
Before sending images to client device, image is encrypted.
80. in the 78th described method of Patent right requirement, further comprised:
Before sending images to client device, image is compressed.
81. in the 78th described method of Patent right requirement, further comprised:
In case receive the request of image from client device, select server to process request from the server of a plurality of operations, wherein this server is selected according to each the relative load in the server of operation.
82. in the 78th described method of Patent right requirement, further comprised:
As the prerequisite that sends image, have access rights to the image of asking according to the user of access control regulations Authentication Client equipment or client device.
83. in the 82nd described method of Patent right requirement, further comprised:
If the user of client device or client device is not authorized to access the image of asking, send error message to client device.
84. a technological system that is used for providing high-definition picture, this system comprises:
The non-transience computer-readable medium that is used for the executable program module of storage computer;
With storing the processor of Program module with execution with the non-transience computer-readable medium of processor coupled communication;
A Network Interface Module that is stored in non-transience computer-readable medium, and be set to
Receive the image request of the selected resolution of client device by network, and
When having the image access authority, the user of client device or client device by network, image transmitting is arrived client device;
The request processing module that is stored in non-transience computer-readable medium and can be communicated with Network Interface Module, request processing module is set to
Receive the request of the selected image in different resolution of client through Network Interface Module,
Process this request, and
From Network Interface Module, the image of asking is sent to client device with desired resolution;
One is stored in non-transience computer-readable medium and the access control module that is communicated with request processing module, and this access control module is set to
Reception is from the client device authorization requests of request processing module, confirming client device or its user's image access right,
According to access control regulations authentication-access authority, and
Whether there is the authorization response of the authority of access images to indicate to request processing module transmission client device or user; And
Be stored in non-transience computer-readable medium and the image management module that can be communicated with request processing module, this image management module is configured usage data and stores to process image management request from request processing module.
85. in Patent right requirement the 84th described system, request processing module is set to when processing request:
Whether there is the authorization response indication of access rights to determine whether to send the image of asking according to the user from the client device of access control module or client device and sends to requesting client equipment to Network Interface Module.
86. in Patent right requirement the 84th described system, request processing module further is set to when processing request:
Transmit a request to image management module, require to obtain and equate with resolution that client device is asked or the image of the request of larger resolution; And
Equate or the image of larger resolution from the resolution that image management module receives with client device is asked.
87. in Patent right requirement the 86th described system, request processing module further is set to when processing request:
Generate the image of being asked from the image that receives from image management module with the desired resolution of client device.
88. in Patent right requirement the 86th described system, request processing module further is set to when processing request:
From the image that receives from the image management module part of being asked with the desired resolution synthetic image of client device.
89. in Patent right requirement the 84th described system, image management module further is set to:
From image input device or system's input picture; And
This image is stored in this data storage.
90. in Patent right requirement the 84th described system, image management module further is set to:
Synthetic image; And
This image is stored in this data storage.
91. in Patent right requirement the 84th described system, image management module further is set to:
Generate a plurality of images, each in these a plurality of images have different level of resolution and from generate, input or be stored on server equate or the image of larger resolution generates, and a plurality of images are stored in this data storage.
92. in Patent right requirement the 84th described system, request processing module further is set to when processing request:
One group of user's Selective storage is used for using later in this data storage.
93. a technological system that is used for checking high-definition picture, this system comprises:
The non-transience computer-readable medium that is used for the executable program module of storage computer;
With storing the processor of Program module with execution with the non-transience computer-readable medium of processor coupled communication;
A Network Interface Module that is stored in non-transience computer-readable medium, and be set to
Send image request to server by network, image by system the user asked, and
Receive the image of asking from server by network;
A subscriber interface module that is stored in non-transience computer-readable medium, and be set to
Reception is from user's the request of checking image,
Reception is corresponding to the base resolution image of the image of asking,
Show the base resolution image on the display of system,
Reception shows the request of area-of-interest in this base resolution image from the user's with high-resolution,
Reception has comprised that the position of the area-of-interest that overlaps this primary image is corresponding to the combination image of the high-definition picture part of area-of-interest; And
Show its combination image;
Be stored in non-provisional computer-readable medium, and the request processing module of communicating by letter with described Network Interface Module with subscriber interface module, request processing module is set to
Receive the request of base resolution image from subscriber interface module, check this image with the response user;
Process the request of this base resolution image from subscriber interface module,
Provide the base resolution image to be shown to subscriber interface module;
Receive the request of combination image, its combination image has comprised that the area-of-interest position that overlaps this primary image is corresponding to the high-definition picture part of area-of-interest;
The request for the treatment of combination image; And
Provide combination image to subscriber interface module for demonstration; And
Be stored in the image management module in non-temporary computer readable medium, with the communication of request processing module and Network Interface Module in, image management module is set to usage data and stores to process the image management request.
94. in Patent right requirement the 93rd described system, request processing module further is set to when processing the request of base resolution image
Reception requires to obtain the base resolution image from the request of subscriber interface module;
Transmit a request to image management module, require to obtain the base resolution image;
Reception is from the base resolution image of image management module; And
Send the base resolution image to subscriber interface module with demonstration.
95. in Patent right requirement the 93rd described system, request processing module further is set to when processing the request of base resolution image
Reception requires to obtain the base resolution image from the request of subscriber interface module;
Transmit a request to image management module, require to obtain the top image in different resolution corresponding to the base resolution image;
Reception is from the top image in different resolution of image management module;
Generate the base resolution image from top image in different resolution; And
The base resolution image is sent to subscriber interface module to show.
96. in Patent right requirement the 93rd described system, image management module further is set to when processing the image management request
Reception requires to obtain image from the request of request processing module;
The image that retrieval is asked; And
Send the image of asking and arrive request processing module.
97. in Patent right requirement the 96th described system, image management module further is set to when the image that retrieval is asked
Check whether the image of asking is buffered in this data storage; And
Whether retrieval is buffered from the image of asking of this data storage.
98. in Patent right requirement the 96th described system, image management module further is set to when the image that retrieval is asked
Transmit a request to Network Interface Module, require to obtain image;
Reception is from the image of asking of Network Interface Module; And
With the image buffer storage that receives in this data storage.
99. in Patent right requirement the 93rd described system, request processing module further is set to when processing request
One group of user's Selective storage is used for using later in this data storage.
100. a computer-implemented method is used for it is characterized by at the local high-definition picture of the context-sensitive of base resolution image, one or more processors programme to carry out following steps, comprising:
Client device receives request, to check image;
Determine to check a group selection parameter of image;
Transmit a request to server by network, require to obtain the image according to selecting parameter;
Receive according to this image of selecting parameter from server by network; And
Show according to this image of selecting parameter on client device.
101. in the 100th described method of Patent right requirement, select parameter to be consisted of by image identifier, resolution specification, virtual lens specification and the area-of-interest position with respect to the reference point in image.
102. in the 101st described method of Patent right requirement, the resolution specification comprises base resolution and high-resolution.
103. in the 102nd described method of Patent right requirement, the resolution specification comprises the ratio of high-resolution and base resolution or suitable parameter therewith.
104. in the 101st described method of Patent right requirement, wherein the virtual lens specification comprises size and shape.
105. in the 104th described method of Patent right requirement, the virtual lens specification comprises with respect to the specification of the virtual lens size of the size of base resolution image and the specification of virtual lens shape.
106. in the 100th described method of Patent right requirement, determine to select parameter to comprise:
Be that the second user specifies the selection parameter by first user;
Transmit and select parameter; And
According to the function of a tree name the second user's client device or network and adjust the selection parameter of transmission.
107. in the 106th described method of Patent right requirement, transmit and select parameter to comprise:
To select parameter to send to the second user's client device from the client device of first user; And
Client device by the second user receives the selection parameter.
108. in the 106th described method of Patent right requirement, transmit and select parameter to comprise:
The client device of selecting parameter from first user is sent to server;
Client device request by the second user is from the selection parameter of server; And
Client device by the second user receives the selection parameter.
109. in the 106th described method of Patent right requirement, determine to select parameter also to comprise:
Client device request by the second user is from the selection parameter of server;
Client device by the second user receives the selection parameter; And
According to the function of a tree name the second user's client device and adjust the selection parameter.
110. in the 106th described method of Patent right requirement, determine to select parameter also to comprise by first user being that the second user specifies the selection parameter; Transmit and select parameter and adjust in real time and select parameter.
111. in the 100th described method of Patent right requirement, determine to select parameter also to comprise and use the calculation procedure that is executed on client device to calculate the selection parameter.
112. in the 106th described method of Patent right requirement, be that the second user carries out and selects parameter to comprise first user input selection parameter on the client device of first user by first user.
113. in the 106th described method of Patent right requirement, be that the second user specifies the selection parameter to comprise by first user:
The client device of first user receives the request from first user, to check image;
Transmit a request to server, require to obtain the base resolution image corresponding to the image of asking;
Receive the base resolution image from server;
Show the base resolution image on the display of the client device of first user;
Reception shows the request of the area-of-interest of base resolution image with high-resolution;
Transmit a request to server, require to obtain the high-definition picture corresponding to the base resolution image;
From server receiving high definition image;
On the client device of first user, show the high-definition picture corresponding to this area-of-interest in the position that is overlapped in area-of-interest on the base resolution image;
Resolution selected according to first user and area-of-interest arrange the selection parameter; And
Select parameter according to the request adjustment of first user.
114. in the 106th described method of Patent right requirement, be that the second user specifies the selection parameter to comprise by first user:
The client device of first user receives request, to check image;
Transmit a request to server, require to obtain the top image in different resolution corresponding to the image of asking;
Receive top image in different resolution from server;
Generate the base resolution image according to the top image in different resolution that receives from server;
Show the base resolution image on the display of the client device of first user;
Reception shows the request of the area-of-interest of base resolution image with high-resolution;
Generate high-definition picture according to the top image in different resolution that receives from server;
Demonstration is corresponding to the high-definition picture of the part of area-of-interest, and this high-definition picture overlaps the position of area-of-interest on corresponding base resolution image;
Resolution selected according to first user and area-of-interest arrange the selection parameter; And
Select parameter according to the request adjustment of first user.
115. in the 106th described method of Patent right requirement, be that the second user specifies the selection parameter to comprise by first user:
The client device of first user receives request, to check image;
Transmit a request to server, require to obtain the base resolution image corresponding to the image of asking;
Receive the base resolution image from server;
Show the base resolution image on the display of the client device of first user;
Reception shows the request of the area-of-interest of base resolution image with high-resolution;
Transmit a request to server, require to obtain the combination image corresponding to the base resolution image;
Receive combination image from server;
Show combination image on the display of the client device of first user;
Resolution selected according to first user and area-of-interest arrange the selection parameter; And
Select parameter according to the request adjustment of first user.
116. in the 100th described method of Patent right requirement, the request that sends image comprises to server:
According to selecting parameter to transmit a request to server, require to obtain the base resolution image corresponding to the image of asking; And
According to selecting parameter to transmit a request to server, require to obtain the high-definition picture corresponding to the base resolution image.
117. in the 116th described method of Patent right requirement, receive image and comprise:
Receive the base resolution image from server; And
From server receiving high definition image.
118. in the 116th described method of Patent right requirement, the resolution of base resolution image is less than the resolution that generates, inputs or be stored in the ultimate resolution image on server.
119. in the 116th described method of Patent right requirement, the resolution of high-definition picture is less than or equal to the resolution of ultimate resolution image, and wherein the resolution of high-definition picture greater than the resolution of base resolution image.
120. in the 116th described method of Patent right requirement, the selection of the resolution of base resolution image at least in part root a tree name client device or network function and determine.
121. in the 116th described method of Patent right requirement, the selection of the resolution of high-definition picture at least in part root a tree name client device or network function and determine.
122. in the 116th described method of Patent right requirement, show high-definition picture corresponding to this area-of-interest according to the position of selecting the parameter display image to be included in to be overlapped in area-of-interest on the base resolution image.
123. in the 122nd described method of Patent right requirement, this overlapping layer has comprised a virtual lens.
124. in the 122nd described method of Patent right requirement, the selection of the size of virtual lens at least in part root a tree name client device or network function and determine.
125. in the 100th described method of Patent right requirement, according to selecting parameter to transmit a request to server, require to obtain image and comprise and transmit a request to server, require to obtain the top image in different resolution corresponding to the image of asking.
126. in the 125th described method of Patent right requirement, comprise from the top image in different resolution of server reception according to selecting parameter to receive image.
127. in the 125th described method of Patent right requirement, according to selecting the parameter display image to comprise:
Generate the base resolution image according to the top image in different resolution that receives from server;
Generate high-definition picture according to the high-definition picture that receives from server; And
Show the base resolution image and corresponding to the high-definition picture of the part of area-of-interest, this high-definition picture overlaps the position of area-of-interest on corresponding base resolution image.
128. in the 125th described method of Patent right requirement, the resolution of top image in different resolution is less than the resolution that generates, inputs or be stored in the ultimate resolution image on server.
129. in the 125th described method of Patent right requirement, the resolution of base resolution image is less than the resolution of top image in different resolution.
130. in the 125th described method of Patent right requirement, the resolution of high-definition picture is less than or equal to the resolution of top image in different resolution, and wherein the resolution of high-definition picture greater than the resolution of base resolution image.
131. in the 125th described method of Patent right requirement, the selection of the resolution of base resolution image at least in part root a tree name client device or network function and determine.
132. in the 125th described method of Patent right requirement, the selection of the resolution of top image in different resolution at least in part root a tree name client device or network function and determine.
133. in the 127th described method of Patent right requirement, this overlapping layer has comprised a virtual lens.
134. in the 133rd described method of Patent right requirement, the selection of the size of virtual lens at least in part root a tree name client device or network function and determine.
135. in the 100th described method of Patent right requirement, transmit a request to server and comprise according to selecting parameter to transmit a request to server, require to obtain the combination image corresponding to the image of asking.
136. in the 135th described method of Patent right requirement, request comprises the Presentation Function of client device.
137. in the 135th described method of Patent right requirement, comprise from server reception combination image according to selecting parameter to receive image.
138. in the 135th described method of Patent right requirement, according to selecting the parameter display image to comprise the demonstration combination image.
139. a computer-implemented method is used for providing high-definition picture, it is characterized by, one or more processors programme to carry out following steps, comprising:
Receive the selection parameter request of client device;
Produce this selection parameter;
Connecting by network to select parameter to send to client device;
Receive the image request of client device;
Have access rights to image according to the user of access control regulations Authentication Client equipment or client device;
Produce this image;
Connect by network and send images to client device.
140. in the 139th described method of Patent right requirement, produce and select parameter to comprise:
Receive the selection parameter that is used for the second user from first user;
To select Parameter storage in memory; And
Retrieval is used for the second user's selection parameter.
141. in the 139th described method of Patent right requirement, produce the calculation procedure of selecting parameter to comprise that use is executed on server and calculate the selection parameter.
142. in the 139th described method of Patent right requirement, produce image and be included in generations, input or be stored in the image that produces the resolution of asking on the basis of the image that is associated of equal on server or larger resolution.
143. in the 139th described method of Patent right requirement, produce image and comprise according to being included in selection parameter in image request and the Presentation Function of client device and produce combination image.
144. in the 143rd described method of Patent right requirement, produce combination image and comprise:
Generate, input or be stored on server and with this base resolution image correlation connection equate or the basis of the image of larger resolution on base resolution image of generation;
Generate, input or be stored on server and with the basis of the image of equating of being associated of this high-definition picture or larger resolution on high-definition picture of generation; And
On will the base resolution image corresponding to the position of area-of-interest of overlapping corresponding to the high-definition picture of area-of-interest.
145. a technological system that is used for providing high-definition picture, this system comprises:
The non-transience computer-readable medium that is used for the executable program module of storage computer;
With storing the processor of Program module with execution with the non-transience computer-readable medium of processor coupled communication;
A Network Interface Module that is stored in non-transience computer-readable medium, and be set to
Receiving from the client device of first user by network is a group selection parameter of second user's appointment by first user,
To select Parameter storage to be used for the second user's retrieval in the data storage,
Receive the request of selection parameter from the second user's client device by network,
To select parameter to send to the second user's client device by network,
Receive the request of image from client device first user or the second user by network, and
When having the image access authority, the user of client device or client device by network, image transmitting is arrived the client device of the request of sending out;
The request processing module that is stored in non-transience computer-readable medium and can be communicated with Network Interface Module, this request processing module is set to
Receive the request of this image through Network Interface Module,
Process this request, and
From Network Interface Module, the image of asking is sent to client device;
One is stored in non-transience computer-readable medium and the access control module that is communicated with request processing module, and this access control module is set to
Reception is from the client device authorization requests of request processing module, confirming client device or its user's image access right,
According to access control regulations authentication-access authority, and
Whether there is the authorization response of the authority of the required image of access to indicate to request processing module transmission client device or user; And
Be stored in non-transience computer-readable medium and the image management module that can be communicated with request processing module, and this image management module is configured usage data and stores to process the image management request.
146. in Patent right requirement the 145th described system, Network Interface Module further is set to be stored as from data the selection parameter that the second user search is asked when selecting parameter sending.
147. in Patent right requirement the 145th described system, Network Interface Module further is set to use calculation procedure to produce the selection parameter of asking when selecting parameter sending.
148. in Patent right requirement the 145th described system, request processing module further is set to when processing request:
Whether there is the authorization response indication of access rights to determine whether to send the image of asking according to the user from the client device of access control module or client device and sends to requesting client equipment to Network Interface Module.
149. in Patent right requirement the 145th described system, request processing module further is set to when processing request:
Request is sent to image management module, require to obtain resolution more than or equal to the image of asking of the desired resolution of client device; And
Receive resolution more than or equal to the image of the desired resolution of client device from image management module.
150. in Patent right requirement the 149th described system, request processing module further is set to when processing request:
The image that receives from image management module produces the image of asking of the resolution of client device request.
151. in Patent right requirement the 149th described system, request processing module further is set to when processing request:
The image that receives from image management module produces the part of asking of image of the resolution of client device request.
152. in Patent right requirement the 145th described system, image management module further is set to:
From image input device or system's input picture; And
Store the image in the data storage.
153. in Patent right requirement the 145th described system, image management module further is set to:
Produce image; And
Store the image in the data storage.
154. in Patent right requirement the 145th described system, image management module further is set to:
Generate a plurality of images, each in these a plurality of images have different level of resolution and from generate, input or be stored on server equate or the image of larger resolution generates, and
A plurality of images are stored in the data storage.
155. in Patent right requirement the 145th described system, request processing module further is set to when processing request:
One group of user's Selective storage is used for using later in the data storage.
156. a technological system that is used for checking high-definition picture, this system comprises:
The non-transience computer-readable medium that is used for the executable program module of storage computer;
With storing the processor of Program module with execution with the non-transience computer-readable medium of processor coupled communication;
A Network Interface Module that is stored in non-transience computer-readable medium, and be set to
Sending by first user by network is a group selection parameter of second user's appointment,
Receive a group selection parameter that is used for the second user by network,
Send image request to server by network,
Receive the image of asking from server by network;
A subscriber interface module that is stored in non-transience computer-readable medium and can be communicated with Network Interface Module, this subscriber interface module is set to
Accept to be used for the second user's selection parameter from first user,
Reception is from the second user's request, checking image,
Transmit a request to request processing module, require to obtain the image that the second user asks,
The combination image of the image that reception is asked corresponding to the second user, and
Show combination image on the display of the second user's client device;
A request processing module that is stored in non-transience computer-readable medium and can be communicated with subscriber interface module, this request processing module is set to
In response to the request of checking this image that receives from first user, the request that processing is obtained image from the requirement of the first user of subscriber interface module,
In response to the request of checking this image that receives from the second user, receive the request of obtaining image for the second user's requirement from subscriber interface module;
It is the selection parameter that the second user is identified for image;
It is the request that second user's processing requirements obtains image; And
Provide the combination image of the image of asking corresponding to the second user to subscriber interface module, to be shown to the second user; And
Be stored in the image management module in non-temporary computer readable medium, with the communication of request processing module and Network Interface Module in, image management module is set to usage data and stores to process the image management request.
157. in Patent right requirement the 156th described system, Network Interface Module further is set to send the selection parameter to the second user's client device by network when sending a group selection parameter.
158. in Patent right requirement the 156th described system, when sending a group selection parameter Network Interface Module further be set to by network sends select parameter to server to be retrieved by the second user's client device.
159. in Patent right requirement the 156th described system, Network Interface Module further is set to receive from the client device of first user by network and selects parameter when receiving a group selection parameter.
160. in Patent right requirement the 156th described system, Network Interface Module further is set to when receiving one group of selection parameter that is used for the second user
Select parameter by network from server request; And
Receive from server by network and select parameter.
161. in Patent right requirement the 156th described system, subscriber interface module further is set to when accepting to select parameter from first user
Reception is from the request of first user, to check image;
Transmit a request to request processing module, require to obtain image;
Receive image from request processing module;
Show image on the display of the client device of first user;
From first user input selection parameter; And
Provide select parameter to Network Interface Module to pass through Internet Transmission.
162. in Patent right requirement the 156th described system, request processing module further is set to when the request that image is obtained in the requirement of processing first user
Transmit a request to image management module, require to obtain the image of the image of asking corresponding to subscriber interface module;
Receive image from image management module;
Produce the image that subscriber interface module is asked; And
Provide image to subscriber interface module to be shown to first user.
163. in Patent right requirement the 156th described system, request processing module further is set to receive from Network Interface Module and selects parameter when determining to select parameter.
164. in Patent right requirement the 156th described system, request processing module further is set to use calculation procedure to produce and selects parameter when determining to select parameter.
165. in Patent right requirement the 156th described system, request processing module further is set to when the request that image is obtained in the requirement of processing the second user
Transmit a request to image management module, require to obtain the base resolution image corresponding to combination image;
Receive the base resolution image from image management module;
Transmit a request to image management module, require to obtain the high-definition picture corresponding to selecting the area-of-interest of appointment in parameter;
From image management module receiving high definition image; And
By producing combination image corresponding to the base resolution image of the position of the image of interest that overlaps of the high-definition picture of area-of-interest.
166. in Patent right requirement the 156th described system, request processing module further is set to when the request that image is obtained in the requirement of processing the second user
Transmit a request to image management module, require to obtain the base resolution image corresponding to combination image;
Receive the base resolution image from image management module;
Transmit a request to image management module, require to obtain the part corresponding to the high-definition picture of selecting area-of-interest specified in parameter, this part comprises area-of-interest;
Part from image management module receiving high definition image; And
By producing combination image corresponding to the base resolution image of the position of the area-of-interest that overlaps of the high-definition picture of area-of-interest.
167. in Patent right requirement the 156th described system, request processing module further is set to when the request that image is obtained in the requirement of processing the second user
Transmit a request to image management module, require to obtain the top image in different resolution corresponding to combination image;
Receive top image in different resolution from image management module;
Produce the base resolution image from top image in different resolution;
Produce high-definition picture from top image in different resolution; And
By producing combination image corresponding to the base resolution image that overlaps corresponding to the position of area-of-interest of the high-definition picture of selecting area-of-interest specified in parameter.
168. in Patent right requirement the 156th described system, request processing module further is set to when the request that image is obtained in the requirement of processing the second user
Transmit a request to image management module, require to obtain the combination image corresponding to selecting parameter; And
Receive combination image from image management module.
169. in Patent right requirement the 156th described system, image management module further is set to when processing the image management request
Reception requires to obtain image from the request of request processing module;
The image that retrieval is asked; And
Send the image of asking and arrive request processing module.
170. in Patent right requirement the 169th described system, image management module further is configured to when the image that retrieval is asked
Check whether the image of asking is buffered in the data storage; And
Whether the image of asking from search data memory is buffered.
171. in Patent right requirement the 169th described system, image management module further is set to when the image that retrieval is asked
Transmit a request to Network Interface Module, require to obtain image;
Reception is from the image of asking of Network Interface Module; And
With received image buffer storage in data storages.
172. in Patent right requirement the 156th described system, request processing module further is set to when processing request:
One group of user's Selective storage is used for using later in the data storage.
173. a computer-implemented method is used for it is characterized by at the local high-definition picture of the context-sensitive of base resolution image, one or more processors programme to carry out following steps, comprising:
Client device receives request, to check image;
Transmit a request to server by network, require to obtain the base resolution image corresponding to the image of asking;
Receive this base resolution image by network from server;
Show this base resolution image on the display of client device;
Reception shows the request of the area-of-interest of this base resolution image with high-resolution;
Transmit a request to server by network, require to obtain the combination image corresponding to this base resolution image;
Receive this combination image by network from server; With
Show combination image on the display of client device.
174. in the 173rd described method of Patent right requirement, the resolution of base resolution image is less than the resolution that generates, inputs or be stored in the ultimate resolution image on server.
175. in the 173rd described method of Patent right requirement, combination image is by the base resolution image and the part high-definition picture corresponding to this area-of-interest consists of in the position that is overlapped in area-of-interest on the base resolution image.
176. in the 175th described method of Patent right requirement, the resolution of high-definition picture is less than or equal to the resolution of ultimate resolution image, and wherein the resolution of high-definition picture greater than the resolution of base resolution image.
177. in the 174th described method of Patent right requirement, the selection of the resolution of base resolution image at least in part root a tree name client device or network function and determine.
178. in the 177th described method of Patent right requirement, shown base resolution image equates or larger image generation from received resolution.
179. in the 175th described method of Patent right requirement, this overlapping layer has comprised a virtual lens.
180. in the 179th described method of Patent right requirement, further comprised:
Client device receives request, to adjust the size of virtual lens;
Transmit a request to server, require to obtain the combination image of the virtual lens with the size of asking;
Receive combination image from server; And
Show combination image on the customer equipment display.
181. in the 179th described method of Patent right requirement, further comprised:
Client device receives request, take the shape of alteration of form as being asked with virtual lens; And
Transmit a request to server, require to obtain the combination image of the virtual lens with the shape of asking;
Receive combination image from server; And
Show combination image on the client device display.
182. in the 179th described method of Patent right requirement, further comprised:
Client device receives request, to change the resolution of the shown high-definition picture of virtual lens;
Transmit a request to server, require obtain combination image and be overlapped in the position of area-of-interest on the base resolution image corresponding to the high-resolution parts of images of asking of this area-of-interest;
Receive combination image from server; And
Show combination image on the client device display.
183. in the 179th described method of Patent right requirement, further comprised:
Follow the tracks of the movement of the cursor of being controlled by pointing apparatus on the base resolution image of client device;
Send the request of combination image to server, combination image is made of the high-resolution parts of images of asking of the position that is overlapped in area-of-interest on the base resolution image corresponding to this area-of-interest;
Receive combination image from server; And
Show combination image on the client device display.
184. in the 183rd described method of Patent right requirement, further comprised:
The response user instruction freezes virtual lens corresponding position on the base resolution image.
185. in the 184th described method of Patent right requirement, further comprised:
The response user instruction, the virtual lens corresponding position on the base resolution image that thaws and before freezed.
186. in the 179th described method of Patent right requirement, further comprised:
Response user's instruction shows that the base resolution image is to hide virtual lens.
187. in the 186th described method of Patent right requirement, further comprised:
Response user's instruction shows that combination image is to illustrate the previous virtual lens of hiding.
188. in the 173rd described method of Patent right requirement, the user's of client device selection is stored in and is used in the memory of client device using later on.
189. a computer-implemented method is used for providing high-definition picture, it is characterized by, one or more processors programme to carry out following steps, comprising:
Receive the request of base resolution image from client device;
Have access rights to the base resolution image according to the user of access control regulations Authentication Client equipment or client device;
Generate, input or be stored on server and with the base resolution image correlation connection of this request equate or the basis of the image of larger resolution on base resolution image of generation;
Connect by network the base resolution image is sent to client device;
Receive the request of the combination image that is associated with base resolution image and area-of-interest;
Have access rights to combination image according to the user of access control regulations Authentication Client equipment or client device;
Produce combination image; And
Combination image is sent to client device.
190. in the 189th described method of Patent right requirement, combination image is by the base resolution image and the high-resolution parts of images of asking corresponding to this area-of-interest consists of in the position that is overlapped in area-of-interest on the base resolution image.
191. in the 190th described method of Patent right requirement, the base resolution image is from generating, input or be stored in equating or the generation of larger image in different resolution on server.
192. in the 190th described method of Patent right requirement, high-definition picture is from generating, input or be stored in equating or the generation of larger image in different resolution on server.
193. in the 190th described method of Patent right requirement, this overlapping layer has comprised a virtual lens.
194. in the 193rd described method of Patent right requirement, generation comprises that the combination image of virtual lens has further comprised:
Add upper side frame around virtual lens, so that virtual lens is divided out from the base resolution image.
195. in the 193rd described method of Patent right requirement, generation comprises that the combination image of virtual lens has further comprised:
Present virtual lens in the center of area-of-interest.
196. in the 195th described method of Patent right requirement, present virtual lens and further comprised in the center of area-of-interest:
If virtual lens is presented in the center of area-of-interest, determine whether that at least a portion virtual lens will be outside the border of base resolution image;
If the virtual lens of at least a portion is in outside the border of base resolution image, determine virtual lens deviation post so that virtual lens not beyond the border of base resolution image; With
Present virtual lens so that shown virtual lens and part high-definition picture in the center of deviation post.
197. in the 193rd described method of Patent right requirement, further comprised:
Adjust the size and dimension of virtual lens, to improve the function of the application program of using virtual lens.
198. in the 190th described method of Patent right requirement, described image is video.
199. in the 198th described method of Patent right requirement, described demonstration is corresponding to the high-definition picture of the part of area-of-interest, this high-definition picture overlaps the position of area-of-interest on corresponding base resolution image, has further comprised:
The frame of synchronous processed frame speed and the current high-definition picture that shows with its frame rate and the frame of current demonstration base resolution video.
200. in the 189th described method of Patent right requirement, the user's of client device selection is stored in and is used in the memory of client device using later on.
201. a technological system that is used for providing high-definition picture, this system comprises:
The non-transience computer-readable medium that is used for the executable program module of storage computer;
With storing the processor of Program module with execution with the non-transience computer-readable medium of processor coupled communication;
A Network Interface Module that is stored in non-transience computer-readable medium, and be set to
Receive the image request of the selected resolution of client device by network, and
When having the image access authority, the user of client device or client device by network, image transmitting is arrived client device;
Receive request from the combination image of client device by network, this combination image is made of the part high-definition picture of the position that is overlapped in area-of-interest on the base resolution image corresponding to this area-of-interest, and
If the user of client device or client device has the image access authority, by network, combination image is sent to client device;
The request processing module that is stored in non-transience computer-readable medium and can be communicated with Network Interface Module, request processing module is set to
Receive the request of the selected image in different resolution of client through Network Interface Module,
Process the request of the selected image in different resolution of this client,
From Network Interface Module, the image of asking is sent to client device with desired resolution,
Receive the request of combination image through Network Interface Module,
Process the request of this combination image, and
From Network Interface Module, combination image is sent to client device;
One is stored in non-transience computer-readable medium and the access control module that is communicated with request processing module, and this access control module is set to
Reception is from the authorization requests of request processing module, with verification client device or its user right to access to the image of request,
According to access control regulations authentication-access authority, and
Whether there is the authorization response of the authority of access images to indicate to request processing module transmission client device or user;
The image management module that is stored in non-transience computer-readable medium and can be communicated with request processing module, this image management module is configured usage data and stores to process from the image management request.
202. in Patent right requirement the 201st described system, request processing module is set to when processing request:
Whether there is the authorization response indication of access rights to determine whether to send the image of asking according to the user from the client device of access control module or client device and sends to requesting client equipment to Network Interface Module.
203. in Patent right requirement the 201st described system, request processing module further is set to when treatment of selected is decided the image request of resolution:
Transmit a request to image management module, require to obtain with ask in specified base resolution equate or the image of larger resolution; And
From image management module receive with ask specified base resolution equate or the image of larger resolution; And
Produce the base resolution image according to the image that receives.
204. in Patent right requirement the 201st described system, request processing module further is set to when the request for the treatment of combination image:
Transmit a request to image management module, require to obtain with ask in specified base resolution equate or the image of larger resolution;
From image management module receive with ask specified base resolution equate or the image of larger resolution;
Produce the base resolution image according to the image that receives;
Transmit a request to image management module, require to obtain with ask in specified high-resolution equate or the image of larger resolution;
From image management module receive with ask specified high-resolution equate or the image of larger resolution;
Produce high-definition picture according to the image that receives; And
By producing combination image corresponding to the position that partially overlaps in corresponding to the base resolution image of area-of-interest of the high-definition picture of specified area-of-interest in request.
205. in Patent right requirement the 201st described system, image management module further is set to:
From image input device or system's input picture; And
This image is stored in this data storage.
206. in Patent right requirement the 201st described system, image management module further is set to:
Synthetic image; And
This image is stored in this data storage.
207. in Patent right requirement the 201st described system, image management module further is set to:
From equating or the image of larger resolution generates a plurality of images, each in these a plurality of images have different level of resolution and from generate, input or be stored on server equate or the image of larger resolution generates, and
A plurality of images are stored in this data storage.
208. in Patent right requirement the 201st described system, request processing module further is set to when processing request:
One group of user's Selective storage is used for using later in this data storage.
209. a technological system that is used for checking high-definition picture, this system comprises:
The non-transience computer-readable medium that is used for the executable program module of storage computer;
With storing the processor of Program module with execution with the non-transience computer-readable medium of processor coupled communication;
A Network Interface Module that is stored in non-transience computer-readable medium, and be set to
Send image request to server by network,
Receive the image of asking from server by network;
Send the combination image request to server by network, and
Receive combination image by network from server;
A subscriber interface module that is stored in non-transience computer-readable medium, and be set to
Reception is from user's the request of checking image,
Reception is corresponding to the base resolution image of the image of asking,
Show the base resolution image on the display of system,
Reception shows the request of area-of-interest in this base resolution image from the user's with high-resolution,
Send the request of combination image to request processing module, this combination image is made of the part high-definition picture of the position that is overlapped in area-of-interest on the base resolution image corresponding to this area-of-interest,
Reception is from the combination image of request processing module, and
Show combination image on the display of system; And
Be stored in non-provisional computer-readable medium, and the request processing module of communicating by letter with described Network Interface Module with subscriber interface module, request processing module is set to
Processing is from the request of the base resolution image of subscriber interface module; And
Processing is from the request of the combination image of subscriber interface module; And
The image management module that is stored in non-temporary computer readable medium and can be communicated with request processing module and Network Interface Module, image management module is set to usage data and stores to process the image management request.
210. in Patent right requirement the 209th described system, request processing module further is set to when processing the request of base resolution image:
Reception requires to obtain the base resolution image from the request of subscriber interface module;
Transmit a request to image management module, require to obtain the base resolution image;
Reception is from the base resolution image of image management module; And
Send the base resolution image to subscriber interface module with demonstration.
211. in Patent right requirement the 209th described system, request processing module further is set to when the request for the treatment of combination image:
Reception requires to obtain combination image from the request of subscriber interface module, and this combination image is made of the part high-definition picture of the position that is overlapped in area-of-interest on the base resolution image corresponding to this area-of-interest;
Transmit a request to image management module, require to obtain combination image;
Reception is from the combination image of image management module; And
The combination image that transmission is asked is to subscriber interface module.
212. in Patent right requirement the 209th described system, image management module further is set to when processing the image management request
Reception requires to obtain image from the request of request processing module;
The image that retrieval is asked; And
Send the image of asking and arrive request processing module.
213. in Patent right requirement the 212nd described system, image management module further is set to when the image that retrieval is asked
Check whether the image of asking is buffered in this data storage; And
Whether retrieval is buffered from the image of asking of this data storage.
214. in Patent right requirement the 212nd described system, image management module further is set to when the image that retrieval is asked
Transmit a request to Network Interface Module, require to obtain image;
Reception is from the image of asking of Network Interface Module; And
With the image buffer storage that receives in this data storage.
215. in Patent right requirement the 209th described system, request processing module further is set to when processing request
One group of user's Selective storage is used for using later in this data storage.
CN2011800438580A 2010-07-12 2011-07-12 Systems and methods for networked in-context, high-resolution image viewing CN103155585A (en)

Priority Applications (9)

Application Number Priority Date Filing Date Title
US12/834,810 2010-07-12
US12/834,810 US8667054B2 (en) 2010-07-12 2010-07-12 Systems and methods for networked, in-context, composed, high resolution image viewing
US12/834,809 2010-07-12
US12/834,806 US8296359B2 (en) 2010-07-12 2010-07-12 Systems and methods for networked, in-context, high resolution image viewing
US12/834,809 US20120011568A1 (en) 2010-07-12 2010-07-12 Systems and methods for collaborative, networked, in-context, high resolution image viewing
US12/834,806 2010-07-12
US12/954,269 US7991837B1 (en) 2010-07-12 2010-11-24 Systems and methods for networked, in-context, high resolution image viewing
US12/954,269 2010-11-24
PCT/US2011/043755 WO2012021246A2 (en) 2010-07-12 2011-07-12 Systems and methods for networked in-context, high-resolution image viewing

Publications (1)

Publication Number Publication Date
CN103155585A true CN103155585A (en) 2013-06-12

Family

ID=45568114

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011800438580A CN103155585A (en) 2010-07-12 2011-07-12 Systems and methods for networked in-context, high-resolution image viewing

Country Status (3)

Country Link
EP (1) EP2594080A4 (en)
CN (1) CN103155585A (en)
WO (1) WO2012021246A2 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103414742A (en) * 2013-07-03 2013-11-27 百度在线网络技术(北京)有限公司 Image transmission method and system
CN104410822A (en) * 2014-11-24 2015-03-11 深圳市华宝电子科技有限公司 Video monitoring method and vehicular video monitoring equipment
CN105850117A (en) * 2013-12-25 2016-08-10 株式会社理光 Information processing device, program, and transfer system
CN105938626A (en) * 2015-03-05 2016-09-14 韩昌烨 3D object modeling method and storage medium having computer program stored thereon using the same
CN106780319A (en) * 2016-11-11 2017-05-31 航天恒星科技有限公司 The processing method and processing device of super large image
WO2017210908A1 (en) * 2016-06-08 2017-12-14 华为技术有限公司 Processing method and terminal
CN107548557A (en) * 2015-04-22 2018-01-05 三星电子株式会社 Method and apparatus for sending and receiving the view data for virtual reality streaming service
CN107645633A (en) * 2016-07-21 2018-01-30 三菱电机大楼技术服务株式会社 Image processing apparatus

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017058665A1 (en) * 2015-10-01 2017-04-06 Vid Scale, Inc. Methods and systems for client interpretation and presentation of zoom-coded content

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6281874B1 (en) * 1998-08-27 2001-08-28 International Business Machines Corporation Method and system for downloading graphic images on the internet
US20020089502A1 (en) * 2001-01-11 2002-07-11 Matchen Paul M. System and method for providing high performance image magnification in a web browser
US6700589B1 (en) * 2000-02-17 2004-03-02 International Business Machines Corporation Method, system, and program for magnifying content downloaded from a server over a network
US20080222273A1 (en) * 2007-03-07 2008-09-11 Microsoft Corporation Adaptive rendering of web pages on mobile devices using imaging technology
CN101350923A (en) * 2008-09-03 2009-01-21 中国科学院上海技术物理研究所 Method for communication and indication of interactive iatrology image
CN101669815A (en) * 2009-09-22 2010-03-17 广东威创视讯科技股份有限公司 Remote diagnosis system of medical section and network transmission method thereof
US20100166334A1 (en) * 2008-12-29 2010-07-01 Arcsoft Hangzhou Co., Ltd. Method for magnifying images and videos

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH04142661A (en) * 1990-10-04 1992-05-15 Toshiba Corp Information processor
US8120624B2 (en) * 2002-07-16 2012-02-21 Noregin Assets N.V. L.L.C. Detail-in-context lenses for digital image cropping, measurement and online maps
KR100436667B1 (en) * 2003-02-20 2004-06-22 브이알 포토 주식회사 The method and equipment of ASP service for multi-resolution image on the environment of multi-server.
CA2449888A1 (en) * 2003-11-17 2005-05-17 Idelix Software Inc. Navigating large images using detail-in-context fisheye rendering techniques
US7804508B2 (en) * 2004-10-06 2010-09-28 Apple Inc. Viewing digital images on a display using a virtual loupe
US7495582B2 (en) * 2005-03-08 2009-02-24 Northrop Grumman Corporation Geographic information storage, transmission and display system
KR100879808B1 (en) * 2006-12-11 2009-01-22 소프트캠프(주) Approching control system to the file server

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6281874B1 (en) * 1998-08-27 2001-08-28 International Business Machines Corporation Method and system for downloading graphic images on the internet
US6700589B1 (en) * 2000-02-17 2004-03-02 International Business Machines Corporation Method, system, and program for magnifying content downloaded from a server over a network
US20020089502A1 (en) * 2001-01-11 2002-07-11 Matchen Paul M. System and method for providing high performance image magnification in a web browser
US20080222273A1 (en) * 2007-03-07 2008-09-11 Microsoft Corporation Adaptive rendering of web pages on mobile devices using imaging technology
CN101350923A (en) * 2008-09-03 2009-01-21 中国科学院上海技术物理研究所 Method for communication and indication of interactive iatrology image
US20100166334A1 (en) * 2008-12-29 2010-07-01 Arcsoft Hangzhou Co., Ltd. Method for magnifying images and videos
CN101669815A (en) * 2009-09-22 2010-03-17 广东威创视讯科技股份有限公司 Remote diagnosis system of medical section and network transmission method thereof

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103414742A (en) * 2013-07-03 2013-11-27 百度在线网络技术(北京)有限公司 Image transmission method and system
CN103414742B (en) * 2013-07-03 2016-12-28 百度在线网络技术(北京)有限公司 A kind of picture transmission method and system
CN105850117A (en) * 2013-12-25 2016-08-10 株式会社理光 Information processing device, program, and transfer system
CN104410822A (en) * 2014-11-24 2015-03-11 深圳市华宝电子科技有限公司 Video monitoring method and vehicular video monitoring equipment
CN105938626A (en) * 2015-03-05 2016-09-14 韩昌烨 3D object modeling method and storage medium having computer program stored thereon using the same
CN107548557A (en) * 2015-04-22 2018-01-05 三星电子株式会社 Method and apparatus for sending and receiving the view data for virtual reality streaming service
WO2017210908A1 (en) * 2016-06-08 2017-12-14 华为技术有限公司 Processing method and terminal
CN108353210A (en) * 2016-06-08 2018-07-31 华为技术有限公司 Processing method and terminal
AU2016409676B2 (en) * 2016-06-08 2020-01-30 Huawei Technologies Co., Ltd. Processing method and terminal
CN107645633A (en) * 2016-07-21 2018-01-30 三菱电机大楼技术服务株式会社 Image processing apparatus
CN106780319A (en) * 2016-11-11 2017-05-31 航天恒星科技有限公司 The processing method and processing device of super large image

Also Published As

Publication number Publication date
EP2594080A4 (en) 2014-11-12
WO2012021246A3 (en) 2012-05-18
WO2012021246A2 (en) 2012-02-16
EP2594080A2 (en) 2013-05-22

Similar Documents

Publication Publication Date Title
US20170004115A1 (en) Systems and methods for sharing user generated slide objects over a network
US10521486B2 (en) Method and apparatus for using proxies to interact with webpage analytics
US9870132B2 (en) Application reporting in an application-selectable user interface
US9270728B2 (en) Creation, sharing and embedding of interactive charts
US20170169054A1 (en) System and method for dynamically retrieving data specific to a region of a layer
US10031891B2 (en) Delivery and display of page previews during page retrieval events
US20200125789A1 (en) Dynamic zooming of content with overlays
US20160301733A1 (en) Accessing and displaying network content
KR20140108154A (en) Apparatus and method for processing a multimedia commerce service
US9141332B2 (en) Masking sensitive information in a screen sharing session
US10146421B1 (en) Online information system with per-document selectable items
CN102520841B (en) Collection user interface
CN101578575B (en) Method and device for selecting and displaying a region of interest in an electronic document
JP5324411B2 (en) Advertisement distribution apparatus, method and program
US20170116160A1 (en) Systems and methods for adaptive content distribution
US8739070B2 (en) System, method and apparatus for providing an application carousel
US6321256B1 (en) Method and apparatus for controlling client access to documents
AU2017232144B2 (en) Systems and methods for managing content items having multiple resolutions
RU2509341C2 (en) Image processing device and image processing method
US7308649B2 (en) Providing scalable, alternative component-level views
US6700589B1 (en) Method, system, and program for magnifying content downloaded from a server over a network
US8823667B1 (en) Touch target optimization system
US8914744B2 (en) Enhanced zoom and pan for viewing digital images
US8560946B2 (en) Timeline visualizations linked with other visualizations of data in a thin client
US20130232009A1 (en) Browsing and quality of service features

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20130612