JPH11136488A - Image transfer method, and program storage and recording medium therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To simultaneously satisfy a request for display in a short time at the sacrifice of quality and a request for display with priority given to image quality, and to efficiently display a required area for each request on a reception side or a transmission side. SOLUTION: A transmission side performs conversion to an image compression form that can be defrosted by a reception side and transmits images 61 of low quality, images 62 of slightly better quality and images 63 requiring a large data amount successively along with display timing information 64 including position information and a display order. Also, entire images can be displayed even in the course of reception, and a traffic state is monitored at the time of the reception so that changeover is automatically or manually performed so as to receive only images of inferior quality and perform shifting to the next image reception in the case that the traffic state is bad, and to receive images including those with high definition in the case that the traffic state is improved.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for transmitting and receiving image data efficiently under the control of a transmission side or a reception side in response to an image display request from a remote place, and displaying a screen with desired quality and display time. The present invention relates to a possible image transfer method and a recording medium storing the program.

[0002]

2. Description of the Related Art In the Internet, information is centrally managed by a Web server, and a Web server mounted on an unspecified number of terminals is used.
Viewing information from a browser. In that case,
There is a need for a method of monitoring and controlling devices on a network using a browser. There is also a need for a method by which an unspecified number of people can view images at remote locations with desired quality and display time. However, when displaying images using a browser on the Internet, it takes a long time to transmit all data when displaying high-quality images due to the performance of the display side and restrictions on transmission paths such as public lines. Sometimes I was waiting. From those restrictions, reduce the amount of data to be sent,
In other words, transmission is generally attempted with reduced image quality. However, on the contrary, users who desire a high-quality image will be dissatisfied.

On the receiving side, generally, after receiving all the data of the image set by the transmitting side, the image is processed and displayed on the screen. Therefore, when the traffic condition is poor, the performance of communication means such as a modem is low. If it is low, it takes time to display a required image. In particular, when there are a large number of images, the recipient may have to wait for a long time to obtain an image he or she needs, and often need to disconnect the line. In order for the receiving side to quickly obtain the desired image, the receiving side must negotiate with the transmitting side in advance before selecting the image. On the other hand, when the traffic condition is poor, there is a method of switching to an image of low image quality or an image of small size and transferring the image. However, the transmission side has to hold a plurality of image information of different image quality and size, Further, when switching images, a protocol is required between the receiver and the receiver.

[0004]

As described above, (1) a user who prefers display time to display images in a short time even if the quality is poor, and a little time is required to give priority to image quality. Since there is a user who wants to display with high quality at the same time, it is impossible to efficiently transmit and display each time the user desires. (2) When transferring data with a large amount of information such as an image, if the traffic condition is poor, the transfer takes a long time, so the transfer cost increases for both the receiver and the transmitter / receiver, and a data error occurs. And can affect the quality of the received image. In such a case, the connection may be terminated during reception. In this case, the image is not reproduced, or only a part of the whole image is displayed, and a method of displaying an outline of the whole is impossible. (3) Regardless of whether the traffic condition is good or bad, the receiving side needs to receive all the image data prepared on the transmitting side. Therefore, when the traffic is bad, the receiving side lowers the image quality and resolution to reduce the image quality. A method of receiving and requesting the next image reception was impossible.

[0005] (4) Image quality such as accuracy and resolution desired by the receiving side needs to be negotiated with the sender. Conventionally, an image of lower quality than the image quality set by the transmitting side is required. Even when receiving, this could not be easily changed. (5) When the traffic condition is bad, there is a method of transferring the image by switching to an image having a low image quality or an image having a small size. It is necessary to hold the information, and when switching images, a protocol with the receiver is required.
(6) If the reception of the image is terminated when the transfer time set by the receiver or the reception data size has been reached, the image is not reproduced or only a part of the whole image is displayed. Therefore, it was impossible to reduce the resolution and display the entire image. In order to make it possible, it is necessary to re-convert an image to be transferred between the sender and the sender, which is troublesome.

Therefore, a first object of the present invention is to solve these conventional problems, and to give priority to display time and user demand for displaying images in a short time even if the quality is poor, and to give priority to image quality. Another object of the present invention is to provide an image transfer method and a recording medium for the same image data and the same processing method that can satisfy a user's request for high quality display even if it takes a little time. A second object of the present invention is to provide an image transfer method capable of efficiently displaying a necessary area on the same image for each destination or source desired on the screen. A third object of the present invention is to
When the traffic condition is poor, the image data required to process or display the image with a low image quality enough for the receiving side to understand the outline of the image can be used as a part of the entire image, and the amount of image information to be received can be reduced. An image transfer method and a recording medium thereof are provided. A fourth object of the present invention is to provide an image transfer system capable of reducing loss in time and cost by performing re-reception from the beginning when a large image is received when the traffic condition is poor. It is to provide a method. A fifth object of the present invention is to eliminate the necessity of preparing a plurality of images having different image qualities on the transmission side, not requiring a special protocol between the transmission and reception sides, and inquiring the transmission side of the required image quality. To provide an image transfer method that can be selected arbitrarily or according to the traffic state on the receiving side without reducing the load on the transmitting side and increasing the scope and flexibility of selecting functions on the receiving side. It is in. Further, a sixth object of the present invention is to monitor the traffic state, switch to the image reception quality depending on the traffic state, and provide a learning function as a criterion for performing the transition of the reception state. It is to provide a possible image transfer method.

[0007]

In order to achieve the above object, according to the image transfer method of the present invention, (1) the transmitting side extracts a plurality of types of data amounts at an arbitrary timing and in an arbitrary area. First, extract low-quality images with limited data amount from image data compressed in an image compression format that can be used, convert them to a compression format that can be decompressed on the receiving side, and then change the position information and display order of the images. The image data is transmitted together with the display timing information including the information, and then information for displaying the next high-quality image is transmitted. Then, image data requiring more data is sequentially transmitted. (2) When transmitting image data, the transmitting side inquires of the receiving side about the display quality, the display area, and the display order, obtains information from the receiving side, and compresses the data at the receiving side. An image to be displayed is extracted from the image data converted into the format and transmitted. (3) The transmission side monitors the data transmission state when transmitting image data, temporarily suspends data transmission when a certain delay or more occurs, inquires the reception side about the next processing, After waiting for the processing designation from the receiving side, the data quality and area are reset and transmission is started. (4) If the transmitting side obtains information about the display quality, display area, and display order from the receiving side before inquiring the information, the transmitting side should immediately display the image data converted into a compression format that can be decompressed on the receiving side. Take out the image and send it. (5) The transmission side monitors the data transmission state when transmitting image data, temporarily suspends data transmission when a certain delay or more occurs, and sends the data to the reception side in advance regardless of the data transmission state. The next process is inquired, and if there is no process specification from the receiving side during the interruption, the data quality and area specified in advance are reset and transmission is started.

[0008] On the other hand, (6) the receiving side receives compressed or uncompressed image data having a data structure of sequentially increasing quality from coarse quality or low quality, and can display the entire image during reception. In addition, the traffic condition is monitored at the time of reception, and when the traffic condition is poor, only the data reception necessary for image processing of coarse image quality is performed, and sequentially,
The process shifts to the next image reception, and when the traffic condition is good or when the traffic condition is restored to a good condition, switching is performed automatically or manually so that data required for high-definition image processing is received. (7) The receiving side sets the image quality desired by the receiving side in a plurality of stages according to the traffic state. (8) The receiving side gives hysteresis to conditions such as the traffic state for switching the quality of the received image. (9) The receiving side has a learning function for conditions such as a traffic state for switching image quality to be received and / or image quality. (10) The receiving side can change the image quality desired by the receiving side during the transfer of the image data. (11) The receiving side automatically re-receives the image information received in low quality when the traffic condition is poor, using the idle time of the processing of the receiving side until the receiving side reaches the desired image quality. continue.

[0009]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The operation principle and embodiments of the present invention will be described below in detail with reference to the drawings. (Principle of operation) (First embodiment) (1) On the transmission side, an image is compressed in an image compression format that can extract a plurality of types of data amounts at an arbitrary timing and an arbitrary area. deep.・ Wait for an image transmission request from the receiving side. -When an image transmission request is received, the receiving side is inquired about the image quality, the display area in the image, and the display order. -Also inquire about the processing after the transmission temporary suspension processing due to the deterioration of the line condition. At the time of transmission, first, data necessary for displaying an image of the lowest quality level determined by the system (which requires the least amount of data) is extracted from the compressed image data and transmitted. Next, when the transmission of the image data of the quality level and the area is completed, the data necessary for displaying the image of the second lowest quality level or the next area is transmitted. Hereinafter, data necessary for displaying an image of a slightly higher quality level is transmitted. -Monitor the amount of data being transmitted. When a reply to the inquiry about the image quality, the image area, and the display order is received, the current transmission data is viewed, and if the transmission has already been completed, the processing is terminated and the next processing is started. If not, the transmission is continued until the transmission is completed. -If the transmission data amount per fixed time becomes smaller than the threshold value, the transmission is suspended. -During the suspension, a message to the effect that the machine is stopped is sent to the receiver. There are three types of release of the halt state, and these are changed in response to the inquiry to the receiving side. If the instruction has been given in advance, the instruction is followed. (A) Stop (cancel) processing by the receiving side. (B) Specify the quality, position, and order of transmission data and continue. (C) When it becomes possible to transmit a data amount equal to or larger than the threshold level due to the improvement of the transmission state, the processing is restarted. Until then, the suspended state will continue. When the type and position information of the transmission data is obtained from the receiving side, transmission is restarted and continued with priority given to the specified data.

(2) On the receiving side: Connect to the host system (transmitting side) using a browser. -Send the functions (support of the compression format used in the present invention, the performance of the client machine, the type of browser, etc.) of the browser side to the transmission side, and secure a communicable state. -If the browser is set to send the setting status in advance, the default image quality, image display area,
Send the display order. -Send an image transmission request to the connected transmitting side.・ Expands and displays the sent image at the specified location. -While receiving and expanding and displaying the image data, wait for user operation and input. -When the user issues a cancel request, a request to stop image transmission is sent to the transmitting side. -When the user specifies the display area, if it is different from the currently displayed area, a request to stop transmission of the image currently being transmitted is sent to the transmitting side, and the image in the area specified by the new user is sent. Request to send. -If the user changes the display order while the display order is specified, a display order change request is issued to the transmission side.・ If the sender informs you that the transmission has been temporarily suspended, and the subsequent processing has not been transmitted, the
Alternatively, the image quality, the image area, and the display order are notified and the transmission is restarted. When the transmission is resumed, the reception processing is resumed after confirming whether or not the image data up to that time has been cancelled.

(Second Embodiment) (1) On the transmission side, the compressed or uncompressed image data having a data structure in which the image information to be transferred sequentially becomes higher in definition from coarse or low quality is created. . -After the line is connected, image information is transmitted in response to a data transmission request from the receiving side, and during transmission, transmission is interrupted (skipped), disconnected, and other processing requests are transmitted from the receiving side at a certain timing or during a protocol procedure. Accept. In response to a request to stop image data transmission from the receiving side, the transmission of the image is stopped, and the process proceeds to the next image transmission or the next process. -Disconnect the connection in response to a request for disconnection from the receiving side.

(2) On the receiving side: one state in which image data reception conditions such as the quality of the image to be received and the maximum communication time per image are determined, and another state in which reception is performed under other conditions There is the above state, and a criterion map in which conditions such as a traffic state for transiting from one state to another state are defined is set with a default value or a previous value. -If necessary, the receiving operator resets the criteria map. Send a data transmission request to the transmission side and start receiving data including images.・ Receive the minimum data required for image profiles and image display. -When a predetermined image quality such as the maximum received image size, the maximum communication time, and the resolution in the current state set in the criteria map is reached, the reception of the image is stopped, and an image of a quality obtained by performing image processing is obtained. Is stored or displayed, and the process proceeds to the next processing, such as requesting the transmission side to stop data transmission of the image and requesting data transmission of the next image. The monitoring unit that monitors the traffic state notifies the control unit that a transition condition from the current state to another state has occurred. -The predetermined image quality such as the maximum reception image size, the maximum reception time, and the resolution to be received in the state after the transition is automatically or manually set according to the criteria map or the like, or the criteria of the criteria map is reset by the learning function.・ Continue receiving images in accordance with the criteria map, and finally disconnect the line. (3) The monitoring unit monitors traffic conditions such as the data transfer speed and compares the traffic conditions with the criteria map. When the condition for transition from the current state to another state is reached according to the criteria map, the content is notified to the receiving side control unit.

FIG. 1 is a schematic configuration diagram of the entire system showing a first embodiment of the present invention. This system includes a server system 1 capable of supplying digital information such as images on a global network system, and a client system capable of receiving supplied information by selecting only necessary information via a network 6. 3,4
And 5. The first embodiment is a method of transmitting an image according to each request of the receiving side under the control of the transmitting side such as the server 1. In this method, processing is performed in the server 1 and the client systems 3 to 5. Installed as software to make FIG. 2 is a specific configuration diagram in FIG. PC (personal computer) 1
Is a central processing unit 11 capable of compressing and decompressing image data on the server 1 side; a high-speed storage medium memory 12 capable of temporarily storing data required for computation; The so-called H, which is an external storage medium for holding data to be stored for a long period of time,
It includes a DD (hard disk device) 13 and an I / F (interface device) 14 capable of communicating with external devices and transmitting and receiving data. However, these are not particularly necessary on the client system side. On the other hand, I / F1
4 is connected to a modem 2 that connects to a transmission path 6 such as a LAN or a public line in accordance with compatible hardware and protocols. This enables communication with an external device and transmission / reception of data to connect the individual devices. Similarly, a plurality of other PCs (clients) 3 to 5 and the like are connected on the public line 6 and exchange information with each other as necessary.

FIG. 3 is a diagram showing a state in which the receiving side (client) is browsing information such as transmitted image data. FIG. 3A is a diagram in a case where the image quality is specified on the browser side, and FIG.
FIG. 9 is a diagram illustrating a case where a display area is specified on the browser side. A connection with the server is made, a request for information transmission is issued, and a so-called browser 30, which is browsing software widely used on the Internet or the like, is displayed, and the transmitted images "image1" to "image3" are displayed on the screen. Is displayed. Of course, although not shown, not only images but also information such as texts and sounds are transmitted, and are displayed on the screen or simultaneously reproduced. Here, when the display order setting screen 31 is opened, the display order determined on the transmission side (server or host) is displayed, and the image or the like currently being displayed can be known. In this state, when an arbitrary image is selected by the pointer 33 using a mouse or the like and a so-called drag and drop operation is performed to change the position of the displayed image on the list, the information is sent to the transmission side.

An image setting screen 32 is displayed for each selected image.
Can be opened. On the image setting screen 32, a plurality of image qualities can be selected for each image, and the default setting of the display area can be changed. It is also possible to specify a display area by directly specifying an image. Similarly, as shown in FIG. 3B, when a specific area of the image 34 displayed on the browser screen 30 is clicked with the mouse pointer 33, the area is usually divided into about four divisions, and the area including the designated point is divided. The image is displayed with the highest priority among the images, and the image quality is improved. The division position and the number are not limited, and are determined in consideration of the compression ratio on the host side. Since image quality is specified for each image, display processing is performed until the specified image quality is reached.

FIGS. 4 to 18 are flowcharts showing processing on the transmitting side (server or host) and receiving side (client). FIGS. 4 to 10 show processing on the transmitting side. Reference numeral 18 denotes processing on the receiving side. In FIG. 4, the data is initialized and becomes operable (step 4-1), and a data compression format described later that can be extracted by limiting a plurality of types of data amounts to an arbitrary timing and an arbitrary area. To compress the image (step 4-2). Next, it waits for an image transmission request from the receiving side (step 4-3). When an image transmission request is received from an unspecified client connected on the network, information about the image to be transmitted is sent, and the image quality, display area, and display order of each image are inquired to the transmission request source (step 4-). 4). The result is then applied as a default action. At the same time, an inquiry is made as to what to do after the transmission temporary suspension processing (step 4-5).

Next, the required required image data is extracted from the storage device, and if the compression format is supported by the receiving side, the image quality is reduced to a decompressible format if the compression format is not supported. The image data is recompressed and transmission is started (step 4-6). Thereafter, while monitoring the transmission state in the subroutine (step 4-7), the transmission is continued while checking whether or not the image transmission is completed (step 4-8). When the transmission of one image is completed, the next transmission data is prepared (step 4).
-9). It is checked whether the transmission of one page has been completed (step 4-10). If not completed, the transmission of the image data is continued repeatedly (return to step 4-6). When one page is completed, transmission data for the next page is similarly prepared (step 4-11), and it is confirmed whether or not transmission of all data to be transmitted has been completed (step 4-12).
If it has been completed, it waits until the next image transmission request comes (step 4-3).

FIG. 5 shows a subroutine for monitoring the transmission state. When a large amount of data such as image data is transmitted, depending on the state of the line, the transmission rate may be extremely reduced, and it may take a very long time to complete transmission of one image data. Therefore, the state on the transmission path is constantly monitored, and when the state becomes equal to or less than the threshold value, the transmission is interrupted once and the instruction of the receiving side is obtained. The monitoring method is
The rate in the flow state may be viewed, and the elapsed time until a response to the inquiry may be viewed. First, it is checked whether or not the transmission state has dropped below the threshold (step 5-1). Next, it is checked whether or not the image quality has been designated by the receiving side (step 5-2). Similarly, it is checked whether the display area has been designated (step 5-3) and whether the display order has been designated (step 5-4). Further, it is also checked whether or not a request to suspend transmission has been sent for the convenience of the receiving side (step 5-5). Such monitoring and checking are taken out first, and are continuously performed until the transmission of the data that has started being transmitted is completed (step 5-6).

FIG. 6 is a diagram showing a process when the transmission state becomes lower than the threshold value as a result of monitoring the transmission state.
First, the transmission is temporarily suspended (step 6-1). next,
The receiving side is notified that transmission is currently suspended (step 6-2). Then, it waits for the designation of the image quality, the designation of the display area, and the designation of the display order from the receiving side (steps 6-3, 6-4, 6-5). It is also checked whether an interruption request has been received from the receiving side (step 6-).
6). These processes are continuously performed until the transmission state returns to the threshold value or more again (step 6-7). FIG. 7 is a diagram illustrating a process when the image quality is specified by the receiving side. If the image quality is the same as the default or currently specified image quality, the process returns to monitoring the transmission state (step 7).
-1) (to step 5-1 in FIG. 5 via (6)).
If the image quality is different from the designated image quality, the image quality is newly set and transmission of the next data is started (step 7-2). Normally, transmission starts with data having the lowest image quality, for example, a thumbnail image, and is sequentially extracted from the original compressed image data and transmitted until the transmitted image quality is reached. If the designated quality is higher than the currently transmitted quality, the transmission is continued. If the specified quality is lower, the transmission is terminated and the next image is transmitted.

FIGS. 8 and 9 are diagrams of a process for setting a new image area and a display order, respectively. If the next specification is the current specification area (step 8-1),
The process branches to step 5-1 in FIG. 5 via (6), and if it is not the current designated area, it is set in the next image area (step 8-2). In the specification of an image area, the highest priority is given to the transmission of the image data when the specified area reaches the previously specified image quality. In the display order,
Images that have already been sent are not newly sent, regardless of order. The specified display order is applied to the images that have not been transmitted yet (step 9-1). If the current order is specified, the process goes to step 5-1 in FIG.
(Step 9-2). FIG. 10 is a diagram illustrating a process when an interruption request is received from the receiving side. The transmission of the image currently being transmitted is stopped, and a flag indicating that the image is being transmitted is set (step 10-1). Then, it waits for a new transmission request. If the transmission request is for a corresponding image, it should be possible to resume from the interrupted state.

FIGS. 11 to 18 are diagrams showing processing on the receiving side. In FIG. 11, first, initialization is performed on the receiving side (step 11-1), and the process waits until a connection request operation from the user is performed. When the connection request operation is performed (step 11-2), a connection process to the designated host is performed (step 11-3). The connection method is not shown, but is performed by a conventional method. When the connection process ends,
Send information to be notified to the host (step 11-
4). This includes, for example, the hardware configuration and performance of the client, support of the compression format, and the type of browser for browsing. Next, if the setting information for display is to be sent, the setting information is sent (step 11).
-5). This is not required and is determined by the browser settings.

Thereafter, an image transmission request is issued by a user operation or browser default setting (step 11-6). The requested image is sent from the host.
An expansion display at the sending place is performed (step 11-7). At the same time as performing the receiving process and the image displaying process, the user operation is also accepted (step 11-8). In addition, since information necessary for control is sent from the host in addition to information such as images, it is checked whether or not transmission interruption has been notified (step 11-9). If there is notification of transmission interruption, the process branches to FIG. If not, it is checked whether all the information requested first has been received (step 11-1).
0), if all the data has not been received yet, the process returns to the process of displaying the transmitted data (steps 11-7).
If the communication has been completed, it is checked whether a communication termination request has been issued from the user. If the communication termination request has been issued, the process returns to step 11-2. If not, the process returns to step 11-4.

FIG. 12 shows a process of transmitting setting information.
It is a figure of processing which sends a default image quality, a display area, and a display order. First, the default image quality is transmitted (step 12-1), then the default display area is transmitted (step 12-2), and finally, the default display order is transmitted (step 12-3). FIG. 13 is a diagram illustrating main processing of a user operation. First, it is checked whether or not there is a cancellation request by the user (step 13-
1) It is checked whether or not the display area, display order, and image quality are designated as shown in FIG. 3 (step 13-).
2, 13-3, 13-4). Further, although not shown, processing relating to other GUI operations is also performed here (step 13-5).

FIG. 14 is a diagram showing processing when a transmission interruption notification is received from the host. First, a message indicating that the reception process has been interrupted is displayed to the user (step 14-).
1). Next, a user operation shown in FIG. 13 is accepted (step 14-2), and it is checked whether or not a transmission restart notification has been received from the host (step 14-3). FIG.
FIG. 5 is a diagram showing processing when a user issues a cancel processing request. The currently displayed image is returned to the state of the previous image quality, and other information that can be displayed is displayed and the interrupted state is saved and saved (step 15-).
1). Thereafter, it waits for a new image transmission request to be issued by a user operation or the like. FIG. 16, FIG. 17, and FIG.
FIG. 4 is a diagram illustrating a process of transmitting a result of an instruction as shown in FIG. 3 by a user to a host. That is, in FIG. 16, the display area is transmitted (step 16-).
1) In FIG. 17, the display order is transmitted (step 17-).
1) In FIG. 18, the image quality is transmitted (step 18-).
1).

FIG. 19 is a diagram showing one of data compression formats which can extract a plurality of types of data amounts used in the present invention limited to an arbitrary timing and an arbitrary area. 19A shows an original image, FIG. 19B shows an enlarged view of a certain area of FIG. 19A, FIG. 19C shows a data sequence of an original image, and FIG. 19D shows image data of the present invention. FIG. 4E is a diagram showing columns, and FIG. 4E is a diagram of data obtained by enlarging a part of the image data shown in FIG. Here, the compression format is not specified. The original image 50 shown in FIG. 19A has a data string of color information in the x and y directions. The enlarged state is shown in a circle 51. For example, color information (RG
B, CMYK, etc.) are arranged, and are arranged line by line in the x direction. Then, those lines are sequentially arranged in the y direction, and as a result, a two-dimensional image (image) is formed. For example, a very high-definition image has a resolution of 400 dpi, and an image that can be displayed in A3 size has an information amount of about 150 MB. It is very inefficient to transmit this as it is or to store it in a storage device or the like. Therefore,
Usually, various compression methods are used to reduce the size before transmitting or storing. Commonly used methods include JPEG and MPEG. As shown in FIG. 19 (c), in these compressions, the original image data is usually stored in an image state as shown in a data string 52. , It is not easy to get the whole picture.

Therefore, it is necessary to decompress once from the compressed state to return to the original image data state and then create and obtain necessary image portions and thumbnails. The image compression format used here is not such, and FIG.
As shown in (d), the compression results in a configuration such as 60 to 63. That is, in the transmission image data sequence according to the present invention, first, the type of the size color information of the original image, the quality of the image to be held, the position information in the image, and the like are stored in the header 60. Next, the schematic image data 61
Stores an entire image (thumbnail) of a certain scale, and if it is desired to view the entire image, only this part needs to be read and decompressed. What comes next is slightly high-quality image data 62, the amount of information of which is considerably increased from the image data 61. By reading the images 61 and 62, a somewhat high-quality image can be read. Similarly, difference data as high-quality images are arranged, and sufficient image quality can be determined by reading up to the final high-quality image data 63. By cutting the high image quality side, compression giving priority to size over image quality is also possible. Further, in each image quality data, as shown in FIG. 19 (e), the original image is held in a state of being divided into blocks, so that the position information is also skipped for each quality level at which the header is read and written. As a result, a part of the original image can be extracted and decompressed and displayed. It should be noted that the present invention is not limited to the compression format as shown in the figure, but can be applied to any format in which the quality and area can be similarly extracted.

In the first embodiment, (1) the receiving side can preferentially obtain the rough image information based on the contents of transmission from the transmitting side, so that it is possible to efficiently grasp the whole situation, If the quality of the rough image is not satisfactory, it is possible to browse the original image without deteriorating the quality by taking sufficient time. The timing for issuing these requests is not limited, and the user can issue an instruction to the host at an arbitrary time. Also, (2) the receiving side can display the desired image information preferentially by specifying the image quality, area, and order, so that the user can efficiently browse the desired image. Also, (3) the transmitting side:
Since the change of the transmission state is notified to the receiving side and the subsequent processing is selected, the receiving side can request the amount of image information suitable for the transmission state, to grasp the entire image as soon as possible, and to want to see the earliest Partial information can be received preferentially. (4) The receiving side can specify the desired image quality, image area, and display order at any time.
Even if the priority request of the user changes, it becomes possible to respond to it. Further, (5) the transmitting side can set the processing contents corresponding to the change in advance, even if the transmitting state is not specified by the state of the receiving side with respect to the change in the transmission state.
The user can perform optimal information acquisition without the trouble of the user designating the processing content each time it changes.

Hereinafter, a second embodiment of the present invention will be described. In the second embodiment, a method of displaying an image at an arbitrary communication time or image quality or a method of performing image processing under the control of the receiving side will be described. FIG. 20 is an overall view of a communication system according to the second embodiment. A server 72 via a network 70 such as a LAN or a public line.
And the client 71 are connected. Server 72
And one client 71, respectively, but a plurality of them are connected.

FIG. 21 is a diagram showing the data structure of an image received by the receiving side, that is, the client. When receiving the image, the receiving side follows the header 60, the coarse image 61, and the high quality image data (1) according to the transfer image data structure shown in FIG.
62a, the image quality improvement data (2) 62b,..., The image quality improvement data (n) 63 are sequentially received in time series, the image is reproduced in the image display processing section, and is sequentially displayed on the display means. As is clear from FIG. 21, the data structure of the image received on the receiving side is the same as the data structure of the image transmitted from the transmitting side, as shown in FIG. The only difference is the difference between the structure viewed from the transmitting side and the structure viewed from the receiving side. In the data of the header 60, the size of the format of the transfer image data structure, the image size, the format of the compression, and the like are stored. A layout frame can be displayed. Subsequently, the coarse image data 61 received displays a coarse image of a line drawing level as shown in FIG. 23B, for example. Thinning can be obtained, for example, by expanding image information obtained by filtering and extracting only high-frequency components.

FIG. 22 is a block diagram showing an example of the terminal device on the receiving side. The receiving terminal device includes a control unit 81 (for example, a central processing unit) that performs various operations, an I / F (interface device) 82 that connects to an external device such as a communication unit, and a LAN and a public line. Communication means 83 for performing data transfer by using an image display processing unit 84 capable of creating a data structure as shown in FIG. 21, a monitoring unit 85 for monitoring a traffic state, and a U / I such as a keyboard and a mouse. (User interface device) 86, display means 87 for displaying an image, storage medium 88 for storing data (for example, HDD), and program storage means 89 for storing a program (for example, ROM). I have. The storage medium 88 also stores a criterion map 90 in which conditions such as a traffic state described later are defined. On the other hand, the transmitting side device is not shown, but includes at least 81 to 84 and 88 devices.

FIG. 23 is a diagram of an image obtained by sequentially receiving the image data structure shown in FIG. In the data structure of FIG. 21, when the header 60 is first received, only text data such as a format size, an image size, and a compression format is used. Therefore, no image is displayed as shown in FIG. Not done. Next, when the coarse data 61 is received, a coarse image at the line drawing level as shown in FIG. 23B is displayed. Next, the high quality image data (1) 62a
23, an image level in which a light color is added to the line drawing as shown in FIG. 23C is displayed. Similarly, FIGS. 23 (d), (e), and (f) are display images at the time when the image quality improvement data (2), (3), and (n) are received, respectively. In particular, FIG. 23F shows a high-definition display image obtained by receiving all the image data.

FIG. 24 is a state transition diagram of this embodiment.
In this embodiment, the operation is performed in three states, State 1, State 2, and State 3. The transition from the state 1 to the state 2 is performed when the condition A12 is satisfied, and the transition from the state 2 to the state 3 is performed when the condition A23 is satisfied. Hereinafter, similarly, when the condition B32 and the condition B21 are satisfied, a transition from the state 3 to the state 2 and a transition from the state 2 to the state 1 are respectively performed.

FIG. 25 is a configuration diagram of the criteria map. The criterion map is a table in which the operation of the state, that is, the quality of the received image and the condition of the state transition are set. This criterion map indicates that the image data is received in the state 1 so as to satisfy the image quality Q1. Further, the image quality to be received in that state is described, which indicates that it is Q1. Where Q
Although 1 is shown as 1/5, this numerical value indicates the coarsest image quality. For example, in the transfer image data structure shown in FIG. 21, the header 60 and the first received coarse image data 61 indicate the quality of the reproduced image.
The maximum high-definition image quality obtained by receiving all image data is 5/5, and the middle is 2/5 to 4/5. In the state 1, when the image quality Q1 is reached, further image reception for that image is stopped, and the process proceeds to the next image reception. The monitoring unit monitors the traffic state, and transitions to state 2 when the condition of A12 is reached. The condition A12 indicates an average data transfer throughput observed during a predetermined time, and in this embodiment, indicates that a transition to the state 2 is performed when the data transfer throughput is greater than 3,000 bps. State 2 indicates that reception is performed with image quality of Q2, transition condition A23 to state 3 is greater than 10,000 bps, and transition condition B21 to state 1 is less than 1500 bps. However, it shows that the received image quality in state 2 can be appropriately changed by providing a learning function. State 3 indicates that reception is performed with the image quality of Q3, and state 2
Indicates that the transition condition B32 to is smaller than 6,000 bps.

Explaining the learning function, the criterion map in FIG. 25 is set so that the value of the received image quality Q2 in the state 2 changes with the state transition.
When the state transits from the state 2 to the state 1, the value is lowered by one step in the range of possible values of Q2 (2/5 to 4/5), and the state 2
Similarly, when the state transits from state 3 to state 3, the value of Q2 is increased by one stage. By taking such measures, in the case where the state 1 and the state 2 are repeatedly changed, the value of Q2 approaches 2/5, and in the case where the state 2 and the state 3 are repeatedly changed, The value of Q2 approaches 4/5, indicating that when traffic conditions are bad, priority is given to reception with coarse image quality, and when traffic conditions are good, priority is given to reception with relatively high image quality. I have. In the present embodiment, for example, transition conditions A12 and B2 between state 1 and state 2
Although 1 has a different value, this is an embodiment in which the transition condition has hysteresis. Of course, a value without hysteresis may be set.

FIGS. 26 to 28 are operation flowcharts of the transmitting side, the receiving side, and the monitoring unit in the present embodiment.
In FIG. 26, the transmitting side transmits image information to be transferred,
It is created with the data structure shown in FIG. 21 (step 26-
1). Next, after the line connection (step 26-2), if there is a data transmission request from the receiving side (step 26-).
3) Transmit the image information (step 26-4). During the transmission, at a certain timing or according to a protocol procedure, transmission interruption, disconnection, and other processing requests from the receiving side are accepted (step 26-5). In response to a request to stop sending image data from the receiving side, the transmission of the image is stopped (step 26-6), and the process proceeds to the next image transmission or the next process. The connection is disconnected in response to a request for disconnection from the receiving side (step 26-7).

In FIG. 27, the receiving side sets the criterion map to a default value or a previous value (step 27-1). If necessary, the receiving operator resets the criteria map (step 2
7-2). Next, the line is connected (step 27-).
3) A data transmission request is issued to the transmission side, and reception of data including an image is started (step 27-4). The minimum data required for an image profile, image display, etc., is received (step 27-5). It is determined whether or not a predetermined image quality such as a maximum received image size, a maximum communication time, and a resolution in the current state set in the criterion map has been reached (step 27-6). Is stopped, the image of the quality obtained by the image processing is stored or displayed, and the transmission side is requested to stop the data transmission of the image (step 27-7). Then, the processing shifts to the next processing such as making a data transmission request for the next image (step 27-8). When the monitoring unit that monitors the traffic state notifies the control unit that a transition condition from the current state to another state has occurred (step 27-).
9), the maximum received image size to be received in the state after the transition,
The conditions of the predetermined image quality such as the maximum communication time and resolution are reset automatically or manually according to a criteria map or the like, or by a learning function (step 27-10). Subsequently, the reception of the image is continued according to the criteria map (step 27-11), and finally the line is disconnected (step 27-12).

Next, in FIG. 28, the monitoring unit monitors traffic conditions such as data transfer speed (step 28-).
1) Check with the criteria map (Step 2)
8-2) When the condition for transition from the current state to another state is reached according to the criteria map, the content is notified to the receiving side control unit (step 28-3).

Next, a third embodiment of the present invention will be described. By converting the processing operations of the first embodiment and the second embodiment described above into programs and storing those programs in a storage medium, by bringing the storage medium, it is possible to change the processing operation to an arbitrary place and time. The present invention can be applied to a communication system.

In the second embodiment, (1) when data having a large amount of information such as an image is transferred, the coarse image is sequentially transferred in time series, so that the receiving side reproduces and displays the outline of the image. The image data required to perform this can be part of the whole. As a result, when an image is processed or displayed with a low image quality enough to give an overview, the amount of image information to be received can be reduced, so that the image can be easily received even when the traffic condition is poor.
(2) When a large image is received, if the traffic condition is poor, the connection is cut off halfway, and the received image data displays part of the entire image or cannot be displayed. In this embodiment, it is possible to reduce such a time and cost loss. Also, (3)
To transmit images from low to high definition in chronological order,
There is no need to prepare multiple images with different image qualities on the sending side to receive the desired image quality, and after receiving an image with the required accuracy, the receiving side interrupts the reception of that image and Processing or a request to receive the next image, no special protocol is required between the sender and the receiver. Further, since the required image quality can be selected arbitrarily or according to the traffic condition on the receiving side without inquiring the transmitting side, the load on the transmitting side can be reduced, and there is room for selecting functions on the receiving side, The degree of freedom can be increased. Further, (4) the traffic condition is monitored, and when the traffic condition is poor in accordance with a predetermined standard, the reception condition is set to a low image quality when the traffic condition is restored, and when the traffic condition is restored, the reception condition is set to the high definition image quality. Since the operation is performed so as to make a transition, it is possible to perform image reception within a predetermined communication time although the image quality per image is different. Since a predetermined reference (that is, a criterion) for performing transition of the reception state can be provided with a learning function, optimization can be performed according to the state of the network or the like.

[0040]

As described above, according to the present invention,
The user's request to give priority to display time and display in a short time even if the quality is low is the same as the user's request to give priority to image quality and display in high quality even if it takes a little time. Can be satisfied by the same processing method as that of the image data described above, and in the same image, a necessary area can be efficiently displayed on the screen for each request of the transmission destination or the transmission source. Also, when the traffic condition is poor, the image data necessary to process or display the image with a low image quality enough to give an overview of the image on the receiving side can be partially used, and the amount of image information to be received can be reduced. If the traffic condition is poor and a large image is to be received, re-reception is performed from the beginning, so that time and cost loss can be reduced. Also, there is no need to prepare multiple images with different image quality on the transmitting side,
Also, no special protocol is required between the sender and the receiver, and the required image quality can be selected arbitrarily or according to the traffic condition without inquiring the sender about the required image quality. It is possible to increase the room and freedom of function selection on the side, and also to monitor the traffic status, switch to the image reception quality depending on the traffic status, and use the criteria for performing the transition of the reception status. Can have a learning function.

[Brief description of the drawings]

FIG. 1 is an overall configuration diagram of a communication system according to a first embodiment of the present invention.

FIG. 2 is a specific configuration diagram of each device in FIG.

FIG. 3 is a diagram illustrating a state where information such as image data is being viewed on a receiving side.

FIG. 4 is a reference operation flowchart on the transmission side according to the first embodiment;

FIG. 5 is a flowchart of a subroutine for monitoring a transmission state.

FIG. 6 is an operation flowchart for temporarily suspending transmission.

FIG. 7 is a processing flowchart when image quality is designated by a receiving side.

FIG. 8 is a processing flowchart when a new image area is set.

FIG. 9 is a processing flowchart when a new display order is set.

FIG. 10 is a processing flowchart in the case of performing an interruption process.

FIG. 11 is an operation flowchart illustrating a reference process on the receiving side.

FIG. 12 is an operation flowchart for transmitting default image quality, display area, and display order in setting information transmission processing.

FIG. 13 is a flowchart illustrating main processing of a user operation.

FIG. 14 is a processing flowchart when a transmission interruption notification is received from the host.

FIG. 15 is an operation flowchart when a cancel processing request is issued by a user.

FIG. 16 is a processing flowchart in the case where an instruction for a display area is issued by a user.

FIG. 17 is a processing flowchart when a display order is instructed by a user.

FIG. 18 is a processing flowchart when an instruction for image quality is issued by a user.

FIG. 19 is an explanatory diagram of a data compression format used in the first embodiment.

FIG. 20 is an overall configuration diagram of a communication system according to a second embodiment.

FIG. 21 is a data structure diagram of image data received in the second embodiment.

FIG. 22 is a block diagram of a receiving-side terminal device.

FIG. 23 is an explanatory diagram of a case where images having the data structure of FIG. 21 are sequentially received and displayed.

FIG. 24 is a state transition diagram of the present embodiment.

FIG. 25 is a diagram showing a criterion map of the present embodiment.

FIG. 26 is a flowchart of a reference operation on the transmission side according to the second embodiment.

FIG. 27 is a flowchart of a reference operation on the receiving side.

FIG. 28 is an operation flowchart of the monitoring unit.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Server system, 2 ... Modem, 3-5 ... Client system, 6 ... Network, 11 ... CPU, 12
... Memory, 13 ... HDD, 14 ... I / F, 30 ... Browser, 31 ... Display order setting screen, 32 ... Image quality setting screen, 33 ... Pointer, 34 ... Image, 50 ... Original image, 51 ... Enlarged Appearance, 52: data string, 60: header, 61: schematic image data, 62: somewhat high quality image data, 63: final high quality image data, 64: block indicating the position of image data, 71: client, 70 ...
Network, 72: server, 81: control unit, 82: I
/ F, 83 communication means, 84 image display processing section, 85
Monitoring unit, 86: U / I, 87: display means, 88: storage medium, 89: program storage means, 90: criteria map.

 ──────────────────────────────────────────────────の Continued on front page (72) Inventor Hiroshi Nakamura 3-12-1 Kachidoki, Chuo-ku, Tokyo Forefront Tower Ricoh System Development Co., Ltd.

Claims (12)

[Claims] 1. An image transfer method in which image data is transmitted online from a transmission side to a reception side, wherein the transmission side extracts a plurality of types of data amounts to be held at an arbitrary timing and an arbitrary area. First, a low-quality image with a limited data amount is extracted from the image data compressed in the image compression format capable of being converted, the image is converted into a compression format that can be decompressed on the receiving side, and the position information of the image and The image is transmitted to the receiving side together with the display timing information including the display order, and then information for displaying a higher quality image is transmitted. Similarly, a larger amount of data is sequentially required. An image transfer method characterized by transmitting various image data. 2. When transmitting image data, the transmitting side inquires of a receiving side about display quality, a display area, and a display order, and obtains information from the receiving side, and then compresses in the compression format. Take out the image to be displayed from the image data
2. The image transfer method according to claim 1, wherein the image is transmitted to the receiving side. 3. The transmission side monitors the transmission status of the image data when transmitting the image data, and temporarily suspends the transmission of the image data when a delay of a predetermined time or more occurs. 2. The image according to claim 1, further comprising: inquiring a next process to a receiving side, waiting for a process designation from the receiving side, resetting the quality and area of the image data, and then starting transmission. Transfer method. 4. An image to be displayed from image data compressed in the compression format, if the transmitting side obtains the information before inquiring information on display quality, display area, and display order from the receiving side. 3. The image transfer method according to claim 2, wherein the image transfer is started and transmission is started. 5. The transmission side monitors a transmission state of the image data when transmitting the image data, and temporarily suspends the transmission of the image data when a delay of a predetermined time or more occurs. Regardless of the transmission status of the image data, inquire the next process in advance to the receiving side, and if there is no process specification from the receiving side during the interruption,
4. The image transfer method according to claim 3, wherein the transmission is started after resetting the quality and area of the image data specified in advance. 6. Compressed or uncompressed image data having a data structure that sequentially increases in resolution from coarse quality or low image quality in which an outline of an image is understood, and performs transfer capable of displaying the entire image even during reception. In the image transfer method, the receiving side monitors the traffic condition, and if the traffic condition is poor, performs only the data reception necessary for image processing with coarse image quality and shifts to the next image reception. An image transfer method characterized by automatically or manually switching according to traffic conditions so as to receive data required for high-definition image processing when the traffic condition is good or when the traffic condition is restored to a good condition. 7. The image transfer method according to claim 6, wherein the receiving side sets a desired image quality in a plurality of stages according to a traffic condition. 8. The image transfer method according to claim 6, wherein the receiving side has hysteresis in a condition such as a traffic state for switching image quality to be received. 9. The image processing apparatus according to claim 6, wherein the receiving side has a learning function for conditions such as a traffic state for switching image quality to be received or image quality.
Or the image transfer method according to 8. 10. The image transfer method according to claim 6, wherein the receiving side is capable of changing a desired image quality. 11. The receiving side automatically re-receives image information received at a low image quality when traffic conditions are poor, using the idle time of processing until the image quality desired by the receiving side is reached. Claim 6 to continue
10. The image transfer method according to any one of 10 above. 12. A program storage medium, wherein each processing according to claim 1 is converted into a program, and the program is stored in a storage medium.