JP2006217654A - Image transfer method and program storage recording medium therefor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce an amount of information to be received and to reduce loss in terms of time and cost by processing or displaying an image with low image quality by which an outline of the image is learned on the receiving side when a traffic state is poor and to further reduce a load on the transmitting side by optionally selecting necessary image quality on the receiving side without inquiring the transmitting side. <P>SOLUTION: In image transfer of compressed or non-compressed image data of data structure in which quality sequentially becomes from rough quality by which the outline of the image is learned to high definition, the receiving side monitors a traffic state (S27-9), automatically or manually switches images according to traffic state (S27-10) so that only data reception required for image processing at the rough image quality is performed when the traffic state is poor (S27-5) and data required for high definition image processing is received when the traffic state is successful or recovered to a successful state (S27-6). <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image transfer method capable of efficiently transmitting / receiving image data in response to an image display request from a remote place under the control of a transmitting side or a receiving side, and displaying a screen with desired quality, display time, etc. The present invention relates to a recording medium storing a program.

In the Internet, information is centrally managed by a Web server, and information is browsed from Web browsers mounted on an unspecified number of terminals. In this case, a method for monitoring and controlling devices on the network using a browser is required. There is also a need for a method that allows an unspecified number of people to view images at remote locations with the desired quality and display time.
However, when displaying an image using a browser on the Internet, due to the performance of the display side and restrictions on the transmission path such as the public line, when displaying a high-quality image, it takes a long time to send all the data. There was sometimes waiting.
Due to these limitations, attempts have been made to reduce the amount of data to be transmitted, that is, to reduce the image quality for transmission, but this causes dissatisfaction for users who desire high-quality images. End up.

On the receiving side, all the image data set on the transmitting side is generally received and then processed and displayed on the screen. Therefore, when the traffic condition is poor or the performance of communication means such as a modem is low Takes time to display the necessary images. In particular, when there are a large number of images, the receiver may have to wait for a long time before obtaining the necessary images, and the line is often required to be disconnected. In order to obtain an image desired by the receiving side as soon as possible, the receiving side must negotiate with the transmitting side in advance before selecting an image.
On the other hand, when the traffic state is bad, there is a method of switching and transferring to an image with a low image quality or an image with a small size, but the transmission side must hold a plurality of pieces of image information with different image quality and size, Further, when switching images, a protocol is required with the receiver side.

In this way, (1) a user who wants to display in a short time even if the quality is poor with priority on display time, and that he wants to display it with high quality even if it takes a little time with priority on image quality. Since the user exists at the same time, it was impossible to efficiently transmit and display it for each user's request.
(2) When transferring a large amount of data such as an image, if the traffic condition is bad, the transfer takes time, so the transfer cost increases for both the receiver and the sender and receiver, and a data error occurs. It becomes easier and affects the quality of the received image. In such a case, the connection may be interrupted during reception. In this case, the image is not reproduced, or only a part of the entire image is displayed, and a method of displaying an outline of the whole is not possible.
(3) Since the receiving side needs to receive all the image data prepared on the transmission side regardless of whether the traffic condition is good or bad, the quality and resolution of the image is reduced on the receiving side when the traffic is bad. A method of receiving and requesting the next image reception is not possible.

In addition, (4) image quality such as accuracy and resolution desired by the receiving side needs to be negotiated with the sender. Conventionally, when receiving an image having a quality lower than the image quality set by the transmitting side Even so, this could not be easily changed.
In addition, (5) when the traffic state is bad, there is a method of switching and transferring to an image having a low image quality or an image having a small size. For this purpose, a plurality of pieces of image information having different quality and size are transmitted on the transmission side. In addition, a protocol with the receiver side is required when switching images.
Furthermore, (6) when the transfer time set by the receiver or the reception data size is reached, if the reception of the image is terminated, the image is not reproduced or only a part of the entire image is displayed. There is no way to display the whole image with a reduced resolution. In order to make it possible, it is necessary to reconvert the image to be transferred to the sender side, which is troublesome.

(the purpose)
Therefore, the first object of the present invention is to solve these conventional problems and give priority to the user's request to display in a short time even if the quality is poor by giving priority to the display time, and a little by giving priority to the image quality. An object of the present invention is to provide an image transfer method capable of satisfying a user's request to display with high quality even if time is required by the same processing method as the same image data and its recording medium.
A second object of the present invention is to provide an image transfer method capable of efficiently displaying a necessary area for each desired destination or source in the same image.
A third object of the present invention is to complete a part of the image data necessary for processing or displaying an image with low image quality so that an outline of the image can be understood on the receiving side when the traffic condition is bad. Thus, an object of the present invention is to provide an image transfer method and recording medium that can reduce the amount of image information to be received.

The fourth object of the present invention is to perform image transfer that can reduce time and cost loss by performing re-reception from the beginning when a large image is received when the traffic condition is bad. It is to provide a method.
The fifth object of the present invention is that it is not necessary to prepare a plurality of images with different image quality on the transmission side, no special protocol is required between the sender and the receiver, and the transmission side is inquired about the required image quality. To provide an image transfer method that can be selected arbitrarily on the receiving side or according to the traffic state, and can reduce the load on the transmitting side and increase the scope and freedom of function selection on the receiving side. It is in.
Furthermore, the sixth object of the present invention is to monitor the traffic state, switch to the image reception image quality depending on the traffic state, and provide a learning function as a reference for performing the transition of the reception state. It is to provide a possible image transfer method.

In order to achieve the above object, in the image transfer method of the present invention, (1) the receiving side receives compressed or non-compressed image data having a data structure that sequentially becomes high definition from coarse quality or low image quality, and is receiving The entire image can be displayed with and the traffic condition is monitored at the time of reception. If the traffic condition is poor, only the data necessary for image processing with coarse image quality is received, and the next image is received sequentially. When the traffic state is good or the good state is restored, the automatic or manual switching is performed so as to receive data necessary for high-definition image processing.
(2) The receiving side sets a plurality of levels of image quality desired by the receiving side according to the traffic state.
(3) The receiving side has a hysteresis in conditions such as a traffic state for switching the image quality to compete.
(4) The receiving side has a learning function for conditions such as a traffic state and / or image quality for switching received image quality.
(5) The receiving side can change the image quality desired by the receiving side during the transfer of the image data.
(6) The reception side automatically re-receives image information received with low image quality when the traffic state is bad, using the idle time of processing on the reception side until the reception side reaches the desired image quality. continue.

According to the present invention, there is a request from a user who wants to display in a short time even if the quality is poor by giving priority to the display time, and a use that wants to display high quality even if it takes a little time to give priority to the image quality. It is possible to satisfy the user's request with the same image data and the same processing method, and in the same image, it is possible to efficiently display the necessary area for each destination or source request on the screen. .
Also, if the traffic condition is bad, the image data necessary to process or display the image with low image quality that can be understood on the receiving side can be part of the entire image, and the amount of image information to be received can be reduced. If it can be reduced and the traffic condition is bad, when receiving a large image, it is possible to reduce the time and cost loss by performing re-reception from the beginning.

In addition, it is not necessary to prepare multiple images with different image quality on the transmission side, no special protocol is required between the sender and the receiver, and any or all on the reception side without inquiring the required image quality to the transmission side. It can be selected according to traffic conditions, reducing the load on the sender and increasing the scope and freedom of function selection on the receiving side. It is possible to switch to the image quality of the image, and it is possible to provide a learning function as a reference for performing the transition of the reception state.

Hereinafter, the operation principle and embodiments of the present invention will be described in detail with reference to the drawings.
(First embodiment)
(1) On the transmission side, an image is compressed in an image compression format that allows extraction of a plurality of types of data amounts at an arbitrary timing and an arbitrary area.
-Wait for an image transmission request from the receiving side.
When an image transmission request is received, the receiver is inquired about the image quality, the display area in the image, and the display order.
-Also inquire about the processing after the temporary suspension processing due to the deterioration of the line status.
At the time of transmission, first, data necessary for displaying an image having the lowest quality level determined by the system (the least amount of data is required) is extracted from the compressed image data and transmitted.
Next, when the transmission of the image data of the quality level and the area is completed, the data necessary for displaying the image of the second lowest quality level or the next area is transmitted.

・ Hereafter, data necessary to display a slightly high-definition quality level image is transmitted.
-Monitor the amount of data being transmitted.
When a reply to the inquiry about the image quality, the image area, and the display order is received, the current transmission data is viewed. If not finished, continue sending until sending is finished.
・ Transmit is temporarily suspended when the amount of transmission data per fixed time becomes less than the threshold value.
・ During suspension, it sends a message to the receiving side that it is stopped. There are three types of cancellation of the stop state, and these change the process by inquiring to the receiving side and replying. If instructed in advance, follow the instruction.
(A) Stop (cancel) processing by the receiving side.
(B) Specify the quality, position, and order of transmission data and continue.
(C) When it becomes possible to transmit a data amount equal to or higher than the threshold level due to the improvement of the transmission state, the processing is resumed. Until then, the suspended state continues.
-When the type and position information of the transmission data is obtained from the receiving side, transmission is resumed and given priority to the specified data.

(2) On the receiving side: • Connect to the host system (transmitting side) using a browser.
-The function on the browser side (support of the compression format used in the present invention, performance of the client machine, browser type, etc.) is sent to the transmission side to ensure a communicable state.
When the browser is set to transmit the setting state in advance, the default image quality, image display area, and display order are transmitted.
-Send an image transmission request to the connected sender.
-Expand and display the sent image at the specified location.
・ While receiving image data and displaying it on the display, it waits for user operations and input.
-When the user issues a cancel request, an image transmission stop request is sent to the transmission side.
-If the user designates a display area, and if it is different from the currently displayed area, a request to stop sending the image currently being sent is sent to the sending side, and the image of the area designated by the new user Send a request to send.
-When the user changes the display order while the display order is specified, a display order change request is issued to the transmission side.
When the transmission side notifies the transmission of the temporary suspension, when the subsequent processing is not transmitted, the transmission is interrupted as it is, or the image quality, the image area, the display order are communicated, and the transmission is waited until the transmission is resumed.
When transmission is resumed, it is confirmed whether or not the previous image data has been canceled, and the reception process is resumed.

(Second embodiment)
(1) On the transmission side, the image information to be transferred is generated as compressed or uncompressed image data having a data structure that sequentially becomes high definition from coarse quality or low image quality.
-After connecting to the line, send image information in response to a data transmission request from the receiving side. During transmission, interrupt the transmission from the receiving side during a certain timing or protocol procedure (skip), disconnect the connection, and other processing requests. Accept.
-In response to a request to stop transmission of image data from the receiving side, the transmission of the image is stopped, and the process proceeds to the next image transmission or the next process.
-The connection is disconnected by a connection disconnection request from the receiving side.

(2) On the receiving side, one state that defines reception conditions for image data such as the quality of the image to be received and the maximum communication time per image, and one or more other states in which reception is performed under other conditions A criterion map in which conditions such as a traffic state for transitioning from one state to another state are determined is set as a default value or a previous value.
・ If necessary, the receiving operator resets the criteria map.
-Send a data transmission request to the transmission side and start receiving data including an image.
・ Receive the minimum data required for image profile and image display.
・ Images of the quality obtained by discontinuing reception of the image and performing image processing when the maximum received image size, maximum communication time, resolution, etc. in the current state set in the criteria map have been reached. Is stored or displayed, and the transmission side is requested to cancel the data transmission of the image, and the next image data transmission request is made.

The monitoring unit that monitors the traffic state notifies the control unit that a transition condition from the current state to another state has occurred.
-The criteria map conditions are reset automatically or manually according to the criteria map or the like, or by the learning function for the predetermined image quality such as the maximum received image size, the maximum reception time, and the resolution to be received in the state after the transition.
-Continue to receive images according to the criteria map, and finally disconnect the line.
(3) The monitoring unit monitors the traffic conditions such as the data transfer rate, and notifies the receiving side control unit of the contents when a condition for transition from the current state to another state is reached by the criteria map. To do.

FIG. 1 is a schematic configuration diagram of the entire system showing a first embodiment of the present invention.
This system includes a server system 1 capable of supplying digital information such as images on a global network system, and a client system capable of receiving the supplied information by selecting only necessary information via the network 6. 3, 4 and 5. The first embodiment is a method of transmitting an image corresponding to each request on the receiving side under the control of the transmitting side of the server 1 or the like. This method performs processing in the server 1 and the client systems 3 to 5. It is installed as software.

FIG. 2 is a specific configuration diagram in FIG.
If the PC (personal computer) 1 is on the server 1 side, a central processing unit 11 capable of compressing and decompressing image data and a memory of a high-speed storage medium capable of temporarily holding data necessary for the operation 12, an I / O capable of communication and data transmission / reception between an external device and a so-called HDD (hard disk device) 13 which is an external storage medium for holding image data and data to be stored for a long period of time. F (interface device) 14. However, these are not particularly necessary on the client system side. On the other hand, a modem 2 for connecting to a transmission path 6 such as a LAN or a public line is connected to the I / F 14 in accordance with compatible hardware and protocols. This enables communication with external devices and transmission / reception of data in order to connect individual devices. Similarly, a plurality of other PCs (clients) 3 to 5 are connected on the public line 6 and exchange information with each other as necessary.

FIG. 3 is a diagram illustrating a state in which information such as transmitted image data is viewed on the receiving side (client).
FIG. 3A is a diagram when the image quality is designated on the browser side, and FIG. 3B is a diagram when the display area is designated on the browser side.
A so-called browser 30, which is a browsing software widely used on the Internet by making a connection with the server and issuing a request for information transmission, is displayed, and the images “image1” to “image3” sent on the screen. Is displayed.
Of course, although not shown in the figure, not only images but also information such as texts and sounds are sent and displayed on the screen or simultaneously reproduced. Here, when the display order setting screen 31 is opened, the display order determined on the transmission side (server or host) is displayed, and the currently displayed image or the like can be known. In this state, for example, when an arbitrary image is selected by a pointer 33 such as a mouse and a position on the list of display images is changed by performing a so-called drag & drop operation, the information is sent to the transmission side.

Further, the image setting screen 32 can be opened for each selected image. On the image setting screen 32, for each image, a plurality of image qualities can be selected and the default setting of the display area can be changed.
It is also possible to specify a display area by directly specifying an image.
Similarly, as shown in FIG. 3B, when a specific area of the image 34 displayed on the browser screen 30 is clicked with the mouse pointer 33, the area is usually divided into about four divisions, and the area including the designated point is displayed. The image is displayed with the highest priority in the image, and the image quality is improved. The division position and the number are not limited and are determined in consideration of the compression rate on the host side. Since image quality is designated for each image, display processing is performed until the designated image quality is achieved.

4 to 18 are flowcharts showing processing on the transmission side (server or host) and reception side (client). FIGS. 4 to 10 are processing on the transmission side, and FIGS. Side processing.
In FIG. 4, the data compression is described below, which is first initialized and operable (step 4-1), and can be extracted by limiting a plurality of types of data amounts to arbitrary timings and arbitrary regions. The image is compressed in the format (step 4-2). Next, it waits for an image transmission request from the receiving side (step 4-3). When an image transmission request is received from an unspecified client connected to the network, information about the image to be transmitted is sent, and the image quality, display area, and display order for each image are inquired to the transmission request source (step 4-). 4). The result is subsequently used as a default process. At the same time, an inquiry is made as to how to perform the processing after the transmission suspension processing (step 4-5).

  Next, the required required image data is taken out from the storage device, and if the receiving side supports the compression format, the image for the image quality with the smallest amount of data in a decompressable format is supported if it is not supported. Data is recompressed and transmission is started (step 4-6). Thereafter, while monitoring the transmission state in a subroutine (step 4-7), the transmission is continued while checking whether the image transmission is completed (step 4-8). When the transmission of one image is completed, the next transmission data is prepared (step 4-9). It is checked whether or not the transmission for one page has been completed (step 4-10). If the transmission has not been completed, the transmission of the image data is continued repeatedly (return to step 4-6). When one page is finished, the transmission data for the next page is similarly prepared (step 4-11), and it is confirmed whether or not all the data transmissions to be transmitted have been completed (step 4-12). Then, it waits until the next image transmission request is received (step 4-3).

FIG. 5 is a diagram showing a subroutine for monitoring the transmission state.
When a large amount of data such as image data is transmitted, depending on the state of the line, the transmission rate may be extremely reduced, and it may take a very long time to finish transmitting one image data. Therefore, the state on the transmission path is constantly monitored, and if the value falls below the threshold value, transmission is interrupted once and the instruction on the receiving side is suppressed. The monitoring method may look at the rate of the flow state or look at the elapsed time until the response to the inquiry.
First, it is checked whether or not the transmission state is below a threshold value (step 5-1).
Next, it is checked whether image quality is designated from the receiving side (step 5-2). Similarly, it is checked whether or not the display area has been designated (step 5-3) and whether or not the display order has been designated (step 5-4). Further, it is also checked whether or not a transmission interruption request has been sent for the convenience of the receiving side (step 5-5). Such monitoring and checking are taken out first and are continuously performed until the transmission of the data which has been started is completed (step 5-6).

FIG. 6 is a diagram of processing when the transmission state becomes equal to or less than the threshold value as a result of monitoring the transmission state.
First, transmission is temporarily interrupted (step 6-1). Next, the receiving side is notified that transmission is currently interrupted (step 6-2). Then, it waits for the image quality designation, display area designation, and display order designation from the receiving side (steps 6-3, 6-4, 6-5). It is also checked whether or not an interruption request has been received from the receiving side (step 6-6). These processes are continued until the transmission state is restored to the threshold value or more again (step 6-7).

FIG. 7 is a diagram of processing when image quality is designated from the receiving side.
If it is the same as the default or currently designated image quality, the process returns to the monitoring of the transmission state (step 7-1). (To (step 5-1 of FIG. 5 via (6))).
If the image quality is different from the designated image quality, the image quality is newly reset and transmission of the next data is started (step 7-2).
Usually, transmission is started from data having the lowest image quality, for example, a thumbnail image, and the original compressed image data is sequentially extracted and transmitted until the designated image quality is obtained. If the designated quality is higher than the currently transmitted quality, the transmission is continued. If the designated quality is lower, the transmission is terminated and the next image is transmitted.

8 and 9 are diagrams of processing for setting a new image area and a display order, respectively.
If the next designation is acceptable in the current designated area (step 8-1), the process branches to step 5-1 in FIG. 5 via (6). Set (step 8-2). In the designation of the image area, the highest priority is given to the designated area reaching the previously designated image quality in the transmission of the image data.
In the display order, images that have already been sent are not newly sent regardless of the order. The designated display order is applied to an image that has not yet been sent (step 9-1). If the current order is specified, the process branches to step 5-1 in FIG. 5 via (6) (step 9-2).

FIG. 10 is a diagram of processing when an interruption request is received from the reception side.
The transmission of the image currently being transmitted is stopped, and a flag indicating that transmission is in progress is set (step 10-1). Then, it waits for a new transmission request. When the transmission request is a corresponding image, it is possible to resume from the interrupted state.

11 to 18 are diagrams showing processing on the reception side.
In FIG. 11, first, initialization on the receiving side is performed (step 11-1), and the process waits until a connection request operation from the user is performed. When a connection request operation is performed (step 11-2), connection processing to a designated host is performed (step 11-3). Although a connection method is not shown, it is performed by a conventional method. When the connection process is completed, information to be notified to the host is transmitted (step 11-4). This includes, for example, the hardware configuration and performance of the client, the support of the compression format, the type of browser for browsing, and the like. Next, if setting information for display is to be sent, it is sent (step 11-5). This is not essential and is determined by browser settings.

  Thereafter, an image transmission request is issued by a user operation or a browser default setting (step 11-6). Since the requested image is transmitted from the host, the received image is received and displayed in a designated place (step 11-7). Simultaneously with the reception process and the image display process, a user operation is also accepted (step 11-8). In addition to information such as images, information necessary for control is also sent from the host, so it is checked whether or not there is a notification of transmission interruption (step 11-9). If there is a communication interruption, the process branches to FIG. If not, it is checked whether or not all the requested information has been received (step 11-10). If all the information has not been received yet, the process returns to the process of displaying the transmitted data (step 11-7). ). If completed, it is checked whether a communication termination request is issued from the user, and if it is issued, the process returns to step 11-2. If not, the process returns to step 11-4.

FIG. 12 is a diagram showing a process of sending the setting information and sending the default image quality, display area, and display order.
First, the default image quality is transmitted (step 12-1), then the default display area is transmitted (step 12-2), and the last default display order is transmitted (step 12-3).

FIG. 13 is a diagram illustrating main processing of user operations.
First, it is checked whether or not there is a cancel request from the user (step 13-1), and it is checked whether or not the display area, display order, and image quality as shown in FIG. 3 are specified (step 13-2, 13-3, 13-4). Although not shown, other processes related to GUI operations are also performed here (step 13-5).

FIG. 14 is a diagram illustrating processing when a transmission interruption notification is received from the host.
First, the fact that the reception process is interrupted is displayed and shown to the user (step 14-1). Next, the user operation shown in FIG. 13 is accepted (step 14-2), and it is checked whether or not a transmission resumption notification is received from the host (step 14-3).

FIG. 15 is a diagram showing processing when a cancel processing request is issued by the user.
The currently displayed image is returned to the previous image quality state, and other information that can be displayed is displayed and the interrupted state is saved and saved (step 15-1). Thereafter, it waits for a new image transmission request to be issued by a user operation or the like.

FIGS. 16, 17, and 18 are diagrams showing processing for sending the result of instructions given by the user as shown in FIG. 3 to the host.
That is, the display area is sent out in FIG. 16 (step 16-1), the display order is sent out in FIG. 17 (step 17-1), and the image quality is sent out in FIG. 18 (step 18-1).

FIG. 19 is a diagram showing one of the data compression formats that can extract a plurality of types of data amounts used in the present invention limited to an arbitrary timing and an arbitrary area.
19A is an original image, FIG. 19B is a diagram showing a state where a certain area of FIG. 19A is enlarged, FIG. 19C is a diagram showing a data string of the original image, and FIG. 19D is image data of the present invention. The figure which shows a row | line | column, (e) is the figure of the data which expanded a part of image data shown in (d).
Here, the compression format is not specified. The original image 50 shown in FIG. 19A has a data sequence of color information in the x direction and the y direction. The enlarged state is shown in a circle 51. For example, color information (expressed in RGB, CMYK, etc.) is arranged in order from the upper left of the image in the x direction, and color information (expressed in RGB, CMYK, etc.) is arranged in order in the x direction. One line is formed in the x direction.

These lines are arranged in order in the y direction, and as a result, a two-dimensional image (image) is formed. For example, an extremely high-definition image has a resolution unit of 400 dpi, and an image that can be displayed in A3 size has an information amount of about 150 MB. It is very inefficient to transmit this as it is or to hold it in a storage device or the like. Therefore, various compression methods are usually used to transmit or store after reducing the size. Examples of frequently used methods include JPEG and MPEG.
As shown in FIG. 19 (c), in these compressions, as shown in the data string 5, the original image position is usually taken out, although the image state is stored. The whole picture is not easily available.

Therefore, it is necessary to create and obtain necessary image portions and thumbnails after decompressing from the compressed state and returning to the original image data state. The image compression format used here is not such, and as shown in FIG. 19 (d), has a configuration such as 60 to 63 as a result of compression.
That is, in the transmission image data string according to the present invention, first, the header 60 stores the original image size color information type, the quality of the image to be held, position information in the image, and the like. Next, the entire image (thumbnail) of a certain scale is stored in the schematic image data 61. If the entire image is desired to be viewed, only this portion needs to be read and decompressed. What comes next is somewhat high-quality image data 62, and the amount of information is considerably increased from the image data 61. By reading the images 61 and 62, a slightly higher quality image can be read. Similarly, difference data as high-quality images are arranged, and by reading up to the final high-quality image data 63, sufficient image quality can be determined. It is possible to perform compression giving priority to size over image quality by cutting the high image quality side. Furthermore, in the individual image quality data, as shown in FIG. 19 (e), the original image is held in a state of being divided into blocks, so that the position information also jumps for each quality level written by reading the header. As a result, a part of the original image can be taken out and decompressed and displayed.
It should be noted that the present invention is not limited to the compression format shown in the figure, and can be applied to any format that can similarly extract quality and area.

In the first embodiment, (1) since the receiving side can preferentially acquire the rough image information according to the transmission content from the transmitting side, it is possible to efficiently grasp the whole state and the rough image. If the user is not satisfied with the quality of the original image, the user can view the original image without degrading the quality of the original image by taking a sufficient amount of time.
The timing of issuing these requests is not limited, and the user can issue an instruction to the host at an arbitrary time.

(2) Since the receiving side designates the image quality, area, and order, the desired image information can be preferentially displayed, so that the user can view the desired image efficiently.
(3) Since the transmission side notifies the reception side of a change in the transmission state and selects subsequent processing, the reception side can request an image information amount suitable for the transmission state, and the entire image can be requested as soon as possible. It is possible to preferentially receive the information of the part that the user wants to see the earliest.
Also, (4) the receiving side can always specify the desired image quality, image area, and display order, so that it is possible to respond to changes in user priority requests.
Further, (5) even if the transmission side is not particularly specified by the situation of the reception side with respect to the change in the transmission state, if the processing content corresponding to the change is set in advance, the user is changed every time it changes. However, the receiving side can obtain optimum information without the trouble of specifying the processing content.

The second embodiment of the present invention will be described below. In the second embodiment, a method for displaying an image with an arbitrary communication time or image quality or a method for image processing under the control of the receiving side will be described.
FIG. 20 is an overall view of a communication system showing the second embodiment.
A server 72 and a client 71 are connected via a network 70 such as a LAN or a public line. One server 72 and one client 71 are shown, but a plurality of them are connected.

FIG. 21 is a data structure diagram of an image received by the receiving side, that is, the client.
When the receiving side receives an image, according to the transfer image data structure shown in FIG. 21, the header 60, the coarse image 61, the high quality image data (1) 62a, the high quality image data (2) 62b,. The image quality data (n) 63 is sequentially received in time series, the image is reproduced in the image display processing unit, and sequentially displayed on the display means. As is clear from FIG. 21, the data structure of the image received on the receiving side is the same as the data structure of the image transmitted from the transmitting side as shown in FIG. The only difference is the difference between the structure seen from the transmitting side and the structure seen from the receiving side.
The data of the header 60 stores the size of the transfer image data structure format, the image size, the compression format, and the like. Since the size of the image is selected only by this information, the actual size A layout frame can be displayed.
Subsequently, the coarse image data 61 received, for example, displays a coarse image at a line drawing level as shown in FIG. The fine line ratio can be obtained, for example, by developing image information obtained by filtering and extracting only high-frequency components.

FIG. 22 is a configuration diagram illustrating an example of a reception-side terminal device.
The receiving-side terminal device includes a control unit 81 (for example, a central processing unit) that performs various operations, an I / F (interface device) 82 that is connected to an external device such as a communication unit, a LAN and a public line. Communication means 83 for transferring data, an image display processing section 84 capable of creating a data structure as shown in FIG. 21, a monitoring section 85 for monitoring the traffic state, and a U / I such as a keyboard and a mouse. (User interface device) 86, display means 87 for displaying images, a storage medium 88 (for example, HDD) for holding data, and program storage means 89 (for example, ROM) for storing programs. Yes. The storage medium 88 also stores a criteria map 90 in which conditions such as a traffic state to be described later are defined.
On the other hand, the sending device is not shown, but includes at least 81 to 84 and 88 devices.

FIG. 23 is a diagram of an image obtained by sequentially receiving the image data structure shown in FIG.
In the data structure of FIG. 21, when the header 60 is first received, there is only text data such as the size of the format, the image size, and the compression format, so no image is displayed as shown in FIG. Not. Next, when the rough data 61 is received, a rough image at the line drawing level is displayed as shown in FIG.
Next, when the high quality data (1) 62a is received, an image level in which a light color is added to the line drawing as shown in FIG. 23C is displayed. Similarly, FIGS. 23 (d), (e), and (f) are display images when the high quality image data (2), (3), and (n) are received, respectively. In particular, FIG. 23F shows a high-definition display image obtained by receiving all image data.

FIG. 24 is a state transition diagram of this embodiment.
In the present embodiment, the operation is represented by three states of state 1, state 2, and state 3. The transition from the state 1 to the state 2 is performed when the condition A12 is satisfied, and the transition from the state 2 to the state 3 is performed when the condition A23 is satisfied. Hereinafter, similarly, when the condition B32 and the condition B23 are satisfied, the transition from the state 3 to the state 2 and from the state 2 to the state 1 is performed.

FIG. 25 is a configuration diagram of the criteria map.
The criteria map is a table in which the state operation, that is, the quality of the received image and the state transition conditions are set. This criterion map indicates that, for state 1, image data is received so as to satisfy image quality Q1. In addition, the image quality to be received in this state is described, which indicates that it is Q1. Here, Q1 is indicated as 1/5, but this numerical value indicates the coarsest image quality. For example, in the transfer image data structure shown in FIG. 21, the quality of the image reproduced by the header 60 and the coarse image data 61 received first is shown. The maximum high-definition image quality obtained by receiving all the image data is set to 5/5, and the middle is defined as 2/5 to 4/5.

When in the state 1, when the image quality Q1 is reached, the image reception for the image is stopped and the next image reception is started. The monitoring unit monitors the traffic state, and transitions to state 2 when the condition A12 is reached. Condition A12 indicates the average data transfer throughput observed during a predetermined time, and in this embodiment, the transition to the state 2 is performed when it is greater than 3,000 bps.
State 2 indicates that reception is performed with an image quality of Q2, indicating that the transition condition A23 to state 3 is greater than 10,000 bps, and that the transition condition B21 to state 1 is less than 1,500 bps. However, it is shown that the received image quality in the state 2 can be appropriately changed by providing a learning function.
The state 3 indicates that reception is performed with the image quality of Q3, and the transition condition B32 to the state 2 indicates that it is smaller than 6,000 bps.

The learning function will be described. The criterion map in FIG. 25 is set so that the value of the received image quality Q2 in the state 2 is changed in accordance with the state transition. When transitioning from state 2 to state 1, the value is lowered by one step within the possible range of Q2 (2/5 to 4/5), and when transitioning from state 2 to state 3, the value of Q2 is also set to 1. Make it higher. By taking such measures, when the state 1 and the state 2 are repeatedly changed, the value of Q2 approaches 2/5, and when the state 2 and the state 3 are repeatedly changed, The value of Q2 approaches 4/5. This indicates that priority is given to reception with coarse image quality when the traffic condition is bad, and priority is given to reception with relatively high image quality when the traffic condition is good. Yes.
In this embodiment, for example, the transition conditions A12 and B21 between the state 1 and the state 2 have different values. However, this is an embodiment in which the transition condition has hysteresis, of course. A value without hysteresis may be set.

26 to 28 are operation flowcharts of the transmission side, the reception side, and the monitoring unit in the present embodiment.
In FIG. 26, the transmission side creates image information to be transferred with the data structure shown in FIG. 21 (step 26-1). Next, after the line connection (step 26-2), if there is a data transmission request from the receiving side (step 26-3), the image information is transmitted (step 26-4). During the protocol procedure, transmission interruption, disconnection, and other processing requests from the receiving side are accepted (step 26-5). In response to a request to stop transmission of image data from the receiving side, the transmission of the image is stopped (step 26-6), and the process proceeds to the next image transmission or the next processing. In response to a connection disconnection request from the receiving side, the connection is disconnected (step 26-7).

  In FIG. 27, the receiving side sets the criterion map as a default value or a previous value (step 27-1). If necessary, the operator on the receiving side resets the criterion map (step 27-2). Next, line connection is performed (step 27-3), a data transmission request is issued to the transmission side, and reception of data including an image is started (step 27-4). The minimum data necessary for the image profile and image display is received (step 27-5). It is determined whether or not a predetermined image quality such as a maximum received image size, a maximum communication time, and a resolution in the current state set in the criteria map has been reached (step 27-6). The reception is aborted, and an image of quality obtained by image processing is stored or displayed, and the transmission side is requested to stop data transmission of the image (step 27-7). Then, the process proceeds to the next process such as requesting data transmission of the next image (step 27-8). When the monitoring unit that monitors the traffic state notifies the control unit that a transition condition from the current state to another state has occurred (step 27-9), the maximum received image that should be received in the state after the transition Conditions for predetermined image quality such as size, maximum communication time, and resolution are reset automatically or manually according to a criteria map or the like, or by a learning function (step 27-10). Subsequently, image reception is continued according to the criteria map (step 27-11), and finally the line is disconnected (step 27-12).

  Next, in FIG. 28, the monitoring unit monitors traffic conditions such as data transfer rate (step 28-1), collates with the criteria map (step 28-2), and separates from the current state by the criteria map. When the condition for performing the transition to the state is reached, the contents are notified to the receiving side control unit (step 28-3).

Next, a third embodiment of the present invention will be described.
If the processing operations of the first embodiment and the second embodiment described above are converted into programs and stored in a storage medium, the storage medium can be brought into an arbitrary place and time. The present invention can be applied to a communication system.

  In the second embodiment, (1) when data with a large amount of information such as an image is transferred, transfer is performed sequentially from a coarse image in time series, so that the outline of the image is reproduced and displayed on the receiving side. Necessary image data can be a part of the whole. As a result, when an image is processed or displayed with a low image quality that provides an overview, the amount of image information to be received can be reduced, so that the image can be easily received even when the traffic state is bad. (2) When a large image is received, if the traffic condition is bad, the connection is cut off in the middle, and the received image data cannot be displayed or displayed in part. However, in this embodiment, such time and cost loss can be reduced. (3) Since images from low image quality to high definition are transmitted in chronological order, it is not necessary and necessary to prepare a plurality of images with different image quality on the transmission side in order to correspond to the image quality desired by the reception side. After receiving an accurate image, the reception side interrupts the reception of the image and proceeds to the next process or the reception request for the next image, so that no special protocol is required between the sender and the receiver. Furthermore, since the image quality required can be selected at the receiving side arbitrarily or according to traffic conditions without inquiring the transmitting side, the load on the transmitting side can be reduced, and there is room for function selection on the receiving side, The degree of freedom can be increased.

  Furthermore, (4) the traffic state is monitored, and when the traffic state is bad according to a predetermined standard, the reception state is in a low image quality, and when the traffic state is recovered, the reception state is in a high definition image quality. Since it operates so as to make a transition, it is possible to receive an image within a predetermined communication time although the image quality per image is different. Since a predetermined criterion (that is, criterion) for performing the transition of the reception state can have a learning function, it is possible to perform optimization according to the state of the network or the like.

1 is an overall configuration diagram of a communication system showing a first embodiment of the present invention. It is a specific block diagram in each apparatus in FIG. It is a figure which shows the state which is browsing information, such as image data in the receiving side. It is a reference | standard operation | movement flowchart by the side of the transmission of a 1st Example. It is a flowchart of a subroutine for monitoring a transmission state. It is an operation | movement flowchart of temporary interruption of transmission. It is a process flowchart in case image quality is designated from the receiving side. It is a processing flowchart in the case of setting a new image area. It is a processing flowchart in the case of setting a new display order. It is a processing flowchart in the case of performing interruption processing. It is an operation | movement flowchart which shows the reference | standard process on the receiving side. 10 is an operation flowchart in the case of transmitting default image quality, display area, and display order in setting information transmission processing. It is a flowchart which shows the main processes of user operation. It is a processing flowchart in case the transmission interruption notification is received from the host. It is an operation | movement flowchart when the cancellation process request | requirement is issued by the user. It is a process flowchart when the instruction | indication of a display area is given by the user. It is a process flowchart when the instruction | indication of a display order is given by the user. It is a process flowchart in case the instruction | indication of image quality is given by the user. It is explanatory drawing of the data compression format utilized in a 1st Example. It is a whole block diagram of the communication system which shows a 2nd Example. It is a data structure figure of the image data received in a 2nd Example. It is a block block diagram of a receiving terminal device. It is explanatory drawing at the time of receiving and displaying the image of the data structure of FIG. 21 sequentially. It is a state transition diagram of a present Example. It is a figure which shows the criteria map of a present Example. It is a flowchart of the reference | standard operation | movement of the transmission side which shows a 2nd Example. It is a flowchart of the reference | standard operation | movement of a receiving side similarly. It is the operation | movement flowchart in a monitoring part similarly.

Explanation of symbols

1 ... server system, 2 ... modem, 3-5 ... client system,
6 ... Network, 11 ... CPU, 12 ... Memory, 13 ... HDD,
14 ... I / F, 30 ... browser, 31 ... display order setting screen,
32 ... Image quality setting screen, 33 ... Pointer, 34 ... Image,
50 ... Original image, 51 ... Enlarged view, 52 ... Data string, 60 ... Header,
61: Outline image data, 62: Somewhat high quality image data,
63 ... final high-quality image data, 64 ... block indicating the position of the image data,
71 ... Client, 70 ... Network, 72 ... Server, 81 ... Control part,
82 ... I / F, 83 ... Communication means, 84 ... Image display processing unit, 85 ... Monitoring unit,
86 ... U / I, 87 ... display means, 88 ... storage medium, 89 ... program storage means,
90 ... Criteria map.

Claims (7)

This is an image transfer method that transfers compressed or uncompressed image data with a data structure that gradually increases in definition from coarse quality or low image quality, which allows the outline of the image to be understood, and that allows the entire image to be displayed even during reception. And
The receiving side monitors the traffic status,
If traffic conditions are poor, only receive the data needed for low-quality image processing and move on to the next image reception,
An image transfer method characterized by switching according to a traffic state so that data necessary for high-quality image processing is received when the traffic state is good or when the traffic state is restored.   2. The image transfer method according to claim 1, wherein the receiving side sets image quality desired by the receiving side in a plurality of stages according to a traffic state.   The image transfer method according to claim 1, wherein the receiving side has a hysteresis in a condition such as a traffic state for switching received image quality.   The image transfer method according to claim 1, wherein the receiving side has a learning function for a traffic state condition or image quality for switching the received image quality.   The image transfer method according to claim 1, wherein the receiving side can change an image quality desired by the receiving side.   The receiving side continues to re-receive image information until it reaches an image quality desired by an image received with low image quality when the traffic state is bad, using a processing idle time. The image transfer method according to claim 1.   A storage medium readable by a program, wherein each processing according to claim 1 is converted into a program and the program is stored in a storage medium.

Images