WO2012165066A1 - Image distribution server and image distribution control method - Google Patents

Image distribution server and image distribution control method Download PDF

Info

Publication number
WO2012165066A1
WO2012165066A1 PCT/JP2012/060221 JP2012060221W WO2012165066A1 WO 2012165066 A1 WO2012165066 A1 WO 2012165066A1 JP 2012060221 W JP2012060221 W JP 2012060221W WO 2012165066 A1 WO2012165066 A1 WO 2012165066A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
compressed
difference
web page
uncompressed
Prior art date
Application number
PCT/JP2012/060221
Other languages
French (fr)
Japanese (ja)
Inventor
敏貢 福島
Original Assignee
富士フイルム株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 富士フイルム株式会社 filed Critical 富士フイルム株式会社
Publication of WO2012165066A1 publication Critical patent/WO2012165066A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality

Definitions

  • the present invention relates to an image distribution server and an image distribution control method for converting a Web page for a PC (personal computer) into an image that can be displayed on a mobile terminal and distributing the image to the mobile terminal, and in particular, processing load on the server.
  • the present invention relates to an image distribution server and an image distribution control method that can be reduced.
  • a mobile terminal such as a mobile phone, a smartphone, or a tablet PC is used as a client, and a Web page for PC acquired from a Web server is converted into an image that can be displayed on the mobile terminal, and the image is distributed to the mobile terminal.
  • a distribution server is known (see Patent Document 1).
  • JP 2004-220260 A JP-T-2004-518218 Special Table 2007-524286
  • Patent Document 1 describes nothing about the processing load reduction of the image distribution server from the acquisition of the Web page for PC to the transmission of the image to the mobile terminal.
  • Patent Literature 2 When the technology described in Patent Literature 2 is applied to the configuration of Patent Literature 1, if the same image exists in the cache, the processing load on the image distribution server can be reduced. When a part changes, the same image does not exist in the cache. In reality, even if the Web page has the same URL, part of the content of the Web page often changes, and the probability that the same image exists in the cache is reduced. Therefore, the processing load on the image distribution server is reduced. It cannot be reduced.
  • Patent Document 3 When the technology described in Patent Document 3 is applied to the configuration of Patent Document 1, it is possible to reduce the amount of transmission data by transmitting only the difference image to the mobile terminal, but the mobile terminal receives the data. Since it is necessary to store all the image data, it is not suitable for a thin client type system.
  • the present invention has been made in view of such circumstances, and provides an image distribution server and an image distribution control method capable of reducing the processing load of the server in a thin client type system for browsing web pages. Objective.
  • the present invention compresses a first uncompressed image corresponding to a specific Web page and a first uncompressed image that can be displayed on a mobile terminal.
  • Storage means for storing the first compressed image
  • communication means for receiving a web page browsing request from the portable terminal
  • web page obtaining means for acquiring a web page requested to be browsed from the portable terminal
  • Analyzing means for analyzing the web page acquired by the web page acquiring means, and generating a second uncompressed image that can be displayed on the portable terminal from the acquired web page based on the analysis result by the analyzing means.
  • a difference image extracting unit that extracts a difference area image different from the first uncompressed image from the second uncompressed image from the second uncompressed image, and the difference image extracting unit.
  • a control unit that compresses the difference image, the first compressed image stored in the storage unit, and the difference image compressed by the compression unit to the portable terminal by the communication unit.
  • an image distribution server provided with a control means for performing the operation.
  • the entire image (second uncompressed image) corresponding to the web page requested to be browsed is not compressed but stored in the storage unit. Since only the image in the difference area (difference image) different from the uncompressed image (first uncompressed image) that has been compressed is compressed, the entire image corresponding to the Web page requested to be browsed is compressed as in the past. Compared with the case where it does, the processing load (calculation amount) in an image delivery server can be reduced.
  • a dynamic Web page (a part of the display content changes each time it is accessed, a Web page in which a part of the display content varies depending on the accessing user, etc.) or a Web page in which a part of the content is updated.
  • the first uncompressed image and the first compressed image obtained by compressing the first uncompressed image are stored in the storage unit, and an image corresponding to the Web page requested for browsing ( The second non-compressed image) is compared with the first non-compressed image stored in the storage means, so that the decompression process is unnecessary and the comparison can be started immediately, and the comparison process is performed by pixel comparison, etc. Can be easily performed.
  • the storage unit stores a URL indicating the location of the specific Web page in association with the specific Web page
  • the control unit stores the URL of the Web page requested to be browsed from the mobile terminal. It is determined whether or not it is stored in the storage means, and if the URL of the web page requested to be browsed is not stored in the storage means, control is performed so as not to extract and compress the difference image.
  • the second compressed image generated by compressing the second uncompressed image by the compressing unit without transmitting the first compressed image and the compressed differential image to the portable terminal, and the communication unit To transmit to the mobile terminal.
  • control means determines whether or not the data amount of the difference image extracted by the difference image extraction means exceeds a threshold, and if the data amount of the extracted difference image exceeds the threshold, The difference image is controlled not to be compressed, and the second uncompressed image is compressed by the compression means without transmitting the first compressed image and the compressed difference image to the portable terminal.
  • the second compressed image generated in this way is controlled to be transmitted to the portable terminal by the communication means.
  • the processing time (computation amount) when compressing (encoding) only the image (difference image) in the difference area and the process when compressing (encoding) the entire second uncompressed image Since the difference between the time (computation amount) is small and the first compressed image and the compressed difference image are distributed to the mobile terminal, the amount of communication data increases, so that the second uncompressed image as in this embodiment. If the second compressed image obtained by compressing the entire image is distributed, the amount of data transmitted to the portable terminal can be reduced, and the time required for image distribution can be reduced.
  • control means determines whether or not the amount of data of the extracted difference image is zero, and when the amount of data of the extracted difference image is zero, the compressed difference The image is not transmitted to the mobile terminal.
  • the present invention is an image distribution control method using a communication unit and a storage unit, and is a first uncompressed image that can be displayed on the mobile terminal and corresponds to a specific Web page.
  • Storing a first compressed image obtained by compressing the first uncompressed image in the storage unit receiving a web page browsing request from the portable terminal by the communication unit, and from the portable terminal A step of acquiring a web page requested to be browsed, a step of analyzing the acquired web page, and a second displayable on the mobile terminal from the acquired web page based on an analysis result of the web page A step of generating a non-compressed image, and comparing the first uncompressed image stored in the storage means with the generated second uncompressed image.
  • the present invention also provides a program for causing an arithmetic device to execute the image distribution control method.
  • the program can be provided by being recorded on various non-temporary recording media.
  • the present invention it is possible to reduce the processing load of the image distribution server in the thin client type system for browsing web pages.
  • FIG. 1 shows a state in which a PC web page is browsed using the display unit 14 of the mobile terminal 10 in the same manner as when a web page is browsed using the display unit 2 of a PC (personal computer) 1.
  • FIG. 1 shows a schematic diagram which shows. As shown in the figure, according to the Web page browsing system of this embodiment, the mobile terminal 10 can browse the Web page for the PC 1.
  • FIG. 2 is an overall configuration diagram showing an example of a Web page browsing system.
  • the Web page browsing system of this example converts a mobile terminal 10 capable of displaying an image and a Web page for PC into an image that can be displayed on the mobile terminal 10, and converts the image to the mobile terminal.
  • An image distribution server 20 that distributes to a PC and a Web server 30 that provides a Web page for a PC are included.
  • the mobile terminal 10 includes a communication unit 11 that communicates with the image distribution server 20, a processing unit 12 that controls each unit of the mobile terminal 10 according to a program, executes various processes, and an input unit 13 that receives an instruction input from a user.
  • a display unit 14 capable of displaying an image and a database (DB) 15 for storing various types of information are included.
  • the portable terminal 10 and the image distribution server 20 are connected via an electric communication line such as the Internet, and the communication unit 11 of the portable terminal 10 and the communication unit 21 of the image distribution server 20 described later are connected via an electric communication line. Via the communication protocol determined in advance.
  • the processing unit 12 displays an image acquired from the image distribution server 20 via the communication unit 11 on the display unit 14 and executes a process according to a user instruction input received by the input unit 13.
  • the input unit 13 includes a power button, a number key, a cross key, a determination key, and the like (not shown), and the user can input various instructions to the mobile terminal 10 by operating the input unit 13.
  • a touch sensor may be disposed on the front surface of the display unit 14 to serve as the input unit 13.
  • the display unit 14 includes a display device (for example, a liquid crystal display device) that can display an image, and performs display based on the image signal input from the processing unit 12.
  • a display device for example, a liquid crystal display device
  • the image distribution server 20 includes a communication unit 21 that communicates with the mobile terminal 10 and the Web server 30, and an image that can be displayed on the mobile terminal 10, and a specific Web page for PC (hereinafter referred to as “first Web page”). And an uncompressed image (hereinafter referred to as a “first uncompressed image”) and an image obtained by compressing the first uncompressed image by a later-described compression unit 26 (hereinafter referred to as a “first compressed image”).
  • Database (DB) 22 to be analyzed, and an analysis unit that analyzes an arbitrary Web page for PC (hereinafter referred to as “second Web page”) that is requested to be browsed from the mobile terminal 10 and acquired from the Web server 30 by the communication unit 21.
  • second uncompressed image an image (hereinafter, “second uncompressed image” that can be displayed on the mobile terminal 10 from the acquired second Web page based on the analysis result of the second Web page by the analysis unit 23. And the second uncompressed image by comparing the first uncompressed image stored in the DB 22 with the second uncompressed image generated by the image generating unit 24.
  • a difference image extraction unit 25 that extracts an image of a difference area different from the first uncompressed image from the second uncompressed image as a difference image
  • a compression unit 26 that performs image data compression
  • image distribution a control unit 29 that controls each unit of the server 20.
  • the image distribution server 20 and the Web server 30 are connected via an electric communication line such as the Internet, and the communication unit 21 of the image distribution server 20 and the communication unit 31 of the Web server 30 are connected in advance via an electric communication line. Communication is performed according to a predetermined communication protocol.
  • the DB 22 is composed of, for example, a known readable / writable disk, and stores various data (information).
  • the control unit 29 of this example uses a part of the DB 22 as a so-called cache.
  • the analysis unit 23 and the image generation unit 24 are configured to include, for example, a CPU (Central Processing Unit), and execute so-called Web browser software.
  • the image generation unit 24 executes an imaging process for converting PC screen information generated by a so-called rendering process into an image that can be displayed on the mobile terminal 10 that is the image distribution destination.
  • the difference image extraction unit 25 and the compression unit 26 are constituted by a CPU, for example. A part or all of these may be configured by an electronic circuit.
  • the format of compression (encoding) by the compression unit 26 is not particularly limited, and examples thereof include JPEG, PNG, and GIF. An irreversible format may be used.
  • the control unit 29 is constituted by a CPU and executes various processes according to a program.
  • the control unit 29 of the present embodiment basically compresses only the difference image (the second non-compressed image is a difference region image different from the first non-compressed image) by the compression unit 26.
  • the communication unit 21 transmits the compressed difference image (compression difference image) and the first compressed image stored in the DB 22 to the portable terminal 10. This reduces the load of compression processing in the image distribution server 20 and shortens the time required from the acquisition of the second Web page to the distribution of the image to the mobile terminal 10.
  • control unit 29 determines whether or not the URL of the second Web page requested to be browsed from the mobile terminal 10 is stored in the DB 22, and the URL of the second Web page requested to be browsed is stored in the DB 22. If not stored, the second image corresponding to the second Web page is controlled without performing extraction and compression of the difference image and without transmitting the first compressed image and the compressed difference image to the mobile terminal 10. Control is performed to transmit the second compressed image generated by compressing the uncompressed image to the mobile terminal 10 by the communication unit 21.
  • control unit 29 determines whether or not the data amount of the uncompressed difference image extracted by the difference image extraction unit 25 exceeds the threshold value, and if the data amount of the uncompressed difference image exceeds the threshold value, The second compressed image generated by compressing the second uncompressed image by the compression unit 26 is transmitted to the portable terminal 10 by the communication unit 21 without transmitting the compressed image 1 and the compressed difference image of the first to the portable terminal 10. Control.
  • control unit 29 determines whether or not the data amount of the extracted uncompressed difference image is zero. If the data amount of the extracted uncompressed difference image is zero, the control unit 29 determines whether or not the compressed difference image is zero. Control is performed so that only the first compressed image stored in the DB 22 is transmitted to the portable terminal 10 by the communication unit 21 without being transmitted to the portable terminal 10.
  • the control unit 29 of this example calculates difference area position information that calculates position information (hereinafter referred to as “difference area position information”) of the difference area that is different from the first uncompressed image among the second uncompressed images. Has a calculation function.
  • the difference area position information indicates the position of the difference area on the second uncompressed image.
  • the control unit 29 of the present example together with the compressed image (first compressed image and compressed difference image), the difference area Send metadata including location information. Therefore, the portable terminal 10 can easily superimpose the difference image on the first uncompressed image based on the difference area position information in the metadata after expanding the first compressed image and the compressed difference image. .
  • control unit 29 of the present example extracts user interface information (hereinafter referred to as “UI information”) from the Web page, and the positional information on the second uncompressed image of the UI information (hereinafter referred to as “UI positional information”).
  • the control part 29 of this example transmits the metadata containing UI information and UI position information with the compressed image with respect to the portable terminal 10. FIG. Therefore, after displaying the image, the mobile terminal 10 can easily execute a process according to the user's input operation based on the UI information and the UI position information in the metadata.
  • FIG. 3 is a flowchart showing a flow of a processing example in the thin client type Web page browsing system.
  • the processing in the image distribution server 20 is executed by the control unit 29 according to a program. Further, the processing in the mobile terminal 10 is executed by the processing unit 12 according to a program.
  • These programs are recorded on a non-transitory computer-readable medium such as a ROM.
  • the image distribution server 20 holds cache data corresponding to a specific Web page (first Web page) in advance by the DB 22 (step S2).
  • the cache data 80 includes a URL (Uniform ResourceatorLocator) 81 of the first Web page and an image that can be displayed on the mobile terminal 10 and corresponds to the first Web page.
  • a compressed image 82 and an image 83 (first compressed image) obtained by compressing the first uncompressed image 82 are included.
  • the control unit 29 stores the cache data 80 in the DB 22.
  • the URL is information indicating the location of the Web page.
  • the control unit 29 identifies the web page by the URL.
  • the input unit 13 of the mobile terminal 10 receives an input of a URL of an arbitrary Web page (second Web page) from the user, and the communication unit 11 of the mobile terminal 10 browses the Web page to the image distribution server 20.
  • a request is transmitted (step S4).
  • the URL received from the user is added to the browsing request.
  • the control unit 29 acquires the second web page requested to be browsed from the mobile terminal 10 from the web server 30 by the communication unit 21 (step S6). ).
  • the image distribution server 20 analyzes the acquired second Web page by the analysis unit 23 (step S8).
  • the image distribution server 20 uses the image generation unit 24 to generate an image (second uncompressed image) that can be displayed on the mobile terminal 10 from the second Web page based on the analysis result of the analysis unit 23. (Step S10).
  • the control unit 29 determines whether or not cache data corresponding to the second Web page exists (step S12).
  • the control unit 29 stores the URL (http://www.site1.co.jp in this example) of the Web page requested to be browsed from the mobile terminal 10 in the DB 22.
  • Whether or not the first uncompressed image and the first compressed image corresponding to the second Web page exist is determined by determining whether or not the image is present (existing in the cache data 80). Note that if a query is added to the URL, whether to ignore the query can be set in the DB 22.
  • the difference image extraction unit 25 When cache data corresponding to the second Web page exists, the difference image extraction unit 25 generates the first uncompressed image 82 stored in the DB 22 and the image generation unit 24 as shown in FIG. Compared with the second uncompressed image 84, the second uncompressed image 84 and an image of the difference area 86 (86a, 86b, 86c) different from the first uncompressed image 82 are A difference image is extracted from the uncompressed image 84 (step S14). If there is no cache data corresponding to the second Web page, the process proceeds to step S24.
  • the difference image extraction unit 25 performs comparison between uncompressed images, there is no need for decompression, the compression format may be irreversible, or the comparison may be simply performed for each pixel (pixel).
  • the difference image extraction unit 25 of this example determines a continuous area of pixels that do not match the first uncompressed image in the second uncompressed image as a difference area 86 (86a, 86b, 86c).
  • the difference image extraction unit 25 detects a rectangular area inscribed by the difference area 86, and uses the image in this rectangular area as a difference image 87 to generate a second image.
  • the uncompressed image 84 may be extracted.
  • the difference image extraction unit 25 calculates (acquires) the coordinates (difference area position information) of the difference area 86 in the second uncompressed image 84 and transmits the position information to the mobile terminal 10.
  • the difference image extraction unit 25 may acquire, for example, two of the rectangle start point coordinates (upper left coordinates) and end point coordinates (lower right coordinates).
  • the position information of the difference area 86 indicates the position of the difference area 86 in the second uncompressed image 84 (and the position of the difference area 86 in the first uncompressed image 82).
  • control unit 29 determines whether or not the data amount (difference amount) of the image (difference image) of the extracted difference region 86 (86a, 86b, 86c) exceeds a threshold value (step S16).
  • the control unit 29 of this example calculates the size (area) of the difference area 86 in the second uncompressed image 84 as the difference amount. For example, the control unit 29 may count the total number of pixels (number of pixels) in the difference area 86 as the area. In the example illustrated in FIG. 6, the control unit 29 calculates the sum of the areas of the difference regions denoted by reference numerals 86 a, 86 b, and 86 c and compares the sum with a threshold set in advance in the DB 22 of the image distribution server 20. For example, the control unit 29 sets 20% of the area of the second uncompressed image 84 as the threshold value. The control unit 29 may simply set the number of pixels as a threshold value.
  • control unit 29 compresses (encodes) only the difference images (87a, 87b, and 87c in FIG. 8) rather than compressing (encoding) the entire second uncompressed image 84 if it is equal to or less than the threshold value.
  • the control unit 29 determines whether or not the difference amount is zero (step S18).
  • the control unit 29 includes images of the difference areas 86 a, 86 b, 86 c in the second uncompressed image 84. Only the difference images 87a, 87b, 87c are compressed by the compression unit 26 of the image distribution server 20, respectively, and compressed difference images 88a, 88b, 88c are generated (step S20).
  • the image distribution server 20 stores the first compressed image 83 stored in the DB 22, the compressed difference image 88 (88 a, 88 b, 88 c), and the metadata 89. It transmits to the portable terminal 10 by the communication part 21 (step S22).
  • the metadata 89 includes difference area position information describing the coordinate position of the difference area 86 (86a, 86b, 86c) in the second uncompressed image. That is, the metadata 89 includes difference area position information describing the coordinate position of the difference area 86 in the first uncompressed image 83.
  • the image distribution server 20 compresses all the second uncompressed images 84 generated by the image generation unit 24 by the compression unit 26 as shown in FIG. S24)
  • the second compressed image 85 generated by the compression is transmitted to the mobile terminal 10 by the communication unit 21 (step S26).
  • the image distribution server 20 transmits the first compressed image 83 stored in the DB 22 to the mobile terminal 10 by the communication unit 21 as shown in FIG. 11 (step S28). .
  • the mobile terminal 10 expands the image received from the image distribution server 20, and displays the expanded image on the display unit 14 of the mobile terminal 10 as shown in FIG. 12 (step S30).
  • the mobile terminal 10 receives the first compressed image 83 and the compressed difference image 88 from the image distribution server 20, as shown in FIG. 12, the entire display area of the first uncompressed image 82 is displayed.
  • the difference areas 86a, 86b, 86c designated by the difference area position information of the metadata are overwritten with the expanded difference images 87a, 87b, 87c and displayed.
  • the images (first uncompressed image and first compressed image) stored as cache data in the DB 22 may not be fixed.
  • the image distribution server 20 stores (holds) the browsing request history (communication log) of the Web page received from the mobile terminal 10 in the DB 22, and the control unit 29 determines the DB 22 based on the history. There is a mode of determining an image to be stored (held) as cache data.
  • the control unit 29 generates a history including a URL indicating the location of the web page in the DB 22, and based on the URL in the history, a certain number of web pages (or in the order in which the number of browsing requests from the mobile terminal 10 is large) Site) is selected, and images corresponding to the selected plurality of Web pages (or sites) are stored in the DB 22 as first uncompressed images 82, respectively.
  • the image distribution server 20 stores (sets) a specific URL as setting information in the DB 22 of the image distribution server 20 in advance, and stores (holds) an image corresponding to the setting information (URL) in the DB 22. There is a mode to keep.
  • timing for starting the retention of cache data is not particularly limited. For example, holding of cache data is started when a certain time has elapsed since the system started operation.
  • Invention 1 A first non-compressed image that can be displayed on a mobile terminal and stores a first non-compressed image corresponding to a specific Web page and a first compressed image obtained by compressing the first non-compressed image Storage means, a communication means for receiving a web page browsing request from the portable terminal, a web page obtaining means for obtaining a web page requested to be browsed from the portable terminal, and a web acquired by the web page acquiring means.
  • Analysis means for analyzing a page, image generation means for generating a second uncompressed image that can be displayed on the mobile terminal from the acquired Web page based on the analysis result by the analysis means, and storage means
  • the stored first uncompressed image is compared with the second uncompressed image generated by the image generating means, and the second uncompressed image is compared with the second uncompressed image.
  • Differential image extraction means for extracting an image of a difference area different from the one uncompressed image from the second uncompressed image as a difference image; compression means for compressing the difference image extracted by the difference image extraction means;
  • Image distribution comprising: control means for controlling the first compressed image stored in the storage means and the difference image compressed by the compression means to be transmitted to the portable terminal by the communication means server.
  • the storage means stores a URL indicating the location of the specific Web page in association with the specific Web page
  • the control means stores the URL of the Web page requested to be browsed from the portable terminal. It is determined whether or not the URL of the web page requested to be browsed is not stored in the storage unit, and control is performed so as not to extract and compress the difference image.
  • the second compressed image generated by compressing the second non-compressed image by the compression unit without transmitting the first compressed image and the compressed difference image to the portable terminal is transmitted by the communication unit.
  • the image delivery server according to claim 1, wherein the image delivery server performs control of transmission to a portable terminal.
  • the control means determines whether or not the data amount of the difference image extracted by the difference image extraction means exceeds a threshold. If the data amount of the extracted difference image exceeds the threshold, the difference Control is performed so as not to compress the image, and the second uncompressed image is generated by compressing the second uncompressed image by the compression means without transmitting the first compressed image and the compressed difference image to the portable terminal.
  • the image distribution server according to claim 1 or 2, wherein control is performed to transmit the second compressed image that has been performed to the portable terminal by the communication unit.
  • Invention 4 The control means determines whether or not the data amount of the extracted difference image is zero, and if the data amount of the extracted difference image is zero, the control unit determines the compressed difference image
  • Invention 5 When the said control means transmits the said compressed difference image with respect to the said portable terminal, the positional information on the difference area different from a said 1st uncompressed image among the said 2nd uncompressed image
  • the image delivery server according to claim 1 or 2 wherein the communication means transmits the information to the portable terminal.
  • the difference image extraction means detects a rectangular area inscribed by the difference area, and extracts the image of the rectangular area as the difference image from the second uncompressed image. 6.
  • the image delivery server according to any one of inventions 1 to 5.
  • Invention 7 The storage means stores a history of browsing requests for Web pages received from the portable terminal, and the control means stores the first uncompressed information stored in the storage means based on the history. 7.
  • the image distribution server according to any one of inventions 1 to 6 for determining an image.
  • Inventions 8 to 14 Method inventions corresponding to Inventions 1 to 7, respectively.
  • Inventions 15 to 21 Inventions of programs corresponding to Inventions 8 to 14, respectively.
  • the invention of the program can be provided by being recorded on various recording media.

Abstract

An image distribution server comprises: a DB (22) for storing a first non-compressed image that corresponds to a specific webpage and a first compressed image in which the first non-compressed image has been compressed; a communication unit (21) for receiving a browser request from a mobile terminal (10) and acquiring a webpage; an analysis unit (23) for analyzing the acquired webpage; an image generator (24) for generating a second non-compressed image that can be displayed on the mobile terminal (10) from the acquired webpage on the basis of the analysis results; a difference image extraction unit (25) for comparing the first non-compressed image and the second non-compressed image and extracting as a difference image from the second image, an image in a difference region of the second non-compressed image that differs from the first non-compressed image; a compression unit (26) for compressing the extracted difference image; and a controller (29) for controlling the transmission of the compressed difference image and the first compressed image stored in the DB (22) to the mobile terminal (10) by the communication unit (21).

Description

画像配信サーバ及び画像配信制御方法Image distribution server and image distribution control method
 本発明は、PC(パーソナルコンピュータ)用のWebページを携帯端末で表示可能な画像に変換して携帯端末に対し配信する画像配信サーバ及び画像配信制御方法に関し、特に、サーバでの処理の負荷を低減することができる画像配信サーバ及び画像配信制御方法に関する。 The present invention relates to an image distribution server and an image distribution control method for converting a Web page for a PC (personal computer) into an image that can be displayed on a mobile terminal and distributing the image to the mobile terminal, and in particular, processing load on the server. The present invention relates to an image distribution server and an image distribution control method that can be reduced.
 従来、携帯電話、スマートフォン、タブレット型PCなどの携帯端末をクライアントとし、Webサーバから取得したPC用のWebページを携帯端末で表示可能な画像に変換し、その画像を携帯端末に対し配信する画像配信サーバが知られている(特許文献1を参照)。 Conventionally, a mobile terminal such as a mobile phone, a smartphone, or a tablet PC is used as a client, and a Web page for PC acquired from a Web server is converted into an image that can be displayed on the mobile terminal, and the image is distributed to the mobile terminal. A distribution server is known (see Patent Document 1).
 また、要求された画像がキャッシュに存在する場合には、キャッシュに格納されている画像を配信することが知られている(特許文献2を参照)。 Also, when the requested image exists in the cache, it is known to distribute the image stored in the cache (see Patent Document 2).
 また、送信データ量を低減するため、直前に送信された画像データとは異なる差分だけを送信することが知られている(特許文献3を参照)。 Also, it is known that only a difference that is different from the image data transmitted immediately before is transmitted in order to reduce the amount of transmission data (see Patent Document 3).
特開2004-220260号公報JP 2004-220260 A 特表2004-518218号公報JP-T-2004-518218 特表2007-524286号公報Special Table 2007-524286
 PC用のWebページを画像化して携帯端末に配信するシンクライアント型のWebページ閲覧技術を利用することにより、PCよりも性能が劣る携帯端末でも、携帯端末上でブラウザを動作させることなく、PC用のWebページをPCで閲覧する場合と同様の表示形態で閲覧することが可能となる。 By using a thin client type web page browsing technology that images a web page for a PC and distributes it to the mobile terminal, even if the mobile terminal is inferior in performance to the PC, the PC does not operate on the mobile terminal. Can be viewed in the same display form as when viewing a Web page for PC.
 しかしながら、携帯端末に対して画像を配信するサーバ(画像配信サーバ)での処理の負荷が大きいために、1台の画像配信サーバで多数の携帯端末からのリクエストを受け付けられないという問題があった。 However, since the processing load on the server (image distribution server) that distributes images to mobile terminals is large, there is a problem that requests from a large number of mobile terminals cannot be received by one image distribution server. .
 特許文献1には、PC用のWebページを取得してから携帯端末に画像を送信するまでの画像配信サーバの処理の負荷低減について、何も記載されていない。 Patent Document 1 describes nothing about the processing load reduction of the image distribution server from the acquisition of the Web page for PC to the transmission of the image to the mobile terminal.
 特許文献2に記載の技術を特許文献1の構成に適用した場合、キャッシュに全く同一の画像が存在する場合には画像配信サーバの処理の負荷を低減することができるが、Webページの内容の一部が変化する場合にはキャッシュに同一の画像が存在しないことになる。現実には、同じURLのWebページであってもWebページの内容の一部が変化する場合が多く、キャッシュに同一の画像が存在する確率が低くなるので、画像配信サーバでの処理の負荷を低減できない。 When the technology described in Patent Literature 2 is applied to the configuration of Patent Literature 1, if the same image exists in the cache, the processing load on the image distribution server can be reduced. When a part changes, the same image does not exist in the cache. In reality, even if the Web page has the same URL, part of the content of the Web page often changes, and the probability that the same image exists in the cache is reduced. Therefore, the processing load on the image distribution server is reduced. It cannot be reduced.
 特許文献3に記載の技術を特許文献1の構成に適用した場合、携帯端末に対して差分画像だけを送信することにより、送信データ量を低減することは可能であるが、携帯端末で受信した画像データの全てを保持しておく必要があるので、シンクライアント型のシステムには適さない。 When the technology described in Patent Document 3 is applied to the configuration of Patent Document 1, it is possible to reduce the amount of transmission data by transmitting only the difference image to the mobile terminal, but the mobile terminal receives the data. Since it is necessary to store all the image data, it is not suitable for a thin client type system.
 本発明はこのような事情に鑑みてなされたもので、Webページ閲覧用のシンクライアント型のシステムにおけるサーバの処理の負荷を低減することができる画像配信サーバ及び画像配信制御方法を提供することを目的とする。 The present invention has been made in view of such circumstances, and provides an image distribution server and an image distribution control method capable of reducing the processing load of the server in a thin client type system for browsing web pages. Objective.
 前記目的を達成するために、本発明は、携帯端末で表示可能な第1の非圧縮画像であって特定のWebページに対応する第1の非圧縮画像と前記第1の非圧縮画像を圧縮した第1の圧縮画像とを記憶する記憶手段と、前記携帯端末からWebページの閲覧要求を受信する通信手段と、前記携帯端末から閲覧要求されたWebページを取得するWebページ取得手段と、前記Webページ取得手段によって取得されたWebページを解析する解析手段と、前記解析手段による解析結果に基づいて、前記取得されたWebページから前記携帯端末で表示可能な第2の非圧縮画像を生成する画像生成手段と、前記記憶手段に記憶されている前記第1の非圧縮画像と、前記画像生成手段によって生成された前記第2の非圧縮画像とを比較して、前記第2の非圧縮画像のうちで前記第1の非圧縮画像とは異なる差分領域の画像を差分画像として前記第2の非圧縮画像から抽出する差分画像抽出手段と、前記差分画像抽出手段によって抽出された差分画像を圧縮する圧縮手段と、前記記憶手段に記憶されている前記第1の圧縮画像と、前記圧縮手段によって圧縮された差分画像とを、前記通信手段によって前記携帯端末に送信する制御を行う制御手段と、を備えた画像配信サーバを提供する。 In order to achieve the above object, the present invention compresses a first uncompressed image corresponding to a specific Web page and a first uncompressed image that can be displayed on a mobile terminal. Storage means for storing the first compressed image, communication means for receiving a web page browsing request from the portable terminal, web page obtaining means for acquiring a web page requested to be browsed from the portable terminal, Analyzing means for analyzing the web page acquired by the web page acquiring means, and generating a second uncompressed image that can be displayed on the portable terminal from the acquired web page based on the analysis result by the analyzing means. Comparing the image generation means, the first uncompressed image stored in the storage means, and the second uncompressed image generated by the image generation means, A difference image extracting unit that extracts a difference area image different from the first uncompressed image from the second uncompressed image from the second uncompressed image, and the difference image extracting unit. A control unit that compresses the difference image, the first compressed image stored in the storage unit, and the difference image compressed by the compression unit to the portable terminal by the communication unit. And an image distribution server provided with a control means for performing the operation.
 本発明によれば、携帯端末からWebページの閲覧要求を受信したとき、閲覧要求されたWebページに対応する画像(第2の非圧縮画像)の全体を圧縮するのではなく、記憶手段に記憶されている非圧縮の画像(第1の非圧縮画像)とは異なる差分領域の画像(差分画像)のみを圧縮するので、従来のように閲覧要求されたWebページに対応する画像の全体を圧縮する場合と比較して、画像配信サーバでの処理の負荷(演算量)を低減することができる。特に、動的なWebページ(アクセスのたびに表示内容の一部が変化したり、アクセスするユーザによって表示内容の一部が異なるWebページなど)や、コンテンツの一部が更新されたWebページの閲覧時に、大きな効果を発揮する。また、本発明によれば、第1の非圧縮画像と第1の非圧縮画像を圧縮した第1の圧縮画像とが記憶手段に記憶されており、閲覧要求されたWebページに対応する画像(第2の非圧縮画像)を、記憶手段に記憶されている第1の非圧縮画像と比較するので、伸長処理が不要であって直ぐに比較を開始することができるとともに、比較処理を画素比較などによって容易に行うことが可能となる。 According to the present invention, when a web page browsing request is received from a portable terminal, the entire image (second uncompressed image) corresponding to the web page requested to be browsed is not compressed but stored in the storage unit. Since only the image in the difference area (difference image) different from the uncompressed image (first uncompressed image) that has been compressed is compressed, the entire image corresponding to the Web page requested to be browsed is compressed as in the past. Compared with the case where it does, the processing load (calculation amount) in an image delivery server can be reduced. In particular, a dynamic Web page (a part of the display content changes each time it is accessed, a Web page in which a part of the display content varies depending on the accessing user, etc.) or a Web page in which a part of the content is updated. Great effect when browsing. Further, according to the present invention, the first uncompressed image and the first compressed image obtained by compressing the first uncompressed image are stored in the storage unit, and an image corresponding to the Web page requested for browsing ( The second non-compressed image) is compared with the first non-compressed image stored in the storage means, so that the decompression process is unnecessary and the comparison can be started immediately, and the comparison process is performed by pixel comparison, etc. Can be easily performed.
 一実施形態において、前記記憶手段は、前記特定のWebページの所在を示すURLを前記特定のWebページと関連付けて記憶し、前記制御手段は、前記携帯端末から閲覧要求されたWebページのURLが前記記憶手段に記憶されているか否かを判定して、前記閲覧要求されたWebページのURLが前記記憶手段に記憶されていない場合、前記差分画像の抽出及び圧縮を行わないように制御するとともに、前記第1の圧縮画像及び前記圧縮された差分画像を前記携帯端末に送信しないで、前記圧縮手段によって前記第2の非圧縮画像を圧縮して生成された第2の圧縮画像を前記通信手段によって前記携帯端末に送信する制御を行う。 In one embodiment, the storage unit stores a URL indicating the location of the specific Web page in association with the specific Web page, and the control unit stores the URL of the Web page requested to be browsed from the mobile terminal. It is determined whether or not it is stored in the storage means, and if the URL of the web page requested to be browsed is not stored in the storage means, control is performed so as not to extract and compress the difference image. The second compressed image generated by compressing the second uncompressed image by the compressing unit without transmitting the first compressed image and the compressed differential image to the portable terminal, and the communication unit To transmit to the mobile terminal.
 一実施形態において、前記制御手段は、前記差分画像抽出手段によって抽出された差分画像のデータ量が閾値を超えるか否かを判定し、前記抽出された差分画像のデータ量が閾値を超える場合、前記差分画像の圧縮を行わないように制御するとともに、前記第1の圧縮画像及び前記圧縮された差分画像を前記携帯端末に送信しないで、前記圧縮手段によって前記第2の非圧縮画像を圧縮して生成された第2の圧縮画像を前記通信手段によって前記携帯端末に送信する制御を行う。 In one embodiment, the control means determines whether or not the data amount of the difference image extracted by the difference image extraction means exceeds a threshold, and if the data amount of the extracted difference image exceeds the threshold, The difference image is controlled not to be compressed, and the second uncompressed image is compressed by the compression means without transmitting the first compressed image and the compressed difference image to the portable terminal. The second compressed image generated in this way is controlled to be transmitted to the portable terminal by the communication means.
 差分領域が大きい場合には、差分領域の画像(差分画像)のみを圧縮(エンコード)する場合の処理時間(演算量)と、第2の非圧縮画像の全体を圧縮(エンコード)する場合の処理時間(演算量)との差が小さく、また、第1の圧縮画像と圧縮差分画像とを携帯端末に配信すると通信データ量が大きくなるため、本実施形態のように、第2の非圧縮画像の全体を圧縮した第2の圧縮画像を配信する方が、携帯端末に送信するデータ量を抑えることができ、画像配信の所要時間を抑えることができる。 When the difference area is large, the processing time (computation amount) when compressing (encoding) only the image (difference image) in the difference area and the process when compressing (encoding) the entire second uncompressed image Since the difference between the time (computation amount) is small and the first compressed image and the compressed difference image are distributed to the mobile terminal, the amount of communication data increases, so that the second uncompressed image as in this embodiment. If the second compressed image obtained by compressing the entire image is distributed, the amount of data transmitted to the portable terminal can be reduced, and the time required for image distribution can be reduced.
 一実施形態において、前記制御手段は、前記抽出された差分画像のデータ量がゼロであるか否かを判定し、前記抽出された差分画像のデータ量がゼロである場合、前記圧縮された差分画像を前記携帯端末に送信しない。 In one embodiment, the control means determines whether or not the amount of data of the extracted difference image is zero, and when the amount of data of the extracted difference image is zero, the compressed difference The image is not transmitted to the mobile terminal.
 差分領域がない場合は、前記記憶手段に記憶されている第1の圧縮画像のみが携帯端末に送信されるので、第2の非圧縮画像を圧縮する場合と比較して、画像配信の所要時間が大きく短縮する。 When there is no difference area, only the first compressed image stored in the storage means is transmitted to the mobile terminal, so that the time required for image distribution is compared with the case where the second uncompressed image is compressed. Is greatly shortened.
 また、本発明は、通信手段及び記憶手段を用いる画像配信制御方法であって、前記携帯端末で表示可能な第1の非圧縮画像であって特定のWebページに対応する第1の非圧縮画像と前記第1の非圧縮画像を圧縮した第1の圧縮画像とを前記記憶手段に記憶させるステップと、前記通信手段によって前記携帯端末からWebページの閲覧要求を受信するステップと、前記携帯端末から閲覧要求されたWebページを取得するステップと、取得された前記Webページを解析するステップと、前記Webページの解析結果に基づいて、前記取得されたWebページから前記携帯端末で表示可能な第2の非圧縮画像を生成するステップと、前記記憶手段に記憶されている前記第1の非圧縮画像と、生成された前記第2の非圧縮画像とを比較して、前記第2の非圧縮画像のうちで前記第1の非圧縮画像とは異なる差分領域の画像を差分画像として前記第2の非圧縮画像から抽出するステップと、抽出された差分画像を圧縮するステップと、前記記憶手段に記憶されている前記第1の圧縮画像と、圧縮された差分画像とを、前記通信手段によって前記携帯端末に送信するステップと、を備えた画像配信制御方法を提供する。 In addition, the present invention is an image distribution control method using a communication unit and a storage unit, and is a first uncompressed image that can be displayed on the mobile terminal and corresponds to a specific Web page. Storing a first compressed image obtained by compressing the first uncompressed image in the storage unit, receiving a web page browsing request from the portable terminal by the communication unit, and from the portable terminal A step of acquiring a web page requested to be browsed, a step of analyzing the acquired web page, and a second displayable on the mobile terminal from the acquired web page based on an analysis result of the web page A step of generating a non-compressed image, and comparing the first uncompressed image stored in the storage means with the generated second uncompressed image. Extracting from the second uncompressed image a difference image different from the first uncompressed image in the second uncompressed image from the second uncompressed image, and compressing the extracted difference image And a step of transmitting the first compressed image stored in the storage means and the compressed difference image to the portable terminal by the communication means.
 また、本発明は、前記画像配信制御方法を演算装置に実行させるプログラムを提供する。本プログラムは、各種の非一時的記録媒体に記録して、提供することができる。 The present invention also provides a program for causing an arithmetic device to execute the image distribution control method. The program can be provided by being recorded on various non-temporary recording media.
 本発明によれば、Webページ閲覧用のシンクライアント型のシステムにおける画像配信サーバの処理の負荷を低減することができる。 According to the present invention, it is possible to reduce the processing load of the image distribution server in the thin client type system for browsing web pages.
PC向けWebページをPCと携帯端末とで閲覧している様子を示す模式図Schematic diagram showing how a web page for PC is viewed on a PC and mobile terminal シンクライアント型のWebページ閲覧システムの全体構成図Overall configuration diagram of a thin client type Web page browsing system シンクライアント型のWebページ閲覧システムにおける処理例の流れを示すフローチャートThe flowchart which shows the flow of the process example in a thin client type web page browsing system キャッシュデータの保持の説明に用いる説明図Explanatory drawing used to explain cache data retention 閲覧要求されたWebページに対応するキャッシュデータが存在するか否かの判定の説明に用いる説明図Explanatory drawing used to explain whether or not there is cache data corresponding to the web page requested to be browsed キャッシュデータとして保持された非圧縮の第1の非圧縮画像と、取得したWebページから生成した第2の非圧縮画像との比較の説明に用いる説明図Explanatory drawing used for description of a comparison between a non-compressed first uncompressed image held as cache data and a second uncompressed image generated from the acquired Web page 差分画像が矩形でない場合に差分画像が内接する矩形領域の画像を抽出することの説明に用いる説明図Explanatory drawing used for explanation of extracting an image of a rectangular area inscribed by a difference image when the difference image is not rectangular 差分量が閾値を超えていない場合の圧縮の説明に用いる説明図Explanatory drawing used for explanation of compression when difference amount does not exceed threshold 差分量が閾値を超えていない場合の画像配信の説明に用いる説明図Explanatory drawing used for explanation of image distribution when difference amount does not exceed threshold 差分量が閾値を超えている場合の圧縮及び画像配信の説明に用いる説明図Explanatory drawing used for explanation of compression and image distribution when difference amount exceeds threshold 差分量がゼロである場合の画像配信の説明に用いる説明図Explanatory drawing used for explanation of image distribution when difference amount is zero 携帯端末における画像表示の説明に用いる説明図Explanatory drawing used for explanation of image display in portable terminal
 以下、添付図面に従って、本発明の実施形態について、詳細に説明する。 Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
 図1は、PC(パーソナルコンピュータ)1の表示部2を用いてWebページを閲覧している場合と同様に、携帯端末10の表示部14を用いてPC用のWebページを閲覧している様子を示す模式図である。同図に示すように、本実施形態のWebページ閲覧システムによれば、携帯端末10により、PC1用のWebページの閲覧が可能である。 FIG. 1 shows a state in which a PC web page is browsed using the display unit 14 of the mobile terminal 10 in the same manner as when a web page is browsed using the display unit 2 of a PC (personal computer) 1. It is a schematic diagram which shows. As shown in the figure, according to the Web page browsing system of this embodiment, the mobile terminal 10 can browse the Web page for the PC 1.
 図2は、Webページ閲覧システムの一例を示す全体構成図である。同図に示すように、本例のWebページ閲覧システムは、画像を表示可能な携帯端末10と、PC用のWebページを携帯端末10で表示可能な画像に変換し、その画像を携帯端末に対して配信する画像配信サーバ20と、PC用のWebページを提供するWebサーバ30とを含んで構成されている。 FIG. 2 is an overall configuration diagram showing an example of a Web page browsing system. As shown in the figure, the Web page browsing system of this example converts a mobile terminal 10 capable of displaying an image and a Web page for PC into an image that can be displayed on the mobile terminal 10, and converts the image to the mobile terminal. An image distribution server 20 that distributes to a PC and a Web server 30 that provides a Web page for a PC are included.
 携帯端末10は、画像配信サーバ20と通信する通信部11と、プログラムに従って携帯端末10の各部を制御し、各種の処理を実行する処理部12と、ユーザからの指示入力を受け付ける入力部13と、画像を表示可能な表示部14と、各種の情報を記憶するデータベース(DB)15を含んで構成されている。 The mobile terminal 10 includes a communication unit 11 that communicates with the image distribution server 20, a processing unit 12 that controls each unit of the mobile terminal 10 according to a program, executes various processes, and an input unit 13 that receives an instruction input from a user. A display unit 14 capable of displaying an image and a database (DB) 15 for storing various types of information are included.
 携帯端末10と画像配信サーバ20とは、インターネットなどの電気通信回線を介して接続されており、携帯端末10の通信部11と後述する画像配信サーバ20の通信部21とは、電気通信回線を介して、予め決められた通信プロトコルに従って通信を行う。 The portable terminal 10 and the image distribution server 20 are connected via an electric communication line such as the Internet, and the communication unit 11 of the portable terminal 10 and the communication unit 21 of the image distribution server 20 described later are connected via an electric communication line. Via the communication protocol determined in advance.
 処理部12は、通信部11を介して画像配信サーバ20から取得した画像を表示部14に表示させるとともに、入力部13により受け付けたユーザの指示入力に従った処理を実行する。 The processing unit 12 displays an image acquired from the image distribution server 20 via the communication unit 11 on the display unit 14 and executes a process according to a user instruction input received by the input unit 13.
 入力部13は、図示しない電源ボタン、番号キー、十字キー、決定キー等を含み、ユーザは、入力部13を操作することにより、携帯端末10に対して各種の指示入力を行うことができる。表示部14の前面にタッチセンサを配置して、入力部13としてもよい。 The input unit 13 includes a power button, a number key, a cross key, a determination key, and the like (not shown), and the user can input various instructions to the mobile terminal 10 by operating the input unit 13. A touch sensor may be disposed on the front surface of the display unit 14 to serve as the input unit 13.
 表示部14は、画像を表示可能な表示デバイス(例えば液晶表示デバイス)からなり、処理部12から入力された画像信号に基づいて、表示を行う。 The display unit 14 includes a display device (for example, a liquid crystal display device) that can display an image, and performs display based on the image signal input from the processing unit 12.
 画像配信サーバ20は、携帯端末10及びWebサーバ30と通信する通信部21と、携帯端末10で表示可能な画像であってPC用の特定のWebページ(以下「第1のWebページ」という)に対応する非圧縮の画像(以下「第1の非圧縮画像」という)、及び第1の非圧縮画像を後述の圧縮部26によって圧縮した画像(以下「第1の圧縮画像」という)を記憶するデータベース(DB)22と、携帯端末10から閲覧要求されて通信部21によってWebサーバ30から取得されたPC用の任意のWebページ(以下「第2のWebページ」という)を解析する解析部23と、解析部23による第2のWebページの解析結果に基づいて、取得された第2のWebページから携帯端末10で表示可能な画像(以下「第2の非圧縮画像」という)を生成する画像生成部24と、DB22に記憶されている第1の非圧縮画像と画像生成部24によって生成された第2の非圧縮画像とを比較して、第2の非圧縮画像のうちで第1の非圧縮画像とは異なる差分領域の画像を差分画像として第2の非圧縮画像から抽出する差分画像抽出部25と、画像のデータ圧縮を行う圧縮部26と、画像配信サーバ20の各部を制御する制御部29とを含んで構成されている。 The image distribution server 20 includes a communication unit 21 that communicates with the mobile terminal 10 and the Web server 30, and an image that can be displayed on the mobile terminal 10, and a specific Web page for PC (hereinafter referred to as “first Web page”). And an uncompressed image (hereinafter referred to as a “first uncompressed image”) and an image obtained by compressing the first uncompressed image by a later-described compression unit 26 (hereinafter referred to as a “first compressed image”). Database (DB) 22 to be analyzed, and an analysis unit that analyzes an arbitrary Web page for PC (hereinafter referred to as “second Web page”) that is requested to be browsed from the mobile terminal 10 and acquired from the Web server 30 by the communication unit 21. 23 and an image (hereinafter, “second uncompressed image” that can be displayed on the mobile terminal 10 from the acquired second Web page based on the analysis result of the second Web page by the analysis unit 23. And the second uncompressed image by comparing the first uncompressed image stored in the DB 22 with the second uncompressed image generated by the image generating unit 24. A difference image extraction unit 25 that extracts an image of a difference area different from the first uncompressed image from the second uncompressed image as a difference image, a compression unit 26 that performs image data compression, and image distribution And a control unit 29 that controls each unit of the server 20.
 画像配信サーバ20とWebサーバ30とは、インターネットなどの電気通信回線を介して接続され、画像配信サーバ20の通信部21とWebサーバ30の通信部31とは、電気通信回線を介して、予め決められた通信プロトコルに従って通信を行う。 The image distribution server 20 and the Web server 30 are connected via an electric communication line such as the Internet, and the communication unit 21 of the image distribution server 20 and the communication unit 31 of the Web server 30 are connected in advance via an electric communication line. Communication is performed according to a predetermined communication protocol.
 DB22は、例えば公知の読み書き可能なディスクによって構成されており、各種のデータ(情報)を記憶する。本例の制御部29は、DB22の一部を、いわゆるキャッシュとして使用する。 The DB 22 is composed of, for example, a known readable / writable disk, and stores various data (information). The control unit 29 of this example uses a part of the DB 22 as a so-called cache.
 解析部23及び画像生成部24は、例えばCPU(Central Processing Unit)を含んで構成されており、いわゆるWebブラウザ・ソフトウェアを実行させる。画像生成部24は、いわゆるレンダリング処理によって生成されるPC用の画面情報を、画像配信先の携帯端末10で表示可能な画像に変換する画像化処理を実行する。 The analysis unit 23 and the image generation unit 24 are configured to include, for example, a CPU (Central Processing Unit), and execute so-called Web browser software. The image generation unit 24 executes an imaging process for converting PC screen information generated by a so-called rendering process into an image that can be displayed on the mobile terminal 10 that is the image distribution destination.
 差分画像抽出部25及び圧縮部26は、例えばCPUによって構成されている。これらの一部又は全部を電子回路によって構成してもよい。 The difference image extraction unit 25 and the compression unit 26 are constituted by a CPU, for example. A part or all of these may be configured by an electronic circuit.
 圧縮部26による圧縮(エンコード)のフォーマットは、特に限定されないが、例えばJPEG、PNG、GIFが挙げられる。不可逆のフォーマットであってもよい。 The format of compression (encoding) by the compression unit 26 is not particularly limited, and examples thereof include JPEG, PNG, and GIF. An irreversible format may be used.
 制御部29は、CPUによって構成されており、プログラムに従って各種の処理を実行する。 The control unit 29 is constituted by a CPU and executes various processes according to a program.
 次に、制御部29による画像の送信制御処理について、説明する。 Next, image transmission control processing by the control unit 29 will be described.
 携帯端末10に対して圧縮(エンコード)された画像(圧縮画像)を送信する必要がある。よって、画像のサイズが巨大である場合、圧縮の演算処理に時間がかかるため、従来はWebページを取得してから携帯端末10に圧縮画像を送信するまでに多くの時間を要していた。そこで、本実施形態の制御部29は、基本的に、差分画像(第2の非圧縮画像のうちで第1の非圧縮画像とは異なる差分領域の画像である)のみを圧縮部26によって圧縮させるとともに、圧縮された差分画像(圧縮差分画像)と、DB22に記憶されている第1の圧縮画像とを、通信部21によって携帯端末10に送信する。これにより、画像配信サーバ20における圧縮処理の負荷を低減するとともに、第2のWebページを取得してから携帯端末10に画像を配信するまでの所要時間の短縮を図る。 It is necessary to transmit a compressed (encoded) image (compressed image) to the mobile terminal 10. Therefore, when the image size is huge, it takes a long time to perform compression calculation processing. Conventionally, it takes a lot of time from acquiring a Web page to transmitting a compressed image to the mobile terminal 10. Therefore, the control unit 29 of the present embodiment basically compresses only the difference image (the second non-compressed image is a difference region image different from the first non-compressed image) by the compression unit 26. At the same time, the communication unit 21 transmits the compressed difference image (compression difference image) and the first compressed image stored in the DB 22 to the portable terminal 10. This reduces the load of compression processing in the image distribution server 20 and shortens the time required from the acquisition of the second Web page to the distribution of the image to the mobile terminal 10.
 また、制御部29は、携帯端末10から閲覧要求された第2のWebページのURLがDB22に記憶されているか否かを判定して、閲覧要求された第2のWebページのURLがDB22に記憶されていない場合、差分画像の抽出及び圧縮を行わないように制御するとともに、第1の圧縮画像及び圧縮差分画像を携帯端末10に送信しないで、第2のWebページに対応する第2の非圧縮画像を圧縮して生成された第2の圧縮画像を、通信部21によって携帯端末10に送信する制御を行う。 Further, the control unit 29 determines whether or not the URL of the second Web page requested to be browsed from the mobile terminal 10 is stored in the DB 22, and the URL of the second Web page requested to be browsed is stored in the DB 22. If not stored, the second image corresponding to the second Web page is controlled without performing extraction and compression of the difference image and without transmitting the first compressed image and the compressed difference image to the mobile terminal 10. Control is performed to transmit the second compressed image generated by compressing the uncompressed image to the mobile terminal 10 by the communication unit 21.
 また、制御部29は、差分画像抽出部25によって抽出された非圧縮の差分画像のデータ量が閾値を超えるか否かを判定し、非圧縮の差分画像のデータ量が閾値を超える場合、第1の圧縮画像及び圧縮差分画像を携帯端末10に送信しないで、圧縮部26によって第2の非圧縮画像を圧縮して生成された第2の圧縮画像を、通信部21によって携帯端末10に送信する制御を行う。 In addition, the control unit 29 determines whether or not the data amount of the uncompressed difference image extracted by the difference image extraction unit 25 exceeds the threshold value, and if the data amount of the uncompressed difference image exceeds the threshold value, The second compressed image generated by compressing the second uncompressed image by the compression unit 26 is transmitted to the portable terminal 10 by the communication unit 21 without transmitting the compressed image 1 and the compressed difference image of the first to the portable terminal 10. Control.
 また、制御部29は、抽出された非圧縮の差分画像のデータ量がゼロであるか否かを判定し、抽出された非圧縮の差分画像のデータ量がゼロである場合、圧縮差分画像を携帯端末10に送信しないで、DB22に記憶されている第1の圧縮画像のみを通信部21によって携帯端末10に送信する制御を行う。 In addition, the control unit 29 determines whether or not the data amount of the extracted uncompressed difference image is zero. If the data amount of the extracted uncompressed difference image is zero, the control unit 29 determines whether or not the compressed difference image is zero. Control is performed so that only the first compressed image stored in the DB 22 is transmitted to the portable terminal 10 by the communication unit 21 without being transmitted to the portable terminal 10.
 また、本例の制御部29は、第2の非圧縮画像のうちで第1の非圧縮画像とは異なる差分領域の位置情報(以下「差分領域位置情報」という)を算出する差分領域位置情報算出機能を有している。差分領域位置情報は、第2の非圧縮画像上における差分領域の位置を示す。また、本例の制御部29は、圧縮された差分画像(圧縮差分画像)を携帯端末10に対して送信する場合、圧縮された画像(第1の圧縮画像及び圧縮差分画像)とともに、差分領域位置情報を含むメタデータを送信する。したがって、携帯端末10は、第1の圧縮画像及び圧縮差分画像を伸長した後、メタデータ中の差分領域位置情報に基づいて、第1の非圧縮画像に差分画像を容易に重ね合わせることができる。 Further, the control unit 29 of this example calculates difference area position information that calculates position information (hereinafter referred to as “difference area position information”) of the difference area that is different from the first uncompressed image among the second uncompressed images. Has a calculation function. The difference area position information indicates the position of the difference area on the second uncompressed image. Further, when transmitting the compressed difference image (compressed difference image) to the mobile terminal 10, the control unit 29 of the present example, together with the compressed image (first compressed image and compressed difference image), the difference area Send metadata including location information. Therefore, the portable terminal 10 can easily superimpose the difference image on the first uncompressed image based on the difference area position information in the metadata after expanding the first compressed image and the compressed difference image. .
 また、本例の制御部29は、Webページからユーザインタフェース情報(以下「UI情報」という)を抽出して、そのUI情報の第2の非圧縮画像上における位置情報(以下「UI位置情報」という)を算出するUI位置情報算出機能を有している。そして、本例の制御部29は、携帯端末10に対し、圧縮された画像とともに、UI情報及びUI位置情報を含むメタデータを送信する。したがって、携帯端末10は、画像を表示した後、メタデータ中のUI情報及びUI位置情報に基づいて、容易にユーザの入力操作に応じた処理を実行することができる。 In addition, the control unit 29 of the present example extracts user interface information (hereinafter referred to as “UI information”) from the Web page, and the positional information on the second uncompressed image of the UI information (hereinafter referred to as “UI positional information”). UI position information calculation function for calculating And the control part 29 of this example transmits the metadata containing UI information and UI position information with the compressed image with respect to the portable terminal 10. FIG. Therefore, after displaying the image, the mobile terminal 10 can easily execute a process according to the user's input operation based on the UI information and the UI position information in the metadata.
 図3は、シンクライアント型のWebページ閲覧システムにおける処理例の流れを示すフローチャートである。なお、画像配信サーバ20での処理は、制御部29によりプログラムに従って実行される。また、携帯端末10での処理は、処理部12によりプログラムに従って実行される。これらのプログラムはROMなどのコンピュータ読み取り可能な非一時的記録媒体(non-transitory computer-readable medium)に記録されている。 FIG. 3 is a flowchart showing a flow of a processing example in the thin client type Web page browsing system. The processing in the image distribution server 20 is executed by the control unit 29 according to a program. Further, the processing in the mobile terminal 10 is executed by the processing unit 12 according to a program. These programs are recorded on a non-transitory computer-readable medium such as a ROM.
 画像配信サーバ20は、予め、DB22によって、特定のWebページ(第1のWebページ)に対応するキャッシュデータを保持しておく(ステップS2)。 The image distribution server 20 holds cache data corresponding to a specific Web page (first Web page) in advance by the DB 22 (step S2).
 図4に示すように、キャッシュデータ80は、第1のWebページのURL(Uniform Resource Locator)81と、携帯端末10で表示可能な画像であって第1のWebページに対応する第1の非圧縮画像82と、第1の非圧縮画像82を圧縮した画像83(第1の圧縮画像)とを含む。制御部29は、キャッシュデータ80を、DB22に記憶させる。URLは、Webページの所在を示す情報である。制御部29は、URLによりWebページを識別する。 As shown in FIG. 4, the cache data 80 includes a URL (Uniform ResourceatorLocator) 81 of the first Web page and an image that can be displayed on the mobile terminal 10 and corresponds to the first Web page. A compressed image 82 and an image 83 (first compressed image) obtained by compressing the first uncompressed image 82 are included. The control unit 29 stores the cache data 80 in the DB 22. The URL is information indicating the location of the Web page. The control unit 29 identifies the web page by the URL.
 携帯端末10の入力部13は、ユーザから、任意のWebページ(第2のWebページ)のURLの入力を受け付け、携帯端末10の通信部11は、画像配信サーバ20に対し、Webページの閲覧要求を送信する(ステップS4)。閲覧要求には、ユーザから受け付けたURLが付加される。 The input unit 13 of the mobile terminal 10 receives an input of a URL of an arbitrary Web page (second Web page) from the user, and the communication unit 11 of the mobile terminal 10 browses the Web page to the image distribution server 20. A request is transmitted (step S4). The URL received from the user is added to the browsing request.
 制御部29は、通信部21によって携帯端末10からWebページの閲覧リクエストを受信すると、携帯端末10から閲覧要求された第2のWebページを、通信部21によってWebサーバ30から取得する(ステップS6)。 When the communication unit 21 receives a web page browsing request from the mobile terminal 10, the control unit 29 acquires the second web page requested to be browsed from the mobile terminal 10 from the web server 30 by the communication unit 21 (step S6). ).
 次に、画像配信サーバ20は、解析部23によって、取得された第2のWebページの解析を行う(ステップS8)。 Next, the image distribution server 20 analyzes the acquired second Web page by the analysis unit 23 (step S8).
 次に、画像配信サーバ20は、画像生成部24によって、解析部23の解析結果に基づいて、第2のWebページから携帯端末10で表示可能な画像(第2の非圧縮画像)を生成する(ステップS10)。 Next, the image distribution server 20 uses the image generation unit 24 to generate an image (second uncompressed image) that can be displayed on the mobile terminal 10 from the second Web page based on the analysis result of the analysis unit 23. (Step S10).
 次に、制御部29は、第2のWebページに対応するキャッシュデータが存在するか否かを判定する(ステップS12)。本例では、図5に示すように、制御部29は、携帯端末10から閲覧要求されたWebページのURL(本例ではhttp://www.site1.co.jp)が、DB22に記憶されているか(キャッシュデータ80中に存在するか)否かを判定することにより、第2のWebページに対応する第1の非圧縮画像及び第1の圧縮画像の存在の有無を確認する。なお、URLにクエリが付加されていた場合、そのクエリを無視するか否かは、DB22に設定可能である。 Next, the control unit 29 determines whether or not cache data corresponding to the second Web page exists (step S12). In this example, as shown in FIG. 5, the control unit 29 stores the URL (http://www.site1.co.jp in this example) of the Web page requested to be browsed from the mobile terminal 10 in the DB 22. Whether or not the first uncompressed image and the first compressed image corresponding to the second Web page exist is determined by determining whether or not the image is present (existing in the cache data 80). Note that if a query is added to the URL, whether to ignore the query can be set in the DB 22.
 第2のWebページに対応するキャッシュデータが存在する場合、差分画像抽出部25は、図6に示すように、DB22に記憶されている第1の非圧縮画像82と、画像生成部24によって生成された第2の非圧縮画像84とを比較して、第2の非圧縮画像84のちで第1の非圧縮画像82とは異なる差分領域86(86a,86b,86c)の画像を第2の非圧縮画像84から差分画像として抽出する(ステップS14)。第2のWebページに対応するキャッシュデータが存在しない場合、ステップS24に進む。 When cache data corresponding to the second Web page exists, the difference image extraction unit 25 generates the first uncompressed image 82 stored in the DB 22 and the image generation unit 24 as shown in FIG. Compared with the second uncompressed image 84, the second uncompressed image 84 and an image of the difference area 86 (86a, 86b, 86c) different from the first uncompressed image 82 are A difference image is extracted from the uncompressed image 84 (step S14). If there is no cache data corresponding to the second Web page, the process proceeds to step S24.
 差分画像抽出部25によって非圧縮の画像間で比較を行うため、伸長の必要がなく、圧縮のフォーマットは不可逆であってもよいし、単純に各ピクセル(画素)ごとで比較を行えばよい。本例の差分画像抽出部25は、第2の非圧縮画像のうちで第1の非圧縮画像と一致しないピクセルの連続した領域を、差分領域86(86a、86b、86c)と判定する。 Since the difference image extraction unit 25 performs comparison between uncompressed images, there is no need for decompression, the compression format may be irreversible, or the comparison may be simply performed for each pixel (pixel). The difference image extraction unit 25 of this example determines a continuous area of pixels that do not match the first uncompressed image in the second uncompressed image as a difference area 86 (86a, 86b, 86c).
 なお、図7に示すように、差分領域86が矩形でない場合、差分画像抽出部25は、その差分領域86が内接する矩形領域を検出し、この矩形領域内の画像を差分画像87として第2の非圧縮画像84から抽出してもよい。 As shown in FIG. 7, when the difference area 86 is not rectangular, the difference image extraction unit 25 detects a rectangular area inscribed by the difference area 86, and uses the image in this rectangular area as a difference image 87 to generate a second image. The uncompressed image 84 may be extracted.
 また、差分画像抽出部25は、第2の非圧縮画像84における差分領域86の座標(差分領域位置情報)を算出(取得)して、その位置情報を携帯端末10に対して送信するメタデータの一部とする。差分画像抽出部25は、差分領域86が矩形である場合、例えば矩形の始点座標(左上座標)及び終点座標(右下座標)の二つを取得すればよい。差分領域86の位置情報は、第2の非圧縮画像84における差分領域86の位置(及び第1の非圧縮画像82における差分領域86の位置)を示す。 Further, the difference image extraction unit 25 calculates (acquires) the coordinates (difference area position information) of the difference area 86 in the second uncompressed image 84 and transmits the position information to the mobile terminal 10. As part of When the difference area 86 is a rectangle, the difference image extraction unit 25 may acquire, for example, two of the rectangle start point coordinates (upper left coordinates) and end point coordinates (lower right coordinates). The position information of the difference area 86 indicates the position of the difference area 86 in the second uncompressed image 84 (and the position of the difference area 86 in the first uncompressed image 82).
 次に、制御部29は、抽出された差分領域86(86a、86b、86c)の画像(差分画像)のデータ量(差分量)が閾値を超えているか否かを判定する(ステップS16)。 Next, the control unit 29 determines whether or not the data amount (difference amount) of the image (difference image) of the extracted difference region 86 (86a, 86b, 86c) exceeds a threshold value (step S16).
 本例の制御部29は、差分量として、第2の非圧縮画像84のうちで差分領域86の大きさ(面積)を算出する。例えば、制御部29は、面積として、差分領域86内のピクセル数(画素数)の総和をカウントすればよい。図6に示す例では、制御部29は、符号86a、86b、86cの各差分領域の面積の和を算出し、その和を、画像配信サーバ20のDB22に予め設定された閾値と比較する。例えば、制御部29は、閾値として、第2の非圧縮画像84の面積の20%を閾値として設定する。制御部29は、単純に画素数を閾値として設定してもよい。ただし、制御部29は、閾値以下であれば、第2の非圧縮画像84の全体を圧縮(エンコード)するよりも、差分画像(図8の87a、87b、87c)のみを圧縮(エンコード)した方が、画像配信サーバ20での処理時間(演算量)が少なくなるように、閾値を設定する必要がある。 The control unit 29 of this example calculates the size (area) of the difference area 86 in the second uncompressed image 84 as the difference amount. For example, the control unit 29 may count the total number of pixels (number of pixels) in the difference area 86 as the area. In the example illustrated in FIG. 6, the control unit 29 calculates the sum of the areas of the difference regions denoted by reference numerals 86 a, 86 b, and 86 c and compares the sum with a threshold set in advance in the DB 22 of the image distribution server 20. For example, the control unit 29 sets 20% of the area of the second uncompressed image 84 as the threshold value. The control unit 29 may simply set the number of pixels as a threshold value. However, the control unit 29 compresses (encodes) only the difference images (87a, 87b, and 87c in FIG. 8) rather than compressing (encoding) the entire second uncompressed image 84 if it is equal to or less than the threshold value. However, it is necessary to set a threshold value so that the processing time (calculation amount) in the image distribution server 20 is reduced.
 前記差分量が閾値を超えていない(差分量≦閾値である)場合、制御部29は、さらに前記差分量がゼロであるか否かを判定し(ステップS18)。前記差分量がゼロではない(0<差分量≦閾値である)場合、図8に示すように、制御部29は、第2の非圧縮画像84のうちで差分領域86a、86b、86cの画像(差分画像87a、87b、87c)のみを、画像配信サーバ20の圧縮部26によってそれぞれ圧縮し、圧縮された差分画像88a、88b、88cを生成する(ステップS20)。 If the difference amount does not exceed the threshold value (difference amount ≦ threshold value), the control unit 29 further determines whether or not the difference amount is zero (step S18). When the difference amount is not zero (0 <difference amount ≦ threshold value), as shown in FIG. 8, the control unit 29 includes images of the difference areas 86 a, 86 b, 86 c in the second uncompressed image 84. Only the difference images 87a, 87b, 87c are compressed by the compression unit 26 of the image distribution server 20, respectively, and compressed difference images 88a, 88b, 88c are generated (step S20).
 そして、図9に示すように、画像配信サーバ20は、DB22に記憶されている第1の圧縮画像83と、圧縮された差分画像88(88a、88b、88c)と、メタデータ89とを、通信部21によって携帯端末10に送信する(ステップS22)。メタデータ89は、第2の非圧縮画像における差分領域86(86a、86b、86c)の座標位置を記述した差分領域位置情報を含む。即ち、メタデータ89は、第1の非圧縮画像83における差分領域86の座標位置を記述した差分領域位置情報を含む。 Then, as shown in FIG. 9, the image distribution server 20 stores the first compressed image 83 stored in the DB 22, the compressed difference image 88 (88 a, 88 b, 88 c), and the metadata 89. It transmits to the portable terminal 10 by the communication part 21 (step S22). The metadata 89 includes difference area position information describing the coordinate position of the difference area 86 (86a, 86b, 86c) in the second uncompressed image. That is, the metadata 89 includes difference area position information describing the coordinate position of the difference area 86 in the first uncompressed image 83.
 画像配信サーバ20は、前記差分量が閾値を超えている場合、図10に示すように、画像生成部24によって生成された第2の非圧縮画像84の全てを圧縮部26によって圧縮し(ステップS24)、圧縮により生成された第2の圧縮画像85を、通信部21によって携帯端末10に送信する(ステップS26)。 When the difference amount exceeds the threshold value, the image distribution server 20 compresses all the second uncompressed images 84 generated by the image generation unit 24 by the compression unit 26 as shown in FIG. S24) The second compressed image 85 generated by the compression is transmitted to the mobile terminal 10 by the communication unit 21 (step S26).
 画像配信サーバ20は、前記差分量がゼロである場合、図11に示すように、DB22に記憶されている第1の圧縮画像83を、通信部21によって携帯端末10に送信する(ステップS28)。 When the difference amount is zero, the image distribution server 20 transmits the first compressed image 83 stored in the DB 22 to the mobile terminal 10 by the communication unit 21 as shown in FIG. 11 (step S28). .
 携帯端末10は、画像配信サーバ20から受信した画像を伸長し、図12に示すように、携帯端末10の表示部14に、伸長された画像を表示する(ステップS30)。携帯端末10は、画像配信サーバ20から、第1の圧縮画像83と圧縮された差分画像88とを受信した場合には、図12に示すように、第1の非圧縮画像82の全表示領域のうちで、メタデータの差分領域位置情報によって指定された差分領域86a、86b、86cを、伸長した差分画像87a、87b、87cで上書きして、表示する。 The mobile terminal 10 expands the image received from the image distribution server 20, and displays the expanded image on the display unit 14 of the mobile terminal 10 as shown in FIG. 12 (step S30). When the mobile terminal 10 receives the first compressed image 83 and the compressed difference image 88 from the image distribution server 20, as shown in FIG. 12, the entire display area of the first uncompressed image 82 is displayed. Of these, the difference areas 86a, 86b, 86c designated by the difference area position information of the metadata are overwritten with the expanded difference images 87a, 87b, 87c and displayed.
 なお、DB22にキャッシュデータとして保持しておく画像(第1の非圧縮画像及び第1の圧縮画像)は、固定でなくてもよい。 Note that the images (first uncompressed image and first compressed image) stored as cache data in the DB 22 may not be fixed.
 第1に、画像配信サーバ20が、携帯端末10から受信したWebページの閲覧要求の履歴(通信ログ)をDB22に記憶(保持)させておき、制御部29により、その履歴に基づいて、DB22にキャッシュデータとして記憶(保持)させておく画像を決定する態様がある。例えば、制御部29は、Webページの所在を示すURLを含む履歴をDB22に生成し、履歴中のURLに基づいて、携帯端末10から閲覧要求の数が多かった順に一定数のWebページ(又はサイト)を選択し、選択した複数のWebページ(又はサイト)にそれぞれ対応する画像を、第1の非圧縮画像82としてDB22に記憶させておく。 First, the image distribution server 20 stores (holds) the browsing request history (communication log) of the Web page received from the mobile terminal 10 in the DB 22, and the control unit 29 determines the DB 22 based on the history. There is a mode of determining an image to be stored (held) as cache data. For example, the control unit 29 generates a history including a URL indicating the location of the web page in the DB 22, and based on the URL in the history, a certain number of web pages (or in the order in which the number of browsing requests from the mobile terminal 10 is large) Site) is selected, and images corresponding to the selected plurality of Web pages (or sites) are stored in the DB 22 as first uncompressed images 82, respectively.
 第2に、画像配信サーバ20が、画像配信サーバ20のDB22に特定のURLを設定情報として予め記憶(設定)しておき、その設定情報(URL)に対応した画像をDB22に記憶(保持)しておく態様がある。 Second, the image distribution server 20 stores (sets) a specific URL as setting information in the DB 22 of the image distribution server 20 in advance, and stores (holds) an image corresponding to the setting information (URL) in the DB 22. There is a mode to keep.
 また、キャッシュデータの保持を開始するタイミングは、特に限定されない。例えば、システムが稼動を開始して、一定時間が経過したときに、キャッシュデータの保持を開始する。 Also, the timing for starting the retention of cache data is not particularly limited. For example, holding of cache data is started when a certain time has elapsed since the system started operation.
 本発明は、本明細書において説明した例や図面に図示された例には限定されず、本発明の要旨を逸脱しない範囲において、各種の設計変更や改良を行ってよいのはもちろんである。 The present invention is not limited to the examples described in the present specification and the examples illustrated in the drawings, and various design changes and improvements may be made without departing from the scope of the present invention.
 本明細書には、以下の発明が開示されている。 This specification discloses the following inventions.
 発明1:携帯端末で表示可能な第1の非圧縮画像であって特定のWebページに対応する第1の非圧縮画像と前記第1の非圧縮画像を圧縮した第1の圧縮画像とを記憶する記憶手段と、前記携帯端末からWebページの閲覧要求を受信する通信手段と、前記携帯端末から閲覧要求されたWebページを取得するWebページ取得手段と、前記Webページ取得手段によって取得されたWebページを解析する解析手段と、前記解析手段による解析結果に基づいて、前記取得されたWebページから前記携帯端末で表示可能な第2の非圧縮画像を生成する画像生成手段と、前記記憶手段に記憶されている前記第1の非圧縮画像と、前記画像生成手段によって生成された前記第2の非圧縮画像とを比較して、前記第2の非圧縮画像のうちで前記第1の非圧縮画像とは異なる差分領域の画像を差分画像として前記第2の非圧縮画像から抽出する差分画像抽出手段と、前記差分画像抽出手段によって抽出された差分画像を圧縮する圧縮手段と、前記記憶手段に記憶されている前記第1の圧縮画像と、前記圧縮手段によって圧縮された差分画像とを、前記通信手段によって前記携帯端末に送信する制御を行う制御手段と、を備えた画像配信サーバ。 Invention 1: A first non-compressed image that can be displayed on a mobile terminal and stores a first non-compressed image corresponding to a specific Web page and a first compressed image obtained by compressing the first non-compressed image Storage means, a communication means for receiving a web page browsing request from the portable terminal, a web page obtaining means for obtaining a web page requested to be browsed from the portable terminal, and a web acquired by the web page acquiring means. Analysis means for analyzing a page, image generation means for generating a second uncompressed image that can be displayed on the mobile terminal from the acquired Web page based on the analysis result by the analysis means, and storage means The stored first uncompressed image is compared with the second uncompressed image generated by the image generating means, and the second uncompressed image is compared with the second uncompressed image. Differential image extraction means for extracting an image of a difference area different from the one uncompressed image from the second uncompressed image as a difference image; compression means for compressing the difference image extracted by the difference image extraction means; Image distribution comprising: control means for controlling the first compressed image stored in the storage means and the difference image compressed by the compression means to be transmitted to the portable terminal by the communication means server.
 発明2:前記記憶手段は、前記特定のWebページの所在を示すURLを前記特定のWebページと関連付けて記憶し、前記制御手段は、前記携帯端末から閲覧要求されたWebページのURLが前記記憶手段に記憶されているか否かを判定して、前記閲覧要求されたWebページのURLが前記記憶手段に記憶されていない場合、前記差分画像の抽出及び圧縮を行わないように制御するとともに、前記第1の圧縮画像及び前記圧縮された差分画像を前記携帯端末に送信しないで、前記圧縮手段によって前記第2の非圧縮画像を圧縮して生成された第2の圧縮画像を前記通信手段によって前記携帯端末に送信する制御を行う発明1に記載の画像配信サーバ。 Invention 2: The storage means stores a URL indicating the location of the specific Web page in association with the specific Web page, and the control means stores the URL of the Web page requested to be browsed from the portable terminal. It is determined whether or not the URL of the web page requested to be browsed is not stored in the storage unit, and control is performed so as not to extract and compress the difference image. The second compressed image generated by compressing the second non-compressed image by the compression unit without transmitting the first compressed image and the compressed difference image to the portable terminal is transmitted by the communication unit. The image delivery server according to claim 1, wherein the image delivery server performs control of transmission to a portable terminal.
 発明3:前記制御手段は、前記差分画像抽出手段によって抽出された差分画像のデータ量が閾値を超えるか否かを判定し、前記抽出された差分画像のデータ量が閾値を超える場合、前記差分画像の圧縮を行わないように制御するとともに、前記第1の圧縮画像及び前記圧縮された差分画像を前記携帯端末に送信しないで、前記圧縮手段によって前記第2の非圧縮画像を圧縮して生成された第2の圧縮画像を前記通信手段によって前記携帯端末に送信する制御を行う発明1または2に記載の画像配信サーバ。 Invention 3: The control means determines whether or not the data amount of the difference image extracted by the difference image extraction means exceeds a threshold. If the data amount of the extracted difference image exceeds the threshold, the difference Control is performed so as not to compress the image, and the second uncompressed image is generated by compressing the second uncompressed image by the compression means without transmitting the first compressed image and the compressed difference image to the portable terminal. The image distribution server according to claim 1 or 2, wherein control is performed to transmit the second compressed image that has been performed to the portable terminal by the communication unit.
 発明4:前記制御手段は、前記抽出された差分画像のデータ量がゼロであるか否かを判定し、前記抽出された差分画像のデータ量がゼロである場合、前記圧縮された差分画像を前記携帯端末に送信しない発明3に記載に画像配信サーバ。 Invention 4: The control means determines whether or not the data amount of the extracted difference image is zero, and if the data amount of the extracted difference image is zero, the control unit determines the compressed difference image The image distribution server according to claim 3, wherein the image distribution server is not transmitted to the portable terminal.
 発明5:前記制御手段は、前記圧縮された差分画像を前記携帯端末に対して送信する場合、前記第2の非圧縮画像のうちで前記第1の非圧縮画像とは異なる差分領域の位置情報を、前記通信手段によって前記携帯端末に送信する発明1または2に記載の画像配信サーバ。 Invention 5: When the said control means transmits the said compressed difference image with respect to the said portable terminal, the positional information on the difference area different from a said 1st uncompressed image among the said 2nd uncompressed image The image delivery server according to claim 1 or 2, wherein the communication means transmits the information to the portable terminal.
 発明6:前記差分画像抽出手段は、前記差分領域が矩形ではない場合、前記差分領域が内接する矩形領域を検出し、この矩形領域の画像を前記差分画像として前記第2の非圧縮画像から抽出する発明1から5のうちいずれか1項に記載の画像配信サーバ。 Invention 6: When the difference area is not rectangular, the difference image extraction means detects a rectangular area inscribed by the difference area, and extracts the image of the rectangular area as the difference image from the second uncompressed image. 6. The image delivery server according to any one of inventions 1 to 5.
 発明7:前記記憶手段は、前記携帯端末から受信したWebページの閲覧要求の履歴を保持し、前記制御手段は、前記履歴に基づいて、前記記憶手段に記憶させておく前記第1の非圧縮画像を決定する発明1から6のうちいずれか1項に記載の画像配信サーバ。 Invention 7: The storage means stores a history of browsing requests for Web pages received from the portable terminal, and the control means stores the first uncompressed information stored in the storage means based on the history. 7. The image distribution server according to any one of inventions 1 to 6 for determining an image.
 発明8~14:発明1~発明7にそれぞれ対応する方法発明。 Inventions 8 to 14: Method inventions corresponding to Inventions 1 to 7, respectively.
 発明15~21:発明8~発明14にそれぞれ対応するプログラムの発明。前記プログラムの発明は、各種の記録媒体に記録して、提供することができる。 Inventions 15 to 21: Inventions of programs corresponding to Inventions 8 to 14, respectively. The invention of the program can be provided by being recorded on various recording media.
 10…携帯端末、20…画像配信サーバ、21…通信部、22…DB、23…解析部、24…画像生成部、25…差分画像抽出部、26…圧縮部、29…制御部、30…Webサーバ、80…キャッシュデータ、81…URL、82…第1の非圧縮画像、83…圧縮された第1の非圧縮画像(第1の圧縮画像)、84…第2の非圧縮画像、85…圧縮された第2の非圧縮画像(第2の圧縮画像)、86(86a、86b、86c)…差分領域、87(87a、87b、87c)…差分画像、88(88a、88b、88c)…圧縮された差分画像(圧縮差分画像) DESCRIPTION OF SYMBOLS 10 ... Portable terminal, 20 ... Image delivery server, 21 ... Communication part, 22 ... DB, 23 ... Analysis part, 24 ... Image generation part, 25 ... Difference image extraction part, 26 ... Compression part, 29 ... Control part, 30 ... Web server, 80 ... cache data, 81 ... URL, 82 ... first uncompressed image, 83 ... compressed first non-compressed image (first compressed image), 84 ... second uncompressed image, 85 ... compressed second uncompressed image (second compressed image), 86 (86a, 86b, 86c) ... difference area, 87 (87a, 87b, 87c) ... difference image, 88 (88a, 88b, 88c) ... compressed differential image (compressed differential image)

Claims (12)

  1.  携帯端末で表示可能な第1の非圧縮画像であって特定のWebページに対応する第1の非圧縮画像と前記第1の非圧縮画像を圧縮した第1の圧縮画像とを記憶する記憶手段と、
     前記携帯端末からWebページの閲覧要求を受信する通信手段と、
     前記携帯端末から閲覧要求されたWebページを取得するWebページ取得手段と、
     前記Webページ取得手段によって取得されたWebページを解析する解析手段と、
     前記解析手段による解析結果に基づいて、前記取得されたWebページから前記携帯端末で表示可能な第2の非圧縮画像を生成する画像生成手段と、
     前記記憶手段に記憶されている前記第1の非圧縮画像と、前記画像生成手段によって生成された前記第2の非圧縮画像とを比較して、前記第2の非圧縮画像のうちで前記第1の非圧縮画像とは異なる差分領域の画像を差分画像として前記第2の非圧縮画像から抽出する差分画像抽出手段と、
     前記差分画像抽出手段によって抽出された差分画像を圧縮する圧縮手段と、
     前記記憶手段に記憶されている前記第1の圧縮画像と、前記圧縮手段によって圧縮された差分画像とを、前記通信手段によって前記携帯端末に送信する制御を行う制御手段と、
     を備えた画像配信サーバ。
    Storage means for storing a first non-compressed image that can be displayed on a portable terminal and corresponding to a specific Web page, and a first compressed image obtained by compressing the first non-compressed image When,
    Communication means for receiving a web page browsing request from the portable terminal;
    Web page acquisition means for acquiring a Web page requested to be browsed from the mobile terminal;
    Analyzing means for analyzing the Web page acquired by the Web page acquiring means;
    Image generating means for generating a second uncompressed image that can be displayed on the mobile terminal from the acquired web page based on the analysis result by the analyzing means;
    The first uncompressed image stored in the storage unit is compared with the second uncompressed image generated by the image generation unit, and the first uncompressed image among the second uncompressed images is compared. Differential image extraction means for extracting, from the second non-compressed image, an image of a difference area different from the one uncompressed image as a differential image;
    Compression means for compressing the difference image extracted by the difference image extraction means;
    Control means for performing control to transmit the first compressed image stored in the storage means and the difference image compressed by the compression means to the portable terminal by the communication means;
    An image distribution server with
  2.  前記記憶手段は、前記特定のWebページの所在を示すURLを前記特定のWebページと関連付けて記憶し、
     前記制御手段は、前記携帯端末から閲覧要求されたWebページのURLが前記記憶手段に記憶されているか否かを判定して、前記閲覧要求されたWebページのURLが前記記憶手段に記憶されていない場合、前記差分画像の抽出及び圧縮を行わないように制御するとともに、前記第1の圧縮画像及び前記圧縮された差分画像を前記携帯端末に送信しないで、前記圧縮手段によって前記第2の非圧縮画像を圧縮して生成された第2の圧縮画像を前記通信手段によって前記携帯端末に送信する制御を行う請求項1に記載の画像配信サーバ。
    The storage means stores a URL indicating the location of the specific Web page in association with the specific Web page;
    The control means determines whether or not the URL of the web page requested to be browsed from the portable terminal is stored in the storage means, and the URL of the web page requested to be browsed is stored in the storage means. If not, control is performed so as not to extract and compress the difference image, and the second compressed image is not transmitted to the portable terminal without transmitting the first compressed image and the compressed difference image. The image distribution server according to claim 1, wherein control is performed to transmit the second compressed image generated by compressing the compressed image to the portable terminal by the communication unit.
  3.  前記制御手段は、前記差分画像抽出手段によって抽出された差分画像のデータ量が閾値を超えるか否かを判定し、前記抽出された差分画像のデータ量が閾値を超える場合、前記差分画像の圧縮を行わないように制御するとともに、前記第1の圧縮画像及び前記圧縮された差分画像を前記携帯端末に送信しないで、前記圧縮手段によって前記第2の非圧縮画像を圧縮して生成された第2の圧縮画像を前記通信手段によって前記携帯端末に送信する制御を行う請求項1または2に記載の画像配信サーバ。 The control unit determines whether or not the data amount of the difference image extracted by the difference image extraction unit exceeds a threshold value. If the data amount of the extracted difference image exceeds a threshold value, the control unit compresses the difference image. The first non-compressed image is generated by compressing the second non-compressed image by the compression means without transmitting the first compressed image and the compressed difference image to the portable terminal. The image distribution server according to claim 1, wherein control is performed to transmit the two compressed images to the portable terminal by the communication unit.
  4.  前記制御手段は、前記抽出された差分画像のデータ量がゼロであるか否かを判定し、前記抽出された差分画像のデータ量がゼロである場合、前記圧縮された差分画像を前記携帯端末に送信しない請求項3に記載に画像配信サーバ。 The control means determines whether or not the amount of data of the extracted difference image is zero, and when the amount of data of the extracted difference image is zero, the compressed difference image is displayed as the portable terminal. The image distribution server according to claim 3, wherein the image distribution server is not transmitted to the server.
  5.  前記制御手段は、前記圧縮された差分画像を前記携帯端末に対して送信する場合、前記第2の非圧縮画像のうちで前記第1の非圧縮画像とは異なる差分領域の位置情報を、前記通信手段によって前記携帯端末に送信する請求項1または2に記載の画像配信サーバ。 The control means, when transmitting the compressed difference image to the mobile terminal, position information of the difference area different from the first uncompressed image among the second uncompressed image, The image distribution server according to claim 1, wherein the image distribution server transmits the information to the portable terminal by communication means.
  6.  前記差分画像抽出手段は、前記差分領域が矩形ではない場合、前記差分領域が内接する矩形領域を検出し、この矩形領域の画像を前記差分画像として前記第2の非圧縮画像から抽出する請求項1から5のうちいずれか1項に記載の画像配信サーバ。 The difference image extraction means detects a rectangular area inscribed by the difference area when the difference area is not rectangular, and extracts an image of the rectangular area as the difference image from the second uncompressed image. The image delivery server according to any one of 1 to 5.
  7.  前記記憶手段は、前記携帯端末から受信したWebページの閲覧要求の履歴を保持し、
     前記制御手段は、前記履歴に基づいて、前記記憶手段に記憶させておく前記第1の非圧縮画像を決定する請求項1から6のうちいずれか1項に記載の画像配信サーバ。
    The storage means holds a history of browsing requests for web pages received from the mobile terminal,
    The image delivery server according to any one of claims 1 to 6, wherein the control unit determines the first uncompressed image to be stored in the storage unit based on the history.
  8.  通信手段及び記憶手段を用いる画像配信制御方法であって、
     演算装置が、
     前記携帯端末で表示可能な第1の非圧縮画像であって特定のWebページに対応する第1の非圧縮画像と前記第1の非圧縮画像を圧縮した第1の圧縮画像とを前記記憶手段に記憶させるステップと、
     前記通信手段によって前記携帯端末からWebページの閲覧要求を受信するステップと、
     前記携帯端末から閲覧要求されたWebページを取得するステップと、
     取得された前記Webページを解析するステップと、
     前記Webページの解析結果に基づいて、前記取得されたWebページから前記携帯端末で表示可能な第2の非圧縮画像を生成するステップと、
     前記記憶手段に記憶されている前記第1の非圧縮画像と、生成された前記第2の非圧縮画像とを比較して、前記第2の非圧縮画像のうちで前記第1の非圧縮画像とは異なる差分領域の画像を差分画像として前記第2の非圧縮画像から抽出するステップと、
     抽出された差分画像を圧縮するステップと、
     前記記憶手段に記憶されている前記第1の圧縮画像と、圧縮された差分画像とを、前記通信手段によって前記携帯端末に送信するステップと、
     を実行する画像配信制御方法。
    An image distribution control method using communication means and storage means,
    Arithmetic unit is
    A first uncompressed image that can be displayed on the portable terminal and corresponds to a specific Web page, and a first compressed image obtained by compressing the first uncompressed image is stored in the storage unit. Memorizing steps,
    Receiving a web page browsing request from the portable terminal by the communication means;
    Obtaining a web page requested to be browsed from the mobile terminal;
    Analyzing the acquired web page;
    Generating a second uncompressed image that can be displayed on the mobile terminal from the acquired Web page based on the analysis result of the Web page;
    The first uncompressed image stored in the storage unit is compared with the generated second uncompressed image, and the first uncompressed image among the second uncompressed images. Extracting an image of a difference area different from the second uncompressed image as a difference image;
    Compressing the extracted difference image;
    Transmitting the first compressed image stored in the storage unit and the compressed difference image to the portable terminal by the communication unit;
    An image delivery control method for executing.
  9.  演算装置が、
     前記特定のWebページの所在を示すURLを前記特定のWebページと関連付けて記憶させるステップと、
     前記携帯端末から閲覧要求されたWebページのURLが前記記憶手段に記憶されているか否かを判定するステップと、
     前記第2の非圧縮画像を圧縮して第2の圧縮画像を生成するステップと、
     前記閲覧要求されたWebページのURLが前記記憶手段に記憶されていない場合、前記第1の圧縮画像及び前記圧縮された差分画像を前記携帯端末に送信しないで、前記第2の圧縮画像を前記通信手段によって前記携帯端末に送信するステップと、
     を実行する請求項8に記載の画像配信制御方法。
    Arithmetic unit is
    Storing a URL indicating the location of the specific Web page in association with the specific Web page;
    Determining whether the URL of the web page requested to be browsed from the portable terminal is stored in the storage means;
    Compressing the second uncompressed image to generate a second compressed image;
    If the URL of the web page requested to be browsed is not stored in the storage unit, the second compressed image is not transmitted to the portable terminal without transmitting the first compressed image and the compressed difference image. Transmitting to the portable terminal by communication means;
    The image delivery control method according to claim 8, wherein:
  10.  演算装置が、
     前記抽出された差分画像のデータ量が閾値を超えるか否かを判定するステップと、
     前記第2の非圧縮画像を圧縮して第2の圧縮画像を生成するステップと、
     前記抽出された差分画像のデータ量が閾値を超える場合、前記第1の圧縮画像及び前記圧縮された差分画像を前記携帯端末に送信しないで、前記第2の圧縮画像を前記通信手段によって前記携帯端末に送信するステップと、
     を実行する請求項8または9に記載の画像配信制御方法。
    Arithmetic unit is
    Determining whether the data amount of the extracted difference image exceeds a threshold;
    Compressing the second uncompressed image to generate a second compressed image;
    When the data amount of the extracted difference image exceeds a threshold value, the second compressed image is transmitted to the portable terminal by the communication means without transmitting the first compressed image and the compressed difference image to the portable terminal. Sending to the device;
    The image delivery control method according to claim 8 or 9, wherein:
  11.  演算装置が、
     前記抽出された差分画像のデータ量がゼロであるか否かを判定するステップと、
     前記抽出された差分画像のデータ量がゼロである場合、前記圧縮された差分画像を前記携帯端末に送信しないステップと、
     を実行する請求項10に記載の画像配信制御方法。
    Arithmetic unit is
    Determining whether the data amount of the extracted difference image is zero;
    If the data amount of the extracted difference image is zero, not transmitting the compressed difference image to the mobile terminal;
    The image delivery control method according to claim 10, wherein:
  12.  請求項8から11のうちいずれか1項に記載の画像配信制御方法を演算装置に実行させるプログラムを記録したコンピュータ読み取り可能な記録媒体。 A computer-readable recording medium storing a program for causing an arithmetic device to execute the image delivery control method according to any one of claims 8 to 11.
PCT/JP2012/060221 2011-05-31 2012-04-16 Image distribution server and image distribution control method WO2012165066A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2011-122293 2011-05-31
JP2011122293A JP2012252381A (en) 2011-05-31 2011-05-31 Image distribution server, image distribution control method, and program

Publications (1)

Publication Number Publication Date
WO2012165066A1 true WO2012165066A1 (en) 2012-12-06

Family

ID=47258930

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/060221 WO2012165066A1 (en) 2011-05-31 2012-04-16 Image distribution server and image distribution control method

Country Status (2)

Country Link
JP (1) JP2012252381A (en)
WO (1) WO2012165066A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106484735A (en) * 2015-09-01 2017-03-08 天脉聚源(北京)科技有限公司 The method and system that a kind of Web page picture self adaptation mobile terminal shows
CN110035309A (en) * 2017-12-25 2019-07-19 古野电气株式会社 Playing device, remote playing system, playback method and recording medium

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5270790B1 (en) 2012-05-30 2013-08-21 富士フイルム株式会社 Radiation image capturing apparatus, radiation image capturing system, control program for radiation image capturing apparatus, and control method for radiation image capturing apparatus
JP6007795B2 (en) * 2013-01-07 2016-10-12 富士通株式会社 Communication apparatus and communication control method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004220260A (en) * 2003-01-14 2004-08-05 Nec Access Technica Ltd Web page browsing system and image distribution server
JP2004246565A (en) * 2003-02-13 2004-09-02 Nec Access Technica Ltd Simple home page browsing system by image display terminal
JP2005107662A (en) * 2003-09-29 2005-04-21 Hitachi Software Eng Co Ltd Www system processing method and system
JP2007094586A (en) * 2005-09-27 2007-04-12 Nec Corp Data providing system, data providing method, server, network system and program
JP2007524286A (en) * 2003-12-16 2007-08-23 インフォーカス コーポレイション System and method for processing image data

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004220260A (en) * 2003-01-14 2004-08-05 Nec Access Technica Ltd Web page browsing system and image distribution server
JP2004246565A (en) * 2003-02-13 2004-09-02 Nec Access Technica Ltd Simple home page browsing system by image display terminal
JP2005107662A (en) * 2003-09-29 2005-04-21 Hitachi Software Eng Co Ltd Www system processing method and system
JP2007524286A (en) * 2003-12-16 2007-08-23 インフォーカス コーポレイション System and method for processing image data
JP2007094586A (en) * 2005-09-27 2007-04-12 Nec Corp Data providing system, data providing method, server, network system and program

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106484735A (en) * 2015-09-01 2017-03-08 天脉聚源(北京)科技有限公司 The method and system that a kind of Web page picture self adaptation mobile terminal shows
CN110035309A (en) * 2017-12-25 2019-07-19 古野电气株式会社 Playing device, remote playing system, playback method and recording medium
CN110035309B (en) * 2017-12-25 2022-05-03 古野电气株式会社 Playback device, remote playback system, playback method, and recording medium

Also Published As

Publication number Publication date
JP2012252381A (en) 2012-12-20

Similar Documents

Publication Publication Date Title
KR101219228B1 (en) System and method for delivering informaiton using image code
US11470387B2 (en) Methods, systems, and media for remote rendering of Web content on a television device
JP5335632B2 (en) Web page browsing system, server, web page browsing method and program
US9690778B2 (en) Information processing system, control method for information processing system, information processing device, control method for information processing device, information storage medium, and program
US9117314B2 (en) Information output apparatus, method, and recording medium for displaying information on a video display
US20170168997A1 (en) System and computer-implemented method for incorporating an image into a page of content for transmission from a web-site
WO2013161104A1 (en) Image display system, image display method, image display program, and computer-readable recording medium storing said program
JP2012133586A (en) Display device, screen image transfer method and program
WO2012165066A1 (en) Image distribution server and image distribution control method
JP2011060215A5 (en)
US20140115445A1 (en) Web page viewing server, web page viewing system, and web page viewing method
JP2004220260A (en) Web page browsing system and image distribution server
JP5279793B2 (en) Mobile terminal, mobile terminal control method and program
US10509826B2 (en) Server device, client device, information processing method, and recording medium
JP6146230B2 (en) Relay device, thin client system, relay method, and relay program
US9690783B2 (en) Image conversion and method for converting text in an image into a targeted language
US20150249722A1 (en) Content providing apparatus and method, and computer program product
JP2015041111A (en) Web page takeover system, web page takeover method, communication terminal, and method and program of web page display
CN113476836B (en) Game picture display method, game picture display device, electronic equipment and readable storage medium
CN113821484A (en) File processing method and device, electronic equipment and readable storage medium
KR20160132607A (en) System for cloud streaming service, method of image cloud streaming service using data substitution and apparatus for the same
JP2013214321A (en) Display terminal device, information processing device and program
KR101473463B1 (en) System for providing terminal service by providing compressed display information in server based computing system of terminal environment and method thereof
CN115935106A (en) Website generation method, device, equipment and storage medium
KR20120055497A (en) System and method for delivering informaiton using image code

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12792755

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12792755

Country of ref document: EP

Kind code of ref document: A1