JP2006331342A - Content layout recognition program, recognition system, recognition method, content layout conversion program, conversion system, and conversion method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To present display data to be displayed on a first terminal screen on a second terminal screen and to perform conversion to the display data effectively using original meaning between the first terminal screen and the second terminal screens different in size, for example, between a PC and a cellular phone. <P>SOLUTION: In receipt of a browsing request from the cellular phone, a content file depicted for the PC is read, and layout recognition data, which is displayed in unique colors while sectioned by structure units for each display area, are generated. When the recognition data are rendered, a layout for a structure unit is recognized, and based on recognized layout information, a layout for the cellular phone is rearranged. In the rearranged area, corresponding structure units are constructed again, and conversion to a content file for the cellular phone is carried out. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  In order to convert the first content display data displayed on the first terminal screen of a personal computer or the like into second content display data displayed on the second terminal screen of a mobile phone or the like, The present invention relates to a content layout recognition program, a recognition system, and a recognition method for recognizing the layout of content display data. Further, by using the content layout recognition program, the recognition system, and the recognition method, the first content display data displayed on the first terminal screen is converted into the second content display data displayed on the second terminal screen. The present invention relates to a content layout conversion program, a conversion system, and a conversion method.

  As a terminal for browsing a website through the Internet, a mobile phone is generally used. In order to display a web page on a mobile phone, because it is not possible to use a web page description language HTML for a personal computer (PC) as it is because of screen restrictions and processing capacity limitations, cHTML Description languages for mobile phones such as HDML, WML, and xHTML are adopted.

  The description language for such a mobile phone has not been standardized, and the description language that can be used for each carrier of the mobile phone is different. Since the compatibility between them is not perfect, operators who operate websites that provide information for mobile phones prepare web pages written in about 5 to 8 languages and maintain them individually. Must manage. In order to cope with such a problem, a transcoding technique for converting a computer program or script written in one language into a computer program or script written in another language has attracted attention.

  The first generation product equipped with transcoding technology, which appeared around 2000, simply replaced the HTML code with a code such as cHTML. However, this method supports the current Web page that uses a lot of graphics. It has become difficult. Following this, the second generation products that appeared around 2002 are also designed to reduce and rearrange graphic information. Various inventions using such a transcoding technique for displaying a Web page in a restricted screen of a mobile phone or the like have been disclosed (for example, see Patent Documents 1 and 2).

JP 2001-273188 A JP 2003-271508 A

  However, second-generation products that respond to issues arising from the first-generation products are often difficult to deal with Web pages that are diversified due to the adoption of applet programs, etc. The current situation is not.

  In addition, each Web page currently provided is created in its own style and method, and it simply tries to convert by code base (markup language conversion or removal of unnecessary tags for layout, etc.). In many cases, Web pages reproduced for mobile phones are often meaningless. In other words, the PC screen and mobile phone screen differ greatly not only in size but also in aspect ratio. Therefore, if the content displayed on the PC is simply arranged from top to bottom, the content displayed on the mobile phone is The meaning that was going to be expressed by the method is often lost. Even if these problems are individually defined and solved, the conversion program may become bloated and complicated, making it unusable for practical use. In order to display a Web page on a mobile phone screen without losing its original meaning, it is necessary to accurately and promptly recognize the layout on the PC screen and use it for reconstruction.

  In addition, as long as conversion based on a code base is assumed, a conversion program corresponding to the type of code employed must be prepared. Under the situation where various description languages are used for mobile phones as in the present situation, a conversion program corresponding to conversion of a plurality of codes is required. Furthermore, with the Internet serving as an infrastructure for providing information, it is not limited to mobile phones. In the future, websites will be viewed on various screens such as TV screens, kiosk terminal screens, and car navigation system screens. there is a possibility. Considering these screens, the environment in which Web pages are displayed is expected to become more diverse, and there may arise a problem that the conversion program must have more types. From this point of view, it is preferable to realize other conversion means that does not depend on the code base.

  Recently, with the advancement of processing functions of mobile phones, mobile phones equipped with browsers that can directly display Web pages written for PCs have also appeared. According to this method, it is possible to display a web page on a mobile phone without using a transcoding technique, but there is no difference in that the layout has not been reconfigured in consideration of the implications on the layout. Cannot be solved, or the original meaning expressed in the layout is lost.

  The present invention has been made to solve such problems, and is displayed on the first terminal screen between the first terminal screen and the second terminal screen, for example, between a PC and a mobile phone. Content layout recognition program for recognizing the layout of the first content display data for converting the first content display data to be converted into second content display data that can be displayed on the second terminal screen, and recognition It is an object to provide a system and a recognition method. It is another object of the present invention to provide a content layout conversion program, a conversion system, and a conversion method for converting first content display data into second content display data by using the content layout recognition program, the recognition system, and the recognition method. It is what.

  According to a first aspect of the content layout recognition program for solving such a problem, the first content display data displayed on the first terminal screen is converted to the second content display data displayed on the second terminal screen. In order to accomplish this, a content layout recognition program for recognizing the layout of the first content display data, wherein predetermined content is stored in a computer system comprising a content storage unit for storing the first content display data Receiving a display request for display on the second terminal screen, reading first content display data for displaying the content specified in the display request from the content storage unit, 1 is displayed when the content display data of 1 is displayed on the second terminal screen. Dividing into structural unit display data divided into structural units to be displayed as units, and creating layout recognition data by embedding RGB values for displaying the structural units in one color in the structural unit display data Rendering the layout recognition data to a state displayed on the first terminal screen, and from the display position of the color displayed by the rendering result, the first layout in which each structural unit is arranged And a step of recognizing the content layout.

  In the present invention, the constituent units displayed on the first terminal screen are colored in different colors, and the colored layout is rendered, so that the display position of each constituent unit is explicitly grasped by a simple method. It becomes possible to do. Thus, by explicitly grasping the visual layout of the screen to be displayed, it becomes possible to reconstruct a display screen having an original meaning in accordance with the second terminal screen.

  In addition, the component contained in the structural unit divided | segmented in this invention is not specifically limited, Various elements, such as a text, an image, and an object, can be included. Since such a structural unit is visually grasped and a position on the layout is specified, it is preferable that it can be grasped by a rectangular block when rendered.

  According to a second aspect of the content layout recognition program, the first content display data displayed on the first terminal screen is converted into the second content display data displayed on the second terminal screen. A content layout recognition program for recognizing the layout of the content display data, the step of receiving the first content display data in a computer having the second terminal screen, and the first content display data Is divided into constituent unit display data divided into constituent units to be displayed as one unit when displayed on the second terminal screen, and the constituent units are displayed in one color on the constituent unit display data. Creating layout recognition data by embedding RGB values for performing layout recognition, Rendering the data to be displayed on the first terminal screen, and recognizing the first layout in which each constituent unit is arranged from the display position of the color displayed according to the rendering result. This is a content layout recognition program.

  The operation of the content layout recognition program according to the second invention is basically the same as that of the first invention, but in the first invention, the program is executed on the server side connected through a network with a computer having the second terminal screen. However, the second invention is different in that it operates on a client computer provided with a second terminal screen.

  In addition, according to a first aspect of the content layout conversion program for solving such a problem, the second content display data for displaying the first content display data to be displayed on the first terminal screen on the second terminal screen. A display request for displaying a predetermined content on the second terminal screen on a computer system comprising a content storage unit for storing the first content display data Receiving the first content display data for displaying the content specified in the display request from the content storage unit, and reading the first content display data from the second terminal screen Unit display data divided into units that should be displayed as one unit when displayed on A step of creating layout recognition data by embedding RGB values for displaying the structural unit in one color in the structural unit display data, and the RGB value in the structural unit display data. Creating data for reconstruction in which an identifier associated with is embedded, rendering the data for layout recognition to be displayed on the first terminal screen, and from the display position of the color displayed by the rendering result Recognizing a first layout in which each constituent unit is arranged, and rearranging the constituent units arranged in the first layout into a second layout suitable for the second terminal screen. And, for the structural units rearranged in the second layout, the identifier is used as reconstruction data corresponding to the key. And generating the second content display data; and transmitting the second content display data to the terminal device that has transmitted the display request. This is a layout conversion program. For the identifier, the same value as the RGB value embedded in the layout recognition data is adopted, and in the step of creating the second content display data, the RGB value of the color displayed in the rendering result is used. The reconstruction data may be specified.

  In the present invention, the structural units displayed on the first terminal screen are colored in different colors, and the colored layout is rendered to explicitly grasp the display position of each structural unit, thereby rendering the first The display data to be displayed on the terminal screen 2 is reconfigured as a display screen having an original meaning.

  At the time of reconstruction, it is necessary to associate the RGB value of the displayed color with the identifier of the reconstruction data in order to specify the reconstruction data corresponding to each of the colored areas. Such association makes it possible to quickly identify the corresponding reconstruction data from the color recognized by the rendering by adopting the numerical value of the RGB value as the identifier.

  A second invention relating to a content layout conversion program is a content layout conversion program for converting first content display data displayed on a first terminal screen into second content display data displayed on a second terminal screen. A step of receiving the first content display data in a computer having the second terminal screen and a unit for displaying the first content display data on the second terminal screen. Dividing into structural unit display data divided into structural units to be displayed, and creating RGB layout recognition data by embedding RGB values for displaying the structural unit in one color in the structural unit display data And reconfiguration in which an identifier associated with the RGB value is embedded in the structural unit display data A step of creating data, rendering the layout recognition data into a state displayed on a first terminal screen, and arranging each structural unit from a display position of a color displayed according to a rendering result. Recognizing the layout, re-arranging the structural units arranged in the first layout to a second layout suitable for the second terminal screen, and re-arranging in the second layout Identifying the reconfiguration data corresponding to the identifier as a key and creating the second content display data, and the second content display data on the second terminal screen. And a step of displaying the content layout conversion program. For the identifier, the same value as the RGB value embedded in the layout recognition data is adopted, and in the step of creating the second content display data, the RGB value of the color displayed in the rendering result is used. The reconstruction data may be specified.

  The operation of the content layout conversion program according to the second invention is basically the same as that of the first invention, but in the first invention, the program is executed on the server side connected through a network to a computer having the second terminal screen. However, the second invention is different in that it operates on a client computer provided with a second terminal screen.

  The content layout recognition program according to the present invention can also be configured as a content layout recognition system including this program. The content layout conversion program according to the present invention can also be configured as a content layout conversion system provided with this program.

  That is, the content layout recognition system according to the present invention converts the first content display data displayed on the first terminal screen into the second content display data displayed on the second terminal screen. A content layout recognition system for recognizing the layout of the content display data, a content storage means for storing the first content display data, and a display for displaying predetermined content on the second terminal screen Receiving means for receiving a request; reading means for reading first content display data for displaying the content designated in the display request from the content storage means; and the first content display data for the second content. Unit table divided into units that should be displayed as a unit when displayed on the terminal screen Dividing means for dividing the data into data; creating means for creating RGB recognition data by embedding RGB values for displaying the structural units in one color in the structural unit display data; and Recognizing means for recognizing a first layout in which each structural unit is arranged from a display position of a color displayed according to a rendering result after rendering into a state displayed on one terminal screen. Is a content layout recognition system.

  The content layout conversion system according to the present invention is a content layout conversion system for converting the first content display data displayed on the first terminal screen into the second content display data displayed on the second terminal screen. A content storage unit that stores the first content display data, a reception unit that receives a display request for displaying predetermined content on the second terminal screen, and a content specified by the display request Reading unit for reading first content display data for displaying the content from the content storage unit, and a configuration for displaying the first content display data as a unit when displaying the first content display data on the second terminal screen Dividing means for dividing into unit display data divided into units; and A first creation means for creating layout recognition data by embedding an RGB value for displaying a unit in one color; and a reconstruction unit in which an identifier associated with the RGB value is embedded in the structural unit display data A second creating means for creating data; and the layout recognition data is rendered to be displayed on the first terminal screen, and each structural unit is arranged from the display position of the color displayed by the rendering result Recognizing means for recognizing the first layout, rearrangement means for rearranging the structural units arranged in the first layout into a second layout suitable for the second terminal screen, For the structural units rearranged in the second layout, the reconfiguration data corresponding to the identifier as a key is specified, and the second content display data is specified. A third generating means for generating a second content display data, and transmitting means for transmitting to the terminal device having transmitted the display request, a content layout conversion system, characterized in that it comprises a. The identifier adopts the same value as the RGB value embedded in the layout recognition data, and the second creation means uses the reconstruction data from the RGB value of the color displayed in the rendering result. It can also be characterized by specifying.

  The content layout recognition program according to the present invention can also be understood as a content layout recognition method implemented by this program. The content layout conversion program according to the present invention can also be understood as a content layout conversion method implemented by this program.

  That is, the content layout recognition method according to the present invention converts the first content display data displayed on the first terminal screen into the second content display data displayed on the second terminal screen. A content layout recognition method for recognizing the layout of the content display data of the computer system including a content storage unit for storing the first content display data, wherein predetermined content is displayed on the second terminal screen. Receiving a display request for display, reading the first content display data for displaying the content specified by the display request from the content storage unit, and the computer system , The first content display data is changed to the second content display data. Dividing into structural unit display data divided into structural units to be displayed as one unit when displayed on the end screen, and the computer system displays the structural unit in one color in the structural unit display data Creating layout recognition data by embedding RGB values for rendering, and the computer system rendering the layout recognition data into a state displayed on the first terminal screen, and colors displayed according to the rendering result And a step of recognizing a first layout in which each structural unit is arranged from the display position.

  In addition, the content layout conversion method according to the present invention is a content layout conversion method for converting first content display data displayed on the first terminal screen into second content display data displayed on the second terminal screen. A computer system comprising a content storage unit for storing the first content display data accepting a display request for displaying predetermined content on the second terminal screen; and Reading out the first content display data for displaying the content specified in the display request from the content storage unit; and the computer system reads the first content display data into the second terminal. Divided into structural units that should be displayed as a unit when displayed on the screen Dividing the composition unit display data, and the computer system creating layout recognition data by embedding RGB values for displaying the composition unit in one color in the composition unit display data; A computer system creating reconstruction data in which an identifier associated with the RGB value is embedded in the structural unit display data; and the computer system displays the layout recognition data on a first terminal screen. Recognizing the first layout in which the respective structural units are arranged from the display position of the color displayed by the rendering result, and the computer system is arranged in the first layout. The configured unit is transferred to a second label suitable for the second terminal screen. Relocating out, and the computer system specifies reconfiguration data corresponding to the identifier as a key for the structural unit rearranged in the second layout, and the second content display data And a step of transmitting the second content display data to the terminal device that has transmitted the display request. For the identifier, the same value as the RGB value embedded in the layout recognition data is adopted, and in the step of creating the second content display data, the RGB value of the color displayed in the rendering result is used. The reconstruction data may be specified.

  According to the present invention, a provider that provides content only needs to prepare content display data to be displayed on one terminal screen, and can display a display screen in which the original meaning is utilized on another terminal screen. It can be converted into content display data and provided. For example, a business operator who operates a website that provides information for a PC can provide information corresponding to that for a PC to a mobile phone by providing the program according to the present invention.

  The best mode for carrying out the present invention will be described below in detail with reference to the drawings. In the following, an example in which a Web page written in a PC language is viewed on a mobile phone will be described. However, this example is an example of the present invention, and the present invention is limited to the following embodiment. It is not something. The present invention can be widely applied to other cases in which content generated in accordance with a certain screen is viewed on different screens.

  In the following embodiments, an example in which operations from content layout recognition to conversion are performed on the server side that has received a content display request has been described. However, the content layout recognition program or conversion program according to the present invention is described below. May be configured to operate on the client terminal side. In this case, normal display data to be displayed on the Web page is transmitted from the server, and appropriate layout conversion is performed and displayed on the client terminal side.

  FIG. 1 is a diagram showing a current general scheme when browsing a website from a mobile phone. 2 to 4 are diagrams showing first to third embodiments of the content layout conversion system according to the present invention, respectively. FIG. 5 is a block diagram showing the configuration of the content layout conversion system according to the present invention. FIG. 6 is an example of a Web page displayed on the PC screen. 7 to 9 are diagrams showing examples of text elements, image elements, and object elements, respectively, in which information necessary for layout recognition and reconstruction is embedded by the content layout conversion program according to the present invention. FIG. 10 is a diagram showing an example of the result of lettering the Web page of FIG. 6 by the content layout conversion program according to the present invention. FIG. 11 is a flowchart showing the entire processing flow of the content layout conversion program according to the present invention. FIGS. 12 and 13 are flowcharts showing a processing flow for creating layout recognition data and reconfiguration data for each structural unit in the content layout conversion program according to the present invention.

  1 and FIG. 2 to FIG. 4, the difference between the current general scheme and the scheme for carrying out the present invention when browsing a PC website from a mobile phone will be described. FIG. 1 shows a current general scheme, while FIGS. 2 to 4 show first to third embodiments using a content layout conversion system according to the present invention.

  When it is desired to configure a Web site created for a PC so that it can be viewed from a mobile phone as well, two methods are currently used as shown in FIG. One is a method of storing content provided in a Web server as a file described with a code for a mobile phone as well as a code for a PC. The other is a method in which a Web server stores only a file described in a PC code, and provides a file whose code is converted by a conversion engine when accessed from a mobile phone.

  The Web server A in FIG. 1 shows the former method. In addition to the content file described in HTML for PC, the Web server is described in cHTML, xHTML, HDML, etc. for mobile phones. Stored content files. Since mobile phones have different codes that can be displayed on the browser depending on the carrier, a plurality of files must be stored for the same content. When the Web server accepts a browsing request from a mobile phone, it identifies the type of mobile phone that made the browsing request, reads a file written in code according to the type of mobile phone, and sends it to the mobile phone The

  On the other hand, the Web server B in FIG. 1 shows the latter method, but the Web server stores only content files described in HTML for the PC. On the other hand, the Web server is provided with a program (conversion engine) for converting HTML into a code such as cHTML, xHTML, HDML, etc. When the Web server accepts a browsing request from a mobile phone, it is described in HTML. A program for reading the file, identifying the type of the mobile phone that has requested the browsing, and converting it into a code corresponding to the type of the mobile phone is activated. Since mobile phones have different codes that can be displayed on the browser depending on the carrier, the conversion engine must be prepared to handle all the codes that need to be converted. A file described in HTML by such a program is converted into a code for the corresponding mobile phone and transmitted to the mobile phone.

  On the other hand, the content layout conversion program according to the present invention uses a method of generating a file suitable for a mobile phone by recognizing and reconfiguring the layout of a content file described in HTML for a PC. . Therefore, only the content file described in HTML needs to be stored in the Web server. 2-4 show three embodiments using such a conversion engine.

  FIG. 2 shows an embodiment in which each Web server that provides information from a Web site includes a conversion engine according to the present invention. When the Web server accepts a browsing request from the mobile phone, the conversion engine reads the content file described in HTML, and transmits the file reconfigured in a layout that matches the screen of the mobile phone to the mobile phone.

  FIG. 3 shows an embodiment provided with a conversion engine according to the present invention in a Web server that manages a portal site. When a portal site is accessed from a mobile phone and browsing of web content stored in another web server is requested, the designated content file is received from the web server and the conversion engine displays it on the screen of the mobile phone. The content file is reconstructed in the combined layout, and the reconstructed file is transmitted to the mobile phone.

  FIG. 4 shows an embodiment including a conversion engine according to the present invention in a server on a mobile phone carrier side such as a gateway server. When browsing of Web content is requested via the mobile phone network, the content file is received from the Web server where the specified Web content exists, and is displayed on the screen of the mobile phone by the conversion engine provided in the server on the carrier side. The content file is reconstructed in the combined layout, and the reconstructed file is transmitted to the mobile phone.

  For these examples, an embodiment in which a conversion engine is further arranged on the mobile phone side and the conversion engine is provided in each mobile phone is also conceivable. However, in order to realize such an embodiment, it is necessary to further improve the processing capability on the mobile phone side. In the case where the processing capability can be ensured, for example, when the present invention is applied to a kiosk terminal or the like, an embodiment including a conversion engine on the terminal side is also considered a realistic method.

  The configuration and operation of the present invention will be described in detail below, but the terms used in the description after FIG. 5 are defined as follows. First, “UGML (Universal Gate Markup Language)” is a markup language including elements for layout recognition used in the present invention. There are two types of UGML: “layout recognition UGML” used at the time of rendering and “reconstruction UGML” used when extracting a structural unit. “Ugmlid” is an identifier indicating a structural unit on the layout.

  FIG. 5 shows a configuration of a content layout conversion system according to the present invention. The content layout conversion system according to the present invention is provided as a partial function of the Web server 10 that manages a Web site. The Web server 10 includes a CPU 11, a RAM 12, a ROM 13, and an HDD 14. The HDD 14 stores an application program of a content conversion program 141, a layout recognition program 142, a reconfiguration program 143, a reconfiguration rule storage unit 144, and a content file 145.

  Hardware such as input control and output control stored in the ROM 13 in order to execute predetermined processing by the application programs of the content conversion program 141, the layout recognition program 142, and the reconstruction program 143 stored in the HDD 14 respectively. The CPU 11 performs arithmetic processing while starting various basic programs for control and causing the RAM 12 to function as a work area for the application program.

  In the embodiment in which the content conversion program 141, the layout recognition program 142, the application program of the reconstruction program 143, and the reconstruction rule storage unit 144 stored in the HDD 14 are converted on the client side. All are provided on the mobile phone 20 side, and the operation of each application program described below is executed by the CPU, RAM, etc. in the mobile phone.

  When the Web server 10 receives a Web site browsing request from the mobile phone 20, the content conversion program 141 is activated, and display data for displaying the corresponding Web content is read from the content file 145 stored in the HDD 14. It is. Here, it is assumed that the display data of the Web content stored in the content file 145 is described in HTML for the PC.

  The display data of the Web content is divided by the content conversion program 141 into structural units that are displayed in a block of rectangular areas on the display screen. The division method of the structural unit is not particularly limited, but the division is performed based on a predetermined rule based on the tag in the display data, the size of the image or the object, and the like. For each divided unit, layout recognition data described in layout recognition UGML and reconfiguration display data described in reconfiguration UGML are as follows according to the operation of the content conversion program 141, respectively. Created.

  As for the layout recognition UGML, a unique color is assigned to each of the display data divided for each structural unit so that the display area can be visually recognized when the display data is displayed. Are embedded in display data.

  For reconfiguration UGML, ugmlid for identifying each structural unit is embedded in the display data divided for each structural unit. In this way, a unique identifier is assigned to each structural unit as ugmlid, but since it should be uniquely associated with the color recognized by the layout recognition UGML, the numerical value part of the RGB value specifying the color Is preferably used as uglid. The ugmlids numbered by the content conversion program 141 in this way are managed as an ugmlid list.

  As described above, the layout recognition data described in the layout recognition UGML, the reconstruction display data described in the reconstruction UGML, and the ugmlid list generated from the content file 145 read from the HDD 144 are stored in the RAM 12. Alternatively, it is stored as a temporary file in a virtual memory area on the HDD 14.

  Next, the layout recognition program 142 is activated to render the layout recognition data described in the layout recognition UGML to recognize the display area of each structural unit. When the layout recognition data is rendered, each structural unit is displayed in a color corresponding to the embedded RGB value, so that the display area can be easily specified by recognizing the color. The method for specifying the display area is not particularly limited, but the idea is to set the coordinate axis on the display screen and grasp the position on the coordinate axis.

  Subsequently, the reconfiguration program 143 is activated, and the correlation between each structural unit is grasped from the display area of each structural unit recognized by the layout recognition program 142. How to replace the structural unit on the screen or rearrange it. Although the method of rearrangement is not particularly limited, the idea of storing rules in the reconfiguration rule storage unit 144 in the case of reconfiguring components based on the display area relationship and arranging based on such rules is fundamental. Become.

  The reconfiguration program 143 creates a rearranged ugmlid list specifying each structural unit specified by ugmlid and the rearranged display area according to the rearrangement for the screen of the mobile phone. In accordance with the rearranged ugmlid list, the display data for reconfiguration temporarily stored using ugmlid as a key is obtained, and the content file for transmission is completed by rearranging these reconfiguration display data for the mobile phone screen. Then, it is transmitted to the mobile phone 20.

  Next, the layout recognition method by the content layout recognition program according to the present invention will be specifically described with reference to FIGS. In this example, the Web page displayed as shown in FIG. 6 on the screen of the PC is rendered as shown in FIG. 10 to recognize the display area of each structural unit.

  FIG. 6 is an example of a Web page displayed on the PC screen. This Web page is displayed by reading a content file described in HTML with a browser. The configuration of the Web page is grasped as a meaningful unit such as a title, new arrival information, new product introduction including images, and a map. The content file is divided into these structural units, and layout recognition data described in layout recognition UGML and reconstruction display data described in reconstruction UGML are created for each structural unit. .

  FIG. 7 shows an example in which text data described in HTML is described in the layout recognition UGML and the reconstruction UGML for the text group. The title “product information” is recognized as one structural unit, and the color “blue” is assigned to recognize the display area of the structural unit. In the layout recognition UGML, the same RGB value (0000FF) for the foreground color (background color) and background color (background-color) so that the part displayed as “product information” as the title part can be recognized as blue. The layout recognition data is created by embedding ugmlid for specifying the structural unit. Note that ugmlid is not an essential component for layout recognition data, but if it is included, association with reconfiguration data becomes easy. By using the same value as the RGB value for the ugmlid, it becomes easy to easily associate the layout recognition data with the reconstruction data.

  Together with the layout recognition data, reconstruction data is created by the reconstruction UGML. In the example of FIG. 7, ugmlid (0000FF) that is the same value as the RGB value (0000FF) specifying the color is embedded in the layout recognition UGML. Such reconstruction data is used as data to be displayed in the display area rearranged for the mobile phone when the display data for the mobile phone is created.

  FIG. 8 shows an example in which image data described in HTML is described in layout recognition UGML and reconstruction UGML for an image group. The image of the new product introduction part is recognized as one structural unit, and the color “green” is assigned to recognize the display area of the structural unit. In the layout recognition UGML, the designated image file is replaced with an image file colored with one color (RGB value is 00BF00) and the structural unit is specified so that the image portion of the new product introduction can be recognized as green. The layout recognition data is created by embedding the ugmlid. As in FIG. 7, it is preferable that ugmlid is not an essential component and that it is preferable to use the same value as the RGB value for ugmlid.

  Together with the layout recognition data, reconstruction data is created by the reconstruction UGML. In the example of FIG. 8, ugmlid (00BF00), which is the same value as the RGB value (00BF00) that specifies the color, is embedded in the layout recognition UGML. Such reconstruction data is used as data to be displayed in the display area rearranged for the mobile phone when the display data for the mobile phone is created.

  FIG. 9 shows an example in which object data described in HTML for an object group is described in layout recognition UGML and reconstruction UGML, respectively. An object in the map portion is recognized as one structural unit, and a color of “yellow” is assigned to recognize the display area of the structural unit. In the layout recognition UGML, the designated object is replaced with an object colored in one color (RGB value is FFFF00) so that the map portion can be recognized as yellow, and ugmlid for specifying such a structural unit is embedded. Layout recognition data is created. As in FIG. 7, it is preferable that ugmlid is not an essential component and that it is preferable to use the same value as the RGB value for ugmlid.

  Together with the layout recognition data, reconstruction data is created by the reconstruction UGML. In the example of FIG. 9, ugmlid (FFFF00), which is the same value as the RGB value (FFFF00) specifying the color, is embedded in the layout recognition UGML. Such reconstruction data is used as data to be displayed in the display area rearranged for the mobile phone when the display data for the mobile phone is created.

  When a layout recognition UGML including image data or the like is described, a color may be specified for an element or attribute of the original content data (for example, font color). If the RGB values of these colors match the RGB values of any of the colors used for layout recognition, there is a possibility that erroneous recognition will occur during layout recognition. The elements and attributes for displaying the colors included in the content data may be necessary for grouping the structural units, and therefore cannot be deleted. Therefore, elements and attributes that display colors included in the content data are all converted into a specific RGB value (for example, 000000 indicating black) to indicate that the colors exist as elements and attributes. However, problems in layout recognition can be solved. The RGB values used here cannot be used as uglid.

  FIG. 10 shows the result of reproducing the layout recognition data described by the layout recognition UGML and performing the lettering to recognize the layout of each structural unit. Each structural unit is displayed as an area colored with a unique rectangular color, so that the visual layout of each structural unit can be explicitly recognized by recognizing the color display area. It becomes possible. By grasping the positional relationship of the display position of each structural unit from the layout thus recognized, the structural unit to be displayed continuously when rearranging for a mobile phone, the structural unit to be arranged side by side, It is possible to perform rearrangement as meaningful information as compared with the current method of simply converting and displaying in code order.

  The processing flow of the content layout conversion program according to the present invention will be described with reference to the flowcharts of FIGS. 11 shows a processing flow of the entire layout conversion, FIG. 12 shows a processing flow for creating layout recognition data for each structural unit, and FIG. 13 shows a processing flow for creating reconfiguration data for each structural unit. Is shown.

  When the Web server receives a Web site browsing request (S01), it is determined from the communication path, the source model ID, and the like (S02) whether the terminal making the browsing request is a mobile phone. If it is determined that the browsing request is from other than a mobile phone, the content file described in HTML is read (S11), and the HTML code file is transmitted as it is to the requested terminal (S10). The process ends.

  On the other hand, if it is determined as a browsing request from the mobile phone, the content file described in HTML is read (S03), a layout recognition UGML file is created from the read content file (S04), and the layout recognition Lettering the UGML file, the layout when the content file is displayed as it is is recognized (S05). Layout recognition is performed by reproducing each structural unit on the layout with different colors. From the recognized layout, the layout is rearranged so that each structural unit becomes meaningful information according to the screen size of the mobile phone (S06).

  FIG. 12 shows a more detailed flow of the procedure for creating the layout recognition UGML file. When the content file is read (S03), the structural unit displayed as a block of rectangular areas when the content file is displayed is specified (S041). In the display data for the structural unit, when each structural unit is displayed, an RGB value for identifying the displayed region by the color is embedded (S042). Subsequently, it is determined whether or not the next structural unit exists (S043), and if it exists, the processes of S041 to S042 are repeated. If it does not exist, creation of the layout recognition UGML file is terminated, and the process proceeds to layout recognition (S05).

  In parallel with the creation of the layout recognition UGML file, a reconstruction UGML file is created (S07). FIG. 13 shows a more detailed flow of the procedure for creating the reconfiguration UGML file. When the content file is read (S03), the same structural unit as the creation of the layout recognition UGML file is specified (S071), and ugmlid for identifying each structural unit is embedded (S072). Subsequently, it is determined whether or not the next structural unit exists (S073), and if it exists, the processes of S071 to S072 are repeated. If it does not exist, the creation of the reconfiguration UGML file is terminated, and the created reconfiguration UGML file is held as a temporary storage file until the reconfiguration UGML file is read (S08).

  Subsequently, based on the layout rearranged for the mobile phone in step 06, as a display data to be displayed in each display area on the layout, a reconfiguration UGML file corresponding to the key ugmlid is read (S08). . A content file to be displayed on the screen of the mobile phone is reconstructed from the read reconstruction UGML file (S09). The reconstructed content file is transmitted to the requested terminal (S10), and the process is terminated.

It is a figure which shows the present general scheme in the case of browsing a website from a mobile phone. It is a figure which shows 1st Embodiment of the content layout conversion system concerning this invention. It is a figure which shows 2nd Embodiment of the content layout conversion system concerning this invention. It is a figure which shows 3rd Embodiment of the content layout conversion system concerning this invention. It is a block diagram which shows the structure of the content layout conversion system concerning this invention. It is an example of the web page displayed on the screen of PC. It is a figure which shows an example of the text element by which the information required for layout recognition and reconstruction was embedded by the content layout conversion program concerning this invention. It is a figure which shows an example of the image element by which the information required for layout recognition and reconstruction was embedded by the content layout conversion program concerning this invention. It is a figure which shows an example of the object element by which the information required for layout recognition and reconfiguration | reconstruction was embedded by the content layout conversion program concerning this invention. FIG. 7 is a diagram showing an example of a result of lettering the Web page of FIG. 6 by the content layout conversion program according to the present invention. It is a flowchart which shows the whole processing flow of the content layout conversion program concerning this invention. 6 is a flowchart showing a processing flow for creating layout recognition data for each constituent unit in the content layout conversion program according to the present invention. 6 is a flowchart showing a processing flow for creating reconfiguration data for each configuration unit in the content layout conversion program according to the present invention.

Explanation of symbols

10 Web server 11 CPU
12 RAM
13 ROM
14 HDD
141 Content Conversion Program 142 Layout Recognition Program 143 Reconfiguration Program 144 Reconfiguration Rule Storage Unit 145 Content File 20 Mobile Phone

Claims (12)

Content for recognizing the layout of the first content display data in order to convert the first content display data to be displayed on the first terminal screen into second content display data to be displayed on the second terminal screen A layout recognition program,
In a computer system comprising a content storage unit for storing the first content display data,
Receiving a display request for displaying predetermined content on the second terminal screen;
Reading first content display data for displaying the content specified in the display request from the content storage unit;
Dividing the first content display data into structural unit display data divided into structural units to be displayed as a unit when displayed on the second terminal screen;
Embedding RGB values for displaying the structural unit in one color in the structural unit display data to create layout recognition data;
Rendering the layout recognition data to be displayed on the first terminal screen, and recognizing the first layout in which each structural unit is arranged from the display position of the color displayed according to the rendering result; ,
The content layout recognition program characterized by performing this. Content for recognizing the layout of the first content display data in order to convert the first content display data to be displayed on the first terminal screen into second content display data to be displayed on the second terminal screen A layout recognition program,
In a computer having the second terminal screen,
Receiving the first content display data;
Dividing the first content display data into structural unit display data divided into structural units to be displayed as a unit when displayed on the second terminal screen;
Embedding RGB values for displaying the structural unit in one color in the structural unit display data to create layout recognition data;
Rendering the layout recognition data to be displayed on the first terminal screen, and recognizing the first layout in which each structural unit is arranged from the display position of the color displayed according to the rendering result; ,
The content layout recognition program characterized by performing this. Content for recognizing the layout of the first content display data in order to convert the first content display data to be displayed on the first terminal screen into second content display data to be displayed on the second terminal screen A layout recognition system,
Content storage means for storing the first content display data;
Receiving means for receiving a display request for displaying predetermined content on the second terminal screen;
Reading means for reading first content display data for displaying the content specified in the display request from the content storage means;
A dividing means for dividing the first content display data into constituent unit display data divided into constituent units to be displayed as one unit when displayed on the second terminal screen;
Creating means for creating layout recognition data by embedding RGB values for displaying the structural unit in one color in the structural unit display data;
Recognizing means for rendering the layout recognition data to be displayed on the first terminal screen and recognizing the first layout in which each structural unit is arranged from the display position of the color displayed according to the rendering result. When,
A content layout recognition system comprising: Content for recognizing the layout of the first content display data in order to convert the first content display data to be displayed on the first terminal screen into second content display data to be displayed on the second terminal screen A layout recognition method,
Receiving a display request for displaying a predetermined content on the second terminal screen, wherein a computer system including a content storage unit for storing the first content display data;
The computer system reading first content display data for displaying the content specified in the display request from the content storage unit;
The computer system dividing the first content display data into structural unit display data divided into structural units to be displayed as a unit when displayed on the second terminal screen;
The computer system creating layout recognition data by embedding RGB values for displaying the structural unit in one color in the structural unit display data; and
The computer system renders the layout recognition data into a state displayed on the first terminal screen, and a first layout in which each structural unit is arranged from the display position of the color displayed according to the rendering result. The step of recognizing
A content layout recognition method comprising: A content layout conversion program for converting first content display data to be displayed on a first terminal screen into second content display data to be displayed on a second terminal screen,
In a computer system comprising a content storage unit for storing the first content display data,
Receiving a display request for displaying predetermined content on the second terminal screen;
Reading first content display data for displaying the content specified in the display request from the content storage unit;
Dividing the first content display data into structural unit display data divided into structural units to be displayed as a unit when displayed on the second terminal screen;
Embedding RGB values for displaying the structural unit in one color in the structural unit display data to create layout recognition data;
Creating reconstruction data in which an identifier associated with the RGB value is embedded in the structural unit display data;
Rendering the layout recognition data to be displayed on the first terminal screen, and recognizing the first layout in which each structural unit is arranged from the display position of the color displayed according to the rendering result; ,
Rearranging the structural units arranged in the first layout into a second layout suitable for the second terminal screen;
For the structural units rearranged in the second layout, identifying the reconstruction data corresponding to the identifier as a key, and creating the second content display data;
Transmitting the second content display data to a terminal device that has transmitted the display request;
A content layout conversion program characterized in that For the identifier, the same value as the RGB value embedded in the layout recognition data is adopted,
6. The content layout conversion program according to claim 5, wherein in the step of creating the second content display data, the reconstruction data is specified from RGB values of colors displayed in the rendering result. A content layout conversion program for converting first content display data to be displayed on a first terminal screen into second content display data to be displayed on a second terminal screen,
In a computer having the second terminal screen,
Receiving the first content display data;
Dividing the first content display data into structural unit display data divided into structural units to be displayed as a unit when displayed on the second terminal screen;
Embedding RGB values for displaying the structural unit in one color in the structural unit display data to create layout recognition data;
Creating reconstruction data in which the identifier associated with the RGB value is embedded in the structural unit display data;
Rendering the layout recognition data to be displayed on the first terminal screen, and recognizing the first layout in which each structural unit is arranged from the display position of the color displayed according to the rendering result; ,
Rearranging the structural units arranged in the first layout into a second layout suitable for the second terminal screen;
For the structural units rearranged in the second layout, identifying the reconstruction data corresponding to the identifier as a key, and creating the second content display data;
Displaying the second content display data on the second terminal screen;
A content layout conversion program characterized in that For the identifier, the same value as the RGB value embedded in the layout recognition data is adopted,
8. The content layout conversion program according to claim 7, wherein in the step of creating the second content display data, the reconstruction data is specified from RGB values of colors displayed in the rendering result. A content layout conversion system for converting first content display data to be displayed on a first terminal screen into second content display data to be displayed on a second terminal screen,
Content storage means for storing the first content display data;
Receiving means for receiving a display request for displaying predetermined content on the second terminal screen;
Reading means for reading first content display data for displaying the content specified in the display request from the content storage means;
A dividing means for dividing the first content display data into constituent unit display data divided into constituent units to be displayed as one unit when displayed on the second terminal screen;
First creation means for creating layout recognition data by embedding RGB values for displaying the structural unit in one color in the structural unit display data;
Second creation means for creating reconstruction data in which an identifier associated with the RGB value is embedded in the structural unit display data;
Recognizing means for rendering the layout recognition data to be displayed on the first terminal screen and recognizing the first layout in which each structural unit is arranged from the display position of the color displayed according to the rendering result. When,
Rearrangement means for rearranging the structural units arranged in the first layout to a second layout suitable for the second terminal screen;
Third composition means for identifying the reconstruction data corresponding to the identifier as a key and creating the second content display data for the structural units rearranged in the second layout;
Transmitting means for transmitting the second content display data to the terminal device that has transmitted the display request;
A content layout conversion system comprising: For the identifier, the same value as the RGB value embedded in the layout recognition data is adopted,
10. The content layout conversion system according to claim 9, wherein the second creating unit specifies the reconstruction data from RGB values of colors displayed in the rendering result. A content layout conversion method for converting first content display data to be displayed on a first terminal screen into second content display data to be displayed on a second terminal screen,
Receiving a display request for displaying a predetermined content on the second terminal screen, wherein a computer system including a content storage unit for storing the first content display data;
The computer system reading first content display data for displaying the content specified in the display request from the content storage unit;
The computer system dividing the first content display data into structural unit display data divided into structural units to be displayed as a unit when displayed on the second terminal screen;
The computer system creating layout recognition data by embedding RGB values for displaying the structural unit in one color in the structural unit display data; and
The computer system creating reconstruction data in which identifiers associated with the RGB values are embedded in the structural unit display data;
The computer system renders the layout recognition data into a state displayed on the first terminal screen, and a first layout in which each structural unit is arranged from the display position of the color displayed according to the rendering result. The step of recognizing
The computer system rearranging the structural units arranged in the first layout in a second layout suitable for the second terminal screen;
The computer system identifying the reconstruction data corresponding to the identifier as a key for the structural units rearranged in the second layout, and creating the second content display data;
The computer system transmitting the second content display data to a terminal device that has transmitted the display request;
A content layout conversion method characterized by comprising: For the identifier, the same value as the RGB value embedded in the layout recognition data is adopted,
12. The content layout conversion method according to claim 11, wherein, in the step of creating the second content display data, the reconstruction data is specified from RGB values of colors displayed in the rendering result.