JP2016024760A - Display control device, display terminal, and display control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display a proper CG video for every display terminal.SOLUTION: A display control device for controlling for displaying a CG video corresponding to script data to a display device comprises: acquisition means for acquiring CG model data associated to the script data; content creation means for creating the CG video for operating the CG model data acquired by the acquisition means, in correspondence to the script data; and display control means for corresponding the CG video created by the content creation means to a display state when being displayed on the display device, for display controlling the CG video.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a display control device, a display terminal, and a display control program, and more particularly to a display control device, a display terminal, and a display control program for displaying an appropriate CG image for each display terminal.

  Conventionally, there is a technique in which a CG (Computer Graphics) model appears in video content such as a program, and a predetermined operation (animation) such as sign language is performed on the CG model. Conventionally, a graphics API (Application) of WebGL is used for the purpose of operating the above-described CG video on various platforms having different hardware or OS (Operating System) of a terminal (display terminal) used by a user. There is a CG viewer using Program Interface (see Non-Patent Document 1, for example).

  WebGL is a standard specification for 3D CG (3DCG) drawing in HTML (Hyper Text Markup Language) 5. By using WebGL, it is possible to generate and display 3DCG video without installing dedicated software or a plug-in application on the display terminal simply by accessing a specific Web page with the Web browser of the display terminal.

Hiroyuki Kaneko, Sakushu Hamaguchi, Mamoru Michiya, Seiki Inoue, “A Study of Sign Language CG Generation Using WebGL”, The Institute of Image Information and Television Engineers, 2012 Annual Conference of the Institute of Image Information and Television Engineers (ITE Annual Convention 2012)

  However, the performance, display (screen) size, and web browser window size vary for each display terminal, and even if the target web page is accessed, the movement of 3DCG video is affected by the lack of rendering performance of the display terminal. May not be displayed correctly because all the CG images cannot be displayed on the screen.

  Further, in the conventional method, even when the drawing performance of the display terminal is sufficient, the size of the displayed CG video is not changed unless the user changes the window size. For this reason, it has been impossible to display a CG video in an appropriate size corresponding to the performance of the display terminal.

  The present invention has been made in view of the above-described problems, and an object thereof is to display an appropriate CG image for each display terminal.

  As one aspect of the present invention, in a display control device that performs control for displaying a CG image corresponding to script data on a display device, an acquisition unit that acquires CG model data associated with the script data; Content generation means for generating CG video for operating CG model data obtained by the acquisition means in correspondence with script data, and display state when the CG video generated by the content generation means is displayed on the display device Display control means for controlling the display of the CG video corresponding to the above.

  As one aspect of the present invention, a display terminal includes the display control device described above and a display device that displays the CG video obtained from the display control device on a screen.

  Further, as one aspect of the present invention, the display control program causes a computer to function as the above-described display control device.

  According to the present invention, it is possible to display an appropriate CG image for each display terminal.

It is a figure which shows an example of schematic structure of a display control system. It is a figure which shows an example of a function structure of the display terminal in this embodiment. It is a flowchart which shows an example of a display control process. It is a flowchart which shows an example of a display environment adaptive control process. It is a figure which shows the example of reduction of the image size in this embodiment, and an expansion. It is a figure which shows the example of a change of TVML script at the time of CG model change. It is a figure which shows an example of a 1st camera shot change process. It is a figure which shows an example of a 2nd camera shot change process.

<About the present invention>
As an example, the present invention uses WebGL technology for generating and displaying CG video on a web browser without requiring special software or the like. For example, in the present invention, the size and content of CG video generated by WebGL are dynamically changed according to the display state (for example, the performance and environment of the display device).

  Specifically, for example, when CG video is generated by WebGL, an optimal image of the CG video is adapted to the display environment such as the performance of the display terminal to be generated, the screen size of the display (display device), and the window size. (Draw) Display on the screen in size, frame rate, etc.

  For example, in the present embodiment, a display state such as a drawing frame rate (FPS) is acquired in an application using WebGL, and the image size of the CG video is enlarged or reduced according to the acquired display state. Note that the above-described frame rate is the number of image frames (FPS: Frame Per Second) per unit time (for example, 1 second) of the CG video being reproduced.

  Further, in the present embodiment, CG models with different densities (number of polygons) to be drawn are prepared in advance, and the CG model having the number of polygons according to the display state (performance, etc.) of the display terminal is used. Generate video. In the present embodiment, the drawing angle of view (camera shot) of the CG model is dynamically changed according to the CG image size. In this embodiment, by performing display control of CG video using at least one of the plurality of methods described above, it is possible to display a screen of CG video that is dynamically adapted to each terminal having different performance. To do. Thereby, the user can view appropriate CG video.

  Hereinafter, embodiments in which a display control device, a display terminal, and a display control program according to the present invention having the above-described features are suitably implemented will be described in detail with reference to the drawings. In the present embodiment, a program is used as an example of video content viewed by the user, and TVML (TV program Making Language) is used as an example of a script used for production, presentation, viewing, and the like of the program. However, the present invention is not limited to this, and other video contents and scripts may be used.

  In TVML, a program is generated based on, for example, a program script, a program production engine, and material data. The program production engine is, for example, a CG model appearing in a program, a studio set of a program, a virtual object (object) such as a desk or chair, and “title display”, “zoom-in”, “CG model” in one operation unit of the program. Events such as “basic motion (for example, bowing and walking motion)” are defined in advance. In this embodiment, by using a program production engine, for example, when text data described in a program script representing the contents (production etc.) of a program is input, a TVML script necessary for automatic program generation is generated based on the text data. Can be output. A program can be generated using material data such as images, video, audio, music, text data, etc., based on the contents of effects described in the TVML script.

  In the present embodiment, the above-described program script, program production engine, material data, and the like are acquired from a providing server or the like in which the display terminal having the display control device in the present embodiment exists on the network, and various information acquired. An example in which a program video is generated and displayed on a screen using is shown, but the embodiment is not limited to this.

<Schematic configuration example of display control system>
FIG. 1 is a diagram illustrating an example of a schematic configuration of a display control system. The display control system 10 illustrated in FIG. 1 includes a providing server 11 and one or a plurality of display terminals 12-1 to 12-n (hereinafter collectively referred to as “display terminals 12” as necessary). The providing server 11 and the display terminal 12 are connected in a state where data can be transmitted and received using a communication network (wired or wireless) 13 typified by the Internet or a LAN (Local Area Network), for example.

  The providing server 11 manages a script (TVML script file) of a program to be provided to the display terminal 12, a program production engine necessary for program generation, material data (for example, images, video, audio, text data) and the like. Further, the providing server 11 manages a user who uses the display control system 10, or generates a CG video from the CG model data and TVML script file provided to the display terminal 12 and displays it on the screen. Player) program and the like. In this embodiment, since the WebGL version of TVMLPlayer is used, source code executable by a Web browser is managed as an example of a program.

  Further, the providing server 11 provides the information described above to the display terminal 12 according to various conditions such as when there is a request from the display terminal 12 or when a predetermined time comes. The providing server 11 is, for example, a Web server and publishes one or a plurality of Web pages in an accessible state. The display terminal 12 accesses a predetermined Web page among the Web pages described above, selects information necessary for generating a program from items described in the accessed page, and performs a download process. The providing server 11 extracts target data in response to the inquiry by the user's selection described above, and causes the display terminal 12 to download the extracted various data.

  The providing server 11 may be an information processing apparatus such as a PC (Personal Computer) or a cloud server including one or more information processing apparatuses.

  The display terminal 12 generates a program (video content) from a program script (TVML script) provided from the providing server 11, a program production engine, material data, and the like, and displays a program controlled by predetermined display control on the screen. .

  Specifically, the display terminal 12 accesses a predetermined Web page of the providing server 11 and receives the WebGL version of the TVMLLPlayer source code, TVML script, CG model data, program production engine, material data, etc. from the providing server 11. get. In addition, the display terminal 12 activates TVML Player and interprets the TVML script on the Web browser to generate a program including CG video. At this time, in the present embodiment, adaptive control for the display environment is performed according to the performance, screen size, window size, and the like of each of the display terminals 12-1 to 12-n.

  The display terminal 12 in the present embodiment is, for example, a general-purpose PC, but is not limited thereto. For example, a predetermined external device (for example, the providing server 11) or a Web site via the communication network 13 or the like is used. It may be a mobile phone, a notebook PC, a PDA (Personal Digital Assistant), a smartphone, a tablet terminal, various communication terminals of a game machine, etc.

<Example of functional configuration of display terminal 12>
Next, a functional configuration example of the display terminal 12 in the present embodiment will be described with reference to the drawings. FIG. 2 is a diagram illustrating an example of a functional configuration of the display terminal according to the present embodiment. In the example of FIG. 2, the display terminal 12 includes a display control device 21 and a display (display device) 22. The display control device 21 includes an input unit 31, an output unit 32, a storage unit 33, an acquisition unit 34, a content generation unit 35, a display control unit 36, a transmission / reception unit 37, and a control unit 38.

  The input unit 31 accepts each input in an instruction to acquire various information input from a user of the display terminal 12, a content generation instruction such as a program including a CG video, a display control instruction, and the like. The input unit 31 is, for example, a keyboard or a mouse, but is not limited thereto, and may be a voice input device such as a microphone. Further, when the display 22 is a touch panel, the input unit 31 may input a touched position, information set corresponding to the position, or information corresponding to a user's touch operation.

  The output means 32 outputs to the display 22 the contents of instructions input by the input means 31 and the results of processing executed based on the contents of each instruction. Further, the output unit 32 may perform audio output from a speaker or the like.

  The storage unit 33 stores various types of information necessary in the present embodiment. For example, the storage unit 33 includes WebGL version TVMLPlayer source code acquired from the providing server 11, a TVML script that is an example of script data, CG model data that is an example of CG data, material data, and the like. The storage means 33 stores the screen size, window size, etc. of the display 22. The information stored in the storage unit 33 is not limited to this.

  The acquisition unit 34 acquires the source code of the TVMLPlayer described above, the TVML script, CG model data associated with the TVML script, and the like from the providing server 11 and the like.

  Further, when acquiring the CG model data, the acquiring unit 34 may acquire a plurality of CG model data having different numbers of polygons (polygon data) forming the CG model. For example, the acquisition unit 34 acquires CG models of two types (dense and coarse) of polygon data. In this case, the CG model displayed by default assumes that the polygon data is “dense”. The acquisition unit 34 may acquire CG models of three types (fine, medium, and coarse) of polygon data.

  The acquisition unit 34 may acquire performance information such as the screen size and window size of the display 22 that reproduces the CG video generated by the content generation unit 35, and the frame rate being played back. In addition, the acquisition unit provides information necessary for appropriately displaying (operating) the CG video in the display control unit 36 in accordance with the performance of the display terminal 12 and the screen size or window size of the display 22. Get from.

  The content generation unit 35 interprets the TVML script acquired by the acquisition unit 34 line by line, and generates a CG video corresponding to the script. For example, the content generation unit 35 generates a CG video or the like that operates the CG model data obtained by the acquisition unit 34 in correspondence with the TVML script.

  In the present embodiment, the content generation unit 35 can use, for example, the above-described WebGL version of TVML Player, but is not limited thereto. The content generation unit 35 may store the generated CG video or the like in the storage unit 33 or display it on the screen of the display 22 or the like.

  The display control unit 36 performs control processing (display environment adaptive control processing) adapted to the display environment on the CG video such as the CG model generated by the content generation unit 35 and reproduced from the display 22 or the like. For example, the display control unit 36 changes the content of the CG video displayed on the display 22 based on the display state of the reproduced CG video, and performs display control according to the performance of the display terminal 12 and the like.

  For example, the display control unit 36 performs display control for enlarging or reducing the image size of the CG video. The display control unit 36 prepares, for example, CG models with different densities (number of polygons forming the CG model (polygon data)) in advance, according to the display state (performance, etc.) of the display 22. Display control for generating a CG image is performed using a CG model having the same number of polygons.

  For example, when changing the displayed CG model, the display control unit 36 selects the currently displayed CG model from among the plurality of CG model data having different numbers of polygons obtained by the acquisition unit 34 described above. A CG image is generated by changing to CG model data with the same CG model and a different number of polygons. Here, changing to CG model data having a different number of polygons may be, for example, changing to a CG model having a smaller number of polygons than the polygon number of the CG model currently displayed (polygon data is “medium”). (Polygon data: “medium” → “coarse”) or a CG model with a large number of polygons (polygon data: “medium” → “fine”).

  The display control unit 36 dynamically changes the angle of view (camera shot) of the CG model according to the drawing size of the CG model. In the present embodiment, a CG image is generated using at least one of the plurality of display controls described above.

  The transmission / reception means 37 is a communication means for transmitting / receiving data to / from the providing server 11 and other external devices via the communication network 13. The transmission / reception means 37 receives various information related to a TVML script and a CG model for generating a CG video.

  The control unit 38 controls the entire functional configuration of the display control device 21. For example, the control unit 38 acquires various information related to the generation of the CG video based on the input information from the user or the like input by the input unit 31, generates the CG video by the TVML Player, and performs display control. Controls processing such as changing the display contents. The control in the control means 38 is not limited to this, and for example, the display control program can be activated or stopped, or the control when an error occurs in the display control process in the present embodiment can be performed.

  The display 22 reproduces the CG video obtained from the display control device 21. The image size related to the display 22, the window size of the Web browser, and the like are acquired and managed by the control means 38.

  As for the display terminal 12 mentioned above, the display control apparatus 21 and the display 22 may be comprised integrally. In the display terminal 12, the display control device 21 and the display 22 are connected on a one-to-one basis. However, the display terminal 12 is not limited to this, and the display control device 21 controls the plurality of displays 22. Also good. In that case, display control is performed based on the screen size and window size of each display 22.

<Example of display control processing in display terminal 12>
Next, an example of display control processing in the display terminal 12 described above will be described using a flowchart. FIG. 3 is a flowchart illustrating an example of the display control process. In the display control process shown in FIG. 3, the display terminal 12 accesses the providing server 11 (S01), and acquires the source code of TVML Player from the providing server 11 (S02). This source code is a WebGL version of the source code. Next, the display terminal 12 starts TVMLPlayer on the Web browser (S03). Next, the display terminal 12 acquires a TVML script for generating a program from the providing server 11 (S04), and further acquires CG model data corresponding to the TVML script acquired in the process of S04 from the providing server 11 (S05). ).

  Next, the display terminal 12 generates a CG image in which the CG model or the like is operated and displays it on the display 22 or the like (S06). In the process of S06, since the display control is not completed, the process may be internally performed without displaying it on the display 22. Next, the display terminal 12 performs a control process (display environment adaptive control process) adapted to the display environment of the display terminal 12 for the operation (display state) of the CG video obtained by the process of S06 (S07). The display environment adaptive control process in S07 will be described later. Next, the display terminal 12 outputs a (program) including the final CG video obtained by the process of S07 (S08).

<S07: Example of display environment adaptive control processing>
Next, an example of the display environment adaptive control process of S07 described above will be described using a flowchart. FIG. 4 is a flowchart illustrating an example of the display environment adaptive control process. In the example of FIG. 4, the display environment adaptive control process acquires the frame rate (FPS) being reproduced for the CG video generated by the content generation unit 35 and reproduced by the display 22 (S11). Note that the frame rate is one index value for acquiring the display state (for example, processing performance) of the display terminal 12, and another value for determining the display state (for example, a CPU in reproducing CG video). (Central Processing Unit) load rate), CG video generation time, and the like may be acquired.

  Next, the display environment adaptive control process determines whether or not the frame rate acquired in the process of S11 is smaller than a preset specified value (S12). The specified value is, for example, about 10 to 20 (frame / second), but is not limited thereto. If the frame rate is smaller than the specified value (YES in S12), the display environment adaptive control process determines whether the currently (currently) set screen size is equal to or smaller than a preset first threshold (threshold 1). (S13).

  In the display environment adaptive control process, when the image (screen drawing) size is not less than or equal to the threshold value 1 (NO in S13), the image size is reduced by a certain size (S14), and the process returns to S11. The constant size reduction in the processing of S14 means, for example, reduction of about −5% with the current (current) image size as a reference (100%), but the reduction rate is not limited to this.

  When the image size is equal to or smaller than the threshold value 1 (YES in S13), the display environment adaptive control process determines whether the CG model has been changed from the preset display content (default display content). (S15). The default display content indicates that, for example, when the polygon data has two types of CG models of “dense” and “rough”, the CG model of “dense” is displayed. Is not to be done. In the process of S15, when the display content of the CG model has not been changed (NO in S15), the CG model data is changed (S16), and the process returns to S11.

  In the process of S16, the frame rate is increased by changing from the above-mentioned CG model having the polygon data “dense” to the CG model having the polygon data “rough” (the number of polygons is small). A plurality of types of CG model data having different polygon data (number of polygons) may be acquired from the providing server 11 or stored in the storage unit 33 in advance. Note that the CG model at this time is the same CG model. Further, when CG model data is acquired from the providing server 11, it may be acquired before performing the display control process in the present embodiment, and an acquisition request is sent to the providing server 11 at the timing of performing the process of S16. Corresponding CG model data may be acquired.

  In the process of S15, when the CG model has been changed (YES in S15), the display environment adaptive control process determines whether or not the image size is equal to or smaller than a preset second threshold (threshold 2). Judgment is made (S17). The threshold value 2 is a value that is smaller in size than the threshold value 1 described above, but is not limited to this. For example, when the threshold value 1 is about 80% of the image size when the default size of the image is 100%, the threshold value 2 means an image size of about 50% of the default size. In the display environment adaptive control process, when the image size is not equal to or smaller than the threshold value 2 (NO in S17), the image size is reduced by a certain size (S18), and the process returns to S11. In the processing of S18, the constant size reduction means, for example, about -5% reduction based on the current image size as described above, but the reduction rate is not limited to this.

  Further, in the display environment adaptive control process, when the image size is equal to or smaller than the threshold value 2 (YES in S17), next, in the program generation by CG, a camera shot in which a pseudo CG model is captured is preset. It is determined whether or not the camera shot (default camera shot) has been changed (S19). The default camera shot is, for example, an upper body shot of the CG model, but is not limited thereto.

  If the camera shot has not been changed in S19 (NO in S19), the first camera shot is changed (S20), and the process returns to S11. The first camera shot change is, for example, a loose bust shot (for example, a camera shot that displays only the hand, wrist, and its surroundings to such an extent that a sign language operation can be confirmed) from the video of the upper body CG model (from the upper body). It means that the camera shot is changed so as to be an up-image), but the content of the change is not limited to this.

  In the process of S19, the display environment adaptive control process determines whether the image size is a preset lower limit value (S21) when the camera shot has been changed (YES in S19). If not (NO in S21), the image size is reduced by a certain size (S22), and the process returns to S11. In the processing of S18, the lower limit value is an image size or the like of about 25% of the default size, but is not limited to this. For example, an operation based on a CG model displayed on the display 22 (for example, a sign language operation) It is sufficient if the size is such that can be recognized. In S22, the constant size reduction means, for example, reduction of about -5% based on the current image size as described above, but the reduction rate is not limited to this.

  If the image size is the lower limit in the process of S21 (YES in S21), the display environment adaptive control process is terminated.

  If the frame rate is not smaller than the specified value in S12 described above (NO in S12), the display environment adaptive control process determines whether the frame rate is greater than the specified value (S23), If the rate is greater than the specified value (YES in S23), it is determined whether the image size is equal to or greater than a preset third threshold (threshold 3) (S24). The threshold 3 is an image size of about 120% when the default size of the image is 100%, but is not limited to this.

  In the display environment adaptive control process, when the image size is not equal to or larger than the threshold 3 (NO in S24), the image size is enlarged by a certain size (S25), and the process returns to S11. In the processing of S25, the constant size enlargement means, for example, enlargement to be about + 5% from the current screen size (100%), but the enlargement rate is not limited to this.

  In the display environment adaptive control process, when the image size is equal to or larger than the threshold value 3 (YES in S24), it is next determined whether or not the camera shot has been changed (S26). If the camera shot has not been changed (NO in S26), the second camera shot is changed (S27), and the process returns to S11. In the process of S27, for example, a process of changing the camera shot from an upper body shot to a full shot (whole body shot) is performed, but the present invention is not limited to this.

  If the camera shot has been changed in S26 (YES in S26), the display environment adaptive control process determines whether or not the image size is the upper limit (S28). In the processing of S28, the upper limit value is an image size or the like of about 125% of the default size, but is not limited to this. For example, the upper limit value does not exceed the size that can be displayed on the display 22 (full screen display size). Any size is acceptable.

  If the image size is not the upper limit in the process of S28 (NO in S28), the display environment adaptive control process enlarges the image size by a certain size (S29), and returns to the process of S11. In the process of S29, the constant size enlargement means, for example, enlargement to be about + 5% from the current screen size, but the enlargement rate is not limited to this.

  If the image size is the upper limit value in S28 (YES in S28), the display environment adaptive control process is terminated. If the frame rate is not greater than the specified value in the process of S23 (NO in S23), it can be determined that the frame rate is the specified value by the processes of S12 and S23, and thus the process ends.

  If there are three types of polygon data (dense, medium and coarse) and the default is “medium”, “CG model changed?” (Direction in which polygon is dense) between the processes of S24 and S26. Whether or not it has been changed to “?” May be provided. In this case, if the determination result is YES, the process proceeds to S26, and if NO, a process of changing the number of polygons of the CG model data from “medium” to “dense” is added to reduce the frame rate, and thereafter The process returns to S11.

  Further, when the image size is the lower limit value in the process of S21 and when the image size is the upper limit value in S28, the CG video at that time may be output in the above-described process of S08. A message indicating that the corresponding display control is not appropriate as error processing may be displayed.

  As described above, in the present embodiment, by accessing a predetermined Web page provided by the providing server 11 from the display terminal 12, the source code of the WebGL version of TVML Player is acquired from the providing server 11, and the display terminal 12 CG video display control is executed on the Web browser. At this time, a TVML script for generating a CG video is acquired from the providing server 11, and the acquired TVML script is executed by the TVMLLayer. In this process, by rendering the CG model corresponding to the performance of the display terminal 12 using the CG model data described in the TVML script, an appropriate CG image corresponding to the performance of the display terminal 12 is displayed on the Web browser. Can be displayed.

<Example of image size reduction and enlargement>
Next, an example of reducing and enlarging the image size in the display environment adaptive control process described above will be described with reference to the drawings. FIG. 5 is a diagram showing an example of image size reduction and enlargement in the present embodiment. In the example illustrated in FIG. 5, the web browser 41 is displayed in a predetermined size (default size) on the screen 40 of the display 22 of the display terminal 12. The size of the web browser 41 can be adjusted by a user operation. The Web browser 41 displays a CG image 42-1 generated by the content generation unit 35 in a size defined by the TVML script.

  In such a case, in the present embodiment, the frame rate at the time of CG video reproduction of the display terminal 12 is acquired, and the image size is reduced or enlarged as shown in FIG. 5 according to the acquired frame rate or the like. As shown in FIG. 5, the image size of the CG video is changed.

  In the example of FIG. 5, a CG video 42-2 when the image size of the original CG image 42-1 is reduced by a certain size and a CG image 42-3 when the image size is enlarged by a certain size are shown. In the present embodiment, the display terminal 12 can automatically perform reduction and enlargement adapted to the display environment shown in FIG. 5 without depending on a user operation.

  For example, in the display environment adaptive control process described above, if the frame rate is a predetermined value set in advance, the current CG image size is determined to be optimal without performing adaptive control. Further, when the frame rate is smaller than the predetermined value set in advance, the size is compared with the threshold value 1, and when the frame rate is not equal to or less than the threshold value 1, the size (image size) of the CG video rendered on the Web browser 41 is reduced by a certain size. . After the reduction, the frame rate is acquired again, and the image size of the CG video is further reduced and adjusted. Note that, by reducing the image size, the CG model 43 in the CG video is also reduced and displayed.

  In the present embodiment, when the frame rate is larger than a preset specified value, the image size of the CG video is enlarged by a certain size within a range not exceeding the threshold value 3 or more. As shown in FIG. 5, by enlarging the image size, the CG model 43 in the CG video is also enlarged and displayed. Further, after enlargement, the frame rate is acquired again to adjust the image size.

<Example of changing TVML script when changing CG model>
Next, an example of changing the TVML script when the CG model is changed will be described. As described above, in the comparison between the image size and the threshold value 1, when the image size is equal to or less than the threshold value 1, the rendering performance of the display terminal 12 is that the CG model data having the normal number of polygons used cannot be normally rendered. Determine and change to CG model data with a small number of polygons.

  Thereby, according to the performance of the display terminal 12, an appropriate CG image can be displayed without the operation of the CG model 43 slowing down or the frame being interrupted and reproduced (frame missing).

  FIG. 6 is a diagram illustrating an example of changing the TVML script when the CG model is changed. In the example of FIG. 6A, a TVML script for reading a CG model of a normal polygon is shown. In the example of FIG. 6B, a TVML script in the case of reading a low polygon CG model is shown. The low polygon indicates that the number of polygons is about 10 to 20% less than the number of polygons normally used in the CG model, but is not limited to this. For example, the number of polygons is half the normal number of polygons. It may be.

  In the example of FIG. 6C, a TVML script for changing a CG model to a low polygon model is shown. The underlined portions in FIGS. 6A and 6B are file names (acquisition destination addresses) of CG model data. Each model data is generated in advance by the providing server 11 or the like.

  The display terminal 12 acquires the TVML scripts shown in FIGS. 6A and 6B, and changes the CG model data as shown in FIG. 6C according to the conditions in the display environment adaptive control process described above. By executing the TVML script, it is possible to easily change the number of polygons of the CG model. Thereby, it is possible to generate a CG image without a sense of incongruity using a CG model whose drawing load is lower than a CG model having a normal number of polygons.

  In the present embodiment, the normal polygon and the low polygon CG model are the same CG model, but the CG model is not limited to this, and a similar model (for example, a person model of the same gender or an animal model) is used. , A different color model) or the like.

  In the above example, the number of polygons is changed once. However, the number of polygons is not limited to this, and the number of polygons may be adjusted step by step in multiple steps.

<Example of First Camera Shot Change Process>
Next, an example of the first camera shot change process described above will be described. In the present embodiment, as described above, the frame rate is acquired for the CG video changed to the low polygon CG model, and the image size is compared with the threshold 2 when the frame rate is smaller than the specified value. Perform size reduction control. If the image size is equal to or smaller than the threshold value 2, the first camera shot change process is performed.

  FIG. 7 is a diagram illustrating an example of the first camera shot change process. For example, as described above, when the previous camera shot is maintained when the image size is equal to or smaller than the threshold value 2, the entire image becomes small, so that it is difficult to understand the operation (for example, sign language operation) and facial expression of the CG model 43. In order to avoid this, the display control means 36 changes the camera shot so that the CG model 43 is displayed up.

  In FIG. 7, “camera: movement (name = Cam1, x = 0.0, y = 1.2, z = 1.0)” is described as an example of a camera shot TVML script of the CG image 51 of the upper body. ing. Here, the “name” parameter indicates camera identification information, and x, y, and z indicate three-dimensional position coordinates based on the camera. At this time, the x coordinate indicates the horizontal direction of the screen, the y coordinate indicates the vertical direction of the screen, and the z coordinate indicates the depth direction of the screen (for example, the distance between the camera and the CG model).

  Here, in the display environment adaptive control process, when changing the camera shot from the upper body shot to the loose bust shot, the camera parameters for the loose bust shot are input to the TVML Player. As camera parameters for the loose bust shot, for example, x = 0.0, y = 0.8, and z = 0.3 are set to change the camera shot from the upper body shot of the CG model 43 to the loose bust shot. be able to.

  In this way, by changing the angle of view of the camera and changing from the original CG video 51 shown in FIG. 7 to the CG video 52, even when the image size is small, the operation and expression of the CG model 43 can be displayed in an easy-to-understand manner. Can do. In the CG image 52 shown in FIG. 7, the hand and wrist portions are not displayed. For example, when the CG model 43 performs a sign language operation, the hand or wrist moves in the vicinity of the face or the chest. Can be easily confirmed.

  In the first camera shot change process, the upper body shot is changed once to the loose bust shot. However, the present invention is not limited to this, and it is divided into multiple steps until the upper body shot changes to the loose bust shot. The camera parameters may be adjusted to be changed to

  In the present embodiment, after changing the camera shot, it is determined whether or not the current image size is a preset lower limit image size. If the lower limit value has been reached, the display environment adaptive control process ends here.

<Example of Second Camera Shot Change Process>
Next, an example of the second camera shot change process described above will be described. In the present embodiment, when the frame rate is greater than a preset specified value, the image size of the CG video is enlarged by a certain size within a range that does not exceed the threshold 3, and when the image size exceeds the threshold 3, In order to adjust the size of the CG model 43, a second camera shot change process is performed.

  FIG. 8 is a diagram illustrating an example of the second camera shot change process. As shown in FIG. 8, in the second camera shot changing process, camera parameters for displaying the CG model 43 from the upper body shot to the full shot (whole body shot) are input to the TVML Player. That is, in order to balance the image size of the output CG video, the angle of view of the camera is changed to a camera parameter to a camera shot (full shot) in which the entire CG model 43 is displayed. This is because the full shot is originally easier to understand the operation of the CG model 43 (sign language etc.), so when the image size is somewhat large, the full shot is changed to a full shot.

  In the example of FIG. 8, the camera parameters of the upper body shot are changed to camera setting parameters (for example, x = 0.0, y = 1.5, z = 1.8) that are full shots of a preset CG model. . Thereby, the angle of view of the camera can be changed, and a balanced CG image 53 can be generated from the original CG image 51 and displayed.

  In the second camera shot change process, the upper body shot is changed once to the full shot. However, the present invention is not limited to this, and the change is made in stages until the upper body shot is changed to the full shot. The camera parameters may be adjusted as described.

  In the present embodiment, after changing the camera shot, it is determined whether or not the image size is a preset upper limit value. If the image size has reached the upper limit value, the display environment adaptive control process is terminated.

  With the control described above, it is possible to display CG video adapted to the performance of the display terminal 12, display size, and the like for reproduction of CG video.

<Execution program (display control program)>
Here, the display control device 21 described above includes, for example, a volatile storage medium such as a CPU and a RAM (Random Access Memory), a non-volatile storage medium such as a ROM (Read Only Memory), a mouse, a keyboard, a pointing device, and the like. The input device, a display unit for displaying images and videos, various data, and a computer having an interface for communication with the outside can be used.

  Accordingly, each function of the display control device 21 can be realized by causing the CPU to execute a program describing these functions. The program can also be stored and distributed in a recording medium such as a magnetic disk (such as a hard disk), an optical disk (such as a CD-ROM or DVD), or a semiconductor memory.

  That is, in the present embodiment, an execution program (display control program) for causing the computer (hardware) to execute the processing in each configuration described above is generated, and for example, a general-purpose PC, server, tablet terminal, smartphone, etc. By installing the program, the display control process described above can be realized by cooperating the hardware described above and software including the program.

  As described above, according to the present embodiment, an appropriate CG image can be displayed for each display terminal. For example, in this embodiment, the user can view CG video corresponding to each display device by adapting CG drawing according to the performance of the display terminal and the display environment. Even if the image size is reduced, the user can acquire necessary information from the CG video. In addition, even if the image size is large, the user can view a CG video with less discomfort.

  Each embodiment has been described in detail above. However, the present invention is not limited to the specific embodiment, and various modifications and changes other than the above-described modification are possible within the scope described in the claims. . In addition, each of the above-described embodiments can be combined with some or all of the components.

DESCRIPTION OF SYMBOLS 10 Display control system 11 Provision server 12 Display terminal 13 Communication network 21 Display control apparatus 22 Display (display apparatus)
31 Input Means 32 Output Means 33 Storage Means 34 Acquisition Means 35 Content Generation Means 36 Display Control Means 37 Transmission / Reception Means 38 Control Means 40 Screen 41 Web Browser 42, 51-53 CG Video 43 CG Model

Claims (6)

In a display control device that performs control for displaying a CG image corresponding to script data on a display device,
Obtaining means for obtaining CG model data associated with the script data;
Content generating means for generating a CG video for operating the CG model data obtained by the acquiring means in correspondence with the script data;
A display control apparatus comprising: display control means for performing display control of the CG video in correspondence with a display state when the CG video generated by the content generation means is displayed on the display device. The display control means includes
Based on the frame rate when the CG video is played back on the display device, the image size of the CG video is reduced or enlarged, the CG model data is changed, and the camera shot is changed when the CG model data is captured. The display control apparatus according to claim 1, wherein at least one of the display control devices is controlled. The display control means includes
A frame rate when the CG video is reproduced on the display device is compared with a specified value, and when the frame rate is smaller than the specified value, the image size of the CG video is reduced, and the frame rate is set to the specified value. The display control apparatus according to claim 2, wherein when the value is larger than the value, the image size of the CG video is enlarged. The display control means includes
When the reduced image size is equal to or smaller than the corresponding first threshold, the camera shot is changed so that the CG model is displayed up, and the enlarged image size is equal to or larger than the corresponding second threshold. The display control apparatus according to claim 2, wherein the camera shot is changed so that the entire CG model is displayed. The display control device according to any one of claims 1 to 4,
And a display device that displays the CG video obtained from the display control device on a screen.   A display control program for causing a computer to function as the display control apparatus according to any one of claims 1 to 4.