JP7018645B2 - Video generator - Google Patents

Description

The present invention relates to an image generator that generates one image from a plurality of images.

For example, companies are often publishing materials such as financial statements on the Internet for IR (Investor Relations) activities. At this time, not only the materials but also the video of the pattern of the briefing session etc. may be released together.

For example, Patent Document 1 describes that an event such as a general meeting of shareholders is distributed in order to support IR activities of a company.

Japanese Unexamined Patent Publication No. 2002-269440

However, a viewer such as an investor may not be able to view them at the same time simply by publishing the materials and the video respectively. Also, even if they can be viewed at the same time, it is inconvenient for the viewer if he / she does not know which part of the material is explained in the video.

Furthermore, if the material and the video are simply displayed separately, the video screen may become smaller, and the facial expressions, gestures, etc. of the explainer may be difficult for the viewer to understand and lack a sense of presence.

Therefore, it is an object of the present invention to provide a video generation device capable of generating a video with a sense of reality in consideration of the convenience of the viewer in view of the above problems.

The invention according to claim 1 made to solve the above problems is a main video information input unit in which a main video, which is a video displayed by the presenter, is input, and information related to the content of the presentation by the presenter . The related information input unit to which certain related information is input and the related information input to the related information input unit are displayed in a predetermined range within the display area of the main video input to the main video information input unit. A generation unit that generates a composite video, a video generation program that causes a computer to function as a function, and a storage unit that stores the composite video generated by the generation unit are provided , and the composite video is linked to the main video. The image generation device is characterized in that the display content of the related information is changed.

The invention according to claim 2 is the invention according to claim 1, wherein the related information is composed of a plurality of pages, and in the composite video, the main video and the page feed of the related information are linked. It is characterized by the fact that it is.

The invention according to claim 3 is characterized in that, in the invention according to claim 2, the display mode in the page changes in the synthetic video.

The invention according to claim 4 is characterized in that, in the invention according to claim 2 or 3, the page feed of the related video is switched to the next page by requiring a plurality of frames. ..

The invention according to claim 5 is the invention according to any one of claims 1 to 4, wherein the related image is displayed in the composite image until it falls within the predetermined range. It is characterized in that it is displayed so as to gradually expand from a small range.

The invention according to claim 6 is the invention according to any one of claims 1 to 5, wherein the video generation program further includes a table of contents generation unit that generates table of contents information displayed together with the composite video. The table of contents information is characterized by including time information for reproducing the synthesized video from a specific position and item information corresponding to the time.

As described above, according to the invention of claim 1, related information is displayed in a predetermined range in the display area of the main image. Therefore, for example, the moving image of the briefing session is used as the main video, and the main video and the briefing session are used. It is possible to browse related information such as materials for use at the same time. In addition, since the related information is displayed as if it is embedded in the main video, the main video can be displayed larger than the related information depending on the application, so the facial expressions of the presenter, etc. displayed in the main video can be understood. It becomes easier and gives a sense of presence. Further, since the display content of the related information changes in conjunction with the main video, the related information can be displayed in conjunction with the content of the main video. Therefore, it is possible to generate an image in consideration of the convenience of the viewer.

According to the invention of claim 2, the related video is composed of a plurality of pages, and the generation unit links the main video and the page feed of the related information. It becomes possible to display.

According to the third aspect of the present invention, the related video can be highlighted in the page in conjunction with the main video, for example, highlighting, etc., and the explanation content can be made easier to understand.

According to the invention of claim 4, since the page turning of the related video is switched to the next page by requiring a plurality of frames, it is possible to reduce the visual discomfort at the time of page turning.

According to the invention of claim 5, when the related video is displayed in the composite video, the related video is displayed so as to expand the range to be a predetermined area, so that the related video is displayed with a sense of presence. be able to.

According to the invention of claim 6, since the table of contents information to be displayed together with the composite video is generated, the viewer can easily browse the desired material and watch the explanation by manipulating the table of contents information. be able to.

It is a schematic block diagram of the computer which executes the image generation program which concerns on one Embodiment of this invention. It is a functional block diagram of the image generation program which concerns on one Embodiment of this invention. It is explanatory drawing of the synthetic image example generated by the generation part shown in FIG. It is explanatory drawing about the page feed in the composite video generated by the generation part shown in FIG. It is explanatory drawing about the visual effect at the time of display of the related image in the composite video generated by the generation part shown in FIG. It is explanatory drawing about the visual effect at the time of display of the related image in the composite video generated by the generation part shown in FIG. It is explanatory drawing about the visual effect at the time of display of the related image in the composite video generated by the generation part shown in FIG. It is a flowchart of the operation of the video generation program shown in FIG. It is explanatory drawing of another example of the synthetic image generated by the generation part shown in FIG. This is an example in which a table of contents is added to the synthetic video example shown in FIG. It is explanatory drawing of the table of contents information shown in FIG.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a schematic configuration diagram of a computer that executes a video generation program according to an embodiment of the present invention.

The computer 100 shown in FIG. 1 has a CPU 101, a ROM 102, a RAM 103, an SSD 104, a video I / F 105, an input I / F 106, a peripheral device I / F 107, and a network I / F 108. There is.

The CPU 101 is a central processing unit that executes a program stored in the ROM 102 or a program stored in the SSD 104.

The ROM 102 is a read-only memory in which a program, data, or the like executed when the computer 100 is started is stored. The RAM 103 is a random access memory in which data and the like when the CPU 101 executes various programs and the like are temporarily stored. The SSD 104 is a Solid State Drive that stores a program executed by the CPU 101 including a video generation program described later and data (information) used in the program. It should be noted that the HDD (hard disk drive) may be used instead of the Solid State Drive, or an optical disk drive may be provided.

The video I / F 105 is an interface (I / F) for displaying on a display device (not shown) such as a liquid crystal display, and the processing result of the CPU 101 or the like is converted into a display format of the display device (not shown) and displayed. .. An input device such as a keyboard or a mouse is connected to the input I / F 106, and an input signal from the input device is output to the CPU 101 or the like. The peripheral device I / F 107 is an expansion I / F such as a USB (Universal Serial Bus), and an external peripheral device such as a printer or an external HDD is connected to the peripheral device I / F 107. The network I / F 108 is an I / F for connecting to an external network such as the Internet, and may be either wired communication or wireless communication.

The CPU 101, ROM 102, RAM 103, SSD 104, video I / F 105, input I / F 106, peripheral device I / F 107, and network I / F 108 are connected to each other by a bus 109. ..

Next, a video generation program according to an embodiment of the present invention executed by the CPU 101 of the computer 100 described above will be described with reference to FIGS. 2 to 5. FIG. 2 is a functional configuration diagram of a video generation program. As shown in FIG. 2, the video generation program 1 has a main video input unit 2, a related information input unit 3, a generation unit 4, and an output unit 5.

The main video input unit 2 reads out the main video stored in the SSD 104 and outputs it to the generation unit 4. The related information input unit 3 reads out the related information stored in the SSD 104 and outputs it to the generation unit 4. That is, the main video input unit 2 functions as a main video information input unit in which the main video is input, and the related information input unit 3 functions as a related information input unit in which related information is input. Here, an example of the composite video generated by the video generation program 1 will be described with reference to FIG.

FIG. 3 is a composite video G in which materials such as sales are embedded in a video of a moving image explained by a presenter P such as the president at a general meeting of shareholders. Here, a wide range including the presenter P is the main image M, and materials such as graphs displayed in a predetermined range in the display area of the main image M are the related information R. That is, the related information R is information displayed subordinately to the main video M, and is information related to the main video M.

The generation unit 4 generates a composite video as shown in FIG. 3 based on the main video information read by the main video input unit 2 and the related video information read by the related information input unit 3. The output unit 5 outputs and stores the composite video generated by the generation unit 4 to, for example, the SSD 104.

In the above-mentioned composite video G, the related information R changes according to the reproduction (time lapse) of the main video M. Here, an example in the case where the related information R is data (slides or the like) composed of a plurality of pages will be described with reference to FIG. In FIG. 4, the related information R is paged to the second page at time t1, paged to the third page at time t2, and paged to the fourth page at time t3. That is, in the composite video G, the main video M and the page feed of the related information R are interlocked (the display content of the related information R is changed in conjunction with the main video M).

In the generation unit 4, for example, in the data related to the related information R of the composite video G, the information of the reproduction time of the main video M at the timing of page turning is added, and the information is based on the added information (additional information). The page according to the playback time is displayed. This additional information is added, for example, by an operator or the like specifying an addition timing (reproduction time of the main video) from a keyboard or the like. Further, the operator or the like can arbitrarily specify the size, display position, etc. of the related information R in the composite video.

Alternatively, when the composite video G is generated, the related information R is arranged in the main video M, the related video R is paged at a predetermined timing while playing the main video, and the main video is played back to the related video. The page-turned state may be recorded as one composite video G as it is.

Here, it is preferable that the page feed (switching of pages) of the related video R is not switched in an instant, but is switched over a plurality of frames (about several tens of frames). That is, it is preferable that the page feed of the related video requires a plurality of frames and is switched to the next page. In other words, by switching pages over multiple frames, it is possible to avoid the appearance of sudden switching of pages and give the image a sense of luxury and presence. In the switching period consisting of a plurality of frames, for example, visual effects such as fade-in / fade-out and page-turning effects may be applied.

Further, the related video R may not be displayed at the same time as the reproduction of the main video M is started. That is, the related video R may be displayed at the timing of explaining, for example. The related image R may be displayed in the main image M by, for example, a visual effect as shown in FIG. In the upper part of FIG. 5, first, a rectangular frame line F elongated in the vertical direction of the image is displayed. Next, in the middle part of FIG. 5, the frame line F spreads to the left and right and expands to the left and right to the range necessary for displaying the related image R. That is, it gradually expands from a smaller range until it reaches a predetermined range. In the state of the middle stage of FIG. 5, only the frame line F is provided. Then, the related video R is displayed in the range of the frame line F in the lower part of FIG. That is, a frame indicating the area of the related video R may be displayed, and then the related video R may be displayed in the range of the frame. This frame line F is not limited to the mode extending from the elongated rectangle as shown in FIG. 5, and is related to the display range of the related image R, for example, the mode in which the frame line F is sequentially drawn from the upper left as shown in FIG. Anything may be displayed before the image R.

Further, the visual effect at the time of displaying the related image R is not limited to FIGS. 5 and 6, and a method may be used in which the related image R is displayed so as to expand from the state of the point D as shown in FIG. Further, the display may be such that it extends from a line instead of a point. Furthermore, the area of the predetermined area that is the display area of the related image R is expanded, such as being displayed by moving from the top to the bottom of the screen, or conversely being displayed by moving from the bottom to the top. It may be displayed as if it were displayed. The area expansion of the related image R is not limited to points and lines, and may be such that the area is gradually expanded from a reduced image of about 50% as an initial state. The above-mentioned visual effects can be achieved by applying technologies such as CG (Computer Graphics) and VFX (Visual Effects). By doing so, it is possible to give a sense of presence when displaying the related video R.

Further, the visual effects shown in FIGS. 5 to 7 and the like may be applied at the time of page turning described above. For example, by inserting the visual effect shown in FIG. 5 into page switching, it is possible to reduce the sudden feeling of page turning and give the image a high-class feeling.

Next, a flowchart of the operation of the video generation program 1 will be described with reference to FIG. 7. First, the main video input unit 2 reads the main video M from the SSD 104 (step S1), and the related information input unit 3 reads the related information R from the SSD 104 (step S2). The order of steps S1 and S2 may be reversed.

Next, the generation unit 4 generates a composite video G based on the main video M read by the main video input unit 2 and the related information R read by the related information input unit 3 (step S3). Then, the output unit 5 outputs and stores the composite video G generated by the generation unit 4 to, for example, the SSD 104 (step S4). The output composite video G is stored in, for example, a Web server or the like, and is distributed in response to an access from the outside. Further, the generation unit 4 may generate a plurality of types of the composite image G by performing movie optimization for each accessed terminal (step S5). For example, since many mobile terminals such as smartphones generally have lower processing performance than terminal devices such as PCs, the composite image G for mobile terminals has a bit rate, frame rate, or compression rate suitable for the mobile terminal. Perform such optimization. In the Web server or the like, the type of the terminal is identified by the tag information or the like transmitted by the software or the like on the terminal side such as the accessed browser, and the composite image G suitable for the terminal is distributed. By doing so, it becomes possible to smoothly reproduce any terminal.

According to the video generation program described above, the main video M is input from the main video input unit 2, the related information R, which is information related to the main video M, is input from the related information input unit 3, and the generation unit 4 is used. A composite video G in which the related video R is embedded in a predetermined range in the display area of the main video M is generated. Then, in the composite video G, the related video R changes in conjunction with the main video M. By doing so, since the related video R is embedded in the display area of the main video M, for example, the moving image of the briefing session is set as the main video M, and the main video M and the materials for the briefing session are related. Information R and information R can be viewed at the same time. Further, since the related information R is displayed as if it is embedded in the main video M, the main video M can be displayed larger than the related information R depending on the application, so that the presenter P displayed on the main video M can be displayed. It is possible to give a sense of realism by making it easier to understand facial expressions such as. Further, the related information R can be displayed in conjunction with the content of the main video M. Therefore, it is possible to generate an image in consideration of the convenience of the viewer.

Further, since the related information R is displayed as if it is embedded in the M in the main video, the display mode does not change depending on the screen size of the terminal to be viewed, and any terminal can be viewed in the same mode. ..

Further, the related video is composed of a plurality of pages, and the generation unit 4 links the main video M and the page feed of the related information R, so that it is possible to display, for example, the page of the material that matches the explanation content. It becomes.

In the above-described embodiment, the related video is described as a still image for each page, but it may be a moving image. In addition, even if it is page-by-page, various effect processing such as highlighting specific characters on the page according to the explanation and changing the color and size of the part to be emphasized in the graph can be performed. It may be applied by the generation unit 4. That is, the display mode on the page has changed. FIG. 9 is an example of highlighting. Similar to FIG. 3, FIG. 9 also displays the related information R in the display area of the main video M. Then, the portion of the related video R to be emphasized is displayed as the highlight H. This highlight H is emphasized according to the explanation of the relevant part.

As for the timing of the effect such as highlight H, by adding the reproduction time as additional information as in the case of page turning, the effect can be displayed according to the explanation of the relevant portion.

Further, as shown in FIG. 10, the generation unit 4 may generate a table of contents (table of contents information) for reproducing the composite video G from a specific position separately from the composite video G. FIG. 10 is, for example, a screen of a Web browser, in which the table of contents I is displayed on the right side where the composite video G is displayed. In this table of contents I, for example, when "2. 2016 first half results" is clicked, the playback position of the composite video G moves to the playback time corresponding to the item. Then, the main video M starts playing from the playback time after the movement, and the related information R displays the page displayed at the playback time after the movement.

For such table of contents information, the generation unit 4 generates a table corresponding to the table of contents I of FIG. 10 as shown in FIG. 11, and by linking it to the composite image G, the numbers or chapter titles of the table of contents I ( If you click (item information), you can play back from the playback time set in the time (time information) in FIG.

Further, the video generation program 1 can be applied not only to IR-related products but also to video generation used in presentations such as product announcements and e-learning (e-learning).

The present invention is not limited to the above embodiment. That is, those skilled in the art can carry out various modifications according to conventionally known knowledge within a range that does not deviate from the gist of the present invention. As long as the configuration of the video generation program of the present invention is still provided by such a modification, it is, of course, included in the category of the present invention.

1 Video generation program 2 Main video input section (main video information input section)
3 Related information input unit 4 Generation unit (table of contents generation unit)

Claims (6)

The main video information input section where the main video, which is the video displayed by the presenter, is input,
A related information input unit in which related information, which is information related to the content of the presenter's presentation, is input, and a related information input unit.
The computer functions as a generation unit for generating a composite video in which the related information input to the related information input unit is displayed in a predetermined range in the display area of the main video input to the main video information input unit. A video generation program to make
A storage unit in which the composite video generated by the generation unit is stored, and a storage unit.
Equipped with
In the composite video, the display content of the related information changes in conjunction with the main video.
A video generator characterized by this. The related information is composed of multiple pages.
In the composite video, the main video and the page feed of the related information are linked.
The video generation device according to claim 1. The video generation device according to claim 2, wherein the composite video is subjected to effect processing on an arbitrary portion in the page . The video generation device according to claim 2, wherein the page feed of the related video is switched to the next page by requiring a plurality of frames. Claims 1 to 4 are characterized in that, when the related video is displayed in the composite video, the related video is displayed so as to gradually expand from a smaller range until the predetermined range is reached. The video generator according to any one of the above. The video generation program further functions the computer as a table of contents generation unit that generates table of contents information displayed together with the composite video.
The video generation according to any one of claims 1 to 5, wherein the table of contents information includes time information for reproducing the composite video from a specific position and item information corresponding to the time. Device.

Images