JP5214426B2 - How to overlay comments on a video - Google Patents

Description

  The present invention relates to a method for displaying a comment on a moving image, and particularly to a method for displaying a comment on a moving image and distributing it on the Internet.

There is a technique for superimposing comments on image information such as moving images and distributing them over the Internet.
For example, Patent Literature 1 discloses a system including a moving image server and a comment distribution server. In the system, the client writes comments via the network, and those comments stored in the comment distribution server are distributed over the moving image. At this time, every time a video is distributed, the client cumulatively writes comments to the comment distribution server for each video scene, and the comments written in the past distribution are read in the same video scene in the future distribution It is configured to be able to.

  This document discloses a technique in which image information formed based on a comment from a comment distribution server is superimposed on image information of a moving image from a moving image server in time series. When a plurality of comments are simply overlaid on a moving image and they overlap each other, the position of one comment is changed so that the comments do not overlap each other.

JP 2008-148071 A

  In recent years, with the spread of the Internet, the number of comments from clients regarding video distribution has increased rapidly. In addition, comments tend to concentrate on a specific scene of one moving image. In order to avoid missing comments, these comments must be distributed within the time that the scene is distributed.

  In order to deliver a large amount of comments within that time, the above document proposes some ideas. For example, it is determined whether to change the speed at which the comment is moved on the screen depending on the length of the comment, or whether the previous comment and the subsequent comment overlap. Change the position on the screen from the previous one, determine whether or not the subsequent comment overlaps with the next comment, and if it overlaps, perform the chain reaction image processing to change the position Has proposed. Furthermore, in some cases, it is proposed to adjust the size of the character of the comment.

  However, since the length of time of a specific scene is fixed and the size of the screen is also fixed, when a large amount of comments are concentrated, a new display for displaying subsequent comments even with such image processing You may not be able to find space. This document does not mention this.

  Accordingly, an object of the present invention is to display a plurality of comments related to a scene within the display time of a specific scene of the video without disturbing a plurality of comments within the display time of the specific scene of the video in a method of displaying a comment on a video. It is to propose a method of displaying the comment on the video.

The above-described problem has been solved by a method for displaying a comment on a moving image according to the present invention.
[1] A combination of a comment storing process for storing a comment made up of a character string in the comment storage unit, an elementary comment image object forming process for forming an elementary comment image object from a comment made up of a character string, and the above-mentioned elementary comment image object In a method for displaying a comment on a moving image, comprising: a composite comment image object forming process for forming a comment image object; and a moving image image display process with a comment for displaying the composite comment image object on a moving image.
When a new elementary comment image object is added to a new elementary image object insertion position, which is a fixed position in the composite comment image object, and when adding a new elementary comment image object, The vertical position of all existing raw comment image objects is moved in the vertical direction away from the new raw image object insertion position, and a new raw comment image object is inserted at the position of the new raw image object insertion position. The method of displaying the comment on the video.
[2] The moving picture according to [1], wherein the insertion position of the new elementary image object is a bottom line, and the movement in the vertical direction is to move up one line in the upward direction. A method of displaying comments superimposed.
[3] The composite comment image object holds the value of the horizontal movement speed on the screen when each of the elementary comment image objects is displayed on the screen, and each elementary comment image object is moved in the horizontal direction. The method according to [1], wherein the comment is superimposed on the moving image, wherein the moving image is moved according to a speed value.
[4] The method for displaying a comment on the moving image according to [3], wherein the moving speed in the left-right direction is determined as a function of the length of each elementary comment image object.
[5] The moving speed described in [3] above is characterized in that the moving speed of the left-right direction is determined so that a time during which each elementary comment image object crosses the screen in the left-right direction becomes a constant value. How to display.
[6] When the vertical size of the composite comment image object exceeds a predetermined vertical size, only the portion from the new raw image object insertion position to a position corresponding to the predetermined vertical size is included. The method for displaying a comment on the moving image according to [1] above, wherein the comment is displayed on a screen.
[7] The method according to [6], wherein the predetermined vertical size is equal to the vertical size of the moving image display area, with the comment superimposed on the moving image.
[8] When any of the complex comment image objects passes through the left end position of the unique display area, the elementary comment image object is deleted, and the new comment image object is The above [1] is characterized in that the vertical position of all the raw comment image objects that are in the vertical direction far from the raw comment image object is moved by one line so as to be close to the new raw image object insertion position. A method of displaying comments on the described videos.
[9] The method for displaying a comment superimposed on the moving image according to the above [1], wherein the comment is superimposed on the moving image via a network such as the Internet.

  According to the above-described invention, a plurality of comments related to the scene can be displayed on the screen without being disturbed within the display time of the specific scene of the moving image.

  In particular, according to the above invention [2], comments can be displayed from the top in the order of moving images (described later). Further, according to the inventions [3] to [5], the comment can be moved in the left-right direction at an appropriate moving speed. Further, according to the invention [6], it is possible to overflow the comment. In addition, according to the invention [7], the screen can be used effectively. Further, according to the invention [8], it is possible to display comments using the screen without waste. In addition, according to the invention [9], distribution is possible via a network.

  Hereinafter, an embodiment of a method for displaying a comment on a moving image according to the present invention will be described with reference to the drawings.

  FIG. 1 is a conceptual diagram of a comment storage unit that stores comments transmitted by a client in a character string format. Although FIG. 1 is expressed in an image format, it is actually stored as tabular data. These comments 1 (C1), comments 2 (C2)... Are written by the client in response to each scene of the moving image in past distribution or current distribution via a network such as the Internet. These comments 1 (C1), comments 2 (C2),... Are displayed over the moving images in the corresponding scenes during current distribution or future distribution via a network such as the Internet. is there.

  In the comment storing process in the comment storage unit, in addition to information about the actual date and time when the comment was written, information for displaying the scene of the movie in which the comment was written, for example, the movie The information about the elapsed time from the start of distribution is attached and stored in the comment storage unit. This “information about the elapsed time from the start of moving image distribution” is referred to as “moving image time” in this specification. Furthermore, information about the person who posted the comment is also attached.

  In the case of FIG. 1, comment numbers are assigned in order of the date and time when comments are actually written. That is, comment 1 (C1) is the newest, comment 2 (C2), comment 3 (C3), comment 4 (C4). On the other hand, comment 10 (C10) is the earliest video time, followed by comment 4 (C4), comment 8 (C8), comment 6 (C6). The length of the comment frame symbolically represents the length of the comment character string.

  Comment 1 (C1), comment 2 (C2),... Are transmitted via a network such as the Internet corresponding to each scene of the moving image. That is, for example, when the video time of the comment 10 (C10), the comment 4 (C4), and the comment 6 (C6) is “90 seconds”, “95 seconds”, and “110 seconds”, the distribution of the video is started. When the elapsed time from “90 seconds”, “95 seconds”, and “110 seconds” is reached, the comment is displayed superimposed on the moving image.

  In the elementary comment image object forming process, an elementary comment image object is created based on each comment, and in the compound comment image object forming process, a plurality of elementary comment image objects are combined to form a compound comment image object. “Object” in this specification means the same as “object” in an object-oriented language such as C ++, and is a collection of data. Both the “elementary comment image object” and the “composite comment image object” are a collection of data, and even in the case of illustration, they are merely symbolically shown.

  FIG. 2 is a conceptual diagram showing the relationship between a plain comment image object and a composite comment image object. A comment is made up of a character string, and a plain comment image object is a representation of the comment in an image format. These elementary image objects are pasted on the composite image object. FIG. 2 shows a composite comment image object A in which the original comment image objects of comment 4 (C4) and comment 10 (C10) and part of the original comment image objects of comment 11 (C11) and comment 12 (C12) are included. Indicates the state of being pasted.

  A unique display area is previously defined for the composite comment image object. Only the portion that overlaps the composite comment image object and the unique display area is displayed on the screen. A region B indicated by a broken line in FIG. 2 is a “unique display region” of the composite image object. FIG. 3 is a conceptual diagram showing a screen of a client terminal. The video and comments are displayed on the client's screen during the video image display with comments. The entire screen Z includes a moving image area D in which moving images are displayed and a comment area E in which comments are displayed. The region D and the region E are not necessarily matched. The raw comment object (part of C10 and C4) in the unique display area B of the composite comment image object A in FIG. 2 is displayed in the comment area E in FIG.

  Each elementary comment object is given a value for the moving speed in the left-right direction, and is held as one property of the composite comment image object. Move at speed. FIG. 4 is a conceptual diagram showing that the position of the original comment image object in the composite comment image object of FIG. 2 has moved to the left. In this state, in the comment area E in the screen of the client terminal, the head part of the comment 10 (C10) and the tail part of the comment 4 (C4) are not displayed.

  Next, the process of adding a new elementary comment image object to the composite comment image object will be described. In the method of displaying a comment superimposed on a moving image according to the present invention, a new elementary comment image object is inserted at a predetermined location (referred to as a new elementary image object insertion position) of the composite comment image object. In the following description, it is assumed that the new elementary image object insertion position N is the right end of the bottom row of the unique display area B of the composite comment image object. FIG. 5 is a conceptual diagram showing that the new elementary image object insertion position N is the right end of the bottom row of the unique display area B.

  FIG. 6 is a conceptual diagram showing a process of newly adding a raw comment image object to a composite comment image object. In FIG. 6, for the sake of simplicity, the vertical and horizontal sizes of the unique display area B and the vertical and horizontal sizes of the comment area E of FIG. 2 are made to coincide with the moving picture area D, and the area D and the area E are at the same position. It is set to be displayed on the screen and the display area is matched. In this embodiment, a comment appears to be displayed with a moving image as a background.

  In [Sequence 1] in FIG. 6, the composite comment image object is composed of a plain comment image object C10 based on the comment 10 (C10). [Order 1] is (at the time of moving image 90 seconds in the above example), an elementary comment image object C10 based on the comment 10 (C10) is inserted at the new elementary image object insertion position, and is half the length of the elementary comment image object. It moves from the right to the left until only the top half of it is superimposed on the video. As time elapses, this plain comment image object C10 advances to the left and disappears from the left end.

  At the moving image time (95 seconds in the above example) at which the comment 4 (C4) is inserted, the elementary comment image object C10 based on the comment 10 (C10) is moved up by one line. As a result, the new elementary image object insertion position N in the bottom row is empty, and the elementary comment image object C4 based on the comment 4 (C4) is inserted there.

  As a result, in [Order 2], the composite comment image object is composed of the elementary comment image object C10 based on the comment 10 (C10) and the elementary comment image object C4 based on the comment 4 (C4). [Sequence 2] is a state in which the comment image object based on the comment 10 (C10) and the comment 4 (C4) is slightly moved in the left direction at each predetermined speed after the comment 4 (C4) is inserted. It is. In this embodiment, the last part of the comment 10 (C10) is not yet displayed on the screen, and only the top part of the comment 4 (C4) is displayed on the screen.

  In [Order 3] in FIG. 6, the video time is the video time of comment 8 (C8) (110 seconds in the above example), and the elementary comment image object C8 based on comment 8 (C8) is on the bottom line. Indicates the inserted state. That is, the original comment image objects C10 and C4 of the comment 10 (C10) and the comment 4 (C4) displayed on the screen having a moving image time earlier than the moving image time of the comment 8 (C8) are moved up by one line. In this state, the lowest new elementary image object insertion position N is opened, and the elementary comment image object C8 based on the comment 8 (C8) is inserted therein. As a result, in [Sequence 3], the composite comment image object is an elementary comment image object C10 based on the comment 10 (C10), an elementary comment image object C4 based on the comment 4 (C4), and an element based on the comment 8 (C8). It consists of a comment image object C8. In [Order 3], the comment 10 (C10) moves to the left, and the head portion has already disappeared from the screen. The end of the long comment 4 (C4) has not been displayed yet. The comment 8 (C8) inserted into the composite comment image object at this moment is not yet displayed on the screen.

  As described above, the elementary comment image objects C10, C4, and C8 of [Order 1], [Order 2], and [Order 3] move from the right to the left on the screen with time and at the respective speeds. . As the movie time advances, all the original comment image objects move to the left in the composite comment image object, and the comment 8 (C8) is also displayed on the screen.

  Thus, every time a new comment is added, the existing raw comment image object is moved up by one line. By repeating this process, a large number of comments can be displayed on the screen one after another. When a large number of comments are concentrated during a short video time, the preceding comments are moved up one after another, and all comments are displayed from the top in the order of the video time.

  However, the maximum number of comments K that can be displayed simultaneously (for example, 25 lines) is defined in the unique display area of the composite comment image object. When more comments (for example, 30 lines) than the maximum number of lines are concentrated on a specific scene of the movie, comments before the maximum number of lines K in the preceding comments (the movie time is young) are displayed from the top of the screen. It goes out and is not displayed on the screen. However, it is not deleted from the composite comment image object.

  When there are K elementary comment image objects in the unique display area B and the K + 1th comment is displayed, the vertical positions of all the elementary comment image objects in the unique display area are moved up by one line. As a result, the elementary comment image object displayed at the top comes out of the screen. Then, the K + 1th elementary comment image object is inserted in the bottom line. Repeat this. As described above, when comments concentrate on a short video time, the display time of each comment is shortened, but all comments are reliably displayed on the screen without overlapping each other.

  FIG. 7 is a conceptual diagram showing a state in which a large number of comments are concentrated during a short video time and overflowed. The elementary comment moving image objects C1 to C19 are in the unique display area B, but the elementary comment image objects C20, C21, and C22 are moved up above the unique display area B, so that the comment area E in FIG. Is not displayed.

  Next, processing when a comment moves to the left in the screen and any comment moves to the left from the left end of the unique display area B will be described. FIG. 8 is a conceptual diagram illustrating a process when any comment disappears from the unique display area B.

  In [Order 1] in FIG. 8, there is a relatively long elementary comment image object C3 on the top line of the composite comment image object, a short elementary comment image object C9 below it, and the bottom line. The moment when a new elementary comment image object C2 is inserted is shown.

  [Sequence 2] in FIG. 8 is a moment when each comment moves to the left with the lapse of the moving image time, and the short elementary comment image object C9 in the middle disappears from the screen to the end. Only the end portion of C3 and the plain comment image object C2 are in the unique display area B. In this state, there is a blank line between C3 and C2.

  When the end of any comment moves in the composite comment image object and the end comes out of the unique display area B of the composite comment image object, the following processing is performed.

1) The elementary comment image object whose end comes out from the unique display area B is deleted.
2) All other elementary comment image objects in the vertical position far from the original comment image object as viewed from the new elementary image object insertion position N are moved so as to approach the new elementary image object insertion position N. Move the vertical position of by one line.

  More specifically, as shown in [Order 3] in FIG. 8, when the end of one of the elementary comment image objects (for example, C9) comes out of the unique display area B of the composite comment image object, the elementary comment image object C9. Is deleted from the composite comment image object and becomes a blank line φ. In [Order 3], the location is indicated by a blank.

  Then, as shown in [Order 4], all other elementary comment image objects (in this example, C3) positioned above the deleted elementary comment image object C9 approach the new elementary image object insertion position N. The vertical position is shifted. As in this embodiment, when the new elementary image object insertion position N is in the lowermost line, it is lowered by one line in the vertical direction. In this way, the blank line φ is filled. When viewed on the screen of FIG. 3, when any comment disappears from the screen, it seems that the comment falls from above toward the blank blank line.

  As described above, when many comments are concentrated during a short video time, comments before the predetermined number K of lines that can be displayed go out to the top of the screen and become invisible. However, they are not deleted from the composite comment image object, and are merely outside the unique display area B. In this situation, if one of the comments below moves to the left and goes out of the screen, the vertical position of all the comments above it will be lowered by one line. As a result, the comment that has been moved upward and disappeared is displayed again.

  Hereinafter, with reference to FIG. 9 to FIG. 11, an embodiment in which the method of displaying a comment on a moving image according to the present invention is realized via the Internet will be described.

  FIG. 9 is a conceptual diagram of this system. A large number of clients CL and a moving image / comment distribution server S are connected to a network NW such as the Internet. The client CL requests the moving image / comment distribution server S to distribute moving images via the network NW. In response to this, the moving image / comment distribution server S distributes the moving image to the client CL via the network NW. When the client CL that has received the moving image distribution wants to send a comment, it writes the comment on its own terminal and transmits it to the moving image / comment distribution server S.

  The moving image / comment distribution server S accumulates the comments in its own memory and distributes the comments over the moving image through the network NW. The comment is attached with data on the sender of the comment (handle name, etc.), date and time when it was actually transmitted, and data such as the video time, which is the time since the start of the video transmission. Stored cumulatively.

  At the time of the next video transmission, this comment is also superimposed and distributed as a comment at the video time. The client CL at that time can also send a comment to the comment, and a pseudo dialogue is possible between the clients.

  FIG. 10 is an example of a flowchart of a sequence in the terminal of the client CL. The video data acquisition request is sent to the video / comment distribution server S by starting with [STEP 0] and specifying the video with the video ID specifying the video with [STEP 1]. In [STEP 2], a comment data acquisition request for the current video time is sent to the video / comment distribution server S. The moving image distributed in [STEP 3] is reproduced, and the comment distributed in accordance with the moving image time in [STEP 4] is displayed so as to overlap the moving image. When a comment is written in [STEP 5], the comment is sent to the moving image / comment distribution server S together with the data relating to the writing time of the moving image ID and user ID in [STEP 6]. If it is determined in [STEP 7] that the process has been completed normally, the comment is superimposed on the moving image in [STEP 8]. If it is not determined in [STEP 7] that the process has been completed normally, the comment is not distributed. If it is determined in [STEP 9] that the reproduction has ended, the sequence ends in [STEP 10]. If it is not determined in [STEP 9] that playback has ended, the process returns to [STEP 4].

  FIG. 11 is an example of a flowchart of a sequence in the moving image / comment distribution server S. Starting with [STEP 0], when it is determined in [STEP 1] that the request from the client is a “video distribution request”, the video having the video ID requested in [STEP 2] is distributed to the client. If it is determined in [STEP 1] that it is not a “video distribution request”, it is determined in [STEP 3] whether or not it is a “comment reception request”. If it is a “comment reception request”, it is determined in [STEP 4]. A comment corresponding to the moving image time of the moving image with the requested moving image ID is distributed to the client. If it is determined in [STEP 3] that it is not a “comment reception request”, it is determined in [STEP 5] whether or not it is a “comment transmission request”. In step 6], the comment sent with information such as the moving image ID, moving image time, and user ID is recorded in a specific record in the memory, and in step 7, the ID of the record is transmitted to the client. Repeat these processes.

  As described above, the embodiment of the method for displaying the comment on the moving image according to the present invention has been described. However, the present invention is not limited to the embodiment described above, and is described in the scope of claims. Naturally, various modifications and changes can be made within the scope of the technical idea of the present invention. For example, although the server and client terminals have been described as being different, it is also possible to execute all the processes within a single computer.

It is a conceptual diagram of the comment memory | storage part which has stored the comment which the client transmitted in the character string format. It is a conceptual diagram which shows the relationship between a plain comment image object and a composite comment image object. It is a conceptual diagram which shows the screen of a client's terminal. FIG. 3 is a conceptual diagram showing that the position of a raw comment image object in the composite comment image object of FIG. 2 has moved to the left. FIG. 6 is a conceptual diagram showing that a new elementary image object insertion position N is the bottom row of a specific display area B. It is a conceptual diagram which shows the process in which a prime comment image object is newly added to a composite comment image object. It is a conceptual diagram which shows the state which many comments concentrated during the short moving image time, and overflowed. It is a conceptual diagram explaining a process when one of the comments disappears from the unique display area. It is a conceptual diagram of the system which implement | achieves the method which overlaps and displays a comment on the moving image which concerns on this invention via the internet. It is an example of the flowchart of the sequence in the terminal of a client. It is an example of the flowchart of the sequence in a moving image and comment delivery server.

Explanation of symbols

A Compound comment image object B Unique display area C1, C2 ... Elementary comment image object CL Client D Movie area E Comment area N New element image object insertion position NW Network Z such as the Internet Screen of client terminal φ Blank line.

Claims (9)

A comment storage process for storing a comment consisting of a character string in a comment storage unit, a simple comment image object forming process for forming a plain comment image object from a comment consisting of a character string, and a combination comment image object A method for displaying a comment on a moving image, comprising: a composite comment image object forming process for forming a moving image with a comment for displaying the composite comment image object on a moving image.
When a new elementary comment image object is added to a new elementary image object insertion position, which is a fixed position in the composite comment image object, and when adding a new elementary comment image object, The vertical position of all existing raw comment image objects is moved in the vertical direction away from the new raw image object insertion position, and a new raw comment image object is inserted at the position of the new raw image object insertion position. The method of displaying the comment on the video.   2. The moving image according to claim 1, wherein the insertion position of the new elementary image object is a bottom line, and the movement in the vertical direction is to move up one line in the upward direction. how to.   The composite comment image object holds the value of the horizontal movement speed on the screen when each of the elementary comment image objects is displayed on the screen, and each of the elementary comment image objects has the value of the horizontal movement speed. The method according to claim 1, wherein the comment is superimposed on the moving image.   4. The method for displaying a comment on a moving image according to claim 3, wherein the moving speed in the left-right direction is determined as a function of the length of each elementary comment image object.   4. The method for displaying a comment on a moving image according to claim 3, wherein the moving speed in the left-right direction is determined so that a time during which each elementary comment image object crosses the screen in the left-right direction becomes a constant value.   When the vertical size of the composite comment image object exceeds a predetermined vertical size, only the portion from the new raw image object insertion position to a position corresponding to the predetermined vertical size is displayed on the screen. The method according to claim 1, wherein the comment is superimposed on the moving image.   7. The method for displaying a comment on a moving image according to claim 6, wherein the predetermined vertical size is equal to the vertical size of an area for displaying the moving image.   When any elementary comment image object passes through the left end position of the unique display area in the composite comment image object, the elementary comment image object is deleted and viewed from the new elementary image object insertion position. 2. The comment on a moving image according to claim 1, wherein the vertical position of all of the elementary comment image objects at a position in the vertical direction far from the object is moved so as to approach the new elementary image object insertion position by one line. To display the images in layers.   The method for displaying a comment superimposed on a moving image according to claim 1, wherein the comment is superimposed and distributed over a network such as the Internet.

Images