JP2011113251A - Device and system for displaying information - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To intuitively recognize a state of communication. <P>SOLUTION: An information display device 10 includes: a display control part 104 for displaying a balloon-shaped image configured of a sending origin region showing the sending origin of a conversation and a conversation display region showing the sending destination of a conversation and the content of a conversation by superimposing it on a video including an image showing a plurality of users; and an acquisition part 102 for acquiring the start point information of the sending origin region and the reference point information of the conversation display region and conversation information displayed in the conversation display region. The display control part 104 defines the start point information of the sending origin region obtained by the acquisition part 102 as the start point of the sending origin region, and defines the reference point information of the conversation display region as the reference point of the conversation display region, and displays the balloon-shaped image in which the conversation information is displayed in the conversation display region by superimposing it on the video. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an information display device and an information display system.

  Recently, the frequency of communication in offices and the status of activities have been visualized to identify problems in in-house communication and improve productivity. For example, it is possible to acquire voice during a meeting, visualize a speaker, the number of times of speaking, the number of conversations, and induce feedback by feeding back the results (for example, patent documents). 1).

JP 2008-262046 A

However, in office communication, in addition to visualizing the number of utterances and conversations, the state of communication such as who and who are talking and who is trying to communicate with whom It was necessary to grasp intuitively. For example, in a chat system using a speech balloon, a speech balloon-shaped image including the content of the conversation is displayed near the image indicating the origin of the conversation. However, in this system, there is a problem that it is impossible to grasp the communication sent from whom to whom, and it is impossible to visually grasp the connection of communication.
Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a new and improved information display device and information capable of intuitively grasping the state of communication To provide a display system.

  In order to solve the above-described problem, according to an aspect of the present invention, a balloon-shaped image including a transmission source area indicating a conversation source and a conversation display area indicating a conversation destination and the content of the conversation, A display control unit that displays the video including images indicating a plurality of users in a superimposed manner, start point information of the transmission source area, reference point information of the conversation display area, and conversation information displayed in the conversation display area; The display control unit uses the origin point information of the source area acquired by the acquisition unit as the start point of the source area, and uses the reference point information of the conversation display area as the conversation point. An information display device is provided, wherein the balloon-shaped image in which the conversation information is displayed in the conversation display area as a reference point of the display area is displayed superimposed on the video.

  The balloon shape may include a frame-shaped area including a reference point of the conversation display area and an area extending toward the conversation display area with the start point of the transmission source area as a vertex.

  In addition, the display control unit may display the conversation display area in the vicinity of an image showing a user who is a conversation destination.

  In addition, a balloon placement management unit that associates the starting point coordinates of the transmission source area and the identification information of the transmission source of the conversation, the reference point coordinates of the conversation display area and the identification information of the transmission destination of the conversation, respectively. The acquisition unit acquires identification information of the conversation originator and identification information of the conversation destination, and the display control unit associates with the identification information of the conversation origin acquired by the acquisition unit. The balloon-shaped image with the start point coordinates of the source area as the start point of the source area and the reference point coordinates of the conversation display area associated with the identification information of the destination of the conversation as a reference point, The video may be superimposed and displayed.

  Moreover, you may provide the speech balloon form management part which counts the frequency | count of transmission from the transmission origin of a conversation, and selects the form of the said balloon shape according to this transmission frequency.

  In addition, the display control unit displays a plurality of balloon-shaped images superimposed on the video, enlarges one balloon-shaped image among the plurality of balloon-shaped images, and displays other balloon-shaped images. You may provide the balloon size management part which reduces an image.

  Moreover, in order to solve the said subject, according to another viewpoint of this invention, the content of the conversation transmitted from the some origin area | region which shows the origin of the conversation originated from a some user, and the some user A display control unit that superimposes and displays a balloon-shaped image composed of a conversation display area indicating a plurality of images including images indicating the plurality of users, start point information of the plurality of transmission source areas, and the conversation display area An acquisition unit for acquiring the reference point information and the conversation information to be displayed in the conversation display area, and the display control unit obtains the start point information of the plurality of transmission source areas acquired by the acquisition unit. Sending from a plurality of users by using as a starting point of a plurality of transmission source areas, using the reference point information of the conversation display area as a reference point of the conversation display area, and adding the plurality of transmission source areas to one conversation display area Said conversation The image of the balloon shape to display the broadcast on one of the conversation display area, wherein the display superimposed on the image, the information display apparatus is provided.

  Further, the display control unit may display the content of the conversation transmitted from the plurality of users in a chat display area in a chat format.

  In addition, a balloon arrangement management unit that associates the start point coordinates of the transmission source area and the identification information of the start point coordinates, the acquisition unit acquires a plurality of identification information of the start point coordinates, the display control unit, The balloon in which the origin point coordinates of the plurality of originator areas associated with the identification information of the plurality of origin point coordinates acquired by the acquisition unit are used as the start point, and the originator area is added to the one conversation display area An image having a shape may be displayed by superimposing the video.

  Moreover, you may provide the speech balloon form management part which counts the frequency | count of transmission from the transmission origin of a conversation, and selects the form of the said balloon shape according to this speech count.

  The balloon arrangement management unit associates reference point coordinates of the conversation display area with identification information for identifying the balloon-shaped image, and the acquisition unit includes the plurality of start point coordinate identification information and the balloon. Identification information for identifying a shape image, and the display control unit identifies the balloon shape image based on the identification information for identifying the balloon shape image acquired by the acquisition unit. The transmission source area starting from the start point coordinates of the transmission source area associated with the identification information of the plurality of start point coordinates in the conversation display area having the reference point coordinates of the conversation display area associated with the reference point The added balloon-shaped image may be displayed superimposed on the video.

  In order to solve the above problem, according to another aspect of the present invention, in response to a user operation, starting point information of the transmission source area, reference point information of the conversation display area, and display in the conversation display area A balloon-shaped image composed of an input device for inputting the conversation information to be sent, a transmission source area indicating the transmission source of the conversation, and a conversation display area indicating the content of the conversation and the conversation content. An information display device that is displayed on a display device so as to be superimposed on an image including the image information, and the information display device uses the start point information of the source region input by the input device as the start point of the source region, The reference point information of the conversation display area is used as a reference point of the conversation display area, and the balloon-shaped image in which the conversation information is displayed in the conversation display area is displayed superimposed on the video. information Display system is provided.

  As described above, according to the present invention, the state of communication can be intuitively grasped.

It is explanatory drawing explaining the example of a display of the display screen which concerns on the 1st Embodiment of this invention. It is explanatory drawing explaining the speech balloon concerning the embodiment. It is a block diagram which shows the function structure of the information display apparatus concerning the embodiment. It is explanatory drawing explaining an example of the input screen concerning the embodiment. It is explanatory drawing explaining the example of a display of the display screen concerning the embodiment. It is a flowchart which shows the detail of operation | movement of the information display apparatus concerning the embodiment. It is a block diagram which shows the function structure of the information display apparatus which concerns on the 2nd Embodiment of this invention. It is explanatory drawing explaining an example of the input screen concerning the embodiment. It is explanatory drawing explaining the information hold | maintained at the balloon arrangement | positioning management part concerning the embodiment. It is a flowchart which shows the detail of operation | movement of the information display apparatus concerning the embodiment. It is a block diagram which shows the function structure of the information display apparatus which concerns on the 3rd Embodiment of this invention. It is explanatory drawing explaining the information hold | maintained at the balloon form management part concerning the embodiment. It is explanatory drawing explaining the example of a display of the balloon form concerning the embodiment. It is a flowchart which shows the detail of operation | movement of the information display apparatus concerning the embodiment. It is a block diagram which shows the function structure of the information display apparatus which concerns on the 4th Embodiment of this invention. It is explanatory drawing explaining the content of the balloon data table concerning the embodiment. It is explanatory drawing explaining the example of a display of the several speech balloon concerning the embodiment. It is a flowchart which shows the detail of operation | movement of the information display apparatus concerning the embodiment. It is explanatory drawing explaining the example of a display of the balloon concerning 5th-8th embodiment. It is a block diagram which shows the function structure of the information display apparatus which concerns on the 5th Embodiment of this invention. It is explanatory drawing explaining an example of the input screen concerning the embodiment. It is a flowchart which shows the detail of operation | movement of the information display apparatus concerning the embodiment. It is a block diagram which shows the function structure of the information display apparatus which concerns on the 6th Embodiment of this invention. It is explanatory drawing explaining an example of the input screen concerning the embodiment. It is explanatory drawing explaining the information hold | maintained at the balloon arrangement | positioning management part concerning the embodiment. It is a flowchart which shows the detail of operation | movement of the information display apparatus concerning the embodiment. It is a block diagram which shows the function structure of the information display apparatus which concerns on the 7th Embodiment of this invention. It is explanatory drawing explaining the information hold | maintained at the balloon form management part concerning the embodiment. It is explanatory drawing explaining the example of a display of the balloon form concerning the embodiment. It is a flowchart which shows the detail of operation | movement of the information display apparatus concerning the embodiment. It is a block diagram which shows the function structure of the information display apparatus which concerns on the 8th Embodiment of this invention. It is explanatory drawing explaining an example of the input screen concerning the embodiment. It is explanatory drawing explaining the information hold | maintained at the balloon arrangement | positioning management part concerning the embodiment. It is explanatory drawing explaining the example of a display of the display screen concerning the embodiment. It is a flowchart which shows the detail of operation | movement of the information display apparatus concerning the embodiment.

  Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

Further, the “detailed description of the embodiments” will be described in the order shown below.
[1] Purpose of this embodiment [2] Outline of this embodiment [3] First embodiment [3-1] Configuration of information display device [3-2] Details of operation of information display device [4] No. Second Embodiment [4-1] Configuration of Information Display Device [4-2] Details of Operation of Information Display Device [5] Third Embodiment [5-1] Configuration of Information Display Device [5-2] Information Details of operation of display device [6] Fourth embodiment [6-1] Configuration of information display device [6-2] Details of operation of information display device [7] Fifth embodiment [7-1] Information Configuration of display device [7-2] Details of operation of information display device [8] Sixth embodiment [8-1] Configuration of information display device [8-2] Details of operation of information display device [9] No. Seventh Embodiment [9-1] Configuration of Information Display Device [9-2] Details of Operation of Information Display Device [10] Eighth Embodiment [10-1] Information Display Device Formed [10-2] information display device details of operation of the

[1] Purpose of this Embodiment First, the purpose of this embodiment will be described. Recently, the frequency of communication in offices and the status of activities have been visualized to identify problems in in-house communication and improve productivity. For example, the voice during a meeting is acquired, the speaker, the number of utterances, and the number of conversations are visualized, and the results are fed back to induce an active discussion.

  However, in office communication, in addition to visualizing the number of utterances and conversations, the state of communication such as who and who are talking and who is trying to communicate with whom It was necessary to grasp intuitively. For example, in a chat system using a speech balloon, a speech balloon-shaped image including the content of the conversation is displayed near the image indicating the origin of the conversation.

  However, in this system, there is a problem that it is impossible to grasp the communication sent from whom to whom, and it is impossible to visually grasp the connection of communication. Therefore, the information display apparatus 10 according to the present embodiment has been created with the above circumstances as a focus. According to the information display device 10, it is possible to intuitively grasp the communication state.

[2] Overview of this embodiment The purpose of this embodiment has been described above. Next, an outline of the present embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is an explanatory diagram illustrating a display example of a display screen according to the present embodiment. Moreover, FIG. 2 is explanatory drawing explaining the speech balloon displayed on a display screen. In the present embodiment, the information display device according to the present invention is applied to the information display device 10 that can display a plurality of layers superimposed on the display screen.

  The information display device 10 superimposes a balloon-shaped image including a message input by a user on an actual image captured by an imaging device such as a camera. For example, a message input using an interface capable of inputting a message, such as a mail function or a messenger function, is included in a balloon-shaped image and displayed on a real image including a plurality of users in the office. In the present embodiment, as shown in FIG. 1, a balloon-shaped image is superimposed on a real image including a plurality of users, but the present invention is not limited to this example. For example, a balloon-shaped image may be superimposed on a virtual stereoscopic image including images indicating a plurality of users.

  Here, the balloon will be described with reference to FIG. As shown in FIG. 2, the balloon is composed of a main body into which the message text is inserted and a root added to the main body. In the present embodiment, for example, the main body has a quadrangular shape with a reference point as a vertex and the root has a triangular shape with a start point as a vertex. However, the present invention is not limited to this example. For example, the main body is not limited to a rectangular shape, and may be a circle or an ellipse as long as a message can be inserted into the frame. Further, the root is not limited to a triangular shape, and may be a solid line or a dotted line connecting the start point and the main body. The main body is an example of a conversation display area in the present invention, and the root is an example of a transmission source area in the present invention.

  In the present embodiment, as shown in FIG. 1, the root of the speech balloon starts from the vicinity of the image indicating the source of the message (conversation), and the main body is displayed near the image indicating the destination of the message. . In general, a balloon is displayed near an image indicating a message sender. However, when the speech balloon is displayed near the image indicating the sender of the message, it can be known who sent the message, but it was not known who the message was sent. In this embodiment, as described above, the main body is displayed in the vicinity of the image indicating the message destination, so that not only the message from whom but also the message to whom is visually recognized, the communication state Can be grasped intuitively.

[3] First Embodiment The outline of the embodiment of the present invention has been described above. Before describing the functional configuration of the information display apparatus 10 according to the present embodiment, the hardware configuration of the information display apparatus 10 will be described. The information display device 10 is an information processing device capable of displaying a video or the like on a display screen, and can be exemplified by a personal computer, for example. In addition, the display device that displays an image or the like may be configured as a device integrated with the information display device 10 or may be configured as a separate device.

  The information display device 10 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), an input device, an output device, a storage device (HDD), and the like.

  The CPU functions as an arithmetic processing device and a control device, and controls the overall operation of the information display device 10 according to various programs. The CPU may be a microprocessor. The ROM stores programs used by the CPU, calculation parameters, and the like. The RAM primarily stores programs used in the execution of the CPU, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus including a CPU bus.

  The input device includes, for example, an input means for a user to input information, such as a mouse, keyboard, touch panel, button, microphone, switch, and lever, and input control that generates an input signal based on the input by the user and outputs the input signal to the CPU. It consists of a circuit.

  The output device includes, for example, a display device such as a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Display) device and a lamp, and an audio output device such as a speaker and headphones. .

  The storage device can include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device is composed of, for example, an HDD (Hard Disk Drive). This storage device drives a hard disk and stores programs executed by the CPU and various data.

[3-1] Functional Configuration of Information Display Device The hardware configuration of the information display device 10 has been described above. Next, a functional configuration of the information display apparatus 10 according to the first embodiment will be described with reference to FIG. Further, in describing the functional configuration of the information display device 10, FIGS. 4 and 5 are referred to as appropriate. FIG. 4 is an explanatory diagram illustrating an example of the input screen, and FIG. 5 is an explanatory diagram illustrating a display example of the display screen. As shown in FIG. 3, the information display apparatus 10 mainly includes an acquisition unit 102, a display control unit 104, and the like. In FIG. 3, the input unit (input device) 20 and the display screen (display device) 30 are separate devices from the information display device 10. However, the input unit 20 and the display screen 30 are not limited to this example. You may comprise as an apparatus integral with the display apparatus 10. FIG.

  The acquisition unit 102 obtains start point information of a source area (hereinafter also referred to as a root) of a balloon-shaped image, reference point information of a conversation display area (hereinafter also referred to as a main body), and conversation information displayed on the main body. Has a function to acquire. In the present embodiment, the acquisition unit 102 acquires start point information, reference point information, and conversation information input by the user via the input unit 20. The start point information is information indicating the start point of the balloon, and is, for example, the coordinates of the start point of the balloon in the actual image. The reference point information is information indicating the reference point of the balloon, and is, for example, the coordinates of the reference point of the balloon in the actual image. The conversation information is text information displayed on the balloon body.

  For example, as shown in FIG. 4, the coordinates “(100, 200)” is input to the start point coordinate input item 302 on the input screen 300, and the coordinates “(300, 400)” is input to the reference point coordinate input item 304. The Then, the text “How does it feel?” Is input to the message input item 306. The input unit 20 provides the value of each item input on the input screen 300 to the acquisition unit 102. The acquisition unit 102 acquires start point information, reference point information, and conversation information input via the input unit 20.

  In the above description, the acquisition unit 102 acquires a value input in response to a user operation, but is not limited to this example. For example, when a plurality of input units are connected to the information display device 10, values such as start point information set in advance in each input unit may be acquired. Further, when a sensor capable of acquiring the user's coordinate position and the like is connected to the information display device 10, a value such as start point information detected by the sensor may be acquired. Further, when an image indicating a user displayed on the real image is selected, coordinates at which the user is positioned may be input to the input unit 20. Returning to FIG. 3, the acquisition unit 102 provides the acquired start point coordinates (start point information), reference point coordinates (reference point information), and a message (conversation information) to the display control unit 104.

  The display control unit 104 generates a plurality of balloon-shaped images including a transmission source area (speech balloon root) indicating a conversation originator and a conversation display area (speech balloon main body) indicating a conversation destination and conversation content. The display screen 30 has a function of being superimposed on a video including an image indicating the user. As shown in FIG. 5, the display control unit 104 superimposes and displays a video layer that displays an actual image and a balloon layer that displays a balloon-shaped image on the display screen 30.

  Returning to FIG. 3, the display control unit 104 provided with the start point coordinates, the reference point coordinates, and the message text by the acquisition unit 102 sets the start point coordinates as the start point of the transmission source area (root) and sets the reference point coordinates as the conversation display area ( A balloon-shaped image in which the message text is displayed in the conversation display area (main body) as a reference point of the main body) is superimposed on the video and rendered on the balloon layer. Here, rendering means imaging a balloon shape based on a given numerical value.

  Specifically, as described above, the balloon-shaped image is composed of a triangular image having the vertex indicated by the coordinates indicated by the starting point information and a square image having the specific vertex indicated by the coordinates indicated by the reference point information. The If the starting point information is set near the image indicating the user who is the origin of the conversation in the real image and the reference point information is set near the image indicating the user who is the destination of the conversation in the real image, Expands from the conversation originator to the conversation destination, and the main body of the balloon is displayed at the conversation destination. As a result, it is possible to intuitively understand who the message is from whom and to make it easy to understand the connection of communication.

[3-2] Details of Operation of Information Display Device The functional configuration of the information display device 10 has been described above. Next, the details of the operation of the information display device 10 will be described with reference to FIG. As illustrated in FIG. 6, the acquisition unit 102 acquires the start point coordinates, the reference point coordinates, and the message that are input via the input unit 20 (S102).

  Then, the display control unit 104 generates a balloon-shaped image based on the start point coordinates and the reference point coordinates acquired in step S102 (S104). In step S104, the balloon shape is formed with the start point coordinates as the root vertex and the reference point coordinates as the body vertex. You may make it change the shape of a main body according to the number of characters of the message inserted in a main body. Also, the size of the balloon may be changed to match the actual image scale.

  The display control unit 104 renders the speech balloon in which the message text is displayed on the body of the speech balloon-shaped image generated in step S104 on the speech balloon layer (S106). When displaying a plurality of balloon-shaped images on the display screen, the processes in steps S102 to S106 are repeated. The details of the operation of the information display device 10 have been described above.

  In the present embodiment, the start point coordinates and the reference point coordinates of the speech balloon are designated, the speech balloon is displayed on the speech balloon layer of the display screen, and superimposed on the video layer on which a plurality of users are displayed. Since the start point of the speech balloon is designated as the coordinates near the person image of the conversation source of the video layer, and the reference point of the speech balloon is designated as the coordinates near the person image of the conversation destination, only by visually recognizing the speech balloon, It is possible to immediately grasp who is talking to whom from the content of the conversation. Thereby, it becomes possible to make the connection of communication easy to understand visually.

[4] Second Embodiment The first embodiment has been described above. Next, the information display apparatus 11 according to the second embodiment will be described. The information display device 11 in the present embodiment is different from the first embodiment in that identification information corresponding to the sender and receiver of the message is input. Hereinafter, differences from the first embodiment will be described in detail, and detailed description of the same configuration and operation as those of the first embodiment will be omitted.

[4-1] Functional Configuration of Information Display Device With reference to FIG. 7, the functional configuration of the information display device 11 according to the second embodiment will be described. Further, in describing the functional configuration of the information display device 11, FIGS. 8 and 9 will be referred to as appropriate. As shown in FIG. 7, the information display apparatus 11 mainly includes an acquisition unit 102, a display control unit 104, a balloon arrangement management unit 106, and the like.

  The acquisition unit 102 has a function of acquiring identification information of a conversation source and identification information of a conversation destination. As in the first embodiment, the acquisition unit 102 acquires conversation information to be displayed on the balloon body. The conversation source identification information is, for example, the ID of the user who is the message transmission source, and the conversation transmission destination identification information is, for example, the ID of the user who is the message transmission destination. In the present embodiment, the acquisition unit 102 acquires the transmission source ID (identification information of the conversation transmission source) and the transmission destination ID (identification information of the conversation transmission destination) input by the user via the input unit 20.

  Here, with reference to FIG. 8, an example of input of a transmission source ID and the like input via the input unit 20 will be described. FIG. 8 is an explanatory diagram illustrating an example of the input screen. As illustrated in FIG. 8, the transmission source ID “001” is input to the transmission source ID input item 312 on the input screen 310, and the transmission destination ID “005” is input to the transmission destination ID input item 314. Then, the message text “Thank you for your work yesterday” is entered in the message input item 316. The input unit 20 provides the value of each item input on the input screen 310 to the acquisition unit 102.

  In the above description, the acquisition unit 102 acquires the transmission source ID and the like input in response to a user operation, but is not limited to this example. For example, when a plurality of input units are connected to the information display device 10, a value such as a transmission source ID set in advance in each input unit may be acquired. When a sensor capable of acquiring the user ID is connected to the information display device 10, a value such as a transmission source ID detected by the sensor may be acquired. Further, when an image indicating a user displayed on the display screen 30 is selected, the ID of the user may be input to the input unit 20.

  Returning to FIG. 7, the acquisition unit 102 provides the acquired transmission source ID, transmission destination ID, and message to the balloon arrangement management unit 106. The balloon placement management unit 106 obtains the start point coordinates of the balloon root (source area), the identification information of the conversation source, the reference point coordinates of the main body of the balloon (conversation display area), and the identification information of the conversation destination. Associating and holding. Here, with reference to FIG. 9, information held in the balloon arrangement management unit 106 will be described. FIG. 9 is an explanatory diagram for explaining information held in the balloon arrangement management unit 106.

  As shown in FIG. 9, the balloon arrangement management unit 106 holds a transmission source data table 2001 and a transmission destination data table 2002. In the transmission source data table 2001, the transmission source ID is associated with the start point coordinates of the balloon root. Further, in the transmission source data table 2002, the transmission destination ID and the reference point coordinates of the main body of the balloon are associated. The balloon placement management unit 106 provides the display control unit 104 with the root start point coordinates associated with the transmission source ID provided to the acquisition unit 102, the main body reference point coordinates associated with the transmission destination ID, and the message text. To do.

  Returning to FIG. 7, the display control unit 104 is provided with the start point coordinates, the reference point coordinates, and the message text of the balloon from the balloon arrangement management unit 106. As in the first embodiment, the display control unit 104 uses the start point coordinates as the start point of the source area (root), the reference point coordinates as the reference point of the conversation display area (main body), and the message text as the conversation display area (main body). The balloon-shaped image displayed in (1) is superimposed on the video and rendered on the balloon layer.

  In this embodiment, by specifying the transmission source ID and the transmission destination ID, the vicinity of the image indicating the user who is the transmission source of the conversation in the real image is the starting point of the root of the balloon, and the user who is the transmission destination of the conversation from the starting point The root of the balloon expands in the vicinity of the image indicating. Then, the main body of the balloon is displayed near the image indicating the user who is the destination of the conversation, and the message text is displayed on the main body. As a result, it is possible to intuitively understand who the message is from whom and to make it easy to understand the connection of communication.

[4-2] Details of Operation of Information Display Device The functional configuration of the information display device 11 has been described above. Next, details of the operation of the information display apparatus 11 will be described with reference to FIG. As illustrated in FIG. 10, the acquisition unit 102 acquires a transmission source ID, a transmission destination ID, and a message input via the input unit 20 (S202).

  Then, the balloon placement management unit 106 acquires the start point coordinates corresponding to the transmission source ID acquired in step S202, the reference point coordinates corresponding to the transmission destination ID, and the message text (S204). The display control unit 104 generates a balloon-shaped image based on the start point coordinates and the reference point coordinates acquired in step S204 (S206). In step S206, the balloon shape is formed with the start point coordinates as the root vertex and the reference point coordinates as the body vertex.

  The display control unit 104 renders the speech balloon in which the message text is displayed on the body of the speech balloon-shaped image generated in step S206 on the speech balloon layer (S208). The details of the operation of the information display device 11 have been described above.

  In the present embodiment, a transmission source ID (identification information of a conversation transmission source) and a transmission destination ID (identification information of a conversation transmission destination) are designated, a balloon start point coordinate corresponding to the transmission source ID, and a transmission destination ID. The reference point coordinates of the balloon corresponding to are specified. A balloon-shaped image is displayed on the balloon layer on the display screen using the specified balloon start point coordinates and reference point coordinates, and superimposed on the video layer on which a plurality of users are displayed. As a result, the user can immediately know who is speaking to whom from the content of the conversation by simply specifying the transmission source ID and the transmission destination ID without specifying the coordinates on the real image. Can be displayed.

[5] Third Embodiment The second embodiment has been described above. Next, an information display device 12 according to the third embodiment will be described. The information display device 12 according to the present embodiment is different from the second embodiment in that the number of times a message is transmitted to a conversation destination is counted and the display form of the balloon is changed according to the number of transmissions. Hereinafter, differences from the first embodiment and the second embodiment will be described in detail, and detailed description of similar configurations and operations will be omitted.

[5-1] Functional Configuration of Information Display Device With reference to FIG. 11, the functional configuration of the information display device 12 according to the third embodiment will be described. In describing the functional configuration of the information display device 12, FIGS. 12 and 13 are referred to as appropriate. As shown in FIG. 11, the information display apparatus 12 mainly includes an acquisition unit 102, a display control unit 104, a balloon arrangement management unit 106, a balloon form management unit 108, and the like.

  As in the second embodiment, the acquisition unit 102 includes a transmission source ID (identification information of a conversation transmission source), a transmission destination ID (identification information of a conversation transmission destination) input by the user via the input unit 20, and Get the message text.

  The balloon form management unit 108 has a function of counting the number of calls from the conversation originator and selecting a form of the balloon shape according to the number of calls. The number of transmissions from the conversation source is the number of acquisitions of the message acquired by the acquisition unit 102. The balloon form management unit 108 counts the combination of the transmission source ID and the transmission destination ID every time the acquisition unit 102 provides the combination. Then, the balloon form management unit 108 selects a balloon form according to the counted number of outgoing calls. The balloon form management unit 108 provides the balloon arrangement management unit 106 with a balloon form according to the number of outgoing conversations together with the transmission source ID, the transmission destination ID, and the message text.

  Here, the information held by the balloon form management unit 108 will be described with reference to FIG. FIG. 12 is an explanatory diagram for explaining information held in the balloon form management unit 108. As shown in FIG. 12, the speech balloon form management unit 108 holds a data table 3001 composed of a transmission source ID, a transmission destination ID, and the number of messages. The balloon form management unit 108 increments the numerical value of the number of messages corresponding to the combination of the transmission source ID and the transmission destination ID in the data table 3001 by one each time data including the transmission source ID, the transmission destination ID, and the message is provided. To do.

  Further, the balloon form management unit 108 may clear the number of utterances in each row in the data table 3001. “Clear” means to set the value to zero. Note that details of the timing for clearing are not specified here, but may be performed every time a preset fixed time elapses, or the source ID, destination ID, and clear command are sent to the balloon form management unit 108. It may be every time the data to be included is provided. In the latter case, the user can manually clear the data by using an interface that provides the data.

  Also, the speech form management table 3002 associates the number of utterances and the speech form. For example, the higher the numerical value of the number of utterances, the thicker the border line of the balloon, the more prominent the background color of the balloon, or the larger the font size. Moreover, you may make it designate the number of speech balloons corresponding to the number of utterances. For example, the number of speech balloons may be increased as the number of utterances increases.

  Here, with reference to FIG. 13, the display of the balloon form changed according to the number of utterances will be described. FIG. 13 is an explanatory diagram illustrating a display example of a balloon form. As shown in FIG. 13, for example, when the number of utterances is three, three balloon-shaped images may be displayed in an overlapping manner. In this case, the latest message is displayed in the balloon displayed at the forefront. Moreover, the superimposed message may be displayed in the forefront by selecting another balloon.

  Returning to FIG. 11, as in the second embodiment, the balloon arrangement management unit 106 specifies the root start point coordinate associated with the transmission source ID and the reference point coordinate of the main body associated with the transmission destination ID. Then, the display control unit 104 is provided with start point coordinates, reference point coordinates, message text, and a balloon form.

  The display control unit 104 uses the start point coordinates as the origin area (root) start point and the reference point coordinates as the reference point of the conversation display area (main body), and generates a balloon in a form specified by the balloon form. Then, a balloon-shaped image in which the message text is displayed in the conversation display area (main body) is superimposed on the video and rendered on the balloon layer.

  In the present embodiment, the number of message transmissions from the conversation source to the conversation destination is counted, and a balloon form corresponding to the count is selected. As a result, it is possible to generate a balloon in a form corresponding to the number of messages from the sender of the message to the caller. For example, the width of the balloon border is proportional to the number of messages, or the background color of the balloon is set to the number of messages The number of utterances can be made easier to understand visually, as well as intuitively grasping who the message is from.

[5-2] Details of Operation of Information Display Device The functional configuration of the information display device 12 has been described above. Next, the details of the operation of the information display device 12 will be described with reference to FIG. As illustrated in FIG. 14, the acquisition unit 102 acquires a transmission source ID, a transmission destination ID, and a message input via the input unit 20 (S302).

  Then, the balloon form management unit 108 counts the number of transmissions corresponding to the combination of the transmission destination ID and the transmission source ID acquired in step S302 (S304). Then, the balloon form management unit 108 selects a balloon form according to the number of transmissions counted in step S304 (S306).

  The balloon arrangement management unit 106 acquires the transmission destination ID, the transmission source ID, the message text, and the balloon form provided from the balloon form management unit 108, and the start point coordinates corresponding to the transmission destination ID and the reference corresponding to the transmission source ID. Point coordinates are specified (S308). The display control unit 104 generates a balloon-shaped image based on the start point coordinates, the reference point coordinates, and the balloon form acquired in step S308 (S310).

  The display control unit 104 renders the speech balloon in which the message text is displayed on the body of the speech balloon-shaped image generated in step S310 on the speech balloon layer (S312). The details of the operation of the display control device 12 have been described above.

  In the present embodiment, a transmission source ID (identification information of a conversation transmission source) and a transmission destination ID (identification information of a conversation transmission destination) are designated, a balloon start point coordinate corresponding to the transmission source ID, and a transmission destination ID. The reference point coordinates of the balloon corresponding to are specified. In addition, a plurality of users are displayed by displaying a balloon-shaped image on a balloon layer on the display screen using a balloon shape according to the specified balloon start point coordinates, reference point coordinates, and the number of transmissions. Superimpose on the video layer. As a result, it is possible to intuitively understand who the message is from whom and the number of utterances can be visually understood.

[6] Fourth Embodiment The third embodiment has been described above. Next, an information display device 13 according to the fourth embodiment will be described. In the information display device 13 according to the present embodiment, when a plurality of balloon-shaped images are displayed on the display screen 30, the sizes of the plurality of balloon main bodies are periodically reduced or returned to the original sizes. ing. Thereby, it is possible to grasp messages of all the displayed balloons while avoiding a situation where the display screen 30 is filled with balloons and it is difficult to visually recognize a video layer such as an actual image.

[6-1] Functional Configuration of Information Display Device The functional configuration of the information display device 13 according to the fourth embodiment will be described with reference to FIG. In describing the functional configuration of the information display device 13, FIGS. 16 and 17 are referred to as appropriate. As shown in FIG. 15, the information display device 13 mainly includes an acquisition unit 102, a display control unit 104, a balloon arrangement management unit 106, a balloon size management unit 110, a balloon data table 112, and the like.

  As in the second and third embodiments, the acquisition unit 102 transmits the transmission source ID (identification information of the conversation originator) input by the user via the input unit 20 and the transmission destination ID (identification of the conversation transmission destination). Information) and message text.

  The balloon arrangement management unit 106 specifies the root start point coordinates associated with the transmission source ID and the main body reference point coordinates associated with the transmission destination ID. Then, the balloon arrangement management unit 106 writes the message text, balloon size, and balloon reduction data in the balloon data table 112 using the combination of the start point coordinates and the reference point coordinates as keys. At this time, the balloon size may be a size corresponding to the number of characters of the message text. The balloon reduction data is set to “TRUE”. Here, the balloon size is a value representing the size of the balloon body. For example, when the shape of the balloon body is a rectangle, the balloon size is represented by the width and height of the body.

In addition, the balloon arrangement management unit 106 directly provides the display control unit 104 with the start point coordinates, the reference point coordinates, the balloon size, and the message text. If the operation is not performed, even if the acquisition unit 102 acquires the transmission source ID, the transmission destination ID, and the message input via the input unit 20, the balloon size management unit 110 stores the balloon reduction data of the corresponding line as “ Unless it is changed to “FALSE” and the corresponding line is further read, the corresponding balloon continues to be displayed in a reduced state. Therefore, after the acquisition unit 102 acquires various data, the corresponding balloon is displayed with a large delay. In some cases, the above-described operation is effective for eliminating the problem. However, in order to achieve the object of the present embodiment, the function of this item is not always necessary.

  Here, the contents of the balloon data table 112 will be described with reference to FIG. FIG. 16 is an explanatory diagram for explaining the contents of the balloon data table 112. As shown in FIG. 16, the balloon data table 112 stores balloon size, message text, and balloon reduction in association with each other using the start point coordinates and the reference point coordinates as keys. The balloon reduction data is a Boolean value, and in this embodiment, for example, “TRUE” or “FALSE” is set. When the balloon reduction data is “TRUE”, the balloon is reduced and displayed, and when the balloon reduction data is “FALSE”, the balloon is displayed in the size of the balloon.

  As will be described later, when the balloon reduction data is periodically changed from “TRUE” to “FALSE”, a plurality of balloons displayed on the display screen 30 are periodically reduced and displayed. Will be displayed. The balloon data table 112 stores data related to the balloon-shaped image displayed on the display screen 30.

Returning to FIG. 15, the balloon size management unit 110 has a function of periodically reading all rows of the balloon data table 112. The balloon size management unit 110 provides the display control unit 104 with the start point coordinates, reference point coordinates, message, and balloon size read from the balloon data table 112. The balloon size provided to the display control unit 104 is set as follows.
<1> When Balloon Reduction = TRUE The balloon size is set to a sufficiently small value (fixed value) instead of the “balloon size” value in the balloon data table 121.
<2> When Balloon Reduction = FALSE The balloon size is set to the value of “balloon size” in the balloon data table 121.

  The balloon size management unit 110 has a function of updating the balloon reduction data in the balloon data table. Specifically, when providing the balloon data to the display control unit 104, the balloon reduction data in the row where the balloon reduction data is “FALSE” is updated to “TRUE”. Then, the balloon reduction data in another line is updated to “TRUE”. To update the data of another line, for example, select the line with 1 added to the line number where the balloon reduction data has been updated from “FALSE” to “TRUE”, and set the balloon reduction data of the line to “TRUE”. Also good.

  The display control unit 104 sets the start point coordinates as the start point of the transmission source area (root), the reference point coordinates as the reference point of the conversation display area (main body), sets the size of the balloon body to the designated balloon size, and sets the message text Is superimposed on the video and rendered on the speech balloon layer. As described above, the balloon size management unit 110 periodically reads the balloon data table 112, updates the balloon reduction data, and provides the display control unit 104 with information related to the balloon.

  Here, a display example of a plurality of balloons displayed on the display screen 30 will be described with reference to FIG. As shown in FIG. 17, when three balloons are displayed on the display screen 30, one of the three balloons is displayed in a normal balloon size, and the other balloons are displayed in a reduced size. Is done. When a predetermined time elapses, the balloon size different from the balloon displayed in the normal balloon size becomes the normal size, and the other balloons are displayed in a reduced size. In this way, one of the balloons is sequentially displayed in the normal size, and the other balloons are reduced in size. The balloon message with a reduced size may be hidden.

  Returning to FIG. 15, the display control unit 104 may clear all the balloons displayed on the balloon layer of the display screen 30 before executing the display shown in FIG. 17. In the present embodiment, a plurality of speech balloons displayed on the display screen 30 are displayed by sequentially changing the size of the speech balloons as shown in FIG. It is possible to grasp messages of all displayed speech balloons while avoiding a situation where it is difficult to see the video layer due to being filled with speech balloons.

[6-2] Details of Operation of Information Display Device The functional configuration of the information display device 13 has been described above. Next, the details of the operation of the information display device 13 will be described with reference to FIG. As illustrated in FIG. 18, the acquisition unit 102 acquires a transmission source ID, a transmission destination ID, and a message input via the input unit 20 (S402). Then, the balloon arrangement management unit 106 acquires the start point coordinates corresponding to the transmission source ID acquired in step S402 and the reference point coordinates corresponding to the transmission destination ID. Then, the display control unit 104 is provided with the start point coordinates, the reference point coordinates, the message text, and the balloon size. (S404).

  Then, the balloon arrangement management unit 106 updates the message, balloon size, and balloon reduction data in the balloon data table 112 using the start point coordinates and reference point coordinates acquired in step S404 as keys (S406). If data having the corresponding start point coordinates and reference point coordinates as keys are not yet stored in the balloon data table 112, new data using the start point coordinates and reference point coordinates as keys is added.

  Then, the display control unit 104 generates a balloon corresponding to the balloon size (S408). The display control unit 104 generates a balloon-shaped image having the start point coordinates acquired in step S404 as the root vertex and the reference point coordinates as the body vertex. The display control unit 104 renders the balloon in which the message text is displayed on the main body of the balloon-shaped image generated in step S408 on the balloon layer (S410). However, with regard to step S408 and step S410, since the purpose is to reduce the time difference from when the information display device 13 acquires data until the speech balloon corresponding to the data is rendered on the speech balloon layer, this embodiment is implemented. These steps may not be necessary to achieve the purpose of the form.

  Next, the balloon size management unit 110 transmits a balloon clear message to the display control unit 104 to clear the displayed balloon layer (S412). Then, the balloon size management unit 110 reads the balloon data table 112 (S414).

  Then, the balloon size management unit 110 determines whether the balloon reduction data included in the data read in step S414 is “TRUE” (S416). If the balloon reduction data is “TRUE” in step S416, the reduced balloon size is set as the balloon size data (S418). On the other hand, if the balloon reduction data is not “TRUE” in step S416, that is, “FALSE”, the balloon size is set as the balloon size data (S420).

  The balloon size management unit 110 provides the display control unit 104 with the start point coordinates, the reference point coordinates, the message, and the balloon size set in step S420 read in step S414 as one message. Then, the display control unit 104 generates a balloon-shaped image having a size corresponding to the balloon size data with the start point coordinates acquired in step S430 as the root vertex and the reference point coordinates as the vertex of the main body (S423). . The display control unit 104 renders the speech balloon in which the message text is displayed on the body of the speech balloon-shaped image generated in step S423 on the speech balloon layer (S424).

  Then, it is determined whether all the rows of the balloon data table 112 have been read (S426). If it is determined in step S426 that all the lines in the balloon data table 112 have not been read, the processes in and after S414 are repeated to read lines that have not been read in the balloon data table 112. On the other hand, if it is determined in step S426 that all the rows in the balloon data table 112 have been read, in the balloon data table 112, a row different from the row in which the balloon reduction data is set to “TRUE” in step S420. Is changed to “FALSE” (S428). As described above, the data in which the balloon reduction data is set to “FALSE” in step S424 may be data of a line obtained by adding 1 to the line number in which the balloon reduction data is set to “TRUE” in step S422. Thereafter, the processing after step S412 is repeated. That is, the balloon layer is once cleared, and all the rows of the balloon data table 112 are sequentially read again.

  As described above, by repeatedly executing the processing from step S414 to step S426, the bodies of all the speech balloons except for one speech balloon rendered in the speech balloon layer are reduced, and the normal size is not reduced. The displayed balloon will be changed periodically. As a result, even if a large number of speech balloons are displayed, it is possible to grasp the messages of all the speech balloons that are displayed while avoiding the situation where the display screen is filled with a large number of speech balloons and the video layer becomes difficult to see. Is possible.

[7] Fifth Embodiment The fourth embodiment has been described above. Next, the outline of the fifth to eighth embodiments will be described with reference to FIG. FIG. 19 is an explanatory diagram for explaining display examples of balloons according to the fifth to eighth embodiments. As shown in FIG. 19, in the fifth to eighth embodiments, the start point coordinates of a plurality of balloons are designated, and the reference point of one balloon is designated, so that one main body has a plurality of roots. A balloon is formed.

  For example, when a chat or the like is performed in a group including a plurality of users, there is a problem that it is difficult to understand which user in the group is transmitting simply by displaying a message transmitted from a plurality of users. . However, as shown in FIG. 19, when the start points of a plurality of speech balloons are displayed in the vicinity of the image showing the user who sent each conversation, chatting or the like is performed in a group including a plurality of users. It becomes possible to intuitively understand who and who are having a conversation.

[7-1] Functional Configuration of Information Display Device Next, a functional configuration of the information display device 14 according to the fifth embodiment will be described with reference to FIG. As shown in FIG. 20, the information display device 14 mainly includes an acquisition unit 102, a display control unit 202, and the like. Further, the display control unit 202 is provided with a chat display unit 204.

  The acquisition unit 102 acquires start point information of a plurality of transmission source areas (roots) of a balloon-shaped image, reference point information of a conversation display area (main body), and conversation information to be displayed in a conversation display area displayed on the main body. It has the function to do. In the present embodiment, as in the first to fourth embodiments, the acquisition unit 102 acquires start point information, reference point information, and conversation information input by the user via the input unit 20.

  For example, as illustrated in FIG. 21, the coordinates “(100, 200)” is input to the start point coordinate input item 322 on the input screen 320, and the coordinates “(700, 800)” is input to the reference point coordinate input item 324. The Then, the text “working” is input to the message input item 326. The input unit 20 provides the value of each item input on the input screen 320 to the acquisition unit 102. The acquisition unit 102 acquires a plurality of start point information, reference point information, and conversation information input via the input unit 20.

  In the above description, the acquisition unit 102 acquires a value input in response to a user operation, but is not limited to this example. For example, when a plurality of input units are connected to the information display device 14, values such as start point information set in advance in each input unit may be acquired. Further, when a sensor capable of acquiring the user's coordinate position and the like is connected to the information display device 14, a value such as start point information detected by the sensor may be acquired. Further, when an image indicating a user displayed on the real image is selected, coordinates at which the user is positioned may be input to the input unit 20. In the present embodiment, in order to acquire a plurality of starting point information and one reference point information, the plurality of starting point information may be values detected by a sensor or the like, and the reference point information may be a fixed value set in advance.

  Returning to FIG. 20, the acquisition unit 102 provides the acquired start point coordinates (start point information), reference point coordinates (reference point information), and message text (conversation information) to the display control unit 202. The display control unit 202 includes a plurality of transmission source areas (roots of speech balloons) indicating conversation sources transmitted from a plurality of users, and a conversation display area (the main body of the speech balloons) indicating the contents of conversations transmitted from the plurality of users. ) Are superimposed on a video including images showing a plurality of users and displayed. The display control unit 104 uses the reference point coordinates as the positions of the reference points of the balloon body, and generates a balloon having n roots starting from each of the n start point coordinates.

Furthermore, the chat display unit 204 has a function of arranging a panel for displaying a chat on the layer of the balloon body. The chat display unit 204 arranges the panel with the reference point coordinates as the position of the upper left vertex of the panel. Then, the message text (conversation information) acquired by the acquisition unit 102 is displayed in the chat format on the arranged panel. Examples of the method for displaying the message text in the chat format include the following: DoChat. NET (www.docat.net/)
Teacup. Everyone's chat (chat. Teacup. Com /)

  As shown in FIG. 19, a plurality of start point information is set near the image indicating the user who is the transmission source of the conversation in the real image, and one reference point information is set. A balloon-shaped image is displayed in which the root of the balloon is extended from a plurality of conversation sources to the balloon body. Thereby, when a chat or the like is performed in a group including a plurality of users, it is possible to intuitively understand who and who are having a conversation.

[7-2] Details of Operation of Information Display Device The functional configuration of the information display device 14 has been described above. Next, the details of the operation of the information display device 14 will be described with reference to FIG. As illustrated in FIG. 22, the acquisition unit 102 acquires a plurality of start point coordinates, reference point coordinates, and a message input via the input unit 20 (S502).

  Then, the display control unit 104 generates a balloon-shaped image based on the plurality of start point coordinates and reference point coordinates acquired in step S102 (S504). In step S504, the balloon shape is formed with a plurality of start point coordinates as a plurality of root vertices and a reference point coordinate as a body vertex. Then, the display control unit 104 renders the balloon-shaped image generated in step S504 on the balloon layer (S506).

  And the chat display part 204 arrange | positions the panel (chat panel) which makes a reference point coordinate an upper left vertex on a balloon main body (S508). The chat panel arranged in the balloon main body in step S508 may be a fixed value set in advance, or may have a size corresponding to the number of characters of the message text displayed on the chat panel. When the size of the chat panel is set to a preset fixed value, the latest message in which the message is scrolled may be displayed.

  Then, the chat screen is displayed on the chat panel arranged in step S508 (S510). The details of the operation of the information display device 14 have been described above. In the present embodiment, the start point coordinates of a plurality of speech balloons and one reference point coordinate are designated, the speech balloons are displayed on the speech balloon layer of the display screen, and superimposed on the video layer on which a plurality of users are displayed. A chat screen displaying a plurality of user messages is displayed on the balloon body displayed in the balloon layer. By specifying the start point of the balloon in the vicinity of the person image that is the origin of multiple conversations in the video layer, who and who are having a conversation when chatting is performed in a group that includes multiple users Can be grasped intuitively.

[8] Sixth Embodiment The fifth embodiment has been described above. Next, an information display device 15 according to the sixth embodiment will be described. The information display device 15 according to the present embodiment is different from the fifth embodiment in that identification information for identifying each user is input when a chat or the like is performed in a group including a plurality of users. Hereinafter, differences from the fifth embodiment will be described in detail, and detailed description of the same configuration and operation as those of the fifth embodiment will be omitted.

[8-1] Functional Configuration of Information Display Device The functional configuration of the information display device 15 according to the sixth embodiment will be described with reference to FIG. In describing the functional configuration of the information display device 15, FIGS. 24 and 25 are referred to as appropriate. As shown in FIG. 23, the information display device 15 mainly includes an acquisition unit 102, a display control unit 202, a balloon arrangement management unit 206, and the like.

  The acquisition unit 102 has a function of acquiring identification information of a conversation source. The identification information of the conversation originator is, for example, the user ID of a user who is participating in chat in a group including a plurality of users. In the present embodiment, the acquisition unit 102 acquires the user ID (identification information of the conversation originator) input by the user via the input unit 20.

  Here, with reference to FIG. 24, an input example of a user ID or the like input via the input unit 20 will be described. FIG. 24 is an explanatory diagram illustrating an example of the input screen. As shown in FIG. 24, user IDs “001” and “002” are input to the user ID input item 332 on the input screen 330, and the message text “working” is input to the message input item 334. The input unit 20 provides the value of each item input on the input screen 320 to the acquisition unit 102.

  In the above description, the acquisition unit 102 acquires a user ID or the like input in response to a user operation, but is not limited to this example. For example, when a plurality of input units are connected to the information display device 15, a value such as a user ID preset in each input unit may be acquired. Further, when a sensor capable of acquiring a user ID is connected to the information display device 15, a value such as a transmission source ID detected by the sensor may be acquired. Further, when an image indicating a user displayed on the display screen 30 is selected, the ID of the user may be input to the input unit 20.

  Returning to FIG. 23, the acquisition unit 102 provides the acquired user ID and message to the balloon arrangement management unit 206. The balloon arrangement management unit 206 stores the start point coordinates of the balloon root (source area) and the identification information (user ID) of the conversation source in association with each other. Here, with reference to FIG. 25, information held in the balloon arrangement management unit 206 will be described. FIG. 25 is an explanatory diagram for explaining information held in the balloon arrangement management unit 206.

  As shown in FIG. 25, the balloon arrangement management unit 206 holds a user data table 4001. The user data table 4001 associates a user ID with the start point coordinates of the balloon root. The balloon placement management unit 206 specifies the root start point coordinates associated with the user ID provided to the acquisition unit 102. In addition, the reference point coordinates serving as a reference for the main body of the balloon are set to fixed values set in advance. For example, in the case where the main body of the balloon is arranged at the center of the window of the display screen, the reference point coordinates for arranging the main body of the balloon are specified at the center of the window. Alternatively, the y coordinate of the lower side of the window may be the y coordinate of the reference point of the balloon body, and the average value of the x values of the n start point coordinates corresponding to the n user IDs may be the x coordinate of the reference point. The balloon arrangement management unit 206 provides the specified start point coordinates, reference point coordinates, and message text to the display control unit 202.

  Returning to FIG. 23, the display control unit 202 generates a balloon having n roots with the reference point coordinates as the positions of the reference points of the balloon body and n start point coordinates as the start points. Furthermore, the chat display part 204 arrange | positions the panel for displaying a chat in the layer of a balloon main body, and displays a message text on this panel by a chat format. In the present embodiment, by specifying a plurality of user IDs, a balloon-shaped image in which the roots of a plurality of balloons are extended from a plurality of conversation sources to the balloon body is displayed. Thereby, when a chat or the like is performed in a group including a plurality of users, it is possible to intuitively understand who and who are having a conversation.

[8-2] Details of Operation of Information Display Device The functional configuration of the information display device 15 has been described above. Next, the details of the operation of the information display device 15 will be described with reference to FIG. As illustrated in FIG. 26, the acquisition unit 102 acquires a user ID and a message input via the input unit 20 (S602).

  Then, the balloon arrangement management unit 206 acquires the start point coordinates corresponding to the user ID acquired in step S602, preset reference point coordinates, and message text (S604). In step S602, since a plurality of user IDs are input from a plurality of input units, a plurality of start point coordinates respectively corresponding to the plurality of user IDs are acquired in step S604.

  The display control unit 202 generates a balloon-shaped image based on the plurality of start point coordinates and reference point coordinates acquired in step S604 (S606). Then, the display control unit 202 renders the balloon-shaped image generated in step S606 on the balloon layer (S608).

  And the chat display part 204 arrange | positions the panel (chat panel) which makes a reference point coordinate an upper left vertex on a balloon main body (S610). A chat screen is displayed on the chat panel arranged in step S610 (S612). The details of the operation of the information display device 15 have been described above. In the present embodiment, the user ID (identification information of the caller of the conversation) is specified, and the balloon start point coordinates corresponding to the user ID and the preset reference point coordinates are used to display the balloon layer on the display screen. A balloon-shaped image is displayed and superimposed on a video layer where a plurality of users are displayed. A chat screen displaying a plurality of user messages is displayed on the balloon body displayed in the balloon layer. By specifying the start point of the balloon in the vicinity of the person image that is the origin of multiple conversations in the video layer, who and who are having a conversation when chatting is performed in a group that includes multiple users Can be grasped intuitively.

[9] Seventh Embodiment The sixth embodiment has been described above. Next, an information display device 16 according to the seventh embodiment will be described. The information display device 16 in the present embodiment is different from the sixth embodiment in that the number of times a plurality of users speak is counted and the display form of the balloon is changed according to the number of utterances. Hereinafter, differences from the fifth embodiment and the sixth embodiment will be described in detail, and detailed description of similar configurations and operations will be omitted.

[9-1] Functional Configuration of Information Display Device With reference to FIG. 27, the functional configuration of the information display device 16 in the seventh embodiment will be described. In describing the functional configuration of the information display device 16, FIGS. 28 and 29 will be referred to as appropriate. As shown in FIG. 27, the information display device 16 mainly includes an acquisition unit 102, a display control unit 202, a balloon arrangement management unit 206, a balloon form management unit 208, and the like.

  As in the sixth embodiment, the acquisition unit 102 acquires the user ID (identification information of the conversation originator) and the message text input by the user via the input unit 20.

  The balloon form management unit 208 has a function of counting the number of calls from the caller of the conversation and selecting a form of a balloon shape according to the number of calls. The balloon form management unit 208 counts the number of times the user ID is included in the data, for example, when data such as a user ID is acquired from the acquisition unit 102. Then, the balloon form management unit 208 provides the balloon arrangement management unit 206 with a balloon form corresponding to the number of outgoing conversations together with the user ID and the message text.

  Here, with reference to FIG. 28, information held by the balloon form management unit 208 will be described. FIG. 28 is an explanatory diagram for explaining information held in the balloon form management unit 208. As shown in FIG. 28, the speech balloon form management unit 208 holds a data table 5001 composed of a user ID and the number of utterances. The balloon form management unit 208 increments the number of utterances corresponding to the user ID in the data table 5001 by one each time data including a user ID and a message is provided.

  Further, the balloon form management unit 208 may clear the number of utterances in each row in the data table 5001. “Clear” means to set the value to zero. Note that details of the timing for clearing are not specified here, but may be performed every time a predetermined time has elapsed, or data including a user ID and a clear command is provided to the balloon form management unit 208. It may be every time. In the latter case, the user can manually clear the data by using an interface that provides the data.

  Also, the speech form management table 5002 associates the number of utterances and the speech form. For example, the higher the numerical value of the number of utterances, the thicker the border line of the balloon root corresponding to the user ID, or the plurality of roots may be displayed. Here, with reference to FIG. 29, the display of the balloon form changed according to the number of utterances will be described. FIG. 29 is an explanatory diagram illustrating a display example of a balloon form. As shown in FIG. 29, for example, in a balloon displaying a chat screen in which a plurality of users participate, a root frame line extended from the vicinity of an image showing a user with a large number of utterances is displayed with a thicker line. is doing.

  Returning to FIG. 27, as in the sixth embodiment, the balloon arrangement management unit 206 identifies the root start point coordinates associated with the user ID and the preset reference point coordinates of the main body. Then, the display control unit 202 is provided with start point coordinates, reference point coordinates, message text, and a balloon form.

  The display control unit 202 generates a balloon having n roots with the reference point coordinates as the positions of the reference points of the balloon body and n start point coordinates as the start points. Furthermore, the chat display part 204 arrange | positions the panel for displaying a chat in the layer of a balloon main body, and displays a message text on this panel by a chat format. In this embodiment, the number of utterances of a plurality of users is counted, and a balloon form corresponding to the number of counts is selected. As a result, it is possible to generate a speech balloon in a form corresponding to the number of utterances of the sender of the message. When chatting is performed in a group that includes multiple users, it is possible to intuitively understand who is having a conversation and visually understand the number of statements from multiple users. It can be made easier.

[9-2] Details of Operation of Information Display Device The functional configuration of the information display device 16 has been described above. Next, the details of the operation of the information display device 16 will be described with reference to FIG. As illustrated in FIG. 30, the acquisition unit 102 acquires a user ID and a message input via the input unit 20 (S702).

  Then, the balloon form management unit 208 counts the number of transmissions of the user ID acquired in step S702 (S704). Then, the balloon form management unit 208 selects a balloon form according to the number of transmissions counted in step S704 (S706).

  The balloon arrangement management unit 206 acquires the user ID, the message text, and the balloon form provided from the balloon form management unit 208, and specifies the start point coordinates and preset reference point coordinates corresponding to the user ID (S708). . The display control unit 202 generates a balloon-shaped image based on the start point coordinates, the reference point coordinates, and the balloon form acquired in step S708 (S710).

  The display control unit 202 renders the balloon-shaped image generated in step S710 on the balloon layer (S712). And the chat display part 204 arrange | positions the panel (chat panel) which makes a reference point coordinate an upper left vertex on a balloon main body (S714). A chat screen is displayed on the chat panel arranged in step S712 (S716).

  The details of the operation of the information display device 16 have been described above. In the present embodiment, the user ID (identification information of the conversation originator) is specified, and the start point coordinates of the balloon corresponding to the user ID and the preset reference point coordinates are specified. Also, a video layer in which a plurality of users are displayed by displaying a balloon-shaped image on a balloon layer on the display screen using a balloon shape according to the start point coordinates, the reference point coordinates, and the number of transmissions of the identified balloon. Superimpose on. As a result, it is possible to generate a speech balloon in a form corresponding to the number of utterances of the sender of the message. When a chat is performed in a group that includes multiple users, it is possible to intuitively understand who is talking with whom and visually count the number of statements made by multiple users. To make it easier to understand.

[10] Eighth Embodiment The seventh embodiment has been described above. Next, an information display device 17 according to the eighth embodiment will be described. The information display device 17 according to the present embodiment is different from the fifth to seventh embodiments in that a plurality of chat balloons are displayed on the display screen 30. Hereinafter, differences from the fifth to seventh embodiments will be described in detail, and detailed description of similar configurations and operations will be omitted.

[10-1] Functional Configuration of Information Display Device With reference to FIG. 31, the functional configuration of the information display device 17 in the eighth embodiment will be described. Further, when the functional configuration of the information display device 17 is described, FIGS. As shown in FIG. 31, the information display device 17 mainly includes an acquisition unit 102, a display control unit 202, a balloon arrangement management unit 206, and the like.

  The acquisition unit 102 acquires a user ID (identification information of a conversation originator) and a balloon ID input by the user via the input unit 20. Here, an input example of a user ID or the like input via the input unit 20 will be described with reference to FIG. FIG. 32 is an explanatory diagram illustrating an example of the input screen. As illustrated in FIG. 32, the user ID “001” is input to the user ID input item 342 on the input screen 340, and the balloon ID “002” is input to the balloon ID input item 344. Then, the message text “I can do the document” is input to the message input item 346. The input unit 20 provides the value of each item input on the input screen 340 to the acquisition unit 102.

  Returning to FIG. 31, the acquisition unit 102 provides the acquired user ID, balloon ID, and message to the balloon arrangement management unit 206. The balloon arrangement management unit 206 identifies the start point coordinates of the balloon root (source area), the identification information (user ID) of the conversation source, the reference point coordinates of the balloon body (conversation display area), and the information identifying the balloon. (Speech ID) is held in association with each other. Here, with reference to FIG. 33, information held in the balloon arrangement management unit 206 will be described. FIG. 33 is an explanatory diagram illustrating information held in the balloon arrangement management unit 206.

  As shown in FIG. 33, the balloon arrangement management unit 206 holds a balloon ID table 8001. In addition, a user data table 4001 in which the user ID and the start point coordinates shown in FIG. 25 are associated is also held. The balloon arrangement management unit 206 specifies the root start point coordinates associated with the user ID provided to the acquisition unit 102 and the main body reference point coordinates associated with the balloon ID. The balloon arrangement management unit 206 provides the specified start point coordinates, reference point coordinates, and message text to the display control unit 202.

  Returning to FIG. 31, the display control unit 202 generates a balloon having n roots with the reference point coordinates as the positions of the reference points of the balloon body and the n start point coordinates as the start points. Furthermore, the chat display part 204 arrange | positions the panel for displaying a chat in the layer of a balloon main body, and displays a message text on this panel by a chat format. Here, a display example in which a plurality of balloons are displayed will be described with reference to FIG. FIG. 34 is an explanatory diagram illustrating a display example of a plurality of balloons.

  As shown in FIG. 34, for example, it is assumed that a plurality of users are chatting by specifying, for example, three balloon IDs. In this case, balloons corresponding to the three balloon IDs are generated and rendered on the balloon layer. The message text is displayed in a chat format in each balloon. The balloon ID may be specified for each conversation content, for example.

  In the present embodiment, when a plurality of balloon IDs are specified, a plurality of balloons are displayed, and message text is displayed in the chat format in the balloons. This makes it possible for each group to intuitively understand who is in a conversation with whom in each group when chatting is performed in multiple groups including multiple users. It becomes.

[10-2] Details of Operation of Information Display Device The functional configuration of the information display device 17 has been described above. Next, the details of the operation of the information display device 17 will be described with reference to FIG. As illustrated in FIG. 35, the acquisition unit 102 acquires a user ID, a balloon ID, and a message input via the input unit 20 (S802).

  Then, the balloon arrangement management unit 106 acquires the start point coordinates corresponding to the user ID acquired in step S802, the reference point coordinates corresponding to the balloon ID, and the message text (S804). In step S802, since a plurality of user IDs are input from a plurality of input units, a plurality of start point coordinates respectively corresponding to the plurality of user IDs are acquired in step S804.

  The display control unit 202 generates a balloon-shaped image based on the plurality of start point coordinates and reference point coordinates acquired in step S804 (S806). The display control unit 202 renders the balloon-shaped image generated in step S806 on the balloon layer (S808).

  And the chat display part 204 arrange | positions the panel (chat panel) which makes a reference point coordinate an upper left vertex on a balloon main body (S810). A chat screen is displayed on the chat panel arranged in step S808 (S812). The details of the operation of the information display device 17 have been described above. In the present embodiment, the user ID (identification information of the caller of the conversation) is designated, and the balloon start layer on the display screen is displayed using the balloon start point coordinates corresponding to the user ID and the reference point coordinates corresponding to the balloon ID. A balloon-shaped image is displayed on the screen and superimposed on the video layer on which a plurality of users are displayed. A chat screen displaying a plurality of user messages is displayed on the balloon body displayed in the balloon layer.

  In addition, when a plurality of balloon IDs are designated, a plurality of balloons are displayed, and message text is displayed in a chat format in the balloons. This makes it possible for each group to intuitively understand who is in a conversation with whom in each group when chatting is performed in multiple groups including multiple users. It becomes.

  The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention pertains can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present invention.

  For example, each step in the processing of the information display devices 10 to 17 in the present specification does not necessarily have to be processed in time series in the order described as a flowchart. That is, each step in the processes of the information display devices 10 to 17 may be executed in parallel even if they are different processes.

  In addition, it is possible to create a computer program for causing hardware such as the CPU, ROM, and RAM incorporated in the information display devices 10 to 17 to perform the same functions as the components of the information display devices 10 to 17 described above. is there. A storage medium storing the computer program is also provided.

10, 11, 12, 13, 14, 15, 16, 17 Information display device 20 Input unit 30 Display screen 102 Acquisition unit 104, 202 Display control unit 106, 206 Balloon arrangement management unit 108, 208 Balloon form management unit 110 Balloon size Administration unit 204 Chat display unit

Claims (12)

Display control for displaying a balloon-shaped image composed of a transmission source area indicating a conversation originator and a conversation display area indicating a conversation destination and conversation contents on a video including images indicating a plurality of users. And
An acquisition unit that acquires start point information of the transmission source area, reference point information of the conversation display area, and conversation information displayed in the conversation display area;
With
The display control unit uses the transmission source area start point information acquired by the acquisition unit as the transmission source area start point, the conversation display area reference point information as the conversation display area reference point, and the conversation information. An information display device, wherein the balloon-shaped image displayed on the conversation display area is displayed superimposed on the video.   The balloon shape includes a frame-like area including a reference point of the conversation display area, and an area extending toward the conversation display area with the start point of the transmission source area as a vertex. Item 4. The information display device according to Item 1.   The information display device according to claim 1, wherein the display control unit displays the conversation display area in the vicinity of an image indicating a user to whom a conversation is transmitted. A speech balloon placement management unit that associates the starting point coordinates of the transmission source area and the identification information of the transmission source of the conversation, the reference point coordinates of the conversation display area and the identification information of the transmission destination of the conversation, respectively.
The acquisition unit acquires identification information of a source of the conversation and identification information of a destination of the conversation,
The display control unit uses the start point coordinates of the transmission source region associated with the identification information of the transmission source of the conversation acquired by the acquisition unit as the start point of the transmission source region, and includes the identification information of the transmission destination of the conversation. The information display device according to claim 3, wherein the balloon-shaped image having the reference point coordinates of the associated conversation display area as a reference point is displayed by superimposing the video.   5. The apparatus according to claim 1, further comprising: a balloon form management unit that counts the number of calls from a conversation source and selects the form of the balloon shape according to the number of calls. Information display device. The display control unit displays a plurality of balloon-shaped images superimposed on the video,
6. The apparatus according to claim 1, further comprising: a balloon size management unit that enlarges one balloon-shaped image among the plurality of balloon-shaped images and reduces another balloon-shaped image. The information display device described. A balloon-shaped image composed of a plurality of source areas indicating the origins of conversations transmitted from a plurality of users and a conversation display area indicating the contents of the conversations transmitted from the plurality of users is indicated for the plurality of users. A display control unit that superimposes and displays the image including the image;
An acquisition unit that acquires start point information of the plurality of transmission source areas, reference point information of the conversation display area, and conversation information to be displayed in the conversation display area;
With
The display control unit uses the starting point information of the plurality of transmission source regions acquired by the acquisition unit as the starting point of the plurality of transmission source regions, and the reference point information of the conversation display region as a reference point of the conversation display region. The balloon-shaped image in which the plurality of transmission source areas are added to one conversation display area and the conversation information transmitted from a plurality of users is displayed in the one conversation display area is displayed on the video. An information display device characterized by being superimposed and displayed.   The information display device according to claim 7, wherein the display control unit displays the content of a conversation transmitted from the plurality of users in a conversation display area in a chat format. A balloon placement management unit associating start point coordinates of the transmission source area and identification information of the start point coordinates,
The acquisition unit acquires identification information of a plurality of the start point coordinates,
The display control unit starts from the start point coordinates of the plurality of source regions associated with the identification information of the plurality of start point coordinates acquired by the acquisition unit, and sets the source region in one conversation display region. The information display device according to claim 7, wherein the added balloon-shaped image is displayed so as to be superimposed on the video.   The information display device according to claim 7, further comprising: a balloon form management unit that counts the number of calls from a conversation originator and selects the form of the balloon shape according to the number of utterances. The balloon arrangement management unit associates reference point coordinates of the conversation display area with identification information for identifying the balloon-shaped image,
The acquisition unit acquires identification information of the plurality of start point coordinates and identification information for identifying the image of the balloon shape,
The display control unit determines the reference point coordinates of the conversation display area associated with the identification information for identifying the balloon-shaped image based on the identification information for identifying the balloon-shaped image acquired by the acquisition unit. The balloon-shaped image obtained by adding the source area starting from the start point coordinates of the source area associated with the identification information of the plurality of start point coordinates to the conversation display area as a reference point is displayed on the video. The information display device according to claim 9, wherein the information display device is displayed in a superimposed manner. An input device that inputs start point information of the source area, reference point information of the conversation display area, and conversation information displayed in the conversation display area in response to a user operation;
A balloon-shaped image composed of a sender area indicating the origin of the conversation and a conversation display area indicating the destination of the conversation and the content of the conversation is superimposed on a video including images showing a plurality of users and displayed on the display device. An information display device
The information display device uses the starting point information of the transmission source region input by the input device as a starting point of the transmission source region, the reference point information of the conversation display region as a reference point of the conversation display region, and the conversation information. An information display system, wherein the balloon-shaped image displayed on the conversation display area is displayed superimposed on the video.

Images