JP7212255B2 - Information processing system, control program and information processing device - Google Patents

Description

The present invention relates to an information processing system, control program, and information processing apparatus.

2. Description of the Related Art A mechanism is known in which viewers of video content being distributed are allowed to have a group chat about the content of the video content. For example, in Patent Document 1, on a chat screen in which avatars corresponding to each user participating in a group chat are arranged around video content, a standard message regarding the content of the video content is displayed according to the button selected by the user. A client device is disclosed.

WO2017/026170

The client device described in Patent Literature 1 displays a standard message selected by the user in a balloon beside the avatar representing the user. Although this allows the user to check the reactions of other users who are viewing the moving image content, simply displaying the standard message selected by the user in a balloon lacks entertainment.

Further, Japanese Patent Application Laid-Open No. 2002-200001 discloses displaying a balloon with a size corresponding to the frequency of selection of standard messages by a plurality of users. However, if another user's standard message is displayed in a large size, the user who is watching the video content may find this annoying.

SUMMARY OF THE INVENTION The problem to be solved by the present invention is to improve entertainment while suppressing annoyance in a mechanism for displaying a reaction of a viewer on a display screen of a viewing target.

In order to solve the above-mentioned problems, the present invention enables a first element based on the user's operation to be superimposed on the viewing target on a screen on which the viewing target is displayed, while allowing a second element based on another person's operation to be superimposed on the viewing target. Cannot be superimposed on the target.

An information processing system, which is an embodiment of the present invention, is a first information processing device in which a viewing target is displayed in a first range that at least partially overlaps a basic region in which the viewing target is displayed. a first control means for displaying a first element based on a first operation by a first user who is viewing the target; and second control means for displaying a second element based on a second operation by a second user.

Advantageous Effects of Invention According to the present invention, it is possible to improve entertainment while suppressing annoyance in a mechanism for displaying a reaction of a viewer on a display screen of a viewing target.

1 is a configuration diagram of a video distribution system; FIG. (Example) 3 is a block diagram showing the electrical configuration of the server; FIG. (Example) 2 is a block diagram showing the electrical configuration of the mobile terminal; FIG. (Example) It is a figure which shows the display mode of the screen of a portable terminal. (Example) It is a figure which shows the screen which displays the onomatopoeia image. (Example) It is a figure which shows the screen which displays the 2nd image. (Example) FIG. 3 is a functional block diagram related to moving image distribution of a server; (Example) It is a functional block diagram about the onomatopoeia display of a portable terminal. (Example) It is a flowchart which shows the flow of onomatopoeia display processing performed with a portable terminal. (Example) It is a flowchart which shows the flow of onomatopoeia display processing performed by a server. (Example) FIG. 3 is a schematic diagram showing the configuration of a screen; (Other embodiments)

[1. embodiment]
[1-1. Main features]
The present invention relates to a mechanism for displaying a viewer's reaction on a viewing target display screen. In each embodiment according to the present invention, in order to improve entertainment while suppressing annoyance, the viewing target is displayed in a first range that at least partially overlaps with the basic area in which the viewing target is displayed. A first element based on a first operation by a user is displayed, and a second element based on a second operation by a second user who is viewing a viewing target is displayed in a second range that does not overlap with the basic area.

The viewing target refers to video content that is at least visually grasped by the user. The video content may include audio content that is perceived aurally by the user. Video content is distributed from a distribution device to an information processing device, for example. Streaming distribution or progressive download distribution, for example, is suitable for distribution of video content. Video content is, for example, moving images. The viewing target is displayed in a basic area that is part of the screen of the information processing device.

A user (viewer) who views a viewing target can add a predetermined element (additional element) to the viewing target by performing a predetermined operation (additional operation). A predetermined operation is, for example, a pointing operation with respect to an input element (operation element). The input element is, for example, a button displayed within the screen. A pointing operation is, for example, a combination of a touch operation on a touch panel, a positioning operation of a pointer displayed on the screen, and a click operation. The predetermined element is, for example, an image representing the user's reaction to the viewing target. The user's reaction is, for example, the user's emotion. An image that expresses the user's feelings toward the viewing target is sometimes called an emotional image. The emotion image is, for example, an image in which an onomatopoeia (also called an onomatopoeia, an onomatopoeia, a mimetic word, etc.) representing the user's emotion is designed. An image in which onomatopoeia is designed is sometimes called an onomatopoeia image. Adding an element to the viewing target means to associate the display timing of the element with the progress of the viewing target. When the display timing is associated with the progress, the display timing is specified at a specific position on the timeline. The element added to the viewing target can be displayed on the screen at the associated display timing while the viewing target is in progress (that is, during playback display).

The first user is the user (the person himself/herself) who uses the information processing apparatus. A predetermined operation (first operation) by the first user is received by, for example, the information processing apparatus. A second user is another user (another person) who uses another information processing apparatus. A predetermined operation (second operation) by the second user is received by, for example, another information processing apparatus. A predetermined element (first element) based on the first operation is displayed in a first range that at least partially overlaps the base area. A predetermined element (second element) based on the second operation is displayed in a second range that does not overlap the basic area. The first range may have a portion (first portion) that does not overlap with the basic region in addition to a portion (second portion) that overlaps with the basic region. The first range may further have a portion (third portion) that overlaps the second range.

[1-2. Note]
The present invention includes at least the following [A] to the following [D].

[A] In the first information processing device, a first user who is viewing the viewing target in the first information processing device displays a first display in a first range that at least partially overlaps the basic region in which the viewing target is displayed. a first control means for displaying a first element based on one operation; and a second area that does not overlap with the basic area based on a second operation by a second user who is viewing the viewing target on the second information processing device. and a second control means for displaying a second element.

[B] At least partially superimposed on a basic area in which the viewing target is displayed on a computer of an information processing device included in an information processing system including a plurality of information processing devices used by a plurality of users who view the viewing target. a first control function for displaying a first element based on a first operation by a user who is viewing the viewing target in a first range where the viewing target is being viewed; A control program for realizing a second control function of displaying a second element based on a second operation on another information processing apparatus by another user. Note that the control program may be non-temporarily recorded on a recording medium.

[C] receiving means for receiving a first operation by a first user who is viewing a viewing target; Acquisition for acquiring information on a second operation from a first control means for displaying a first element based on a first operation and a management means for managing information on a second operation by a second user who is viewing the viewing target and a second control means for displaying a second element based on the second operation acquired by the acquisition means in a second range that does not overlap with the basic area.

[D] a receiving step of receiving a first operation by a first user who is viewing a viewing target; a first control step of displaying a first element based on a first operation; and an acquisition of acquiring information of the second operation from a management means for managing information of the second operation by the second user who is viewing the viewing target. and a second control step of displaying a second element based on the second operation acquired in the acquisition step in a second range that does not overlap with the basic region.

The following technical limitations may be added to the above [A] "information processing system". Also, the same technical limitation may be added to the above [B] "control program", the above [C] "information processing apparatus", and the above [D] "information processing apparatus control method".

(1) The first information processing apparatus further includes reception means for receiving the first operation via an operation element arranged at a position not superimposed on the basic area. As a result, the element based on the operation received by the information processing device becomes the first element.

(2) The first control means assigns the first element to the first range having a first portion that overlaps neither the basic region nor the second range, and a second portion that overlaps the basic region. , while changing the display mode from the first portion toward the second portion. The display mode is, for example, the size, shape, position, and number of components. The first element, which is displayed while changing the display mode from the first part toward the second part, changes from a state in which it is not superimposed on the viewing target to a state in which it is superimposed on the viewing target. This further improves entertainment.

(3) The first control means transfers the first element to the first range, which further has a third section overlapping the second range, from the first section to the third section via the second section. It is displayed while changing the display mode toward it. The display mode is, for example, the size, shape, position, and number of components. The first element, which is displayed while changing the display mode from the first part to the third part through the second part, changes from a state in which it is not superimposed on the viewing target to a state in which it is superimposed on the viewing target, It changes from a state in which it cannot be superimposed on the element to a state in which it can be superimposed on the second element. This further improves entertainment.

(4) The first control means causes the first element to be displayed in the first range while changing the display mode so as to extend from the vicinity of the operation element arranged in the first portion as a starting point. . This further improves entertainment.

[2. Example]
Embodiments of the present invention will be described below with reference to the drawings. The present embodiment relates to a mechanism for displaying an image representing a user's (viewer's) emotion (an image representing a reaction) on a display screen of a moving image (viewing target). In this embodiment, the information processing apparatus will be described as a mobile terminal, a so-called smart phone. Note that the mobile terminal is not limited to a smart phone, and may be a tablet terminal, a laptop computer, or the like. Further, the information processing device may be a desktop personal computer. Each program according to the embodiment is stored in an information processing device, but is not limited to this, and can be stored in an optical disk such as a CD-ROM (Compact Disk Read Only Memory) or a portable storage device such as a USB (Universal Serial Bus) flash memory. It may be stored in a storage medium such as a semiconductor memory.

[2-1. Features]
In this embodiment, in order to improve entertainment while suppressing annoyance, a range (first range) that partially overlaps with the distribution video display area (basic area) is displayed for the first user (the person himself/herself) who is watching the video. ), the first image (additional element, first element) based on the additional operation (first operation) is generated from the vicinity of the input element (operation element) arranged in the first image display area (first part) as a starting point, Expanded display (display while changing the display mode) from the first image display area to the second image display area (third part) via the distribution moving image display area (second part), and the distribution moving image display area and A second image (additional element, second element) based on an additional operation (second operation) by a second user (another person) who is watching a moving image is displayed in a non-overlapping range (second range).

In addition, in this embodiment, in order to allow the viewer of the moving image to efficiently specify the elements to be added to the moving image, the user (the person himself/herself) for the moving image can input the input element (operation element) while the moving image and the input element (operation element) are displayed on the screen. Receives a touch operation (additional operation) for displaying a first image (additional element) that expresses the emotion (reaction) of The longer the time (the duration of the additional operation), the larger the extension display (display while changing the display mode).

[2-2. Video distribution system]
A mobile terminal according to an embodiment is included in a video delivery system, and videos are delivered from a server.

[2-2-1. Overall configuration of video distribution system]
FIG. 1 is a schematic configuration diagram of a video distribution system 1 according to an embodiment. A video distribution system 1 includes a communication line 2 , a plurality of mobile terminals 3 and a server 4 .

The communication line 2 forms a computer network, and is, for example, a wide area communication line provided by an electric power company.

The mobile terminal 3 is, for example, an information processing terminal such as a smart phone, a tablet terminal, or a notebook computer. The mobile terminal 3 includes a touch panel display 3a for displaying images, a speaker 3b for outputting sound, a microphone 3c for inputting sound, a camera 3d for capturing an image of an object, and the like. As an example, dedicated application software (hereinafter referred to as “moving image viewing application”) is installed on the mobile terminal 3 in order to display the moving images distributed from the server 4 .

The server 4 is an information processing device that distributes content to a plurality of mobile terminals 3 via the communication line 2 . A content according to the embodiment is, for example, a moving image. The videos are not particularly limited, and include, for example, animations, dramas, etc., in which a story exists and the story progresses along the story, music videos, live music videos, various sports videos, and the like. In addition, the animation which concerns on an Example is an animation as an example. Also, the content delivered from the server is not limited to moving images, and may be other services, such as a set of continuous still images, as long as the content can be viewed by the user.

Furthermore, viewing here means that the user recognizes the content by at least one of visual and auditory sense. It may be sound or the like.

A plurality of mobile terminals 3 to which moving images are distributed are registered in the server 4 as a group 5 (hereinafter referred to as "group registration"), for example. The server 4 simultaneously distributes moving images to the mobile terminals 3 registered in the group. That is, the plurality of mobile terminals 3 registered in the group display the moving images distributed from the server 4 on the touch panel display 3a at the same timing, in other words, in synchronization. As a result, each user of the mobile terminal 3 who is registered as a group can watch the video at the same time.

It should be noted that the moving image may be distributed at a predetermined date and time, or may be distributed at an arbitrary timing for each group 5 . When a moving image is distributed at an arbitrary timing, for example, the mobile terminal 3 serving as a host requests the server 4 to distribute the moving image, and the server 4 that receives the distribution request Deliver videos to.

In FIG. 1, four mobile terminals 3 constitute the group 5, but this is an example, and the number of mobile terminals 3 is not limited as long as the group 5 is composed of a plurality of mobile terminals 3. FIG. Also, the types of the mobile terminals 3 constituting the group 5 are not limited, and smartphones, tablet terminals, notebook computers, and the like may be mixed.

[2-2-2. Server configuration]
FIG. 2 is a block diagram showing the electrical configuration of the server 4 according to the embodiment.

The server 4 according to the embodiment includes a CPU (Central Processing Unit) 20 that is a main control unit that controls the overall operation of the server 4, a ROM (Read Only Memory) 22 in which various programs and various data are stored in advance, and various A RAM (Random Access Memory) 24 used as a work area or the like during program execution, and an HDD (Hard Disk Drive) 26 as storage means for storing various programs and various data are provided.

The HDD 26 stores information about the registered group 5, moving images (moving image data) to be distributed to the portable terminal 3, and various other information. Note that the storage means is not limited to the HDD 26, and may be other storage media such as semiconductor memory such as flash memory.

Further, the server 4 includes an operation input unit 28 configured with a keyboard, a mouse, etc., for receiving input of various operations, a monitor 30 such as a liquid crystal display device for displaying various images, and a mobile terminal 3 or the like via the communication line 2. It is provided with an external interface 32 that is connected to other information processing devices or the like and performs transmission/reception of various data with the other information processing devices or the like.

The CPU 20 , ROM 22 , RAM 24 , HDD 26 , operation input section 28 , monitor 30 and external interface 32 are electrically connected to each other via a system bus 34 . Therefore, the CPU 20 accesses the ROM 22, the RAM 24, and the HDD 26, grasps the operation state of the operation input unit 28, displays images on the monitor 30, and exchanges various data with other information processing devices or the like via the external interface 32. Transmission and reception can be performed respectively.

[2-2-3. Electrical Configuration of Mobile Terminal]
FIG. 3 is a functional block diagram showing the electrical configuration of the mobile terminal 3. As shown in FIG. The mobile terminal 3 includes a main control section 40, a main storage section 42, an auxiliary storage section 44, a communication section 46, and operation buttons 48 in addition to the configuration shown in FIG.

The main control unit 40 is, for example, a CPU, a microprocessor, a DSP (Digital Signal Processor), etc., and controls the overall operation of the mobile terminal 3 .

The main storage unit 42 is composed of, for example, a RAM or a DRAM (Dynamic Random Access Memory), and is used as a work area or the like when the main control unit 40 executes processing based on various programs.

The auxiliary storage unit 44 is, for example, a non-volatile memory such as a flash memory, and stores various data such as images, programs used for processing by the main control unit 40, and the like. The programs stored in the auxiliary storage unit 44 include, for example, an OS (Operating System) for realizing the basic functions of the mobile terminal 3, drivers for controlling various hardware, e-mail and web browsing, and various other programs. It is a program or the like for realizing a function. Further, the auxiliary storage unit 44 pre-stores application software such as a video viewing application for reproducing the video distributed from the server 4 and displaying it on the touch panel display 3a.

The communication unit 46 is, for example, a NIC (Network Interface Controller) and has a function of connecting to the communication line 2 . Note that the communication unit 46 has a function of connecting to a wireless LAN (Local Area Network), a function of connecting to a wireless WAN (Wide Area Network), a function of connecting to a wireless LAN (Local Area Network), a function of connecting to a wireless WAN (Wide Area Network), or a short-range communication such as Bluetooth (registered trademark), instead of or together with the NIC. It may have a function of enabling wireless communication, infrared communication, and the like.

The operation button 48 is provided on the side surface of the mobile terminal 3, and includes a power button for starting or stopping the mobile terminal 3, a volume adjustment button for sound output by the speaker 3b, and the like.

These main control unit 40, main storage unit 42, auxiliary storage unit 44, communication unit 46, touch panel display 3a, speaker 3b, microphone 3c, camera 3d, and operation button 48 are electrically connected to each other via system bus 49. It is connected. Therefore, the main control unit 40 accesses the main storage unit 42 and the auxiliary storage unit 44, displays an image on the touch panel display 3a, grasps the operating state of the touch panel display 3a and the operation buttons 48 by the user, and transmits sound to the microphone 3c. Input, sound output from the speaker 3b, control of the camera 3d, access to various communication networks and other information processing devices via the communication unit 46, and the like can be performed.

[2-3. Onomatopoeia display]
The mobile terminal 3 according to the embodiment can display an image (an onomatopoeia image whose details will be described later) according to the user's operation while displaying the moving image distributed from the server 4 on the touch panel display 3a. In addition, in the following description, the function to display an onomatopoeia image on the touch-panel display 3a is called an onomatopoeia display function, and the touch-panel display 3a is also called screen 3a.

The onomatopoeia display function is, for example, one of the functions that the video viewing application according to the embodiment has. In addition, as an example, onomatopoeia display is not possible for all the videos displayed on the screen 3a using the video viewing application, and the videos for which the onomatopoeia display is possible are determined in advance.

[2-3-1. screen structure]
4 to 6 show display modes of the screen 3a of the mobile terminal 3 on which the video viewing application according to the embodiment is running. A distribution moving image display area 50A, a first image display area 50B, and a second image display area 50C are set on the screen 3a.

50 A of delivery animation display areas are areas which display the animation delivered from the server 4. FIG. The first image display area 50B is an area for displaying the first image 51 (see FIG. 5) according to the user's operation. The second image display area 50C is an area for displaying a second image 52 (see FIG. 6) based on the first image 51 displayed on another mobile terminal 3 by another user's operation. As will be described in detail later, the second image 52 is a reduced image of the first image 51 displayed in the first image display area 50B of the other mobile terminal 3 . In addition, the first image display area 50B and the second image display area 50C according to the embodiment are provided at positions facing each other with the delivered moving image display area 50A interposed therebetween, as an example.

Here, the first image 51 is an image including an emotion image that indicates the emotion of the user who is watching the moving image. The emotion image according to the embodiment is, for example, an image in which an onomatopoeic word (also called an onomatopoeia or a mimetic word) indicating a user's emotion is designed, in other words, an onomatopoeia image. Onomatopoeia images include, for example, "Amazing", "Yabai", and "Bravo". It should be noted that the designing is, for example, decorative drawing of characters indicating onomatopoeia.

In addition to the onomatopoeia image, the first image 51 includes a character image showing a character appearing in the moving image, a dialogue image showing the character's dialogue, text input by the user himself, and other various images. good too.

Also, the first image 51 may differ depending on the scene of the moving image. For example, it may be possible to display an onomatopoeia image or a character image that is highly likely to be selected by the user in sympathy with the scene, depending on a happy scene, a sad scene, a confrontation scene between characters, or the like.

Also, the first image 51 that can be displayed may differ depending on the user. For example, the number of types of displayable first images 51 may be increased by acquiring specific items through services such as games related to distributed moving images. Further, for example, the number of types of first images 51 that can be displayed may be increased on condition that a predetermined consideration (for example, monetary value such as currency, virtual currency, or points) is paid.

In the first image display area 50B according to the embodiment, a plurality of display buttons 53A to 53D, which are operation units operated by the user and corresponding to different first images 51, are displayed. Accordingly, the user can display the first image 51 in the first image display area 50B by operating the display buttons 53A to 53D while watching the moving image. The operation of the display buttons 53A to 53D is, for example, touching (pressing) the display buttons 53A to 53D with an indicator. An indicator according to the embodiment is, for example, a user's finger. Further, in the following description, when the display buttons 53A to 53D are not described separately, the alphabetical notation at the end is omitted.

In the examples of FIGS. 4 to 6, four display buttons 53A to 53D are displayed in a row in the horizontal direction below the first image display area 50B. The display button 53A corresponds to the onomatopoeia image stylized "Sugee", the display button 53B corresponds to the onomatopoeia image stylized "Yabai", and the display button 53C corresponds to the stylized onomatopoeia image "Bravo". Corresponds to onomatopoeia images. Furthermore, the display button 53D corresponds to a character image. The display button 53 is designed so that the user can intuitively recognize the corresponding onomatopoeia image, character image, or the like.

By displaying a plurality of display buttons 53 in the first image display area 50B in this manner, the user can easily display the first image 51 that best matches his reaction (emotion) to the moving image on the screen 3a. can be done. In addition, since the first image 51 includes an onomatopoeia image indicating the user's emotion, the user can display his/her own emotion after watching the moving image on the screen 3a.

In the examples of FIGS. 4 to 6, four types of display buttons 53 are displayed in the first image display area 50B, but this is an example, and the number and type of display buttons 53 are not limited to this. . Further, the display button 53 may be switched and displayed as appropriate so that different first images 51 can be displayed according to the scene of the moving image or the like.

Also, the arrangement of the display buttons 53 is also an example. may Furthermore, a display button 53 for displaying a different type of first image 51 may be newly displayed by, for example, the user swiping the lower portion of the screen 3a in the left or right direction.

[2-3-2. Display of first image]
A display mode of the first image 51 will be described in detail with reference to FIG. In the example of FIG. 5, the display button 53C is operated by the user, and an onomatopoeia image in which "Bravo" is designed is displayed on the screen 3a.

The onomatopoeia display function according to the embodiment receives a user's operation for displaying an onomatopoeia image (first image 51) on the screen 3a while a moving image is displayed on the screen 3a. That is, the user operates the display button 53 while watching the moving image to display the onomatopoeia image corresponding to the emotion felt by watching the moving image on the screen 3a.

The onomatopoeia image according to the embodiment is displayed on the screen 3a displaying the moving image while changing according to the operation mode of the display button 53 by the user. As an example, the onomatopoeia image according to the embodiment is displayed so as to extend from the first image display area 50B to the delivery moving image display area 50A according to the operation mode of the display button 53 by the user.

In this way, the user can change the onomatopoeia image displayed on the screen 3a by operating the mobile terminal 3 while watching the moving image. Therefore, the user can easily display on the screen, while watching the moving image, the emotions that the user has felt while watching the moving image.

Moreover, in the example of FIG. 5, the onomatopoeia image is superimposed and displayed on the distribution animation display area 50A beyond the 1st image display area 50B. Thus, the onomatopoeia display function according to the embodiment superimposes the onomatopoeia image on the distribution video display region 50A beyond the first image display region 50B according to the user's operation mode, so that the user can view the video It becomes easier to empathize with the viewer, and the enjoyment of viewing the moving image is enhanced.

In addition, in FIG. 5, the onomatopoeia image is also superimposed on the second image display area 50C beyond the delivery moving image display area 50A. However, this is an example, and the onomatopoeia image may not be superimposed on the second image display area 50C.

Next, the details of the onomatopoeia image that changes according to the operation mode of the display button 53 will be described.

As an example, the display mode of the first image 51 according to the embodiment changes according to the duration of the operation of the display button 53 by the user. The duration of operation of the display button 53 is, for example, the time during which the display button 53 is continuously pressed (hereinafter referred to as “long pressing time”).

When the user presses the display button 53, the onomatopoeia display function according to the embodiment starts displaying the onomatopoeia image starting from the vicinity of the position of the display button 53. FIG. The display of the onomatopoeia image starting from the vicinity of the position of the display button 53 means that the onomatopoeia image is displayed so that the lower end of the onomatopoeia image substantially matches the position of the display button 53, for example.

Then, the onomatopoeia image is expanded (hereinafter referred to as "expansion display") from the first image display area 50B toward the delivery moving image display area 50A according to the long-pressing time of the display button 53. FIG.

In the extended display, for example, the onomatopoeia image is elongated or enlarged. Note that the expansion display may be such that the onomatopoeia image is expanded while changing the form such as the number of characters or the type of characters. For example, if the onomatopoeia image is "Bravo", it may be stretched so that "a" increases between "Bra" and "Bo" depending on the long press time, or It may be extended so that "o" increases between "bravo" and "-".

That is, when the user feels a stronger emotion toward the moving image being viewed, the user keeps pressing the display button 53 for displaying an onomatopoeia image corresponding to this emotion. As a result, the onomatopoeia image is expanded and displayed from the first image display area 50B toward the delivery moving image display area 50A, and displayed on the screen 3a so that the onomatopoeia image is more conspicuous.

In this way, the onomatopoeia image included in the first image 51 changes according to the user's operation mode, so that the user can display his/her own reaction (emotion) to the content on the screen 3a in a more entertaining way.

In addition, since the first image 51 is displayed so as to extend from the first image display area 50B toward the delivery moving image display area 50A according to the operation mode of the user, the user can express his or her reaction (emotion) to the content. ) can be displayed on the screen 3a in a more entertaining manner.

In addition, when the operation (long-press operation) of the display button 53 by the user ends, the display of the onomatopoeia image on the screen 3a is stopped. Stopping the display of the onomatopoeia image, for example, the displayed onomatopoeia image may disappear from the screen 3a momentarily, or the expanded onomatopoeia image may shrink toward the display button 53 and disappear from the screen 3a. good.

Moreover, in the example of FIG. 5, the periphery of the display button 53C operated by the user is highlighted in order to display the onomatopoeia image. As a result, the user can easily recognize the display button 53C that the user is operating, and the onomatopoeia display is more entertaining.

In addition, the character image or the like, which is the first image 51 other than the onomatopoeia image according to the embodiment, is displayed without change on the screen 3a. It may be displayed on the screen 3 a displaying the moving image while changing according to the operation mode of the display button 53 .

[2-3-3. Another display example of the first image]
The operation for displaying the first image 51 and the manner in which the first image 51 is displayed are not limited to the manners described above, and may be other manners exemplified below.

The onomatopoeia image is not limited to the long press operation, and the display mode may change according to, for example, a gesture operation on the screen 3a by the user. As a result, the user can easily display on the screen 3a the emotions he or she has felt by viewing the moving image while viewing the moving image.

The gesture operation for displaying the onomatopoeia is, for example, a so-called flick operation, in which the user presses the display button 53 and flips it in a desired direction. When the flick operation is performed, as an example, the onomatopoeia image is displayed in the direction of the flick operation with the vicinity of the position of the display button 53 as a starting point. That is, when the user presses the display button 53 and performs a flick operation in the upper right direction, the onomatopoeia image is displayed in the upper right direction with the position of the display button 53 as a starting point. Also, the onomatopoeia image may be expanded and displayed differently according to the speed of the flick operation. For example, the faster the flick speed, the larger the onomatopoeia image may be expanded and displayed, or the faster the flick speed, the faster the expansion speed of the onomatopoeia image may be.

In addition, when the finger of the user who presses the display button 53 slides without leaving the screen 3a, the onomatopoeia image is extended and displayed with the position of the display button 53 as the starting point in accordance with the movement of the finger of the user who is performing the slide operation. may be Moreover, when the display button 53 is continuously pushed like a double tap etc., an onomatopoeia image may be expanded and displayed according to the continuous number of times.

Moreover, the change of the display mode of an onomatopoeia image is not restricted to an expansion display. For example, when the user performs a flick operation, the onomatopoeia image may be displayed so as to move in the direction of the flick operation without changing its form, starting near the position of the display button 53 . In this case, the movement speed of the onomatopoeia image may change depending on the speed of the flick operation. For example, the faster the flick operation speed, the faster the movement speed of the onomatopoeia image.

Also, the onomatopoeia image may be displayed in the largest size at the start of display, and may be displayed so as to be gradually reduced in size according to the long-pressing time.

Also, the onomatopoeia image is not limited to being displayed starting from the position of the display button 53 . For example, when the display button 53 is pressed, an onomatopoeia image may be displayed in the center of the screen 3a (distributed moving image display area 50A), and may be vertically expanded and displayed according to the length of time the button is pressed.

Further, the onomatopoeia image may be displayed at the timing when the finger is separated from the display button 53 instead of the onomatopoeia image being displayed at the timing when the display button 53 is pressed with the finger. Also in this case, for example, the display mode of the onomatopoeia image changes depending on how long the display button 53 is pressed.

Furthermore, the size or shape of the onomatopoeia image does not have to change regardless of how the display button 53 is operated. For example, at the timing when the user operates the display button 53, an onomatopoeia image having a size superimposed on the first image display area 50B, the distribution video display area 50A, and the second image display area 50C is displayed for a predetermined time. good.

[2-3-4. Display of second image]
A display mode of the second image 52 will be described in detail with reference to FIG. Note that the second image 52 is a reduced image of the first image 51 displayed on another mobile terminal 3 by another user's operation, as described above.

The onomatopoeia display function according to the embodiment causes the second image 52 to be displayed in the second image display area 50</b>C almost without delay from the timing when the other user causes the other mobile terminal 3 to display the first image 51 . This allows the user to know the reactions of other users viewing the same moving image while viewing the moving image.

In addition, when the second image 52 is superimposed and displayed on the distributed moving image display area 50A like the first image 51, the second image 52 may interfere with the viewing of the moving image and may be annoyed. Therefore, the second image 52 is not superimposed and displayed on the distribution moving image display area 50A beyond the second image display area 50C regardless of the operation mode of other users. Thereby, the user can confirm the reactions of other users to the video being viewed without feeling annoyed.

As described above, the first image 51 can also be superimposed on the distribution moving image display area 50A. The superimposition of 51 does not bother the user.

Further, since the screen 3a is set such that the first image display area 50B and the second image display area 50C are different areas, the first image 51 displayed by the user and the image displayed by the other user are displayed. The second image 52 is not mixed and displayed. Accordingly, the user can easily separate and recognize the first image 51 displayed by the user and the second image 52 displayed by another user.

Further, another user according to the embodiment is, for example, another user registered in the same group as the user. That is, when the user is watching the moving image without group registration, the second image 52 is not displayed in the second image display area 50C. In addition, the second image 52 may be displayed in the second image display area 50</b>C according to the operations of all other users who are watching the moving image regardless of whether or not the user is registered in the group.

Also, in the second image display area 50C according to the embodiment, a plurality of second images 52 operated by a plurality of other users are displayed. Further, in the second image display area 50C according to the embodiment, as an example, the position where the second image 52 is displayed for each other user is not determined. That is, in the second image display area 50C, a plurality of second images 52 operated by a plurality of other users are mixed and displayed at random positions. Further, the second image 52 may be displayed while moving vertically and horizontally within the second image display area 50C. In addition, the position which displays the 2nd image 52 for every other user may be determined not only in this but in the 2nd image display area 50C.

Further, the second image 52 is adjacent to an identification image (hereinafter referred to as a “user icon”) 54 indicating another user who displayed the first image 51 as the second image 52 on his mobile terminal 3. displayed. This allows the user to recognize which user is responsible for the second image 52 displayed in the second image display area 50C. In the example of FIG. 6, the user icon 54 is a single alphabetic character displayed in the center of a circle, but this is just an example. and the design of the user icon 54 is not limited.

In addition, the second image 52 shown in FIG. 6 displays the onomatopoeia image horizontally. 52 may display an onomatopoeia image in vertical writing.

Moreover, although the second image 52 is not superimposed on the delivery moving image display area 50A, it may be displayed while being changed (e.g. expanded) within the second image display area 50C in accordance with the operation mode of another user. The second image 52 may be superimposed from the second image display area 50C to the first image display area 50B as long as it is not superimposed on the distribution moving image display area 50A.

[2-4. Function block]
Next, onomatopoeia display will be explained using a functional block diagram. In addition, the function regarding the onomatopoeia display in the server 4 is included in a moving image delivery function.

[2-4-1. Functional block related to video distribution function of server]
FIG. 7 is a functional block diagram relating to the video distribution function of the server 4 according to the embodiment.

The CPU 20 included in the server 4 includes a group registration section 60 , a video distribution section 61 , a first image display information reception control section 62 , a second image display information generation section 63 and a second image display information transmission control section 64 . Each function provided by the CPU 20 is implemented by a program stored in the HDD 26 .

The group registration unit 60 accepts registration of a group 5 made up of a plurality of mobile terminals 3 . Registration of group 5 is performed by registering a user ID, for example.

The moving image distribution unit 61 distributes moving images to the mobile terminal 3 in response to a request from the mobile terminal 3 .

The first image display information reception control unit 62 receives the first image display information received from the mobile terminal 3 via the external interface 32, and stores the first image display information in the HDD 26 in association with the corresponding moving image.

The first image display information is information related to the first image 51 displayed on the screen 3a of the mobile terminal 3, and is transmitted from the mobile terminal 3 to the server 4 at the timing when the first image 51 is displayed on the mobile terminal 3. . The first image display information includes, for example, the type of the displayed first image 51, the user ID indicating the user who displayed the first image 51, the user's operation mode performed to display the first image 51, It is the elapsed time from the start of the moving image when the first image 51 is displayed, and the like.

The second image display information generation unit 63 generates second image display information based on the received first image display information, and stores the second image display information in the HDD 26 in association with the corresponding moving image.

The second image display information is information related to the second image 52 to be displayed in the second image display area 50C. includes the user ID of the user displayed in .

The second image display information transmission control section 64 controls the external interface 32 so as to transmit the second image display information to the mobile terminal 3 . The destination of the second image display information is another mobile terminal 3 different from the mobile terminal 3 that sent the first image display information.

[2-4-2. Functional blocks related to onomatopoeia display on mobile terminals]
FIG. 8 is a functional block diagram regarding onomatopoeia display of the mobile terminal 3 according to the embodiment.

The main control unit 40 included in the mobile terminal 3 includes an image display control unit 70, a display area setting unit 71, a first image display operation reception unit 72, an operation state determination unit 73, a first image display information generation unit 74, a first image A display information transmission control section 75 and a second image display information reception control section 76 are provided. Each function provided by the main control unit 40 is implemented by a program stored in the auxiliary storage unit 44 .

The image display control unit 70 controls the touch panel display 3a to display an image based on the image data. The image display control unit 70 according to the embodiment displays the moving image distributed from the server 4 in the distributed moving image display area 50A, displays the first image 51 in the first image display area 50B according to the user's operation, and displays other images. The second image 52 based on the first image 51 displayed on the other mobile terminal 3 by the user is displayed in the second image display area 50C. Further, the image display control unit 70 according to the embodiment superimposes the first image 51 beyond the first image display area 50B and displays it on the delivery moving image display area 50A according to the user's operation mode.

The display area setting unit 71 sets the positions and sizes (vertically and horizontally) of the distribution moving image display area 50A, the first image display area 50B, and the second image display area 50C as the display mode of the screen 3a when the moving image is distributed from the server 4. length). Note that the positions and sizes of these are predetermined, but may be arbitrarily set by the user.

The first image display operation accepting unit 72 accepts an operation of the display button 53 by the user while the screen 3a is displaying a moving image. That is, the first image display operation reception unit 72 recognizes the display button 53 operated by the user among the plurality of display buttons 53, and displays the first image 51 corresponding to the display button 53 via the image display control unit 70. to display on the screen 3a. Note that the first image display operation receiving section 72 displays the first image 51 on the screen 3 a so that the display mode of the first image 51 changes according to the determination result of the operation state determining section 73 .

The operation state determination unit 73 determines the operation state of the display button 53 by the user. The operation state referred to here is, for example, an operation mode including a long pressing time of the display button 53 .

The first image display information generating section 74 generates first image display information according to the first image 51 displayed on the screen 3a by the user's operation.

The first image display information transmission control section 75 controls the communication section 46 to transmit the first image display information to the server 4 .

The second image display information reception control section 76 outputs the second image display information received from the server 4 via the communication section 46 to the image display control section 70 .

[2-5. Processing flow]
Next, the flow of onomatopoeia display processing in the mobile terminal 3 and the server 4 will be explained using a flowchart.

[2-5-1. Flow regarding onomatopoeia display on mobile terminal]
FIG. 9 is a flow chart showing the flow of onomatopoeia display processing according to the embodiment executed by the main control unit 40 provided in the mobile terminal 3. As shown in FIG. A program for executing the onomatopoeia display process is stored in advance in a predetermined area of the auxiliary storage unit 44 . As an example, the onomatopoeia display process is started when the portable terminal 3 starts playing a moving image distributed from the server 4, and ends when the playing of the moving image ends.

In step S100, occurrence of a trigger is detected. The trigger in this embodiment is either the first trigger (acceptance of user's operation of the display button 53) or the second trigger (receipt of second image display information). The mobile terminal 3 according to the present embodiment updates the display contents of the screen each time the generation of the trigger is detected. The first trigger and the second trigger can occur in parallel. Therefore, during execution of processing in response to the occurrence of one trigger, processing may be performed in response to the occurrence of the other trigger. Also, multiple secondary triggers may occur in parallel. Therefore, during the execution of the process in response to the generation of one second trigger, the process in response to the generation of another second trigger may be executed.

In step S102, when the detected trigger is the first trigger, the process proceeds to step S106, and when the detected trigger is the second trigger, the process proceeds to step S104.

In step S104, the image display control unit 70 causes the second image 52 indicated by the second image display information to be displayed in the second image display area 50C, and the process ends.

In step S106, the image display control unit 70 causes the first image display area 50B to display the first image 51 corresponding to the display button 53 operated by the user. Note that the first image 51 may be stored in the mobile terminal 3 in advance, or may be downloaded from the server 4 each time the display button 53 is operated by the user.

In step S108, the first image display information generator 74 generates first image display information corresponding to the first image 51 displayed in the first image display area 50B.

In step S<b>110 , the first image display information transmission control section 75 controls the communication section 46 to transmit the first image display information to the server 4 .

In step S112, the operation state determination unit 73 determines whether or not the operation of the display button 53 by the user has ended. If the determination is affirmative, the process proceeds to step S116, and if the determination is negative, the process proceeds to step S114.

In step S114, the image display control unit 70 expands and displays the first image 51 (onomatopoeia image) until the operation of the display button 53 by the user is completed, and the process returns to step S112.

In step S116, the image display control unit 70 ends the display of the first image 51, and ends the process.

In the flowchart shown in FIG. 9, the first image display information is generated together with the display of the first image 51, and the first image display information is transmitted to the server 4; The first image display information may be transmitted to the server 4 after the display is completed. Further, the first image display information transmission control unit 75 transmits the first image display information indicating the start of display of the first image 51 to the server 4 at the timing when the display of the first image 51 is started. The first image display information indicating the end of display of the second image 52 may be transmitted to the server 4 at the timing when the display ends. As a result, the server 4 displays the first image 51 (onomatopoeia image) in a decompressed manner during the reception interval between the first image display information indicating the start of display of the first image 51 and the first image display information indicating the end of display. I can recognize that.

[2-5-2. Flow regarding onomatopoeia display on the server]
FIG. 10 is a flow chart showing the flow of onomatopoeia display processing according to the embodiment executed by the CPU 20 provided in the server 4 . A program for executing the onomatopoeia display process is pre-stored in a predetermined area of the HDD 26 . As an example, the onomatopoeia display process is started when the server 4 distributes the video to the mobile terminal 3, and ends when the distribution of the video ends.

In step S<b>200 , the first image display information reception control section 62 determines whether or not the first image display information has been received from the mobile terminal 3 . If the determination is affirmative, the process proceeds to step S202, and if the determination is negative, the process enters a waiting state.

In step S<b>202 , the received first image display information is stored in the HDD 26 by the first image display information reception control unit 62 .

In step S<b>204 , the second image display information generator 63 generates second image display information based on the received first image display information, and stores it in the HDD 26 .

In step S206, the second image display information transmission control unit 64 controls the external interface 32 to transmit the second image display information to the mobile terminal 3 different from the mobile terminal 3 that has transmitted the first image display information, Return to step S200.

It should be noted that the server 4 may also transmit the second image display information to the mobile terminal 3 when the video to be delivered to the mobile terminal 3 is already associated with the second image display information. Thereby, the user can recognize the first image 51 displayed by another user in the past, not in real time. For example, even if a user registered in a group views a video as a group 5 and then views the video alone (asynchronously with the other mobile terminals 3) instead of as a member of the group 5, the previously displayed A second image 52 based on the first image 51 is displayed in the second image display area 50C.

As described above, the mobile terminal 3 according to the embodiment includes the distributed moving image display area 50A that displays the moving image distributed from the server 4, and the first image display area 50B that displays the first image 51 according to the user's operation. A second image display area 50C for displaying a second image 52 based on the first image 51 displayed on another mobile terminal 3 by another user's operation is set on the screen 3a. Although the first image 51 is superimposed on the distribution moving image display area 50A beyond the first image display area 50B according to the operation mode of the user, the second image 52 is displayed regardless of the operation mode of another user. First, the second image display area 50C is not superimposed and displayed on the delivery moving image display area 50A.

As a result, the portable terminal 3 can display the user's own reaction to the moving image on the screen 3a in a highly entertaining manner, and allows the user viewing the moving image to confirm the reactions of other users without feeling annoyed. can.

Further, the mobile terminal 3 according to the embodiment accepts a user's operation for displaying an onomatopoeia image representing the user's emotion on the screen 3a while the screen 3a is displaying a moving image. Then, the onomatopoeia image is displayed on the screen 3a displaying the moving image while changing the display mode according to the operation mode by the user. Therefore, the user can change the display mode of the onomatopoeia image displayed on the screen according to the operation mode while viewing the content.

As a result, the portable terminal 3 can easily display the emotion felt by the user watching the moving image on the screen 3a while the user is watching the moving image.

[3. Modification]
The technical scope of the present invention is not limited to the scope described in the above examples. Various modifications or improvements can be made to the above-described embodiments without departing from the spirit of the invention, and forms with such modifications or improvements are also included in the technical scope of the present invention.

In the above embodiment, the user's operation for displaying the first image 51 on the screen 3a is the operation of the display button 53, but the present invention is not limited to this. For example, the first image may be displayed on the screen 3a by the user operating the operation button 48 provided on the side surface of the mobile terminal 3 or the like. Further, when the mobile terminal 3 has a keyboard, the first image 51 may be displayed on the screen 3a by performing a predetermined key input.

Moreover, although the said Example demonstrated the form which the onomatopoeia display process starts with the delivery of a moving image, and is complete|finished with the redistribution of a moving image, this invention is not limited to this. For example, the onomatopoeia display process may be started a predetermined time before delivery of the moving image.

For example, when the distribution start time of the moving image is predetermined, the first image 51 and the second image 52 are displayed from a predetermined time (for example, 30 minutes) before the distribution start time by the user's operation. It may be possible to display in the display area 50B and the second image display area 50C. This allows the user to display his or her reaction to the moving image, such as expectations, on the screen 3a even before distribution of the moving image starts, and to check the reactions of other users. Further, the first image 51 and the second image 52 can be displayed in the first image display area 50B and the second image display area 50C by the user's operation until a predetermined time (for example, 30 minutes) after the end of the distribution of the moving image. may be assumed. Thereby, the user can display his/her own reaction such as a comprehensive impression of the moving image on the screen 3a even after the distribution of the moving image has started, and can confirm the reactions of other users.

In addition, the position and size of the distributed moving image display area 50A, the first image display area 50B, the second image display area 50C, and the display button 53 on the screen 3a shown in FIG. It is not limited. For example, the mode shown in FIG. 11 may be used. The example of FIG. 11A is an example of a display mode of the screen 3a when the screen 3a is oriented horizontally (the major axis direction is horizontal with respect to the user, and the minor axis direction is vertical with respect to the user). . The example of FIG. 11B is an example of the display mode of the screen 3a when the screen 3a is oriented vertically (the major axis direction is vertical with respect to the user, and the minor axis direction is horizontal with respect to the user). be.

In the example of FIG. 11A, the first image display area 50B is displayed on the right side of the delivery moving image display area 50A in the center, and the second image display area 50C is displayed on the left side. A plurality of display buttons 53 are vertically displayed on the right side of the first image display area 50B. In the example of FIG. 11B, a distributed moving image display area 50A is displayed in the upper half of the screen 3a, a first image display area 50B is displayed on the right side of the lower half of the screen 3a, and a second image display area 50C is displayed on the left side. is displayed. In both FIGS. 11A and 11B, the first image display area 50B may be displayed on the left side of the screen 3a, and the second image display area 50C may be displayed on the right side, according to the user's dominant hand.

Further, in the above embodiment, the server 4 receives the first image display information from the mobile terminal 3, transmits the second image display information generated based on the first image display information to the other mobile terminal 3, and Although the mobile terminal 3 has described a form in which the second image 52 indicated by the second image display information is displayed in the second image display area 50C, the present invention is not limited to this.

For example, the mobile terminals 3 may display the second image 52 in the second image display area 50</b>C by transmitting and receiving the first image display information between the mobile terminals 3 without going through the server 4 . That is, when the mobile terminal 3 receives the first image display information from the other mobile terminal 3, the mobile terminal 3 reads information about the first image 51 displayed on the other mobile terminal 3 from the first image display information, and based on the information, The second image 52 is displayed in the second image display area 50C.

Further, the flow of various processes described in the above embodiments is also an example, and unnecessary steps may be deleted, new steps added, or the processing order changed within the scope of the present invention. good too.

1 video distribution system 2 communication line 3 portable terminal (an example of "information processing device")
3a screen (an example of a "display screen")
4 Server (an example of "management means")
5 Group (an example of "information processing system")
50A Delivery video display area (example of "basic area", example of "second part" of first range)
50B First image display area (an example of the "first part" of the first range)
50C Second image display area (an example of the "third part" of the first range, an example of the "second range")
51 First image (an example of "first element" and "additional element")
52 second image (an example of a "second element")
53 display button (an example of "operation element")
70 Image display control unit (an example of "first control means", "second control means", and "control means")
71 Display area setting unit 72 First image display operation receiving unit (an example of “receiving means”)
73 Operation state determination unit 74 First image display information generation unit 75 First image display information transmission control unit 76 Second image display information reception control unit (an example of “acquisition means”)

Claims (7)

In the first information processing device, a first operation by a first user who is viewing the viewing target in the first information processing device is performed in a first range that at least partially overlaps the basic region in which the viewing target is displayed. a first control means for displaying a first element based on
a second information processing device for displaying a second element based on a second operation by a second user who is viewing the viewing target in a second information processing device in a second range not overlapping with the basic region in the first information processing device ; a control means;
with
The second control means controls the second control device in the first information processing device at the timing when the display of the second first element displayed on the second information processing device based on the second operation ends. end the display of the element,
Information processing system. The second control means, when the second user is registered in the same group as the first user, causes the second element based on the second operation to be displayed in the second range, and the first not displaying the second element based on the second operation when not registered in the same group as the user;
The information processing system according to claim 1. The second control means superimposes and displays the second element and a third element based on a third operation by a third user registered in the same group as the first user.
The information processing system according to claim 2. The second control means displays the second element representing the emotion of the second user due to viewing of the viewing target.
The information processing system according to any one of claims 1 to 3 . The second control means displays the second element indicating an onomatopoeia,
The information processing system according to claim 4 . In a computer of an information processing device included in an information processing system including a plurality of information processing devices used by a plurality of users who view a viewing target,
a first control function for displaying a first element based on a first operation by a user who is viewing the viewing target in a first range that at least partially overlaps a basic area in which the viewing target is displayed;
a second control function for displaying a second element based on a second operation on another information processing device by another user who is viewing the viewing target in a second range that does not overlap with the basic region;
to realize
The second control function terminates the display of the second element at the timing when the display of the second first element displayed on the other information processing device based on the second operation is terminated.
control program. receiving means for receiving a first operation by a first user who is viewing a viewing target;
a first control means for displaying a first element based on the first operation received by the receiving means in a first range that at least partially overlaps a basic area where the viewing target is displayed;
Acquisition means for acquiring information on the second operation from a management means for managing information on the second operation by the second user who is viewing the viewing target;
a second control means for displaying a second element based on the second operation acquired by the acquisition means in a second range that does not overlap with the basic area;
with
The second control means terminates the display of the second element at the timing when the display of the second first element displayed on the information processing device used by the second user based on the second operation is terminated. let
Information processing equipment.

Images