WO2015079865A1 - Input device, communication information identification method, processing device, display device, program, and recording medium - Google Patents

Abstract

In order to provide an input device with which users can browse content and communicate with other users simultaneously, a tablet terminal (1) is equipped with a display instruction determination unit (134), which identifies communication information associated with an identification result from a state identification unit (132) that identifies the state of the tablet terminal or the state of the area around the tablet terminal.

Description

INPUT DEVICE, COMMUNICATION INFORMATION SPECIFICATION METHOD, PROCESSING DEVICE, DISPLAY DEVICE, PROGRAM, AND RECORDING MEDIUM

The present invention provides an input for receiving an input operation for executing processing on a communication image for communication with other users in a collaborative browsing system that enables browsing and communication of content by a plurality of users via a communication network. The present invention relates to a device, a method for identifying communication information, a processing device for transmitting communication images, a display device for displaying communication images together with contents, a program for operating an input device, and a recording medium for recording the program.

In recent years, there is a need for technology (hereinafter referred to as a joint viewing system) for communication with remote friends and family while browsing content such as video. Conventionally, as a method for realizing the collaborative browsing system, there is a method of simultaneously performing text chat while browsing content. There are other methods for voice chat and video chat while browsing content.

For example, Patent Document 1 below discloses a TV chat system in which a viewer can participate in real-time communication of a chat group with another viewer while watching the TV. The real-time communication is realized by text message, voice communication, or video communication.

Japanese Patent Publication “JP 2013-50960 A (published March 14, 2013)” Japanese Patent Publication “JP 2013-149262 A (published on August 1, 2013)”

However, the conventional techniques as described above have the following problems.

First, when trying to communicate with other users by inputting text, the input becomes complicated, so browsing of content is often neglected. In particular, if the content is a video, it is difficult to communicate with other users if the video is missed.

Also, when communicating with other users by voice or video, the voices of a plurality of users overlap, making it difficult to hear the voices of other users, making it difficult to communicate. In addition, if the timings of speaking by a plurality of users overlap, it may be difficult for each user to speak later. Furthermore, when the content is a video, in addition to the audio uttered by the user, the audio of the content can be heard at the same time, so that communication is more difficult. Further, when there are three or more users, it becomes more difficult to communicate.

As described above, the conventional technology has a problem that the user cannot enjoy browsing the content and communicating with other users at the same time.

The present invention has been made in view of the above problems, and an object of the present invention is to provide an input device that allows a user to simultaneously enjoy browsing content and communicating with other users.

In order to solve the above-described problem, an input device according to an aspect of the present invention is intended to communicate with other users in a collaborative browsing system that allows a plurality of users to browse and communicate content via a communication network. An input device that includes a transmission unit that transmits communication information indicating processing for a communication image for the state identification unit that identifies the own device or a state around the own device, and is associated with the identification result by the state identification unit A communication information specifying unit for specifying the communication information.

In order to solve the above problem, a communication information specifying method using an input device according to an aspect of the present invention is a collaborative browsing that enables browsing and communication of content by a plurality of users via a communication network. In the system, a method for identifying communication information using an input device including a transmission unit that transmits communication information indicating processing for a communication image for communication with another user, the state of the device or the surroundings of the device And a communication information specifying step for specifying the communication information associated with the specifying result in the state specifying step.

According to one aspect of the present invention, there is an effect that it is possible to provide an input device that can simultaneously enjoy browsing of content and communication with other users.

It is a functional block diagram which shows an example of the principal part structure of the tablet terminal which concerns on one Embodiment of this invention. It is a block diagram which shows an example of the state acquisition part of the tablet terminal shown in FIG. It is the schematic which shows an example of a structure of the collaborative browsing system (communication system) using the tablet terminal shown in FIG. (A) And (b) is a schematic diagram which shows an example of the image displayed on the touch panel of the tablet terminal shown in FIG. It is a schematic diagram which shows an example of the image displayed on the television in the collaborative browsing system shown in FIG. (A) is a figure which shows a mode that the user is using the collaborative browsing system shown in FIG. 3, (b) is a schematic diagram which shows an example of the image displayed on the television shown in (a). (A) is a figure which shows a mode that the user is using the collaborative browsing system shown in FIG. 3, (b) is a schematic diagram which shows an example of the image displayed on the television shown in (a). (A) And (b) is a schematic diagram which shows another example of the image displayed on the television in the collaborative browsing system shown in FIG. It is a flowchart which shows an example of the flow of the process performed with the tablet terminal shown in FIG. (A) And (b) is a schematic diagram which shows another example of the image displayed on the touch panel of the tablet terminal shown in FIG. It is a schematic diagram which shows another example of the image displayed on the television in the collaborative browsing system shown in FIG. It is a functional block diagram which shows the principal part structure of the tablet terminal which concerns on other embodiment of this invention. It is the schematic which shows another example of a structure of the collaborative browsing system which concerns on further another embodiment of this invention.

Hereinafter, embodiments of the present invention will be described in detail. In the embodiments described below, an example in which the input device of the present invention is applied to a tablet terminal will be described. The application example is not limited to the tablet terminal, and the present invention can be applied to any input device that accepts an input operation for executing processing on a communication image for communication with other users. For example, it can be applied to a smartphone, a mobile phone, and the like. For convenience of explanation, members having the same functions as those shown in each embodiment are given the same reference numerals, and the explanation thereof is omitted as appropriate. Furthermore, the shape of the configuration described in each drawing and the dimensions such as length, size, and width do not reflect the actual shape or dimensions, but are changed as appropriate for clarity and simplification of the drawings. ing.

Embodiment 1
In one embodiment of the present invention, it will be described below with reference to FIGS.

(Functional overview of tablet devices)
First, with reference to FIG. 1 and FIG. 5, the functional outline of the tablet terminal 1 according to the present invention will be described. FIG. 1 is a block diagram illustrating an example of a main configuration of the tablet terminal 1. FIG. 5 is a schematic diagram illustrating an example of a screen displayed on the television 2.

As shown in FIG. 1, the tablet terminal 1 according to the present invention is a communication image for communicating with other users in a collaborative browsing system that enables browsing and communication of content by a plurality of users via a communication network. And a communication terminal 15 that transmits communication information indicating processing for the state acquisition unit 12 that specifies the own device or a surrounding state of the own device, and is associated with a specification result by the state acquisition unit 12. And a display instruction determination unit 134 for specifying the communication information.

That is, the tablet terminal 1 according to the present invention transmits the communication information associated with the own device or the surrounding state of the own device, so that the communication image displayed on the display unit 21 of the television 2 illustrated in FIG. Processing is executed.

For example, the state in which the tablet terminal 1 is gripped can be specified, and the communication image can be changed to display content indicating the state. Specifically, the display of the avatar 73 displayed in the communication area 72 shown in FIG. 5 is changed. In the example of FIG. 5, the avatar 73 b and the avatar 73 c are displayed (display with both hands raised) indicating that the tablet terminal 1 is being held. “Avatar 73” is a generic name of avatar 73a to avatar 73c shown in FIG. 5, and this designation may be used when referring to other drawings. Note that the communication image displayed on the television 2 is not limited to the avatar 73 as long as the user can be uniquely identified. For example, only the user name may be displayed, or an image such as an icon or a color ball may be displayed. Further, a photograph taken using the camera 124 (FIG. 2) of the tablet terminal 1 may be pasted on the face portion of the avatar 73.

Thereby, the user using the collaborative browsing system can tell his / her situation (for example, the situation of holding the tablet terminal 1) to other users without performing a conscious input operation. Can do.

Also, for example, by performing a simple input operation on the touch panel 11, the communication image can be changed, or the pointer 74 can be displayed on the content 71 or the communication area 72. As a specific example of changing the communication image, a simple input operation is performed on the touch panel 11 so that the utterance 75 is displayed on the avatar 73b shown in FIG. 5 or the remote control is displayed on the avatar 73c to change the content. You can let them know you ’re trying.

As described above, the user using the collaborative browsing system can communicate with other users without performing a complicated input operation on the tablet terminal 1. Moreover, since no complicated input operation is required, it is possible to simultaneously enjoy browsing of content and communication with other users.

Note that the communication area 72 is not limited to an area where a chat by a plurality of users is performed. That is, the communication area 72 may be an area where communication by a plurality of users is possible. For example, in a state where a music program is displayed as the content 71, a game that plays music in accordance with the content 71 in the communication area 72 is played. It may be implemented by a plurality of users via a communication network.

(Configuration of collaborative browsing system)
Next, the configuration of the collaborative browsing system 100 according to the present embodiment will be described with reference to FIG. FIG. 3 is a diagram illustrating a configuration of the collaborative browsing system 100 according to the present embodiment.

As shown in FIG. 3, the collaborative browsing system 100 according to this embodiment includes at least a subsystem 101a including a tablet terminal 1a, a tablet terminal 1b, a television 2a, and a router 4a, a tablet terminal 1c, a television 2b, and a router 4b. The subsystem 101b and the server 3 (processing device) are included. Hereinafter, the tablet terminal 1a, the tablet terminal 1b, and the tablet terminal 1c may be collectively referred to as “tablet terminal 1”. Similarly, the television 2a and the television 2b may be referred to as “TV 2”, the router 4a and the router 4b as “router 4”, and the subsystem 101a and the subsystem 101b as “subsystem 101”.

The tablet terminal 1 and the television 2 can communicate with the outside through a wide-area communication network such as the Internet by the router 4. Thereby, the subsystem 101 and the server 3 are connected so as to communicate with each other.

The tablet terminal 1 is an input device in the collaborative browsing system 100, and the television 2 is a display device in the collaborative browsing system 100. In addition, the server 3 transmits information from the tablet terminal 1 of each subsystem 101 to instruct processing on content displayed on the television 2 or a communication image (display image) for communication with other users. (Instruction information) is received and processing for the display image is executed. And the display image which performed the said process is transmitted to the television 2, and is displayed. The instruction information may be transmitted from the television 2 in addition to the tablet terminal 1.

That is, the instruction information is transmitted from the tablet terminal 1 to the server 3 via the router 4. And the process with respect to a display image is performed based on instruction information. Thereafter, the server 3 transmits the processed display image to each subsystem 101. As a result, a display image that has been processed is displayed on the television 2. For example, the server 3 generates a display image based on the instruction information, and transmits the generated display image to the television 2. Thereby, the pose of the avatar 73 currently displayed on the television 2 changes, or the speech of the avatar 73 is displayed. Thus, the user of the collaborative browsing system 100 can communicate while browsing the common content. Further, for example, the server 3 may transmit the instruction information to the television 2, and the television 2 may generate and display a display image based on the instruction information. In this case, the server 3 has material data necessary for generating the display image, and the television 2 acquires the material data from the server 3 as necessary.

The configuration of the subsystem 101 illustrated in FIG. 3 is an example, and the number of tablet terminals 1 and televisions that configure the subsystem 101 may be changed, or an input device other than the tablet terminal 1 or a display other than the television 2 may be displayed. It may be a device. The tablet terminal 1 may also serve as an input device and a display device. In this case, the subsystem 101 may not include the television 2.

In FIG. 3, the tablet terminal 1 and the television 2 communicate with each other via the same router 4, but the present invention is not limited to this example. For example, the tablet terminal 1 may be configured to access the Internet via a mobile phone line, or only the television 2 may be configured to be able to communicate with the outside via the Internet. It may be configured to be able to communicate with the outside (for example, the server 3). That is, the tablet terminal 1 in this case is configured to communicate only with the television 2.

(Configuration of tablet device)
Next, with reference to FIG. 1 and FIG. 2, the principal part structure of the tablet terminal 1 is demonstrated. FIG. 1 is a block diagram illustrating an example of a main part configuration of the tablet terminal 1 as described above, and FIG. 2 is a block diagram illustrating details of the state acquisition unit 12.

As shown in FIG. 1, the tablet terminal 1 includes at least a touch panel 11, a state acquisition unit 12, a control unit 13, a storage unit 14, and a communication unit 15 (transmission unit).

The touch panel 11 includes an input unit 111 and a display unit 112.

The input unit 111 is an input device that accepts an input operation by a user. Note that the input unit 111 may include a physical key. The input unit 111 detects an input surface that accepts contact (including approach) of an indicator (such as a finger or a pen), and a position where the indicator contacts the input surface while detecting that the indicator has contacted the input surface ( And a touch sensor that detects coordinates). The touch sensor may be realized by any sensor as long as it can detect contact / non-contact between the indicator and the input surface. For example, it is realized by a pressure sensor, a capacitance sensor, an optical sensor, or the like. Further, the input unit 111 outputs the detected coordinates to the input specifying unit 131 described later.

The display unit 112 is a display device that displays information processed by the tablet terminal 1 as an image in a display area. Specifically, the display unit 112 displays information processed by the tablet display control unit 133 described later. As an example of information processed by the tablet display control unit 133, the display unit 112 displays one or more user interfaces for receiving an input operation. The display unit 112 is configured by a display device such as an LCD (liquid crystal display).

The state acquisition unit 12 acquires specific information for specifying the own device or the surrounding state of the own device. As illustrated in FIG. 2, the state acquisition unit 12 includes, for example, an acceleration sensor 121 (acceleration acquisition unit), an illuminance sensor 122 (illuminance acquisition unit), a position information acquisition unit 123, a camera 124 (imaging unit), and a microphone 125 (audio). Acquisition unit) and geomagnetic sensor 126 (direction / tilt acquisition unit).

The acceleration sensor 121 is a sensor that acquires acceleration generated in the tablet terminal 1. As the acceleration sensor 121, an existing acceleration sensor generally mounted on a tablet terminal can be used.

The illuminance sensor 122 is a sensor that acquires the illuminance around the tablet terminal 1. As the illuminance sensor 122, an existing illuminance sensor generally mounted on a tablet terminal can be used.

The location information acquisition unit 123 acquires location information of the tablet terminal 1. As the position information acquisition unit 123, a GPS or the like generally mounted on a tablet terminal may be used, or other members may be used. For example, when the tablet terminal 1 and the television 2 are configured to be able to use a wide-area communication network such as the Internet by wireless communication (Wi-Fi (registered trademark), etc.), the position information acquisition unit 123 is connected to the tablet terminal 1 and the television 2. The positional relationship with respect to the router 4 may be acquired. In addition, the existing technology can be used to acquire the positional relationship of the tablet terminal 1 and the television 2 with respect to the router 4 using wireless communication.

The camera 124 is a photographing device that photographs the surroundings of the tablet terminal. As the camera 124, an existing camera generally mounted on a tablet terminal can be used. Note that the camera 124 may capture a still image, or may capture a moving image. Further, both still images and moving images may be taken.

The microphone 125 is for acquiring the sound around the tablet terminal 1. As the microphone 125, an existing microphone generally mounted on a tablet terminal can be used.

The geomagnetic sensor 126 is a sensor that acquires the orientation and inclination of the tablet terminal 1. As the geomagnetic sensor 126, an existing geomagnetic sensor generally mounted on a tablet terminal can be used.

The state acquisition unit 12 may not include all the members illustrated in FIG. Moreover, members other than the members shown in FIG. 2 may be included. That is, the state acquisition unit 12 may include any member as long as it is a member that can acquire specific information for specifying the own device or a state around the own device.

Further, the state acquisition unit 12 outputs the specific information acquired by the member capable of acquiring the specific information as described above to the state specification unit 132 in the control unit 13 described later.

The control unit 13 performs overall control of each unit included in the tablet terminal 1. The control unit 13 includes at least an input specifying unit 131, a state specifying unit 132, a tablet display control unit 133 (display content determining unit), and a display instruction determining unit 134 (communication information specifying unit).

The input specifying unit 131 specifies an input operation accepted by the input unit 111. Specifically, the input specifying unit 131 specifies the input operation based on the coordinates in the input operation, the time that the indicator has been in contact, the moving direction of the indicator that has been in contact, and the like. And according to the specified input operation, the tablet display control part 133 or the display instruction | indication determination part 134 is instruct | indicated.

The state specifying unit 132 specifies the tablet terminal 1 or the surrounding state of the tablet terminal 1. Specifically, when the state specifying unit 132 is supplied with specific information for specifying the tablet terminal 1 or the surrounding state of the tablet terminal 1 acquired by the state acquiring unit 12, the state specifying unit 132 responds to the supplied specific information. The state around tablet terminal 1 or tablet terminal 1 is specified. Then, it instructs the display instruction determination unit 134 to execute processing according to the specific result.

For example, when the orientation and inclination of the tablet terminal 1 are supplied from the geomagnetic sensor 126, the state specifying unit 132 is estimated to be obtained when the user is holding the tablet terminal 1 And whether it is within the range of inclination. Note that whether or not the user is holding the tablet terminal 1 may be specified from the acceleration generated in the tablet terminal 1 supplied from the acceleration sensor 121. In this case, the state specifying unit 132 specifies whether or not the acceleration is an acceleration within a range estimated as an acceleration that occurs when the user is holding the tablet terminal 1.

For example, when the illuminance around the tablet terminal 1 is supplied from the illuminance sensor 122, the state specifying unit 132 specifies whether the illuminance exceeds a predetermined value.

For example, when the position information of the tablet terminal 1 is supplied from the position information acquisition unit 123, the state specifying unit 132 specifies the positional relationship between the tablet terminal 1 and the television 2 based on the position information.

Note that the state of the tablet terminal 1 or the surroundings of the tablet terminal 1 specified by the state specifying unit 132 is not limited to the above example. For example, whether or not the user of the tablet terminal 1 is captured in an image (video) captured by the camera 124 may be specified, and the environment around the tablet terminal 1 may be determined based on the sound acquired by the microphone 125. You may specify.

Thereby, the user can convey his / her situation to other users without performing a conscious input operation on the tablet terminal 1.

Further, the state specifying unit 132 may specify a conscious operation performed by the user. For example, when the orientation and inclination of the tablet terminal 1 are supplied from the geomagnetic sensor 126, the state specifying unit 132 temporarily stores the supplied orientation and inclination values in a temporary storage unit (not shown). And the rotational speed of a terminal can be obtained by taking the difference with the value obtained next. Thereby, it can be specified whether the user shakes the tablet terminal 1 or not. Note that whether or not the user has shaken the tablet terminal 1 may be specified by the acceleration generated in the tablet terminal 1 supplied from the acceleration sensor 121.

Further, for example, when the state specifying unit 132 is supplied with the orientation and inclination of the tablet terminal 1 from the geomagnetic sensor 126, the surface having the touch panel 11 of the tablet terminal 1 is closest to the ground from the orientation and inclination. It may be specified whether or not it is placed on a table or floor.

Further, for example, when the position specifying unit 132 is supplied with the position information of the tablet terminal 1 from the position information acquiring unit 123, whether or not the tablet terminal 1 and the television 2 are separated by a predetermined distance or more based on the position information. May be specified.

The tablet display control unit 133 determines an image to be displayed on the display unit 112. Specifically, the tablet display control unit 133 reads image data such as a user interface from a display image storage unit 141 (to be described later) of the storage unit 14 in accordance with an instruction from the input specifying unit 131. Then, a tablet display image to be displayed on the display unit 112 is generated from the read image data and displayed on the display unit 112.

The display instruction determining unit 134 specifies communication information indicating processing for a communication image for communicating with other users, which is associated with the specifying result by the input specifying unit 131 or the state specifying unit 132. Specifically, the display instruction determination unit 134 reads out the communication information corresponding to the specification result from the input specifying unit 131 or the state specifying unit 132 from a display instruction storage unit 142 (to be described later) of the storage unit 14. Then, the read communication information is transmitted to the outside (server 3) via the communication unit 15.

The storage unit 14 is a storage device that stores various data used in the tablet terminal. As shown in FIG. 1, the storage unit 14 includes a display image storage unit 141 and a display instruction storage unit 142.

The display image storage unit 141 stores display image data to be displayed on the display unit 112 of the tablet terminal 1. In response to an instruction from the input specifying unit 131, the tablet display control unit 133 reads out image data from the display image storage unit 141 and generates a display image to be displayed on the display unit 112.

The display instruction storage unit 142 communicates with the input operation specified by the input specifying unit 131 and the tablet terminal 1 specified by the state specifying unit 132 and the surrounding state of the tablet terminal 1 (specific result), and communication with other users. Communication information indicating processing for a communication image for illustration is stored in association with each other. When an instruction based on the identification result is supplied from the input identification unit 131 or the state identification unit 132, the display instruction determination unit 134 reads the communication information associated with the identification result from the display instruction storage unit 142, and performs communication. The data is transmitted to the outside (server 3) via the unit 15.

The communication unit 15 is a communication device for transmitting / receiving information to / from the outside of the tablet terminal 1. Specifically, the communication unit 15 transmits to the server 3 communication information indicating processing for a communication image for communicating with other users.

(Identification of communication information by input operation)
Next, with reference to FIG. 4 and FIG. 5, the detail of input operation by the touch panel 11 of the tablet terminal 1 is demonstrated. FIG. 4 is a schematic diagram illustrating an example of an image (tablet display image) displayed on the touch panel 11 (display unit 112).

(A) of FIG. 4 is a diagram showing a communication tab 50 displayed when a user tries to communicate with another user while browsing the content displayed on the television 2. The communication tab 50 includes a message input area 51, an avatar & pointer operation area 52, and a fixed phrase input area 53. 4A is an example, and the communication tab 50 is not limited to the configuration of FIG.

The message input area 51 is an area for inputting a message 75 shown in FIG. The message input area 51 includes a text input area 511 and a send button 512. Thereby, for example, the input specifying unit 131 specifies an input operation for inputting a word that the user wants the avatar 73 to speak to the text input area 511. Then, the tablet display control unit 133 receives the instruction from the input specifying unit 131 and causes the display unit 112 to display the words input by the user. In addition, the input specifying unit 131 specifies an input operation for tapping the transmission button 512. In response to the instruction from the input specifying unit 131, the display instruction determining unit 134 specifies communication information for displaying the utterance 75 including the word input in the text input area 511, and the server via the communication unit 15 3 to send. In other words, when the user inputs a character in the text input area 511 and performs a tap operation on the send button 512, the avatar 73 displayed on the television 2 speaks the input character (for example, the avatar in FIG. 5). Like 73b, the utterance 75 is displayed in the vicinity of the avatar 73).

The avatar & pointer operation area 52 is an area for operating the avatar 73 and the pointer 74 shown in FIG. The avatar & pointer operation area 52 includes an avatar & pointer movement area 521 and an avatar action area 522. Thereby, for example, the input specifying unit 131 specifies the user's drag operation in the avatar & pointer movement area 521. The display instruction determining unit 134 receives the instruction from the input specifying unit 131, specifies communication information for displaying the pointer 74 on the television 2, and transmits the communication information to the server 3 via the communication unit 15. In addition, for example, after specifying and transmitting communication information for displaying the pointer 74, when the input specifying unit 131 specifies the user's drag operation in the avatar & pointer moving area 521, the display instruction determining unit 134 specifies the input In response to an instruction from the unit 131, communication information for moving the pointer 74 to the television 2 in accordance with the drag operation is specified and transmitted to the server 3 via the communication unit 15. In other words, the pointer 74 is displayed on the television 2 when the user performs a drag operation in the avatar & pointer movement area 521. In this state, when the user further performs a drag operation in the avatar & pointer movement area 521, the pointer 74 displayed on the television 2 moves.

Thereby, the user can point an arbitrary position on the screen of the television 2 with the pointer 74. For example, when the user wants to ask other users about the contents in the content 71, the pointer 74 is moved to an arbitrary position in the content 71 and the avatar 73 says “What is this?” 74 can be used as an aid to let other users understand the intention of the speech.

It should be noted that the display instruction determination unit 134 does not perform an input operation for operating the pointer 74 for a predetermined time (for example, about 15 seconds) on the touch panel 11 (input unit 111). Communication information for deleting the pointer 74 from the screen of the television 2 when no instruction for changing the display of the pointer 74 for a predetermined time is received from the unit 131 may be specified.

In addition, for example, after specifying and transmitting communication information for displaying the pointer 74, when the input specifying unit 131 specifies the user's tap operation in the avatar & pointer moving area 521, the display instruction determining unit 134 specifies the input. In response to an instruction from the unit 131, the communication information for moving the user's own avatar 73 to the position indicated by the pointer 74 is specified and transmitted to the server 3 via the communication unit 15. In other words, when the user performs a tap operation in the avatar & pointer movement area 521 while the pointer 74 is displayed on the television 2, the user's own avatar 73 moves to the position indicated by the pointer 74. In the present embodiment, the area where the avatar 73 can move is limited to the communication area 72 shown in FIG. Therefore, even when the tap operation is executed in the avatar & pointer movement area 521 with the pointer 74 other than the communication area 72, the avatar 73 does not move to the position indicated by the pointer 74. Specifically, when the server 3 receives communication information for moving the avatar 73, it is specified whether or not the pointer 74 is in the communication area 72. If the pointer 74 is not in the communication area 72, the process indicated by the received communication information (the process of moving the avatar 73 to the position indicated by the pointer 74) is not executed, and the process ends.

In addition, the avatar & pointer movement area 521 and the communication area 72 may be associated with each other. That is, the input specifying unit 131 specifies the user's tap operation in the avatar & pointer movement area 521. In response to the instruction from the input specifying unit 131, the display instruction determining unit 134 specifies communication information for moving the avatar 73 to the position of the communication area 72 associated with the position where the tap operation has been performed. Via the server 3. Thereby, the user can move the position of the avatar 73 without displaying the pointer 74 only by performing a tap operation on the avatar & pointer movement area 521.

Also, for example, the input specifying unit 131 specifies a tap operation for each button in the avatar operation area 522. Then, the display instruction determination unit 134 receives the instruction from the input specifying unit 131 and performs communication for causing the avatar 73 to perform an operation (for example, “jump”, “dancing”, etc.) according to the tapped button. Information is specified and transmitted to the server 3 via the communication unit 15. In other words, when the user performs a tap operation on the button in the avatar operation area 522, the avatar 73 displayed on the television 2 performs an operation corresponding to the button on which the tap operation is performed.

The fixed phrase input area 53 includes a fixed sentence button area 531. Thereby, for example, the input specifying unit 131 specifies a tap operation for each button in the fixed sentence button area 531. Then, the display instruction determination unit 134 receives an instruction from the input specifying unit 131, specifies communication information for causing the avatar 73 to execute a speech according to the tapped button, and the server 3 through the communication unit 15. Send to. In other words, when the user performs a tap operation on the button in the fixed sentence button area 531, the avatar 73 displayed on the television 2 speaks a character corresponding to the tapped button.

FIG. 4B is a diagram showing a content change tab 60 displayed when the user wants to change the content displayed on the television 2. The content change tab 60 includes a content change area 61. FIG. 4B is an example, and the content change tab 60 is not limited to the configuration of FIG. In FIG. 4B, the content is described as a video such as a television program. However, the content is not limited to a video and may be an image such as a browser or a photo.

The input specifying unit 131 specifies an input operation for displaying the content change tab 60 (for example, a tap operation to an area where “change channel” in FIG. 4 is displayed). And the display instruction | indication determination part 134 specifies the communication information for changing the display of the avatar 73 so that it may show that the user displayed the content change tab 60 in response to the instruction | indication from the input specific | specification part 131, and communication It transmits to the server 3 via the unit 15. In other words, when the user performs a tap operation for displaying the content change tab 60, the display of the avatar 73 displayed on the television 2 is changed (for example, in the vicinity of the avatar 73c as shown in FIG. 5). Appears on the remote control). Thereby, the user can inform other users that the content being viewed is being changed. Note that the image indicating the change of the content is not limited to an image in which the remote controller is displayed in the vicinity of the avatar 73 illustrated in FIG. In other words, any image may be used as long as the user is about to change the content.

The content change area 61 includes a content button area 611. Thereby, for example, the input specifying unit 131 specifies a tap operation for each button in the content button area 611. The display instruction determining unit 134 receives the instruction from the input specifying unit 131, specifies communication information for displaying the content corresponding to the tapped button on the television 2, and the server 3 through the communication unit 15. Send to. In other words, the user can change the content that he / she browses by performing a tap operation on the button in the content button area 611.

Note that the content change area 61 may include a search word input area (not shown) for searching for content. Thereby, the user can search for the desired content by inputting a word related to the content in the search word input area. Specifically, when the input specifying unit 131 specifies an input operation (input of the search word) to the search word input area, the input specifying unit 131 instructs the search unit (not shown) to search for content highly relevant to the search word. To do. The searchable content is not particularly limited, and includes content in the tablet terminal 1, content in the server 3, and content that can be acquired via the Internet (for example, a video posted on a video posting site). It is done. The search result is displayed on the display unit 112 by the tablet display control unit 133. For example, the search result is displayed on the display unit 112 so as to be selectable by the user, and the user can select content corresponding to the search result by performing an input operation (for example, a tap operation) on the search result. .

(Identification of communication information by acquiring status)
Next, with reference to FIGS. 6 to 8, details of the input operation by acquiring the tablet terminal 1 and the surrounding state of the tablet terminal 1 will be described. FIG. 6 is a schematic diagram illustrating the acquisition of the state by the geomagnetic sensor 126 and the display change of the avatar due to the acquisition of the state. FIG. 7 is a schematic diagram illustrating the acquisition of the state by the illuminance sensor 122 and the display change of the avatar. FIG. 8 is a schematic diagram showing a state acquisition by the position information acquisition unit 123 and a display change of the avatar.

First, an input operation using the result of state acquisition by the geomagnetic sensor 126 will be described. As shown in FIG. 6A, the user A participates in the collaborative browsing system 100 without holding the tablet terminal 1a. On the other hand, the user B participates in the collaborative browsing system 100 while holding the tablet terminal 1b. Note that user A's avatar is avatar 73a and user B's avatar is avatar 73b. The avatar 73c is an avatar of the user of the tablet terminal 1c included in a subsystem (not shown in FIG. 6A) different from the tablet terminal 1a and the tablet terminal 1b.

The state specifying unit 132 included in the tablet terminal 1a and the tablet terminal 1b specifies whether or not the tablet terminal 1a and the tablet terminal 1b are gripped from the orientation and inclination of the tablet terminal 1 acquired by the geomagnetic sensor 126. . In the case of FIG. 6, the state specifying unit 132 of the tablet terminal 1a specifies that the tablet terminal 1a is not gripped. Then, the display instruction determination unit 134 specifies communication information for displaying the avatar 73 a so as to indicate a state where the tablet terminal 1 a is not held, and transmits the communication information to the server 3 via the communication unit 15. Then, the server 3 generates an image to be displayed on the television 2 based on the received communication information, and transmits the image to the television 2. As a result, the image is displayed on the television 2. Specifically, as shown in FIG. 6B, an image in which both hands of the avatar 73a are lowered is displayed on the television 2. Thereby, the user participating in the collaborative browsing system 100 can know that the user of the avatar 73a does not hold the tablet terminal 1.

On the other hand, the state specifying unit 132 of the tablet terminal 1b specifies that the tablet terminal 1b is held. Then, the display instruction determination unit 134 specifies communication information for displaying the avatar 73b so as to indicate a state where the tablet terminal 1b is held, and transmits the communication information to the server 3 via the communication unit 15. The subsequent processing of the server 3 and the television 2 is the same as the processing in the tablet terminal 1a described above. As a result, as shown in FIG. 6B, an image in which both hands of the avatar 73b are raised is displayed on the television 2. Thereby, the user participating in the collaborative browsing system 100 can know that the user of the avatar 73b is holding the tablet terminal 1.

From the above, the user participating in the collaborative browsing system 100 can know that it is possible to communicate with the user B. That is, the user B can notify other users that his / her confidence can be communicated without performing a conscious input operation using the tablet terminal 1.

Note that the display of the avatar 73 indicating whether or not the tablet terminal 1 is being held is not limited to the example of FIG. That is, the display of the avatar 73 should just be a display which can distinguish whether the tablet terminal 1 is hold | gripped. For example, when the tablet terminal 1 is gripped, the display may be such that the avatar 73 dances.

Further, the state specifying unit 132 may specify whether or not the tablet terminal 1 is gripped from the acceleration acquired by the acceleration sensor 121.

Next, an input operation using the result of state acquisition by the illuminance sensor 122 will be described. As shown in (a) of FIG. 7, the user C participates in the collaborative browsing system 100 without holding the tablet terminal 1. Furthermore, the user C participates in the collaborative browsing system 100 with his / her room darkened. The avatar of user C is avatar 73c.

The state specifying unit 132 provided in the tablet terminal 1c specifies whether or not the illuminance around the tablet terminal 1c exceeds a predetermined value from the illuminance acquired by the illuminance sensor 122. In the case of FIG. 7, the state specifying unit 132 of the tablet terminal 1c specifies that the illuminance around the tablet terminal 1c does not exceed a predetermined value. Then, the display instruction determination unit 134 specifies communication information for displaying the avatar 73c and transmits the communication information to the server 3 via the communication unit 15 so as to indicate that the periphery of the tablet terminal 1c is in a dark state. The subsequent processing of the server 3 and the television 2 is the same as the processing in the tablet terminal 1a described above. As a result, an image as if the avatar 73c is sleeping is displayed on the television 2 as shown in FIG. Thereby, the user participating in the collaborative browsing system 100 can know that the surroundings of the user of the avatar 73c are dark.

In addition, the display of the avatar 73 which shows that the circumference | surroundings of the tablet terminal 1 are dark is not limited to the example of (b) of FIG. That is, the display of the avatar 73 should just be a display which can distinguish whether the circumference | surroundings of the tablet terminal 1 are dark. For example, a predetermined area around the avatar 73 may be darkened.

Next, an input operation using the result of state acquisition by the position information acquisition unit 123 will be described. Assume that the positional relationship between the user A and the user B and the television 2a and the positional relationship between the user C and the television 2b are as shown in FIGS. 6A and 7A, respectively.

The state specifying unit 132 specifies the positional relationship between the tablet terminal 1 and the television 2 based on the position information of the tablet terminal 1 acquired by the position information acquiring unit 123. For example, the tablet terminal 1a and the tablet terminal 1b specify the positional relationship with the television 2a. Then, the display instruction determination unit 134 specifies communication information for displaying the avatar 73 so that the positional relationship between the tablet terminal 1 and the television 2 is reflected in the positional relationship between the avatar 73 and the content 71, and communication. It transmits to the server 3 via the unit 15. The server 3 generates an image in which each avatar 73 is placed in the communication area 72 based on the communication information transmitted from each tablet terminal 1. That is, each avatar 73 is arranged in the communication area 72 so that the positional relationship between each tablet terminal 1 and the television 2 in the same subsystem 101 is reflected in the positional relationship between each avatar 73 and the content 71. Then, the generated image is transmitted to the television 2. As a result, an image as shown in FIG. Thereby, the user participating in the collaborative browsing system 100 can know where each user is with respect to the television 2.

In addition, the display reflecting the position of the tablet terminal 1 with respect to the television 2 is not limited to the example of (a) of FIG. For example, as shown in FIG. 8B, the display may reflect the position of the tablet terminal 1 with respect to the television 2 in the divided area 76 obtained by dividing the communication area 72 for each subsystem 101. Thereby, the user participating in the collaborative browsing system 100 can know which user is included in which subsystem 101.

Note that the input operation by acquiring the state is not limited to the examples of FIGS. That is, the state specifying unit 132 specifies the state as described in (Configuration of the tablet terminal), and the display instruction determining unit 134 sends communication information corresponding to the specified state via the communication unit 15 to the server 3. May be sent to.

For example, when the user of the tablet terminal 1 is not shown in the image (video) captured by the camera 124, the server 3 may leave the user's avatar 73. Here, “exit” indicates that the user's avatar 73 is deleted from the image displayed on the television 2. In the following, “exit” is used in this sense.

In addition, when the state specifying unit 132 specifies that music is sounding around the tablet terminal 1 from the sound acquired by the microphone 125, the server 3 displays a note around the avatar 73 of the user of the tablet terminal 1. May be. Further, when the tablet terminal 1 is outdoors from the voice acquired by the microphone 125, the server 3 may change the periphery of the user's avatar 73 of the tablet terminal 1 to indicate the outdoors.

Further, the state specifying unit 132 may specify whether or not the volume of the sound acquired by the microphone 125 is greater than a predetermined value. And when the volume of the acquired audio | voice is larger than a predetermined value, the server 3 may change the display of the user's avatar 73 of the tablet terminal 1 so that the avatar 73 is jumping. Further, the state specifying unit 132 may specify whether or not the volume of the acquired sound exceeds a plurality of preset threshold values. The server 3 may change the height of the jump of the avatar 73 stepwise according to the exceeded threshold.

Further, when the state specifying unit 132 specifies that the user is shaking the tablet terminal 1 from the orientation and inclination of the tablet terminal 1 acquired by the geomagnetic sensor 126, the server 3 determines that the user of the tablet terminal 1 is an avatar. The display of 73 may be changed so that the avatar 73 is jumping.

Further, the state specifying unit 132 is placed on a table, a floor, or the like so that the surface having the touch panel 11 of the tablet terminal 1 is closest to the ground based on the orientation and inclination of the tablet terminal 1 acquired by the geomagnetic sensor 126. If it is specified that the user is a user, the server 3 may leave the avatar 73 of the user of the tablet terminal 1.

Further, when the state specifying unit 132 specifies that the tablet terminal 1 and the television 2 are separated by a predetermined distance or more from the position information of the tablet terminal 1 acquired by the position information acquiring unit 123, the server 3 determines that the tablet terminal 1 The user's avatar 73 may be withdrawn.

(Tablet processing flow)
Next, the flow of processing executed by the tablet terminal 1 will be described with reference to FIG. FIG. 9 is a flowchart illustrating an example of a flow of processing executed by the tablet terminal 1.

When the touch panel 11 (input unit 111) receives an input operation (YES in S1), the input specifying unit 131 specifies the input operation (S2). And the input specific | specification part 131 specifies whether the specified input operation is an input operation for performing the display process with respect to the television 2 (S3). When the identified input operation is identified as an input operation for performing a display process on the television 2 (YES in S3), the input identifying unit 131 instructs a process to be executed by the display instruction determining unit 134. For example, when the input specifying unit 131 specifies that any one of the buttons in the fixed sentence button area 531 illustrated in FIG. 4 has been tapped, the display instruction determining unit specifies the communication information corresponding to the operation. 134 is instructed.

In response to the instruction from the input specifying unit 131, the display instruction determining unit 134 specifies communication information (S4). Specifically, the communication information associated with the input operation specified by the input specifying unit 131 is read from the display instruction storage unit 142. For example, the communication information for displaying the word indicated by the button in the fixed sentence button area 531 that has been tapped is read from the display instruction storage unit 142 in the vicinity of the avatar 73. Then, the display instruction determination unit 134 transmits the specified communication information to the server 3 via the communication unit 15 (S5).

On the other hand, when the input specifying unit 131 specifies that the input operation is not an input operation for performing a display process on the television 2 (NO in S3), the input specifying unit 131 is an input operation for performing a display process on the tablet terminal 1. It is specified that there is (S6). And the input specific | specification part 131 instruct | indicates the process which the tablet display control part 133 performs. For example, when the input specifying unit 131 specifies a text input operation to the text input area 511 illustrated in FIG. 4, the tablet display control unit 133 is instructed to display characters corresponding to the operation in the text input area 511. To do.

The tablet display control unit 133 receives the instruction from the input specifying unit 131, executes processing based on the instruction, and displays the execution result (S7). Specifically, the tablet display control unit 133 reads image data from the display image storage unit 141 and generates a tablet display image to be displayed on the display unit 112. For example, a tablet display image in which characters input by the user are displayed in the text input area 511 is generated and displayed on the display unit 112.

Next, when the state specifying unit 132 specifies the state of the own device or the surrounding state from the specifying information for specifying the own device or the surrounding state of the own device acquired by the state acquiring unit 12 (in S8) YES, state specifying step), instructing the display instruction determining unit 134 to specify communication information corresponding to the specified state. For example, from the orientation and inclination of the tablet terminal 1 acquired by the geomagnetic sensor 126 included in the state acquisition unit 12, the state specifying unit 132 is obtained when the user holds the tablet terminal 1. It is specified whether or not it is within the range of the estimated direction and inclination. And when specifying that it is in the range of the direction and inclination estimated to be obtained when the user is holding the tablet terminal 1, communication information corresponding to the state where the user is holding the tablet terminal 1 is displayed. The display instruction determination unit 134 is instructed to specify.

The display instruction determining unit 134 receives the instruction from the state specifying unit 132 and specifies communication information (S9, communication information specifying step). Specifically, communication information associated with the state specified by the state specifying unit is read from the display instruction storage unit 142. For example, communication information for displaying the avatar 73 as a display indicating that the user is holding the tablet terminal 1 is read from the display instruction storage unit 142. Then, the display instruction determination unit 134 transmits the specified communication information to the server 3 via the communication unit 15 (S10).

In steps S8 to S10, if the state of the own device or the surrounding state is not specified for a predetermined time, the communication information corresponding to the fact that the state of the own device or the surrounding state is not specified is specified. Then, it may be transmitted to the server 3. That is, the state acquisition unit 12 further includes a timer (not shown), and when the timer measures a predetermined time, when the state of the device itself or the surrounding state is not specified, the state acquisition unit 12 indicates that fact. The specific information is supplied to the state specifying unit 132. The state specifying unit 132 instructs the display instruction determining unit 134 to specify communication information corresponding to the fact that the state of the device itself or the surrounding state is not specified. The display instruction determination unit 134 receives the instruction from the state specifying unit 132 and specifies communication information. For example, communication information for making the avatar 73 translucently displayed is specified and transmitted to the server 3 via the communication unit 15. Thereby, when the state of the own apparatus or the surrounding state is not specified for a predetermined time, the avatar 73 displayed on the television 2 is displayed translucently.

(Operational effects of the invention according to Embodiment 1)
As described above, in the collaborative browsing system 100, the tablet terminal 1 according to the first embodiment performs not only the input operation by the user but also the self-operation in order to execute the process for the communication image (for example, the avatar) displayed on the television 2. Communication information is specified based on the state of the device or the surroundings of the device itself. For example, it is determined whether or not the user is gripping the user's own device based on the orientation and inclination of the user's own device specified by the geomagnetic sensor 126. Identify communication information that indicates

Thereby, even if the user does not perform a conscious input operation, the communication information specified based on the own device or the surrounding state of the own device is transmitted to the outside, and the processing on the communication image is executed. That is, even if the user does not perform a conscious input operation, other users can grasp the state of the user by looking at the communication image. In addition, since the user can execute processing on the communication image without performing a conscious input operation, the user is not distracted by the input operation and browsing of content is not neglected. As described above, the user can enjoy browsing the content and communicating with other users at the same time.

Further, when communication is specified based on an input operation by the user, communication information corresponding to the input operation on the user interface displayed on the touch panel 11 (display unit 112) can be specified. For example, the tap operation on the button arranged in the fixed sentence button area 531 is specified, and the communication information for causing the avatar to execute a speech according to the button that has been tapped is specified.

This allows the user to execute processing on the communication image simply by performing an input operation on the user interface. That is, the process for the communication image can be executed by a simple operation. Therefore, the user can enjoy browsing the content and communicating with other users at the same time because the user is not distracted by the input operation.

Furthermore, since voice is not used in communication with other users, it is possible to prevent a situation in which other users' speech cannot be heard. In addition, since the user can concentrate the hearing on the sound emitted from the content, the user can easily understand the content (particularly video content) while communicating.

Further, as shown in FIG. 5, in the collaborative browsing system 100 according to the present invention, a communication image (avatar 73) is displayed around the content 71. Thereby, even if a user moves a line of sight to one of the content 71 and the avatar 73, the other enters the field of view, and thus it is easy to grasp both contents. Therefore, it is possible to prevent a state in which any browsing is neglected.

In the present embodiment, since the avatar 73 is used as a communication image, information that the user does not want to be seen by other users, such as video communication (for example, video chat) (your face, the state of the room, etc.) There is an advantage that is not displayed. In addition, although the image of the own face may be displayed, when the state of the room is not desired to be displayed, the camera 124 (FIG. 2) of the tablet terminal 1 is placed on the face portion of the avatar 73 as described above. You may paste the photograph image | photographed using.

(Modification 1 of Embodiment 1)
Next, a modification of the first embodiment will be described with reference to FIG. FIG. 10 is a schematic diagram illustrating an example of an image (tablet display image) displayed on the touch panel 11 (display unit 12).

As shown in FIG. 10A, the fixed phrase input area 53 may include a emotion input area 532 instead of the fixed sentence button area 531 described in the first embodiment. The emotion input area 532 includes a straight line in which opposite words such as “good-bad” are written at both ends, and one or more sliders that accept the user's drag operation and move along the straight line. Thereby, the input specifying unit 131 specifies a drag operation on the slider of the emotion input area 532. Then, the display instruction determining unit 134 receives the instruction from the input specifying unit 131, specifies communication information for causing the avatar 73 to speak a fixed phrase corresponding to the position of the slider, and causes the server 3 to communicate via the communication unit 15. Send. In other words, the user moves the slider to a position representing his / her feelings by performing a drag operation on the slider. Thereby, the avatar 73 displayed on the television 2 speaks a fixed phrase that matches his / her feelings. That is, the user can convey his / her feelings to other users without directly inputting text. It should be noted that the antonyms written at both ends of the straight line are not limited to the example shown in FIG.

Further, as shown in FIG. 10B, the fixed phrase input area 53 may include a mental input area 533. The emotion input area 533 may be a two-dimensional area in which opposite words such as “good-bad” and “joyful-bad” are arranged at both ends of the vertical axis and the horizontal axis. Thereby, for example, the input specifying unit 131 specifies a tap operation on the emotion input area 533. Then, in response to the instruction from the input specifying unit 131, the display instruction determining unit 134 specifies communication information for causing the avatar 73 to speak a fixed phrase corresponding to the tapped position of the emotion input area 533, and the communication unit 15 To the server 3 via. In other words, the user performs a tap operation on a position close to his / her feeling in the feeling input area 533. Thereby, the avatar 73 displayed on the television 2 speaks a fixed phrase that matches his / her feelings.

(Modification 2 of Embodiment 1)
Next, another modification of the first embodiment will be described with reference to FIG. FIG. 11 is a schematic diagram illustrating an example of an image (display image) displayed on the television 2.

Unlike the display image of the first embodiment, the display image of this modification includes a divided area 77 obtained by dividing the communication area instead of the communication area 72. The divided area 77 is a general term for the divided area 77a, the divided area 77b, and the divided area 77c.

In this modification, the display position of the avatar 73 is changed according to how the user is browsing the content. Specifically, the server 3 determines whether or not the communication information transmitted from each tablet terminal 1 for displaying a message is communication information for displaying the message 75 for a specific user. And when the said communication information is communication information for displaying the message with respect to a specific user, in the display image, the message 75 which is a message with respect to a specific user is arrange | positioned in the vicinity of the user's avatar 73 which transmitted communication information. When the avatar 73 is not in the divided area 77a, the avatar 73 and the utterance 75 are moved to the divided area 77a.

On the other hand, when the communication information is not communication information for displaying a message for a specific user, the message 75 is arranged near the avatar 73 of the user who transmitted the communication information in the display image, and the avatar 73 is divided into regions. If it is not in 77b, the avatar 73 and the utterance 75 are moved to the divided area 77b.

Further, when communication information for displaying the remarks 75 is not received for a predetermined time from the tablet terminal 1, the avatar 73 of the user of the tablet terminal 1 is moved to the divided area 77 c in the display image.

That is, the divided area 77 can be expressed as follows. The divided area 77a is an area in which the avatar 73 of the user who is communicating with other users is arranged. The divided area 77b is an area where the avatar 73 of a user who is speaking (operating the tablet terminal 1 to display the statement 75) but is not communicating with other users is displayed. is there. The divided area 77c is an area in which an avatar of a user who is not operating the tablet terminal 1 is displayed.

Thereby, the user can easily specify whether or not other users can communicate with each other. For example, the user can recognize that there is a high possibility of actively communicating with the user in which the avatar 73 is arranged in the divided area 77a. On the other hand, it can be recognized that there is a low possibility of communication with the user in which the avatar 73 is arranged in the divided area 77c.

This configuration is suitable when a large number of users are viewing the same content, in other words, when a large number of avatars 73 are displayed in the display image.

(Modification 3 of Embodiment 1)
Next, still another modification of the first embodiment will be described with reference to FIGS. 1, 3, and 4. In the first embodiment, the fixed sentence button displayed in the fixed sentence button area 531 is configured to be generated based on the data read from the display image storage unit 141 by the tablet display control unit 133. On the other hand, in the present modification, the tablet display control unit 133 generates a fixed sentence button image based on data acquired from the outside via the communication unit 15.

Specifically, the server 3 identifies the content 71 displayed on the television 2. For example, when the content 71 is a television program, information such as the type of program and performers is specified. Then, the server 3 generates button generation information for generating a fixed sentence button based on the specified information, and transmits the button generation information to the tablet terminal 1. For example, button generation information for generating the name of the performer of the TV program as a fixed sentence button, or button generation information for generating “I understand!” Or the like as a fixed sentence button when the TV program is a quiz program Is transmitted to the tablet terminal 1.

The tablet display control unit 133 generates a tablet display image based on the received button generation information in addition to the data read from the display image storage unit 141. As a result, the user can cause the avatar 73 to speak a fixed sentence corresponding to the contents 71. Therefore, the user can communicate with the other users according to the contents 71 by a simple operation on the tablet terminal 1.

In addition, each modification mentioned above is applicable also in each embodiment mentioned later.

[Embodiment 2]
Another embodiment of the present invention will be described with reference to FIG. FIG. 12 is a block diagram illustrating a main configuration of the tablet terminal 10. Note that the tablet terminal 10 is included in a subsystem as shown in FIG. 3, similarly to the tablet terminal 1 described in the first embodiment. That is, the tablet terminal 10 is connected to the server 3 through a router or the like so as to be able to communicate with each other.

The tablet terminal 10 according to the present embodiment operates the vibrator 16 based on information from the outside. Specifically, when the server 3 specifies that the user's avatar 73 of the tablet terminal 10 and another user's avatar 73 are arranged at the same position in the communication area 72 (or divided area 73, divided area 77). The collision information, which is information indicating that, is transmitted to the tablet terminal 10. The collision information is supplied to the notification operation control unit 135 via the communication unit 15. And the alerting | reporting operation | movement control part 135 will operate the vibrator 16, if collision information is supplied.

Further, the server 3 creates an image indicating that the avatars 73 arranged at the same position collide with each other, and transmits them to the television 2 to display them.

Thereby, the user can experience the vibration of the tablet terminal 10 at the same time as confirming that the avatars 73 collide with each other on the television 2. Therefore, the event in the image displayed on the television 2 can be realistically experienced.

[Embodiment 3]
The following will describe still another embodiment of the present invention. This embodiment demonstrates the structure which performs a text input with the audio | voice which the microphone 125 contained in the state acquisition part 12 acquired.

The message input area 51 shown in FIG. 4 further includes a voice input start button (not shown). When the input specifying unit 131 specifies a tap operation on the voice input start button, the input specifying unit 131 sets the voice information acquired by the microphone 125 to be output to the tablet display control unit 133. Then, the input specifying unit 131 outputs, to the tablet display control unit 133, the input voice until the input operation for ending the text input by voice (for example, the operation of tapping the voice input start button again) is specified. To do. The tablet display control unit 133 converts voice information input from the microphone 125 into text information and causes the display unit 112 to display the text information.

The input specifying unit 131 may be set so that the voice information acquired by the microphone 125 is not output to the state specifying unit 132 when the tap operation on the voice input start button is specified. As a result, while the voice input operation is being executed, the process for specifying the communication information by the voice acquired by the microphone 125 as described in the first embodiment is not executed. That is, when the user wants to perform an input operation by voice, another process (process for the communication image) is not executed. Therefore, it is possible to realize an input device that can appropriately execute the process desired by the user.

[Embodiment 4]
The following will describe still another embodiment of the present invention with reference to FIG. FIG. 13 is a diagram illustrating a configuration of the collaborative browsing system 200 in the present embodiment.

The collaborative browsing system 200 includes a subsystem 101c instead of the subsystem 101b included in the collaborative browsing system 100 shown in FIG. The subsystem 101c includes a smartphone 5 that can be connected to the Internet. That is, the smartphone 5 serves as both an input device and a display device. The block diagram showing the main configuration of the smartphone 5 is the same as the block diagram shown in FIG. 1, for example. However, the tablet display control unit 133 causes the display unit 112 to display the display image transmitted from the server 3 in addition to the tablet display image.

This allows the user to participate in the collaborative browsing system 200 even when the user is out. In the present embodiment, the sub-system 101c has been described as including the smartphone 5. However, the sub-system 101c is not limited to this as long as the user can participate in the collaborative browsing system 200 on the go. For example, the subsystem 101c may include a tablet terminal and a portable router.

[Example of software implementation]
The control blocks (particularly the input specifying unit 131, the state specifying unit 132, the tablet display control unit 133, and the display instruction determining unit 134) of the tablet terminal 1 and the tablet terminal 10 are logic circuits formed in an integrated circuit (IC chip) or the like. (Hardware) or software using a CPU (Central Processing Unit).

In the latter case, the tablet terminal 1 and the tablet terminal 10 include a CPU that executes instructions of a program, which is software that implements each function, and a ROM (Read CPU) in which the program and various data are recorded so as to be readable by the computer (or CPU). Only Memory) or a storage device (these are referred to as “recording media”), RAM (Random Access Memory) for expanding the program, and the like. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
The input device (tablet terminal 1) according to aspect 1 of the present invention is a communication for communicating with other users in a collaborative browsing system 100 that enables browsing and communication of content by a plurality of users via a communication network. An input device including a transmission unit (communication unit 15) for transmitting communication information indicating processing for an image, the state specifying unit 132 for specifying the own device or a surrounding state of the own device, and the specification result by the state specifying unit A communication information specifying unit (display instruction determining unit 134) that specifies the communication information associated with the communication information.

According to said structure, by specifying the communication information matched with the specific result by a state specific | specification part, the communication image for aiming at communication with another user according to the surrounding state of the own apparatus or the own apparatus It is possible to specify communication information indicating a process for.

Thus, even if the user does not perform a conscious input operation, communication information corresponding to the own device or the surrounding state of the own device is transmitted to the outside, and processing for the communication image is executed. That is, even if the user does not perform a conscious input operation, other users can grasp the state of the user by looking at the communication image. In addition, since the user can execute processing on the communication image without performing a conscious input operation, the user is not distracted by the input operation and browsing of content is not neglected. As described above, the user can enjoy browsing the content and communicating with other users at the same time.

The input device according to aspect 2 of the present invention further includes an acquisition unit (state acquisition unit 12) that acquires specific information for specifying the self device or a surrounding state of the self device in the above aspect 1, and the state specifying The unit may specify the own device or a surrounding state of the own device based on the identification information acquired by the acquisition unit.

According to the above configuration, since the input device includes the acquisition unit that acquires the identification information for identifying the device or the surrounding state of the device, the input device identifies the device or the surrounding state of the device. Specific information can be acquired only by the configuration of the device itself.

In the input device according to aspect 3 of the present invention, in the above aspect 2, the acquisition unit includes an acceleration acquisition unit (acceleration sensor 121) that acquires acceleration generated in the device, and an illuminance acquisition unit that acquires illuminance around the device. (Illuminance sensor 122), position information acquisition unit 123 for acquiring position information of the own device, an imaging unit (camera 124) for photographing the surroundings of the own device, and an audio acquisition unit (microphone 125) for acquiring sounds around the own device , And a direction / tilt acquisition unit that acquires the orientation and inclination of the device itself, and the state specifying unit includes the acceleration acquisition unit, the illuminance acquisition unit, the position information acquisition unit, Based on the identification information acquired by at least one of the photographing unit, the sound acquisition unit, and the direction / tilt acquisition unit, the device itself or the surrounding state of the device may be specified.

According to the above configuration, among the acceleration generated in the own device, the illuminance around the own device, the position information of the own device, the image taken around the own device, the sound around the own device, the orientation and the tilt of the own device, Communication information based on at least one of them is specified. Therefore, since communication information according to various own devices or the surrounding conditions of the own device is specified, other users can specify various states of the user using the input device according to the present invention. it can.

In the input device according to aspect 4 of the present invention, in the above aspect 3, the communication information specifying unit is configured such that the state specifying unit is configured so that the user himself / herself from the orientation and inclination of the own device acquired by the direction / tilt acquisition unit. The communication information indicating that the user is holding his / her device may be specified.

According to the above configuration, when it is specified that the user is holding the own device from the direction and inclination of the own device, the communication information indicating that the user is holding the device is specified. Thereby, the other user can recognize that the user of the input device according to the present invention is browsing the content while holding the input device.

That is, since the other user can recognize that the user of the input device according to the present invention can execute an input operation to the input device, the other user can communicate with the user. It can be recognized that there is.

In the input device according to aspect 5 of the present invention, in the aspect 3, the communication information specifying unit is configured so that the user specifies his / her own device from the acceleration generated in the own device acquired by the acceleration acquiring unit. When it is specified that the user is holding, the communication information indicating that the user is holding the device may be specified.

According to the above configuration, when it is determined from the acceleration generated in the own device that the user is holding the own device, the communication information indicating that the user is holding is specified. Thereby, the other user can recognize that the user of the input device according to the present invention is browsing the content while holding the input device.

That is, since the other user can recognize that the user of the input device according to the present invention can execute an input operation to the input device, the other user can communicate with the user. It can be recognized that there is.

In the input device according to aspect 6 of the present invention, in any of the above aspects 3 to 5, the communication information specifying unit is configured such that the state specifying unit has an illuminance around the own device acquired by the illuminance acquiring unit. When the predetermined value is not exceeded, the communication information indicating that the surrounding of the user is dark may be specified.

According to the above configuration, when it is specified that the illuminance around the device does not exceed a predetermined value, the communication information indicating that the user is dark is specified. Thereby, other users can recognize that the circumference of the user of the input device concerning the present invention is dark. Therefore, other users can determine whether or not communication with the user is possible.

In the input device according to aspect 7 of the present invention, in any one of the above aspects 3 to 6, the communication image is an image for uniquely identifying a user, and the state specifying unit includes the position information acquisition unit. Identifies the positional relationship between the display device (TV 2) that displays the content and the communication image and the device itself based on the location information of the device acquired by the device, and the state identification unit identifies the communication information identification unit. The communication information for reflecting the positional relationship between the display device and the device itself to the positional relationship between the content displayed on the display device and the communication image may be specified.

According to the above configuration, the positional relationship between the own device and the display device is reflected in the positional relationship between the communication image displayed on the display device and the content. Thereby, another user can recognize where the user of the input device according to the present invention is located with respect to the display device used by the user.

An input device according to aspect 8 of the present invention is the display unit according to any one of aspects 1 to 7, wherein the display unit displays an input unit 111 that receives an input operation by a user and one or more user interfaces for receiving the input operation. 112 and an input specifying unit 131 for specifying an input operation accepted by the input unit, wherein the input specifying unit specifies an input operation for the user interface displayed on the display unit, and specifies the communication information The unit may specify the communication information associated with the input operation specified by the input specifying unit for the user interface.

According to the above configuration, the communication operation associated with the input operation is specified by specifying the input operation for the user interface displayed on the display unit. Thus, the user can execute processing on the communication image only by performing an input operation on the user interface. That is, the process for the communication image can be executed by a simple operation. Therefore, the user can enjoy browsing the content and communicating with other users at the same time because the user is not distracted by the input operation.

The input device according to aspect 9 of the present invention is the input apparatus according to aspect 8, wherein the input operation is an input operation for changing the content, and the communication information specifying unit specifies the content specified by the input specifying unit. The communication information associated with the input operation for changing may be specified.

According to the above configuration, when an input operation for changing content is specified, communication information associated with the input operation for changing content is specified. Thereby, the other user can recognize that the user of the input device according to the present invention intends to change the content. Therefore, it is possible to achieve communication suitable for the state where the content is to be changed.

The input device according to aspect 10 of the present invention further includes a display content determination unit (tablet display control unit 133) that determines the user interface to be displayed on the display unit in the above aspect 8, wherein the display content determination unit includes: You may determine the said user interface displayed on the said display part according to the content of the said content.

According to the above configuration, the user interface displayed on the display unit is determined according to the content. That is, when the content is changed, the user interface is also changed. This makes it possible to achieve a variety of communication while using the user interface.

A communication information specifying method using an input device according to an aspect 11 of the present invention is for communicating with other users in a collaborative browsing system that enables browsing and communication of content by a plurality of users via a communication network. A communication information specifying method using an input device including a transmission unit that transmits communication information indicating processing for the communication image of the device, and a state specifying step (step S8) for specifying the own device or a surrounding state of the own device; A communication information specifying step (step S9) for specifying the communication information associated with the specifying result in the state specifying step.

The operational effect of the above configuration is the same as that of the above-described aspect 1.

The processing device (server 3) according to aspect 12 of the present invention executes processing on a communication image according to the communication information transmitted from the input device according to any one of aspects 1 to 10, and You may transmit the said communication image by which the process was performed to the display apparatus (TV 2) which displays the said communication image.

According to the above configuration, since the processing on the communication image is executed in the processing device, the processing load on the input device and the display device can be reduced.

The display device (TV 2) according to aspect 13 of the present invention may display the communication image transmitted from the processing device according to aspect 12 together with the content.

According to the above configuration, since the display device displays the transmitted communication image together with the content, no special function is required. Therefore, a general television or display can be used as the display device of the present invention.

The processing device (server 3) according to the fourteenth aspect of the present invention provides an instruction for executing processing on the communication image according to the communication information transmitted from the input device according to any one of the first to tenth aspects. Information may be transmitted to the display device (television 2) that displays the content and the communication image.

According to the above configuration, since the instruction information corresponding to the communication information is transmitted to the display device, the processing for the communication image is not executed. Therefore, the processing load of the processing device can be reduced.

The display device (television 2) according to aspect 15 of the present invention performs processing on a communication image in accordance with the instruction information transmitted from the processing device according to aspect 14, and the communication image on which the processing has been executed. May be displayed together with the content.

According to the above configuration, since the processing for the communication image is executed in the display device, a large amount of information such as a communication image is not transmitted from the processing device. Therefore, information can be exchanged smoothly between apparatuses.

The input device according to each aspect of the present invention may be realized by a computer. In this case, the input device is operated by the computer by causing the computer to operate as each unit (limited to software elements) included in the input device. An input device control program to be realized and a computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

The present invention provides an input for receiving an input operation for executing processing on a communication image for communication with other users in a collaborative browsing system that enables browsing and communication of content by a plurality of users via a communication network. Can be used in the device. Specifically, it can be suitably used for tablet terminals, smartphones, and the like.

1 Tablet terminal (input device)
2 Television (display device)
12 Status acquisition unit (acquisition unit)
15 Communication unit (transmission unit)
100 collaborative browsing system 111 input unit 112 display unit 121 acceleration sensor (acceleration acquisition unit)
122 Illuminance sensor (illuminance acquisition unit)
123 Position information acquisition unit 124 Camera (shooting unit)
125 microphone (voice acquisition unit)
126 Geomagnetic sensor (direction / tilt acquisition unit)
131 Input specifying unit 132 State specifying unit 133 Tablet display control unit (display content determining unit)
134 Display instruction determining unit (communication information specifying unit)
S8 State identification step S9 Communication information identification step

Claims (16)

1. In a collaborative browsing system that enables browsing and communication of content by a plurality of users via a communication network, an input device including a transmission unit that transmits communication information indicating processing on a communication image for communication with other users There,
   A state identifying unit for identifying the own device or the surrounding state of the own device;
   An input device comprising: a communication information specifying unit that specifies the communication information associated with the specifying result by the state specifying unit.
2. It further includes an acquisition unit that acquires specific information for specifying the own device or the surrounding state of the own device,
   The input device according to claim 1, wherein the state specifying unit specifies the own device or a surrounding state of the own device based on the specifying information acquired by the acquiring unit.
3. The acquisition unit is an acceleration acquisition unit that acquires acceleration generated in the own device, an illuminance acquisition unit that acquires illuminance around the own device, a position information acquisition unit that acquires position information of the own device, and photographs the surroundings of the own device. Including at least one of a photographing unit, a sound acquisition unit that acquires sound around the device, and a direction / tilt acquisition unit that acquires the orientation and inclination of the device,
   The state specifying unit includes specific information acquired by at least one of the acceleration acquisition unit, the illuminance acquisition unit, the position information acquisition unit, the imaging unit, the sound acquisition unit, and the direction / tilt acquisition unit. The input device according to claim 2, wherein the input device or a surrounding state of the device is specified based on the input device.
4. The communication information specifying unit, when the state specifying unit specifies that the user is holding the own device from the acceleration generated in the own device acquired by the acceleration acquiring unit, The input device according to claim 3, wherein the communication information indicating that the information is present is specified.
5. The communication information specifying unit indicates that the surrounding of the user is dark when the state specifying unit specifies that the illuminance around the own device acquired by the illuminance acquiring unit does not exceed a predetermined value. 5. The input device according to claim 3, wherein communication information is specified.
6. The communication image is an image for identifying a user,
   The state specifying unit specifies a positional relationship between the display device that displays the content and the communication image and the own device based on the position information of the own device acquired by the position information acquisition unit,
   The communication information specifying unit is configured to reflect the positional relationship between the display device specified by the state specifying unit and the device itself to the positional relationship between the content displayed on the display device and the communication image. 6. The input device according to claim 3, wherein information is specified.
7. An input unit that receives an input operation by a user; a display unit that displays one or more user interfaces for receiving the input operation; and an input specifying unit that specifies an input operation received by the input unit;
   The input specifying unit specifies an input operation for the user interface displayed on the display unit,
   The said communication information specific | specification part specifies the said communication information matched with the input operation specified by the said input specific | specification part with respect to the said user interface, The any one of Claim 1 to 6 characterized by the above-mentioned. Input device.
8. The input operation is an input operation for changing the content,
   The input device according to claim 7, wherein the communication information specifying unit specifies the communication information associated with an input operation for changing the content specified by the input specifying unit.
9. A display content determination unit for determining the user interface to be displayed on the display unit;
   The input device according to claim 7, wherein the display content determination unit determines the user interface to be displayed on the display unit according to the content.
10. An input device including a transmission unit that transmits communication information indicating processing for a communication image for communicating with other users in a collaborative browsing system that enables browsing and communication of content by a plurality of users via a communication network A method for identifying communication information used,
    A state identifying step for identifying the own device or a surrounding state of the own device;
    A communication information specifying method using an input device, comprising: a communication information specifying step for specifying the communication information associated with the specifying result in the state specifying step.
11. A process for a communication image is executed according to the communication information transmitted from the input device according to any one of claims 1 to 9, and the process is executed on a display device that displays the content and the communication image. A processing apparatus for transmitting the communication image.
12. 12. A display device, wherein the communication image transmitted from the processing device according to claim 11 is displayed together with the content.
13. In response to the communication information transmitted from the input device according to any one of claims 1 to 9, instruction information for executing processing on a communication image is displayed on the display device that displays the content and the communication image. A processing device for transmitting.
14. 14. A display device, wherein processing is performed on a communication image in accordance with the instruction information transmitted from the processing device according to claim 13, and the communication image on which the processing has been performed is displayed together with the content.
15. A program for operating the input device according to claim 1, which causes a computer to function as the state specifying unit and the communication information specifying unit.
16. A computer-readable recording medium on which the program according to claim 15 is recorded.

Images