JP5974928B2 - Display control device, display device, display control method, and program - Google Patents

Description

  The present disclosure relates to a display control device, a display device, a display control method, and a program.

  For example, a head mounted display (hereinafter, sometimes referred to as “HMD”) having an operation device has been developed. As a technique regarding the HMD provided with the operation device, for example, a technique described in Patent Document 1 below can be cited.

JP 2011-249966 A

  For example, in a display device that is worn by a user such that the display surface is positioned in front of the user, such as an HMD, an operation device that can be operated by the user may be provided on the side of the worn user. Here, in the display device as described above, when the user operates the operation device, it is difficult for the user to perform the operation after visually recognizing the operation device. Therefore, in the display device as described above, for example, a change in display content displayed on the display surface as a result of an operation performed by itself (for example, movement of a display object, change of a display object selected by a cursor, etc.) However, there is a possibility that the operability of the user may be lowered due to the fact that the desired change is not achieved.

  Here, for example, when the technique described in Patent Document 1 is used, a guide display image for guiding the function of the operation device is displayed on the display surface. Therefore, for example, when the technique described in Patent Document 1 is used, if the user can perform an operation according to the guide display image, the user can perform a desired operation. Therefore, for example, when the technique described in Patent Document 1 is used, there is a possibility that a reduction in user operability can be prevented to some extent.

  However, as described above, in a display device in which an operation device is provided on the side of the user who wears it, it is difficult for the user to perform an operation after visually recognizing the operation device. Therefore, for example, even if the guide display image is displayed on the display surface as in the technique described in Patent Document 1, the user intuitively grasps the content indicated by the guide display image and the operation content for the operation device. It is not always possible. Therefore, even if the technique described in Patent Document 1 is used, for example, the above-described deterioration in user operability may occur.

  The present disclosure proposes a new and improved display control device, display device, display control method, and program capable of improving user operability.

  According to the present disclosure, display of a display object displayed on the display surface is controlled in a display device mounted on the user so that a display surface capable of displaying the display object is positioned in front of the user. A display control unit configured to move the display object based on an operation signal acquired in response to detection by an operation device provided at a position on the side surface of the user in the display device. There is provided a display control device for controlling the display of the display object such that the trajectory of the part shows a trajectory having a vertical component with respect to the display surface.

  Further, according to the present disclosure, the display unit has a display surface capable of displaying a display object, and when the user wears the display surface, the display unit is positioned in front of the user, and is attached to the user. An operation unit provided at a position on the side surface of the user, and a display control unit that controls display of a display object displayed on the display surface, wherein the display control unit is configured to operate the operation unit. The display of the display object is controlled so that at least a part of the trajectory for moving the display object shows a trajectory having a vertical component with respect to the display surface based on an operation signal acquired in response to A display device is provided.

  Further, according to the present disclosure, the display object displayed on the display surface is displayed on the display device mounted on the user so that a display surface capable of displaying the display object is positioned in front of the user. A step of controlling, and in the step of controlling, at least the display object is moved based on an operation signal acquired in response to detection by an operation device provided at a position on the side surface of the user in the display device. There is provided a display control method for controlling the display of the display object such that a part of the trajectory indicates a trajectory having a vertical component with respect to the display surface.

  Further, according to the present disclosure, the display object displayed on the display surface is displayed on the display device mounted on the user so that a display surface capable of displaying the display object is positioned in front of the user. The control step is executed by a computer, and in the control step, the display object is displayed on the basis of an operation signal acquired in response to detection by an operation device provided at a position on the side surface of the user in the display device. There is provided a program for controlling display of the display object such that at least a part of the trajectory to be moved indicates a trajectory having a vertical component with respect to the display surface.

  According to the present disclosure, it is possible to improve user operability.

It is explanatory drawing which shows an example of the display apparatus which concerns on this embodiment. It is explanatory drawing for demonstrating an example of the problem which may arise when a display surface is located in front of the user who mounted | worn and a display apparatus with which an operation device is provided in the side surface of the user who mounted | worn is used. It is explanatory drawing for demonstrating the 1st example of the display control process which concerns on this embodiment in the display control apparatus which concerns on this embodiment. It is explanatory drawing for demonstrating the 1st example of the display control process which concerns on this embodiment in the display control apparatus which concerns on this embodiment. It is explanatory drawing for demonstrating the 1st example of the display control process which concerns on this embodiment in the display control apparatus which concerns on this embodiment. It is explanatory drawing for demonstrating the 1st example of the display control process which concerns on this embodiment in the display control apparatus which concerns on this embodiment. It is explanatory drawing for demonstrating the 1st example of the display control process which concerns on this embodiment in the display control apparatus which concerns on this embodiment. It is explanatory drawing for demonstrating the 1st example of the display control process which concerns on this embodiment in the display control apparatus which concerns on this embodiment. It is explanatory drawing for demonstrating the 2nd example of the display control process which concerns on this embodiment in the display control apparatus which concerns on this embodiment. It is explanatory drawing for demonstrating the 2nd example of the display control process which concerns on this embodiment in the display control apparatus which concerns on this embodiment. It is explanatory drawing for demonstrating the 2nd example of the display control process which concerns on this embodiment in the display control apparatus which concerns on this embodiment. It is a block diagram which shows an example of a structure of the display control apparatus which concerns on this embodiment. It is explanatory drawing which shows an example of the hardware constitutions of the display control apparatus which concerns on this embodiment. It is explanatory drawing which shows an example of the display system which concerns on this embodiment. It is explanatory drawing which shows an example of the operation device in which the operation which concerns on the control of the display on the display surface of the display apparatus which concerns on this embodiment in a display system is possible. It is explanatory drawing which shows an example of operation using the operation device in the display system which concerns on this embodiment. It is explanatory drawing which shows an example of operation using the operation device in the display system which concerns on this embodiment. It is explanatory drawing which shows an example of operation using the operation device in the display system which concerns on this embodiment. It is explanatory drawing which shows an example of operation using the operation device in the display system which concerns on this embodiment. It is explanatory drawing which shows an example of operation using the operation device in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating an example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the display in the display system which concerns on this embodiment.

  Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

In the following, description will be given in the following order.
1. 1. Display control method according to this embodiment 2. Display control apparatus according to this embodiment 3. Program according to this embodiment Display system according to this embodiment

(Display control method according to this embodiment)
Before describing the configuration of the display control apparatus according to the present embodiment, first, the display control method according to the present embodiment will be described. Hereinafter, the display control method according to the present embodiment will be described by taking as an example a case where the display control apparatus according to the present embodiment performs processing related to the display control method according to the present embodiment.

[1] Example of display device according to this embodiment First, an example of the configuration of the display device according to this embodiment controlled by the display control device according to this embodiment by the processing according to the display control method according to this embodiment. Will be described. Note that the display control device according to the present embodiment and the display device according to the present embodiment may be separate devices or may be integrated devices, for example. When the display control device according to the present embodiment and the display device according to the present embodiment are an integrated device, the display control device according to the present embodiment controls the own device (the display control device according to the present embodiment). It will be.

  FIG. 1 is an explanatory diagram illustrating an example of a display device according to the present embodiment. The display device according to the present embodiment is mounted on the user so that the display surface is positioned in front of the user, for example. Here, A shown in FIG. 1 shows an example of the HMD, and B shown in FIG. 1 shows another example of the HMD. Further, C illustrated in FIG. 1 illustrates an example of an operation device provided in the HMD.

  The display device according to the present embodiment includes, for example, a display unit 10 and an operation unit 12. In addition, the display device according to the present embodiment includes, for example, one or more members such as a temple member 14, a bridge member 16, a modern member 18, and a pad member 20 as illustrated in FIG. 1A and FIG. 1B. , Composed of various members.

  The display unit 10 has, for example, a display surface capable of displaying a display object, and is disposed at a position in front of the user's eyes so that the display surface is positioned in front of the user when the display unit 10 is attached to the user. Is done. Here, FIG. 1 shows a configuration in which the display unit 10 has display surfaces corresponding to both eyes of the user, but the configuration of the display unit according to the present embodiment is not limited to the above. For example, the display unit according to this embodiment may have a display surface corresponding to only one eye of the user.

  Here, as display objects according to the present embodiment, for example, icons associated with applications, thumbnail images of still images and moving images, content images indicating still images and moving images, and notification to the user are given. Images (still images or moving images). Further, the display object according to the present embodiment may include, for example, an image (still image or moving image) related to the screen layout.

  The operation unit 12 is provided so as to be positioned on the side surface of the user when worn on the user. As a position where the operation unit 12 is provided, for example, as shown in FIGS. 1A and 1B, a position on the temple member 14 constituting the display device may be mentioned.

  The operation unit 12 is provided on the left side surface of the user when the operation unit 12 is worn by the user, for example, as shown in FIGS. In addition, the position where the operation unit 12 is provided is not limited to the left side surface of the user when the operation unit 12 is attached to the user. For example, the operation unit 12 may be provided on the right side of the user when worn on the user, or may be provided on both the left and right sides of the user when worn on the user. . Hereinafter, a case where the operation unit 12 is provided on the left side surface of the user when worn by the user will be mainly described as an example.

  The operation unit 12 includes, for example, one or more operation devices. As an operation device which operation part 12 has, a sensor, a button, etc. are mentioned, for example. Examples of the sensor according to the present embodiment include an infrared proximity sensor, various types of touch sensors such as a capacitance type, and an image sensor.

  The operation unit 12 detects a user operation using an operation device that the operation unit 12 has, and generates an operation signal corresponding to the detection result.

  Here, examples of the user operation detected by the operation device according to the present embodiment include “operation input to the operation device by the user”. When “operation input to the operation device by the user” is detected by the operation device as the user operation, the operation signal according to the present embodiment indicates, for example, an operation performed on the operation device by the user.

  Note that the user operation detected by the operation device according to the present embodiment is not limited to the above. For example, when the operation device according to the present embodiment is a device that can detect that the user has approached the operation device, such as an infrared proximity sensor or an image sensor, the operation device according to the present embodiment detects the user The operation may be “the user has approached the operation device”. When “the user has approached the operation device” is detected by the operation device as the user's operation, the operation signal according to the present embodiment is, for example, a stage before the operation performed on the operation device by the user (the operation is performed). Preparatory stage).

  In C of FIG. 1, the first sensor 22 positioned on the front side of the user when the operation unit 12 is mounted on the user, and the second sensor 24 positioned on the rear side of the user when mounted on the user. The example which has these two sensors is shown.

  In addition, the sensor with which the operation part which concerns on this embodiment is provided is not restricted to the example shown to C of FIG. For example, the operation unit according to the present embodiment may include a sensor in which the first sensor 22 and the second sensor 24 are integrated.

  When the display device according to the present embodiment is attached to the user, for example, as shown in FIGS. 1A and 1B, the display surface is positioned in front of the user, and the operation device is positioned on the side surface of the user. It has a configuration.

  Needless to say, the appearance of the display device according to the present embodiment is not limited to the appearance shown in FIGS.

  Further, the configuration of the display device according to the present embodiment is not limited to the configuration illustrated in A and B of FIG.

  For example, the display device according to the present embodiment may be configured such that an external operation device is connected to a position on the side surface of the user when the display device is worn by the user. Further, when an external operation device is connected to the position of the side surface of the user when worn by the user, the display device according to the present embodiment can be configured not to include the operation unit 12. . That is, “the operation device provided at the position of the side surface of the user in the display device according to the present embodiment” refers to the operation device constituting the operation unit included in the display device according to the present embodiment and / or the present embodiment. In such a display device, it means an external operation device connected to the position of the side surface of the user wearing the display device according to the present embodiment. Note that an example of the user's operation on the “operation device provided at the position of the user's side surface in the display device according to the present embodiment” will be described in “[I] Example of operation in the display system 1000” to be described later.

  In addition, the display device according to the present embodiment is configured by an MPU (Micro Processing Unit), various processing circuits, and the like, and may include a control unit (not shown) that controls the entire display device. In addition, when the display device according to the present embodiment and the display control device according to the present embodiment are an integrated device, the control unit (not shown), for example, displays a display control method according to the present embodiment described later. It plays the role which performs the process which concerns on.

  In addition, the display device according to the present embodiment may include a communication unit (not shown) for performing wireless / wired communication with an external device such as the display control device according to the present embodiment. Examples of the communication unit (not shown) include a communication antenna and an RF (Radio Frequency) circuit (wireless communication), an IEEE 802.15.1 port and a transmission / reception circuit (wireless communication), an IEEE 802.11b port and a transmission / reception circuit (wireless communication). Communication), or a LAN (Local Area Network) terminal and a transmission / reception circuit (wired communication). Note that the display device according to the present embodiment may be configured to communicate with an external device such as the display control device according to the present embodiment via a connected external communication device.

  Further, the display device according to the present embodiment may include, for example, a battery (not shown) that supplies power to each device. Here, examples of the battery (not shown) included in the display device according to the present embodiment include a secondary battery such as a lithium ion battery. When the display device according to this embodiment is driven by obtaining power from an external power source such as a commercial power source, the display device according to this embodiment may not include a battery (not shown). .

  Further, the display device according to the present embodiment is not limited to the HMD as shown in A and B of FIG. For example, the display device according to the present embodiment may be a monocular device. The display device according to the present embodiment is, for example, a device having an arbitrary shape having a configuration in which a display surface is positioned in front of the user and an operation device is positioned on the side surface of the user when worn by the user. It is possible to apply.

  Hereinafter, the case where the display device according to the present embodiment is the HMD shown in FIG. 1A will be described as an example, and the processing related to the display control method according to the present embodiment in the display control device according to the present embodiment will be described. To do.

[2] Processing related to the display control method according to the present embodiment As described above, for example, the HMD shown in A of FIG. In a “display device provided with a device”, it is difficult for a user to perform an operation after visually recognizing the operation device. For this reason, in the display device as described above, for example, a change in display content on the display surface resulting from an operation performed by the user may not be a desired change.

  FIG. 2 is an explanatory diagram for explaining an example of a problem that may occur when a display device is used in which a display surface is positioned in front of a wearing user and an operation device is provided on the side of the wearing user.

  Here, FIG. 2 shows an example in which the display object displayed on the display surface moves on the display axis A (corresponding to a trajectory described later) when the user operates the operation unit 12 of the display device. ing. That is, in the example shown in FIG. 2, when the display object moves on the display axis A, the display object moves in parallel to the display surface. In addition, the change of the display content of the display surface by the said operation of a user is not restricted above. For example, in FIG. 2, a cursor (or a focus frame; hereinafter the same) for selecting a display object displayed on the display surface when the user operates the operation unit 12 of the display device. An example of moving on the display axis A (corresponding to a trajectory described later) may be shown. FIG. 2 shows an example in which the operation of the operation unit 12 by the user is an operation corresponding to the operation axis A.

  Here, the operation axis according to the present embodiment refers to a user who wears a display device (a display device in which a display surface is located in front of the worn user and an operation device is provided on the side of the worn user). When operating the operation device provided in the position of a side surface, it is a virtual axis | shaft corresponding to the direction assumed to move the medium (for example, a user's hand, a finger | toe etc.) used for operation.

  When the operation device according to the present embodiment includes a plurality of sensors as illustrated in C of FIG. 1, as an operation axis according to the present embodiment, for example, a medium used for an operation by a user between the plurality of sensors. The direction (for example, the direction corresponding to the straight line which passes along the center position of each sensor) is mentioned. Further, when the operation device according to the present embodiment is a touch sensor of various types such as a capacitance method, for example, the operation device according to the present embodiment is the user's slide. The direction which can detect operation is mentioned. In addition, when the operation device according to the present embodiment is a button (or a button group including a plurality of buttons) capable of inputting at least in the horizontal direction, such as a cross key, for example, according to the present embodiment. An example of the operation axis is the horizontal direction of the button. Needless to say, the example of the operation axis according to the present embodiment is not limited to the above.

  For example, as shown in FIG. 2, when the operation axis A and the display axis A are orthogonal (or when they intersect at an angle close to a right angle, the same applies hereinafter), the user performs the operation on the operation unit 12. The direction of operation and the direction in which the display object displayed on the display surface moves cannot be easily associated. For example, when the user performs an operation in the direction a shown in FIG. 2, the display object moves in the direction c shown in FIG. 2, or the display object moves in the direction d shown in FIG. It is difficult to judge.

  Therefore, for example, as shown in FIG. 2, when the operation axis A and the display axis A are orthogonal to each other, the user's operability may be deteriorated due to the display object not moving in the direction intended by the user. .

  Further, as described above, even if the guide display image is displayed on the display surface as in the technique described in Patent Document 1, for example, the user's operability may be deteriorated. Even if the technology is used, it is not always possible to improve the operability of the user.

  Therefore, the display control apparatus according to the present embodiment includes, for example, the display apparatus according to the present embodiment (a display surface capable of displaying a display object is positioned in front of the user as illustrated in FIGS. The display object displayed on the display surface of the display device in which the operation device is provided at a position on the side surface of the mounted user is controlled (display control processing). The display control device according to the present embodiment, for example, displays a display object based on an operation signal acquired in response to detection by an operation device provided at a position on the side surface of the user mounted on the display device according to the present embodiment. The display of the display object is controlled so that at least a part of the trajectory to be moved indicates a trajectory having a vertical component with respect to the display surface.

  More specifically, in the display control device according to the present embodiment, at least a part of the trajectory for moving the display object selectively has a component perpendicular to the display surface based on the acquisition state of the operation signal. The display of the display object is controlled so as to indicate the trajectory it has. An example of processing related to selective display object display in the display control apparatus according to the present embodiment will be described later.

  Here, examples of the operation device provided at the position of the side surface of the mounted user according to the present embodiment include one or more operation devices included in the operation unit 12 as illustrated in FIG. 1. In addition, the operation device provided in the position of the side surface of the mounted user according to the present embodiment is not limited to one or more operation devices that the operation unit 12 has. For example, the operation device provided at the position of the mounted user's side according to the present embodiment is the display device according to the present embodiment, when the user wears the display device according to the present embodiment. There may be one or more external operation devices connected to the position.

  In the following, the “operation signal according to detection in the operation device provided at the position of the attached user's side surface” acquired by the display control device according to the present embodiment corresponds to the detection in the operation unit 12 shown in FIG. A case where the operation signal is acquired will be described as an example. Here, for example, when the display control device according to the present embodiment and the display device according to the present embodiment are an integrated device, the display control device according to the present embodiment transmits from the operation unit 12 provided. Processing is performed based on the operation signal. In addition, when the display control device according to the present embodiment and the display device according to the present embodiment are separate devices, the display control device according to the present embodiment includes, for example, a communication unit (described later). ) Or a connected external communication device, and processing is performed based on an operation signal according to detection in the operation unit 12 of the display device according to the present embodiment.

  In addition, the trajectory according to the present embodiment is a path along which the display object moves and a path along which the position where the display object is selected moves, such as the display axis A shown in FIG. Examples of the trajectory according to the present embodiment include a virtual route that is not perceived by the user on the display surface. The trajectory according to the present embodiment is not limited to a virtual route that is not perceived by the user. For example, the trajectory according to the present embodiment may be visually recognized by the user by being displayed on the display surface. Hereinafter, the trajectory according to the present embodiment may be referred to as a “display axis”.

As described above, the trajectory according to the present embodiment corresponds to a “display axis” as shown by the display axis A in FIG. Here, taking FIG. 2 as an example, if at least a part of the trajectory according to the present embodiment indicates a trajectory having a vertical direction component with respect to the display surface, the present embodiment has a vertical direction component. orbital will have a parallel direction component to the operating axis a.

  Therefore, in the display control processing according to the present embodiment, “controlling the display of the display object so that at least a part of the trajectory for moving the display object has a trajectory having a vertical component with respect to the display surface” is For example, this corresponds to “controlling the display of the display object so that at least a part of the trajectory for moving the display object indicates a trajectory having a parallel direction component with respect to the operation axis according to the present embodiment”.

  In addition, for example, when an operation signal acquired in response to detection by the operation unit 12 is acquired, the display control device according to the present embodiment performs an operation indicated by the operation signal along the trajectory according to the present embodiment. The display object is moved by scrolling in a direction corresponding to the direction.

  The display object moving method according to the present embodiment is not limited to the above. For example, the display control apparatus according to the present embodiment discretely changes the position where the display object is displayed on the trajectory according to the present embodiment to the direction corresponding to the operation direction indicated by the operation signal, thereby changing the display object. It may be moved.

  Further, when the display control device according to the present embodiment and the display device according to the present embodiment are separate devices, the display control device according to the present embodiment includes, for example, a communication unit (described later). Or the connected external communication device transmits a display control signal for controlling the display on the display surface of the display unit 10 to the display device according to the present embodiment, whereby the display device according to the present embodiment is displayed. Controls display of display objects in. When the display control device according to the present embodiment and the display device according to the present embodiment are an integrated device, the display control device according to the present embodiment displays a display control signal on the display unit 10 provided. Is transmitted to control the display of the display object in the display device according to the present embodiment.

  Here, as the display control signal according to the present embodiment, for example, a signal related to control for controlling the display timing of the display object and the like can be mentioned. In addition, the display control signal according to the present embodiment may include, for example, a signal indicating data related to display contents such as data indicating a display object to be displayed on the display surface and data indicating a layout.

  Note that the control target that the display control device according to the present embodiment controls the display of the display object is not limited to the display device according to the present embodiment. For example, the display control device according to the present embodiment can also control devices other than the display device according to the present embodiment, such as a communication device such as a smartphone or a computer such as a PC (Personal Computer). is there.

  Hereinafter, the display control process according to the present embodiment will be described more specifically. Hereinafter, a case where the operation device provided at the position of the side surface of the user in the display device according to the present embodiment such as the operation unit 12 is provided on the left side surface of the user when worn by the user will be mainly described as an example. The display control process according to the present embodiment will be described.

  For example, when an operation signal acquired in response to detection by the operation unit 12 is acquired, the display control device according to the present embodiment “at least a part of display objects to be displayed on the display surface” The display object so that at least a part of the trajectory for moving the display object indicates a trajectory having a vertical component with respect to the display surface. Control the display of.

  Here, as described above, the operation signal according to the present embodiment is, for example, an operation performed on the operation device by the user or an operation performed before the operation on the operation device by the user (before the operation is performed). Preparation stage). In other words, the display control apparatus according to the present embodiment, for example, when the user performs an operation on the operation device or when the user tries to perform an operation on the operation device, It is possible to control the display of the display object so that at least a part of the trajectory to be displayed indicates a trajectory having a vertical component with respect to the display surface.

(I) First Example of Display Control Process According to This Embodiment FIG. 3 is an explanatory diagram for explaining a first example of the display control process according to this embodiment in the display control apparatus according to this embodiment. is there. Here, FIG. 3 shows a first example of display in which at least a part of the display objects is displayed so as to have a vertical component with respect to the display surface. 3, as in FIG. 2, when the user operates the operation unit 12 of the display device, the display object displayed on the display surface corresponds to the display axis (corresponding to the trajectory according to the present embodiment). An example of moving above is shown.

  For example, as described with reference to FIG. 2, when the operation axis A and the display axis are orthogonal to each other, for example, as the display axis A in FIG. 3, the user operability may be reduced. Therefore, the display control apparatus according to the present embodiment, for example, displays the entire display object to be displayed on the display surface, such as the display object displayed along the display axis B in FIG. To display.

  For example, like the display object displayed along the display axis B in FIG. 3, the entire display object to be displayed on the display surface is displayed so as to have a vertical component with respect to the display surface. The display axis B is more parallel to the operation axis A and the display axis A. Therefore, for example, the user viewing the display object displayed on the display surface corresponds to the operation direction a shown in FIG. 3 corresponding to the movement direction f shown in FIG. 3 and the operation direction b shown in FIG. It is possible to more intuitively recognize that it corresponds to the moving direction e shown. In addition, as described above, since the operation direction and the movement direction can be recognized more intuitively, for example, the change in display content on the display surface resulting from the operation performed by the user is a change desired by the user. This is prevented.

  Therefore, for example, the display control apparatus according to the present embodiment displays the entire display object to be displayed on the display surface so as to have a component in the vertical direction with respect to the display surface. Can improve the operability of the user.

  4 and 5 are explanatory diagrams for explaining a first example of the display control process according to the present embodiment in the display control apparatus according to the present embodiment. Here, A shown in FIG. 4 shows an example of how the display object is displayed on the display surface when the display axis is the display axis A shown in FIG. 4 shows an example of how the display object is displayed on the display surface when the display axis is the display axis B shown in FIG. FIG. 5 shows an example of a change in display content corresponding to an operation signal corresponding to a user operation in the appearance shown in FIG. 4B.

  When the display axis is the display axis A shown in FIG. 3, since the entire display axis does not have a component in the vertical direction with respect to the display surface, the display object displayed on the display surface is, for example, in A of FIG. As shown, drawing using perspective is not done. Therefore, for example, when the user performs an operation on the operation unit 12 in the operation direction b shown in FIG. 3, the user guesses how the display object shown in A of FIG. 4 moves. ,Have difficulty.

  On the other hand, when the display axis is the display axis B shown in FIG. 3, since the entire display axis has a vertical component with respect to the display surface, the display object displayed on the display surface is, for example, FIG. As shown in B, the drawing using the perspective method is performed. Therefore, for example, when the user operates the operation unit 12 in the operation direction b shown in FIG. 3, the user moves the display object in the direction e shown in FIG. It can be estimated more easily that the state shown in FIG. 5A changes to the state shown in FIG. 5B.

  Note that, for example, when the entire display axis has a component in the vertical direction with respect to the display surface as in the display axis B of FIG. 3, the change in display content corresponding to the operation signal according to the user's operation is shown in FIG. It is not restricted to the example shown.

  6A to 6C are explanatory diagrams for explaining a first example of display control processing according to the present embodiment in the display control apparatus according to the present embodiment. Here, FIG. 6A to FIG. 6C each show another example of the change in display content in accordance with the user's operation in the appearance shown in FIG. 4B.

  For example, as shown in FIGS. 6A and 6B, the display control apparatus according to the present embodiment displays a cursor C indicating the selected display object in the direction of the display axis corresponding to the operation signal according to the user's operation. It may be moved.

  Further, the display control apparatus according to the present embodiment changes, for example, the representation of the selected display object (S shown in FIG. 6B) and the representation of the display object that is not selected. And the display control apparatus which concerns on this embodiment may change the display object's expression to the direction of the display axis corresponding to the operation signal according to a user's operation, for example, as shown to A and B of FIG. 6B. .

  Further, the display control apparatus according to the present embodiment is the same as FIG. 5 in a state where all display objects are expressed in the same manner as S shown in FIG. 6B, for example, as shown in A and B of FIG. 6C. In addition, the display object may be moved in the direction of the display axis corresponding to the operation signal according to the user's operation.

  In addition, the change of the display content corresponding to the operation signal according to a user's operation is not restricted to FIG. 5 and FIG. 6A-FIG. 6C. For example, the display control apparatus according to the present embodiment displays each display object displayed on the display surface as a three-dimensional image including a right eye image corresponding to the user's right eye and a left eye image corresponding to the user's left eye. The congestion of each display object may be changed.

(Ii) Second Example of Display Control Process According to This Embodiment FIG. 7 is an explanatory diagram for explaining a second example of the display control process according to this embodiment in the display control apparatus according to this embodiment. is there. Here, FIG. 7 shows a second example of display in which at least some display objects are displayed so as to have a component in the vertical direction with respect to the display surface. In FIG. 7A, as in FIG. 2, when the user operates the operation axis A of the operation unit 12 of the display device, the display object displayed on the display surface is displayed on the display axis (the trajectory according to the present embodiment). It corresponds to the above example). A display axis C illustrated in FIG. 7A illustrates an example of a display axis in which a part of the display axis is a curve. Further, B shown in FIG. 7 shows an example of how the display object is displayed on the display surface when the display axis is the display axis C shown in FIG.

  For example, as described with reference to FIG. 2, when the operation axis A and the display axis are orthogonal to each other as in the display axis A of FIG. 7, for example, the user operability may be reduced. Therefore, the display control apparatus according to the present embodiment has, for example, one portion of the display object to be displayed on the display surface as a component perpendicular to the display surface, as indicated by P1 in FIG. 7B. Display so that there is no. In addition, the display control apparatus according to the present embodiment, for example, as shown in P2 of B of FIG. 7, causes other portions of the display object to be displayed on the display surface to have a vertical component with respect to the display surface. To display.

  For example, like a display axis C shown in FIG. 7A, a part of the display axis (corresponding to the trajectory according to the present embodiment) is curved to be displayed on the display screen shown in FIG. 7B. For example, the user viewing the display object indicates that the operation direction a shown in FIG. 7 corresponds to the movement direction h shown in FIG. 3, and the operation direction b shown in FIG. 7 corresponds to the movement direction g shown in FIG. Can be recognized more intuitively. In addition, as described above, since the operation direction and the movement direction can be recognized more intuitively, for example, the change in display content on the display surface resulting from the operation performed by the user is a change desired by the user. This is prevented.

  Therefore, for example, the display control apparatus according to the present embodiment displays “one part of the display object to be displayed on the display surface so as not to have a vertical component with respect to the display surface, and By displaying the other part of the display object to be displayed so as to have a vertical component with respect to the display surface, the display control apparatus according to the present embodiment can improve the operability of the user. it can.

  Note that the display axis according to the second example of the display control processing according to the present embodiment is not limited to a partially curved display axis, such as the display axis C shown in FIG. For example, the display axis according to the second example of the display control process according to the present embodiment is a display axis in which a part of the display axis is bent (for example, a part of the display axis has a vertical component with respect to the display surface). Alternatively, the other part of the display axis may be a display axis having a vertical component with respect to the display surface.

  Even if the display axis is a bent display axis, the user can select “one of the display objects to be displayed on the display surface” as in the case where the display axis is the display axis C shown in FIG. Display the portion so that it does not have a vertical component with respect to the display surface, and display other portions of the display object to be displayed on the display surface so as to have a vertical component with respect to the display surface. "Is realized. Therefore, for example, even if the display axis is a part of the display axis that is bent, the user can more intuitively determine the operation direction and the movement direction as in the case where the display axis is the display axis C shown in A of FIG. Can be recognized.

  8A and 8B are explanatory diagrams for describing a second example of the display control process according to the present embodiment in the display control apparatus according to the present embodiment. Here, FIG. 8A and FIG. 8B each show an example of a change in display contents in accordance with a user operation in the appearance shown in FIG. 7B.

  For example, as shown in FIGS. 8A and 8B, the display control apparatus according to the present embodiment responds to an operation signal in accordance with a user operation with the position of the cursor C indicating the selected display object fixed. The display object may be moved in the direction of the display axis to be performed.

  For example, as illustrated in FIGS. 8A and 8B, the display control apparatus according to the present embodiment has a cursor indicating the selected display object in the direction of the display axis corresponding to the operation signal according to the user's operation. C may be moved.

  In addition, the change of the display content corresponding to the operation signal according to a user's operation is not restricted to FIG. 8A and FIG. 8B. For example, the display control apparatus according to the present embodiment displays each display object displayed on the display surface as a three-dimensional image including a right eye image corresponding to the user's right eye and a left eye image corresponding to the user's left eye. The congestion of each display object may be changed.

(Iii) Third example of display control processing according to this embodiment Note that examples of the display control processing according to this embodiment in the display control device according to this embodiment include the first example and the second example described above. It is not limited to examples.

  For example, when the operation device provided at the position of the user's side surface in the display device according to the present embodiment is provided on the right side surface of the user when worn by the user, the display control device according to the present embodiment is Based on the acquired operation signal, the trajectory according to the present embodiment is displayed so that, for example, the trajectory according to the present embodiment changes to the opposite side (right side as viewed from the user wearing the display device according to the present embodiment) from FIGS. Control the display of objects. Here, the display control apparatus according to the present embodiment performs, for example, the same processing as in the first example and the second example.

  Further, for example, when the operation device provided at the position of the user's side surface in the display device according to the present embodiment is provided on both the left side surface and the right side surface of the user when worn on the user, this embodiment The display control apparatus according to the embodiment controls display of the display object based on the acquired operation signal so that the trajectory according to the present embodiment changes to a side corresponding to the operation device from which the operation signal is acquired. . For example, when an operation signal corresponding to an operation device provided on the left side of the user when worn by the user is acquired, the display control device according to the present embodiment is based on the acquired operation signal, For example, the display of the display object is controlled so that the trajectory according to the present embodiment changes to the side illustrated in FIGS. 3 and 7 (left side as viewed from the user wearing the display device according to the present embodiment). For example, when an operation signal corresponding to an operation device provided on the right side of the user when worn by the user is acquired, the display control apparatus according to the present embodiment is based on the acquired operation signal. Thus, the display of the display object is controlled so that the trajectory according to the present embodiment changes to the side opposite to that shown in FIGS. 3 and 7 (right side as viewed from the user wearing the display device according to the present embodiment).

  When the operation signal acquired in response to the detection in the operation unit 12 is acquired, the display control apparatus according to the present embodiment, for example, the process according to the first example shown in (i) above or the above ( By performing the process according to the second example shown in ii) and the process according to the third example shown in (iii) above, at least some of the display objects to be displayed on the display surface are displayed on the display surface. Are displayed so as to have a vertical component.

  The display control processing according to the present embodiment in the display control apparatus according to the present embodiment includes: “at least a part of display objects to be displayed on the display surface has a vertical component with respect to the display surface. It is not limited to the “displaying process”.

  For example, in the display control device according to the present embodiment, when an operation signal acquired in response to detection by the operation unit 12 is not acquired, the entire trajectory for moving the display object is perpendicular to the display surface. The display of the display object is controlled so as to indicate a trajectory having no component. That is, the display control apparatus according to the present embodiment, for example, when the operation signal acquired in response to the detection in the operation unit 12 is acquired, the entire trajectory for moving the display object is perpendicular to the display surface. The display of the display object is controlled so as to show the trajectory having the component. The display control apparatus according to the present embodiment displays on the display surface by controlling the display of the display object so as to show a trajectory parallel to the display surface, for example, as the display axis A shown in FIG. The entire display object is displayed so as not to have a vertical component with respect to the display surface.

  Further, the display control apparatus according to the present embodiment, for example, as shown in FIGS. 3 and 7, so that at least a part of the trajectory for moving the display object shows a trajectory having a vertical component with respect to the display surface. After the display object display is controlled, if the operation signal is not acquired for the set predetermined time, the display object display may be returned to the state before the control. Here, the predetermined time may be, for example, a preset fixed time or a variable time that can be set by the user.

  For example, the display control device according to the present embodiment displays the trajectory according to the present embodiment from the trajectory corresponding to the display axis A shown in FIG. 3 to the trajectory corresponding to the display axis B shown in FIG. When the display of the object is controlled, the display control apparatus according to the present embodiment corresponds to the trajectory according to the present embodiment from the trajectory corresponding to the display axis B shown in FIG. 3 to the display axis A shown in FIG. Control the display of the display object to return to the orbit. Further, for example, the display control apparatus according to the present embodiment changes the trajectory according to the present embodiment from the trajectory corresponding to the display axis A shown in FIG. 7 to the trajectory corresponding to the display axis C shown in FIG. When the display of the display object is controlled, the display control apparatus according to the present embodiment changes the trajectory according to the present embodiment from the trajectory corresponding to the display axis C shown in FIG. 7 to the display axis A shown in FIG. The display of the display object is controlled so as to return to the corresponding trajectory.

  The display control apparatus according to the present embodiment, for example, as described above, at least a part of the trajectory that selectively moves the display object based on the acquisition state of the operation signal acquired according to the detection in the operation unit 12. Controls the display of the display object so as to show a trajectory having a vertical component with respect to the display surface.

  In the display control process according to the present embodiment, the display control apparatus according to the present embodiment, for example, as described above, “the operation signal acquired in response to the detection in the operation device provided at the position of the user's side surface in the display device”. The display of the display object is controlled based on the acquisition state.

  Note that the operation signal processed by the display control apparatus according to the present embodiment is, for example, an operation signal acquired in response to detection in the operation unit 12 "detection in an operation device provided at a position on the side surface of the user in the display device. It is not limited to the “operation signal” acquired according to “. For example, the display control apparatus according to the present embodiment is an operation device other than an operation device (or an external operation device connected to the position, hereinafter the same) provided at a position on the side surface of the user in the display device. It is also possible to process an operation signal according to the detection.

  Here, as the “operation device other than the operation device provided at the position of the user's side surface in the display device” according to the present embodiment, for example, a wearable operation device used by being worn on the user's body such as the user's arm And an external operation device such as a remote controller, and a communication device operable by a user such as a smartphone. A specific example of “an operation device other than the operation device provided at the position of the user's side surface in the display device” according to the present embodiment will be described in a display system according to the present embodiment described later. An example of the user's operation on “an operation device other than the operation device provided at the position of the user's side surface in the display device” according to the present embodiment will be described in “[I] Example of operation in display system 1000” described later. explain.

  When an operation signal corresponding to detection in the “operation device other than the operation device provided at the position of the user's side surface in the display device” according to the present embodiment is acquired, the display control device according to the present embodiment, for example, The display object is not displayed so that at least a part of the trajectory for moving the display object shows a trajectory having a vertical component with respect to the display surface. In the above case, the display control apparatus according to the present embodiment displays the display object by controlling the display of the display object so as to show a trajectory parallel to the display surface, for example, the display axis A shown in FIG. The entire display object to be displayed on the surface is displayed so as not to have a vertical component with respect to the display surface.

  Here, for example, the display control apparatus according to the present embodiment identifies an operation device corresponding to the acquired operation signal based on identification information (for example, data indicating an ID) indicating the operation device included in the operation signal. To do. The operation device identification method corresponding to the acquired operation signal is not limited to the above. For example, the display control apparatus according to the present embodiment uses an operation signal acquisition path (for example, an operation signal transmitted from the operation unit 12 provided or an operation signal received by a communication unit (described later)). The operation device corresponding to the acquired operation signal may be identified.

  For example, as described above, the display control device according to the present embodiment changes the display object display method displayed on the display surface, the display object movement method, and the like according to the operation device corresponding to the operation signal. Is also possible.

(Display control apparatus according to this embodiment)
Next, an example of the configuration of the display control apparatus according to the present embodiment that can perform the process according to the display control method according to the present embodiment described above will be described.

  FIG. 9 is a block diagram illustrating an example of the configuration of the display control apparatus 100 according to the present embodiment. The display control device 100 includes a communication unit 102 and a control unit 104, for example.

  The display control apparatus 100 includes, for example, a ROM (Read Only Memory) (not shown), a RAM (Random Access Memory) (not shown), a storage unit (not shown), and an operation unit (not shown) that can be operated by the user. And a display unit (not shown) for displaying various screens on the display screen. For example, the display control apparatus 100 connects the above-described components through a bus as a data transmission path.

  Here, a ROM (not shown) stores control data such as a program used by the control unit 104 and calculation parameters. A RAM (not shown) temporarily stores a program executed by the control unit 104.

  The storage unit (not shown) is a storage unit included in the display control apparatus 100, and stores various data such as data indicating display objects and applications. Here, as the storage unit (not shown), for example, a magnetic recording medium such as a hard disk, a nonvolatile memory such as an EEPROM (Electrically Erasable and Programmable Read Only Memory), a flash memory (flash memory), or the like. nonvolatile memory). Further, the storage unit (not shown) may be detachable from the display control device 100.

[Hardware Configuration Example of Display Control Device 100]
FIG. 10 is an explanatory diagram illustrating an example of a hardware configuration of the display control apparatus 100 according to the present embodiment. The display control apparatus 100 includes, for example, an MPU 150, a ROM 152, a RAM 154, a recording medium 156, an input / output interface 158, an operation input device 160, a display device 162, and a communication interface 164. In addition, the display control apparatus 100 connects each component with a bus 166 as a data transmission path, for example.

  The MPU 150 includes, for example, an MPU and various processing circuits, and functions as the control unit 104 that controls the entire display control apparatus 100. Further, the MPU 150 plays a role of, for example, a display control unit 110 described later in the display control apparatus 100.

  The ROM 152 stores programs used by the MPU 150, control data such as calculation parameters, and the like. The RAM 154 temporarily stores a program executed by the MPU 150, for example.

  The recording medium 156 functions as a storage unit (not shown), and stores various data such as data indicating a display object and applications. Here, examples of the recording medium 156 include a magnetic recording medium such as a hard disk and a non-volatile memory such as a flash memory. Further, the recording medium 156 may be detachable from the display control apparatus 100.

  The input / output interface 158 connects, for example, the operation input device 160 and the display device 162. The operation input device 160 functions as an operation unit (not shown), and the display device 162 functions as a display unit (not shown). Here, examples of the input / output interface 158 include a USB (Universal Serial Bus) terminal, a DVI (Digital Visual Interface) terminal, an HDMI (High-Definition Multimedia Interface) terminal, and various processing circuits. Further, the operation input device 160 is provided on the display control device 100, for example, and is connected to the input / output interface 158 inside the display control device 100. Examples of the operation input device 160 include a rotary selector such as a button, a direction key, and a jog dial, or a combination thereof. The display device 162 is provided on the display control device 100, for example, and is connected to the input / output interface 158 inside the display control device 100. Examples of the display device 162 include a liquid crystal display (LCD), an organic EL display (Organic Electro-Luminescence display, or an OLED display (Organic Light Emitting Diode display)), and the like.

  Needless to say, the input / output interface 158 can be connected to an external device such as an operation input device (for example, a keyboard or a mouse) as an external device of the display control device 100 or a display device. The display device 162 may be a device capable of display and user operation, such as a touch screen.

  The communication interface 164 is a communication unit included in the display control apparatus 100, and is a communication for performing wireless / wired communication with an external apparatus such as the display apparatus according to the present embodiment via a network (or directly). It functions as the unit 102. Here, examples of the communication interface 164 include a communication antenna and an RF circuit (wireless communication), an IEEE 802.15.1 port and a transmission / reception circuit (wireless communication), an IEEE 802.11b port and a transmission / reception circuit (wireless communication), or a LAN. Examples include terminals and transmission / reception circuits (wired communication). The network according to the present embodiment includes, for example, a wired network such as a LAN or a WAN (Wide Area Network), a wireless LAN (WLAN; Wireless Local Area Network), or a wireless WAN (WWAN; Wireless Wide Area Network) via a base station. Network), or the Internet using a communication protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol).

  The display control apparatus 100 performs processing related to the display control method according to the present embodiment, for example, with the configuration shown in FIG. Note that the hardware configuration of the display control apparatus 100 according to the present embodiment is not limited to the configuration illustrated in FIG.

  For example, the display control apparatus 100 may include a plurality of communication interfaces having different communication methods or the same communication method.

  For example, when communicating with an external apparatus such as the display apparatus according to the present embodiment via an external communication device connected via the input / output interface 158 or the like, the display control apparatus 100 includes the communication interface 164. May not be provided.

  In addition, for example, when the display control apparatus 100 is configured to perform a stand-alone process (for example, when the display control apparatus 100 and the display apparatus according to the present embodiment are an integrated apparatus), the communication device 164 is provided. It does not have to be provided.

  Further, the display control apparatus 100 can be configured not to include the operation device 160 and the display device 162.

  With reference to FIG. 9 again, an example of the configuration of the display control apparatus 100 will be described. The communication unit 102 is a communication unit included in the display control apparatus 100, and performs wireless / wired communication with an external apparatus such as the display apparatus according to the present embodiment via a network (or directly). The communication of the communication unit 102 is controlled by the control unit 104, for example.

  Here, examples of the communication unit 102 include a communication antenna and an RF circuit, a LAN terminal, and a transmission / reception circuit, but the configuration of the communication unit 102 is not limited to the above. For example, the communication unit 102 can have a configuration corresponding to any standard capable of performing communication, such as a USB terminal and a transmission / reception circuit, or any configuration capable of communicating with an external device via a network.

  The control unit 104 is configured by, for example, an MPU and plays a role of controlling the entire display control apparatus 100. In addition, the control unit 104 includes, for example, a display control unit 110 and plays a role of leading the processing related to the display control method according to the present embodiment.

  The display control unit 110 plays a role of leading the processing related to the display control method according to the present embodiment, and is mounted on the display device according to the present embodiment (the display surface is positioned in front of the user, Display of a display object displayed on the display surface in a display device in which an operation device is provided at a position on the side surface of the user who is mounted. For example, the display control unit 110 moves at least one display object based on an operation signal acquired in response to detection by an operation device provided at the position of the side surface of the user attached to the display device according to the present embodiment. The display of the display object is controlled so that the trajectory of the part shows a trajectory having a vertical component with respect to the display surface.

  Here, when the display control device 100 and the display device according to the present embodiment are separate devices, the display control unit 110 is based on the operation signal received by the communication unit 102, for example. The process which concerns on the display control method which concerns on is performed. In the above case, for example, the display control unit 110 causes the communication unit 102 to transmit a display control signal corresponding to the processing result to the display device according to the present embodiment, thereby displaying the display according to the present embodiment. Controls the display of display objects on the device.

  In addition, when the display control device 100 and the display device according to the present embodiment are an integrated device, the display control unit 110 performs the present embodiment based on an operation signal transmitted from the operation unit 12, for example. Processing related to the display control method is performed. In the above case, the display control unit 110 controls the display of the display object in the display device according to the present embodiment, for example, by transmitting a display control signal corresponding to the processing result to the display unit 10.

  For example, the control unit 104 includes the display control unit 110 to lead the process related to the display control method according to the present embodiment.

  The display control apparatus 100 performs a process (for example, the display control process) according to the display control method according to the present embodiment, for example, with the configuration illustrated in FIG. Therefore, the display control apparatus 100 can improve the operability of the user, for example, with the configuration shown in FIG.

  Note that the configuration of the display control apparatus according to the present embodiment is not limited to the configuration illustrated in FIG.

  For example, the display control apparatus according to the present embodiment can individually include the display control unit 110 illustrated in FIG. 9 (for example, each can be realized by an individual processing circuit).

  In addition, for example, when the display control apparatus according to the present embodiment is configured to perform stand-alone processing (for example, when the display control apparatus is an apparatus integrated with the display apparatus according to the present embodiment), the display control apparatus includes the communication unit 102. It does not have to be.

  As described above, the display control apparatus according to the present embodiment performs, for example, the display control process as a process according to the display control method according to the present embodiment. Here, as shown in FIG. 4B, for example, the display control apparatus according to the present embodiment displays the entire display object to be displayed on the display surface so as to have a vertical component with respect to the display surface. In addition, the display control apparatus according to the present embodiment has, for example, one part of the display object to be displayed on the display surface as a component perpendicular to the display surface, as indicated by P1 in FIG. 7B. For example, as indicated by P2 in FIG. 7B, other portions of the display object to be displayed on the display surface are displayed so as to have a vertical component with respect to the display surface.

  Therefore, the user who views the display object displayed on the display surface can more intuitively recognize the operation direction and the movement direction. In addition, since it becomes possible to more intuitively recognize the operation direction and the movement direction, for example, the change in display content on the display surface resulting from the operation performed by the user does not become the change desired by the user. Is prevented.

  Therefore, the display control apparatus according to the present embodiment can improve user operability.

  As mentioned above, although the display apparatus was mentioned and demonstrated as this embodiment, this embodiment is not restricted to this form. In the present embodiment, for example, an HMD or a monocular device, such as “a display surface is positioned in front of the user, and an operation device is positioned on the side surface of the user. It can be applied to the “device”.

  Moreover, although the display control apparatus was mentioned and demonstrated as this embodiment, this embodiment is not restricted to this form. In the present embodiment, for example, a communication device such as a mobile phone or a smartphone, a video / music playback device (or video / music recording / playback device), a game machine, a computer such as a PC or a server, a display device such as a television receiver, etc. It can be applied to various devices. Moreover, this embodiment can also be applied to the display device according to this embodiment, for example. Furthermore, this embodiment can also be applied to, for example, a processing IC (Integrated Circuit) that can be incorporated into the devices as described above and the display device according to this embodiment.

(Program according to this embodiment)
A program for causing a computer to function as the display control apparatus according to the present embodiment (for example, a program capable of executing processing related to the display control method according to the present embodiment, such as display control processing according to the present embodiment) However, it is possible to improve user operability by being executed in the computer.

(Display system according to this embodiment)
Next, for example, the display device according to this embodiment as illustrated in FIGS. 1A and 1B and the operation device according to this embodiment capable of operating the display device according to this embodiment are included in this embodiment. Such a display system will be described.

  FIG. 11 is an explanatory diagram showing an example of the display system 1000 according to the present embodiment.

  The display system 1000 includes, for example, a display device (A shown in FIG. 11) according to the present embodiment, an operation device (B and C shown in FIG. 11) according to the present embodiment, and a communication that can be operated by a user such as a smartphone. Device (D shown in FIG. 11). The operation device shown in FIG. 11B is an example of a remote controller (operation device). In addition, the operation device illustrated in FIG. 11C is an example of a wearable operation device that is used by being worn on the user's body. FIG. 11C shows an example of a clock-type operation device that is used by being worn on the user's arm. Here, the operation device according to the present embodiment illustrated in FIGS. 11B and 11C is an example of “an operation device other than the operation device provided at the position of the user's side surface in the display device” according to the present embodiment described above. It corresponds to. In the display system 1000, for example, the communication device shown in FIG. 11D further serves as an “operation device other than the operation device provided on the side surface of the user in the display device” according to the above-described embodiment. Also good. That is, in the display system 1000, the communication device shown in FIG. 11D can also serve as the operation device according to the present embodiment.

  The display device according to the present embodiment has, for example, the configuration (including modifications) described with reference to FIG. Needless to say, the configuration of the display device according to the present embodiment is not limited to the configuration described with reference to FIG. 1.

  The operating device according to the present embodiment includes, for example, operating devices such as buttons and touch sensors, a control unit (not shown), and a communication unit (not shown). An example of an operation device provided in the operation apparatus according to the present embodiment will be described later.

  A control unit (not shown) included in the operating device according to the present embodiment is configured by an MPU, various processing circuits, and the like, and controls the entire operating device according to the present embodiment. Further, a control unit (not shown) included in the operation device according to the present embodiment controls communication in a communication unit (not shown) included in the operation device according to the present embodiment or a connected external communication device, For example, an operation signal corresponding to the detection in the operation device is transmitted to an external apparatus such as the display apparatus according to the present embodiment or the communication apparatus illustrated in FIG.

  A communication unit (not shown) included in the operation device according to the present embodiment serves to perform wireless / wired communication with an external device such as a display device according to the present embodiment. As a communication unit (not shown) included in the operation device according to the present embodiment, for example, a communication antenna and an RF circuit (wireless communication), an IEEE 802.15.1 port and a transmission / reception circuit (wireless communication), an IEEE 802.11b port And a transmission / reception circuit (wireless communication) or a LAN terminal and a transmission / reception circuit (wired communication).

  Note that the configuration of the operating device according to the present embodiment is not limited to the above.

  For example, in the case of a configuration that communicates with an external device such as a display device according to the present embodiment via a connected external communication device, the operation device according to the present embodiment includes a communication unit (not shown). May not be provided.

  Moreover, the operating device according to the present embodiment may include, for example, a battery (not shown) that supplies power to each device. Here, examples of a battery (not shown) included in the operation device according to the present embodiment include a secondary battery such as a lithium ion battery. Note that when the operating device according to the present embodiment is driven by obtaining power from an external power source such as a commercial power source, the operating device according to the present embodiment may not include a battery (not shown). .

  The display system 1000 includes, for example, a display device according to this embodiment having the above-described configuration and an operation device according to this embodiment having the above-described configuration. Note that the configuration of the display system according to the present embodiment is not limited to the configuration illustrated in FIG.

  For example, the display system according to the present embodiment may not have the communication device that can be operated by the user shown in FIG.

  FIG. 11 shows two apparatuses, the remote controller shown in FIG. 11B and the wearable operation device shown in FIG. 11C, as the operation apparatus according to this embodiment. The operation device according to the present embodiment included in the display system according to the embodiment is not limited to the two devices illustrated in FIGS. For example, the display system according to the present embodiment can be configured to include one or more operation devices according to the present embodiment.

  Hereinafter, the display system according to the present embodiment will be described using the display system 1000 illustrated in FIG. 11 as an example.

  In the display system 1000, for example, display on the display surface of the display device according to the present embodiment is controlled based on a user operation. Here, in the display system 1000, for example, when the user operates the operation device included in the display device according to the present embodiment and the operation device included in the operation device according to the present embodiment, the display according to the present embodiment. The display on the display surface of the device is controlled.

  FIG. 12 is an explanatory diagram illustrating an example of an operation device capable of performing an operation related to display control on the display surface of the display device according to the present embodiment in the display system 1000.

  A shown in FIG. 12 illustrates an example of an operation device included in the display device according to the present embodiment, and an example in which the operation device is provided at a position on a temple member configuring the display device according to the present embodiment. Is shown. The display device according to the present embodiment corresponds to, for example, a sensor (front sensor shown in FIG. 12A. First sensor 22 shown in FIG. 1C) that is positioned on the front side of the user when worn by the user. ) And a sensor (rear sensor shown in FIG. 12A, corresponding to the second sensor 24 shown in FIG. 1C) positioned on the rear side of the user when worn by the user as an operation device. . Examples of the sensor included in the display device according to the present embodiment include an infrared proximity sensor, various types of touch sensors such as a capacitance method, and an image sensor. In addition, the sensor which the display apparatus which concerns on this embodiment has as an operation device is not restricted to the example shown to A of FIG. For example, the operation device included in the display device according to the present embodiment includes a sensor located on the front side of the user when worn on the user and a sensor located on the rear side of the user when worn on the user. An integrated sensor may be used.

  B illustrated in FIG. 12 illustrates an example of an operation device included in the remote controller (an example of the operation device according to the present embodiment) illustrated in B of FIG. 11. For example, as shown in FIG. 12B, the remote controller includes various buttons as operation devices.

  C illustrated in FIG. 12 illustrates an example of an operation device included in the wearable operation device (an example of the operation apparatus according to the present embodiment) illustrated in C of FIG. 11. For example, as shown in FIG. 12C, the wearable operation device includes various types of touch sensors such as a capacitance method as an operation device.

  Needless to say, the display device according to the present embodiment and the operation device included in the operation device according to the present embodiment are not limited to the example illustrated in FIG. 12.

  Hereinafter, the operation in the display system 1000 will be described by taking as an example the case where the operation device capable of performing the operation related to the display control on the display surface of the display device according to the present embodiment is the operation device illustrated in FIGS. And an example of display in the display system 1000 will be described.

[I] Example of Operation in Display System 1000 FIGS. 13A to 13E are explanatory diagrams illustrating an example of an operation using an operation device in the display system 1000 according to the present embodiment. Here, FIGS. 13A to 13E show operations performed by the user (“gesture” shown in each drawing) and operations recognized by the display device according to the present embodiment in accordance with the operation (“user action” shown in each drawing). An example of the association with “)” is shown. Needless to say, the example of the association between the operation performed by the user and the operation recognized by the display device according to the present embodiment in accordance with the operation is not limited to the examples illustrated in FIGS. 13A to 13E. .

  FIG. 13A shows an operation performed by the user, respectively, a “decision operation (Enter shown in FIG. 13A)” and a “return operation or cancellation operation (Back shown in FIG. 13A)” recognized by the display device according to the present embodiment. An example of the association is shown.

For example, when the user performs the following operation, the “determination operation” is recognized in the display device according to the present embodiment.
-An operation of touching a sensor located on the front side of the display device according to the present embodiment for a predetermined time or longer (or beyond a predetermined time)-An operation of pressing an Enter button provided in the remote controller-Wearable type To touch the touch sensor of the operating device

Further, for example, when the user performs the following operation, the display device according to the present embodiment recognizes the “return operation or cancel operation”.
An operation of touching a sensor located on the rear side included in the display device according to the present embodiment for a predetermined time or longer (or beyond a predetermined time) An operation of pressing a BACK button included in the remote controller A wearable type Touching the touch sensor of the operation device for a predetermined time (or beyond the predetermined time)

  A shown in FIG. 13B is a correspondence between “an operation for moving a display object, a cursor, and the like to the left (Left shown in FIG. 13B)” recognized by the display device according to the present embodiment and an operation performed by the user. An example is shown. B shown in FIG. 13B shows an example of a change in display content displayed on the display surface as a result of recognition in the display device according to the present embodiment.

For example, when the user performs the following operation, the “operation for moving to the left” is recognized in the display device according to the present embodiment.
-An operation of touching a sensor located on the rear side after touching a sensor located on the front side provided in the display device according to the present embodiment-An operation of pressing a Left button provided in the remote controller-A wearable type operation device On the touch sensor, slide from left to right

Further, for example, when the user performs the following operation, the display device according to the present embodiment recognizes a continuous “operation to move to the left”.
An operation of continuously pressing the Left button provided in the remote controller (corresponding to “Continuous operation” shown in A of FIG. 13B)

  A shown in FIG. 13C is a correspondence between “an operation for moving a display object, a cursor, or the like to the right (Right shown in FIG. 13C)” recognized by the display device according to the present embodiment and an operation performed by the user. An example is shown. C shown in FIG. 13C shows an example of a change in display content displayed on the display surface as a result of recognition in the display device according to the present embodiment.

For example, when the user performs the following operation, the “operation to move to the right side” is recognized in the display device according to the present embodiment.
-An operation of touching a sensor located on the front side after touching a sensor located on the rear side included in the display device according to the present embodiment-An operation of pressing a Right button provided in the remote controller-A wearable type operation device On the touch sensor, slide from right to left

Further, for example, when the user performs the following operation, the display device according to the present embodiment recognizes a continuous “operation to move to the right”.
An operation of continuously pressing the Right button provided in the remote controller (corresponding to “Continuous operation” shown in A of FIG. 13C)

  A shown in FIG. 13D indicates “an operation for moving the display object or cursor upward (Up shown in FIG. 13D)” and “display object or cursor” recognized in the display device according to the present embodiment to the lower side. FIG. 13D shows an example of correspondence between each operation to be moved to (Down shown in FIG. 13D) ”and an operation performed by the user. Further, B shown in FIG. 13D shows an example of a change in the display content displayed on the display surface as a result of recognizing the “operation to move upward” in the display device according to the present embodiment. Further, C shown in FIG. 13D shows an example of a change in display content displayed on the display surface as a result of recognizing the “operation to move downward” in the display device according to the present embodiment.

For example, when the user performs the following operation, the “upward movement operation” is recognized in the display device according to the present embodiment.
-Operation to press the Up button of the remote controller-Operation to slide from the upper side to the lower side on the touch sensor of the wearable operation device

Further, for example, when the user performs the following operation, the “operation to move downward” is recognized in the display device according to the present embodiment.
・ Operation to press down button of remote controller ・ Operation to slide from bottom to top on touch sensor of wearable type operation device

  FIG. 13E shows the “operation for turning on / off display on the display surface (Display On / Off shown in FIG. 13E)” recognized by the display device according to the present embodiment, and “turns on the power of the display device according to the present embodiment. "Operation to turn off / off (Power On / Off shown in FIG. 13E)" and "Operation for making wireless communication of a predetermined communication method communicable (Pairing and BT connection shown in FIG. 13E)" and the user An example of the association with the operation performed by is shown.

For example, when the user performs the following operation, the display device according to the present embodiment recognizes the “operation for turning on / off the display on the display surface”.
An operation of touching a sensor located on the front side and a sensor located on the rear side of the display device according to this embodiment for a predetermined time or longer (or beyond a predetermined time). A power button provided in the remote controller. Operation of pressing, below the set first time (or less than the first time)

Further, for example, when the user performs the following operation, the display device according to the present embodiment recognizes the “operation for turning on / off the power of the display device according to the present embodiment”.
-Press the Power button of the remote controller longer than the set first time (or more than the first time) and less than the set second time (or less than the second time). Operation However, 1st time <2nd time

Further, for example, when the user performs the following operation, the display device according to the present embodiment recognizes “an operation for setting wireless communication of a predetermined communication method to a communicable state”.
-Operation of pressing the Power button of the remote controller below the set first time (or less than the first time): At the first setting-The Power button of the remote controller is set An operation of pressing longer than 2 time (or more than the second time) and less than or equal to the set third time (or less than the third time), however, second time <third time

[II] Example of Display in Display System 1000 Next, an example of display in the display system 1000 realized by a user operation as shown in FIGS. 13A to 13E will be described.

  FIG. 14 is an explanatory diagram for explaining an example of display in the display system 1000 according to the present embodiment, and illustrates an example of display contents displayed on the display surface of the display device according to the present embodiment.

  A shown in FIG. 14 indicates a state in which the display in the display device according to the present embodiment is off.

  B1 and B2 shown in FIG. 14 show an example of a reference screen (so-called home screen) displayed on the display surface. For example, as shown in B1 and B2 of FIG. 14, on the reference screen according to the present embodiment, a frame indicating a region where the display object is displayed (for example, a frame displayed so as to surround the display object) is not drawn. As described above, since the frame indicating the area where the display object is displayed is not drawn, it is possible to give the user a feeling as if the display object is floating.

  Here, I shown in B1 and B2 in FIG. 14 is an icon indicating the remaining battery level. The icon indicating the remaining battery level according to the present embodiment indicates, for example, the remaining battery level of the display device according to the present embodiment, but the remaining battery level indicated by the icon indicating the remaining battery level according to the present embodiment. The amount is not limited to the above. For example, the icon indicating the remaining amount of the battery according to the present embodiment includes the remaining amount of the battery included in the operation device according to the present embodiment and the remaining amount of the battery included in the communication device illustrated in FIG. The remaining amount of the battery provided in the external device of the display device according to the above may be indicated. The display device according to the present embodiment displays, for example, an icon I indicating the remaining amount of battery included in the external device indicated by the acquired data by acquiring data indicating the remaining amount of battery from the external device. To display.

  C1 and C2 shown in FIG. 14 show an example of a screen corresponding to the selected display object displayed when a display object is selected on the reference screen shown in B1 and B2 shown in FIG. . Here, when the screens shown in C1 and C2 in FIG. 14 are displayed, the display in the display device according to the present embodiment shown in A of FIG. 14 is turned off, and again the display device according to the present embodiment. When the display in is turned on, for example, the screen (screen shown in C1 or C2 in FIG. 14) before being turned off is displayed on the display surface of the display device according to the present embodiment. The

  Further, for example, as shown in C1 and C2 in FIG. 14, in the case of a screen on which a sentence (indicated by “xxx...,“ Yyy... In C1 and C2 in FIG. 14) is displayed. In some cases, the entire sentence cannot be displayed on the display surface. When the full text cannot be displayed on the display surface as described above, the display device according to the present embodiment presents the full text to the user by, for example, automatically scrolling and displaying the text. Note that the processing of the display device according to the present embodiment when the entire sentence cannot be displayed on the display surface as described above is not limited to the above. For example, the display device according to the present embodiment may perform scroll display according to an operation signal based on a user operation. Further, in the case where scroll display is performed according to an operation signal based on a user operation, the display device according to the present embodiment may not be automatically scroll-displayed, for example.

  D1 and D2 illustrated in FIG. 14 illustrate an example of a screen corresponding to the selected display object displayed when the display object is selected on the screen illustrated in C1 and C2 in FIG. 14, for example. Here, when the screens shown in D1 and D2 in FIG. 14 are displayed, the display in the display device according to the present embodiment shown in FIG. 14A is turned off, and again the display device according to the present embodiment. When the display at is turned on, for example, a screen (screen shown as D1 or D2 in FIG. 14) before being turned off is displayed on the display surface of the display device according to the present embodiment. The

  E shown in FIG. 14 is an example of a screen corresponding to the selected display object that is displayed when a third-party display object is selected on the reference screens B1 and B2 shown in FIG. Show.

  In the display system 1000 according to the present embodiment, for example, transition of display contents as shown in FIG. 14 is realized by a user operation as shown in FIGS. 13A to 13E, for example.

  For example, the transition of the display content by the user operation as illustrated in FIGS. 13A to 13E is not limited to the example illustrated in FIG. 14. Hereinafter, an example of transition of display contents displayed on the display surface of the display device according to the present embodiment by a user operation as illustrated in, for example, FIGS. 13A to 13E will be described.

  15A to 15H are explanatory diagrams for explaining another example of the display in the display system 1000 according to the present embodiment, and an example of display contents displayed on the display surface of the display device according to the present embodiment. Show.

  FIG. 15A shows an example of transition of display contents when the user performs the “operation to turn on / off the power of the display device according to the present embodiment” shown in FIG. 13E.

  For example, when “the operation of turning on / off the power supply of the display device according to the present embodiment” is performed when the power supply of the display device according to the present embodiment is in an off state, the display device according to the present embodiment is The power is turned on based on an operation signal corresponding to the operation. As a result, the display content of the display surface of the display device according to the present embodiment changes, for example, from the state A1 shown in FIG. 15A to the state A2 shown in FIG. 15A.

  Further, for example, when the operation of turning on / off the display device according to the present embodiment is performed when the display device according to the present embodiment is turned on, the display device according to the embodiment The power is turned off based on the operation signal corresponding to the operation. As a result, the display content of the display surface of the display device according to the present embodiment changes, for example, from the state B1 shown in FIG. 15A to the state B2 shown in FIG. 15A.

  FIG. 15B shows an example of the transition of the display content when the “operation for turning on / off the display on the display surface” shown in FIG. 13E is performed by the user.

  For example, when “display operation on / off the display surface” is performed when the display on the display surface of the display device according to the present embodiment is in the off state, the display device according to the present embodiment Based on the operation signal corresponding to the operation, the display on the display surface is turned on. As a result, the display content of the display surface of the display device according to the present embodiment changes, for example, from the state A1 shown in FIG. 15B to the state A2 shown in FIG. 15B.

  Further, for example, when the “operation for turning on / off the display on the display surface” is performed when the display on the display surface of the display device according to the present embodiment is on, the display device according to the present embodiment performs the operation The display on the display surface is turned off based on the operation signal according to the above. As a result, the display content of the display surface of the display device according to the present embodiment changes, for example, from the state B1 shown in FIG. 15B to the state B2 shown in FIG. 15B.

  Note that, for example, when the display on the display surface of the display device according to the present embodiment is on, the display device according to the present embodiment does not acquire an operation signal corresponding to the “operation for turning on / off the display on the display surface”. Even in this case, the display on the display surface can be automatically turned off. The display device according to the present embodiment is, for example, when no operation signal is acquired even when a predetermined period has elapsed when the display on the display surface of the display device according to the present embodiment is on. Automatically turns off the display on the display surface. When the display on the display surface is automatically turned off, the display content of the display surface of the display device according to the present embodiment changes from the state C1 shown in FIG. 15B to the state C2 shown in FIG. 15B, for example.

  FIG. 15C shows an example of transition of display contents when various operations shown in FIGS. 13A to 13C and 13E are performed on the reference screen shown in B1 and B2 of FIG. FIG. 15D shows an example of transition of display contents when various operations shown in FIGS. 13A to 13C are performed on the screens shown in C1, C2, D1, and D2 in FIG. For example, as illustrated in FIGS. 15C and 15D, the display device according to the present embodiment can change the display content of the display surface of the display device according to the present embodiment to the operation based on the operation signal according to the performed operation. Change to the corresponding content. For example, as shown in A1 and A2 of FIG. 15D, when the screen displays a sentence (indicated by “xxx...,“ Yyy... In A1 and A2 of FIG. 15D) ”. As described above, the display device according to the present embodiment may present the entire sentence to the user by, for example, automatically scrolling the display.

  A shown in FIG. 15E shows an example of transition of display contents when the “decision operation” shown in FIG. 13A is performed on the third-party display object on the reference screen shown in B1 and B2 of FIG. ing. Further, B shown in FIG. 15E indicates, for example, that the screen displayed when the third-party display object shown in E of FIG. 14 is selected is displayed on the “display surface” shown in FIG. 10 shows an example of transition of display contents when an “operation to turn on / off display” is performed. For example, as illustrated in FIG. 15E, the display device according to the present embodiment changes the display content of the display surface of the display device according to the present embodiment to the content corresponding to the operation based on the operation signal according to the performed operation. Change to

  FIG. 15F shows another example of transition of display contents when various operations shown in FIGS. 13A to 13C are performed on the screens shown in C1, C2, D1, and D2 of FIG.

  For example, when the “operation to move to the left” shown in FIG. 13B or the “operation to move to the right” shown in FIG. 13C is performed on the screen indicated by A1 in FIG. 15F, the display device according to the present embodiment is For example, the display content on the display surface is changed to the display content shown in A2 in FIG. 15F or A4 in FIG. 15F. Here, when the display content is changed, the display content after the transition may be display content that does not accept any further “operation to move to the left” or “operation to move to the right”.

  Therefore, in the case where the display content does not accept any further “operation to move to the left”, the display device according to the present embodiment has a direction in which the display content cannot be moved, for example, as illustrated in A3 of FIG. 15F. Change to an expression that stretches in the opposite direction. In addition, when the display content does not accept “an operation to move to the right” any more, the display device according to the present embodiment has a direction in which the display content cannot be moved, for example, as illustrated in A5 of FIG. 15F. Change to an expression that stretches in the opposite direction.

  For example, when the display contents are displayed on the display surface in expressions such as A3 and A5 in FIG. 15F, the user cannot perform any further “operation to move to the left” or “operation to move to the right”. It becomes possible to recognize. Accordingly, the display device according to the present embodiment displays the display content on the display surface with an expression indicating that the operation cannot be performed, for example, as illustrated in A3 and A5 of FIG. Can be made.

  The expression indicating that the operation according to the present embodiment cannot be performed is not limited to the examples illustrated in A3 and A5 in FIG. 15F. For example, the display device according to the present embodiment, such as “expression that shines the edge corresponding to the direction in which no further operation can be performed on the screen”, “expression that displays an arrow directed to the direction in which the operation can be performed on the screen”, etc. The display content may be displayed on the display surface using any expression that can notify the user that the operation cannot be performed.

  Also, for example, as shown in A1 to A5 of FIG. 15F, a screen on which texts (in A1 to A5 of FIG. 15F are indicated by “vvv...”, “Xxx...”, “Yyy...”) Is displayed. In this case, as described above, the display device according to the present embodiment may present the entire sentence to the user by, for example, automatically scrolling the display.

  15A to 15F show an example in which the display device according to the present embodiment transitions display content displayed on the display surface based on an operation signal corresponding to a user operation. However, the processing in the display device according to the present embodiment is not limited to transition of display content displayed on the display surface based on the operation signal.

  For example, the display device according to the present embodiment may change the display content displayed on the display surface based on a set trigger such as reception of a new mail or reception of a new writing such as a tweet. Good. Here, the reception of the e-mail or writing may be, for example, reception in the display device according to the present embodiment, or reception in an external device such as a communication device as illustrated in FIG. Good. The display device according to the present embodiment acquires, for example, the data indicating that the above-described mail or writing has been received or the received data such as the above-described mail or writing from the external device, thereby obtaining the above-described data in the external device. Receiving mail or writing is a trigger.

  FIG. 15G and FIG. 15H show an example of the transition of display contents when a set trigger is detected. Here, FIG. 15G shows an example of transition of display contents when a set trigger is detected when the display on the display surface of the display device according to the present embodiment is in an off state. FIG. 15H shows an example of transition of display contents when a set trigger is detected when display on the display surface of the display device according to the present embodiment is on.

  For example, when the trigger set when the display on the display surface is in the off state is detected, the display device according to the present embodiment displays the display content on the display surface from the state illustrated in A of FIG. The state is changed to a state shown in FIG. 15G corresponding to the detected trigger. When another trigger is detected in the state shown in B of FIG. 15G, the display device according to the present embodiment displays the display content on the display surface from the state shown in B of FIG. 15G. The state is changed to the state shown in FIG. 15G, when the operation signal corresponding to the “decision operation” shown in FIG. 13A is acquired, the display device according to the present embodiment displays the display content on the display surface as follows. The state shown in B and C of FIG. 15G is changed to the state shown in D of FIG. 15G corresponding to the operation signal.

  Further, when the trigger set when the display on the display surface is in the on state is detected, the display device according to the present embodiment detects, for example, as shown in A2, B2, C2, and D2 of FIG. 15H. The icon I corresponding to the triggered trigger is displayed on the display surface.

  For example, the icon I corresponding to the detected trigger is displayed on the display surface, so that the user can recognize that a new mail has been received or a new write has been received. Therefore, the display device according to the present embodiment displays the icon I corresponding to the detected trigger on the display surface as shown in, for example, A2, B2, C2, and D2 in FIG. It can be improved further.

  In the display system 1000, for example, as shown in FIGS. 14 and 15A to 15H, the display is performed on the display surface based on the operation signal corresponding to the user operation as shown in FIGS. 13A to 13E and the detected trigger. The displayed content is transitioned.

  Note that examples of display in the display system 1000 are not limited to the examples illustrated in FIGS. 14 and 15A to 15H. Therefore, another example of display in the display system 1000 will be described next.

[III] Other examples of display in the display system 1000 (i) First example: Display capable of feedbacking operations The display device according to the present embodiment constituting the display system 1000 is, for example, A in FIG. As shown in FIG. 11B and FIG. 11A, “the display device capable of displaying a display object is mounted in front of the user so that the display device is positioned on the user, and the operation device is provided at the side surface of the mounted user. In the case of the “display device”, it is difficult for the user wearing the display device according to the present embodiment to perform an operation while visually checking the operation device on the side. Therefore, for example, a user operation that is not intended for an operation such as an operation device search operation or a hair scuffing operation is detected by the operation device. What happens in the display device can occur. Moreover, there is a possibility that the operability of the user may be reduced by performing the processing not intended by the user as described above in the display device according to the present embodiment.

  Therefore, when the operation signal is acquired, the display device according to the present embodiment feeds back to the user that the operation signal has been acquired. In addition, the display device according to the present embodiment performs processing based on the acquired operation signal after a set time has elapsed since the feedback was started.

  16A and 16B are explanatory diagrams for explaining another example of display in the display system 1000 according to the present embodiment, and it is possible to feed back an operation corresponding to the operation signal acquired to the user. An example of a simple display is shown. Here, A to D shown in FIG. 16A indicate changes in display content displayed on the display surface in time series in the order of A to D. Moreover, AH shown to FIG. 16B have shown the change of the display content displayed on a display surface in time series in order of AH.

  For example, when a “decision operation” for a certain display object is recognized, the display device according to the present embodiment changes the display of the focus frame indicating the selected display object, for example, as shown in FIGS. Let In the example shown in FIG. 16A, the display device according to the present embodiment has the display of the focus frame in the state shown in D of FIG. 16A (that is, when the set time has elapsed since the feedback was started). ), A process corresponding to the “decision operation” is performed.

  Further, the method of feeding back the operation corresponding to the operation signal acquired for the user is not limited to changing the display of the focus frame as shown in FIG. 16A. For example, as shown in FIG. 16B, the display device according to the present embodiment can feed back an operation corresponding to the acquired operation signal to the user by expressing progress. In the example shown in B of FIG. 16, the display device according to the present embodiment is in a state where the expression of progress is in the state shown in H of FIG. 16B (that is, a set time has elapsed since the feedback was started). )), Processing corresponding to the operation indicated by the acquired operation signal is performed.

  16A and 16B show an example in which the display device according to the present embodiment visually feeds back an operation corresponding to the acquired operation signal to the user. The method of feeding back the operation corresponding to the operation signal is not limited to the method of visually feeding back. For example, the display device according to the present embodiment can also provide aural feedback with sound (including music) corresponding to the type of operation. In addition, the display device according to the present embodiment may feed back an operation corresponding to the operation signal acquired for the user by feedback with respect to other senses of the user such as a tactile sensation and an olfactory sense.

  For example, as described above, by feeding back an operation corresponding to the acquired operation signal to the user, the user can recognize that an operation not intended for the operation is detected by the operation device. . In addition, the display device according to the present embodiment performs a process that is not intended by the user by performing a process based on the acquired operation signal after a set time has elapsed after the feedback is started. The possibility of being performed in the display device according to the embodiment is reduced.

  Therefore, by performing the processing as described above, the display device according to the present embodiment can improve user operability.

  Note that the method for preventing the user's operability from being lowered due to the operation device detecting an operation not intended for the operation according to the present embodiment is not limited to the above method.

  For example, in the display system 1000 according to the present embodiment, a user operation (for example, a tap operation or a double tap operation) with a short detection time for detecting that an operation has been performed on the operation device is performed according to the present embodiment. An operation recognized by the display device may not be performed.

  In the display system 1000 according to the present embodiment, for example, the operation recognized by the display device according to the present embodiment is changed depending on the detection time and the detection position where the position where the operation device is operated is detected. May be. As an example of changing the operation recognized in the display device according to the present embodiment depending on the detection time and the detection position, for example, a finger or the like is detected for a time set in the first sensor 22 shown in FIG. For example, “decision” is assigned when the second sensor 24 shown in FIG. 1C is used, and a “cancel” command is assigned when a finger or the like has been detected for a time set for the set time or longer.

(Ii) Second Example: Animation Display For example, as described with reference to FIGS. 14 and 15A to 15H, the display device according to the present embodiment performs user operations as illustrated in FIGS. 13A to 13E. Based on the corresponding operation signal and the detected trigger, the display content displayed on the display surface is changed. When the display content displayed on the display surface is changed, the display device according to the present embodiment can also use animation display.

  17A to 17F are explanatory diagrams for explaining another example of display in the display system 1000 according to the present embodiment, and show an example of animation display.

  FIG. 17A shows an example of an animation display when the display on the display surface of the display device according to the present embodiment is changed from the off state to the on state. Here, A to D shown in FIG. 17A indicate changes in display content displayed on the display surface in time series in the order of A to D.

  When the display operation of the display device according to the present embodiment is in the off state, when the “operation for turning on / off the display on the display surface” illustrated in FIG. The display device turns on the display on the display surface based on the operation signal corresponding to the operation. And the display apparatus which concerns on this embodiment displays a display object on a display surface by the animation display as shown to AD of FIG. 17A, for example.

  When the display on the display surface of the display device according to the present embodiment is changed from the off state to the on state, for example, when an animation display as illustrated in FIGS. Since it does not appear on the display surface, the user's field of view is not interrupted. Further, since the displayed display object does not suddenly appear on the display surface, it is possible to prevent the user's attention from being dispersed by the suddenly appearing display object.

  Therefore, when the display on the display surface of the display device according to the present embodiment is changed from the off state to the on state, for example, by displaying an animation as shown in FIGS. Can be prevented.

  FIG. 17B shows an example of an animation display when the user performs the operation shown in FIGS. 13B and 13C to select a display object on the reference screen shown in B1 and B2 of FIG. Here, A to G shown in FIG. 17B indicate changes in display contents displayed on the display surface in time series in the order of A to G.

  For example, as illustrated in FIGS. 17B to 17G, the display device according to the present embodiment displays the display object on the display surface using, for example, an animation display in which the size of the display object and the transparency of the display object are changed. Let

  FIG. 17C shows an example of the animation display when the user performs “decision operation” shown in FIG. 13A to select a display object on the reference screen shown in B1 and B2 of FIG. Here, A to F shown in FIG. 17C show changes in display contents displayed on the display surface in time series in the order of A to F.

  For example, as illustrated in FIGS. 17C to 17D, the display device according to the present embodiment continuously displays the display object indicated by the operation signal corresponding to the “decision operation” on the display surface longer than the other display objects. Use the display. For example, as illustrated in E and F of FIG. 17C, the display device according to the present embodiment displays the display content corresponding to the display object indicated by the operation signal corresponding to the “decision operation” using the animation display. To display. For example, as shown in F of FIG. 17C, when the screen is a screen on which a text is displayed, as described above, the display device according to the present embodiment automatically scrolls and displays the text. The full text may be presented to the user.

  FIG. 17D shows an example of an animation display when the user performs the “return operation or cancel operation” shown in FIG. 13A when the display content shown in F of FIG. 17C is displayed on the display surface. ing. Here, A to E shown in FIG. 17D show changes in display contents displayed on the display surface in time series in the order of A to E.

  For example, when the display content shown in F of FIG. 17C is displayed on the display surface and the user performs the “return operation or cancel operation” shown in FIG. 13A, the display device according to the present embodiment As shown in A to E of FIG. 17D, display is performed using an animation display opposite to the animation display shown in FIG. 17C (that is, an animation display whose time series corresponds to the order of F to A of FIG. 17C). Transition content.

  FIG. 17E shows an example of an animation display when no operation signal is acquired even when a predetermined period has elapsed when the display on the display surface of the display device according to the present embodiment is on. Yes. The animation display shown in FIG. 17E corresponds to the animation display in a so-called standby state. Here, A to C shown in FIG. 17E show changes in display contents displayed on the display surface in time series in the order of A to C.

  When the display on the display surface of the display device according to the present embodiment is on, if no operation signal is acquired even after the set predetermined period has elapsed, the display device according to the present embodiment is, for example, As illustrated in FIGS. 17C to 17C, the position where each display object is displayed is changed for each display object. For example, as shown in FIGS. 17C to 17C, by changing the display position of each display object for each display object, it is possible to give the user a feeling that each display object is drifting. Become.

  FIG. 17F shows an example of an animation display when the display on the display surface of the display device according to the present embodiment is changed from the on state to the off state. Here, A to D shown in FIG. 17F indicate changes in display contents displayed on the display surface in time series in the order of A to D.

  When the display on the display surface of the display device according to the present embodiment is changed from the on state to the off state, the display device according to the present embodiment performs the animation illustrated in FIG. 17A, for example, as illustrated in FIGS. The display content is changed using an animation display opposite to the display (that is, an animation display whose time series corresponds to the order of D to A in FIG. 17A).

  When the display content displayed on the display surface is changed, the display device according to the present embodiment can use, for example, animation display as illustrated in FIGS. 17A to 17F. Needless to say, the animation display according to the present embodiment is not limited to the examples shown in FIGS. 17A to 17F.

  The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

  For example, in the above description, it has been shown that a program (computer program) for causing a computer to function as the display control apparatus according to the present embodiment is provided. However, in the present embodiment, the recording further stores the program. A medium can also be provided.

  Further, in the display system according to the present embodiment, such as the display system 1000 illustrated in FIG. 11, for example, any of the devices constituting the display system according to the present embodiment serves as the display control device according to the present embodiment. You may play. In addition, the display system according to the present embodiment may further include a display control device according to the present embodiment, for example.

  The configuration described above shows an example of the present embodiment, and naturally belongs to the technical scope of the present disclosure.

The following configurations also belong to the technical scope of the present disclosure.
(1)
A display control unit that controls display of a display object displayed on the display surface in a display device mounted on the user such that a display surface capable of displaying a display object is positioned in front of the user. ,
The display control unit is configured to display at least a part of a trajectory for moving the display object based on an operation signal acquired in response to detection by an operation device provided at a position of a side surface of the user in the display device. A display control apparatus for controlling display of the display object so as to show a trajectory having a vertical component with respect to a surface.
(2)
The display control unit selectively, based on the acquisition state of the operation signal, so that at least a part of the trajectory for moving the display object indicates a trajectory having a vertical component with respect to the display surface. The display control apparatus according to (1), which controls display of the display object.
(3)
The display control unit
When the operation signal is acquired, the display of the display object is controlled so that at least a part of the trajectory for moving the display object has a trajectory having a vertical component with respect to the display surface,
After controlling the display of the display object so that at least a part of the trajectory for moving the display object indicates a trajectory having a vertical component with respect to the display surface, the operation is performed for a predetermined time. When the signal is not acquired, the display of the display object is controlled so that the entire trajectory for moving the display object indicates a trajectory having no vertical component with respect to the display surface. The display control apparatus described.
(4)
When the operation signal is acquired, the display control unit displays at least some of the display objects to be displayed on the display surface so as to have a vertical component with respect to the display surface. The display control apparatus according to any one of (1) to (3).
(5)
The display control unit
One part of the display object to be displayed on the display surface is displayed so as not to have a vertical component with respect to the display surface,
The display control apparatus according to (4), wherein another part of the display object to be displayed on the display surface is displayed so as to have a vertical component with respect to the display surface.
(6)
The display control device according to (4), wherein the display control unit displays the entire display object to be displayed on the display surface so as to have a vertical component with respect to the display surface.
(7)
When the operation signal is not acquired, the display control unit is configured so that the entire trajectory for moving the display object indicates a trajectory having no vertical component with respect to the display surface. The display control apparatus according to any one of (1) to (6), which controls display of
(8)
The display control device according to (7), wherein the display control unit displays the entire display object to be displayed on the display surface so as not to have a vertical component with respect to the display surface.
(9)
When the operation signal is acquired, the display control unit moves the display object by scrolling in the direction corresponding to the operation direction indicated by the operation signal along the trajectory. (1) The display control apparatus as described in any one of-(8).
(10)
When an operation signal according to detection in an operation device other than the operation device provided at the position of the user's side surface in the display device is acquired,
The display control unit does not display the display object so that at least a part of the trajectory for moving the display object indicates a trajectory having a vertical component with respect to the display surface. (1) to (9) The display control apparatus according to any one of the above.
(11)
The display control apparatus according to any one of (1) to (10), wherein the operation device detects an operation input to the operation device by the user or proximity of the user to the operation device.
(12)
A display unit having a display surface capable of displaying a display object, and when the display surface is mounted on a user, the display unit is positioned in front of the user;
An operation unit provided at a position of a side surface of the user when attached to the user;
A display control unit for controlling display of a display object displayed on the display surface;
With
The display control unit indicates a trajectory in which at least a part of the trajectory for moving the display object has a vertical component with respect to the display surface, based on an operation signal acquired in response to detection by the operation unit. A display device for controlling display of the display object.
(13)
The display device according to (12), wherein the operation unit is provided on a temple member positioned at the temple portion of the user when the operation unit is attached to the user.
(14)
The display device according to (12) or (13), wherein the display device is a head mounted display mounted on a user's head.
(15)
A step of controlling display of a display object displayed on the display surface in a display device mounted on the user such that a display surface capable of displaying the display object is positioned in front of the user;
In the controlling step, at least a part of a trajectory for moving the display object based on an operation signal acquired in response to detection by an operation device provided at a position of a side surface of the user in the display device is the display. A display control method for controlling display of the display object so as to show a trajectory having a vertical component with respect to a surface.
(16)
A step of controlling the display of the display object displayed on the display surface in a display device mounted on the user so that a display surface capable of displaying the display object is positioned in front of the user; Let it run
In the controlling step, at least a part of a trajectory for moving the display object based on an operation signal acquired in response to detection by an operation device provided at a position of a side surface of the user in the display device is the display. A program for controlling display of the display object so as to show a trajectory having a vertical component with respect to a surface.

DESCRIPTION OF SYMBOLS 10 Display part 12 Operation part 14 Temple member 16 Bridge member 18 Modern member 20 Pad member 22 1st sensor 24 2nd sensor 100 Display control apparatus 102 Communication part 104 Control part 110 Display control part 1000 Display system

Claims (16)

A display control unit that controls display of a display object displayed on the display surface in a display device mounted on the user such that a display surface capable of displaying a display object is positioned in front of the user. ,
The display control unit moves the display object based on an operation signal acquired in response to detection of an operation instructing movement of the display object in an operation device provided at a position on a side surface of the user in the display device. Controlling the display of the display object so that at least a part of the trajectory indicates a trajectory having a vertical component with respect to the display surface;
The display control unit is configured to display the display object based on an operation signal corresponding to detection of an operation instructing movement of the display object in an operation device other than the operation device provided at a position of the user's side surface in the display device. A display control apparatus that displays the display object such that a trajectory for moving the image indicates a trajectory having no vertical component with respect to the display surface.   The display control unit is configured so that, when the operation signal is acquired, at least a part of a trajectory for moving the display object indicates a trajectory having a vertical component with respect to the display surface. The display control apparatus of Claim 1 which controls a display. The display control unit
When the operation signal is acquired, the display of the display object is controlled so that at least a part of the trajectory for moving the display object has a trajectory having a vertical component with respect to the display surface,
After controlling the display of the display object so that at least a part of the trajectory for moving the display object indicates a trajectory having a vertical component with respect to the display surface, the operation is performed for a predetermined time. The display object is controlled so that an entire trajectory for moving the display object indicates a trajectory having no vertical component with respect to the display surface when a signal is not acquired. The display control apparatus described.   When the operation signal is acquired, the display control unit displays at least some of the display objects to be displayed on the display surface so as to have a vertical component with respect to the display surface. The display control apparatus according to any one of claims 1 to 3. The display control unit
One part of the display object to be displayed on the display surface is displayed so as not to have a vertical component with respect to the display surface,
The display control apparatus according to claim 4, wherein another part of the display object to be displayed on the display surface is displayed so as to have a vertical component with respect to the display surface.   The display control apparatus according to claim 4, wherein the display control unit displays the entire display object to be displayed on the display surface so as to have a vertical component with respect to the display surface.   When the operation signal is not acquired, the display control unit is configured so that the entire trajectory for moving the display object indicates a trajectory having no vertical component with respect to the display surface. The display control apparatus of any one of Claims 1-6 which control the display of these.   The display control device according to claim 7, wherein the display control unit displays the entire display object to be displayed on the display surface so as not to have a vertical component with respect to the display surface.   The said display control part moves the said display object by scrolling in the direction corresponding to the operation direction which the said operation signal shows along the said track | orbit, when the said operation signal is acquired. The display control apparatus of any one of -8.   The display control apparatus according to claim 1, wherein the operation device detects an operation input to the operation device by the user or proximity of the user to the operation device.   The display control apparatus according to claim 1, wherein the display control unit controls display of the display object according to an identification result of an operation device corresponding to the acquired operation signal. A display unit having a display surface capable of displaying a display object, and when the display surface is mounted on a user, the display unit is positioned in front of the user;
An operation unit provided at a position of a side surface of the user when attached to the user;
A display control unit for controlling display of a display object displayed on the display surface;
With
The display control unit has at least a part of a trajectory for moving the display object on the display surface based on an operation signal acquired in response to detection of an operation instructing movement of the display object in the operation unit. Controlling the display of the display object so as to show a trajectory having a vertical direction component,
The display control unit is configured to display the display object based on an operation signal corresponding to detection of an operation instructing movement of the display object in an operation device other than the operation unit provided at a position on the side surface of the user in the display device. A display device that displays the display object such that a trajectory to be moved indicates a trajectory having no vertical component with respect to the display surface.   The display device according to claim 12, wherein the operation unit is provided on a temple member positioned at a temple portion of the user when the operation unit is attached to the user.   The display device according to claim 12 or 13, wherein the display device is a head-mounted display attached to a user's head. A step of controlling display of a display object displayed on the display surface in a display device mounted on the user such that a display surface capable of displaying the display object is positioned in front of the user;
In the controlling step, the display object is moved based on an operation signal acquired in response to detection of an operation instructing movement of the display object in an operation device provided at a position on the side surface of the user in the display device. Display of the display object is controlled such that at least a part of the trajectory to be displayed indicates a trajectory having a vertical component with respect to the display surface;
In the controlling step, the display object is based on an operation signal corresponding to detection of an operation instructing movement of the display object in an operation device other than the operation device provided at a position on the side surface of the user in the display device. A display control method for displaying the display object such that a trajectory for moving the image indicates a trajectory having no vertical component with respect to the display surface. A step of controlling the display of the display object displayed on the display surface in a display device mounted on the user so that a display surface capable of displaying the display object is positioned in front of the user; Let it run
In the controlling step, the display object is moved based on an operation signal acquired in response to detection of an operation instructing movement of the display object in an operation device provided at a position on the side surface of the user in the display device. Display of the display object is controlled such that at least a part of the trajectory to be displayed indicates a trajectory having a vertical component with respect to the display surface;
In the controlling step, the display object is based on an operation signal corresponding to detection of an operation instructing movement of the display object in an operation device other than the operation device provided at a position on the side surface of the user in the display device. The display object is displayed such that the trajectory for moving the image indicates a trajectory having no vertical component with respect to the display surface.