JP6532359B2 - Input device - Google Patents

Description

  The present invention relates to an input device capable of inputting instruction information based on an operation.

  In the past, many devices were stationary and were not supposed to move or change their attitude. However, recently, it has come to cause movement in the equipment. For example, Patent Document 1 discloses a technique for moving an information display device.

Japanese Patent Laid-Open Publication No. 2003-50559 (published on February 21, 2003)

  Moving the display surface while displaying an image is a process that is not usually performed except for the technology as described in Patent Document 1. However, the inventors of the present invention repeated studies based on the idea that various visual effects can be imparted to the image by moving the display surface of the display device during image display. As a result, it was concluded that moving the display surface of the display device during image display can provide effects such as presence and stereoscopic effect as well as the effect of making the content of the image pay attention.

  However, depending on the shape or the use of the case, not only the display device, the user of the device is effective in that it is effective to move the case of the device or change the posture when receiving an operation from the user. It is generally difficult to operate correctly for a given position on the device's housing. It is desirable that even if the housing moves or the posture changes, operation input by intuitive and simple operation is possible. Buttons and touch panels are widely used as conventional input devices, but when the housing moves or the attitude of the housing changes as described above, input using such a conventional input device It will be difficult to do.

  The present invention has been made in view of the above problems, and an object thereof is to realize an input device or the like capable of easily performing an operation input to a housing which moves or changes its posture. is there.

  In order to solve the above-mentioned subject, an input device concerning one mode of the present invention is an input device which can input directions information based on external force applied to a case, and specifies movement or an attitude of the above-mentioned case The instruction information according to a combination of a movement identifying unit, an external force detecting unit detecting the external force, and a movement or posture of the casing specified by the identifying unit and a direction of the external force detected by the external force detecting unit And an instruction determination unit that determines the

  According to one aspect of the present invention, an effect is provided that operation input can be easily performed on a housing whose movement or posture changes.

It is a block diagram which shows an example of a principal part structure of the display apparatus which concerns on Embodiment 1 of this invention. It is a figure which shows the example of an external appearance of a display apparatus. It is a figure explaining an example of the operation | movement mechanism for moving a display apparatus or changing an attitude | position. It is a figure which shows the variation of the housing | casing shape of a display apparatus. It is a figure explaining change of movement or posture according to shape of a case of a display. It is a figure which shows the example of how to move the housing | casing according to an image | video. It is a figure which shows the example of input operation using the operation detection surface provided in the housing | casing of a display apparatus. It is a figure which shows the example which operates a display apparatus using the external force added to the housing | casing. It is a figure which shows the example which operates a display apparatus using the external force added to the housing | casing. It is a figure which shows the example which operates a display apparatus using the external force added to the housing | casing. It is a figure which shows an example of the method a display apparatus detects the external force applied to the own apparatus. It is a flowchart which shows an example of the flow of the process in which a display apparatus detects external force. It is a block diagram which shows an example of a principal part structure of the display apparatus which concerns on Embodiment 2 of this invention. It is a figure which shows the operation example which switches the motion of a display apparatus by operation which lifts a housing | casing. It is a figure which shows the operation example which switches the motion of a display apparatus by operation which lifts a housing | casing. FIG. 13 is a diagram illustrating an example of control for returning the display device to the original posture when the display device is lowered to the original position after the housing is lifted. It is a figure which shows an example of the method a display apparatus detects operation which lifts a housing | casing. It is a figure which shows the operation example which transmits operation instruction | indication from a display apparatus to a smart phone by operation which lifts a housing | casing. It is a figure explaining cooperation with a display apparatus and other devices. It is a figure which shows the other example of the operation | movement mechanism which changes the movement or attitude | position of a housing | casing. It is a block diagram showing an outline of a delivery system concerning one embodiment of the present invention.

  The input device according to the present invention determines an operation instruction (instruction information) according to a combination of the movement or posture of the housing of the own device and the direction of the external force applied to the housing. By this configuration, the user can input an operation instruction by receiving an operation according to the movement or posture of the housing when the housing of the input device is moving or when the posture is changed. It can be performed.

  Hereinafter, although the display device 1 to which the input device according to the present invention is applied is described as an example, the present invention is not limited to this. That is, the display unit 32 is not an essential component of the input device according to the present invention. For example, the input device according to the present invention can be applied to a mouse that transmits an operation instruction to an external device, a touch pad, a remote controller of various devices (such as a television and an air conditioner), and a controller of a game machine. Alternatively, the present invention can be applied to devices such as a microphone (voice input device), a speaker (voice output device), a lighting device, a projection device, a robot device, and a self-propelled cleaner.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to FIGS.

Embodiment 1
(Appearance of display 1)
First, the appearance of the display device 1 will be described with reference to FIG. FIG. 2 is a view showing an example of the appearance of the display device 1. The display device 1 shown in (a) and (b) of FIG. 2 has a configuration in which a display unit 32 is provided in a spherical casing 3. More specifically, the housing 3 is in the shape of a ball that is partially chipped, and the display surface of the display unit 32 is located on the cross section of the chipped portion. That is, the housing 3 has a shape in which a part of the sphere is cut by a plane crossing the sphere, and the circular display surface of the display unit 32 is disposed on the cross section thereof. In other words, the cut-off circular cut surface of the casing 3 having a shape in which a part of the sphere is cut in a plane is the display surface of the display unit 32. Furthermore, if the expression is changed, the housing 3 is a solid (spheroid) obtained by dividing the sphere at a split plane, and a part of the split plane is the display surface of the display unit 32. Although the display surface shown is a flat surface, the display surface may be a curved surface. The shape of the display surface is not limited to a circle, and may be a polygon such as a rectangle, an ellipse, or the like.

  The display device 1 can roll and move along the spherical outer edge of the housing 3 or can rotate the housing to change its posture. Although the details will be described later, the display device 1 can be moved by rolling or sliding using the shape of the housing 3. That is, the display device 1 can change the orientation and the posture of the display surface of the display unit 32 by moving the own device or changing the posture. In addition, when the display device 1 is in a posture in which the display surface faces a desired direction, the display device 1 can stop its movement in that posture and can take a desired posture.

  When the display device 1 is not displaying an image, such as when the display device 1 is powered off, the display surface of the display unit 32 of the display device 1 is oriented in an arbitrary direction. On the other hand, when an image is displayed on the display device 1, as shown in (a) and (b) of FIG. 2, an attitude in which the display surface of the display unit 32 faces a predetermined direction (this state below) May be called a reference posture). That is, the display device 1 changes the posture of the housing 3 to become the reference posture between the start and the start of the display of the video. Thus, the display surface can be directed to the user so that the image displayed on the display unit 32 can be easily viewed. The display device 1 includes an imaging unit (not shown) and an image analysis unit (not shown), and the image analysis unit analyzes an image obtained by imaging the surroundings by the imaging unit, and the user (a user's face etc.) The posture in which the display surface is turned in the direction in which the image is captured may be used as the reference posture. When the vertical direction of the display unit 32 (the vertical direction of the image to be displayed) is set in advance, the housing 3 may be rotated so that the upper end of the display unit 32 is at the uppermost position in the reference posture.

  The display device 1 may move or change the orientation of the display surface while the video is displayed on the display unit 32. For example, it is possible to move the housing 3 while displaying an image on the display unit 32. The housing 3 moves to swing the direction of the display surface vertically and horizontally, or the housing 3 is rotated to display It is also possible to invert the top and bottom without changing the orientation of the face. When the display control unit (not shown) can change the vertical direction or the like of the video displayed on the display unit 32, the display direction of the video may be adjusted after setting the housing 3 as the reference posture. In the display control unit, the movement of the case 3 is performed even when the case 3 of the display device 1 is rotated and the display surface of the display unit 32 is rotated clockwise (or counterclockwise). May be configured to control the display direction of the image in accordance with the above. Thereby, even when the display device 1 is rotating, it is possible to present a non-rotated image to the user.

(Internal configuration of display device 1)
Next, the internal configuration of the display device 1 will be described with reference to FIG. FIG. 1 is a block diagram showing an example of a main part configuration of a display device 1 according to Embodiment 1 of the present invention. The display device 1 includes a control unit 10, a storage unit 20, an output unit 30, and a sensor unit 40. Although not illustrated in FIG. 1, an imaging unit (digital camera or digital video), an audio input unit (microphone), a communication unit (not illustrated), and the like may be included. For example, by providing a communication unit, receiving an application program, video data, audio data and the like distributed via a network such as the Internet, and receiving video data and the like captured by another device Can. Furthermore, by including the imaging unit in the display device 1, the display device 1 can be used as a terminal and a monitor of a videophone with another user.

  The output unit 30 includes an operation mechanism 31, a display unit 32, and an audio output unit 33. Each unit of the output unit 30 operates in accordance with a control instruction from the control unit 10.

  The storage unit 20 is a storage area that stores various application programs executed by the control unit 10, an OS program, a control program, and various data (setting values, tables, etc.) read and used when these programs are executed. It is. In the storage unit 20, an operation instruction rule 21 defining an operation instruction to the display device 1 corresponding to a combination of the movement or posture of the case 3 of the display device 1 and the direction of the external force applied to the case 3. Is stored. The operation instruction rule 21 includes the movement or posture of the housing 3 of the display device 1, an operation by an external force applied to the housing 3, and a predetermined object (a face of the image displayed on the display unit 32). An operation instruction to the display device 1 may be defined in correspondence with a combination with an expression or the like. In the storage unit 20, as an application program, a video management application (not shown) for managing a video displayed on the display unit 32, an application (not shown) for controlling the movement or posture of the housing 3, etc. May be stored. The operation instruction rule 21 will be described later by giving a specific example.

  The control unit 10 includes an operation data generation unit 11, a motor control unit 12, an external force detection unit 13 (movement identification unit), and an operation instruction determination unit 14 (instruction determination unit). In order to simplify the description, the display control unit that controls the display unit 32 and the voice control unit that controls the voice output from the voice output unit 33 are not shown.

  The movement data generation unit 11 generates movement data for controlling at least one of the movement and the posture of the housing 3 by driving the movement mechanism 31. The illustration exemplifies a configuration in which the operation data generation unit 11 generates operation data based on sensor information obtained from the sensor unit 40 and indicating the state of the surroundings such as the position of the user. That is, the operation data is data for controlling the movement of the housing 3. The motion data generation unit 11 may analyze the video displayed on the display unit 32 and generate motion data according to the video as described later, or may use motion data received from another device. It is also good.

  The motor control unit 12 drives the operation mechanism 31 in accordance with the operation data acquired from the operation data generation unit 11. The operation mechanism 31 included in the display device 1 will be described later.

  The external force detection unit 13 acquires operation data (state information) for controlling the movement or attitude of the housing 3 from the operation data generation unit 11, and detects the detection result from the sensor unit 40 (for example, the gyro sensor 41). Acquire and identify the movement or posture of the housing 3. The external force detection unit 13 detects an external force applied to the housing 3 based on the displacement between the movement or posture of the housing 3 indicated by the operation data and the detection result of the gyro sensor 41. Note that the external force detected by the external force detection unit 13 may be an external force that changes the movement or the posture of the housing 3. The external force detection unit 13 may detect the direction of the external force in addition to the presence or absence of the external force. The display device 1 further includes an acceleration sensor (not shown) for detecting the acceleration generated in the housing 3, and the external force is applied based on the change in acceleration of the housing 3 generated by the external force applied to the housing 3. It may be detected. The external force detection unit 13 detects the direction of the external force applied to the housing 3 using the inclination (angle, posture information) of the housing 3 measured by the gyro sensor 41, as a specific example later. To explain.

  The operation instruction determination unit 14 acquires, from the external force detection unit 13, information regarding the movement or posture of the housing 3 and the direction of the external force applied to the housing 3 (or the presence or absence of the external force). When the operation by the external force applied to the housing 3 is detected, the operation instruction determination unit 14 refers to the operation instruction rule 21 for the operation instruction corresponding to the combination of the operation and the movement or posture of the housing 3. Decide.

  As described above, the display device 1 can receive an input of an operation instruction for instructing various operations based on the application of an external force to the housing 3. Therefore, the user can input instruction information by an operation suitable for the movement or posture of the housing of the input device.

  In the display device 1, it is conceivable that the housing 3 of the display device 1 is moving or the attitude is changed when receiving an operation from the user. In such a display device 1, it is difficult for the user to operate the predetermined position on the housing 3 correctly. By configuring as described above, the user can input an operation instruction based on a simple and intuitive operation to the display device 1.

(Operation mechanism)
Subsequently, an operation mechanism for moving or changing the posture of the display device 1 will be described based on FIG. FIG. 3 is a diagram for explaining the operation mechanism 31 provided in the display device 1. (A) and (b) of FIG. 3 are displays in a plane perpendicular to the display surface of the display unit 32 and passing through the center of the housing 3 (a point at the same distance from the surface of the housing 3 which is a part of a spherical surface) It is a figure which shows the cross section of the apparatus 1, and (c) of FIG. 3 is a perspective view which shows the structure of the operation | movement mechanism 31. FIG. Although not shown in FIG. 3, the inside of the housing 3 includes a power source for operating the operating mechanism 31 as well as a configuration for displaying an image on the display unit 32 in addition to the operating mechanism 31. It is done. Further, the components shown by broken lines in (c) of FIG. 3 are the components housed inside the housing 3 (the inside of the housing 3).

  As shown in (a) to (c) of FIG. 3, an operation mechanism 31, a control unit 10, and a gyro sensor 41 for detecting the inclination of the case 3 are provided inside the case 3 of the display device 1. It is done. The operation mechanism 31 includes a shaft 311, a motor 312, a support 313, a weight 314, and a guide rail 315. In the following, an axis perpendicular to the display surface of the display unit 32 is Z axis, an axis perpendicular to the paper is X axis, and an axis perpendicular to the Z axis and the X axis ((a) to (c) The description will be made assuming that the axis parallel to the axis 311 is the Y axis.

  The shaft 311 supports the motor 312. The shaft 311 is a straight rod-like support, and the motor 312 is fixed at the center in the longitudinal direction. More specifically, the shaft 311 is provided to pass through the center of the housing 3. For this reason, the length of the shaft 311 is equal to the diameter of the spherical housing 3, and the rotation shaft of the motor 312 attached to the longitudinal center of the shaft 311 is located at the center of the housing 3.

  The motor 312 is fixed to the shaft 311 such that the rotation shaft is positioned at the center of the housing 3 as described above. The motor 312 may be, for example, a stepping motor. The motor 312 is driven by receiving power supplied from a power supply (not shown). Further, a support 313 is attached to the rotation shaft of the motor 312, and by driving the motor 312, the support 313 can be rotated in any direction about the X axis with the rotation shaft as a fulcrum. It is supposed to be.

  The post 313 is a linear support for supporting the weight 314, one end of which is connected to the rotation shaft of the motor 312 and the other end of which is connected to the weight 314. When the column 313 is rotated by the motor 312, the position of the weight 314 supported by the column 313 changes, as shown in FIG. And thereby, the position of the gravity center of the display apparatus 1 changes, the housing | casing 3 rolls along a ground-contact plane, and the display surface of the display part 32 moves.

  The weight 314 is a weight for changing the position of the center of gravity of the display device 1. As described above, it is connected to one end of the column 313, and the position of the weight 314 inside the housing 3 changes with the rotation of the column 313, whereby the position of the center of gravity of the display device 1 changes. It is supposed to be.

  The guide rail 315 is for rotating the axis 311 around the Z axis, and is disposed parallel to the display surface of the display unit 32 along the inner wall of the housing 3. Both ends of the shaft 311 are movably connected to the guide rail 315 on the guide rail 315. Then, the motor control unit 12 drives a motor (not shown) to move both end portions of the shaft 311 on the guide rails 315, so that the shaft 311 can be rotated around the Z axis with the center of the housing 3 as a rotation axis. It can be rotated in either direction.

  Next, the operation of the operation mechanism 31 will be described in more detail. As shown in (a) of FIG. 3, the motor control unit 12 drives the motor 312 to support the column 313 in parallel with the Z axis, so that the weight 314 is at the center of the display surface of the display unit 32. It is possible to position the display surface of the display unit 32 directly upwards by positioning the unit directly below the unit.

In addition, as shown in (b) of FIG. 3, the motor control unit 12 can drive the motor 312 to support the support 313 in a state of being inclined by θ with respect to the Z axis. In this case, as shown in FIGS. 3A and 3B, the length of the column 313 is L, the height of the weight 314 is T, the width of the weight 314 is W, and the display 32 is displayed from the center of the sphere. Assuming that the distance to the surface is K, and the weight 314 can move to the position where the weight 314 contacts the display surface of the display unit 32 from the inside of the housing 3, the rotation angle θ is
θ = arcsin [K− {W / 2 + (L + T)}]
It can be expressed as.

  Therefore, if K> W / 2, it becomes possible to set θ> 90 °. Therefore, the housing 3 is shaped such that K has a positive value (the shape of the side including the center of the sphere out of the two solid bodies (spheroid) generated by dividing the sphere at the split plane), and K By setting> W / 2, it is possible to tilt the column 313 to the range of θ> 90 °. In other words, of the hemisphere and the ball stand produced by dividing the case 3 by a plane passing through the center of the case 3 and parallel to the display surface of the display unit 32, a shape capable of moving the weight 314 inside the ball stand The column 313 can be inclined to the range of θ> 90 ° by using the housing 3 and the weight 314 of the above.

  And thereby, as shown to (b) of FIG. 3, it is displayed to the extent that the display surface of the display part 32 turns downward (The angle which the ground plane and the display surface of the display part 32 make becomes less than 90 degrees.) It is possible to tilt the display surface of the section 32. The motor control unit 12 can also swing the display surface of the display unit 32 with a swing width of 180 ° or more by causing the support column 313 and the weight 314 to perform a pendulum motion by controlling the motor 312. . In this way, the casing 3 is swung up and down, and the orientation of the display surface of the display unit 32 is changed up and down, so that it is expressed by gestures indicating anthropomorphic "nod" and "agreement" etc. Is possible. In addition, it is also possible to express the human body by the gesture indicating “person feeling upset”, “rejection” or the like by swinging the case 3 left and right and changing the direction of the display surface of the display unit 32 right and left. It is possible. An example of controlling the movement or posture of the housing 3 in accordance with the image displayed on the display unit 32 in this manner will be described later.

  Also, as described in FIG. 3C, the shaft 311 can be rotated around the Z axis along the guide rail 315. Therefore, by combining the rotation of the shaft 311 and the movement of the column 313 and the weight 314 by the motor 312, the weight 314 can be placed at an arbitrary position on the spherical surface at a distance L from the center of the housing 3 inside the housing 3. It can be moved. This makes it possible to move the display surface of the display unit 32 with a complex motion that is not limited to swinging and rotation in one direction.

  Further, as in the example of FIG. 3, when the casing 3 is shaped such that K has a positive value, the connection angle α between the casing 3 and the display surface of the display unit 32 should be larger than 90 °. Can. Thereby, the impact and pressure applied from the outside of the housing 3 to the connection portion between the housing 3 and the display surface of the display unit 32 are distributed to both the housing 3 and the display surface of the display unit 32. Becomes possible. For example, when the display device 1 is accidentally dropped to a floor or the like, the risk of breakage of the connection portion can be reduced.

  In addition, when K is a positive value, the shape of the cross section which cut | disconnected the housing | casing 3 in the surface perpendicular | vertical to the display surface of the display part 32 is two figures (dividing circle) obtained by dividing a circle by a dividing line. Among them, it can be said that the shape of the side including the longer arc (superior arc) is included.

(About the shape of the housing 3 of the display device 1)
Next, the shape of the housing of the display device 1 will be described with reference to FIG. FIG. 4 is a view showing a variation of the housing shape of the display device 1. The display devices 1 of (a) to (c) of FIG. 4 are common in that they all have a spherically-shaped case 3 in which a part of a sphere of diameter D is cut away, but The positions of the notches (the distance from the center of the housing 3 to the display surface of the display unit 32) are different. That is, in the display device 1 of (a) of FIG. 4, the height from the ground plane to the display surface of the display unit 32 is H1 when the display surface of the display unit 32 is directed upward. The display device 1 of (b) of 4 is different in that the height is H2 and the height of the display device 1 of (c) of FIG. 4 is H3 (H2>H1> H3).

  More specifically, the display device 1 of (c) of FIG. 4 has a hemispherical casing 3 obtained by cutting a sphere at a split plane passing through the center, and the height H3 is , Equal to the radius of the sphere (D / 2). Further, the height H1 of the display device 1 of (a) of FIG. 4 is equal to 2D / 3, and the height H2 of the display device 1 of (b) of FIG. 4 is equal to 3D / 4.

  The height H of the display device 1 may be appropriately set in the range of D> H. However, since the impression received from the appearance of the display device 1 changes depending on the value of the height H, it is preferable to set the height H in consideration of this point. For example, as an appearance of the display device 1 viewed from the side, it is recognized that the display device 1 of (a) of FIG. 4 has a shape in which a part of a circle is cut. On the other hand, when the height is close to D as in the display device 1 of FIG. 4B, it can be recognized as if it is an ellipse or a distorted circle (sphere).

  The size of the display surface of the display unit 32 also changes according to the value of the height H. For example, in the example of FIG. 4, the display surface of the display unit 32 of (c) of FIG. 4 is the widest, and the display surface of the display unit 32 of (a) of FIG. The display surface of the display unit 32 is narrower. Although not shown, the height H may be less than D / 2. In this case, the smaller the height H, the narrower the display surface of the display unit 32. That is, from the viewpoint of widening the display surface of the display unit 32, it is preferable to set the height H to D / 2 or a value close thereto.

  Furthermore, the range in which the orientation of the display surface of the display unit 32 can be changed, and the stability when the display device 1 is installed, also change depending on the value of the height H. This will be described based on FIG. FIG. 5 is a diagram for explaining the movement or the change of the posture according to the shape of the housing 3 of the display device 1. (A) to (c) in FIG. 5 show the movement or posture of the display device 1 where H> D / 2, and in (d) to (f) in FIG. 5, H ≦ D / 2. The movement or posture of the display device 1 is shown.

  In the case 3 of the display device 1 with H> D / 2, as shown in FIG. 5B, the display surface of the display unit 32 is vertically oriented (horizontal to the ground plane), as shown in FIG. As shown in a), the display surface of the display unit 32 is configured to be capable of rolling to a state in which the display surface is directed in the horizontal direction (perpendicular to the ground surface). Strictly speaking, as described above with reference to FIG. 1, in addition to the condition of H> D / 2, the condition of K> W / 2 needs to be satisfied. As described above, in the display device 1 with H> D / 2, the display surface of the display unit 32 can be swung with a large swing width of 180 ° or more as shown by the arrow shown in FIG. 5B. .

  Further, by rotating the shaft 311 from the state of (a) of FIG. 5, as shown in (c) of FIG. It is also possible to move the display device 1 linearly. That is, the display device 1 with H> D / 2 can move by rotating and rolling the housing 3.

  On the other hand, it is difficult for the display device 1 with H ≦ D / 2 to be tilted until the display surface of the display unit 32 is perpendicular to the ground surface, as shown in (d) of FIG. For this reason, as shown to (e) of FIG. 5, a fluctuation width becomes less than 180 degrees, and becomes a small thing compared with the example of (b) of FIG. In addition, since the angle between the display surface of the display unit 32 and the ground contact surface is larger than 90 °, when the shaft 311 is rotated with the display surface of the display unit 32 being maximally inclined, (f of FIG. As shown in), the locus of the contact point is arc-shaped. That is, the display device 1 with H ≦ D / 2 moves within a certain range.

  In addition, the movable range of the display surface of the display part 32 spreads, so that H is enlarged (as it approaches H to D). Further, as described above with reference to FIG. 1, by increasing H, the connection angle α between the display surface of the display unit 32 and the housing 3 is increased, so that the tolerance of the display device 1 to impact is enhanced. it can. However, as H is increased, the area of the display surface of the display unit 32 becomes smaller, and when it is installed, it becomes easy to roll. In consideration of the above, it is preferable to set the height of the display device 1 to 2D / 3 as in the example of FIG. 3A. When the height is 2D / 3, the distance from the center of the housing 3 to the display surface of the display unit 32 is 1/3 of the radius (D / 2) of the sphere.

  In addition, although the housing | casing 3 of the display apparatus 1 which has a spherical part shape was demonstrated here, the display apparatus 1 is not limited to these shapes. A variation of the shape of the housing of the display device 1 will be described later by giving a specific example (see FIG. 20).

(How to move the case 3 according to the image)
As described above, the display device 1 may be configured to control the movement or posture of the housing 3 of the display device 1 according to the image displayed on the display unit 32. Since the orientation of the display surface of the display unit 32 can be changed by moving the housing 3, the display device 1 uses the movement to add various items related to the image in addition to the image being displayed. Information can be conveyed to the user. An example of how to move the housing 3 according to the image displayed on the display unit 32 will be described with reference to FIG. FIG. 6 is a diagram showing an example of how to move the housing 3 according to the image. The left side of FIG. 6 shows an image to be displayed, and the right side of the arrow shows an example of the movement of the housing 3 of the display device 1 according to each image. In addition, the movement shown here is an example, and it may be comprised so that another movement may be performed according to the shape of the housing | casing 3 of the display apparatus 1, and the variation of a possible movement.

  The display device 1 can move the housing 3 as shown on the right side of FIG. 6 while displaying an image as shown on the left side of FIG. 6 on the display unit 32. By operating the operation mechanism 31 using the operation data corresponding to the movement of the housing 3, the movement of the housing 3 interlocked with the video as shown in FIG. 6 is realized. The operation data is data indicating the movement of the housing 3. The display device 1 may use, for example, operation data generated by analyzing a video to be displayed or the like, or sensor information obtained by the sensor unit 40 (refer to FIG. 1) indicating the surrounding state such as the position of the user. The motion data generated based on the data may be used, or motion data received from another device may be used.

  As shown in (a) of FIG. 6, when the person in the image displayed on the display unit 32 is nod, the movement of the head of the person in the image is simulated (as if the display of the display unit 32 The housing 3 may be moved as if the surface is the face of the display device 1). In the illustrated example, the display surface of the display unit 32 is also moved so as to fall forward in response to the motion of falling down in front of the head of the nodded person. While the motion of the person in the image is flat, by moving and expressing the housing 3 in this manner, it is possible to convey a nod in a more emphasized manner than the image.

  Further, as shown in (b) of FIG. 6, the display surface of the display unit 32 may be moved according to the expression of the person in the displayed video. In the illustrated example, when the facial expression of the person in the image turns into a smiley expression, the housing 3 of the display device 1 circularly moves clockwise and counterclockwise when viewed from directly above It is moving as it is.

  As in this example, when the person in the video has a predetermined facial expression, the motor control unit 12 (see FIG. 1) may move the housing 3 in a motion associated in advance with the facial expression. The predetermined facial expression is not limited to smile, and the movement associated with the facial expression is not particularly limited. However, it is preferable that the movement associated with the expression be a movement that matches the image of the expression. For example, in the case of a gentle expression such as smile, it is preferable to make the corresponding movement also a gentle rocking, and in the case of an expression based on a violent emotion such as anger, it is preferable that the corresponding movement also be a violent movement . The violent movement is, for example, increasing the swing width or increasing the moving speed. The target for detecting an expression from the displayed image is not limited to a person, and may be a character such as an animation.

  Alternatively, as shown in (c) and (d) of FIG. 6, the housing 3 may be moved according to the direction of the line of sight of the person in the video (movement of the black eye). In the illustrated example, when the person in the image moves to the left, the housing 3 is moved so that the display surface of the display unit 32 faces the same direction as the line of sight of the person, and the line of sight of the person in the image is upward In the case of moving to the position, the housing 3 is moved so that the display surface of the display unit 32 faces upward as well as the line of sight of the person.

  As in these examples, the motor control unit 12 may move the display surface of the display unit 32 according to the movement of a predetermined object in the displayed image. In the example of FIG. 6A, the head (or face) of the person, and in the examples of FIGS. 6C and 6D, the black-eye portion of the person is a predetermined object. The object is not limited to these examples as long as the object occupies a predetermined range in the video. For example, the entire body of the person in the image may be an object, and the case 3 may be moved according to the movement of the person's body. In this case, when the person in the image moves to the right, the case 3 is also You may move so as to turn to the same direction. Note that the predetermined object may be an animal other than a human, or may be an object (non-living). In addition, it may be a virtual object such as an animation character. Alternatively, the display device 1 may display a predetermined face on the display unit 32. By displaying a predetermined face on the display unit of the display unit 32, the display device 1 communicates with the user by the change of the facial expression to be displayed and the movement of the housing 3 associated with the facial expression. It can be rich.

  Further, as shown in (e) of FIG. 6, the housing 3 may be moved according to the content of speech of a person (calling party) in the displayed video. In the illustrated example, when the person in the image utters surprise, the case 3 is moved to fall backward to emphasize and convey the surprise of the person. In addition, when what kind of content utterance is performed, movement of the housing | casing 3 matched with the content of utterance is not specifically limited.

  In the example shown in (f) of FIG. 6, a video in which the character is angry is displayed, and at this time, a motion associated in advance with this video (for example, a pattern in which the housing 3 is vigorously rocked back and forth The housing 3 is moved by). As described above, by predetermining the movement according to the video, the housing 3 can be moved by the movement according to the displayed video without analyzing the contents of the video.

  As described above, the housing 3 can be moved by the movement according to the displayed image, but for the video corresponding to the same emotion, the housing 3 is moved by the movement of the same pattern. Is preferred. For example, even if it can be determined that the person is angry from the movement of the person in the video, it can be determined that it is angry from the expression, and it can be determined that It is preferable to move the housing 3 in the same pattern as the example shown in f). Thereby, it is possible to make the user correctly recognize that the movement of the pattern indicates the emotion of anger, the display device 1 has the emotion, and the emotion is expressed by moving the housing 3 It is possible to give the user a sense of feeling.

  The predetermined emotion is not limited to anger. Further, as in the above-described example of the expression, the movement (pattern of movement) to be associated with the emotion is preferably one that matches the image of the emotion, but the type of movement to be associated is not particularly limited. Furthermore, the emotion corresponding to the image may be specified from the scene being displayed as long as the image has a story character. Thus, for example, when a feeling of sadness is associated with a movement that depresses the display surface of the display unit 32, when displaying a crying character, when a person in the video is crying, and a sad scene It is also possible to move the housing 3 to depress the display surface of the display unit 32 when displayed. Besides this, the movement of the housing 3 may be determined in consideration of the sound to be output. For example, the pattern of movement may be determined from the video, and the speed of movement may be determined according to the tempo, volume, etc. of the audio.

  The case 3 may be moved at a timing related to the display, and the timing for moving the case 3 is not limited to the timing at which the video of the predetermined content is displayed as in the above examples. For example, the housing 3 may be moved when the user performs a predetermined operation on the display device 1. Alternatively, for example, the presence of a person around the display device 1 may be detected, and the housing 3 may be moved so that the display surface of the display unit 32 faces the detected person. Furthermore, for example, when a plurality of users make a telephone call by videophone, each user may use the display device 1 for himself / herself as a monitor of the videophone, and the movement of the casing 3 of each display 1 The housing 3 of each display device 1 may be moved so as to synchronize with each other. In this case, the display device 1 may generate operation data indicating the movement of the case 3 in the display device 1 in which the case 3 is moved, and transmit the operation data to another display device 1. The movement of the display surface of the display unit 32 of each display device 1 can be synchronized.

(Operation detection surface 43)
An operation detection surface 43 that receives an input operation by the user may be provided on the surface of the housing 3 of the display device 1. FIG. 7 is a diagram showing an example of an input operation on the display device 1 using the operation detection surface 43. As shown in FIG. As shown in (a) of FIG. 7, in the display device 1, the operation detection surface 43 is provided on a part of the surface of the housing 3.

  A contact sensor for detecting contact with the user's body is disposed on the operation detection surface 43, and when the user's finger or the like contacts a portion of the operation detection surface 43 of the housing 3, the touched position and its movement , The number of touched positions, and the timing when touch starts and when it deviates.

  More specifically, in the case where the operation detection surface 43 divides the housing 3 into two in a plane parallel to the display surface of the display unit 32 through the center of the housing 3 in the surface area of the housing 3, the display unit 32 And a region on a spherical band sandwiched between the surface and the display surface of the display unit 32. Here, although an example in which the entire surface of the region is used as the operation detection surface 43 will be described, a part of this region may be used as the operation detection surface 43.

  When the operation detection surface 43 is provided in this area, as illustrated, when the user holds the hemisphere on the side of the display unit 32 of the housing 3 on which the display surface is not provided, the display unit 32 displays As the face faces the user, the operation detection face 43 also faces the user. As a result, the user can hold the housing 3 of the display device 1 in hand and perform input operation on the operation detection surface 43 while looking at the display surface of the display unit 32.

  Although the content of the input operation received by the operation detection surface 43 is not particularly limited, for example, the input operation as illustrated in (b) to (g) of FIG. 7 may be received. FIG. 7B shows an example in which an operation of touching the operation detection surface 43 with a finger and immediately thereafter releasing the touched finger from the operation detection surface 43 is accepted as a single click (tap) operation. Further, (c) of FIG. 7 shows an example in which when the operation of (b) of FIG. 7 is performed twice in a row, these operations are accepted as double-click (tap) operations.

  Furthermore, in (d) of FIG. 7, an operation of touching a finger on two places of the operation detection surface 43 and immediately thereafter releasing the touched finger from the operation detection surface 43 is output an image on the display surface of the display unit 32 The example which receives as screen ON operation to make it show is shown.

  Further, in (e) of FIG. 7, an operation of sliding at least one of the fingers touched at two places of the operation detection surface 43 along the operation detection surface 43 to widen the interval of the contact position is a zoom of the display content An example of accepting as an out (reduction) operation is shown. Then, in (f) of FIG. 7, an operation of sliding at least one of the fingers whose fingers are touched at two positions of the operation detection surface 43 along the operation detection surface 43 to narrow the distance between the contact positions is displayed. An example is shown that is accepted as a zoom-in (magnification) operation of.

  Further, in (g) of FIG. 7, an example in which an operation of touching two places on the operation detection surface 43 and sliding both fingers along the operation detection surface 43 is accepted as a rotation operation of the display content It shows.

(Example of switching the speed to play back an image)
Next, an example of use of the display device 1 will be described with reference to FIG. FIG. 8 is a diagram showing an example in which the display device 1 is operated using an external force applied to the housing 3. (A) of FIG. 8 is an operation instruction rule 21 defining an operation instruction described here, and (b) to (d) of FIG. 8 are diagrams for explaining the operation instruction corresponding to the detected external force. is there.

  In the example shown in FIG. 8A, when the housing 3 is swinging to the right, an external force (the direction of the external force is such that the housing 3 is inclined in the same direction (forward direction) as the swing direction When the forward direction is added, the playback speed of the image displayed on the display unit 32 is increased. On the other hand, when an external force (the direction of the external force is reverse) is applied to the housing 3 in the direction (reverse direction) opposite to the swing direction, the reproduction speed of the image displayed on the display unit 32 is reduced. As described above, the external force detected when the housing 3 is swung left and right without changing the orientation of the display unit 32 is the direction (forward direction) according to the swing or the opposite direction (opposite direction). Different operation instructions are associated depending on whether the

  (B) of FIG. 8 shows a state where the housing 3 is swung to the right while reproducing (displaying) an image shown on the left side of the drawing. At this time, as shown in FIG. 8C, when an external force is applied to move the housing 3 in the forward direction, the playback speed of the video being played back is increased (for example, double speed playback). On the other hand, as shown in FIG. 8D, when an external force is applied to move the housing 3 in the reverse direction, the playback speed of the video being played back is reduced. In addition, when an external force that stops the rocking is applied, the reproduction of the video may be stopped.

  When the housing 3 is swinging to the left and right, it is difficult to perform an operation on a predetermined position (an operation button or the like) of the housing 3. As described above, if an operation instruction by applying an external force to the housing 3 to change the rocking of the housing 3 of the display device 1 can be input, as described above, Convenience can be improved.

  Here, an example in which the housing 3 is swung from side to side when reproducing an image is shown, but it may be up and down, rotation, or the like.

(Example of operation to switch facial expression)
Subsequently, another use example of the display device 1 will be described with reference to FIG. FIG. 9 is a diagram showing an example in which the display device 1 is operated using an external force applied to the housing 3. (A) of FIG. 9 is an operation instruction rule 21 which defines the operation instruction described here, and (b) to (d) of FIG. 9 are diagrams for explaining the operation instruction corresponding to the detected external force. is there.

  In the example shown in FIG. 9A, the display unit 32 displays the true face, and when the case 3 is swung downward, the case is moved in the same direction (forward direction) as the direction of the swing. When an external force (for example, the direction of the external force is forward) in which 3 is inclined is applied, the face (for example, the face of the robot) displayed on the display unit 32 is switched to the smileed face and displayed. On the other hand, when an external force (the direction of the external force is the forward direction) is applied such that the housing 3 is inclined in the direction (reverse direction) opposite to the swing direction, the face displayed on the display unit 32 is angry Switch to face and display. As described above, the external force detected when the housing 3 is moving so that the direction of the display unit 32 swings up and down is the direction (forward direction) according to the swing or the opposite direction (opposite direction) Different operation instructions are associated depending on whether the

  (B) of FIG. 9 shows a state where the housing 3 is swung downward while displaying the face shown on the left side of the drawing. At this time, as shown in (c) of FIG. 9, when an external force is applied to move the housing 3 in the forward direction, the displayed face is a smiling face. On the other hand, as shown in (d) of FIG. 9, when an external force is applied to move the housing 3 in the reverse direction, the displayed face becomes an angry face. Note that when an external force is applied to stop swinging, the displayed face may be switched to a surprised face.

  Thus, when the external force in the same direction as the direction of movement of the case 3 is applied while the case 3 is moving, the expression when it is fun is displayed; When an external force in the direction opposite to the direction of movement is applied, the expression of the time when the user leans is displayed. Thereby, the user can be made to feel as if the display device 1 has an emotion.

  In addition, although the example which the case 3 rock | fluctuates up and down was shown here, left-right rocking | fluctuation, a vibration, rotation, etc. may be sufficient. Further, although the case where the operation instruction is different depending on whether the external force applied to the housing 3 is forward or reverse with respect to the direction of movement of the housing is illustrated here, the present invention is not limited thereto. That is, even if the operation instruction is configured to be different based on the relative relationship between the direction of movement of the case and the direction of the external force applied to the case 3 (for example, the angle between the two directions). Good.

  Furthermore, while the example in which the housing 3 is swung up and down when displaying the true face on the display unit 32 is shown here, the housing 3 may perform another movement. , May be stopped.

(Example of game character operation etc.)
Then, the other usage example of the display apparatus 1 is demonstrated using FIG. FIG. 10 is a diagram showing an example in which the display device 1 is operated using an external force applied to the housing 3. (A) and (b) of FIG. 10 are operation instruction rules 21 which define the operation instruction described here, and (c) to (e) of FIG. 10 indicate the operation instructions corresponding to the detected external force. It is a figure explaining.

  In the example shown to (a) of FIG. 10, the case where the user is playing the competitive game using the display apparatus 1 is shown. The control unit 10 executes the application program of the game stored in the storage unit 20 and causes the display unit 32 to display the character of the game. As shown in (c) of FIG. 10, the housing 3 of the display device 1 vibrates the housing 3 when the character is in the state of battle preparation which is neither attack nor defense. In addition, it is not essential that the housing 3 is vibrating, and may be swung left and right or up and down, or may be rotating or rolling. In addition, the housing 3 may be stopped to be in a predetermined posture.

  As shown in (d) of FIG. 10, when an external force that shakes the housing 3 is applied while the housing 3 is vibrating, an attack is made on the opponent of the game, and The posture of the character displayed on the display unit 32 (for example, the posture of the fighter) is switched to the attack posture and displayed. On the other hand, as shown in (e) of FIG. 10, when an external force that stops the vibration (for example, pressing the housing 3) is applied, the player is protected from the attack of the opponent and displayed on the display unit 32. Display the posture of the character you are switching to the defensive posture.

  Alternatively, as in the example shown in FIG. 10B, the user can use the display device 1 to play a race (driving of a car, a motorbike, etc.) game. The housing 3 of the display device 1 vibrates the housing 3 during the game. For example, when an external force is applied to shake the housing 3 to the left while the housing 3 is vibrating, the road surface and the surrounding scenery displayed on the display unit 32 are turned to the left. Switch to video and display. On the other hand, when an external force that stops the vibration is applied, the image is switched to an image indicating that the vehicle has stopped (for example, the movement of the road surface and surrounding scenery displayed on the display unit 32 is stopped).

  Thus, it is also possible to use the display device 1 as a game controller.

(Process of detecting external force applied to display device 1)
Next, processing for detecting an external force applied to the display device 1 will be described with reference to FIGS. 11 and 12. FIG. 11 is a diagram showing an example of a method in which the display device 1 detects an external force applied to its own device. FIG. 12 is a flowchart illustrating an example of the flow of processing in which the display device 1 detects an external force. Here, the case of detecting the direction of the external force that changes the movement or the posture of the housing 3 will be described. An external force that does not change the movement or posture of the housing 3 can be detected by the operation detection surface 43 or the like.

  When the operation data acquired from the operation data generation unit 11 is acquired, as shown in (a) of FIG. 11, the motor control unit 12 drives the operation mechanism 31 to tilt the housing 3 by the angle α. The external force detection unit 13 acquires the angle α (state information) indicated by the operation data from the operation data generation unit 11 (step 1 in FIG. 12 (hereinafter referred to as S1)), and the inclination angle of the housing 3 to the gyro sensor 41 β (posture information) is acquired, and the movement or posture of the housing 3 is specified (S2 in FIG. 12: specifying step).

  When no external force is applied to the housing 3, the angle β indicated by the gyro sensor 41 is equal to the angle α indicated by the operation data generated by the operation data generation unit. If the angle α is equal to the angle β (YES in S2 of FIG. 12), the external force detection unit 13 determines that the external force applied to the housing 3 is not detected, and the process returns to S1.

  On the other hand, when an external force is applied to the housing 3, a shift occurs between the angle β indicated by the gyro sensor 41 and the angle α indicated by the operation data generated by the operation data generation unit 11. When the angle α is different from the angle β (NO in S2 of FIG. 12), the external force detection unit 13 detects an external force by determining that an external force is applied. More specifically, when external force is applied to the housing 3 in the forward direction, the angle α is smaller than the angle β, as shown in FIG. Conversely, when an external force in the reverse direction is applied to the housing 3, the angle α becomes larger than the angle β, as shown in FIG.

  The external force detection unit 13 compares the angle α with the angle β, and when the angle α is smaller than the angle β (YES in S4 of FIG. 12), an external force in the forward direction is applied to the housing 3 If the angle α is larger than the angle β (NO in S4 of FIG. 12), it is detected that an external force in the reverse direction is applied to the housing 3 (S4 of FIG. 12: external force detection) Step).

  The operation instruction determination unit 14 obtains the movement or posture of the housing 3 and the direction of the external force applied to the housing 3 (or the presence or absence of the external force) from the external force detection unit 13 and adds the movement or posture to the housing 3. When an external force is detected, an operation instruction corresponding to the combination of the movement or posture of the housing 3 and the direction of the external force is determined with reference to the operation instruction rule 21. That is, when the angle α is smaller than the angle β, the operation instruction determination unit 14 determines the operation instruction corresponding to the case where the external force in the forward direction is applied to the housing 3 (S5 in FIG. 12: instruction In the determination step), when the angle α is larger than the angle β, the operation instruction corresponding to the case where the external force in the reverse direction is applied to the housing 3 is determined (S6: instruction determination step in FIG. 12).

Second Embodiment
It will be as follows if other embodiment of this invention is described based on FIGS. 13-19. In addition, about the member which has the same function as the member demonstrated in the said embodiment for convenience of explanation, the same code | symbol is appended and the description is abbreviate | omitted.

  For example, when the user lifts the housing 3 of the display device 1a, an acceleration in a direction opposite to the direction of gravity occurs. When the housing 3 of the display device 1a is lifted by the user's hand, the housing 3 receives an external force applied to the housing from the user's hand. The display device 1a according to the present embodiment can input an operation instruction according to a combination of the movement or posture of the housing 3 and the external force in the opposite direction to the gravity lifting the housing 3.

(Internal configuration of display device 1a)
First, the configuration of the display device 1a will be described using FIG. FIG. 13 is a block diagram showing an example of the main configuration of the display device 1a of the present invention. The display device 1a differs from the display device 1 in that the sensor unit 40a further includes an acceleration sensor 42 for detecting the magnitude and direction of the acceleration generated in the housing 3. Similar to the gyro sensor 41, the acceleration sensor 42 is provided inside the housing 3 of the display device 1a, and detects the acceleration generated in the housing 3. The acceleration sensor 42 may be disposed at any position as long as it is inside the housing 3.

  In addition, the display device 1a further includes a communication unit 50, and can communicate with the smartphone 100. The display device 1a can also communicate with one or more other display devices 1a (for example, display devices 1a owned by other users) and a personal computer (PC) 200 (see FIG. 21). .

  The display device 1a may transmit the operation instruction determined by the operation instruction determination unit 14 to the other display device 1a, the smartphone 100, and the PC 200 via the communication unit 50. According to this configuration, it is possible to input an operation instruction to another display device 1a, the smartphone 100, and the PC 200 using the display device 1a.

  Below, the operation example which detects that the housing | casing 3 of the display apparatus 1a was lifted, and switches a motion or an attitude | position is demonstrated using FIGS. 14-18.

(Operation example 1 for switching the movement of the housing 3)
FIG. 14 is a diagram showing an operation example for switching the operation of the display device 1 a by an operation (external force) for lifting the housing 3. (A) of FIG. 14 is an operation instruction rule 21 which defines the operation instruction described here, and (b) and (c) of FIG. 14 are diagrams for explaining the operation instruction corresponding to the lifting operation.

  The example shown in (a) of FIG. 14 exemplifies a case where the display device 1a is used as a terminal of a videophone and a monitor. In addition, as shown in (b) of FIG. 6, the display device 1a displays when the expression of the person (calling party) in the image displayed on the display unit 32 becomes an expression (smile) of smile. The housing 3 of the device 1 moves so that the orientation of the display unit 32 circularly moves clockwise and counterclockwise as viewed from directly above.

  If the housing 3 is kept placed on a desk or the like, the display device 1a continues the circular motion as shown in (b) of FIG. On the other hand, when an external force is detected such that the user lifts the housing 3 of the display device 1a, that is, when lifting is performed, as shown in FIG. Switch to Thus, the display device 1a switches to a motion different from the motion when being placed on a desk or the like when the housing 3 is lifted by the user.

  By switching the movement of the lifted case 3 from movement such as rotation and rocking to vibration, the user can be prevented from removing the case 3 of the display device 1a. Note that, contrary to the example shown in FIG. 14, the movement of the lifted housing 3 may be switched to a movement that is more violent than when the housing 3 is placed on a desk or the like. When the housing 3 is lifted by the user, the display device 1a can provide sensory stimulation to the user, in addition to merely visual information. Thus, by using the operation that the user lifts the housing 3 as an operation input, the convenience of the display device 1a can be improved, and communication between the display device 1a and the user can be enriched. .

(Operation example 2 for switching the movement of the housing 3)
FIG. 15 is a diagram showing an operation example of switching the movement of the display device 1a by the operation of lifting the housing 3. (A) of FIG. 15 is an operation instruction rule 21 that defines the operation instruction described here, and (b) and (c) of FIG. 15 are diagrams for explaining the operation instruction corresponding to the lifting operation.

  In the example illustrated in (a) of FIG. 15, the housing 3 of the display device 1a moves so that the orientation of the display unit 32 swings up and down with the image of the face displayed on the display unit 32. Therefore, as shown in (b) of FIG. 15, when an external force for lifting the housing 3 is detected, if the displayed face is a smile, the amplitude of the swing is made larger than before being lifted. . This makes it possible to express the feeling of being happy that the user gets stuck when being lifted while displaying a smile. On the other hand, as shown to (c) of FIG. 15, when the external force which lifts the housing | casing 3 is detected, if the face which is being displayed is an angry face, the rocking of the housing is stopped. In this way, it is possible to express a gesture (movement) as if the user is lifted and he / she stands still while being lifted.

  Thus, the display device 1a determines the operation instruction according to the combination of the movement or posture of the housing, the displayed video (display content), and the direction of the external force applied to the housing 3. . As a result, various emotions and gestures can be shown to the user who performed the operation, and rich communication can be realized.

(Example of controlling the posture of the housing 3)
FIG. 16 is a diagram showing a control example in which the display device 1a returns to the original posture when the display device 1a is lowered to the original position after the housing 3 is lifted. After activation, the display device 1a placed on a desk or the like has a posture in which the display surface of the display unit 32 is obliquely upward (in the figure, the display unit 32 is inclined 50 ° as shown in FIG. 16A). Take a stance towards

  At this time, the case 3 is lifted by the user ((b) in FIG. 16), and then placed again on the desk with, for example, the display unit 32 facing substantially straight upward (as shown in FIG. 16 (c), the display device 1a returns the posture of the housing 3 to the original posture (the posture before being lifted by the user). The display device 1a may be returned to its original posture immediately after the display device 1a is lifted after being lifted, or the external force on the housing 3 is not detected for a predetermined time (for example, 3 seconds). You may return to the original posture. The housing 3 of the display device 1a may not be returned to the original position, and may be placed at another place, for example, after being carried by the user.

  As a result, when the user lifts the housing 3 and then places the housing 3 on the desk again, it is possible to avoid the inconvenience of the user adjusting the posture of the housing 3 of the display device 1a. Therefore, the user can be urged to pick up the case 3 of the display device 1a with ease or place it on a desk or the like. Therefore, the convenience of the display device 1a can be improved.

  In addition, the user lifts the housing 3 ((b) in FIG. 16), and then, the display unit 32 is placed on the desk, for example, in a posture (face-down posture) such that the display unit 32 faces the upper surface side of the desk. In this case, the main power may be turned off or switched to the charging mode. In this case, for example, the display device 1a specifies the posture of the housing 3 when lifted and then lowered, and if the posture can not be changed by the operation mechanism 31, the main power is turned off. Or switch to the charge mode. The display device 1a may be configured to determine an operation instruction according to what the posture of the housing 3 is after being lifted and then lowered.

(Process of detecting that the display device 1a has been lifted)
Here, processing for detecting that the housing 3 of the display device 1a has been lifted will be described with reference to FIG. FIG. 17 is a diagram illustrating an example of a method of processing in which the display device 1 a detects an operation of lifting the housing 3.

  The external force detection unit 13 acquires the tilt angle β (posture information) of the housing 3 from the gyro sensor 41 (S11), and acquires the acceleration generated in the housing 3 detected by the acceleration sensor 42 (S12).

  Next, the external force detection unit 13 calculates an acceleration Az, which is a component of the acceleration in a direction parallel to the gravity, based on the angle β and the magnitude and direction of the acceleration generated in the housing 3 (S13). When the housing 3 is moved in the opposite direction to the direction of acceleration, the acceleration Az is smaller than the gravitational acceleration. The external force detection unit 13 uses this fact to determine the deviation between the calculated acceleration Az and the gravitational acceleration (S14).

  If the acceleration Az is smaller than the gravitational acceleration (YES in S14), the external force detection unit 13 determines that the housing 3 has been lifted. The operation instruction determination unit 14 acquires the determination result and refers to the operation instruction rule 21 to correspond to the combination of the movement or posture of the housing 3 and whether or not the housing 3 has been lifted. An operation instruction is determined (S15).

  As described above, the display device 1 a detects the external force applied to the housing 3 in the direction opposite to the gravity, and combines the movement or posture of the housing 3 with the detected external force in the opposite direction. Corresponding operation instructions can be determined.

(Operation example of controlling the operation of another device by the operation to the display device 1a)
The display device 1a can communicate with an external device such as the smartphone 100 via the communication unit 50. Using this communication, it is also possible to operate the operation of the smartphone 100 or the like in response to the operation on the display device 1a. An example of controlling the operation of another device such as the smartphone 100 by an operation on the display device 1a as described above will be described using FIGS. 18 and 19. In addition, although the example which transmits operation instruction | indication from the display apparatus 1a to the smart phone 100 is demonstrated here, it is not limited to this. For example, the operation instruction may be transmitted from the display device 1a to another display device 1a, or the operation instruction may be transmitted to the stationary PC 200.

  FIG. 18 is a diagram showing an operation example of transmitting an operation instruction from the display device 1 a to the smartphone 100 by an operation (external force) for lifting the housing 3. (A) of FIG. 18 is an operation instruction rule 21 which defines the operation instruction described here, and (b) to (d) of FIG. 18 are diagrams for explaining the operation instruction corresponding to the lifting operation.

  The example shown in FIG. 18 exemplifies a case where the display device 1a is used as an external terminal of the smartphone 100 and a display. As illustrated, the housing 3 of the display device 1a displays the timeline of the social networking service (SNS) on the display unit 32, and vibrates the housing 3 every time a new message is posted on the SNS. .

  When the housing 3 is lifted when there is a new post and the housing 3 vibrates, the display device 1a transmits an operation instruction to the smartphone 100 as shown in FIG. 18B. , Display "OK!", "Good!", "Like!" Etc. on the SNS display screen. In this way, it is possible to show on the SNS the impression and consent to the newly posted message. On the other hand, even if the housing 3 is lifted when there is no new message posted on the SNS and the housing 3 is stopped, as shown in (c) of FIG. Nothing is sent to the operation instruction.

  In addition, as shown to (d) of FIG. 18, when the housing | casing 3 is lifted when the goods image is displayed on the display part 32 of the display apparatus 1a, an operation instruction | indication is transmitted to the smart phone 100. Alternatively, information such as an advertisement, a shop, or a price related to the displayed product may be displayed. In addition, when displaying the product image, the housing 3 of the display device 1a may be stopped as illustrated, or may be swung left and right.

  As described above, when an operation by an external force applied to the display device 1a is received, the operation instruction associated with the operation is determined, and the determined operation instruction is transmitted from the display device 1a to another device. It may be Thereby, the operation of the other device can be controlled by a simple operation of lifting the housing 3. Thus, the convenience of the display device 1a is improved, and the range of application can be expanded.

(Example of cooperation between display device 1a and other devices)
FIG. 19 shows components and states of respective devices when communication between the display device 1a and another display device 1a and communication between the display device 1a and an external device (C) such as the PC 200 and the smartphone 100 are possible. It is a figure explaining various variations by combination of. In addition, although the case where a display apparatus (A) and a display apparatus (B) are the display apparatuses 1a is illustrated in illustration, it is not limited to this.

  As illustrated, a plurality of pieces of instruction information can be input to the display device (A), the display device (B), and the external device (C) according to the components at the time of receiving the input of the instruction information. For example, if a display apparatus (A) is demonstrated, the input of instruction information like following (1)-(4) is possible. (1) instruction information according to the display content to be displayed by the display device (A), (2) instruction information when a touch input is accepted, and (3) vibration (or oscillation, rotation, etc.) during reception / output Instruction information according to the direction of the external force applied to the case at the same time, and (4) the direction of the external force applied to the case when vibrating (or oscillating, rotating, etc.) at the time of transmission / output Instruction information according to. Furthermore, the instruction information of the above (1) to (4) corresponds to the state where the housing 3 of the display device (A) is placed (placed) on a desk or the like, and the state where it is lifted. It is possible to make them different.

  Similarly, in the display device (B) that receives the instruction information from the display device (A), there are a plurality of components and a plurality of states, so in the display device (B), based on the received instruction information Can perform various processes.

Third Embodiment
Another embodiment of the present invention is described below with reference to FIG. In addition, about the member which has the same function as the member demonstrated in the said embodiment for convenience of explanation, the same code | symbol is appended and the description is abbreviate | omitted.

  In the above embodiment, the display device 1 having the casing 3 having a spherical surface and the operation mechanism 31 for changing the position of the center of gravity of the display device 1a are provided, and the casing 3 is moved by the operation mechanism 31 and the display surface of the display unit 32 faces The display devices 1 and 1a that change the direction or change the posture have been described. However, the display devices 1 and 1a are not limited to the above-described shape as long as they are configured to be able to move the housing 3 with the operation mechanism 31 or change the posture. In the present embodiment, another example of the operation mechanism 31 for moving the housing 3 or changing the posture will be described based on FIG. FIG. 20 is a view showing another example of the operation mechanism 31 for changing the movement or posture of the housing 3.

  In the example shown in (a) of FIG. 20, the housing 3a having a shape (for example, a semi-cylindrical shape) obtained by cutting a cylinder by one plane so that the cross section is rectangular is used. The display surface of the display unit 32 is disposed on a rectangular flat portion (portion corresponding to a cut surface). In this configuration, by moving the center of gravity by the same operating mechanism as the above-described operating mechanism 31, the housing 3a is moved along the outer edge portion of the housing 3a (curved portion corresponding to the side surface of the cylinder) as illustrated. It can move and change its attitude. Along with this, the orientation of the display surface of the display unit 32 can be changed. In the example shown in (a) of FIG. 20, the outer edge portion of the housing 3a is arc-shaped as in the above embodiment, so that smooth rocking is possible.

  In the example shown in (b) of FIG. 20, the display unit 32 is provided in the first housing 3b, and the first housing 3b is connected to the second housing 3c via the hinge 3d. It is configured to be rotatable in the direction of the arrow in the figure. As described above, it is also possible to change the orientation of the display surface of the display unit 32 by the pivoting member such as the hinge 3d. In this case, it is possible to control the orientation of the display surface by connecting a drive unit (not shown) such as a motor to the rotation member. The example shown in (b) of FIG. 20 has the same configuration as the case of a general notebook computer or mobile phone. Therefore, the display device of the present invention can be realized by mounting an operating mechanism for controlling the angle in the opening / closing operation of the hinge portion provided in a general notebook computer or mobile phone.

  In the example shown in (c) of FIG. 20, the display unit 32 is attached to the arm provided with the joint unit 61 via the joint unit 60. In this case, the orientation and posture of the display surface of the display unit 32 can be controlled by an operating mechanism (not shown) that moves the joint unit 60 and the joint unit 61.

  In the example illustrated in (d) to (f) of FIG. 20, the display stand 70 and the display unit 32 are connected via the connection unit 71. The connection unit 71 rotatably connects the display stand 70 and the display unit 32, whereby the display surface of the display unit 32 is movable with the connection unit 71 as a fixed point. For example, the orientation of the display surface is fixed while being turned (d in the same figure), the orientation of the display surface is moved to the left and right (e in the figure), or the orientation of the display surface is vertically moved (the same figure f) It is possible. In this case, by connecting a drive unit (not shown) to the connection unit 71, it is possible to control the movement and attitude of the display surface of the display unit 32.

Embodiment 4
Another embodiment of the present invention will be described based on FIG. FIG. 21 is a block diagram showing an outline of a distribution system 300 according to an embodiment of the present invention. In addition, about the member which has the same function as the member demonstrated in the said embodiment for convenience of explanation, the same code | symbol is appended and the description is abbreviate | omitted. In this embodiment, a distribution system for distributing operation data from a server will be described.

  Distribution system 300 shown in FIG. 21 is a system for distributing operation data to display device 1a, and includes server 310 for distributing operation data, display device 1 for receiving operation data to be distributed, and smartphone 100. Note that the device that receives operation data in the distribution system 300 is not limited to the display device 1 a and the smartphone 100, and any device that can communicate with the server 310 can be an entity that receives operation data.

  The server 310 has a function of generating operation data as in the smart phone 100 of the above embodiment, and is configured to automatically generate operation data according to the uploaded video and distribute it. Good.

  For example, when the video taken by the display device 1a is uploaded, the server 310 acquires the uploaded video, generates operation data according to the acquired video, and transmits the operation data to the display device 1a. May be As a result, the image can be viewed while moving the display surface without giving the display device 1a a function of generating operation data.

  The server 310 may transmit the operation data together with the video. For example, in the above example, the operation data may be transmitted together with the video to another display device 1a different from the display device 1a to which the video is uploaded. Further, such transmission may be performed in response to a request from the display device 1a, or the server 310 may be distributed to the predetermined display device 1 on its own initiative. A plurality of distribution destinations may be provided. For example, a video received from one display device 1a and operation data according to the video may be distributed to the plurality of display devices 1a all at once.

  Further, as shown in FIG. 21, the smartphone 100 may communicate with the server 310 to acquire operation data. The acquisition source of the video to be transmitted to the server 310 is not particularly limited, and may be, for example, the display device 1 a or a content distribution server (not shown) such as a moving picture posting site. In addition to this, when the smartphone 100 is provided with a photographing device, a video photographed by the photographing device may be used, or the image is generated or acquired by application software (for example, a game or the like) operating on the smartphone 100. You may use an image.

  In addition, the smartphone 100 may request the server 310 to transmit video and operation data, and transfer the video and operation data transmitted in response to the request to the display device 1a. In this case, the user can select a desired video from the videos that can be transmitted by the server 310 with the smartphone 100, and can enjoy the video on the display device 1a along with the movement of the display surface. For example, there is a social networking service (SNS) that allows posting and viewing of moving pictures, so an SNS server (not shown) has the same function as the server 310, and an image selected by the user with the smartphone 100 And motion data according to the video may be distributed. Alternatively, the server of the moving picture posting site or moving picture distribution site may have the same function as that of the server 310, and the picture selected by the user with the smartphone 100 and the operation data according to the picture may be distributed.

  In addition to this, it is conceivable to provide a service for live delivery of video, a server 310 provided in a content delivery platform or the like, and deliver video content together with operation data. Alternatively, a server that delivers an advertisement may have the same function as that of the server 310, and the server may generate operation data according to the video of the advertisement and deliver the data together with the video of the advertisement.

  Although the server 310 described above performs acquisition of video, generation of operation data, transmission of video, and transmission of operation data, the processing may be performed by an individual server. For example, the same function as that of the server 310 can be realized by a combination of a server that receives upload of a video, a server that generates operation data, a server that transmits operation data, and a server that transmits video.

[Example of software implementation]
The control blocks (in particular, operation data generation unit 11, motor control unit 12, external force detection unit 13, and operation instruction determination unit 14) of display devices 1 and 1a are logic circuits (hardware) formed in integrated circuits (IC chips) or the like. Hardware, or may be realized by software using a CPU (Central Processing Unit).

  In the latter case, the display device 1 or 1a is a CPU that executes instructions of a program that is software that realizes each function, a ROM (Read Only Memory) in which the program and various data are readably recorded by a computer (or CPU). Or a storage device (these are referred to as "recording media"), a RAM (Random Access Memory) for developing the program, and the like. The object of the present invention is achieved by the computer (or CPU) reading the program from the recording medium and executing the program. As the recording medium, a “non-transitory tangible medium”, for example, a tape, a disk, a card, a semiconductor memory, a programmable logic circuit or the like can be used. The program may be supplied to the computer via any transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.

[Summary]
The input device (display devices 1 and 1a) according to aspect 1 of the present invention is an input device capable of inputting instruction information based on an external force applied to the housing 3, and a motion for specifying the motion or posture of the housing A specific part (external force detection part 13), an external force detection part 13 for detecting the external force, the movement or posture of the housing specified by the movement specific part, and the direction of the external force detected by the external force detection part And a command determination unit (operation command determination unit 14) for determining the command information according to the combination.

  According to the above configuration, the external force applied to the housing of the input device is detected, and instruction information according to the combination of the movement or posture of the housing and the detected external force direction is determined. Thereby, the input of instruction information can be received by the operation suitable for the movement or posture of the housing of the input device. Therefore, even when the case of the input device is moving or the posture is changed when receiving an operation from the user, the instruction information can be input by a simple operation.

  The input device according to aspect 2 of the present invention includes the operation mechanism for moving the housing in aspect 1 above, and the instruction determination unit determines the movement or attitude of the housing specified by the movement identification unit, and the operation The indication information may be determined according to a combination with the direction of the external force applied to the casing moving by the mechanism.

  When the housing moves or the posture of the housing changes, it is difficult to accurately operate the conventional input device such as a button or a touch panel. According to the above configuration, the instruction information is determined according to the combination of the movement or posture of the housing and the direction of the external force applied to the moving housing. As a result, the operation input can be easily performed by a simple operation of applying an external force to the housing that moves or changes in posture.

  For example, even when an external force in the same direction is applied to the housing, if the housing is moving, depending on the movement or posture of the housing when the external force is applied to the housing, Various instruction information can be determined. Therefore, various operations can be input by a simple operation, and the convenience of the input device can be improved by moving the housing.

  In the input device according to aspect 3 of the present invention, in the aspect 1 or 2, the instruction determination unit determines the instruction information according to the relationship between the direction of movement of the housing and the direction of the external force. Good.

  For example, while it is difficult to touch a predetermined position of a moving housing, it is easy to change the direction of external force applied to the housing. According to the above configuration, different instruction information can be determined only by changing the direction of the external force applied to the housing.

  In the input device according to aspect 4 of the present invention, in any of the above aspects 1 to 3, the instruction determination unit is configured such that the external force detection unit applies the external force applied in a direction opposite to gravity with respect to the housing. When detected, the instruction information may be determined according to the movement or posture of the housing when the external force is detected.

  In this way, it is possible to determine instruction information in accordance with the lifting of the housing. Thus, for example, the user can input instruction information by a simple operation of lifting the housing.

  The input device according to aspect 5 of the present invention further includes a display unit according to any of the above aspects 1 to 4, and the instruction determination unit determines the movement or posture of the casing specified by the movement identification unit; You may determine the said instruction information according to the combination of the display content currently displayed on the display part, and the direction of the said external force which the said external force detection part detected.

  According to the above configuration, instruction information is determined according to a combination of the movement or posture of the housing, the display content displayed on the display unit, and the direction of the external force detected by the external force detection unit. Thus, the user can input various instruction information suitable for the display content while visually recognizing the display content displayed on the display unit.

  A control method of an input device (display device 1 or 1a) according to a sixth aspect of the present invention is a control method of an input device capable of inputting instruction information based on an external force applied to a housing 3, and the movement of the housing Alternatively, a specifying step (S2) for specifying a posture, an external force detection step (S4) for detecting the external force, a movement or posture of the housing specified in the specific step, and the above detected in the external force detection step And an instruction determination step (S5, S6) of determining the instruction information according to the combination with the direction of the external force. According to the above-mentioned composition, the same effect as the above-mentioned mode 1 is produced.

  The input device according to each aspect of the present invention may be realized by a computer, and in this case, the computer is realized as each unit (software element) included in the input device to realize the input device by the computer. A control program of an input device and a computer readable recording medium recording the same also fall within the scope of the present invention.

  The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims, and embodiments obtained by appropriately combining the technical means disclosed in the different embodiments. Is also included in the technical scope of the present invention. Furthermore, new technical features can be formed by combining the technical means disclosed in each embodiment.

1, 1a Display device (input device, external device)
3 Case 13 External force detection unit (motion identification unit)
14 Operation Instruction Determination Unit (Instruction Determination Unit)
31 operating mechanism 32 display unit 41 gyro sensor 42 acceleration sensor S2 identification step S4 external force detection step S5, S6 instruction determination step 100 smartphone (external device)
200 personal computer (PC) (external device)

Claims (6)

An input device capable of inputting instruction information based on an external force applied to a housing,
A movement identifying unit that identifies the movement or posture of the housing;
An external force detection unit that detects the external force;
An instruction determination unit that determines the instruction information according to a combination of the movement or posture of the housing specified by the movement specification unit and the direction of the external force detected by the external force detection unit;
And an operation mechanism for vibrating or vibrating the housing.
The instruction determination unit determines whether or not an external force that stops the peristaltic movement or vibration is applied while the casing is peristaltically moved or vibrated by the operation mechanism, and stops the peristaltic movement or vibration. a case where an external force is determined to have been added, an input device which is characterized that you determine the first indication information as the instruction information.   The instruction determination unit determines whether or not an external force that amplifies the swing is applied while the case is swung by the operation mechanism, and amplifies the swing. The input device according to claim 1, wherein second instruction information is determined as the instruction information when it is determined that an external force is applied.   The instruction determination unit determines whether or not an external force is applied to shake the case to the left or right while the case is vibrated by the operation mechanism, and shakes the case to the left or right. The input device according to claim 1, wherein third instruction information is determined as the instruction information when it is determined that an external force is applied.   It has an operation mechanism to move the above-mentioned case,
  The instruction determination unit may perform the instruction information according to a combination of the movement or posture of the case specified by the movement specifying unit and the direction of the external force applied to the case being moved by the operation mechanism. The input device according to any one of claims 1 to 3, characterized in that   When the external force detection unit detects the external force applied in the direction opposite to the gravity with respect to the housing, the instruction determination unit responds to the movement or posture of the housing when the external force is detected. The input device according to any one of claims 1 to 4, wherein the instruction information is determined.   Further comprising a display unit,
  The instruction determination unit is a combination of the movement or posture of the housing specified by the movement specification unit, the display content displayed on the display unit, and the direction of the external force detected by the external force detection unit. The input device according to any one of claims 1 to 5, wherein the instruction information corresponding to the instruction information is determined.

Images