JP2009181261A - Bidirectional communication system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To three-dimensionally arrange a plurality of vibrating elements at an input device, and to three-dimensionally recognize a positional relationship between a cursor and an object through vibration even when the cursor and the object are not brought into contact with each other. <P>SOLUTION: When receiving the operation signal of a cursor 302 transmitted from an input device 100, control terminal equipment 200 calculates cursor position coordinates from the received operation signal, and generates a control signal for determining the position of vibration, the amplitude of vibration and the pattern of vibration of a vibration element 101 arranged in the input device 100 by using the calculated cursor position coordinates and object position coordinates controlled by the control terminal equipment 200, and transmits the control signal to the input device 100. Also, the input device 100 arranged so that the vibration position of the input device can be three-dimensionally recognized through vibration receives the control signal, and determines the place of vibration, the amplitude of vibration and the pattern of vibration of the vibration element 101 from the received control signal, and makes the vibration element 101 perform a vibrating operation based on this. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a bidirectional communication system capable of recognizing both positional relations or azimuth information three-dimensionally through vibration using position coordinates of an object displayed on an operation screen and a cursor.

The conventional input device vibrates the vibration element provided in the input device to determine whether or not the cursor and the object are in contact with each other when the cursor and the object displayed on the operation screen are operated by the input device. It was possible to recognize by doing (for example, refer patent document 1).
Japanese Patent Laid-Open No. 8-95693

  However, in the above conventional technique, for example, when the cursor is not in contact with the object, for example, it is difficult to see the object and it is not known where the object exists on the screen. I couldn't.

  In consideration of such a conventional problem, the present invention provides a three-dimensional arrangement of a plurality of vibration elements in an input device, and even if the cursor and the object are not in contact, the positional relationship between them is three-dimensional. It aims at making it recognize through vibration.

  To achieve the above object, in a bidirectional transmission / reception system comprising a control terminal device that controls an object and a cursor on a display unit, and an input device that transmits an operation signal to the control terminal device, the control terminal device A cursor signal receiving unit that receives an operation signal of the cursor transmitted by the input device, a cursor information analysis unit that calculates a cursor position coordinate on the display unit from the operation signal, the cursor position coordinate, and the object A control signal generation unit that generates a control signal for determining a vibration location, an amplitude and a vibration pattern of a vibration element provided in the input device using the position coordinates, and transmits the control signal to the input device. A control signal transmission unit that performs a three-dimensional vibration position of the input device by an operator through vibration. A plurality of vibration elements having vibration elements arranged so that they can be recognized, a control signal receiving unit that receives the control signal transmitted by the control terminal, and the control signal received by the control signal receiving unit, A signal analysis unit that determines a vibration location of the element, an amplitude of vibration, and a vibration pattern, and a vibration control unit that vibrates the vibration element based on vibration information analyzed by the signal analysis unit. It is said.

  According to this configuration, the control terminal device that controls the object on the display unit, the cursor, and the input device that transmits an operation signal to the control terminal device are provided. When the cursor operation signal to be transmitted is received, the cursor position coordinates can be calculated from the received operation signal. Furthermore, using the calculated cursor position coordinates and the object position coordinates controlled by the control terminal device, a control signal for determining the vibration location, vibration amplitude and vibration pattern of the vibration element provided in the input device is generated. Can be sent to the input device. In addition, the input device arranged so that the vibration position of the input device can be three-dimensionally recognized via vibration receives a control signal, and from the received control signal, the vibration location of the vibration element, the amplitude of vibration, and the vibration pattern And the vibration element can be vibrated based on this.

  Thereby, for example, even when the cursor on the display unit and the object are not in contact, the vibration element is arranged on the input device so that the vibration position of the input device can be recognized three-dimensionally through vibration. Therefore, the user can recognize the positional relationship between the cursor and the object three-dimensionally through vibration.

  In an embodiment of the present invention, in a bidirectional transmission / reception system including a control terminal device that controls an object and a cursor on a display unit, and an input device that transmits an operation signal to the control terminal device, the control terminal The apparatus includes: a cursor signal receiving unit that receives an operation signal of the cursor transmitted by the input device; a cursor information analysis unit that calculates a cursor position coordinate on the display unit from the operation signal; the cursor position coordinate; Using the position coordinates of the object, a control signal generation unit that generates a control signal for determining a vibration location of a vibration element provided in the input device, a vibration amplitude, and a vibration pattern, and the control signal to the input device A control signal transmission unit for transmitting, and the input device has a three-dimensional vibration position of the input device via vibration. A plurality of vibration elements arranged so as to be recognized, a control signal receiving unit that receives the control signal transmitted by the control terminal, and a vibration location of the vibration element from the control signal received by the control signal receiving unit And a signal analysis unit for determining a vibration amplitude and a vibration pattern, and a vibration control unit for vibrating the vibration element based on vibration information analyzed by the signal analysis unit.

  The interactive communication system includes a control terminal device that controls an object on the display unit, a cursor, and an input device that transmits an operation signal to the control terminal device. When the cursor operation signal transmitted by the apparatus is received, the cursor position coordinates can be calculated from the received operation signal. Furthermore, using the calculated cursor position coordinates and the object position coordinates controlled by the control terminal device, a control signal for determining the vibration location, vibration amplitude and vibration pattern of the vibration element provided in the input device is generated. Can be sent to the input device. In addition, the input device arranged so that the vibration position of the input device can be three-dimensionally recognized via vibration receives a control signal, and from the received control signal, the vibration location of the vibration element, the amplitude of vibration, and the vibration pattern And the vibration element can be vibrated based on this.

  Thereby, for example, even when the cursor on the display unit and the object are not in contact, the vibration element is arranged on the input device so that the vibration position of the input device can be recognized three-dimensionally through vibration. Therefore, the user can recognize the positional relationship between the cursor and the object three-dimensionally through vibration.

In the bidirectional communication system according to claim 1,
The control terminal device
Furthermore, the object selection part which selects the object linked | related with the vibration motion of the said vibration element based on the said cursor and the conditions regarding the said object is provided, The said control signal generation part is the said cursor position coordinate, The said object selection part Using the position coordinates of the selected object, a control signal for determining the vibration location, vibration amplitude and vibration pattern of the vibration element provided in the input device may be generated.

  The interactive communication system includes a control terminal device that controls an object on the display unit, a cursor, and an input device that transmits an operation signal to the control terminal device. When the cursor operation signal transmitted by the apparatus is received, the cursor position coordinates can be calculated from the received operation signal. Furthermore, an object associated with the vibration operation of the vibration element can be selected based on the cursor position coordinates and the object position coordinates. Further, a control signal for determining the vibration location, vibration amplitude and vibration pattern of the vibration element provided in the input device is generated from the calculated cursor position coordinates and the selected object position coordinates, and transmitted to the input device. be able to. Then, the input device arranged so that the vibration position of the input device can be three-dimensionally recognized through vibration receives the control signal, and from the received control signal, the vibration location of the vibration element, the amplitude of vibration, and the vibration pattern And the vibration element can be vibrated based on this.

  Thereby, for example, even when there are a plurality of objects on the display unit, it is possible to recognize only the object to be associated with the vibration operation of the vibration element in three dimensions from the cursor position coordinates through vibration.

  The control signal generation unit provided in the control terminal device further generates a plurality of control signals for each object when a plurality of objects are selected in the object selection unit, and the generated plurality It is also possible to adopt a configuration characterized in that a combination of these control signals is used as a representative control signal.

  The interactive communication system includes a control terminal device that controls an object on the display unit, a cursor, and an input device that transmits an operation signal to the control terminal device. When the cursor operation signal transmitted by the apparatus is received, the cursor position coordinates can be calculated from the received operation signal. Furthermore, an object associated with the vibration operation of the vibration element can be selected based on the cursor position coordinates and the object position coordinates. When there are a plurality of selected objects, the vibration location, vibration amplitude and vibration pattern of the vibration element provided in the input device are determined from the calculated cursor position coordinates and the selected object position coordinates. A plurality of control signals can be generated, and a combination of the generated control signals can be transmitted to the input device as a representative control signal. Then, the input device arranged so that the vibration position of the input device can be three-dimensionally recognized through vibration receives the control signal, and from the received control signal, the vibration location of the vibration element, the amplitude of vibration, and the vibration pattern And the vibration element can be vibrated based on this.

  Thereby, for example, even when there are a plurality of objects to be related to the vibration operation of the vibration element, a control signal is generated and synthesized for each of the objects to be related. It becomes possible to recognize the object.

  In the above-described interactive communication system, the control terminal device further includes an attribute information storage unit that stores attribute information corresponding to an object existing on the display unit, and the control signal generation unit further includes the control signal generation unit. A configuration may be employed in which a control signal that determines a vibration location, a vibration amplitude, and a vibration pattern of a vibration element provided in the input device is generated using attribute information.

  The interactive communication system includes a control terminal device that controls an object on a display unit, a cursor, and an input device that transmits an operation signal to the control terminal device. When the cursor operation signal transmitted by is received, the cursor position coordinates can be calculated from the received operation signal. The control signal generation unit may further generate a control signal for determining the vibration location, vibration amplitude, and vibration pattern of the vibration element provided in the input device using the attribute information of the object, and transmit the control signal to the input device. it can. Further, the input device arranged so that the vibration position of the input device can be three-dimensionally recognized via vibration receives the control signal, and from the received control signal, the vibration location of the vibration element, the amplitude of vibration, and the vibration pattern And the vibration element can be vibrated based on this.

  Thereby, for example, even when there are a plurality of different types of objects on the display unit, the position of the cursor and the object is three-dimensionally through vibration by using the accumulated attribute information of the object. In addition to the relationship, the type of object can be recognized.

  In the bidirectional communication system described above, the control signal generation unit provided in the control terminal device further includes a line segment connecting the cursor position coordinates and the object position coordinates, and an angle determined by the cursor position coordinates. The control device may be configured to generate a control signal that determines a vibration location, a vibration amplitude, and a vibration pattern of a vibration element provided in the input device.

  The interactive communication system includes a control terminal device that controls an object on a display unit, a cursor, and an input device that transmits an operation signal to the control terminal device. When the cursor operation signal transmitted by is received, the cursor position coordinates can be calculated from the received operation signal. Further, the control signal generation unit uses the angle at which the line segment connecting the calculated cursor position coordinates and the object position coordinates is determined by the cursor position coordinates, the vibration location of the vibration element provided in the input device, the vibration A control signal that determines the amplitude and vibration pattern of the signal can be generated and transmitted to the input device. Further, the input device arranged so that the vibration position of the input device can be three-dimensionally recognized via vibration receives the control signal, and from the received control signal, the vibration location of the vibration element, the amplitude of vibration, and the vibration pattern And the vibration element can be vibrated based on this.

  Thus, for example, when the cursor is approached from the upper right to an object on the display unit, the control signal is determined using the cursor position coordinates and the angle calculated from the object position coordinates. Not only the positional relationship between the cursor and the object but also the orientation information can be recognized in a three-dimensional manner.

  In the bidirectional communication system described above, the control signal generation unit provided in the control terminal device further uses the length of a line segment connecting the cursor position coordinates and the object position coordinates to perform the input. A configuration may be adopted in which a control signal for determining a vibration location, a vibration amplitude, and a vibration pattern of a vibration element provided in the apparatus is generated.

  The interactive communication system includes a control terminal device that controls an object on a display unit, a cursor, and an input device that transmits an operation signal to the control terminal device. When the cursor operation signal transmitted by is received, the cursor position coordinates can be calculated from the received operation signal. Further, the control signal generation unit uses the length of the line segment connecting the calculated cursor position coordinates and the object position coordinates to determine the vibration location, vibration amplitude, and vibration pattern of the vibration element provided in the input device. A control signal to be determined can be generated and transmitted to the input device. Further, the input device arranged so that the vibration position of the input device can be three-dimensionally recognized via vibration receives the control signal, and from the received control signal, the vibration location of the vibration element, the amplitude of vibration, and the vibration pattern And the vibration element can be vibrated based on this.

  Thereby, for example, when the distance relationship between the cursor and the object is to be expressed by the amplitude of vibration, the control signal is determined using the length of the line segment calculated from the cursor position coordinates and the object position coordinates. It becomes possible to recognize the distance relationship between the cursor and the object three-dimensionally through vibration.

  In the interactive communication system described above, the control signal generation unit provided in the control terminal device further overlaps the cursor and the object using the cursor position coordinates and the object position coordinates. And a control signal for determining a vibration location, a vibration amplitude, and a vibration pattern of a vibration element provided in the input device, using a determination result of the determination means. It may be configured.

  The interactive communication system includes a control terminal device that controls an object on a display unit, a cursor, and an input device that transmits an operation signal to the control terminal device. When the cursor operation signal transmitted by is received, the cursor position coordinates can be calculated from the received operation signal. The control signal generation unit further generates a control signal for determining a vibration location, vibration amplitude, and vibration pattern of the vibration element provided in the input device using the determination result of the overlap between the cursor and the object, Can be sent to. Further, the input device arranged so that the operator can three-dimensionally recognize the vibration position of the input device through vibration, receives the control signal, and from the received control signal, the vibration location of the vibration element, the amplitude of vibration, and The vibration pattern can be determined, and the vibration element can be vibrated based on the vibration pattern.

  Thus, for example, even when the cursor on the display unit and the object overlap, by using the overlap determination result, the user can not only overlap the positional relationship between the cursor and the object via vibration but also overlap. It is also possible to recognize the state of being.

(Embodiment 1)
The bidirectional communication system according to Embodiment 1 of the present invention will be described below with reference to the drawings.

  FIG. 1 shows a configuration of a bidirectional communication system according to Embodiment 1 of the present invention. The bidirectional communication system of the present invention includes an input device 100 and a control terminal device 200, and is configured to perform bidirectional communication using a communication unit 1200.

  The input device 100 is an operating device that operates the control terminal device 200. In addition, the plurality of vibration elements 101 are arranged radially from the center point of the three-dimensional shape so that the vibration position of the input device 100 can be recognized three-dimensionally. When the vibration element 101 is viewed from the surface on which the key is provided, the center point of the input device 100 may be included in the polygon formed by connecting the center points of the vibration element 101. 2 may be configured so as to be substantially symmetrical with respect to the center point of the three-dimensional shape, and the surface formed when the vibration element 101 is connected as shown in FIG. The solid angle seen from the center point of 100 solid shapes may be constant, or the longitude or latitude of the vibration element 101 may be constant as shown in FIG. . The input device 100 only needs to be provided in a three-dimensional manner so that a plurality of vibration elements 101 can recognize the vibration position of the input device 100. For example, a remote control for operating a TV, a touch pad, a mouse, or a track A pointing device such as a ball, joystick, or tablet may be used.

  Based on the operation information transmitted from the input device 100, the control terminal device 200 connects an object 301 corresponding to an operation actually performed by the control terminal device 200 and a cursor 302 that can be operated using the input device 100. Can be displayed on the display unit 300. Then, the operation information of the cursor 302 transmitted from the input device 100 can be received, and the object 301 and the cursor 302 displayed on the display unit 300 can be controlled based on the received operation information. In addition, the position coordinates of the object 301 displayed on the display unit 300 can be acquired. Furthermore, a control signal for vibrating the vibration element 101 is generated using the cursor position coordinates calculated from the operation information, the position coordinates of the object 301 displayed on the display unit 300, and the attribute information of the object 301. Then, the generated control signal is transmitted to the input device 100. As the control terminal device 200, for example, an electronic device such as a television main body, a DVD recorder, or a personal computer may be used. Note that the control terminal device 200 may include the display unit 300 or may be externally connected.

  As long as the communication means 1200 can transmit and receive data between the input device 100 and the control terminal device 200, any communication means 1200 may be used. For example, radio waves based on communication standards established in IEEE 802.11, or wireless or wired networks using Bluetooth, IP protocols, buses, etc. based on communication standards established in IEEE 802.15.1 may be used. Absent.

  Hereinafter, the input device 100 provided in the bidirectional communication system according to Embodiment 1 of the present invention will be described.

  FIG. 5 is a block diagram showing a configuration example of the input device 100 according to Embodiment 1 of the present invention.

  In FIG. 5, the input device 100 includes a control signal receiving unit 102, a signal analysis unit 103, a vibration control unit 104, and a vibration element 101.

  The vibration element 101 is a plurality of or a single device that is provided inside the input device 100 and causes vibration. The vibration element 101 is an element that actually vibrates based on a signal from the vibration control unit 104, switching of the vibration location, vibration The amplitude and vibration pattern can be controlled. As the vibration element 101, a device that causes vibration, such as an element driven by a small motor or an element using a piezoelectric element, may be used.

  The control signal receiving unit 102 receives a control signal from the control terminal device 200 and outputs it to the signal analyzing unit 103. Note that the control signal receiving unit 102 may use a device for transmitting and receiving such as a modem and a network card. The control signal receiving unit 102 may be realized by hardware.

  When a control signal is output from the control signal receiving unit 102, the signal analysis unit 103 analyzes the control signal, determines vibration location information, vibration amplitude information, and vibration pattern information of the vibration element 101, and performs vibration control. Output to the unit 104. Here, for convenience, the first control signal is the vibration location information of the vibration element 101, the vibration amplitude information is the second control signal, and the vibration pattern information is the third control signal. When the first control signal is not included, a specific vibration element that performs a vibration operation, such as vibrating all vibration elements, may be set in advance. Furthermore, when the second control signal is not included, the vibration amplitude may be set in advance, for example, the vibration element is vibrated with the maximum vibration amplitude. If the third control signal is not included, a vibration pattern may be set in advance for the vibration element, for example, the vibration element is vibrated at a constant cycle. The first to third control signals are set for convenience of explanation, and the three control signals may be collectively treated as one control signal. For example, the vibration amplitude and the vibration pattern May be treated as a single control signal.

  When receiving the notification from the signal analysis unit 103, the vibration control unit 104 outputs a signal for causing the vibration element 101 to perform a vibration operation based on the vibration location information, the vibration amplitude information, and the vibration pattern information of the vibration element 101.

  Hereinafter, the operation of the input device 100 according to Embodiment 1 of the present invention will be described with reference to the drawings.

  FIG. 6 is a flowchart showing the operation of the input device 100.

  (Step S <b> 401) The control signal receiving unit 102 receives a control signal from the control terminal device 200 via the communication unit 1200. Then, a control signal is output to the signal analysis unit 103, and the process proceeds to step S402.

  (Step S <b> 402) Upon receiving the notification from the control signal receiving unit 102, the signal analysis unit 103 receives a first control signal for specifying the vibration element 101 from the control signal, a second control signal for specifying the amplitude of vibration, and a vibration pattern. And a third control signal that identifies Further, the acquired three signals are output to the vibration control unit 104, and the process proceeds to step S403.

  (Step S403) Upon receiving the notification from the signal analysis unit 103, the vibration control unit 104 identifies the vibration element 101 from the first control signal, determines the vibration amplitude from the second control signal, and performs the third control. A vibration pattern is determined from the signal, and a signal for actual vibration operation is output to the vibration element 101, and the process proceeds to step S404.

  (Step S <b> 404) Upon receiving the notification from the vibration control unit 104, the vibration element 101 performs the requested vibration operation and ends the operation.

  Note that the control signal received by the input device 100 from the control terminal device 200 is, for example, as shown in FIG. 7, a first control signal in which the placement location of the vibration element 101 is represented by a classification symbol, and the vibration amplitude as a voltage value. And a third control signal in which the vibration pattern is represented by a classification symbol. For convenience, the first to third control signals have been described separately. However, the three control signals may be handled as one control signal. For example, the vibration amplitude and the vibration pattern may be combined into one control signal. It may be handled as a signal.

  Hereinafter, the control terminal apparatus provided in the bidirectional communication system according to Embodiment 1 of the present invention will be described.

  FIG. 8 is a block diagram showing a configuration example of the control terminal device 200 in the present embodiment.

  In FIG. 8, the control terminal device 200 includes a cursor signal reception unit 201, a cursor information analysis unit 202, an attribute information storage unit 203, a control signal generation unit 204, and a control signal transmission unit 205. The control terminal device 200 can perform bidirectional signal communication with the input device 100 via the communication unit 1200, as shown in FIG.

  The cursor signal reception unit 201 receives the operation information of the cursor 302 transmitted from the input device 100 and outputs the operation information to the cursor information analysis unit 202. As with the control signal receiving unit 102, the cursor signal receiving unit 201 may use a device for transmitting and receiving such as a modem or a network card. The cursor signal receiving unit 201 may be realized by hardware.

  The cursor information analysis unit 202 calculates the position coordinates of the cursor 302 on the display unit 300 based on the operation information notified from the cursor signal reception unit 201, and outputs it to the control signal generation unit 204.

  The attribute information accumulation unit 203 accumulates attribute information and position coordinates of the object 301 existing on the display unit 300 and outputs the accumulated information to the control signal generation unit 204. The attribute information is information indicating what the object 301 is, and file information of the object 301, for example, date information, extension information, and information based on an operation corresponding to the object 301, for example, a pressing operation with a cursor. Any information can be used as long as it is information that can represent the object 301, such as a button or a pop-up that can be used.

  The control signal generation unit 204 uses the cursor position coordinates calculated by the cursor information analysis unit 202, the attribute information stored in the attribute information storage unit 203, and the position table, so that the vibration element 101 provided in the input device 100 can be used. A control signal for determining the vibration location, vibration amplitude, and vibration pattern is generated and output to the control signal transmission unit 205. The control signal generated in the control information generation unit 204 includes a first control signal for specifying the vibration location of the vibration element 101, a second control signal for specifying the amplitude of vibration, and a third control for specifying the vibration pattern. A plurality of control signals may be collectively handled as one control signal, for example, three control signals may be collectively handled as one control signal.

  When the control signal is notified from the control signal generation unit 204, the control signal transmission unit 205 transmits the control signal to the input device 100 via the communication unit 1200.

  Next, the operation of the control terminal device 200 according to Embodiment 1 of the present invention will be described with reference to the drawings.

  FIG. 9 is a flowchart showing the operation of the control terminal device 200.

  (Step S701) First, the cursor signal receiving unit 201 receives cursor operation information transmitted from the input device 100. Then, the operation information is notified to the cursor information analysis unit 202, and the process proceeds to step S702.

  (Step S <b> 702) Upon receiving notification from the cursor signal receiving unit 201, the cursor information analysis unit 202 calculates cursor position coordinates on the display unit 300. Then, the calculated cursor position coordinates are output to the control signal generation unit 204, and the process proceeds to step S703.

  (Step S <b> 703) Upon receiving the notification from the cursor information analysis unit 202, the control signal generation unit 204 uses the calculated cursor position coordinates and the attribute information and position coordinates of the object 301 accumulated in the attribute information accumulation unit 203. Then, a control signal for determining the vibration location, vibration amplitude, and vibration pattern of the vibration element 101 provided in the input device 100 is generated, and the process proceeds to step 704.

  (Step S704) When the control signal is input, the control signal transmission unit 205 transmits the control signal to the input device 100 via the communication unit 1200 and ends the operation.

  Here, the control signal generated in control signal generation section 204 in Embodiment 1 of the present invention will be described.

  The control signal generated by the control signal generation unit 204 is calculated based on the attribute information of the object 301 and information indicating the positional relationship between the object 301 and the cursor 302. The information indicating the positional relationship between the cursor 302 and the object 301 includes, for example, the object position coordinates and the length of a line segment connecting the cursor position coordinates, an angle determined by the line segment and the cursor position coordinates, or the cursor 302 It is composed of the speed.

  FIG. 10 is a diagram illustrating an operation screen that the control terminal device 200 outputs to the display unit 300.

  For example, the operation screen illustrated in FIG. 10 includes an object 301 and a cursor 302. In this case, an object position coordinate 305, a cursor position coordinate 306, an object position coordinate 305, a line segment 303 connecting the cursor position coordinates 306, and a right half line 304 starting from the cursor position coordinates 306 are defined.

  First, a method for calculating the length of the line segment 303 connecting the cursor position coordinates 306 and the object position coordinates 305 will be described.

  The length of the line segment 303 connecting the cursor position coordinates 306 and the object position coordinates 305 can be calculated by coordinate calculation using both position coordinates. Note that any algorithm may be used as a calculation algorithm for obtaining the length of the line segment.

  Next, a method of calculating the line segment 303 connecting the cursor position coordinates and the object position coordinates and the angle determined by the cursor position coordinates will be described.

  As an angle formed by the object 301 and the cursor 302, an angle formed counterclockwise with respect to the right half line 304 among the angles formed by the line segment 303 and the right half line 304 is used. This angle calculation method can be calculated using vector calculation of a two-dimensional plane. Note that the angle is not limited to the counterclockwise angle with respect to the right half line 304. For example, any angle that can express the positional relationship between the cursor 302 and the object 301, such as an clockwise angle, can be used. You may use anything.

  Further, a method for calculating the speed from the cursor position coordinates 306 and the object position coordinates 305 will be described.

  The speed of the cursor 302 with respect to the object 301 can be calculated by calculating the displacement information at a fixed time from the transition of the position information of the cursor 302. Any calculation algorithm for obtaining the speed may be used.

  Here, a specific example of the control signal generated by the control signal generation unit 204 will be described with reference to the drawings.

  FIG. 11 is a display example of an operation screen displayed on the display unit 300, and represents a state in which the cursor 601 approaches from the right side of the object 602 in which attribute information called A file is preset. In this specific example, the vibration pattern is identified using the angle to identify the vibration element 101 and the length of the line segment connecting the cursor position coordinates and the object position coordinates to identify the vibration amplitude. Use attribute information to do this. It is assumed that the cursor position coordinates are (x2, y2), the object position coordinates are (x1, y1), and attribute information A file is accumulated.

  When the cursor 601 and the object 602 are arranged as shown in FIG. 11, the angle is 180 degrees from the two position coordinates, and the length of the line segment is

Is calculated using In this case, with respect to the vibration element 101 provided on the left side of the input device 100, for example, vibrations determined on the basis of a function whose axes are the vibration amplitude and the distance between the cursor and the object as shown in FIG. With the amplitude, for example, a signal for causing a vibration operation using a vibration pattern associated with an A file as shown in FIG. 16 is generated. Note that the vibration amplitude is not limited to a function in which the maximum and minimum amplitude values are connected by a straight line as shown in FIG. 12, but the maximum and minimum amplitude values as shown in FIG. Any means may be used as long as it is possible to determine the amplitude according to the distance between the cursor and the object, such as a function connected by. Further, the vibration pattern is not limited to a pattern in which a constant pulse is generated for a certain time as shown in FIG. 16, and for example, pulses having a short rise time as shown in FIG. 17 are continuously generated. 18 may be used, or any pattern such as a vibration pattern that constantly vibrates as shown in FIG. 18 may be used. By setting various patterns in advance, for example, a display unit The type of the object displayed on 300 can be recognized by vibration.

  Thereby, for example, even when the cursor 601 on the display unit 300 and the object 602 are not in contact with each other, since the vibration element 101 is three-dimensionally arranged inside the input device 100, the user can The positional relationship of 602 can be recognized three-dimensionally through vibration. Furthermore, by using the attribute information, the type of the object 602 can also be recognized through vibration. The vibration amplitude or vibration pattern is determined based on the output result by setting the length of the line segment connecting the cursor position coordinates and the object position coordinates or the function having the speed of the cursor 302 as a variable. You may make it the structure to do. The vibration element 101 may be configured so that a function having the calculated angle as a variable is set in advance and determined based on the output result. Furthermore, the configuration may be such that the control signal is generated using only the cursor position coordinates and the object position coordinates without using the attribute information storage unit 203. Further, when calculating the length of the line segment connecting the cursor position coordinates and the object position coordinates, the overlap between the cursor 302 and the object 301 may be determined, and a control signal may be generated based on the determination result. The positional relationship can be recognized in more detail by determining the overlap. In this case, as shown in FIG. 14 and FIG. 15, the vibration amplitude may be a function that emphasizes the amplitude at the distance where the cursor and the object overlap.

(Embodiment 2)
Hereinafter, a bidirectional communication system according to Embodiment 2 of the present invention will be described with reference to the drawings.

  FIG. 19 is a block diagram illustrating a configuration of a control terminal device 1701 that selects an object 301 related to the vibration operation of the vibration element 101 and generates a control signal for the selected object 301. The control terminal device 1701 shown in FIG. 19 is different from the first embodiment in that an object selection unit 1702 is newly provided.

  The object selection unit 1702 selects the object 301 to be associated with the vibration operation of the vibration element 101 based on the cursor and the preset condition related to the object, and outputs the selected object information. The selected object 301 may be selected based on the distance from the cursor 302, or the attribute information of the object 301 stored in the attribute information storage unit 203 may be used. Furthermore, a configuration may be adopted in which a plurality of objects existing in the display unit 300 are selected.

  Here, the operation of the object selection unit 1702 in the second embodiment will be described.

  FIG. 20 is a flowchart showing the operation of the object selection unit 1702 provided in the control terminal device 1701 in the second embodiment.

  First, the object selection unit 1702 receives notification of cursor position coordinates from the cursor information analysis unit 202 (step S1801).

  Next, the distance from the cursor 302 to the object 301 is calculated using the cursor position coordinates notified from the cursor information analysis unit 202 and the position coordinates of the object 301 displayed on the display unit 300 (step S1802). ). Note that the object for calculating the distance from the cursor 302 may be configured to be all objects existing on the display unit 300, or may be configured to be an object that exists within a certain distance from the cursor. I do not care.

  Further, based on the distance between the cursor 302 and the object 301 calculated in step S1802, an object that meets a preset condition is selected (step S1803). The condition to be set in advance may be a condition for selecting the object having the shortest or longest distance from the cursor 302, or a condition for selecting all objects whose calculated distance is within a certain value. Any condition may be used as long as it is a condition regarding the distance between the object 302 and the object 301.

  Then, the selection information of the object selected in step S1803 and the cursor position coordinates are output to the control signal generation unit 204, and the operation ends (step S1804).

  In the object selection unit 1702 in the second embodiment, the distance is used as the selection condition. For example, instead of the distance, the attribute information of the object 301 is used to select an object having specific attribute information. It doesn't matter. In this case, instead of the processing in step S1802, when notification is received from the cursor information analysis unit 202, the attribute information of the object may be acquired from the attribute information storage unit 203.

  FIG. 21 is a display example of the operation screen displayed on the display unit 300, and represents a state in which the cursor 1901, the object 1902 having the attribute information of the A file, and the object 1903 having the attribute information of the B file are approached. is doing. In this specific example, in order to select the object 1902, the cursor position coordinates and the distance calculated from the object position coordinates are used. The cursor position coordinates are (x1, y1), the first object position coordinates are (x2, y2), and the second object position coordinates are (x3, y3). It is assumed that information called B file is accumulated as an attribute of the object.

  As shown in FIG. 21, when the cursor 1901 and two objects are arranged, the distance from the cursor 1901 to each object is calculated using the position coordinates. For example, the object closest to the cursor 1901 is calculated. If the condition is to select the first object 1902 is selected. If a plurality of objects are selected, the object 1902 and the object 1903 are selected. In this case, the control signal generation unit 204 is notified of two objects, generates a control signal for each object, synthesizes the generated control signals, and then outputs them to the control signal transmission unit 205. Become. For example, when two control signals shown in FIG. 22 are synthesized, any configuration may be used as long as the two control signals are synthesized, such as a simple addition as shown in FIG. Absent. For the synthesis of the vibration pattern, any signal synthesis algorithm such as a synthesis method for adding and vibrating the vibration patterns may be used.

  Thereby, for example, even when there are a plurality of objects on the display unit 300, it is possible to spatially recognize an object to be related to the vibration operation of the vibration element 101 from the cursor position coordinates through vibration. Become.

  In an input device having a plurality of vibrators according to the present invention, a response to an input operation from the input device can be notified as a tactile sense, and the movement of the cursor on the operation screen can be intuitively notified to the user through vibration. It is possible to improve the operability of the user, which is useful as an input device for searching for and operating an operation target.

The figure which shows the structure of the whole bidirectional | two-way communication system in embodiment of this invention. The block diagram which shows arrangement | positioning of the vibration element provided in the inside of the input device in embodiment of this invention The block diagram which shows the internal structure of the input device in embodiment of this invention The block diagram which shows the internal structure of the input device in embodiment of this invention The block diagram which shows the internal structure of the input device in embodiment of this invention The flowchart which shows operation | movement of the input device in embodiment of this invention. The figure which shows the structural example of the control signal in embodiment of this invention. The block diagram which shows the internal structure of the control terminal device in embodiment of this invention The flowchart which shows operation | movement of the control terminal device in embodiment of this invention. The figure which shows the operation screen which a control terminal device outputs to a display part in embodiment of this invention The figure which shows the positional relationship of the cursor output on the display part and the object in embodiment of this invention. The figure which shows the function which connected the maximum value and minimum value of the amplitude of a vibration with the straight line centering on the amplitude of the vibration and the distance of a cursor and an object in embodiment of this invention. The figure which shows the function which connected the maximum value and minimum value of the amplitude of a vibration with the curve centering on the amplitude of the vibration and the distance of a cursor and an object in embodiment of this invention. The figure which shows the function which emphasizes the amplitude in the distance which a cursor and an object overlap in the embodiment of this invention centering on the amplitude of a vibration and the distance of a cursor and an object The figure which shows the function which emphasizes the amplitude in the distance which a cursor and an object overlap in the embodiment of this invention centering on the amplitude of a vibration and the distance of a cursor and an object The figure which shows the vibration pattern which a fixed pulse generate | occur | produces for a fixed time in embodiment of this invention. The figure which shows the vibration pattern which the pulse with short rise time in the embodiment of this invention generate | occur | produces continuously. The figure which shows the vibration pattern which the pulse always stands | starts up in embodiment of this invention The figure which shows the internal structure of the control terminal device in Embodiment 2 of this invention The flowchart which shows operation | movement of the object selection part with which the control terminal device was provided in Embodiment 2 of this invention. The figure which shows the positional relationship of the cursor and object which were output on the display part in Embodiment 2 of this invention. The figure which showed the structural example of the control signal before synthesize | combining in Embodiment 2 of this invention. The figure which showed the structural example of the control signal after the synthesis | combination in Embodiment 2 of this invention

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Input device 101 Vibration element 102 Control signal receiving part 103 Signal analysis part 104 Vibration control part 200 Control terminal device 201 Cursor signal receiving part 202 Cursor information analysis part 203 Attribute information storage part 204 Control signal generation part 205 Control signal transmission part 300 Display Part 301 Object 302, 601, 1901 Cursor 303 Line segment connecting the cursor position coordinate and the object 304 Right half line starting from the cursor position coordinate 305 Object position coordinate 306 Cursor position coordinate 602, 1902 Object having attribute information of A file 1200 Communication unit 1701 Control terminal device 1702 according to Embodiment 2 of the present invention 1702 Object selection unit 1903 Object having attribute information of B file

Claims (7)

A control terminal device for controlling an object and a cursor on the display unit;
In a bidirectional transmission / reception system comprising an input device that transmits an operation signal to the control terminal device,
The control terminal device
A cursor signal receiving unit for receiving an operation signal of the cursor transmitted by the input device;
A cursor information analysis unit that calculates a cursor position coordinate on the display unit from the operation signal;
A control signal generation unit that generates a control signal for determining a vibration location, a vibration amplitude, and a vibration pattern of a vibration element provided in the input device using the cursor position coordinates and the position coordinates of the object;
A control signal transmitter for transmitting the control signal to the input device;
The input device is:
A plurality of vibration elements arranged on the input device so that the vibration position of the input device can be three-dimensionally recognized through vibration;
A control signal receiving unit for receiving the control signal transmitted by the control terminal;
From the control signal received by the control signal receiving unit, a signal analysis unit that determines a vibration location, vibration amplitude, and vibration pattern of the vibration element;
Based on the vibration information analyzed by the signal analysis unit, a vibration control unit that vibrates the vibration element;
A two-way communication system comprising: The bidirectional communication system according to claim 1,
The control terminal device
And an object selection unit that selects an object associated with the vibration operation of the vibration element based on the cursor and a condition related to the object,
The control signal generation unit determines a vibration location, a vibration amplitude, and a vibration pattern of a vibration element provided in the input device, using the cursor position coordinates and the position coordinates of the object selected by the object selection unit. A bidirectional communication system characterized by generating a control signal. The bidirectional communication system according to claim 2, wherein
The control signal generation unit provided in the control terminal device further generates a plurality of control signals for each object when the object selection unit selects a plurality of objects, and generates the plurality of controls. A bidirectional communication system characterized in that a synthesized signal is used as a representative control signal. The bidirectional communication system according to any one of claims 1 to 3,
The control terminal device
Furthermore, an attribute information storage unit that stores attribute information corresponding to the object existing on the display unit,
The control signal generation unit further generates a control signal for determining a vibration location, vibration amplitude and vibration pattern of a vibration element provided in the input device using the attribute information. . The bidirectional communication system according to claim 1, wherein:
The control signal generation unit provided in the control terminal device further includes a vibration element provided in the input device using a line segment connecting the cursor position coordinates and the object position coordinates and an angle determined by the cursor position coordinates. A bidirectional communication system characterized by generating a control signal for determining a vibration location, vibration amplitude and vibration pattern. A two-way communication system according to claim 1 to claim 5, wherein
The control signal generation unit provided in the control terminal device further uses a length of a line segment connecting the cursor position coordinates and the object position coordinates to vibrate vibration points and vibrations of a vibration element provided in the input device. A bidirectional communication system, characterized by generating a control signal for determining the amplitude and vibration pattern of the signal. The bidirectional communication system according to claim 6, wherein
The control signal generation unit provided in the control terminal device further includes a determination unit that determines an overlap between the cursor and the object using the cursor position coordinates and the object position coordinates,
A bidirectional communication system, characterized in that a control signal for determining a vibration location, vibration amplitude and vibration pattern of a vibration element provided in the input device is generated using a determination result of the determination means.

Images