WO2013157626A1 - Dispositif électronique et procédé de commande de vibrations - Google Patents

Dispositif électronique et procédé de commande de vibrations Download PDF

Info

Publication number
WO2013157626A1
WO2013157626A1 PCT/JP2013/061603 JP2013061603W WO2013157626A1 WO 2013157626 A1 WO2013157626 A1 WO 2013157626A1 JP 2013061603 W JP2013061603 W JP 2013061603W WO 2013157626 A1 WO2013157626 A1 WO 2013157626A1
Authority
WO
WIPO (PCT)
Prior art keywords
vibration
unit
electronic device
luminance value
display
Prior art date
Application number
PCT/JP2013/061603
Other languages
English (en)
Japanese (ja)
Inventor
敏 赤坂
Original Assignee
株式会社ニコン
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社ニコン filed Critical 株式会社ニコン
Publication of WO2013157626A1 publication Critical patent/WO2013157626A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user

Definitions

  • the present invention relates to an electronic device and a vibration control method.
  • This application claims priority based on Japanese Patent Application No. 2012-096572 for which it applied on April 20, 2012, and uses the content here.
  • Patent Document 1 a portable information terminal including a touch panel and a vibration unit is known (for example, see Patent Document 1).
  • the portable information terminal disclosed in Patent Literature 1 vibrates the vibration unit at a different level according to whether or not input is possible using a touch panel.
  • the drive unit of the portable information terminal disclosed in Patent Document 1 vibrates as a notification unit and cannot drive the housing according to the touch position on the touch panel.
  • An electronic device is displayed on the display screen, a vibration unit that generates vibration, a display unit including a display screen, an instruction position reception unit that receives an input of an instruction position on the display screen. And a vibration control unit that generates vibration control information for vibrating the vibration unit based on the displayed image and the designated position received by the designated position receiving unit.
  • an electronic device includes a vibration unit that generates vibrations, a detection unit that detects movement of the device main body as an input operation for moving an indicated position on the display screen of another device, A communication unit that transmits the movement information detected by the detection unit to another device, and that receives a luminance value of a display image displayed on the display screen at an instruction position moved based on the movement information; And a vibration control unit that generates vibration control information for causing the vibration unit to vibrate according to the luminance value received by the communication unit.
  • a vibration control method is a vibration control method for a vibration unit in an electronic apparatus having a display screen and a vibration unit, and receives an instruction position input on the display screen. And a vibration control information generation step for vibrating the vibration unit based on the display image displayed on the display screen and the indication position received by the indication position reception step. To do.
  • the housing can be driven according to the touch position on the touch panel.
  • visual information can be converted into tactile information. Therefore, the user can feel the display image as a tactile sense in addition to the visual sense.
  • FIG. 1 is an example of a functional block diagram of an electronic device 1 according to the first embodiment of the present invention.
  • the electronic device 1 includes a main body (housing) 10, a display control unit 100, a display unit 110, a touch sensor (pointed position reception unit) 120, a vibration control unit 130, a vibration unit 140, and a storage unit. 190.
  • An example of the electronic device 1 is a camera, a smartphone, a tablet, a portable music playback device, or the like.
  • the vibration unit 140 (the same applies to vibration units 240 and 340 described later) is an example of the drive unit of the present invention.
  • Another example of the drive unit of the present invention is a position moving unit that moves the display screen in the thickness direction of the display unit 110.
  • the electronic device 1 (the same applies to electronic devices 2, 3, and 4 described later) may include a position moving unit (not shown) instead of the vibrating unit 140 (vibrating units 240 and 340).
  • the electronic apparatus 1 includes a position moving unit (not shown) instead of the vibrating unit 140, a position moving unit (not shown) is used instead of the vibration control unit 130 (the same applies to vibration control units 230, 330, and 332 described later). ) Is provided.
  • the case where the electronic apparatus 1 includes the vibration unit 140 as illustrated in FIG. 1 will be described.
  • the display unit 110 has a display screen (not shown).
  • the information displayed on the display screen is also referred to as a display image.
  • the basic data of the display image is stored in the storage unit 190.
  • the storage unit 190 stores various data.
  • the storage unit 190 stores basic data of the display image.
  • An example of the basic data of the display image is bitmap information (for example, a photograph and an illustration) and screen information of a predetermined screen (for example, a menu screen and a help screen).
  • bitmap information for example, a photograph and an illustration
  • screen information of a predetermined screen for example, a menu screen and a help screen.
  • bitmap information of A image is also simply referred to as “A image”
  • screen information of B screen is simply “B screen”. It shall also be called.
  • the image (bitmap information) stored in the storage unit 190 is not particularly limited.
  • the electronic device 1 includes a communication unit (not shown), and the storage unit 190 stores a received image received by the communication unit.
  • the electronic device 1 may include a medium connection unit (not shown), and the storage unit 190 may store an image in a medium (for example, a memory card) connected to the medium connection unit.
  • the electronic device 1 may include an imaging unit (not shown), and the storage unit 190 may store a captured image captured by the imaging unit.
  • the electronic device 1 may include an image creation unit (drawing software), and the storage unit 190 may store the created image created by the image creation unit.
  • the basic data of the display image is stored (saved) in the storage unit 190 in accordance with an explicit save instruction from the user at the time of shipment or after shipment, and is not based on the above-described save instruction after shipment.
  • examples of display image base data temporarily stored in the storage unit 190 are a cache image, a cache screen, and a through image.
  • Touch sensor 120 detects the contact position on the display screen. That is, the touch sensor 120 accepts an input of the designated position on the display screen from the user. The touch sensor 120 outputs the contact position (instructed position) to the display control unit 100 when detecting the contact position on the display screen, that is, when receiving the input of the designated position.
  • the display control unit 100 displays the display image on the display screen based on the basic data of the display image stored in the storage unit 190. More specifically, the display control unit 100 generates display data based on the basic data of the display image stored in the storage unit 190 and outputs the generated display data to the display unit 110.
  • the display control unit 100 displays the display image on the display screen.
  • the display control unit 100 displays an image stored in the storage unit 190 in the past on the display screen when the user gives an instruction via the touch sensor 120.
  • the display control unit 100 displays the temporarily stored image on the display screen.
  • the display control unit 100 acquires a contact position (instructed position) from the touch sensor 120.
  • the display control unit 100 executes various processes according to the display image and the indicated position.
  • the display control unit 100 acquires a contact position from the touch sensor 120 during display of a certain screen, the contact position is on one button on the screen (in the button display area).
  • a process ID corresponding to the button is output to a process execution unit (not shown).
  • the process execution unit that has acquired the process ID from the display control unit 100 executes the process according to the process ID and outputs an instruction to display the process result to the display control unit 100.
  • the display control unit 100 After outputting the process ID to the process execution unit, the display control unit 100 generates display data according to an instruction from the process execution unit, and outputs the generated display data to the display unit 110.
  • the display control unit 100 may execute a process according to the process ID instead of the process execution unit. That is, the display control unit 100 may have the function of a processing execution unit.
  • the display control unit 100 acquires a contact position from the touch sensor 120 while displaying an image
  • the display control unit 100 outputs a luminance value at the contact position of the display image to the vibration control unit 130.
  • the vibration control unit 130 controls the vibration unit 140 by generating vibration control information and outputting the generated vibration control information to the vibration unit 140.
  • the vibration control unit 130 generates vibration control information according to the display image and the contact position. More specifically, the vibration control unit 130 acquires a luminance value (luminance value at the contact position of the display image) from the display control unit 100. The vibration control unit 130 that has acquired the luminance value from the display control unit 100 generates vibration control information corresponding to the luminance value.
  • the vibration control unit 130 that has acquired the luminance value from the display control unit 100 calculates the difference between the luminance value (the luminance value acquired this time) and the luminance value acquired last time, and performs vibration control according to the difference in luminance value. Information may be generated. That is, the vibration control unit 130 may generate vibration control information according to whether or not the contact position is an edge portion of the display image.
  • the vibration unit 140 vibrates the main body (housing) 10 based on the vibration control information output from the vibration control unit 130. Since the vibration control information output from the vibration control unit 130 is generated according to the display image and the contact position as described above, in other words, the vibration unit 140 includes the display image and the designated position. Vibrates accordingly.
  • the vibration unit 140 vibrates according to the vibration control information. Further, when the vibration unit 140 acquires vibration control information corresponding to the difference in luminance value, the vibration unit 140 vibrates according to the vibration control information. That is, the vibration unit 140 vibrates according to whether or not the contact position is an edge portion of the display image.
  • an example of the vibration unit 140 is a vibration motor or a linear vibrator.
  • the vibration control information is an input voltage for driving the vibration motor and the linear vibrator, or information (signal) for generating the input voltage.
  • the number of the vibrating units 140 illustrated is one, but the electronic device 1 (the same applies to electronic devices 2, 3, and 4 described later) includes two or more vibrating units 140. May be provided.
  • the vibration of the housing 10 (specifically, the display screen) when a vibration motor is used as the vibration unit 140 will be described.
  • FIG. 2 is an example of a display image.
  • FIG. 3 is an example of luminance values on the display image and changes in luminance values.
  • FIG. 4 is an example of the time variation of the input voltage and the vibration waveform.
  • FIG. 5 is a cross-sectional view of the housing 10 for explaining the arrangement position of the vibration motor.
  • the vibration motor is a vibration element that is input with a direct current, and generates a vibration having a strength proportional to the input voltage.
  • FIG. 2 shows a display image P that is an example of a display image.
  • the finger and an arrow 2 traces the upper straight line L represents (from the start position p 0 to the end point position p 7, straight contact position moving) state. Each of the positions p exists on the straight line L.
  • FIG. 3A shows luminance values on a straight line L including each position p.
  • the luminance value between the position p 0 and the position p 1 on the straight line L is B 4
  • the luminance value between the position p 1 and the position p 2 on the straight line L is B 1
  • the straight line L The luminance value between the upper position p 2 and the position p 3 is B 3
  • the luminance value between the position p 3 and the position p 4 on the straight line L is B 2
  • the luminance value between the position p 4 and the position p 5 on the straight line L It is assumed that the value is B 3
  • the luminance value between position p 5 and position p 6 on the straight line L is B 1
  • the luminance value between position p 6 and position p 7 on the straight line L is B 4 .
  • FIG. 3 (b) the upper straight line L shown in FIG. 2, at a constant rate over a m seconds, when traced with a finger (multiplied by m sec at a constant speed, the end position p 7 from the start position p 0 Time variation of the brightness value when the contact position is moved straight up to the present). That is, FIG. 3B shows a temporal change of the luminance value for m seconds.
  • the time change of the luminance value from time T 0 (zero seconds) to time T 7 (m seconds) is the time T 0. to time T 1 between the luminance value B 4, the time T 1 ⁇ time T 2, between the luminance value B 1, time T 2, to time T 3 between the luminance value B 3, time T 3 to time T 4 between the luminance value B 2, the time T 4 ⁇ time T 5 between the luminance value B 3, between times T 5 ⁇ time T 6 the luminance value B 1, between times T 6 ⁇ time T 7 is the luminance value B 4.
  • FIG. 4A shows an input voltage input to the vibration motor (vibration unit 140) shown in FIG. 5 when the finger is traced on the straight line L shown in FIG.
  • the time change of (vibration element input voltage) is represented. That is, FIG. 4A shows the time change of the input voltage when the luminance value changes with time as shown in FIG.
  • FIG. 4B shows the vibration of the casing 10 by the vibration motor (vibration unit 140) shown in FIG. 5 when the finger is traced on the straight line L shown in FIG. It represents the time change of the waveform. That is, FIG. 4B shows the change over time of the vibration intensity of the housing 10 when the luminance value changes over time as shown in FIG. Note that the vibration frequency shown in FIG. 4B is determined by the vibration element forming the vibration motor.
  • the time change of the vibration waveform from time T 0 (zero seconds) to time T 7 (m seconds) is the time T 0. to time T 1 between the vibration intensity V 4, while the time T 1 ⁇ time T 2, the vibration intensity V 1, time T 2, to time T 3 between the vibration intensity V 3, while the time T 3 to time T 4 vibration intensity V 2, between times T 4 ⁇ time T 5 vibration intensity V 3, while the time T 5 ⁇ time T 6 between vibration intensity V 1, the time T 6 ⁇ time T 7 is the vibration intensity V 4.
  • the vibration control unit 130 vibrates the vibration motor (vibration unit 140) with a vibration intensity proportional to the luminance value (vibration intensity obtained by multiplying the luminance value by a predetermined coefficient).
  • the coefficient may be changed according to the pressure (contact area) at the time of contact. For example, the degree of amplification may be increased as the pressure is higher. Further, the coefficient may be changed according to the moving speed of the contact position.
  • FIG. 6 is an example of a time change of the drive waveform (input waveform) and the vibration waveform.
  • FIG. 7 is a cross-sectional view of the housing 10 for explaining the arrangement position of the linear vibrator.
  • the linear vibrator is a vibration element that inputs at the vibration frequency itself, and generates vibration having a strength proportional to the input voltage.
  • FIG. 6A shows a drive waveform (vibration element) of the linear vibrator (vibration unit 140) shown in FIG. 7 when the finger is traced on the straight line L shown in FIG. Drive waveform) over time. That is, FIG. 6A shows the change over time of the drive waveform when the luminance value changes over time as shown in FIG. According to FIG. 6A, the amplitude of the drive waveform changes according to the change of the luminance value.
  • the drive waveform shown in FIG. 6A is obtained by, for example, AM modulating the vibration frequency (determined by the vibration element forming the linear vibrator).
  • FIG. 6B shows the vibration of the casing 10 by the linear vibrator (vibration unit 140) shown in FIG. 7 when the finger is traced on the straight line L shown in FIG. It represents the time change of the waveform. That is, FIG. 6B shows the change over time of the vibration intensity of the housing 10 when the luminance value changes over time as shown in FIG.
  • the vibration control unit 130 has a linear vibrator (vibration unit) with a vibration intensity proportional to the luminance value. 140) is vibrated.
  • the proportional coefficient may be changed according to the pressure (contact area) at the time of contact, or the proportional coefficient according to the moving speed of the contact position. May be changed.
  • the electronic device 1 includes a position moving unit (voice coil motor (VCM)) that moves the display screen in the thickness direction of the display unit 110 instead of the vibration unit 140 (for example, a vibration motor or a linear vibrator).
  • VCM voice coil motor
  • vibration control information generated by a position movement control unit is an input voltage for driving the voice coil motor or information (signal) for generating the input voltage.
  • FIG. 8 is an example of the time change of the input voltage and the vibration waveform.
  • FIG. 9 is a cross-sectional view of the housing 10 for explaining the arrangement position of the voice coil motor.
  • the voice coil motor is a vibration element that inputs at the vibration frequency itself, and generates vibration having a strength proportional to the input voltage. Voice coil motors can generate vibrations from direct current or very low frequencies.
  • the number of voice coil motors illustrated is one, but the electronic device 1 (the same applies to electronic devices 2, 3, and 4 described later) may include two or more voice coil motors. .
  • FIG. 8A shows an input input to the voice coil motor (position moving unit) shown in FIG. 9 when the finger is traced on the straight line L shown in FIG. It shows the time change of voltage (vibration element input voltage). That is, FIG. 8A shows the time change of the input voltage when the luminance value changes with time as shown in FIG.
  • FIG. 8B shows the height of the display screen by the voice coil motor (position moving unit) shown in FIG. 9 when the finger is traced on the straight line L shown in FIG. This represents a change with time (position in the thickness direction). That is, FIG. 8B shows a change over time in the height of the display screen when the luminance value changes over time as shown in FIG.
  • the position moving control unit moves the display screen to a height proportional to the luminance value.
  • the proportional coefficient may be changed according to the pressure at the time of contact (contact area), or according to the moving speed of the contact position, The proportionality coefficient may be changed.
  • FIG. 10 is another example of the time change of the luminance value, the input voltage, and the vibration waveform.
  • FIG. 10A is a diagram in which a threshold value Th1, a threshold value Th2,..., A threshold value Th8 are added to the diagram of the change in luminance value over time shown in FIG.
  • FIG. 10B shows the change over time of the input voltage to the voice coil motor (vibration element) when the threshold value is set as shown in FIG.
  • the input voltage shown in FIG. 10B includes the brightness values (brightness value B 1 , brightness value B 2 ,..., Brightness value B 4 ) and threshold values (threshold value Th 1, threshold value Th 2 ,...) Shown in FIG.
  • the threshold value Th8) is determined based on the comparison result.
  • FIG. 10C shows a time change of the vibration waveform of the casing 10 by the vibration motor (vibration unit 140) shown in FIG. 5 when the input voltage changes with time as shown in FIG. 10B.
  • the relationship between the luminance value and the vibration intensity is such that the vibration intensity is zero (no vibration) when the luminance value is less than the threshold Th1, and the vibration intensity when the luminance value is greater than or equal to the threshold Th1 and less than Th2.
  • the vibration intensity is the intensity Lv2 when the luminance value is the threshold Th2 or more and less than Th3
  • the vibration intensity is the intensity Lv3 when the luminance value is the threshold Th3 or more and less than Th4
  • the luminance value is the threshold Th4 or more Th5. If the brightness value is less than or equal to threshold Th5 and less than Th6, the vibration intensity is set to intensity Lv5.
  • the vibration intensity is set to intensity Lv6.
  • the vibration intensity is set as the intensity Lv7, and when the luminance value is the threshold Th8, the vibration intensity is set as the intensity Lv8.
  • the vibration motor may vibrate the housing 10 with a predetermined vibration intensity according to a comparison result between the luminance value and the threshold value.
  • a linear vibrator is used as the vibration unit 140.
  • a position moving unit voice coil motor
  • vibrating unit 140 vibrating motor, linear vibrator
  • the interval (difference) between adjacent threshold values is constant, but the interval between adjacent threshold values may not be constant.
  • eight threshold values are used, but one to seven or nine or more threshold values may be used.
  • FIG. 11 shows another example of temporal changes in the luminance value, input voltage, and vibration waveform.
  • FIG. 11A shows a change in luminance value over time when the finger is traced on the straight line L shown in FIG. 2 at a constant speed over m seconds. That is, FIG. 11A shows the change over time in the difference in luminance value over the m seconds.
  • the input voltage in FIG. 11 (b) represents the change over time of the input voltage to the voice coil motor (vibration element) when the difference in luminance value changes over time as shown in FIG. 11 (a).
  • the input voltage shown in FIG. 11B is determined based on the difference between the luminance values shown in FIG.
  • FIG. 11 (c) shows the time change of the vibration waveform of the housing 10 by the vibration motor (vibration unit 140) shown in FIG. 5 when the input voltage changes with time as shown in FIG. 11 (b).
  • the vibration motor (vibration unit 140) may vibrate the housing 10 with a predetermined vibration intensity according to the difference in luminance value.
  • the vibration motor (vibration unit 140) may drive the housing 10 according to whether or not the indicated position is the edge portion of the display image, or to what extent the position is applied to the edge portion.
  • a linear vibrator is used as the vibration unit 140.
  • a position moving unit voice coil motor
  • vibrating unit 140 vibrating motor, linear vibrator
  • a threshold value may be set for the difference in luminance value and the housing 10 may be driven (vibration, the height of the display screen is moved). That is, the vibration motor (vibration unit 140) may vibrate the housing 10 with a predetermined vibration intensity according to the comparison result between the difference in luminance value and the threshold value.
  • the vibration motor vibration unit 140
  • a position moving unit voice coil motor
  • vibrating unit 140 vibrating motor, linear vibrator
  • FIG. 12 is an example of a flowchart showing a processing flow of the electronic device 1.
  • FIG. 13 is another example of a flowchart showing the flow of processing of the electronic device 1.
  • FIG. 12 shows a flow of processing (one example) when a touch is detected by the touch sensor 120 in any of the following situations 1, 2 and 3.
  • FIG. 13 illustrates a process flow (one example) when a touch is detected by the touch sensor 120 in any of the following situations 1 and 2. The flowcharts shown in FIGS. 12 and 13 are started when a display image is displayed.
  • the touch sensor 120 determines whether or not contact on the display screen has been detected (step S100). Note that the touch sensor 120 detects contact in the case of any of the above-described situation 1, situation 2, and situation 3.
  • step S100 Yes
  • the touch sensor 120 outputs the contact position to the display control unit 100.
  • Display control part 100 which acquired a contact position from touch sensor 120 judges whether a contact position is the same as the last time (Step S102). That is, the display control unit 100 determines whether the situation 1, the situation 2, or the situation 3 is the situation 1, the situation 2, or the situation 3.
  • step S102 when the contact position is not the same as the previous time (step S102: No), that is, in the case of situation 1 or situation 2, the brightness value of the contact position of the display image (that is, the display image and the designated position). A corresponding luminance value) is output to the vibration control unit 130.
  • the vibration control unit 130 that has acquired the luminance value from the display control unit 100 generates vibration control information (an input voltage for driving a vibration motor or a linear vibrator or an input voltage corresponding to the display image and the contact position). Information) is generated (step S110). For example, the vibration control unit 130 generates vibration control information according to the luminance value acquired from the display control unit 100 (the luminance value at the contact position of the display image). Further, the vibration control unit 130 may generate vibration control information according to a difference between the previous luminance value acquired from the display control unit 100 and the current luminance value acquired from the display control unit 100. That is, the vibration control unit 130 may generate vibration control information according to whether or not the contact position is an edge portion of the display image. The vibration control unit 130 outputs the generated vibration control information to the vibration unit 140. The vibration unit 140 that has acquired the vibration control information from the vibration control unit 130 vibrates the main body (housing) 10 according to the vibration control information (step S120).
  • step S130 determines that the housing 10 is vibrating after outputting the vibration control information for vibrating the housing 10 and before outputting the vibration control information for stopping the vibration.
  • step S130 when the housing 10 is not vibrating (step S130: No), the process proceeds to step S160. If the housing 10 is vibrating in step S130 (step S130: Yes), it is determined whether or not a predetermined time has elapsed from the start of the vibration (step S132). For example, when a predetermined time has passed since the vibration control information (excluding vibration control information for stopping vibration) is output to the vibration unit 140 at the last (most recent time), the vibration control unit 130 performs predetermined processing from the start of the vibration. Judge that time has passed.
  • step S132: No If the predetermined time has not elapsed in step S132 (step S132: No), the process proceeds to step S160.
  • step S132: Yes the vibration of the housing 10 is stopped (step S134).
  • the vibration control unit 130 outputs vibration control information for stopping the vibration to the vibration unit 140.
  • step S100 determines whether the housing 10 is vibrating (step S130). Step S150). If the housing 10 is vibrating in step S150 (step S150: Yes), the vibration of the housing 10 is stopped (step S154), as in step S134.
  • step S120 step S130 (No), step S132 (No), step S134, step S150 (No), or step S154, the display control unit 100 determines whether or not display of the display image has ended (step S120). Step S160). If the display has not ended (step S160: No), the process returns to step S100.
  • step S160: Yes it is determined whether the housing 10 is vibrating as in step S130 (step S170).
  • step S170 the vibration of the casing 10 is stopped (step S174) as in step S134, and the flowchart shown in FIG.
  • step S174 is skipped and the flowchart shown in FIG.
  • the touch sensor 120 determines whether or not contact on the display screen has been detected (step S202). Note that the touch sensor 120 detects a contact when the situation 1 or the situation 2 is described above. In the case of situation 3 described above, no contact is detected.
  • step S202 When a contact is detected in step S202 (step S202: Yes), that is, in the case of either situation 1 or situation 2, the touch sensor 120 outputs the contact position to the display control unit 100.
  • the display control unit 100 that has acquired the contact position from the touch sensor 120 outputs the luminance value of the contact position of the display image (that is, the luminance value according to the display image and the designated position) to the vibration control unit 130.
  • the vibration control unit 130 that has acquired the luminance value from the display control unit 100 generates vibration control information according to the display image and the contact position (step S210). For example, the vibration control unit 130 generates vibration control information according to the luminance value acquired from the display control unit 100 (the luminance value at the contact position of the display image). Further, the vibration control unit 130 may generate vibration control information according to a difference between the previous luminance value acquired from the display control unit 100 and the current luminance value acquired from the display control unit 100. That is, the vibration control unit 130 may generate vibration control information according to whether or not the contact position is an edge portion of the display image. The vibration control unit 130 outputs the generated vibration control information to the vibration unit 140. The vibration unit 140 that has acquired the vibration control information from the vibration control unit 130 vibrates the main body (housing) 10 according to the vibration control information (step S220).
  • step S230 it is determined whether or not the housing 10 is vibrating.
  • the vibration control unit 130 determines that the housing 10 is vibrating after outputting the vibration control information for vibrating the housing 10 and before outputting the vibration control information for stopping the vibration.
  • step S230 when the housing 10 is not vibrating (step S230: No), the process proceeds to step S260. If the casing 10 is vibrating in step S230 (step S230: Yes), it is determined whether or not a predetermined time has elapsed since the start of the vibration (step S232). For example, when a predetermined time has passed since the vibration control information (excluding vibration control information for stopping vibration) is output to the vibration unit 140 at the last (most recent time), the vibration control unit 130 performs predetermined processing from the start of the vibration. Judge that time has passed.
  • step S232: No If the predetermined time has not elapsed in step S232 (step S232: No), the process proceeds to step S260.
  • step S232: Yes the vibration of the housing 10 is stopped (step S234).
  • the vibration control unit 130 outputs vibration control information for stopping the vibration to the vibration unit 140.
  • step S230 No
  • step S232 No
  • step S234 the display control unit 100 determines whether or not display of the display image has ended (step S260). If the display has not ended (step S260: No), the process returns to step S202.
  • step S260: Yes it is determined whether the housing 10 is vibrating as in step S230 (step S270). If the housing 10 is vibrating in step S270 (step S270: Yes), the vibration of the housing 10 is stopped (step S274) as in step S234, and the flowchart shown in FIG. On the other hand, when the housing 10 is not vibrating in step S270 (step S270: No), step S274 is skipped and the flowchart shown in FIG.
  • FIGS. 12 and 13 show the case where the electronic device 1 uses the vibration unit 140 (vibration motor, linear vibrator) as a drive unit, that is, according to the luminance value (or luminance value difference). 10 shows the flow of processing in the case of vibrating 10.
  • the electronic device 1 uses a position moving unit (voice coil motor) as a driving unit, that is, when the display screen is moved in the thickness direction of the housing 10 in accordance with the luminance value (or luminance value difference). Is the same.
  • the housing 10 can be driven according to the luminance value (or the difference in luminance value) at the contact position.
  • the vibration unit 140 vibration motor, linear vibrator
  • the housing 10 can be vibrated according to the luminance value (or the difference in luminance value) at the contact position.
  • a position moving unit voice coil motor
  • the height of the display screen can be changed according to the luminance value (or luminance value difference) at the contact position. That is, the electronic device 1 converts visual information into tactile information. Therefore, the user can recognize the image as a tactile sense in addition to the visual sense.
  • FIG. 14 is an example of a functional block diagram of the electronic device 2 according to the second embodiment of the present invention.
  • the electronic device 2 includes a main body (housing) 20 including a display control unit 200, a display unit 210, a keyboard 220, a vibration control unit 230, a vibration unit 240, and a storage unit 290.
  • the keyboard 220 includes a pressing key unit 222 and a cursor pad (instructed position receiving unit) 224.
  • the push key unit 222 has a plurality of buttons.
  • the cursor pad 224 is an example of a pointing device for moving the designated position on the display screen.
  • An example of the electronic device 2 is a notebook computer or a notebook computer.
  • the vibrating unit 240 is an example of the driving unit of the present invention.
  • the electronic device 2 may include a position moving unit that moves the display screen in the thickness direction of the display unit 210 as a driving unit instead of the vibration unit 240.
  • the keyboard 220 When the button of the pressing key unit 222 is pressed, the keyboard 220 outputs pressing information (information for identifying the button) to the display control unit 200. In addition, when the cursor pad 224 is operated, the keyboard 220 outputs operation information (operation direction and operation amount) to the display control unit 200. The cursor pad 224 outputs the operation information to the display control unit 200 when receiving an input of the designated position.
  • the display control unit 200 displays a display image on the display screen, similarly to the display control unit 100 included in the electronic device 1. Further, the display control unit 200 displays a cursor (pointer) indicating the designated position on the display screen.
  • a cursor pointer
  • the display control unit 200 acquires the pressing information from the keyboard 220, the display control unit 200 outputs a processing ID corresponding to the pressed button to a processing execution unit (not shown).
  • the process execution unit that has acquired the process ID from the display control unit 200 executes the process according to the process ID, and outputs an instruction to display the process result to the display control unit 200.
  • the display control unit 200 After outputting the process ID to the process execution unit, the display control unit 200 generates display data in accordance with an instruction from the process execution unit, and outputs the generated display data to the display unit 210.
  • the display control unit 200 may execute the process according to the process ID instead of the process execution unit. That is, the display control unit 200 may have the function of a process execution unit.
  • the display control unit 200 acquires operation information from the keyboard 220 while displaying an image
  • the display control unit 200 moves the cursor according to the operation information. That is, the cursor pad 224 provided in the keyboard 200 is a pointing device for moving the designated position on the display screen.
  • the display control unit 200 displays the cursor position of the display image when the cursor is displayed or when the cursor position is moved while the image is displayed (when operation information is acquired from the keyboard 220).
  • the luminance value is output to the vibration control unit 230.
  • the vibration control unit 230 acquires a luminance value (luminance value at the cursor position of the display image) from the display control unit 200.
  • the vibration control unit 230 that has acquired the luminance value from the display control unit 200 generates vibration control information corresponding to the luminance value.
  • the vibration control unit 230 that has acquired the luminance value from the display control unit 200 calculates a difference between the luminance value (the luminance value acquired this time) and the luminance value acquired last time, and performs vibration control according to the difference in luminance value. Information may be generated. That is, the vibration control unit 230 may generate vibration control information according to whether or not the cursor position is an edge portion of the display image.
  • the housing 20 can be driven according to the luminance value (or luminance value difference) at the cursor position.
  • the vibration unit 240 vibration motor or linear vibrator
  • the housing 20 can be vibrated according to the luminance value (or the difference in luminance value) at the cursor position.
  • a position moving unit voice coil motor
  • the height of the display screen can be changed according to the luminance value (or luminance value difference) at the cursor position. That is, the electronic device 2 converts visual information into tactile information. Therefore, the user can recognize the image as a tactile sense in addition to the visual sense.
  • FIG. 15 is an example of a functional block diagram of the electronic device 3 according to the third embodiment of the present invention.
  • the electronic device 3 includes a main body (housing) 30a, a keyboard 30b, a mouse 30c, and a display 30d.
  • the main body (housing) 30a includes a display control unit 300, a vibration control unit 330, a communication unit 380, and a storage unit 390.
  • the keyboard 30b includes a push key unit 322 and a communication unit 382.
  • the mouse 30c includes a detection unit 326, a vibration unit 340, and a communication unit 384.
  • the display 30d includes a display screen 312 and a communication unit 386.
  • the mouse 30c is an example of a pointing device for moving the designated position on the display screen 312.
  • An example of the electronic device 3 is a desktop personal computer.
  • the display control unit 300, the vibration control unit 330, and the storage unit 390 included in the main body 30a of the electronic device 3 are the same as the display control unit 200, the vibration control unit 230, and the storage unit 290 included in the electronic device 2, one description will be given. Some or all of them are omitted.
  • the keyboard 30b of the electronic device 3 is the same as the keyboard 220 provided in the electronic device 2 except that the keyboard 30b is provided with a communication unit 382 instead of the cursor pad 224, description thereof is omitted.
  • the display 30d of the electronic device 3 will not be described regarding the same contents as the display unit 210 provided in the electronic device 2.
  • the vibrating unit 340 is an example of the driving unit of the present invention.
  • the electronic device 3 may include a position moving unit that moves the display screen 312 in the thickness direction of the display 30d as a driving unit instead of the vibration unit 340.
  • the detecting unit 326 detects the movement of the own device (device main body, mouse 30c) as an input operation for moving the indicated position on the display screen of the display 30d.
  • the communication unit 384 transmits the movement information (movement direction and movement amount) detected by the detection unit 326 to the main body 32a. In other words, when movement is detected by the detection unit 326, the mouse 30c outputs movement information (movement direction and movement amount) to the main body 30a via the communication unit 384.
  • the communication unit 384 receives vibration control information from the main body 30a.
  • the vibration unit 340 vibrates according to the vibration control information received by the communication unit 384.
  • the mouse 30c vibrates the vibration unit 340 according to the vibration control information acquired from the main body 30a.
  • the display control unit 300 displays a display image on the display screen 312 in the same manner as the display control unit 200 included in the electronic device 2.
  • the display control unit 300 displays a cursor (pointer) indicating the designated position on the display screen 312, similarly to the display control unit 200 included in the electronic device 2.
  • the display control unit 300 acquires the pressing information from the keyboard 30b via the communication unit 380, the display control unit 300 assigns the processing ID corresponding to the pressed button to the processing execution unit, similarly to the display control unit 200 included in the electronic device 2. (Not shown), generates display data in accordance with an instruction from the processing execution unit, and outputs the display data to the display 30d via the communication unit 380.
  • the display control unit 300 may also have the function of a process execution unit.
  • the display control unit 300 When the display control unit 300 acquires movement information from the mouse 30c via the communication unit 380 during display of a certain image, the display control unit 300 performs a cursor according to the movement information in the same manner as the display control unit 200 provided in the electronic device 2. Move. That is, the detection unit 328 included in the mouse 30c is a pointing device for moving the designated position on the display screen 312.
  • the display control unit 300 includes a display control unit included in the electronic device 2 when a cursor is displayed during display of a certain image or when the cursor position is moved (when movement information is acquired from the mouse 30c). Similarly to 200, the luminance value at the cursor position of the display image is output to the vibration control unit 330.
  • the vibration control unit 330 acquires the luminance value (the luminance value at the cursor position of the display image) from the display control unit 300.
  • the vibration control unit 330 that has acquired the luminance value from the display control unit 300 generates vibration control information corresponding to the luminance value.
  • the vibration control unit 330 that has acquired the luminance value from the display control unit 300 calculates a difference between the luminance value (the luminance value acquired this time) and the luminance value acquired last time, and performs vibration control according to the difference in luminance value. Information may be generated. That is, the vibration control unit 330 may generate vibration control information according to whether or not the cursor position is an edge portion of the display image.
  • the vibration control unit 330 that has generated the vibration control information outputs the vibration control information to the mouse 30c via the communication unit 380.
  • the mouse 30c can be driven in accordance with the luminance value (or luminance value difference) at the cursor position.
  • the vibration unit 340 vibration motor, linear vibrator
  • the mouse 30c can be vibrated according to the luminance value (or the difference in luminance value) at the cursor position.
  • a position moving unit voice coil motor
  • the height of the mouse 30c (for example, the height of the upper portion relative to the bottom of the mouse 30c) according to the luminance value (or luminance value difference) at the cursor position.
  • the electronic device 3 converts visual information into tactile information. Therefore, the user can recognize the image as a tactile sense in addition to the visual sense.
  • FIG. 16 is an example of a functional block diagram of the electronic device 4 according to the fourth embodiment of the present invention.
  • the electronic device 4 includes a main body (housing) 32a, a keyboard 30b, a mouse 32c, and a display 30d.
  • the electronic device 4 includes the vibration control unit 332 not in the main body 32a but in the mouse 32c, whereas the electronic device 3 includes the vibration control unit 330 in the main body 30a.
  • the vibration control unit 330 is provided in the main body 30a
  • the vibration control unit 332 is provided in the mouse 32c. Note that in the electronic device 4, the same reference numerals as those of the electronic device 3 are the same as those of the electronic device 3, and thus a part or all of the description is omitted.
  • the communication unit 384 of the mouse 32c transmits the movement information (movement direction and movement amount) detected by the detection unit 326 to the main body 32a.
  • the communication unit 384 receives a luminance value from the main body 32a.
  • the luminance value received by the communication unit 384 from the main body 32a is the luminance value of the display image at the designated position moved by the main body 32a based on the movement information. That is, the display control unit 300 of the main body 32a acquires the movement information from the mouse 32c via the communication unit 381, moves the designated position based on the movement information, and sets the luminance value of the display image at the designated position after the movement.
  • the data is transmitted to the mouse 32c via the communication unit 381.
  • the communication unit 384 outputs the luminance value received from the main body 32 a to the vibration control unit 332.
  • the vibration control unit 332 that has received the luminance value from the main body 32a performs vibration control according to the vibration control information corresponding to the luminance value (or the difference between the luminance value (the luminance value acquired this time) and the luminance value acquired last time). Information).
  • the vibration control unit 332 that has generated the vibration control information outputs the vibration control information to the vibration unit 340. That is, the vibration unit 340 vibrates according to the luminance value received by the communication unit 384.
  • the main body 32a, the keyboard 30b, the mouse 32c, and the display 30d are collectively referred to as the electronic device 4.
  • the main body 32a, the keyboard 30b, the mouse 32c, and the display 30d, which are each element, may also be referred to as electronic devices.
  • the mouse 32c which is an electronic device, detects the movement of its own device (device main body, mouse 32c) as an input operation for moving the indicated position on the display screen of another device (display 30d). And transmitting the movement information detected by the detection unit 326 to another device (main body 32) and receiving the luminance value of the display image displayed on the display screen at the indicated position moved based on the movement information.
  • Unit 384 and a vibration unit 340 that vibrates according to the luminance value received by communication unit 384.
  • the same effect as the electronic device 3 can be acquired.
  • visual information is converted into tactile information. Therefore, the user can recognize the image as a tactile sense in addition to the visual sense.
  • a program for executing each process of the electronic devices 1 to 4 according to the embodiment of the present invention is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed. By doing so, you may perform the various process which concerns on each process of the electronic devices 1 to 4 by embodiment of this invention.
  • the “computer system” may include an OS and hardware such as peripheral devices.
  • the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
  • the “computer-readable recording medium” refers to a floppy (registered trademark) disk, a magneto-optical disk, an SD card, a writable nonvolatile memory such as a flash memory, a portable medium such as a CD-ROM, and a computer system.
  • a built-in storage device such as a hard disk.
  • the “computer-readable recording medium” means a volatile memory (for example, DRAM (Dynamic DRAM) in a computer system that becomes a server or a client when a program is transmitted through a network such as the Internet or a communication line such as a telephone line. Random Access Memory)), etc., which hold programs for a certain period of time.
  • the program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium.
  • the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.
  • the program may be for realizing a part of the functions described above. Furthermore, what can implement
  • the electronic device includes a display unit having a display screen, an instruction position reception unit that receives an input of an instruction position on the display screen, a display image displayed on the display screen, and the instruction position reception A drive unit that drives the housing in accordance with the indicated position received by the unit.
  • the drive unit can drive the housing in accordance with the luminance value at the indicated position.
  • the drive unit can drive the housing depending on whether or not the indicated position is an edge portion of the display image.
  • the drive unit can vibrate the display screen or move the display screen in the thickness direction of the display unit.
  • the indication position receiving unit may be a sensor that detects a contact position on the display screen as the indication position.
  • the pointing position receiving unit may be a pointing device that operates the pointing position on the display screen.
  • the electronic device receives, as an input operation for moving the designated position on the display screen of another device, a detection unit that detects the movement of the device itself, and movement information detected by the detection unit as another device.
  • a communication unit that receives the luminance value of the display image displayed on the display screen at the indicated position moved based on the movement information, and a housing according to the luminance value received by the communication unit And a drive unit for driving the motor.
  • the drive control method is a drive control method of a housing in an electronic device having a display screen and a drive unit, and includes an indication position receiving unit that receives an input of an indication position on the display screen, and the display Drive control means for driving the drive unit in accordance with the display image displayed on the screen and the designated position received by the designated position accepting means;

Abstract

Selon l'invention, un dispositif électronique comprend une unité vibrante qui génère des vibrations; une unité d'affichage présentant un écran d'affichage; une unité de réception de position d'instruction qui reçoit sur l'écran d'affichage l'entrée d'une position d'instruction; une image d'affichage affichée sur l'écran d'affichage; et une unité de commande de vibrations qui génère des informations de commande de vibrations pour faire vibrer l'unité vibrante en fonction de la position d'instruction reçue par l'unité de réception de position d'instruction.
PCT/JP2013/061603 2012-04-20 2013-04-19 Dispositif électronique et procédé de commande de vibrations WO2013157626A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2012-096572 2012-04-20
JP2012096572 2012-04-20

Publications (1)

Publication Number Publication Date
WO2013157626A1 true WO2013157626A1 (fr) 2013-10-24

Family

ID=49383575

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/061603 WO2013157626A1 (fr) 2012-04-20 2013-04-19 Dispositif électronique et procédé de commande de vibrations

Country Status (1)

Country Link
WO (1) WO2013157626A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080068348A1 (en) * 1998-06-23 2008-03-20 Immersion Corporation Haptic feedback for touchpads and other touch controls
WO2010105012A1 (fr) * 2009-03-12 2010-09-16 Immersion Corporation Systèmes et procédés pour un moteur de texture
WO2010105011A1 (fr) * 2009-03-12 2010-09-16 Immersion Corporation Systèmes et procédés pour des dispositifs d'affichage à frottement et effets haptiques supplémentaires
JP2010238222A (ja) * 2009-03-12 2010-10-21 Ricoh Co Ltd タッチパネル装置、これを含むタッチパネル付き表示装置、及びタッチパネル装置の制御方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080068348A1 (en) * 1998-06-23 2008-03-20 Immersion Corporation Haptic feedback for touchpads and other touch controls
WO2010105012A1 (fr) * 2009-03-12 2010-09-16 Immersion Corporation Systèmes et procédés pour un moteur de texture
WO2010105011A1 (fr) * 2009-03-12 2010-09-16 Immersion Corporation Systèmes et procédés pour des dispositifs d'affichage à frottement et effets haptiques supplémentaires
JP2010238222A (ja) * 2009-03-12 2010-10-21 Ricoh Co Ltd タッチパネル装置、これを含むタッチパネル付き表示装置、及びタッチパネル装置の制御方法

Similar Documents

Publication Publication Date Title
JP6008331B2 (ja) 触覚提示装置および触覚提示装置の駆動方法、駆動プログラム
CN108369456B (zh) 用于触摸输入设备的触觉反馈
US10620705B2 (en) Vibrating the surface of an electronic device to raise the perceived height at a depression in the surface
KR102141155B1 (ko) 모바일 장치의 상태에 대응하는 변경된 숏컷 아이콘을 제공하는 모바일 장치 및 그 제어 방법
US10248204B2 (en) Tactile stimulus control apparatus, tactile stimulus control method, and storage medium
US10254835B2 (en) Method of operating and electronic device thereof
US20150253851A1 (en) Electronic device and method for outputting feedback
US20150261296A1 (en) Electronic apparatus, haptic feedback control method, and program
JP2010231609A (ja) 触感呈示装置及び方法
US9524026B2 (en) Portable apparatus, control method and program
JP2010015239A (ja) 情報処理装置、及び情報処理装置における振動制御方法
JPWO2013114792A1 (ja) 触感呈示装置および触感呈示方法
JP2015028766A (ja) 触感呈示装置および触感呈示方法
JP2015118605A (ja) 触感制御装置、制御方法及びプログラム
JP2015130006A (ja) 触感制御装置、触感制御方法及びプログラム
JP6528086B2 (ja) 電子機器
US10664056B2 (en) Control device, input system and control method
WO2016037408A1 (fr) Procédé de fonctionnement d'un terminal informatique et terminal informatique
KR102115727B1 (ko) 하이브리드 위젯을 제공하는 모바일 장치 및 그 제어 방법
KR20160096645A (ko) 컴퓨팅 디바이스에 대한 장치의 결합
WO2013157626A1 (fr) Dispositif électronique et procédé de commande de vibrations
JP5962756B2 (ja) 電子機器及び振動提供方法
CN104793736B (zh) 电子装置及其控制方法
JP6627603B2 (ja) 電子機器、及び、電子機器の駆動方法
US20180067559A1 (en) Electronic apparatus and non-transitory recording medium having stored therein

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13777755

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13777755

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP