JP6512299B2 - Drive control device, electronic device, drive control program, and drive control method - Google Patents

Description

The present invention relates to a drive control device, an electronic device, a drive control program, and a drive control method.

Conventionally, when an object contacts a touch surface, a sensor configured to detect a touch in the touch area and a first actuator in communication with the processor and further coupled to the touch surface, the haptic signal And a first actuator configured to provide a haptic output that varies the coefficient of friction of the touch surface in response.

The system is a second actuator in communication with the processor and further coupled to at least one of the touch surface and a housing including the touch surface, and an output that changes the coefficient of friction in response to the haptic signal. Further comprises a second actuator configured to provide a different second haptic output.

The system is a processor in communication with the first actuator, the second actuator, and the sensor, for selecting a synthetic haptic effect to be generated, and of the first and second actuators to generate the selected synthetic haptic effect. The electronic device further comprises a processor configured to transmit at least one haptic signal (see, for example, claim 1 of Patent Document 1).

The system further comprises a display, the display comprising a plurality of pixels and configured to output an image based on at least a portion of a display signal, the touch surface being on the display or the display Corresponding to the material, the processor is configured to output the display signal (see, for example, claim 10 of Patent Document 1).

JP 2012-520523 gazette

By the way, when a conventional system displays an image including a specific display area on a display unit such as a display, even if the specific display area does not fit in the display unit even if the image is scrolled by swipe operation or the like, The user can not know by touch that the specific display area is not accommodated in the display unit.

Specifically, for example, in the case where a specific display area is a plurality of icons, it is as follows. While scrolling through a plurality of icons at a time, in a state where the plurality of icons do not reach the fixed position of the display unit, the user may know by tactile sensation that all the icons are not accommodated in the display unit I can not

Also, for example, in the case where the specific display area is a box area for displaying text data, it is as follows. When the box area is scrolled in the vertical direction or in the horizontal direction, the user feels that the image does not fit in the display area in a state where the box area has not reached the fixed position of the display area. I can not know.

The fact that it is not possible to feel by touch that a specific display area is not contained in the display as described above is not limited to the case of the icon and the box area, and for example, a web page including the specific display area is displayed on the display This may also occur when the user is executing various applications and displaying various specific display areas on the display unit.

That is, in the conventional system, when an image including a specific display area is being scrolled, it is not possible to sense by touch whether the specific display area fits in the display unit.

Therefore, it is an object of the present invention to provide a drive control device, an electronic device, a drive control program, and a drive control method capable of detecting by touch whether or not a specific display area is included in the display unit.

A drive control device according to an embodiment of the present invention includes a display unit, a top panel having an operation surface disposed on the display surface side of the display unit, and a position for detecting a position of an operation input performed on the operation surface. A drive control apparatus for driving the vibration element of an electronic device including a detection unit and a vibration element generating vibration on the operation surface, which is image data of a scrollable image displayed on the display unit. A block for displaying a predetermined image or a predetermined symbol, and a part of the scrollable image represents the image data displayed on the display unit and the position of the block in the scrollable image A storage unit associated with position data and stored, and an operation unit for obtaining an operation amount and an operation direction of a scroll operation performed on the operation surface based on the position detected by the position detection unit; A driving control unit for driving the vibrating element with a driving signal that generates natural vibration of an ultrasonic band on the operation surface when a scroll operation is performed on the top panel, and the scroll operation of the scroll operation determined by the arithmetic unit When at least one of the left end and the right end of the block or at least one of the upper end and the lower end of the block is not displayed on the display unit based on the operation amount and the operation direction and the position data Drives the vibrating element in the first pattern, and at least one of the left end and the right end, or at least one of the upper end and the lower end is displayed on the display unit in the second pattern driving the vibration element, seen including a drive control unit, the predetermined image is an image of the GUI operation unit, the image data, a plurality of pre It has a block, and each of the plurality of blocks can arrange the GUI operation unit, and the drive control unit is configured such that the left end, the right end, the upper end, and the lower end of each of the plurality of blocks are the When not displayed on the display unit, the vibration element is driven in the first pattern, and when the left end, the right end, the upper end, and the lower end of each of the plurality of blocks are displayed on the display unit The vibrating element is driven by the second pattern .

It is possible to provide a drive control device, an electronic device, a drive control program, and a drive control method capable of detecting by touch whether or not a specific display area is included in the display unit.

It is a perspective view showing the electronic equipment of an embodiment. It is a top view which shows the electronic device of embodiment. It is a figure which shows the AA arrow cross section of the electronic device shown in FIG. It is a figure which shows the wave front formed in parallel with the short side of a top panel among the standing waves which generate | occur | produce on a top panel by the intrinsic vibration of an ultrasonic band. It is a figure explaining a mode that the dynamic friction force applied to the fingertip which performs operation input changes with the intrinsic vibration of the ultrasonic wave band made to be generated in the top panel of an electronic device. It is a figure which shows the structure of the electronic device of embodiment. FIG. 5 is a diagram showing an example of display on a display panel of the electronic device of the first embodiment. It is a figure which shows the whole of a scrollable image. It is a figure which shows the data stored in memory. It is a figure which shows the data stored in memory. FIG. 7 is a diagram showing an example of the operation of the electronic device of the first embodiment. FIG. 7 is a diagram showing an example of the operation of the electronic device of the first embodiment. FIG. 7 is a diagram showing an example of the operation of the electronic device of the first embodiment. It is a figure which shows the operation example of an electronic device. It is a flowchart which shows the process which the drive control part of the drive control apparatus of the electronic device of embodiment performs. It is a figure which shows the block which displays a sentence. It is a figure which shows the cross section of the electronic device of a modification. It is a figure which shows the electronic device of a modification. It is a figure which shows the cross section of the touch pad of the electronic device of a modification. It is a top view which shows the operation state of the electronic device of a modification.

Hereinafter, an embodiment to which a drive control device, an electronic device, a drive control program, and a drive control method of the present invention are applied will be described.

Embodiment

FIG. 1 is a perspective view showing an electronic device 100 according to the embodiment.

The electronic device 100 is, for example, a smart phone terminal or a tablet computer that uses a touch panel as an input operation unit. The electronic device 100 may be any device having a touch panel as an input operation unit, and thus is a device installed and used at a specific place such as a portable information terminal or an ATM (Automatic Teller Machine), for example. May be In addition, the electronic device 100 may be a device such as a navigation system or various controllers installed in a vehicle such as an automobile or a motorcycle or a mobile object.

In the input operation unit 101 of the electronic device 100, a display panel is disposed under the touch panel, and various buttons 102A, a slider 102B, and the like (hereinafter referred to as a GUI operation unit 102) are displayed on the display panel. Will be displayed.

Generally, the user of the electronic device 100 touches the input operation unit 101 with a fingertip in order to operate the GUI operation unit 102.

Next, a specific configuration of the electronic device 100 will be described with reference to FIG.

FIG. 2 is a plan view showing the electronic device 100 according to the embodiment, and FIG. 3 is a view showing a cross section of the electronic device 100 shown in FIG. 2 and 3, an XYZ coordinate system, which is an orthogonal coordinate system, is defined as illustrated.

The electronic device 100 includes a housing 110, a top panel 120, a double-sided tape 130, a vibrating element 140, a touch panel 150, a display panel 160, and a substrate 170.

The housing 110 is made of, for example, a resin, and as shown in FIG. 3, the substrate 170, the display panel 160, and the touch panel 150 are disposed in the recess 110A, and the top panel 120 is bonded by the double-sided tape 130. .

The top panel 120 is a thin flat plate having a rectangular shape in plan view, and is made of transparent glass or reinforced plastic such as polycarbonate. The surface (surface on the Z-axis positive direction side) of the top panel 120 is an example of an operation surface on which the user of the electronic device 100 performs an operation input.

In the top panel 120, the vibrating element 140 is bonded to the surface on the Z-axis negative direction side, and the four sides in a plan view are bonded to the housing 110 by the double-sided adhesive tape 130. The double-sided adhesive tape 130 is not limited to a rectangular ring as shown in FIG. 3 as long as the four sides of the top panel 120 can be bonded to the housing 110.

A touch panel 150 is disposed on the Z-axis negative direction side of the top panel 120. The top panel 120 is provided to protect the surface of the touch panel 150. Further, another panel or a protective film may be provided on the surface of the top panel 120.

The top panel 120 vibrates by driving the vibrating element 140 in a state where the vibrating element 140 is bonded to the surface on the Z-axis negative direction side. In the embodiment, the top panel 120 is vibrated at the natural vibration frequency of the top panel 120 to generate a standing wave in the top panel 120. However, since the vibrating element 140 is bonded to the top panel 120, it is preferable in practice to determine the natural vibration frequency in consideration of the weight of the vibrating element 140 and the like.

The vibrating element 140 is bonded along the short side extending in the X-axis direction on the Y-axis positive direction side on the surface on the Z-axis negative direction side of the top panel 120. The vibrating element 140 may be any element as long as it can generate vibration in the ultrasonic band, and for example, one including a piezoelectric element such as a piezoelectric element can be used.

The vibrating element 140 is driven by a drive signal output from a drive control unit described later. The amplitude (intensity) and frequency of the vibration generated by the vibrating element 140 are set by the drive signal. Further, the on / off of the vibrating element 140 is controlled by the drive signal.

The ultrasonic band refers to, for example, a frequency band of about 20 kHz or more. In the electronic device 100 according to the embodiment, since the frequency at which the vibrating element 140 vibrates is equal to the frequency of the top panel 120, the vibrating element 140 is driven by the drive signal to vibrate at the natural frequency of the top panel 120. Be done.

The touch panel 150 is disposed above the display panel 160 (Z-axis positive direction side) and below the top panel 120 (Z-axis negative direction side). The touch panel 150 is an example of a position detection unit that detects a position at which the user of the electronic device 100 touches the top panel 120 (hereinafter referred to as a position of an operation input).

On the display panel 160 below the touch panel 150, various buttons (hereinafter referred to as a GUI operation unit) by GUI are displayed. Therefore, the user of the electronic device 100 usually touches the top panel 120 with a fingertip to operate the GUI operation unit.

The touch panel 150 may be any position detection unit capable of detecting the position of the operation input to the top panel 120 of the user, and may be, for example, a capacitance type or resistive film type position detection unit. Here, an embodiment in which the touch panel 150 is a capacitance type position detection unit will be described. Even if there is a gap between the touch panel 150 and the top panel 120, the capacitive touch panel 150 can detect an operation input to the top panel 120.

Further, although a mode in which the top panel 120 is disposed on the input surface side of the touch panel 150 will be described here, the top panel 120 may be integral with the touch panel 150. In this case, the surface of the touch panel 150 is the surface of the top panel 120 shown in FIGS. 2 and 3 to construct an operation surface. Moreover, the structure which abbreviate | omitted the top panel 120 shown to FIG.2 and FIG.3 may be sufficient. Also in this case, the surface of the touch panel 150 constructs an operation surface. In this case, the member having the operation surface may be vibrated by the natural vibration of the member.

When the touch panel 150 is of the capacitance type, the touch panel 150 may be disposed on the top panel 120. Also in this case, the surface of the touch panel 150 constructs an operation surface. Moreover, when the touch panel 150 is a capacitance type, the top panel 120 shown in FIG. 2 and FIG. 3 may be omitted. Also in this case, the surface of the touch panel 150 constructs an operation surface. In this case, the member having the operation surface may be vibrated by the natural vibration of the member.

The display panel 160 may be, for example, a display unit capable of displaying an image such as a liquid crystal display panel or an organic electroluminescence (EL) panel. The display panel 160 is installed on the substrate 170 (in the positive Z-axis direction) by a holder or the like (not shown) inside the recess 110A of the housing 110.

The display panel 160 is driven and controlled by a driver IC (Integrated Circuit) to be described later, and displays a GUI operation unit, an image, characters, symbols, figures, and the like according to the operation state of the electronic device 100.

The substrate 170 is disposed inside the recess 110A of the housing 110. The display panel 160 and the touch panel 150 are disposed on the substrate 170. The display panel 160 and the touch panel 150 are fixed to the substrate 170 and the housing 110 by a holder or the like (not shown).

In addition to a drive control device described later, various circuits and the like necessary for driving the electronic device 100 are mounted on the substrate 170.

In the electronic device 100 configured as described above, when the finger of the user contacts the top panel 120 and the movement of the fingertip is detected, the drive control unit mounted on the substrate 170 drives the vibration element 140, and the top panel 120 Vibrate at the frequency of the ultrasonic band. The frequency of the ultrasonic band is a resonant frequency of a resonant system including the top panel 120 and the vibrating element 140, and causes the top panel 120 to generate a standing wave.

The electronic device 100 provides the user with a tactile sensation through the top panel 120 by generating a standing wave of an ultrasonic band.

Next, a standing wave generated in the top panel 120 will be described with reference to FIG.

FIG. 4 is a view showing a wave front formed in parallel to the short side of the top panel 120 among the standing waves generated in the top panel 120 due to the natural vibration of the ultrasonic band, and FIG. 4 (A) is a side view , (B) is a perspective view. In (A) and (B) of FIG. 4, XYZ coordinates similar to those of FIGS. 2 and 3 are defined. In addition, in (A) and (B) of FIG. 4, the amplitude of the standing wave is exaggerated and shown for ease of understanding. Moreover, the vibrating element 140 is abbreviate | omitted in (A) and (B) of FIG.

Using the Young's modulus E, density 、, Poisson's ratio δ, long side dimension l, thickness t of the top panel 120, and the number k of standing waves existing in the long side direction, the natural frequency of the top panel 120 The (resonance frequency) f is expressed by the following equations (1) and (2). Since the standing wave has the same waveform in units of half a cycle, the number of cycles k takes 0.5 values and becomes 0.5, 1, 1.5, 2...

なお、式（２）の係数αは、式（１）におけるｋ^２以外の係数をまとめて表したものである。

Incidentally, the coefficient α of the formula (2) is a representation collectively coefficients other than k ² in the formula (1).

The standing wave shown in (A) and (B) of FIG. 4 is a waveform in the case where the cycle number k is 10, as an example. For example, in the case of using Gorilla (registered trademark) glass having a long side length of 140 mm, a short side length of 80 mm, and a thickness t of 0.7 mm as the top panel 120, the cycle number k is 10 In this case, the natural frequency f is 33.5 [kHz]. In this case, a drive signal with a frequency of 33.5 kHz may be used.

Although the top panel 120 is a flat member, when the vibration element 140 (see FIG. 2 and FIG. 3) is driven to generate the natural vibration of the ultrasonic band, the top panel 120 is shown in (A) and (B) of FIG. By bending as shown, standing waves are generated on the surface.

Here, a mode is described in which one vibrating element 140 is bonded along the short side extending in the X-axis direction on the Y-axis positive direction side in the surface on the Z-axis negative direction side of the top panel 120. The two vibration elements 140 may be used. When two vibrating elements 140 are used, another vibrating element 140 is bonded along the short side extending in the X-axis direction on the Y-axis negative direction side of the top panel 120 in the Z-axis negative direction side. Just do it. In this case, the two vibration elements 140 may be disposed so as to be axially symmetrical with respect to a central line parallel to the two short sides of the top panel 120 as an axis of symmetry.

When driving two vibration elements 140, they may be driven in the same phase when the cycle number k is an integer, and in an opposite phase when the cycle number k is a decimal (a number including an integer part and a decimal part). You can drive it.

Next, natural vibration of an ultrasonic wave band generated in the top panel 120 of the electronic device 100 will be described with reference to FIG.

FIG. 5 is a view for explaining how the dynamic friction force applied to the fingertip performing the operation input changes due to the natural vibration of the ultrasonic wave band generated in the top panel 120 of the electronic device 100. In (A) and (B) of FIG. 5, while the user touches the top panel 120 with a fingertip, an operation input is performed to move the finger from the back side of the top panel 120 to the front side along the arrow. The vibration on / off is performed by turning on / off the vibrating element 140 (see FIGS. 2 and 3).

Further, in FIGS. 5A and 5B, in the depth direction of the top panel 120, the range touched by the finger while the vibration is off is shown in gray, and the range touched by the finger is shown white while the vibration is on. .

The natural vibration of the ultrasonic band occurs in the entire top panel 120 as shown in FIG. 4, but in FIGS. 5A and 5B, the user's finger is from the back side to the front side of the top panel 120. Shows an operation pattern for switching vibration on / off while moving to

Therefore, in (A) and (B) in FIG. 5, the range touched by the finger while the vibration is off is shown in gray in the depth direction of the top panel 120, and the range touched by the finger is white while the vibration is on. Show.

In the operation pattern shown in FIG. 5A, the vibration is off when the user's finger is on the back side of the top panel 120, and the vibration is on while the finger is moved to the near side.

On the other hand, in the operation pattern shown in FIG. 5B, the vibration is on when the user's finger is on the back side of the top panel 120, and the vibration is off while moving the finger to the front side. There is.

Here, when the natural vibration of the ultrasonic band is generated in the top panel 120, an air layer by the squeeze effect intervenes between the surface of the top panel 120 and the finger, and the surface of the top panel 120 is traced with the finger. Dynamic coefficient of friction decreases.

Therefore, in FIG. 5A, in the range shown in gray on the back side of the top panel 120, the dynamic friction force applied to the fingertip is large, and in the range shown white on the front side of the top panel 120, the dynamic friction force applied to the fingertip is small. Become.

Therefore, as shown in FIG. 5A, the user performing the operation input to the top panel 120 senses the reduction of the dynamic friction force applied to the fingertip when the vibration is turned on, and perceives the slipperiness of the fingertip. It will be. At this time, the user feels that a recess is present on the surface of the top panel 120 when the dynamic friction force is reduced by making the surface of the top panel 120 smoother.

On the other hand, in FIG. 5B, in the range shown in white behind the top panel 120, the dynamic friction force applied to the fingertip is small, and in the range shown in gray on the front side of the top panel 120, the kinetic friction force applied to the fingertip is large. Become.

For this reason, as shown in FIG. 5B, the user performing the operation input to the top panel 120 senses an increase in the dynamic frictional force applied to the fingertip when the vibration is turned off, and the slippage of the fingertip or You will perceive the feeling of getting stuck. And when a dynamic friction force becomes high because a finger tip becomes difficult to slip, it is felt that a convex part exists in the surface of top panel 120.

As mentioned above, in the case of (A) and (B) of FIG. 5, the user can sense unevenness with a fingertip. Thus, human perception of unevenness is, for example, "printed material transfer method for tactile design and Sticky-band Illusion" (Proceedings of the 11th SICE System Integration Division Conference (SI2010, Sendai) ____ 174 -177, 2010-12). It is also described in "Fishbone Tactile Illusion" (The Proceedings of the 10th Annual Meeting of the Virtual Reality Society of Japan (September 2005)).

In addition, although the change of the dynamic friction force in the case of switching vibration on / off was demonstrated here, this is also the same as when the amplitude (intensity | strength) of the vibration element 140 is changed.

Next, the configuration of the electronic device 100 according to the embodiment will be described with reference to FIG.

FIG. 6 is a diagram showing the configuration of the electronic device 100 according to the embodiment.

The electronic device 100 includes a vibration element 140, an amplifier 141, a touch panel 150, a driver IC (Integrated Circuit) 151, a display panel 160, a driver IC 161, a control unit 200, a sine wave generator 310, and an amplitude modulator 320.

The control unit 200 includes an application processor 220, a communication processor 230, a drive control unit 240, and a memory 250. The control unit 200 is realized by, for example, an IC chip.

The drive control unit 240, the memory 250, the application processor 220, the sine wave generator 310, and the amplitude modulator 320 construct the drive control apparatus 300. The drive control device 300 may include the scroll degree computing unit of the application processor 220. The scroll degree calculation unit is a part of the application processor 220 that calculates the operation amount and the operation direction of the scroll operation.

Here, although an embodiment in which the application processor 220, the communication processor 230, the drive control unit 240, and the memory 250 are realized by one control unit 200 will be described, the drive control unit 240 is separately provided outside the control unit 200. May be provided as an IC chip or processor of In this case, among the data stored in the memory 250, the data necessary for the drive control of the drive control unit 240 is stored in a memory different from the memory 250 and provided in the drive control device 300. Just do it.

In FIG. 6, the housing 110, the top panel 120, the double-sided tape 130, and the substrate 170 (see FIG. 2) are omitted. Here, the amplifier 141, the driver IC 151, the driver IC 161, the drive control unit 240, the memory 250, the sine wave generator 310, and the amplitude modulator 320 will be described.

The amplifier 141 is disposed between the drive control device 300 and the vibrating element 140, and amplifies the drive signal output from the drive control device 300 to drive the vibrating element 140.

The driver IC 151 is connected to the touch panel 150, detects position data representing a position at which an operation input to the touch panel 150 has been made, and outputs the position data to the control unit 200. As a result, the position data is input to the application processor 220 and the drive control unit 240. Note that inputting position data to the drive control unit 240 is equivalent to inputting position data to the drive control device 300.

The driver IC 161 is connected to the display panel 160, inputs drawing data output from the drive control device 300 to the display panel 160, and causes the display panel 160 to display an image based on the drawing data. As a result, on the display panel 160, a GUI operation unit or an image or the like based on the drawing data is displayed.

The application processor 220 performs processing to execute various applications of the electronic device 100. In addition, the application processor 220 calculates an operation amount and an operation direction of the scroll operation based on a change in position data detected by the touch panel 150.

The application processor 220 scrolls the image displayed on the display panel 160 when the top panel 120 is scrolled based on data representing the detected operation amount and operation direction of the scroll operation. When the application processor 220 scrolls the image to be displayed on the display panel 160, the top panel 120 may have a scroll due to the inertia of the scroll operation.

Also, the application processor 220 inputs data representing the detected operation amount and operation direction of the scroll operation to the drive control unit 240. The application processor 220 is an example of a scroll degree operation unit. The drive control unit 240 may calculate the operation amount and the operation direction of the scroll operation based on the change in the position data detected by the touch panel 150.

The communication processor 230 executes processing necessary for the electronic device 100 to perform communication such as 3G (Generation), 4G (Generation), LTE (Long Term Evolution), WiFi, and the like.

The drive control unit 240 outputs the amplitude data to the amplitude modulator 320 when the operation input is performed on the top panel 120 and the scroll operation for scrolling the image displayed on the display panel 160 is performed. The amplitude data is data representing an amplitude value for adjusting the strength of the drive signal used to drive the vibration element 140. The amplitude value is set according to the temporal change degree of the position data. Here, as the temporal change degree of the position data, the speed at which the user's fingertip moves along the surface of the top panel 120 is used. The movement speed of the user's fingertip is calculated by the drive control unit 240 based on the temporal change degree of the position data input from the driver IC 151.

Further, when the user's fingertip is moving along the surface of the top panel 120, the drive control device 300 according to the embodiment vibrates the top panel 120 to change the dynamic friction force applied to the fingertip. Since the dynamic friction force is generated when the fingertip is moving, the drive control unit 240 vibrates the vibrating element 140, for example, when the moving speed becomes equal to or higher than a predetermined threshold speed.

Therefore, the amplitude value represented by the amplitude data output by the drive control unit 240 is zero when the moving speed is less than the predetermined threshold speed, and is set to the predetermined amplitude value when the moving speed is equal to or higher than the predetermined threshold speed. Ru.

As a type of operation input for moving the fingertip touching the surface of the top panel 120, there is, for example, a so-called flick operation when operating the GUI operation unit. The flick operation is an operation of moving the fingertip along the surface of the top panel 120 by a relatively short distance so as to snap.

In addition, when turning a page, for example, a swipe operation is performed. The swipe operation is an operation of moving the fingertip along a surface of the top panel 120 for a relatively long distance. The swipe operation is performed, for example, when looking at a photo, as well as when looking at a page. Further, when sliding the slider (see the slider 102B in FIG. 1) by the GUI operation unit, a drag operation of dragging the slider is performed.

The operation input for moving the fingertip touching the surface of the top panel 120, such as the flick operation, the swipe operation, and the drag operation given as an example here, is properly used depending on the type of display by the application. Therefore, when it is determined whether or not the position of the fingertip at which the operation input is performed is within the predetermined area in which the vibration is to be generated, the type of application in which the electronic device 100 is activated is related.

Note that to scroll an image is to move the image or the like by the flick operation, the swipe operation, the drag operation, or the like as described above. An operation for scrolling an image is called a scroll operation.

The memory 250 stores data and programs that the application processor 220 needs to execute an application, and data and programs that the communication processor 230 needs for communication processing.

Further, the position on the display panel 160 such as a GUI operation unit displayed on the display panel 160, an area for displaying an image, or an area representing the entire page is specified by area data representing the area. The area data exists for all GUI operation units displayed on the display panel 160, an area for displaying an image, or an area for representing an entire page in all applications. The area data is stored in the memory 250.

The sine wave generator 310 generates a sine wave necessary to generate a drive signal for vibrating the top panel 120 at a natural frequency. For example, in the case where the top panel 120 is vibrated at a natural frequency f of 33.5 kHz, the frequency of the sine wave is 33.5 kHz. The sine wave generator 310 inputs a sine wave signal in the ultrasonic band to the amplitude modulator 320.

The sine wave signal generated by the sine wave generator 310 is an AC reference signal which is the source of a drive signal for generating the natural vibration of the ultrasonic band, and has a constant frequency and a constant phase. The sine wave generator 310 inputs a sine wave signal in the ultrasonic band to the amplitude modulator 320.

Here, although a form using sine wave generator 310 which generates a sine wave signal is explained, it may not be an exact sine wave signal. For example, a signal having a waveform in which the rising and falling waveforms of the clock are blunted may be used as a sine wave signal. Therefore, instead of the sine wave generator 310, a signal generator that generates a signal having a waveform that blunts the rising and falling edges of the clock may be used.

The amplitude modulator 320 modulates the amplitude of the sine wave signal input from the sine wave generator 310 using the amplitude data input from the drive control unit 240 to generate a drive signal. The amplitude modulator 320 modulates only the amplitude of the sine wave signal of the ultrasonic band input from the sine wave generator 310, and generates a drive signal without modulating the frequency and phase.

For this reason, the drive signal output from the amplitude modulator 320 is a sine wave signal of an ultrasonic wave band in which only the amplitude of the sine wave signal of the ultrasonic wave band input from the sine wave generator 310 is modulated. When the amplitude data is zero, the amplitude of the drive signal is zero. This is equivalent to the fact that the amplitude modulator 320 does not output the drive signal.

Next, an example of the display of the electronic device 100, an example of data stored in the memory 250, and an example of the operation will be described with reference to FIGS.

FIG. 7 is a diagram showing an example of display on the display panel 160 of the electronic device 100 according to the first embodiment. In FIG. 7, an XYZ coordinate system common to FIGS. 2 to 4 is defined.

In FIG. 7, the home screen is displayed on the display panel 160. On the home screen, a navigation key 180A, a quick menu 180B, and an icon 181 are displayed on the display panel 160.

The navigation keys 180A are arranged in the X axis direction at the end of the display panel 160 on the Y axis negative direction side. Navigation key 180A includes a return button, a home button, and a multitasking button. The return button, the home button, and the multitasking button are arranged in this order in three rows (horizontal: X-axis direction) x 1 row (vertical: Y-axis direction) from the X-axis negative direction side to the X-axis positive direction side .

Quick menu 180B is arranged adjacent to the Y axis positive direction side of navigation key 180A, and is an area where five icons 180B1 of quick menu 180B can be arranged in five columns by one row. In FIG. 7, five icons 180B1 such as a telephone and a camera are arranged.

The size in plan view of each of the five areas where the five icons 180B1 can be arranged is equal to the size of the icon 180B1. In the quick menu 180B, the area where the icon 180B1 can be arranged is determined to five areas, and the icon 180B1 can not be arranged at a place other than the five areas.

The icons 181 can be arranged in five rows (horizontal: X-axis direction) × 6 rows (vertical: Y-axis direction) on the Y axis positive direction side of the quick menu 180B. The area where the icons 181 can be arranged is arranged in a matrix of 5 columns × 6 rows.

The size in plan view of each of the 30 regions in which the icon 181 can be arranged corresponds to the size of the icon 181. The area in which the icon 181 can be arranged is determined to be 30 areas, and the icon 181 can not be arranged in places other than the 30 areas.

Further, as shown in FIG. 7, when the icon 181 is displayed on the display panel 160, the icon 181 displayed on the display panel 160 when the user touches the top panel 120 with a finger and performs a scroll operation in the X-axis direction. Can be replaced. When replacing the icons 181 by the scroll operation, the icons 181 arranged in all of the 30 areas in which the icons 181 shown in FIG. 7 can be arranged will be replaced.

FIG. 8 is a diagram showing the entire scrollable image 500. As shown in FIG. 9 and 10 show data stored in the memory 250. FIG.

A scrollable image 500 is shown in FIG. The scrollable image 500 can not be displayed on the display panel 160 in its entirety, and only a part of the entire image is displayed, and a scroll operation is necessary to cause the display panel 160 to display a non-displayed part. Image.

The scrollable image 500 shown in FIG. 8 includes the icon 181 shown in FIG. 7 and all the icons 181 not displayed on the display panel 160 in FIG.

In the scrollable image 500, an area where the icon 181 can be arranged is a block 501. The image 500 has 90 blocks 501 as an example. The 90 blocks 501 are arranged in 15 columns (horizontal) × 6 rows (vertical).

One icon 181 can be arranged in each of the 90 blocks 501. In addition, the block 501 in which the icon 181 is not arranged is blank. In FIG. 8, for convenience of explanation, one blank block 501 is indicated by a broken line.

The coordinates (M, N) of block 501 are represented relative to the top left vertex 502 of the image 500. The coordinates (M, N) indicate the coordinates of a block 501 that is the Mth column rightward from the vertex 502 and is in the Nth row downward from the vertex 502. For example, a block 501 indicated by a broken line in FIG. 8 is coordinates (2, 2). The rightward direction from the vertex 502 is the X-axis positive direction shown in FIG. 7, and the downward direction from the vertex 502 is the Y-axis negative direction shown in FIG. 7.

Among the images 500 shown in FIG. 8, an image displayed on the display panel 160 of FIG. 7 is referred to as a display image 503. The display image 503 includes 30 blocks 501 of 5 columns (horizontal) × 6 rows (vertical). Of the entire image 500, the image included in the display image 503 is a part. That is, the display image 503 includes 30 blocks 501 of continuous 5 lines out of the blocks 501 arranged over 15 lines of the image 500.

The user can select five consecutive lines included in the display image 503 among the fifteen lines by touching the top panel 120 with a fingertip and performing a scroll operation in the X-axis direction.

More specifically, when the user performs a scroll operation in the X-axis positive direction, the display image 503 moves in the left direction in the image 500. In addition, when the user performs the scroll operation in the negative direction of the X axis, the display image 503 moves in the right direction in the image 500.

Further, the selection of five columns included in the block 501 can be changed in units of one column. Therefore, when the user performs a scroll operation over the length of one column in the X-axis positive direction, the display image 503 moves by one column in the left direction in the image 500. In addition, when the user performs a scroll operation over the length of one column in the negative direction of the X-axis, the display image 503 moves by one column in the right direction in the image 500.

The coordinates (M, N) of the block 501 included in the display image 503 are managed by the application processor 220. Further, the coordinates (M, N) of the block included in the display image 503 are associated with the coordinates of the pixels of the display panel 160 and the coordinates used by the touch panel 150 for position detection.

In this case, for example, among the coordinates (M, N) of the 30 blocks 501 included in the display image 503, the application processor 220 sets the coordinates (M, N) of one block 501 closest to the vertex 502. You may manage. One block 501 near the vertex 502 is the block 501 that is in the leftmost column of the 30 blocks 501 included in the display image 503 and is in the first row.

In addition, the application processor 220 may manage the coordinates (M, N) of the six blocks 501 included in the leftmost column, or the coordinates (M, N) of the thirty blocks 501 included in the display image 503. N) may be managed. Moreover, you may manage by another method.

In the following, the application processor 220 is described as managing the coordinates (M, N) of the six blocks 501 included in the leftmost column of the display image 503.

Also, here, an embodiment in which the icon 181 is arranged in the block 501 will be described. However, in the image displayed on the display panel 160, blocks of various sizes can be arranged at various positions.

Such a block is an area for displaying a predetermined image or a predetermined symbol. The block is a specific display area standardized to display a predetermined image or a predetermined symbol in the image 500. The block may be a rectangular area, or may be, for example, an area having a shape other than a rectangle, such as a circle or a polygon.

Examples of the predetermined image include an icon 181, a GUI operation unit, an image of a photo, and an image representing a character of an animated cartoon. That is, the block that displays a predetermined image is, for example, a block that displays an icon 181, a GUI operation unit, an image of a photo, an image representing an animated cartoon character, and the like.

Also, a symbol is a generic term including letters, numbers, pictograms, emoticons and other symbols. The predetermined symbols include, for example, characters, numbers, pictograms, emoticons, and other symbols that represent a specific article, an explanatory note, and the like. That is, the block that displays a predetermined symbol is, for example, a block that displays characters, numbers, pictograms, smileys, and other symbols that represent sentences such as a specific article or explanatory text.

Note that a block that displays text, numbers, pictograms, emoticons, and other symbols that represent text is a block that displays a unit of a text, such as the entire text or one or more lines. A block is not allocated for one character or the like.

An example of such a block is Android (registered trademark) View. The blocks are included in the image data displayed on the display panel 160. The blocks correspond to the particular display area used in describing the subject of the present application.

Data illustrated in FIG. 9 is data in which an application ID (Identification), a package name, an application name, an icon name, and coordinate data are associated.

The application ID is data indicating the type of application, and FIG. 9 shows 001, 002, 003,. The application represented by the application ID includes any application that can be used in a smartphone terminal, a tablet computer, a touch panel device, an in-vehicle device, and the like.

The package name is one of the names assigned to the application, and is a name in which the domain name is described in reverse. FIG. 9 shows com. Fujitsu. F-05 f. Telev etc. as an example.

The application name represents the name of the application. FIG. 9 shows a television or the like as an example.

The icon name is the name of an icon used in the application. FIG. 9 shows tv_icon.png etc. as an example. The icon name represents an image of the icon.

The coordinate data is data representing the coordinates of the block in which the icon is arranged, and is the coordinates (M, N) shown in FIG.

For example, the block whose coordinate data is f (1, 1) is the coordinates of the block 501 closest to the vertex 502 of the image of FIG. f (1, 2) indicates the coordinates of the block 501 located in the second row in the first column from the vertex 502. The same applies to the following, and the coordinate data of the block farthest from the vertex 502 is f (5, 6).

FIG. 10 is data representing a vibration pattern. In the display image 503, the electronic device 100 includes all the coordinates (M, N) of the six blocks 501 included in the leftmost column in the six blocks 501 included in the leftmost column. The vibration pattern is switched depending on whether the area is displayed on the display panel 160.

If even part of the six blocks is not displayed on the display panel 160, it is determined that the entire area is not displayed on the display panel 160. When all six blocks are displayed on the display panel 160, it is determined that the entire area is displayed on the display panel 160.

As shown in FIG. 10, when the entire area of the six blocks 501 included in the leftmost column of the display image 503 is not displayed on the display panel 160, the electronic device 100 vibrates with the vibration pattern P1. The element 140 is vibrated.

When the entire area of the six blocks 501 included in the leftmost column of the display image 503 is displayed on the display panel 160, the electronic device 100 vibrates the vibrating element 140 with the vibration pattern P2. .

Here, the vibration patterns P1 and P2 represent patterns for modulating the amplitude of the drive signal for driving the vibration element 140. In other words, the vibration patterns P1 and P2 are pattern data in which the amplitude data output to the amplitude modulator 320 by the drive control unit 240 (see FIG. 6) are arranged in time series.

Here, as an example, the vibration pattern P1 is a vibration pattern that generates a natural vibration of an ultrasonic wave band having a constant amplitude A1. The vibration pattern P2 is a vibration pattern in which the vibration element 140 is not driven by setting the amplitude of the natural vibration of the ultrasonic band to zero.

The vibration patterns P1 and P2 are not limited to such pattern data, but the amplitude value is set such that the strength of the natural vibration due to the vibration pattern P1 is stronger than the strength of the natural vibration due to the vibration pattern P2 .

Next, an example of the operation of the electronic device 100 will be described with reference to FIG.

11 to 13 are diagrams showing an example of the operation of the electronic device 100 according to the first embodiment.

FIG. 11 shows the state immediately before the user performs a scroll operation in the right direction (X-axis positive direction) by touching the top panel 120 with a fingertip while the home screen icon 181 is displayed on the display panel 160. Show. The icon 181 displayed on the display panel 160 in FIG. 11 is the same as the icon 181 shown in FIG.

In FIG. 12, the user performs a scroll operation with the fingertip in the right direction (X-axis positive direction). The movement amount in the X-axis direction of the operation input by the scroll operation is half the width of the block 501 shown in FIG. That is, the scroll operation is performed by a half of the width of one row.

Therefore, in FIG. 12, the display panel 160 displays the icon 181 shifted to the left by 0.5 column as compared with FIG. In other words, in FIG. 12, the left half of the six blocks 501 included in the leftmost column of the display image 503 is not displayed. That is, in FIG. 12, the entire area of the six blocks 501 included in the leftmost column of the display image 503 is not displayed on the display panel 160.

In FIG. 13, the user further performs the scroll operation in the right direction (X-axis positive direction) with the fingertip than in the state illustrated in FIG. 12. The operation amount by the scroll operation in the X-axis direction is one row in the X-axis positive direction side with respect to the state shown in FIG.

Therefore, in FIG. 13, the icons 181 included in the display image 503 are shifted leftward by one row as compared with FIG. 11. In FIG. 13, the entire area of the six blocks 501 included in the leftmost column of the display image 503 is displayed on the display panel 160.

When the scroll operation is performed as shown in FIGS. 11 to 13, the electronic device 100 vibrates the vibrating element 140 as follows.

FIG. 14 is a diagram illustrating an operation example of the electronic device 100. In FIG. 14, the horizontal axis represents time, and the vertical axis represents the amplitude of the drive signal. Here, the operation of the electronic device 100 will be described using FIGS. 11 to 13 in addition to FIG.

Before time t1, the user's fingertip touches the top panel 120 but the fingertip does not move. That is, as shown in FIG. 11, this state is a state immediately before the scroll operation is performed.

At time t1, the user starts moving the fingertip touching the top panel 120 in the X-axis positive direction. That is, the user starts the scroll operation in an attempt to replace the icon 181 displayed on the display panel 160.

When the scroll operation is started, the entire area of the six blocks 501 included in the leftmost column of the display image 503 is not displayed, and the electronic device 100 vibrates the vibrating element 140. Thus, at time t1, the amplitude increases from zero to A1.

When the vibrating element 140 is vibrated, the dynamic friction force applied to the user's finger tip is reduced by the squeeze effect, so that the user's finger tip is provided with a feeling of low dynamic friction force. For this reason, the user can detect that the icon 181 is about to be selected and changed only by the tactile sensation.

Since the user continues the scroll operation and the entire area of the six blocks 501 included in the leftmost column of the display image 503 is not displayed on the display panel 160, the vibrating element 140 continues to vibrate. , The amplitude is held at A1.

The vibrating element 140 is driven until immediately before time t2 when the entire area of the six blocks 501 included in the leftmost column of the display image 503 is displayed on the display panel 160.

At time t2, as shown in FIG. 13, when the entire area of the six blocks 501 included in the leftmost column of the display image 503 is displayed on the display panel 160, the electronic device 100 outputs the vibrating element 140. Turn off.

When the vibrating element 140 is not driven at time t2, the user's fingertip is provided with a tactile sensation of high dynamic frictional force. Therefore, the user senses by touch that the icons 181 displayed on the display panel 160 have been replaced by one row, and finishes the scroll operation.

Then, the user releases the fingertip from the top panel 120 at time t3.

As described above, the electronic device 100 provides the user with a different tactile sensation depending on whether the replacement of the row of the icons 181 is completed, and whether the replacement of the row of the icons 181 is completed by the tactile sensation obtained by the user from the fingertip. It is possible to judge whether or not.

Next, processing performed by the drive control unit 240 of the drive control device 300 of the electronic device 100 according to the embodiment will be described with reference to FIG.

FIG. 15 is a flowchart showing processing executed by the drive control unit 240 of the drive control apparatus 300 of the electronic device 100 according to the embodiment.

The drive control unit 240 starts processing when the power of the electronic device 100 is turned on.

The drive control unit 240 determines whether the home screen is displayed on the display panel 160 (step S1). The setting of the display of the display panel 160 on the home screen is controlled by an operating system (OS) installed in the application processor 220.

Therefore, the drive control unit 240 may perform determination by obtaining data indicating whether the display on the display panel 160 is set to the home screen from the application processor 220. The drive control unit 240 may make the determination based on, for example, the value of the home screen flag indicating whether the home screen is set.

The drive control unit 240 repeats the process of step S1 until determining that the home screen is displayed on the display panel 160 (S1: YES).

When the determination in step S1 is performed, the entire area of the six blocks 501 included in the leftmost column of the display image 503 is displayed on the display panel 160. The fact that the entire area of the six blocks 501 included in the leftmost column of the display image 503 is displayed on the display panel 160 means that the entire area of the thirty blocks 501 included in the display image 503 is the display panel It is synonymous with what is displayed on 160.

If it is determined that the home screen is displayed on the display panel 160 (S1: YES), the drive control unit 240 determines whether a scroll operation is performed (step S2).

Here, when the user's fingertip is touching the top panel 120, the electronic device 100 provides a tactile sensation to the user's fingertip using a squeeze effect. Therefore, when determining whether the scroll operation is performed in step S2, it is necessary to perform the determination under the premise that the user's fingertip is touching the top panel 120.

The fact that the user's fingertip is touching the top panel 120 is equivalent to the operation input being performed, and the presence or absence of the operation input is detected by the touch panel 150.

In addition, the scrolling of the image displayed on the display panel 160 is performed under the control of the OS installed in the application processor 220.

Therefore, the drive control unit 240 may obtain data indicating whether the image of the display panel 160 is being scrolled from the application processor 220 and perform the determination. The drive control unit 240 may make the determination based on, for example, the value of the scroll flag indicating whether or not scrolling is in progress.

Therefore, in step S2, the drive control unit 240 determines that the scroll operation is performed when the coordinates of the operation input are detected by the touch panel 150 and the value of the scroll flag indicates whether the scrolling is in progress. It may be determined.

When it is determined that the scroll operation is being performed (S3: YES), the drive control unit 240 turns on the vibrating element 140 (step S3).

Next, the drive control unit 240 determines whether the scroll amount of the image displayed on the display panel 160 has reached one row of the block 501 (step S4).

When the scroll amount reaches one row of blocks 501, the icons 181 displayed on the display panel 160 are replaced by one row, and the entire area of the six blocks 501 included in the leftmost row in the display image 503 is It will be displayed on the display panel 160.

Note that the amount of scrolling of the image in step S4 is not limited to the amount of scrolling by the scroll operation with the user's fingertip touching the top panel 120, but the user's fingertip is away from the top panel 120 and the image is scrolled by inertia. Also includes the amount of scrolling.

Since the OS installed in the application processor 220 determines such a scroll amount of the image, the drive control unit 240 may perform the determination in step S4 based on the scroll amount output from the OS.

If the drive control unit 240 determines that the scroll amount has not reached one column of the block 501 (S4: NO), the drive control unit 240 determines whether a scroll operation is performed (step S5). In step S5, the drive control unit 240 determines whether a scroll operation is performed as in step S2.

In the state where the scroll amount has not reached one column of blocks 501, the entire area of the six blocks 501 included in the leftmost column of the display image 503 is not displayed on the display panel 160. Equivalent to.

If the drive control unit 240 determines that the scroll operation is being performed (S5: YES), the flow returns to step S4. This is to determine whether the scroll amount has reached one row of the block 501.

When it is determined that the scroll operation is not performed (S5: NO), the drive control unit 240 turns off the vibrating element 140 (Step S6). For example, when the user removes the fingertip from the top panel 120 and the scroll operation is not performed before the scroll amount reaches one row of the block 501, the vibration element 140 need not be vibrated. , The vibration element 140 is turned off.

After completing the process of step S6, the drive control unit 240 ends the series of processes (END).

When it is determined in step S4 that the scroll amount has reached one row of blocks 501 (S4: YES), the drive control unit 240 advances the flow to step S6 and turns off the vibrating element 140 ( Step S6).

This is to inform the user by touch that the scroll amount has reached one row of the block 501. When the vibrating element 140 is turned off, the dynamic frictional force applied to the user's fingertip is increased, so that the user's fingertip is provided with a tactile sensation like touching a convex portion. With such a tactile sensation, the user can detect that the replacement of the icon 181 is completed only by the tactile sensation.

As described above, according to the embodiment, when the scroll operation is performed on the top panel 120 and the page is transitioned, the pattern of vibration generated on the top panel 120 is changed, and the replacement of the icons 181 is completed. Since the vibration is turned off, the user can know that the replacement of the icon 181 on the home screen is completed only by the touch of the fingertip.

The completion of the replacement of the icons 181 is an example of the block (specific display area) being accommodated in the display panel 160 (display unit).

Therefore, according to the embodiment, it is possible to provide the drive control device 300, the electronic device 100, the drive control program, and the drive control method that can detect by touch whether or not a specific display area is included in the display unit.

For the user, it may be difficult to judge whether the specific display area is in the display unit with visual sense alone, and if the user does not intuitively understand it, the user may be stressed. .

On the other hand, in the electronic device 100 according to the embodiment, the user can understand by touch whether the specific display area is included in the display unit.

Further, the electronic device 100 according to the embodiment generates the drive signal by modulating only the amplitude of the sine wave of the ultrasonic wave band generated by the sine wave generator 310 with the amplitude modulator 320. The frequency of the sine wave of the ultrasonic band generated by the sine wave generator 310 is equal to the natural frequency of the top panel 120, and the natural frequency is set in consideration of the vibrating element 140.

That is, the drive signal is generated by modulating only the amplitude by the amplitude modulator 320 without modulating the frequency or phase of the sine wave of the ultrasonic band generated by the sine wave generator 310.

Therefore, the natural vibration of the ultrasonic band of the top panel 120 can be generated in the top panel 120, and the dynamic coefficient of friction when the surface of the top panel 120 is traced with a finger using interposition of the air layer by the squeeze effect is obtained. It can be reduced with certainty. In addition, the Sticky-band Illusion effect can provide the user with a good tactile sensation in which unevenness is present on the surface of the top panel 120.

Moreover, in the above, in order to provide the user with a tactile sensation that the top panel 120 has unevenness, the embodiment has been described in which the vibrating element 140 is switched on / off. To turn off the vibrating element 140 is to set the amplitude value represented by the drive signal for driving the vibrating element 140 to zero.

However, in order to provide such a tactile sensation, the vibrating element 140 does not necessarily have to be turned off. For example, instead of the off state of the vibrating element 140, a state in which the vibrating element 140 is driven with a smaller amplitude may be used. For example, by reducing the amplitude to about 1⁄5, the user may be provided with a tactile sensation in which unevenness is present in the top panel 120 as in the case where the vibrating element 140 is turned off.

In this case, the vibration element 140 is driven by a drive signal that switches the strength of the vibration of the vibration element 140. As a result, the strength of the natural vibration generated in the top panel 120 can be switched, and a tactile sensation can be provided in which unevenness is present on the user's fingertip.

When the vibration element 140 is turned off at the time of weakening the vibration in order to switch the strength of the vibration of the vibration element 140, the vibration element 140 is switched on / off. To switch on / off the vibrating element 140 is to drive the vibrating element 140 intermittently.

In the above, the mode has been described in which the vibrating element 140 is driven when the icon 181 displayed on the display panel 160 is replaced on the home screen. However, the block is not limited to the icon 181, but is an area for displaying various predetermined images or predetermined symbols. Here, a block for displaying a sentence will be described with reference to FIG.

FIG. 16 shows a block 505 for displaying a sentence. Block 505 contains a press release dated March 12, 2015 of Fujitsu Laboratories Ltd. The width of the block 505 in the X-axis direction is slightly smaller than the width of the display panel 160 in the X-axis direction.

In FIG. 16, the display panel 160 displays the upper end (end on the Y-axis positive direction), the left end (end on the X-axis negative direction), and the right end (end on the X-axis positive direction) of the block 505. The lower end of the block 505 (the end in the negative Y-axis direction) is not displayed on the display panel 160.

Block 505 has a length in the Y-axis direction longer than a length in the Y-axis direction of display panel 160. Therefore, here, as shown in FIG. 16, that the lower end of the block 505 is not displayed on the display panel 160 is a condition that is not related to the determination of whether to drive the vibrating element 140. .

Here, when at least one of the upper end, the left end, or the right end of the block 505 is not displayed on the display panel 160, the vibrating element 140 is vibrated.

As described above, if the vibrating element 140 is vibrated depending on whether the upper end, the left end, or the right end of the block 505 is displayed on the display panel 160, the user can detect only the tactile sensation detected with a fingertip. It can be detected whether the upper end, the left end, or the right end of is displayed on the display panel 160.

Although the vibration element 140 is vibrated depending on whether the upper end, the left end or the right end of the block 505 is displayed on the display panel 160 here, the left end and the right end of the block 505 are displayed on the display panel 160 In this state, the vibrating element 140 may be vibrated depending on whether the upper end or the lower end is displayed on the display panel 160.

Alternatively, the vibrating element 140 may be vibrated depending on whether any one of the upper end, the left end, the right end, and the lower end of the block 505 is displayed on the display panel 160.

In addition, the vibrating element 140 may be vibrated depending on whether or not any two or three of the upper end, the left end, the right end, and the lower end of the block 505 are displayed on the display panel 160.

When the size of the block 505 is smaller than the size of the display panel 160, the vibrating element 140 is vibrated depending on whether all of the upper end, the left end, the right end and the lower end of the block 505 are displayed on the display panel 160. You may do so.

Further, as shown in FIG. 16, when block 505 contains sentence data, a block smaller than block 505 may be further provided in block 505. For example, a block including any one or more lines of text data included in block 505 is provided, and any one of the upper end, the left end, the right end, and the lower end of the block including any one or more lines The vibrating element 140 may be vibrated depending on whether or not it is displayed on the display panel 160.

Also, as described above, instead of providing a block smaller than block 505 in block 505, without providing block 505, providing a block including any one or more lines of text data May be

Then, the vibrating element 140 may be vibrated depending on whether any one of the upper end, the left end, the right end, and the lower end of the block including any one or a plurality of rows is displayed on the display panel 160.

Alternatively, the vibration element 140 may be vibrated depending on whether any one of the upper end, the left end, the right end, and the lower end is displayed on the display panel 160 with the entire web page as one block.

In addition, even if an image such as an icon 181 or a picture or a symbol such as a character is not arranged in the block, any one of the upper end, the left end, the right end, and the lower end of the block is a display panel The vibrating element 140 may be vibrated depending on whether it is displayed at 160 or not. In this case, it may be understood that a background image representing a block is displayed.

Here, a modification of the electronic device 100 according to the embodiment will be described with reference to FIGS.

FIG. 17 is a view showing a cross section of the electronic device 100A of the modification. The cross section shown in FIG. 17 is a cross section corresponding to the cross section taken along the line AA in FIG. In FIG. 17, an XYZ coordinate system which is an orthogonal coordinate system is defined as in FIG.

The electronic device 100A includes a housing 110B, a top panel 120, a top panel 121, a double-sided tape 130, a vibrating element 140, a touch panel 150, a display panel 160A, and a substrate 170.

The electronic device 100A has a configuration in which the touch panel 150 of the electronic device 100 shown in FIG. 3 is provided on the back surface side (Z-axis negative direction side). Therefore, compared to the electronic device 100 shown in FIG. 3, the double-sided tape 130, the vibrating element 140, the touch panel 150, and the substrate 170 are disposed on the back side.

The housing 110B is formed with a recess 110A on the Z-axis positive direction side and a recess 110C on the Z-axis negative direction side. A display panel 160A is disposed inside the recess 110A and covered with the top panel 120. Further, the substrate 170 and the touch panel 150 are provided in an overlapping manner in the recess 110C, the top panel 121 is fixed to the housing 110B with the double-sided tape 130, and the surface of the top panel 121 in the positive Z-axis direction is vibrated. An element 140 is provided.

In the electronic device 100A shown in FIG. 17, when the top panel 121 generates the natural vibration of the ultrasonic band by switching on / off the vibrating element 140 according to the operation input to the top panel 121, FIG. As with the electronic device 100 shown, it is possible to provide the electronic device 100A in which the user can perceive the tactile sensation corresponding to the image displayed on the display panel 160 with the feeling of a fingertip.

Although FIG. 17 shows the electronic device 100A provided with the touch panel 150 on the back surface side, the touch panel 150 is provided on the front surface side and the back surface side by combining the structure shown in FIG. 3 and the structure shown in FIG. May be

FIG. 18 is a diagram showing an electronic device 100B according to a modification. The electronic device 100B is a notebook PC (Personal Computer).

The PC 100B includes a display panel 160B1 and a touch pad 160B2.

FIG. 19 is a view showing a cross section of the touch pad 160B2 of the electronic device 100B of the modification. The cross section shown in FIG. 19 is a cross section corresponding to the cross section taken along the line AA in FIG. In FIG. 19, an XYZ coordinate system, which is an orthogonal coordinate system, is defined as in FIG.

The touch pad 160B2 has a configuration in which the display panel 160 is removed from the electronic device 100 shown in FIG.

In the electronic device 100B as a PC as shown in FIG. 18, the natural vibration of the ultrasonic band is generated in the top panel 120 by switching on / off the vibrating element 140 according to the operation input to the touch pad 160B2. For example, similarly to the electronic device 100 illustrated in FIG. 3, according to the movement amount of the operation input to the touch pad 160B2, an operation feeling can be provided through the tactile sensation on the user's fingertip.

Further, if the vibrating element 140 is provided on the back surface of the display panel 160B1, the user's fingertip is operated through the touch according to the movement amount of the operation input to the display panel 160B1 as in the electronic device 100 shown in FIG. Can provide a feeling. In this case, the electronic device 100 shown in FIG. 3 may be provided instead of the display panel 160B1.

FIG. 20 is a plan view showing an operation state of the electronic device 100C of the modification.

The electronic device 100C includes a housing 110, a top panel 120C, a double-sided tape 130, a vibrating element 140, a touch panel 150, a display panel 160, and a substrate 170.

An electronic device 100C shown in FIG. 20 is the same as the configuration of the electronic device 100 according to the embodiment shown in FIG. 3 except that the top panel 120C is a curved glass.

The top panel 120C is curved so that the central portion in a plan view protrudes in the positive Z-axis direction. Although the cross-sectional shape in YZ plane of top panel 120C is shown in FIG. 20, the cross-sectional shape in XZ plane is also the same.

Thus, by using the curved glass top panel 120C, a good touch can be provided. In particular, it is effective when the shape of the actual object to be displayed as an image is curved.

Although the drive control apparatus, the electronic device, the drive control program, and the drive control method of the exemplary embodiment of the present invention have been described above, the present invention is limited to the specifically disclosed embodiments. Rather, various modifications and changes are possible without departing from the scope of the claims.

100, 100A, 100B, 100C electronic devices

110 chassis

120 top panel

130 Double sided tape

140 vibration element

150 touch panel

160 Display Panel

170 substrates

200 control unit

220 application processor

230 communication processor

240 Drive control unit

240 Data Generation Unit

250 memory

300 drive controller

310 sine wave generator

320 Amplitude Modulator

Claims (6)

A display unit, a top panel provided on the display surface side of the display unit and having an operation surface, a position detection unit for detecting a position of an operation input performed on the operation surface, and vibration on the operation surface A drive control device for driving the vibration element of an electronic device including the vibration element;
Image data of a scrollable image displayed on the display unit, the image having a block for displaying a predetermined image or a predetermined symbol, wherein an image of which part of the scrollable image is displayed on the display unit A storage unit for storing data and position data representing the position of the block in the scrollable image in association with each other;
An operation unit for obtaining an operation amount and an operation direction of the scroll operation performed on the operation surface based on the position detected by the position detection unit;
A drive control unit that drives the vibration element with a drive signal that generates natural vibration of an ultrasonic band on the operation surface when a scroll operation is performed on the top panel, and the scroll operation of the scroll operation determined by the calculation unit When at least one of the left end and the right end of the block or at least one of the upper end and the lower end of the block is not displayed on the display unit based on the operation amount and the operation direction and the position data Drives the vibrating element in the first pattern, and at least one of the left end and the right end, or at least one of the upper end and the lower end is displayed on the display unit in the second pattern driving the vibration element, seen including a drive control unit,
The predetermined image is an image of the GUI operation unit,
The image data comprises a plurality of the blocks,
Each of the plurality of blocks can arrange the GUI operation unit,
The drive control unit drives the vibrating element in a first pattern when the left end, the right end, the upper end, and the lower end of each of the plurality of blocks are not displayed on the display unit, and the plurality of driving control units A drive control device for driving the vibration element in a second pattern when the left end, the right end, the upper end, and the lower end of each block are displayed on the display unit;   The drive according to claim 1, wherein the drive control unit drives the vibration element such that the strength of the natural vibration generated by the first pattern becomes stronger than the strength of the natural vibration generated by the second pattern. Control device. The drive control apparatus according to claim 1 or 2 , wherein the strength of the natural vibration by the second pattern is zero or less than or equal to a predetermined value lower than the strength of the natural vibration by the first pattern. The display unit;
The top panel disposed on the display surface side of the display unit and having an operation surface;
The position detection unit that detects the position of an operation input performed on the operation surface;
The vibration element that generates vibration on the operation surface;
An electronic device comprising: the drive control device according to any one of claims 1 to 3 . A display unit, a top panel provided on the display surface side of the display unit and having an operation surface, a position detection unit for detecting a position of an operation input performed on the operation surface, and vibration on the operation surface A drive control program for driving the vibrating element of an electronic device including the vibrating element, comprising:
Image data of a scrollable image displayed on the display unit, the image having a block for displaying a predetermined image or a predetermined symbol, wherein an image of which part of the scrollable image is displayed on the display unit A computer having a storage unit for storing data and position data representing the position of the block in the scrollable image in association with each other;
Determining an operation amount and an operation direction of the scroll operation performed on the operation surface based on the position detected by the position detection unit;
Driving the vibrating element with a drive signal that generates natural vibration of an ultrasonic band on the operation surface when a scroll operation is performed on the top panel, and the operation amount of the scroll operation determined by the determination And when at least one of the left end and the right end of the block or at least one of the upper end and the lower end of the block is not displayed on the display unit based on the operation direction and the position data, When the vibration element is driven in one pattern and at least one of the left end and the right end, or at least one of the upper end and the lower end is displayed on the display unit, the vibration is generated in the second pattern to execute a driving element,
The predetermined image is an image of the GUI operation unit,
The image data comprises a plurality of the blocks,
Each of the plurality of blocks can arrange the GUI operation unit,
Driving the vibrating element drives the vibrating element in the first pattern when the left end, the right end, the upper end, and the lower end of each of the plurality of blocks are not displayed on the display unit. And driving the vibration element with a second pattern when the left end, the right end, the upper end, and the lower end of each of the plurality of blocks are displayed on the display unit . A display unit, a top panel provided on the display surface side of the display unit and having an operation surface, a position detection unit for detecting a position of an operation input performed on the operation surface, and vibration on the operation surface A drive control method for driving the vibrating element of an electronic device including the vibrating element,
Image data of a scrollable image displayed on the display unit, the image having a block for displaying a predetermined image or a predetermined symbol, wherein an image of which part of the scrollable image is displayed on the display unit A computer having a storage unit which stores data and position data representing the position of the block in the scrollable image in association with each other;
Based on the position detected by the position detection unit, an operation amount and an operation direction of the scroll operation performed on the operation surface are obtained.
Driving the vibrating element with a drive signal that generates natural vibration of an ultrasonic band on the operation surface when a scroll operation is performed on the top panel, and the operation amount of the scroll operation determined by the determination And when at least one of the left end and the right end of the block or at least one of the upper end and the lower end of the block is not displayed on the display unit based on the operation direction and the position data, When the vibration element is driven in one pattern and at least one of the left end and the right end, or at least one of the upper end and the lower end is displayed on the display unit, the vibration is generated in the second pattern to drive the device,
The predetermined image is an image of the GUI operation unit,
The image data comprises a plurality of the blocks,
Each of the plurality of blocks can arrange the GUI operation unit,
Driving the vibrating element drives the vibrating element in the first pattern when the left end, the right end, the upper end, and the lower end of each of the plurality of blocks are not displayed on the display unit. Driving the vibrating element with a second pattern when the left end, the right end, the upper end, and the lower end of each of the plurality of blocks are displayed on the display unit .

Images