JP2018129102A - Electronic device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To control generation of vibration in accordance with enlargement or reduction of an image.SOLUTION: An electronic device includes: a touch panel having a display surface for displaying an image, and detecting a contact position of an object on the display surface; a vibration generation unit which generates vibration; a storage unit for storing waveform data in association with an object in an image; and a control unit which vibrates the vibration generation unit, on the basis of the waveform data associated with the object in the image in the storage unit, when the object touches the object in the image displayed on the display surface. The control unit controls enlargement or reduction of the image displayed on the display surface, in response to a predetermined input, and synthesizes, when a plurality of different objects are included in sub areas formed by dividing the display surface and the object comes into contact with the sub areas, waveform data associated with each of the objects, in accordance with display area ratio of each of the objects in the sub areas, out of the objects included in the sub areas, to vibrate the vibration generation unit on the basis of the synthesized waveform data.SELECTED DRAWING: Figure 2

Description

The present invention relates to an electronic device.
This application claims priority based on Japan Japanese Patent Application No. 2013-160320 for which it applied on August 1, 2013, and uses the content here.

  Conventionally, there has been disclosed an invention of a system that operates an actuator so as to generate a haptic effect of a texture such as sand, grass, brick, rock, skin, fabric, and fur when a user touches a touch sensor (for example, , See Patent Document 1).

International Publication No. 2010/105010

However, the conventional system merely activates the actuator in response to a tactile sensation on a fixed image, and does not consider the case where the image is enlarged or reduced.
An object of an aspect of the present invention is to control generation of vibration in response to enlargement or reduction of an image.

  An electronic apparatus according to an embodiment has a display surface for displaying an image, a touch panel capable of detecting a contact position of an object with respect to the display surface, a vibration generation unit that generates vibration, and waveform data as a target in the image. Based on the waveform data associated with the target in the image in the storage unit when the object comes into contact with the target in the image displayed on the display surface and the storage unit associated with the storage A control unit that vibrates the vibration generating unit, and the control unit controls the enlargement or reduction of the image displayed on the display surface based on a predetermined input, and divides the display surface When a plurality of different targets are included and an object comes into contact with the divided region, a display area ratio of each of the plurality of targets in the divided region among the plurality of targets included in the divided region In response, combining the waveform data associated with each of the plurality of target synthesized on the basis of the waveform data obtained by vibrating the vibration generating portion.

  An electronic device according to an embodiment includes a display surface that displays an image, a touch panel that can detect a contact position of an object with respect to the display surface, a vibration generation unit that generates vibration, and waveform data in the image When the object comes into contact with the target in the image displayed on the display surface and the storage unit that stores the data in association with the target, the waveform data associated with the target in the image in the storage unit And a control unit that vibrates the vibration generation unit based on a predetermined input, the control unit controls enlargement or reduction of the image displayed on the display surface, and divides the display surface When a plurality of different targets are included in the divided area and an object contacts the divided area, the waveform data associated with each of the plurality of targets included in the divided area is added. Et It was based on the waveform data to vibrate the vibration generating portion.

  According to one embodiment of the present invention, generation of vibration can be controlled in response to image enlargement or reduction.

It is a figure which shows an example of the external appearance structure of the electronic device which concerns on 1st Embodiment of this invention. It is a figure which shows an example of the external appearance structure of the electronic device which concerns on 1st Embodiment of this invention. It is a block diagram which shows an example of a function structure of the electronic device which concerns on 1st Embodiment. It is the figure which illustrated the arrangement position of the vibrator which a vibration generating part has, and is a partial perspective view which looked at electronic equipment from the back cover side. It is a figure which shows an example of the data stored as waveform data. It is a figure which shows a mode that the object A and the object B which were displayed on the touch panel are expanded or reduced. It is a figure which shows the state which generate | occur | produces the vibration corresponding to a target, and does not accept various operation, and the state which accepts various operations, without generating the vibration corresponding to a target. It is a figure which shows typically a mode that waveform data are corrected according to expansion or reduction of an image. It is a figure which shows the correspondence of a contact position and a vibrator | oscillator when the vibrator | oscillator is arrange | positioned in the aspect shown to FIG. 3 (A). It is a figure which shows the correspondence of a contact position and a vibrator | oscillator when the vibrator | oscillator is arrange | positioned in the aspect shown to FIG. 3 (B). It is a figure which shows the correspondence of a contact position and a vibrator | oscillator when the vibrator | oscillator is arrange | positioned in the aspect shown in FIG.3 (C). It is a figure which shows the display image of a touchscreen in a certain scene, and the relationship of a division.

  Hereinafter, embodiments of an electronic device and a control program for the electronic device of the present invention will be described with reference to the drawings.

[Constitution]
1A and 1B are diagrams illustrating an example of an external configuration of an electronic device 1 according to an embodiment of the present invention. FIG. 2 is a configuration diagram illustrating an example of a functional configuration of the electronic apparatus 1 according to the embodiment. Hereinafter, in the present embodiment, the configuration of the electronic apparatus 1 will be described using an XYZ orthogonal coordinate system. The XYZ orthogonal coordinate system is a coordinate system based on the electronic device 1. In the XYZ orthogonal coordinate system, the stacking direction of each component of the electronic device 1 is defined as the Z direction. A plane orthogonal to the Z direction is defined as an XY plane, and directions orthogonal to the XY plane are defined as an X direction and a Y direction, respectively.

  The electronic device 1 has, for example, a substantially rectangular shape when viewed in the Z direction, and has a configuration in which the touch panel 10, the main body unit 20, and the back cover 30 are stacked in the Z direction. 1A is a diagram of the electronic device 1 as viewed from the touch panel 10 side, and FIG. 1B is a diagram of the electronic device as viewed from the back cover 30 side.

  The touch panel 10 displays an image input from the control unit 90 accommodated in the main body unit 20, detects a contact position (coordinates) touched by the user with a finger or the like on the display surface, and outputs the detected position to the control unit 90. . The touch panel 10 is configured by combining, for example, a liquid crystal display device that displays an image and a contact detection mechanism. Various contact detection mechanisms can be used. For example, a contact detection mechanism using various systems such as a resistive film system, a capacitance system, an infrared system, and a surface acoustic wave system can be employed. Further, an organic EL (Electroluminescence) display device or the like may be used instead of the LCD.

  The main unit 20 includes an imaging unit (camera) 40, a communication unit 50, an I / O unit (I / O port, I / O interface) 52, a storage unit 60, a speaker 70, and an acceleration sensor shown in FIG. 75, the vibration generating unit 80, the control unit 90, and the like are accommodated. The main body 20 may house a power supply circuit, a battery, a GPS (Global Positioning System) receiver, and the like in a housing.

  A hole 32 is formed in the back cover 30 to expose the lens 42 of the imaging unit 40. The back cover 30 is attached with a mount 35 on which various operation switches such as a release button for operating the imaging unit 40 can be mounted.

  The imaging unit 40 is a digital camera that uses a solid-state imaging device such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). Note that the imaging unit 40 may be a video camera.

The communication unit 50 performs wireless communication using a wireless LAN network such as Wi-Fi (registered trademark), Bluetooth (registered trademark), infrared communication, a mobile phone network, a PHS network, or the like.
The communication unit 50 may include a network card that functions as a communication interface when the electronic device is connected by wire.

  The I / O unit 52 includes, for example, a universal serial bus (USB) terminal, a high definition multimedia interface (HDMI) terminal, a terminal to which an SD card or the like is attached.

  The storage unit 60 is a storage device such as a flash memory, a hard disk drive (HDD), a random access memory (RAM), a read only memory (ROM), or a register. The storage unit 60 stores in advance a program (firmware) that is executed by a CPU (Central Processing Unit) of the control unit 90. In addition, the storage unit 60 stores calculation results obtained by the CPU performing calculation processing, content data received from other devices via the communication unit 50, and read from devices attached to the I / O unit 52. Stored content data and the like.

  The speaker 70 outputs sound based on the sound data generated by the control unit 90.

  The acceleration sensor 75 is, for example, a three-axis acceleration sensor, detects accelerations (including gravitational acceleration) that act on the electronic device 1 in the X direction, the Y direction, and the Z direction, respectively, and detects the detection result as a control unit 90 Output to.

  The vibration generator 80 generates vibration based on the vibration data generated by the controller 90. FIG. 3 is a diagram illustrating the arrangement position of the vibrators included in the vibration generating unit 80, and is a partial perspective view of the electronic device 1 as viewed from the back cover 30 side. For example, as shown in FIG. 3A, the vibration generating unit 80 includes vibrators 80 (1), 80 (2), 80 (3), and 80 (4) disposed near the four corners of the electronic device 1. You may prepare. Further, as shown in FIG. 3B, the vibration generating unit 80 may include vibrators 80 (1) and 80 (2) disposed in the vicinity of two corners located on the diagonal of the electronic device 1. Good. Further, as shown in FIG. 3C, the vibration generating unit 80 may include a plurality of vibrators 80 (1) to 80 (n) in a lattice shape, or the vibrators may be arranged in other arrangements. May be.

  The vibrator is attached to the housing or support portion of the main body 20 or the back cover 30. For example, a voice coil motor (VCM) or an eccentric motor is used as the vibrator. When the voice coil motor is used, the vibrator generates, for example, vibration in the Z direction with respect to a part or the whole of the electronic device 1.

  The control unit 90 controls the entire electronic device 1 including the vibration generating unit 80. In the storage unit 60, waveform data 64 associated with the image is stored as information for the control unit 90 to control the vibration generating unit 80, in addition to the image data 62 that is the original data of the image displayed on the touch panel 10. Has been. The image data 62 is image data in a format that can be enlarged or reduced, and includes a plurality of objects (object A, object B,...).

  As the waveform data 64, for example, uncompressed PCM (Pulse Code Modulation) data, compressed AAC (Advanced Audio Coding) data, or the like is used. The waveform data 64 may include a tone burst so that a vibration effect can be obtained more.

  The control unit 90 vibrates each vibrator of the vibration generating unit 80 based on the waveform data 64 stored in the storage unit 60. FIG. 4 is a diagram illustrating an example of data stored as the waveform data 64. The waveform data 64 is data in which waveform data is associated with each target. Each waveform data is the original data when the tactile sensation (rough feeling, smooth feeling, etc.) generated when touching (stroking) the material is reproduced by vibration.

  Any processing may be performed in the generation process of the waveform data. For example, a measurement device including an acceleration sensor (the electronic device 1 may be used as a measurement device) is moved in contact with an actual target object, and the normal direction acceleration at the measurement location of the target object is measured. The waveform data 64 can be generated by processing the measurement result.

[Vibration control corresponding to enlargement / reduction]
Hereinafter, vibration control corresponding to image enlargement or reduction performed by the control unit 90 will be described. FIGS. 5A to 5C are diagrams illustrating how the objects A and B in the image displayed on the touch panel 10 are enlarged or reduced. FIG. 5A shows an initial state in which the objects A and B are displayed without being enlarged or reduced. In this state, when the touch panel 10 detects that the user has touched (patched) the area of the target A with a finger or the like, the control unit 90 generates vibration based on the waveform data corresponding to the target A. In this way, each vibrator of the vibration generator 80 is controlled. Further, when the touch panel 10 detects that the user has touched (patched) the area of the target B with a finger or the like, the control unit 90 generates vibration based on the waveform data corresponding to the target B. Each vibrator of the vibration generator 80 is controlled. Here, the control unit 90 may vibrate each transducer of the vibration generating unit 80 in the same manner, or may select a transducer that operates according to a location touched by the user, as will be described later. .

  FIG. 5B shows a state in which the target A and the target B are enlarged and displayed. In this state, when the touch panel 10 detects that the user has touched (patched) the area of the target A enlarged with a finger or the like, the control unit 90 vibrates based on the waveform data corresponding to the target A. Each vibrator of the vibration generating unit 80 is controlled so as to generate. When the touch panel 10 detects that the user has touched (patched) the area of the target B enlarged with a finger or the like, the control unit 90 generates vibration based on the waveform data corresponding to the target B. Each vibrator of the vibration generating unit 80 is controlled so as to cause the vibration to occur. The area occupied by each enlarged object can be calculated based on the area occupied by the original objects A and B, the enlargement ratio, and the like.

  On the other hand, FIG. 5C shows a state in which the target A and the target B are reduced and displayed. In this state, when the touch panel 10 detects that the user has touched (patched) the area of the target A reduced with a finger or the like, the control unit 90 vibrates based on the waveform data corresponding to the target A. Each vibrator of the vibration generating unit 80 is controlled so as to generate. When the touch panel 10 detects that the user has touched (patched) the area of the target B reduced with a finger or the like, the control unit 90 generates vibration based on the waveform data corresponding to the target B. Each vibrator of the vibration generating unit 80 is controlled so as to cause the vibration to occur. The area occupied by each reduced object can be calculated based on the area occupied by the original objects A and B, the reduction ratio, and the like. 5A to 5C illustrate an example in which two objects are included in the image, but the present invention is not limited to this, and an arbitrary number and size of objects are displayed on the touch panel 10. Good.

  The enlargement of the image is performed, for example, according to a pinch-out operation by the user. More specifically, when the user touches two points on the touch panel 10 with different fingers and moves the fingers away from each other while touching the touch panel 10, the image displayed on the touch panel 10 is enlarged as a whole. The Note that instead of enlarging or reducing the entire image, it may be possible to enlarge or reduce an object such as the object A or the object B. The control unit 90 may determine whether or not a pinch-out operation has been performed, and may perform control so that vibration corresponding to the target is not generated as much as possible according to the pinch-out operation. Specifically, the control unit 90 detects contact at two points on the touch panel 10 and stops generating vibration corresponding to the target when the two points move in a substantially opposite direction by a predetermined distance or more. . Conversely, image reduction is performed in accordance with, for example, a pinch-in operation by the user. More specifically, when the user touches two points on the touch panel 10 with different fingers and moves the fingers toward each other while touching the touch panel 10, the image displayed on the touch panel 10 is reduced as a whole. (Or the target is reduced). Similar to the above, the control may be performed so that the vibration corresponding to the image does not occur as much as possible according to the pinch-in operation.

  Further, the control unit 90 may switch between a state in which vibration corresponding to the target is generated and a state in which various operations (pinch-out, pinch-in, scroll, drag, etc.) are received. FIG. 6A is a diagram illustrating a state where vibration corresponding to the target is generated and various operations are not accepted, and FIG. 6B is a state where various operations are accepted without generating vibration corresponding to the target. FIG. When the “execute operation” button BO in FIG. 6A is tapped, the electronic device 1 shifts to the state shown in FIG. In addition, when the “vibration generation” BV button in FIG. 6B is tapped, the electronic device 1 shifts to a state illustrated in FIG. Thereby, it is possible to prevent unnecessary vibrations from occurring in response to the pinch-out and pinch-in operations performed by the user.

  Here, when the image is enlarged, it can be considered that the tactile sensation is different if it is assumed that the material set for the object is similarly enlarged. Therefore, the control unit 90 may correct the waveform data according to the enlargement or reduction of the image. For example, the control unit 90 may stretch the waveform data in the time axis direction according to the image enlargement ratio and increase the amplitude of vibration according to the image enlargement ratio. When the image is reduced, the control unit 90 conversely shortens the waveform data in the time axis direction according to the image reduction rate, and reduces the vibration amplitude according to the image reduction rate. You can do it. FIG. 7 is a diagram schematically showing how the waveform data is corrected in accordance with the enlargement or reduction of the image. Further, the present invention is not limited to this, and the control unit 90 may not correct the waveform data.

  By the above-described control, as the image is enlarged or reduced, the region that generates vibration when the user touches the image is similarly enlarged or reduced. In other words, the electronic device 1 can control the occurrence of vibration in response to image enlargement or reduction.

[Control of vibrator according to contact position]
Hereinafter, the control of the vibrator according to the contact position on the display surface of the touch panel 10 by the user will be described. For example, the control unit 90 selects and operates a vibrator corresponding to the contact position. FIG. 8 is a diagram illustrating a correspondence relationship between the contact position and the vibrator when the vibrator is arranged in the manner illustrated in FIG. The control unit 90 operates the vibrator 80 (1) when contact is made with the section A1 in FIG. 8, and operates the vibrator 80 (2) when contact is made with the section A2 and makes contact with the section A3. If there is, the vibrator 80 (3) is operated, and if there is a contact with the section A4, the vibrator 80 (4) is operated. In addition, when there is a contact at an overlapping portion of the section, the control unit 90 operates a plurality of vibrators corresponding to the overlapping section. Not only this but the control part 90 does not need to provide an overlap part.

  FIG. 9 is a diagram illustrating a correspondence relationship between the contact position and the vibrator when the vibrator is arranged in the manner illustrated in FIG. The control unit 90 operates the vibrator 80 (1) when the section B1 in FIG. 9 is contacted, and operates the vibrator 80 (2) when the section B2 is contacted. In addition, when there is a contact at an overlapping portion of the section, the control unit 90 operates a plurality of vibrators corresponding to the overlapping section. Not only this but the control part 90 does not need to provide an overlap part.

  FIG. 10 is a diagram showing a correspondence relationship between the contact position and the vibrator when the vibrator is arranged in the manner shown in FIG. When the section C1 in FIG. 10 is contacted, the control unit 90 operates the vibrator 80 (1). When the section C2 is contacted, the control unit 90 operates the vibrator 80 (2). If there is a contact, the vibrator 80 (n) is operated.

  Through the control described above, the electronic device 1 can simultaneously generate different vibration patterns. For example, the target A is displayed in the section A2 and the target B is displayed in the section A3 in FIG. 8, and contact is simultaneously made in the area of the target A in the section A2 and in the area of the target B in the section A3. If there is, the vibrator 80 (2) is vibrated based on the waveform data associated with the object A, and the vibrator 80 (3) is vibrated based on the waveform data associated with the object B. And the haptic effect corresponding to the target B can be generated simultaneously. As a result, the usage mode of the electronic device 1 can be expanded.

[Control at the target boundary]
Hereinafter, the control on the target boundary line executed by the control unit 90 will be described. Here, it is assumed that the vibrator is arranged in the arrangement shown in FIG. However, control can be performed according to the same principle when the vibrators are arranged in the other arrangements shown in FIGS. 3A and 3B.

  FIG. 11 is a diagram illustrating a relationship between a display image on the touch panel 10 and a section in a certain scene. A section Ck shown in FIG. 11 includes a part of the target A and a part of the target B. In this case, when there is a contact with the section Ck, the control unit 90 may control the vibration as follows. The following description is about the case where two objects are included in one section, but even when three or more objects are included in one section, processing may be performed according to the same principle.

(1) The control unit 90 may vibrate the transducer 80 (k) based on the waveform data associated with the target having the larger area in the section Ck among the target A and the target B.
(2) The control unit 90 combines the waveform data associated with the target A and the waveform data associated with the target B based on the ratio of the area occupied by the target A and the target B in the section Ck. Good.
Here, assuming that the area ratio is SA: SB, for example, waveform data obtained by multiplying the amplitude of the waveform data associated with the target A by SA / (SA + SB) and the waveform data associated with the target B Is added to the waveform data obtained by multiplying the amplitude of SB / (SA + SB) by the same amount to generate combined waveform data.
(3) The control unit 90 may generate the combined waveform data by simply adding (superimposing) the waveform data associated with the target A and the waveform data associated with the target B.

  Through these controls, the electronic device 1 smoothly switches the vibration from the vibration associated with the object on one side to the vibration associated with the object on the other side in the boundary portion of the object. Can be realized.

[Summary]
According to the electronic apparatus 1 and the control program thereof according to the present embodiment described above, it is possible to control the generation of vibration in response to image enlargement or reduction.

  Moreover, according to the electronic device 1 of this embodiment and its control program, mutually different vibration patterns can be generated at the same time, and the usage mode of the electronic device 1 can be expanded.

  Further, according to the electronic device 1 and the control program of the present embodiment, from the vibration associated with the object on one side to the vibration associated with the object on the other side in the boundary line portion of the object. Smooth switching of vibration can be realized.

  As mentioned above, although the form for implementing this invention was demonstrated using the Example, this invention is not limited to such an Example at all, In the range which does not deviate from the summary of this invention, various deformation | transformation and substitution Can be added.

  For example, the electronic device of the present invention is not limited to the one having the shape and function as shown in FIGS. 1A to 3, and various electronic devices including a vibration generating unit such as a foldable mobile phone, a smartphone, a tablet terminal, and a personal computer It may be a computer or the like.

DESCRIPTION OF SYMBOLS 1, 2 ... Electronic device 10, Touch panel, 20 ... Main-body part, 30 ... Back cover, 32 ... Hole part, 35 ... Mount part, 40 ... Imaging part, 42 ... Lens, 50 ... Communication part, 52 ... I / O part , 60 ... storage section, 62 ... image data, 64 ... waveform data, 70 ... speaker, 75 ... acceleration sensor, 80 ... vibration generation section, 90 ... control section

Claims (10)

A touch panel having a display surface for displaying an image and capable of detecting a contact position of an object with respect to the display surface;
A vibration generator for generating vibrations;
A storage unit for storing waveform data in association with an object in the image;
A control unit configured to vibrate the vibration generation unit based on the waveform data associated with the target in the image in the storage unit when an object contacts the target in the image displayed on the display surface; ,
With
The control unit controls enlargement or reduction of the image displayed on the display surface based on a predetermined input, a plurality of different objects are included in a divided region obtained by dividing the display surface, and the division When an object touches the area, the object is associated with each of the plurality of objects according to the display area ratio of each of the plurality of objects in the divided area among the plurality of objects included in the divided area. Synthesize the waveform data, and vibrate the vibration generator based on the waveform data obtained by synthesis,
Electronics. A touch panel having a display surface for displaying an image and capable of detecting a contact position of an object with respect to the display surface;
A vibration generator for generating vibrations;
A storage unit for storing waveform data in association with an object in the image;
A control unit configured to vibrate the vibration generation unit based on the waveform data associated with the target in the image in the storage unit when an object contacts the target in the image displayed on the display surface; ,
With
The control unit controls enlargement or reduction of the image displayed on the display surface based on a predetermined input, a plurality of different objects are included in a divided region obtained by dividing the display surface, and the division When an object touches the area, the vibration generating unit is vibrated based on the waveform data obtained by adding the waveform data associated with each of a plurality of targets included in the divided area. ,
Electronics. The electronic device according to claim 1 or 2,
The control unit, when the image is enlarged or reduced, varies the vibration mode generated by the vibration generation unit before and after the enlargement or reduction.
Electronics. The electronic device according to claim 3,
The control unit varies a mode of vibration generated by the vibration generation unit according to an enlargement rate or reduction rate of the image.
Electronics. The electronic device according to claim 4,
The mode of vibration includes a period of the waveform data.
Electronics. The electronic device according to claim 5,
The control unit lengthens the period of the waveform data in accordance with the enlargement ratio.
Electronics. The electronic device according to claim 5 or 6,
The control unit shortens the cycle of the waveform data according to the reduction rate.
Electronics. The electronic device according to any one of claims 5 to 7,
The control unit changes the amplitude of the waveform data according to the enlargement ratio or the reduction ratio.
Electronics. The electronic device according to any one of claims 5 to 8,
The control unit increases the amplitude of the waveform data according to the enlargement ratio.
Electronics. The electronic device according to any one of claims 5 to 9,
The control unit reduces the amplitude of the waveform data according to the reduction ratio,
Electronics.

Images