WO2014006797A1 - Electronic device, control method therefor, and non-transitory computer-readable medium containing control program - Google Patents

Abstract

An electronic device (100) has the following: a display unit (101) that displays application data processed by an application program; an action detection unit (102) that detects contact actions performed by a user on one of a plurality of objects included in the displayed application data; a vibration unit (104) that produces vibration; and a control unit (103) that, when a contact action performed on an object is detected, controls the vibration unit (104) on the basis of index information contained in said object. This makes it possible for the user to get an intuitive sense of the content of the application data.

Description

Non-transitory computer-readable medium storing electronic device, its control method, and control program

The present invention relates to an electronic device, a control method thereof, and a non-transitory computer readable medium storing a control program, and more particularly, to an electronic device that controls vibration of a display unit, a control method thereof, and a non-temporary computer program storing a control program. Relates to a typical computer readable medium.

In recent years, multifunctional electronic devices such as smartphones and tablet terminals have become widespread, and users of electronic devices have increased opportunities to use various applications (application programs) regardless of location or time. For example, many users always carry electronic devices and frequently use social network services (SNS) such as Facebook and Twitter. For example, Patent Documents 1 to 3 describe technologies related to SNS.

On the other hand, such an electronic device includes a touch panel that detects a user's touch operation (contact operation) on the display screen. For example, Patent Document 4 describes a technique for vibrating a screen according to a user's operation on a touch panel and performing tactile feedback to the user.

JP 2012-018678 A JP 2012-034337 A JP-T 2009-521752 JP 2004-094389 A

As described above, since electronic devices are widely spread and various applications such as SNS are used by many users, the data amount of applications displayed on the electronic devices tends to increase.

However, in a related electronic device, when a lot of application data is displayed, in order to determine which application data the user should refer to, the user visually checks the contents of the data displayed on the screen one by one. I had to check in. In addition, although the said patent document 4 describes performing tactile feedback according to the icon which an electronic device displays, it does not consider at all about the application data to display.

Therefore, in related electronic devices, since it is necessary to identify displayed application data only by visual observation, there is a problem that it is difficult for the user to intuitively understand the contents of the displayed data.

An object of the present invention is to provide a non-transitory computer-readable medium in which an electronic device that solves such a problem, a control method thereof, and a control program are stored.

An electronic device according to the present invention generates vibrations, a display unit that displays application data processed by an application program, an operation detection unit that detects a touch operation on any of a plurality of objects included in the displayed application data, and And a control unit that controls the vibration unit based on index information included in the object when a contact operation on the object is detected.

The method for controlling an electronic device according to the present invention displays application data processed by an application program on a display unit, detects a touch operation on any of a plurality of objects included in the displayed application data, and touches the object. When an operation is detected, a vibration unit that generates vibration is controlled based on index information included in the object.

A non-transitory computer-readable medium storing an electronic device control program according to the present invention is a control program for causing a computer to execute control processing of an electronic device, and displays application data processed by the application program. Vibration that generates a vibration based on index information included in the object when a contact operation on any of the plurality of objects included in the displayed application data is detected and a contact operation on the object is detected. The part is controlled.

According to the present invention, it is possible to provide an electronic device that allows the user to intuitively understand the contents of application data, a control method thereof, and a non-transitory computer-readable medium storing a control program.

It is a block diagram for demonstrating the main characteristics of the electronic device which concerns on this invention. 1 is a configuration diagram illustrating an external configuration of an electronic device according to a first embodiment. 1 is a configuration diagram illustrating an external configuration of an electronic device according to a first embodiment. 3 is a configuration diagram illustrating a configuration of a display module according to Embodiment 1. FIG. 3 is a configuration diagram illustrating a configuration of a display module according to Embodiment 1. FIG. 3 is a configuration diagram illustrating a configuration of a display module according to Embodiment 1. FIG. 3 is a configuration diagram illustrating a configuration of a hardware block of the electronic device according to the first embodiment. FIG. FIG. 3 is a configuration diagram showing a functional block configuration of the electronic device according to the first embodiment. FIG. 4 is a waveform diagram showing a vibration pattern of the electronic device according to the first embodiment. FIG. 4 is a waveform diagram showing a vibration pattern of the electronic device according to the first embodiment. FIG. 4 is a waveform diagram showing a vibration pattern of the electronic device according to the first embodiment. FIG. 4 is a waveform diagram showing a vibration pattern of the electronic device according to the first embodiment. 3 is a flowchart illustrating a method for controlling the electronic device according to the first embodiment. 10 is an image diagram of a display screen displayed on the display unit according to Embodiment 2. FIG. 10 is an image diagram of a display screen displayed on the display unit according to Embodiment 2. FIG. 10 is an image diagram of a display screen displayed on the display unit according to Embodiment 2. FIG. 10 is an image diagram of a display screen displayed on a display unit according to Embodiment 3. FIG. 10 is an image diagram of a display screen displayed on a display unit according to Embodiment 3. FIG. 10 is an image diagram of a display screen displayed on a display unit according to Embodiment 4. FIG. 10 is an image diagram of a display screen displayed on a display unit according to Embodiment 4. FIG. FIG. 10 is an image diagram of a display screen displayed on a display unit according to a fifth embodiment. FIG. 10 is an image diagram of a display screen displayed on a display unit according to a fifth embodiment.

(Features of the present invention)
Prior to the description of the embodiment of the present invention, the outline of the features of the present invention will be described with reference to FIG. As shown in FIG. 1, an electronic device 100 according to the present invention includes a display unit 101, an operation detection unit 102, a control unit 103, and a vibration unit 104.

The display unit 101 displays application data processed by the application program, the operation detection unit 102 detects a user's touch operation on any of the plurality of objects included in the displayed application data, and the control unit 103 The main feature of the present invention is to control the vibration unit 104 that generates vibration based on the index information included in the object when a contact operation is detected.

As described above, in the electronic device 100 according to the present invention, when the user operates the application data displayed on the display unit 101, the vibration unit 16 vibrates according to the index related to the application data, and tactile feedback is performed to the user. For this reason, the user can grasp | ascertain the content of the displayed application data intuitively.

(Embodiment 1)
The first embodiment will be described below with reference to the drawings. 2A is a front external view of electronic device 1 according to the present embodiment, and FIG. 2B is a side external view thereof. The electronic device 1 is an electronic device that can be carried by a user, such as a smartphone, a tablet-type mobile terminal device, a mobile phone, a game machine, or an electronic book terminal. Note that the electronic device may be an electronic device that allows a user to perform a touch operation (contact operation) on the display screen, and may be a computer device such as a personal computer.

As shown in FIGS. 2A and 2B, the electronic apparatus 1 according to the present embodiment includes a display module 10 disposed on the main surface and a housing 20 disposed on the back surface. The casing 20 has a concave cross section, and is fixedly arranged so as to cover the entire back surface of the display module 10.

The main surface (front surface) is a surface facing the user side in the electronic device 1 in a state of being gripped by the user, and is an input / output surface that mainly performs input / output with the user, that is, a GUI (Graphical User) Interface) and the like, and an operation surface on which a user performs an input operation. Further, the back surface (back surface) is a surface opposite to the main surface in the electronic device 1.

The display module 10 includes a display unit (display screen) 11 that displays a GUI and the like, and a touch panel 12 on which a user performs an input operation. The display module 10 (the main surface of the electronic device 1) includes a camera 13 for imaging the user and the like, a microphone 14 for inputting sound and the like, and a speaker 15 for outputting sound and the like. For example, when the display unit 11 of the display module 10 displays a GUI (object) such as a list of icons and application data, and the user operates the GUI by touching the touch panel 12 with a finger or the like, processing (function) corresponding to the operation is performed. Execute.

FIG. 3A is a front view of the display module 10 according to the present embodiment, and FIG. 3B is a side view thereof. As illustrated in FIGS. 3A and 3B, the display module 10 includes a display unit 11 and a touch panel 12 disposed on the surface side (main surface side) of the display unit 11. The display unit 11 is bonded to the center of the back surface (back surface) of the touch panel 12 with an adhesive or the like, and the surface area of the display unit 11 that the user visually recognizes via the touch panel 12 becomes a display region (display screen). .

In addition, a vibration unit 16 is disposed at one end of the back surface of the touch panel 12. For example, the vibration unit 16 is bonded to the touch panel 12 with an adhesive or the like. The vibration unit 16 is a haptic element for providing haptic feedback to the user. As shown in FIGS. 3A and 3B, by providing the display module 10 with the vibration unit 16, vibration according to an operation on the touch panel 12 can be transmitted to the user.

3A and 3B, one vibration unit 16 may be disposed in the display module 10, or a plurality of vibration units 16 may be disposed in the display module 10 as illustrated in FIG. FIG. 4 shows an example in which four vibration parts 16 a to 16 d are arranged, and the vibration parts 16 a to 16 d are arranged near the corners of the display unit 11, respectively. When the screen size of the display unit 11 is small, the vibration can be accurately transmitted to the user by one vibration unit as shown in FIGS. 3A and 3B. When the screen size of the display unit 11 is large, a plurality of vibration units are arranged as shown in FIG. 4, and the vibration unit close to the area operated by the user is vibrated, so that the user can vibrate according to the operation position. Can be accurately conveyed.

FIG. 5 shows a hardware block configuration of the electronic apparatus 1 according to the present embodiment. As shown in FIG. 5, the electronic device 1 includes a display unit 11, a touch panel 12, a camera 13, a microphone 14, a speaker 15, and a vibration unit 16 as in FIGS. 2A and 2B to 4, and further includes a control unit. Unit 17, wireless communication unit 19, and storage unit 18.

The control unit 17 is a control unit that controls the operation of each unit, such as a CPU. The control unit 17 executes a control program and an application program stored in the storage unit 18 and controls an output operation such as a display according to an input operation and each program.

The wireless communication unit 19 is a communication unit for performing wireless communication with a base station and other communication devices. The wireless communication unit 19 transmits and receives audio signals for calls and the like, and transmits and receives application data and the like that are processed and displayed by an application program. In addition, you may perform not only wireless but wired communication and other communication control.

The display unit 11 is a display such as a liquid crystal display or an organic EL display. The display unit 11 displays a GUI such as an icon or a list of application data in accordance with an instruction from the control unit 17.

The touch panel 12 is affixed to the display unit 11 as illustrated in FIGS. 3A and 3B and detects a user's touch operation (contact operation) on the display unit 11. The touch panel 12 detects the position on the display unit 11 touched by the user's finger using capacitance or the like, and outputs a signal indicating the detected position to the control unit 17.

The vibration unit 16 is attached to the touch panel 12 as shown in FIGS. 3A and 3B, and performs tactile feedback to the user by vibration. The vibration unit 16 is a piezoelectric element or the like, is supplied with a control signal according to a user operation from the control unit 17, and vibrates the touch panel 12 (display unit) with strength or length based on the control signal.

The camera 13 is an image pickup device that picks up an image of a user or an image pickup device arranged on the back surface of the electronic device 1. Image data obtained by capturing a still image or a moving image with the camera 13 is output to the control unit 17. The control unit 17 displays the image data on the display unit 11 or stores it in the storage unit 18.

The microphone 14 inputs a voice from the user, and the speaker 15 outputs a voice or the like to the user. For example, a sound signal corresponding to the sound input from the user is transmitted to the microphone 14 via the wireless communication unit 19, and a sound corresponding to the sound signal received by the wireless communication unit 19 is output from the speaker 15 to the user.

The storage unit 18 is a storage unit such as a flash memory, and stores information necessary for the operation of the control unit 17 and each unit. For example, the storage unit 18 stores a control program executed by the control unit 17, an application program, application data, and the like.

FIG. 6 shows a functional block configuration realized by the control unit 17 of the electronic apparatus 1 according to the present embodiment. As illustrated in FIG. 6, the control unit 17 includes an operation detection unit 31, an application unit 32, a display data element acquisition unit 33, a display data analysis unit 34, and a vibration control unit 35. The functional blocks in FIG. 6 are examples, and other block configurations may be used as long as a control operation according to the present embodiment described later with reference to FIG. 8 can be realized. For example, the application unit 32, the display data element acquisition unit 33, the display data analysis unit 34, and the vibration control unit 35 may be a single control unit.

Each block (functional unit or processing unit) in FIG. 6 may be configured by hardware, software, or both. For example, each block of the control unit 17 is realized by executing a control program for performing a control operation according to the present embodiment on a CPU (computer).
The program can be stored and provided to a computer using various types of non-transitory computer readable media. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (for example, magneto-optical disks), CD-ROM (Read Only Memory) CD-R, CD -R / W, including semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may also be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

The operation detection unit 31 receives a user's touch operation through the touch panel 12 and detects what operation has been performed. When the user operates a list or icon displayed on the display unit 11, the operation detection unit 31 receives a position signal corresponding to the operation from the touch panel 12 and detects a user operation on the list or icon. The operation detection unit 31 detects a flick operation, a drag operation, a tap operation, a double tap operation, a pinch-in operation, a pinch-out operation, and the like according to a user operation on the touch panel 12, and notifies each unit that an input operation has been detected. To do.

The application unit 32 executes an application program and executes processing according to the application program. The application unit 32 outputs and displays display data including a part of application data processed by the application program on the display unit 11. For example, the application unit 32 displays a list of a plurality of application data (display data). The application unit 32 executes processing according to a user operation input via the operation detection unit 31 and displays the execution result on the display unit 11. For example, the application unit 32 displays detailed data of a selected item (display data) in the list in response to a user operation on the list display.

The display data element acquisition unit 33 acquires element information (index information) of the operated display data in response to a user operation on the display data displayed on the display unit 11. The display data element acquisition unit 33 acquires, from the application unit 32, element information of display data that is a target of the user operation, in response to a user operation input via the operation detection unit 31. For example, a list of display data is displayed as a list on the display unit 11, and when the user performs a touch operation on the list display, an element of an item (display data) in the list touched by the user is acquired.

The element information of display data is index information for the user to identify application data (display data). The element information of the display data is information for identifying data that the user is interested in. If the element information is larger, the user's interest is higher, and if the element information is smaller, the user's interest is greater. Means low interest. The element information of the display data is also guidance information for causing the user to identify the application data and guiding the user to the next operation.

The display data analysis unit 34 analyzes the operated display data according to the data operation on the display data displayed on the display unit 11, and generates analysis information. The display data analysis unit 34 analyzes the element information acquired by the display data element acquisition unit 33 and generates analysis information for vibrating the vibration unit 16. Further, the display data analysis unit 34 acquires detailed information of display data that is a target of user operation from the application unit 32, analyzes the acquired detailed information, and generates analysis information. The display data analysis unit 34 performs text analysis, image analysis, etc. on element information and detailed information, extracts features of the display data, and generates analysis information to allow the user to identify the features.

When the user operates the display data displayed on the display unit 11, the vibration control unit 35 controls the vibration of the vibration unit 16 according to the index of the operated display data. The vibration control unit 35 vibrates the vibration unit 16 according to the element information acquired by the display data element acquisition unit 33. In addition, the vibration control unit 35 vibrates the vibration unit 16 according to the display data analysis information analyzed by the display data analysis unit 34. The vibration control unit 35 causes the vibration unit 16 to vibrate more as the element information or analysis information is larger, and causes the vibration unit 16 to vibrate smaller as the element information or analysis information is smaller.

The vibration control unit 35 controls the vibration pattern of the vibration unit 16 according to the element information (analysis information) of the display data. 7A to 7D show an example of a vibration pattern of the vibration unit 16 controlled by the vibration control unit 35. FIG. For example, as the vibration pattern control, the vibration level, vibration time, vibration cycle, vibration rhythm, and the like are switched in a plurality of stages according to display data. Note that more vibration patterns may be generated by combining the strength of vibration, the time for vibration, the period of vibration, the rhythm of vibration, and the like. In other words, to control the vibration more greatly, control the vibration level (strength) more strongly, control the vibration time longer, control the vibration cycle shorter, and control the rhythm tempo faster. Including any or a combination of. To control vibration smaller, control vibration level (intensity) weaker, control vibration time shorter, control vibration period longer, control vibration rhythm tempo slower. Any one or combination.

FIG. 7A is an example in which the strength of the vibration level is controlled in two stages. For example, when the element information of the display data is large, the maximum level of the vibration pattern is increased to control to vibrate more strongly (a-1), and when the element information of the display data is small, the vibration pattern The maximum level is reduced to control to vibrate weaker (a-2).

FIG. 7B is an example in which the length of vibration time is controlled in two stages. For example, when the element information of the display data is large, the vibration pattern period is lengthened and controlled to vibrate longer (b-1). When the element information of the display data is small, the period of the vibration pattern Is controlled so as to vibrate shorter (b-2).

FIG. 7C is an example in which the period (frequency) of the vibration pattern is controlled in two stages. For example, when the element information of the display data is large, control is performed so that the vibration pattern period is shortened to vibrate faster (c-1). When the element information of the display data is small, the period of the vibration pattern is controlled. And control to vibrate more slowly (c-2).

FIG. 7D is an example in which the rhythm of the vibration pattern is controlled in two stages. For example, when the element information of the display data is large, control is performed so that the rhythm of the vibration pattern is 2 beats at a time, so that it vibrates much at a faster tempo (d-1), and when the element information of the display data is small, The vibration pattern rhythm is controlled by one beat at a time so as to vibrate less at a slower tempo (d-2).

FIG. 8 shows a control operation (control method) for tactile feedback of the electronic apparatus 1 according to the present embodiment. For example, an icon for an application program is displayed on the display unit 11 of the electronic device 1. When the user operates the icon via the touch panel 12, the execution of the application program is started and the following processing is executed. The

First, the application unit 32 displays a list of display data including a part of the application data on the display unit 11 according to the application program (S101). The application unit 32 accesses a server or the like via the wireless communication unit 19 and also accesses a database or the like in the storage unit 18 to acquire a plurality of display data according to a user operation and display the acquired display data A list is displayed in the section 11. In addition, since it is only necessary to display a plurality of display data that can be operated by the user, the display data is not limited to the list format and may be displayed in an arbitrary format.

Subsequently, the operation detection unit 31 detects a user operation input to the touch panel 12 (S102). The operation detection unit 31 detects a user operation on the list of display data displayed on the display unit 11. The operation detection unit 31 receives a user operation from the touch panel 12, and whether the user operation is a list scroll operation for scrolling the list, a list tactile operation for tactile feedback, or an item included in the list It is determined whether or not the operation is a list item selection operation for selecting (display data).

The operation detection unit 31 detects an arbitrary touch pattern and causes each unit to perform an operation corresponding to the touch pattern. For example, the list scroll operation is a drag operation on the list, the list tactile operation is a flick operation on the list, and the list item selection operation is a tap operation on the list item. Moreover, you may identify each operation according to the area | region which a user operates. For example, an operation area for list tactile operation may be displayed, and it may be determined that the list tactile operation is performed when this operation area is operated.

In S102, when the user operation is a list scroll operation, the application unit 32 scrolls and displays the list according to the user operation (S103). For example, when the user performs a drag operation on the displayed list, the operation detection unit 31 determines that the operation is a list scroll operation, and the application unit 32 scrolls and displays the list according to the user operation.

In S102, when the user operation is a list tactile operation, the display data element acquisition unit 33 acquires list item information (element information) from the application unit 32 (S104). For example, when the user performs a flick operation on the displayed list, the operation detection unit 31 determines that the operation is a list tactile operation, and the display data element acquisition unit 33 displays the list item operated by the user ( Element information of (display data) is acquired from the application unit 32.
Specifically, the operation detection unit 31 acquires element information of the items in the list specified by the position where the operation is accepted in the flick operation from the application unit 32.

Subsequently, the display data analysis unit 34 further analyzes the item information of the list that has received the operation for vibration feedback (S105). The display data analysis unit 34 analyzes the element information of the list item operated by the user acquired in S104, acquires the detailed information of the list item operated by the user from the application unit 32, and performs vibration. Generate analysis information for feedback. Here, the element information may be information including numerical information. The analysis of the display data can be omitted if the vibration is controlled by the element information of the application program.

Subsequently, the vibration control unit 35 vibrates the vibration unit 16 according to the contents of the list item information (S106). The vibration control unit 35 performs vibration of the vibration unit 16 according to the element information of the list item (display data) acquired in S104, the numerical information included in the element information, or the analysis information of the list item (display data) analyzed in S105. To control. The vibration control unit 35 selects the size of the vibration pattern as shown in FIGS. 7A to 7D according to the size of the element information (analysis information) of the display data, and sends the control signal of the selected vibration pattern to the vibration unit 16. Output to. The vibration control unit 35 causes the vibration unit 16 to vibrate more as the numerical information of the display data is larger, and vibrates the vibration unit 16 smaller as the numerical information is smaller. Further, when the flick operation continues, steps S104 to S106 are repeated, and vibration control is performed in the order of display data that the user touches.

In S102, when the user operation is a list selection operation, the application unit 32 displays detailed information on the item (display data) selected according to the user operation (S107). For example, when the user performs a tap operation on an item in the displayed list, the operation detection unit 31 determines that the operation is a list item selection operation, and the application unit 32 details the item (display data) selected by the user. Various contents are displayed on the display unit 11.

As described above, in the present embodiment, display data corresponding to an application is displayed on the display unit of the electronic device, and when the user performs a touch operation on the display data, vibration feedback corresponding to the index of the display data is performed. Therefore, the user can intuitively grasp the contents of the display data. A list of multiple display data of the application is displayed, and when the user performs a flick operation, etc., by controlling vibration for each display data, it is possible to intuitively identify display data with strong interest and interest. Data can be referenced immediately with a simple operation.

(Embodiment 2)
The second embodiment will be described below with reference to the drawings. In the present embodiment, an example of a screen image and vibration feedback in the electronic device 1 shown in the first embodiment will be mainly described. In particular, in the present embodiment, an example in which an SNS application program is executed will be described.

FIG. 9A shows a display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment, and FIG. 9B shows a vibration pattern example for a user operation on the display unit 11. FIG. 9A is an example of a timeline display of Facebook (registered trademark) which is an SNS, for example.

For example, when a user starts a Facebook application (or accesses a website) and logs in, messages 201 posted in chronological order are displayed as shown in FIG. Each message 201 displays a part of the poster's image and posted content, and further displays the number of “likes” registered 202. That is, the control unit 17 executes the Facebook application program and displays a message acquired from the Facebook server on the display unit 11.

The screen display of FIG. 9A is controlled to vibrate with a vibration pattern corresponding to each message 201 as shown in FIG. 9B. That is, in this example, as the numerical information, vibration feedback is performed with the strength corresponding to the number of “like” registrations 202 of each message 201. The control unit 17 acquires the “like!” Registration number 202 of the message 201 specified by the user's flick operation, and vibrates so as to vibrate at a strength corresponding to the acquired “like” registration number 202. The unit 16 is controlled.
Note that vibration control may be performed according to the number of “Like” registrations 202 without displaying the “Like” registrations 202 on the screen. Hereinafter, in other screen displays as well, vibration control may be performed according to index information without displaying index information including numerical information.

When the user performs a flick operation by bringing the finger into contact with the display unit 11 as indicated by the arrow 203, the control unit 17 performs the vibration unit 16 according to the number of “like!” Registrations 202 of the message 201 touched by the user's finger. Vibrate. In the example of FIG. 9B, when the user touches the first message 201 from the top of the display unit 11, the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the number of registrations “2”. When the user touches the second message 201 from the top, the control unit 17 vibrates the vibration unit 16 with the strength corresponding to the registered number “10”, and when the user touches the third message 201 from the top, the control unit 17 17 vibrates the vibration unit 16 with a strength corresponding to the registered number “5”. Thereby, since it vibrates according to the number of “Like” registrations of each message, it is possible to intuitively grasp messages of interest and interest from other users.

FIG. 10 is another example of the Facebook timeline display of FIG. In FIG. 10A, the control unit 17 displays a timeline display area 200a and a tactile area 200b on the display screen of the display unit 11. In the timeline display area 200a, the same timeline display as in FIG. 9A is performed. The haptic area 200b is an operation area for haptic feedback.

When the user performs a flick operation on the tactile area 200b as indicated by an arrow 204, the control unit 17 responds to the number of “like!” Registrations 202 of the message 201 that contacts the tactile area 200b touched by the user's finger. Vibrate. The vibration pattern is the same as in FIG. As shown in FIG. 10, by providing a region for tactile operation, an operation for tactile feedback can be performed using a touch pattern used in timeline display.

FIG. 11A is another display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment, and FIG. 11B shows an example of a vibration pattern for a user operation on the display unit 11. . FIG. 11A is an example of a timeline display of Twitter (registered trademark) which is an SNS, for example.

For example, when a user starts a Twitter application (or accesses a website) and logs in, a short message 211 posted in chronological order is displayed as shown in FIG. Each short message 211 displays an image of the poster and part of the posted content, and further displays the number 212 of retweets. That is, the control unit 17 executes a Twitter application program and displays a short message acquired from the Twitter server on the display unit 11.

Control is performed so that the screen display of FIG. 11A vibrates with a vibration pattern corresponding to each short message 211 as shown in FIG. 11B. That is, in this example, as the numerical information, vibration feedback is performed with the strength corresponding to the number of retweets 212 of each short message 211. The control unit 17 acquires the number of retweets 212 of the short message 211 specified by the user's flick operation, and controls the vibration unit 16 to vibrate with a strength according to the acquired number of retweets 212.

When the user performs a flick operation on the display unit 11 as indicated by an arrow 213, the control unit 17 vibrates the vibration unit 16 according to the number of retweets 212 of the short message 211 touched by the user's finger. In the example of FIG. 11B, when the user touches the first short message 211 from the top of the display unit 11, the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the number of retweets “10”. When the user touches the second short message 211 from the top, the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the number of retweets “5”, and when the user touches the third short message 211 from the top. The control unit 17 vibrates the vibration unit 16 with a strength corresponding to the registered number “100”. Thereby, since it vibrates according to the number of retweets of each message, it is possible to intuitively grasp messages of interest and interest by other users.
As an example of numerical information, vibration control may be performed according to an index that can identify a message, such as the number of comments, as well as the number of “Like” in FIG. 9 and the number of retweets in FIG.

As described above, in the present embodiment, in the screen display when an SNS application such as Facebook or Twitter is executed, the display unit 11 (in accordance with the number of “likes”, the number of retweets, the number of comments, etc. The touch panel 12) was vibrated. That is, the display data element acquisition unit 33 acquires the number of likes, the number of retweets, and the number of comments as index information, and vibrates the display unit 11 according to the number of cases acquired by the vibration control unit 35. For this reason, there are many interests and interests by other users, and it is possible to intuitively identify a message that is a topic. Further, since the identified message can be opened immediately by tapping, the message that the user is interested in can be referred to by a simple operation.

With related technology, the only way to see information on Twitter and Facebook is to see how many “likes” were received, how many retweets were made, and how many comments were made on the timeline. It was complicated.

Therefore, in this embodiment, the user can recognize the excitement of the timeline of Twitter and Facebook by tactile feedback.

Depending on the number of comments, the number of likes, and the number of retweets, the screen vibrates when the user traces his / her finger on the timeline screen. For example, the number of comments. Traces over “tweets / tweets”, which often have strong vibrations (or vibrations that give a feeling of excitement). This is because the control unit 17 determines that the operation position at the time of the flick operation by the operator is on the “tweet / tweet” with a large number of cases, and the numerical value included in the element information with respect to the vibration unit 16. This is because vibration based on information is performed.
Thus, when the control part 17 vibrates proportionally with respect to numerical information, a vibration becomes so strong that there are many cases. Rather than visually confirming it, it is easier to grasp the reactions of other users to tweets / tweets by simply tracing the timeline with a finger.

(Embodiment 3)
The third embodiment will be described below with reference to the drawings. In the present embodiment, an example of a screen image and vibration feedback in the electronic device 1 shown in the first embodiment will be mainly described. In particular, in the present embodiment, an example when a website application program is executed will be described.

FIG. 12A shows a display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment, and FIG. 12B shows a vibration pattern example for a user operation on the display unit 11. FIG. 12A is an example of a website search result display, for example.

For example, when the user inputs a search keyword into the search box 221, the hit website information 222 is displayed in the order of the number of hits as shown in FIG. Each website information 222 displays the title of the website and a part of the website, and further displays the number of hits 223 of the website and the number of accesses 224 recently accessed by the user. That is, the control unit 17 executes a website search application program and displays the search result of the website acquired from the server on the display unit 11.

The screen display of FIG. 12A is controlled to vibrate with a vibration pattern corresponding to each website information 222 as shown in FIG. That is, in this example, vibration feedback is performed as numerical information with a strength corresponding to the number of accesses 224 of each website information 222. The control unit 17 acquires the number of accesses 224 of the website information 222 specified by the user's flick operation, and controls the vibration unit 16 to vibrate with a strength corresponding to the acquired number of accesses 224.
As numerical information, vibration control may be performed according to the number of hits 223 or other information.

When the user performs a flick operation on the display unit 11 as indicated by an arrow 225, the control unit 17 vibrates the vibration unit 16 according to the number of accesses 224 of the website information 222 touched by the user's finger. In the example of FIG. 12B, when the user touches the first website information 222 from the top of the display unit 11, the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the access count “1”. When the user touches the second website information 222 from the top, the control unit 17 vibrates the vibration part 16 with the strength corresponding to the access count “2”, and the third website information 222 from the top When touched, the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the access count “5”. Thereby, since it vibrates according to the frequency | count of access of each website, a user can grasp intuitively a website with much interest and interest.

FIG. 13A shows another display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment, and FIG. 13B shows an example of a vibration pattern for a user operation on the display unit 11. . FIG. 13A is a display example of an introduction site that introduces a website of a recommended store, for example.

For example, when the user accesses the introduction site, as shown in FIG. 13A, store information 231 of the store introduced by the introduction site as a recommendation is displayed. Each store information 231 displays a store name and a part of the store website, and further displays a store evaluation score 232 and a store website bookmark number 233. That is, the control unit 17 executes the application program for the introduction site and displays recommended store information acquired from the server on the display unit 11.

The screen display of FIG. 13A is controlled so as to vibrate with a vibration pattern corresponding to each store information 231 as shown in FIG. 13B. That is, in this example, as the numerical information, vibration feedback is performed with the strength according to the evaluation score 232 and the bookmark number 233 of each store information 231. The control unit 17 acquires the evaluation score 232 and the bookmark number 233 of the store information 231 designated by the user's flick operation, and vibrates at a strength corresponding to the acquired evaluation score 232 and bookmark number 233. 16 is controlled.
Note that vibration control may be performed according to one of the evaluation score 232 or the bookmark number 233 as numerical information.

When the user performs a flick operation on the display unit 11 as indicated by an arrow 234, the control unit 17 vibrates the vibration unit 16 according to the evaluation score 232 and the bookmark number 233 of the store information 231 touched by the user's finger. In the example of FIG. 13B, when the user touches the first store information 231 from the upper part of the display unit 11, the control unit 17 vibrates with strength corresponding to the evaluation score “1” and the bookmark number “0”. When the user touches the store information 231 that is second from the top, the control unit 17 vibrates the vibration unit 16 with the strength corresponding to the evaluation score “3” and the bookmark number “10”. When the user touches the third store information 231, the control unit 17 causes the vibration unit 16 to vibrate with the strength corresponding to the evaluation score “3” and the bookmark number “100”. Thereby, since it vibrates according to the evaluation score of each store and the number of bookmarks on the website, it is possible to intuitively grasp stores where the user is more interested and interested in consideration of a plurality of factors.
In addition, as numerical information, vibration control is performed according to an index that can identify a website, such as the number of comments and the number of reviews, as well as the number of hits and the number of accesses in FIG. 12, the number of evaluation points (evaluation number) in FIG. Also good.

As described above, according to the present embodiment, in the screen display when the website application is executed, the display unit 11 (touch panel) is displayed according to the number of hits, the number of accesses, the number of evaluation points, the number of bookmarks, and the number of comments. 12) was vibrated. That is, the display data element acquisition unit 33 acquires the number of hits of the website, the number of accesses, the number of evaluation points, the number of bookmarks, and the number of comments as index information, and displays the display unit 11 according to the number of cases acquired by the vibration control unit 35. Vibrate. For this reason, there are many interests and interests by other users, and it is possible to intuitively identify a website that is a topic. In addition, since the identified website can be opened immediately by tapping, the website that the user is interested in can be referred to with a simple operation.

(Embodiment 4)
The fourth embodiment will be described below with reference to the drawings. In the present embodiment, an example of a screen image and vibration feedback in the electronic device 1 shown in the first embodiment will be mainly described. In particular, in the present embodiment, an example when an application program for e-mail is executed will be described.

FIG. 14A shows a display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment, and FIG. 14B shows a vibration pattern example for a user operation on the display unit 11. FIG. 14A is a display example that displays, for example, read / unread and importance of received mail.

For example, when the user activates an e-mail application, received mails 241 are displayed in the order of received time series as shown in FIG. Each received mail 241 displays a mail title, a sender, and a part of the mail, and further displays a read / unread state 241 and an importance 243. That is, the control unit 17 executes an e-mail application program and displays the mail acquired from the mail server on the display unit 11.

14A is controlled so as to vibrate with the vibration pattern corresponding to each received mail 241 as shown in FIG. 14B with respect to the screen display of FIG. In other words, in this example, vibration feedback is performed with a strength corresponding to the read / unread state 241 and importance 243 of each received mail 241. The control unit 17 acquires the read / unread state 241 and the importance level 243 of the received mail 241 specified by the user's flick operation, and has the strength according to the acquired read / unread state 241 and the importance level 243. The vibration part 16 is controlled to vibrate.

When the user performs a flick operation on the display unit 11 as indicated by an arrow 244, the control unit 17 vibrates the vibration unit 16 according to the read / unread state 241 and the importance 243 of the received mail 241 touched by the user's finger. Let In the example of FIG. 14B, when the user touches the first received mail 241 from the top of the display unit 11, the control unit 17 corresponds to the read / unread state “read” and the importance “low”. When the vibration unit 16 is vibrated with strength and the user touches the second received mail 241 from the top, the control unit 17 vibrates with the strength corresponding to the read / unread state “unread” and the importance “high”. When the user touches the third received mail 241 from the top, the control unit 17 vibrates the vibration unit 16 with the strength corresponding to the read / unread state “unread” and the importance “medium”. Let Thereby, since it vibrates according to the read / unread state and importance of each received mail, the received mail that the user is interested in can be intuitively grasped.

FIG. 15A is another display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment, and FIG. 15B shows an example of a vibration pattern in response to a user operation on the display unit 11. . FIG. 15A is a display example for displaying the emotion of the received mail, for example.

For example, when the user activates an e-mail application, received mails 251 are displayed in the order of received time series as shown in FIG. Each received mail 251 displays a mail title, a sender, a part of the mail, and an emotion icon 252. That is, the control unit 17 executes an e-mail application program and displays the mail acquired from the mail server and an emotion icon corresponding to the mail on the display unit 11.

The screen display of FIG. 15A is controlled to vibrate with a vibration pattern corresponding to each received mail 251 as shown in FIG. That is, in this example, vibration feedback is performed with a strength corresponding to the emotion of each received mail 251. The control unit 17 acquires information indicating the emotion of the received mail 251 specified by the user's flick operation, and controls the vibration unit 16 to vibrate with a strength corresponding to the acquired information indicating the emotion.
The emotion of the received mail may be determined according to a text analysis of the received mail and according to a word expressing the emotion, or according to the type and number of pictograms.

When the user performs a flick operation on the display unit 11 as indicated by an arrow 253, the control unit 17 vibrates the vibration unit 16 according to the emotion of the emotion icon 252 of the received mail 251 touched by the user's finger. In the example of FIG. 15B, when the user touches the first received mail 241 from the top of the display unit 11, the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the emotion icon 252 “surprise”. When the user touches the second received mail 241 from the top, the control unit 17 vibrates the vibration part 16 with a strength corresponding to the emotion icon 252 “fun”, and the user touches the third received mail 241 from the top. When touched, the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the emotion icon 252 “like”. Thereby, since it vibrates according to the emotion of each received mail, the received mail that the user is interested in can be intuitively grasped.
Note that the vibration control may be performed according to an index that can identify the mail, such as the address of the transmission source, without being limited to the read / unread state and importance of FIG. 14 and the emotion of FIG. For example, control is performed so as to vibrate strongly in the case of mail received from a partner who frequently sends and receives mail. Further, not only the received mail but also the transmitted mail may be controlled in the same manner.

As described above, in the present embodiment, the display unit 11 (touch panel 12) vibrates in accordance with the read / unread status, importance, and emotion of the received mail in the screen display when the e-mail application is executed. I decided to let them. That is, the display data element acquisition unit 33 acquires the read / unread state, importance, emotion, and the like of the received mail as index information, and vibrates the display unit 11 according to the number of cases acquired by the vibration control unit 35. For this reason, it is possible to intuitively identify emails that the user is interested in. In addition, since the identified mail can be opened immediately by tapping, the mail that the user is interested in can be referred to by a simple operation.

(Embodiment 5)
The fifth embodiment will be described below with reference to the drawings. In the present embodiment, an example of a screen image and vibration feedback in the electronic device 1 shown in the first embodiment will be mainly described. In particular, in the present embodiment, an example in which an application program for reproducing a moving image or an image (still image) is executed will be described.

FIG. 16A shows a display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment, and FIG. 16B shows a vibration pattern example for a user operation on the display unit 11. FIG. 16A is a display example of an application for reproducing a moving image, for example.

For example, when the user starts an application for reproducing a moving image (or accesses a moving image site), a moving image reproduction screen 261 is displayed as shown in FIG. Further, a timeline bar 262 indicating the reproduction time of the moving image being reproduced, and a comment graph 263 indicating the number of comments at the time corresponding to the timeline bar 262 are displayed. That is, the control unit 17 executes an application program for reproducing a moving image, and displays a comment included in the moving image data and a comment acquired from the server on the display unit 11.

16A is controlled so as to vibrate with a vibration pattern corresponding to each time of the timeline as shown in FIG. 16B with respect to the screen display of FIG. That is, in this example, as the numerical information, vibration feedback is performed with a strength corresponding to the number of comments at each playback time of the moving image. The control unit 17 acquires the number of comments at the playback time specified by the user's flick operation, and controls the vibration unit 16 to vibrate with a strength according to the acquired number of comments.

When the user performs a flick operation on the display unit 11 as indicated by an arrow 264, the control unit 17 controls the vibration unit 16 according to the number of comments in the comment graph 263 corresponding to the time on the timeline bar 262 touched by the user's finger. Vibrate. In the example of FIG. 16B, when the user touches time t1 on the timeline bar 262 of the display unit 11, the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the number of comments “100” at time t1. Then, when the user touches the time t2 of the timeline bar 262, the control unit 17 vibrates the vibration unit 16 with the strength corresponding to the number of comments “200” at the time t2, and the user at the time t3 of the timeline bar 262. Touches, the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the number of comments “50” at time t3. Thereby, since it vibrates according to the number of comments at each time of the moving image, it is possible to intuitively grasp the portion of the moving image that is interesting or interested by other users.

FIG. 17A shows another display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment, and FIG. 17B shows an example of a vibration pattern for a user operation on the display unit 11. . FIG. 17A is a display example of an application for reproducing an image (still image), for example.

For example, when the user activates an image playback application (or accesses an image browsing site), a plurality of image icons 271 are displayed as shown in FIG. Furthermore, a star icon 272 indicating the favorite score of the image is displayed on each image icon 271. That is, the control unit 17 executes an application program for image reproduction, and displays the favorite score included in the image data on the display unit 11.

17A is controlled so as to vibrate with a vibration pattern corresponding to each image icon 271 as shown in FIG. That is, in this example, vibration feedback is performed as numerical information with a strength corresponding to the number of favorite points of each image icon 271. The control unit 17 acquires the favorite score of the image icon 271 designated by the user's flick operation, and controls the vibrating unit 16 to vibrate with the strength according to the acquired favorite score.

When the user performs a flick operation on the display unit 11 as indicated by an arrow 273, the control unit 17 vibrates the vibration unit 16 according to the number of star icons 272 of the image icon 271 touched by the user's finger. In the example of FIG. 17B, when the user touches the first image icon 271 from the lower left side of the display unit 11, the control unit 17 has the strength corresponding to the number “1” of the star icons 272 and the vibration unit 16. When the user touches the second image icon 271 from the lower left side of the display unit 11, the control unit 17 vibrates the vibration unit 16 with the strength corresponding to the number “2” of the star icons 272, and displays it. When the user touches the third image icon 271 from the lower left side of the unit 11, the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the number “3” of the star icons 272. Thereby, since it vibrates according to the favorite score of each image, it can grasp | ascertain intuitively an image with much interest and interest by a user.
The number of comments shown in FIG. 16 and the number of favorites shown in FIG. 17 are not limited to the index that can identify the video, voice, and still image, such as the volume of the sound and the shooting location of the still image, the shooting date and time. Vibration control may be performed.

As described above, in the present embodiment, the display unit 11 (touch panel 12) is displayed according to the number of comments at each playback time of a moving image or the number of favorite points of an image in screen display when a moving image or image playback application is executed. ) Was vibrated. That is, the display data element acquisition unit 33 acquires the number of comments and the score as index information, and vibrates the display unit 11 according to the number of cases acquired by the vibration control unit 35. For this reason, it is possible to intuitively identify a moving image portion or an image that has a lot of interest or interest by the user. Further, since the identified moving image or image can be played back immediately after being tapped, it is possible to refer to a website in which the user is interested with a simple operation.

Note that the present invention is not limited to the above-described embodiment, and can be changed as appropriate without departing from the spirit of the present invention.
Further, a part or all of the above embodiment can be described as in the following supplementary notes, but is not limited thereto.

(Appendix 1)
A display unit for displaying application data processed by the application program;
An operation detection unit that detects a contact operation on any of the plurality of objects included in the displayed application data;
A vibration part that generates vibration;
An electronic apparatus comprising: a control unit that controls the vibration unit based on index information included in the object when a contact operation on the object is detected.

(Appendix 2)
When the control unit detects a touch operation on the object, the control unit acquires index information corresponding to the object.
The electronic device according to attachment 1.

(Appendix 3)
The indicator information includes numerical information related to the object,
The electronic device according to attachment 2.

(Appendix 4)
The control unit displays an index corresponding to the index information in association with the object;
The electronic device according to attachment 3.

(Appendix 5)
The index information is analysis information obtained by analyzing the application data.
The electronic device according to any one of appendices 1 to 4.

(Appendix 6)
The application data is website information including a website link,
The electronic device according to any one of appendices 1 to 5.

(Appendix 7)
The application data is website information including a website link;
The numerical information includes the number of accesses to the website.
The electronic device according to attachment 3.

(Appendix 8)
The application data is website information including a website link;
The numerical information includes the number of search keyword hits for the website,
The electronic device according to attachment 3.

(Appendix 9)
The application data is website information including a website link;
The numerical information includes an evaluation number or an evaluation score evaluated by a user referring to the website.
The electronic device according to attachment 3.

(Appendix 10)
The application data is website information including a website link;
The numerical information includes the number of comments posted to the website.
The electronic device according to attachment 3.

(Appendix 11)
The application data is website information including a website link;
The numerical information includes the number of bookmarks in which the website is registered as a bookmark.
The electronic device according to attachment 3.

(Appendix 12)
The application data is an email transmitted or received by the electronic device.
The electronic device according to any one of appendices 1 to 5.

(Appendix 13)
The index information includes read / unread status information indicating whether or not the electronic mail has been browsed.
The electronic device according to attachment 12.

(Appendix 14)
The index information includes importance information indicating an importance level of the email,
The electronic device according to appendix 12 or 13.

(Appendix 15)
The indicator information includes emotion information obtained by analyzing the content of the email, and indicating emotion of the email.
The electronic device according to any one of appendices 12 to 14.

(Appendix 16)
The application data is video or audio data that is reproduced by a video or audio reproduction program.
The electronic device according to any one of appendices 1 to 5.

(Appendix 17)
The application data is video or audio data that is reproduced by a video or audio reproduction program,
The numerical information includes the number of comments posted at the playback time of the video or audio data.
The electronic device according to attachment 3.

(Appendix 18)
The application data is still image data displayed by a still image display program.
The electronic device according to any one of appendices 1 to 5.

(Appendix 19)
The application data is still image data displayed by a still image display program,
The numerical information includes an evaluation number or an evaluation score evaluated by a user who refers to the still image data.
The electronic device according to attachment 3.

The present invention has been described above with reference to the embodiment, but the present invention is not limited to the above. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the invention.

This application claims priority based on Japanese Patent Application No. 2012-150443 filed on July 4, 2012, the entire disclosure of which is incorporated herein.

DESCRIPTION OF SYMBOLS 1 Electronic device 10 Display module 11 Display part 12 Touch panel 13 Camera 14 Microphone 15 Speaker 16 Vibration part 17 Control part 18 Storage part 19 Wireless communication part 20 Case 31 Operation detection part 32 Application part 33 Display data element acquisition part 34 Display data analysis Unit 35 vibration control unit 100 electronic device 101 display unit 102 operation detection unit 103 control unit 104 vibration unit

Claims (11)

1. Display means for displaying application data processed by the application program;
   An operation detecting means for detecting a contact operation on any of the plurality of objects included in the displayed application data;
   Vibration means for generating vibration;
   An electronic apparatus comprising: a control unit that controls the vibration unit based on index information included in the object when a contact operation on the object is detected.
2. When the control means detects a contact operation on the object, the control means acquires index information corresponding to the object.
   The electronic device according to claim 1.
3. The indicator information includes numerical information related to the object,
   The electronic device according to claim 2.
4. The control means displays an index corresponding to the index information in association with the object;
   The electronic device according to claim 3.
5. The index information is analysis information obtained by analyzing the application data.
   The electronic device as described in any one of Claims 1 thru | or 4.
6. The application data is a posted message posted by a user using a social network service.
   The electronic device as described in any one of Claims 1 thru | or 5.
7. The application data is a posted message posted by a user using a social network service,
   The numerical information includes the number of evaluations or evaluation points that the user evaluated the posted message,
   The electronic device according to claim 3.
8. The application data is a posted message posted by a user using a social network service,
   The numerical information includes the number of comments posted by the user for the posted message.
   The electronic device according to claim 3.
9. The application data is a posted message posted by a user using a social network service,
   The numerical information includes the number of reposts that the user has reposted the post message.
   The electronic device according to claim 3.
10. Display the application data processed by the application program on the display means,
    Detecting a touch operation on any of a plurality of objects included in the displayed application data;
    When a contact operation on the object is detected, vibration means for generating vibration is controlled based on index information included in the object.
    Control method of electronic equipment.
11. A non-transitory computer-readable medium storing a control program for causing a computer to execute control processing of an electronic device,
    Display the application data processed by the application program on the display means,
    Detecting a touch operation on any of a plurality of objects included in the displayed application data;
    When a contact operation on the object is detected, vibration means for generating vibration is controlled based on index information included in the object.
    A non-transitory computer readable medium storing a control program for an electronic device.

Images