WO2014006797A1 - Dispositif électronique, procédé de commande associé et support non temporaire lisible par un ordinateur contenant un programme de commande - Google Patents

Dispositif électronique, procédé de commande associé et support non temporaire lisible par un ordinateur contenant un programme de commande Download PDF

Info

Publication number
WO2014006797A1
WO2014006797A1 PCT/JP2013/002130 JP2013002130W WO2014006797A1 WO 2014006797 A1 WO2014006797 A1 WO 2014006797A1 JP 2013002130 W JP2013002130 W JP 2013002130W WO 2014006797 A1 WO2014006797 A1 WO 2014006797A1
Authority
WO
WIPO (PCT)
Prior art keywords
vibration
user
unit
display
electronic device
Prior art date
Application number
PCT/JP2013/002130
Other languages
English (en)
Japanese (ja)
Inventor
内田　薫
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Publication of WO2014006797A1 publication Critical patent/WO2014006797A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/014—Force feedback applied to GUI

Definitions

  • the present invention relates to an electronic device, a control method thereof, and a non-transitory computer readable medium storing a control program, and more particularly, to an electronic device that controls vibration of a display unit, a control method thereof, and a non-temporary computer program storing a control program. Relates to a typical computer readable medium.
  • Patent Documents 1 to 3 describe technologies related to SNS.
  • Such an electronic device includes a touch panel that detects a user's touch operation (contact operation) on the display screen.
  • Patent Document 4 describes a technique for vibrating a screen according to a user's operation on a touch panel and performing tactile feedback to the user.
  • An object of the present invention is to provide a non-transitory computer-readable medium in which an electronic device that solves such a problem, a control method thereof, and a control program are stored.
  • An electronic device generates vibrations, a display unit that displays application data processed by an application program, an operation detection unit that detects a touch operation on any of a plurality of objects included in the displayed application data, and And a control unit that controls the vibration unit based on index information included in the object when a contact operation on the object is detected.
  • the method for controlling an electronic device displays application data processed by an application program on a display unit, detects a touch operation on any of a plurality of objects included in the displayed application data, and touches the object.
  • a vibration unit that generates vibration is controlled based on index information included in the object.
  • a non-transitory computer-readable medium storing an electronic device control program according to the present invention is a control program for causing a computer to execute control processing of an electronic device, and displays application data processed by the application program. Vibration that generates a vibration based on index information included in the object when a contact operation on any of the plurality of objects included in the displayed application data is detected and a contact operation on the object is detected. The part is controlled.
  • an electronic device that allows the user to intuitively understand the contents of application data, a control method thereof, and a non-transitory computer-readable medium storing a control program.
  • FIG. 1 is a configuration diagram illustrating an external configuration of an electronic device according to a first embodiment.
  • 1 is a configuration diagram illustrating an external configuration of an electronic device according to a first embodiment.
  • 3 is a configuration diagram illustrating a configuration of a display module according to Embodiment 1.
  • FIG. 3 is a configuration diagram illustrating a configuration of a display module according to Embodiment 1.
  • FIG. 3 is a configuration diagram illustrating a configuration of a display module according to Embodiment 1.
  • FIG. 3 is a configuration diagram illustrating a configuration of a hardware block of the electronic device according to the first embodiment.
  • FIG. 3 is a configuration diagram showing a functional block configuration of the electronic device according to the first embodiment.
  • FIG. 4 is a waveform diagram showing a vibration pattern of the electronic device according to the first embodiment.
  • FIG. 4 is a waveform diagram showing a vibration pattern of the electronic device according to the first embodiment.
  • FIG. 4 is a waveform diagram showing a vibration pattern of the electronic device according to the first embodiment.
  • FIG. 4 is a waveform diagram showing a vibration pattern of the electronic device according to the first embodiment.
  • 3 is a flowchart illustrating a method for controlling the electronic device according to the first embodiment.
  • 10 is an image diagram of a display screen displayed on the display unit according to Embodiment 2.
  • FIG. 10 is an image diagram of a display screen displayed on the display unit according to Embodiment 2.
  • FIG. 10 is an image diagram of a display screen displayed on the display unit according to Embodiment 2.
  • FIG. 10 is an image diagram of a display screen displayed on the display unit according to Embodiment 2.
  • FIG. 10 is an image diagram of a display screen displayed on a display unit according to Embodiment 3.
  • FIG. 10 is an image diagram of a display screen displayed on a display unit according to Embodiment 3.
  • FIG. 10 is an image diagram of a display screen displayed on a display unit according to Embodiment 4.
  • FIG. 10 is an image diagram of a display screen displayed on a display unit according to Embodiment 4.
  • FIG. 10 is an image diagram of a display screen displayed on a display unit according to a fifth embodiment.
  • FIG. 10 is an image diagram of a display screen displayed on a display unit according to a fifth embodiment.
  • an electronic device 100 includes a display unit 101, an operation detection unit 102, a control unit 103, and a vibration unit 104.
  • the display unit 101 displays application data processed by the application program
  • the operation detection unit 102 detects a user's touch operation on any of the plurality of objects included in the displayed application data
  • the control unit 103 The main feature of the present invention is to control the vibration unit 104 that generates vibration based on the index information included in the object when a contact operation is detected.
  • the vibration unit 16 vibrates according to the index related to the application data, and tactile feedback is performed to the user. For this reason, the user can grasp
  • FIG. 2A is a front external view of electronic device 1 according to the present embodiment
  • FIG. 2B is a side external view thereof.
  • the electronic device 1 is an electronic device that can be carried by a user, such as a smartphone, a tablet-type mobile terminal device, a mobile phone, a game machine, or an electronic book terminal.
  • the electronic device may be an electronic device that allows a user to perform a touch operation (contact operation) on the display screen, and may be a computer device such as a personal computer.
  • the electronic apparatus 1 includes a display module 10 disposed on the main surface and a housing 20 disposed on the back surface.
  • the casing 20 has a concave cross section, and is fixedly arranged so as to cover the entire back surface of the display module 10.
  • the main surface is a surface facing the user side in the electronic device 1 in a state of being gripped by the user, and is an input / output surface that mainly performs input / output with the user, that is, a GUI (Graphical User) Interface) and the like, and an operation surface on which a user performs an input operation.
  • the back surface is a surface opposite to the main surface in the electronic device 1.
  • the display module 10 includes a display unit (display screen) 11 that displays a GUI and the like, and a touch panel 12 on which a user performs an input operation.
  • the display module 10 (the main surface of the electronic device 1) includes a camera 13 for imaging the user and the like, a microphone 14 for inputting sound and the like, and a speaker 15 for outputting sound and the like.
  • a GUI object
  • processing function
  • FIG. 3A is a front view of the display module 10 according to the present embodiment
  • FIG. 3B is a side view thereof.
  • the display module 10 includes a display unit 11 and a touch panel 12 disposed on the surface side (main surface side) of the display unit 11.
  • the display unit 11 is bonded to the center of the back surface (back surface) of the touch panel 12 with an adhesive or the like, and the surface area of the display unit 11 that the user visually recognizes via the touch panel 12 becomes a display region (display screen). .
  • a vibration unit 16 is disposed at one end of the back surface of the touch panel 12.
  • the vibration unit 16 is bonded to the touch panel 12 with an adhesive or the like.
  • the vibration unit 16 is a haptic element for providing haptic feedback to the user. As shown in FIGS. 3A and 3B, by providing the display module 10 with the vibration unit 16, vibration according to an operation on the touch panel 12 can be transmitted to the user.
  • one vibration unit 16 may be disposed in the display module 10, or a plurality of vibration units 16 may be disposed in the display module 10 as illustrated in FIG.
  • FIG. 4 shows an example in which four vibration parts 16 a to 16 d are arranged, and the vibration parts 16 a to 16 d are arranged near the corners of the display unit 11, respectively.
  • the vibration can be accurately transmitted to the user by one vibration unit as shown in FIGS. 3A and 3B.
  • the screen size of the display unit 11 is large, a plurality of vibration units are arranged as shown in FIG. 4, and the vibration unit close to the area operated by the user is vibrated, so that the user can vibrate according to the operation position. Can be accurately conveyed.
  • FIG. 5 shows a hardware block configuration of the electronic apparatus 1 according to the present embodiment.
  • the electronic device 1 includes a display unit 11, a touch panel 12, a camera 13, a microphone 14, a speaker 15, and a vibration unit 16 as in FIGS. 2A and 2B to 4, and further includes a control unit.
  • the control unit 17 is a control unit that controls the operation of each unit, such as a CPU.
  • the control unit 17 executes a control program and an application program stored in the storage unit 18 and controls an output operation such as a display according to an input operation and each program.
  • the wireless communication unit 19 is a communication unit for performing wireless communication with a base station and other communication devices.
  • the wireless communication unit 19 transmits and receives audio signals for calls and the like, and transmits and receives application data and the like that are processed and displayed by an application program. In addition, you may perform not only wireless but wired communication and other communication control.
  • the display unit 11 is a display such as a liquid crystal display or an organic EL display.
  • the display unit 11 displays a GUI such as an icon or a list of application data in accordance with an instruction from the control unit 17.
  • the touch panel 12 is affixed to the display unit 11 as illustrated in FIGS. 3A and 3B and detects a user's touch operation (contact operation) on the display unit 11.
  • the touch panel 12 detects the position on the display unit 11 touched by the user's finger using capacitance or the like, and outputs a signal indicating the detected position to the control unit 17.
  • the vibration unit 16 is attached to the touch panel 12 as shown in FIGS. 3A and 3B, and performs tactile feedback to the user by vibration.
  • the vibration unit 16 is a piezoelectric element or the like, is supplied with a control signal according to a user operation from the control unit 17, and vibrates the touch panel 12 (display unit) with strength or length based on the control signal.
  • the camera 13 is an image pickup device that picks up an image of a user or an image pickup device arranged on the back surface of the electronic device 1. Image data obtained by capturing a still image or a moving image with the camera 13 is output to the control unit 17. The control unit 17 displays the image data on the display unit 11 or stores it in the storage unit 18.
  • the microphone 14 inputs a voice from the user, and the speaker 15 outputs a voice or the like to the user. For example, a sound signal corresponding to the sound input from the user is transmitted to the microphone 14 via the wireless communication unit 19, and a sound corresponding to the sound signal received by the wireless communication unit 19 is output from the speaker 15 to the user.
  • the storage unit 18 is a storage unit such as a flash memory, and stores information necessary for the operation of the control unit 17 and each unit.
  • the storage unit 18 stores a control program executed by the control unit 17, an application program, application data, and the like.
  • FIG. 6 shows a functional block configuration realized by the control unit 17 of the electronic apparatus 1 according to the present embodiment.
  • the control unit 17 includes an operation detection unit 31, an application unit 32, a display data element acquisition unit 33, a display data analysis unit 34, and a vibration control unit 35.
  • the functional blocks in FIG. 6 are examples, and other block configurations may be used as long as a control operation according to the present embodiment described later with reference to FIG. 8 can be realized.
  • the application unit 32, the display data element acquisition unit 33, the display data analysis unit 34, and the vibration control unit 35 may be a single control unit.
  • Each block (functional unit or processing unit) in FIG. 6 may be configured by hardware, software, or both.
  • each block of the control unit 17 is realized by executing a control program for performing a control operation according to the present embodiment on a CPU (computer).
  • the program can be stored and provided to a computer using various types of non-transitory computer readable media.
  • Non-transitory computer readable media include various types of tangible storage media.
  • non-transitory computer-readable media examples include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (for example, magneto-optical disks), CD-ROM (Read Only Memory) CD-R, CD -R / W, including semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)).
  • the program may also be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves.
  • the temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.
  • the operation detection unit 31 receives a user's touch operation through the touch panel 12 and detects what operation has been performed.
  • the operation detection unit 31 receives a position signal corresponding to the operation from the touch panel 12 and detects a user operation on the list or icon.
  • the operation detection unit 31 detects a flick operation, a drag operation, a tap operation, a double tap operation, a pinch-in operation, a pinch-out operation, and the like according to a user operation on the touch panel 12, and notifies each unit that an input operation has been detected. To do.
  • the application unit 32 executes an application program and executes processing according to the application program.
  • the application unit 32 outputs and displays display data including a part of application data processed by the application program on the display unit 11. For example, the application unit 32 displays a list of a plurality of application data (display data).
  • the application unit 32 executes processing according to a user operation input via the operation detection unit 31 and displays the execution result on the display unit 11. For example, the application unit 32 displays detailed data of a selected item (display data) in the list in response to a user operation on the list display.
  • the display data element acquisition unit 33 acquires element information (index information) of the operated display data in response to a user operation on the display data displayed on the display unit 11.
  • the display data element acquisition unit 33 acquires, from the application unit 32, element information of display data that is a target of the user operation, in response to a user operation input via the operation detection unit 31. For example, a list of display data is displayed as a list on the display unit 11, and when the user performs a touch operation on the list display, an element of an item (display data) in the list touched by the user is acquired.
  • the element information of display data is index information for the user to identify application data (display data).
  • the element information of the display data is information for identifying data that the user is interested in. If the element information is larger, the user's interest is higher, and if the element information is smaller, the user's interest is greater. Means low interest.
  • the element information of the display data is also guidance information for causing the user to identify the application data and guiding the user to the next operation.
  • the display data analysis unit 34 analyzes the operated display data according to the data operation on the display data displayed on the display unit 11, and generates analysis information.
  • the display data analysis unit 34 analyzes the element information acquired by the display data element acquisition unit 33 and generates analysis information for vibrating the vibration unit 16. Further, the display data analysis unit 34 acquires detailed information of display data that is a target of user operation from the application unit 32, analyzes the acquired detailed information, and generates analysis information.
  • the display data analysis unit 34 performs text analysis, image analysis, etc. on element information and detailed information, extracts features of the display data, and generates analysis information to allow the user to identify the features.
  • the vibration control unit 35 controls the vibration of the vibration unit 16 according to the index of the operated display data.
  • the vibration control unit 35 vibrates the vibration unit 16 according to the element information acquired by the display data element acquisition unit 33.
  • the vibration control unit 35 vibrates the vibration unit 16 according to the display data analysis information analyzed by the display data analysis unit 34.
  • the vibration control unit 35 causes the vibration unit 16 to vibrate more as the element information or analysis information is larger, and causes the vibration unit 16 to vibrate smaller as the element information or analysis information is smaller.
  • the vibration control unit 35 controls the vibration pattern of the vibration unit 16 according to the element information (analysis information) of the display data.
  • 7A to 7D show an example of a vibration pattern of the vibration unit 16 controlled by the vibration control unit 35.
  • FIG. For example, as the vibration pattern control, the vibration level, vibration time, vibration cycle, vibration rhythm, and the like are switched in a plurality of stages according to display data.
  • more vibration patterns may be generated by combining the strength of vibration, the time for vibration, the period of vibration, the rhythm of vibration, and the like.
  • control the vibration level (strength) more strongly, control the vibration time longer, control the vibration cycle shorter, and control the rhythm tempo faster.
  • Including any or a combination of To control vibration smaller, control vibration level (intensity) weaker, control vibration time shorter, control vibration period longer, control vibration rhythm tempo slower. Any one or combination.
  • FIG. 7A is an example in which the strength of the vibration level is controlled in two stages. For example, when the element information of the display data is large, the maximum level of the vibration pattern is increased to control to vibrate more strongly (a-1), and when the element information of the display data is small, the vibration pattern The maximum level is reduced to control to vibrate weaker (a-2).
  • FIG. 7B is an example in which the length of vibration time is controlled in two stages. For example, when the element information of the display data is large, the vibration pattern period is lengthened and controlled to vibrate longer (b-1). When the element information of the display data is small, the period of the vibration pattern Is controlled so as to vibrate shorter (b-2).
  • FIG. 7C is an example in which the period (frequency) of the vibration pattern is controlled in two stages. For example, when the element information of the display data is large, control is performed so that the vibration pattern period is shortened to vibrate faster (c-1). When the element information of the display data is small, the period of the vibration pattern is controlled. And control to vibrate more slowly (c-2).
  • FIG. 7D is an example in which the rhythm of the vibration pattern is controlled in two stages. For example, when the element information of the display data is large, control is performed so that the rhythm of the vibration pattern is 2 beats at a time, so that it vibrates much at a faster tempo (d-1), and when the element information of the display data is small, The vibration pattern rhythm is controlled by one beat at a time so as to vibrate less at a slower tempo (d-2).
  • FIG. 8 shows a control operation (control method) for tactile feedback of the electronic apparatus 1 according to the present embodiment.
  • an icon for an application program is displayed on the display unit 11 of the electronic device 1.
  • the execution of the application program is started and the following processing is executed.
  • the application unit 32 displays a list of display data including a part of the application data on the display unit 11 according to the application program (S101).
  • the application unit 32 accesses a server or the like via the wireless communication unit 19 and also accesses a database or the like in the storage unit 18 to acquire a plurality of display data according to a user operation and display the acquired display data
  • a list is displayed in the section 11.
  • the display data is not limited to the list format and may be displayed in an arbitrary format.
  • the operation detection unit 31 detects a user operation input to the touch panel 12 (S102).
  • the operation detection unit 31 detects a user operation on the list of display data displayed on the display unit 11.
  • the operation detection unit 31 receives a user operation from the touch panel 12, and whether the user operation is a list scroll operation for scrolling the list, a list tactile operation for tactile feedback, or an item included in the list It is determined whether or not the operation is a list item selection operation for selecting (display data).
  • the operation detection unit 31 detects an arbitrary touch pattern and causes each unit to perform an operation corresponding to the touch pattern.
  • the list scroll operation is a drag operation on the list
  • the list tactile operation is a flick operation on the list
  • the list item selection operation is a tap operation on the list item.
  • the application unit 32 scrolls and displays the list according to the user operation (S103). For example, when the user performs a drag operation on the displayed list, the operation detection unit 31 determines that the operation is a list scroll operation, and the application unit 32 scrolls and displays the list according to the user operation.
  • the display data element acquisition unit 33 acquires list item information (element information) from the application unit 32 (S104). For example, when the user performs a flick operation on the displayed list, the operation detection unit 31 determines that the operation is a list tactile operation, and the display data element acquisition unit 33 displays the list item operated by the user ( Element information of (display data) is acquired from the application unit 32. Specifically, the operation detection unit 31 acquires element information of the items in the list specified by the position where the operation is accepted in the flick operation from the application unit 32.
  • the display data analysis unit 34 further analyzes the item information of the list that has received the operation for vibration feedback (S105).
  • the display data analysis unit 34 analyzes the element information of the list item operated by the user acquired in S104, acquires the detailed information of the list item operated by the user from the application unit 32, and performs vibration. Generate analysis information for feedback.
  • the element information may be information including numerical information.
  • the analysis of the display data can be omitted if the vibration is controlled by the element information of the application program.
  • the vibration control unit 35 vibrates the vibration unit 16 according to the contents of the list item information (S106).
  • the vibration control unit 35 performs vibration of the vibration unit 16 according to the element information of the list item (display data) acquired in S104, the numerical information included in the element information, or the analysis information of the list item (display data) analyzed in S105.
  • the vibration control unit 35 selects the size of the vibration pattern as shown in FIGS. 7A to 7D according to the size of the element information (analysis information) of the display data, and sends the control signal of the selected vibration pattern to the vibration unit 16. Output to.
  • the vibration control unit 35 causes the vibration unit 16 to vibrate more as the numerical information of the display data is larger, and vibrates the vibration unit 16 smaller as the numerical information is smaller. Further, when the flick operation continues, steps S104 to S106 are repeated, and vibration control is performed in the order of display data that the user touches.
  • the application unit 32 displays detailed information on the item (display data) selected according to the user operation (S107). For example, when the user performs a tap operation on an item in the displayed list, the operation detection unit 31 determines that the operation is a list item selection operation, and the application unit 32 details the item (display data) selected by the user. Various contents are displayed on the display unit 11.
  • display data corresponding to an application is displayed on the display unit of the electronic device, and when the user performs a touch operation on the display data, vibration feedback corresponding to the index of the display data is performed. Therefore, the user can intuitively grasp the contents of the display data.
  • a list of multiple display data of the application is displayed, and when the user performs a flick operation, etc., by controlling vibration for each display data, it is possible to intuitively identify display data with strong interest and interest. Data can be referenced immediately with a simple operation.
  • FIG. 9A shows a display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment
  • FIG. 9B shows a vibration pattern example for a user operation on the display unit 11.
  • FIG. 9A is an example of a timeline display of Facebook (registered trademark) which is an SNS, for example.
  • each message 201 displays a part of the poster's image and posted content, and further displays the number of “likes” registered 202. That is, the control unit 17 executes the Facebook application program and displays a message acquired from the Facebook server on the display unit 11.
  • the screen display of FIG. 9A is controlled to vibrate with a vibration pattern corresponding to each message 201 as shown in FIG. 9B. That is, in this example, as the numerical information, vibration feedback is performed with the strength corresponding to the number of “like” registrations 202 of each message 201.
  • the control unit 17 acquires the “like!” Registration number 202 of the message 201 specified by the user's flick operation, and vibrates so as to vibrate at a strength corresponding to the acquired “like” registration number 202.
  • the unit 16 is controlled. Note that vibration control may be performed according to the number of “Like” registrations 202 without displaying the “Like” registrations 202 on the screen.
  • vibration control may be performed according to index information without displaying index information including numerical information.
  • the control unit 17 When the user performs a flick operation by bringing the finger into contact with the display unit 11 as indicated by the arrow 203, the control unit 17 performs the vibration unit 16 according to the number of “like!” Registrations 202 of the message 201 touched by the user's finger. Vibrate. In the example of FIG. 9B, when the user touches the first message 201 from the top of the display unit 11, the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the number of registrations “2”.
  • the control unit 17 vibrates the vibration unit 16 with the strength corresponding to the registered number “10”, and when the user touches the third message 201 from the top, the control unit 17 17 vibrates the vibration unit 16 with a strength corresponding to the registered number “5”.
  • the control unit 17 17 vibrates the vibration unit 16 with a strength corresponding to the registered number “5”.
  • FIG. 10 is another example of the Facebook timeline display of FIG.
  • the control unit 17 displays a timeline display area 200a and a tactile area 200b on the display screen of the display unit 11.
  • the same timeline display as in FIG. 9A is performed.
  • the haptic area 200b is an operation area for haptic feedback.
  • the control unit 17 When the user performs a flick operation on the tactile area 200b as indicated by an arrow 204, the control unit 17 responds to the number of “like!” Registrations 202 of the message 201 that contacts the tactile area 200b touched by the user's finger. Vibrate.
  • the vibration pattern is the same as in FIG. As shown in FIG. 10, by providing a region for tactile operation, an operation for tactile feedback can be performed using a touch pattern used in timeline display.
  • FIG. 11A is another display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment, and FIG. 11B shows an example of a vibration pattern for a user operation on the display unit 11.
  • FIG. 11A is an example of a timeline display of Twitter (registered trademark) which is an SNS, for example.
  • a short message 211 posted in chronological order is displayed as shown in FIG.
  • Each short message 211 displays an image of the poster and part of the posted content, and further displays the number 212 of retweets. That is, the control unit 17 executes a Twitter application program and displays a short message acquired from the Twitter server on the display unit 11.
  • Control is performed so that the screen display of FIG. 11A vibrates with a vibration pattern corresponding to each short message 211 as shown in FIG. 11B. That is, in this example, as the numerical information, vibration feedback is performed with the strength corresponding to the number of retweets 212 of each short message 211.
  • the control unit 17 acquires the number of retweets 212 of the short message 211 specified by the user's flick operation, and controls the vibration unit 16 to vibrate with a strength according to the acquired number of retweets 212.
  • the control unit 17 vibrates the vibration unit 16 according to the number of retweets 212 of the short message 211 touched by the user's finger.
  • the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the number of retweets “10”.
  • the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the number of retweets “5”, and when the user touches the third short message 211 from the top.
  • the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the registered number “100”. Thereby, since it vibrates according to the number of retweets of each message, it is possible to intuitively grasp messages of interest and interest by other users.
  • vibration control may be performed according to an index that can identify a message, such as the number of comments, as well as the number of “Like” in FIG. 9 and the number of retweets in FIG.
  • the display unit 11 in the screen display when an SNS application such as Facebook or Twitter is executed, the display unit 11 (in accordance with the number of “likes”, the number of retweets, the number of comments, etc.
  • the touch panel 12 was vibrated. That is, the display data element acquisition unit 33 acquires the number of likes, the number of retweets, and the number of comments as index information, and vibrates the display unit 11 according to the number of cases acquired by the vibration control unit 35. For this reason, there are many interests and interests by other users, and it is possible to intuitively identify a message that is a topic. Further, since the identified message can be opened immediately by tapping, the message that the user is interested in can be referred to by a simple operation.
  • the user can recognize the excitement of the timeline of Twitter and Facebook by tactile feedback.
  • the screen vibrates when the user traces his / her finger on the timeline screen.
  • the number of comments Traces over “tweets / tweets”, which often have strong vibrations (or vibrations that give a feeling of excitement).
  • the control unit 17 determines that the operation position at the time of the flick operation by the operator is on the “tweet / tweet” with a large number of cases, and the numerical value included in the element information with respect to the vibration unit 16. This is because vibration based on information is performed.
  • the control part 17 vibrates proportionally with respect to numerical information, a vibration becomes so strong that there are many cases. Rather than visually confirming it, it is easier to grasp the reactions of other users to tweets / tweets by simply tracing the timeline with a finger.
  • FIG. 12A shows a display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment
  • FIG. 12B shows a vibration pattern example for a user operation on the display unit 11.
  • FIG. 12A is an example of a website search result display, for example.
  • the hit website information 222 is displayed in the order of the number of hits as shown in FIG.
  • Each website information 222 displays the title of the website and a part of the website, and further displays the number of hits 223 of the website and the number of accesses 224 recently accessed by the user. That is, the control unit 17 executes a website search application program and displays the search result of the website acquired from the server on the display unit 11.
  • the screen display of FIG. 12A is controlled to vibrate with a vibration pattern corresponding to each website information 222 as shown in FIG. That is, in this example, vibration feedback is performed as numerical information with a strength corresponding to the number of accesses 224 of each website information 222.
  • the control unit 17 acquires the number of accesses 224 of the website information 222 specified by the user's flick operation, and controls the vibration unit 16 to vibrate with a strength corresponding to the acquired number of accesses 224.
  • vibration control may be performed according to the number of hits 223 or other information.
  • the control unit 17 vibrates the vibration unit 16 according to the number of accesses 224 of the website information 222 touched by the user's finger.
  • the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the access count “1”.
  • the control unit 17 vibrates the vibration part 16 with the strength corresponding to the access count “2”, and the third website information 222 from the top
  • the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the access count “5”.
  • FIG. 13A shows another display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment, and FIG. 13B shows an example of a vibration pattern for a user operation on the display unit 11.
  • FIG. 13A is a display example of an introduction site that introduces a website of a recommended store, for example.
  • store information 231 of the store introduced by the introduction site as a recommendation is displayed.
  • Each store information 231 displays a store name and a part of the store website, and further displays a store evaluation score 232 and a store website bookmark number 233. That is, the control unit 17 executes the application program for the introduction site and displays recommended store information acquired from the server on the display unit 11.
  • the screen display of FIG. 13A is controlled so as to vibrate with a vibration pattern corresponding to each store information 231 as shown in FIG. 13B. That is, in this example, as the numerical information, vibration feedback is performed with the strength according to the evaluation score 232 and the bookmark number 233 of each store information 231.
  • the control unit 17 acquires the evaluation score 232 and the bookmark number 233 of the store information 231 designated by the user's flick operation, and vibrates at a strength corresponding to the acquired evaluation score 232 and bookmark number 233. 16 is controlled. Note that vibration control may be performed according to one of the evaluation score 232 or the bookmark number 233 as numerical information.
  • the control unit 17 vibrates the vibration unit 16 according to the evaluation score 232 and the bookmark number 233 of the store information 231 touched by the user's finger.
  • the control unit 17 vibrates with strength corresponding to the evaluation score “1” and the bookmark number “0”.
  • the control unit 17 vibrates the vibration unit 16 with the strength corresponding to the evaluation score “3” and the bookmark number “10”.
  • the control unit 17 causes the vibration unit 16 to vibrate with the strength corresponding to the evaluation score “3” and the bookmark number “100”.
  • the vibration unit 16 vibrates according to the evaluation score of each store and the number of bookmarks on the website, it is possible to intuitively grasp stores where the user is more interested and interested in consideration of a plurality of factors.
  • vibration control is performed according to an index that can identify a website, such as the number of comments and the number of reviews, as well as the number of hits and the number of accesses in FIG. 12, the number of evaluation points (evaluation number) in FIG. Also good.
  • the display unit 11 (touch panel) is displayed according to the number of hits, the number of accesses, the number of evaluation points, the number of bookmarks, and the number of comments. 12) was vibrated. That is, the display data element acquisition unit 33 acquires the number of hits of the website, the number of accesses, the number of evaluation points, the number of bookmarks, and the number of comments as index information, and displays the display unit 11 according to the number of cases acquired by the vibration control unit 35. Vibrate. For this reason, there are many interests and interests by other users, and it is possible to intuitively identify a website that is a topic. In addition, since the identified website can be opened immediately by tapping, the website that the user is interested in can be referred to with a simple operation.
  • FIG. 14A shows a display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment
  • FIG. 14B shows a vibration pattern example for a user operation on the display unit 11.
  • FIG. 14A is a display example that displays, for example, read / unread and importance of received mail.
  • received mails 241 are displayed in the order of received time series as shown in FIG.
  • Each received mail 241 displays a mail title, a sender, and a part of the mail, and further displays a read / unread state 241 and an importance 243. That is, the control unit 17 executes an e-mail application program and displays the mail acquired from the mail server on the display unit 11.
  • vibration feedback is performed with a strength corresponding to the read / unread state 241 and importance 243 of each received mail 241.
  • the control unit 17 acquires the read / unread state 241 and the importance level 243 of the received mail 241 specified by the user's flick operation, and has the strength according to the acquired read / unread state 241 and the importance level 243.
  • the vibration part 16 is controlled to vibrate.
  • the control unit 17 vibrates the vibration unit 16 according to the read / unread state 241 and the importance 243 of the received mail 241 touched by the user's finger.
  • the control unit 17 corresponds to the read / unread state “read” and the importance “low”.
  • the vibration unit 16 is vibrated with strength and the user touches the second received mail 241 from the top, the control unit 17 vibrates with the strength corresponding to the read / unread state “unread” and the importance “high”.
  • the control unit 17 vibrates the vibration unit 16 with the strength corresponding to the read / unread state “unread” and the importance “medium”. Let Thereby, since it vibrates according to the read / unread state and importance of each received mail, the received mail that the user is interested in can be intuitively grasped.
  • FIG. 15A is another display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment, and FIG. 15B shows an example of a vibration pattern in response to a user operation on the display unit 11.
  • FIG. 15A is a display example for displaying the emotion of the received mail, for example.
  • received mails 251 are displayed in the order of received time series as shown in FIG.
  • Each received mail 251 displays a mail title, a sender, a part of the mail, and an emotion icon 252. That is, the control unit 17 executes an e-mail application program and displays the mail acquired from the mail server and an emotion icon corresponding to the mail on the display unit 11.
  • the screen display of FIG. 15A is controlled to vibrate with a vibration pattern corresponding to each received mail 251 as shown in FIG. That is, in this example, vibration feedback is performed with a strength corresponding to the emotion of each received mail 251.
  • the control unit 17 acquires information indicating the emotion of the received mail 251 specified by the user's flick operation, and controls the vibration unit 16 to vibrate with a strength corresponding to the acquired information indicating the emotion.
  • the emotion of the received mail may be determined according to a text analysis of the received mail and according to a word expressing the emotion, or according to the type and number of pictograms.
  • the control unit 17 vibrates the vibration unit 16 according to the emotion of the emotion icon 252 of the received mail 251 touched by the user's finger.
  • the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the emotion icon 252 “surprise”.
  • the control unit 17 vibrates the vibration part 16 with a strength corresponding to the emotion icon 252 “fun”, and the user touches the third received mail 241 from the top.
  • the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the emotion icon 252 “like”.
  • the vibration control may be performed according to an index that can identify the mail, such as the address of the transmission source, without being limited to the read / unread state and importance of FIG. 14 and the emotion of FIG.
  • control is performed so as to vibrate strongly in the case of mail received from a partner who frequently sends and receives mail.
  • the transmitted mail may be controlled in the same manner.
  • the display unit 11 vibrates in accordance with the read / unread status, importance, and emotion of the received mail in the screen display when the e-mail application is executed. I decided to let them. That is, the display data element acquisition unit 33 acquires the read / unread state, importance, emotion, and the like of the received mail as index information, and vibrates the display unit 11 according to the number of cases acquired by the vibration control unit 35. For this reason, it is possible to intuitively identify emails that the user is interested in. In addition, since the identified mail can be opened immediately by tapping, the mail that the user is interested in can be referred to by a simple operation.
  • FIG. 16A shows a display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment
  • FIG. 16B shows a vibration pattern example for a user operation on the display unit 11.
  • FIG. 16A is a display example of an application for reproducing a moving image, for example.
  • a moving image reproduction screen 261 is displayed as shown in FIG. Further, a timeline bar 262 indicating the reproduction time of the moving image being reproduced, and a comment graph 263 indicating the number of comments at the time corresponding to the timeline bar 262 are displayed. That is, the control unit 17 executes an application program for reproducing a moving image, and displays a comment included in the moving image data and a comment acquired from the server on the display unit 11.
  • the control unit 17 acquires the number of comments at the playback time specified by the user's flick operation, and controls the vibration unit 16 to vibrate with a strength according to the acquired number of comments.
  • the control unit 17 controls the vibration unit 16 according to the number of comments in the comment graph 263 corresponding to the time on the timeline bar 262 touched by the user's finger. Vibrate.
  • the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the number of comments “100” at time t1.
  • the control unit 17 vibrates the vibration unit 16 with the strength corresponding to the number of comments “200” at the time t2, and the user at the time t3 of the timeline bar 262.
  • the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the number of comments “50” at time t3. Thereby, since it vibrates according to the number of comments at each time of the moving image, it is possible to intuitively grasp the portion of the moving image that is interesting or interested by other users.
  • FIG. 17A shows another display example of the display unit 11 in the electronic apparatus 1 according to the present embodiment, and FIG. 17B shows an example of a vibration pattern for a user operation on the display unit 11.
  • FIG. 17A is a display example of an application for reproducing an image (still image), for example.
  • a plurality of image icons 271 are displayed as shown in FIG. Furthermore, a star icon 272 indicating the favorite score of the image is displayed on each image icon 271. That is, the control unit 17 executes an application program for image reproduction, and displays the favorite score included in the image data on the display unit 11.
  • the control unit 17A is controlled so as to vibrate with a vibration pattern corresponding to each image icon 271 as shown in FIG. That is, in this example, vibration feedback is performed as numerical information with a strength corresponding to the number of favorite points of each image icon 271.
  • the control unit 17 acquires the favorite score of the image icon 271 designated by the user's flick operation, and controls the vibrating unit 16 to vibrate with the strength according to the acquired favorite score.
  • the control unit 17 vibrates the vibration unit 16 according to the number of star icons 272 of the image icon 271 touched by the user's finger.
  • the control unit 17 has the strength corresponding to the number “1” of the star icons 272 and the vibration unit 16.
  • the control unit 17 vibrates the vibration unit 16 with the strength corresponding to the number “2” of the star icons 272, and displays it.
  • the control unit 17 vibrates the vibration unit 16 with a strength corresponding to the number “3” of the star icons 272. Thereby, since it vibrates according to the favorite score of each image, it can grasp
  • the number of comments shown in FIG. 16 and the number of favorites shown in FIG. 17 are not limited to the index that can identify the video, voice, and still image, such as the volume of the sound and the shooting location of the still image, the shooting date and time. Vibration control may be performed.
  • the display unit 11 (touch panel 12) is displayed according to the number of comments at each playback time of a moving image or the number of favorite points of an image in screen display when a moving image or image playback application is executed. ) Was vibrated. That is, the display data element acquisition unit 33 acquires the number of comments and the score as index information, and vibrates the display unit 11 according to the number of cases acquired by the vibration control unit 35. For this reason, it is possible to intuitively identify a moving image portion or an image that has a lot of interest or interest by the user. Further, since the identified moving image or image can be played back immediately after being tapped, it is possible to refer to a website in which the user is interested with a simple operation.
  • Appendix 1 A display unit for displaying application data processed by the application program; An operation detection unit that detects a contact operation on any of the plurality of objects included in the displayed application data; A vibration part that generates vibration; An electronic apparatus comprising: a control unit that controls the vibration unit based on index information included in the object when a contact operation on the object is detected.
  • the indicator information includes numerical information related to the object, The electronic device according to attachment 2.
  • the control unit displays an index corresponding to the index information in association with the object;
  • the electronic device according to attachment 3.
  • the index information is analysis information obtained by analyzing the application data.
  • the electronic device according to any one of appendices 1 to 4.
  • the application data is website information including a website link, The electronic device according to any one of appendices 1 to 5.
  • the application data is website information including a website link;
  • the numerical information includes the number of accesses to the website.
  • the application data is website information including a website link;
  • the numerical information includes the number of search keyword hits for the website,
  • the application data is website information including a website link;
  • the numerical information includes an evaluation number or an evaluation score evaluated by a user referring to the website.
  • the application data is website information including a website link;
  • the numerical information includes the number of comments posted to the website.
  • the application data is website information including a website link;
  • the numerical information includes the number of bookmarks in which the website is registered as a bookmark.
  • the application data is an email transmitted or received by the electronic device.
  • the electronic device according to any one of appendices 1 to 5.
  • the index information includes read / unread status information indicating whether or not the electronic mail has been browsed.
  • the index information includes importance information indicating an importance level of the email, The electronic device according to appendix 12 or 13.
  • the indicator information includes emotion information obtained by analyzing the content of the email, and indicating emotion of the email.
  • the electronic device according to any one of appendices 12 to 14.
  • the application data is video or audio data that is reproduced by a video or audio reproduction program.
  • the electronic device according to any one of appendices 1 to 5.
  • the application data is video or audio data that is reproduced by a video or audio reproduction program,
  • the numerical information includes the number of comments posted at the playback time of the video or audio data.
  • the application data is still image data displayed by a still image display program.
  • the electronic device according to any one of appendices 1 to 5.
  • the application data is still image data displayed by a still image display program,
  • the numerical information includes an evaluation number or an evaluation score evaluated by a user who refers to the still image data.

Abstract

L'invention concerne un dispositif électronique (100) ayant ce qui suit : une unité d'affichage (101) qui affiche des données d'application traitées par un programme d'application ; une unité de détection d'action (102) qui détecte les actions de contact réalisées par un utilisateur sur un d'une pluralité d'objets contenus dans les données d'application affichées ; une unité de vibration (104) qui produit une vibration ; et une unité de commande (103) qui, lorsqu'une action de contact réalisée sur un objet est détectée, commande l'unité de vibration (104) en fonction des informations d'indice contenues dans ledit objet. Cela permet à l'utilisateur d'obtenir une sensation intuitive du contenu des données d'application.
PCT/JP2013/002130 2012-07-04 2013-03-28 Dispositif électronique, procédé de commande associé et support non temporaire lisible par un ordinateur contenant un programme de commande WO2014006797A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2012150443 2012-07-04
JP2012-150443 2012-07-04

Publications (1)

Publication Number Publication Date
WO2014006797A1 true WO2014006797A1 (fr) 2014-01-09

Family

ID=49881575

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/002130 WO2014006797A1 (fr) 2012-07-04 2013-03-28 Dispositif électronique, procédé de commande associé et support non temporaire lisible par un ordinateur contenant un programme de commande

Country Status (1)

Country Link
WO (1) WO2014006797A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014021882A (ja) * 2012-07-23 2014-02-03 Canon Inc 操作装置、その制御方法及びプログラム並びに記録媒体
WO2018105266A1 (fr) * 2016-12-05 2018-06-14 ソニー株式会社 Appareil de traitement d'informations, procédé de traitement d'informations, programme et système de traitement d'informations

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010128526A (ja) * 2008-11-25 2010-06-10 Canon Inc 電子機器
WO2011115829A1 (fr) * 2010-03-16 2011-09-22 Immersion Corporation Systèmes et procédés destinés à la prévisualisation d'informations haptiques

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010128526A (ja) * 2008-11-25 2010-06-10 Canon Inc 電子機器
WO2011115829A1 (fr) * 2010-03-16 2011-09-22 Immersion Corporation Systèmes et procédés destinés à la prévisualisation d'informations haptiques

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
YASUYUKI FUKATSU: "Site o Social Media ni Saitekika suru", WEB DESIGNING, vol. 11, no. 10, 1 October 2011 (2011-10-01), pages 66 - 69 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014021882A (ja) * 2012-07-23 2014-02-03 Canon Inc 操作装置、その制御方法及びプログラム並びに記録媒体
WO2018105266A1 (fr) * 2016-12-05 2018-06-14 ソニー株式会社 Appareil de traitement d'informations, procédé de traitement d'informations, programme et système de traitement d'informations
CN110023917A (zh) * 2016-12-05 2019-07-16 索尼公司 信息处理装置、信息处理方法、程序以及信息处理系统
JPWO2018105266A1 (ja) * 2016-12-05 2019-10-24 ソニー株式会社 情報処理装置、情報処理方法、プログラム、および情報処理システム
JP7067484B2 (ja) 2016-12-05 2022-05-16 ソニーグループ株式会社 情報処理装置、情報処理方法、プログラム、および情報処理システム

Similar Documents

Publication Publication Date Title
JP7377319B2 (ja) タッチ感知式セカンダリディスプレイにおいてユーザインタフェースコントロールを動的に提供するシステム、デバイス、及び方法
US11023120B1 (en) User interface mechanics
JP6492069B2 (ja) 環境を認識した対話ポリシーおよび応答生成
CN105009062B (zh) 浏览被显示为瓦块的电子消息
EP2901256B1 (fr) Procédé et dispositif d'affichage à rétroaction tactile
KR102084041B1 (ko) 펜 기능 운용 방법 및 시스템
KR101550520B1 (ko) 사용자 입력에 응답하는 커스텀 진동 패턴의 생성
US9652145B2 (en) Method and apparatus for providing user interface of portable device
CN104965843B (zh) 一种获取评论信息的方法及装置
CN105706428B (zh) 提供消息的方法以及支持所述方法的用户设备
US20130311881A1 (en) Systems and Methods for Haptically Enabled Metadata
US20170084273A1 (en) Automatic performance of user interaction operations on a computing device
CN106412282B (zh) 一种实时消息语音提示方法及移动终端
CN105359121A (zh) 使用接收数据的应用远程操作
CN105094661A (zh) 移动终端及其控制方法
US10156979B2 (en) Method and apparatus for providing user interface of portable device
JP6078375B2 (ja) 電子機器及び制御プログラム並びに電子機器の動作方法
WO2014006797A1 (fr) Dispositif électronique, procédé de commande associé et support non temporaire lisible par un ordinateur contenant un programme de commande
CN107193819A (zh) 用于网页预读的方法、设备、浏览器及客户端设备
US20140173428A1 (en) Electronic device and method for importing email onto editing interface thereof
KR102137489B1 (ko) 전자 장치 및 전자 장치에서 메신저 서비스 제공 방법
JP5947145B2 (ja) 携帯通信端末、情報表示プログラムおよび情報表示方法
KR101711679B1 (ko) 이동 통신 장치 사용자 인터페이스
TWI526924B (zh) 聲音播放方式之管理方法及系統，及其電腦程式產品
KR20150025298A (ko) 전자 장치 및 전자 장치에서 기능 추천 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13813724

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13813724

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP