WO2010050547A1 - 電子機器、メニューの選択方法、メニューの選択プログラム - Google Patents
電子機器、メニューの選択方法、メニューの選択プログラム Download PDFInfo
- Publication number
- WO2010050547A1 WO2010050547A1 PCT/JP2009/068571 JP2009068571W WO2010050547A1 WO 2010050547 A1 WO2010050547 A1 WO 2010050547A1 JP 2009068571 W JP2009068571 W JP 2009068571W WO 2010050547 A1 WO2010050547 A1 WO 2010050547A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- menu
- unit
- display
- electronic device
- selection
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0412—Digitisers structurally integrated in a display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
Definitions
- the present invention relates to an electronic device provided with a display-integrated touch panel, a menu selection method using the electronic device, and a menu selection program.
- Patent Document 1 Japanese Patent Laid-Open No. 2004-5105
- Patent Document 2 Japanese Patent Laid-Open No. 2004-5212
- Patent Document 3 Japanese Patent Laid-Open No. 2004-234504
- Patent Document 4 Japanese Patent Laid-Open No. 2000-339097
- the electronic device may display a plurality of menus, for example, image thumbnails, command menus, etc. on its display device.
- the user can simultaneously select a plurality of menus from the displayed menus using the input device.
- the user can simultaneously select a plurality of menus by the following operation.
- the user has to perform an operation for switching the input mode to the simultaneous menu selection mode when selecting a plurality of menus. That is, the user has to perform troublesome operations such as pressing the ctrl key and the shift key on the keyboard.
- the present invention has been made to solve the above-described problems, and an object of the present invention is to provide an electronic device that allows a user to simultaneously select a plurality of menus through intuitive operations. .
- An electronic device includes a storage unit for storing a plurality of menus, a display-integrated tablet capable of multipoint input, a display control unit for displaying a display screen including a plurality of menus on the display-integrated tablet, and a display While an input to the integrated tablet is being made, an input processing unit for outputting an instruction position corresponding to the input, a selection unit for selecting a menu based on a plurality of instruction positions output at the same time, And an output unit for outputting the selected menu.
- the selection unit selects a menu sandwiched between two designated positions that are output simultaneously.
- the selection unit selects a menu in a rectangle having two designated positions output at the same time as diagonal vertices.
- the selection unit selects a menu on a line segment having two designated positions output at the same time as end points.
- the storage unit stores the start timing of each input, and the selection unit changes from one end point to the other end point based on the order of the input start timing corresponding to each end point.
- a selection number is given in order, and the output unit outputs a menu based on the selection number.
- the storage unit stores the start timing of each input
- the selection unit displays a menu on a polygonal line in which a plurality of designated positions output at the same time are connected in order of the input start timing corresponding to each designated position. select.
- the selection unit sequentially gives a selection number to the selected menu from one end point of the broken line toward the other end point of the broken line, and the output unit outputs the menu based on the selection number.
- the storage unit stores a display order of each menu in the display screen
- the selection unit has a plurality of menus corresponding to each of the two designated positions input at the same time and having a continuous display order. Select the menu.
- the selection unit temporarily selects one menu designated simultaneously by a plurality of designated positions, and selects a plurality of menus having a continuous display order with the two temporarily selected menus as both ends.
- the display control unit scrolls the display screen according to continuous movement of the designated position.
- the output unit outputs the menu based on the display order.
- the output unit includes a monitor.
- the monitor is a liquid crystal panel with a built-in optical sensor.
- the display-integrated tablet is a liquid crystal panel with a built-in optical sensor.
- a method for selecting a menu by an electronic device having a display-integrated tablet capable of multipoint input includes a step of displaying a display screen including a plurality of menus on the display-integrated tablet, a step of outputting an indication position corresponding to the input while the input to the display-integrated tablet is being performed, Selecting a menu based on a plurality of output indication positions.
- a menu selection program that displays a plurality of menus and causes an electronic device having a display-integrated tablet capable of multipoint input to select the menu.
- the electronic device includes an input processing unit that outputs an indication position corresponding to the input while the input to the display-integrated tablet is being performed.
- the menu selection program causes the electronic device to determine whether or not the input processing unit outputs a plurality of indicated positions at the same time, and when the electronic device determines that the input processing unit outputs a plurality of indicated positions simultaneously. And causing the electronic device to select a menu from a plurality of menus displayed on the display-integrated tablet based on a plurality of instruction positions output simultaneously.
- the electronic device When the display-integrated touch panel that displays a plurality of menus receives a plurality of inputs at the same time, the electronic device according to the present invention can select the menu based on a plurality of input positions designated at the same time. As a result, according to the present invention, the user can simultaneously select a plurality of menus by an intuitive operation.
- FIG. 10 is a diagram for explaining a command of type “001”.
- FIG. 10 is a diagram for explaining a command of type “011”. It is a figure for demonstrating the command of classification "100”.
- FIG. 10 is a diagram for explaining a command of type “101”. It is the figure which showed schematic structure of the response data. It is the figure which showed the image (scanned image) obtained by scanning a finger
- FIG. 1 is a diagram illustrating an appearance of electronic device 100 according to the present embodiment.
- electronic device 100 includes a first housing 100A and a second housing 100B.
- the first casing 100A and the second casing 100B are foldably connected by a hinge 100C.
- the first housing 100A includes a liquid crystal panel 140 with a built-in optical sensor.
- the second housing 100B includes an optical sensor built-in liquid crystal panel 240.
- the electronic device 100 includes two optical sensor built-in liquid crystal panels.
- the electronic device 100 is configured as a portable device having a display function such as a PDA (Personal Digital Assistant), a notebook personal computer, a portable telephone, and an electronic dictionary.
- a display function such as a PDA (Personal Digital Assistant), a notebook personal computer, a portable telephone, and an electronic dictionary.
- FIG. 2 is a block diagram illustrating a hardware configuration of electronic device 100.
- the electronic device 100 includes a first unit 1001 and a second unit 1002.
- the second unit 1002 is detachably connected to the first unit 1001 from the electronic device 100.
- the first unit 1001 includes a main body device 101 and a display device 102.
- the second unit 1002 includes a display device 103 and a main device 104.
- the first housing 100A includes a display device 102.
- Second housing 100B includes main device 101.
- the second housing 100B includes a second unit 1002.
- the main unit 101 includes a CPU (Central Processing Unit) 110, a RAM (Random Access Memory) 171, a ROM (Read-Only Memory) 172, a memory card reader / writer 173, an external communication unit 174, a microphone 175, A speaker 176, an operation key 177, a power switch 191, a power circuit 192, a power detection unit 193, a USB (Universal Serial Bus) connector 194, an antenna 195, and a LAN (Local Area Network) connector 196 are included. .
- Each component (110, 171 to 177, 193) is connected to each other by a data bus DB1.
- a memory card 1731 is attached to the memory card reader / writer 173.
- the CPU 110 executes the program.
- the operation key 177 receives an instruction input from the user of the electronic device 100.
- the RAM 171 stores data generated by the execution of the program by the CPU 110 or data input via the operation keys 177 in a volatile manner.
- the ROM 172 stores data in a nonvolatile manner.
- the ROM 172 is a ROM capable of writing and erasing data such as an EPROM (Erasable Programmable Read-Only Memory) and a flash memory.
- External communication unit 174 communicates with other electronic devices. Specifically, the external communication unit 174 communicates with, for example, the second unit 1002 via the USB connector 194. The external communication unit 174 performs wireless communication with the second unit 1002 via the antenna 195, for example. Further, the external communication unit 174 performs wired communication with other electronic devices via the LAN connector 196.
- the main device 101 may communicate with other electronic devices by wireless communication other than Bluetooth (registered trademark).
- the external communication unit 174 may perform wireless communication with other electronic devices connected to the LAN via a wireless LAN antenna (not shown).
- wireless communication may be performed with another electronic device via an infrared port (not shown).
- the power switch 191 is a switch for starting up the electronic device 100.
- the power supply circuit 192 supplies power to each component connected to the data bus DB1 and the display device 102 via the power detection unit 193.
- the power circuit 192 supplies power to the external communication unit 174 without going through the power detection unit 193.
- the power supply detection unit 193 detects the output from the power supply circuit 192. In addition, the power supply detection unit 193 sends information (for example, a voltage value and a current value) regarding the detected output to the CPU 110.
- information for example, a voltage value and a current value
- the USB connector 194 is used to connect the first unit 1001 to the second unit 1002.
- the main device 101 may include other USB connectors in addition to the USB connector 194.
- the first unit 1001 transmits data to the second unit 1002 via the USB connector 194.
- the first unit 1001 receives data from the second unit 1002 via the USB connector 194. Further, the first unit 1001 supplies power to the second unit 1002 via the USB connector 194.
- the antenna 195 is used for communication in accordance with the Bluetooth (registered trademark) standard between the first unit 1001 and another communication device (for example, the second unit 1002).
- the LAN connector 196 is used to connect the electronic device 100 to the LAN.
- the display device 102 includes a driver 130, an optical sensor built-in liquid crystal panel 140 (hereinafter referred to as a liquid crystal panel 140), an internal IF 178, a backlight 179, and an image processing engine 180.
- the driver 130 is a drive circuit for driving the liquid crystal panel 140 and the backlight 179. Various drive circuits included in the driver 130 will be described later.
- the liquid crystal panel 140 is a device having a liquid crystal display function and an optical sensor function. That is, the liquid crystal panel 140 can perform image display using liquid crystal and sensing using an optical sensor. Details of the liquid crystal panel 140 will be described later.
- the internal IF (Interface) 178 mediates exchange of data between the main device 101 and the display device 102.
- the backlight 179 is a light source disposed on the back surface of the liquid crystal panel 140.
- the backlight 179 irradiates the back surface with uniform light.
- the image processing engine 180 controls the operation of the liquid crystal panel 140 via the driver 130. Here, the control is performed based on various data sent from the main apparatus 101 via the internal IF 178. Note that the various data includes commands to be described later. Further, the image processing engine 180 processes data output from the liquid crystal panel 140 and sends the processed data to the main apparatus 101 via the internal IF 178. Further, the image processing engine 180 includes a driver control unit 181, a timer 182, and a signal processing unit 183.
- the driver control unit 181 controls the operation of the driver 130 by sending a control signal to the driver 130.
- the driver control unit 181 analyzes a command transmitted from the main device 101. Then, the driver control unit 181 sends a control signal based on the analysis result to the driver 130. Details of the operation of the driver 130 will be described later.
- the timer 182 generates time information and sends the time information to the signal processing unit 183.
- the signal processing unit 183 receives data output from the optical sensor.
- the signal processing unit 183 first converts the analog data into digital data.
- the signal processing unit 183 performs data processing on the digital data in accordance with the content of the command sent from the main device 101.
- the signal processing unit 183 sends data (hereinafter referred to as response data) including data after the above data processing and time information acquired from the timer 182 to the main unit 101.
- the signal processing unit 183 includes a RAM (not shown) that can store a plurality of scan data, which will be described later, continuously.
- the command includes a sensing command for instructing sensing by the optical sensor. Details of the sensing command and the response data will be described later (FIGS. 7, 8, and 14).
- the timer 182 is not necessarily provided in the image processing engine 180.
- the timer 182 may be provided outside the image processing engine 180 in the display device 102.
- the timer 182 may be provided in the main body device 101.
- the microphone 175 and the speaker 176 are not always provided in the electronic device 100, and may be configured so as not to include either or both of the microphone 175 and the speaker 176 depending on the embodiment of the electronic device 100.
- the display device 102 includes a system liquid crystal.
- the system liquid crystal is a device obtained by integrally forming peripheral devices of the liquid crystal panel 140 on the glass substrate of the liquid crystal panel 140.
- the driver 130 (excluding the circuit that drives the backlight 179), the internal IF 178, and the image processing engine 180 are integrally formed on the glass substrate of the liquid crystal panel 140.
- the display device 102 is not necessarily configured using the system liquid crystal, and the driver 130 (excluding a circuit that drives the backlight 179), the internal IF 178, and the image processing engine 180 are included in the glass substrate. Other substrates may be configured.
- the second unit 1002 receives power supply from the first unit 1001. Specifically, the second unit 1002 is supplied with power from the power supply circuit 192 of the first unit 1001 by connecting a USB connector 294 described later and the USB connector 194 of the first unit 1001.
- the main body device 104 includes a CPU 210, a RAM 271, a ROM 272, an external communication unit 274, a power supply detection unit 293, a USB connector 294, an antenna 295, and a signal strength detection unit 297.
- Each component 210, 271, 272, 274, 293) is connected to each other by a data bus DB2.
- the CPU 210 executes a program.
- the RAM 271 stores data generated by the execution of the program by the CPU 210 in a volatile manner.
- the ROM 272 stores data in a nonvolatile manner.
- the ROM 272 is a ROM capable of writing and erasing data such as an EPROM (Erasable Programmable Read-Only Memory) and a flash memory.
- the external communication unit 274 communicates with other electronic devices. Specifically, the external communication unit 274 communicates with, for example, the first unit 1001 via the USB connector 294. The external communication unit 274 communicates with the first unit 1001 through the antenna 295, for example.
- the main device 104 may communicate with another electronic device (for example, the first unit 1001) by wireless communication other than Bluetooth (registered trademark).
- the external communication unit 274 may perform wireless communication with other electronic devices via an infrared port (not shown).
- the signal strength detection unit 297 detects the strength of the signal received via the antenna 295. Then, the signal strength detection unit 297 sends the detected strength to the external communication unit 274.
- the USB connector 294 is used to connect the second unit 1002 to the first unit 1001.
- the second unit 1002 transmits data to the first unit 1001 via the USB connector 294.
- the second unit 1002 receives data from the first unit 1001 via the USB connector 294.
- the second unit 1002 receives power supply from the first unit 1001 via the USB connector 294 as described above.
- the second unit 1002 stores the electric power supplied from the first unit 1001 in a battery (not shown).
- the antenna 295 is used for communication according to the Bluetooth (registered trademark) standard between the second unit 1002 and the first unit 1001, for example.
- the power detection unit 293 detects the power supplied via the USB connector 294. In addition, the power supply detection unit 293 sends information about the detected power to the CPU 210.
- the main device 104 may have a function of performing infrared communication.
- the display device 103 includes a driver 230, an optical sensor built-in liquid crystal panel 240 (hereinafter referred to as “liquid crystal panel 240”), an internal IF 278, a backlight 279, and an image processing engine 280.
- the image processing engine 280 includes a driver control unit 281, a timer 282, and a signal processing unit 283.
- the display device 103 has the same configuration as the display device 102. That is, the driver 230, the liquid crystal panel 240, the internal IF 278, the backlight 279, and the image processing engine 280 have the same configuration as the driver 130, the liquid crystal panel 140, the internal IF 178, the backlight 179, and the image processing engine 180 in the display device 102. Have each.
- the driver control unit 281, the timer 282, and the signal processing unit 283 have the same configurations as the driver control unit 181, the timer 182, and the signal processing unit 183 in the display device 102, respectively. Therefore, description of each functional block included in display device 103 will not be repeated.
- the processing in the electronic device 100 is realized by software executed by each hardware and the CPU 110.
- Such software may be stored in the ROM 172 in advance.
- the software may be stored in a memory card 1731 or other storage medium and distributed as a program product.
- the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet.
- Such software is read from the storage medium by the memory card reader / writer 173 or other reading device, or downloaded via the communication unit 174 or communication IF (not shown), and then temporarily stored in the ROM 172.
- the software is read from the ROM 172 by the CPU 110 and stored in the RAM 171 in the form of an executable program.
- CPU 110 executes the program.
- Each component constituting the main device 101 of the electronic device 100 shown in FIG. 2 is a general one. Therefore, it can be said that the essential part of the present invention is the software stored in the RAM 171, the ROM 172, the memory card 1731 and other storage media, or the software downloadable via the network. Since the hardware operation of main device 101 of electronic device 100 is well known, detailed description will not be repeated.
- the storage medium is not limited to a memory card, but is a CD-ROM, FD (Flexible Disk), hard disk, magnetic tape, cassette tape, optical disk (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versatile). Disc)), IC (Integrated Circuit) card (excluding memory card), optical card, mask ROM, EPROM, EEPROM (Electronically Erasable Programmable Read-Only Memory), semiconductor memory such as flash ROM, etc. It may be a medium to be used.
- the program here includes not only a program directly executable by the CPU but also a program in a source program format, a compressed program, an encrypted program, and the like.
- FIG. 3 is a diagram showing a configuration of the liquid crystal panel 140 and peripheral circuits of the liquid crystal panel 140.
- the liquid crystal panel 140 includes a pixel circuit 141, an optical sensor circuit 144, a scanning signal line Gi, a data signal line SRj, a data signal line SGj, a data signal line SBj, and a sensor signal line.
- SSj, sensor signal line SDj, read signal line RWi, and reset signal line RSi are included.
- i is a natural number satisfying 1 ⁇ i ⁇ m
- j is a natural number satisfying 1 ⁇ j ⁇ n.
- a scanning signal line driving circuit 131 includes a scanning signal line driving circuit 131, a data signal line driving circuit 132, an optical sensor driving circuit 133, a switch 134, as peripheral circuits of the liquid crystal panel 140. And an amplifier 135.
- the scanning signal line drive circuit 131 receives the control signal TC1 from the driver control unit 181 shown in FIG.
- the scanning signal line drive circuit 131 applies a predetermined voltage in order from the scanning signal line G1 to each scanning signal line (G1 to Gm) based on the control signal TC1. More specifically, the scanning signal line driving circuit 131 sequentially selects one scanning signal line from the scanning signal lines (G1 to Gm) per unit time, and a TFT (to be described later) with respect to the selected scanning signal line.
- a voltage that can turn on the gate of the thin film transistor 142 (hereinafter referred to as a high level voltage) is applied. Note that a low level voltage is applied to a scanning signal line that is not selected without applying a high level voltage.
- the data signal line drive circuit 132 receives image data (DR, DG, DB) from the driver control unit 181 shown in FIG.
- the data signal line driving circuit 132 applies a voltage corresponding to one row of image data to the 3n data signal lines (SR1 to SRn, SG1 to SGn, SB1 to SBn) for each unit time. Apply sequentially.
- a drive system is not limited to this.
- the pixel circuit 141 is a circuit for setting the luminance (transmittance) of one pixel. Further, m ⁇ n pixel circuits 141 are arranged in a matrix. More specifically, m pixel circuits 141 are arranged in the vertical direction in FIG. 3 and n pixel circuits in the horizontal direction.
- the pixel circuit 141 includes an R subpixel circuit 141r, a G subpixel circuit 141g, and a B subpixel circuit 141b. Each of these three circuits (141r, 141g, 141b) includes a TFT 142, a pair of electrode pairs 143 including a pixel electrode and a counter electrode, and a capacitor (not shown).
- CMOS Complementary Metal Oxide Semiconductor
- a-Si TFT amorphous silicon thin film transistor
- p-Si TFT polycrystalline silicon thin film transistor
- the TFT 142 will be described as an n-channel field effect transistor.
- the TFT 142 may be a p-type channel field effect transistor.
- the source of the TFT 142 in the R subpixel circuit 141r is connected to the data signal line SRj.
- the gate of the TFT 142 is connected to the scanning signal line Gi.
- the drain of the TFT 142 is connected to the pixel electrode of the electrode pair 143.
- a liquid crystal is disposed between the pixel electrode and the counter electrode.
- the G sub-pixel circuit 141g and the B sub-pixel circuit 141b have the same configuration as the R sub-pixel circuit 141r except that the data signal line to which the source of each TFT 142 is connected is different. Therefore, description of these two circuits (141g, 141b) will not be repeated.
- the high level voltage is applied to the scanning signal line Gi.
- the gate of the TFT 142 is turned on.
- a specified voltage (voltage corresponding to image data for one pixel) is applied to each data signal line (SRj, SGj, SBj).
- a voltage based on the designated voltage is applied to the pixel electrode.
- a potential difference is generated between the pixel electrode and the counter electrode.
- the liquid crystal responds and the luminance of the pixel is set to a predetermined luminance. Note that the potential difference is held by the capacitor (auxiliary capacitor) (not shown) until the scanning signal line Gi is selected in the next frame period.
- the optical sensor driving circuit 133 receives the control signal TC2 from the driver control unit 181 shown in FIG.
- the optical sensor drive circuit 133 sequentially selects one signal line from the reset signal lines (RS1 to RSm) for each unit time based on the control signal TC2, and determines in advance for the selected signal line.
- the voltage VDDR that is higher than usual is applied.
- a voltage VSSR lower than the voltage applied to the selected reset signal line is kept applied to the unselected reset signal line.
- the voltage VDDR may be set to 0V and the voltage VSSR may be set to ⁇ 5V.
- the photosensor driving circuit 133 sequentially selects one signal line from the readout signal lines (RW1 to RWm) per unit time based on the control signal TC2, and determines in advance for the selected signal line.
- a voltage VDD higher than usual is applied.
- the voltage VSSR is applied to the read signal line that is not selected.
- the value of VDD may be set to 8V.
- the timing for applying the voltage VDDR and the timing for applying the voltage VDD will be described later.
- the optical sensor circuit 144 includes a photodiode 145, a capacitor 146, and a TFT 147.
- the TFT 147 is an n-type channel field effect transistor.
- the TFT 147 may be a p-type channel field effect transistor.
- the anode of the photodiode 145 is connected to the reset signal line RSi.
- the cathode of the photodiode 145 is connected to one electrode of the capacitor 146.
- the other electrode of the capacitor 146 is connected to the read signal line RWi.
- a connection point between the photodiode 145 and the capacitor 146 is referred to as a node N.
- the gate of the TFT 147 is connected to the node N.
- the drain of the TFT 147 is connected to the sensor signal line SDj. Further, the source of the TFT 147 is connected to the sensor signal line SSj. Details of sensing using the optical sensor circuit 144 will be described later.
- the switch 134 is a switch provided for switching whether or not to apply a predetermined voltage to the sensor signal lines (SD1 to SDn).
- the switching operation of the switch 134 is performed by the optical sensor driving circuit 133.
- the voltage applied to the sensor signal lines (SD1 to SDn) when the switch 134 is turned on will be described later.
- the amplifier 135 amplifies the voltage output from each sensor signal line (SS1 to SSn).
- the amplified voltage is sent to the signal processing unit 183 shown in FIG.
- the image processing engine 180 controls the timing at which an image is displayed on the liquid crystal panel 140 using the pixel circuit 141 and the timing at which sensing is performed using the optical sensor circuit 144.
- FIG. 4 is a cross-sectional view of the liquid crystal panel 140 and the backlight 179.
- liquid crystal panel 140 includes an active matrix substrate 151A, a counter substrate 151B, and a liquid crystal layer 152.
- the counter substrate 151B is disposed to face the active matrix substrate 151A.
- the liquid crystal layer 152 is sandwiched between the active matrix substrate 151A and the counter substrate 151B.
- the backlight 179 is disposed on the opposite side of the liquid crystal layer 152 with respect to the active matrix substrate 151A.
- the active matrix substrate 151A includes a polarizing filter 161, a glass substrate 162, a pixel electrode 143a constituting an electrode pair 143, a photodiode 145, a data signal line 157, and an alignment film 164. Further, although not shown in FIG. 4, the active matrix substrate 151A includes the capacitor 146, the TFT 147, the TFT 142, and the scanning signal line Gi shown in FIG.
- the polarizing filter 161, the glass substrate 162, the pixel electrode 143a, and the alignment film 164 are arranged in this order from the backlight 179 side.
- the photodiode 145 and the data signal line 157 are formed on the liquid crystal layer 152 side of the glass substrate 162.
- the counter substrate 151B includes a polarizing filter 161, a glass substrate 162, a light shielding film 163, color filters (153r, 153g, 153b), a counter electrode 143b constituting an electrode pair 143, and an alignment film 164.
- the alignment film 164, the counter electrode 143b, the color filters (153r, 153g, 153b), the glass substrate 162, and the polarizing filter 161 are arranged in this order from the liquid crystal layer 152 side.
- the light shielding film 163 is formed in the same layer as the color filters (153r, 153g, 153b).
- the color filter 153r is a filter that transmits light having a red wavelength.
- the color filter 153g is a filter that transmits light having a green wavelength.
- the color filter 153b is a filter that transmits light having a blue wavelength.
- the photodiode 145 is arranged at a position facing the color filter 153b.
- the liquid crystal panel 140 displays an image by blocking or transmitting light emitted by a light source such as external light or a backlight 179. Specifically, the liquid crystal panel 140 changes the direction of liquid crystal molecules in the liquid crystal layer 152 by applying a voltage between the pixel electrode 143a and the counter electrode 143b, thereby blocking or transmitting the light. However, since the light cannot be completely blocked by the liquid crystal alone, a polarizing filter 161 that transmits only light having a specific polarization direction is provided.
- the position of the photodiode 145 is not limited to the above position, and may be provided at a position facing the color filter 153r or a position facing the color filter 153g.
- FIG. 5 is a diagram showing a timing chart when the optical sensor circuit 144 is operated.
- a voltage VINT indicates a potential at the node N in the photosensor circuit 144.
- a voltage VPIX is an output voltage from the sensor signal line SSj shown in FIG. 3 and is a voltage before being amplified by the amplifier 135.
- the description will be divided into a reset period for resetting the optical sensor circuit 144, a sensing period for sensing light using the optical sensor circuit 144, and a readout period for reading the sensing result.
- the reset period will be described.
- the voltage applied to the reset signal line RSi is instantaneously switched from the low level (voltage VSSR) to the high level (voltage VDDR).
- the voltage applied to the read signal line RWi is kept at the low level (voltage VSSR).
- the high-level voltage to the reset signal line RSi a current starts to flow in the forward direction (from the anode side to the cathode side) of the photodiode 145.
- the voltage VINT which is the potential of the node N has a value represented by the following expression (1).
- Equation (1) the forward voltage drop amount in the photodiode 145 is Vf.
- VINT VSSR +
- the voltage VINT is not more than the threshold value for turning on the gate of the TFT 147, there is no output from the sensor signal line SSj. For this reason, the voltage VPIX does not change. Further, a difference corresponding to the voltage VINT occurs between the electrodes of the capacitor 146. For this reason, the capacitor 146 accumulates charges corresponding to the difference.
- the sensing period will be described.
- the voltage applied to the reset signal line RSi instantaneously switches from the high level (voltage VDDR) to the low level (voltage VSSR).
- the voltage applied to the read signal line RWi is kept at the low level (voltage VSSR).
- the potential of the node N becomes higher than the voltage of the reset signal line RSi and the voltage of the read signal line RWi.
- the photodiode 145 the voltage on the cathode side becomes higher than the voltage on the anode side. That is, the photodiode 145 is in a reverse bias state.
- the photodiode 145 receives light from the light source, current starts to flow from the cathode side to the anode side of the photodiode 145.
- the potential of the node N that is, the voltage VINT
- the reading period will be described.
- the voltage applied to the reset signal line RSi is kept at the low level (voltage VSSR).
- the voltage applied to the read signal line RWi is instantaneously switched from the low level (voltage VSSR) to the high level (voltage VDD).
- the voltage VDD is higher than the voltage VDDR.
- the potential of the node N is raised through the capacitor 146 as shown in FIG. Note that the increase width of the potential of the node N is a value corresponding to the voltage applied to the read signal line RWi.
- the potential of the node N that is, the voltage VINT
- the gate of the TFT 147 is turned on.
- the optical sensor circuit 144 changes the value of the voltage output to the sensor signal line SSj in accordance with the amount of light received by the photodiode 145.
- the optical sensor driving circuit 133 applies a predetermined voltage to all n sensor signal lines (SD1 to SDn).
- the photosensor drive circuit 133 applies a voltage VDDR that is higher than normal to the reset signal line RS1.
- the other reset signal lines (RS2 to RSm) and read signal lines (RW1 to RWm) are kept in a state where a low level voltage is applied.
- the n photosensor circuits in the first row in FIG. 3 enter the reset period described above. Thereafter, the n photosensor circuits in the first row enter a sensing period. Further, thereafter, the n photosensor circuits in the first row enter a reading period.
- timing for applying a predetermined voltage to all n sensor signal lines is not limited to the above timing, and may be any timing that is applied at least before the readout period. .
- the photosensor drive circuit 133 applies a voltage VDDR that is higher than usual to the reset signal line RS2. That is, the reset period of the n photosensor circuits in the second row starts. When the reset period ends, the n photosensor circuits in the second row enter a sensing period, and thereafter enter a reading period.
- the above-described processing is sequentially performed on the n photosensor circuits in the third row, the n photosensor circuits in the fourth row,..., The n photosensor circuits in the m row.
- the sensor signal lines (SS1 to SSn) output the first row sensing result, the second row sensing result,..., The mth row sensing result in this order.
- scan data refers to image data obtained by scanning a scan target (for example, a user's finger). An image displayed based on the scan data is referred to as a “scanned image”. Further, in the following, sensing is referred to as “scan”.
- the electronic device 100 can take either configuration. Further, switching between the components is assumed to be performed by a command sent from the main device 101 based on an input via the operation key 177 or the like. Note that when scanning is performed on a partial area on the surface of the liquid crystal panel 140, the image processing engine 180 sets a scan target area. The setting of the area may be configured to be specified by the user via the operation key 177.
- the first is a mode in which an image is displayed in a surface area other than the partial area (hereinafter referred to as a scan area).
- the second is a mode in which no image is displayed in the surface area other than the scan area. Which mode is used is based on a command sent from the main apparatus 101 to the image processing engine 180.
- FIG. 6 is a cross-sectional view of the liquid crystal panel 140 and the backlight 179, and shows a configuration in which the photodiode 145 receives light from the backlight 179 during scanning.
- the photodiode 145 receives the reflected light.
- the amount of light received by the photodiode 145 is smaller than the region in which the finger 900 is in contact. Note that the photodiode 145 cannot receive most of the light emitted from the backlight 179 that does not reach the user's finger 900.
- the optical sensor circuit 144 can output a voltage corresponding to the amount of light reflected by the user's finger 900 from the sensor signal line SSj. it can.
- the liquid crystal panel 140 has a contact position of the finger 900, a range in which the finger 900 is in contact (determined by the pressing force of the finger 900), and the liquid crystal panel 140.
- the voltage output from the sensor signal lines (SS1 to SSn) varies depending on the direction of the finger 900 with respect to the surface of the sensor.
- the display device 102 can scan an image (hereinafter also referred to as a reflected image) obtained by reflecting light with the finger 900.
- examples of the scan object other than the finger 900 include a stylus.
- a liquid crystal panel is described as an example of the display device of electronic device 100, but another panel such as an organic EL (Electro-Luminescence) panel is used instead of the liquid crystal panel. Also good.
- FIG. 7 is a diagram showing a schematic configuration of a command.
- the command includes header DA01, first field DA02, second field DA03, third field DA04, fourth field DA05, fifth field DA06, and spare data area DA07. including.
- FIG. 8 is a diagram for explaining a command of type “000” (that is, a sensing command).
- the CPU 110 sends a command of type “000” (hereinafter referred to as “first command”) from the main unit 101 of the first unit 1001 to the second unit 1002.
- first command a command of type “000”
- the CPU 110 sends the first command from the main body device 101 to the display device 102.
- the case where the CPU 110 sends the first command from the main unit 101 of the first unit 1001 to the second unit 1002 will be described as an example.
- the CPU 110 writes the command type (“000”), the command transmission destination, and the like in the header DA01.
- the CPU 110 writes the value of the timing whose number is “1” in the first field DA02.
- the CPU 110 writes the value of the data type with the number “2” in the second field DA03.
- the CPU 110 writes the value of the reading method whose number is “3” in the third field DA04.
- the CPU 110 writes the value of the image gradation number “4” in the fourth field DA05.
- the CPU 110 writes the value of the resolution with the number “5” in the fifth field DA06.
- the first command in which “00” is set in the first field DA02 requests the image processing engine 280 to transmit scan data at that time. That is, the sensing first command requests transmission of scan data obtained by scanning using the optical sensor circuit of the liquid crystal panel 240 after the image processing engine 280 receives the first command. Further, the first command in which “01” is set in the first field DA02 requests transmission of scan data when the scan result is changed. Further, the first command in which “10” is set in the first field DA02 requests transmission of scan data at regular intervals.
- the first command in which “001” is set in the second field DA03 requests transmission of the coordinate value of the center coordinate in the partial image.
- the first command in which “010” is set in the second field DA03 requests transmission of only the partial image whose scan result has changed. Note that the change in the scan result indicates that the previous scan result is different from the current scan result.
- the first command in which “100” is set in the second field DA03 requests transmission of the entire image.
- the “whole image” is an image generated by the image processing engine 280 based on the voltage output from each optical sensor circuit when scanning using m ⁇ n optical sensor circuits.
- the “partial image” is a part of the entire image. The reason why the partial image is requested to transmit only the partial image whose scan result has changed will be described later.
- the coordinate value and the partial image or the entire image may be requested at the same time. Further, in the case of a configuration in which scanning is performed on a partial area on the surface of the liquid crystal panel 240, the entire image is an image corresponding to the area to be scanned.
- the first sensing command in which “00” is set in the third field DA04 requests that the backlight 279 be turned on to scan.
- the first command in which “01” is set in the third field DA04 requests that the backlight 279 be turned off to perform scanning. Note that the configuration for scanning with the backlight 279 off is described later (FIG. 17).
- the first command in which “10” is set in the third field DA04 requests scanning using both reflection and transmission. Note that the combined use of reflection and transmission refers to scanning a scanning object by switching between a method of scanning with the backlight 279 turned on and a method of scanning with the backlight turned off.
- the first command in which “00” is set in the fourth field DA05 requests black and white binary image data. Further, the first command in which “01” is set in the fourth field DA05 requests multi-gradation image data. Further, the first command in which “10” is set in the fourth field DA05 requests RGB color image data.
- the first command in which “0” is set in the fifth field DA06 requests image data with high resolution.
- the first command in which “1” is set in the fifth field DA06 requests image data with a low resolution.
- the first command includes designation of a region to be scanned (pixel region that drives the optical sensor circuit 144), timing for scanning, lighting timing of the backlight 179, and the like. Is described.
- the image processing engine 280 analyzes the content of the first command, and sends back data (that is, response data) according to the result of the analysis to the main unit 101.
- FIG. 9 is a diagram for explaining a command of type “001” (hereinafter referred to as “second command”).
- the CPU 110 sends a second command from the main unit 101 of the first unit 1001 to the second unit 1002.
- the CPU 110 writes the command type (“001”), the command transmission destination, and the like in the header DA01.
- the CPU 110 writes the value of the display request with the number “1” in the first field DA02.
- CPU 110 writes information on the number / type of number “2” in second field DA03.
- the CPU 110 writes the value of the display range whose number is “3” in the third field DA04.
- the CPU 110 writes information related to the image data with the number “4” in the fourth field DA05.
- the second command in which “001” is set in the first field DA02 requests the image processing engine 280 to display an image on the liquid crystal panel 240 (sub-screen).
- the second command in which “010” is set in the first field DA02 requests the image processing engine 280 to display an icon on the liquid crystal panel 240.
- the second command in which “011” is set in the first field DA02 requests the image processing engine 280 to display the handwriting area on the liquid crystal panel 240.
- the second field DA03 stores the number of images to be displayed on the liquid crystal panel 240 and a number for designating the type of handwriting language.
- the image processing engine 280 performs processing according to the number of the images or the language type.
- the second command in which “01” is set in the third field DA04 requests the image processing engine 280 to designate the display range on the liquid crystal panel 240 by coordinates. Further, the second command in which “10” is set in the third field DA04 requests the image processing engine 280 to set the display range on the liquid crystal panel 240 to the entire display area.
- the fourth field DA05 stores image data to be displayed on the liquid crystal panel 240 and position information for displaying the image data.
- the image processing engine 280 performs processing for displaying the image data at a position specified by the position information.
- FIG. 10 is a diagram for explaining a command of type “010” (hereinafter referred to as “third command”).
- the CPU 110 sends the third command from the main unit 101 of the first unit 1001 to the second unit 1002.
- the CPU 210 sends a third command from the main body device 104 of the second unit 1002 to the first unit 1001.
- the CPUs 110 and 210 write the command type (“010”), the command transmission destination, and the like in the header DA01.
- the CPUs 110 and 210 write the value of the OS (Operating System) processing request with the number “1” in the first field DA02.
- the CPUs 110 and 210 write the value of the OS information with the number “2” in the second field DA03.
- the third command in which “01” or “10” is set in the first field DA02 is transmitted from the second unit 1002 to the first unit 1001.
- the third command in which “01” is set in the first field DA02 requests the first unit 1001 to transmit information indicating the type of OS of the first unit 1001 (main device).
- the third command in which “10” is set in the first field DA02 requests the first unit 1001 to start the OS specified by the OS information.
- the third command in which “000”, “001”, or “010” is set in the second field DA03 is transmitted from the second unit 1002 to the first unit 1001.
- the third command in which “000” is set in the second field DA03 does not request the activation of the OS in the first unit 1001.
- the third command in which “001” is set in the second field DA03 indicates that the second unit 1002 has selected to start the first OS.
- the third command in which “010” is set in the second field DA03 indicates that the second unit 1002 has selected to start the second OS.
- FIG. 11 is a diagram for explaining a command of type “011” (hereinafter referred to as “fourth command”).
- the CPU 210 sends a fourth command from the main body device 104 of the second unit 1002 to the first unit 1001.
- the CPU 210 writes the command type (“011”), the command transmission destination, and the like in the header DA01.
- the CPU 210 writes information related to the activated application with the number “1” in the first field DA02.
- the CPU 210 writes the startup information with the number “2” in the second field DA03.
- the first field DA02 information specifying an application to be activated in the first unit 1001 is stored.
- the second field DA03 stores information used at the time of activation setting and information used after activation.
- FIG. 12 is a diagram for explaining a command of type “100” (hereinafter referred to as “fifth command”).
- the CPU 210 sends the fifth command from the main body device 104 of the second unit 1002 to the first unit 1001.
- the CPU 210 writes the command type (“100”), the command transmission destination, and the like in the header DA01.
- the CPU 210 writes information related to the reception request with the number “1” in the first field DA02.
- the CPU 210 writes information relating to the number “2” in the second field DA03.
- the CPU 210 writes information related to the file with the number “3” in the third field DA04.
- the fifth command in which “01” is set in the first field DA02 requests the first unit 1001 to receive a file.
- the number of files transmitted from the second unit 1002 to the first unit 1001 is stored. Further, a file transmitted from the second unit 1002 to the first unit 1001 is stored in the third field DA04.
- FIG. 13 is a diagram for explaining a command of type “101” (hereinafter referred to as “sixth command”).
- the CPU 110 sends the sixth command from the main unit 101 of the first unit 1001 to the second unit 1002.
- the CPU 210 sends the sixth command from the main body device 104 of the second unit 1002 to the first unit 1001.
- the CPUs 110 and 210 write the command type (“101”), the command transmission destination, and the like in the header DA01.
- the CPUs 110 and 210 write the value of the communication type with the number “1” in the first field DA02.
- the CPUs 110 and 210 write the value of the connection destination with the number “2” in the second field DA03.
- the CPUs 110 and 210 write the value of the transfer destination with the number “3” in the third field DA04.
- the CPUs 110 and 210 write the value of the signal strength acquisition timing number “4” in the fourth field DA05.
- the sixth command in which “001” is set in the first field DA02 requests the counterpart device to perform infrared communication.
- the sixth command in which “010” is set in the first field DA02 requests the counterpart device to perform wireless communication by Bluetooth (registered trademark).
- the sixth command in which “011” is set in the first field DA02 requests the counterpart device to perform LAN communication.
- the sixth command in which “000” is set in the second field DA03 indicates that it does not have information specifying the communication connection destination.
- the sixth command in which “001” is set in the second field DA03 is transmitted by the first unit 1001 to the device to which the first unit 1001 is connected.
- Such a sixth command requests transmission of information related to a device to which the first unit 1001 is connected.
- the sixth command in which “010” is set in the second field DA03 is transmitted by the second unit 1002 to the first unit 1001 to which the second unit 1002 is connected.
- Such a sixth command requests transmission of information regarding the first unit 1001 to which the second unit 1002 is connected.
- the sixth command in which “011” is set in the second field DA03 is transmitted by the second unit 1002 to the first unit 1001 to which the second unit 1002 is connected.
- Such a sixth command requests that information regarding the second unit 1002 be set as connection destination device information.
- the sixth command in which “100” is set in the second field DA03 is transmitted by the first unit 1001 to the device to which the first unit 1001 is connected (for example, the second unit 1002).
- Such a sixth command requests that information regarding the first unit 1001 be set as connection destination device information.
- the sixth command in which “000” is set in the third field DA04 indicates that it does not have information specifying the transfer destination of data (for example, a file).
- the sixth command in which “001” is set in the third field DA04 is transmitted by the first unit 1001 to the data transfer destination device.
- Such a sixth command requests transmission of information relating to the data transfer destination device.
- the sixth command in which “010” is set in the third field DA04 is transmitted by the second unit 1002 to the first unit 1001 that is the data transfer destination.
- Such a sixth command requests transmission of information related to the first unit 1001 of the data transfer destination.
- the sixth command in which “011” is set in the third field DA04 is transmitted by the second unit 1002 to the first unit 1001 that is the data transfer destination.
- Such a sixth command requests that information regarding the second unit 1002 be set as device information of the data transfer source.
- the sixth command in which “100” is set in the third field DA04 is transmitted by the first unit 1001 to the data transfer destination device (for example, the second unit 1002).
- the data transfer destination device for example, the second unit 1002.
- Such a sixth command requests that information regarding the first unit 1001 be set as device information of the data transfer source.
- the sixth command in which “00”, “01”, “10”, or “11” is set in the fourth field DA05 is transmitted by the first unit 1001 to the second unit 1002.
- the sixth command in which “00” is set in the fourth field DA05 does not request the second unit 1002 to transmit data indicating the signal strength. Also, the sixth command in which “01” is set in the fourth field DA05 requests the signal strength detection unit 297 to transmit data indicating the signal strength at that time. Furthermore, the sixth command in which “10” is set in the fourth field DA05 requests transmission of data indicating the signal strength when the signal strength is changed. Further, the sixth command in which “11” is set in the fourth field DA05 requests the transmission of data indicating the signal strength at regular intervals.
- FIG. 14 is a diagram showing a schematic configuration of response data.
- the response data is data corresponding to the content of the first command (sensing command).
- the CPU 210 transmits response data from the display device 103 to the first unit 1001.
- the image processing engine 180 transmits response data from the image processing engine 180 to the main device 101.
- a case where the first command is transmitted from the main device 101 to the second unit 1002 will be described as an example.
- the response data includes a header data area DA11, a coordinate data area DA12, a time data area DA13, and an image data area DA14.
- the value of the center coordinates of the partial image is written in the data area DA12 indicating the coordinates.
- the time information acquired from the timer 282 of the image processing engine 280 is written in the data area indicating the time.
- image data that is, scan data
- the image processing engine 280 is written in the data area indicating the image.
- FIG. 15 is a diagram showing an image obtained by scanning the finger 900 (that is, a scanned image).
- an image of a region W1 surrounded by a thick solid line is an entire image
- an image of a region P1 surrounded by a broken line is a partial image.
- the center point C1 of the cross indicated by a thick line is the center coordinate.
- a pixel that is, a predetermined gradation or a pixel having a photosensor circuit which is a rectangular region and whose output voltage from the sensor signal line SSj is equal to or higher than a predetermined value.
- An area including all of the pixels having a luminance equal to or higher than a predetermined luminance is set as a partial image area.
- the center coordinates are coordinates determined in consideration of the gradation of each pixel in the partial image area. Specifically, for each pixel in the partial image, the center coordinate is determined by performing a weighting process based on the gradation of the pixel and the distance between the pixel and the rectangular center point (that is, the centroid). Is done. That is, the center coordinates do not necessarily match the centroid of the partial image.
- the position of the center coordinates is not necessarily limited to the above, and the center coordinates may be the coordinates of the centroid or the coordinates near the centroid.
- the image processing engine 280 When “001” is set in the data area indicating the data type of the first command, the image processing engine 280 writes the value of the central coordinate in the data area DA12 indicating the coordinate. In this case, the image processing engine 280 does not write image data in the data area DA14 indicating an image. After writing the value of the center coordinate, the image processing engine 280 sends response data including the value of the center coordinate to the main body device 104. The main device 104 sends response data including the value of the center coordinate to the main device 101 of the first unit 1001. As described above, when “001” is set in the data area indicating the data type, the first command does not request output of the image data but requests output of the value of the center coordinate.
- the image processing engine 280 stores the image data of the partial image whose scan result has changed in the data area DA14 indicating the image. Write. In this case, the image processing engine 280 does not write the value of the center coordinate in the data area DA12 indicating the coordinate.
- the image processing engine 280 writes the image data of the partial image whose scan result has changed, and then sends response data including the image data of the partial image to the main body device 104.
- the main device 104 sends response data including image data of the partial image to the main device 101 of the first unit 1001.
- the first command does not request the output of the value of the center coordinate, and the image data of the partial image whose scan result has changed. Request output.
- the reason for requesting transmission of only the partial image whose scan result has changed is that the scan data of the partial image area of the scan data is more important than the scan data of the other area. This is because the data is high, and the scan data in the region corresponding to the region of the partial image in the scan data is likely to change due to the contact state with the scan object such as the finger 900.
- the image processing engine 280 When “011” is set in the data area indicating the data type of the first command, the image processing engine 280 writes the value of the center coordinate in the data area DA12 indicating the coordinate and also indicates the data indicating the image. The image data of the partial image whose scan result has changed is written in the area DA14. Thereafter, the image processing engine 280 sends response data including the value of the center coordinate and the image data of the partial image to the main body device 104. The main device 104 sends response data including the value of the center coordinate and the image data of the partial image to the main device 101 of the first unit 1001.
- the first command outputs the value of the center coordinate and the output of the image data of the partial image whose scan result has changed. Request.
- the image processing engine 280 displays the entire image in the data area DA14 indicating the image of the response data shown in FIG. Write image data. In this case, the image processing engine 280 does not write the value of the center coordinate in the data area DA12 indicating the coordinate.
- the image processing engine 280 writes the image data of the entire image, and then sends response data including the image data of the entire image to the main body device 104.
- the main device 104 sends response data including image data of the entire image to the main device 101 of the first unit 1001.
- the first command requests the output of the image data of the entire image without requesting the output of the center coordinate value. .
- the image processing engine 280 When “101” is set in the data area indicating the data type of the first command, the image processing engine 280 writes the value of the central coordinate in the data area DA12 indicating the coordinate and the data indicating the image. The image data of the entire image is written in the area DA14. Thereafter, the image processing engine 280 sends response data including the value of the center coordinate and the image data of the entire image to the main body device 104. The main device 104 sends response data including the value of the center coordinate and the image data of the entire image to the main device 101 of the first unit 1001.
- the first command requests the output of the value of the center coordinate and the output of the image data of the entire image.
- the structure of the liquid crystal panel 140 is not limited to the structure shown in FIG.
- a liquid crystal panel having a mode different from that in FIG. 3 will be described.
- FIG. 16 is a circuit diagram of the photosensor built-in liquid crystal panel 140A according to the different embodiment.
- photosensor built-in liquid crystal panel 140A (hereinafter referred to as liquid crystal panel 140A) includes three photosensor circuits (144r, 144g, 144b) in one pixel.
- the liquid crystal panel 140A is different from the liquid crystal panel 140 including one photosensor circuit in one pixel in that the liquid crystal panel 140A includes three photosensor circuits (144r, 144g, and 144b) in one pixel.
- the configuration of the optical sensor circuit 144 is the same as that of each of the three optical sensor circuits (144r, 144g, 144b).
- the three photodiodes (145r, 145g, 145b) in one pixel are arranged at positions facing the color filter 153r, the color filter 153g, and the color filter 153b, respectively. Therefore, the photodiode 145r receives red light, the photodiode 145g receives green light, and the photodiode 145b receives blue light.
- liquid crystal panel 140 since the liquid crystal panel 140 includes only one photosensor circuit 144 in one pixel, two data signal lines for the TFT 147 disposed in one pixel are a sensor signal line SSj and a sensor signal line SDj. Met. However, since the liquid crystal panel 140A includes three photosensor circuits (144r, 144g, 144b) in one pixel, there are six data signal lines for TFTs (147r, 147g, 147b) arranged in one pixel. It becomes.
- the sensor signal line SSRj and the sensor signal line SDRj are arranged corresponding to the TFT 147r connected to the cathode of the photodiode 145r arranged at a position facing the color filter 153r.
- a sensor signal line SSGj and a sensor signal line SDGj are arranged corresponding to the TFT 147g connected to the cathode of the photodiode 145g arranged at a position facing the color filter 153g.
- a sensor signal line SSBj and a sensor signal line SDBj are disposed corresponding to the TFT 147b connected to the cathode of the photodiode 145b disposed at a position facing the color filter 153b.
- the white light emitted from the backlight 179 passes through the three color filters (153r, 153g, 153b), and red, green, and blue are displayed on the surface of the liquid crystal panel 140A. It mixes and becomes white light.
- white light is reflected by the scan object, a part of the white light is absorbed by the pigment on the surface of the scan object, and a part is reflected. And the reflected light permeate
- the color filter 153r transmits light having a red wavelength, and the photodiode 145r receives light having the red wavelength.
- the color filter 153g transmits light having a green wavelength, and the photodiode 145g receives light having the green wavelength.
- the color filter 153b transmits light having a blue wavelength, and the photodiode 145b receives light having the blue wavelength. That is, the light reflected by the scan object is separated into three primary colors (R, G, B) by three color filters (153r, 153g, 153b), and each photodiode (145r, 145g, 145b) The light of the color corresponding to is received.
- each photodiode (145r, 145g, 145b) When a part of white light is absorbed by the pigment on the surface of the scan target, the amount of light received by each photodiode (145r, 145g, 145b) is different for each photodiode (145r, 145g, 145b). For this reason, the output voltages of the sensor signal line SSRj, the sensor signal line SSGj, and the sensor signal line SSBj are different from each other.
- the image processing engine 180 determines the R gradation, the G gradation, and the B gradation according to each output voltage, so that the image processing engine 180 sends the RGB color image to the main body device 101. Can send.
- the scan object can be scanned in color.
- FIG. 17 is a cross-sectional view showing a configuration in which a photodiode receives external light during scanning. As shown in the figure, part of the external light is blocked by the finger 900. Therefore, the photodiode disposed under the surface region of the liquid crystal panel 140 that is in contact with the finger 900 can hardly receive external light. In addition, although the photodiodes disposed under the surface area where the shadow of the finger 900 is formed can receive a certain amount of external light, the amount of external light received is small compared to the surface area where no shadow is formed.
- the optical sensor circuit 144 can output a voltage corresponding to the position of the finger 900 with respect to the surface of the liquid crystal panel 140 from the sensor signal line SSj. it can.
- the liquid crystal panel 140 has a contact position of the finger 900, a range in which the finger 900 is in contact (determined by the pressing force of the finger 900), and the liquid crystal panel 140.
- the voltage output from the sensor signal lines (SS1 to SSn) varies depending on the direction of the finger 900 with respect to the surface of the sensor.
- the display device 102 can scan an image (hereinafter also referred to as a shadow image) obtained by blocking external light by the finger 900.
- the display device 102 may be configured to perform scanning by turning on the backlight 179 and then performing scanning again by turning off the backlight 179.
- the display device 102 may be configured to perform scanning by turning off the backlight 179 and then performing scanning again by turning on the backlight 179.
- the operation of the display device 103 is controlled in accordance with a command (for example, a first command) from the main body device 101 as in the operation of the display device 102.
- the display device 103 has the same configuration as the display device 102. Therefore, when the display device 103 receives the same command as the display device 102 from the main body device 101, the display device 103 performs the same operation as the display device 102. For this reason, description of the configuration and operation of the display device 103 will not be repeated.
- the main device 101 can send commands having different commands to the display device 102 and the display device 103.
- the display device 102 and the display device 103 perform different operations.
- the main device 101 may send a command to either the display device 102 or the display device 103. In this case, only one display device performs an operation according to the command.
- the main device 101 may send a command having the same command to the display device 102 and the display device 103. In this case, the display device 102 and the display device 103 perform the same operation.
- the size of the liquid crystal panel 140 of the display device 102 and the size of the liquid crystal panel 240 of the display device 103 may be the same or different. Further, the resolution of the liquid crystal panel 140 and the resolution of the liquid crystal panel 240 may be the same or different.
- FIG. 18 is a block diagram illustrating a hardware configuration of the electronic device 1300. Similar to the electronic device 100, the electronic device 1300 includes a first housing 100A and a second housing 100B. Referring to FIG. 18, electronic device 1300 includes a first unit 1001A and a second unit 1002. The first unit 1001A includes a main body device 101 and a display device 102A. The second unit 1002 includes a main device 104 and a display device 103.
- the display device 102A includes a liquid crystal panel that does not incorporate a photosensor (that is, a liquid crystal panel having only a display function).
- the electronic device 1300 is different from the electronic device 100 in which the first unit 1001A includes a liquid crystal panel that does not include a photosensor, and the first unit 1001 includes a liquid crystal panel 240 that includes a photosensor.
- Such an electronic device 1300 performs the above-described sensing using the display device 103 of the second unit 1002.
- the first unit 1001 may be provided with, for example, a resistive film type or capacitive type touch panel instead of the liquid crystal panel 140 incorporating the optical sensor.
- the display device 102 includes the timer 182 and the display device 103 includes the timer 282.
- the display device 102 and the display device 103 may share one timer. .
- the electronic device 100 is described as a foldable device, but the electronic device 100 is not necessarily limited to the foldable device.
- the electronic device 100 may be a sliding device configured such that the first housing 100A slides with respect to the second housing 100B.
- the second unit 1002 is detachable from the first unit 1001 via the USB connectors 194 and 294.
- the electronic device 100 which concerns on this Embodiment can exhibit the following functions, for example at the time of power activation.
- the first unit 1001 activates a BIOS (Basic Input / Output System) by using power from the power supply circuit 192.
- BIOS Basic Input / Output System
- the second unit 1002 acquires power from the first unit 1001 via the USB connectors 194 and 294.
- the second unit 1002 can transmit and receive data to and from the first unit 1001 by using the power.
- the CPU 210 of the second unit 1002 can display the OS (Operation System) type on the liquid crystal panel 240 in a selectable manner by using the power from the USB connectors 194 and 294.
- OS Operaation System
- the user selects an OS to be started up via the liquid crystal panel 240.
- the CPU 210 transmits a command (for example, a “first OS” command shown in FIG. 10) specifying the OS to be activated to the first unit 1001 via the USB connectors 194 and 294 according to the user's selection. .
- the first unit 1001 starts the OS in response to the command.
- the second unit 1002 transmits / receives data to / from an external mobile phone via the antenna 295.
- the CPU 210 of the second unit 1002 acquires photographic image data and corresponding thumbnail data from an external mobile phone via the antenna 295, and stores the photographic image data and corresponding thumbnail data in the RAM 271 or the like.
- the CPU 210 reads the thumbnail data from the RAM 271 and causes the liquid crystal panel 240 to display a thumbnail image of the photo in a selectable manner.
- the CPU 210 causes the liquid crystal panel 240 to display a photographic image in response to an external selection command.
- the CPU 210 displays a photographic image on the liquid crystal panel 140 or the display device 102A via the USB connector 294.
- electronic device 100 includes first unit 1001 and second unit 1002 as described above.
- the first unit 1001 includes an input unit 310, an output unit 320, a storage unit 330, an interface unit 340, and a control unit 350.
- the input unit 310 receives an instruction from the outside.
- the operation key 177 functions as the input unit 310.
- the liquid crystal panel 140 with a built-in optical sensor also functions as the input unit 310.
- the output unit 320 outputs information inside the first unit 1001 to the outside.
- the output unit 320 includes a display unit 322 that displays an image.
- the liquid crystal panel 140 functions as the display unit 322.
- another display device for example, a display such as an LCD (Liquid Crystal Display) may be used.
- the storage unit 330 stores information such as a plurality of menus 332. Each menu 332 can be selected based on an instruction received by the input unit 310.
- the menu 332 includes, for example, an image thumbnail and a command menu.
- the interface unit 340 exchanges information with the interface unit 440 on the second unit 1002 side.
- the USB connector 194 functions as the interface unit 340.
- the antenna 195 functions as the interface unit 340.
- the method of exchanging information by the interface unit 340 is not limited to this.
- the control unit 350 controls the operations of the output unit 320, the storage unit 330, and the interface unit 340 based on instructions received by the input unit 310 and the like.
- the second unit 1002 includes a display / input unit 410, a storage unit 430, an interface unit 440, and a control unit 450.
- the display / input unit 410 displays information inside the second unit 1002 to the outside. Further, the display / input unit 410 receives an instruction from the outside.
- the optical sensor built-in liquid crystal panel 240 and the backlight 279 serve as the display / input unit 410.
- the configuration of the display / input unit 410 is not limited to this.
- Another display device such as a combination of a display such as an LCD (Liquid Crystal Display) and an input device capable of multipoint input can also be used as the display / input unit 410.
- the storage unit 430 stores information such as a plurality of menus 432 and display data 434 displayed on the display / input unit 410.
- the menu 432 includes, for example, an image thumbnail and a command menu, like the menu 332 stored in the storage unit 330 of the first unit 1001.
- the interface unit 440 exchanges information with the interface unit 340 on the first unit 1001 side.
- the USB connector 294 functions as the interface unit 440.
- the antenna 295 functions as the interface unit 440.
- the method of exchanging information by the interface unit 440 is not limited to this.
- Control unit 450 controls operations of the display / input unit 410, the storage unit 430, and the interface unit 440 based on instructions received by the display / input unit 410.
- Control unit 450 includes a display control unit 452, a position calculation unit 454, and a menu selection unit 456.
- the display control unit 452 controls the liquid crystal panel 240 and the backlight 279, and displays an image based on the display data 434 on the liquid crystal panel 240.
- the display control unit 452 creates display data 434 including a plurality of menus 432 and displays an image based on the display data 434 on the liquid crystal panel 240.
- display data 434 including a plurality of menus 432 includes display position information of each menu 432.
- the position calculation unit 454 calculates the position indicated from the outside. Specifically, for example, the position calculation unit 454 obtains a partial image area based on the sensing result of the liquid crystal panel 240, and calculates the center coordinates of the partial image area as the designated position. In the present embodiment, the position calculation unit 454 outputs the indicated position while there is an input to the liquid crystal panel 240. That is, the position calculation unit 454 constantly outputs the indicated position while an external object such as the finger 900 is in contact with or close to the liquid crystal panel 240.
- Menu selection unit 456 selects a menu from the menus displayed on liquid crystal panel 240 based on the indicated position calculated by position calculation unit 454. Details of the menu selection method by the menu selection unit 456 will be described later.
- the menu selection unit 456 passes the selected menu to the interface unit 440.
- FIG. 20 shows an operation of the electronic device 100 when attaching a plurality of files to an e-mail as an example.
- FIG. 20A is a diagram showing a screen displayed on the electronic device 100 when the electronic mail application is activated.
- the liquid crystal panel 140 on the first unit 1001 side displays a screen including a destination (To) field, a subject (Title) field, a text field, and an attached button.
- the liquid crystal panel 240 on the second unit 1002 side displays nothing. However, the liquid crystal panel 240 may display some screen.
- FIG. 20B is a diagram showing a screen displayed on the electronic device 100 when the attached button shown in FIG. 20A is selected.
- the liquid crystal panel 204 displays a screen including a plurality of menus (here, thumbnail images).
- the menu displayed on the liquid crystal panel 204 may be stored in advance in the second unit 1002 or sent from the first unit 1001 to the second unit 1002 when the attached button is selected. It may be what was made.
- the user can select each thumbnail image by touching the liquid crystal panel 240 with the finger 900 or the finger 900 #. Note that the user may select a thumbnail image using an input device such as a stylus instead of the finger 900 or 900 #.
- FIG. 20C is a diagram showing a screen displayed on the electronic device 100 when the image abc in the liquid crystal panel 240 shown in FIG. 20B and the image ghi are touched at the same time.
- an image sandwiched between the touched images is extracted as a temporarily selected image.
- the liquid crystal panel 240 displays the extracted temporarily selected image surrounded by a frame. However, the liquid crystal panel 240 may highlight these candidate images by other methods.
- electronic device 100 determines the temporarily selected image as a selected image.
- the e-mail application attaches the determined selected images, that is, the image abc, the image def, and the image ghi to the e-mail being created.
- the liquid crystal panel 140 displays the file name of the attached image next to the attachment button.
- electronic device 100 regards a touch on a determination button (not shown in FIG. 20) displayed on liquid crystal panel 240 as a selection determination instruction.
- the selection determination instruction is not limited to this.
- the electronic device 100 may select, as a selection image, an image that is sandwiched between touched images without instructing the selection determination in response to two menus being touched at the same time.
- the present embodiment using the selection determination instruction has an advantage that it is possible to prevent malfunction caused by the user selecting an incorrect region.
- electronic device 100 displays a screen including a plurality of menus as selection candidates on liquid crystal panel 240 of second unit 1002. Therefore, the electronic device 100 can allow the user to select a menu while securing a work space on the liquid crystal panel 140.
- the menu selection unit 456 regards simultaneous input of two designated positions as an instruction to switch to the multiple menu selection mode. That is, when the menu selection unit 456 receives input of two designated positions from the position calculation unit 454, the menu selection unit 456 temporarily selects a menu in a rectangle having the two designated positions as diagonal vertices. Here, the direction of each side of the rectangle coincides with either the horizontal direction or the vertical direction of the display screen. When the horizontal coordinates or the vertical coordinates of the two designated positions match, the menu selection unit 456 temporarily selects a menu on a line segment connecting the two designated positions.
- the menu selection unit 456 determines the temporarily selected menu as a selection menu.
- menu selection unit 456 regards pressing of the determination key displayed on liquid crystal panel 240 as a selection determination instruction.
- Menu selection unit 456 outputs the selection menu to interface unit 440.
- the interface unit 440 that has received the selection menu transmits the selection menu to the interface unit 340 on the first unit 1001 side.
- the control unit 350 on the first unit 1001 side performs a predetermined process on the selection menu. In the case of the example shown in FIG. 20, the control unit 350 attaches content corresponding to the selected thumbnail to the e-mail.
- FIG. 21 is a diagram illustrating an operation in which the electronic device 100 selects a menu arranged in the horizontal direction.
- the user of electronic device 100 simultaneously presses the area on the upper left thumbnail and the area on the upper right thumbnail with finger 900 and finger 900 #, respectively.
- the position calculation unit 454 outputs two designated positions simultaneously. Therefore, menu selection unit 456 provisionally selects a rectangular area or a thumbnail on a line segment specified at two designated positions.
- Menu selection unit 456 specifically displays the temporarily selected thumbnail. In the present embodiment, it is assumed that menu selection unit 456 surrounds the temporarily selected thumbnail with a frame as shown in FIG. However, menu selection unit 456 may specifically display the temporarily selected thumbnail by another method.
- menu selection unit 456 When the menu selection unit 456 temporarily selects a thumbnail and the position calculation unit 454 outputs the designated position in the determination button 500, the menu selection unit 456 selects the temporarily selected thumbnail. In addition, menu selection unit 456 outputs the selected menu to interface unit 440.
- the interface unit 440 that has received the selected menu sends the selected menu to the interface unit 340 on the first unit 1001 side.
- the control unit 350 on the first unit 1001 side performs predetermined processing (such as content corresponding to the selected thumbnail) on the selected menu.
- FIG. 22 is a diagram illustrating an operation in which the electronic device 100 selects a menu arranged in the vertical direction. Referring to FIG. 22, the user of electronic device 100 simultaneously presses the area on the upper left thumbnail and the area on the lower left thumbnail with finger 900 and finger 900 #.
- the menu selection unit 456 provisionally selects the three thumbnails surrounded by the frame in FIG. 22 by the same processing as described above.
- the enter button 500 is pressed, the menu selection unit 456 selects and outputs the temporarily selected thumbnail.
- the control unit 350 on the first unit 1001 side performs a predetermined process on the selected menu.
- FIG. 23 is a diagram illustrating an operation in which the electronic device 100 selects a menu over three rows and three columns. Referring to FIG. 23, the user of electronic device 100 simultaneously presses the area on the upper left thumbnail and the area on the lower right thumbnail with finger 900 and finger 900 #.
- the menu selection unit 456 temporarily selects nine thumbnails surrounded by the frame in FIG. 23 by the same processing as described above.
- the enter button 500 is pressed, the menu selection unit 456 selects and outputs the temporarily selected thumbnail.
- the control unit 350 on the first unit 1001 side performs a predetermined process on the selected menu.
- Menu selection unit 456 accepts one input (first input) made in an area corresponding to one menu and an input (second input) made in an area corresponding to another menu. Until the first input is completed, a menu corresponding to the first input is provisionally selected. Such provisional selection of one menu is called single selection. Hereinafter, single selection will be described with reference to FIG.
- FIG. 24A is a diagram showing a display screen of the liquid crystal panel 240 when the user's finger 900 is pressing one menu. At this time, menu selection unit 456 does not provisionally select a menu yet. The menu selection unit 456 determines whether to perform single selection or provisional selection of a plurality of menus based on the subsequent input of the liquid crystal panel 240.
- FIG. 24B is a diagram showing a display screen of the liquid crystal panel when the finger 900 is separated from the liquid crystal panel 240 after the state shown in FIG. At this time, menu selection unit 456 extracts the pressed menu.
- the display control unit 452 controls the liquid crystal panel 240 and highlights the single selected menu.
- the menu selection unit 456 outputs the single selected menu to the interface unit 440.
- the menu selection unit 456 can continuously select a single menu according to repetition of the single selection operation. The continuous selection of a single menu will be described with reference to FIG.
- FIG. 25A is a diagram showing a display screen of the liquid crystal panel 240 when one menu is extracted and the user's finger 900 is pressing the other one menu. At this time, menu selection unit 456 does not extract the pressed menu yet.
- FIG. 25 (b) is a diagram showing a display screen of the liquid crystal panel when the finger 900 is separated from the liquid crystal panel 240 after the state shown in FIG. 25 (a).
- menu selection unit 456 temporarily selects the pressed menu.
- the menu selection unit 456 continues provisional selection for the menu that was provisionally selected when shown in FIG.
- the menu selection unit 456 selects the menu temporarily selected as shown in FIG. 25A and the newly temporarily selected menu, and sends the selected menu to the interface unit 440. Output.
- the menu selection unit 456 may output the menu to the interface unit 440 without pressing the enter button 500.
- menu selection unit 456 temporarily selects a menu and selects the temporarily selected menu in response to pressing of determination button 500 as in the present embodiment. And output is preferred.
- menu selection unit 456 cancels the temporary selection of the menu in response to the pressing of the temporarily selected menu again.
- the user can cancel the provisional selection of the pressed menu.
- FIG. 26A shows a display screen of the liquid crystal panel 240 when the finger 900 presses the temporarily selected menu.
- FIG. 26B is a diagram showing a display screen of the liquid crystal panel 240 when the finger 900 is separated from the liquid crystal panel 240 after the state shown in FIG.
- the menu selection unit 456 cancels the temporary selection of the menu pressed with the finger 900. Further, menu selection unit 456 returns the temporarily selected menu display form to the normal display form.
- the menu selection unit 456 can also cancel provisional selection of a specific menu from a plurality of provisionally selected menus. Such an operation example will be described with reference to FIG.
- FIG. 27A is a diagram showing a display screen of the liquid crystal panel 240 when the finger 900 presses one of the two menus temporarily selected.
- FIG. 27B is a diagram showing a display screen of the liquid crystal panel 240 when the finger 900 is separated from the liquid crystal panel 240 after the state shown in FIG.
- the menu selection unit 456 cancels the temporary selection of the menu pressed with the finger 900. Further, menu selection unit 456 returns the temporarily selected menu display form to the normal display form.
- the user can cancel the temporary selection of some menus. Therefore, the user can select the menu in various ways. For example, the user can temporarily select a menu in a rectangle and cancel the temporary selection of one of the menus.
- menu selection unit 456 performs menu selection using provisional selection processing and selection determination instructions. Therefore, menu selection unit 456 can select a menu in various ways by issuing a selection decision instruction after making a plurality of temporary selections. Such a selection method is called composite selection.
- FIG. 28A is a diagram showing a display screen of the liquid crystal panel 240 when the menu selection unit 456 temporarily selects one menu when pressed by the finger 900.
- FIG. 28B shows a display screen of the liquid crystal panel 240 when the finger 900 touches one menu and the finger 900 # touches another menu after the state shown in FIG. It is.
- menu selection unit 456 has a menu sandwiched between the indicated position of finger 900 and the indicated position of finger 900 # in addition to the menu temporarily selected in the state shown in FIG. 28 (a). Is temporarily selected.
- menu selection unit 456 determines whether a first selection instruction has been received from position calculation unit 454 or not.
- selection instruction refers to an instruction position corresponding to a menu display area.
- the selection instruction received when menu selection unit 456 has not received another selection instruction is referred to as a first selection instruction.
- menu selection unit 456 repeats the process of step S101.
- menu selection unit 456 determines whether or not the first selection instruction has ended. Specifically, menu selection unit 456 determines that the first selection instruction has ended when position calculation unit 454 has stopped outputting the instruction position of the first selection instruction.
- menu selection unit 456 When it is determined that the first selection instruction has been completed (YES in step S103), menu selection unit 456 temporarily selects a menu corresponding to the designated position of the first selection instruction in step S104.
- step S105 the menu selection unit 456 highlights the temporarily selected content.
- highlight display refers to specific display of content such as surrounding the content with a frame.
- menu selection unit 456 repeats the processing from step S101.
- menu selection unit 456 determines whether a second selection instruction has been accepted in step S107.
- the second selection instruction is a selection instruction different from the first selection instruction.
- menu selection unit 456 repeats the processing from step S103.
- menu selection unit 456, in step S109 based on the instruction position of the first selection instruction and the instruction position of the second selection instruction. Temporarily select content. Details of the processing in step S109 will be described later.
- step S111 the menu selection unit 456 highlights the content provisionally selected in step S109.
- menu selection unit 456 determines whether or not there has been an instruction to cancel provisional selection. In the present embodiment, menu selection unit 456 regards re-pressing of provisionally selected content as a provisional selection cancellation instruction.
- menu selection unit 456 cancels the temporary selection in accordance with the cancel instruction, and repeats the processing from step S101.
- menu selection unit 456 determines whether there has been a selection decision instruction. In the present embodiment, menu selection unit 456 determines that there has been a selection decision instruction when the designated position output from position calculation unit 454 is within the display area of decision button 500.
- menu selection unit 456 may regard the end of the first selection instruction and the second selection instruction as a cancel instruction.
- the user can select a menu by pressing the enter button 500 while designating two positions on the liquid crystal panel 240.
- the display control unit 452 may display a cancel key on the liquid crystal panel 240, and the menu selection unit 456 may regard pressing of the cancel key as a cancel instruction.
- menu selection unit 456 may regard the end of the first selection instruction and the second selection instruction as a selection determination instruction.
- menu selection unit 456 repeats the processing from step S113.
- menu selection unit 456 determines the temporarily selected content as the selected content, and outputs the selected content toward first unit 1001. Specifically, menu selection unit 456 outputs the selected content to interface unit 440. The interface unit 440 outputs the selected content to the interface unit 340 on the first unit 1002 side. The interface unit 340 passes the selected content to the control unit 350. Control unit 350 performs predetermined processing on the selected content.
- step S201 the menu selection unit 456 acquires coordinates (first instruction coordinates) indicated by the first selection instruction from the position calculation unit 454.
- first designated coordinates are referred to as (X1, Y1).
- step S203 the menu selection unit 456 acquires coordinates (second indication coordinates) indicated by the second selection instruction from the position calculation unit 454.
- the second designated coordinates are referred to as (X2, Y2).
- step S209 the menu selection unit 456 determines whether the display area of the i-th image includes a horizontal coordinate xi that satisfies Xmin ⁇ xi ⁇ Xmax.
- step S209 If the display area of the i-th image does not include the x coordinate xi that satisfies Xmin ⁇ xi ⁇ Xmax (NO in step S209), the menu selection unit 456 advances the process to step S215.
- the menu selection unit 456 determines that the display area of the i-th image is Ymin ⁇ yi ⁇ in step S211. It is determined whether or not a vertical coordinate yi that satisfies Ymax is included.
- step S211 When the display area of the i-th image does not include the vertical coordinate yi that satisfies Ymin ⁇ yi ⁇ Ymax (NO in step S211), the menu selection unit 456 advances the process to step S215.
- the menu selection unit 456 temporarily selects the content corresponding to the i-th image.
- menu selection unit 456 determines whether or not processing from step S209 has been performed for all i.
- menu selection unit 456 ends the content selection processing.
- step S209 and step S211 it is determined whether any coordinate (xi, yi) included in the i-th image satisfies Xmin ⁇ xi ⁇ Xmax and Ymin ⁇ yi ⁇ Ymax.
- the coordinates (xi, yi) used for the determination are not limited to this.
- (Xi, yi) may be any coordinate corresponding to the display area of the i-th image.
- the menu selection unit 456 may perform the determination in step S209 and step S211 with the center coordinate of the i-th image as (xi, yi).
- the electronic device 100 according to the second embodiment has the same hardware configuration and functional configuration as the electronic device 100 according to the first embodiment. However, the processing performed by menu selection unit 456 is different.
- the menu selection unit 456 selects a menu on a line segment having the two input positions that are input at both end points when receiving the input of two specified positions at the same time.
- the menu selection unit 456 stores the input start timing of each indicated position in the storage unit 430.
- the menu selection unit 456 selects a menu on a broken line that connects the designated positions in the order of input start timings corresponding to the designated positions.
- FIG. 31A is a diagram showing a display screen of the liquid crystal panel 240 when the finger 900 presses the first menu (the menu indicated by (1) in the figure).
- menu selection unit 456 updates display data 434 so that the pressed menu is displayed surrounded by a frame. By changing the display form of the menu in this way, the user can easily grasp which menu is pressed.
- the menu selection unit 456 may update the display data 434 so that the pressed menu is specifically displayed by a method other than surrounding the menu with a frame.
- FIG. 31B shows the display on the liquid crystal panel 240 when the finger 900 # presses the second menu (the menu marked with (2) in the figure) while the finger 900 presses the first menu. It is a figure which shows a screen.
- menu selection unit 456 updates display data 434 so that a line of menus having both ends of the first menu and the second menu are displayed surrounded by a frame.
- menu selection unit 456 includes a line of menus having both ends of the first menu and the second menu, and a line having both ends of the second menu and the third menu.
- the display data 434 is updated so that the menu is displayed in a frame.
- FIG. 31 shows an example in which the menu selection unit 456 selects menus arranged in the horizontal direction or the vertical direction.
- menu selection unit 456 may select menus arranged obliquely depending on the designated position.
- electronic device 100 the user can select a menu on a pattern such as an L shape.
- electronic device 100 according to the present embodiment makes it easy for the user to select menus arranged on a straight line.
- menu selection unit 456 numbers each provisionally selected menu in order from one end point of the broken line to the other end point.
- the menu selection unit 456 sets each menu in the order of the menu with (1) ⁇ ... ⁇ the menu with (2) ⁇ ... ⁇ the menu with (3). Number it.
- the menu selection unit 456 selects a menu surrounded by a frame and outputs the selected menu together with a number.
- the control unit 350 on the first unit 1001 side receives the output menu via the interface unit 440 and the interface unit 340.
- the control unit 350 on the first unit 1001 side causes the output unit 320 to output each menu in a manner based on the number.
- the display control unit 352 included in the control unit 350 causes the display unit 322 to display each menu in numerical order.
- the user can determine the menu output mode of the output unit 320 according to the menu selection order displayed on the liquid crystal panel 240. Therefore, the convenience of the menu selection for the user can be improved.
- FIG. 32 is a diagram for explaining a case where the menu selection method according to the present embodiment is used for creating a blog.
- FIG. 32 (a) is a diagram showing a selection screen for a file to be inserted into a blog.
- the liquid crystal panel 240 displays thumbnail images of a plurality of image files.
- menu selection unit 456 temporarily selects a plurality of thumbnail images based on the positions pressed by the user.
- the menu selection unit 456 assigns number 1 to the uppermost left image, number 2 to the uppermost center image, and number 3 to the uppermost right image based on the input start timing.
- FIG. 32B shows the display unit 322 on the first unit 1001 side (that is, the liquid crystal panel 140) when the determination button is pressed in a state where a plurality of thumbnail images are temporarily selected in FIG. FIG.
- the blog creation application embeds the selected thumbnail images in the blog in order from the upper left according to the number.
- the liquid crystal panel 140 displays the created blog.
- step S301 to step S307 is the same as the processing from step S101 to step S107 in FIG. 29 described in the first embodiment, and description thereof will not be repeated.
- the menu selection unit 456 can perform single selection.
- step S309 the menu selection unit 456 temporarily selects content. Details of step S309 will be described later.
- step S311 the menu selection unit 456 highlights the content provisionally selected in step S109.
- the menu selection unit 456 determines whether there has been an instruction to cancel the temporary selection. For example, the menu selection unit 456 regards the re-pressing of the temporarily selected content as a temporary selection cancel instruction. Alternatively, menu selection unit 456 may regard the end of the second or later (including second) selection instruction as a cancellation instruction for the selection instruction.
- menu selection unit 456 cancels the temporary selection in response to the cancel instruction, and repeats the processing from step S301.
- menu selection unit 456 further determines whether a selection instruction has been accepted.
- menu selection unit 456 repeats the processing from step S309.
- menu selection unit 456 determines whether there has been a selection decision instruction. In the present embodiment, menu selection unit 456 determines that there has been a selection decision instruction when the designated position output from position calculation unit 454 is within the display area of decision button 500.
- cancel instruction and the selection determination instruction are not limited to those described above.
- menu selection unit 456 repeats the processing from step S313.
- step S317 the menu selection unit 456 determines the temporarily selected content as the selected content, and outputs the selected content toward the first unit 1001. Specifically, menu selection unit 456 outputs the selected content to interface unit 440.
- the interface unit 440 outputs the selected content to the interface unit 340 on the first unit 1002 side.
- the interface unit 340 passes the selected content to the control unit 350.
- Control unit 350 performs predetermined processing on the selected content.
- step S401 the menu selection unit 456 acquires the newest designated coordinates (Xn + 1, Yn + 1).
- n is an integer of 1 or more representing the order of the designated coordinates.
- step S403 the menu selection unit 456 obtains a line segment Ln connecting (Xn, Yn) and (Xn + 1, Yn + 1).
- step S405 the menu selection unit 456 sequentially searches the content on the line segment Ln from (Xn, Yn) to (Xn + 1, Yn + 1). Specifically, for example, the menu selection unit 456 selects content whose coordinates (xi, yi) included in the display image corresponding to the content match the coordinates on the line segment Ln as content on the line segment Ln. Search as.
- step S407 the menu selection unit 456 provisionally selects the content on the line segment Ln with serial numbers according to the search order.
- Menu selection unit 456 sets the temporarily selected content together with the content temporarily selected so far as a new temporarily selected content.
- the electronic device 100 according to the third embodiment has the same hardware configuration and functional configuration as the electronic device 100 according to the first embodiment. However, the contents of the display data 434 and the processing performed by the menu selection unit 456 are different.
- the display data 434 includes data on the menu display order.
- the menu selection unit 456 accepts input of two designated positions at the same time, the menu selecting unit 456 selects menus having a continuous display order with the menus corresponding to the two designated positions being input as both ends.
- FIG. 35A is a diagram showing a display screen of the liquid crystal panel 240 when the finger 900 presses the first menu.
- menu selection unit 456 updates display data 434 so that the pressed menu is displayed surrounded by a frame.
- FIG. 35A also shows an arrow indicating the flow of the menu display order.
- the display order increases or decreases in order from one end of the arrow to the other end.
- the display order is assumed to be along the horizontal direction, but the display order is not limited to this.
- the display order may be along the horizontal direction.
- FIG. 35B is a diagram illustrating a display screen of the liquid crystal panel 240 when the finger 900 # presses the second menu while the finger 900 presses the first menu.
- menu selection unit 456 updates display data 434 such that a menu having a first menu and a second menu as both ends and a menu in which the display order is continuous is surrounded by a frame.
- the menu selection unit 456 assigns numbers (1 to 6 in the figure) according to the flow of the display order to each content from the first menu to the second menu. Note that the menu selection unit 456 assigns a number to each content from the menu with the earlier start timing of the corresponding selection instruction to the other menu. For example, in FIG. 35B, when the input start timing with the finger 900 and the input start timing with the finger 900 # are opposite, numbers 1 to 6 in the figure are 6 to 1, respectively.
- the menu selection unit 456 can select a menu more in accordance with the user's intention. This is because it is expected that the menu that the user first selected is often the menu that the user wanted to select preferentially.
- FIG. 35C shows that the liquid crystal panel 140 of the liquid crystal panel 240 is displayed when the finger 900 ## presses the enter button 500 while the finger 900 presses the first menu and the finger 900 # presses the second menu. It is a figure which shows a display screen. 35A and 35B, the liquid crystal panel 240 is drawn without the display area of the enter button 500.
- the menu selection unit 456 determines the temporarily selected menu as the selection menu, and outputs the selection menu to the interface unit 440.
- the interface unit 440 that has received the selection menu sends the selection menu to the interface unit 340 on the first unit 1001 side.
- the control unit 350 on the first unit 1001 side performs a predetermined process on the selection menu.
- control unit 350 performs processing corresponding to the number assigned to each selection menu.
- 35A to 35C show an example in which the control unit 350 displays the selection menu on the display unit 322 in the order corresponding to the numbers.
- menu selection unit 456 The rough flow of processing performed by the menu selection unit 456 is the same as that described with reference to FIG. 29 in the first embodiment, and therefore will not be repeated. However, menu selection unit 456 is different from the first embodiment in the processing performed in step S109 (content selection) in FIG.
- step S501 the menu selection unit 456 acquires the first designated coordinates (X1, Y1).
- step S503 the menu selection unit 456 acquires the second designated coordinates (X2, Y2).
- step S505 the menu selection unit 456 determines a first selected image corresponding to the first designated coordinate. Specifically, the menu selection unit 456 determines, for example, the content corresponding to the display image including the coordinates (xi, yi) matching the first designated coordinates (X1, Y1) as the selected image.
- the menu selection unit 456 determines a second selected image corresponding to the second designated coordinates. Specifically, the menu selection unit 456 determines, for example, the content corresponding to the display image including the coordinates (xi, yi) matching the second designated coordinates (X2, Y2) as the selected image.
- step S509 the menu selection unit 456 determines, as selection images, all display images that have the first selection image and the second selection image as both ends and display sequences are continuous.
- step S511 the menu selection unit 456 gives a number along the flow of the display order to the selected image.
- menu selection unit 456 assigns a number to each selected image in order from the first selected image whose input start timing is early to the second selected image.
- Electronic device 100 according to the fourth embodiment can set an anchor for selecting a plurality of menus. Moreover, the electronic device 100 according to the fourth embodiment can scroll the screen. Hereinafter, these operations will be described in detail. Note that the hardware configuration and the functional configuration (except for the function of the menu selection unit 456) of the electronic device 100 according to the fourth embodiment are the same as those in the first embodiment, and thus will not be repeated.
- the menu selection unit 456 basically selects a menu in the same manner as the menu selection unit 456 according to the third embodiment. That is, when there are two different menu selection instructions at the same time, the two menus that are instructed are used as both ends, and a menu in which the display order is continuous is temporarily selected.
- menu selection unit 456 according to the present embodiment is different from menu selection unit 456 according to the third embodiment in the following points.
- Menu selection unit 456 sets an anchor in the menu when a plurality of designated positions are simultaneously included in the display area of one menu. When an anchor is set in two different menus, menu selection unit 456 temporarily selects a plurality of menus having a continuous display order with the two menus having the anchor set as both ends.
- FIG. 37A is a diagram illustrating a state where the finger 900 and the finger 900 # touch one menu displayed on the liquid crystal panel 240.
- FIG. 456 sets an anchor in the menu.
- FIG. 37B is a diagram showing a display screen of the liquid crystal panel 240 after the menu selection unit 456 sets an anchor in the menu.
- the menu selection unit 456 updates the display data 434 so that the menu set with the anchor is specifically displayed.
- an anchored menu is surrounded by a dotted line, and an arrow is drawn on the menu.
- Menu selection unit 456 does not cancel the anchor setting for the menu even if finger 900 and finger 900 # are released from the menu in which the anchor is set.
- FIG. 37 (c) is a diagram illustrating a state in which the finger 900 and the finger 900 # touch one menu that is not set with the anchor displayed on the liquid crystal panel 240.
- menu selection unit 456 temporarily selects a plurality of menus having two menus with anchors at both ends and having a continuous display order.
- a menu temporarily selected by the menu selection unit 456 is shown in FIG. In this case, menu selection unit 456 temporarily selects all menus displayed on liquid crystal panel 240. Note that the menu selection unit 456 may attach a number corresponding to the display order to the temporarily selected menu as in the third embodiment.
- menu selection unit 456 scrolls the display screen when there is a continuous movement of the designated position, that is, a so-called drag operation. That is, menu selection unit 456 scrolls the display screen by an amount of movement based on the input displacement of the designated position when it receives an input of the designated position from time calculation unit 454 in a time sequence.
- FIG. 38A is a diagram for explaining a display screen of the liquid crystal panel 240 when the finger 900 presses one menu (indicated by a frame in the drawing).
- the finger 900 presses the lower menu in FIG. 38 in the liquid crystal panel 240.
- FIG. 38B shows a display screen of the liquid crystal panel 240 when the user slides the finger 900 on the liquid crystal panel 240 from the position of FIG. 38A to the position indicated by the dotted line in FIG. It is a figure for demonstrating.
- the menu selection unit 456 scrolls the display screen downward. That is, the menu selection unit 456 updates the display data 434 so that the liquid crystal panel 240 displays a menu below the menu displayed in FIG. For the user, it feels as if the menu pressed by the finger 900 is pulled up as the finger 900 moves.
- menu selection unit 456 scrolls the display screen up.
- menu selection unit 456 may perform scrolling in the left-right direction.
- menu selection unit 456 can execute a combination of anchor setting and scrolling. An example of such a menu selection operation will be described with reference to FIGS.
- FIG. 39A is a diagram illustrating a state where the user drags the finger 900 from the bottom of the display screen of the liquid crystal panel 240 to the top.
- FIG. 39B is a diagram showing the display screen after dragging in FIG. The display screen scrolls down.
- FIG. 39 (c) is a diagram illustrating a state where the user presses one menu in the display screen after scrolling with the finger 900.
- FIG. 39D is a diagram showing a display screen when the user releases the finger 900 from the menu.
- Menu selection unit 456 selects a single menu.
- FIG. 40 (a) is a diagram showing a state where the user drags the finger 900 from the top to the bottom of the display screen of the liquid crystal panel 240 in the state shown in FIG. 39 (d).
- FIG. 40B is a diagram showing the display screen after dragging in FIG. The display screen scrolls up.
- FIG. 40C is a diagram illustrating a state where the user presses one menu in the display screen after scrolling with the finger 900 and the finger 900 #.
- FIG. 40D is a diagram showing a display screen after the user presses the menu with the finger 900 and the finger 900 #.
- Menu selection unit 456 sets an anchor to the menu pressed with finger 900 and finger 900 #.
- FIG. 41 (a) is a diagram showing a state where the user drags the finger 900 from the bottom to the top of the display screen of the liquid crystal panel 240 in the state shown in FIG. 40 (d).
- FIG. 41B is a diagram showing the display screen after dragging in FIG. The display screen scrolls down.
- FIG. 41C is a diagram showing a state where the user presses one menu (anchor is not set) in the display screen after scrolling with the finger 900 and the finger 900 #.
- FIG. 41D shows a display screen after the user presses the menu with the finger 900 and the finger 900 #.
- Menu selection unit 456 temporarily selects a menu sandwiched between menus to which anchors are set.
- the combination of the anchor setting and the scroll allows the user to simultaneously select a menu within a range that does not fit on one screen of the liquid crystal panel 240.
- step S601 the menu selection unit 456 determines whether a first selection instruction (for the sake of simplicity, the first input is shown in the figure) is received from the position calculation unit 454.
- menu selection unit 456 repeats the process of step S601.
- step S603 menu selection unit 456 highlights the content corresponding to the first selection instruction.
- menu selection unit 456 determines whether there is a drag operation. Menu selection unit 456 determines that there is a drag operation when the indicated position output by position calculating unit 454 is continuous in time and the indicated position moves.
- menu selection unit 456 scrolls the display screen by the amount of movement based on the change in the designated position in step S607.
- menu selection unit 456 determines in step S609 whether there is a second selection instruction (second input in the figure).
- menu selection unit 456 determines in step S611 whether the first selection instruction has ended.
- menu selection unit 456 repeats the processing from step S605.
- menu selection unit 456 provisionally selects content corresponding to the first selection instruction in step S613. Thereafter, menu selection unit 456 proceeds to the processing after step S615. The processing after step S615 will be described later.
- menu selection unit 456 determines whether two display areas (one area) corresponding to one content have been touched in step S623. to decide. That is, menu selection unit 456 determines whether or not the instruction positions of the first selection instruction and the second selection instruction are included in one common area.
- menu selection unit 456 provisionally selects content in step S625.
- menu selection unit 456 performs the same process as described with reference to FIG. 36 in the third embodiment. Thereafter, menu selection unit 456 proceeds to the processing after step S615. The processing after step S615 will be described later.
- menu selection unit 456 determines in step S627 whether content other than the content corresponding to the area touched by two points has an anchor setting. to decide.
- menu selection unit 456 sets an anchor in the content corresponding to the area touched by two points in step S629. Thereafter, menu selection unit 456 repeats the processing from step S601.
- menu selection unit 456 is sandwiched in step S631 between the content for which the anchor has already been set and the content corresponding to the area touched by two points. Temporarily select content. Thereafter, menu selection unit 456 proceeds to the processing after step S615.
- step S615 the menu selection unit 456 highlights the temporarily selected content.
- step S617 the menu selection unit 456 determines whether there has been an instruction to cancel the temporary selection. For example, the menu selection unit 456 regards the re-pressing of the temporarily selected content as a temporary selection cancel instruction.
- menu selection unit 456 cancels the temporary selection in response to the cancel instruction, and repeats the processing from step S601.
- menu selection unit 456 determines whether there is a selection decision instruction. For example, menu selection unit 456 determines that there has been a selection decision instruction when the designated position output from position calculation unit 454 is within the display area of decision button 500.
- menu selection unit 456 repeats the processing from step S617.
- step S621 the menu selection unit 456 determines the temporarily selected content as the selected content, and outputs the selected content toward the first unit 1001. Specifically, menu selection unit 456 outputs the selected content to interface unit 440.
- the interface unit 440 outputs the selected content to the interface unit 340 on the first unit 1002 side.
- the interface unit 340 passes the selected content to the control unit 350.
- Control unit 350 performs predetermined processing on the selected content. Here, control unit 350 may perform processing on the selected content according to the number corresponding to the display order given to the selected content.
- menu selection unit 456 displays switching button 600 on liquid crystal panel 240.
- the switching button 600 shows the current determination order.
- FIG. 43A is a diagram for explaining the determination order when the determination order is “horizontal selection”. At this time, the order of determination is the same as that shown in FIG. 35A.
- FIG. 43B is a diagram for explaining the determination order when the determination order is “vertical selection”.
- menu selection unit 456 assigns a number to the selection menu along the arrow in FIG.
- menus can be selected in various patterns by switching the determination order. This will be described with reference to FIGS. 44 and 45.
- FIG. 44A shows a state in which the user presses one menu in the liquid crystal panel 240 with the finger 900.
- FIG. 44B is a diagram showing a state in which the user presses a menu other than the menu pressed in FIG. 44A in the liquid crystal panel 240 with the finger 900 #. Since two menus are pressed at the same time, the menu selection unit 456 temporarily selects a menu having the pressed menu as both ends. At this time, since the determination order is horizontal selection, the menu indicated by the diagonal lines in FIG. 44B is provisionally selected.
- FIG. 44 (c) is a diagram illustrating a state where the user presses the switching button 600 with a finger after the temporary selection in FIG. 44 (b). By this operation, menu selection unit 456 switches the determination order to vertical selection.
- FIG. 44D is a diagram showing a display screen after the determination order is switched.
- FIG. 45 (a) is a diagram showing a state where the user presses one menu in the liquid crystal panel 240 that is not temporarily selected with the finger 900 in the state shown in FIG. 44 (d).
- FIG. 44 (b) is a diagram showing a state in which the user has pressed a menu that is not temporarily selected in the liquid crystal panel 240 with the finger 900 # and was not pressed in FIG. 45 (a). Since two menus are pressed at the same time, the menu selection unit 456 temporarily selects a menu having the pressed menu as both ends. At this time, since the determination order is vertical selection, the menu indicated by the diagonal lines in FIG. 45B is provisionally selected.
- FIG. 45 (c) shows a state where the user presses the decision button 500 with the finger 900 after the provisional selection in FIG. 45 (b).
- menu selection unit 456 determines the temporarily selected menu as the selection menu, and outputs the selection menu.
- the user can select menus in more diverse patterns. For example, when the menu cannot be displayed in the vertical direction, the user can select the menu in the vertically long area by using the anchor and the scroll after setting the determination order to the vertical selection.
- 100 electronic device 100A casing, 100B casing, 100C hinge, 101 main unit, 102 display unit, 102A display unit, 103 display unit, 104 main unit, 130 driver, 131 scanning signal line drive circuit, 132 data signal line drive Circuit, 133 photosensor driving circuit, 134 switch, 135 amplifier, 140 photosensor built-in liquid crystal panel, 140A photosensor built-in liquid crystal panel, 141 pixel circuit, 141b subpixel circuit, 141g subpixel circuit, 141r subpixel circuit, 143 electrode pair , 143a pixel electrode, 143b counter electrode, 144 photosensor circuit, 145 photodiode, 145b photodiode, 145g photodiode, 145r photodiode, 146 con Sensor, 151A active matrix substrate, 151B counter substrate, 152 liquid crystal layer, 153b color filter, 153g color filter, 153r color filter, 157 data signal line, 161 polarization filter, 162 glass substrate, 163 light shielding film, 164 alignment
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Description
好ましくは、出力部は、モニタを含む。
好ましくは、表示一体型タブレットは、光センサ内蔵液晶パネルである。
<電子機器の外観>
図1は、本実施の形態に係る電子機器100の外観を示した図である。図1を参照して、電子機器100は、第1の筐体100Aと第2の筐体100Bとを含む。
次に、図2を参照して、電子機器100の具体的構成の一態様について説明する。図2は、電子機器100のハードウェア構成を表わすブロック図である。
本体装置101は、CPU(Central Processing Unit)110と、RAM(Random Access Memory)171と、ROM(Read-Only Memory)172と、メモリカードリーダライタ173と、外部通信部174と、マイク175と、スピーカ176と、操作キー177と、電源スイッチ191と、電源回路192と、電源検出部193と、USB(Universal Serial Bus)コネクタ194と、アンテナ195と、LAN(Local Area Network)コネクタ196とを含む。各構成要素(110,171~177,193)は、相互にデータバスDB1によって接続されている。メモリカードリーダライタ173には、メモリカード1731が装着される。
電源スイッチ191がオンすると、電源回路192は、電源検出部193を介して、データバスDB1に接続されている各構成要素と表示装置102とに電力を供給する。また、電源スイッチ191がオンすると、電源回路192は、電源検出部193を介することなく、外部通信部174に電力を供給する。
信号処理部183は、上記光センサから出力されるデータを受け取る。ここで、上記光センサから出力されるデータはアナログデータであるため、信号処理部183は、まず当該アナログデータをデジタルデータに変換する。さらに、信号処理部183は、当該デジタルデータに対して、本体装置101から送られてくるコマンドの内容に応じたデータ処理を行う。そして、信号処理部183は、上記データ処理を行った後のデータと、タイマ182から取得した時刻情報とを含んだデータ(以下、応答データと称する)を本体装置101に送る。また、信号処理部183は、後述するスキャンデータを連続して複数格納できるRAM(図示せず)を備えている。
第2ユニット1002は、第1ユニット1001から電力の供給を受ける。具体的には、後述するUSBコネクタ294と第1ユニット1001のUSBコネクタ194とを接続することにより、第2ユニット1002は、第1ユニット1001の電源回路192から電力の供給を受ける。
表示装置103は、ドライバ230と、光センサ内蔵液晶パネル240(以下、「液晶パネル240」と称する)と、内部IF278と、バックライト279と、画像処理エンジン280とを含む。画像処理エンジン280は、ドライバ制御部281と、タイマ282と、信号処理部283とを含む。
次に、液晶パネル140の構成と、当該液晶パネル140の周辺回路の構成とについて説明する。図3は、液晶パネル140の構成と、当該液晶パネル140の周辺回路とを示した図である。
それゆえ、ノードNの電位は、図5に示すとおり、電圧VDDRよりもVfだけ小さな値となる。
ところで、本実施の形態においては、電子機器100の表示装置として液晶パネルを例に挙げて説明しているが、液晶パネルの代わりに有機EL(Electro-Luminescence)パネルなどの他のパネルを用いてもよい。
次に、第1ユニット1001と第2ユニット1002との間でやり取りされるコマンド、および第1ユニット1001内の本体装置101と表示装置102との間でやり取りされるコマンドについて説明する。
ところで、液晶パネル140の構成は、図3に示した構成に限定されるものではない。以下では、図3とは異なる態様の液晶パネルについて説明する。
表示装置103の動作は、表示装置102の動作と同様、本体装置101からのコマンド(たとえば、第1コマンド)に応じて制御される。表示装置103は表示装置102と同様な構成を有する。それゆえ、表示装置103が表示装置102と同じコマンドを本体装置101から受け付けた場合、表示装置103は表示装置102と同様の動作を行う。このため、表示装置103の構成や動作についての説明は繰り返さない。
本実施の形態では、電子機器100が、液晶パネル140と液晶パネル240といったそれぞれに光センサを内蔵した液晶パネルを備える構成について説明するが、一方の液晶パネルのみが光センサを内蔵している構成であってもよい。
本実施の形態に係る電子機器100の機能的構成を図19を参照して説明する。図19を参照して、電子機器100は、すでに説明したように、第1ユニット1001と、第2ユニット1002とを備える。
(概要)
電子機器100の使用の際、複数のファイルの指定が必要となることがある。電子機器100は、ユーザによる複数のファイルの指定を容易にする。電子機器100の動作の概要を図20を参照して説明する。図20では、一例として、電子メールに複数のファイルを添付する際の電子機器100の動作を示している。
本実施の形態に係る電子機器100が、液晶パネル240への入力に応じて、メニューを選択する規則について、より詳しく説明する。
図21は、電子機器100が横方向に並んだメニューを選択する動作を説明する図である。図21を参照して、電子機器100のユーザは、同時に、指900と指900#とで左上のサムネイル上の領域および右上のサムネイル上の領域をそれぞれ押さえている。このとき、位置算出部454は、2つの指示位置を同時に出力する。したがって、メニュー選択部456は、2つの指示位置で指定される矩形領域あるいは線分上のサムネイルを仮選択する。
以上では、メニュー選択部456が、複数のメニューを選択する規則および動作例について説明してきた。ここからは、メニュー選択部456が、単一のメニューを選択する規則および動作例について説明する。
さらに、メニュー選択部456は、仮選択されたメニューへの再度の押下に応じて、メニューの仮選択を解除する。これにより、ユーザは、意図しないメニューを押下した場合に、押下したメニューの仮選択を解除できる。
本実施の形態では、メニュー選択部456は、仮選択処理と、選択決定指示とを用いてメニューの選択を行なう。したがって、メニュー選択部456は、複数回の仮選択を行なったあとに、選択決定指示を出すことで、様々な選び方でメニューを選択することができる。このような選択方法を複合選択と呼ぶ。
ここからは、メニュー選択部456が行なう処理の流れを図29を参照して説明する。ここでは、図20等に示した例に即して、サムネイル画像などのコンテンツの選択処理について説明するものの、この説明は、一般的なメニューの選択処理にもあてはまる。
第2の実施の形態に係る電子機器100は、第1の実施の形態に係る電子機器100と同様のハード構成および機能的構成を有する。ただし、メニュー選択部456の行なう処理が異なる。
図31(a)は、指900が第1のメニュー(図中(1)を付したメニュー)を押さえたときの液晶パネル240の表示画面を示す図である。図31(a)を参照して、メニュー選択部456は、押下されているメニューが枠で囲んで表示されるように表示データ434を更新する。このようにメニューの表示形態を変えることで、ユーザは、どのメニューが押下されているかを把握しやすくなる。なお、メニュー選択部456は、メニューを枠で囲む以外の方法で、押下されているメニューが特定的に表示されるように表示データ434を更新してもよい。
第3の実施の形態に係る電子機器100は、第1の実施の形態に係る電子機器100と同様のハード構成および機能的構成を有する。ただし、表示データ434の内容およびメニュー選択部456の行なう処理が異なる。
第4の実施の形態に係る電子機器100は、複数メニューを選択するためのアンカーを設定できる。また、第4の実施の形態に係る電子機器100は、画面をスクロールできる。以下、これらの動作について詳しく説明する。なお、第4の実施の形態に係る電子機器100のハード構成および機能的構成(メニュー選択部456の機能を除く)は、第1の実施の形態と同様であるので繰り返さない。
ここでは、サムネイル画像などのコンテンツの選択処理について説明するものの、この説明は、一般的なメニューの選択処理にもあてはまる。
第3の実施の形態および第4の実施の形態では、表示画面内でのメニュー選択を決める決定順序は固定されているものとして説明を進めてきた。これに対し、第5の実施の形態に係る電子機器100は、この決定順序を切り替えることができる。
できる。
上記の各実施の形態を適宜組み合わせたものも、本発明の一態様としてみなすことができる。
Claims (16)
- 電子機器(100)であって、
複数のメニューを格納するための記憶部(430)と、
多点入力可能な表示一体型タブレット(410)と、
前記複数のメニューを含む表示画面を前記表示一体型タブレットに表示するための表示制御部(452)と、
前記表示一体型タブレットへの入力がなされている間、前記入力に応じた指示位置を出力するための入力処理部(454)と、
同時に出力されている複数の前記指示位置に基づいて前記メニューを選択するための選択部(456)と、
選択された前記メニューを出力するための出力部(240)とを備える、電子機器。 - 前記選択部は、同時に出力されている2つの前記指示位置に挟まれる前記メニューを選択する、請求の範囲第1項に記載の電子機器。
- 前記選択部は、同時に出力されている2つの前記指示位置を対角の頂点とする矩形内の前記メニューを選択する、請求の範囲第2項に記載の電子機器。
- 前記選択部は、同時に出力されている2つの前記指示位置を端点とする線分上にある前記メニューを選択する、請求の範囲第2項に記載の電子機器。
- 前記記憶部は、各前記入力の開始タイミングを格納し、
前記選択部は、各前記端点に対応する前記入力の前記開始タイミングの順序に基づいて、選択された前記メニューに、一方の前記端点から他方の前記端点に向けて順に選択番号を与え、
前記出力部は、選択番号に基づいて前記メニューを出力する、請求の範囲第4項に記載の電子機器。 - 前記記憶部は、各前記入力の開始タイミングを格納し、
前記選択部は、同時に出力されている複数の前記指示位置を、各前記指示位置に対応する前記入力の前記開始タイミングの順につないだ折れ線上の前記メニューを選択する、請求の範囲第1項に記載の電子機器。 - 前記選択部は、選択された前記メニューに、前記折れ線の一方の端点から前記折れ線の他方の端点に向けて順に選択番号を与え、
前記出力部は、前記選択番号に基づいて前記メニューを出力する、請求の範囲第6項に記載の電子機器。 - 前記記憶部は、前記表示画面中の各前記メニューの表示順を格納し、
前記選択部は、同時に入力されている2つの前記指示位置のそれぞれに対応する前記メニューを両端とし、連続する前記表示順をもつ複数の前記メニューを選択する、請求の範囲第1項に記載の電子機器。 - 前記選択部は、複数の前記指示位置により同時に指定された1つの前記メニューを仮選択し、仮選択された2つの前記メニューを両端とし、連続する前記表示順をもつ複数の前記メニューを選択する、請求の範囲第8項に記載の電子機器。
- 前記表示制御部は、前記指示位置の連続的な移動に応じて、前記表示画面をスクロールする、請求の範囲第9項に記載の電子機器。
- 前記出力部は、前記表示順に基づいて前記メニューを出力する、請求の範囲第8項に記載の電子機器。
- 前記出力部は、モニタを含む、請求の範囲第1項に記載の電子機器。
- 前記モニタは、光センサ内蔵液晶パネルである、請求の範囲第12項に記載の電子機器。
- 前記表示一体型タブレットは、光センサ内蔵液晶パネルである、請求の範囲第1項に記載の電子機器。
- 多点入力可能な表示一体型タブレットを有する電子機器によるメニューの選択方法であって、
複数の前記メニューを含む表示画面を前記表示一体型タブレットに表示するステップと、
前記表示一体型タブレットへの入力がなされている間、前記入力に応じた指示位置を出力するステップと、
同時に出力されている複数の前記指示位置に基づいて前記メニューを選択するステップとを備える、メニューの選択方法。 - 複数のメニューを表示し、多点入力可能な表示一体型タブレットを有する電子機器にメニューを選択させるメニューの選択プログラムであって、
前記電子機器は、前記表示一体型タブレットへの入力がなされている間、前記入力に応じた指示位置を出力するための入力処理部を含み、
前記入力処理部が前記指示位置を同時に複数出力しているかどうかを前記電子機器に判断させるステップと、
前記電子機器が前記入力処理部が前記指示位置を同時に複数出力していると判断した場合に、前記電子機器に、同時に出力されている複数の前記指示位置に基づいて前記表示一体型タブレットに表示されている前記複数のメニューの中からメニューを選択させるステップとを備える、メニューの選択プログラム。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN2009801435506A CN102203702B (zh) | 2008-10-30 | 2009-10-29 | 电子设备、菜单的选择方法、菜单的选择程序 |
US13/124,239 US9015625B2 (en) | 2008-10-30 | 2009-10-29 | Electronic device, method of selecting menu, and program for selecting menu |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2008-280100 | 2008-10-30 | ||
JP2008280100A JP5540344B2 (ja) | 2008-10-30 | 2008-10-30 | 電子機器、メニューの選択方法、メニューの選択プログラム |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010050547A1 true WO2010050547A1 (ja) | 2010-05-06 |
Family
ID=42128906
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2009/068571 WO2010050547A1 (ja) | 2008-10-30 | 2009-10-29 | 電子機器、メニューの選択方法、メニューの選択プログラム |
Country Status (4)
Country | Link |
---|---|
US (1) | US9015625B2 (ja) |
JP (1) | JP5540344B2 (ja) |
CN (1) | CN102203702B (ja) |
WO (1) | WO2010050547A1 (ja) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014164688A (ja) * | 2013-02-27 | 2014-09-08 | Kyocera Document Solutions Inc | 画像処理装置及びこれを備えた画像形成装置 |
JP2018133298A (ja) * | 2017-02-17 | 2018-08-23 | 積水化学工業株式会社 | 非水電解質二次電池 |
Families Citing this family (45)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
USD701880S1 (en) | 2010-12-28 | 2014-04-01 | Sony Corporation | Display panel or screen with graphical user interface |
EP2708995A4 (en) | 2011-05-12 | 2014-10-01 | Nec Casio Mobile Comm Ltd | ELECTRONIC DEVICE, METHOD FOR CONTROLLING IT AND PROGRAM THEREFOR |
US20130239051A1 (en) | 2012-03-06 | 2013-09-12 | Apple Inc. | Non-destructive editing for a media editing application |
US9569078B2 (en) | 2012-03-06 | 2017-02-14 | Apple Inc. | User interface tools for cropping and straightening image |
US20130239031A1 (en) * | 2012-03-06 | 2013-09-12 | Apple Inc. | Application for viewing images |
US9131192B2 (en) | 2012-03-06 | 2015-09-08 | Apple Inc. | Unified slider control for modifying multiple image properties |
AU2013259606B2 (en) | 2012-05-09 | 2016-06-02 | Apple Inc. | Device, method, and graphical user interface for displaying additional information in response to a user contact |
AU2013259630B2 (en) * | 2012-05-09 | 2016-07-07 | Apple Inc. | Device, method, and graphical user interface for transitioning between display states in response to gesture |
JP6182207B2 (ja) | 2012-05-09 | 2017-08-16 | アップル インコーポレイテッド | ユーザインタフェースオブジェクトのアクティブ化状態を変更するためのフィードバックを提供するためのデバイス、方法、及びグラフィカルユーザインタフェース |
CN108241465B (zh) | 2012-05-09 | 2021-03-09 | 苹果公司 | 用于针对在用户界面中执行的操作提供触觉反馈的方法和装置 |
WO2013169843A1 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for manipulating framed graphical objects |
WO2013169865A2 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for moving a user interface object based on an intensity of a press input |
JP6032794B2 (ja) * | 2012-06-08 | 2016-11-30 | 株式会社ジャパンディスプレイ | 液晶表示装置 |
JP2014048840A (ja) * | 2012-08-30 | 2014-03-17 | Sharp Corp | 表示装置、表示装置の制御方法、プログラムおよび記録媒体 |
TWI461896B (zh) * | 2012-11-07 | 2014-11-21 | Chih Chung Lin | 具光電轉換之觸控面板 |
USD749125S1 (en) | 2013-03-29 | 2016-02-09 | Deere & Company | Display screen with an animated graphical user interface |
JP6152730B2 (ja) * | 2013-07-18 | 2017-06-28 | 富士ゼロックス株式会社 | 情報処理装置及び情報処理プログラム |
USD741343S1 (en) * | 2013-09-06 | 2015-10-20 | Microsoft Corporation | Display screen with graphical user interface |
USD752599S1 (en) * | 2013-09-06 | 2016-03-29 | Microsoft Corporation | Display screen with graphical user interface |
JP6264997B2 (ja) * | 2014-03-27 | 2018-01-24 | 株式会社島津製作所 | 自動分析装置用制御装置 |
USD777783S1 (en) * | 2015-02-05 | 2017-01-31 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with icon |
USD777208S1 (en) * | 2015-02-27 | 2017-01-24 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with graphical user interface |
USD776156S1 (en) * | 2015-02-27 | 2017-01-10 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with graphical user interface |
US9632664B2 (en) | 2015-03-08 | 2017-04-25 | Apple Inc. | Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback |
US10095396B2 (en) | 2015-03-08 | 2018-10-09 | Apple Inc. | Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object |
US9639184B2 (en) | 2015-03-19 | 2017-05-02 | Apple Inc. | Touch input cursor manipulation |
US20170045981A1 (en) | 2015-08-10 | 2017-02-16 | Apple Inc. | Devices and Methods for Processing Touch Inputs Based on Their Intensities |
US9860451B2 (en) | 2015-06-07 | 2018-01-02 | Apple Inc. | Devices and methods for capturing and interacting with enhanced digital images |
US9830048B2 (en) | 2015-06-07 | 2017-11-28 | Apple Inc. | Devices and methods for processing touch inputs with instructions in a web page |
KR20160148771A (ko) * | 2015-06-16 | 2016-12-27 | 엔에이치엔엔터테인먼트 주식회사 | 파일 일괄 처리 방법 및 이에 따른 프로그램을 수행하는 디지털 디바이스 |
US9880735B2 (en) | 2015-08-10 | 2018-01-30 | Apple Inc. | Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback |
USD847308S1 (en) * | 2016-12-15 | 2019-04-30 | Spectrum Brands, Inc. | Faucet with a set of icons |
CN108664080A (zh) * | 2017-03-31 | 2018-10-16 | 华硕电脑股份有限公司 | 控制方法、电子装置及非瞬时电脑可读取记录介质 |
CN107122077B (zh) * | 2017-05-02 | 2020-06-02 | 上海天马微电子有限公司 | 一种触控显示装置 |
KR102413936B1 (ko) | 2018-02-21 | 2022-06-28 | 삼성전자주식회사 | 스위치를 갖는 디스플레이를 포함하는 전자장치 |
JP7081964B2 (ja) * | 2018-04-12 | 2022-06-07 | シャープ株式会社 | 情報処理装置、情報処理方法、及びプログラム |
JP1661812S (ja) | 2019-05-16 | 2020-06-15 | 内視鏡用プロセッサ | |
USD925568S1 (en) * | 2019-05-16 | 2021-07-20 | Hoya Corporation | Display screen with transitional graphical user interface |
USD925567S1 (en) * | 2019-05-16 | 2021-07-20 | Hoya Corporation | Display screen with transitional graphical user interface |
USD924914S1 (en) | 2019-05-16 | 2021-07-13 | Hoya Corporation | Display screen with transitional graphical user interface |
USD959481S1 (en) * | 2020-10-01 | 2022-08-02 | Botrista Technology, Inc. | Display screen or portion thereof with graphical user interface |
USD959480S1 (en) * | 2020-10-01 | 2022-08-02 | Botrista Technology, Inc. | Display screen or portion thereof with animated graphical user interface |
USD938475S1 (en) * | 2020-10-01 | 2021-12-14 | Botrista Technology, Inc. | Display screen or portion thereof with graphical user interface |
USD980856S1 (en) * | 2021-04-08 | 2023-03-14 | Botrista Technology, Inc. | Display screen or portion thereof with animated graphical user interface |
USD949919S1 (en) * | 2021-04-12 | 2022-04-26 | Xiamen Sienluo Trading Co., Ltd. | Display screen or portion thereof with graphical user interface |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07261932A (ja) * | 1994-03-18 | 1995-10-13 | Hitachi Ltd | センサ内蔵型液晶表示装置及びこれを用いた情報処理システム |
JP2001356878A (ja) * | 2000-06-14 | 2001-12-26 | Hitachi Ltd | アイコン制御方法 |
JP2007156983A (ja) * | 2005-12-07 | 2007-06-21 | Toshiba Corp | 情報処理装置およびタッチパッド制御方法 |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000339097A (ja) | 1998-12-16 | 2000-12-08 | Sony Corp | 情報処理装置およびその制御方法、並びに記録媒体 |
US6560612B1 (en) * | 1998-12-16 | 2003-05-06 | Sony Corporation | Information processing apparatus, controlling method and program medium |
US7469381B2 (en) * | 2007-01-07 | 2008-12-23 | Apple Inc. | List scrolling and document translation, scaling, and rotation on a touch-screen display |
ATE362131T1 (de) * | 2000-10-04 | 2007-06-15 | Siemens Ag | Kraftfahrzeug-multimediasystem mit animierter anzeigefunktion |
DE10207185A1 (de) * | 2002-02-21 | 2003-09-04 | Kid Systeme Gmbh | Verfahren zur Selektion und Darstellung von Objekten in der Ebene und im N-dimensionierten Raum |
JP4039660B2 (ja) | 2002-05-31 | 2008-01-30 | 株式会社東芝 | 情報処理装置 |
JP3892760B2 (ja) * | 2002-05-31 | 2007-03-14 | 株式会社東芝 | 情報処理装置 |
JP4217051B2 (ja) * | 2002-10-31 | 2009-01-28 | キヤノンイメージングシステムズ株式会社 | 情報処理装置、オブジェクト選択方法、及びオブジェクト選択プログラム |
JP3811128B2 (ja) | 2003-01-31 | 2006-08-16 | 株式会社東芝 | 情報処理装置およびポインタの操作方法 |
KR100672605B1 (ko) * | 2006-03-30 | 2007-01-24 | 엘지전자 주식회사 | 아이템 선택 방법 및 이를 위한 단말기 |
JP2008191779A (ja) * | 2007-02-01 | 2008-08-21 | Sony Corp | 表示制御装置および方法、並びにプログラム |
US20080229232A1 (en) * | 2007-03-16 | 2008-09-18 | Apple Inc. | Full screen editing of visual media |
US7936341B2 (en) * | 2007-05-30 | 2011-05-03 | Microsoft Corporation | Recognizing selection regions from multiple simultaneous inputs |
-
2008
- 2008-10-30 JP JP2008280100A patent/JP5540344B2/ja not_active Expired - Fee Related
-
2009
- 2009-10-29 US US13/124,239 patent/US9015625B2/en not_active Expired - Fee Related
- 2009-10-29 CN CN2009801435506A patent/CN102203702B/zh not_active Expired - Fee Related
- 2009-10-29 WO PCT/JP2009/068571 patent/WO2010050547A1/ja active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07261932A (ja) * | 1994-03-18 | 1995-10-13 | Hitachi Ltd | センサ内蔵型液晶表示装置及びこれを用いた情報処理システム |
JP2001356878A (ja) * | 2000-06-14 | 2001-12-26 | Hitachi Ltd | アイコン制御方法 |
JP2007156983A (ja) * | 2005-12-07 | 2007-06-21 | Toshiba Corp | 情報処理装置およびタッチパッド制御方法 |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014164688A (ja) * | 2013-02-27 | 2014-09-08 | Kyocera Document Solutions Inc | 画像処理装置及びこれを備えた画像形成装置 |
US9223485B2 (en) | 2013-02-27 | 2015-12-29 | Kyocera Documents Solutions Inc. | Image processing apparatus, image forming apparatus including same, and method for controlling image processing apparatus |
JP2018133298A (ja) * | 2017-02-17 | 2018-08-23 | 積水化学工業株式会社 | 非水電解質二次電池 |
Also Published As
Publication number | Publication date |
---|---|
JP5540344B2 (ja) | 2014-07-02 |
CN102203702A (zh) | 2011-09-28 |
US9015625B2 (en) | 2015-04-21 |
CN102203702B (zh) | 2013-09-11 |
US20110202875A1 (en) | 2011-08-18 |
JP2010108277A (ja) | 2010-05-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5540344B2 (ja) | 電子機器、メニューの選択方法、メニューの選択プログラム | |
JP5278948B2 (ja) | オブジェクト表示装置、オブジェクト表示方法、およびオブジェクト表示プログラム | |
WO2010050477A1 (ja) | 2つの表示装置を有する電子機器、その制御方法および記録媒体 | |
JP5240773B2 (ja) | 情報処理装置、情報処理方法および情報処理プログラム | |
JP5322163B2 (ja) | 表示装置、表示方法、および表示プログラム | |
JP2011008424A (ja) | 電子機器、動作モード設定方法、およびプログラム | |
JP2010134625A (ja) | 電子機器、表示制御方法、およびプログラム | |
JP5303785B2 (ja) | 表示装置、表示方法、および表示プログラム | |
JP5526397B2 (ja) | コンテンツ表示装置、コンテンツ表示方法、およびコンテンツ表示プログラム | |
JP5526400B2 (ja) | 電子機器、情報処理システム、電子機器の制御方法および電子機器の制御プログラム | |
JP5707029B2 (ja) | 電子機器、電子機器の制御方法および電子機器の制御プログラム | |
JP5344555B2 (ja) | オブジェクト表示装置、オブジェクト表示方法、およびオブジェクト表示プログラム | |
JP5126895B2 (ja) | 電子機器、および表示制御方法 | |
JP5617120B2 (ja) | 電子機器、表示制御方法、およびプログラム | |
JP5110594B2 (ja) | 情報処理装置、情報処理方法、および情報処理プログラム | |
JP5322161B2 (ja) | 電子機器、情報処理システム、電子機器の制御方法および電子機器の制御プログラム | |
JP2010204729A (ja) | テキスト表示装置、テキスト表示方法、およびテキスト表示プログラム | |
JP5380729B2 (ja) | 電子機器、表示制御方法、およびプログラム | |
WO2010103888A1 (ja) | コンテンツ表示装置、コンテンツ表示方法、およびコンテンツ表示プログラムを記録するコンピュータ読取可能な記録媒体 | |
JP5289889B2 (ja) | 表示装置、表示装置の制御方法、表示装置を制御するためのプログラム | |
JP5257892B2 (ja) | 電子機器、画面切替方法および画面切替プログラム | |
JP2010108373A (ja) | 電子機器、アプリケーションプログラム、情報処理端末およびその制御プログラム | |
JP2011008425A (ja) | 電子機器、動作モード設定方法、およびプログラム | |
JP5172641B2 (ja) | 電子機器、情報処理方法および情報処理プログラム | |
JP2010211384A (ja) | 電子機器、電子機器の制御方法および電子機器の制御プログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200980143550.6 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09823657 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13124239 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 3650/CHENP/2011 Country of ref document: IN |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 09823657 Country of ref document: EP Kind code of ref document: A1 |