JP2020061085A - Information processing apparatus, control method, and program - Google Patents

Abstract

To realize good user experience.SOLUTION: An information processing apparatus comprises: a foldable touch screen that has a display unit and a detection unit that detects a touch position at which a display surface of the display unit is touched by an operating medium; and a detection processing unit that, in a state where the touch screen itself is folded with the display surface on the outside, outputs position information indicating a position on a second display area that is a display area on the front side of the display surface, based on a first touch position that is the touch position for a first display area that is a display area on the back side of the display surface.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an information processing device, a control method, and a program.

  2. Description of the Related Art In recent years, information processing devices such as portable personal computers and PDAs (Personal Digital Assistants) are known that include a plurality of touch screens each having a display and a touch panel that functions as an input device by directly touching the screen of the display. (For example, see Patent Document 1).

JP, 2013-47975, A

  By the way, attempts are being made to mount a foldable display using an OLED (Organic Light Emitting Diode) or the like on a touch screen display in an information processing apparatus. In the information processing apparatus including such a foldable touch screen, various usage patterns are possible by folding the touch screen, and it is desired to realize good user experience according to the usage patterns. There is.

  The present invention has been made to solve the above problems, and an object of the present invention is to provide an information processing device, a control method, and a program that can realize good user experience.

  In order to solve the above problems, one embodiment of the present invention is a foldable touch screen having a display portion and a detection portion that detects a touch position at which a display surface of the display portion is touched by an operation medium; In a state where the touch screen itself is folded with the display surface facing outward, based on the first touch position that is the touch position with respect to the first display area that is the display area on the back side of the display surface, An information processing apparatus including: a detection processing unit that outputs position information indicating a position on a second display area that is a front display area.

  Further, according to an aspect of the present invention, in the information processing device, the detection processing unit, in the folded state, of the coordinates of the first touch position, a coordinate in a direction perpendicular to a folding line of the touch screen. The position information may be generated by using coordinates converted into a coordinate system in which the highest coordinate and the lowest coordinate are inverted.

  Further, according to an aspect of the present invention, in the information processing device, the detection processing unit outputs the position information generated based on the first touch position in a first detection mode, and the second display area. A first switching unit that switches between a second detection mode in which the position information generated based on the second touch position touched by the detection unit is output may be provided.

  Further, according to an aspect of the present invention, in the above-described information processing device, the detection processing unit touches the inverted coordinates with respect to the first touch position and the detection unit in the second display area. The coordinates of the second touch position and the coordinates of the second touch position are supplied, and the coordinates of the first touch position converted into the inverted coordinate system are further converted into the coordinates corresponding to the second display area. A touch control unit may be provided that outputs the coordinate as the position information to the coordinate of the second touch position with respect to the second touch position.

  Further, according to an aspect of the present invention, in the above information processing device, an input control unit configured to display a cursor is provided at a position on the second display area corresponding to the position information output by the detection processing unit. May be.

  Further, according to an aspect of the present invention, in the information processing device, the input control unit uses the position information as absolute position information on the second display region, and the second display region corresponding to the absolute position information. A first control mode for displaying the cursor at the upper position and absolute position information based on the amount of movement of the relative position information, using the position information as relative position information, and the generated absolute position information A second switching unit that switches between the second control mode for displaying the cursor and the corresponding position on the second display area may be provided.

  Further, in one aspect of the present invention, in the information processing device, the detection processing unit, while displaying the touch screen, and a touch display area that can be detected by the detection unit, while hiding, Position information indicating a third touch position where the detection unit is touched in the touch display area and a touch pad area that can be detected by the detection unit, and the detection unit touches in the touch pad area. The position information indicating the fourth touch position, and the input control unit, based on a combination of the position information indicating the third touch position and the position information indicating the fourth touch position, the own device. You may make it perform predetermined operation which operates.

  Further, one embodiment of the present invention is a control method of an information processing device including a foldable touch screen having a display portion and a detection portion which detects a touch position at which a display surface of the display portion is touched by an operation medium. Then, in the state where the detection processing unit folds the touch screen itself with the display surface facing outside, the first touch that is the touch position with respect to the first display area that is the display area on the back side of the display surface. A detection processing step of outputting position information indicating a position on a second display area, which is a display area on the front side of the display surface, based on the position; and an input control section, which outputs the position information. An input control step of displaying a cursor at a position on the second display area corresponding to position information.

  Further, one embodiment of the present invention is a computer of an information processing device including a foldable touch screen having a display portion and a detection portion that detects a touch position at which a display surface of the display portion is touched by an operation medium, In a state where the touch screen itself is folded with the display surface facing outside, the display surface is based on a first touch position that is the touch position with respect to a first display area that is a display area on the back side of the display surface. Of the position information on the second display area, which is the front display area, and a position on the second display area corresponding to the position information output by the detection processing step. Is a program for executing an input control step of displaying a cursor on the.

  According to the above aspect of the present invention, good user experience can be realized.

1 is an external view showing an example of an information processing device according to a first embodiment. It is a figure which shows an example of the main hardware constitutions of the information processing apparatus by 1st Embodiment. It is a block diagram showing an example of functional composition of an information processor by a 1st embodiment. It is a figure explaining an example of a process of a touch screen in a 1st embodiment. 6 is a flowchart illustrating an example of touch screen position detection processing according to the first embodiment. It is a figure which shows an example of the position detection of the back side screen area in 1st Embodiment. 6 is a flowchart showing an example of cursor display processing in the first embodiment. It is a figure which shows an example of the conversion process to the relative position coordinate in 1st Embodiment to an absolute position coordinate. It is a figure which shows an example of the scroll process in 1st Embodiment. It is an external view which shows an example of the information processing apparatus by 2nd Embodiment. It is a figure which shows an example of the zoom process in 2nd Embodiment.

  An information processing apparatus and a control method according to an embodiment of the present invention will be described below with reference to the drawings.

[First Embodiment]
FIG. 1 is an external view showing an example of the information processing device 1 according to the first embodiment.
FIG. 1A is an external view of the information processing device 1 viewed from the front, and FIG. 1B is an external view of the information processing device 1 viewed from the side. Further, FIG. 1C shows a state before folding the touch screen 10 mounted on the information processing apparatus 1.

  As shown in FIGS. 1A and 1B, the information processing device 1 is, for example, a tablet PC (personal computer), and the touch is arranged in a state of being folded from the front side (front side) to the back side. A screen 10 is provided. That is, the touch screen 10 is arranged so as to extend from the front side surface F2 (first surface) of the housing to the back side surface F1 (second surface).

  As shown in FIG. 1C, the touch screen 10 detects the display unit 11 and a position (touch position) at which the display surface of the display unit 11 is directly or indirectly touched by an operation medium such as a user's finger. The touch screen 10 itself is foldable. Further, as shown in FIG. 1B, the touch screen 10 is a back screen area DA1 (first screen) which is a back display area of the display surface when the touch screen 10 itself is folded with the display surface facing outward. 1 display area) and a front screen area DA2 (second display area) which is a front display area on the display surface. That is, the display surface of the touch screen 10 is bent along the folding line FL and divided into a back side screen area DA1 and a front side screen area DA2.

The display unit 11 is, for example, a display device such as an OLED display (organic EL display), and is configured to be bendable (foldable).
The detection unit 12 is, for example, a touch sensor, and is arranged so as to overlap the display surface of the display unit 11. The detection unit 12 detects the touch position. The detection unit 12 is configured integrally with the display unit 11 and is foldable (foldable) like the display unit 11.

Next, the hardware of the information processing device 1 according to the present embodiment will be described with reference to FIG.
FIG. 2 is a diagram showing an example of a main hardware configuration of the information processing device 1 according to the present embodiment.
As shown in FIG. 2, the information processing device 1 includes a touch screen 10, a CPU 15, a main memory 16, a video subsystem 17, a chipset 21, a BIOS memory 22, a HDD 23, a touch controller 24, and a touch controller 24. The audio system 25, the WLAN card 26, the embedded controller 31, the input unit 32, and the power supply circuit 33 are provided.

A CPU (Central Processing Unit) 15 executes various kinds of arithmetic processing under program control and controls the information processing apparatus 1 as a whole.
The main memory 16 is a writable memory used as a read area for the execution program of the CPU 15 or as a work area for writing the processing data of the execution program. The main memory 16 is composed of, for example, a plurality of DRAM (Dynamic Random Access Memory) chips. The execution program includes an OS, various drivers for operating hardware of peripheral devices, various services / utilities, application programs, and the like.

  The video subsystem 17 is a subsystem for realizing a function related to image display, and includes a video controller. The video controller processes the drawing command from the CPU 15, writes the processed drawing information in the video memory, reads the drawing information from the video memory, and outputs it to the display unit 11 as drawing data (display data).

  The chipset 21 includes a USB (Universal Serial Bus), a serial ATA (AT Attachment), a SPI (Serial Peripheral Interface) bus, a PCI (Peripheral Component Interconnect) bus, a PCI-Express bus, and an LPC (Low Pin Count) bus. It is equipped with a controller to connect multiple devices. In FIG. 2, as an example of devices, a BIOS memory 22, an HDD 23, a touch controller 24, an audio system 25, a WLAN card 26, and an embedded controller 31 are connected to the chipset 21.

  The BIOS (Basic Input Output System) memory 22 is configured by an electrically rewritable nonvolatile memory such as an EEPROM (Electrically Erasable Programmable Read Only Memory) or a flash ROM. The BIOS memory 22 stores BIOS, system firmware for controlling the embedded controller 31, and the like.

An HDD (Hard Disk Drive) 23 (an example of a non-volatile storage device) stores an OS, various drivers, various services / utilities, application programs, and various data.
The touch controller 24 (an example of a detection processing unit) controls the detection unit 12 of the touch screen 10. The touch controller 24 acquires, for example, position information indicating the touch position on the display surface of the display unit 11 detected by the detection unit 12, and converts and outputs the position information according to the detection mode of the detection unit 12. The detailed processing of the touch controller 24 will be described later.

The audio system 25 records, reproduces, and outputs sound data. The audio system 25 is connected to a microphone 251 and a speaker 252 and is used for a voice assistant function described later.
A WLAN (Wireless Local Area Network) card 26 is connected to a network by a wireless LAN to perform data communication.

  The embedded controller 31 is a one-chip microcomputer that monitors and controls various devices (peripheral devices, sensors, etc.) regardless of the system state of the information processing device 1. Further, the embedded controller 31 has a power management function of controlling the power circuit 33. The embedded controller 31 is composed of a CPU, a ROM, a RAM, and the like (not shown), and is provided with A / D input terminals, D / A output terminals, timers, and digital input / output terminals of a plurality of channels. For example, the input unit 32 and the power supply circuit 33 are connected to the embedded controller 31 via these input / output terminals, and the embedded controller 31 controls these operations.

The input unit 32 is, for example, an input device such as a power switch or a function switch.
The power supply circuit 33 includes, for example, a DC / DC converter, a charging / discharging unit, a battery unit, an AC / DC adapter, and the like. Converted to multiple voltages required for operation. Further, the power supply circuit 33 supplies power to each unit of the information processing device 1 under the control of the embedded controller 31.

Next, the functional configuration of the information processing apparatus 1 according to the present embodiment will be described with reference to FIG.
FIG. 3 is a block diagram showing an example of the functional configuration of the information processing device 1 according to the present embodiment.
As shown in FIG. 3, the information processing device 1 includes an HID class driver 41, an input control unit 42, an application 43, and a display control unit 44, which are realized by software. Further, the information processing device 1 includes a touch screen 10, a touch controller 24, and a chipset 21 as main hardware of this embodiment.

  Further, in FIG. 3, the software is realized by reading a program stored in the HDD 23 or the BIOS memory 22 into the main memory 16 and executing the program by the CPU 15.

  The touch controller 24, based on the back side touch position (first touch position) which is the touch position in the back side screen area DA1 in the state where the touch screen 10 is folded with the display surface facing outward (see FIG. 1), The position information for specifying the position on the front screen area DA2 is output. The touch controller 24, for example, when the touch screen 10 is folded, among the coordinates of the back side touch position, the coordinates in the direction perpendicular to the folding line FL are the highest coordinate (MSB coordinate) and the lowest coordinate (LSB coordinate). The position information is generated using the coordinates converted into the inverted coordinate system.

  Here, in the coordinate system in which the highest coordinate and the lowest coordinate are inverted, for example, conversion is performed by exchanging the upper and lower coordinates between the highest coordinate (MSB coordinate) and the lowest coordinate (LSB coordinate). It is a coordinate system. The touch controller 24 outputs the position information generated based on the back side touch position as position information of the front side screen area DA2 to a back touch mode (first detection mode) and a front side touch position (second touch position). It has a normal cursor mode (second detection mode) in which the position information generated based on it is directly output as the position information of the front screen area DA2. Here, the front side touch position is a touch position in the front side screen area DA2.

The touch controller 24 switches the position information output to the input control unit 42 according to the back touch mode or the normal cursor mode. The touch controller 24 outputs the position information to the input control unit 42 via the chipset 21 and the HID (Human Interface Device) class driver 41.
The HID class driver 41 is, for example, a class driver that controls HID using USB, and supplies position information detected by the touch controller 24 to the input control unit 42 using USB.

  The input control unit 42 is, for example, a device driver that controls an input device such as a mouse class driver or a Windows kernel driver (Windows is a registered trademark). The input control unit 42 executes a predetermined operation of displaying a cursor or operating the own device (information processing device 1) based on the acquired position information of the display unit 11. The input control unit 42 displays a cursor at a position on the front screen area DA2 corresponding to the position information output by the touch controller 24, for example.

  Further, the input control unit 42 switches between the absolute coordinate mode (first control mode) and the touch pad mode (second control mode) to control the position of the cursor displayed on the display unit 11. Here, the absolute coordinate mode is, for example, a normal touch screen control mode, and the input control unit 42 corresponds to the absolute position information as the absolute position information on the front screen area DA2 in the absolute coordinate mode. The position of the cursor on the front side screen area DA2 is controlled.

The touch pad mode is a control mode that functions as a touch pad that operates equivalently to a pointing device such as a mouse, and the input control unit 42 acquires position information as relative position information and moves the relative position information. Absolute position information is generated based on the amount, and the position of the cursor on the front screen area DA2 corresponding to the generated absolute position information is controlled.
The input control unit 42 supplies the position information of the display unit 11 to the application 43 in response to the request of the application 43.

  The display control unit 44 is, for example, a display driver, and controls the display on the display unit 11. The display control unit 44 displays the cursor on the display unit 11 (for example, the front screen area DA2) based on the control of the position of the cursor by the input control unit 42, for example.

Next, the operation of the information processing device 1 according to the present embodiment will be described with reference to the drawings.
FIG. 4 is a diagram illustrating an example of processing of the touch screen 10 in the present embodiment.
In FIG. 4, with the touch screen 10 itself folded, the range of the coordinates of the entire display screen from the front side screen area DA2 to the back side screen area DA1 is set from X coordinate "0" to "63" and Y coordinate The case of changing from “0” to “45” will be described as an example. Further, the X coordinate is a coordinate in the direction perpendicular to the folding line FL, and the Y coordinate is a coordinate parallel to the folding line FL. Further, the X coordinate of the front screen area DA2 of the display unit 11 is changed from "0" to "31", and the X coordinate of the back screen area DA1 of the display unit 11 is changed from "32" to "63".

As shown in FIG. 4, the touch controller 24 includes an inverted coordinate conversion unit 241, a coordinate switching unit 242, and a touch control unit 243.
The inverted coordinate conversion unit 241 obtains the X coordinate (X (32 ... 63)) of the back screen area DA1 and inverts the highest coordinate (MSB coordinate) and the lowest coordinate (LSB coordinate). To generate the inverted X coordinate (X (63 ... 32)). On the other hand, the X coordinate (X (32 ... 63)) of the back side screen area DA1 is directly supplied to the touch control unit 243. The X coordinate (X (32 ... 63)) is used by the touch control unit 243 when the cursor is displayed on the back screen area DA1.

  The coordinate switching unit 242 (an example of a first switching unit) switches between the above-mentioned back touch mode and normal cursor mode. In the back touch mode, the coordinate switching unit 242 further converts the inverted X coordinate (X (63 ... 32)) inverted by the inverted coordinate conversion unit 241 into the X coordinate corresponding to the X coordinate of the front screen area DA2. The coordinates are converted into coordinates (X ((0 ... 31)) and output to the touch control unit 243. Thus, in the back touch mode, the coordinates of the touch position of the back screen area DA1 are the X coordinates. Is inverted, further converted into the X coordinate of the front screen area DA2, and output to the touch control unit 243.

  Further, in the case of the normal cursor mode, regarding the coordinates of the touch position detected in the front screen area DA2, the X coordinate of the front screen area DA2 is directly output to the touch control unit 243 as the X coordinate.

  The touch control unit 243 controls the input X coordinate (X (0 ... 63)) and Y coordinate (Y (0 ... 45)) as position information for controlling the position of the cursor. It is output to the unit 42.

As shown in FIG. 4, the input control unit 42 includes an absolute coordinate conversion unit 421 and a mode switching unit 422.
The absolute coordinate conversion unit 421 converts the coordinates of the position information output from the touch controller 24 into absolute coordinates. That is, the absolute coordinate conversion unit 421 uses the position information acquired from the touch controller 24 as the relative position information, and generates the absolute position information based on the moving amount of the relative position information.

  The mode switching unit 422 (an example of a second switching unit) switches between the absolute coordinate mode described above and the touch pad mode. In the absolute coordinate mode, the mode switching unit 422 controls the position information output from the touch controller 24 as absolute position information to display a cursor at the position of the display unit 11 corresponding to the absolute position information. .

In addition, the mode switching unit 422 controls to display the cursor at the position of the display unit 11 corresponding to the absolute position information converted by the absolute coordinate conversion unit 421 in the touch pad mode.
In this way, the input control unit 42 outputs the absolute position information (absolute coordinate information) determined according to the absolute coordinate mode and the touchpad mode to the display control unit 44 to display the absolute position information. The display position of the cursor to the position of the section 11 is controlled.

  The display control unit 44 displays the cursor on the display unit 11 according to the control of the display position of the cursor from the input control unit 42.

Next, an example of the position detection processing of the touch screen 10 according to the present embodiment will be described with reference to FIG.
FIG. 5 is a flowchart showing an example of position detection processing of the touch screen 10 according to this embodiment.

  As shown in FIG. 5, first, the touch controller 24 of the information processing device 1 determines whether or not the back touch mode is set (step S101). For example, the touch controller 24 refers to a storage unit (not shown) in which the detection mode is stored, and determines whether or not the back touch mode is set according to whether or not the back touch mode is set. When the touch controller 24 is in the back touch mode (step S101: YES), the process proceeds to step S102. Further, when the touch controller 24 is not in the back touch mode (for example, in the normal cursor mode) (step S101: NO), the process proceeds to step S104.

  To switch the detection mode between the back touch mode and the normal cursor mode, for example, the application 43 (or various drivers) stores a determination information such as a flag in a storage unit (not shown) (such as a setting register). Done by. For example, when the information processing apparatus 1 is activated, the storage unit (not shown) is set to the normal cursor mode as an initial setting, and the detection unit 12 detects that the user holds the information processing apparatus 1 with both hands. In this case, the back touch mode may be set. The storage unit (not shown) may be set to the normal cursor mode when the detection unit 12 detects that the user holds the information processing device 1 with one hand. Further, the application 43 may change the setting of the detection mode in the storage unit (not shown), for example, according to the state of the display screen or the processing content.

  In step S102, the inverted coordinate conversion unit 241 of the touch controller 24 generates inverted X coordinates by inverting the highest coordinate (MSB coordinate) and the lowest coordinate (LSB coordinate) of the X-axis coordinate. For example, the reverse coordinate conversion unit 241 converts the X coordinate of the back screen area DA1 into the reverse X coordinate.

  Next, the touch controller 24 outputs the position information of the front screen area DA2 based on the inverted X coordinate (step S103). That is, the coordinate switching unit 242 of the touch controller 24 converts the inverted X coordinate into the X coordinate of the front screen area DA2 and outputs it. After the processing of step S103, the touch controller 24 ends the detection processing.

Further, in step S104, the touch controller 24 outputs the position information as it is. The touch controller 24 outputs the X coordinate of the back screen area DA1 as it is, and also outputs the X coordinate of the front screen area DA2 as it is. That is, the coordinate switching unit 242 outputs the X coordinate of the front screen area DA2 as it is. After the processing of step S104, the touch controller 24 ends the detection processing.
The touch controller 24 periodically (at a predetermined detection cycle) causes the detection unit 12 to detect the position information indicating the touch position.

Next, with reference to FIG. 6, the operation in the back touch mode in this embodiment will be described.
FIG. 6 is a diagram showing an example of position detection of the back screen area DA1 in the present embodiment.

  As shown in FIG. 6, in the back touch mode, the information processing device 1 turns off the display of the back side screen area DA1 to function as a pointing device and causes the front side screen area DA2 to display a display screen. Here, an example in which the operation mode is the absolute coordinate mode will be described.

  When the user's finger touches (is touched) the back side screen area DA1, for example, the position on the back side screen area DA1 and the position on the front side screen area DA2 have a one-to-one correspondence, and the information processing device 1 displays the cursor CR1 at the position on the front screen area DA2 corresponding to the touch position on the back screen area DA1.

  Since the X coordinates of the back screen area DA1 and the front screen area DA2 are inverted, the touch controller 24 converts the X coordinates, which are the coordinates in the direction perpendicular to the folding line FL, into the inverted coordinates. , Generate location information.

Next, with reference to FIG. 7, the cursor display processing in this embodiment will be described.
FIG. 7 is a flowchart showing an example of the cursor display process in this embodiment.
As illustrated in FIG. 7, the input control unit 42 of the information processing device 1 first acquires the position information detected by the detection unit 12 from the touch controller 24 (step S201).

  Next, the input control unit 42 determines whether or not the touch pad mode is set (step S202). The input control unit 42 refers to, for example, a storage unit (not shown) in which the operation mode is stored, and determines whether or not the touch pad mode is set according to whether or not the touch pad mode is set. . The input control unit 42 advances the process to step S203 when the touchpad mode is set (step S202: YES). Further, when the touch pad mode is not set (the absolute coordinate mode is set) (step S202: NO), the input control unit 42 advances the process to step S205.

  Note that, for switching the operation mode between the touch pad mode and the absolute coordinate mode, for example, the application 43 (or various drivers) stores the determination information such as a flag in a storage unit (not shown) (for example, a setting register). Done by. Similarly to the detection mode setting described above, the application 43 may change the detection mode setting in the storage unit (not shown), for example, according to the state of the display screen or the processing content. Further, the operation mode may be switched according to the setting of the area of the touch screen 10. For example, when the back side screen area DA1 having the same size as the front side screen area DA2 can be secured, the storage unit (not shown) is set in the absolute coordinate mode so that the operation is easy and comfortable to use. Further, when the size of the back screen area DA1 is smaller than the size of the front screen area DA2, the storage unit (not shown) is set to the touch pad mode, which is easier to operate and can be used comfortably.

  In step S203, the absolute coordinate conversion unit 421 of the input control unit 42 uses the acquired position information as relative position information and generates absolute position information based on the amount of movement of the relative position information. The absolute coordinate conversion unit 421 generates absolute position information based on the amount of movement of the relative position information, for example, using the following formula (1).

Here, Xai represents the i-th X absolute coordinate, and Yai represents the i-th X absolute coordinate. In addition, Xo indicates the initial value of the X absolute coordinate, and Yo indicates the initial value of the Y absolute coordinate. Further, Xr _i represents the detected X relative position coordinate, Yr _i represents the detected Y relative position coordinate, and (Xr _k −Xr _k−1 ) and (Yr _k −Yr _k−1 ) are relative. The amount of movement of position information is shown. Note that Xo and Yo are updated to the absolute coordinates at that time when the touch is separated from the detection unit 12 (when the touch position is no longer detected).

  Next, the input control unit 42 displays the cursor at the position corresponding to the generated absolute position information (step S204). That is, the mode switching unit 422 of the input control unit 42 outputs to the display control unit 44 a request to display the cursor at the position of the display unit 11 corresponding to the absolute position information converted by the absolute coordinate conversion unit 421, and displays the request. The cursor is displayed on the section 11. After the processing of step S204, the input control unit 42 ends the cursor display processing.

  Further, in step S205, the input control unit 42 displays the cursor at the position corresponding to the absolute position information, using the acquired position information as the absolute position information. In this case, the mode switching unit 422 of the input control unit 42 outputs to the display control unit 44 a request to display the cursor at the position of the display unit 11 corresponding to the absolute coordinate information acquired from the touch controller 24, and the display unit Display the cursor at 11. After the processing of step S205, the input control unit 42 ends the cursor display processing.

Next, with reference to FIG. 8, the operation of the touch pad mode in this embodiment will be described.
FIG. 8 is a diagram showing an example of conversion processing of relative position coordinates into absolute position coordinates in the present embodiment.

  Further, FIG. 8A shows, for example, the movement paths (OP1, OP2, and OP3) of the relative position information acquired by the input control unit 42 from the touch controller 24. Further, FIG. 8B shows the movement route of the cursor CR2 displayed on the front screen area DA2, for example.

  In FIG. 8A, when the input control unit 42 obtains the relative position information in the order of the moving route OP1 → the moving route trace OP2 → the moving route OP3, the absolute coordinates (X0, Y0) are used as the initial values. Convert to coordinates. The input control unit 42 converts the absolute coordinates (X0, Y0) into absolute coordinates having initial values, and the cursor CR2 is displayed as in the moving route OP1, the moving route trace OP2, and the moving route OP3 shown in FIG. 8B. Is moved and displayed on the front side screen area DA2.

Next, a modified example of the input process using the touch screen 10 by the information processing apparatus 1 according to the present embodiment will be described with reference to the drawings.
In the information processing apparatus 1 according to the present embodiment, as shown in FIG. 9, the touch screen 10 is displayed and at the same time, the touch display area TDA in which the detection unit 12 can detect and the detection screen of the detection unit 12 are hidden. It may be divided into a touch pad area TPA that can be detected. In this case, the touch controller 24 includes position information indicating the touch position (third touch position) where the detection unit 12 is touched in the touch display area TDA, and the touch position where the detection unit 12 is touched in the touch pad area TPA. The position information indicating the (fourth touch position) is output.

  Both the touch display area TDA and the touch pad area TPA may be a partial area in the front screen area DA2 described above, or may be a partial area in the back screen area DA1 described above. The touch display area TDA may be the front screen area DA2 and the touch pad area TPA may be the back screen area DA1. In this case, the touch controller 24 switches the position information in which the X coordinate based on the back side touch position is inverted and the position information based on the front side touch position by switching, and outputs the position information in which the X coordinate based on the back side touch position is reversed. And both position information based on the front touch position.

  Further, the input control unit 42 operates its own device (information processing device 1) based on a combination of position information indicating the touch position of the touch display area TDA and position information indicating the touch position of the touch pad area TPA. Perform a given operation. Here, the predetermined operation is the following operation.

  (A) The input control unit 42 touches the position information indicating the touch position of the touch pad area TPA in a state where the position information indicating the touch position of the touch display area TDA does not exist (the touch display area TDA is not touched). When it is acquired from the controller 24, the operation of the mouse cursor is executed. The input control unit 42 executes, for example, the above-described touchpad mode processing.

  (B) When the input control unit 42 acquires the position information of one finger in the window of the application in the touch display area TDA and the position information of one finger in the touch pad area TPA. Then, perform the scroll operation. In this case, the input control unit 42 executes, for example, a scrolling process of the display in the window according to the movement of the position information of one finger in the touchpad area TPA.

FIG. 9 is a diagram illustrating an example of the scroll process in the present embodiment.
The example illustrated in FIG. 9 is an example in which the input control unit 42 executes the scroll process, and the user touches the window W1 displayed in the touch display area TDA with the finger FG1 to display the touch pad area TPA. By moving the finger FG2 while touching it, the input control unit 42 executes the scroll processing of the display in the window W1. That is, the input control unit 42 causes the display control unit 44 to scroll the display in the window W1.

  (C) In the touch display area TDA, the input control unit 42 acquires, for example, the position information of one finger in the window of the application, and in the touch pad area TPA, the position information of two fingers (two locations). When the position information of is acquired), the zoom operation is executed. In this case, the input control unit 42 executes, for example, a zoom process of displaying in the window according to the movement of the position information of the two fingers of the touch pad area TPA.

  (D) The input control unit 42 acquires the position information of one finger on the desktop screen (basic operation screen) in the touch display area TDA, and the position information of one finger in the touch pad area TPA. When it is acquired, the screen brightness adjustment (brightness adjustment) operation is executed. In this case, the input control unit 42 causes the display control unit 44, for example, to perform a process of changing the brightness (luminance) of the screen according to the movement of the position information of the one finger in the touchpad area TPA.

  (E) In the touch display area TDA, the input control unit 42 acquires, for example, position information of one finger on the desktop screen (basic operation screen), and in the touch pad area TPA, position information of two fingers ( When the position information of two places) is acquired, the volume operation is executed. In this case, the input control unit 42 causes, for example, the audio system 25 to execute a process of changing the volume according to the movement of the position information of the two fingers of the touch pad area TPA.

  As described above, the information processing device 1 according to the present embodiment includes the touch screen 10 and the touch controller 24 (detection processing unit). The touch screen 10 is configured to be foldable (foldable) having a display unit 11 and a detection unit 12 that detects a touch position where the display surface of the display unit 11 is touched by an operation medium. The touch controller 24 is a back side touch position (first touch position) that is a touch position with respect to the back side screen area DA1 (first display area) in a state where the touch screen 10 itself is folded (folded state) with the display surface facing outward. Based on, the position information indicating the position on the front side screen area DA2 (second display area) is output. Here, the back side screen area DA1 is a back side display area of the display surface, and the front side screen area DA2 is a front side display area of the display surface. The operation medium includes, for example, a user's finger or a touch pen.

  With such a configuration, the information processing apparatus 1 according to the present embodiment can specify the position of the front screen area DA2 by touching the back screen area DA1, and the user can intuitively perform an operation. Can be realized. Therefore, the information processing device 1 according to the present embodiment can realize good user experience.

  For example, when a user holds the information processing apparatus 1 in his / her hand and operates it, by touching the back side screen area DA1 while holding the information processing apparatus 1, the position of the front side screen area DA2 displaying the screen can be specified. Therefore, it is possible to realize an operation that is intuitive to the user.

  Further, in the present embodiment, the touch controller 24, in the folded state, of the coordinates of the back side touch position, the coordinates in the direction perpendicular to the folding line FL of the touch screen 10 (for example, the coordinates in the X direction), the back side screen area. The position information is generated using the coordinates converted into a coordinate system in which the highest coordinate and the lowest coordinate in the vertical direction in DA1 are inverted. Here, a coordinate (reversed coordinate) obtained by inverting the highest coordinate and the lowest coordinate is, for example, a conversion in which the upper and lower coordinates are switched between the highest coordinate (MSB coordinate) and the lowest coordinate (LSB coordinate). Is the coordinates at which

  As a result, the information processing apparatus 1 according to the present embodiment reverses the touch position of the back screen area DA1 and specifies the position of the front screen area DA2. Therefore, when viewed from the front screen area DA2 side, You can perform sensory operations by touching. Therefore, the information processing device 1 according to the present embodiment can realize a better user experience.

  In addition, in the present embodiment, the touch controller 24 includes a coordinate switching unit 242 (first switching unit). The coordinate switching unit 242 outputs a back touch mode (first detection mode) that outputs position information generated based on the back side touch position, and a front side touch position (second position) where the detection unit 12 is touched in the front side screen area DA2. The normal cursor mode (second detection mode) that outputs the position information generated based on the touch position) is switched.

  As a result, the information processing apparatus 1 according to the present embodiment can switch between the back touch mode by touching the back side screen area DA1 and the normal cursor mode by touching the front side screen area DA2, thereby improving operability and convenience. Can be improved. Therefore, the information processing device 1 according to the present embodiment can realize a better user experience.

In addition, in the present embodiment, the touch controller 24 supplies both the coordinates that are reversed with respect to the back side touch position and the coordinates of the front side touch position where the detection unit 12 is touched in the front side screen area DA2. Accordingly, the coordinates converted into the inverted coordinate system for the back side touch position are further converted into the coordinates corresponding to the front side screen area DA2, and the coordinates of the front side touch position are compared with the front side touch position. The touch control unit 243 that outputs information is provided.
As a result, the information processing apparatus 1 according to the present embodiment can appropriately correspond to both the back-side touch position and the front-side touch position, and thus it is possible to realize a better user experience.

The information processing apparatus 1 according to the present embodiment also includes an input control unit 42 that displays a cursor at a position on the front screen area DA2 corresponding to the position information output by the touch controller 24.
Accordingly, the information processing apparatus 1 according to the present embodiment can appropriately display the cursor at the position on the front screen area DA2 corresponding to the position information output by the touch controller 24.

Further, in the present embodiment, the input control unit 42 includes a mode switching unit 422 (second switching unit) that switches between the absolute coordinate mode (first control mode) and the touch pad mode (second control mode). Prepare In the absolute coordinate mode, the position information is used as the absolute position information on the front screen area DA2, and the cursor is displayed at the position on the front screen area DA2 corresponding to the absolute position information. In the touchpad mode, the position information is used as relative position information, absolute position information is generated based on the amount of movement of the relative position information, and a cursor is displayed at a position on the front screen area DA2 corresponding to the generated absolute position information. .
As a result, the information processing apparatus 1 according to the present embodiment can switch between the absolute coordinate mode in which the position of the display unit 11 is directly specified and the touch pad mode in which the touch pad functions as a touch pad, and thus the operability and convenience are improved. Can be improved.

In addition, in the present embodiment, the touch controller 24 has position information indicating the touch position (third touch position) at which the detection unit 12 is touched in the touch display area TDA and the detection unit 12 touches in the touch pad area TPA. The position information indicating the touched position (the fourth touch position) is output. The touch screen 10 is divided into a touch display area TDA in which the detection unit 12 can detect while displaying, and a touch pad area TPA in which the detection unit 12 can detect while hiding. The input control unit 42 operates its own device based on a combination of position information indicating a touch position touched within the touch display area TDA and position information indicating a touch position touched within the touch pad area TPA. A predetermined operation (for example, scrolling or zooming) is executed.
As a result, the information processing apparatus 1 according to the present embodiment can perform various operations with a simple user interface and can improve convenience.

In addition, the control method according to the present embodiment includes an information processing device including a foldable touch screen 10 having a display unit 11 and a detection unit 12 that detects a touch position where the display surface of the display unit 11 is touched by an operation medium. The control method of No. 1 includes a detection processing step (first step) and an input control step (second step). In the detection processing step, the touch controller 24, in a state where the touch screen 10 itself is folded with the display surface facing outside, is set to a back side touch position which is a touch position with respect to a back side screen area DA1 which is a back side display area of the display surface. Based on this, position information indicating the position on the front screen area DA2, which is the front display area on the display surface, is output. In the input control step, the input control unit 42 causes the cursor to be displayed at the position on the front screen area DA2 corresponding to the position information output by the detection processing step.
As a result, the control method according to the present embodiment has the same effects as those of the information processing device 1 described above, and can realize good user experience.

In addition, in the above-described embodiment, when the detection unit 12 detects the position information in a planar shape having a predetermined area or more, the touch controller 24 or the input control unit 42 falls within a predetermined range including the planar portion. It is also possible to invalidate the position information indicating the touch position detected in. That is, the touch controller 24 or the input control unit 42 does not detect a peripheral touch including the part of the hand holding the information processing device 1 when operating the information processing device 1 with the hand, for example.
As a result, the information processing apparatus 1 according to the present embodiment can reduce erroneous detection (malfunction) when the information processing apparatus 1 is held and operated, for example.

[Second Embodiment]
Next, an information processing device 1a according to the second embodiment will be described with reference to the drawings.
In the present embodiment, a modification in which one touch screen 10 is folded (folded) at a plurality of locations will be described.

FIG. 10 is an external view showing an example of the information processing device 1a according to the present embodiment.
As shown in FIG. 10, in the information processing device 1 a, the first housing 51 and the second housing 52 are connected by a hinge H, and one sheet is provided on the surfaces of the first housing 51 and the second housing 52. The touch screen 10 is arranged. 10A shows an external view of the information processing apparatus 1a in a folded state, and FIG. 10B shows the first housing 51 and the second housing 52 opened and arranged linearly. The external view of a state is shown.

The hardware configuration and the functional configuration of the information processing apparatus 1a according to the present embodiment are the same as those of the first embodiment shown in FIGS. 2 and 3 described above, and therefore the description thereof is omitted here.
Further, the operation of the information processing apparatus 1a according to the present embodiment is also the same as that of the first embodiment, so the description thereof is omitted here.

  In the present embodiment, the touch screen 10 is arranged in an M shape in a folded state as shown in FIG. The touch screen 10 includes a back screen area DA11 that is a display area on the back side of the first housing 51, a front screen area DA21 that is a front display area on the first housing 51, and a back side of the second housing 52. Includes a back side screen area DA12 which is a display area and a front side screen area DA22 which is a front side display area of the second housing 52.

Here, the back screen area DA11 and the back screen area DA12 correspond to the back screen area DA1 (first display area) in the above-described first embodiment, and the front screen area DA21 and the front screen area DA22 are the above-mentioned It corresponds to the front screen area DA2 (second display area) in the first embodiment. Therefore, the touch controller 24 or the input control unit 42 in the present embodiment performs the same processing as in the first embodiment on the back screen area DA11 and the back screen area DA12, and the front screen area DA21 and the front screen area DA22. To execute.
As a result, the information processing device 1a according to the present embodiment can achieve the same effect as that of the first embodiment and realize good user experience.

The present invention is not limited to the above-described embodiments, and can be modified within the scope of the present invention.
For example, in each of the above-described embodiments, an example in which the information processing device 1 (1a) is a tablet PC has been described, but the present invention is not limited to this. The information processing device 1 (1a) may be another device such as a PDA (Personal Digital Assistant), a smartphone, or a notebook PC.

Further, in each of the above-described embodiments, based on a combination of position information indicating the touch position of the touch display area TDA and position information indicating the touch position of the touch pad area TPA, an input as an example of a predetermined operation is performed. The example in which the control unit 42 executes the operations (A) to (E) has been described, but the present invention is not limited to this.
For example, as illustrated in FIG. 11, when the input control unit 42 acquires the position information of one finger in the touch display area TDA and the position information of one finger in the touch pad area TPA. The zoom operation may be executed.

FIG. 11 is a diagram illustrating an example of zoom processing according to the second embodiment.
As shown in FIG. 11, when the information processing apparatus 1a is opened and used, the user touches the touch display area TDA (front side screen area DA21) with the finger FG1, and the touch pad area TPA (back side screen area DA12). ) Is touched with the finger FG2, and the fingers FG1 and FG2 are moved, whereby the input control unit 42 executes the zoom process of the display screen.
Thereby, the information processing apparatus 1a can provide a highly convenient user interface, for example, when a user holds it with both hands and uses it.

  Further, in the above-described first embodiment, the touch screen 10 is arranged so as to extend from the front side surface F2 (first surface) to the back side surface F1 (second surface) of the housing, and the touch screen 10 is folded. Although the example fixed by is explained, it is not limited to this. For example, the information processing device 1 may be configured to open the touch screen 10 linearly and display it on one screen.

  In addition, in each of the above-described embodiments, the touch screen 10 may use the region on the side surface of each housing of the information processing device 1 (1a) for display and touch detection. That is, a portion of the side surface when the touch screen 10 is folded (folded) may be included in the touch display area TDA or the touch pad area TPA described above.

Each configuration included in the above-described information processing device 1 (1a) has a computer system inside. Then, a program for realizing the function of each configuration included in the information processing apparatus 1 (1a) described above is recorded in a computer-readable recording medium, and the program recorded in this recording medium is read by a computer system, By executing the processing, the processing in each configuration included in the information processing apparatus 1 (1a) described above may be performed. Here, “reading and executing a program recorded in a recording medium on a computer system” includes installing the program in the computer system. The "computer system" here includes an OS and hardware such as peripheral devices.
Further, the “computer system” may include a plurality of computer devices connected via a network including the Internet, WAN, LAN, and a communication line such as a dedicated line. The "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a storage device such as a hard disk built in a computer system. As described above, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM.

  The recording medium also includes a recording medium provided inside or outside accessible from the distribution server for distributing the program. It should be noted that even if a program is divided into a plurality of programs and the programs are downloaded at different timings and then combined with each other provided in the information processing apparatus 1 (1a) or a distribution server that distributes each of the divided programs is different. Good. Further, the "computer-readable recording medium" holds a program for a certain period of time, such as a volatile memory (RAM) inside a computer system which is a server or a client when the program is transmitted via a network. It also includes things. Further, the program may be for realizing some of the functions described above. Further, it may be a so-called difference file (difference program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

  Further, some or all of the above-mentioned functions may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each of the functions described above may be individually implemented as a processor, or a part or all of the functions may be integrated and implemented as a processor. Further, the method of circuit integration is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when a technology for forming an integrated circuit that replaces LSI appears due to the progress of semiconductor technology, an integrated circuit according to the technology may be used.

1, 1a Information processing device 10 Touch screen 11 Display unit 12 Detection unit 15 CPU
16 Main Memory 17 Video Subsystem 21 Chipset 22 BIOS Memory 23 HDD
24 touch controller 25 audio system 26 WLAN card 31 embedded controller 32 input unit 33 power supply circuit 41 HID class driver 42 input control unit 43 application 44 display control unit 51 first casing 52 second casing 241 inverted coordinate conversion unit 242 coordinate switching Unit 243 Touch control unit 421 Absolute coordinate conversion unit 422 Mode switching unit H hinge

In order to solve the above problems, one aspect of the present invention includes a display unit, and one of the touch screen foldable and a detection unit that the display surface of the display unit detects a touch position touched by the operation medium In the state where the touch screen itself is folded with the display surface facing outward, the display is performed based on a first touch position that is the touch position with respect to a first display area that is a display area on the back side of the display surface. A detection processing unit that outputs position information indicating a position on a second display region that is a front side display region of the surface , wherein the detection processing unit is a coordinate of the first touch position with respect to the first display region. Of the above, a fold line of the touch screen and a coordinate in a direction perpendicular to the fold line are provided, and an inverting coordinate transforming unit that transforms the coordinate system in which the highest coordinate and the lowest coordinate are inverted is provided. In the state, the vertical coordinate of one display surface is divided into the first display area and the second display area, and the vertical coordinate of the first display area is converted into the reverse coordinate conversion unit. The information processing apparatus is configured to generate the position information by using the coordinates converted into the inverted coordinate system by .

Further, according to one embodiment of the present invention, control of an information processing device including one foldable touch screen having a display portion and a detection portion that detects a touch position at which a display surface of the display portion is touched by an operation medium. A method, wherein the detection processing unit is the touch position with respect to a first display area, which is a display area on the back side of the display surface, in a state in which the touch screen itself is folded with the display surface facing outside. A detection processing step of outputting position information indicating a position on a second display area, which is a front side display area of the display surface, based on one touch position, and an input control unit is output by the detection processing step. with a position on the second display area corresponding to the position information, viewing including an input control step of displaying a cursor, the detection processing step, said first table Of the coordinates of the first touch position with respect to the area, a reverse coordinate conversion step of converting coordinates in a direction perpendicular to the folding line of the touch screen to a coordinate system in which the highest coordinate and the lowest coordinate are inverted, In the detection processing step, in the folded state, the vertical coordinate of one display surface is divided into the first display area and the second display area, and the vertical direction of the first display area is divided. It is a control method for generating the position information by using the coordinates converted into the inverted coordinate system in the inverted coordinate conversion step .

Further, according to one embodiment of the present invention, a computer of an information processing device including one foldable touch screen having a display portion and a detection portion which detects a touch position at which a display surface of the display portion is touched by an operation medium. In the state where the touch screen itself is folded with the display surface facing outward, based on the first touch position that is the touch position with respect to the first display area that is the display area on the back side of the display surface, A detection processing step of outputting position information indicating a position on a second display area, which is a front side display area of the display surface, and a second display area corresponding to the position information output by the detection processing step. the position, to execute an input control step of displaying a cursor, the detection processing step, the first touch relative to the first display region Of the position coordinates, the fold line of the touch screen and the vertical direction coordinates, including a reverse coordinate conversion step of converting into a coordinate system in which the highest coordinate and the lowest coordinate are inverted, the detection processing step, In the folded state, the vertical coordinate of one display surface is divided into the first display area and the second display area, and the vertical coordinate of the first display area is converted into the inverted coordinate. It is a program for executing the process of generating the position information by using the coordinates converted into the inverted coordinate system in the conversion step .

Claims (9)

A foldable touch screen having a display unit and a detection unit that detects a touch position where the display surface of the display unit is touched by an operation medium,
In a state where the touch screen itself is folded with the display surface facing outside, the display surface is based on a first touch position that is the touch position with respect to a first display area that is a display area on the back side of the display surface. An information processing apparatus that outputs position information indicating a position on a second display area that is a front-side display area of the information processing apparatus. The detection processing unit, in the folded state, of the coordinates of the first touch position, the coordinates in the direction perpendicular to the folding line of the touch screen, the coordinate system in which the highest coordinate and the lowest coordinate are reversed. The information processing apparatus according to claim 1, wherein the position information is generated using the converted coordinates. The detection processing unit,
The first detection mode for outputting the position information generated based on the first touch position, and the position information generated based on the second touch position where the detection unit is touched in the second display area are displayed. The information processing apparatus according to claim 1 or 2, further comprising a first switching unit that switches between a second detection mode for outputting. The detection processing unit,
The first touch position is supplied with both of the inverted coordinates with respect to the first touch position and the coordinates of the second touch position where the detection unit is touched in the second display area. For the position, the coordinate converted to the inverted coordinate system is further converted to the coordinate corresponding to the second display area, and the coordinate of the second touch position is relative to the second touch position. The information processing apparatus according to claim 2, further comprising a touch control unit that outputs the position information. The information processing apparatus according to claim 1, further comprising an input control unit that displays a cursor at a position on the second display area corresponding to the position information output by the detection processing unit. . The input control unit,
Using the position information as absolute position information on the second display area, the position information is relative to a first control mode for displaying the cursor at a position on the second display area corresponding to the absolute position information. A second control mode in which absolute position information is generated as position information based on the amount of movement of the relative position information, and the cursor is displayed at a position on the second display area corresponding to the generated absolute position information. The information processing apparatus according to claim 5, further comprising a second switching unit that switches between and. The detection processing unit divides the touch screen into a touch display region that can be detected by the detection unit and a touch pad region that can be detected by the detection unit while hiding, while displaying. Outputting position information indicating a third touch position touched by the detection unit in the touch display area and position information indicating a fourth touch position touched by the detection unit in the touch pad area,
The said input control part performs the predetermined operation which operates its own device based on the combination of the positional information which shows the said 3rd touch position, and the positional information which shows the said 4th touch position. 6. The information processing device according to item 6. A control method for an information processing device comprising a foldable touch screen having a display unit and a detection unit for detecting a touch position at which a display surface of the display unit is touched by an operation medium,
The detection processing unit is based on a first touch position which is the touch position with respect to a first display area which is a display area on the back side of the display surface in a state where the touch screen itself is folded with the display surface facing outside. A detection processing step of outputting position information indicating a position on a second display area which is a front side display area of the display surface;
And an input control step of causing a cursor to be displayed at a position on the second display area corresponding to the position information output by the detection processing step. A computer of an information processing apparatus including a foldable touch screen having a display unit and a detection unit that detects a touch position where the display surface of the display unit is touched by an operation medium,
In a state where the touch screen itself is folded with the display surface facing outside, the display surface is based on a first touch position that is the touch position with respect to a first display area that is a display area on the back side of the display surface. A detection processing step of outputting position information indicating a position on a second display area which is a front display area of
An input control step of displaying a cursor at a position on the second display area corresponding to the position information output by the detection processing step.

Images