JP2011154524A - Three-dimensional input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a three-dimensional input device preventing a screen from becoming hard to be visually recognized because a magnified image overlaps an input medium when displaying the magnified image of an approach position when the input medium such as a finger approaches the screen. <P>SOLUTION: The three-dimensional input device includes: a display means displaying data; a specification means (S101) detecting a three-dimensional position of the input medium, and specifying the approach position in the screen of the display means from the three-dimensional position; a display control means (S103) making the magnified image of a range within a prescribed distance from the approach position be displayed in a position wherein the magnified image is moved to a prescribed direction from approach coordinates in the screen; and an input means (S115) inputting the data based on a contact position when detecting contact in the screen. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention displays a magnified image near the proximity position as the input medium approaches the screen, and inputs data based on the contact position when the input medium contacts the screen. About.

  In recent years, touch panels that allow a user to input data by touching a screen with a finger or the like have been widely used. However, a portable information processing terminal such as a cellular phone has a small screen and cannot display an object to be operated large, or a part of the screen is covered with a finger or the like so that the object is difficult to see. Misoperations were easy to occur.

Therefore, a touch panel device that allows a user to easily select a selection target has been proposed (see Patent Document 1). This touch panel device is a touch panel device that determines which one of a plurality of selection targets displayed on a screen is selected. The touch panel device is provided on a screen on which a plurality of selection targets are displayed and a front surface of the screen. A touch panel that outputs information indicating a contacted area when touched, an area determination unit that determines a contact area based on the output information, and a portion that overlaps the contact area from among a plurality of selection targets An extraction unit for extracting a selection target, an overlap determination unit for determining whether or not there are a plurality of selection targets to be extracted, and an enlarged selection target to be displayed on a screen when it is determined that there are a plurality of selection targets An enlargement condition determination unit for determining an enlargement magnification for the purpose based on the shape of the contact area, and a display control unit for redisplaying the extracted selection target enlarged at the enlargement magnification on the screen.

JP 2009-32028 A

  When displaying an enlarged image of an operation position using an input medium on a mobile terminal equipped with a touch panel, the user performs an input operation using, for example, a finger as an input medium in the method of redisplaying the enlarged image at the operation position. In this case, the enlarged image is covered with the user's finger, and the user may not be able to visually recognize the enlarged image. In addition, when the user performs input using the fingers of both hands in such a portable terminal, the enlarged images may overlap each other, which may hinder each input operation.

  The present invention has been made in view of the above problems. When an input medium such as a finger approaches the screen, when the enlarged image at the close position is displayed, the enlarged image overlaps the input medium and the screen is visually recognized. It is an object of the present invention to provide a three-dimensional input device capable of preventing difficulty.

  In order to solve the above problems, a three-dimensional input device according to the present invention includes a display means for displaying data, and a three-dimensional position of the input medium, and a proximity position on the screen of the display means is determined from the three-dimensional position. A display control means for displaying an enlarged image within a predetermined distance from the proximity position at a position moved in a predetermined direction from the proximity coordinates on the screen of the display means, and a screen of the display means. And an input means for inputting data based on the contact position when the contact is detected.

  According to the three-dimensional input device according to the present invention, when an enlarged image such as a finger is brought close to the screen, when the enlarged image at the close position is displayed, the enlarged image overlaps with the input medium so that the screen becomes difficult to visually recognize. It becomes possible to prevent.

1 is a perspective view of a three-dimensional input device (cellular phone) according to the present invention. The block diagram which shows the function of the three-dimensional input device (mobile telephone) which concerns on this invention. Schematic for demonstrating input operation in the three-dimensional input device (mobile telephone) which concerns on this invention. The flowchart which shows the procedure at the time of the three-dimensional input device (cellular phone) concerning this invention performing an input control process. The flowchart which shows the procedure at the time of the three-dimensional input device (mobile telephone) which concerns on this invention performing an enlarged image display process. Schematic which shows the state just before "7" is input when input control processing is performed in the three-dimensional input device (cellular phone) according to the present invention. Schematic which shows the state just before "g" is input, when input control processing is performed in the three-dimensional input device (cellular phone) which concerns on this invention. Schematic which shows the state just before "g" is input in the state where the enlarged image of "7" is displayed when the input control process is performed in the three-dimensional input device (cellular phone) according to the present invention.

  An embodiment of a three-dimensional input device according to the present invention will be described with reference to the accompanying drawings. The three-dimensional input device according to the present invention includes a display device (touch screen) that displays input items on a screen and allows a user to input data by touching the screen with an input medium such as a finger U. The cellular phone 1 will be described as an example.

  FIG. 1 is a perspective view showing a mobile phone 1. As shown in FIG. 1, the mobile phone 1 includes a rectangular plate-shaped housing 10. On one surface of the housing 10, a touch screen 11 for inputting data by displaying data and detecting contact of an input medium, a speaker 12 for outputting sound, a microphone 13 for inputting sound, and data are input. An operation key 14 is provided.

  The touch screen 11 displays the data on the screen 11a, and corresponds to the touch position by detecting the touch position when the user touches the screen 11a with an input medium such as a finger U or a dedicated pen. It has both functions of the input function to input data. The method for detecting contact may be a method for detecting by static electricity or a method for detecting by pressure, or a method using infrared rays, or other methods.

  The touch screen 11 includes, for example, a plurality of infrared transmission devices that transmit infrared rays, and a plurality of infrared detection devices that detect reflected light when the transmitted infrared rays are reflected by an input medium. The plurality of infrared transmission devices and the plurality of infrared detection devices are arranged in a grid on the screen 11a of the touch screen 11, for example, and the touch screen 11 transmits reflected light even when the input medium is not in contact with the screen 11a. The three-dimensional position of the input medium can be estimated based on the detected position of the infrared detection device. Note that the three-dimensional position detection method is not limited to this, and any method may be used.

  The operation key 14 may be a key for inputting data by being physically pressed by a user, or a key for inputting data by detecting contact of an input medium by static electricity or pressure. The operation keys 14 are, for example, a power key for switching power ON / OFF or returning from a standby state, a call key for starting a call, and the like.

  FIG. 2 is a block diagram showing functions of the mobile phone 1. As shown in FIG. 2, the mobile phone 1 includes a main control unit 20, a power supply circuit unit 21, a three-dimensional input detection unit 22, a display control unit 23, an audio control unit 24, a communication control unit 25, and a storage unit 26 via a bus. They are configured to be communicable with each other.

  The main control unit 20 includes a CPU (Central Processing Unit), performs overall control of the mobile phone 1, and performs input control processing, which will be described later, and various other arithmetic processing and control processing. Further, when detecting an input operation of any one of the operation keys 14, the main control unit 20 performs a process corresponding to the operation key 14. The power supply circuit unit 21 includes a power supply source (battery or the like), for example, switches the power supply ON / OFF state of the mobile phone 1 based on an input via a predetermined operation key 14, and power is supplied when the power supply is ON. Electric power is supplied from the supply source to each unit to enable the mobile phone 1 to operate.

  The three-dimensional input detection unit 22 generates a signal indicating the contact position when the contact of the input medium is detected on the screen 11 a of the touch screen 11 and transmits the signal to the main control unit 20. The three-dimensional input detection unit 22 transmits infrared rays from each infrared transmission device of the touch screen 11 based on, for example, a user operation or every predetermined time, and detects the reflected light of the infrared rays in each infrared detection device. Let The three-dimensional input detection unit 22 generates a signal indicating the detected value and transmits the signal to the main control unit 20. The main control unit 20 that has received the signals estimates a three-dimensional position of the input medium based on those signals, and performs processing corresponding to the three-dimensional position.

  The display control unit 23 generates screen display data based on the control of the main control unit 20 and displays the data on the screen 11 a of the touch screen 11.

  The sound control unit 24 generates an analog sound signal from the sound collected by the microphone 13 based on the control of the main control unit 20, and converts the analog sound signal into a digital sound signal. Further, when acquiring the digital audio signal, the audio control unit 24 converts the digital audio signal into an analog audio signal based on the control of the main control unit 20, and outputs the analog audio signal as audio from the speaker 12.

  The communication control unit 25 includes an antenna 25a, and based on the control of the main control unit 20, the received signal received from the base station via the antenna 25a is decoded to restore the data. This data is transmitted to the voice control unit 24 and output from the speaker 12 or recorded in the storage unit 26 according to an instruction from the main control unit 20. In addition, when the communication control unit 25 acquires voice data collected by the microphone 13 or data stored in the storage unit 26 based on the control of the main control unit 20, the communication control unit 25 performs encoding processing on these data. And transmit to the base station via the antenna 25a.

  The storage unit 26 is used when processing performed by the main control unit 20 is performed by a ROM (Read Only Memory), a hard disk, a non-volatile memory, and the main control unit 20 that store processing programs and data necessary for the processing. RAM (Random Access Memory) that temporarily stores data to be stored. Further, it is assumed that a processing program when the main control unit 20 performs input control processing described later is stored in, for example, a ROM.

  FIG. 3 is a schematic diagram illustrating how the user performs an input operation using the touch screen 11. As shown in FIG. 3, each infrared output device arranged in a grid, for example, on the touch screen 11 outputs infrared rays substantially perpendicular to the screen 11a. When the user brings the finger U close to the screen 11 a of the touch screen 11, the infrared light is reflected by the finger U, and the reflected light is any one of the infrared detection devices arranged in a grid pattern on the touch screen 11. Is detected. The mobile phone 1 estimates the proximity position (three-dimensional position) of the finger U based on the position of the infrared detection device that has detected the reflected light.

  The mobile phone 1 specifies the proximity coordinates on the screen 11a of the finger U based on the proximity position of the finger U, and enlarges and displays the vicinity of the proximity coordinates (for example, a range within a predetermined distance from the proximity coordinates). When the finger U further approaches the screen 11a and the finger U touches the screen 11a of the touch screen 11, the touch of the finger U is detected by the touch screen 11, and input processing corresponding to the contact position is executed. .

  When the cellular phone 1 enlarges and displays the vicinity of the proximity position by the proximity operation of the finger U on the touch screen 11, the display position of the enlarged image is adjusted so that the enlarged image does not overlap the finger U performing the proximity operation. . When the mobile phone 1 adjusts the display position of the enlarged image, for example, an enlarged image with a radius of 10 mm is displayed with the position moved 20 mm upward (Y-axis plus direction) from the proximity position of the finger U as the center position of the enlarged image. . Further, for example, when the user is inputting with both hands, when another enlarged image is displayed at the display position of the enlarged image, or when the display position of the enlarged image is operated by the finger U. If the position overlaps with the existing position, the mobile phone 1 further moves the display position of the enlarged image in the horizontal direction (any direction of the X axis). These prevent the input operation from being hindered by the enlarged image.

  As described above, when the user brings the finger U close to the screen 11a of the touch screen 11 in order to perform an input operation, the mobile phone 1 displays an enlarged image based on the proximity position of the finger U, and the user The procedure for performing input control processing for inputting data based on the contact position of the finger U when the finger U is brought into contact with the screen 11a of the touch screen 11 will be described based on the flowcharts shown in FIGS. To do.

  As shown in FIG. 4, first, the main control unit 20 determines whether or not the proximity of the finger U is detected (S101). At this time, for example, when the three-dimensional input detection unit 22 detects a three-dimensional position such as the finger U and the three-dimensional position is within a predetermined distance from the screen 11a of the touch screen 11, the main control unit 20 detects the finger. It is determined that the proximity of U has been detected. When the proximity of the finger U is not detected (No in S101), the main control unit 20 stands by as it is.

  When the proximity of the finger U is detected (Yes in S101), the main control unit 20 performs an enlarged display process for enlarging and displaying the vicinity of the proximity position. FIG. 5 is a flowchart showing a procedure when the cellular phone 1 performs the enlarged display process. As shown in FIG. 5, the main control unit 20 sets the center of the enlarged position (displayed position of the enlarged image) as a position shifted 20 mm upward from the proximity position of the finger U in the Y direction (Y axis plus direction), for example. For example, an area having a radius of 10 mm from the center is set as an enlarged position (S201).

  The main control unit 20 determines whether an enlarged image is already displayed at the enlarged position (S203). For example, when the user performs input using the fingers U of both hands, a plurality of enlarged images are displayed. In that case, it is necessary to display the enlarged images so as not to overlap each other. Therefore, when an enlarged image has already been displayed at the enlarged position (Yes in S203), the main control unit 20 sets the enlarged position of the newly displayed enlarged image in the X direction so as not to overlap with other enlarged images. (S205).

  The main control unit 20 determines whether there is a range in which an input operation is performed in the vicinity of the enlargement position (S207). For example, when the user performs input using the fingers U of both hands, and the user performs a new enlarged display at a position where the input operation is to be performed with one finger U, the input operation with the finger U is performed. It becomes impossible. Therefore, if there is a range where the input operation is performed in the vicinity of the expansion position (Yes in S207), the main control unit 20 moves the expansion position in the X direction so as not to overlap the range where the input operation is performed. (S209).

  The main control unit 20 displays an enlarged image with a radius of 10 mm, for example, with the enlarged position as the center (S211).

  In this way, when the finger U approaches the screen 11a of the touch screen 11, the main control unit 20 displays an enlarged image of the proximity position at an appropriate position. Then, the main control unit 20 displays a cross (“+”) mark indicating the proximity position of the finger U in the enlarged image (S105). This mark is not limited to the “+” mark, but may be a mark of any shape.

  A specific display example of the enlarged image will be described with reference to FIGS. 6 is a schematic diagram illustrating a state immediately before “7” is input by a user operation with the finger U when input control processing is performed in the mobile phone 1, and FIG. It is the schematic which shows the state just before "g" is input. FIG. 8 is a schematic diagram illustrating a state immediately before “g” is input in a state where an enlarged image near the display of “7” is displayed when input control processing is performed in the mobile phone 1. It is.

  As shown in FIG. 6, when the user wants to input “7” into the mobile phone 1, the proximity position 30 of the finger U is brought close to the position where “7” is displayed on the screen 11a. In that case, an enlarged image 31 is displayed at a position where the proximity position 30 of the finger U is moved in the Y-axis plus direction, and a “+” mark 32 is displayed at a position corresponding to the proximity position 30 in the enlarged image 31. A dotted circle around the proximity position 30 is a circle having a predetermined radius (for example, 5 mm) with the proximity position 30 as the center, and indicates an area to be enlarged.

  Similarly, as shown in FIG. 7, when the user wants to input “g” to the mobile phone 1, the proximity position 30 a of the finger U is positioned near the position where “g” is displayed on the screen 11 a. . In that case, an enlarged image 31 is displayed at a position where the proximity position 30 of the finger U is moved in the Y-axis plus direction, and a “+” mark 32 is displayed at a position corresponding to the proximity position 30 in the enlarged image 31.

  Further, for example, when the user tries to input “g” with the left hand finger U while the user is trying to input “7” with the right hand finger U, as shown in FIG. If the enlarged image 31a is displayed by moving in the Y-axis plus direction in the peripheral range where “g” is displayed, the enlarged image 31 around the “7” and the enlarged image 31a around the “g” are displayed. Will overlap. It should be noted that when the circles on the outer circumferences of both enlarged images 31, 31a intersect, it may be determined that the enlarged images 31, 31a overlap. If the enlarged images 31 and 31a overlap, as shown in FIG. 8, the mobile phone 1 moves the enlarged image 31a around “g” in any direction of the X axis in step S205. Display.

  Further, the main control unit 20 determines whether or not the finger U has moved in the horizontal direction (direction parallel to the screen 11a) with the finger U approaching the screen 11a (S107). When the finger U has moved in the horizontal direction (Yes in S107), the process returns to step S103, and the main control unit 20 performs the processes of steps S103 to S107 again.

  When the finger U has not moved in the horizontal direction (No in S107), the main control unit 20 determines whether or not the finger has left the screen 11a of the touch screen 11 (S109). At this time, the main control unit 20 detects the three-dimensional position of the finger U, for example, by the same method as in step S101, and the three-dimensional position is a predetermined distance from the screen 11a of the touch screen 11. When it is outside, it is determined that the finger U is separated.

  When the finger U is not separated from the screen 11a (No in S109), the main control unit 20 determines whether or not the finger U has touched the screen 11a of the touch screen 11 (S111). When the finger U is not in contact with the screen 11a (No in S111), the main control unit 20 returns to Step S103 and performs the processing of Steps S103 to S107 again, assuming that no input instruction has been given by the user. .

  When the finger U touches the screen 11a (Yes in S111), the main control unit 20 displays an enlarged image of the contact position on the assumption that an input instruction has been given by the user (S113). The display position of the enlarged image is the same as the display position in step S211. Then, the main control unit 20 executes a process corresponding to the contact position (S115). The processing corresponding to the contact position is general processing performed after contact with the finger U, and includes processing for waiting until the finger U is not in contact with the screen 11a.

  The main control unit 20 determines whether or not the finger U has left the screen 11a of the touch screen 11 (S117). At this time, the main control unit 20 detects the three-dimensional position of the finger U, for example, by the same method as in step S101, and the three-dimensional position is a predetermined distance from the screen 11a of the touch screen 11. When it is outside, it is determined that the finger U is separated.

  When the finger U is not away from the screen 11a (No in S117), the process returns to step S103, and the main control unit 20 performs the processes from S103 to S117 again. When the finger U has left the screen 11a (Yes in S109, Yes in S117), the main control unit 20 hides the enlarged image displayed in step S211 or S113, and ends the input control process.

  In this way, when the cellular phone 1 detects the proximity of the finger U to the screen 11a of the touch screen 11, the cellular phone 1 displays an enlarged image around the proximity position on the screen 11a at a position shifted from the proximity position, and enlarges. A “+” mark indicating the proximity position of the finger is displayed in the image. Then, when the finger U moves in a state of being close to the screen 11a, the cellular phone 1 updates and displays the enlarged range as the finger U moves.

  When the finger U touches the screen 11a of the touch screen 11, the mobile phone 1 executes an input process corresponding to the contact position. During this contact, the enlarged image is displayed in the same manner as when the finger U is close to the screen 11a. When the finger U is within a predetermined distance with respect to the screen 11a after contact on the screen 11a, the display of the enlarged image is continued. On the other hand, when the user moves the finger U outside the predetermined distance with respect to the screen 11 a of the touch screen 11, the mobile phone 1 stops displaying the enlarged image.

  According to the three-dimensional input device (mobile phone 1) according to the present invention, when an input medium such as the finger U approaches the screen 11a, an enlarged image of the close position is moved from the close position of the input medium and displayed. It is possible to prevent the enlarged image from overlapping the input medium and make it difficult to visually recognize the screen 11a, and even when input is performed using a plurality of input media, the respective enlarged images are overlapped to hinder the input operation. This can be prevented.

  As an explanation of the present invention, the mobile phone 1 has been described. However, the present invention is not limited to this, but PHS (Personal Handyphone System), PDA (Personal Digital Assistants), MID (Mobile Internet Device), mobile music player, mobile video camera, mobile game Any information processing terminal may be used as long as the information processing terminal has a three-dimensional input function such as a computer.

  DESCRIPTION OF SYMBOLS 1 ... Mobile phone, 10 ... Housing | casing, 11 ... Touch screen, 11a ... Screen, 12 ... Speaker, 13 ... Microphone, 14 ... Operation key, 20 ... Main control part, 21 ... Power supply circuit part, 22 ... Three-dimensional input detection 23, display control unit, 24 ... voice control unit, 25 ... communication control unit, 25a ... antenna, 26 ... storage unit, 30, 30a ... proximity position, 31, 31a ... enlarged image, 32, 32a ... cross (" + ") Mark.

Claims (5)

Display means for displaying data;
A specifying means for detecting a three-dimensional position of the input medium and specifying a proximity position on the screen of the display means from the three-dimensional position;
Display control means for displaying an enlarged image within a predetermined distance from the proximity position at a position moved in a predetermined direction from the proximity coordinates on the screen of the display means;
3. A three-dimensional input device comprising: an input unit that inputs data based on a contact position when contact is detected on the screen of the display unit.   The three-dimensional input device according to claim 1, wherein the display control unit displays a mark indicating the proximity position in the enlarged image when the enlarged image is displayed. The specifying unit sequentially updates the proximity position in accordance with the movement of the three-dimensional position of the input medium,
The three-dimensional input device according to claim 1, wherein the display control unit sequentially updates a range of the enlarged image in accordance with the proximity position updated by the specifying unit.   2. The display control unit according to claim 1, wherein when there are a plurality of input media, the display control unit adjusts and displays the positions of the enlarged images so that the enlarged images of the input media do not overlap each other. 3D input device.   The three-dimensional input device according to claim 1, wherein the display control means displays an enlarged image when the input medium is within a predetermined distance with respect to the screen of the display means.

Images