JP2004102719A - Information processing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display and control characters by many complicated operation patterns. <P>SOLUTION: A touch pad 20 formed of a transparent member is provided on the display part 12 of a cellphone. A user input operation determination part 24 determines the moving direction and the moving distance of a user's finger based on XY-coordinate data corresponding to the movement of the user's finger on the touch pad 20. A character operation selection part 25 selects a corresponding control pattern from among a plurality of stored control patterns based on the present display position of each portion such as the head or the arm of the character stored in a character data preservation part 27 and a determination result from the user input operation determination part 24. A character data processing part 26 and a character rendering part 11 display and control the character operating corresponding to the selected pattern on the display part 12. Since a complicated input can be detected by the touch pad 20, the characters can be displayed and controlled the many complicated operation patterns. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
INDUSTRIAL APPLICABILITY The present invention is suitable for use in a terminal device such as a mobile phone, a PHS phone (PHS: Personal Handyphone System), a PDA device having a communication function (PDA: Personal Digital Assistants), or a personal computer device having a communication function. The present invention relates to an information processing apparatus, and more particularly to an information processing apparatus that determines the current state based on a sensor and controls operation of a terminal device.
[0002]
[Prior art]
At present, an application program (interaction program) for displaying a predetermined character on a display screen of a terminal device such as a mobile phone or a personal computer device and displaying the character in response to a key operation by a user is known.
[0003]
This interaction program controls the display of a character on the display screen so that the character on the display screen raises the right hand, for example, when a key “1” is pressed among ten keys provided on the mobile phone. Is pressed, the display control of the character is performed such that the character in the display screen raises the right foot.
[0004]
This allows the user to interactively (interactively) operate the character displayed on the standby screen of the mobile phone or the desktop of the personal computer device through a desired key operation.
[0005]
In many cases, the standby screen or the desktop of a mobile phone simply displays an image of a character or the like. And provide desktop images.
[0006]
[Problems to be solved by the invention]
However, in the conventional interaction program, “character action” is assigned to “operation key”. For this reason, the number of operation keys provided on a terminal device such as a mobile phone or a personal computer device is limited, so that there is a problem that the motion pattern of the character is small and simplified.
[0007]
The operation of “pressing” the operation key is an operation of “pressing” in the real world. In response to the “push” action in the real world, the user intuitively expects the action of the character being pushed by a finger and retreating.
[0008]
However, the operation key provided in the terminal device has only an operation method of “pressing”, and the character performs a plurality of patterns of operations for one operation of “pressing”. As a reaction of a character in the world, there is a problem that a reaction far from the action in the real world exists.
[0009]
Further, the conventional interaction program controls the display of a character after a key operation by a user, so that there is a problem that only a passive display control can be performed.
[0010]
The present invention has been made in view of the above-described problems, and can control display of a character in a complex and numerous motion patterns so as to be a reaction corresponding to an action in the real world. It is an object of the present invention to provide an information processing apparatus which can be operated in a dynamic manner.
[0011]
[Means for Solving the Problems]
The information processing apparatus according to the present invention can detect a complicated input operation from a user by providing at least a two-dimensional input unit that detects an input position and an input distance of the user. Then, the display of the character is controlled in a number of motion patterns respectively corresponding to the complicated input.
[0012]
Further, the information processing apparatus according to the present invention comprehensively determines the current situation based on outputs from a plurality of sensors, and at least changes a display object displayed on the display means based on the determination result. The display object is actively operated by controlling the display.
[0013]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, as a first embodiment, an example of a terminal device for actively operating a character or the like will be described. As a second embodiment, a complex and a large number of motion patterns will be set so as to be reactions corresponding to actions in the real world. An example of a terminal device that controls display of a character will be described.
[0014]
[First Embodiment]
[Configuration of First Embodiment]
FIG. 1 is a block diagram showing a main configuration of a terminal device according to a first embodiment to which the present invention is applied. The terminal device shown in FIG. 1 is a mobile phone. In order to make the block diagram complicated, illustration of a communication system and the like is omitted.
[0015]
In FIG. 1, a mobile phone includes a timer 1 (= time sensor) for measuring time, an optical sensor 2 for detecting the brightness of a place where the mobile phone is placed, and a place where the mobile phone is placed. And a sound sensor 3 for detecting a sound around.
[0016]
The mobile phone has a schedule book 4 storing a user's schedule including data such as a date, a start time, an end time, and the like, and a call book, a call time, a telephone number of a call destination, a call destination name, and the like. A call history memory 5 in which a call history made up of data is stored, and a control pattern in which information of a plurality of control patterns for operating the mobile phone based on each information of the timer 1 to the call history memory 5 is stored. And a table.
[0017]
The mobile phone includes a vibration function 7 for vibrating the mobile phone, a voice control unit 8 for controlling a predetermined voice corresponding to the control pattern through a speaker unit 9, and a plurality of voice patterns of the character. It has a stored character voice memory 10, a character drawing unit 11 for drawing a character to be displayed on the display unit 12 based on the control pattern, and a control unit 13 (CPU) for controlling the entire mobile phone. ing.
[0018]
[Operation of First Embodiment]
FIG. 2 is a flowchart showing a flow until the mobile phone actively operates a character or the like. The flowchart in FIG. 2 starts when the main power supply of the mobile phone is turned on.
[0019]
First, in steps S1 and S2, the CPU 13 acquires time information from the timer 1 and holds 1-bit data of “1” or “0” according to the time information.
[0020]
Specifically, as shown in FIG. 3, the CPU 13 determines, for example, a period from 4:00 am to 16:00 pm as “daytime”, and sets “1” when the current time corresponds to this daytime. Retain data. On the other hand, the CPU 13 determines that the period from 16:00 pm to 4:00 am is “nighttime”, and holds the data “0” when the current time corresponds to this nighttime.
[0021]
Next, the schedule book 4 stores data such as a future schedule date, a start time, and an end time. In steps S3 and S4, the CPU 13 acquires schedule information within a predetermined time, such as the current day, from the schedule book 4, and holds the 1-bit data according to the schedule information.
[0022]
Specifically, in this case, the CPU 13 operates as a so-called schedule sensor, and when, for example, the schedule of the day is stored in the schedule book 4, as shown in FIG. Is retained. On the other hand, when the schedule of the day is not stored in the schedule book 4, the schedule is determined to be “none” and the data of “0” is held.
[0023]
Next, in the call history memory 5, when the user makes a call, data such as a call date, a call time, a telephone number of a call destination, a call destination name, and the like are stored as histories. In step S5 and step S6, the CPU 13 acquires the call history from the call history memory 5, and detects the call history information within a predetermined time, for example, within 3 hours from the current time, from among the call history. Then, the 1-bit data is held according to the presence or absence of the call history information within the predetermined time.
[0024]
More specifically, in this case, the CPU 13 operates as a so-called call history sensor, and determines that the call history is “present” as shown in FIG. Then, the data of "1" is held. On the other hand, if there is no call history within the predetermined time in the call history memory 5, the CPU 13 determines that the call history is "none" and holds the data of "0".
[0025]
In this example, the call history such as the call date, the call time, the telephone number of the callee, and the callee name, which is stored when the user makes a call, is used. The incoming call history, such as the incoming date, the incoming time, the telephone number of the transmission destination, and the name of the sender, which are stored at that time may be used. Alternatively, the call history and the incoming call history may be used together.
[0026]
Next, the optical sensor 2 detects the illuminance (brightness) of the place where the mobile phone is placed. In steps S7 and S8, the CPU 13 acquires the illuminance information detected by the optical sensor 2, and holds the one-bit data corresponding to the illuminance information.
[0027]
Specifically, as shown in FIG. 6, the CPU 13 determines that the illuminance is “dark” when the illuminance is, for example, from 0.0 to 0.4, and “1” when the current illuminance corresponds to this range. Holds the data. On the other hand, the CPU 13 determines that the illuminance is “bright” when the illuminance is, for example, from 0.4 to 1.0, and holds “0” data when the current illuminance falls within this range.
[0028]
In this example, two kinds of judgments, “dark” or “bright”, are made. However, this is done by a plurality of judgments such as “dark”, “dim”, “slightly bright”, and “bright”. The determination may be made in stages. This means that the number of bits held by the CPU 13 in the determination of the brightness is 2 bits, and “dark” = “00”, “dim” = “01”, “slightly bright” = “10”, and “bright” = This can be realized by setting “11”.
[0029]
Next, the sound sensor 3 detects the loudness (sound pressure level) of the sound around the place where the mobile phone is placed. In step S9, the CPU 13 acquires information (sound pressure information) indicating the sound pressure level detected by the sound sensor 3, and holds 1-bit data corresponding to the sound pressure information.
[0030]
Specifically, as shown in FIG. 7, when the sound pressure level is less than 40 dB, for example, the CPU 13 determines that the surroundings are “quiet”, and when the current sound pressure level is less than this 40 dB, “1” is set. Is retained. On the other hand, when the sound pressure level is, for example, 40 dB or more, the surroundings are determined to be “noisy”, and when the current sound pressure level is 40 dB or more, the data of “0” is held.
[0031]
In this example, two kinds of judgments, such as "quiet" or "noisy", are performed. However, this is performed in a plurality of stages such as "quiet", "normal", "slightly noisy", "noisy", and the like. Alternatively, the determination may be made separately. This can be realized when the CPU 13 sets the number of bits of data held based on the sound pressure information to 2 bits, as in the case of the illuminance.
[0032]
Next, in step S10, the CPU 13 sets the “current data pattern”, which is a combination of the one-bit data held in steps S2, S4, S6, S8, and S9, and the control pattern table 6 Is compared with the "data pattern" of each control pattern stored in the control pattern. Then, in step S11, from among the "data patterns" stored in the operation pattern table 6, a "data pattern" that matches the "current data pattern" is detected, thereby corresponding to the "current data pattern". The “control pattern” to be performed is detected.
[0033]
Next, in step S12, the CPU 13 controls each section of the mobile phone based on the detected control pattern. Thus, one control process shown in the flowchart of FIG. 2 ends.
[0034]
The control process shown in the flowchart of FIG. 2 is repeatedly executed while the main power of the mobile phone is turned on.
[0035]
[Specific example of control]
As an example, FIG. 8 shows a relationship between each control pattern and a control example of each unit.
[0036]
[First control pattern]
In FIG. 8, when the “current data pattern” becomes “11011”, the CPU 13 selects the first control pattern from the control pattern table 6.
[0037]
This first control pattern is currently daytime (1), a schedule of the day exists (1), there is no call history within 3 hours (0), the periphery of the mobile phone is dark (1), and The case around the telephone is quiet (1).
[0038]
In such a case, it is morning, and the user is sleeping while the schedule is on, and the telephone that he calls every morning has not been used yet. In other words, the user is sleeping in the morning.
[0039]
For this reason, the CPU 13 sets and controls the voice control unit 8 to “ring tone → on” and “volume → maximum level”, and reads character voice information for getting up, such as “wake up”, from the character voice memory 10. Control. This character voice information is supplied to the voice control unit 8.
[0040]
Further, the CPU 13 controls the character drawing unit 11 so as to perform a drawing process on a character performing a shouting operation, and controls driving of a vibration function.
[0041]
As a result, the character performing a shouting operation is displayed on the display unit 12 of the mobile phone, and the voice of “Wake up” is controlled by the voice of the character via the speaker unit 9. Vibration drive.
[0042]
Note that, in this case, the CPU 13 continuously executes the voice utterance control and the drive control of the vibration function until the user performs a stop operation.
[0043]
Thereby, in this case, the mobile phone functions as an alarm clock. The user will recognize that he or she has been woken up by looking at the character shouting “Get up” displayed on the display unit 12. They will also remember the schedule of the day and implement the schedule as scheduled. In this way, the character who wakes up in this way will remember feelings such as intimacy.
[0044]
[Second control pattern]
Next, when the “current data pattern” becomes “10011”, the CPU 13 selects a second control pattern from the control pattern table 6.
[0045]
This second control pattern is currently daytime (1), there is no schedule for the day (0), there is no call history within 3 hours (0), the periphery of the mobile phone is dark (1), and the mobile phone is dark. Is a quiet (1) case.
[0046]
In such a case, it is morning, and the user is still sleeping and the telephone that he calls every morning is not yet used. In other words, the user is sleeping slowly because there is no schedule.
[0047]
For this reason, the CPU 13 sets and controls the voice control unit 8 so that the ring tone is turned on without changing the normally set volume, and also wakes up from the character voice memory 10 such as "What if it is about to happen?" The character voice information is read and controlled.
[0048]
Further, the CPU 13 controls the character drawing unit 11 so as to perform a drawing process on a character performing an easy visiting operation, and also turns off the vibration function.
[0049]
As a result, a character making a gently visiting operation is displayed on the display unit 12 of the mobile phone, and the voice of the character is controlled via the loudspeaker unit 9 to say "If it is time to get up?"
[0050]
Note that, in this case, the CPU 13 continuously executes the voice utterance control until a stop operation is performed by the user.
[0051]
Thus, in this case, as in the first control pattern, the mobile phone functions as an alarm clock, but the mobile phone gently wakes up the user as a so-called alarm clock.
[0052]
As described above, the first control pattern and the second control pattern differ in how the user wakes up depending on the presence or absence of the schedule. By performing the operation control of each unit based on the plurality of sensor outputs, it is possible to perform the control according to the situation as described above.
[0053]
[Third control pattern]
Next, when the “current data pattern” becomes “10101”, the CPU 13 selects a third control pattern from the control pattern table 6.
[0054]
This third control pattern is currently daytime (1), there is no schedule for the day (0), there is a call history within 3 hours (1), the surroundings of the mobile phone are bright (0), and the mobile phone is Is a quiet (1) case.
[0055]
In such a case, it is morning, and the user is awake because of the call history, and the surroundings are in a quiet state. In other words, the user is awake but not aware of what he is doing.
[0056]
For this reason, the CPU 13 sets and controls the voice control unit 8 to “ringtone → on” and “volume → minimum level”, and controls the voice so that the ringtone sounds only for 2 seconds, for example, to attract the user's attention. The unit 8 is controlled.
[0057]
Further, the CPU 13 reads out character voice information such as “Hey, what are you doing?” From the character voice memory 10 and controls it.
[0058]
In addition, the CPU 13 controls the character drawing unit 11 so as to perform a drawing process on a character performing such a visiting operation, and also controls off the vibration function.
[0059]
As a result, after the ringing tone of the mobile phone sounds for two seconds, the character performing the visiting operation is displayed on the display unit 12, and the character's voice is displayed via the speaker unit 9 as “Hey, what? Is it voiced? "
[0060]
As a result, the user hears the ring tone of the mobile phone, and when the user looks at the mobile phone, the character displayed on the display unit 12 visits, "Hey, what are you doing?" . Therefore, the user will feel more intimate with such a character.
[0061]
[Fourth control pattern]
Next, when the “current data pattern” becomes “10100”, the CPU 13 selects the fourth control pattern from the control pattern table 6.
[0062]
This fourth control pattern is currently daytime (1), there is no schedule for the day (0), there is a call history within 3 hours (1), the surroundings of the mobile phone are bright (0), and the mobile phone is Is noisy (0).
[0063]
In such a case, it is the morning, and the user has woken up because of the call history, and the user is in a noisy place such as in a city or on a train because the surroundings are noisy. It is in a state of viewing broadcasts and listening to music. In this case, in any case, the user is currently in a state where he / she cannot take hold of the character.
[0064]
For this reason, the CPU 13 sets and controls the voice control unit 8 so as to turn off the ringtone and controls the character drawing unit 11 so as to draw a character performing a predetermined operation for such a situation. In addition, the vibration function is turned off.
[0065]
This is the same state as the so-called "manner mode". For this reason, it is possible to prevent the inconvenience of injuring people in the street or on the train due to an unexpected ringtone. Alternatively, it is possible to prevent inconvenience of disturbing a user who concentrates on television broadcasting and music.
[0066]
Note that the description of the control pattern will be limited to the description of the above four patterns because the description will be long. However, in the other control patterns, it is assumed that the control based on the current state determined according to each sensor output is performed. I want to be understood.
[0067]
[Effects of the First Embodiment]
As is apparent from the above description, the mobile phone according to the first embodiment has a timer 1, an optical sensor 2, sensor outputs from the sound sensor 3, a schedule registered in the schedule book 4, and a call history memory. Based on the call history stored in 5, the current status of the mobile phone is determined, and each unit of the mobile phone is controlled so as to perform an operation according to the determination result.
[0068]
Thus, instead of passive control such as controlling each unit after waiting for a user's input, active control such as operating a mobile phone (including a character or the like) voluntarily by judging the current situation is performed. Can be.
[0069]
[Second embodiment]
[Configuration of Second Embodiment]
Next, FIG. 9 shows a block diagram of a terminal device according to a second embodiment to which the present invention is applied. The terminal device shown in FIG. 9 is also a mobile phone as in the first embodiment described above, and only the main configuration is shown.
[0070]
In FIG. 9, the mobile phone includes a touchpad 20 having a built-in pressure sensor and a position sensor, a CPU 13, a display unit 12, and character data for storing position information of each part of the character displayed on the display unit 12. It has a holding unit 27 and other components 28 of a mobile phone such as a communication system.
[0071]
The touch pad 20 is formed of a transparent plate-like member in which transparent electrodes are arranged in a matrix, and is provided so as to cover the entire surface of the display unit 12 (or a part of the surface). Therefore, when the user operates the touch pad 20, the user operates the touch pad 20 by scanning the surface of the display unit 12 with a finger (or an input pen).
[0072]
The CPU 13 corresponds to the CPU 13 of the above-described first embodiment. In the case of the mobile phone according to the second embodiment, the CPU 13 includes: an input information conversion unit 21 that converts the position information from the position sensor of the touch pad 20 into XY coordinate data of a display screen of the display unit 12; A pressure detector 22 for detecting the presence or absence of the pressing force of the user based on the detection output from the pressure sensor of the pad 20.
[0073]
Further, the CPU 13 analyzes an input information analyzing unit 23 for analyzing a moving direction of the user's finger (an operation direction of the touch pad 20) based on the XY coordinate data from the input information converting unit 21. And a user input operation determining unit 24 that determines the movement of the user's finger based on the analysis output from the user.
[0074]
The CPU 13 further includes a character motion selection unit 25 for selecting a motion pattern of a character to be displayed on the display unit 12 based on the determination output from the user input motion determination unit 24 and the pressure detection output from the pressure detection unit 22. Referring to the position information of each part of the character stored in the character data storage unit 27, the character drawing unit 11 draws a character image indicating the motion selected by the character motion selection unit 25. And a character data processing unit 26 for forming drawing processing data.
[0075]
[Operation of Second Embodiment]
[When pressure is not detected]
First, the pressure detection unit 22 of the CPU 13 detects that the user has pressed the touch pad 20 when a pressure detection output indicating a pressing force equal to or greater than a predetermined threshold is supplied from the pressure sensor of the touch pad 20. It has become. For this reason, when the pressure detection output indicates a pressing force equal to or less than the predetermined threshold, the CPU 13 determines that the user has not pressed the touch pad 20 and determines that the character has only been moved by the user's finger described below. Perform display control.
[0076]
First, when the user scans the touch pad 20 with a finger, the position sensor forms position information of the finger corresponding to the scan, and supplies the position information to the input information conversion unit 21. The input information conversion unit 21 captures each position information by sampling it at predetermined intervals, and converts each of the captured position information into XY coordinate data on the display screen of the display unit 12.
[0077]
FIG. 10 shows a trajectory obtained by scanning the touch pad 20 with a finger, XY coordinate data formed by sampling position information corresponding to the trajectory and performing XY coordinate conversion processing, and an input from the input information conversion unit 21. 4 shows XY coordinate data supplied to the information analysis unit 23.
[0078]
FIG. 10 shows an example in which a finger is moved substantially zigzag in the vertical direction of the touch pad 20. Then, for such scanning, (X, Y) = (30, 50) → (X, Y) = (30, 40) → (X, Y) = (30, 30) → (X, Y ) = (30, 20)... XY coordinate data are sequentially formed, and in a state where the XY coordinate data is set as a set before and after the XY coordinate data, “(30, 50), (30, 40)” → “( 30, 40), (30, 30) "→" (30, 30), (30, 20) "...
[0079]
The notation such as (X, Y) = (30, 50) indicates that the X coordinate is the position of 30 dots in the horizontal direction of the display unit 12, and the Y coordinate is the position of 50 dots in the vertical direction of the display unit 12. Means.
[0080]
Next, the input information analysis unit 23 analyzes the direction and distance in which the user has moved his / her finger based on the XY coordinate data supplied in a state where the front and rear are paired. Specifically, when the set of XY coordinate data is “(X1, Y1), (X2, Y2)”, the input information analysis unit 23 calculates “X2-X1” and “Y2-Y1”. The calculation is performed, and the direction and distance in which the user has moved the finger are analyzed based on the numerical value of the X coordinate and the numerical value of the Y coordinate obtained by the calculation.
[0081]
FIG. 11 shows an example of this analysis operation. In FIG. 11, for example, if the XY coordinate data supplied in a state where the front and rear are paired is “(50, 40), (50, 60)”, the input information analysis unit 23 determines that “50- 50 "and" 60-40 ". The operation of “50-50” corresponds to the operation of “X2-X1”, and the operation of “60-40” corresponds to the operation of “Y2-Y1”. In this example, the calculated value of “X2-X1” is “0”, and the calculated value of “Y2-Y1” is “+20”.
[0082]
Next, the user input operation determination unit 24 detects the direction and distance in which the user has moved his / her finger based on the analysis result (= the calculated value) from the input information analysis unit 23.
[0083]
Specifically, when the sign of the calculated value of “X2-X1” is “+”, the user input operation determining unit 24 moves the display unit 12 rightward, and the sign of the calculated value is “−”. Is detected as a movement of the display unit 12 to the left, and if the sign of the operation value of “Y2-Y1” is “+”, the movement of the display unit 12 in the upward direction is detected. If the sign of the operation value is "-", it is detected as a downward movement of the display unit 12.
[0084]
In the case of the above-described calculated value, the calculated value of “X2-X1” is “0”, and the calculated value of “Y2-Y1” is “+20”. This indicates that there is no movement in the horizontal direction of the display unit 12 in the X direction, but a movement of +20 dots has occurred in the vertical direction of the display unit 12 in the Y direction. Therefore, in this case, the user input operation determination unit 24 determines the user's input operation as if the user has moved the finger by 20 dots upward in the display unit 12. Such a determination output is supplied to the character action selection unit 25.
[0085]
Further, in another example, for example, if the XY coordinate data supplied in a state where the front and rear are paired are “(30, 30), (40, 50)”, “X2−X1” The calculated value is "+10", and the calculated value of "Y2-Y1" is "+20". This indicates that the display unit 12 has moved by +10 dots in the horizontal direction and has moved by +20 dots in the vertical direction. For this reason, in this case, the user input operation determination unit 24 determines that the user has moved his or her finger in the diagonally upper right direction of the display unit 12 by approximately 20 dots.
[0086]
Next, the character action selection unit 25 selects (determines) a character action based on the character data before movement display stored in the character data storage unit 27 and the determination output from the user input action determination unit 24. I do.
[0087]
FIG. 12 is a schematic diagram of a humanoid character displayed on the display unit 12. In this case, the display unit 12 assumes that the number of dots in the vertical (Y direction) × horizontal (X direction) is 100 dots × 80 dots.
[0088]
The XY coordinate data of each part such as the head, the body, the right hand, and the left hand of the character before the movement display is stored in the character data storage unit 27 as character data.
[0089]
Specifically, in the case of this example, as shown in FIG. 13, XY coordinate data “(30, 80), (50, 80)” at both ends of a line segment corresponding to the width of the head of the character as character data. , XY coordinate data "(40, 60), (40, 40)" at both ends of a line corresponding to the length of the body, and XY coordinate data "(40, 60)," corresponding to the length of the right hand (20, 80) ”and XY coordinate data“ (40, 60), (60, 40) ”of a line segment corresponding to the length of the left hand are stored in the character data storage unit 27.
[0090]
Here, when the movement of the user's finger of “(50, 40), (60, 40)” described with reference to FIG. 11 is superimposed on the image of the character, a line corresponding to the left hand of the character is obtained as shown in FIG. It can be seen that a line segment corresponding to the movement of the user's finger intersects the minute.
[0091]
The XY coordinate data of “(50, 40), (60, 40)” is an adjacent sample as described above. That is, it means that the sample (60, 40) was obtained immediately after the sample (50, 40) was obtained. This sample is obtained using, for example, a sampling frequency of several kHz. Despite such a high frequency, each XY coordinate data of (50, 40) → (60, 40) can be obtained in a short time. Successive acquisition means that the user's finger has been moved to flip (flick) upward in the display screen.
[0092]
When such movement and position of the user's finger are superimposed on the character image shown in FIG. 12, it can be understood that the left hand of the character has been flipped upward by the user's finger.
[0093]
The character motion selection unit 25 has a motion pattern table in which a plurality of pieces of information indicating motion patterns are stored. The character motion selection unit 25 selects a corresponding motion pattern from the motion pattern table based on the character image before the movement display and the movement and the position of the user's finger, and selects the selected motion pattern. The indicated information is supplied to the character data processing unit 26.
[0094]
In the case of the above-described example, since the left hand of the character is flipped upward by the user's finger, the character motion selection unit 25 selects a motion pattern of raising the left hand of the character, and processes the information indicating the motion pattern into character data processing. To the unit 26.
[0095]
Next, the character data processing section 26 forms drawing processing data for drawing a character performing an operation corresponding to the information indicating the movement pattern from the character movement selection section 25, and controls the character drawing section 11 to generate the drawing processing data. I do.
[0096]
The character drawing unit 11 draws a character displayed on the display unit 12 based on the drawing processing data.
[0097]
In the case of the above-described example, the character data processing unit 26 forms drawing processing data for drawing a character performing an operation of raising the left hand upward, and supplies this to the character drawing unit 11. As a result, the character drawing unit 11 controls the display of the character performing the operation of raising the left hand as shown by the dotted line in FIG.
[0098]
[When pressure is detected]
Next, the drawing processing operation when the pressure is detected by the pressure detection unit 22 of the CPU 13 will be described.
[0099]
As described above, when a pressure detection output indicating a pressure level equal to or higher than a predetermined threshold is supplied from the pressure sensor of the touchpad 20, the pressure detection unit 22 detects that the user has pressed the touchpad 20. It has become. When the pressure detection unit 22 detects the pressing force, the character motion selection unit 25 determines the pressure level and the position on the display unit 12 where the pressure is applied, and determines the position from the user input motion determination unit 24. The above operation pattern is selected based on the output.
[0100]
Specifically, when the user presses the character's mouth with his / her finger, for example, in order to press the character's mouth, each of the characters is indicated as "pressed" from the position of the character's mouth indicated by a circle in FIG. Will be detected. The pressure detection unit 22 takes in the pressure detection output of the center coordinates “(40, 72)” of the range among the pressure detection outputs corresponding to the detected range, and supplies it to the character action selection unit 25. .
[0101]
In the case of this example, since the user is pressing the mouth of the character with the finger, the XY coordinate data of (40, 72) is continuously supplied to the input information analysis unit 23. For this reason, the user input motion determining unit 24 determines that the user's finger has stopped at the (40, 72) XY coordinate position on the display unit 12, and supplies the determination output to the character motion selecting unit 25. I do.
[0102]
The character action selection unit 25 detects the position where the user's finger has stopped based on the XY coordinate data of each part of the character stored in the character data storage unit 27.
[0103]
In this case, since the XY coordinates at which the user's finger is stopped are (40, 72), the character motion selection unit 25 determines that the user's finger is stopped at the position of the character's mouth.
[0104]
Further, in this case, a pressure detection output indicating that the pressing is detected from the position of the mouth of the character is supplied to the character motion selection unit 25.
[0105]
Since the user's finger is stopped at the position of the mouth of the character and the mouth of the character is pressed with the finger of the user, the character action selection unit 25 selects, for example, an action pattern in which the character closes the mouth, The information indicating the operation pattern is supplied to the character data processing unit 26.
[0106]
The character data processing unit 26 forms drawing processing data for drawing a character performing an operation corresponding to the information indicating the movement pattern from the character movement selection unit 25, and controls the character drawing unit 11.
[0107]
As a result, the character drawing unit 11 performs a drawing process for the character performing the mouth closing operation, and this is displayed on the display unit 12.
[0108]
[Effect of Second Embodiment]
As is clear from the above description, the mobile phone according to the second embodiment detects the movement of the user's finger on the display unit 12 by using the touch pad 20 provided with the position sensor and the pressure sensor. Based on the movement of the user's finger and the display position of the currently displayed character, the movement of the character is determined and display control of the character is performed.
[0109]
The pressure sensor detects a position on the display unit 12 where the user applies pressure with a finger, and based on the position where the pressure is applied and the display position of the currently displayed character, detects the position of the character. The display of the character is controlled by determining the movement.
[0110]
By providing the touch pad 20 in this manner, a complicated and large number of inputs corresponding to the scanning of the user's finger can be made possible. The display can be controlled so as to perform
[0111]
Further, the reaction of the character in the virtual world can be a reaction in accordance with the action in the real world.
[0112]
Further, the touch pad 20 is provided on the surface of the display unit 12, and can be operated while looking at a character displayed on the display unit 12 through the touch pad 20. The scanning of the finger on the touch pad 20 is reflected on the action of the character displayed on the display unit 12.
[0113]
For this reason, the user can provide a feeling of directly touching and operating the character displayed on the display unit 12 with the finger. For this reason, the user can treat the character displayed on the display unit 12 as if it were a pet, such as stroking or tickling the head. Therefore, the character displayed on the display unit 12 can be a character that increases the sense of intimacy.
[0114]
In this example, the input is complicated by providing the touch pad 20, but input means such as a trackball or a joystick may be provided instead of the touch pad 20.
[0115]
The trackball and the joystick are provided in places other than the display unit 12 due to their characteristics. However, as in the case of the touchpad 20, complicated input can be performed. The same effects as described above can be obtained as in the case of
[0116]
Although the presence or absence of a press is detected by the pressure sensor of the touch pad 20, the pressure level of the press may be detected, and the motion pattern of the character may be determined according to the pressure level. In this case, since the motion pattern of the character can be determined in accordance with the pressure level, the motion of the user's finger is analyzed in more detail than in determining the motion pattern of the character in accordance with the presence or absence of pressing. The pattern can be determined.
[0117]
[Composite operation of the first embodiment and the second embodiment]
As described above, the mobile phone to which the present invention is applied has been described as being divided into the first embodiment and the second embodiment for ease of understanding. However, the mobile phones according to the respective embodiments may be combined. . The operation in this case will be described by taking the first control pattern (current data pattern = 111011) in the above-described first embodiment as an example and in conformity with the use form of the mobile phone.
[0118]
First, the CPU 13 of the mobile phone acquires time information from the timer 1. For example, assume that this time information indicates 8:15 am on weekdays.
[0119]
Next, the CPU 13 refers to the schedule of the day from the schedule book 4 and determines whether or not a schedule is included at a time around 8:15 am. For example, it is assumed that a schedule to wait for a friend A at a coffee shop in front of the station at 9:00 am is included as this schedule.
[0120]
Next, the CPU 13 refers to the call history memory 5 and confirms whether or not there is a partner to make a call on a daily basis in the time zone around 8:15 am. For example, it is assumed that it is detected that the user calls the friend B on a daily basis for about 5 minutes from 8:00 am to 8:10 am
[0121]
Next, the CPU 13 detects the brightness around the mobile phone based on the detection output from the optical sensor 2. In this detection, it is assumed that it is detected that the surroundings of the mobile phone are dark even in the morning.
[0122]
Next, the CPU 13 detects a noise level around the mobile phone based on the detection output from the sound sensor 3. In this detection, it is assumed that almost no sound is detected around the mobile phone.
[0123]
Next, the CPU 13 determines the current state where the mobile phone is placed based on the detection results.
[0124]
That is, in the case of this example, it is currently 8 o'clock in the morning on weekdays. In addition, there is a meeting with a friend A today, and it is less than one hour before the meeting time. Despite this, the area around the mobile phone is dark and quiet. The user does not call the friend B on a daily basis. This indicates that the user is likely to be sleeping in the morning. Then, if this is the case, the meeting with the friend A will be late.
[0125]
For this reason, the CPU 13 sounds a ring tone of the mobile phone and simultaneously drives the vibration. Further, the CPU 13 controls the display unit 12 to display an image of the character shouting “Get up”.
[0126]
As a result, the user can be woken up by the character of the mobile phone and fulfill the schedule as scheduled.
[0127]
On the other hand, if the user has already woken up and is quietly organizing his / her behavior at home, the operation of such a mobile phone is annoying to the user.
[0128]
Therefore, in order to stop such an operation of the mobile phone, the user picks up the mobile phone and closes the mouth of the character shouting "Get up" with the finger.
[0129]
Such a user's action is detected by the pressure sensor of the touchpad 20, and the CPU controls the ringing tone and the vibration function 7 to be turned off, and displays the image in which the character closes the mouth on the display unit 12 as described above. Control.
[0130]
In this case, the image in which the character bows and makes an error, the image in which the character visits "Are you up?", Or the character teaches "Oh, goodbye. It's almost time to meet Mr. A". An image may be displayed.
[0131]
As can be seen from this example, the character displayed on the display unit 12 acts as a manager and watches over the user. The mobile phones according to the embodiments, which provide such a manager-like and friendly character, can be said to be very convenient devices.
[0132]
As described above, the present invention has been described in accordance with the embodiments. However, it is to be understood that each of the embodiments is an example of the present invention. For this reason, in the description of the above-described embodiment, the present invention is applied to a mobile phone. However, the present invention is applied to a PHS phone (PHS: Personal Handyphone System), a PDA device having a communication function (PDA: Personal Digital Assistants). Alternatively, the present invention may be applied to another terminal device such as a personal computer device having a communication function. Even in this case, the same effect as described above can be obtained.
[0133]
Further, other sensors such as a temperature sensor may be used in addition to the sensors 2 and 3 described above.
[0134]
It should be added that, other than these, various changes can be made according to the design and the like as long as the technical idea according to the present invention is not deviated.
[0135]
【The invention's effect】
According to the present invention, it is possible to control the display of a character displayed on the display means in a complicated and numerous motion pattern so as to be a reaction corresponding to an action in the real world.
[0136]
Further, according to the present invention, the display object displayed on the display means can be actively operated.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a main configuration of a mobile phone according to a first embodiment of the present invention.
FIG. 2 is a flowchart showing a flow of control of the mobile phone according to the first embodiment.
FIG. 3 is a diagram for explaining a day / night determination operation performed based on time information from a timer provided in the mobile phone according to the first embodiment.
FIG. 4 is a diagram for explaining an operation of determining whether there is a schedule registered in a schedule book provided in the mobile phone according to the first embodiment.
FIG. 5 is a diagram illustrating an operation of determining whether there is a call history stored in a call history memory provided in the mobile phone according to the first embodiment.
FIG. 6 is a diagram for explaining an operation of determining the brightness around the mobile phone, which is performed based on a detection output from an optical sensor provided in the mobile phone according to the first embodiment.
FIG. 7 is a diagram illustrating an operation of determining sound around the mobile phone, which is performed based on a detection output from a sound sensor provided in the mobile phone according to the first embodiment.
FIG. 8 is a diagram for explaining a control pattern of control performed based on each detection result in the mobile phone according to the first embodiment.
FIG. 9 is a block diagram illustrating a main configuration of a mobile phone according to a second embodiment of the present invention.
FIG. 10 is a diagram illustrating an example of input to a touch pad provided in the mobile phone according to the second embodiment and an example of XY coordinate data detected based on the input.
FIG. 11 is a diagram for explaining a detection operation of a moving direction and a moving distance of a user's finger of the mobile phone according to the second embodiment, which is performed based on the detected XY coordinate data.
FIG. 12 is a diagram for explaining a display control operation of a character displayed on a display unit of the mobile phone according to the second embodiment.
FIG. 13 is a diagram illustrating an example of XY coordinate data of each part of the character displayed on the display unit of the mobile phone according to the second embodiment.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Timer, 2 ... Optical sensor, 3 ... Sound sensor, 4 ... Schedule book, 5 ... Call history memory, 6 ... Control pattern table, 7 ... Vibration function, 8 ... Voice control unit, 9 ... Speaker unit, 10 ... Character Voice memory, 11 ... Character drawing unit, 12 ... Display unit, 13 ... Control unit (CPU), 20 ... Touch pad (position sensor, pressure sensor), 21 ... Input information conversion unit, 22 ... Pressure detection unit, 23 ... Input Information analysis unit, 24: User input operation determination unit, 25: Character operation selection unit, 26: Character data processing unit, 27: Character data storage unit, 28: Other components of mobile phone

Claims (6)

Two-dimensional input means provided so that a display object displayed on the display means can be viewed, and detects an input position and an input distance of the user,
Display position storage means for storing a current display position of a display object displayed on the display means,
The display object is displayed at the current position of the display object stored in the display position storage unit and the display position on the display unit determined based on the input position and the input distance detected by the two-dimensional input unit. An information processing apparatus having control means for controlling. The two-dimensional input means is a touch pad provided with a position sensor or a position sensor and a pressure sensor, and provided on a surface of the display means so that a display object displayed on the display means can be viewed. The information processing apparatus according to claim 1, wherein: Multiple sensors,
Current status determination means for comprehensively determining the current status based on the output from each of the sensors,
An information processing apparatus having at least a control means for performing variable display control of a display object displayed on the display means based on a determination result from the current state determination means. As the sensor, a timer for measuring time, an optical sensor for sensing light, a sound sensor for sensing sound, a schedule sensor for detecting a schedule within a predetermined time from a schedule book in which a user's schedule is stored, and a call history of the user are included. A call history sensor for detecting a call history within a predetermined time from the stored call history memory, a position sensor, or a two-dimensional input means provided with a position sensor and a pressure sensor is provided, or two of these sensors are provided. The information processing apparatus according to claim 3, wherein at least one sensor is provided. A voice generating means for generating a predetermined voice;
The information processing apparatus according to any one of claims 1 to 4, wherein the control means controls the voice utterance means so as to utter a predetermined voice together with the display control. Has a vibration function,
The information processing apparatus according to claim 1, wherein the control unit drives and controls the vibration function together with the display control.

Images