JP3521456B2 - Image display control device and image display control method - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display control device and an image display control device for selectively displaying prestored image data in an electronic device such as an electronic notebook or an electronic game machine.
The present invention relates to an image display control method .

[0002]

2. Description of the Related Art In a conventional electronic device, for example, in an image display device for displaying a character such as an animal, it is usually a plurality of keys from a key input section to move or change the displayed character image. It is performed according to the key input operation of.

That is, when, for example, a dog is displayed as the character image, by selectively operating cursor keys indicating up, down, left, and right, movement display of the dog in each direction can be performed.

[0004]

However, in the above-mentioned conventional image display device, in order to change or move the displayed character image, a command is made by a mechanical operation of key input.

Therefore, there is a problem in that the displayed character image of an animal or the like cannot be displayed by being moved or changed in accordance with a command of a realistic sensation by the user, which is not interesting.

The present invention has been made in view of the above problems,
Animals, etc. are operated in the same manner as the gesture-like operation feeling of actually moving the animal by transmitting commands and intentions to the animal etc. by waving hands to the animal etc. without performing mechanical key input operation. It is an object of the present invention to provide an image display control device and an image display control method capable of moving or changing the displayed image of 1.

[0007]

The present invention is provided with the following means in order to achieve such an object. Numerical values and the like attached to each component in parentheses are the drawing reference numerals and paragraph numbers in the embodiments. That is, images display control device that involved in the present invention, Oyo biological image
And sound effects and their designated data are associated and stored in multiple sets
The storage means (ROM 1 in FIGS. 1, 2 and 12)
3; [0016] [0060]) and infrared light to the outside
Optical transmission means for sequentially transmitting light at regular intervals (the transmission times in FIG.
Path 14; Steps B1 to B5 of FIG. 14; FIG. 17; [ 00
72 ] [0073]) and constant by this optical transmission means
Infrared light transmitted sequentially every hour hits the operating body
An optical receiver that irradiates and receives the reflected infrared light sequentially.
Stage (reception circuit 15 in FIG. 1; steps B2 to B in FIG. 14)
6; [ 0074 ] ) and infrared light by the light transmitting means
The red light reflected by the light receiving means is transmitted every time a certain period of time is transmitted.
A reflection time counter that counts the time until external light is received.
Und means (counter register C in FIG. 13;
Steps B2 to B10; [0062] [0079]),
The count value by this reflection time counting means is updated sequentially.
The new time is acquired as the moving time of the operating body.
Timer means (time register 16d in FIG. 13; FIG. 14)
Steps B10 to B16; [0078] to [008]
1]) and the first counter by the reflection time counting means.
The open value is stored as the movement start position of the operating body.
Start position storage means (counter register A in FIG. 13; FIG. 14)
Steps B2 to B8; [0062] [0075])
And the final count by the reflection time counting means
Stop position that stores the value as the movement stop position of the operating body
Storage means (counter register B in FIG. 13;
B11 to B15; [0062] [0080]),
Corresponding to the count value by the reflection time counting means
To obtain the distance to the position where infrared light is reflected by the operating body.
Conversion data storage means (FIG.
1 counter / distance conversion table 13a; [0061]
[0063]) and the converted data storage means.
The start position storage means based on the stored conversion data
As the movement start position of the operating body stored by
And the stop value stored by the stop position storage means.
Corresponds to the difference from the count value as the movement stop position of the operating body
Distance acquisition means for acquiring the movement distance of the operating body
(CPU 11 in FIG. 1; steps B17 and B1 in FIG. 14)
8; [0081] [0082]) and this moving distance
The moving distance of the operating body obtained by the obtaining means and the timer
Based on the moving time of the operating body acquired by the means
Moving speed calculating means for calculating the moving speed (CP of FIG. 1
U11; step B19 of FIG. 14; [0083]),
Of the operating body calculated by the moving speed calculating means
The biological image corresponding to the designated data according to the moving speed is
Read out from storage means and display this read out image now
It is controlled to display instead of the biological image inside
The specified data corresponding to the moving speed of the operating body.
The sound effect is read from the storage means and read out
Control means for controlling to generate a sound effect (C in FIG. 1
PU11; Steps C1 to C11 in FIG. 7; [0051]
~ [0057]; Steps BD and BC in Fig. 14; Fig. 15
Steps D1 to D6 of FIG. 16; Steps C1 to C7 of FIG.
[ 0084 ] to [ 0091 ] ) and are provided.

[0008]

[0009]

[Action] in front Kiga image display control device, the biological image and efficiency
A plurality of pairs of fruit sounds and their designated data are stored in association with each other.
Has a storage means that stores the infrared light by the optical transmission means.
The infrared light hits the operating body every time it is transmitted at regular intervals.
The time it takes for the light to be reflected and sequentially received by the optical receiving means is
While counting by the shooting time counting means,
The time when the count value is sequentially updated is determined by the timer means.
Therefore, it is acquired as the moving time of the operating body. When reflected again
The first count value by the interval counting means is
It is stored by the start position storage means as the movement start position,
Stop the final count value as the movement stop position of the operating body.
It is stored by the stop position storage means. Then, during the reflection
The operating body corresponding to the count value by the interval counting means
Conversion to obtain the distance to the reflection position of infrared light
Based on the data, it is stored by the start position storage means.
And the count value as the movement start position of the operating body
Movement of the operating body stored by the stop position storage means
The operation corresponding to the difference from the count value as the stop position
The movement distance of the body is acquired by the movement distance acquisition means, and
Of the acquired moving distance of the operating body and the timer means
The movement based on the obtained movement time of the operation body
The speed is calculated by the moving speed calculation means. And
Designated data corresponding to the calculated moving speed of the operating body
The biological image corresponding to the
The display is controlled in place of the biological image being displayed,
The effect corresponding to the specified data according to the moving speed of the operating body
The sound effect is read out from the storage means and its generation is controlled .

[0010]

[0011]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A first embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing the configuration of an electronic circuit of an electronic notebook equipped with the first image display device of the present invention.

This electronic notebook has a CPU (central processing unit).
11 is provided. The CPU 11 has a key input unit 12
It controls the operation of each part of the circuit in accordance with a system program stored in advance in the ROM 13 which is activated in response to a key operation signal from the CPU 11. The CPU 11 includes a key input unit 12, a ROM 13, a transmitter 14, and a receiver. 15, and the RAM 16 are connected.

Further, the CPU 11 includes an oscillator circuit 11
b and a timer 11a including a frequency dividing circuit 11c are connected, and a liquid crystal display unit 18 is further provided via a display driving circuit 17.
Is connected to the speaker 2 via the amplifier circuit 19
0 is connected.

The key input section 12 is provided with character keys and a ten-key pad 12a for inputting "name" and "telephone number" to be registered as notebook data, and when switching between notebook mode and image display mode. A “mode” key 12b operated, a “start” key 12c operated in the notebook mode as a transmission start key for notebook data to another electronic device, and a “start” key 12c operated as an infrared light emission start key in the image display mode, a notebook mode Is operated as a reception end key of notebook data received from another electronic device, and is operated as an infrared light emission stop key in the image display mode, and is transmitted from another electronic device in the notebook mode. In response to the operation of the "Receive" key 12e, the character keys and the numeric keypad 12a that are operated when receiving the notebook data. Notebook data inputted Te, or other notebook data received from the electronic device RAM16
"Write" key 12f, R operated when registering in
A “search” key 12g and the like operated when searching and displaying the notebook data registered in the AM 16 is provided.

In the ROM 13, in addition to a system program for controlling the CPU 11, a plurality of types of displayed image data and sound effect data corresponding to each of the displayed image data are stored in advance.

FIG. 2 is a diagram showing the displayed image data and its sound effect data stored in advance in the ROM 13 of the electronic notebook. That is, the ROM 13 stores "M = 0 to 0".
4 types (group) of dog character data addressed by "3" are two as bitmap data (1) (2) 1
The sound effect data is stored as a set and the sound effect data corresponding to the four types of character data is stored as PCM data.

Further, the ROM 13 is provided with a counter / distance conversion table 13a in advance, and the counter / distance conversion table 13a corresponds to the count value until the emitted infrared light is reflected and received. Then, the conversion data for obtaining the distance to the reflection position is stored in advance.

The transmitting unit 14 is provided with a transmitting circuit 14a and a light emitting element 14b and emits infrared light in accordance with transmission data given from the CPU 11. In the notebook mode, the character keys and the numeric keypad 12a are used. The notebook data that is input and displayed according to the operation, or the "Search" key 1
The notebook data retrieved and displayed according to the operation of 2g is modulated by the transmission circuit 14a according to the operation of the "start" key 12c, and transmitted and output as infrared emission data via the light emitting element 14b.

Further, in the image display mode, infrared light of a predetermined frequency is emitted and output via the transmission circuit 14a and the light emitting element 14b in response to a command from the CPU 11. The receiving section 15 is provided with a receiving circuit 15a and a light receiving element 15b for receiving and receiving an infrared light emission signal from the outside.
In the notebook mode, the notebook data transmitted as infrared light emission data from another electronic device is received and demodulated by the receiving circuit 15a via the light receiving element 15b according to the operation of the "receive" key 12e, and the liquid crystal display unit 18 is displayed. Is displayed in.

In the image display mode, the infrared light from the outside or the reflected light of the infrared light emitted by the transmitting unit 14 is received by the light receiving element 15b, and the light receiving state is received by the CPU 11 via the receiving circuit 15a. Will be notified.

FIG. 3 is a diagram showing a configuration of a register provided in the RAM 16 of the electronic notebook. That is, the R
The AM 16 has a notebook data register 16a in which notebook data for a predetermined number of people consisting of "name" and "telephone number" is registered at the address indicated by the notebook data pointer P, and display data to be displayed on the liquid crystal display unit 18. The display register 16b, which is written as image data, reflects the infrared light emitted from the transmitter 14, and receives the infrared light.
The counter register 16c in which the count value in the CPU 11 is received until the light is received, the mode flag register N set to "0" in the notebook mode and "1" in the image display mode, the character data stored in the ROM 13 and A ROM address register M indicating the address of the sound effect data and a reception flag register F0 set to "1" in the reception state of the notebook data in the notebook mode are provided.

In the notebook mode, the liquid crystal display section 18 retrieves the notebook data input in response to the operation of the character keys and the numeric keypad 12a or the notebook data register 16a of the RAM 16 in response to the operation of the "search" key 12g. Either the notebook data that has been received or the notebook data that has been received via the receiving unit 15 in response to the operation of the "receive" key 12e is displayed.

In the image display mode, at least one set (1) read from the ROM 13 according to the ROM address indicated by the ROM address register M of the RAM 16.
The character data of (2) is displayed alternately every second.

From the speaker 20, in the image display mode, the ROM address register M of the RAM 16
A sound effect based on the sound effect data read from the ROM 13 is generated according to the ROM address indicated by.

On the other hand, the timer 11a is, for example, 32 Hz.
The timer signal of is supplied to the CPU 11.
The timer timing data T is added corresponding to the timer signal of Hz, and it is determined that, for example, T = 32 is 1 second and T = 64 is 2 seconds.

In the image display mode, R
The distance to the infrared light reflection position obtained from the counter / distance conversion table 13a in the ROM 13 corresponding to the infrared transmission / reception count value read from the counter register 16c in the AM 16 is within 30 cm, for example. In this case, "1" is set in the ROM address register M, and in the case of 31 to 60 cm, "2" is set in the ROM address register M.
If it is ˜90 cm, “3” is set in the ROM address register M.

That is, the ROM address register M
When the infrared light emitted from the transmitter 14 is received by the receiver 15 by a non-contact operation by the user's hand, the distance from the transmitter / receivers 14, 15 to the infrared light reflection position, that is, The address value is set according to the distance to the hand by the non-contact operation.

Next, the operation of the electronic notebook having the above structure will be described. FIG. 4 is a flowchart showing the overall processing of the electronic notebook. That is, when "0" is set in the mode flag register N of the RAM 16 when the "mode" key 12b in the key input unit 12 is operated, that is, when the CPU 11 is currently set in the notebook mode. "1" is set in the mode flag register N, and the CPU 11 is switched to the image display mode and set (steps S1 → S2 → S3).

When the CPU 11 is set to the image display mode, "0" is set in the ROM address register M (step S4). In addition, the "mode" key 12
When "1" is set in the mode flag register N of the RAM 16 when operating b, that is, C
When the PU 11 is set to the image display mode,
"0" is set in the mode flag register N, and CP
U11 is switched to the notebook mode and set (step S1).
→ S2 → S5).

Then, in the notebook mode in which "0" is set in the mode flag register N of the RAM 16, the notebook mode processing (see FIG. 5) is executed by the CPU 11 (step S6 → SA).

Further, in the image display mode in which "1" is set in the mode flag register N, the CPU 1
1, the image display mode process (see FIGS. 6 to 11) is executed (step S6 → SB).

FIG. 5 is a flow chart showing the notebook mode processing in the electronic notebook. That is, the RAM 16
In the notebook mode in which “0” is set in the mode flag register N of No. 2, when the notebook data such as “name” and “telephone number” is input by operating the character keys of the key input unit 12 and the numeric keypad 12a, Keypad notebook data is CP
U11 is sequentially displayed on the liquid crystal display unit 18 through the display drive circuit 17 (steps A1 → A2, A3).

[Write] key 1 of the key input unit 12
When 2f is operated, the notebook data currently displayed on the liquid crystal display unit 18 is changed to the notebook data register 16 of the RAM 16.
It is registered in a (step A4 → A5).

[Search] key 12 of key input unit 12
When g is operated, the notebook data pointer P of the RAM 16 is updated by (+1) for each key operation, and the notebook data of a predetermined number of persons registered in the notebook data register 16a is sequentially searched and the searched. Notebook data is C
It is read by the PU 11 and displayed on the liquid crystal display unit 18 via the display drive circuit 17 (steps A6 → A7, A3).

When the "start" key 12c of the key input section 12 is operated, the notebook data currently displayed on the liquid crystal display section 18 is modulated to an infrared wavelength by the transmitting circuit 14a of the transmitting section 14 and emitted. Infrared emission data is transmitted from the element 14b to another electronic device (step A8).
→ A9).

The "reception" key 12 of the key input unit 12
When e is operated, the reception flag register F0 of the RAM 16
"1" is set to, and the notebook data transmitted as infrared emission data from another electronic device is received by the receiving unit 15 and displayed on the liquid crystal display unit 18 from the CPU 11 via the display drive circuit 17 (step A10). → A11, A1
2, A3).

When the "end" key 12d of the key input unit 12 is operated, "0" is set in the reception flag register F0 of the RAM 16, and the notebook data transmitted as infrared emission data from the other electronic device is stored. The reception process is stopped (steps A13 → A14, A15).

FIG. 6 is a flowchart showing the image display mode processing in the electronic notebook. FIG. 7 is a flowchart showing an image display process accompanying the image display mode process in the electronic notebook.

FIG. 8 is a timing chart showing an example of infrared light emission and light reception timings associated with the image display mode processing in the electronic notebook. FIG. 9 is a diagram showing a character display state accompanying the setting of the image display mode process in the electronic notebook.

FIG. 10 shows a non-contact operation distance by the user of 30 cm accompanying the image display mode processing in the electronic notebook.
It is a figure which shows the character display state when it is within.
FIG. 11 is a diagram showing a character display state when the non-contact operation distance by the user associated with the image display mode processing in the electronic notebook is 31 to 60 cm.

First, in the overall process of the electronic notebook shown in FIG. 4, the "mode" key 1 of the key input unit 12
When the operation of 2b sets "1" in the mode flag register N in the RAM 16 and "0" in the ROM address register M to set the CPU 11 in the image display mode, the image display in FIG. The mode process is activated (steps S1 to S4, SB).

That is, in this image display mode,
When the "start" key 12c is not operated, the state shown in FIG.
The image display processing in step S1 is started (step B1 → B).
C).

In this case, step S4 in FIG.
In the above, since "0" is initially set in the ROM address register M of the RAM 16, a set of character data (1) (2) corresponding to the ROM address "M = 0" is set.
(See FIG. 2) is read from the ROM 13 to the CPU 11,
The character data (1) and (2), that is, the dog character data that comes in and goes out of the kennel, which is a combination of the kennel (1) and the dog (2) that makes a face out of the kennel (1), is shown in FIG. As shown by, the display is made on the liquid crystal display unit 18 every one second (step C1 → C2).

Here, although the output processing of the sound effect data corresponding to the ROM address "M = 0" is performed, the RO corresponding to the ROM address "M = 0" in the present embodiment.
Since the sound effect data in M13 is "silent", no actual sound effect is generated from the speaker 20, and the above step C is performed.
The image display process of 1 → C2 is continuously executed (step C3).

On the other hand, when the “start” key 12c of the key input section 12 is operated, the light emitting element 14 in the transmitting section 14 is operated.
When the emission output of infrared light from b is started,
The counter register 16c in 16 is reset and counting is started (steps B1 → B2, B3).

Here, when the non-contact operation by the user is not performed on the transmitter 14 and the receiver 15 and the reflected infrared light through the user's hand is not received by the light receiving element 15b in the receiver 15 for a certain period of time. Repeats the infrared light transmission process again, and resets and starts the counter register 16c (steps B4 → B5 → B2, B).
3).

In steps B2 to B5, the counter register 16 associated with the infrared emission from the transmitter 14 is sent.
In the state in which the reset / start of c is repeated, as shown in FIG.
4B and the light receiving element 15b are positioned in front of the light receiving element 15b in a non-contact manner, the infrared light emitted and output from the light emitting element 14b at a certain timing is reflected by the user's hand and received by the light receiving element 15b. The counting operation is stopped (steps B2, B3, B4 → B
6).

That is, as shown in FIG. 8, the counter register 16c corresponds to the reflection response time until the infrared light emitted from the transmitter 14 is reflected by the user's hand and received by the receiver 15. A counter value A is obtained. The counter / distance conversion table 13a in the ROM 13 is referred to in correspondence with the counter value A, and the non-contact operation distance by the user's hand to the light emitting and light receiving elements 14b and 15b is calculated by the CPU 11 Read to (step B
7).

Here, in step B7, RO
CP from the counter / distance conversion table 13a in M13
If it is determined that the non-contact operation distance to the light emitting and light receiving elements 14b and 15b read out by U11 is within 30 cm (see FIG. 10), the RA is determined in step B9.
The ROM address register M in M16 is set to "1", and the image display processing is executed according to this ROM address "M = 1" (steps B8 → B9, BC).

That is, in the image display process in FIG. 7, one set of character data (1) (2) (see FIG. 2) corresponding to the updated ROM address "M = 1" is RO.
The character data (1) (2) read from the M13 to the CPU 11, that is, the dog (1) facing backward in front of the kennel.
10 is replaced with the character data (1) and (2) corresponding to the ROM address "M = 0" shown in FIG. 9 for each character data of the dog (2) turning to the front. like,
It is alternately displayed on the liquid crystal display unit 18 every one second (steps C4 → C5).

Further, the sound effect data "Woo" in the ROM 13 corresponding to the ROM address "M = 1" is the CPU 1
1 is read out, and each character data corresponding to the ROM address "M = 1" is displayed and generated and output from the speaker 20 through the amplifier circuit 19 (step C6).

On the other hand, in step B7, the ROM
From the counter / distance conversion table 13a in 13 to the CPU
If it is determined that the non-contact operation distance to the light emitting and light receiving elements 14b and 15b read out in 11 is within the range of 31 to 60 cm (see FIG. 11), the ROM address in the RAM 16 is determined in step B11. The register M is set to "2", and the image display processing is executed according to this ROM address "M = 2" (step B10 → B).
11, BC).

That is, in the image display processing in FIG. 7, one set of character data (1) (2) (see FIG. 2) corresponding to the updated ROM address “M = 2” is RO.
The character data (1) (2) read from the M13 to the CPU 11, that is, the dog (1) holding his hand in front of the kennel
Replace each character data of the dog (2) holding out his tongue with his hand with the character data (1) (2) corresponding to the ROM address "M = 0" shown in FIG. , As shown in FIG. 11, they are alternately displayed on the liquid crystal display unit 18 every one second (steps C7 → C8).

Further, the sound effect data “one-one” in the ROM 13 corresponding to the ROM address “M = 2” is CP.
The amplifier circuit 19 is read out by U11 and displays each character data corresponding to the ROM address "M = 2".
Generated and output from the speaker 20 via the (step C
9).

On the other hand, in step B7, the ROM
From the counter / distance conversion table 13a in 13 to the CPU
When it is determined that the non-contact operation distance to the light emitting and light receiving elements 14b and 15b read out in 11 is within the range of 61 to 90 cm, the RAM 1 is determined in step B13.
The ROM address register M in 6 is set to "3", and the image display processing is executed according to this ROM address "M = 3" (steps B12 → B13, BC).

That is, in the image display process in FIG. 7, one set of character data (1) (2) (see FIG. 2) corresponding to the updated ROM address “M = 3” is RO.
The character data (1) (2) read from the M13 to the CPU 11, that is, each character data of the dog lying prone in front of the kennel is stored in the ROM address "M = 0" shown in FIG. The corresponding character data (1) and (2) are displayed alternately on the liquid crystal display unit 18 every second (steps C7 → C10).

Further, the sound effect data “Cou” in the ROM 13 corresponding to the ROM address “M = 3” is the CPU 1
1 and the character data corresponding to the ROM address “M = 3” is displayed and generated and output from the speaker 20 via the amplifier circuit 19 (step C1).
1).

Therefore, according to the electronic notebook having the above-described structure, the user's hand is placed in front of the light emitting element 14b and the light receiving element 15b provided in the main body of the apparatus in a non-contact manner, so that the red light from the light emitting element 14b is red. The external reflection light is received by the light receiving element 15b, and the value of the ROM address register M is selected according to the non-contact operation distance obtained from the counter / distance conversion table 13a corresponding to the counter value corresponding to the light emission reflection response time. By setting
A plurality of types of dog character data, such as a turning dog and a dog you are holding, which are stored in advance in the ROM 13 and whose movements are changed, and their sound effect data are selectively read out to the CPU 11,
Since the corresponding sound effects are generated from the speaker 20 while being displayed on the liquid crystal display unit 18, it is not necessary to issue a command by mechanical operation such as key input as in the conventional image display device, and the user's hand does not have to issue a command. By a command in accordance with the actual movement, it is possible to selectively display, for example, the character data of the dog turning around or the dog you are working on,
The fun of character display can be greatly improved.

Next, a second embodiment of the present invention will be described. The block configuration of the electronic circuit of the electronic notebook equipped with the second image display device as the second embodiment is the same as the block configuration of the electronic circuit of the electronic notebook equipped with the first image display device shown in FIG. Since they are the same, description thereof will be omitted.

FIG. 12 is a diagram showing the displayed image data stored in advance in the ROM 13 of the electronic notebook equipped with the second image display device. That is, in the ROM 13,
Character data of four types (groups) of dogs addressed by "M = 0 to 3" is stored as bitmap data, and two character data (in the address area of ROM address "M = 0") 1) The dog character data that comes in and goes out from the doghouse that makes up one set in (2) is stored, and RO
11 in the address area of M address "M = 1" (1)
~ (11) character data is stored as a set of dog character data that is returned by picking up a thrown rod, and 9 pieces (1) to (9) are stored in the address area of the ROM address "M = 2".
In the character data of, the dog character data, which is a set of normally thrown sticks and returns, is stored. In the address area of the ROM address “M = 3”, 7 pieces (1) to (7) of character data are stored. The dog character data for picking up the thrown sticks and returning to be one set is stored.

Further, the ROM 13 is provided with a counter / distance conversion table 13a in advance in the same manner as the electronic notebook equipped with the first image display device. The counter / distance conversion table 13a includes: Conversion data for obtaining the distance to the reflection position corresponding to the count value until the emitted infrared light is reflected and received is stored in advance.

FIG. 13 is a diagram showing a configuration of a register provided in the RAM 16 of the electronic notebook equipped with the second image display device. That is, in the RAM 16, the notebook data register 16 a in which the notebook data for a predetermined number of persons, which are “name” and “telephone number”, are registered at the address indicated by the notebook data pointer P, and the liquid crystal display unit 18 are displayed. The display register 16b in which display data is written as image data, the first count value in the CPU 11 until the infrared light emitted from the transmitter 14 is reflected and received by the receiver 15 is the initial value of the non-contact operation. A counter register A written as a position (movement start position), similarly CP until infrared light emitted from the transmitter 14 is reflected and received by the receiver 15
A counter register B in which the final count value in U11 is written as the end position (moving stop position) of the non-contact operation, and the transmitter 14 emits light at regular intervals between the initial position and the end position of the non-contact operation. CPU 1 until reflected infrared light is reflected and received by the receiving unit 15
The counter register C in which each count value in 1 is sequentially updated and written, the mode flag register N set to "0" in the notebook mode, "1" in the image display mode, the address of the character data stored in the ROM 13 ROM address register M, which indicates a reception flag register F0 which is set to "1" in the reception state of the notebook data in the notebook mode, and the contact value based on the count value sequentially written in the counter register C (in this case, , A movement detection flag register G which is set to "1" when a movement operation of the user's hand) is detected, the transmission unit 1
Infrared light emitted from No. 4 is reflected and the light receiving flag register H set to "1" when the light is first received by the receiving unit 15 and the count value of the counter register C are sequentially updated and written. A time register 16d is provided in which the state of being loaded, that is, the elapsed time associated with the movement of the non-contact operation medium is written.

Here, in the image display mode, the count value corresponding to the movement start position of the non-contact operation written in the counter register A in the RAM 16 and the movement stop position written in the counter register B are corresponded. The moving distance of the non-contact operation medium corresponding to the difference between the count value and the count value is obtained from the counter / distance conversion table 13a in the ROM 13, and the counter / distance conversion table 1
3a and the moving distance of the non-contact operating medium and the RA
The moving speed of the non-contact operating medium calculated by the CPU 11 based on the moving time of the non-contact operating medium obtained from the time register 16d in M16 is, for example, 1.0 to 1.5.
If it is m / s, "3" is set in the ROM address register M, and if it is 1.6 to 2.0 m / s, "2" is set in the ROM address register M. If it is 2.1 m / s or more, "1" is set in the ROM address register M.

That is, the ROM address register M
When the infrared light emitted from the transmission unit 14 is received by the reception unit 15 by a non-contact operation by the user's hand, the operation between the transmission / reception units 14 and 15 and the infrared light reflection position is performed. The moving speed based on the moving distance and the moving time, that is, the address value according to the moving speed of the hand by the non-contact operation is set.

Next, the operation of the electronic notebook equipped with the second image display device having the above configuration will be described. here,
The entire processing and the notebook mode processing of the electronic notebook equipped with this second image display device are the same as those of the first notebook document shown in FIG. 4 and FIG.
Since this is the same as the entire processing and the notebook mode processing of the electronic notebook equipped with the image display device, the description thereof will be omitted.

FIG. 14 is a flowchart showing the image display mode processing in the electronic notebook equipped with the second image display device. FIG. 15 shows the RO associated with the image display mode processing in the electronic notebook equipped with the second image display device.
7 is a flowchart showing a setting process of an M address M.

FIG. 16 is a flow chart showing the image display processing accompanying the image display mode processing in the electronic notebook equipped with the second image display device. FIG. 17 shows the second
6 is a timing chart showing an example of emission and reception timings of infrared light accompanying movement of a non-contact operation medium in an image display mode process in an electronic notebook equipped with the image display device of FIG.

FIG. 18 is a view showing a character display state in the electronic notebook equipped with the second image display device when the moving speed of the non-contact operation accompanying the image display mode processing is 2.0 m / s or more. Is.

First, in the overall processing shown in FIG. 4, by operating the "mode" key 12b of the key input unit 12, "1" is set in the mode flag register N in the RAM 16 and the ROM address register M Is set to "0" and the CPU 11 is set to the image display mode, the image display mode process in FIG. 14 is activated (steps S1 to S4, SB).

That is, in this image display mode,
When the "start" key 12c is not operated, the state shown in FIG.
The image display processing in 4 is activated (step B1 →
BC).

In this case, step S4 in FIG.
In the above, since "0" is initially set in the ROM address register M of the RAM 16, a set of character data (1) (2) corresponding to the ROM address "M = 0" is set.
(See FIG. 12) is read from the ROM 13 to the CPU 11, and its character data (1) (2), that is, the kennel (1)
As shown in FIG. 9, the dog character data entering and exiting the kennel, which is a combination of the dog and the dog (2) with its face out of the kennel (1), is displayed on the liquid crystal display unit 18 every one second. (Step C1 → C2).

On the other hand, when the “start” key 12c of the key input section 12 is operated, the light emitting element 14 in the transmitting section 14 is operated.
When the emission output of infrared light from b is started,
The counter 16e in 16 is reset and counting is started (steps B1 → B2, B3).

Here, when the non-contact operation by the user is not performed on the transmitting unit 14 and the receiving unit 15 and the reflected infrared light through the user's hand is not received by the light receiving element 15b in the receiving unit 15 for a certain period of time. The infrared transmission process is repeated again, and the counter 16e is reset and started (steps B4 → B5 → B2, B3).

In steps B2 to B5, the user's hand is moved to the light emitting element 14b as shown in FIG. 18 while the reset / start of the counter 16e associated with the infrared emission from the transmitter 14 is repeated. And the light receiving element 15b
If the infrared light emitted from the light emitting element 14b at a certain timing is reflected by the user's hand and received by the light receiving element 15b, the counter 1
The counting operation for 6e is stopped (step B
2, B3, B4 → B6).

That is, as shown in FIG. 17, the counter 16e receives an initial reflection response until the infrared light emitted from the transmitter 14 is reflected by the user's hand and is received by the receiver 15 at this point. A counter value (A) corresponding to time is obtained, and the count value (A) is used as an initial position (moving start position) of the non-contact operation by the user's hand, as indicated by a broken line i in FIG. It is written in the register A and "1" is set in the light receiving flag register H (steps B7 → B8, B9).

Here, in a state where the user's hand stands still at the initial position indicated by the broken line i, the steps B2 to B6 are performed.
The same counter value (A) is again obtained in the counter 16e through the processing of step A, and the counter value (A) is written in the counter register C in accordance with the judgment that the light receiving flag register H is not "0". (Steps B7 → B10).

Then, a match / mismatch between the counter value written in the counter register C and the counter value obtained by the counter 16e immediately before is compared and judged. In this case, each counter to be compared is compared. Since all the values are counter values (A) in the state where the user's hand is still at the same position shown by the broken line i, it is determined that "counter value match", that is, the user's hand is not moved by the non-contact operation. Then, the infrared light transmission process is repeated again with "0" set in the movement detection flag register G, and the counter 16e is reset / started (step B11 →
B12 → B2, B3).

That is, when the user's hand remains stationary at the initial position i, the steps B2 to B4 → B are performed.
6, B7 → B10 to B12 are repeatedly executed.
Then, as shown by the broken line arrow j in FIG. 18, the user's hand is moved from its initial position i to the light emitting and receiving elements 14b, 15.
When moved in the direction of b, the count values obtained by the counter 16e are sequentially (A) →, as shown in FIG.
Since the value changes from (B) to (C) to (D) in the decreasing direction, a comparison / judgment process of a match / mismatch between the counter value written in the counter register C and the counter value obtained immediately before by the counter 16e. Then, "Counter value mismatch",
That is, when it is determined that the user's hand has moved due to the non-contact operation and the count value (B) is written to the counter register C immediately after the start of the movement, "1" is set to the movement start flag register G. , Time counting of the elapsed time from the start of the non-contact operation movement in the time register 16d is started (steps B2 to B4 → B6 → B7 → B10, B).
11 → B13, B14).

Thereafter, the user's hand is continuously moved in the direction of the light-emitting and light-receiving elements 14b, 15b, and the counter values (B), (C), (D) corresponding to the distance to the moving position.
Is sequentially updated and written in the counter register C, the steps B2 to B4 → B6, B7 → B10,
The process of B11 → B13 is repeatedly executed.

Here, when the movement of the hand by the non-contact operation of the user is stopped immediately before the light emitting and light receiving elements 14b and 15b as shown by the practice k in FIG. 18, the counter 16e is obtained by the counter 16e in step B6. The counter value (D)
Since it is repeatedly written into the counter register C in step B10, it is determined in step B11 that "counter value coincides", and the movement detection flag register G is set to "1", and the counter is counted. The value (D) is written in the counter register B as the end position (movement stop position) of the non-contact operation by the user's hand (steps B11 → B12 → B15).

That is, at the present time (step B15), the counter value (A) corresponding to the movement start position i of the non-contact operation is stored in the counter register A in the RAM 16.
The counter value (D) corresponding to the movement stop position k is obtained in the counter register B.
"0" is set in the movement detection flag register G, the time counting of the elapsed time from the start of the non-contact operation movement in the time register 16d is stopped, and the counter register A-counter register B, that is, the non-contact operation. Counter value "(A)-
(D) ”is calculated (steps B16 and B17).

Here, the counter value "(A) corresponding to the movement distance of the non-contact operation calculated in step B17.
-(D) "corresponding to the counter / distance conversion table 13a in the ROM 13 to refer to the light emitting / receiving element 1
The moving distance of the non-contact operation by the user's hand with respect to 4b and 15b is read by the CPU 11 (step B18).

Then, in the step 18, the ROM 13
The moving speed is calculated based on the moving distance of the non-contact operation read from the counter / distance conversion table 13a and the moving time of the non-contact operation read from the timer register 16d (step B19).

After the timer register 16d is cleared, the setting process of the ROM address M is executed according to the moving speed of the non-contact operation calculated in the step B19 (steps B20, BD).

That is, in the process of setting the ROM address M in FIG. 15, in step B19, the CPU
The moving speed of the non-contact operation calculated by 11 is 2.1.
If it is determined that the speed is m / s or more (see FIG. 18),
At step D6, the ROM address register M in the RAM 16 is set to "1", and the image display processing is executed according to this ROM address "M = 1" (step BD "D5 → D6", BC).

That is, in the image display processing in FIG. 16, a set of character data (1) to (11) (see FIG. 12) corresponding to the updated ROM address “M = 1” is sequentially transferred from the ROM 13 to the CPU 11. The read character data (1) to (11), that is, the dog character data that picks up a rod thrown away and returns, is the character data corresponding to the ROM address "M = 0" shown in FIG.
Instead of (1) and (2), as shown in FIG. 18, the images are sequentially displayed on the liquid crystal display unit 18 like an animation (steps C3 → C4).

On the other hand, in the setting process of the ROM address M in FIG.
The moving speed of the non-contact operation calculated by
If it is determined that the speed is within the range of 2.0 m / s, the ROM address register M in the RAM 16 is set to "2" at step D4, and the ROM address "M =
2 ”, the image display processing is executed (step BD
"D3 → D4", BC).

That is, in the image display processing in FIG. 16, a set of character data (1) to (9) (see FIG. 12) corresponding to the updated ROM address “M = 2” is sequentially transferred from the ROM 13 to the CPU 11. The character data (1) to (9) read out, that is, the dog character data returned by picking up a normally thrown rod is the character data corresponding to the ROM address "M = 0" shown in FIG.
Instead of (1) and (2), the liquid crystal display 1 like an animation
8 will be displayed in order (step C5 →
C6).

On the other hand, in the setting process of the ROM address M in FIG.
The moving speed of the non-contact operation calculated by
When it is determined that the speed is within the range of 1.5 m / s, the ROM address register M in the RAM 16 is set to "3" in step D2, and the ROM address "M =
Image display processing is executed according to "3" (step BD
"D1 → D2", BC).

That is, in the image display processing in FIG. 16, a set of character data (1) to (7) (see FIG. 12) corresponding to the updated ROM address “M = 3” is sequentially transferred from the ROM 13 to the CPU 11. The character data (1) to (7) read out, that is, the dog character data which picks up a rod thrown nearby and returns, is the character data corresponding to the ROM address "M = 0" shown in FIG.
Instead of (1) and (2), the liquid crystal display 1 like an animation
8 will be displayed in order (step C5 →
C7).

Therefore, according to the electronic notebook equipped with the second image display device having the above-mentioned configuration, the user's hand can be moved without contact in front of the light emitting element 14b and the light receiving element 15b provided on the apparatus main body. To allow the light receiving element 15b to receive the infrared reflected light from the light emitting element 14b,
By selectively setting the value of the ROM address register M according to the moving speed of the non-contact operation calculated based on the light emission reflection response distances at the moving start position and the moving stop position and the required moving time. , A plurality of types of character data, which are stored in the ROM 13 in advance, such as a dog that picks up a thrown rod far away or near and return, and the movements of which have changed in relation to the moving speed of the non-contact operation, are selectively read out to the CPU 11, Since the image is displayed on the liquid crystal display unit 18, it is not necessary to issue a command by a mechanical operation such as a key input as in the conventional image display device. It is possible to selectively display character data of a dog that picks up a rod thrown nearby and returns, and it is possible to greatly improve the fun of character display.

In each of the above-described embodiments, the presence or absence of the non-contact operation by the user's hand is detected by utilizing the reflection of infrared light emitted from the main body of the apparatus. Sound waves emitted from the device body (eg ultrasonic waves)
By detecting the reflection by the hand of the user, the blocking of the sound wave from the outside by the hand, or the change of the magnetism from the magnetic substance held in the user's hand, the user makes a gesture or the like without touching the device body. The displayed image displayed on the display unit of the main body may be switched and displayed according to the intention display or the instruction.

Further, it is also possible to adopt a configuration in which the change in waveform of infrared light, sound waves, magnetism or the like is detected, the moving distance or moving speed of the non-contact operation is obtained, and the displayed image is switched and displayed. Further, in each of the above-described embodiments, the displayed image displayed on the display unit is switched and displayed according to the non-contact operation state. However, not only the image display but also the mechanical operation is switched in the device body. For example, different control processing may be performed.

[0094]

According to images display control apparatus of the present invention as described above, according to the present invention, versus the count value of the reflection time counting means
Accordingly, the distance to the position where the operating body reflects infrared light is obtained.
Based on the conversion data for
A counter that is stored in memory as the movement start position of the operating body.
Value of the operating body stored by the stop value and stop position storage means.
Corresponding to the difference from the count value as the movement stop position
The moving distance of the operating body is acquired, and the acquired moving body of the operating body is transferred.
Movement distance and movement of the operating body acquired by the timer means
The moving speed is calculated based on the time. And this
Designated data according to the calculated moving speed of the operating body of
The biological image corresponding to is read out from the storage means and is currently displayed
Display control can be performed instead of the biological image inside, and
A sound effect corresponding to the specified data according to the moving speed of the structure
It is possible to control generation by reading from the storage means
Become

[0095]

For this reason, a gesture-like operation feeling that an animal or the like is moved by actually giving a command or intention to the animal by a hand gesture operation without performing a mechanical key input operation. By the same operation, it becomes possible to move or change the displayed image data of an animal or the like and display it.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an electronic circuit of an electronic notebook equipped with a first image display device according to a first embodiment of the invention.

FIG. 2 is a diagram showing displayed image data and its sound effect data stored in advance in a ROM of the electronic notebook.

FIG. 3 is a diagram showing a configuration of a register included in a RAM of the electronic notebook.

FIG. 4 is a flowchart showing the overall processing of the electronic notebook.

FIG. 5 is a flowchart showing a notebook mode process in the electronic notebook.

FIG. 6 is a flowchart showing image display mode processing in the electronic notebook.

FIG. 7 is a flowchart showing an image display process accompanying the image display mode process in the electronic notebook.

FIG. 8 is a timing chart showing an example of emission and reception timings of infrared light accompanying the image display mode processing in the electronic notebook.

FIG. 9 is a diagram showing a character display state associated with setting of image display mode processing in the electronic notebook.

FIG. 10 is a diagram showing a character display state when the non-contact operation distance by the user accompanying the image display mode processing in the electronic notebook is within 30 cm.

FIG. 11 is a diagram showing a character display state when the non-contact operation distance by the user associated with the image display mode processing in the electronic notebook is 31 to 60 cm.

FIG. 12 is a diagram showing displayed image data stored in advance in a ROM of an electronic notebook equipped with a second image display device according to a second embodiment of the invention.

FIG. 13 is a diagram showing a configuration of a register included in a RAM of an electronic notebook equipped with the second image display device.

FIG. 14 is a flowchart showing an image display mode process in an electronic notebook equipped with the second image display device.

FIG. 15 is a ROM address M associated with image display mode processing in the electronic notebook equipped with the second image display device.
3 is a flowchart showing the setting process of FIG.

FIG. 16 is a flowchart showing an image display process accompanying an image display mode process in an electronic notebook equipped with the second image display device.

FIG. 17 is a timing chart showing an example of emission and reception timings of infrared light accompanying the movement of the non-contact operation medium in the image display mode process in the electronic notebook equipped with the second image display device.

FIG. 18 is a diagram showing a character display state when the moving speed of the non-contact operation accompanying the image display mode processing in the electronic notebook equipped with the second image display device is 2.0 m / s or more.

[Explanation of symbols]

11 ... CPU (Central Processing Unit), 11a ... Timer, 11
b ... Oscillation circuit, 11c ... Frequency divider circuit, 12 ... Key input section,
12a ... Character keys and numeric keys, 12b ... "Mode" key, 12c ... "Start" key, 12d ... "End" key, 12e ... "Receive" key, 12f ... "Write" key,
12g ... "Search" key, 13 ... ROM, 13a ... Counter / distance conversion table, 14 ... Transmitting section, 14a ... Transmitting circuit, 14b ... Light emitting element, 15 ... Receiving section, 15a ... Receiving circuit, 15b ... Light receiving element, 16 ... RAM, 16a ... Notebook data register, 16b ... Display register, 16c ... Counter register, 16d ... Time register, 16e ... Counter, A, B, C ... Counter register, N ... Mode flag register, M ... ROM address register, F0 ... reception flag register, P ... notebook data pointer, G ... movement detection flag register, H ... light reception flag register, 17 ... display drive circuit, 18 ... liquid crystal display section, 19 ... amplification circuit, 20 ...
Speaker.

─────────────────────────────────────────────────── ─── Continuation of the front page (56) Reference JP-A-2-199526 (JP, A) JP-A-4-220716 (JP, A) JP-A-5-265683 (JP, A) Toshihiro Abe, virtual Reality, finally, to market formation, Nikkei Computer No. 283, Nikkei BP, Japan, June 1, 1992, No. 283, p. 55 to 65 (58) Fields surveyed (Int.Cl. ⁷ , DB name) G06F 3/14 360 G06F 3/033 310 G06F 3/16 330

Claims (2)

(57) [Claims] 1. A biological image, a sound effect, and its designated data.
And a light transmitting means for sequentially transmitting infrared light to the outside at regular time intervals.
And the infrared light sequentially transmitted by this optical transmission means at regular intervals.
Line light hits the operating body and is reflected, and this reflected infrared ray
Light receiving means for sequentially receiving light, and for each transmission of infrared light by the light transmitting means at regular time intervals
Until the reflected infrared light is received by the light receiving means.
The reflection time counting means for counting the time and the count value by this reflection time counting means are sequentially updated.
Is acquired as the moving time of the operating body
The first count value by the timer means and the reflection time counting means
A start position memory that is stored as the movement start position of the operating body.
And the final count value by the reflection time counting means.
A stop position storage hand that stores the movement stop position of the operating body.
Corresponding to the step and the count value by the reflection time counting means
Obtain the distance to the position where infrared light is reflected by the operating body
A conversion data storage means for storing conversion data for, the conversion data stored by the conversion data storage means
On the basis of the start position storing means
Count value as the movement start position of the operating body and the stop position
Movement stop position of the operating body stored by the storage means
Of the operation body corresponding to the difference from the count value as
A moving distance acquisition means for acquiring the distance, and a moving distance of the operating body acquired by the moving distance acquisition means.
Release and movement of the operating body acquired by the timer means
A moving speed calculator that calculates the moving speed based on time and
Step and the movement of the operating body calculated by the moving speed calculating means.
The biological image corresponding to the designated data according to the moving speed is described above.
Read out from storage This read image is currently displayed
It is controlled to display instead of the biological image of
The specified data corresponding to the moving speed of the operating body.
The sound effect is read from the storage means and read out
An image display control device comprising: a control unit that controls to generate a sound effect . 2. Displaying a pre-stored biological image
Image with display and sound generator that produces sound effects
In the image display control method used in the display control device, the biological image and the sound effect are associated with the designated data.
Access the storage means that stores multiple sets of
Control to display the biological images stored in the memory
Control step and an optical transmission step for sequentially transmitting infrared light to the outside at regular intervals.
And red transmitted sequentially at regular intervals in this optical transmission step.
External light hits the operating body and is reflected, and the reflected infrared rays
In the light receiving step of sequentially receiving the line light, and in the light transmitting step, the infrared light is transmitted at regular intervals.
Each time, the reflected infrared light is received in the light receiving step.
Reflection time counting step to count the time until
And the count counted in this reflection time counting step
The time during which the operating value is sequentially updated is the moving time of the operating body.
And the first step counted in the reflection time counting step.
Store the count value as the movement start position of the operating body.
The start position storage step and the final position counted in the reflection time counting step
Store the count value as the movement stop position of the operating body.
A counter that counts in the stop position storing step and the reflection time counting step.
The infrared light reflection position by the operating body corresponding to the
Based on the conversion data to get the distance at the start
Start of movement of the operating body stored in the position storing step
The count value as the position and the stop position storing step
A coun- ter stored as a stop position for moving the operating body.
The movement distance of the operation body corresponding to the difference with the operation value
Movement distance acquisition step and movement of the operating body acquired in this movement distance acquisition step
Distance and the operating body of the operation object acquired in the timer step
Moving speed calculation that calculates the moving speed based on the moving time
Of the operating body calculated in the moving step and the moving speed calculating step.
The biological image corresponding to the designated data according to the moving speed is
Read out from storage means and display this read out image now
The display unit is controlled so as to be displayed instead of the living creature image, and a designated data corresponding to the moving speed of the operating body is displayed.
The sound effect corresponding to the data is read from the storage means.
A second control step of controlling the sound generation unit so as to generate the read-out sound effect, and an image display control method.