JPH06202648A - Input device and electronic musical instrument equipped with the same - Google Patents

Abstract

PURPOSE:To set musical sound characteristics in relation to display data such as characters, figures displayed on a display means by specifying musical sound characteristics such as a pitch, a timbre. for a area specified by an area specifying means. CONSTITUTION:An image is fetched from a TV receiver 3 which is connected with a cable 3 and displayed on a display part 6, and the area of the image displayed on this display part 6 is specified in drawing mode to specifies an area on the screen of the display part 6, i.e., an LCD panel. Musical sound characteristic are specified in setting mode for the specified area and respective areas and musical sound characteristics are stored in a data RAM in relation to each other. Then an optional area is touched with a touch pen 7 in sound generation mode and then the musical sound having the musical sound characteristics specified for the area can be generated, so that an image of figures, characteristics, etc., and a musical sound can be generated while related to each other. Consequently, a musical performance wherein the image and musical sound are related with each other is obtained.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an input device and an electronic musical instrument equipped with this input device. More specifically, the characters and figures displayed on the screen are designated as an area and the tone characteristics are set and input in the designated area. The present invention relates to a possible input device and an electronic musical instrument equipped with this input device.

[0002]

2. Description of the Related Art Recently, with the spread of TV (television) devices, video devices, etc., video controllers have emerged as input devices for incorporating separately created characters and images into images of TV devices, video devices, etc. ing.

This video controller is usually equipped with a touch panel, detects the position of the pressed portion on the touch panel, recognizes it as a character or graphic, and combines the character or graphic with selected color information to obtain a video signal. It is converted to and output to the outside. When the video signal output from this video controller is input to a TV device or a video device, the characters and figures drawn on the touch panel are displayed on the TV.
It can be displayed on the device or on the screen of the video device.

[0004]

However, the video controller as such a conventional input device has the following problems.
Characters and figures drawn on the touch panel can be displayed on the screen of the TV device or video device, but it is not possible to operate by associating sounds with the characters and figures on the screen, which is a low degree of freedom and is interesting. Was lacking in.

Therefore, the present invention provides an input device capable of inputting a sound in association with a character or a graphic on a screen, and an electronic musical instrument which is provided with this input device and which can generate a sound in association with a character or a graphic. It is intended to be provided.

[0006]

An input device according to the present invention includes a display unit for displaying and outputting display data, and a region designation for designating an arbitrary region of display data which is stacked on the display unit and displayed and output on the display unit. The above-mentioned object is achieved by including means and tone characteristic designating means for designating tone characteristics for the area designated by the area designating means.

In this case, the tone characteristic designating means may designate a pitch as described in claim 2 or a tone color as described in claim 3, for example. May be.

Further, the display means is, for example, as defined in claim 4.
As described in, the graphic may be displayed and output as the display data, and the area designating unit may designate an arbitrary area of the graphic displayed by the display unit.

Further, for example, as described in claim 5, further comprising area recognition means for recognizing an area of the display data displayed on the display means designated by the area designating means, the display means comprising: A graphic is displayed and output as the display data, and the area designating means is capable of designating the area by dividing each part of the graphic to be output by the display means.
The area recognition means may recognize each area designated by the area designation means.

Further, the area designating means inputs the figure as display data by drawing a figure as described in claim 6, and the display means displays the display inputted from the area designating means. The data may be displayed and output as a graphic, and, for example, as described in claim 7, the display means may display and output the graphic data input from the outside as a graphic.

The electronic musical instrument of the present invention, when an area is designated by the input device according to any one of claims 1 to 7 and the area designating means,
The above-mentioned object is achieved by providing a musical tone generating means for generating a musical tone having a musical tone characteristic designated by the musical tone characteristic designating means.

[0012]

According to the input device of the present invention, the area designation means laminated with the display means for displaying and outputting the display data such as characters and figures designates an arbitrary area of the display data displayed and output on the display means. To the area designated by the area designating means, the musical tone characteristic designating means designates musical tone characteristics such as pitch and tone color. Therefore, the musical tone characteristics are associated with display data such as characters and figures displayed on the display means. Can be set.

In this case, if the figure drawn by the area designating means is displayed on the display means and the tone characteristic is designated by designating the area for the displayed figure, the musical tone is associated with the arbitrarily drawn figure. You can set the characteristics. Further, by displaying a graphic input from the outside on the display means and designating the displayed graphic by specifying the region and the musical tone characteristic, the graphic and the musical tone characteristic can be easily set in association with each other.

Further, according to the electronic musical instrument of the present invention, the area of the display data of the display means and the musical tone characteristic are set by the input device, and when the set area is designated, it is set to the designated area. Since it generates a musical tone with the specified musical tone characteristics, the musical tone set in the designated display data area can be set by simply designating the area of the display data such as figures and characters displayed on the display means without using a keyboard or the like. It can be generated, and the display data such as figures and characters and the musical sound can be generated in association with each other.

[0015]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The input device of the present invention and an electronic musical instrument equipped with this input device will be specifically described below based on embodiments.

1 to 14 are diagrams showing a first embodiment of an input device and an electronic musical instrument equipped with this input device.

FIG. 1 shows an electronic musical instrument 1 having an input device and a TV device 3 connected to the electronic musical instrument 1 by a cable 2.
FIG. 3 is an external view of the TV device 3, and the TV device 3 is a normal liquid crystal TV device.

The electronic musical instrument 1 is provided with a mode key 5 on the surface of its main body case 4, and when the mode key 5 is turned on, the drawing mode, the setting mode and the sounding mode can be switched and set.

When the electronic musical instrument 1 is set to the drawing mode by the mode key 5, the image data is taken in from the TV device 3 via the cable 2 and the image taken in the display section 6 provided on the surface of the main body case 4. Data can be displayed and output. In this drawing mode, the surface of the display unit 6 can be touched by the touch pen 7 to draw an image of an arbitrary figure or character, and the image of the drawn figure or character is displayed and output to the display unit 6. be able to.

That is, in the display unit 6, as shown in FIG. 2, a touch panel 9 is laminated on an LCD (Liquid Crystal Display) panel 8, and a backlight unit 10 is arranged below the LCD panel 8. LCD panel 8
A normal LCD is used, and the LCD panel 8 displays and outputs a video image as described later. As the touch panel 9, a normal touch panel is used, and the sensors are arranged in a matrix of n rows and m columns. The touch panel 9 detects the pressed position on the touch panel 9 and outputs it as touch position information. Further, the touch panel 9 is formed of a transparent member, and the display content of the LCD panel 8 can be viewed through the touch panel 9. The backlight unit 10 includes a casing 11, a reflector 12 arranged in the casing 11, and a plurality of reflectors (see FIG. 2).
It consists of two fluorescent lamps 13, and LC
The D panel 8 is illuminated with light from the back, and the LCD panel 8
The visibility of images such as characters and figures displayed on is improved.

Referring again to FIG. 1, when the contour of the image displayed on the display unit 6 is traced by the touch pen 7 in the drawing mode, the inside of the contour of the traced image is recognized as a drawing area. . At this time, if there are a plurality of traced contours, they are distinguished and recognized as a plurality of drawing areas.

When the electronic musical instrument 1 is set to the setting mode by the mode key 5 and the select key 14 provided on the surface of the main body case 4 is turned on, the areas designated in the drawing mode are sequentially selected. , A display indicating that it is the selected area is displayed. The display of this selection area is, for example, changing the color of the image of the selection area from the color before selection,
The pitch key 1 provided on the surface of the main body case 4 for the area in the selected state by blinking or the like.
When the tone pitch is designated by 5 and the tone color of the piano, organ, etc. is designated by the tone color key 16 provided on the surface of the body case 4 as well, the electronic musical instrument 1 is designated for the selected region. Tone characteristics such as pitch and tone are set.

Further, the electronic musical instrument 1 is set to the tone generation mode by the mode key 5, and when the touch pen 7 touches one of the plurality of regions for which the musical tone characteristics are set in the above-mentioned setting mode, it is touched. It is determined which region the position belongs to, a musical tone of the pitch set in the setting mode is generated for the region, and the musical tone is generated from the speaker 17 provided in the main body case 4. At this time, when a tone color and a tone color are designated for the area, the electronic musical instrument 1 generates a musical tone having the tone pitch with the designated tone color.

An image capture button 18 is provided on the upper surface of the main body case 4, and when the image capture button 18 is turned on in the drawing mode of the electronic musical instrument 1, a TV is displayed when the button is turned on. The image displayed on the screen of the device 3 is captured from the TV device 3.

Further, in FIG. 1, the TV device 3 is connected to the electronic musical instrument 1 via the cable 2, but the connection is not limited to the TV device 3, but may be a video device or the like. May be.

The electronic musical instrument 1 has a circuit configuration as shown in FIG.

That is, the electronic musical instrument 1 includes an LCD controller 21, a video interface 22, a touch panel interface 23, a video RAM 24, a sound source circuit 25,
The sound system 26, the video RAM map 27, the data RAM 28, the CPU 29, the program ROM 30, the waveform ROM 31, the operation unit 32, the video input terminal 33, the video output terminal 34, the audio output terminal 35, and the like are provided.

The operation section 32 is a general term for the mode key 5, the select key 14, the pitch key 15, the tone color key 16, the image reading button 18, and the like.

The CPU 29 scans the key operation of the operation section 32, controls each section of the electronic musical instrument 1 in accordance with the program stored in the program ROM 30, and selects the processing corresponding to the key operation, particularly the mode key 5. The processing according to the selection mode is performed.

That is, the cable 2 connected to the TV device 3 is connected to the video input terminal 33, and the electronic musical instrument 1
When the image reading button 18 of the operation unit 32 is turned on in the drawing mode, the image input from the image input terminal 33 is temporarily stored in the video RAM 24 as a video signal via the video interface 22. Video RA
The image stored in M24 as a video signal is displayed and output on the LCD panel 8 via the video interface 22 and the LCD controller 21. When the touch panel 9 is drawn in the drawing mode, the electronic musical instrument 1
Captures the drawing data as bitmap data via the touch panel interface 23,
It is temporarily stored in the AM map 27, then converted into a video signal and stored in the video RAM 24. Then, the electronic musical instrument 1 uses the video signal stored in the video RAM 24 as the LC signal.
The display is output to the D panel 8, and the image drawn on the touch panel 9 is displayed on the display unit 6.

Further, in the electronic musical instrument 1, when the outline of the image displayed and output on the LCD panel 8 is traced by the touch pen 7 in the drawing mode, the region of the traced image is identified, and the region information of the identified designated region is identified. Data RAM
28. That is, the LCD panel 8 of the display unit 6 is now displaying the figures of the sun A, the child B, and two sunflowers 1C and 2C as shown in FIG. 1C1, 2C1, leaves 1C2, 1
C3, 2C2 and stems 1C4, 2C3 are depicted. Then, in the drawing mode, the sun A, the child B, the sunflowers 1C, 2C flowers 1C1, 2C1 and leaves 1C of this figure
Assuming that the contours of 2, 1C3, and 2C2 are traced by the touch pen 7 as shown in FIG. 5, the electronic musical instrument 1 determines the area of the figure traced by the touch pen 7 among the figures by the touch panel interface 23. Recognized as a designated area by importing through the area information of the designated area in the data R
Store in AM28.

Further, in the setting mode, in the electronic musical instrument 1, as shown in FIG. 5, musical tone information such as pitch and tone color is provided to the identified area by the tone pitch key 15 and tone color key 16 of the operating section 32. When designated, the designated musical tone information is stored in the data RAM 28 in association with the area. When the select key 14 of the operation unit 32 is pressed at this time, the electronic musical instrument 1 sequentially selects each area every time the key is pressed, blinks the area, or changes the color to output the display.

In the sounding mode, the electronic musical instrument 1 detects which area is touched by the touch panel 9 when one of the above-mentioned areas of the image displayed on the display section 6 is touched by the touch pen 7, The circuit 25 is controlled to generate a designated pitch for the detected region with a designated timbre. That is, the CPU 29
Reads tone information such as pitch and tone color stored in the data RAM 28 corresponding to the area, reads a waveform corresponding to the read tone information from the waveform ROM 31, and supplies it to the tone generator circuit 25. The sound source circuit 25 is supplied with a waveform and, when instructed to start sounding, generates a musical sound and supplies it to the sound system 26 to start sounding. The sound system 26 includes an A / D converter, an amplifier and a speaker 17.
Etc., the supplied musical sound is generated from the speaker 17 and is output to the external device from the audio output terminal 35.

Next, the operation will be described.

In this embodiment, the T connected by the cable 2 is used.
By capturing an image from the V device 3 and displaying and outputting the image on the display unit 6 and designating an area of the image displayed and output on the display unit 6 in the drawing mode, the display unit 6, that is, the screen of the LCD panel 8 is displayed. Specify the area. In the setting mode, a musical tone characteristic is designated for the designated region, and each region and the musical tone characteristic are associated with each other to form the data RAM 28.
Remember. Then, in the sound generation mode, when an arbitrary area is touched with the touch pen 7, a musical sound having a musical sound characteristic designated for the area is generated.

The electronic musical instrument 1 performs the above operation by executing the main process shown in FIG.

That is, the electronic musical instrument 1 first performs an initial setting process when the power is turned on (step S).
1) Initialize various registers. After that, when the image reading button 18 of the operation unit 32 is pressed, the image displayed on the TV device 3 at the time when the image reading button 18 is pressed is captured and stored in the video RAM 24 as a video signal.

Next, the CPU 29 scans the mode key 5 of the operation unit 32 to check the selection mode (step S2).

If the selection mode is the drawing mode, the drawing mode processing from step S3 to step S6 is performed. In this drawing mode process, the outline of the image displayed on the LCD panel 8 is traced on the touch panel 9 to first perform a touch position detection process for detecting the touch position of the touch panel 9, and then a touch position detection. A figure recognition process is performed in which a range traced from the touch position detected in the process is recognized as a drawing region.

That is, when shifting to the drawing mode, first, the touch panel 9 is scanned to detect the touch position on the touch panel 9 (step S3), and the detected touch position information is transferred to the video RAM map 27 and stored. Yes (step S4). That is, the touch panel 9
As shown in FIG. 7, the detection sensors are arranged in a matrix of m columns in the x direction (row direction) and n rows in the y direction (column direction), and the touch pen 7 presses each detection sensor of the touch panel 9. Then, the detection result is transferred and stored in the video RAM map 27 as bit information.

Next, it is checked whether or not the mode key 5 has been pressed, that is, whether or not the mode has been switched (step S5). When the mode key 5 has not been pressed, the process returns to step S3 and similarly. The touch position information of the touch panel 9 is fetched and transferred / stored in the video RAM map 27 as bit information.

As described above, in the drawing mode, when the outline of the image displayed on the LCD panel 8 is traced by the touch pen 7 as shown in FIG. 5, the touch position is detected and the video RAM map 27 is displayed. Transfer and store as bit information. For example, when the position indicated by a black circle in FIG. 7 is touched by the touch pen 7, the bit information corresponding to this touch position is transferred to the video RAM map 27 and stored as a bit map indicating the touch position on the touch panel 9.

After that, when the mode key 5 is pressed, graphic recognition processing (step S6) for recognizing the drawing area from the touch position detected by the touch position detection processing is performed,
Return to step S2. This figure recognition processing is processing for recognizing the area of the figure whose contour is traced by the touch pen 7, and is executed in the procedure shown in FIG.

That is, in the figure recognition process, the touched position in the x direction is detected for each y direction in FIG. 7 (that is, only the touched position is detected for each row) to detect the area A of the data RAM 28 (hereinafter, referred to as "area A"). Data RAM (A) write processing (step P1) for writing data RAM (A), and data RAM by identifying both ends in the x direction of each designated area from the data of this data RAM (A)
The data RAM (B) writing process (step P2) for writing data in the B area 28 (hereinafter referred to as the data RAM (B)) and the data in both ends in the x direction belonging to the same area from the data in the data RAM (B). A data RAM (C) writing process (step) in which the y direction is classified and summarized, and an area C1 ... (Hereinafter, abbreviated as data RAM (C1). It is processed by sequentially performing P3).

First, the data RAM (A) writing process will be described with reference to the detailed flowchart shown in FIG.

In the data RAM (A) writing process, first, "0" is set to the counter y that counts in the y direction of the bitmap stored in the video RAM map 27 and the counter x that counts in the x direction (step P101). , P102) and both counters are sequentially incremented, and the video RAM map 2 corresponding to these x and y
It is checked whether or not there is a write indicating that there is a touch in the bitmap of 7 (step P3).

When there is no touch, it is checked whether or not the value of the counter x has reached the value of the last column, "m" (step P105). When the last column has not been processed, the counter x is incremented by "1". Then (step P106), the process returns to step P103, and similarly, the video RA corresponding to the incremented x and y.
It is checked whether or not there is writing with a touch on the M map 27 (step P103).

If there is a touch in step P103, the value of x is written in the y column of the data RAM (A) (step P104), and it is checked whether x has become "m" (step P105). By sequentially repeating the processing from step P103 to step P106 above, it is checked whether or not there is writing with a touch in the y-th row from the first column to the last column, and the value of the column with the writing with a touch (value of x ) Are sequentially written in the y column of the data RAM (A).

When x matches m in step P105, it is determined that the processing for the y row is completed, and the end mark "E" is written in the y column of the data RAM (A) (step P107), and the counter is counted. It is checked whether the value of y has become the value "n" which is the value in the last line (step P
108), when the last line is not processed, the counter y is incremented by "1" (step P10).
9) Return to step P102, and set the counter x to "0".
Set to. Thereafter, similarly, it is checked whether or not there is writing with touch with respect to the row of the value of the incremented counter y, and the value of x in the column where writing with touch is written is sequentially written into the relevant y column of the data RAM (A). (Step P103 to Step P106).

The above process is sequentially repeated, and in step P108, the value of the counter y is "n" which is the value of the last line.
Then, in the data RAM (A), as shown in the left end diagram of FIG. 10 as a diagram of the data RAM (A), when there is a touch for each column of y, the x value and the end with the touch are touched. When the mark "E" is not touched,
Only the end mark "E" is written.

When the processing up to the last row is completed in this way, the data RAM (A) writing processing (step P1) shown in FIG. 8 is completed, and then the data RAM (B) writing processing (step P2) is performed. .

The data RAM (B) writing process is shown in FIG.
1 is processed.

In the data RAM (B) writing process, first, "0" is set to the counter y and the counter x (steps P201 and P202). This counter x, y
Are sequentially incremented. And data RAM
The data of x in the y column of (A) is set in the register X0 (step P203), and the value of this register X0 is written in the y column of the data RAM (B) (step P204).

Next, it is checked whether the value of the register X0 is "E", that is, whether the data written in the y column of the data RAM (A) is only "E" (step P205). ), The data RAM of FIG.
As in the column y = 0 in (A), when "E", it is checked whether the value of y is "n", that is, whether the last line has been processed (step P215). When the last line is not processed, the value of the counter y is incremented by "1" (step P216), and the step P2
Returning to 02, the counter x is set to "0".

Similarly for the next column y, the data RAM
The first x data in the y column of (A) is set in the register X0 (step P203), the set value of the register X0 is written in the y column of the data RAM (B) (step P204), and the register X0 It is checked whether the value is "E" (step P205).

In step P205, when the value of the register X0 is not "E", data other than "E" is written in the y column as in the y = 1 column of the data RAM (A) of FIG. Then, the register x is incremented by "1" (step P206), and the data RAM
The data of x in the y column of (A) is set in the register X1 (step P207).

Next, it is checked whether or not the value of the register X1 is "E" (step P208), and the register X1 is registered as shown in the y = 5 column of the data RAM (A) of FIG.
When the value of is “E”, it is determined that the data in the y column is the last, and y = of the data RAM (B) of FIG.
As shown in column 5, the value of the same register X0 is set to the data RA.
Write in the y column of M (B) (step P213). Further, "E" is written in the y column of the data RAM (B) (step P214), and it is checked whether the value of the counter y is "n" (step P215). Here, when there is only one x data, as in the case of y = 5 column of the data RAM (A) of FIG. 10, in step P213, the value of the register X0 is stored in the y column of the data RAM (B). Although it is written, the data of the same value is written in the data RAM (B).
Further, the data is written in the y column, and the left end data and the right end data of the area are written as a pair of data.

Then, in step P215, the counter y
When the value of is not "n", the value of the counter y is set to "1".
Only (step P216), the process returns to step P202, and the counter x is set to "0".

Thereafter, similarly, for the new y column, the first x data of the data RAM (A) is set in the register X0 and written in the y column of the data RAM (B) (steps P203 and P204), It is checked whether or not the data of x is "E" (step P205). If it is not "E", the value of the counter x is incremented and the data of the incremented x column of the y column of the data RAM (A) is registered. It is stored in X1 (step P207). It is checked whether the value of this register X1 is "E" (step P206), and y = 1 in the data RAM (A) of FIG.
To y = 4, when not “E”, the result of subtracting the value of the register X0 from the value of the register X1 is a preset value “N” (for example, N is 10 to 20).
The value of is set. ), It is determined whether x stored in the register X1 and x stored in the register X0 are in the same area in the row direction (step P209). That is, for example, in the data RAM (A) of FIG. 10, in the case of the y = 3 column, the data in the x = 0 column is “1”, and the data in the x = 1 column is
Since it is "3", when "10" is set as "N", the result of subtracting "1" from "3" is smaller than "10", so that the same region in the row direction (x direction) Judge as data. Similarly, in the case of column y = 3 in the data RAM (A) of FIG. 10, the data in column x = 2 is
Since it is “80”, the result of subtracting “3” which is the data of the x = 1 column from this “80” is larger than “10”, so it is determined that the data is of a different region in the x direction.

If the comparison result is NO in step P209, it is determined that the data is in the same area in the x direction, the process proceeds to step P212, and the value of the register X1 is stored in the register X0. (Step P21
2) The process moves to step P206.

Then, in step P206, the counter x
Is incremented by 1 to check if it is “E” for the next x (step P208), and if the result of subtraction from the previous value of x is larger than “N” (step P209). Here, if the result of subtracting the register X0 from the register X1 is larger than “N”, it is determined that the current x data is data in a different area in the x direction, and the y column of the data RAM (B) is stored. Write data in register X0 (step P210), data RAM (B)
Write the data of the register X1 into the y column of the
211). Then, the data in the register X1 is transferred to the register X
0 (step P212) and step P206
Then, the counter x is incremented and the next x is similarly processed.

That is, in steps P206 to P209, the counter x is sequentially incremented, and if the data of the x in the data RAM (A) is the final data (“E”) or is not the final data, the previous x. Depending on whether the difference from the data of is larger than “N”,
It is determined whether the data is in the same area in the x direction. Then, from step P210 to step P212, when the data is not in the same area, the previous x data is written to the data RAM (B), then the current x data is written to the data RAM (B), and Write the value to register X0, and when the data is the same area,
The value of the register X1 is written to the register X0 without writing the data of x to the data RAM (B).

That is, in the data RAM (A) of FIG. 10, the data of the x = 1 column and the x = 2 column of the y = 3 column are the data of different areas, and when the data of this different area appears, step At P210, the data at the right end of the previous area is written to the data RAM (B), and the process proceeds to Step P211.
Then, the data at the left end of the next area is written in the data RAM (B). Then, in the data RAM (A), y = 3 column x =
The data from the 2nd column to the 6th column is the data of the same area. At this time, the data from the x = 3rd column to the 5th column is
Do not write to M (B).

Then, in Step P208, the register X
When the data of 1 is "E", the data of the register X0 is written in the y column of the data RAM (B) (step P2
13), "E" is written in the y column of the data RAM (B) (step P214). That is, in FIG. 10, the data R
If the data read from x of AM (A) is "E", the value of x before this "E", that is, the value of the register X0 which is the data at the right end of the area is set to the data RAM
Write to (B) (step P213), then
Write "E" to the data RAM (B) (step P
214), and it is checked whether the value of the counter y has become "n" (step P215).

If the value of the counter y is not "n" in step P215, the counter y is incremented and the same processing is performed for the next y rows.

The above processing is sequentially carried out, and step P215
Then, when the value of the counter y reaches "n", it is determined that the processing has been completed up to the last row, and the data RAM (B) write processing is ended. By this data RAM (B) writing process, it is possible to identify the x direction of each area traced by touching on the touch panel 9, and
As shown in the data RAM (B) of FIG. 10, the data at the left end and the data at the right end of each area identified as “E” in each y column can be written in the data RAM (B) as a pair.

When the processing is completed up to the last row in this way, the data RAM (B) writing processing (step P2) shown in FIG. 8 is completed, and then the data RAM (C) writing processing (step P3) is performed. .

The data RAM (C) writing process is shown in FIG.
2 is processed.

In the data RAM (C) writing process, the data RAM (B) writing process is performed.
Area delimiters in the column direction (y direction) of the designated area are identified from the data written in (B), and an area Cz (z = 0, 1, 2,
...) is secured and the first row to the last row of each area are written for each row in the area Cz in which the data of the leftmost column and the data of the rightmost column are secured. This data RAM (C) writing process will be described with reference to FIGS.

That is, in the data RAM (C) writing process, first, a counter w, a counter y and a counter x for counting the number of areas of the created data RAM (Cz).
Also, "0" is set to the counter z that counts the data RAM (Cz) being processed (step P301 to step P304). These counters w, x, y, z are sequentially incremented. X in the y column of data RAM (B)
Data is read out and set in the register a (step P305). It is checked whether the data in the register a is "E" (step P306). Now, as shown in the column y = 0 in the data RAM (B) of FIG. 10, when the data in the register a is "E", Then, it is determined that there is no area data in the y column, and it is checked whether the value of the counter y is "n", that is, whether the last line has been processed (step P319). When the value of the counter y is not "n", the value of the counter y is incremented by "1", the process returns to step P303, the counter x and the counter z are set to "0", and the first y in the next y column is set. The data of x is set in the register a (step P30).
5). It is checked whether or not the data in the register a is "E" (step P306). For example, the data R in FIG.
When it is not “E” as in the y = 1 column of AM (B), the data of the register a is the data indicating the left end of the area, so the x + 1 data of the y column of the data RAM (B),
That is, the data indicating the right end of the area is read and set in the register b (step P307).

Then, it is checked whether the value of the counter w is larger than the value of the counter z (step P308).
Since "0" is set to both the counter w and the counter z in Steps P303 and P304, the value of the counter w is incremented by "1" (Step P317), and the data RAM (Cz), that is, , The data RAM (C
0) is secured. Next, since the flag Fz is now z = 0, "0" is set to the flag F0 (step P
318). This flag Fz (z = 0, 1, 2, ...)
Are created by the number of counters z, and each data RAM (C
z) corresponding to the data RAM (C
It is set to "0" when z) is being written and is set to "1" when the writing is completed.

Next, as will be described later, when processing the next y column, in step P310, the data RAM (B)
In order to check whether the data of x read from the data belonging to the area currently being written, the value of the register a is set to the register az (z = 0, 1, 2,
...)) (step P311), and the data RA
The data of the register a and the register b is written in the y column of M (Cz) (step P312). That is, x data indicating the left end of the first area in the secured data RAM (C0) (x = 0 in the y = 1 column of the data RAM (B) in FIG. 10).
The right end view of FIG. 10 is the data “2” of the column and the data x of the right end (the data “3” of the column x = 1 in the column y = 1 of the data RAM (B) of FIG. 10). As shown in, the data RAM (C0) is written in the y = 1 column. Then, the counter z is incremented by "1" (step P3
13) Further, since the data of x is a pair at the left and right ends of the area, the counter x is incremented by "2" (step P314).

Then, returning to step P305, similarly, the incremented x data in the same y column of the data RAM (B) is read and set in the register a, and whether the data in the register a is "E" or not Check (step P306). Now, the data RAM of FIG.
Since the data "1" in the column x = 0 in the column y = 2 in (B) has been read, the data in the register a is not "E", but the data x + 1 from the data RAM (B), that is, the figure “3”, which is the data of the x = 1 column of the y = 2 column of 10
Is read and it is checked whether the value of the counter w is larger than the value of the counter z (step P308).

Since the counter w is set to "1" and the counter z is set to "0", it is checked whether the flag Fz is "0" (step P309).
Since the flag Fz is set to "0" in Step P318, the absolute value of the subtraction result obtained by subtracting the data of the register a from the data of the register az, that is, the previous y column ((y) in the data RAM (B) of FIG. Data (x = “2”) of x indicating the left end of the area (data RAM (C0)) currently being written in the y = 1 column and x indicating the left end of the area read from the data RAM (B) this time. Data (x =
The absolute value of the difference from “1” is smaller than a preset value “M” (for example, a value of 10 to 20 is set) (|
az-a | <M) Depending on whether or not this time data RAM
It is checked whether the x data indicating the left end read from (B) is the same area as the area of the data RAM (Cz) being written (step P310).

When | az-a | <M, it is determined that the data is in the same area, and the values of the register a and the register b are written in the y column of the data RAM (Cz) (step P312), and the counter z and The counter x is incremented and the process returns to step P305. That is, "1" of the register a is set in the y = 2 column of the data RAM (C0) of FIG.
And write "3" in register b and set counter z to "1".
Then, the counter x is incremented to "2".

Similarly, the next x data is read from the y column of the data RAM (B) and set in the register a (step P305), and it is checked whether the data in the register a is "E" (step P306). ). Now, since the data in the x = 2 column of the y = 2 column is “E”, step P
However, since y = n has not been processed yet, the counter y is incremented to "3" (step P320), and the counter x and the counter z are set to "0" (steps P303 and P304). ), Y = 3, and then perform the same processing.

The data set in the register a in step P305 is "1" as can be seen from the data RAM (B) in FIG. 10, and the data in the register a is not "E" (step P306). The x + 1 data of the y column of the RAM (B) is set in the register b (step P307). Data RAM (C) is now 1
The counter w is "1", the counter z is set to "0" in step P304, and the data set in the registers a and b is stored in the data RAM (C0). This is the data to which it belongs.
Therefore, YES is obtained in steps P308, P309, and P310, the data in the register a is stored in the register az (step P311), and then the data in the registers a and b is stored in the data RAM (C
0) is written in the y = 3 column (step P312), and the counter z and the counter x are incremented (steps P313 and P314).

Then, the incremented x data (x = 2 "80" in FIG. 10) is read from the data RAM (B) and set in the register a (step P30).
5). Since the data in the register a is not "E" now, the next incremented x from the data RAM (B)
Data (x in the y = 3 column of the data RAM (B) in FIG. 10)
= “3” in column 3 is read out and set in the register b (step P307), and the counter w and the counter z are compared (step P308). Now, the value of the counter w is
Since it is "1" and the counter z is incremented to "1" and w = 1 and z = 1 and w> z is not satisfied, the counter w is incremented, that is,
Set the value of the counter w to "2" (step P317),
A data RAM (C1) is newly created and "0" is set in the flag Fz (step P318). The data of this register a is written to the register az (step P3
11), and the data in register a and register b
As shown in the rightmost diagram of FIG. 10, newly created data R
The data is written to AM (C1) (step P312), and the counter z and the counter x are incremented (steps P313 and P314).

In step P305, the data RAM (B)
To the incremented x data in the y column, that is, “E” is read and set in the register a. Since the data in the register a is now "E", the counter y is checked and incremented (steps P319 and P320), and the next y column is similarly processed. Since the value of y is set to "4" now,
The same process as in the case of y = 3 above, and when the process is completed,
As shown in FIG. 10, the data RAM (C0) and the data RAM (C1) have the data RAM in the corresponding y column.
The data of x in the y column of (B) is written respectively.

Then, the processing for y = 4 is completed,
When the counter y is incremented in step P320 via step P319, the process returns to step P303 to process the next y = 5.

When y = 5, as shown in FIG. 10, the first data of x in the y = 5 column of the data RAM (B) is "82".
Therefore, in step P306, it is determined that the value of the register a is not “E”, and the data of x + 1 is “8”.
2 ”is read and set in the register b.

Now, since the counter w is set to "2" and the counter z is set to "0", the flag Fz is checked. However, since the flag Fz is set to "0", writing is performed. Register az of the value of counter z which is inside
Data, that is, whether the absolute value of the difference between the data of the register az at z = 0 and the data of the register a read this time is smaller than a predetermined value “M” (step P310). Here, y in the data RAM (B) of FIG.
= 4 column x = 0 column data and y = 5 column x = 0 column data are data in different areas and are not smaller than the predetermined value "M". Therefore, the flag Fz corresponding to the z value is set. (Fig. 1
At 0, the flag F0 is set to "1" (step P
316), the counter z is incremented by "1" (step P315), and the counter w and the counter z are compared (step P308).

Next, again, the counter w is "2".
However, since the counter z is set to "1", the flag Fz is checked. However, since the flag Fz, that is, the flag F1 is set to "0", the value of the counter z being written is It is checked whether or not the absolute value of the difference between the data of the register az, that is, the data of the register az with z = 1 and the data of the register a read this time is smaller than a predetermined value "M" (step P310). Here, the data of the x = 2 column of the y = 4 column and the data of the x = 0 column of the y = 5 column of the data RAM (B) of FIG. Since it is small, the data in the register a is set in the register az (step P31
1), the data of register a and register b are changed to data RA
M (Cz), that is, data RAM (C1) is written (step P312), and counter z and counter x are written.
Is incremented (steps P313, P31
4).

Then, the data in the x column next to the y column is read from the data RAM (B) and set in the register a (step P305), and it is checked whether the value of the register a is the counter w (step P306). Now, Figure 1
At 0, the value in the x = 2 column of the y = 5 column of the data RAM (B) is “E”, so it is checked whether y = n (step P319), but since y = n is not satisfied, the counter y is incremented and the same processing is performed for the next y column (y = 6 column).

Now, there is no area data in the y = 6 column,
Since "E" has been written, step P30 is subsequently performed.
3 to step P306, step P319, and step P320 are sequentially executed, and step P319
Then, when y = n, the data RAM (C) writing process is terminated.

As described above, in the data RAM (C) writing process, the delimiter of the drawing region in the column direction is identified from the data written in the data RAM (B) by the data RAM (B) writing process. An area Cz (data RAM) is provided in the area C of the data RAM 28 for each drawing area.
(C1) ...) can be ensured, and the first row to the last row of each drawing area can be written into the data RAM (Cz) in which the data in the leftmost column and the data in the rightmost column are secured for each row. . When the data RAM (C) writing process is completed in this way, the graphic recognition process is completed as shown in FIG. 8, and the process returns to step S2 to check the selection mode as shown in FIG.

Here, when the setting mode is selected,
Performs setting mode processing.

The setting mode process is a process of setting the figure number, pitch and tone color for each figure surrounded by the designated area designated in the drawing mode processing.

In the setting mode process, first, as shown in FIG. 6, it is checked whether or not a figure number has been designated (step S7). This graphic number is designated by the operation unit 32.
By pressing the select key 14 of, the figures in the area designated in the drawing mode can be sequentially selected and designated. When the figures are designated, the CPU 29 assigns the figure numbers in the designated order, for example, to FIG. As shown, 1, 2, ...
As in.

When this figure number is designated, the system waits until the pitch or tone color is designated by the tone pitch key 15 or tone color key 16 of the operation section 32 (step S8), and then the designated figure number and tone are selected. The pitch and tone color data are written in a predetermined area of the data RAM 28 as shown in FIG. 13 (step S
9). Thereafter, it is checked whether or not the mode key 5 has been pressed (step S10). When the mode key 5 has not been pressed, the process returns to step S7, and the same processing is performed from the check of the designation of the figure number. When the above processes are sequentially executed, the data RAM 28 is displayed as shown in FIG.
The graphic number, tone color number, and pitch number are written for each designated area, and when the mode key 5 is pressed in step S10, the setting mode process is terminated and the process returns to step S2.

As described above, by the setting mode processing, the pitch and the tone color can be arbitrarily set for the figure in the area designated in the drawing mode.

If the tone generation mode is selected,
Performs pronunciation mode processing.

In the tone generation mode process, when the figure on the touch panel 9 set in the setting mode is designated by the touch pen 7,
This is a process of causing a designated figure to generate a tone having a pitch set in the setting mode with a designated tone color.

In the sound generation mode process, first, the touch panel 9 is scanned (step S11), and the touch panel 9 is scanned.
The position pressed by the touch pen 7 is detected as the pressed position data on the touch panel 9 in the x direction (row direction) and the y direction (column direction), and the pressed position data is captured. A pressed figure recognition process (step S12) is performed based on the pressed position data obtained as a result of this scanning.

This pressed figure recognition process is performed as shown in FIG.

That is, in the pressed figure recognition processing, first,
The detected pressed position data is stored in a register x for storing data in the x direction and a register y for storing data in the y direction (step Q1), and the data RAM (C
"0" is set to the counter z for scanning each designated area stored in z) (step Q2).

Then, the data (x data) in the y column corresponding to the pressed y row is read from the data RAM (Cz) into the registers a and b (step Q3),
Whether the data of the register x indicating the pressed x column is in the data of the register a and the register b (a ≦ x ≦
By b), it is checked whether or not the pressed position is within the figure of the data RAM (Cz) (step Q4). That is, by checking whether or not the data of the register x which is the pressed position is within the range of the data of the register a and the register b which are the x data of the data RAM (Cz) only for the same y column as the pressed position. It is checked whether the pressed position is within the area of the data RAM (Cz).

In step Q4, the pressed position is the data R
When it is not within the area of AM (Cz), it is checked whether the value of the counter z has reached the number of data RAM (Cz) created in the data RAM 28 (step Q5), and only the number of data RAM (Cz) is checked. If not, the counter z is incremented by "1" (step Q6), similarly, the data in the y column of the next data RAM (Cz) is read into the registers a and b (step Q3), and similarly. To process.

At step Q4, the data in the register x is
When it is within the range of the data of the register a and the register b, a return indicating that the designated figure is at the pressed position is returned together with the area number (z) in which the data of the register a and the register b are included. If the data of the register x is not within the range of the data of the registers a and b in step Q4, the value of the counter z is the data R.
It is checked whether or not the number of data RAM (Cz) created in AM28 has been reached (step Q5), and data RAM
When the number of (Cz) has not been reached, the counter z is incremented (step Q6) and the process returns to step Q3.

The above-described processing is repeated in sequence, and the pressing position is set in each data RAM (C
z), the data RA
When all the areas created in M28 have been checked, no return is returned to the effect that there is no figure corresponding to the pressed position, and the pressed figure recognition process ends.

When this pressed figure recognition process is completed, CP
U29 returns to the main processing of FIG. 6 and checks whether or not the pressed position does not specify the area set in the drawing mode based on the result of the pressed figure recognition processing, that is,
It is checked whether it is a non-setting area (step S13). If it is not a non-setting area, the pitch and tone color data are read from the data RAM 28 based on the figure number of the pressed designated area (step S14). The CPU 29 uses the waveform ROM 31 based on the read pitch and tone color data.
The waveform data is read out from, and set in the tone generator circuit 25 (step S15), and the tone generator circuit 25 is instructed to start sound generation (step S16).

When the tone generator circuit 25 is supplied with the waveform data and is instructed to start sounding, it generates a musical tone by the supplied waveform data and supplies it to the sound system 26.
The sound system 26 outputs the supplied musical sound to the speaker 1
7 and outputs to an external device via the audio output terminal 35.

When the CPU 29 outputs a sound generation start instruction to the tone generator circuit 25, it checks whether or not the mode key 5 has been pressed (step S17). When the mode key 5 is not pressed, the mode switching is not performed. Then, the process returns to step S11. And so on,
The touch panel 9 is sequentially scanned, and each time the touch panel 9 is pressed, a musical tone of the pitch or tone color set in the figure at the pressed position is generated.

As described above, the image from the TV device 3 is captured and displayed on the LCD panel 8, and the contour of the arbitrary image displayed and output is traced by the touch pen 7 on the touch panel 9 to specify the area. it can. Then, musical tone characteristics such as pitch and timbre can be designated in the designated area. As a result, it is possible to specify the area of the image such as characters and figures displayed on the LCD panel 8 and easily set the musical tone characteristics in association with the specified area.

Further, when the area in which the musical tone characteristic is designated is set and the designated area is designated by the touch pen 7, the musical tone having the musical tone characteristic set in the designated area is generated. You can Therefore, it is possible to generate the musical sound set in the image in the designated area by simply designating the area of the image such as the figure or character displayed on the LCD panel 8 without using the keyboard or the like. It is possible to generate an image by associating a video with a musical sound. As a result, it is possible to perform a performance in which the image and the musical sound are associated with each other, and it is possible to provide an interesting electronic musical instrument that has never been seen before.

FIG. 15 is a flow chart showing the main processing of the second embodiment of the input device of the present invention and the electronic musical instrument provided with this input device.

This embodiment is applied to an electronic musical instrument similar to the electronic musical instrument 1 shown in FIG. 1. In the present embodiment, in the drawing mode, an image drawn by a touch pen on the touch panel is captured, The area of the video output to the display unit and output to the display unit is automatically recognized as a drawing area. Therefore, in describing the present embodiment, the same reference numerals used in the first embodiment will be used as they are in the following description. In particular, the same steps as those in FIG. 6 are designated by the same step numbers, and detailed description thereof will be omitted.

In FIG. 15, when the power of the electronic musical instrument 1 is turned on, first, as in the first embodiment, initial processing is performed (step S1), and the mode key 5 of the operation unit 32 is scanned, Check the selection mode (step S
2).

If the selection mode is the drawing mode, first,
The touch panel 9 is scanned to detect the touch position on the touch panel 9 (step S3), the detected touch position information is transferred to the video RAM map 27, and stored as bit information (step S4). The CPU 29 converts this bit information into video data according to the video data conversion program stored in the program ROM 30, and transfers / stores it in the video RAM 24 (step S20). The CPU 29 outputs the video data stored in the video RAM 24 to the LCD controller 21 via the video interface 22, and the LCD controller 21 controls the LCD panel 8 to touch the touch panel 9
The upper touch position is displayed and output on the LCD panel 8 (step S21).

Next, it is checked whether or not the mode key 5 has been pressed (step S5). If the mode key 5 has not been pressed, the process returns to step S3 and similarly the touch position on the touch panel 9 is determined by the video RAM map 27. Stored in and converted to video data
After being stored in the AM 24, it is displayed and output on the LCD panel 8 (steps S3 to S21). When images of characters, figures, etc. are drawn on the touch panel 9 by the touch pen 7 by sequentially repeating the above processes, the drawn images are sequentially developed on the video RAM map 27,
The video data is converted and stored in the video RAM 24, and is displayed and output on the LCD panel 8.

After that, when the mode key 5 is pressed, the process proceeds from step S5 to step S6, and the same graphic recognition process as in the first embodiment is performed (step S6). However, in this figure recognition processing, the same processing procedure as the figure recognition processing shown in FIGS. 8 to 12 is performed, but in the present embodiment, the image itself drawn on the touch panel 9 is automatically set as an area. Recognize it.

When the figure recognition process is completed, the process returns to step S2 to check the selection mode (step S2).
2). After that, the setting mode process and the sound generation process are performed according to the selection mode. The setting mode process and the sound generation mode process are the same as those in the above-described embodiment.

As described above, according to the present embodiment, by touching the touch panel 9, an image such as a character or a figure is drawn, and the drawn image area is recognized. Then, when the tone characteristics such as pitch and tone color are set in the region recognized in the setting mode and the set region is designated by the touch pen 7 in the sounding mode, a tone having the tone characteristic set in the designated region can be generated. it can. Therefore, the player can generate a musical tone having the set musical tone characteristic by setting the musical tone characteristic in an image drawn arbitrarily and designating the image. As a result, it is possible to set a musical sound for a video having a higher degree of freedom and to generate the musical sound in an arbitrary order, so that it is possible to provide a more interesting electronic musical instrument.

[0114]

According to the input device of the present invention, by the area designating means laminated with the display means for displaying and outputting the display data such as characters and figures, any area of the display data displayed and output on the display means can be displayed. Since the tone characteristics such as pitch and tone can be designated for the area designated by the area designating means, the tone characteristic can be associated with the display data such as characters and figures displayed on the display means. Can be set.

According to the electronic musical instrument of the present invention, the area of the display data of the display means and the musical tone characteristic are set by the input device of the present invention, and when the set area is designated, the designated area is set. Since it is possible to generate musical tones with the set musical tone characteristics, it is possible to specify the area of the specified display data by simply specifying the area of the display data such as figures and characters displayed on the display means without using the keyboard etc. It is possible to generate the musical tone set to, and display data such as figures and characters and the musical tone can be generated in association with each other.

[Brief description of drawings]

FIG. 1 is an external configuration diagram of an electronic musical instrument according to a first embodiment of the present invention.

FIG. 2 is an exploded perspective view of the display unit shown in FIG.

FIG. 3 is a circuit block diagram of an electronic musical instrument.

FIG. 4 is a front view of a display unit on which graphics are displayed.

FIG. 5 is a front view of the display unit in a state where the displayed figure is designated as an area.

FIG. 6 is a flowchart showing main processing of the electronic musical instrument shown in FIG.

FIG. 7 is a diagram showing an example of pressed positions on the touch panel as dots in xy directions.

8 is a flowchart showing the procedure of the graphic recognition process of FIG.

9 is a flowchart showing the detailed processing of the data RAM (A) write processing of FIG.

10 is a diagram showing a memory map of a data RAM (A), a data RAM (B) and a data RAM (C) which are formed in the data RAM by the figure recognition processing of FIG.

11 is a flowchart showing the detailed processing of the data RAM (B) write processing of FIG.

FIG. 12 is a flowchart showing detailed processing of a data RAM (C) writing process of FIG.

13 is a data RAM for the pressed figure recognition process of FIG.
The figure which shows the relationship of the figure number, tone color number, and pitch number written in.

FIG. 14 is a flowchart showing detailed processing of the pressed figure recognition processing of FIG.

FIG. 15 is a flowchart showing the main processing of the second embodiment of the electronic musical instrument to which the present invention is applied.

[Explanation of symbols]

 1 electronic musical instrument 2 cable 3 TV device 5 mode key 6 display section 7 touch pen 8 LCD panel 9 touch panel 15 pitch key 16 tone color key 17 speaker 18 image capture button 21 LCD controller 22 video interface 23 touch panel interface 24 video RAM 25 sound source Circuit 26 Sound system 27 Video RAM map 28 Data RAM 29 CPU 30 Program ROM 31 Waveform ROM 32 Operation part 33 Video input terminal 34 Video output terminal 35 Audio output terminal

Claims (8)

[Claims] 1. Display means for displaying and outputting display data; area designating means for designating an arbitrary area of display data which is stacked with said display means and outputted and displayed on the display means; and the area designating means. An input device, comprising: a musical tone characteristic designating unit for designating a musical tone characteristic to an area. 2. The input device according to claim 1, wherein the musical tone characteristic designating unit designates a pitch. 3. The input device according to claim 1, wherein the musical tone characteristic designating unit designates a tone color. 4. The display means outputs the graphic as display data, and the area designating means designates an arbitrary area of the graphic displayed by the display means. Item 4. The input device according to any one of Item 3. 5. The apparatus further comprises area recognition means for recognizing an area of the display data displayed on the display means designated by the area designation means, the display means displaying and outputting a graphic as the display data,
The area designating means is capable of designating an area by dividing each part of a graphic to be displayed and output by the display means, and the area recognizing means recognizes each area designated by the area designating means. The input device according to any one of claims 1 to 4. 6. The area designation means can input the figure as display data by drawing a figure, and the display means displays and outputs the display data input from the area designation means as a figure. The input device according to any one of claims 1 to 5, which is characterized. 7. The input device according to claim 1, wherein the display means displays and outputs the graphic data input from the outside as a graphic. 8. The input device according to claim 1, wherein when the area is designated by the area designating means, the area is designated by the tone characteristic designating means. An electronic musical instrument comprising: a musical tone generating means for generating a musical tone having a musical tone characteristic.