JPH07271507A - Information input method/device and information providing system - Google Patents

Abstract

PURPOSE:To attain a remote operations for users and also to reduce the manipulated variable for pointing the shown image information in order to shorten the pointing operation time. CONSTITUTION:A processor 10 shows a menu on a display 2 for a user. The user emits a visible semiconductor laser beam by means of a remote controller 1 to point a desired position of the shown menu. This pointed position is photographed by a camera 4 and reported to an image processing part 5. The part 5 processes the image received from the camera 4 to measure the irradiating position of the semiconductor laser beam and sends the coordinate value of the measured position to the processor 10. The processor 10 decides the choice number corresponding to the irradiating position of the laser beam and requests an information center for the information on the choice number. Then the processor 10 shows the information received from the information center on the display 2 for the user.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information providing system, and more particularly to an information providing system for providing single media information such as still images and moving images, or multimedia information combining these, according to a user's request. The present invention relates to an information input method and its device in a providing system or the like.

[0002]

2. Description of the Related Art In a conventional information providing system, there is a KB (keyboard), a mouse, a touch panel or the like as means for a user to input information.

In an information providing system for searching for a desired still image or moving image in a menu format, when a menu is presented by the system, the user uses the numeric keys arranged on the KB to select desired option numbers. Or use the cursor movement keys (that is, "↑", "↓", "←", "→") arranged on the KB or the mouse to move the cursor to the desired position. The menu is being searched by a method such as moving and designating or designating by touching a desired option with a finger using a touch panel. Here, the options are represented by characters, a still image, a moving image, or the like.

Further, in the information providing system capable of scrolling and displaying the screen like map information,
The user uses a mouse or the like to specify a scroll destination such as “↑”, “↓”, “←”, “→” displayed on the display.

Further, in the moving image providing system in which the user designates a position with respect to the displayed moving image, detailed information regarding a person, an object, etc. existing at the position is presented, and the user uses a mouse or the like. The cursor is moved to a desired position and designated.

Further, in a hypermedia system that provides more detailed information by pointing to an image or characters (strings) displayed on the display, the user desires a cursor by using a KB or a mouse. It is specified by moving it to an image or text (column).

[0007]

In the above-mentioned conventional information providing system, since the input means is a KB or mouse connected to the processor by a cable or the like, or a touch panel attached to the display, the user can remotely It is difficult to operate, and in order for the user to point to the presented image information, it is necessary to move the cursor to the desired position using the cursor movement keys or the mouse. The amount of operation of was increased and the operation took time, and pointing was delayed.

The present invention has been made to solve the above-mentioned problems, and in an information providing system or the like that provides corresponding information in response to a user's request, it is possible for a user to remotely perform information input operation. It is possible to reduce the amount of operation for the user to perform pointing on the presented image information, and to shorten the operation time for the user to perform pointing.

[0009]

In order to achieve the above object, in the information input method of the invention of claim 1, visible light or visible semiconductor laser light is irradiated on the display screen of information for pointing, The irradiation position of visible light or visible semiconductor laser light is image-processed and measured to obtain pointing information.

Further, in the invention of claim 2, a remote controller for irradiating the information display screen with visible light or visible semiconductor laser light for pointing, a means for imaging the information display screen, and the image capturing. An image processing means for measuring an irradiation position of visible light or visible semiconductor laser light from the remote controller by collating an image with information held in advance and outputting it as pointing information.

Further, in the information input method of the invention of claim 3, in the information providing system for providing corresponding information in response to the user's request, the system displays the information on the display means and presents it to the user, and the user can see the Alternatively, a desired position is pointed in the information presented by using a remote controller having a function of emitting visible semiconductor laser light, and the system displays the display means irradiated with the visible light or visible semiconductor laser light. An image of the screen is captured, image processing is performed on the captured image, the irradiation position of the visible light or the visible semiconductor laser light is measured, and the measured irradiation position is processed as pointing information designated by the user.

In the above information input method, according to the invention of claim 4, the process of measuring the pointed irradiation position by the image processing is performed by pointing visible light or a visible semiconductor laser which holds an imaged image in advance. It is assumed that the coordinate value of the pointed irradiation position is extracted by collating with the information on the shape and / or color of light.

Further, in the invention of claim 5, information processing means, display means for displaying information from the information processing means, and visible light or visible semiconductor for pointing information on the display screen of the display means. A remote controller for emitting a laser beam, a unit for capturing an image of the display screen of the display unit pointed by the visible light or the visible semiconductor laser beam, and a unit for collating the imaged display screen with information held in advance. An image providing means for measuring the pointed irradiation position and inputting as pointing information to the information processing means, wherein the information processing means performs a process corresponding to the pointing information and provides information. And

[0014]

In the information input method and the apparatus thereof according to the first and second aspects of the invention, the user irradiates the information display screen with visible light or visible semiconductor laser light to perform pointing,
By obtaining the irradiation position by image processing and using it as pointing information, it is possible to remotely input information using a display screen of information in a wide range of applications.

Further, according to the inventions of claims 3 and 5, in the information providing system for providing corresponding information in response to a user's request, a remote controller having a function of emitting visible light or visible semiconductor laser light by the user is used. Then, the desired position is illuminated with respect to the presented image information, the system performs image processing on the captured image by the image pickup means or the like to measure the illuminated position, and the illuminated position is designated as specified by the user. By performing the process, the amount of operation for the user to point to the information presented by the system is reduced, and the operation time for the user to point is reduced.

According to the invention of claim 4, the information about the shape and color of the pointing by the visible light or the visible semiconductor laser light is held in advance, and the pointing is made by the visible light or the visible semiconductor laser light by the user. The pointing position is easily measured by measuring the pointed irradiation position by collating the image captured on the display screen with the above information and extracting the coordinate value of the matching portion.

[0017]

Embodiments of the present invention will now be described in detail with reference to the drawings.

The structure of one embodiment of the present invention is shown in FIG. This embodiment is an example when applied to an information providing system,
FIG. 1 shows the configuration of the information search terminal. In the figure, 1 is a remote controller, 2 is a display, 4 is a camera, 5 is an image processing unit, and 10 is a processor. As a component of the processor 10, 3 is a display control unit, 6 is a communication control unit, 7 is a line control unit, and 8 is an information receiving unit.

FIG. 2 shows an arrangement example of the remote controller 1, the display 2 and the camera 4 in the information retrieval terminal. The remote controller 1 operated by the user exists in front of the display 2. The display 2 displays information according to the user's request, and is irradiated with visible semiconductor laser light (generally visible light) emitted from the remote controller 1.

The camera 4 is arranged in front of or behind the display surface of the display 2 (in the case of a rear projection type display), is directed to the display 2, and the information displayed on the display 2 and the semiconductor emitted by the user. The irradiation position of laser light is collected.

The information retrieval terminal is connected to the information center through the line controller 7 by a communication network or the like. The information center stores multimedia information such as still images, moving images, and audio.

Here, it goes without saying that the information retrieval terminal itself may be of a stand-alone type which holds such multimedia information.

After the connection is established between the information retrieval terminal and the information center, the menu request command is transferred from the information retrieval terminal to the information center. Upon receiving the menu request command, the information center transfers a menu confirmation response to the information search terminal.

Here, an example of the format of the menu request command, the menu confirmation response, etc. is shown in FIG. As parameters of the menu confirmation response, in addition to the total number of options and the menu body, there are option numbers that exist corresponding to the options and layout information that the options should be arranged on the display 2.

When the information retrieval terminal receives the menu confirmation response, the line controller 7 notifies the communication controller 6 of the menu confirmation response. Communication control unit 6
With respect to the parameter of the menu confirmation response, holds the option number and layout information existing corresponding to the option, and the menu body notifies the display control unit 3. The display control unit 3 displays the menu body on the display 2.

When the user looks at the menu displayed on the display 2 and finds a desired option, he or she uses the remote controller 1 to emit a semiconductor laser beam toward the option.

Here, the substance of the remote controller 1 is, for example, a laser pointer (for example, a visible light semiconductor laser having a wavelength of 670 nm (red) or the like is used) for a presentation using an OHP, or , A remote controller for a TV or video equipped with such a laser pointer. FIG. 4 shows a configuration example of the remote controller 1. In the figure, buttons "1", "2", ...
“0” is a button for inputting numbers, and button “R” is a button for confirming input of numbers, and is transmitted to the presentation through the transmission window 12 for the processor. The button “P” is a pointer button, and the semiconductor laser light is emitted from the transmission window 11 for display while the user is pressing the button.

The emitted semiconductor laser light is applied to the display 2. The camera 4 collects the image which is the display content on the display 2, that is, the displayed menu and the irradiation position of the emitted semiconductor laser light, and notifies the image processing unit 5 (A). The image processing unit 5 displays the semiconductor laser light, which is held in advance, on the display 2
Information of the color and the shape when it is illuminated on the image is extracted, and the matching process is performed on the image notified from the camera 4,
A portion matching the color and shape of the semiconductor laser light is found, and the coordinate value of the matching portion is extracted. The image processing unit 5 notifies the communication control unit 6 of the coordinate value (a).

Here, FIG. 5 shows an example of the inter-block interface information relating to the measurement processing of the irradiation position of the semiconductor laser light in the information retrieval terminal. In this example, the captured image shown in (A) above is sent from the camera 4 to the image processing unit 5, and the coordinate values sent out in (A) above are sent from the image processing unit 5 to the communication control unit 6. Sent out.

The communication control unit 6 extracts the option number and layout information held as described above, checks which option the notified coordinate value corresponds to, and extracts the option number of the corresponding option. Then, the communication control unit 6 edits the format of the search request command that specifies the option number and notifies the line control unit 7 of the format. The line controller 7 transfers the search request command to the information center.

In the above, when there is no option corresponding to the coordinate value notified from the image processing unit 5, the communication control unit 6 waits for the coordinate value notified next from the image processing unit 5. .

An example of the menu display processing in the above information retrieval terminal is shown in the flow chart of FIG.

Upon receipt of the search request command, the information center extracts the option number from the search request command, performs a search based on the option number, reads the corresponding multimedia information from the database, and sends a search confirmation response. The format is edited and the search confirmation response is transferred to the information search terminal.

Here, an example of the format of the search request command, the search confirmation response, etc. is shown in FIG. The parameters of the search confirmation response include, in addition to the media type and the image information body, the component image number that exists corresponding to the component image that constitutes the image information and the layout information that the component image should be arranged on the display 2. .

When the information search terminal receives the search confirmation response, the line controller 7 notifies the communication controller 6 of the search confirmation response. Regarding the parameter of the search confirmation response, the communication control unit 6 holds the component image number and the layout information of the component image corresponding to the component image, and notifies the display control unit 3 of the image information body. The display control unit 3 displays the image information body on the display 2.

When the user looks at the image information displayed on the display 2 and finds a desired component image, he or she uses the remote controller 1 to emit a semiconductor laser toward the component image.

As in the above, the emitted semiconductor laser irradiates the display 2. The camera 4 collects the display contents on the display 2 and notifies the image processing unit 5 of the display contents. The image processing unit 5 performs collation processing on the image notified from the camera 4, finds a portion that matches the color and shape of the semiconductor laser, and extracts coordinate values of the matching portion. The image processing unit 5 notifies the communication control unit 6 of the coordinate value.

The communication control unit 6 extracts the component image numbers and layout information held as described above, checks which component image the notified coordinate value corresponds to, and extracts the corresponding component image numbers. Then, the communication control unit 6 edits the format of the search request command that specifies the component image number and notifies the line control unit 7. The line controller 7 transfers the search request command to the information center.

Upon receipt of the search request command, the information center extracts the option number from the search request command, performs a search based on the component image number, and retrieves the multimedia information related to the component image from the database. The format of the search confirmation response is read and edited, and the search confirmation response is transferred to the information retrieval terminal.

When the information search terminal receives the search confirmation response, the line controller 7 notifies the communication controller 6 of the search confirmation response. The communication control unit 6 extracts the image information body with respect to the parameter of the search confirmation response, and notifies the display control unit 3 of the image information body. The display control unit 3 displays the image information body on the display 2.

In the present invention, the information display screen is irradiated with visible light or visible semiconductor laser light for pointing, and the irradiation position of the visible light or visible semiconductor laser light is image-processed and measured for pointing. Information input method characterized by using information, or a remote controller for pointing by irradiating visible light or visible semiconductor laser light on the information display screen, means for picking up the information display screen, and the remote controller By using an information input device characterized by having an image processing means for performing image processing on the irradiation position of visible light from the semiconductor laser or visible semiconductor laser light to generate pointing information, an information providing system as described above is provided. Without limitation, it can be applied to a wide range of purposes.

[0042]

As described above, according to the information input method and apparatus of the first and second aspects of the present invention, it is possible to input information remotely using a display screen of information in a wide range of applications. Is.

According to the inventions of claims 3 and 5, in the information providing system for providing the corresponding information in response to the user's request, the user can remotely operate and the presented image information can be displayed. On the other hand, it is possible to reduce the amount of operation for the user to perform pointing and to shorten the operation time for the user to perform pointing.

According to the fourth aspect of the present invention, the pointing position can be easily measured by the image processing in the above information input method.

[Brief description of drawings]

FIG. 1 is a configuration diagram of an information search terminal that is an embodiment of the present invention.

FIG. 2 is a diagram showing an arrangement example of a remote controller, a display and a camera in the information retrieval terminal.

FIG. 3 is a diagram showing an example of a format of a menu request command, a menu confirmation response, etc. transferred between the information retrieval terminal and the information center.

FIG. 4 is a diagram showing a configuration example of a remote controller in the information retrieval terminal.

FIG. 5 is a diagram showing an example of inter-block interface information regarding measurement processing of a semiconductor laser light irradiation position in the information retrieval terminal.

FIG. 6 is a diagram showing an example of a flowchart regarding a menu display process in the information retrieval terminal.

FIG. 7 is a diagram showing an example of a format of a search request command, a search confirmation response, etc. transferred between the information search terminal and the information center.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Remote control 2 ... Display 3 ... Display control part 4 ... Camera 5 ... Image processing part 6 ... Communication control part 7 ... Line control part 8 ... Information receiving part 10 ... Processor

Claims (5)

[Claims] 1. The information display screen is irradiated with visible light or a visible semiconductor laser light for pointing, and the irradiation position of the visible light or the visible semiconductor laser light is image-processed and measured to obtain pointing information. Information input method characterized by. 2. A remote controller for pointing by irradiating visible light or visible semiconductor laser light on the information display screen, means for picking up the information display screen, and the imaged image held in advance. And an image processing unit that measures the irradiation position of visible light or visible semiconductor laser light from the remote controller by comparing with information and outputs it as pointing information. 3. An information providing system for providing corresponding information in response to a user's request, wherein the system displays the information on a display unit to present it to the user, and the user has a function of emitting visible light or visible semiconductor laser light. A desired position in the presented information is pointed by using the remote controller, and the system captures the display screen of the display unit irradiated with the visible light or the visible semiconductor laser light and performs image processing on the captured image. Is performed to measure the irradiation position of the visible light or the visible semiconductor laser light, and the corresponding processing is performed as the pointing information designated by the user. 4. The process of measuring a pointed irradiation position by image processing is collated with information of the shape and / or color of the pointed visible light or visible semiconductor laser light holding the captured image in advance. The information input method according to claim 1 or 3, wherein the coordinate value of the pointed irradiation position is extracted. 5. An information processing means, a display means for displaying information from the information processing means, and a remote control for emitting visible light or visible semiconductor laser light for pointing information on a display screen of the display means. , Means for imaging the display screen of the display means pointed by the visible light or visible semiconductor laser light, and the pointing irradiation position by comparing the imaged display screen with information held in advance. An information providing system, comprising: an image processing unit for measuring and inputting to the information processing unit as pointing information, the information processing unit providing information by performing a process corresponding to the pointing information.