JP2000215250A - Commodity information processor, commodity information processing method, and machine-readable recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a commodity information processor, etc., capable of improving customer's convenience by providing the processor with a menu selecting function using voice input and a function enabling a user to reach a required commodity without being conscious of the hierarchical structure of menus. SOLUTION: A CPU 401 executes the display processing of menus and various contents information in a main display part 403 constituted integrally with a touch panel and the display processing of video information for guiding specific commodities or various contents information on a sub-display part 404, allows a voice recognition part 405 to recognize user's input voice from microphones 44 and analyzes various commodity names, various contents names, instructed contents, etc., corresponding to the voice recognition result based on a voice recognition dictionary stored in an HD drive 413. Then the CPU 401 reads out response voice data corresponding to the voice contents from a voice response file stored in the HD drive 413 and outputs a response voice from a voice synthesis part 406.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a merchandise information processing apparatus installed in a store represented by a convenience store and selling various merchandise information.

[0002]

2. Description of the Related Art Fixtures installed in stores, such as convenience stores, are provided with display shelves on which various types of product cards are placed and a monitor for displaying game promotion images for sale of game software. There is.

[0003] Further, a touch panel is provided which also serves as a display screen on which display information is switched. By touch input operation on a menu screen displayed on the touch panel, various shopping applications such as application for reservation and reservation, purchase including ticket reservation, etc., and game rewriting are performed. Some have multiple functions such as application, introduction of various information and products.

[0004]

In the above-mentioned conventional furniture, the configuration of the menu displayed on the touch panel is, for example, a hierarchical structure as shown in FIG. When selecting the software, first, as shown in FIG. 14, a game is selected and operated from a menu screen on which classifications of music, video, game, ticket, print, and the like are displayed.
A desired genre is selected and operated from a genre screen on which genres such as shooting, RPG, and simulation are displayed as shown in FIG. Further, after selecting and operating a desired maker from the maker screen on which each maker such as company A, company B, and company C is displayed as shown in FIG. 16, finally, as shown in FIG. Adventure, Y story,
By selecting and operating a desired title from a title screen on which titles such as Z fantasy are displayed, FIG.
A display screen of a desired game software as shown in FIG. 8 can be reached.

As described above, when a game selection is taken as an example of a menu operation on the touch panel, the user has to go through at least four operation procedures, which makes the user feel complicated in touch panel operation. In addition, touch panel operation based on a menu having such a hierarchical structure has a problem in terms of versatility of operation. That is, since customers of all ages visit stores where furniture is installed, touch panel operations based on menus having a hierarchical structure are particularly unfamiliar to young and elderly users. Further, in the case of the furniture having the above-mentioned multi-function, the hierarchical structure of the menu displayed on the touch panel is further complicated, and the operability is further complicated.

Further, in the case of furniture having the above-mentioned multi-functions, since there are many types of information to be purchased or introduced,
Because of the complexity of the operability, it takes time for the user to reach the desired information, and the time required for receiving the provision of the information is prolonged. For this reason, the time for one user to occupy the furniture is prolonged, and the operating rate and utilization rate of the furniture are reduced.

[0007] Therefore, an object of the present invention is to provide a menu selection function by voice input and a function of allowing a customer to reach a desired product without being aware of the hierarchical structure of the menu, thereby improving the convenience of the user. It is an object of the present invention to provide a machine-readable recording medium storing a product information processing apparatus, a product information processing method, and a processing program for processing product information that can be enhanced.

[0008]

In order to solve the above-mentioned problems, according to the image information processing apparatus of the present invention, the merchandise information storage means includes various merchandise information and identification information for identifying the various merchandise information. The speech recognition dictionary storage means stores a speech recognition dictionary corresponding to the product information and the identification information stored in the product information storage means, and the speech recognition means is inputted from the speech input means. The content of the audio,
Recognition is performed based on the voice recognition dictionary stored in the voice recognition dictionary storage unit, and the product information extraction unit analyzes the voice content recognized by the voice recognition unit, and based on the analysis result, the product information storage unit The corresponding product information is extracted from the various types of product information stored in the storage unit, and the product information processing unit specifies the processing content specified by the voice content recognized by the voice recognition unit, and the specified processing content And processes the product information extracted by the product information extracting means based on the information.

According to the image information processing method of the present invention, various types of product information and identification information for identifying the various types of product information are stored in association with each other, and then the stored product information and identification information are stored. After storing the voice recognition dictionary corresponding to the, the content of the input voice is recognized based on the voice recognition dictionary, the recognized voice content is analyzed, and the stored voice content is stored based on the analysis result. The corresponding product information is extracted from the various types of product information, the processing content specified by the recognized voice content is specified, and the extracted product information is processed based on the specified processing content.

According to a machine readable recording medium storing a processing program for processing product information according to the present invention, various types of product information can be stored by executing the processing program stored in the recording medium. The identification information identifying the various types of product information is stored in association with the identification information, and then the stored product information and the voice recognition dictionary corresponding to the identification information are stored, and the content of the input voice is stored in the voice recognition dictionary. After the recognition based on the recognized voice content, the recognized voice content is analyzed, and corresponding product information is extracted from the stored various product information based on the analysis result. Then, the extracted product information is processed based on the specified processing content.

[0011] Therefore, according to the inventions described in claims 1, 16 and 19, the commodity information can be instructed by voice, so that it is possible to provide a simple and convenient input environment and to cope with a wider age group. be able to.

According to the image information processing apparatus of the present invention, the instruction selecting means instructs and selects the processing contents relating to the various product information together with the various product information, and the display means includes:
The various product information indicated and selected by the instruction selection means and the processing content are appropriately switched and displayed, and the product information storage means stores the various product information and identification information for identifying the various product information in association with each other, The voice recognition dictionary storage means stores a voice recognition dictionary corresponding to the product information and the identification information stored in the product information storage means, the voice input means inputs a user's voice, and the voice recognition means The content of the voice input by the voice input means is recognized based on the voice recognition dictionary stored in the voice recognition dictionary storage means, and the product information extracting means analyzes the voice content recognized by the voice recognition means. Extracting corresponding product information from various types of product information stored in the product information storage means based on the analysis result, or selecting an instruction by the instruction selection means. The product information corresponding to the selected instruction content is extracted from the product information storage unit, the extraction result display output unit displays and outputs the extraction result by the product information extraction unit to the display unit, and the processing content specifying unit includes Analyzing the voice content recognized by the voice recognition means to specify the processing content specified by the user, or specifying the processing content of the product information corresponding to the instruction selection content specified by the instruction selection means Then, the product information processing means processes and outputs the product information extracted by the product information extracting means based on the processing content specified by the processing content specifying means.

Further, according to the image information processing method of the present invention, the user is allowed to instruct and select the processing contents related to the various product information together with the various product information, and the variously selected product information and the processing contents are selected. And appropriately switch and display, store various product information and identification information for identifying the various product information in association with each other, and store a voice recognition dictionary corresponding to the stored product information and identification information,
When the voice of the user is input, the content of the input voice is recognized based on the stored voice recognition dictionary,
The recognized voice content is analyzed, and corresponding product information is extracted from the stored various product information based on the analysis result, or product information corresponding to the selected instruction is selected. It extracts from the stored various product information, displays the extraction result, and then analyzes the recognized voice content to identify the processing content instructed by the user, or After the processing content of the product information corresponding to the instruction selection content is specified, the extracted product information is processed and output based on the specified processing content.

According to a machine-readable recording medium storing a processing program for processing product information according to the present invention, by executing the processing program stored on the recording medium, various types of product information can be obtained. The user is instructed to select the processing content related to the various product information, and switches and displays the variously selected product information and the processing content as appropriate, and displays the various product information and identification information for identifying the various product information. A voice recognition dictionary corresponding to the stored merchandise information and identification information is stored, and when a user's voice is input, the content of the input voice is stored in the stored voice recognition dictionary. Recognize based on the dictionary, analyze the recognized voice content, and, based on the analysis result, the corresponding product information from the stored various product information. Extracted or extracts product information corresponding to the instruction selected instruction selection from among the stored variety of product information, and displays the extraction result,
After analyzing the recognized voice content and specifying the processing content specified by the user, or specifying the processing content of the product information corresponding to the specified instruction selection, the specified processing is performed. The extracted product information is processed and output based on the content.

[0015] Therefore, according to the inventions described in claims 2, 17 and 20, it is possible to instruct the selection of the product information and to process the product information corresponding to the content of the instruction by voice, which is simple and convenient for the user. It is possible to provide a convenient input environment, and to cope with a wider age group.

According to the image information processing apparatus of the present invention, the instruction selecting means instructs and selects the processing contents related to the various product information together with the various product information, and the display means includes:
The various product information indicated and selected by the instruction selection means and the processing content are appropriately switched and displayed, and the product information storage means stores the various product information and identification information for identifying the various product information in association with each other, The imaging means captures a user and outputs a captured image, and the product information extracting means extracts and extracts from the product information storage means product information corresponding to the instruction selected by the instruction selecting means. The result display output unit, when a captured image of a user is output from the imaging unit, causes the display unit to start displaying an instruction selection screen for product information and processing content,
The extraction result by the product information extraction means is displayed and output on the display means, and the processing content specifying means specifies the processing content of the product information corresponding to the instruction selection content specified by the instruction selection means, and The means processes and outputs the product information extracted by the product information extracting means based on the processing content specified by the processing content specifying means.

Further, according to the image information processing method of the present invention, the processing contents relating to the various kinds of product information are instructed and selected together with the various kinds of product information, and the variously selected product information and the processing contents thereof are selected. Are appropriately switched and displayed, and various kinds of product information and identification information for identifying the various kinds of product information are stored in association with each other, a user is imaged and a captured image is output, and the instruction selection content selected by the instruction is selected. Is extracted from the stored various types of product information, and when a captured image of the user is output, display of the product information and a process content selection screen is started, and the extraction is performed. After displaying the result and specifying the processing content of the product information corresponding to the selected instruction, the extracted product information is processed based on the specified processing content. To and output.

According to a machine readable recording medium storing a processing program for processing product information according to the invention of claim 21, by executing the processing program stored in the recording medium, together with various types of product information, The user is instructed to select the processing content related to the various product information, and switches and displays the variously selected product information and the processing content as appropriate, and displays the various product information and identification information for identifying the various product information. The user stores an image of the user, outputs a captured image, and extracts product information corresponding to the selected instruction from the stored various types of product information. When the image is output, the display of the instruction selection screen for the product information and the processing content is started, and the extraction result is displayed. After identifying the processing content of the product information corresponding to the selection, processing and outputting product information that is extracted on the basis of the specified processing content.

Therefore, according to the present invention, it is possible to efficiently display the product information only when the user uses the product information, and to efficiently process the product information. The operation in the information processing device can be performed efficiently, and power consumption can be reduced.

In this case, as in the invention according to claim 4, in the image information processing apparatus according to claim 2 or 3, the product information processing means stores the product information extracted by the product information extraction means. A recording medium reading means for writing on a recording medium set by the user or for reading product information written on the recording medium may be provided.

According to a fifth aspect of the present invention, in the merchandise information processing apparatus according to the fourth aspect, the recording medium reading / writing means writes the merchandise information to a card-type or disk-type recording medium. You may comprise so that reading may be performed.

According to an eighth aspect of the present invention, in the merchandise information processing apparatus according to any one of the fourth to seventh aspects, the merchandise information processing means includes a plurality of the plurality of types corresponding to different types of recording media. You may comprise so that a recording medium reading means may be provided.

According to the fourth, fifth, and eighth aspects of the present invention, in the commodity information processing apparatus, for example, a memory card, an IC card, or the like can be used as a card-type recording medium. Is MD, F
D, CD-R, CD-RW, DVD-R, DVD-RA
M and the like can be used, and writing, rewriting, and the like of game data, music data, and the like as product information can be easily performed.

According to a sixth aspect of the present invention, in the merchandise information processing apparatus according to any one of the second to fifth aspects, the merchandise information processing means reads an image of a document set by the user. You may comprise so that an image reading means may be provided.

According to the sixth aspect of the present invention, it is possible to easily read various original images in the commodity information processing apparatus, and to improve the usability of the commodity information processing apparatus.

According to a seventh aspect of the present invention, in the product information processing apparatus according to any one of the first to sixth aspects, the product information processing means is configured to output the product information extracted by the product information extracting means. You may comprise so that it may have the printing means which prints image information on predetermined printing paper.

According to the seventh aspect of the present invention, it is possible to easily print various images in the commodity information processing apparatus and improve the usability of the commodity information processing apparatus.

According to a ninth aspect of the present invention, in the commodity information processing apparatus according to any one of the first to eighth aspects, the voice content recognized by the voice recognition means is analyzed, and based on the analysis result. A first voice response unit that outputs a response voice such as operation guidance, and a second voice response unit that outputs a corresponding voice based on the extraction result of the product information extracted by the product information extraction unit. It may be configured as follows.

According to the ninth aspect of the present invention, it is possible to notify the user of the contents selected and selected by the voice input and the result of extracting the product information in an easy-to-understand manner. Expansion can be achieved.

According to a tenth aspect of the present invention, in the commodity information processing apparatus according to the ninth aspect, the voice input means, the first voice response means, and the second voice response means include a handset. You may comprise so that it may be provided as.

According to the tenth aspect of the present invention, since the voice input and the response voice can be heard only by the handset, the privacy of the user can be protected, and the sound leakage at the time of using the product information processing apparatus can be achieved. Since prevention can be achieved, the product information processing apparatus can be used without disturbing other users such as a convenience store where the product information processing apparatus is installed.

Further, as in the invention according to claim 11, in the commodity information processing apparatus according to any one of claims 2 to 10, the display means comprises: a main display unit for displaying various commodity information and processing contents; An auxiliary display unit that displays supplementary information that supplements various types of product information may be provided.

According to the eleventh aspect of the present invention, the merchandise information that is currently hit can be introduced, so that the shop where the merchandise information processing device is installed can appeal the user to the merchandise information that is being hit. This makes it possible to diversify the use form of the commodity information processing apparatus.

According to a twelfth aspect of the present invention, in the merchandise information processing apparatus according to any one of the fourth to eleventh aspects, the recording medium reading means writes and reads merchandise information to and from a portable information terminal. May be provided.

According to the twelfth aspect of the present invention, the PD
It becomes possible to read and write product information even on a recording medium built in a portable information terminal such as A (Personal Digital Assistants).

According to a thirteenth aspect of the present invention, in the merchandise information processing apparatus according to the twelfth aspect, the recording medium reading means transmits and receives merchandise information to and from the portable information terminal wirelessly. Communication means may be provided.

According to the thirteenth aspect, it is possible to read and write product information even on a recording medium built in a portable information terminal having a radio communication function of radio waves, infrared rays, etc. Become.

According to a fourteenth aspect of the present invention, in the merchandise information processing apparatus according to any one of the first to thirteenth aspects, a settlement means for performing a settlement based on the commodity information processed by the commodity information processing means. May be further provided.

According to the fourteenth aspect of the present invention, it is possible to perform the settlement related to the sale of the commodity information by the settlement means, so that a commodity information processing apparatus is installed, for example, a cash register settlement in a convenience store or the like, It reduces the work load in daily sales calculations, etc., making it easier for the installing store to introduce the product information processing device, and at the same time, the user does not need to go to a cash register or the like for payment. An easy-to-use product information processing device can be provided.

According to a fifteenth aspect of the present invention, in the merchandise information processing apparatus according to any one of the second to fourteenth aspects, based on the merchandise information processed by the merchandise information processing means, It may be configured to further include purchase information recording means for recording purchase information.

According to the fifteenth aspect of the present invention, points corresponding to the price of the sold merchandise information and the like are recorded for each user as the purchase information, so that the purchase amount of the user can be adjusted. By performing various services such as discount sales of tickets and gifts of prizes, it is possible to increase the user's willingness to purchase. Further, the recording medium may be a medium in the product information processing apparatus, or may be a medium held by the user such as a point card, for example.

[0042]

Embodiments of the present invention will be described below in detail with reference to the drawings. 1 to 12 are diagrams showing an embodiment of a product sales information processing system to which the present invention is applied.

First, the configuration will be described. FIG. 1 is a diagram showing an overall configuration of a product sales information processing system 1 according to the present embodiment and conceptually showing exchange of information in the product sales information processing system 1. As shown in FIG. 1, the product sales information processing system 1 includes a sales management center B and a store A. The sales management center B and the store A are, for example, a dedicated line or an ISD
N (Integrated Services Digital Network) and other public lines, and stores A typified by convenience stores scattered in various places have music, video, games, tickets, etc. Content information is transmitted and accumulated as needed.

Further, the sales management center B is provided by CS (Comm
It is also possible to distribute various types of content information including advertising images and the like via satellite communication such as a communication satellite (communication satellite). Stores A scattered in various places are provided from a sales management center B by a dedicated antenna and a tuner. The distributed information is received and displayed on the display screen of the merchandise sales information processing terminal device 4 installed in the store to provide the visitor with the content information.

Further, sales data indicating the sales status of the product in the product sales information processing terminal device 4 installed in the store A is transmitted to the product sales information management device 3, and the store A and the sales management center B In between, sales information described later,
Various types of content information and voice data related to voice recognition dictionary learning processing are transmitted and received.

FIG. 2 is a block diagram showing the connection relationship between the sales management center B constituting the product sales information processing system 1 and the devices installed in the store A. As shown in FIG. 2, the merchandise sales information processing system 1 is different from the network 2 in that the merchandise sales information management device 3 as a network server installed in the sales management center B and the network installed in each store A A plurality of product sales information processing terminal devices 4 as clients are connected to each other. The network 2 can adopt various line forms such as a line constituted by a dedicated line, a line constituted by a public line such as ISDN, or a line constituted by wireless communication. From the viewpoint of reliability, it is preferable that the network has secured security.

Next, each device constituting the product sales information processing system 1 will be described in detail. FIG. 3 is a block diagram showing a schematic internal configuration of the product sales information management device 3 shown in FIG.

In FIG. 3, the merchandise sales information management device 3 includes a CPU 31, an input device 32, a display device 33, a communication device 34, a RAM 35, and an HD drive 36, and each unit is connected by a bus 37.

CPU (Central Processing Unit) 31
Is an application program designated from among various application programs stored in the HD drive 36 and corresponding to the merchandise sales information management device 3 and various instructions or data input from the input device 32.
In accordance with the input instructions and the input data, various processes are executed in accordance with the application program stored in the RAM 35, and the processing results are stored in the work area in the RAM 35, and stored in the display device 33. indicate. The processing result stored in the work area H
The data is stored in the storage destination in the D drive 36.

The input device 32 includes a keyboard having cursor keys, numeric input keys, various function keys, and the like, and a mouse as a pointing device. The input device 32 outputs to the CPU 31 a pressing signal of a key pressed by the keyboard. An operation signal from the mouse is output to the CPU 31.

The display device 33 is a CRT (Cathode Ray Tu).
be), composed of a liquid crystal display device or the like, and performs screen display based on display data input from the CPU 31.

The communication device 34 is a modem (MODEM: MO
dulator / DEModulator), terminal adapter (TA:
Tarminal Adapter) or a router for communicating with each of a plurality of product sales information processing terminal devices 4 connected to the network 2 via a communication line such as a telephone line, an ISDN line, or a dedicated line. Communication control. Further, by providing a satellite antenna and a decoder, satellite communication with the CS or the like as shown in FIG. 1 is possible.

The RAM (Random Access Memory) 35
It has a work area for storing designated programs, input instructions, input data, processing results, and the like.

The HD drive 36 stores a merchandise sales information management program, a server application program, a speech recognition dictionary learning processing program corresponding to the merchandise sales information management device 3, and data processed by these programs.

FIG. 4 is a schematic perspective view showing the merchandise sales information processing terminal device 4 of FIG. 2. The merchandise sales information processing terminal device 4 integrally has an upright portion 42 at the back of the upper surface of the operation console 41. It has a main body shape and is suitable as a fixture installed in a store represented by a convenience store. For example, the width and depth of the operation console 41 are 90 cm × 55 cm.
The height of the upper surface of the operation console 41 is a height near the waist of a general user, and the height up to the upper surface of the upright portion 42 is 150 c.
m.

This merchandise sales information processing terminal device 4 is the same as that shown in FIG.
Is connected to the network 2, but this network 2
May be connected to a multimedia network, a music copyright network, or the like, or may be connected to a POS system (Point Of Sales System) terminal installed in the store.

As shown in the figure, the product sales information processing terminal device 4 is provided with a touch panel 43 which also serves as a display screen on which display information such as a menu screen and content information is displayed on the upper surface of the operation console 41. Left and right microphones 44, 44, which are voice input units, a recording medium insertion / ejection unit 45 therebetween, and a cash input unit 81 are provided on the front of the standing unit 42 at the back.
And three output units 46, 47, 48 arranged in a row in the horizontal direction, and an output unit 4
8, a change discharge unit 83 is provided.

Further, in the commodity sales information processing terminal device 4, in addition to the input operation unit by the touch panel 43 on the upper surface of the operation console 41, the microphones 44, 44
, And a simple input unit comprising a recording medium input unit 45, and output units 46, 47, 48 on the front of the operation console 41.

The microphones 44, 44 may be fixed or detachable by wire or wireless. The shape of the microphones is not limited to a circle, but may be any shape.
Is provided, at least one of them is used for voice input of the customer.

The recording medium insertion / ejection unit 45 inserts a card-type recording medium such as a RAM card, an IC card, or a magnetic card, and sets it in the built-in memory card drive 416 (see FIG. 5). An insertion / ejection port for ejecting a card-type recording medium. When a card type recording medium is inserted by the user from the recording medium insertion / ejection unit 45 and set in the memory card drive 416, various types of content information such as predetermined game data and music name data written on the recording medium are written. , And new writing or rewriting of various types of content information requested by the user on the recording medium. Further, when the IC card or the magnetic card is a point card,
In order to update the points, the identification information and points unique to the point card are read, and the points are overwritten according to various kinds of content information purchased by the customer. After the reading and writing of the content information and the like are performed, the card-type recording medium is ejected.

The output units 46, 47 and 48 are, for example, in order from the left, a commodity discharge port for tickets and the like, a recording medium insertion / discharge unit for MD and the like, and a receipt discharge port. Here, the recording medium insertion / ejection unit 47 is, for example, an MD (Mini Disc).
), FD (Floppy Disk), CD-R (Compact Disc-
Recordable), CD-RW (Compact Disc-Rewritabl)
e), DVD-R (Digital Video Disc-Recordable)
), DVD-RAM (Digi-tal Video Disc-Random Ac)
This is an insertion / ejection port for setting a disk-type recording medium such as a cess memory) in a built-in disk-media drive 417 (see FIG. 5) or for discharging the set disk-type recording medium. When a disc type recording medium is inserted by the user from the recording medium insertion / ejection port 47 and set in the built-in disc medium drive 417, various contents information requested to be purchased by the user is newly written on the recording medium. After the content information has been written, the disc-type recording medium is ejected.

The cash input unit 81 is provided with, for example, a bill insertion slot and a coin insertion slot. The cash input unit 421 (see FIG. 5), which will be described later, calculates the amount of money inserted and purchases the money. Payment for the requested various content information is performed. The change discharge unit 83 is provided with the cash settlement unit 421.
It is a discharge port for discharging the change that has been settled, and is constituted by a discharge port for bills and a discharge port for coins.

The merchandise sales information processing terminal device 4 is
If installed in a convenience store open for 4 hours,
POS system terminals also operate 24 hours a day.
PO connected to OS system terminal via communication line
S management center or product sales information processing terminal 4
Is also running 24 hours a day.
For this reason, in the product sales information processing terminal device 4, menu information of a menu screen displayed on the touch panel 43, and a large product installed in the product sales information processing terminal device 4 for selling products such as games, music, videos, tickets, and the like. Various kinds of content information and the like stored in a capacity storage device (for example, a hard disk device or the like) can be rewritten in real time from the merchandise sales information management device 3 using idle time during which a user does not operate.

As a result, the merchandise sales information processing terminal device 4 can always accumulate various types of content information that meet the needs of the user, and can quickly respond to the needs of the user. Further, in this case, the merchandise sales information processing terminal device 4 always stores various types of content information that meet the needs of the user in its own large-capacity storage device.
The user can obtain desired content information more quickly than downloading from the merchandise sales information management device 3 via the network 2.

In the above, the recording medium insertion / ejection unit 4
5. The cash input unit 81, the output units 46, 47 and 48, and the change discharging unit 83 may have the opening shapes as shown in the figure, but slide-type shutters 45a and 81a as lids for opening and closing the respective openings. 46a, 47a, 48a, 83
a, respectively, and the shutters 45a, 81a,
It is desirable to control each of 46a, 47a, 48a and 83a so that they are opened only when used and closed when not in use.

On the front surface of the upright portion 42, microphones 44, 44 are provided above and below the center thereof, three or more microphones 44, 44, 44,... A plurality of parts 45 may be laid out arbitrarily such as at the center, up and down, left and right.

Further, in the present embodiment, as shown, other functional units are provided. That is, the operation console 41
A paper insertion / ejection unit 50 for a scanner 414 or a printer 415 built in the operation console 41 is provided beside the touch panel 43 on the upper surface of the touch panel 43.
Directional speakers 5 as voice response units on the left and right sides in front of
1, 51 are provided.

In the illustrated example, the paper insertion / ejection unit 50 has the insertion opening and the ejection opening arranged side by side, but the insertion opening and the ejection opening may be common. Directional speakers 51, 51
From this, a response voice corresponding to the voice input to the microphones 44, 44 is output to the user, whereby the user confirms whether or not there is no difference with the target.

The touch panel 43 is rotatable by a hinge 43a on one side as shown by an arrow, and a scanner 414 (see FIG.
(See FIG. 2) also serves as a cover for opening and closing a reading surface (not shown).

The microphone 4 is provided on the front of the upright portion 42.
A guide display section 53 located above the recording medium input section 45 between the recording medium input sections 4 and 44, an imaging section 54 in the upper center of the guide display section 53, and recommended display sections 55 on the left and right thereof are provided.

The guidance display section 53 is for promotion for guiding a specific product or various contents for sales promotion or the like, and includes a display screen for introducing product images or contents, and a space for advertisement or the like. A holder that can be used is also acceptable.

The imaging section 54 is for photographing a customer, and is formed by exposing a photographing lens section of a digital camera 407 (see FIG. 5) such as a digital still camera or a digital video camera. The imaging unit 54 captures a customer, captures the data as image data, outputs the captured data as a photograph, and stores the data for user layer analysis and crime prevention. Further, when used for photographing, it is desirable to have a function of selecting image quality, enlargement / reduction ratio, monochrome color, and the like.

The recommended display sections 55 and 55 are for introducing a specific product or information currently being hit, and may be a display screen for introducing a video or a holder for inserting a space such as a title. 55 and 55 may be different.

Note that on the front surface of the operation console 41, a spare output unit 5 is provided below the upper horizontal output unit 46, 47, 48.
6, 57 are provided.

The spare output sections 56 and 57 appear when used in accordance with the addition of other functions, and are covered with an outer cover so as not to appear as shown when unnecessary.

On the side surface of the operation console 41, a hanging portion 60 is provided at an upper portion on the front side. In the illustrated example, the hanging portion 60 is a multipurpose hook that can hold baggage such as shopping bags and umbrellas, but may have another shape.

Then, the touch panel 43, the microphone 44,
44, recording medium input unit 45, cash input unit 81, output unit 4
6, 47, 48, change discharge section 83, paper insertion / discharge section 5
0, the respective in-process display units 63, 64, 64, 65, 8 near the directional speakers 51, 51 and the imaging unit 54.
2, 66, 67, 68, 84, 70, 71, 71, 74
Is provided. This processing display section 63, 64, 6
4, 65, 82, 66, 67, 68, 84, 70, 7
Reference numerals 1, 71, and 74 indicate that each functional unit is in the process of processing, and are lamps typified by LEDs that light or blink during the process.

FIG. 5 is a diagram showing a schematic internal configuration of the commodity sales information processing terminal device 4 shown in FIG.

In FIG. 5, the merchandise sales information processing terminal device 4 includes a CPU 401, an input unit 402, a main display unit 403, a sub display unit 404, a voice recognition unit 405, a voice synthesis unit 406, a digital camera 407, and a communication control unit. 40
8, receipt issuing unit 409, ticket issuing unit 410, R
OM 411, RAM 412, HD drive 413, scanner 414, printer 415, memory card drive 4
16, disk media drive 417, cash settlement section 4
21, PDA connection part 418, and a plurality of spare drives 4
19, 419, and each part is a bus 42.
Connected by 0. The spare drive 41
9 and 419 are not particularly limited to one or two, and a plurality of spare drives 419,
419,... Can of course be provided.

The CPU 401 stores a program designated from the programs corresponding to the commodity sales information processing terminal device 4 stored in the ROM 411 or the HD drive 413 and various instructions or data input from the input unit 402 into the RAM 412. Of the RAM 412 according to the input instruction and the input data.
Various processes are executed in accordance with the programs stored therein, and the processing results are stored in the work area in the RAM 412 and displayed on the main display unit 403 and the sub display unit 404. Then, the processing result stored in the work area in the RAM 412 is stored in a predetermined storage destination in the HD drive 413.

The CPU 401 performs display processing for displaying menus and various types of content information on the main display unit 403 integrated with the touch panel 43 and processing for the sub display unit 404 (guidance display unit 53). A display process of advertisement product video for introducing specific product or various content information or video information for introducing various content information is executed. Also, the CPU 401
Is a microphone 4 by a user as a process related to voice input.
The voice recognition unit 405 recognizes input voices from the voices 4 and 44, and stores, based on the voice recognition results, various product names, various content names, instruction contents, and the like corresponding to the input voices in a voice recognition dictionary stored in the HD drive 413. A voice recognition process for analyzing based on the voice recognition result, response voice data corresponding to voice content obtained from the voice recognition result is read from a voice response file stored in the HD drive 413, and the voice synthesis unit 40
Then, a speech synthesis process for synthesizing the sound is performed in step S6.

The CPU 401 executes a card-type recording medium inserted from the recording medium insertion / ejection unit 45 or a disk type recording medium inserted from the recording medium insertion / ejection unit 47 as content sales processing related to the sale of various types of content information. A data writing process for writing various types of content information is performed on the recording medium. That is, the CPU 401
In the data writing process, the touch panel 4
3 is stored in the HD drive 413 in accordance with various content information requested to be purchased by selecting and operating from the menu displayed in 3, or various types of content information requested to be purchased by voice input from the microphones 44, 44 by the user. The data corresponding to the content information is read out, and a card-type recording medium inserted from the recording medium insertion / ejection unit 45 and set in the memory card drive 416 or a disk medium drive inserted from the recording medium insertion / ejection unit 47 is read. A process of writing the read data to the disk-type recording medium set in 417 is executed.

After selling the content in the content sales processing, the CPU 401 inserts the recording medium from the point card inserted from the recording medium insertion / ejection unit 45 or the unused point card storage unit 416a (see FIG. 5). After the points are read from the new point card conveyed to the discharge unit 45, points corresponding to the sold contents are added and a process of writing the points into the point card is executed. The point card is I
It is a card composed of a C card, a magnetic card, and the like, which accumulatively records points according to the sales amount and the like, and allows the user to receive discounts, prizes, and the like according to the accumulated points. Note that, in addition to accumulatively recording points on the point card itself, only the identification information unique to the point card is recorded on the point card.
1 transmits the identification information and the sales information to the merchandise sales information management device 3, and the points themselves may be managed by the merchandise sales information management device 3. In the present embodiment, only the former case will be described.

Further, as other processes, the CPU 401 performs a customer identification process for identifying a user from video data imaged by the digital camera 407 (imaging unit 54), menu information, games, music, video, tickets, and the like. Communication control unit 40 when downloading various content information and the like for product sales from product sales information management device 3
8, a receipt issuing process in a receipt issuing unit 409 when selling products or selling various types of content information, and a ticket issuing unit 410 when a ticket is reserved.
, An image reading process in which an image of a print surface of a photograph or a document inserted and conveyed from the insertion / ejection unit 50 is read by the scanner 414, and a printer 415 of the image data read by the scanner 414.
Settlement unit 421 that performs settlement related to print processing and sales of contents, etc. in the commodity sales information processing terminal device 4
Execute the cash settlement process in.

The input unit 402 includes a keyboard having cursor keys, numeric input keys (numeric keys), various function keys, and the like, and a mouse as a pointing device.
The CPU 401 sends a press signal of a key pressed by the keyboard.
Output to the CPU 4 and an operation signal from the mouse
Output to 01. It should be noted that since the numeric keypad is frequently input, it is always displayed on a part of the touch panel 43,
It is also possible to be able to always input. In addition, a mouse or keyboard for maintenance may be provided inside the product sales information processing terminal device 4 such as the operation console 41.

The main display unit 403 is constituted by a CRT or a color liquid crystal display device, and the display screen unit is integrally formed with the touch panel 43.
The screen is displayed based on display data (menus and various types of content information) input from.

The sub display unit 404 (guidance display unit 53)
It is constituted by a CRT or a color liquid crystal display device, etc., and performs a screen display based on display data (product information for advertisement for guiding products or various contents or video information for introducing various contents) input from the CPU 401.

The voice recognition unit 405 is connected to the microphones 44, 44, analyzes and recognizes the voice signal of the customer input from the microphones 44, 44, and recognizes the recognition result by the CPU 401.
Output to The voice synthesizing unit 406 includes speakers 51, 5
1, and synthesizes the voice of the response voice signal instructed and input from the CPU 401 and outputs the synthesized voice from the speakers 51 and 51.

The digital camera 407 is a CCD (Charge)
A built-in semiconductor imaging device such as a Coupled Device), and a photographic lens unit of an optical system composed of the imaging device and a predetermined lens group is provided in an imaging unit 5 formed in the upright part 42 of FIG.
4, an imaging area is set in a predetermined range in front of the imaging unit 54, an image is focused mainly on a customer standing in front of the product sales information processing terminal device 4, and the captured image data is Output to CPU 401.

The communication control unit 408 is connected to the network 2 shown in FIG.
Communication control for transmitting / receiving sales information, various content information, voice data related to voice recognition dictionary learning processing, etc. with the product sales information management device 3 via the network 2 in response to a communication request from 401 Has functions.

Receipt issuing section 409 issues a receipt based on sales information input from CPU 401 and a receipt issuing instruction when selling a product or selling various contents information, and transmits the issued receipt to operation console section 4 in FIG.
The paper is discharged from a receipt discharge port 48 provided in the printer 1.

The ticket issuing unit 410 issues a ticket based on the ticket information and the ticket issuing instruction input from the CPU 401 when selling the ticket, and outputs the issued ticket to the commodity discharging unit provided on the operation console 41 in FIG. Discharge from outlet 46.

The ROM (Read Only Memory) 411 stores C
The PU 401 stores a system program for controlling each unit in the product sales information processing terminal device 4 and the like. RAM 412
Has a work area for storing designated programs, input instructions, input data, processing results, and the like.

The HD drive 413 stores the menu information downloaded from the merchandise sales information management device 3 by the CPU 401 and various content information. When the menu screen display on the main display unit 403 is switched, the menu information required by the CPU 401 is stored. Is read out and when selling various content information, C
The corresponding content information is read by the PU 401. The HD drive 413 stores a sales information management table 413a for storing management information related to sales of various types of content information.
6 is shown in FIG. In the sales information management table 413a shown in FIG. 6, "content code" set for each piece of content information, "content content" indicating the content of various content information, "sale date and time" indicating the date and time of sale, It is configured to store "user information" indicating information (gender, age group, etc.) relating to the user who sold the content information and "billing information" indicating the sales amount of the sold content information in association with each other. I have.

The scanner 414 is built in the operation console 41, reads a photograph or an image of a printed surface of a document inserted and conveyed from the paper insertion / ejection unit 50 on a reading surface, and sends the read image data to the CPU 401. Output. The printer 415 is built in the operation console 41 and includes a CPU 401.
The image data input from is printed on the printing paper stored in advance and discharged from the paper insertion / discharge unit 50,
When the menu screen displayed on the touch panel 43 is operated by the user and the print output of the image content is selected, the selected image content data input from the internal hard disk device that stores the information content is stored in advance. The printing paper is printed and discharged from the paper insertion / ejection unit 50.

For a child or an elderly person who is not good at menu operations on the touch panel 43, an operation method of ordering contents using a scanner as an input tool is conceivable.

That is, the content selection operation is not performed on the touch panel 43, and an appropriate sheet corresponding to the order slip on which the content name and the like is written is inserted from the sheet insertion / ejection unit 50, and is placed on the reading surface of the scanner 414. When the sheet is conveyed, the CPU 401 invalidates the output of the image data read by the scanner 414 to the printer 415, causes the CPU 401 to read a character (character) indicating the name or the like of the content written on the order slip sheet, and reads the image. Recognize the name of the content from the character. Then, it is also possible to execute the selling process of the content corresponding to the recognized name of the content.

Thus, the product sales information processing terminal device 4 can provide a good operation environment even for children and elderly people who are not good at menu operations on the touch panel 43.

The memory card drive 416 is used by the user to insert a RAM card or IC from the recording medium insertion / ejection unit 45.
When a card-type recording medium such as a card or a magnetic card is inserted and set in the memory card drive 416, C
In response to a data read instruction input from the PU 401, various content information such as predetermined game data and music name data written on the card-type recording medium are read and output to the CPU 401, and when a purchase request is issued by a customer. An instruction to newly write or rewrite various kinds of content information to the recording medium is performed, and in response to a data rewriting instruction or data writing instruction input from the CPU 401, the CPU 401 sends the data to the card type recording medium from the HD drive 413. The content information to be read is written, and after the reading and writing of the content information are completed, the card type recording medium is ejected from the recording medium input unit 45.

When the inserted card is a point card, the points recorded on the point card are read out and output to the CPU 401, and the points are added according to the purchased contents input from the CPU 401. The points are overwritten on the point card and discharged. When an instruction to create a new point card is issued, the memory card drive 416 transports an unused point card from the unused point card storage unit 416a into the memory card drive 416, and After performing the recording process, the point card is ejected.

The disk media drive 417 is operated by the user from the recording medium insertion / ejection unit 47 to the MD, FD, C
When a disk-type recording medium such as a DR, a CD-RW, a DVD-R, and a DVD-RAM is inserted and set in the disk medium drive 417, the recording medium of various content information requested to be purchased by the user is provided. A new write or rewrite instruction is performed on the disk-type recording medium in response to a data rewrite instruction or data write instruction input from the CPU 401.
And rewriting and writing with the content information read from the HD drive 413, and after the rewriting and writing of the content information are completed, the disc type recording medium is ejected from the recording medium insertion / ejection unit 47.

The PDA connection unit 418 is connected to an input / output interface unit provided in the recording medium
A (Personal Digital Assistants), in order to execute data transmission / reception, when various devices provided in the input / output interface unit perform data transmission / reception in a non-contact type, for example, IrDA (Infrared DataAss)
An infrared communication unit for performing infrared communication conforming to an infrared communication standard according to an association, or a wireless communication unit for transmitting and receiving a predetermined wireless radio signal. When data is transmitted / received to / from the PDA by a contact type input / output interface unit, the input / output interface unit is provided on the PDA side, for example, RS232C, various SCSs.
I / F (interface), IEEE1394,
PS / 2, various PCMCIA-I / Fs, various communication I / Fs such as modular jacks, video / audio pin-type connection terminals, video / audio S-type connection terminals, and the like are provided.

Further, the PDA connection unit 418 also includes an encoder for encoding data according to the non-contact type and contact type input / output interfaces, a decoder for decoding encoded data, and the like. When the user detects that the PDA is connected to the input / output interface unit provided in the recording medium insertion / ejection unit 45 in a contact type or is ready for communication in a non-contact type, the input from the CPU 401 is performed. Information required for writing data to the PDA based on a data transmission / reception instruction with the PDA by a predetermined communication procedure (memory capacity of various recording media built in the PDA, header information of various contents, etc.) And notifies the CPU 401 of the
The various types of content information input by the user and designated by the user are transmitted to the connected PDA, and the various types of content information are written to various recording media built in the PDA. The PDA used here includes an electronic notebook used for schedule management, address management, and the like,
A portable game machine and the like can be mentioned.

The spare drives 419 and 419 are used to add other memory card drives that can use other card-type recording media and other disk media drives that can use other disk-type recording media. 4 and are provided as spare output units 56 and 57 in FIG.
Mounted on the part.

The cash settlement section 421 accounts for the cash inputted from the cash insertion section 81, performs settlement of the sold contents and the like according to the sales amount of the contents and the like inputted from the CPU 401, and has a change. Change discharge unit 8 in case
Discharge change from 3.

Next, the operation of this embodiment will be described. First, the CP in the product sales information processing terminal device 4
The display processing executed in U401 will be described based on the flowchart shown in FIG.

At normal times, the merchandise sales information processing terminal device 4 installed in the store A displays advertisements, new arrival information of content information, and the like on the sub-display unit 404, and displays the information on the screen of the main display unit 403. Also displays constantly changing content information in order to also prevent burn-in of the display screen.

In the display processing shown in FIG. 7, first, the digital camera 407 also serves as a monitoring unit, and the imaging unit 54 whose imaging lens unit is always exposed is in front of the operation console unit 41 of the commodity sales information processing terminal device 4. Is defined as an imaging range, and subject images in the imaging range are captured at predetermined time intervals. When the user approaches the imaging range in front of the operation console 41 and it is determined that the captured image captured by the imaging system of the digital camera 407 has been captured within the focusing range (steps S1 and S2), the CPU 401 determines , Read the main menu data from the HD drive 413,
The main menu display data is output to the main display unit 403 to display the main menu screen (step S3).

After displaying the main menu screen, the CPU 401
Is a touch panel 43 which is an input unit 402 by a user.
The process shifts to a state of waiting for an instruction input to the touch panel 43 or a voice input to the microphones 44, 44 as the voice recognition unit 405 (step S4), and when it is determined that the instruction input to the touch panel 43 has been performed (step S4).
5) As a process corresponding to the menu operation on the touch panel 43, the menu item displayed on the touch panel 43 instructed is detected, and the detected content is acquired (step S5). If it is determined that voice input has been performed on the microphones 44, 44, the voice recognition unit 405 performs voice recognition processing on the input voice, and obtains a voice recognition result (step S).
6).

Next, the CPU 401 determines whether or not the operation instruction content of the customer is a menu item based on the detected content of the menu item obtained in step S5 and the voice recognition result obtained in step S6 (step S7). ).
If it is a menu item, the HD drive 41 displays the next menu screen corresponding to the menu item.
3, the menu display data is read out, and the display content of the menu screen displayed on the main display unit 403 is switched (step S8). If the operation instruction content of the user is not a menu item, it is determined whether or not the operation instruction content is content information (step S9). If the content information is the content information, the content display data is read from the HD drive 413 to display a screen related to the sale of the content information, and the display content of the menu screen displayed on the main display unit 403 is switched (step S10). ).

Then, if the operation instruction content of the user is neither a menu item nor content information, or after switching the display content of the menu screen, the CPU 401 performs an “end” instruction operation on the touch panel 43 or the microphone 44, With the "end" voice input from 44,
Alternatively, it is determined whether or not the display processing for the current customer is to be ended (step S11) when the predetermined time has elapsed since the user moved out of the imaging range of the imaging unit 54 (step S11). Returning to S4, the main display unit 40 responding to the next instruction operation and voice input by the customer
The screen display switching process of No. 3 is repeatedly executed. If there is a termination instruction, the display processing is terminated.

As described above, in the merchandise sales information processing terminal device 4 of the present embodiment, the touch panel 43 integrated with the main display unit 403 is used as the operating environment of the customer.
(Input unit 402) Touch input mode and microphone 4
In addition to providing a voice input mode using the user interface 4 and 44, the user can arbitrarily select both input environments, and the display of the menu screen can be switched according to each input mode. For this reason, a more convenient input environment can be provided to the customer, and the merchandise sales information processing terminal device 4 can be provided.
May correspond to a wider age group.

Next, C in the merchandise sales information processing terminal device 4
The content sales processing executed in the PU 401 will be described based on the flowcharts shown in FIGS.

In the content sales processing shown in FIGS. 8 to 10, the CPU 401 first waits for the user to specify the content information in the display processing (step S21).
It is determined whether the write destination is a card type recording medium or a disk type recording medium based on the storage capacity of the content information or the purpose of use (step S22). If it is determined that the writing destination is a card-type recording medium, a display on the main display unit 402 and a voice synthesizing unit are provided to prompt the user to set the card-type recording medium into the recording medium insertion / ejection unit 45. Speakers 51 and 51 by voice synthesis in 406
(Step S23). If it is determined that the write destination is a disk-type recording medium, the recording medium insertion / ejection unit 4 of the disk-type recording medium
7 in order to prompt the user to set the main display unit 402
, And voice utterance from the speakers 51, 51 by voice synthesis in the voice synthesis unit 406 (step S24).

[0115] Next, the CPU 401 inserts a recording medium.
When the setting of the card type recording medium into the ejection unit 45 or the setting of the disk type recording medium into the recording medium insertion / ejection unit 47 is confirmed, the content information is written on the card type recording medium or the disk type recording medium. In order to confirm whether or not it is possible, the memory card drive 4
16 or disk media drive 417
The storage information of the card type recording medium or the disk type recording medium is read, and it is confirmed whether or not the information has been read normally (steps S25 and S26).

When the reading is not performed normally, the display on the main display unit 402 indicates that a reading error has occurred on the card-type recording medium or the disk-type recording medium and that the information cannot be written. The user is notified by voice utterance from the speakers 51, 51 by voice synthesis in the voice synthesis unit 406 (step S2).
7) The process proceeds to step S44. If the data is normally read, the read information is stored as user information in the sales information management table 413a of FIG. 6 stored in the HD drive 413 (step S28).

Next, the CPU 401 checks whether or not the corresponding content information is stored in the HD drive 413 (step S29). If the content information is stored, the CPU 401 reads the content information from the HD drive 413 and reads the content information from the memory card drive 413. The data is written on the card-type recording medium or the disk-type recording medium by the 416 or the disk medium drive 417 (step S30).
If the content information is not stored in the HD drive 413, the content information is transmitted to the communication control unit 4.
After downloading the content information from the merchandise sales information management device 3 to the HD drive 413 via the network 2 in step 08 (step S31), the content information is read out from the HD drive 413 and read from the memory card drive 416.
Alternatively, the data is written on the card type recording medium or the disk type recording medium by the disk medium drive 417 (step S30).

Next, the CPU 401 informs the main display unit 40 that the content information is being downloaded to the card type recording medium or the disk type recording medium.
The notification is made to the user by the display in 2 and the voice utterance from the speakers 51, 51 by the voice synthesis in the voice synthesis unit 406 (step S32). When it is confirmed that the writing of the content information on the card-type recording medium or the disk-type recording medium is completed (step S33), as sales information of the content information, charging information indicating a content code, a content content, a selling date and time, and a selling fee is provided. And stored in the sales information management table 413a of FIG. 6 stored in the HD drive 413 (step S
34), the sales information of the content information is transmitted to the communication control unit 4
In step S35, the information is transmitted to the merchandise sales information management device 3 via the network 2 by step 08.

Next, the main display unit 402 determines whether the settlement is to be performed at the merchandise sales information processing terminal device 4 or at a cash register.
The user is asked a question by the display in and the voice utterance from the speakers 51, 51 by voice synthesis in the voice synthesis unit 406 (step S36). Then, as a result of voice recognition for an instruction input by the touch panel 43 or voice input by the microphones 44, 44,
If it is determined that the payment method is the cashier settlement method, the process proceeds to step S37, and the merchandise sales information processing terminal device 4
If it is determined that settlement is to be performed, the process proceeds to step S41.

If it is determined that the payment by the cash register is to be performed, the CPU 401 causes the receipt issuing section 409 to issue a receipt relating to the sale of the content information, causes the receipt issuing section 409 to eject the receipt (step S37), and issues the receipt. Is notified to the user by voice utterance from the speakers 51, 51 by voice synthesis in the voice synthesis unit 406, and the lamp 66 near the receipt outlet 46 is blinked (step S38). Then C
The PU 401 takes the receipt to the cash register in the store A and instructs the main display unit 402 to pay the fee.
Is displayed to the user and voice is output from the speakers 51 and 51 by voice synthesis in the voice synthesis unit 406 to guide the user (step S39), and after confirming that the receipt is taken out from the receipt outlet 48 (step S39).
40), and proceed to step S44.

If it is determined in step S36 that payment is to be made in the merchandise sales information processing terminal device 4, the CPU 401 prompts the main display unit 40 to input cash.
2 and the voices from the speakers 51, 51 by voice synthesis in the voice synthesis unit 406 to notify the user, and the lamp 8 near the cash input unit 81.
2 is blinked (step S41). Next, after cash is inserted, the CPU 401 outputs the sales amount of the sold content information to the cash settlement unit 421 to calculate the change. If there is change (step S42),
The CPU 401 sends out the change to the main display unit 4.
At the same time, the user is notified by the display at 02 and the voice utterance from the speakers 51, 51 by the voice synthesis by the voice synthesis unit 406, and the lamp 84 near the change discharge unit 83 is blinked (step S43).

After the processing in step S43, or when it is determined in step S42 that there is no change, the CPU 401 proceeds to step S44. Incidentally, after the cash input is performed in step S41, the CPU 4
In step 01, a receipt may be issued by performing the same processing as in steps S37 and S38.

In step S44, CPU 401
Indicates that the removal of the card-type recording medium from the recording medium input unit 45 or the removal of the disk-type recording medium from the recording medium insertion / ejection unit 47 is performed by the display on the main display unit 402 and the speech synthesis by the speech synthesis unit 406. The system guides the user by voice utterance from the speakers 51 and 51, and blinks the lamps 65 and 67 near the recording medium insertion / ejection unit 45 or the recording medium insertion / ejection unit 47 (step S44).

Next, when it is confirmed that the card-type recording medium or the disk-type recording medium has been removed (step S45), the CPU 401 displays on the main display unit 402 whether or not the point of the point card is updated. Is asked to the user by voice utterance from the speakers 51, 51 by voice synthesis in the voice synthesis unit 406 (step S46). As a result of voice recognition of an instruction input through the touch panel 43 or voices input through the microphones 44 and 44, when the CPU 401 determines that the point is to be updated, the process proceeds to step S47, and when it is determined that the point is not updated. , The content sales processing ends.

If it is determined in step S46 that the point is to be updated, the CPU 401 prompts the user to set the point card into the recording medium insertion / ejection unit 45, and displays a sound on the main display unit 402 and a sound. Speakers 51 and 5 by voice synthesis in synthesis section 406
1 and flashes the lamp 65 near the recording medium insertion / ejection unit 45 (step S4).
7). Then, in step S46, when there is an instruction from the customer to create a new point card (step S48), the CPU 401 stores the unused point card 1 in the unused point card storage unit 416a.
The card is conveyed to the memory card drive 416, and points corresponding to the price of the content sold on the point card are recorded (step S49). When a point card is inserted into the recording medium insertion / ejection unit 45, the CPU 401 updates the points by adding and recording points corresponding to the price of the content sold on the point card. Yes (Step S5
0).

Then, the CPU 401 inserts the recording medium
The removal of the point card from the discharge unit 45 is guided to the user by the display on the main display unit 402 and the voice utterance from the speakers 51, 51 by the voice synthesis in the voice synthesis unit 406, and the recording medium insertion / discharge unit 45. The nearby lamp 65 blinks (step S5).
1). Then, when it is confirmed that the point card has been taken out (step S52), the content sales processing is terminated.

As described above, in the merchandise sales information processing terminal device 4 of the present embodiment, various card-type recording media and various disk-type recording media are set as sales environments for various types of content information in accordance with the specifications and contents of the content information. Since the content information can be written on the recording medium, the types of the content information to be sold can be diversified, and the opportunity for selling the content information can be improved.

In the commodity sales information processing terminal device 4, the main menu is displayed on the main display unit 403 after confirming that the image of the customer has been captured by the imaging unit 54. Display unit 4
03 can be displayed efficiently,
Power consumption can be reduced.

Further, since it is decided to issue a point card for accumulating points according to the price of the sold contents and update the points, various services corresponding to the purchase amount of the customer, for example, discount sales of tickets, The presenter can give a prize as a gift, for example, and can increase the customer's willingness to purchase.

Further, since the settlement relating to the sale of various contents is to be realized in the product sales information processing terminal device 4, the sales / payment in the product sales information processing terminal device 4 is performed by the product sales information processing terminal device 4. It can be performed separately and independently. For this reason, it is possible to reduce the work load in a cash register of a convenience store or the like in which the product sales information processing terminal device 4 is installed, and to reduce a work load in daily sales calculation and the like. At the same time, it is possible to provide an easy-to-use merchandise sales information processing terminal device 4 that does not require the customer to go to the cash register for payment.

According to the merchandise sales information processing terminal device 4 having the above-described configuration, in addition to the input operation using the touch panel 4, the following use environments can be further provided.

(1) By simple voice input, selection including purchase of various commodities including reservation and application for rewriting of game software can be performed immediately.

That is, when a customer stands in front of the product sales information processing terminal device 4 and inputs a desired product name or content information name, for example, a title of game software, into the microphones 44, 44, the input voice is input. Is the voice recognition unit 40
5, the final selection screen, that is, the game software title screen including the target game software is displayed on the main display unit 403 of the touch panel 43. Therefore, the user can immediately select the target game software by touch operation, and can also immediately apply for rewriting the game software.

When rewriting the game software, for example, a disc-type recording medium such as an MD brought in is inserted into the recording medium insertion / ejection unit 47 and rewritten by the disk media drive 417 built in the operation console 41. Thereafter, the disc-type recording medium is discharged, and the receipt is discharged from the receipt discharge port 46.

(2) Inserting a recording medium into a card-type recording medium in which code information or the like indicating content information has been written in advance
By inputting data into the discharge unit 45, purchase including reservation of various commodities, selection of various content information, and the like can be performed immediately without performing touch panel operation or voice input.

That is, the user inserts, for example, a RAM card, MD,
When a card-type recording medium such as a C-card is inserted, predetermined data indicating code information or the like indicating content information written on the card-type recording medium is read by the memory card drive 416, and the main display of the touch panel 43 is displayed. On the screen, a final selection screen, that is, a music title screen including a music piece as read data is displayed. Therefore, the user can easily apply for music purchase by touching and selecting the target music.

For writing the selected music data, for example, a disk-type recording medium such as an MD to be brought in is inserted into the recording medium insertion / ejection unit 47, and the HD data is written by the disk medium drive 417 incorporated in the operation console 41. Drive 41
3, or after being downloaded and written from the merchandise sales information management device 3 via the network 2, the disc type recording medium is discharged, and the receipt is discharged from the receipt discharge port 46.

(3) The user pulls out the microphone 44 from the front of the standing portion 42 and puts it close to the mouth to perform voice input, and does not need to make a loud voice so that others can hear the contents of the product to be purchased. It is possible to protect customer privacy.

(4) In the case of voice input, a response voice is output from the left and right directional speakers 51 and 51 on the upper surface of the operation console 41 toward the user's ear, so that order confirmation becomes easy. In addition, there is an effect that the contents of the order need not be heard by others.

(5) The image of the customer is captured by the image capturing section 54, and can be sold as a photo if necessary. Can be used for business.

(6) Guidance display section 53 on front of upright section 42
The (sub-display unit 404) and the recommendation display units 55, 55 can advertise a specific product or content information, and can also introduce the currently hit product or content information. Can be appealed to the customers, and the use form of the product sales information processing terminal device 4 can be diversified.

(7) The paper insertion / ejection port 50 on the upper surface of the operation table 41 allows insertion of a copy document or printing paper and removal of the paper after copying or printing. For this reason, the user can easily insert and discharge the paper at the time of copying and printing.

(8) Touch panel 4 on the upper surface of the operation console 41
3 is opened upward by the hinge portion 43a, the original is placed on the screen portion of the built-in scanner 414, and then copying can be performed with the touch panel 43 as a cover overlapped. The paper is ejected. For this reason, the user can easily make a copy of a double-page spread document or the like that cannot be inserted into the paper insertion / ejection opening 50.

(9) Baggage, such as shopping bags and umbrellas, held by the user can be hung on the hanging part 60 on the front side on the side of the operation console 41. Therefore, the user can easily perform various operations on the product sales information processing terminal device 4 even after shopping or when it is raining.

(10) Output units 46 (commodity discharge port), 47 (recording medium insertion / discharge unit), and 48 (receipt discharge port) are arranged in a row in the upper part on the front of the operation console 41. Since the output positions are arranged differently in the horizontal direction according to the type of the ticket or the like and various types of content information, the user can take out the output at the same height position. For this reason, the customer can easily grasp the position at which the product or various content information is taken out.

(11) Touch panel 43, microphone 44,
44, recording medium insertion / ejection unit 45, cash input unit 81, output unit 46 (product exit), recording medium insertion / ejection unit 47
(Recording medium insertion / ejection unit), 48 (receipt exit),
A display unit 63 that blinks (or lights up) when each unit is processing, corresponding to each of the change discharge unit 83, the paper insertion / discharge unit 50, the directional speakers 51, 51, and the imaging unit 54.
64, 64, 65, 82, 66, 67, 68, 84, 7
With 0, 71, 71, and 74, it is possible to notify the user that each functional unit is currently processing, and it is easy to confirm the processing operation.

(12) Recording medium insertion / ejection section 45, cash insertion section 81, output section 46 (commodity ejection port), recording medium insertion / ejection section 47 (recording medium insertion / ejection section), 48 (receipt ejection port) ), The change discharge section 83, slide type shutters 45a, 81a, 46a, 47a, 48a, 83
By providing “a” and controlling to open only when in use and close when not in use, mischief by the user can be prevented, and the function can be effectively functioned as dust prevention measures.

In the above embodiment, the microphones 44, 44, the recording medium insertion / ejection unit 45, and the cash insertion unit 8 shown in the schematic perspective view of the commodity sales information processing terminal device 4 in FIG.
1, output unit 46 (product outlet), 47 (recording medium insertion /
Discharge section), 48 (receipt discharge port), change discharge section 83,
The arrangement relationship and layout of each part of the paper insertion / ejection unit 50, the directional speakers 51, 51, and the imaging unit 54 are merely examples, and the shapes of the respective parts are also examples.
The arrangement relationship, layout, and shape of each unit can be changed in consideration of the installation environment when installing in the store A, the operability of the customer, and the like.

Also, as shown in the general perspective view of the merchandise sales information processing terminal device 4 shown in FIG. 4, the layout and shape of the operation console 41 and the upright portion 42 for determining the general appearance are also examples. Of course, various layouts and shapes can be applied in consideration of the installation environment at the time of installation in the store A, the operability of the user, and the like.

[0150] Further, each function related to the sale of various commodities and various content information shown in the general perspective view of the commodity sales information processing terminal device 4 in FIG. A part of the functions may be deleted or added or changed in consideration of operability or the like.

Further, in the above embodiment, the imaging unit 54 shown in the general perspective view of the commodity sales information processing terminal device 4 of FIG. 4 and the schematic internal configuration of FIG. 5 corresponding to the imaging unit 54 are shown. Although the digital camera 407 has been described as being used to determine the presence or absence of a customer standing in front of the product sales information processing terminal device 4, it is simply used to determine the presence or absence of a customer. In this case, the imaging unit 54 is used as a light emitting / receiving window of the infrared sensor, and the digital camera 407
May be used as an infrared transceiver.

In the above embodiment, the microphone (voice input unit) and the speaker (voice response unit) are provided separately, but a handset of a wired telephone or a wireless telephone may be provided. That is, as shown in FIG. 11 showing a modification of the product sales information processing terminal device 100 provided with the handset 49 on the right side of the operation console section 41 with respect to the product sales information processing terminal device 4 of FIG. The information processing terminal device 100 is newly provided with a handset 4 on the right side of the operation console 41 of the product sales information processing terminal device 4 shown in FIG.
9 and a hook 49a. FIG. 12 shows a schematic internal configuration of the product sales information processing terminal device 100 in this case. 12, a handset 49 includes a speech recognition unit 405 and a speech synthesis unit 406.
The voice recognition unit 405 connects the handset 49 and the microphones 44 and 44 to the voice synthesis unit 406.
Connects the handset 49 and the directional speakers 51, 51 by switching according to the state of the handset 49.

For this reason, when the handset 49 is picked up by the user, it is detected that the handset 49 has been used by the hook 49a which has been hung by the handset 49, and the microphones 44, 44 and the directional speaker 51, The voice input by 51 and the output of the response voice are switched to the handset 49 by the voice recognition unit 405 and the voice synthesis unit 406. For this reason, the customer can listen to the voice input and the response voice only with the handset 49, thereby protecting the privacy of the user. In addition, since no sound is leaked to the surroundings, the product sales information processing terminal device 100 can be used without disturbing other customers such as a convenience store where the product sales information processing terminal device 100 is installed. it can. In addition,
Although the handset 49 has been described as being provided on the right side of the operation console 41, it may be provided on the left side, on the platform of the operation console 41, on the front of the upright portion 42, or the like.

Further, in the above-described embodiment, the points have been described as being accumulated and recorded on the point card itself. However, only the identification information unique to the point card is recorded on the point card, and the CPU 401 executes the merchandise sales information management. The identification information and the sales information may be transmitted to the device 3, and the points themselves may be managed by the product sales information management device 3.

In the above embodiment, the settlement in the product sales information processing terminal device 4 has been described as being performed by cash, but may be performed by a credit card.

[0156]

According to the inventions described in claims 1, 16 and 19, since the product information can be instructed by voice, it is possible to provide a simple and convenient input environment, and to support a wider age group. Can be done.

According to the invention as set forth in claims 2, 17 and 20, since the selection instruction of the product information and the processing of the product information corresponding to the instruction content can be performed by voice, it is simple and convenient for the user. It is possible to provide a simple input environment, and to correspond to a wider age group.

According to the invention described in claims 3, 18 and 21, it is possible to efficiently display the product information only when the user uses the product information, and to efficiently process the product information. The operation in the processing device can be performed efficiently, and power consumption can be reduced.

According to the fourth, fifth and eighth aspects of the present invention, for example, a memory card or an IC
A card or the like can be used, and as a disk type recording medium, MD, FD, CD-R, CD-RW, DVD-
R, DVD-RAM, and the like can be used, and writing, rewriting, and the like of game data and music data as product information can be easily performed.

According to the sixth aspect of the present invention, various original images can be easily read in the commodity information processing apparatus, and the usability of the commodity information processing apparatus can be improved.

According to the seventh aspect of the invention, it is possible to easily print various images in the product information processing apparatus, and to improve the usability of the product information processing apparatus.

According to the ninth aspect of the present invention, the contents selected and selected by voice input and the result of extraction of the product information can be notified to the user in an easy-to-understand manner, and the age group using the product information processing apparatus can be expanded. Can be achieved.

According to the tenth aspect of the present invention, since the voice input and the response voice can be heard only by the handset, the privacy of the user can be protected, and the sound leakage can be prevented when using the product information processing apparatus. Therefore, it is possible to use the product information processing apparatus without bothering other users such as a convenience store where the product information processing apparatus is installed.

According to the eleventh aspect of the present invention, it is possible to introduce the currently hit product information, so that the shop where the product information processing apparatus is installed can appeal the hit product information to the user. This makes it possible to diversify the use form of the commodity information processing apparatus.

According to the twelfth aspect of the present invention, the PDA
(Personal Digital Assistants) and the like can read and write product information even on a recording medium built in a portable information terminal.

According to the thirteenth aspect, it is possible to read and write product information even on a recording medium built in a portable information terminal having a radio communication function such as radio waves or infrared rays. .

According to the fourteenth aspect of the present invention, it is possible to perform the settlement related to the sale of the commodity information by the settlement means, so that a commodity information processing apparatus is installed, for example, a cash register settlement in a convenience store or the like. The work load in daily sales calculation etc. is reduced, making it easier for the installing store to introduce the product information processing device, and also easy for users to use without having to go to a cash register or the like for payment. A product information processing device can be provided.

According to the fifteenth aspect of the present invention, for example, points corresponding to the price of the sold merchandise information are recorded for each user as the purchase information, so that various points corresponding to the purchase amount of the user are recorded. By performing services such as discount ticket sales and gift giveaways, it is possible to increase the user's willingness to purchase. Further, the recording medium may be a medium in the product information processing apparatus, or may be a medium held by the user such as a point card, for example.

[Brief description of the drawings]

FIG. 1 is a diagram showing an overall configuration of a product sales information processing system 1 according to an embodiment of the present invention.

FIG. 2 is a block diagram showing a connection relation between devices installed in a sales management center B and a store A which constitute the product sales information processing system 1 in FIG.

FIG. 3 is a block diagram showing a schematic internal configuration of a merchandise sales information management device 3 shown in FIG. 2;

FIG. 4 is a perspective view showing an example of a schematic external appearance of the commodity sales information processing terminal device 4 shown in FIG.

FIG. 5 is a block diagram showing a schematic internal configuration of the product sales information processing terminal device 4 shown in FIG. 4;

6 is a diagram showing an example of H in the merchandise sales information processing terminal device 4 shown in FIG.
Sales information management table 4 stored in D drive 413
FIG. 13B is a diagram showing a configuration of 13a.

7 is a diagram showing a C in the product sales information processing terminal device 4 shown in FIG. 5;
6 is a flowchart illustrating a display process performed by a PU 401.

8 is a diagram showing a C in the product sales information processing terminal device 4 shown in FIG.
6 is a flowchart showing a part of a content sales process executed by a PU 401.

FIG. 9 is a flowchart showing a part of the content selling process following FIG. 8;

FIG. 10 is a flowchart showing a part of a content sales process following FIG. 9;

FIG. 11 is a schematic perspective view showing a product sales information processing terminal device 100 which is a modification example in which a handset 49 is provided on the right side surface of the operation console 41 with respect to the product sales information processing terminal device 4 of FIG. .

12 is a merchandise sales information processing terminal device 10 shown in FIG.
FIG. 2 is a block diagram showing a schematic internal configuration of a block 0.

FIG. 13 is a diagram showing a configuration example of a menu having a conventional hierarchical structure.

FIG. 14 is a diagram illustrating an example of an initial menu screen displayed according to the example of the configuration of the menu having a hierarchical structure in FIG. 13;

FIG. 15 is a diagram showing an example of a genre selection screen displayed when “game” is selected on the screen shown in FIG. 14;

16 is a diagram showing an example of a maker selection screen displayed when “RPG” is selected on the screen shown in FIG.

17 is a diagram showing an example of a product selection screen displayed when “Company A” is selected on the screen shown in FIG. 16;

18 is a diagram showing an example of a product guidance screen displayed when “Z fantasy” is selected on the screen shown in FIG. 17;

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Merchandise sales information processing system 2 Network 3 Merchandise sales information management device 31 CPU 32 Input device 33 Display device 34 Communication device 35 RAM 36 HD drive 37 Bus 4, 100 Merchandise sales information processing terminal device 41 Operation console part 42 Standing part 43 Touch panel 44 Microphone 45 Recording medium insertion / ejection section 46 Commodity exit 47 Recording medium insertion / ejection section 48 Receipt exit 49 Handset 49a Hook 50 Paper insertion / ejection section 51 Speaker 53 Guide display section 54 Imaging section 55 Recommended display section 60 Hanging Unit 81 cash input unit 83 change discharge unit 401 CPU 402 input unit 403 main display unit 404 sub display unit 405 voice recognition unit 406 voice synthesis unit 407 digital camera 408 communication control unit 409 receipt issuing unit 410 ticket issuing unit 41 ROM 412 RAM 413 HD drive 414 scanner 415 printer 416 memory card drive 417 the disc media drive 418 PDA connection portion 419 spare drive 421 cash settlement unit 420 bus

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) G10L 15/00 G10L 3/00 551Z

Claims (21)

[Claims] 1. Product information storage means for storing various product information and identification information for identifying the various product information in association with each other, and a speech recognition dictionary corresponding to the product information and the identification information stored in the product information storage means. Voice recognition dictionary storing means for storing the voice recognition means stored in the voice recognition dictionary storage means based on the voice recognition dictionary stored in the voice recognition dictionary storage means, A product information extracting unit that analyzes the recognized voice content and extracts corresponding product information from various product information stored in the product information storage unit based on the analysis result; The processing content specified by the voice content is specified, and the product information extracted by the product information extracting means is processed based on the specified processing content. And a product information processing means. 2. An instruction selecting means for instructing and selecting various kinds of product information as well as processing contents relating to the various kinds of product information; Means, product information storage means for storing various product information and identification information for identifying the various product information in association with each other, and a speech recognition dictionary corresponding to the product information and the identification information stored in the product information storage means. Voice recognition dictionary storage means, a voice input means for inputting a user's voice, and the contents of voice input by the voice input means are recognized based on the voice recognition dictionary stored in the voice recognition dictionary storage means. A voice recognition unit that analyzes the voice content recognized by the voice recognition unit, and stores the voice content in the product information storage unit based on the analysis result. Product information extracting means for extracting corresponding product information from various product information, or extracting product information corresponding to the instruction selection content indicated and selected by the instruction selecting means from the product information storage means; An extraction result display and output unit for displaying and outputting the extraction result by the information extraction unit to the display unit; and analyzing the voice content recognized by the voice recognition unit and specifying the processing content specified by the user, or
Processing content specifying means for specifying the processing content of the product information corresponding to the instruction selection content selected and selected by the instruction selecting means; and extracting by the product information extracting means based on the processing content specified by the processing content specifying means And a product information processing means for processing and outputting the obtained product information. 3. An instruction selecting means for instructing and selecting various kinds of product information as well as processing contents relating to the various kinds of product information; Means, merchandise information storage means for storing various merchandise information and identification information for identifying the various merchandise information in association with each other, imaging means for imaging a user to output a captured image, and instruction selection by the instruction selection means Product information extraction means for extracting product information corresponding to the selected instruction content from the product information storage means, and when a user's captured image is output from the imaging means, the product information and processing content of the display means are displayed. Extraction result display output means for starting display of an instruction selection screen and displaying and outputting the extraction result by the product information extraction means to the display means A processing content specifying means for specifying the processing content of the product information corresponding to the instruction selection content specified by the instruction selecting means; and the product information extracting means based on the processing content specified by the processing content specifying means. A product information processing device, comprising: a product information processing unit that processes and outputs extracted product information. 4. The merchandise information processing means writes the merchandise information extracted by the merchandise information extracting means on a recording medium set by the user, or reads out the merchandise information written on the recording medium. 4. The commodity information processing apparatus according to claim 2, further comprising a recording medium reading unit. 5. The commodity information processing apparatus according to claim 4, wherein said recording medium reading means writes and reads the commodity information to and from a card-type or disk-type recording medium. 6. The product information processing apparatus according to claim 2, wherein said product information processing means includes image reading means for reading an image of a document set by said user. 7. The product information processing apparatus according to claim 1, wherein said product information processing means includes printing means for printing image information of the product information extracted by said product information extracting means on a predetermined printing paper. The product information processing device according to any one of the above. 8. The merchandise information processing apparatus according to claim 4, wherein said merchandise information processing means includes a plurality of said recording medium reading means respectively corresponding to different types of recording media. 9. A first voice response means for analyzing a voice content recognized by said voice recognition means and outputting a response voice such as operation guidance based on the analysis result; The product information processing apparatus according to any one of claims 1 to 8, further comprising: a second voice response unit that outputs a corresponding voice based on the extracted result of the product information. 10. The product information processing apparatus according to claim 9, wherein said voice input means, said first voice response means, and said second voice response means are provided as a handset. 11. The display device according to claim 2, wherein said display means includes: a main display section for displaying various product information and processing contents; and an auxiliary display section for displaying supplementary information for supplementing the various product information. Item 11. The product information processing apparatus according to any one of items 1 to 10. 12. The product information processing apparatus according to claim 4, wherein said recording medium reading means has an input / output interface for writing and reading product information to and from a portable information terminal. apparatus. 13. The merchandise information processing apparatus according to claim 12, wherein said recording medium reading means includes wireless communication means for transmitting and receiving merchandise information to and from said portable information terminal by radio. 14. The product information processing apparatus according to claim 1, further comprising a settlement unit for performing a settlement based on the product information processed by said product information processing unit. 15. The system according to claim 2, further comprising purchase information recording means for recording purchase information of said user based on the product information processed by said product information processing means. Product information processing equipment. 16. A step of storing various kinds of product information and identification information for identifying the various kinds of product information in association with each other; a step of storing a speech recognition dictionary corresponding to the stored product information and the identification information; Recognizing the voice content based on the voice recognition dictionary; analyzing the recognized voice content; and extracting corresponding product information from the stored various product information based on the analysis result. And a step of specifying processing content specified by the recognized voice content, and processing the extracted product information based on the specified processing content. Processing method. 17. A step of instructing and selecting processing contents relating to the various product information together with various product information, a step of appropriately switching and displaying the variously selected product information and the processing contents thereof, Storing the associated product information and identification information for identifying the various product information in association with each other; storing the speech recognition dictionary corresponding to the stored product information and identification information; and causing the user to input a voice. Recognizing the input voice content based on the stored voice recognition dictionary; analyzing the recognized voice content; and performing a response from the stored various product information based on the analysis result. Extracting the product information to be executed, or extracting the product information corresponding to the instruction selection content selected from the instruction from the stored various types of product information; Displaying the result, and analyzing the recognized voice content to specify the processing content instructed by the user, or specifying the processing content of the product information corresponding to the selected instruction content. And a step of processing and outputting the extracted product information based on the specified processing content. 18. A process for instructing and selecting processing contents relating to the various product information together with various product information, a process of appropriately switching and displaying the variously selected product information and the processing contents thereof, A step of storing in association with identification information for identifying the various types of product information, a step of imaging a user and outputting a captured image, and a step of storing the product information corresponding to the instruction selection content selected by the instruction. Extracting from the various types of product information; and, when the captured image of the user is output, starting the display of the product information and the instruction selection screen of the processing content, and displaying the extraction result; A step of specifying the processing content of the product information corresponding to the selected instruction content, and processing and outputting the extracted product information based on the specified processing content Performing a product information processing method. 19. A machine-readable recording medium storing a processing program for processing product information, comprising: a program code for storing various product information and identification information for identifying the various product information in association with each other; A program code for storing a voice recognition dictionary corresponding to the received product information and identification information; a program code for recognizing the content of the input voice based on the voice recognition dictionary; and analyzing the recognized voice content. A program code for extracting corresponding product information from the various types of stored product information based on the analysis result, and a process content specified by the recognized voice content is specified, and the specified process content is specified. And a program code for processing the extracted product information based on Machine-readable recording medium that. 20. A machine-readable recording medium storing a processing program for processing product information, the program code for instructing selection of processing contents relating to the various product information together with various product information, and the instruction code being selected. A program code for appropriately switching and displaying various types of product information and processing contents thereof; a program code for storing various types of product information in association with identification information for identifying the various types of product information; and the stored product information and identification information. A program code for storing a voice recognition dictionary corresponding to the following, a program code for inputting a user's voice, and a program code for recognizing the content of the input voice based on the stored voice recognition dictionary. Analyzes the recognized voice content, and based on the analysis result, stores the stored various product information. A program code for extracting corresponding product information from among them, or extracting product information corresponding to the selected instruction content from the stored various types of product information, and a program code for displaying the extraction result And a program code for analyzing the recognized voice content to specify the processing content specified by the user, or specifying the processing content of the product information corresponding to the specified instruction selection content. And a program code for processing and outputting the extracted product information based on the specified processing content. A machine-readable recording medium storing a processing program comprising: 21. A machine-readable recording medium storing a processing program for processing product information, the program code for instructing and selecting processing contents related to the various product information together with the various product information, A program code for appropriately switching and displaying various product information and its processing contents; a program code for storing various product information and identification information for identifying the various product information in association with each other; A program code to be output; a program code to extract product information corresponding to the selected instruction content from the stored various types of product information; and a product when the image of the user is output. A program code for starting the display of an information and processing content instruction selection screen and displaying the extraction result is displayed. A program code for specifying the processing content of the product information corresponding to the selected instruction content, and a program code for processing and outputting the extracted product information based on the specified processing content; A machine-readable recording medium storing a processing program including: