JP2009100351A - Information processing device, information processing system, and information processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processing device for acquiring recipe information from video data. <P>SOLUTION: An information processing device is provided for storage, search and display of recipe information extracted by performing image recognition processing for video data. A recipe information creation determination part 520 determines whether it is a cooking program by program information acquired by an EPG or the like. If it is a cooking program, still picture data is acquired from video data by a capture part 30. Furthermore, character recognition is carried out on the still picture data by an image recognition processing part 60. Also, a character data determination processing part determines whether the recipe information is included in character data subjected to character recognition. When character data is included, a still picture data read/write processing part 560 stores the still picture data in a storage part 40. A recipe information management data preparing part 510 also stores management information of the still picture data in the storage part 40. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an information processing device, an information processing system, and an information processing method, and more particularly to an information processing device, an information processing system, and an information processing method for extracting recipe information from video data.

Compared to cooking by yourself with reference to only recipes on paper, the amount of cooking ingredients and cooking methods are more specific for watching TV programs. There is an advantage that you can cook while.
However, in the cooking program, there is a problem that the recipe showing the actual amount of ingredients is displayed only for a very short time.

In other words, when actually creating a dish based on a cooking program, the user who is the viewer of the cooking program needs to take notes while watching or record and watch it later. . Therefore, in any case, the user must watch all the cooking programs.
This is inconvenient for users who just want to make a particular dish, because it is a waste of time.

In view of this, in a cooking program for television, a system for transmitting recipe information prepared in advance at the time of program broadcasting as character broadcast data accompanying the program has been put into practical use.
Thereby, the user can browse the recipe information converted into character information at any time while receiving the main broadcast of the cooking program in the television receiver or browsing the text broadcast data in the recorded program.

As this type of technology, referring to paragraph [0046] of Patent Document 1, a food information device for displaying a recipe is described (hereinafter referred to as Conventional Technology 1).
In the apparatus of prior art 1, in a radio wave broadcast on a television, when a broadcaster prepares in advance a food information code that is recipe information attached to a program and puts it in the blanking period of the scan line of the broadcast radio wave, The food information device of technology 1 can receive this food information code and display it electronically. Thereby, the user can browse a recipe at any time by the food information apparatus of the prior art 1.
Here, with reference to paragraph [0037] of Patent Document 1, as for the food information code of the prior art 1, character information encoded in the same manner as the above-mentioned character broadcasting, audio information encoded in ASCII code, It describes that an image coded by an image compression technique such as JPEG or JBIG is used.
JP-A-8-272808

However, in the conventional text broadcasting and the prior art 1, in order to view the recipe information attached to the program, it is necessary to prepare and insert text information as recipe information and another image in advance in the broadcast.
Moreover, the apparatus of the prior art 1 can read only the food information code distributed for the apparatus and has a problem that it is not versatile.

  This invention is made | formed in view of such a condition, and makes it a subject to eliminate the above-mentioned subject.

An information processing apparatus according to the present invention is an information processing apparatus that performs image recognition processing of video data, and includes control means for extracting cooking recipe information from the video data by the image recognition processing.
In the information processing apparatus of the present invention, the control means includes character recognition means for recognizing characters from the video data, and the character recognition means includes capture means for acquiring still image data from the video data, and the still image And image recognition means for performing character recognition using data.
The information processing apparatus according to the present invention is characterized in that the control means includes a recipe information extraction means for extracting the recipe information from the character-recognized character data.
The information processing apparatus according to the present invention is characterized in that the recipe information extraction unit includes a determination unit that determines whether to acquire the still image data from accompanying information of video data.
The information processing apparatus according to the present invention is characterized in that the recipe information extraction means includes list display means for displaying a list of the still image data.
In the information processing apparatus of the present invention, the control means includes storage means for storing accompanying information of the still image data and the video data, and the recipe information extraction means is the still image data stored in the storage means. The image recognition means comprises character recognition and search means for searching for a match with the keyword.
In the information processing apparatus according to the present invention, the storage unit is a storage unit that also stores character data of the recipe information.
In the information processing apparatus of the present invention, the recipe information extraction unit includes a recipe information management data creation unit that creates recipe information management data for the character data of the recipe information and the accompanying information and stores the recipe information in the storage unit. Features.
The information processing apparatus according to the present invention is characterized in that the search means is search means for searching the keyword also from the recipe information management data.
In the information processing apparatus according to the present invention, the video data is video data acquired from an analog broadcast or a digital broadcast, and the accompanying information of the video data is program genre information.
An information processing system according to the present invention is an information processing system including an information processing device that performs image recognition processing of video data and a terminal, and the information processing device obtains cooking recipe information from the video data by the image recognition processing. Control means for extracting, and the terminal comprises display means for displaying still image data and / or recipe information of the information processing apparatus, and network means for connecting the information processing apparatus and the terminal. Features.
In the information processing system of the present invention, the control means includes character recognition means for recognizing characters from the video data, and the character recognition means includes capture means for acquiring still image data from the video data, and the still image And image recognition means for performing character recognition using data.
In the information processing system of the present invention, the control unit includes a recipe information extraction unit that extracts the recipe information from the character-recognized character data, and the recipe information extraction unit includes the character data and video data of the recipe information. It includes a recipe information management data creating means for creating recipe information management data for the accompanying information and storing it in a storage means, and a search means for retrieving the keyword from the recipe information management data.
An information processing method of the present invention is an information processing apparatus that performs image recognition processing of video data.
Character recognition is performed from video data, and the recipe information is extracted when the character-recognized character data includes cooking recipe information.
The information processing method of the present invention is characterized in that still image data is acquired from the video data and character recognition is performed from the still image data.
The information processing method of the present invention stores the still image data, performs character recognition from the stored still image data, searches the recipe information, and displays the list.

  According to the present invention, it is possible to provide an information processing apparatus that creates recipe information from video data of a general-purpose program without using recipe information associated with broadcast radio waves in advance by using image recognition means.

<Embodiment>
(Control configuration)
Referring to FIG. 1, an information processing apparatus X according to an embodiment of the present invention is a liquid crystal television receiver, a DVD recorder, a network connection television receiver, a recipe extraction dedicated television receiver, or the like, or a PC (personal computer). A computer) video capture device and software for this device.
The information processing apparatus X includes a video reception processing unit 10, a program information acquisition unit 20, a program information analysis unit 25, a capture unit 30 (capture unit), and a storage unit 40 (storage unit) via a common bus. A recipe information creation processing unit 50, an image recognition processing unit 60 (image recognition means), a natural language processing unit 70, and a GUI processing unit 80 are provided. These components are used as control means. The capture unit 30, the image recognition processing unit 60, and the natural language processing unit 70 implement the function of character recognition means.
The information processing apparatus X includes a reconfigurable structure (reconfigurable) that actively changes the control configuration of each part for each function to be executed.

The video reception processing unit 10 includes an analog or digital tuner that receives a broadcast radio wave from an antenna, an external video input terminal, and a conversion unit that converts the broadcast radio wave and information accompanying the broadcast into digital data. .
The program information acquisition unit 20 is a part that acquires EPG (Electronic Program Guide) program information, which is information associated with broadcasting, and accompanying information such as text broadcasting.
The program information analysis unit 25 is a part that extracts necessary information from the above-mentioned program information and accompanying information such as text broadcasting.
The capture unit 30 is a part that acquires still image data that is a still image from video data that is digital data.
The storage unit 40 is a RAM, SRAM, battery backup SRAM, ROM, HDD, NAND / NOR type flash memory, an external memory card, or the like.
The recipe information creation processing unit 50 is a part that creates recipe information, a video index, and the like from the above-described video data, still image data, and accompanying information.
The image recognition processing unit 60 is a dedicated image / video processing MPU or DSP (digital signal processor) or / and OCR (Optical Character Reader, Optical Character) that performs image processing of still image data and image recognition or character recognition. (Recognition) image recognition program.
The natural language processing unit 70 is a DSP or / and a program that performs natural language processing such as extracting predetermined reserved words from character information and performing grammar / context estimation by statistical calculation or artificial intelligence processing.
The GUI processing unit 80 is a part that performs GUI (graphical user interface) processing that detects a user command from an input unit such as a button and outputs information to a display unit such as a liquid crystal panel.

The recipe information creation processing unit 50 includes a recipe information management data creation unit 510 (recipe information management data creation unit), a recipe information creation judgment unit 520 (judgment unit), and a character data judgment processing unit 540 (recipe information extraction unit). Functions of the recipe information extraction unit 550 (search means), still image data read / write processing unit 560, recipe list display processing unit 570 (list display means), and recipe information management data read processing unit 580. I have.
Each function of the recipe information creation processing unit 50 is such that a recipe information creation processing program stored in an auxiliary storage device such as a ROM or HDD by a CPU, MPU, DSP, or recipe information creation dedicated processor is a main storage device such as a RAM. It is realized by being loaded and executed.

The recipe information management data creation unit 510 is a part that creates recipe information management data that is management data of recipe information stored in the storage unit 40.
The recipe information creation determination unit 520 is a part that determines whether to create recipe information from the character information processed by the natural language processing unit 70.
The character data determination processing unit 540 is a part that determines whether character data has been acquired from the character information processed by the natural language processing unit 70.
The recipe information extraction unit 550 is a part that retrieves recipe information from the storage unit 40 based on the recipe information in the search keyword input to the GUI processing unit 80.
The still image data read / write processing unit 560 is a part that reads and writes recipe still image data with the storage unit 40.
The recipe information management data reading processing unit 580 is a database access unit that reads recipe information management data from the storage unit 40.
The recipe list display processing unit 570 is a part that creates data for searching and displaying a recipe list based on a signal from the GUI processing unit 80.

The GUI processing unit 80 includes a search keyword input processing unit 810 that is a numeric keypad, an arrow key, a touch pad, a soft keyboard, and the like, and a recipe list display reception processing unit that is a button or file menu for inputting a signal for displaying a recipe list. 820.
The GUI processing unit 80 includes a display unit such as a liquid crystal display, a plasma display panel, an organic EL panel, a liquid crystal / DLP projector, or the like that displays a recipe image and characters retrieved from the storage unit 40, a recipe list, management information, and the like. You may have.
Further, it may include a web server capable of transmitting a protocol such as http, and an interface such as a CGI (Common Gateway Interface) or Java (registered trademark) servlet corresponding to web form input, or an ASP execution function.

In the case of analog broadcasting, the accompanying information is included in the blanking period of the scanning line.
In the case of digital broadcasting, accompanying information that is directly inserted as part of the digital signal of the broadcast radio wave can be decoded.

Next, actual processing performed by the information processing apparatus X according to the embodiment of the present invention will be described in detail.
The information processing apparatus X has three functions: recipe information creation, recipe information search, and recipe list display.
Of these three functions, the recipe information creation function will be described first.

[Recipe information creation function]
With reference to FIG. 2 and FIG. 3, the recipe information creation function which is one of the functions of the information processing apparatus X according to the embodiment of the present invention will be described.
The information processing apparatus X according to the embodiment of the present invention extracts recipe information from video using image recognition, and stores the extracted recipe information in the storage unit 40 together with management information. For this reason, recipe information is acquired from video data in which character data is inserted, not from character data transmitted in advance by broadcasters as character information.
In other words, the recipe information creation function uses image recognition processing such as OCR from the video that is being broadcast to check whether character data such as telop is included, and automatically detects where character data exists. The function of capturing as still image data and saving it as recipe information is realized.
Furthermore, since the end time of the program is known from the EPG (program information) data included in the broadcast signal, the creation of the recipe information is finished at that time.
Also, recipe information management data can be created so that recipe information can be managed collectively.

The user can set in advance whether to use this recipe information creation function.
The settings are as follows: (1) The user presses the remote control button for calling the recipe information creation function in the program currently being viewed by the user. (2) The recipe information creation function is always used in the program currently being viewed. (3) When recording reservations, set to use the recipe information creation function for the recorded program (make the user point out), (4) Play the already recorded program and search for the one with recipe information (5) By using EPG data, settings such as recording all cooking programs and setting to use the recipe information creation function are detected and stored in the storage unit 40, and the following processing is performed. Can be used.

  Moreover, in the recipe creation function, recipe information can be created in real time, or recipe data can be created after video data is once stored in the storage unit 40 as in chasing playback.

(Real-time recipe information creation process)
First, with respect to recipe information creation processing for creating recipe information in real time from video data when a program is broadcast, FIG. 2 shows a control configuration when the information processing apparatus X is reconfigured during this real-time recipe information creation processing. This will be described in detail with reference to FIG. 3 of the flowchart.
When performing this recipe information creation process, the information processing apparatus X stores in the storage unit 40 that the user has made the above settings in advance, and performs the process based on this.
Further, it is assumed that the information processing apparatus X is turned on by a user or is started by a timer for scheduled recording and is in a recording start state. That is, the standby state is changed to the operating state.
Further, the information processing apparatus X assumes that an analog tuner or a digital tuner is selected for a specific channel in accordance with a signal from the user's remote controller or recording reservation information.
Under these conditions, the information processing apparatus X performs the following processing.

(Step S101)
First, in step S101, the video reception processing unit 10 performs a video data reception process in which a broadcast radio wave input from an antenna (terminal) is received by an analog tuner or a digital tuner and decoded to create video data.
Here, the video reception processing unit 10 performs video processing for noise removal such as three-dimensional Y / C separation and ghost removal on the received signal from the analog tuner, and then performs MPEG2 or H.264. It is converted into digital data by an H.264 encoder LSI or the like.
The video reception processing unit 10 generates video data by decoding the received signal from the digital tuner into data in the MPEG2 TS (Transport Stream) format.

(Step S102)
Next, in step S102, the program information acquisition unit 20 performs an EPG acquisition process for acquiring accompanying information such as EPG data and teletext data based on the video signal or TS data received by the video reception processing unit 10.
At this time, the video reception processing unit 10 acquires EPG data from the video signal received by the analog tuner within a blanking period (VBI, Vertical Blanking Interval) of the broadcast radio wave scanning line at predetermined time intervals.
The video reception processing unit 10 acquires teletext data and EPG data from the TS data received from the digital tuner at the time of decoding described above. Further, PSI (Program Specific Information), SI (Service Information), and the like, which are program information, can be referred to.
The video reception processing unit 10 can also acquire EPG data (iEPG) from a LAN terminal or the like via a network such as the Internet.
In addition to EPG, time information is acquired by time information included in a broadcast signal and NTP (Network Time Protocol) via a network. Thereby, the time of the timer of the information processing apparatus X can be set.
The accompanying information is converted into character information and used in the following steps.

The video reception processing unit 10 can also convert video input from an external input such as a composite, S terminal, D terminal, HDMI, i-link (IEEE 1394) terminal into digital data.
At this time, it is also possible to receive a signal related to the accompanying information. However, when the video from the external input is only the video and there is no accompanying information, it can be handled as video data of the cooking program by the following processing according to the setting of the information processing apparatus X.

(Step S103)
Next, in step S103, the program information analysis unit 25 performs program information extraction processing for extracting and outputting information necessary for creating recipe information from the accompanying information converted into character information.
Specifically, the program information analysis unit 25 reads information such as the genre of the program currently received by the analog or digital tuner from the EPG data converted into character data. Furthermore, the information of the teletext is read.
On this basis, the program information analysis unit 25 uses the information on the genre and the character data as character information about whether the currently received program is a cooking program, and a recipe such as a cooking corner during character broadcasting. Analyzes and outputs whether related words appear.
For this analysis, the program information analysis unit 25 cuts out and outputs only information such as the genre of the genre data program.
Note that the program information analysis unit 25 uses the natural language processing unit 70 to store predetermined reserved words (for example, “cooking”, “recipe”, “cooking”, “ It may be output by analyzing natural language processing as to whether "cooking" has occurred.
In this case, the natural language processing unit 70 relates to the recipe information by using statistical methods such as various statistical tests such as Bayesian estimation and non-parametric statistical tests of the appearance probability of reserved words in the text broadcast information. It is also possible to output an estimation result as to whether data is included.

(Step S104)
Next, in step S104, the recipe information creation determination unit 520 determines whether to actually create recipe information.
Here, it is set to use the recipe information creation function for the currently received program, and the above-mentioned natural language processing unit 70 makes a predetermined reserved word in the case of a cooking program or text broadcast data. Is included, it is determined that recipe information is to be created (Yes).
If the determination is Yes, the recipe information creation determination unit 520 advances the process to step S105.
When it is determined No, the recipe information creation determination unit 520 advances the process to step S110.

(Step S105)
Here, in step S105, the capture unit 30 performs a capture process when it is determined to create recipe information.
Specifically, during the broadcast time of the program in the above EPG program data, still image data is always created and stored from video data while recording is being performed or while video data is being reproduced. The data is stored in a primary storage memory secured in the main storage unit of the unit 40.
This still image data is created at a timing such as every frame of video data, every MPEG2 I picture (or key frame), or every predetermined time (for example, 10 seconds), and is overwritten in the primary storage memory.
However, as will be described later, the still image data in the primary storage memory can be copied and stored / saved in the auxiliary storage device of the storage unit 40 by the capture unit 30.

(Step S106)
Next, in step S <b> 106, character information analysis processing is performed by the image recognition processing unit 60 and the natural language processing unit 70.
In this step, first, the image recognition processing unit 60 performs image recognition processing such as OCR based on still image data stored in the primary storage memory.
As the image recognition processing, the image recognition processing unit 60 first divides still image data into a plurality of areas, and then performs FFT (discrete Fourier transform), wavelet transform, SVM (support vector machine), or artificial Using a technique such as a neural network, (a) in a line drawing, (b) the color is close to binary display, (c) the character with uniform shape is drawn in a grid, etc. Extract the area that has. Here, as an area where characters are actually displayed in a cooking program, recipes are often displayed at positions such as the bottom, left, and right of the screen. Therefore, this area is weighted and extracted. Also, if the video data contains data such as a time signal, a broadcast station name logo, or a digital watermark, these are not extracted.
Further, a plurality of still image data is prepared at predetermined time intervals using a ring buffer or the like, and by comparing the still image data, a process in which almost no change is handled as character data is performed. You can also. It is also possible to detect a portion where this change has not occurred in the information amount of the difference picture of the video data.

If there is an area having the character data feature amount, actual character recognition is performed on the area, and the character data is stored in the storage unit 40.
When the image recognition processing unit 60 is configured by hardware such as a plurality of DSPs, the processing can be performed at higher speed by causing each DSP to perform processing for each area described above. Thereby, real-time OCR processing in a full frame (every 1/60 seconds) is also possible.

When the image recognition processing unit 60 performs character recognition, the natural language processing unit 70 checks whether character data of recipe information exists from the recognized character data.
That is, when character data is present on still image data and a predetermined reserved word related to the recipe (for example, “g (gram)”, “salt”, “pepper”, etc.) is recognized in this character data, When the estimated value is high in the statistical estimation such as estimation, the natural language processing unit 70 confirms that the character data of the recipe information exists. In addition, when various statistical tests are performed, if the test result is a predetermined value (for example, p <0.05), it is confirmed that character data exists, and further, a p value (p-value, probability value), etc. Output statistics.
In other cases, the natural language processing unit 70 confirms that there is no character data, and outputs that effect.
Note that the image recognition processing unit 60 and the natural language processing unit 70 accumulate data related to recognition of character information analysis processing in the storage unit 40. This makes it possible to increase the accuracy when performing OCR processing or the like later.

(Step S107)
Next, in step S107, the character data determination processing unit 540 determines whether there is character data of recipe information.
Specifically, when the natural language processing unit 70 confirms that the character data of the recipe information exists in the above-described step S106, the character data determination processing unit 540 determines that the character data exists, that is, Yes. In other cases, the character data determination processing unit 540 determines that there is no character data of the recipe information, that is, No.
In the case of Yes, the character data determination processing unit 540 advances the process to step S108.
In No, the character data determination process part 540 advances a process to step S110.

(Step S108)
Next, in step S108, the still image data read / write processing unit 560 performs still image data storage processing.
In this still image data saving process, the still image data reading / writing processing unit 560 copies the still image data in the primary storage memory to an auxiliary storage device such as an HDD, a flash memory, or a memory card in the storage unit 40. Remember.
In addition, at the time of this storage, it is stored in the storage unit 40 in the same folder or associated state as recipe information management data described later.

(Step S109)
Next, in step S109, the recipe information management data creation unit 510 performs recipe information management data creation / storage processing.
Specifically, the recipe information management data creation unit 510 creates management data related to the above-described still image data and recipe information, and stores it by storing it in an auxiliary recording device such as a memory card or HDD in the storage unit 40.
As the recipe information management data, the recipe information management data creation unit 510 uses still image data management information (information specifying the still image data such as a file name, an index number, and the number of frames) stored in the storage unit 40. Create and remember.
If recording data exists, recording data management information such as the storage location and file name of the recording data file is also stored.
Furthermore, information such as the program name, program contents, and the start / end date and time of the program is created and stored from the text broadcast data and EPG data.
In addition, the character data itself of the above-recognized recipe information is also stored.

As for the character data of the recipe information described above, the character data of the recipe and information on the dish name and material name are created and stored.
For the character data of this recipe, the recipe information management data creation unit 510 determines that there has been a misrecognition in the OCR (for example, when “sugar” is recognized as “stone shabby rice” or “g” In the case of “recognized”, etc.), based on the appearance probability of the word used in the recipe accumulated in the storage unit 40, this is replaced with a word estimated to be correct and stored. It is also possible to automatically correct using the data of teletext data.
In addition, the recipe information management data creation unit 510 includes character data of recipe information and text broadcast data, and words indicating attributes of predetermined dishes stored in the storage unit 40 (for example, Italian cuisine, side dishes, low calories, low Salted food etc.) and the attribute information of the dish such as the matching rate can be stored.

Here, in an actual cooking program, when using ingredients in each cooking procedure, it is common to display a material name and a quantity of telop, and finally display all ingredients and a quantity of telop.
Therefore, by storing the displayed character data collectively for each program, it is possible to accumulate information on the material name and quantity in each procedure and the necessary material and quantity as a whole.
It is also possible to compare information between character-recognized information in each procedure and information obtained by character-recognizing the last displayed telop, and correct and store a portion of an apparent character recognition error.

Furthermore, even when the information processing apparatus X has failed and stored the above word replacement or correction, the user can use the GUI processing unit 80 to refer to still image data for correction.
This correction is stored in the storage unit 40 by the recipe information management data creation unit 510 and is referred to in subsequent character information recognition processing.

With these recipe information management data, it is possible to search for recipe information using a search keyword for a dish name, an ingredient name, etc., as will be described later.
For storing the recipe information management data for this search, it is preferable to prepare a database such as DBM or SQL in the storage unit 40 and store it in this database.

(Step S110)
Next, in step S110, the recipe information creation determination unit 520 determines whether or not to finish the recipe information creation process.
Specifically, when it is detected that the user has pressed the button on the remote controller to finish the recipe information creation, when the current time is measured and the broadcast time of the program being viewed in the above EPG data is over, The recipe information creation determination unit 520 can end the recipe information creation process, that is, determine Yes when the scheduled recording time has elapsed or when there is no input signal from the external input. In other cases, No is determined.
In the case of Yes, the recipe information creation determination unit 520 ends the recipe information creation process. As a result, the information processing apparatus X returns to the standby state.
In the case of No, the recipe information creation determination unit 520 returns the process to step S101, further receives a video signal, and acquires accompanying information.

Thus, the recipe information creation process for creating recipe information in real time is completed.
By creating the recipe information in real time in this way, the recipe information can be obtained immediately when it is desired to obtain the recipe information with the buttons on the remote controller as described above. In addition, recipe information can be created at the same time as recording the video reserved for recording. Furthermore, recipe information can be created simultaneously with recording from an external input.
Since the created recipe information stores recipe information management data and captured still image data, it can be easily called later.

(Recipe information creation process from stored video data)
Next, with reference to FIGS. 4 and 5, the recipe information creation process in the case where the video data of the program is temporarily stored in the storage unit 40 and the recipe information is extracted, such as chasing playback, will be described in detail below. .
During follow-up playback, etc., by performing recipe information creation processing, the user happened to watch the TV broadcast using the information processing device X and wanted to write down the recipe introduced in the program It can be used in some cases.

(Step S201)
First, in step S201, the video reception processing unit 10 performs video data reception processing similar to that in step S101 described above. That is, a process for decoding the received video is performed.

(Step S202)
Next, in step S202, the program information acquisition unit 20 acquires accompanying information such as EPG data and teletext data based on the video signal received by the video reception processing unit 10, as in step S102 described above.
Further, when there is no accompanying information in the video from the external input, this can also be handled as video data of the cooking program by setting as in step S102 described above.

(Step S203)
Next, in step S203, the program information analysis unit 25 extracts and outputs information necessary for creating recipe information from the accompanying information converted into character information, as in step S103 described above.

(Step S204)
Next, in step S204, the recipe information creation determination unit 520 determines whether to actually create recipe information, as in step S104 described above.
If it is determined Yes, the recipe information creation determination unit 520 advances the process to Step S205.
If it is determined No, the recipe information creation determination unit 520 advances the process to step S211.

(Step S205)
In step S205, the video reception processing unit 10 performs video data storage processing.
Here, for the video data decoded in step S201 described above, video data for a predetermined time is temporarily stored in the HDD or flash memory of the storage unit 40. The predetermined time is a default or a time set in advance by the user, such as a chasing playback time (for example, 5 minutes).
Further, the temporarily stored video data can store the decoded TS data as it is. Still image data may be stored after being converted into a data format that is easy to acquire and easy to calculate fast forward or rewind, for example, an uncompressed format or a Motion JPEG format.

(Step S206)
Next, in step S206, the capture unit 30 performs video data read processing.
Specifically, the capture unit 30 reads the above-described temporarily stored video data from the storage unit 40.
Furthermore, as in step S105 described above, still image data is created and saved in the primary storage memory secured in the main storage unit of the storage unit 40.

(Step S207)
Next, in step S207, character information analysis processing is performed by the image recognition processing unit 60 and the natural language processing unit 70, as in step S106 described above.
In this character information analysis, still image data created from the above-mentioned temporarily stored video data is used.

Furthermore, when it is detected that the user has pressed the button for calling the recipe creation process of the remote controller in the middle of the program and the still image data is analyzed, the character data of the recipe information cannot be confirmed. The video data stored temporarily is created to create still image data, and the character information analysis process is repeated.
As a result, it is possible to cope with situations such as when the user wants to save the recipe at once, but the operation of the remote controller takes time and the button press is delayed.

(Step S208)
Next, in step S208, as in step S107 described above, the character data determination processing unit 540 determines whether there is character data in the recipe information.
In the case of Yes, the character data determination processing unit 540 advances the process to step S209.
In No, the character data determination process part 540 advances a process to step S211.

(Step S209)
Next, in step S209, as in step S108 described above, the capture unit 30 performs still image data storage processing.
When still image data is created from the above-mentioned temporarily stored video data, the capture unit 30 performs still image storage processing on the still image data. Furthermore, the video data stored temporarily can be saved until a predetermined time or until the detection of a CM or a break of video depending on user settings.

(Step S210)
Next, in step S210, as in step S109 described above, the recipe information management data creation unit 510 creates and stores recipe information management data.

(Step S211)
Next, in step S211, as in step S110 described above, the recipe information creation determination unit 520 determines whether or not to finish the recipe information creation process.
In the case of Yes, the recipe information creation determination unit 520 ends the recipe information creation process. As a result, the information processing apparatus X returns to the standby state.
In the case of No, the recipe information creation determination unit 520 returns the process to step S201, further receives a video signal, and acquires accompanying information.

As described above, the video data of the program is temporarily stored in the storage unit 40, and the recipe information creation process for extracting the recipe information is completed.
In this manner, by accumulating video data of a program such as chasing playback, by extracting recipe information, as described above, it is possible to cope with a case where the user intends to quickly save the recipe. Can do.
Furthermore, since the chasing playback is normally turned on as a standard, it is possible to deal with a quick storage of recipe information even in a program that is not particularly recorded by the user.
Also, in EPG and the like, recipe information may be disclosed even for programs that are not in the genre of cooking programs (for example, news programs and shopping programs). While the user is watching this in real time, it is possible to cope with a case where the recipe telop immediately disappears when the user wants to save the recipe.

Recipe information can be created from a file recorded and stored in the HDD or the like of the storage unit 40 by the same process as the recipe information creation process from the video data once stored.
In this case, since the accompanying information such as EPG data and text broadcasting has already been stored in the storage unit 40, the processing can be started from step S206 described above.
In the case of setting (4) described above, recipe information creation processing can also be performed when the recorded file is a cooking program based on information such as a genre stored in the storage unit 40. .
Furthermore, recipe extraction can be performed even if it is not a cooking program, according to user settings.

Also, video data in MPEG2 or MPEG4 format is input to the storage unit 40 via a network such as a LAN or wireless LAN, USB, eSATA, i-link, telephone line, optical fiber, etc. The recipe information creation function can be executed.
In this case, it is also possible to start the process from the above-described step S206 without inputting incidental information such as EPG data or text broadcasting.

[Recipe information search function]
Next, a recipe information search function for searching for recipe information created in the above-described recipe information creation process will be described.
This recipe information search function uses the database storing the recipe information management data described above, and retrieves recipe information management data based on a search keyword such as an ingredient name and a dish name specified by the user and narrowing down the date and attribute. You may search directly.

It is also possible to realize a recipe information search function by performing character information analysis processing again using the information of the still image data stored in the storage unit 40 and performing a search again using the obtained character information.
That is, using a search keyword, the character recognition technology such as OCR is used from still image data as recipe information to check whether there is matching still image data. If there is matching still image data, the recipe is displayed. By doing so, the recipe information search function is realized.
Thereby, since the data accumulated in the character information recognition process stored in the storage unit 40 and the data corrected by the user can be referred to, the search accuracy can be further improved.
Hereinafter, with reference to FIG. 6 and FIG. 7, a process for realizing the recipe information search function when the character information analysis process is performed again will be described in detail.

(Step S301)
First, in step S301, the search keyword input processing unit 810 in FIG. 3 performs a search keyword receiving process.
Specifically, the search keyword input processing unit 810 of the GUI processing unit 80 displays a soft keyboard or the like on the display unit, and detects a search keyword input by a user pressing a button on the remote controller using the soft keyboard. To do.
The search keyword input processing unit 810 is displayed on a web browser such as a PC using a web server and CGI function built into the information processing apparatus X, or detecting a key press signal of a keyboard such as a USB connection. It is also possible to perform a search by detecting a keyword input by the user in a form.
In addition to this search keyword, it is possible to narrow down conditions such as “dishes name”, “broadcast date / time”, and “material”. Further, it is possible to narrow down the conditions regarding the attribute data of the recipe information management data such as “soup”, “low salt diet (salt content of 7 g or less)”, “for dinner (500 kcal or more)”, “side dish”, and “one soup”.

(Step S302)
Next, in step S302, the still image data reading / writing processing unit 560 performs still image data reading processing.
Specifically, the still image data reading / writing processing unit 560 reads the still image data stored in the above steps from the storage unit 40 one by one and sends it to the image recognition processing unit 60.
At this time, it is possible to perform processing for reading all stored still image data. However, the recipe information management data is first searched to read from still image data corresponding to a keyword having many matching characters. It is preferable.

(Step S303)
Next, in step S303, the image recognition processing unit 60 performs character information analysis processing.
In the character information recognition processing, processing equivalent to that in step S106 described above is performed on one piece of still image data read in step S302 described above.

(Step S304)
Next, the character data determination processing unit 540 determines whether the character data of the recipe information matches the search keyword.
Specifically, when the natural language processing unit 70 confirms that the character data of the recipe information exists in the above-described step S303, alignment is performed between the character data and the search keyword by dynamic programming or the like. . Furthermore, the conditions narrowed down by the user when inputting the search keyword are also matched.
As a result, when the predetermined number of characters or the number of statistically significant characters match and the conditions narrowed down by the user also match, the character data determination processing unit 540 It is determined that the still image data includes the search keyword, that is, Yes. Otherwise, the character data determination processing unit 540 determines No.
In the case of Yes, the character data determination processing unit 540 advances the processing to step S305.
In the case of No, the character data determination processing unit 540 advances the process to step S307.

(Step S305)
Here, the recipe information extraction unit 550 and the recipe information management data read processing unit 580 perform a recipe information management data extraction process.
Specifically, first, when the character data determination processing unit 540 determines in step S304 described above that the still image data includes the search keyword, the recipe information extraction unit 550 determines the recipe information of the still image data. Get management data. Also, recipe information management data stored in the memory card can be obtained. When actually reading, the recipe information extraction unit 550 specifies the index number of the still image data and acquires the recipe information management data from the storage unit 40 via the recipe information management data reading processing unit 580. .
Thereafter, the recipe information extraction unit 550 stores the still image data and the extracted data in the storage unit 40.

(Step S306)
Next, in step S306, the recipe list display processing unit 570 performs display processing for displaying the above-described still image data and the extracted data.
Specifically, in order to display the data stored in the recipe information extraction unit 550 in step S305 on the display unit, a process of creating drawing data for actually rendering (image drawing) on the display unit is performed. .
In addition, when drawing an image in the display process, a recipe information list display described later can be displayed on the display unit. In this case, the recipe list display processing unit 570 first creates display data in which still image data and extracted data are arranged. The display data is rendered by the recipe list display processing unit 570 and displayed on the display unit. At the time of display, it is possible to display thumbnails and display them in a format such as a film roll.
Further, when displaying via a web server, the recipe list display processing unit 570 creates drawing data such as thumbnail images and HTML data by a CGI program. A link for displaying a still image of a large recipe is pasted on the HTML by the user clicking on the link. In order to display a still image with a web browser, it is naturally necessary to convert the still image data into an image data format such as jpeg, GIF, or PNG that can be displayed with the web browser.

(Step S307)
In step S307, the still image data read / write processing unit 560 determines whether all the still image data related to the search result has been read.
This determination is naturally made based on the conditions narrowed down when the user search keyword is input. For example, if the user has specified a date and time, it is determined whether still image data up to this date and time has been searched. If the user has narrowed down attribute data, the still image associated with the attribute data is determined. Determine whether you searched for data only.
In the case of Yes, the still image data reading / writing processing unit 560 advances the processing to step S308.
In the case of No, the still image data reading / writing processing unit 560 returns the process to step S301.

(Step S308)
Next, in step S308, the recipe list display processing unit 570 performs a search end display process.
Specifically, characters such as “search end” are displayed on the display unit, and the number of searched still images is displayed. In addition, a dialog box or the like about whether or not to further narrow down can be displayed.
When displaying via a web server, the thumbnail image and HTML data created here are transmitted by the web server by the http protocol. By performing a search once and then transmitting at a time, it is possible to suppress display defects in the web browser when a timeout occurs during the search.
Thus, the process for realizing the recipe information search function when the character information analysis process is performed again is completed.

  Through these processes, character information analysis processing is performed again from still image data, so that characters can be recognized from analog broadcasts with poor reception status, or the same series of programs with the same character font and layout used. When the character is recognized, the recognition efficiency can be further improved. Therefore, it is possible to increase search efficiency.

If there is a high-speed image recognition processing unit 60 capable of character recognition by hardware using a plurality of DSPs as described above, it is possible to search while performing character recognition at any time. It does not have to include character data after recognition.
Thereby, the structure of the database of the memory | storage part 40 becomes simple and it can also reduce the area | region required for character data. In this case, only the information such as the broadcast date of the program can be stored in the recipe information search function.

[Recipe list display function]
Next, a recipe list display function for displaying a list of the above recipe information and recipe information management data will be described.
In the information processing apparatus X according to the embodiment of the present invention, when the user browses the stored recipe information, the recipe list is displayed using the management data, and the cooking program selected by the user is reproduced in a digest manner. Such a recipe list display function can be realized.
This recipe list display function is preferably applied to a case where recipe information is automatically accumulated as the user has set (5) with the above-described recipe information creation function.
Further, as described above, keyword search results can be displayed as a list.
Hereinafter, specific processing of the recipe information list display function will be described with reference to the functional block diagram of FIG. 8, the flowchart of FIG. 9, and the example of the list display of FIG. 10.

(Step S401)
First, in step S401, the recipe list display acceptance processing unit 820 of FIG. 3 performs a recipe list display acceptance process.
Specifically, the recipe list display acceptance processing unit 820 accepts a recipe list display when a user senses a recipe display function of the remote controller or a button press for recipe list display, or by an http request from an external device. .
At this time, if it is detected that the user has pressed the “return” button or cancel button on the remote controller, the recipe list display function is terminated.

(Step S402)
Next, in step S402, the recipe information extraction unit 550 performs a recipe information management data extraction process.
Specifically, the recipe information extraction unit 550 acquires recipe information management data from the database for all still image data. At this time, recipe information management data of still image data stored in the storage unit 40 is read via the recipe information management data reading processing unit 580. Further, it may be acquired from a memory card or the like that is the storage unit 40.
On this basis, the recipe information extraction unit 550 extracts data such as date data and title names necessary for the recipe information list display function.

(Step S403)
Next, in step S403, the recipe list display processing unit 570 performs display information creation processing for recipe information.
Specifically, display data to be actually displayed on the recipe list display processing unit 570 is created for the recipe information management data acquired in the above steps.
As the display data, the table shown in FIG. 10 can be created in actual rendering data or HTML format. In this table, it is possible to create, as display data, attributes such as names of dishes from character extraction from still image data and text broadcast information, and program titles, broadcast station names, broadcast dates, broadcast times, etc. acquired by EPG.
In addition, it is possible to create text broadcast information including cooking-related words obtained by the natural language processing unit 70 extracted from text broadcast information as display data. As a result, it is possible to compare highly reliable cooking-related information intended by the broadcaster and the cooking name obtained by character recognition.

Furthermore, in the table of FIG. 10, display data can be created for whether or not there is video data.
For example, when recipe information is created at the time of scheduled recording, display data indicating that the recorded data exists is created. Also, when there is no video data recorded due to lack of memory card or HDD capacity or deletion by the user, or when there is no video data because the recipe information was created in real time (for example, “Mix Juice” in the table of FIG. 10). In this case, display data of “none” or “still image only” is created as video data.
In addition, when only the short video data exists (for example, in the case of “green curry” in the table of FIG. 8) when the recipe information search function is used for chasing playback, etc., the amount of video data is set in units of hours and minutes. Create the display data shown.

Moreover, display data can be created also about other attributes (for example, low salt etc.) of recipe information management data by a user setting.
In addition, the above-mentioned thumbnail display data can be combined with this table.
Furthermore, according to the user's remote control operation or a request from the network, the images can be rearranged in the order of eye way, new image creation order, calorie order, category order, and the like. This rearrangement is performed when the recipe list display reception processing unit 820 detects a user operation on the GUI while performing the reception process of the recipe list display.

(Step S404)
Next, in step S404, the recipe information management data read processing unit 580 determines whether all recipe information management data has been read.
In the case of Yes, the recipe information management data reading processing unit 580 advances the process to step S405.
In the case of No, the recipe information management data reading processing unit 580 returns the process to step S401 and continues to read the recipe information management data.

(Step S405)
In step S405, the recipe list display processing unit 570 performs a recipe information list display process.
Here, as in step S308 described above, the recipe list display processing unit 570 can perform rendering using the display data created by the recipe list display processing unit 570 or output from the web server. .
Here, when the table of FIG. 10 is displayed on the GUI of the video display device and there is a lot of recipe information, it is detected that the user presses the cursor key, and the recipe list display processing unit 570 displays the scroll. Etc. can be performed.
In addition, when it is detected in this table that the user has moved the cursor and pressed the “decision” button or the like, the recipe list display processing unit 570 displays still image data related to the recipe information management data in that row.
Further, when there is video data, the video can be displayed in a small size.
When it is detected that the user has pressed the “play” button or the like while this video is displayed, the recipe list display processing unit 570 normally plays back this video on a large screen.
When this recipe information list display process ends, the process of the recipe list display function ends.

By configuring as described above, the information processing apparatus X according to the embodiment of the present invention can obtain the following effects.
First, in the prior art 1, code information added by the broadcaster, which is composed of characters, sounds or images such as a cooking menu, a material table, how to make, cooking time, cooking utensil control information, nutrition information, price, etc. is distributed. In addition, a food information device using a media medium storing the same has been provided.
However, the prior art 1 has a problem that only information distributed on the broadcaster side for the corresponding device can be used.
In the first place, the conventional technique 1 has a problem that information on recipes that the broadcaster does not include as code information cannot be used. That is, recipe information cannot be extracted by a food information device from a mere video that does not contain character information.

However, the information processing apparatus X according to the embodiment of the present invention can create recipe information from video data even in a program for which a broadcaster does not provide pre-encoded recipe information.
That is, the information processing apparatus X uses the character recognition technique to extract recipe information from the video broadcast as a cooking program. As a result, it is possible to recognize a video containing text data such as a telop in a video of a cooking program being broadcast, and to capture and save the video as a still image.
In addition, since recipe information can be created from video during real-time or chasing playback, it is possible to save the user from having to pause the video and write notes when viewing the video.
Furthermore, the information processing apparatus X automatically creates recipe information according to user settings, accumulates recipe information from the video, and can later view the cooking procedure, ingredients, and amount in a digest manner. .

For this reason, the user who is the user of the information processing apparatus X can use the recipe displayed on the video of various cooking programs distributed in general as recipe information. In addition, by inputting from an external input, video data of a program recorded by a user with a model other than the information processing apparatus X of the present invention can also be used as recipe information.
As a result, a favorite program can be selected and recipe information can be accumulated, improving the convenience for the user.

Also, by extracting only the video that contains text data and automatically saving it, a cookbook is automatically created, so you can cook without having to watch all the cooking programs. The effect that it can be obtained.
In addition, an effect of making it easy to find a recipe can be obtained by installing a function of searching for the still image data by a designated material name or cooking name.
Furthermore, by providing a function of searching for material names and cooking names as keywords, it is possible to easily find a recipe that meets the needs from a large amount of stored recipe information.
Further, since still image data is also stored at the same time, it is easy to correct even if there is an erroneous recognition based on the still image data.

  In addition, since the recipe information can be extracted in real time or without specifying genre information in the information processing apparatus X, the recipe information can be obtained from shopping programs, news programs, variety programs, etc. that are not recognized as cooking programs. Can be saved.

In the information processing apparatus X according to the embodiment of the present invention, the still image data of the recipe information is stored, but is described so as to be displayed without any particular editing.
However, when it is actually displayed using a terrestrial digital television broadcast display, a DVD recorder, or the like, it is also possible to display it after editing the recipe information and character information in combination.
Furthermore, it is also possible to draw the character information translucently and display it superimposed on the information of the still image data.

The recipe information stored in the storage unit 40 can be stored in a highly compatible text or HTML format, such as a steam oven, a liquid crystal display panel of a microwave oven, a mobile phone display, an electronic notebook, a television. It can be viewed with a John receiver.
Further, the information processing apparatus X can be stored in a storage medium such as a removable memory card, or can be transmitted / received via a network such as a LAN or a wireless LAN.

An information processing system Z that is an example of an information processing system that combines the information processing apparatus X and other devices will be described with reference to FIG.
In this information processing system Z, the information processing apparatus X includes a PC 1000 which is a general PC / AT compatible machine, and a steam oven 1500 which is a cooking device such as a steam oven or a microwave oven. (Power Line Communications) It is connected to a network 5 such as a network, a wireless LAN, a wired LAN, and a wireless USB (ultra wide band).

In the information processing system Z, the information processing apparatus X includes a web processing unit 80 and a network connection unit in the GUI processing unit 80. Therefore, the information processing apparatus X detects a request sent from the PC 1000 or the steam oven 1500 via the network 5 and transmits recipe information.
Thereby, in the PC 1000 and the steam oven 1500, the recipe information stored in the information processing apparatus X and the storage unit 40 can be browsed.
Further, the steam oven 1500 can be converted into a data format that can be easily viewed, read by this device, and used for cooking.

Further, since a television device for wireless transmission corresponding to a transmission standard of DLNA (Digital Living Network Alliance) or the like is widespread, it is possible to cook while watching the recipe by sending it.
By configuring the information processing system Z as described above, it is possible to improve user convenience when utilizing the accumulated recipe information.

Further, as described above, the information processing apparatus X according to the embodiment of the present invention stores only still image data in the storage unit 40 and does not include the character data of the recipe that has been recognized as the recipe information management data. May be.
As an example of this, it is possible to store only still image data without adding character data to the video data from the analog tuner, and to store character data with respect to the video data from the digital tuner.
This is because video data from an analog tuner may have low character recognition efficiency due to the broadcast reception status and noise. Also in this case, the user can check the contents of the program based on the EPG program information, and can cook by visually recognizing the still image data.
In addition, when the video data from the analog tuner is image-analyzed, the GUI processing unit 80 can be configured to ask the user to check and correct the character data.

As described above, since video data received from a digital tuner often creates a telop image digitally by a device on the broadcaster side, character recognition efficiency is high.
Therefore, in the information processing apparatus according to the embodiment of the present invention, when the terrestrial analog tuner and the terrestrial digital tuner can be received at the same time, the terrestrial analog broadcast and the terrestrial digital broadcast are received at the same time, and both the video data are received. It is also possible to extract recipe information by using it.
In addition, in the extraction of recipe information, it is possible to capture from terrestrial digital broadcast video, and as data to be actually recorded and saved, terrestrial analog broadcast video data with a small amount of data can be saved.

Furthermore, in the above-described configuration, it has been described that still image data is stored in the storage unit and captured based on the still image data. However, when OCR is performed in real time, character recognition is directly performed from TS data. Of course, such a configuration is also possible.
In this case, in the case of MPEG2 TS data, it is preferable that character recognition is performed using data in a portion almost including image data such as an I picture because the processing load can be reduced. It is also possible to perform character recognition while decoding other frames.

  Note that the configuration and operation of the above-described embodiment are examples, and it is needless to say that the configuration and operation can be appropriately changed and executed without departing from the gist of the present invention.

It is a block diagram which shows the control structure of the information processing apparatus X which concerns on embodiment of this invention. It is a block diagram which shows the control structure at the time of the real-time recipe information preparation which concerns on embodiment of this invention. It is a flowchart of the real-time recipe information creation process which concerns on embodiment of this invention. It is a block diagram which shows the control structure at the time of the recipe information preparation from the image | video data memorize | stored which concerns on embodiment of this invention. It is a flowchart of the recipe information creation process from the stored video data according to the embodiment of the present invention. It is a block diagram which shows the control structure in the case of performing the character information analysis process again concerning embodiment of this invention. It is a flowchart of the recipe information search function in the case of performing the character information analysis process again according to the embodiment of the present invention. It is a block diagram which shows the control structure of a recipe list display function. It is a flowchart of the recipe list display function which concerns on embodiment of this invention. It is a conceptual diagram which shows the example of the list display by the recipe list display function which concerns on embodiment of this invention. It is a block diagram of an information processing system concerning an embodiment of the invention.

Explanation of symbols

5 Network 10 Video Reception Processing Unit 20 Program Information Acquisition Unit 25 Program Information Analysis Unit 30 Capture Unit 40 Storage Unit 50 Recipe Information Creation Processing Unit 60 Image Recognition Processing Unit 70 Natural Language Processing Unit 80 GUI Processing Unit 510 Recipe Information Management Data Creation Unit 520 Recipe information creation determination unit 540 Character data determination processing unit 550 Recipe information extraction unit 560 Still image data reading / writing processing unit 570 Recipe list display processing unit 580 Recipe information management data reading processing unit 810 Search keyword input processing unit 820 Recipe list Display reception processing unit 1000 PC
1500 Steam oven X Information processing device Z Information processing system

Claims (16)

An information processing apparatus for performing image recognition processing of video data,
An information processing apparatus comprising: control means for extracting recipe information of a dish from the video data by the image recognition process. The control means includes
Character recognition means for performing character recognition from the video data,
The character recognition means includes
Capture means for acquiring still image data from the video data;
The information processing apparatus according to claim 1, further comprising: an image recognition unit that performs character recognition using the still image data. The control means includes
The information processing apparatus according to claim 2, further comprising a recipe information extraction unit that extracts the recipe information from the character data that has been character-recognized. The recipe information extracting means includes
The information processing apparatus according to claim 3, further comprising: a determination unit that determines whether to acquire the still image data from accompanying information of video data. The recipe information extracting means includes
The information processing apparatus according to claim 3, further comprising a list display unit configured to display a list of the still image data. The control means includes
Storage means for storing accompanying information of the still image data and the video data;
The recipe information extracting means includes
6. The apparatus according to claim 3, further comprising: a search unit that performs character recognition on the still image data stored in the storage unit by the image recognition unit and searches for a match with a keyword. Information processing device. The information processing apparatus according to claim 6, wherein the storage unit is a storage unit that also stores character data of the recipe information. The recipe information extracting means includes
The information processing apparatus according to claim 7, further comprising: recipe information management data creation means for creating recipe information management data for the character data of the recipe information and the accompanying information and storing the recipe information in the storage means. The information processing apparatus according to claim 8, wherein the search means is search means for searching the keyword also from the recipe information management data. The information according to any one of claims 4 to 9, wherein the video data is video data acquired from an analog broadcast or a digital broadcast, and the accompanying information of the video data is information on a program genre. Processing equipment. An information processing system comprising an information processing apparatus and a terminal for performing image recognition processing of video data,
The information processing apparatus includes:
Control means for extracting cooking recipe information from the video data by the image recognition process;
The terminal
Comprising display means for displaying still image data and / or recipe information of the information processing apparatus;
An information processing system comprising network means for connecting the information processing apparatus and the terminal. The control means includes
Character recognition means for performing character recognition from the video data,
The character recognition means includes
Capture means for acquiring still image data from the video data;
The information processing system according to claim 11, further comprising: an image recognition unit that performs character recognition using the still image data. The control means includes
A recipe information extracting means for extracting the recipe information from the character-recognized character data;
The recipe information extracting means includes
Recipe information management data creating means for creating recipe information management data and storing it in the storage means for the accompanying information of the character data and video data of the recipe information;
The information processing system according to claim 12, further comprising search means for searching for the keyword from the recipe information management data. In an information processing apparatus that performs image recognition processing of video data,
Character recognition from video data,
An information processing method comprising: extracting recipe information when character recipe data includes character recipe information. The information processing method according to claim 14, wherein still image data is acquired from the video data, and character recognition is performed from the still image data. The information processing method according to claim 15, wherein the still image data is stored, character recognition is performed from the stored still image data, the recipe information is searched and displayed as a list.

Images